2023-10-03T09:55:45.679 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T09:55:45.679 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_dparmar@teuthology --name dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --archive /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568 --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} --verbose -- /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/orig.config.yaml 2023-10-03T09:55:45.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T09:55:45.806 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} email: null first_in_suite: false job_id: '7409568' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6051 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 targets: smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPW21wSPrWg+e2zCzUBGgpqi3ldHVtstWGWks9X/CTU1m7MnklW98O/LTGyRbwvd0a4tHBLD80qAy22EnwD7iZs= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLiWOod+mpVQsSNdmAbjWWxo9+aMyr5y9bm6rTT1lFDhBsbX+PmOdU/qPDp/aq8vzVZs/2BX564XeISsneBrdw= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph.healthy: null - ceph-fuse: client.0: null - print: '**** done remount client' - cephfs_test_runner: modules: - tasks.cephfs.test_newops teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_09:48:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T09:55:45.806 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa; will attempt to use it 2023-10-03T09:55:45.807 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks 2023-10-03T09:55:45.807 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T09:55:45.808 INFO:teuthology.task.internal:Checking packages... 2023-10-03T09:55:45.834 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-03T09:55:45.834 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T09:55:45.834 INFO:teuthology.packaging:ref: None 2023-10-03T09:55:45.834 INFO:teuthology.packaging:tag: None 2023-10-03T09:55:45.835 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-03T09:55:45.835 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T09:55:45.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-03T09:55:46.051 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-03T09:55:46.052 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T09:55:46.058 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T09:55:46.059 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T09:55:46.065 INFO:teuthology.task.internal:Saving configuration 2023-10-03T09:55:46.082 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T09:55:46.088 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T09:55:46.112 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:46.371067', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPW21wSPrWg+e2zCzUBGgpqi3ldHVtstWGWks9X/CTU1m7MnklW98O/LTGyRbwvd0a4tHBLD80qAy22EnwD7iZs='} 2023-10-03T09:55:46.132 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:46.368675', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLiWOod+mpVQsSNdmAbjWWxo9+aMyr5y9bm6rTT1lFDhBsbX+PmOdU/qPDp/aq8vzVZs/2BX564XeISsneBrdw='} 2023-10-03T09:55:46.132 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T09:55:46.138 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T09:55:46.138 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['client.0'] 2023-10-03T09:55:46.139 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T09:55:46.205 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49388a7f70>, signals=[15]) 2023-10-03T09:55:46.206 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T09:55:46.213 INFO:teuthology.task.internal:Opening connections... 2023-10-03T09:55:46.213 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T09:55:46.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:55:46.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-10-03T09:55:46.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:55:46.355 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T09:55:46.362 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-03T09:55:46.385 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-03T09:55:46.385 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:55:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:55:46.446 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:55:46.446 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-03T09:55:46.471 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-03T09:55:46.493 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-03T09:55:46.494 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-10-03T09:55:46.554 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:55:46.555 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:55:46.555 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-03T09:55:46.579 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T09:55:46.587 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T09:55:46.592 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T09:55:46.592 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:55:46.594 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:55:46.613 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T09:55:46.618 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T09:55:46.619 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:55:46.654 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:55:46.685 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T09:55:46.733 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T09:55:46.748 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T09:55:46.748 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T09:55:46.748 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:55:46.749 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:55:46.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:55:46.768 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-03T09:55:46.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:55:46.769 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-03T09:55:46.827 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:55:46.828 INFO:teuthology.task.kernel:Running kernel on smithi125: 4.18.0-489.el8.x86_64 2023-10-03T09:55:46.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum install -y kernel 2023-10-03T09:55:46.829 INFO:teuthology.orchestra.run.smithi167.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:55:46.829 INFO:teuthology.task.kernel:Running kernel on smithi167: 4.18.0-489.el8.x86_64 2023-10-03T09:55:46.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2023-10-03T09:55:51.928 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T09:55:51.935 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T09:56:00.137 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T09:56:00.344 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 48 MB 00:02 2023-10-03T09:56:07.370 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-10-03T09:56:10.879 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - Extras common packages 2.1 kB/s | 6.9 kB 00:03 2023-10-03T09:56:11.230 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-03T09:56:12.397 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-03T09:56:14.467 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras 2.5 kB/s | 18 kB 00:07 2023-10-03T09:56:14.893 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2023-10-03T09:56:16.214 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-10-03T09:56:16.336 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 2.7 kB/s | 3.5 kB 00:01 2023-10-03T09:56:17.957 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-03T09:56:19.713 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:19.713 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:19.965 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:19.966 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout:Install 3 Packages 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:56:19.967 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 88 M 2023-10-03T09:56:19.968 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 96 M 2023-10-03T09:56:19.968 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-10-03T09:56:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 8.8 MB/s | 10 MB 00:01 2023-10-03T09:56:21.777 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 222 kB/s | 24 kB 00:00 2023-10-03T09:56:22.224 INFO:teuthology.orchestra.run.smithi167.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 16 MB/s | 35 MB 00:02 2023-10-03T09:56:22.974 INFO:teuthology.orchestra.run.smithi167.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 14 MB/s | 43 MB 00:02 2023-10-03T09:56:22.974 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:22.975 INFO:teuthology.orchestra.run.smithi167.stdout:Total 29 MB/s | 88 MB 00:03 2023-10-03T09:56:23.649 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-10-03T09:56:24.073 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-10-03T09:56:24.073 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-10-03T09:56:25.294 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-10-03T09:56:25.310 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:25.311 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:25.317 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-10-03T09:56:25.568 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-03T09:56:25.568 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-03T09:56:25.569 INFO:teuthology.orchestra.run.smithi125.stdout:Install 3 Packages 2023-10-03T09:56:25.570 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:56:25.570 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 88 M 2023-10-03T09:56:25.570 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 96 M 2023-10-03T09:56:25.570 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-03T09:56:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 8.2 MB/s | 10 MB 00:01 2023-10-03T09:56:28.071 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-10-03T09:56:28.576 INFO:teuthology.orchestra.run.smithi125.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 13 MB/s | 35 MB 00:02 2023-10-03T09:56:28.706 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:29.155 INFO:teuthology.orchestra.run.smithi125.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-10-03T09:56:29.155 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:29.155 INFO:teuthology.orchestra.run.smithi125.stdout:Total 25 MB/s | 88 MB 00:03 2023-10-03T09:56:29.827 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-03T09:56:30.260 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-03T09:56:30.260 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-03T09:56:31.477 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-03T09:56:31.523 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-03T09:56:32.246 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:32.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:34.295 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-03T09:56:34.787 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:38.337 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:38.720 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:42.096 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:42.441 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:58.089 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:58.466 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:58.466 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:58.466 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:59.461 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:56:59.462 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-03T09:56:59.627 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:56:59.842 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:56:59.843 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:56:59.843 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:56:59.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:56:59.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:56:59.844 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T09:56:59.844 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:56:59.844 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:00.052 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:00.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:00.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2023-10-03T09:57:00.086 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2023-10-03T09:57:00.086 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.02 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 129.el8 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Group : System Environment/Base 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 9265586 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:00.087 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Relocations : (not relocatable) 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:00.088 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:00.089 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2023-10-03T09:57:00.089 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T09:57:00.089 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:00.090 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:00.090 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:00.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:01.568 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-10-03T09:57:03.774 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-10-03T09:57:03.775 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-10-03T09:57:03.802 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.THyhnDBHbU 2023-10-03T09:57:03.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.THyhnDBHbU 2023-10-03T09:57:03.876 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.THyhnDBHbU 2023-10-03T09:57:04.018 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.THyhnDBHbU is 6KB 2023-10-03T09:57:04.065 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.THyhnDBHbU 2023-10-03T09:57:04.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:04.131 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:04.155 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:04.157 INFO:teuthology.orchestra.run.smithi167.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:04.157 INFO:teuthology.orchestra.run.smithi167.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:04.157 INFO:teuthology.orchestra.run.smithi167.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:04.157 INFO:teuthology.orchestra.run.smithi167.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:04.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:04.321 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2023-10-03T09:57:04.517 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:04.517 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:04.517 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:57:05.239 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-03T09:57:06.014 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:06.232 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:06.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:06.233 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:06.233 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:06.233 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:06.233 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T09:57:06.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi125.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:06.234 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:06.440 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:06.441 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:06.441 DEBUG:teuthology.orchestra.run.smithi125:> sudo rpm -qi grub2-tools 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Name : grub2-tools 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Epoch : 1 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Version : 2.02 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Release : 129.el8 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: x86_64 2023-10-03T09:57:06.473 INFO:teuthology.orchestra.run.smithi125.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:Group : System Environment/Base 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:Size : 9265586 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:License : GPLv3+ 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Relocations : (not relocatable) 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Vendor : CentOS 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:06.475 INFO:teuthology.orchestra.run.smithi125.stdout:Description : 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout:hardware devices. 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T09:57:06.476 INFO:teuthology.orchestra.run.smithi125.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:06.477 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:06.477 INFO:teuthology.task.kernel:Updating grub on smithi125 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:06.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:07.892 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2023-10-03T09:57:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:done 2023-10-03T09:57:10.202 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-03T09:57:10.225 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.11PkJhAY2b 2023-10-03T09:57:10.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.11PkJhAY2b 2023-10-03T09:57:10.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.11PkJhAY2b 2023-10-03T09:57:10.460 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.11PkJhAY2b is 6KB 2023-10-03T09:57:10.509 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.11PkJhAY2b 2023-10-03T09:57:10.527 DEBUG:teuthology.orchestra.run.smithi125:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:10.592 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:10.592 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:10.593 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:10.593 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:10.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:10.764 DEBUG:teuthology.orchestra.run.smithi125:> sudo shutdown -r now 2023-10-03T09:57:34.333 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T09:57:34.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T09:57:34.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:40.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T09:57:40.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T09:57:40.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:52.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-03T09:57:59.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T09:58:01.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T09:58:01.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:04.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-03T09:58:08.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T09:58:08.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:11.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T09:58:16.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T09:58:16.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:23.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T09:58:23.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:35.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-03T09:58:41.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T09:58:50.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T09:58:50.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:50.841 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-03T09:58:51.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T09:58:51.118 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:58:51.118 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-03T09:58:51.136 INFO:teuthology.orchestra.run.smithi167.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:58:51.136 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:58:51.136 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:58:51.136 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:58:52.138 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T09:58:52.138 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:58:52.221 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-10-03T09:58:52.232 DEBUG:teuthology.parallel:result is None 2023-10-03T09:58:56.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T09:58:56.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:57.663 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-03T09:58:58.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T09:58:58.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:58:58.650 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-03T09:58:58.709 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:58:58.709 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:58:58.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:58:58.709 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:58:59.710 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T09:58:59.710 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:58:59.774 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2023-10-03T09:58:59.790 DEBUG:teuthology.parallel:result is None 2023-10-03T09:58:59.790 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T09:58:59.797 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T09:58:59.798 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:58:59.800 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:58:59.824 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T09:58:59.854 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T09:58:59.860 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T09:58:59.860 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:58:59.863 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:58:59.907 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T09:58:59.914 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T09:58:59.914 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:58:59.945 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:58:59.975 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:59.982 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:59.985 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:59.994 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:59.995 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T09:59:00.002 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T09:59:00.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:00.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:00.065 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T09:59:00.074 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T09:59:00.074 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:00.097 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:00.125 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:00.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:00.250 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:00.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:00.377 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T09:59:00.377 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:00.443 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:00.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:00.541 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:00.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:00.672 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T09:59:00.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:00.741 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-10-03T09:59:00.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-10-03T09:59:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:00.844 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:01.318 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T09:59:01.326 INFO:teuthology.task.internal:Starting timer... 2023-10-03T09:59:01.326 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T09:59:01.335 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T09:59:01.343 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-03T09:59:01.343 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2023-10-03T09:59:01.430 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2023-10-03T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2023-10-03T09:59:01.507 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2023-10-03T09:59:01.508 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T09:59:01.509 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2023-10-03T09:59:01.546 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2023-10-03T09:59:01.546 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2023-10-03T09:59:01.575 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2023-10-03T09:59:01.575 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi125.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2023-10-03T09:59:01.575 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:01.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:01.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:01.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:01.644 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T09:59:01.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:01.682 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:01.712 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T09:59:01.722 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-03T09:59:01.722 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T09:59:01.738 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T09:59:01.739 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi125.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T10:06:20.683 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-10-03T10:06:20.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T10:06:20.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:20.756 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-03T10:06:20.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T10:06:20.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T10:06:20.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:20.903 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-03T10:06:20.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-03T10:06:20.976 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T10:06:20.988 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T10:06:20.988 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:20.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:20.992 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:20.992 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:21.023 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:21.038 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:21.051 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:21.066 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2023-10-03T10:06:21.115 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2023-10-03T10:06:21.129 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:21.133 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2023-10-03T10:06:21.142 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2023-10-03T10:06:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:21.174 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:21.208 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-03T10:06:21.211 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:21.212 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-03T10:06:21.212 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.212 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.212 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.212 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.231 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-10-03T10:06:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-10-03T10:06:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:21.236 INFO:teuthology.run_tasks:Running task install... 2023-10-03T10:06:21.244 DEBUG:teuthology.task.install:project ceph 2023-10-03T10:06:21.245 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-03T10:06:21.245 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:06:21.245 INFO:teuthology.task.install:Using flavor: default 2023-10-03T10:06:21.250 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:06:21.250 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-03T10:06:21.251 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:21.251 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:21.251 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:21.251 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:21.251 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:21.251 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:21.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:21.253 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:21.253 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:21.253 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:21.254 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:21.254 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:21.254 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:21.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:21.464 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:21.464 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:21.575 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:21.576 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:21.588 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:21.589 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:06:21.589 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:21.622 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:21.622 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:21.622 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:21.623 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:21.623 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:21.623 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:21.623 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:21.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:21.743 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:21.743 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:06:21.743 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:21.770 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:21.773 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:21.773 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:21.773 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:21.773 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:21.773 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:21.773 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:21.774 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:21.836 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2023-10-03T10:06:21.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2023-10-03T10:06:21.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:21.922 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:21.988 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-10-03T10:06:21.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-10-03T10:06:22.108 INFO:teuthology.orchestra.run.smithi167.stdout:76 files removed 2023-10-03T10:06:22.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:22.259 INFO:teuthology.orchestra.run.smithi125.stdout:76 files removed 2023-10-03T10:06:22.288 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:22.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 212 kB/s | 76 kB 00:00 2023-10-03T10:06:22.958 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 283 kB/s | 76 kB 00:00 2023-10-03T10:06:23.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2023-10-03T10:06:23.360 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 42 kB/s | 15 kB 00:00 2023-10-03T10:06:23.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 3.8 kB/s | 1.4 kB 00:00 2023-10-03T10:06:23.743 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2023-10-03T10:06:26.116 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T10:06:26.351 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T10:06:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-10-03T10:06:34.727 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-10-03T10:06:41.600 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-10-03T10:06:41.760 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras 99 kB/s | 18 kB 00:00 2023-10-03T10:06:41.926 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - Extras common packages 46 kB/s | 6.9 kB 00:00 2023-10-03T10:06:42.094 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras common packages 43 kB/s | 6.9 kB 00:00 2023-10-03T10:06:42.727 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 8 - PowerTools 9.9 MB/s | 6.5 MB 00:00 2023-10-03T10:06:42.854 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:06:44.121 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:06:44.247 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:06:45.073 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-03T10:06:45.855 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-03T10:06:48.923 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 414 kB/s | 24 kB 00:00 2023-10-03T10:06:49.714 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-10-03T10:06:53.126 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:06:53.127 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:06:53.151 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:06:53.152 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:06:53.153 INFO:teuthology.orchestra.run.smithi125.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:06:53.154 INFO:teuthology.orchestra.run.smithi125.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:06:53.356 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:06:53.368 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:06:53.369 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:06:53.370 INFO:teuthology.orchestra.run.smithi125.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:06:53.371 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:06:53.372 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:06:53.373 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:06:53.374 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:06:53.375 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:06:53.377 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout:Install 108 Packages 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 14 Packages 2023-10-03T10:06:53.378 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:06:53.379 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 200 M 2023-10-03T10:06:53.379 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-03T10:06:53.910 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:06:53.911 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:06:53.935 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:06:53.936 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:06:53.936 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:06:53.937 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:06:54.145 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:06:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:06:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:06:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:06:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:06:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:06:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:06:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:06:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:06:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:06:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout:Install 108 Packages 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 14 Packages 2023-10-03T10:06:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:06:54.168 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 200 M 2023-10-03T10:06:54.168 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-10-03T10:06:54.274 INFO:teuthology.orchestra.run.smithi125.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 29 kB/s | 6.4 kB 00:00 2023-10-03T10:06:54.716 INFO:teuthology.orchestra.run.smithi125.stdout:(2/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 9.1 MB/s | 6.1 MB 00:00 2023-10-03T10:06:54.966 INFO:teuthology.orchestra.run.smithi125.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 9.8 MB/s | 2.4 MB 00:00 2023-10-03T10:06:55.199 INFO:teuthology.orchestra.run.smithi167.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 23 kB/s | 6.4 kB 00:00 2023-10-03T10:06:55.199 INFO:teuthology.orchestra.run.smithi125.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 6.9 MB/s | 1.6 MB 00:00 2023-10-03T10:06:55.319 INFO:teuthology.orchestra.run.smithi125.stdout:(5/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 871 kB/s | 910 kB 00:01 2023-10-03T10:06:55.707 INFO:teuthology.orchestra.run.smithi167.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.7 MB/s | 910 kB 00:00 2023-10-03T10:06:55.783 INFO:teuthology.orchestra.run.smithi125.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 14 MB/s | 24 MB 00:01 2023-10-03T10:06:56.816 INFO:teuthology.orchestra.run.smithi167.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 2.2 MB/s | 2.4 MB 00:01 2023-10-03T10:06:56.934 INFO:teuthology.orchestra.run.smithi125.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 10 MB/s | 12 MB 00:01 2023-10-03T10:06:57.025 INFO:teuthology.orchestra.run.smithi125.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 281 kB/s | 26 kB 00:00 2023-10-03T10:06:57.134 INFO:teuthology.orchestra.run.smithi125.stdout:(9/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 2.6 MB/s | 5.0 MB 00:01 2023-10-03T10:06:57.226 INFO:teuthology.orchestra.run.smithi125.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 279 kB/s | 25 kB 00:00 2023-10-03T10:06:57.333 INFO:teuthology.orchestra.run.smithi167.stdout:(4/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 2.5 MB/s | 6.1 MB 00:02 2023-10-03T10:06:57.493 INFO:teuthology.orchestra.run.smithi125.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 3.0 MB/s | 824 kB 00:00 2023-10-03T10:06:57.585 INFO:teuthology.orchestra.run.smithi125.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.9 MB/s | 174 kB 00:00 2023-10-03T10:06:57.677 INFO:teuthology.orchestra.run.smithi125.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.4 MB/s | 131 kB 00:00 2023-10-03T10:06:57.844 INFO:teuthology.orchestra.run.smithi125.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 2.9 MB/s | 493 kB 00:00 2023-10-03T10:06:57.925 INFO:teuthology.orchestra.run.smithi167.stdout:(5/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 8.0 MB/s | 24 MB 00:03 2023-10-03T10:06:57.966 INFO:teuthology.orchestra.run.smithi167.stdout:(6/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 1.4 MB/s | 1.6 MB 00:01 2023-10-03T10:06:58.317 INFO:teuthology.orchestra.run.smithi167.stdout:(7/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 5.1 MB/s | 5.0 MB 00:00 2023-10-03T10:06:58.426 INFO:teuthology.orchestra.run.smithi167.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 237 kB/s | 26 kB 00:00 2023-10-03T10:06:59.094 INFO:teuthology.orchestra.run.smithi125.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 3.0 MB/s | 3.8 MB 00:01 2023-10-03T10:06:59.170 INFO:teuthology.orchestra.run.smithi125.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 602 kB/s | 45 kB 00:00 2023-10-03T10:06:59.245 INFO:teuthology.orchestra.run.smithi125.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.3 MB/s | 99 kB 00:00 2023-10-03T10:06:59.425 INFO:teuthology.orchestra.run.smithi125.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.2 MB/s | 215 kB 00:00 2023-10-03T10:06:59.645 INFO:teuthology.orchestra.run.smithi125.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 1.7 MB/s | 390 kB 00:00 2023-10-03T10:06:59.854 INFO:teuthology.orchestra.run.smithi125.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 369 kB 00:00 2023-10-03T10:06:59.936 INFO:teuthology.orchestra.run.smithi125.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.4 MB/s | 114 kB 00:00 2023-10-03T10:06:59.988 INFO:teuthology.orchestra.run.smithi125.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.7 MB/s | 88 kB 00:00 2023-10-03T10:07:00.017 INFO:teuthology.orchestra.run.smithi167.stdout:(9/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 8.8 MB/s | 18 MB 00:02 2023-10-03T10:07:00.084 INFO:teuthology.orchestra.run.smithi167.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 385 kB/s | 25 kB 00:00 2023-10-03T10:07:00.251 INFO:teuthology.orchestra.run.smithi167.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 4.8 MB/s | 824 kB 00:00 2023-10-03T10:07:00.326 INFO:teuthology.orchestra.run.smithi167.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.3 MB/s | 174 kB 00:00 2023-10-03T10:07:00.402 INFO:teuthology.orchestra.run.smithi167.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.7 MB/s | 131 kB 00:00 2023-10-03T10:07:00.502 INFO:teuthology.orchestra.run.smithi167.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 4.8 MB/s | 493 kB 00:00 2023-10-03T10:07:01.028 INFO:teuthology.orchestra.run.smithi167.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 7.2 MB/s | 3.8 MB 00:00 2023-10-03T10:07:01.103 INFO:teuthology.orchestra.run.smithi167.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 602 kB/s | 45 kB 00:00 2023-10-03T10:07:01.195 INFO:teuthology.orchestra.run.smithi167.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.1 MB/s | 99 kB 00:00 2023-10-03T10:07:01.204 INFO:teuthology.orchestra.run.smithi125.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 3.0 MB/s | 3.7 MB 00:01 2023-10-03T10:07:01.253 INFO:teuthology.orchestra.run.smithi167.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 3.6 MB/s | 215 kB 00:00 2023-10-03T10:07:01.297 INFO:teuthology.orchestra.run.smithi125.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.8 MB/s | 173 kB 00:00 2023-10-03T10:07:01.345 INFO:teuthology.orchestra.run.smithi167.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 4.2 MB/s | 390 kB 00:00 2023-10-03T10:07:01.389 INFO:teuthology.orchestra.run.smithi125.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 266 kB/s | 24 kB 00:00 2023-10-03T10:07:01.437 INFO:teuthology.orchestra.run.smithi167.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 3.9 MB/s | 369 kB 00:00 2023-10-03T10:07:01.504 INFO:teuthology.orchestra.run.smithi167.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 114 kB 00:00 2023-10-03T10:07:01.588 INFO:teuthology.orchestra.run.smithi167.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-10-03T10:07:02.055 INFO:teuthology.orchestra.run.smithi167.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 7.9 MB/s | 3.7 MB 00:00 2023-10-03T10:07:02.130 INFO:teuthology.orchestra.run.smithi167.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.3 MB/s | 173 kB 00:00 2023-10-03T10:07:02.197 INFO:teuthology.orchestra.run.smithi167.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 366 kB/s | 24 kB 00:00 2023-10-03T10:07:02.405 INFO:teuthology.orchestra.run.smithi125.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 3.1 MB/s | 3.1 MB 00:01 2023-10-03T10:07:02.573 INFO:teuthology.orchestra.run.smithi167.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 8.3 MB/s | 3.1 MB 00:00 2023-10-03T10:07:03.156 INFO:teuthology.orchestra.run.smithi125.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 8.4 MB/s | 52 MB 00:06 2023-10-03T10:07:03.473 INFO:teuthology.orchestra.run.smithi125.stdout:(28/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 2.2 MB/s | 18 MB 00:08 2023-10-03T10:07:03.498 INFO:teuthology.orchestra.run.smithi125.stdout:(29/122): ceph-mgr-modules-core-16.2.14-44.geeb 716 kB/s | 244 kB 00:00 2023-10-03T10:07:03.506 INFO:teuthology.orchestra.run.smithi167.stdout:(27/122): ceph-mgr-diskprediction-local-16.2.14 9.2 MB/s | 8.6 MB 00:00 2023-10-03T10:07:03.539 INFO:teuthology.orchestra.run.smithi125.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 359 kB/s | 15 kB 00:00 2023-10-03T10:07:03.557 INFO:teuthology.orchestra.run.smithi125.stdout:(31/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 328 kB/s | 27 kB 00:00 2023-10-03T10:07:03.565 INFO:teuthology.orchestra.run.smithi167.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 4.1 MB/s | 244 kB 00:00 2023-10-03T10:07:03.632 INFO:teuthology.orchestra.run.smithi167.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 411 kB/s | 27 kB 00:00 2023-10-03T10:07:03.699 INFO:teuthology.orchestra.run.smithi167.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 223 kB/s | 15 kB 00:00 2023-10-03T10:07:04.349 INFO:teuthology.orchestra.run.smithi125.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 404 kB/s | 320 kB 00:00 2023-10-03T10:07:04.382 INFO:teuthology.orchestra.run.smithi125.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 817 kB/s | 688 kB 00:00 2023-10-03T10:07:04.449 INFO:teuthology.orchestra.run.smithi167.stdout:(31/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 1.8 MB/s | 12 MB 00:06 2023-10-03T10:07:04.516 INFO:teuthology.orchestra.run.smithi125.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-03T10:07:04.541 INFO:teuthology.orchestra.run.smithi125.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-10-03T10:07:04.633 INFO:teuthology.orchestra.run.smithi167.stdout:(32/122): bison-3.0.4-10.el8.x86_64.rpm 737 kB/s | 688 kB 00:00 2023-10-03T10:07:04.708 INFO:teuthology.orchestra.run.smithi125.stdout:(36/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-10-03T10:07:04.742 INFO:teuthology.orchestra.run.smithi125.stdout:(37/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-10-03T10:07:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-03T10:07:04.975 INFO:teuthology.orchestra.run.smithi167.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-10-03T10:07:04.975 INFO:teuthology.orchestra.run.smithi125.stdout:(38/122): ceph-mgr-diskprediction-local-16.2.14 3.3 MB/s | 8.6 MB 00:02 2023-10-03T10:07:05.134 INFO:teuthology.orchestra.run.smithi167.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.6 MB/s | 259 kB 00:00 2023-10-03T10:07:05.159 INFO:teuthology.orchestra.run.smithi167.stdout:(36/122): flex-2.6.1-9.el8.x86_64.rpm 451 kB/s | 320 kB 00:00 2023-10-03T10:07:05.217 INFO:teuthology.orchestra.run.smithi125.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 9.3 MB/s | 4.7 MB 00:00 2023-10-03T10:07:05.284 INFO:teuthology.orchestra.run.smithi167.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-03T10:07:05.342 INFO:teuthology.orchestra.run.smithi125.stdout:(40/122): openblas-threads-0.3.15-4.el8.x86_64. 8.1 MB/s | 4.9 MB 00:00 2023-10-03T10:07:05.367 INFO:teuthology.orchestra.run.smithi125.stdout:(41/122): python3-jsonpatch-1.21-2.el8.noarch.r 68 kB/s | 27 kB 00:00 2023-10-03T10:07:05.393 INFO:teuthology.orchestra.run.smithi125.stdout:(42/122): python3-jsonpointer-1.10-11.el8.noarc 114 kB/s | 20 kB 00:00 2023-10-03T10:07:05.468 INFO:teuthology.orchestra.run.smithi125.stdout:(43/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:05.493 INFO:teuthology.orchestra.run.smithi125.stdout:(44/122): python3-markupsafe-0.23-19.el8.x86_64 308 kB/s | 39 kB 00:00 2023-10-03T10:07:05.602 INFO:teuthology.orchestra.run.smithi125.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-03T10:07:05.628 INFO:teuthology.orchestra.run.smithi125.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2023-10-03T10:07:05.745 INFO:teuthology.orchestra.run.smithi125.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 730 kB/s | 103 kB 00:00 2023-10-03T10:07:05.751 INFO:teuthology.orchestra.run.smithi167.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 8.0 MB/s | 4.7 MB 00:00 2023-10-03T10:07:05.770 INFO:teuthology.orchestra.run.smithi125.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 891 kB/s | 126 kB 00:00 2023-10-03T10:07:05.827 INFO:teuthology.orchestra.run.smithi167.stdout:(39/122): openblas-threads-0.3.15-4.el8.x86_64. 9.0 MB/s | 4.9 MB 00:00 2023-10-03T10:07:05.870 INFO:teuthology.orchestra.run.smithi125.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 880 kB/s | 110 kB 00:00 2023-10-03T10:07:05.877 INFO:teuthology.orchestra.run.smithi167.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 212 kB/s | 27 kB 00:00 2023-10-03T10:07:05.895 INFO:teuthology.orchestra.run.smithi125.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 455 kB/s | 57 kB 00:00 2023-10-03T10:07:05.944 INFO:teuthology.orchestra.run.smithi167.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 170 kB/s | 20 kB 00:00 2023-10-03T10:07:06.003 INFO:teuthology.orchestra.run.smithi167.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:06.029 INFO:teuthology.orchestra.run.smithi125.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-03T10:07:06.061 INFO:teuthology.orchestra.run.smithi167.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 332 kB/s | 39 kB 00:00 2023-10-03T10:07:06.162 INFO:teuthology.orchestra.run.smithi125.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-10-03T10:07:06.187 INFO:teuthology.orchestra.run.smithi167.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-03T10:07:06.271 INFO:teuthology.orchestra.run.smithi125.stdout:(53/122): python3-numpy-1.14.3-10.el8.x86_64.rp 4.3 MB/s | 3.7 MB 00:00 2023-10-03T10:07:06.296 INFO:teuthology.orchestra.run.smithi125.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 528 kB/s | 71 kB 00:00 2023-10-03T10:07:06.304 INFO:teuthology.orchestra.run.smithi167.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 377 kB/s | 44 kB 00:00 2023-10-03T10:07:06.371 INFO:teuthology.orchestra.run.smithi167.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-10-03T10:07:06.421 INFO:teuthology.orchestra.run.smithi167.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 886 kB/s | 103 kB 00:00 2023-10-03T10:07:06.496 INFO:teuthology.orchestra.run.smithi167.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-03T10:07:06.547 INFO:teuthology.orchestra.run.smithi167.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 878 kB/s | 110 kB 00:00 2023-10-03T10:07:06.580 INFO:teuthology.orchestra.run.smithi125.stdout:(55/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-10-03T10:07:06.622 INFO:teuthology.orchestra.run.smithi167.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 455 kB/s | 57 kB 00:00 2023-10-03T10:07:06.664 INFO:teuthology.orchestra.run.smithi125.stdout:(56/122): elfutils-libelf-devel-0.189-3.el8.x86 157 kB/s | 62 kB 00:00 2023-10-03T10:07:06.705 INFO:teuthology.orchestra.run.smithi125.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 203 kB/s | 83 kB 00:00 2023-10-03T10:07:06.755 INFO:teuthology.orchestra.run.smithi167.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-10-03T10:07:06.847 INFO:teuthology.orchestra.run.smithi125.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 273 kB/s | 39 kB 00:00 2023-10-03T10:07:06.881 INFO:teuthology.orchestra.run.smithi167.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-10-03T10:07:06.931 INFO:teuthology.orchestra.run.smithi125.stdout:(59/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 137 kB/s | 48 kB 00:00 2023-10-03T10:07:07.006 INFO:teuthology.orchestra.run.smithi167.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 566 kB/s | 71 kB 00:00 2023-10-03T10:07:07.056 INFO:teuthology.orchestra.run.smithi125.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-10-03T10:07:07.173 INFO:teuthology.orchestra.run.smithi125.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 403 kB/s | 47 kB 00:00 2023-10-03T10:07:07.198 INFO:teuthology.orchestra.run.smithi125.stdout:(62/122): libquadmath-8.5.0-20.el8.x86_64.rpm 646 kB/s | 172 kB 00:00 2023-10-03T10:07:07.265 INFO:teuthology.orchestra.run.smithi125.stdout:(63/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2023-10-03T10:07:07.299 INFO:teuthology.orchestra.run.smithi125.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-10-03T10:07:07.324 INFO:teuthology.orchestra.run.smithi125.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 692 kB/s | 87 kB 00:00 2023-10-03T10:07:07.366 INFO:teuthology.orchestra.run.smithi125.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2023-10-03T10:07:07.400 INFO:teuthology.orchestra.run.smithi125.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 435 kB/s | 44 kB 00:00 2023-10-03T10:07:07.490 INFO:teuthology.orchestra.run.smithi167.stdout:(54/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 5.7 MB/s | 52 MB 00:09 2023-10-03T10:07:07.525 INFO:teuthology.orchestra.run.smithi125.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-10-03T10:07:07.550 INFO:teuthology.orchestra.run.smithi125.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-10-03T10:07:07.642 INFO:teuthology.orchestra.run.smithi125.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:07.677 INFO:teuthology.orchestra.run.smithi125.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-03T10:07:07.784 INFO:teuthology.orchestra.run.smithi125.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 393 kB/s | 43 kB 00:00 2023-10-03T10:07:07.824 INFO:teuthology.orchestra.run.smithi167.stdout:(55/122): python3-scipy-1.0.0-21.module_el8.5.0 11 MB/s | 14 MB 00:01 2023-10-03T10:07:07.843 INFO:teuthology.orchestra.run.smithi125.stdout:(73/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.1 MB/s | 3.2 MB 00:00 2023-10-03T10:07:07.857 INFO:teuthology.orchestra.run.smithi167.stdout:(56/122): elfutils-libelf-devel-0.189-3.el8.x86 72 kB/s | 62 kB 00:00 2023-10-03T10:07:07.868 INFO:teuthology.orchestra.run.smithi125.stdout:(74/122): python3-cryptography-3.2.1-6.el8.x86_ 2.8 MB/s | 641 kB 00:00 2023-10-03T10:07:07.891 INFO:teuthology.orchestra.run.smithi167.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 207 kB/s | 83 kB 00:00 2023-10-03T10:07:07.902 INFO:teuthology.orchestra.run.smithi125.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-10-03T10:07:07.944 INFO:teuthology.orchestra.run.smithi125.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-10-03T10:07:07.969 INFO:teuthology.orchestra.run.smithi125.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 424 kB/s | 43 kB 00:00 2023-10-03T10:07:08.011 INFO:teuthology.orchestra.run.smithi125.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 533 kB/s | 58 kB 00:00 2023-10-03T10:07:08.024 INFO:teuthology.orchestra.run.smithi167.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 290 kB/s | 39 kB 00:00 2023-10-03T10:07:08.175 INFO:teuthology.orchestra.run.smithi167.stdout:(59/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 137 kB/s | 48 kB 00:00 2023-10-03T10:07:08.233 INFO:teuthology.orchestra.run.smithi167.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-10-03T10:07:08.287 INFO:teuthology.orchestra.run.smithi125.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 217 kB/s | 59 kB 00:00 2023-10-03T10:07:08.320 INFO:teuthology.orchestra.run.smithi125.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 516 kB/s | 181 kB 00:00 2023-10-03T10:07:08.342 INFO:teuthology.orchestra.run.smithi167.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 433 kB/s | 47 kB 00:00 2023-10-03T10:07:08.353 INFO:teuthology.orchestra.run.smithi125.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 748 kB/s | 306 kB 00:00 2023-10-03T10:07:08.387 INFO:teuthology.orchestra.run.smithi125.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 749 kB/s | 75 kB 00:00 2023-10-03T10:07:08.392 INFO:teuthology.orchestra.run.smithi167.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2023-10-03T10:07:08.412 INFO:teuthology.orchestra.run.smithi125.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 474 kB/s | 44 kB 00:00 2023-10-03T10:07:08.446 INFO:teuthology.orchestra.run.smithi125.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-10-03T10:07:08.467 INFO:teuthology.orchestra.run.smithi167.stdout:(63/122): libquadmath-8.5.0-20.el8.x86_64.rpm 590 kB/s | 172 kB 00:00 2023-10-03T10:07:08.471 INFO:teuthology.orchestra.run.smithi125.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 393 kB/s | 33 kB 00:00 2023-10-03T10:07:08.488 INFO:teuthology.orchestra.run.smithi125.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 215 kB/s | 16 kB 00:00 2023-10-03T10:07:08.501 INFO:teuthology.orchestra.run.smithi167.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-10-03T10:07:08.527 INFO:teuthology.orchestra.run.smithi167.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 649 kB/s | 87 kB 00:00 2023-10-03T10:07:08.538 INFO:teuthology.orchestra.run.smithi125.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-03T10:07:08.569 INFO:teuthology.orchestra.run.smithi167.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 178 kB/s | 18 kB 00:00 2023-10-03T10:07:08.572 INFO:teuthology.orchestra.run.smithi125.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 974 kB/s | 81 kB 00:00 2023-10-03T10:07:08.602 INFO:teuthology.orchestra.run.smithi167.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 435 kB/s | 44 kB 00:00 2023-10-03T10:07:08.605 INFO:teuthology.orchestra.run.smithi125.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-03T10:07:08.647 INFO:teuthology.orchestra.run.smithi125.stdout:(90/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-10-03T10:07:08.681 INFO:teuthology.orchestra.run.smithi125.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 161 kB/s | 18 kB 00:00 2023-10-03T10:07:08.723 INFO:teuthology.orchestra.run.smithi125.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 648 kB/s | 49 kB 00:00 2023-10-03T10:07:08.736 INFO:teuthology.orchestra.run.smithi167.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-03T10:07:08.773 INFO:teuthology.orchestra.run.smithi125.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 640 kB/s | 59 kB 00:00 2023-10-03T10:07:08.815 INFO:teuthology.orchestra.run.smithi125.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2023-10-03T10:07:08.840 INFO:teuthology.orchestra.run.smithi125.stdout:(95/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-03T10:07:08.866 INFO:teuthology.orchestra.run.smithi125.stdout:(96/122): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-10-03T10:07:08.878 INFO:teuthology.orchestra.run.smithi167.stdout:(69/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2023-10-03T10:07:08.891 INFO:teuthology.orchestra.run.smithi125.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-10-03T10:07:08.903 INFO:teuthology.orchestra.run.smithi167.stdout:(70/122): pcre2-devel-10.32-3.el8.x86_64.rpm 1.8 MB/s | 605 kB 00:00 2023-10-03T10:07:08.945 INFO:teuthology.orchestra.run.smithi167.stdout:(71/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-10-03T10:07:08.958 INFO:teuthology.orchestra.run.smithi125.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 700 kB/s | 64 kB 00:00 2023-10-03T10:07:08.983 INFO:teuthology.orchestra.run.smithi125.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-10-03T10:07:08.995 INFO:teuthology.orchestra.run.smithi167.stdout:(72/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-10-03T10:07:09.008 INFO:teuthology.orchestra.run.smithi125.stdout:(100/122): python3-routes-2.4.1-12.el8.noarch.r 1.1 MB/s | 196 kB 00:00 2023-10-03T10:07:09.042 INFO:teuthology.orchestra.run.smithi125.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2023-10-03T10:07:09.062 INFO:teuthology.orchestra.run.smithi167.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2023-10-03T10:07:09.067 INFO:teuthology.orchestra.run.smithi125.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 349 kB/s | 29 kB 00:00 2023-10-03T10:07:09.092 INFO:teuthology.orchestra.run.smithi125.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 328 kB/s | 27 kB 00:00 2023-10-03T10:07:09.096 INFO:teuthology.orchestra.run.smithi167.stdout:(74/122): python3-cryptography-3.2.1-6.el8.x86_ 3.3 MB/s | 641 kB 00:00 2023-10-03T10:07:09.121 INFO:teuthology.orchestra.run.smithi167.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-10-03T10:07:09.135 INFO:teuthology.orchestra.run.smithi125.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2023-10-03T10:07:09.160 INFO:teuthology.orchestra.run.smithi125.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 2.7 MB/s | 251 kB 00:00 2023-10-03T10:07:09.171 INFO:teuthology.orchestra.run.smithi167.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:07:09.185 INFO:teuthology.orchestra.run.smithi125.stdout:(106/122): python3-websocket-client-0.56.0-5.el 662 kB/s | 61 kB 00:00 2023-10-03T10:07:09.188 INFO:teuthology.orchestra.run.smithi167.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 463 kB/s | 43 kB 00:00 2023-10-03T10:07:09.210 INFO:teuthology.orchestra.run.smithi125.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-10-03T10:07:09.238 INFO:teuthology.orchestra.run.smithi167.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 495 kB/s | 58 kB 00:00 2023-10-03T10:07:09.269 INFO:teuthology.orchestra.run.smithi125.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-10-03T10:07:09.386 INFO:teuthology.orchestra.run.smithi125.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-10-03T10:07:09.503 INFO:teuthology.orchestra.run.smithi125.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 652 kB/s | 76 kB 00:00 2023-10-03T10:07:09.572 INFO:teuthology.orchestra.run.smithi167.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2023-10-03T10:07:09.620 INFO:teuthology.orchestra.run.smithi125.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-10-03T10:07:09.656 INFO:teuthology.orchestra.run.smithi167.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 387 kB/s | 181 kB 00:00 2023-10-03T10:07:09.706 INFO:teuthology.orchestra.run.smithi167.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 573 kB/s | 306 kB 00:00 2023-10-03T10:07:09.757 INFO:teuthology.orchestra.run.smithi167.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 408 kB/s | 75 kB 00:00 2023-10-03T10:07:09.774 INFO:teuthology.orchestra.run.smithi125.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2023-10-03T10:07:09.857 INFO:teuthology.orchestra.run.smithi167.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 217 kB/s | 44 kB 00:00 2023-10-03T10:07:09.882 INFO:teuthology.orchestra.run.smithi167.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-03T10:07:09.907 INFO:teuthology.orchestra.run.smithi167.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 219 kB/s | 33 kB 00:00 2023-10-03T10:07:09.962 INFO:teuthology.orchestra.run.smithi125.stdout:(113/122): iproute-6.2.0-5.el8.x86_64.rpm 4.4 MB/s | 854 kB 00:00 2023-10-03T10:07:10.006 INFO:teuthology.orchestra.run.smithi167.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 109 kB/s | 16 kB 00:00 2023-10-03T10:07:10.041 INFO:teuthology.orchestra.run.smithi167.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-03T10:07:10.071 INFO:teuthology.orchestra.run.smithi125.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-10-03T10:07:10.141 INFO:teuthology.orchestra.run.smithi167.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 604 kB/s | 81 kB 00:00 2023-10-03T10:07:10.166 INFO:teuthology.orchestra.run.smithi167.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-10-03T10:07:10.180 INFO:teuthology.orchestra.run.smithi125.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-10-03T10:07:10.192 INFO:teuthology.orchestra.run.smithi167.stdout:(90/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-10-03T10:07:10.242 INFO:teuthology.orchestra.run.smithi167.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-10-03T10:07:10.301 INFO:teuthology.orchestra.run.smithi167.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 449 kB/s | 49 kB 00:00 2023-10-03T10:07:10.313 INFO:teuthology.orchestra.run.smithi125.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 236 kB 00:00 2023-10-03T10:07:10.361 INFO:teuthology.orchestra.run.smithi167.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 493 kB/s | 59 kB 00:00 2023-10-03T10:07:10.430 INFO:teuthology.orchestra.run.smithi125.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.5 MB/s | 179 kB 00:00 2023-10-03T10:07:10.445 INFO:teuthology.orchestra.run.smithi167.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-03T10:07:10.470 INFO:teuthology.orchestra.run.smithi167.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-03T10:07:10.529 INFO:teuthology.orchestra.run.smithi167.stdout:(96/122): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-10-03T10:07:10.539 INFO:teuthology.orchestra.run.smithi125.stdout:(118/122): libuuid-2.32.1-43.el8.x86_64.rpm 914 kB/s | 99 kB 00:00 2023-10-03T10:07:10.554 INFO:teuthology.orchestra.run.smithi167.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 309 kB/s | 34 kB 00:00 2023-10-03T10:07:10.596 INFO:teuthology.orchestra.run.smithi167.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-03T10:07:10.638 INFO:teuthology.orchestra.run.smithi167.stdout:(99/122): python3-rsa-4.9-2.el8.noarch.rpm 590 kB/s | 64 kB 00:00 2023-10-03T10:07:10.664 INFO:teuthology.orchestra.run.smithi167.stdout:(100/122): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-10-03T10:07:10.689 INFO:teuthology.orchestra.run.smithi167.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 259 kB/s | 24 kB 00:00 2023-10-03T10:07:10.731 INFO:teuthology.orchestra.run.smithi167.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 317 kB/s | 29 kB 00:00 2023-10-03T10:07:10.756 INFO:teuthology.orchestra.run.smithi125.stdout:(119/122): util-linux-2.32.1-43.el8.x86_64.rpm 11 MB/s | 2.5 MB 00:00 2023-10-03T10:07:10.789 INFO:teuthology.orchestra.run.smithi167.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-10-03T10:07:10.823 INFO:teuthology.orchestra.run.smithi167.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-10-03T10:07:10.865 INFO:teuthology.orchestra.run.smithi167.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2023-10-03T10:07:10.881 INFO:teuthology.orchestra.run.smithi125.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 822 kB/s | 103 kB 00:00 2023-10-03T10:07:10.907 INFO:teuthology.orchestra.run.smithi167.stdout:(106/122): python3-websocket-client-0.56.0-5.el 523 kB/s | 61 kB 00:00 2023-10-03T10:07:10.941 INFO:teuthology.orchestra.run.smithi167.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 729 kB/s | 85 kB 00:00 2023-10-03T10:07:10.974 INFO:teuthology.orchestra.run.smithi167.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 210 kB/s | 23 kB 00:00 2023-10-03T10:07:11.091 INFO:teuthology.orchestra.run.smithi167.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-10-03T10:07:11.200 INFO:teuthology.orchestra.run.smithi167.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 702 kB/s | 76 kB 00:00 2023-10-03T10:07:11.264 INFO:teuthology.orchestra.run.smithi125.stdout:(121/122): librados2-16.2.14-44.geeb13ac9.el8.x 1.8 MB/s | 3.7 MB 00:02 2023-10-03T10:07:11.334 INFO:teuthology.orchestra.run.smithi167.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.7 MB/s | 232 kB 00:00 2023-10-03T10:07:11.467 INFO:teuthology.orchestra.run.smithi167.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2023-10-03T10:07:11.659 INFO:teuthology.orchestra.run.smithi167.stdout:(113/122): iproute-6.2.0-5.el8.x86_64.rpm 4.4 MB/s | 854 kB 00:00 2023-10-03T10:07:11.768 INFO:teuthology.orchestra.run.smithi167.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-10-03T10:07:11.877 INFO:teuthology.orchestra.run.smithi167.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-10-03T10:07:11.985 INFO:teuthology.orchestra.run.smithi167.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-10-03T10:07:12.094 INFO:teuthology.orchestra.run.smithi167.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-03T10:07:12.194 INFO:teuthology.orchestra.run.smithi167.stdout:(118/122): libuuid-2.32.1-43.el8.x86_64.rpm 992 kB/s | 99 kB 00:00 2023-10-03T10:07:12.403 INFO:teuthology.orchestra.run.smithi167.stdout:(119/122): util-linux-2.32.1-43.el8.x86_64.rpm 12 MB/s | 2.5 MB 00:00 2023-10-03T10:07:12.504 INFO:teuthology.orchestra.run.smithi167.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2023-10-03T10:07:12.506 INFO:teuthology.orchestra.run.smithi125.stdout:(122/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 4.2 MB 00:03 2023-10-03T10:07:12.511 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:12.511 INFO:teuthology.orchestra.run.smithi125.stdout:Total 10 MB/s | 200 MB 00:19 2023-10-03T10:07:12.645 INFO:teuthology.orchestra.run.smithi167.stdout:(121/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 2.5 MB/s | 4.2 MB 00:01 2023-10-03T10:07:13.215 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-03T10:07:13.312 INFO:teuthology.orchestra.run.smithi167.stdout:(122/122): librados2-16.2.14-44.geeb13ac9.el8.x 1.6 MB/s | 3.7 MB 00:02 2023-10-03T10:07:13.315 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:13.315 INFO:teuthology.orchestra.run.smithi167.stdout:Total 10 MB/s | 200 MB 00:19 2023-10-03T10:07:13.435 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-03T10:07:13.436 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-03T10:07:14.030 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-10-03T10:07:14.253 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-10-03T10:07:14.253 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-10-03T10:07:14.854 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-03T10:07:14.857 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-03T10:07:15.616 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-10-03T10:07:15.619 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-10-03T10:07:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-03T10:07:19.761 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:19.959 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:20.207 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:20.330 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-10-03T10:07:20.360 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:20.368 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:20.675 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:20.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:20.851 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:20.955 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:21.115 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:21.173 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:21.199 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:21.363 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:21.374 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:21.543 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:21.704 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:21.930 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:21.946 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:22.168 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:22.486 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:22.584 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:22.657 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:22.801 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:22.916 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:23.065 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:23.101 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:23.224 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:23.364 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:23.432 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:23.540 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:23.584 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:23.641 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:23.945 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:24.092 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:24.380 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:07:24.431 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:24.574 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:07:24.581 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:24.750 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:24.857 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:24.911 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:07:25.000 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:07:25.114 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:25.231 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:25.331 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:25.340 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:07:25.481 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:25.499 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:07:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:25.625 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:25.763 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:25.770 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:07:25.909 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:25.946 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:07:26.065 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:26.507 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:26.700 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:26.948 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:27.148 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:27.320 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:27.484 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:27.767 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:27.931 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:28.162 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:28.518 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:07:28.625 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:28.728 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:07:28.931 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:07:28.957 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:07:29.080 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:07:29.185 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:07:29.279 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:07:29.403 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:07:29.483 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:29.562 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:07:29.778 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:07:29.972 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:31.257 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:31.586 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:07:31.758 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:07:31.768 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:32.011 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:07:32.094 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:07:32.231 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:07:32.265 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:07:32.395 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:07:32.517 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:07:32.664 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:07:32.758 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:07:32.835 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:07:32.951 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:07:33.057 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:07:33.247 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:07:33.282 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:33.361 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:33.448 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:07:33.566 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:33.625 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:33.639 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:07:33.799 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:07:33.880 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:33.955 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:34.122 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:34.193 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:34.290 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:07:34.338 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:07:34.566 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:07:34.580 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:07:34.760 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:07:34.850 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:07:35.000 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:07:35.105 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:07:35.120 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:07:35.288 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:07:35.291 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:07:35.461 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:07:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:07:35.651 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:07:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:07:35.848 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:07:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:07:36.100 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:07:36.176 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:07:36.261 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:07:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:07:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:07:36.750 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:07:36.796 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:07:36.949 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:07:36.956 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:07:37.121 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:07:37.131 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:07:37.297 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:07:37.381 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:07:37.514 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:07:37.597 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:07:37.779 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:07:37.825 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:07:37.981 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:07:38.058 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:07:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:07:38.309 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:07:38.372 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:07:38.530 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:07:38.628 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:07:38.770 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:07:38.851 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:07:39.135 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:07:39.210 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:07:39.434 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:07:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:07:39.633 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:07:39.706 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:07:39.902 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:07:39.943 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:07:40.111 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:07:40.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:07:41.173 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:07:41.252 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:07:41.439 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:07:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:07:41.664 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:07:41.763 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:07:41.890 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:07:41.963 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:07:42.117 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:07:42.215 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:07:42.330 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:07:42.432 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:07:42.624 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:07:42.712 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:07:42.878 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:07:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:07:43.000 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:07:43.048 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:07:43.165 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:07:43.225 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:07:43.508 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:07:43.513 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:07:43.716 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:07:43.718 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:07:43.849 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:07:43.902 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:07:44.089 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:07:44.105 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:07:44.288 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:07:44.307 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:07:44.497 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:07:44.516 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:07:44.755 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:07:44.783 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:07:44.968 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:07:44.987 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:07:45.148 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:07:45.151 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:07:45.345 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:07:45.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:07:45.662 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:07:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:07:45.929 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:07:45.939 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:07:46.081 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:07:46.087 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:07:48.606 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:48.837 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:48.847 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:49.543 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:49.549 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:07:49.810 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:07:49.823 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:07:49.922 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:07:49.929 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:07:50.103 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:07:50.121 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /run 2023-10-03T10:08:08.436 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2023-10-03T10:08:08.437 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2023-10-03T10:08:08.437 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2023-10-03T10:08:08.437 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2023-10-03T10:08:08.437 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-03T10:08:08.437 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:08.857 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /run 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2023-10-03T10:08:09.006 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2023-10-03T10:08:09.007 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-10-03T10:08:09.007 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:09.288 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:09.409 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:09.468 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:09.838 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:10.008 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:10.950 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:11.185 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:11.219 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:11.436 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:11.493 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:11.683 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:11.718 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:11.789 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:11.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:12.107 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:12.280 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:12.311 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:12.548 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:12.901 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:12.987 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:13.002 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:13.170 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:13.174 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:13.283 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:13.435 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:14.302 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:14.555 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:14.614 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:14.869 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:15.593 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:15.792 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:15.881 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:15.912 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:16.124 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:16.215 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:16.238 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:16.455 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:16.481 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:16.594 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:16.642 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:16.653 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:16.786 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:16.812 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:16.982 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:16.993 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:21.305 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:21.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:22.535 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:22.729 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:22.838 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:23.060 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:23.125 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:23.308 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:23.401 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:23.463 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:23.940 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:24.035 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:24.267 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:08:24.562 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:08:24.743 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:08:24.904 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:08:24.952 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:08:25.102 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:08:25.202 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:08:25.289 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:08:25.410 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:08:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:08:25.620 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:08:25.773 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:08:25.859 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:08:25.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:08:26.035 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:26.099 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:08:26.323 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:26.407 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:26.550 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:08:26.635 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:26.647 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:26.731 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:26.796 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:26.808 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:08:26.989 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:27.022 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:08:27.022 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:27.080 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:27.259 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:27.264 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:27.273 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:27.393 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:27.393 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:08:27.638 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:27.653 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:08:27.653 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:27.817 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:08:27.857 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:27.863 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:27.992 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:27.993 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:28.010 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:08:28.233 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:28.233 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:28.238 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:28.414 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:08:28.500 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:28.501 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:28.565 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:08:28.742 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:28.742 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:28.749 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:28.750 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:28.933 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:28.933 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:28.942 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:28.942 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:29.133 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:29.133 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:29.184 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:29.184 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:29.333 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:29.333 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:29.379 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:29.541 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:29.541 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:29.594 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:29.973 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:30.194 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:08:30.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:08:30.196 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:08:30.197 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:08:30.206 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:08:30.207 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:08:30.208 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:08:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:08:30.210 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:08:30.211 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:08:30.212 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:08:30.213 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:08:30.214 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:30.215 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:08:30.558 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:08:30.559 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:08:30.560 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:08:30.569 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:08:30.570 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:08:30.571 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:08:30.572 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:08:30.573 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:08:30.574 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:08:30.575 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:08:30.576 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:30.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:08:32.195 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:08:32.195 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:08:32.196 INFO:teuthology.orchestra.run.smithi125.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.197 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.198 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.199 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:08:32.200 INFO:teuthology.orchestra.run.smithi125.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.201 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.202 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:08:32.203 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:08:32.204 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.205 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:08:32.206 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:08:32.207 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:08:32.208 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:08:32.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:08:32.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.212 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:08:32.213 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:08:32.213 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:08:32.213 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:32.213 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-03T10:08:32.369 DEBUG:teuthology.parallel:result is None 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:08:32.494 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:08:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.496 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:08:32.497 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.498 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:08:32.499 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:08:32.500 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:08:32.501 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.502 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:08:32.503 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:08:32.504 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-03T10:08:32.686 DEBUG:teuthology.parallel:result is None 2023-10-03T10:08:32.687 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:32.687 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:32.687 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:32.687 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:32.687 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:32.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:08:32.917 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:08:32.941 INFO:teuthology.orchestra.run.smithi125.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:08:32.942 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:08:32.942 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:08:32.942 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:32.942 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:32.942 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:32.943 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:32.943 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:32.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:08:33.196 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:08:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:08:33.220 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:08:33.220 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:08:33.220 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T10:08:33.220 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:33.220 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:08:33.252 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:33.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:08:33.291 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T10:08:33.291 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:33.291 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:08:33.321 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:08:33.388 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:33.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:08:33.416 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:08:33.484 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T10:08:33.484 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:33.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:08:33.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:08:33.578 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:33.578 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:08:33.606 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:08:33.672 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T10:08:33.672 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:33.673 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:08:33.699 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:08:33.765 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:33.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:08:33.793 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:08:33.860 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:08:33.869 INFO:teuthology.task.print:**** done installing pacific 2023-10-03T10:08:33.869 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T10:08:33.959 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T10:08:33.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2023-10-03T10:08:33.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-10-03T10:08:33.989 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T10:08:33.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:08:34.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:08:34.056 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T10:08:34.056 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:08:34.096 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:08:34.132 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T10:08:34.132 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T10:08:34.133 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}}', 'email': None, 'first_in_suite': False, 'job_id': '7409568', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6051, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5', 'targets': {'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPW21wSPrWg+e2zCzUBGgpqi3ldHVtstWGWks9X/CTU1m7MnklW98O/LTGyRbwvd0a4tHBLD80qAy22EnwD7iZs=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLiWOod+mpVQsSNdmAbjWWxo9+aMyr5y9bm6rTT1lFDhBsbX+PmOdU/qPDp/aq8vzVZs/2BX564XeISsneBrdw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph.healthy': None}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client'}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_newops']}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_09:48:43', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T10:08:34.133 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:08:34.162 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:08:34.181 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:08:34.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:08:34.247 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:34.247 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T10:08:34.303 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T10:08:34.303 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-10-03T10:08:34.361 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T10:08:34.361 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:08:34.361 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 379869 Links: 1 2023-10-03T10:08:34.361 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:08:34.362 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:08:34.362 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-03 10:08:29.825849363 +0000 2023-10-03T10:08:34.362 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-03 10:05:43.940489505 +0000 2023-10-03T10:08:34.362 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-03 10:05:43.940489505 +0000 2023-10-03T10:08:34.362 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-03T10:08:34.362 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T10:08:34.427 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-03T10:08:34.427 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-03T10:08:34.427 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.00024957 s, 2.1 MB/s 2023-10-03T10:08:34.428 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T10:08:34.487 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-10-03T10:08:34.545 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T10:08:34.545 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:08:34.545 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 391465 Links: 1 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-03 10:08:29.826849346 +0000 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-03 10:05:44.444481127 +0000 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-03 10:05:44.444481127 +0000 2023-10-03T10:08:34.546 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-03T10:08:34.546 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T10:08:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-03T10:08:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-03T10:08:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000209335 s, 2.4 MB/s 2023-10-03T10:08:34.613 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T10:08:34.672 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 390882 Links: 1 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-03 10:08:29.826849346 +0000 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-03 10:05:44.950472716 +0000 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-03 10:05:44.950472716 +0000 2023-10-03T10:08:34.730 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-03T10:08:34.731 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T10:08:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-03T10:08:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-03T10:08:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.00023287 s, 2.2 MB/s 2023-10-03T10:08:34.797 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T10:08:34.856 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 391025 Links: 1 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:08:34.913 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-03 10:08:29.826849346 +0000 2023-10-03T10:08:34.914 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-03 10:05:45.449464421 +0000 2023-10-03T10:08:34.914 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-03 10:05:45.449464421 +0000 2023-10-03T10:08:34.914 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-03T10:08:34.914 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T10:08:34.979 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-03T10:08:34.979 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-03T10:08:34.979 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000234072 s, 2.2 MB/s 2023-10-03T10:08:34.980 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T10:08:35.038 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:08:35.039 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:08:35.039 INFO:tasks.ceph:Generating config... 2023-10-03T10:08:35.040 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-03T10:08:35.040 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-03T10:08:35.040 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-03T10:08:35.040 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-03T10:08:35.040 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-03T10:08:35.040 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T10:08:35.040 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T10:08:35.040 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T10:08:35.040 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T10:08:35.041 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T10:08:35.041 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T10:08:35.042 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-03T10:08:35.043 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T10:08:35.044 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T10:08:35.045 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T10:08:35.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T10:08:35.198 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T10:08:35.200 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T10:08:35.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:08:35.308 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.125'), ('mon.b', '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]'), ('mon.c', '[v2:172.21.15.125:3302,v1:172.21.15.125:6791]')] 2023-10-03T10:08:35.308 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790],[v2:172.21.15.125:3302,v1:172.21.15.125:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T10:08:35.309 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:35.309 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:08:35.366 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.125 --addv b '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]' --addv c '[v2:172.21.15.125:3302,v1:172.21.15.125:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:35.450 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:35.450 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: generated fsid 15b0d202-3c9c-40fb-bdbc-3890d84c122d 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:epoch 0 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:fsid 15b0d202-3c9c-40fb-bdbc-3890d84c122d 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:last_changed 2023-10-03T10:08:35.451605+0000 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:created 2023-10-03T10:08:35.451605+0000 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:min_mon_release 0 (unknown) 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:election_strategy: 1 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:0: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.a 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:1: [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] mon.b 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:2: [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] mon.c 2023-10-03T10:08:35.451 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T10:08:35.452 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:08:35.470 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 15b0d202-3c9c-40fb-bdbc-3890d84c122d... 2023-10-03T10:08:35.471 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:08:35.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:08:35.555 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-10-03T10:08:35.555 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-10-03T10:08:35.555 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-10-03T10:08:35.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:08:35.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-10-03T10:08:35.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790],[v2:172.21.15.125:3302,v1:172.21.15.125:6791]" 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on pool no app = False 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: ms bind msgr2 = False 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn min per osd = 0 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = 15b0d202-3c9c-40fb-bdbc-3890d84c122d 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-10-03T10:08:35.559 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.560 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-10-03T10:08:35.561 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: bdev async discard = True 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: bdev enable discard = True 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore allocator = bitmap 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 1/20 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 1/20 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 4/10 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-10-03T10:08:35.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-10-03T10:08:35.563 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.564 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-10-03T10:08:35.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-03T10:08:35.566 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-03T10:08:35.567 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-03T10:08:35.568 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-03T10:08:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-10-03T10:08:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-10-03T10:08:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-10-03T10:08:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790],[v2:172.21.15.125:3302,v1:172.21.15.125:6791]" 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on pool no app = False 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: ms bind msgr2 = False 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn min per osd = 0 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 15b0d202-3c9c-40fb-bdbc-3890d84c122d 2023-10-03T10:08:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-10-03T10:08:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:08:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-10-03T10:08:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2023-10-03T10:08:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-10-03T10:08:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-10-03T10:08:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-10-03T10:08:35.581 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T10:08:35.581 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T10:08:35.660 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T10:08:35.660 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:35.661 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T10:08:35.678 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:35.678 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T10:08:35.736 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:08:35.736 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:35.736 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:08:35.736 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:08:35.812 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:35.813 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:35.870 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-10-03T10:08:35.870 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:35.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:08:35.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:08:35.912 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:35.913 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:35.972 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T10:08:35.972 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T10:08:35.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:08:36.021 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:08:36.023 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T10:08:36.023 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:08:36.072 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:08:36.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T10:08:36.102 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T10:08:36.102 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T10:08:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T10:08:36.224 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T10:08:36.224 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:08:36.224 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T10:08:36.251 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:08:36.251 INFO:tasks.ceph:role: osd.0 2023-10-03T10:08:36.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:08:36.251 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T10:08:36.325 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:08:36.325 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:08:36.326 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:08:36.764 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-03T10:08:36.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-03T10:08:36.766 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T10:08:36.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T10:08:36.956 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T10:08:37.023 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:08:37.024 INFO:tasks.ceph:role: osd.1 2023-10-03T10:08:37.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:08:37.024 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T10:08:37.097 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:08:37.097 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:08:37.098 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:08:37.530 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-03T10:08:37.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-03T10:08:37.532 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T10:08:37.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T10:08:37.674 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T10:08:37.741 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:08:37.741 INFO:tasks.ceph:role: osd.2 2023-10-03T10:08:37.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:08:37.742 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:08:37.816 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:08:37.817 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:08:37.817 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:08:37.817 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:08:38.263 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-03T10:08:38.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-03T10:08:38.264 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T10:08:38.424 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T10:08:38.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T10:08:38.524 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:08:38.554 INFO:tasks.ceph:role: osd.3 2023-10-03T10:08:38.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:08:38.554 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:08:38.599 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:08:38.600 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:08:38.600 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:08:38.600 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:08:39.052 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-03T10:08:39.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-03T10:08:39.054 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T10:08:39.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T10:08:39.240 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:39.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.344+0000 7ff4ab907200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T10:08:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.345+0000 7ff4ab907200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T10:08:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.345+0000 7ff4ab907200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:08:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.345+0000 7ff4ab907200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:08:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.345+0000 7ff4ab907200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:08:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:39.345+0000 7ff4ab907200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T10:08:42.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T10:08:42.227 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:42.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.316+0000 7f2c0fc4b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T10:08:42.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.316+0000 7f2c0fc4b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T10:08:42.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.316+0000 7f2c0fc4b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:08:42.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.316+0000 7f2c0fc4b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:08:42.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.316+0000 7f2c0fc4b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:08:42.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:42.317+0000 7f2c0fc4b200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T10:08:45.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T10:08:45.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.285+0000 7f0b9fcfd200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.285+0000 7f0b9fcfd200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.285+0000 7f0b9fcfd200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.285+0000 7f0b9fcfd200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.285+0000 7f0b9fcfd200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:45.286+0000 7f0b9fcfd200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T10:08:48.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T10:08:48.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.249+0000 7efeec056200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T10:08:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.250+0000 7efeec056200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T10:08:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.250+0000 7efeec056200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:08:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.250+0000 7efeec056200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:08:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.250+0000 7efeec056200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:08:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:48.250+0000 7efeec056200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T10:08:51.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T10:08:51.124 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T10:08:51.124 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.124 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T10:08:51.197 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.198 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T10:08:51.270 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T10:08:51.343 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.343 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T10:08:51.415 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T10:08:51.487 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:51.488 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T10:08:51.560 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:08:51.560 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T10:08:51.582 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T10:08:51.583 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T10:08:51.631 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2023-10-03T10:08:51.631 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAk6BtlAd5NARAAGVmPQhxaFWWdeiPLDxw8+Q== 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAk6BtlCwpjBBAA7wkoVcPtvcQQKiwnO+ZPIA== 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAn6BtlqsmhFBAA2EacU3gEZ4JlR0pu72oMkg== 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAq6BtlMyTxEhAA4pk8pUuOLswN7QELuxG+MA== 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2023-10-03T10:08:51.633 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAt6Btlk9gTERAA98bGqJdJeADGrmELuqOmdQ== 2023-10-03T10:08:51.633 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2023-10-03T10:08:51.633 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAw6BtlM7b1DhAA2vFx7MAcP8Ma5qSaUSRrdQ== 2023-10-03T10:08:51.633 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-10-03T10:08:51.633 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAk6BtlWhGlDBAAFz90m7N2wfYRAIOQbeD0yg== 2023-10-03T10:08:51.634 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T10:08:51.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T10:08:51.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:08:51.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:08:51.948 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:08:52.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:08:52.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T10:08:52.227 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T10:08:52.227 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T10:08:52.254 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:08:52.347 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T10:08:52.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T10:08:52.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:08:52.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T10:08:52.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T10:08:52.626 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:08:52.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T10:08:52.746 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:08:52.804 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T10:08:52.804 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:08:52.804 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:08:52.847 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:08:52.847 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:08:52.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:08:52.849 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:08:52.849 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:08:52.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:08:52.851 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:08:52.851 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T10:08:52.851 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:08:52.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:08:52.853 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:08:52.853 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T10:08:52.853 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T10:08:52.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.997+0000 7ff0d399d700 1 Processor -- start 2023-10-03T10:08:52.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.997+0000 7ff0d399d700 1 -- start start 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d399d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d399d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d399d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc094ba0 con 0x7ff0cc12c240 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d399d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc092e90 con 0x7ff0cc093950 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d399d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc096b60 con 0x7ff0cc095c50 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1739700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d0f38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1f3a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff0cc12c240 0x7ff0cc12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:32896/0 (socket says 172.21.15.125:32896) 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1f3a700 1 -- 172.21.15.125:0/2716777863 learned_addr learned my addr 172.21.15.125:0/2716777863 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:08:53.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:52.998+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:08:53.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:53.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:53.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.199+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:08:53.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:53.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:53.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:53.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:53.600+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:08:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:54.401+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:08:55.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc096030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:08:56.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0cc096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:56.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc095760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:08:56.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:56.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 >> v1:172.21.15.125:6789/0 conn(0x7ff0cc12c240 legacy=0x7ff0cc12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:56.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc092e90 con 0x7ff0b8005790 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:56.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:55.999+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:08:56.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.200+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:56.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.200+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:56.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.200+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:56.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.200+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:56.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.200+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:08:56.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.601+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:56.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.601+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:56.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.601+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:56.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.601+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:56.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:56.601+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:08:57.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:57.402+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:57.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:57.402+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:08:57.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:57.402+0000 7ff0d1739700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:08:57.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:57.402+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:08:57.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:57.402+0000 7ff0d1739700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:08:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b8007c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:08:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0b800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b800e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc093150 con 0x7ff0cc12c240 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc092e90 con 0x7ff0b8005790 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0caffd700 1 -- 172.21.15.125:0/2716777863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc096b60 con 0x7ff0cc095c50 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0d1f3a700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b800e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.998+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0b800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 msgr2=0x7ff0b800e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b800e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 >> v1:172.21.15.125:6789/0 conn(0x7ff0cc12c240 legacy=0x7ff0b800a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d0f38700 1 -- 172.21.15.125:0/2716777863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8007cb0 con 0x7ff0cc095c50 2023-10-03T10:08:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0cbfff700 1 -- 172.21.15.125:0/2716777863 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169680406 0 0) 0x7ff0cc093150 con 0x7ff0cc12c240 2023-10-03T10:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d1f3a700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b800e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0b800dbe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff0cc09b9b0 tx=0x7ff0c0008040).ready entity=mon.2 client_cookie=818e243dafa442b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0cbfff700 1 -- 172.21.15.125:0/2716777863 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0011450 con 0x7ff0cc095c50 2023-10-03T10:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0cbfff700 1 -- 172.21.15.125:0/2716777863 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0013510 con 0x7ff0cc095c50 2023-10-03T10:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:58.999+0000 7ff0cbfff700 1 -- 172.21.15.125:0/2716777863 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0013890 con 0x7ff0cc095c50 2023-10-03T10:08:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 -- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 msgr2=0x7ff0b800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0b800dbe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff0cc09b9b0 tx=0x7ff0c0008040).stop 2023-10-03T10:08:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 -- 172.21.15.125:0/2716777863 shutdown_connections 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc093950 0x7ff0cc095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 --2- 172.21.15.125:0/2716777863 >> v2:172.21.15.125:3300/0 conn(0x7ff0b8005790 0x7ff0b800e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 --2- 172.21.15.125:0/2716777863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0cc095c50 0x7ff0b800dbe0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 -- 172.21.15.125:0/2716777863 >> 172.21.15.125:0/2716777863 conn(0x7ff0cc09aa50 msgr2=0x7ff0cc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 -- 172.21.15.125:0/2716777863 shutdown_connections 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.000+0000 7ff0d399d700 1 -- 172.21.15.125:0/2716777863 wait complete. 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.001+0000 7ff0d399d700 1 Processor -- start 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.002+0000 7ff0d399d700 1 -- start start 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.002+0000 7ff0d399d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 0x7ff0cc116a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d399d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d399d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 0x7ff0cc117450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d399d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc128be0 con 0x7ff0cc093950 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d399d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc092410 con 0x7ff0cc095c50 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d399d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc11a5a0 con 0x7ff0b8005790 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d1739700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 0x7ff0cc116a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52002/0 (socket says 172.21.15.125:52002) 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 -- 172.21.15.125:0/3038181893 learned_addr learned my addr 172.21.15.125:0/3038181893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d1f3a700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 0x7ff0cc117450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 -- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 msgr2=0x7ff0cc116a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 0x7ff0cc116a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 -- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 msgr2=0x7ff0cc117450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 0x7ff0cc117450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 -- 172.21.15.125:0/3038181893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc094ba0 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d1739700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 0x7ff0cc116a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d1f3a700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 0x7ff0cc117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0d0f38700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff0b8005760 tx=0x7ff0c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.003+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0025070 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00208c0 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c000e040 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0006af0 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc11ac80 con 0x7ff0cc093950 2023-10-03T10:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff0c00166c0 con 0x7ff0cc093950 2023-10-03T10:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.004+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff0c0033790 con 0x7ff0cc093950 2023-10-03T10:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.005+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc11ae40 con 0x7ff0cc093950 2023-10-03T10:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.007+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff0cc11ae40 con 0x7ff0cc093950 2023-10-03T10:08:59.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.082+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff0cc05a260 con 0x7ff0cc093950 2023-10-03T10:08:59.090 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:08:59.089+0000 7fc2bf4ca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.092+0000 7ff0c97fa700 1 -- 172.21.15.125:0/3038181893 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff0c0038060 con 0x7ff0cc093950 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 msgr2=0x7ff0cc116f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff0b8005760 tx=0x7ff0c0008040).stop 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 shutdown_connections 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0cc095c50 0x7ff0cc117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0b8005790 0x7ff0cc116a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 --2- 172.21.15.125:0/3038181893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0cc093950 0x7ff0cc116f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 >> 172.21.15.125:0/3038181893 conn(0x7ff0cc09aa50 msgr2=0x7ff0cc098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 shutdown_connections 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.094+0000 7ff0d399d700 1 -- 172.21.15.125:0/3038181893 wait complete. 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi125.stderr:adjusted tunables profile to default 2023-10-03T10:08:59.106 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T10:08:59.106 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T10:08:59.107 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:59.107 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T10:08:59.134 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:59.135 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T10:08:59.165 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:08:59.165+0000 7fc2bf4ca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:08:59.191 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:59.191 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T10:08:59.253 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:08:59.252+0000 7fc2bf4ca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:08:59.258 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:08:59.258 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T10:08:59.325 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new e46d0293-43a8-48d0-8115-65e8d17976fd 0 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 Processor -- start 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 -- start start 2023-10-03T10:08:59.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 0x7f1b9c130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c093340 con 0x7f1b9c092190 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c05f940 con 0x7f1b9c12dd40 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1ba09a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c097c30 con 0x7f1b9c05f560 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1b9a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1b9ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 0x7f1b9c130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1b9a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33968/0 (socket says 172.21.15.125:33968) 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1b9a59c700 1 -- 172.21.15.125:0/1826892039 learned_addr learned my addr 172.21.15.125:0/1826892039 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.486+0000 7f1b99d9b700 1 --1- 172.21.15.125:0/1826892039 >> v1:172.21.15.125:6789/0 conn(0x7f1b9c092190 0x7f1b9c1291a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37324/0 (socket says 172.21.15.125:37324) 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9a59c700 1 -- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 msgr2=0x7f1b9c130130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9a59c700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 0x7f1b9c130130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9a59c700 1 -- 172.21.15.125:0/1826892039 >> v1:172.21.15.125:6789/0 conn(0x7f1b9c092190 legacy=0x7f1b9c1291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9a59c700 1 -- 172.21.15.125:0/1826892039 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0941f0 con 0x7f1b9c05f560 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9959a700 1 -- 172.21.15.125:0/1826892039 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153382173 0 0) 0x7f1b9c093340 con 0x7f1b9c092190 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9ad9d700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 0x7f1b9c130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9a59c700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1b8c009830 tx=0x7f1b8c0090f0).ready entity=mon.2 client_cookie=1e6ca55e640789ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9959a700 1 -- 172.21.15.125:0/1826892039 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00b580 con 0x7f1b9c05f560 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9959a700 1 -- 172.21.15.125:0/1826892039 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00b6e0 con 0x7f1b9c05f560 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.487+0000 7f1b9959a700 1 -- 172.21.15.125:0/1826892039 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00ba80 con 0x7f1b9c05f560 2023-10-03T10:08:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 -- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 msgr2=0x7f1b9c128cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1b8c009830 tx=0x7f1b8c0090f0).stop 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 -- 172.21.15.125:0/1826892039 shutdown_connections 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c12dd40 0x7f1b9c130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/1826892039 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c05f560 0x7f1b9c128cb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 -- 172.21.15.125:0/1826892039 >> 172.21.15.125:0/1826892039 conn(0x7f1b9c09a1c0 msgr2=0x7f1b9c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 -- 172.21.15.125:0/1826892039 shutdown_connections 2023-10-03T10:08:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.488+0000 7f1ba09a5700 1 -- 172.21.15.125:0/1826892039 wait complete. 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 Processor -- start 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 -- start start 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 0x7f1b9c1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 0x7f1b9c1368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1131a0 con 0x7f1b9c05f560 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c12e1c0 con 0x7f1b9c092190 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1ba09a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0690c0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1b9ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1b99d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 0x7f1b9c1368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1b9ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33976/0 (socket says 172.21.15.125:33976) 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1b9ad9d700 1 -- 172.21.15.125:0/3124371716 learned_addr learned my addr 172.21.15.125:0/3124371716 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.489+0000 7f1b9a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 0x7f1b9c1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 -- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 msgr2=0x7f1b9c1368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 0x7f1b9c1368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 -- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 msgr2=0x7f1b9c1363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 0x7f1b9c1363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 -- 172.21.15.125:0/3124371716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009a20 con 0x7f1b9c12dd40 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9a59c700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 0x7f1b9c1363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b99d9b700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 0x7f1b9c1368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b9ad9d700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1b9400b460 tx=0x7f1b9400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94015070 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9401a420 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c009370 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9401a7a0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c114cb0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1b9401abd0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.490+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1b940247b0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.491+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c0677b0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.494+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1b9401f070 con 0x7f1b9c12dd40 2023-10-03T10:08:59.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.572+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd new", "uuid": "e46d0293-43a8-48d0-8115-65e8d17976fd", "id": 0} v 0) v1 -- 0x7f1b9c05a260 con 0x7f1b9c12dd40 2023-10-03T10:08:59.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.580+0000 7f1b8a7fc700 1 -- 172.21.15.125:0/3124371716 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e46d0293-43a8-48d0-8115-65e8d17976fd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1b940249f0 con 0x7f1b9c12dd40 2023-10-03T10:08:59.581 INFO:teuthology.orchestra.run.smithi125.stdout:0 2023-10-03T10:08:59.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 msgr2=0x7f1b9c110c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1b9400b460 tx=0x7f1b9400b040).stop 2023-10-03T10:08:59.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 shutdown_connections 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1b9c12dd40 0x7f1b9c110c60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b9c05f560 0x7f1b9c1363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 --2- 172.21.15.125:0/3124371716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b9c092190 0x7f1b9c1368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 >> 172.21.15.125:0/3124371716 conn(0x7f1b9c09a1c0 msgr2=0x7f1b9c12cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 shutdown_connections 2023-10-03T10:08:59.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.582+0000 7f1ba09a5700 1 -- 172.21.15.125:0/3124371716 wait complete. 2023-10-03T10:08:59.598 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 900e5e55-9496-43ac-b8c8-a1c1305d5a2f 1 2023-10-03T10:08:59.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.714+0000 7f8377fa4700 1 Processor -- start 2023-10-03T10:08:59.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.714+0000 7f8377fa4700 1 -- start start 2023-10-03T10:08:59.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8377fa4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f837005f560 0x7f837012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8377fa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8377fa4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8370097ac0 con 0x7f8370095d90 2023-10-03T10:08:59.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8377fa4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837005f940 con 0x7f837005f560 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8377fa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837012ab20 con 0x7f837012b250 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f837553f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f837005f560 0x7f837012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f837553f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33982/0 (socket says 172.21.15.125:33982) 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8376541700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8370095d90 0x7f8370096220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37328/0 (socket says 172.21.15.125:37328) 2023-10-03T10:08:59.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f837005f560 0x7f837012ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52030/0 (socket says 172.21.15.125:52030) 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f837553f700 1 -- 172.21.15.125:0/3946877704 learned_addr learned my addr 172.21.15.125:0/3946877704 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 -- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 msgr2=0x7f837012b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 -- 172.21.15.125:0/3946877704 >> v1:172.21.15.125:6789/0 conn(0x7f8370095d90 legacy=0x7f8370096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 -- 172.21.15.125:0/3946877704 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370066f90 con 0x7f837005f560 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8374d3e700 1 -- 172.21.15.125:0/3946877704 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023146863 0 0) 0x7f8370097ac0 con 0x7f8370095d90 2023-10-03T10:08:59.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f837553f700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.715+0000 7f8375d40700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837005f560 0x7f837012ad60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f836c009790 tx=0x7f836c009060).ready entity=mon.0 client_cookie=89d8dd6dd2016317 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8374d3e700 1 -- 172.21.15.125:0/3946877704 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00f510 con 0x7f837005f560 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8374d3e700 1 -- 172.21.15.125:0/3946877704 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00f670 con 0x7f837005f560 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8374d3e700 1 -- 172.21.15.125:0/3946877704 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00f9f0 con 0x7f837005f560 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 -- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837005f560 msgr2=0x7f837012ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837005f560 0x7f837012ad60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f836c009790 tx=0x7f836c009060).stop 2023-10-03T10:08:59.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 -- 172.21.15.125:0/3946877704 shutdown_connections 2023-10-03T10:08:59.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837005f560 0x7f837012ad60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3946877704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837012b250 0x7f837012b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 -- 172.21.15.125:0/3946877704 >> 172.21.15.125:0/3946877704 conn(0x7f837009a1c0 msgr2=0x7f837009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 -- 172.21.15.125:0/3946877704 shutdown_connections 2023-10-03T10:08:59.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.716+0000 7f8377fa4700 1 -- 172.21.15.125:0/3946877704 wait complete. 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.717+0000 7f8377fa4700 1 Processor -- start 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.717+0000 7f8377fa4700 1 -- start start 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 0x7f837013a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 0x7f837013aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370129280 con 0x7f837012b250 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83701155d0 con 0x7f8370095d90 2023-10-03T10:08:59.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83700671c0 con 0x7f837005f560 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f837553f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 0x7f837013aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f837553f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35092/0 (socket says 172.21.15.125:35092) 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f837553f700 1 -- 172.21.15.125:0/3996967763 learned_addr learned my addr 172.21.15.125:0/3996967763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8375d40700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 0x7f837013a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 -- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 msgr2=0x7f837013a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 0x7f837013a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 -- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 msgr2=0x7f837013a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 -- 172.21.15.125:0/3996967763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360009370 con 0x7f837012b250 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f837553f700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8375d40700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 0x7f837013a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8376541700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 0x7f837013aec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f836800c7e0 tx=0x7f8368007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368005c70 con 0x7f837012b250 2023-10-03T10:08:59.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368005df0 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0092a0 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368007360 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.718+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8368013410 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.719+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8370117200 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.719+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f83680138f0 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.719+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8370117440 con 0x7f837012b250 2023-10-03T10:08:59.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.722+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f836801c3e0 con 0x7f837012b250 2023-10-03T10:08:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.801+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "900e5e55-9496-43ac-b8c8-a1c1305d5a2f", "id": 1} v 0) v1 -- 0x7f837005a260 con 0x7f837012b250 2023-10-03T10:08:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.808+0000 7f8365ffb700 1 -- 172.21.15.125:0/3996967763 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "900e5e55-9496-43ac-b8c8-a1c1305d5a2f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f836801c580 con 0x7f837012b250 2023-10-03T10:08:59.809 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-03T10:08:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 msgr2=0x7f837013aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 0x7f837013aec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f836800c7e0 tx=0x7f8368007eb0).stop 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 shutdown_connections 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837012b250 0x7f837013aec0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f837005f560 0x7f837013a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 --2- 172.21.15.125:0/3996967763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8370095d90 0x7f837013a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 >> 172.21.15.125:0/3996967763 conn(0x7f837009a1c0 msgr2=0x7f837012e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 shutdown_connections 2023-10-03T10:08:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.809+0000 7f8377fa4700 1 -- 172.21.15.125:0/3996967763 wait complete. 2023-10-03T10:08:59.825 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 7a1e1fe5-345d-4830-9c17-9662b63d17c2 2 2023-10-03T10:08:59.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.954+0000 7fceb2e4a700 1 Processor -- start 2023-10-03T10:08:59.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.954+0000 7fceb2e4a700 1 -- start start 2023-10-03T10:08:59.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.955+0000 7fceb2e4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 0x7fceac097630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.955+0000 7fceb2e4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fceac13cf80 0x7fceac13f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.955+0000 7fceb2e4a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac093030 con 0x7fceac097b20 2023-10-03T10:08:59.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.955+0000 7fceb2e4a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac082dd0 con 0x7fceac13cf80 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.955+0000 7fceb2e4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac098950 con 0x7fceac0829f0 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceabfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fceac097b20 0x7fceac097f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37344/0 (socket says 172.21.15.125:37344) 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceabfff700 1 -- 172.21.15.125:0/643474029 learned_addr learned my addr 172.21.15.125:0/643474029 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> v2:172.21.15.125:3300/0 conn(0x7fceac13cf80 0x7fceac13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264942550 0 0) 0x7fceac093030 con 0x7fceac097b20 2023-10-03T10:08:59.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce940033f0 con 0x7fceac097b20 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceb0be6700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 0x7fceac097630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.956+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481817310 0 0) 0x7fce940033f0 con 0x7fceac097b20 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 msgr2=0x7fceac097630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 0x7fceac097630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 >> v2:172.21.15.125:3300/0 conn(0x7fceac13cf80 msgr2=0x7fceac13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 --2- 172.21.15.125:0/643474029 >> v2:172.21.15.125:3300/0 conn(0x7fceac13cf80 0x7fceac13f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac092ae0 con 0x7fceac097b20 2023-10-03T10:08:59.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2079740769 0 0) 0x7fcea0001470 con 0x7fceac097b20 2023-10-03T10:08:59.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> v2:172.21.15.125:3300/0 conn(0x7fceac13cf80 0x7fceac13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 >> v1:172.21.15.125:6789/0 conn(0x7fceac097b20 legacy=0x7fceac097f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce940038e0 0x7fce94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 0x7fce94004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce94004b80 0x7fce94005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac082dd0 con 0x7fce940038e0 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac098950 con 0x7fceac0829f0 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce9400b8e0 con 0x7fce94004b80 2023-10-03T10:08:59.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce94004b80 0x7fce94005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb0be6700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce940038e0 0x7fce94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 -- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 msgr2=0x7fce94004690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac0829f0 0x7fce94004690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 -- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce940038e0 msgr2=0x7fce94003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce940038e0 0x7fce94003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:08:59.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb13e7700 1 -- 172.21.15.125:0/643474029 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce940033f0 con 0x7fce94004b80 2023-10-03T10:08:59.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.957+0000 7fceb0be6700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce940038e0 0x7fce94003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:08:59.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceb13e7700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce94004b80 0x7fce94005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcea400cdd0 tx=0x7fcea400c480).ready entity=mon.2 client_cookie=23cab7d314aac401 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4011040 con 0x7fce94004b80 2023-10-03T10:08:59.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40079f0 con 0x7fce94004b80 2023-10-03T10:08:59.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceab7fe700 1 -- 172.21.15.125:0/643474029 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4007d70 con 0x7fce94004b80 2023-10-03T10:08:59.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceb2e4a700 1 -- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce94004b80 msgr2=0x7fce94005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.958+0000 7fceb2e4a700 1 --2- 172.21.15.125:0/643474029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce94004b80 0x7fce94005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcea400cdd0 tx=0x7fcea400c480).stop 2023-10-03T10:08:59.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.959+0000 7fceb13e7700 1 -- 172.21.15.125:0/643474029 reap_dead start 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.959+0000 7fceb2e4a700 1 -- 172.21.15.125:0/643474029 shutdown_connections 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.959+0000 7fceb2e4a700 1 -- 172.21.15.125:0/643474029 >> 172.21.15.125:0/643474029 conn(0x7fceac099820 msgr2=0x7fceac099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.959+0000 7fceb2e4a700 1 -- 172.21.15.125:0/643474029 shutdown_connections 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.959+0000 7fceb2e4a700 1 -- 172.21.15.125:0/643474029 wait complete. 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.960+0000 7fceb2e4a700 1 Processor -- start 2023-10-03T10:08:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 -- start start 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac1378a0 0x7fceac137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fceac13b5f0 0x7fceac13ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac13a470 con 0x7fce94004b80 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac138b00 con 0x7fceac1378a0 2023-10-03T10:08:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb2e4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceac096760 con 0x7fceac13b5f0 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb0be6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb0be6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52066/0 (socket says 172.21.15.125:52066) 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.961+0000 7fceb0be6700 1 -- 172.21.15.125:0/3067050415 learned_addr learned my addr 172.21.15.125:0/3067050415 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 -- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fceac13b5f0 msgr2=0x7fceac13ba50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fceac13b5f0 0x7fceac13ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 -- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac1378a0 msgr2=0x7fceac137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:08:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac1378a0 0x7fceac137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 -- 172.21.15.125:0/3067050415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac091980 con 0x7fce94004b80 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb0be6700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fce9c009d40 tx=0x7fce9c012040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00ea50 con 0x7fce94004b80 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c00ebb0 con 0x7fce94004b80 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0193f0 con 0x7fce94004b80 2023-10-03T10:08:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.962+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0924b0 con 0x7fce94004b80 2023-10-03T10:08:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.963+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac13b2b0 con 0x7fce94004b80 2023-10-03T10:08:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.963+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fce9c019a80 con 0x7fce94004b80 2023-10-03T10:08:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.963+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fce9c0217d0 con 0x7fce94004b80 2023-10-03T10:08:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.964+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac05a260 con 0x7fce94004b80 2023-10-03T10:08:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:08:59.967+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fceac13b2b0 con 0x7fce94004b80 2023-10-03T10:09:00.001 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.000+0000 7fc2bf4ca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:09:00.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.060+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a1e1fe5-345d-4830-9c17-9662b63d17c2", "id": 2} v 0) v1 -- 0x7fceac0654d0 con 0x7fce94004b80 2023-10-03T10:09:00.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.070+0000 7fcea8ff9700 1 -- 172.21.15.125:0/3067050415 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a1e1fe5-345d-4830-9c17-9662b63d17c2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce9c0213a0 con 0x7fce94004b80 2023-10-03T10:09:00.071 INFO:teuthology.orchestra.run.smithi125.stdout:2 2023-10-03T10:09:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 msgr2=0x7fceac1373b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fce9c009d40 tx=0x7fce9c012040).stop 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 shutdown_connections 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fceac13b5f0 0x7fceac13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce94004b80 0x7fceac1373b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 --2- 172.21.15.125:0/3067050415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fceac1378a0 0x7fceac137c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 >> 172.21.15.125:0/3067050415 conn(0x7fceac099820 msgr2=0x7fceac0950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 shutdown_connections 2023-10-03T10:09:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.071+0000 7fceb2e4a700 1 -- 172.21.15.125:0/3067050415 wait complete. 2023-10-03T10:09:00.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 337de985-5ba4-41db-9d64-832f9a8393ca 3 2023-10-03T10:09:00.114 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.113+0000 7fc2bf4ca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:09:00.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.199+0000 7fd953edd700 1 Processor -- start 2023-10-03T10:09:00.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 -- start start 2023-10-03T10:09:00.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 0x7fd94c123a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c092820 con 0x7fd94c092440 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c097eb0 con 0x7fd94c127390 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.200+0000 7fd953edd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c069760 con 0x7fd94c126f70 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951c79700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd95247a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951c79700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52072/0 (socket says 172.21.15.125:52072) 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd95247a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35124/0 (socket says 172.21.15.125:35124) 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951c79700 1 -- 172.21.15.125:0/135851474 learned_addr learned my addr 172.21.15.125:0/135851474 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 0x7fd94c123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 -- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 msgr2=0x7fd94c123f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 -- 172.21.15.125:0/135851474 >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 msgr2=0x7fd94c127910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 --2- 172.21.15.125:0/135851474 >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 -- 172.21.15.125:0/135851474 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c091980 con 0x7fd94c126f70 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951c79700 1 --2- 172.21.15.125:0/135851474 >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd95247a700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd951478700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 0x7fd94c123a90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd93c009790 tx=0x7fd93c009060).ready entity=mon.2 client_cookie=5a5770085b9c1f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd950c77700 1 -- 172.21.15.125:0/135851474 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0090d0 con 0x7fd94c126f70 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd950c77700 1 -- 172.21.15.125:0/135851474 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c00d4a0 con 0x7fd94c126f70 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.201+0000 7fd950c77700 1 -- 172.21.15.125:0/135851474 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c00d820 con 0x7fd94c126f70 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 -- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 msgr2=0x7fd94c123a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 0x7fd94c123a90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd93c009790 tx=0x7fd93c009060).stop 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 -- 172.21.15.125:0/135851474 shutdown_connections 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c127390 0x7fd94c123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 --2- 172.21.15.125:0/135851474 >> v2:172.21.15.125:3300/0 conn(0x7fd94c092440 0x7fd94c127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 --2- 172.21.15.125:0/135851474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c126f70 0x7fd94c123a90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 -- 172.21.15.125:0/135851474 >> 172.21.15.125:0/135851474 conn(0x7fd94c09a1c0 msgr2=0x7fd94c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 -- 172.21.15.125:0/135851474 shutdown_connections 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.202+0000 7fd953edd700 1 -- 172.21.15.125:0/135851474 wait complete. 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 Processor -- start 2023-10-03T10:09:00.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 -- start start 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd94c126f70 0x7fd94c128630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c127390 0x7fd94c128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c129010 con 0x7fd94c126f70 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c126010 con 0x7fd94c092440 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd953edd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0977d0 con 0x7fd94c127390 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd951c79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd95247a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c127390 0x7fd94c128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd951c79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35136/0 (socket says 172.21.15.125:35136) 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.203+0000 7fd951c79700 1 -- 172.21.15.125:0/2681795293 learned_addr learned my addr 172.21.15.125:0/2681795293 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 -- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c127390 msgr2=0x7fd94c128b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c127390 0x7fd94c128b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 -- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd94c126f70 msgr2=0x7fd94c128630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd94c126f70 0x7fd94c128630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 -- 172.21.15.125:0/2681795293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd948009370 con 0x7fd94c092440 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd951c79700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd94800ea20 tx=0x7fd9480090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800c850 con 0x7fd94c092440 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800c9b0 con 0x7fd94c092440 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800cd30 con 0x7fd94c092440 2023-10-03T10:09:00.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd944009a20 con 0x7fd94c092440 2023-10-03T10:09:00.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd948012860 con 0x7fd94c092440 2023-10-03T10:09:00.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0092a0 con 0x7fd94c092440 2023-10-03T10:09:00.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.204+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fd948012d40 con 0x7fd94c092440 2023-10-03T10:09:00.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.205+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c05a260 con 0x7fd94c092440 2023-10-03T10:09:00.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.207+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd948016020 con 0x7fd94c092440 2023-10-03T10:09:00.253 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.252+0000 7fc2bf4ca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:09:00.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.286+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "337de985-5ba4-41db-9d64-832f9a8393ca", "id": 3} v 0) v1 -- 0x7fd94c046c20 con 0x7fd94c092440 2023-10-03T10:09:00.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.294+0000 7fd941ffb700 1 -- 172.21.15.125:0/2681795293 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "337de985-5ba4-41db-9d64-832f9a8393ca", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd948025480 con 0x7fd94c092440 2023-10-03T10:09:00.295 INFO:teuthology.orchestra.run.smithi125.stdout:3 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 msgr2=0x7fd94c128140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd94800ea20 tx=0x7fd9480090f0).stop 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 shutdown_connections 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd94c127390 0x7fd94c128b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd94c092440 0x7fd94c128140 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 --2- 172.21.15.125:0/2681795293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd94c126f70 0x7fd94c128630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:00.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 >> 172.21.15.125:0/2681795293 conn(0x7fd94c09a1c0 msgr2=0x7fd94c124e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:00.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 shutdown_connections 2023-10-03T10:09:00.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.295+0000 7fd953edd700 1 -- 172.21.15.125:0/2681795293 wait complete. 2023-10-03T10:09:00.307 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:09:00.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:09:00.349 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:09:00.349 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:09:00.350 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:09:00.352 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:09:00.352 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:09:00.352 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:09:00.354 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:09:00.354 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:09:00.355 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:09:00.357 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:09:00.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:00.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.505+0000 7f0240d93700 1 Processor -- start 2023-10-03T10:09:00.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.505+0000 7f0240d93700 1 -- start start 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f023c062b00 0x7f023c1257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 0x7f023c125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c062ee0 con 0x7f023c062b00 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0969c0 con 0x7f023c093b90 2023-10-03T10:09:00.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0240d93700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023c095950 con 0x7f023c125330 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f023c062b00 0x7f023c1257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0239d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 0x7f023c125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f023c062b00 0x7f023c1257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52104/0 (socket says 172.21.15.125:52104) 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 -- 172.21.15.125:0/4282539761 learned_addr learned my addr 172.21.15.125:0/4282539761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35172/0 (socket says 172.21.15.125:35172) 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 -- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 msgr2=0x7f023c125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 0x7f023c125cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 -- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 msgr2=0x7f023c094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 -- 172.21.15.125:0/4282539761 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0635f0 con 0x7f023c062b00 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f0239d9b700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 0x7f023c125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023ad9d700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.506+0000 7f023a59c700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c1257c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f022c00dc50 tx=0x7f022c00d5b0).ready entity=mon.0 client_cookie=c579a87d5666062e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f023959a700 1 -- 172.21.15.125:0/4282539761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c012070 con 0x7f023c062b00 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f023959a700 1 -- 172.21.15.125:0/4282539761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c00d2e0 con 0x7f023c062b00 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f023959a700 1 -- 172.21.15.125:0/4282539761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00f860 con 0x7f023c062b00 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 -- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 msgr2=0x7f023c1257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c1257c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f022c00dc50 tx=0x7f022c00d5b0).stop 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 -- 172.21.15.125:0/4282539761 shutdown_connections 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c093b90 0x7f023c094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c1257c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 --2- 172.21.15.125:0/4282539761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c125330 0x7f023c125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 -- 172.21.15.125:0/4282539761 >> 172.21.15.125:0/4282539761 conn(0x7f023c09aa50 msgr2=0x7f023c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:00.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 -- 172.21.15.125:0/4282539761 shutdown_connections 2023-10-03T10:09:00.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.507+0000 7f0240d93700 1 -- 172.21.15.125:0/4282539761 wait complete. 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 Processor -- start 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 -- start start 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 0x7f023c0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:00.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c069310 con 0x7f023c062b00 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c06a330 con 0x7f023c069ed0 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.508+0000 7f0240d93700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023c112c80 con 0x7f023c093b90 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35182/0 (socket says 172.21.15.125:35182) 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 -- 172.21.15.125:0/1838636262 learned_addr learned my addr 172.21.15.125:0/1838636262 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f0239d9b700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 0x7f023c0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 -- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 msgr2=0x7f023c0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 0x7f023c0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 -- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 msgr2=0x7f023c0694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c0694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 -- 172.21.15.125:0/1838636262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0234009a20 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023a59c700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c0694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f0239d9b700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 0x7f023c0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f023ad9d700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0234009fc0 tx=0x7f023400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400cbd0 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400f040 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300092a0 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234013400 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c00d810 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0234013a50 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.509+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f0234013d00 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.510+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c05a260 con 0x7f023c069ed0 2023-10-03T10:09:00.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.513+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0234027480 con 0x7f023c069ed0 2023-10-03T10:09:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.578+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f023c113250 con 0x7f023c069ed0 2023-10-03T10:09:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.579+0000 7f022a7fc700 1 -- 172.21.15.125:0/1838636262 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f02340263d0 con 0x7f023c069ed0 2023-10-03T10:09:00.579 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:00.579 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":6,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:00.288581+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 msgr2=0x7f023c135dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0234009fc0 tx=0x7f023400b040).stop 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 shutdown_connections 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f023c069ed0 0x7f023c135dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f023c062b00 0x7f023c0694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 --2- 172.21.15.125:0/1838636262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f023c093b90 0x7f023c0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 >> 172.21.15.125:0/1838636262 conn(0x7f023c09aa50 msgr2=0x7f023c092d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 shutdown_connections 2023-10-03T10:09:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:00.580+0000 7f0240d93700 1 -- 172.21.15.125:0/1838636262 wait complete. 2023-10-03T10:09:00.592 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T10:09:00.592 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T10:09:00.720 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.719+0000 7fc2bf4ca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:09:00.891 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.891+0000 7fc2bf4ca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:00.955 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:00.955+0000 7fc2bf4ca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:00.958 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:09:00.957+0000 7f9cdbd06200 -1 Falling back to public interface 2023-10-03T10:09:00.967 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:09:00.966+0000 7f564357f200 -1 Falling back to public interface 2023-10-03T10:09:00.982 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:09:00.981+0000 7fbc769bf200 -1 Falling back to public interface 2023-10-03T10:09:00.982 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:09:00.982+0000 7f8687232200 -1 Falling back to public interface 2023-10-03T10:09:00.995 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:01.038 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:01.038+0000 7fc2bf4ca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:09:01.103 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.103+0000 7f400118f700 1 Processor -- start 2023-10-03T10:09:01.104 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.103+0000 7f400118f700 1 -- start start 2023-10-03T10:09:01.106 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.103+0000 7f400118f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ffc062850 0x7f3ffc1275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.106 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.103+0000 7f400118f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.106 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f400118f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc0957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.106 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f400118f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc062c30 con 0x7f3ffc062850 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f400118f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc091ec0 con 0x7f3ffc127be0 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f400118f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc094ed0 con 0x7f3ffc095310 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ffc062850 0x7f3ffc1275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc0957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35192/0 (socket says 172.21.15.125:35192) 2023-10-03T10:09:01.107 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ffc062850 0x7f3ffc1275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52134/0 (socket says 172.21.15.125:52134) 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffa59c700 1 -- 172.21.15.125:0/1644524380 learned_addr learned my addr 172.21.15.125:0/1644524380 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 -- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 msgr2=0x7f3ffc0957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc0957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 -- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 msgr2=0x7f3ffc128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 -- 172.21.15.125:0/1644524380 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc091b00 con 0x7f3ffc062850 2023-10-03T10:09:01.108 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffb59e700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc0957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffa59c700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ffad9d700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc062850 0x7f3ffc1275c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3fec009790 tx=0x7f3fec009060).ready entity=mon.0 client_cookie=3f01399656d36cee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ff9d9b700 1 -- 172.21.15.125:0/1644524380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00d4a0 con 0x7f3ffc062850 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ff9d9b700 1 -- 172.21.15.125:0/1644524380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec00d600 con 0x7f3ffc062850 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.104+0000 7f3ff9d9b700 1 -- 172.21.15.125:0/1644524380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00d980 con 0x7f3ffc062850 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 -- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc062850 msgr2=0x7f3ffc1275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:01.109 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc062850 0x7f3ffc1275c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3fec009790 tx=0x7f3fec009060).stop 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 -- 172.21.15.125:0/1644524380 shutdown_connections 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc0957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc062850 0x7f3ffc1275c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 --2- 172.21.15.125:0/1644524380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc127be0 0x7f3ffc128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 -- 172.21.15.125:0/1644524380 >> 172.21.15.125:0/1644524380 conn(0x7f3ffc05ee70 msgr2=0x7f3ffc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 -- 172.21.15.125:0/1644524380 shutdown_connections 2023-10-03T10:09:01.110 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.105+0000 7f400118f700 1 -- 172.21.15.125:0/1644524380 wait complete. 2023-10-03T10:09:01.112 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.106+0000 7f400118f700 1 Processor -- start 2023-10-03T10:09:01.112 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.106+0000 7f400118f700 1 -- start start 2023-10-03T10:09:01.112 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc13a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc13aeb0 0x7f3ffc067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc116310 con 0x7f3ffc127be0 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc127080 con 0x7f3ffc13aeb0 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f400118f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc09b540 con 0x7f3ffc095310 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc13a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.113 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52136/0 (socket says 172.21.15.125:52136) 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 -- 172.21.15.125:0/921297860 learned_addr learned my addr 172.21.15.125:0/921297860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffb59e700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc13aeb0 0x7f3ffc067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 -- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 msgr2=0x7f3ffc13a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc13a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 -- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc13aeb0 msgr2=0x7f3ffc067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc13aeb0 0x7f3ffc067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.114 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.107+0000 7f3ffa59c700 1 -- 172.21.15.125:0/921297860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4009a20 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3ffa59c700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3ff000ea20 tx=0x7f3ff00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000c7f0 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff000c950 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff0009370 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000ccd0 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0092a0 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3ff0012860 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.108+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f3ff001b910 con 0x7f3ffc127be0 2023-10-03T10:09:01.115 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.109+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc05a260 con 0x7f3ffc127be0 2023-10-03T10:09:01.116 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:01.111+0000 7fc2bf4ca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:09:01.116 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.111+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3ff003ae50 con 0x7f3ffc127be0 2023-10-03T10:09:01.177 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.177+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ffc046c20 con 0x7f3ffc127be0 2023-10-03T10:09:01.178 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.177+0000 7f3fe2ffd700 1 -- 172.21.15.125:0/921297860 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f3ff0029030 con 0x7f3ffc127be0 2023-10-03T10:09:01.178 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-03T10:09:01.178 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":6,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:00.288581+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 msgr2=0x7f3ffc13a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3ff000ea20 tx=0x7f3ff00090f0).stop 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 shutdown_connections 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ffc13aeb0 0x7f3ffc067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ffc095310 0x7f3ffc13a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 --2- 172.21.15.125:0/921297860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ffc127be0 0x7f3ffc13a9c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:01.179 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 >> 172.21.15.125:0/921297860 conn(0x7f3ffc062850 msgr2=0x7f3ffc098f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:01.180 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 shutdown_connections 2023-10-03T10:09:01.180 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:01.178+0000 7f400118f700 1 -- 172.21.15.125:0/921297860 wait complete. 2023-10-03T10:09:01.190 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-03T10:09:01.458 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:01.458+0000 7fc2bf4ca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:09:01.542 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:01.542+0000 7fc2bf4ca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:02.168 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.168+0000 7fc2bf4ca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:09:02.236 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.235+0000 7fc2bf4ca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:09:02.313 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.312+0000 7fc2bf4ca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:09:02.610 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.610+0000 7fc2bf4ca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:09:02.682 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.681+0000 7fc2bf4ca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:09:02.796 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.796+0000 7fc2bf4ca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:09:02.905 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:02.905+0000 7fc2bf4ca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:03.052 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:03.052+0000 7fc2bf4ca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:09:03.121 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:03.121+0000 7fc2bf4ca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:09:04.142 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:04.141+0000 7fc275f07700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:09:04.219 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:09:04.142+0000 7fc275f07700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:09:04.467 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:09:04.467+0000 7f9cdbd06200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-03T10:09:04.475 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:09:04.475+0000 7f564357f200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-03T10:09:04.511 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:09:04.510+0000 7fbc769bf200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-03T10:09:04.518 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:09:04.518+0000 7f8687232200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-03T10:09:06.151 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:09:06.151+0000 7fbc6d360700 -1 osd.3 0 waiting for initial osdmap 2023-10-03T10:09:06.153 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:09:06.153+0000 7f9cd26a7700 -1 osd.1 0 waiting for initial osdmap 2023-10-03T10:09:06.155 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:09:06.155+0000 7f5639f20700 -1 osd.2 0 waiting for initial osdmap 2023-10-03T10:09:06.157 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:09:06.157+0000 7f867dbd3700 -1 osd.0 0 waiting for initial osdmap 2023-10-03T10:09:06.161 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:09:06.161+0000 7f9ccee23700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:06.164 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:09:06.164+0000 7f563669c700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:06.165 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:09:06.164+0000 7fbc69adc700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:06.165 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:09:06.164+0000 7f867a34f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:07.593 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:07.705 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.705+0000 7f13d08a6700 1 Processor -- start 2023-10-03T10:09:07.706 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.705+0000 7f13d08a6700 1 -- start start 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13d08a6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13d08a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13d08a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc093360 con 0x7f13cc091e70 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13d08a6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc06a220 con 0x7f13cc069050 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13d08a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc065b80 con 0x7f13cc069920 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:07.708 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13ca59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58008/0 (socket says 172.21.15.125:58008) 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13ca59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34556/0 (socket says 172.21.15.125:34556) 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13cad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13cc091e70 0x7f13cc12e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43864/0 (socket says 172.21.15.125:43864) 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 -- 172.21.15.125:0/2312326638 learned_addr learned my addr 172.21.15.125:0/2312326638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c959a700 1 -- 172.21.15.125:0/2312326638 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217627959 0 0) 0x7f13cc093360 con 0x7f13cc091e70 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c959a700 1 -- 172.21.15.125:0/2312326638 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b40033f0 con 0x7f13cc091e70 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 -- 172.21.15.125:0/2312326638 >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 msgr2=0x7f13cc069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 --2- 172.21.15.125:0/2312326638 >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 -- 172.21.15.125:0/2312326638 >> v1:172.21.15.125:6789/0 conn(0x7f13cc091e70 legacy=0x7f13cc12e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 -- 172.21.15.125:0/2312326638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc065e20 con 0x7f13cc069920 2023-10-03T10:09:07.709 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13ca59c700 1 --2- 172.21.15.125:0/2312326638 >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c9d9b700 1 --2- 172.21.15.125:0/2312326638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f13bc006fd0 tx=0x7f13bc0090f0).ready entity=mon.2 client_cookie=60e5ffaa345190c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c959a700 1 -- 172.21.15.125:0/2312326638 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00f510 con 0x7f13cc069920 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c959a700 1 -- 172.21.15.125:0/2312326638 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00f670 con 0x7f13cc069920 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.706+0000 7f13c959a700 1 -- 172.21.15.125:0/2312326638 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00fa10 con 0x7f13cc069920 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 -- 172.21.15.125:0/2312326638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 msgr2=0x7f13cc091980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 --2- 172.21.15.125:0/2312326638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f13bc006fd0 tx=0x7f13bc0090f0).stop 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 -- 172.21.15.125:0/2312326638 shutdown_connections 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 --2- 172.21.15.125:0/2312326638 >> v2:172.21.15.125:3300/0 conn(0x7f13cc069050 0x7f13cc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 --2- 172.21.15.125:0/2312326638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc069920 0x7f13cc091980 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 -- 172.21.15.125:0/2312326638 >> 172.21.15.125:0/2312326638 conn(0x7f13cc096480 msgr2=0x7f13cc096890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 -- 172.21.15.125:0/2312326638 shutdown_connections 2023-10-03T10:09:07.710 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.707+0000 7f13d08a6700 1 -- 172.21.15.125:0/2312326638 wait complete. 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 Processor -- start 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 -- start start 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13cc069050 0x7f13cc115f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 0x7f13cc116910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0616b0 con 0x7f13cc069920 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc118fb0 con 0x7f13cc069050 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13d08a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc06a470 con 0x7f13cc091e70 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13c9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13cad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 0x7f13cc116910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13c9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34560/0 (socket says 172.21.15.125:34560) 2023-10-03T10:09:07.713 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.708+0000 7f13c9d9b700 1 -- 172.21.15.125:0/1750064575 learned_addr learned my addr 172.21.15.125:0/1750064575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13ca59c700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13cc069050 0x7f13cc115f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 -- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 msgr2=0x7f13cc116910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 0x7f13cc116910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 -- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13cc069050 msgr2=0x7f13cc115f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13cc069050 0x7f13cc115f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 -- 172.21.15.125:0/1750064575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00092a0 con 0x7f13cc069920 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13cad9d700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 0x7f13cc116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13c9d9b700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f13cc065cc0 tx=0x7f13bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc01f070 con 0x7f13cc069920 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc006970 con 0x7f13cc069920 2023-10-03T10:09:07.714 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc009370 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00f7e0 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.709+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc119970 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.710+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f13bc011400 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.710+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f13bc03d920 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.710+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc097c20 con 0x7f13cc069920 2023-10-03T10:09:07.715 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.715+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f13bc028030 con 0x7f13cc069920 2023-10-03T10:09:07.873 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.873+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13cc118da0 con 0x7f13cc069920 2023-10-03T10:09:07.874 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.873+0000 7f13ba7fc700 1 -- 172.21.15.125:0/1750064575 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4968 (secure 0 0 0) 0x7f13bc028030 con 0x7f13cc069920 2023-10-03T10:09:07.874 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-03T10:09:07.874 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":9,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:07.150639+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 >> v1:172.21.15.125:6816/118167 conn(0x7f13ac02bb60 legacy=0x7f13ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 msgr2=0x7f13cc116420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f13cc065cc0 tx=0x7f13bc017000).stop 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 shutdown_connections 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13cc091e70 0x7f13cc116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13cc069050 0x7f13cc115f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 --2- 172.21.15.125:0/1750064575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13cc069920 0x7f13cc116420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 >> 172.21.15.125:0/1750064575 conn(0x7f13cc096480 msgr2=0x7f13cc068450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 shutdown_connections 2023-10-03T10:09:07.876 INFO:teuthology.misc.health.smithi125.stderr:2023-10-03T10:09:07.875+0000 7f13d08a6700 1 -- 172.21.15.125:0/1750064575 wait complete. 2023-10-03T10:09:07.886 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-03T10:09:07.886 INFO:tasks.ceph:Creating RBD pool 2023-10-03T10:09:07.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T10:09:08.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 Processor -- start 2023-10-03T10:09:08.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 -- start start 2023-10-03T10:09:08.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:08.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb87412dc50 0x7fb874130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:08.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874095950 con 0x7fb874062b00 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb874062ee0 con 0x7fb87412dc50 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb878fac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740969c0 con 0x7fb874125330 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb872d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb87412dc50 0x7fb874130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb871d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb871d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58016/0 (socket says 172.21.15.125:58016) 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb872d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb87412dc50 0x7fb874130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34574/0 (socket says 172.21.15.125:34574) 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb87259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb874062b00 0x7fb8741257c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43866/0 (socket says 172.21.15.125:43866) 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.004+0000 7fb871d9b700 1 -- 172.21.15.125:0/3747060058 learned_addr learned my addr 172.21.15.125:0/3747060058 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb872d9d700 1 -- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 msgr2=0x7fb874125ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb872d9d700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:08.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb872d9d700 1 -- 172.21.15.125:0/3747060058 >> v1:172.21.15.125:6789/0 conn(0x7fb874062b00 legacy=0x7fb8741257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb872d9d700 1 -- 172.21.15.125:0/3747060058 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740635f0 con 0x7fb87412dc50 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb87159a700 1 -- 172.21.15.125:0/3747060058 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855214960 0 0) 0x7fb874095950 con 0x7fb874062b00 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb871d9b700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb872d9d700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb87412dc50 0x7fb874130040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb86c009e60 tx=0x7fb86c009780).ready entity=mon.0 client_cookie=6acf9e761e1be5ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb87159a700 1 -- 172.21.15.125:0/3747060058 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00e070 con 0x7fb87412dc50 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb87159a700 1 -- 172.21.15.125:0/3747060058 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00bb60 con 0x7fb87412dc50 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb87159a700 1 -- 172.21.15.125:0/3747060058 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c012410 con 0x7fb87412dc50 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 -- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb87412dc50 msgr2=0x7fb874130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb87412dc50 0x7fb874130040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb86c009e60 tx=0x7fb86c009780).stop 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 -- 172.21.15.125:0/3747060058 shutdown_connections 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb87412dc50 0x7fb874130040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:08.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 --2- 172.21.15.125:0/3747060058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb874125330 0x7fb874125ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:08.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.005+0000 7fb878fac700 1 -- 172.21.15.125:0/3747060058 >> 172.21.15.125:0/3747060058 conn(0x7fb87409aa50 msgr2=0x7fb87409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:08.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.006+0000 7fb878fac700 1 -- 172.21.15.125:0/3747060058 shutdown_connections 2023-10-03T10:09:08.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.006+0000 7fb878fac700 1 -- 172.21.15.125:0/3747060058 wait complete. 2023-10-03T10:09:08.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.006+0000 7fb878fac700 1 Processor -- start 2023-10-03T10:09:08.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.006+0000 7fb878fac700 1 -- start start 2023-10-03T10:09:08.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:08.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:08.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87412c2f0 0x7fb87412c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874069a50 con 0x7fb874062b00 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740685c0 con 0x7fb87412c2f0 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87412b220 con 0x7fb87412dc50 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb871d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34580/0 (socket says 172.21.15.125:34580) 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 -- 172.21.15.125:0/3931517257 learned_addr learned my addr 172.21.15.125:0/3931517257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb871d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58032/0 (socket says 172.21.15.125:58032) 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb872d9d700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87412c2f0 0x7fb87412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:08.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 -- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 msgr2=0x7fb87412be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 -- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87412c2f0 msgr2=0x7fb87412c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87412c2f0 0x7fb87412c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 -- 172.21.15.125:0/3931517257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009370 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb871d9b700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb87259c700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb86800c4c0 tx=0x7fb868007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800ce30 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8680072e0 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c009a20 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8680056e0 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.007+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87412aff0 con 0x7fb874062b00 2023-10-03T10:09:08.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.008+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb868005a50 con 0x7fb874062b00 2023-10-03T10:09:08.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.008+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7fb868039f90 con 0x7fb874062b00 2023-10-03T10:09:08.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.009+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87405a260 con 0x7fb874062b00 2023-10-03T10:09:08.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.013+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb86801c350 con 0x7fb874062b00 2023-10-03T10:09:08.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:08.176+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb87409a050 con 0x7fb874062b00 2023-10-03T10:09:09.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.178+0000 7fb8627fc700 1 -- 172.21.15.125:0/3931517257 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb868010ab0 con 0x7fb874062b00 2023-10-03T10:09:09.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.182+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 >> v1:172.21.15.125:6816/118167 conn(0x7fb85402bb90 legacy=0x7fb85402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:09.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.182+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 msgr2=0x7fb87412d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:09.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.182+0000 7fb878fac700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb86800c4c0 tx=0x7fb868007c10).stop 2023-10-03T10:09:09.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 shutdown_connections 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87412c2f0 0x7fb87412c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874062b00 0x7fb87412d700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 --2- 172.21.15.125:0/3931517257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb87412dc50 0x7fb87412be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 >> 172.21.15.125:0/3931517257 conn(0x7fb87409aa50 msgr2=0x7fb8741249b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 shutdown_connections 2023-10-03T10:09:09.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.183+0000 7fb878fac700 1 -- 172.21.15.125:0/3931517257 wait complete. 2023-10-03T10:09:09.185 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'rbd' created 2023-10-03T10:09:09.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T10:09:09.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 Processor -- start 2023-10-03T10:09:09.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 -- start start 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f463c094770 0x7f463c094b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c096170 con 0x7f463c094770 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0985f0 con 0x7f463c095d90 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f4642419700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0982b0 con 0x7f463c095040 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f46409b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.321+0000 7f463bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58046/0 (socket says 172.21.15.125:58046) 2023-10-03T10:09:09.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42932/0 (socket says 172.21.15.125:42932) 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 -- 172.21.15.125:0/342784707 learned_addr learned my addr 172.21.15.125:0/342784707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463b7fe700 1 --2- 172.21.15.125:0/342784707 >> v2:172.21.15.125:3300/0 conn(0x7f463c094770 0x7f463c094b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 -- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 msgr2=0x7f463c094280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 -- 172.21.15.125:0/342784707 >> v2:172.21.15.125:3300/0 conn(0x7f463c094770 msgr2=0x7f463c094b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 --2- 172.21.15.125:0/342784707 >> v2:172.21.15.125:3300/0 conn(0x7f463c094770 0x7f463c094b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 -- 172.21.15.125:0/342784707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c093ba0 con 0x7f463c095040 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463bfff700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f46409b6700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4634009f50 tx=0x7f4634009840).ready entity=mon.2 client_cookie=cc50aae3d6c773f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463affd700 1 -- 172.21.15.125:0/342784707 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400e070 con 0x7f463c095040 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463affd700 1 -- 172.21.15.125:0/342784707 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400b910 con 0x7f463c095040 2023-10-03T10:09:09.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.322+0000 7f463affd700 1 -- 172.21.15.125:0/342784707 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400bc90 con 0x7f463c095040 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 -- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 msgr2=0x7f463c12f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4634009f50 tx=0x7f4634009840).stop 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 -- 172.21.15.125:0/342784707 shutdown_connections 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095d90 0x7f463c094280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 --2- 172.21.15.125:0/342784707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c095040 0x7f463c12f4b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 --2- 172.21.15.125:0/342784707 >> v2:172.21.15.125:3300/0 conn(0x7f463c094770 0x7f463c094b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 -- 172.21.15.125:0/342784707 >> 172.21.15.125:0/342784707 conn(0x7f463c09bc50 msgr2=0x7f463c09c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 -- 172.21.15.125:0/342784707 shutdown_connections 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 -- 172.21.15.125:0/342784707 wait complete. 2023-10-03T10:09:09.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.323+0000 7f4642419700 1 Processor -- start 2023-10-03T10:09:09.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 -- start start 2023-10-03T10:09:09.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 0x7f463c065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 0x7f463c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c09ab50 con 0x7f463c095d90 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c097b20 con 0x7f463c095040 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f4642419700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463c064ad0 con 0x7f463c094770 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 0x7f463c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58050/0 (socket says 172.21.15.125:58050) 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463bfff700 1 -- 172.21.15.125:0/998696767 learned_addr learned my addr 172.21.15.125:0/998696767 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463b7fe700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 0x7f463c065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 -- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 msgr2=0x7f463c064d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 -- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 msgr2=0x7f463c065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 0x7f463c065250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f46409b6700 1 -- 172.21.15.125:0/998696767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300092a0 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463b7fe700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 0x7f463c065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.324+0000 7f463bfff700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f46409b6700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 0x7f463c065740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4634009f50 tx=0x7f463c0954b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634007080 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340092e0 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4634009ae0 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463401e470 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c11e8a0 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.325+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4634003040 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.326+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7f463403bf30 con 0x7f463c095d90 2023-10-03T10:09:09.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.326+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c05a260 con 0x7f463c095d90 2023-10-03T10:09:09.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.330+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4634023080 con 0x7f463c095d90 2023-10-03T10:09:09.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:09.493+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f463c046c20 con 0x7f463c095d90 2023-10-03T10:09:10.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.178+0000 7f4623fff700 1 -- 172.21.15.125:0/998696767 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4634011370 con 0x7f463c095d90 2023-10-03T10:09:10.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.180+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 >> v1:172.21.15.125:6816/118167 conn(0x7f462802bb60 legacy=0x7f462802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 msgr2=0x7f463c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 0x7f463c065740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4634009f50 tx=0x7f463c0954b0).stop 2023-10-03T10:09:10.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 shutdown_connections 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f463c095d90 0x7f463c065740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f463c094770 0x7f463c064d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 --2- 172.21.15.125:0/998696767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f463c095040 0x7f463c065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.181+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 >> 172.21.15.125:0/998696767 conn(0x7f463c09bc50 msgr2=0x7f463c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.182+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 shutdown_connections 2023-10-03T10:09:10.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.182+0000 7f4642419700 1 -- 172.21.15.125:0/998696767 wait complete. 2023-10-03T10:09:10.183 INFO:teuthology.orchestra.run.smithi125.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T10:09:10.198 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T10:09:10.199 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:09:10.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:09:10.201 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:09:10.202 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T10:09:10.202 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:10.281 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-03T10:09:10.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 Processor -- start 2023-10-03T10:09:10.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 -- start start 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c069090 con 0x7fd06c128a10 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0694e0 con 0x7fd06c066e30 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd072ec5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c094130 con 0x7fd06c068680 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd070c61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd06bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd071462700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd06bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58080/0 (socket says 172.21.15.125:58080) 2023-10-03T10:09:10.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd071462700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34600/0 (socket says 172.21.15.125:34600) 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd070c61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42950/0 (socket says 172.21.15.125:42950) 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.327+0000 7fd06bfff700 1 -- 172.21.15.125:0/2902057699 learned_addr learned my addr 172.21.15.125:0/2902057699 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 -- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 msgr2=0x7fd06c067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 -- 172.21.15.125:0/2902057699 >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 msgr2=0x7fd06c128ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 --2- 172.21.15.125:0/2902057699 >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 -- 172.21.15.125:0/2902057699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c069a10 con 0x7fd06c066e30 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd06bfff700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd071462700 1 --2- 172.21.15.125:0/2902057699 >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd070c61700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd060009760 tx=0x7fd060009060).ready entity=mon.1 client_cookie=5a75b52fe1bf5343 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd06b7fe700 1 -- 172.21.15.125:0/2902057699 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600090d0 con 0x7fd06c066e30 2023-10-03T10:09:10.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd06b7fe700 1 -- 172.21.15.125:0/2902057699 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000d4a0 con 0x7fd06c066e30 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd06b7fe700 1 -- 172.21.15.125:0/2902057699 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000d820 con 0x7fd06c066e30 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 -- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 msgr2=0x7fd06c067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd060009760 tx=0x7fd060009060).stop 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 -- 172.21.15.125:0/2902057699 shutdown_connections 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c067210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2902057699 >> v2:172.21.15.125:3300/0 conn(0x7fd06c128a10 0x7fd06c128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2902057699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.328+0000 7fd072ec5700 1 -- 172.21.15.125:0/2902057699 >> 172.21.15.125:0/2902057699 conn(0x7fd06c09a230 msgr2=0x7fd06c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.329+0000 7fd072ec5700 1 -- 172.21.15.125:0/2902057699 shutdown_connections 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.329+0000 7fd072ec5700 1 -- 172.21.15.125:0/2902057699 wait complete. 2023-10-03T10:09:10.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.329+0000 7fd072ec5700 1 Processor -- start 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 -- start start 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 0x7fd06c115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c118890 con 0x7fd06c128a10 2023-10-03T10:09:10.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c1285f0 con 0x7fd06c066e30 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd072ec5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0691e0 con 0x7fd06c068680 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd06bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42952/0 (socket says 172.21.15.125:42952) 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 -- 172.21.15.125:0/2464967257 learned_addr learned my addr 172.21.15.125:0/2464967257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd071462700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 0x7fd06c115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 -- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 msgr2=0x7fd06c115850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c115850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 -- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 msgr2=0x7fd06c115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 0x7fd06c115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd070c61700 1 -- 172.21.15.125:0/2464967257 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009370 con 0x7fd06c066e30 2023-10-03T10:09:10.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd071462700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 0x7fd06c115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.330+0000 7fd06bfff700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c115850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd070c61700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd06c06a960 tx=0x7fd060016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060006910 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0600127f0 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060012b70 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd064009a20 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600092a0 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.331+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd060026460 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.332+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd06003bfb0 con 0x7fd06c066e30 2023-10-03T10:09:10.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.332+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c1297f0 con 0x7fd06c066e30 2023-10-03T10:09:10.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.336+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd0600259b0 con 0x7fd06c066e30 2023-10-03T10:09:10.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.496+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd06c1186d0 con 0x7fd06c066e30 2023-10-03T10:09:10.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.497+0000 7fd068ff9700 1 -- 172.21.15.125:0/2464967257 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8169 (secure 0 0 0) 0x7fd060034090 con 0x7fd06c066e30 2023-10-03T10:09:10.497 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:10.497 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":12,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:10.175012+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 >> v1:172.21.15.125:6816/118167 conn(0x7fd05002bb90 legacy=0x7fd05002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 msgr2=0x7fd06c115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd06c06a960 tx=0x7fd060016000).stop 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 shutdown_connections 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd06c128a10 0x7fd06c115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd06c066e30 0x7fd06c115360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 --2- 172.21.15.125:0/2464967257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd06c068680 0x7fd06c115850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 >> 172.21.15.125:0/2464967257 conn(0x7fd06c09a230 msgr2=0x7fd06c12b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 shutdown_connections 2023-10-03T10:09:10.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.499+0000 7fd072ec5700 1 -- 172.21.15.125:0/2464967257 wait complete. 2023-10-03T10:09:10.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:10.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:10.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 Processor -- start 2023-10-03T10:09:10.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 -- start start 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6dbc0985e0 0x7f6dbc0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 0x7f6dbc12f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0964f0 con 0x7f6dbc12f980 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc09a3f0 con 0x7f6dbc0985e0 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dc164a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc095100 con 0x7f6dbc098eb0 2023-10-03T10:09:10.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dbaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6dbc0985e0 0x7f6dbc0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dba7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 0x7f6dbc12f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dbaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6dbc0985e0 0x7f6dbc0989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34626/0 (socket says 172.21.15.125:34626) 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.629+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1899213868 learned_addr learned my addr 172.21.15.125:0/1899213868 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 msgr2=0x7f6dbc12f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dbaffd700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 0x7f6dbc12f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1899213868 >> v1:172.21.15.125:6789/0 conn(0x7f6dbc12f980 legacy=0x7f6dbc131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1899213868 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc099e70 con 0x7f6dbc0985e0 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6db9ffb700 1 -- 172.21.15.125:0/1899213868 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051993726 0 0) 0x7f6dbc0964f0 con 0x7f6dbc12f980 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dba7fc700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 0x7f6dbc12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dbaffd700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc0989c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6dac006fd0 tx=0x7f6dac0090f0).ready entity=mon.0 client_cookie=43bf283366d503d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6db9ffb700 1 -- 172.21.15.125:0/1899213868 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00b580 con 0x7f6dbc0985e0 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6db9ffb700 1 -- 172.21.15.125:0/1899213868 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00b6e0 con 0x7f6dbc0985e0 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6db9ffb700 1 -- 172.21.15.125:0/1899213868 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00ba80 con 0x7f6dbc0985e0 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 -- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 msgr2=0x7f6dbc0989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc0989c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6dac006fd0 tx=0x7f6dac0090f0).stop 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 -- 172.21.15.125:0/1899213868 shutdown_connections 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc0989c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1899213868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc098eb0 0x7f6dbc12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.630+0000 7f6dc164a700 1 -- 172.21.15.125:0/1899213868 >> 172.21.15.125:0/1899213868 conn(0x7f6dbc09dc40 msgr2=0x7f6dbc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.631+0000 7f6dc164a700 1 -- 172.21.15.125:0/1899213868 shutdown_connections 2023-10-03T10:09:10.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.631+0000 7f6dc164a700 1 -- 172.21.15.125:0/1899213868 wait complete. 2023-10-03T10:09:10.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.631+0000 7f6dc164a700 1 Processor -- start 2023-10-03T10:09:10.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 -- start start 2023-10-03T10:09:10.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc11b510 con 0x7f6dbc0985e0 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc11d5a0 con 0x7f6dbc098eb0 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dc164a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc09a0f0 con 0x7f6dbc12f980 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dba7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58118/0 (socket says 172.21.15.125:58118) 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dba7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42954/0 (socket says 172.21.15.125:42954) 2023-10-03T10:09:10.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34634/0 (socket says 172.21.15.125:34634) 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbb7fe700 1 -- 172.21.15.125:0/1822785423 learned_addr learned my addr 172.21.15.125:0/1822785423 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 msgr2=0x7f6dbc11b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 msgr2=0x7f6dbc11ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbaffd700 1 -- 172.21.15.125:0/1822785423 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00092a0 con 0x7f6dbc0985e0 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dbb7fe700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.632+0000 7f6dba7fc700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6dbaffd700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6dac014000 tx=0x7f6dac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00b580 con 0x7f6dbc0985e0 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac006950 con 0x7f6dbc0985e0 2023-10-03T10:09:10.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00be40 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac009370 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc11dad0 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6dac01c630 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.633+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f6dac03c390 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.634+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc05a260 con 0x7f6dbc0985e0 2023-10-03T10:09:10.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.638+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6dac020080 con 0x7f6dbc0985e0 2023-10-03T10:09:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.793+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6dbc0661a0 con 0x7f6dbc0985e0 2023-10-03T10:09:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.794+0000 7f6da2ffd700 1 -- 172.21.15.125:0/1822785423 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6dac029020 con 0x7f6dbc0985e0 2023-10-03T10:09:10.793 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:09:10.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 >> v1:172.21.15.125:6816/118167 conn(0x7f6da802bb60 legacy=0x7f6da802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 msgr2=0x7f6dbc11a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6dac014000 tx=0x7f6dac017000).stop 2023-10-03T10:09:10.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 shutdown_connections 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc12f980 0x7f6dbc11b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc0985e0 0x7f6dbc11a640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 --2- 172.21.15.125:0/1822785423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc098eb0 0x7f6dbc11ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.795+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 >> 172.21.15.125:0/1822785423 conn(0x7f6dbc09dc40 msgr2=0x7f6dbc114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.796+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 shutdown_connections 2023-10-03T10:09:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.796+0000 7f6dc164a700 1 -- 172.21.15.125:0/1822785423 wait complete. 2023-10-03T10:09:10.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:10.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.925+0000 7fc2f5bda700 1 Processor -- start 2023-10-03T10:09:10.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.925+0000 7fc2f5bda700 1 -- start start 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.925+0000 7fc2f5bda700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2f0062b00 0x7fc2f0095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2f5bda700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2f5bda700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f0091980 con 0x7fc2f0096490 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2f5bda700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f00973f0 con 0x7fc2f0062b00 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2f5bda700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0062ee0 con 0x7fc2f0095b80 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2f0062b00 0x7fc2f0095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2f0062b00 0x7fc2f0095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34636/0 (socket says 172.21.15.125:34636) 2023-10-03T10:09:10.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42964/0 (socket says 172.21.15.125:42964) 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2effff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2f0096490 0x7fc2f0131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43894/0 (socket says 172.21.15.125:43894) 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 -- 172.21.15.125:0/267719223 learned_addr learned my addr 172.21.15.125:0/267719223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 -- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 msgr2=0x7fc2f0095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 -- 172.21.15.125:0/267719223 >> v1:172.21.15.125:6789/0 conn(0x7fc2f0096490 legacy=0x7fc2f0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ee7fc700 1 -- 172.21.15.125:0/267719223 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709966257 0 0) 0x7fc2f0091980 con 0x7fc2f0096490 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 -- 172.21.15.125:0/267719223 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0092310 con 0x7fc2f0062b00 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2eeffd700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ef7fe700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0095690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc2e4009830 tx=0x7fc2e40090f0).ready entity=mon.0 client_cookie=39d2e8cf241a3918 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ee7fc700 1 -- 172.21.15.125:0/267719223 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400b580 con 0x7fc2f0062b00 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ee7fc700 1 -- 172.21.15.125:0/267719223 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e400b6e0 con 0x7fc2f0062b00 2023-10-03T10:09:10.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.926+0000 7fc2ee7fc700 1 -- 172.21.15.125:0/267719223 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400ba60 con 0x7fc2f0062b00 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 -- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 msgr2=0x7fc2f0095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0095690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc2e4009830 tx=0x7fc2e40090f0).stop 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 -- 172.21.15.125:0/267719223 shutdown_connections 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0095690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/267719223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f0095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 -- 172.21.15.125:0/267719223 >> 172.21.15.125:0/267719223 conn(0x7fc2f009aa50 msgr2=0x7fc2f009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 -- 172.21.15.125:0/267719223 shutdown_connections 2023-10-03T10:09:10.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.927+0000 7fc2f5bda700 1 -- 172.21.15.125:0/267719223 wait complete. 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 Processor -- start 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 -- start start 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f01157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2f0096490 0x7fc2f0115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01192f0 con 0x7fc2f0062b00 2023-10-03T10:09:10.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0096da0 con 0x7fc2f0095b80 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2f5bda700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0099c20 con 0x7fc2f0096490 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2ef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f01157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2ef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34650/0 (socket says 172.21.15.125:34650) 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2effff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2f0096490 0x7fc2f0115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.928+0000 7fc2ef7fe700 1 -- 172.21.15.125:0/112164817 learned_addr learned my addr 172.21.15.125:0/112164817 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 -- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2f0096490 msgr2=0x7fc2f0115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2f0096490 0x7fc2f0115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 -- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 msgr2=0x7fc2f0119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 -- 172.21.15.125:0/112164817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00092a0 con 0x7fc2f0095b80 2023-10-03T10:09:10.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2ef7fe700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2eeffd700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f01157e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc2e000e950 tx=0x7fc2e0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0009580 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0012600 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e4009370 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00129c0 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.929+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f0118ce0 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.930+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc2e0012d30 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.930+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fc2e003afc0 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.930+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f005fa80 con 0x7fc2f0095b80 2023-10-03T10:09:10.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:10.934+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc2e0019310 con 0x7fc2f0095b80 2023-10-03T10:09:11.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.089+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2f005a260 con 0x7fc2f0095b80 2023-10-03T10:09:11.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.089+0000 7fc2d77fe700 1 -- 172.21.15.125:0/112164817 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2e0011b40 con 0x7fc2f0095b80 2023-10-03T10:09:11.089 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:09:11.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.090+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 >> v1:172.21.15.125:6816/118167 conn(0x7fc2dc02bb90 legacy=0x7fc2dc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 msgr2=0x7fc2f01157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f01157e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc2e000e950 tx=0x7fc2e0009060).stop 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 shutdown_connections 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2f0096490 0x7fc2f0115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f0062b00 0x7fc2f0119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 --2- 172.21.15.125:0/112164817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f0095b80 0x7fc2f01157e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 >> 172.21.15.125:0/112164817 conn(0x7fc2f009aa50 msgr2=0x7fc2f012ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 shutdown_connections 2023-10-03T10:09:11.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.091+0000 7fc2f5bda700 1 -- 172.21.15.125:0/112164817 wait complete. 2023-10-03T10:09:11.102 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:11.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.221+0000 7fdd33fe0700 1 Processor -- start 2023-10-03T10:09:11.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 -- start start 2023-10-03T10:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 0x7fdd2c096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd2c12d250 0x7fdd2c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c094ba0 con 0x7fdd2c093950 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c092e90 con 0x7fdd2c12d250 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd33fe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c096b60 con 0x7fdd2c095e70 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd3157b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 0x7fdd2c096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd31d7c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdd2c093950 0x7fdd2c095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43900/0 (socket says 172.21.15.125:43900) 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd3157b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 0x7fdd2c096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58128/0 (socket says 172.21.15.125:58128) 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd31d7c700 1 -- 172.21.15.125:0/218573222 learned_addr learned my addr 172.21.15.125:0/218573222 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.222+0000 7fdd3257d700 1 --2- 172.21.15.125:0/218573222 >> v2:172.21.15.125:3300/0 conn(0x7fdd2c12d250 0x7fdd2c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd3257d700 1 -- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 msgr2=0x7fdd2c096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd3257d700 1 --2- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 0x7fdd2c096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd3257d700 1 -- 172.21.15.125:0/218573222 >> v1:172.21.15.125:6789/0 conn(0x7fdd2c093950 legacy=0x7fdd2c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd30d7a700 1 -- 172.21.15.125:0/218573222 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564982131 0 0) 0x7fdd2c094ba0 con 0x7fdd2c093950 2023-10-03T10:09:11.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd3257d700 1 -- 172.21.15.125:0/218573222 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c093150 con 0x7fdd2c12d250 2023-10-03T10:09:11.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd3257d700 1 --2- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c12d250 0x7fdd2c12f640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdd24009e60 tx=0x7fdd24009780).ready entity=mon.0 client_cookie=48e3b4de9761752e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd30d7a700 1 -- 172.21.15.125:0/218573222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400e070 con 0x7fdd2c12d250 2023-10-03T10:09:11.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd30d7a700 1 -- 172.21.15.125:0/218573222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2400bb60 con 0x7fdd2c12d250 2023-10-03T10:09:11.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd30d7a700 1 -- 172.21.15.125:0/218573222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24012410 con 0x7fdd2c12d250 2023-10-03T10:09:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 -- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c12d250 msgr2=0x7fdd2c12f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c12d250 0x7fdd2c12f640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdd24009e60 tx=0x7fdd24009780).stop 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 -- 172.21.15.125:0/218573222 shutdown_connections 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c12d250 0x7fdd2c12f640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/218573222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c095e70 0x7fdd2c096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.223+0000 7fdd33fe0700 1 -- 172.21.15.125:0/218573222 >> 172.21.15.125:0/218573222 conn(0x7fdd2c09aa50 msgr2=0x7fdd2c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.224+0000 7fdd33fe0700 1 -- 172.21.15.125:0/218573222 shutdown_connections 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.224+0000 7fdd33fe0700 1 -- 172.21.15.125:0/218573222 wait complete. 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.224+0000 7fdd33fe0700 1 Processor -- start 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.224+0000 7fdd33fe0700 1 -- start start 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 0x7fdd2c119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c12d250 0x7fdd2c11a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c11d3d0 con 0x7fdd2c093950 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c11cfb0 con 0x7fdd2c095e70 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd33fe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c099360 con 0x7fdd2c12d250 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd3157b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 0x7fdd2c119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34660/0 (socket says 172.21.15.125:34660) 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 -- 172.21.15.125:0/2693034720 learned_addr learned my addr 172.21.15.125:0/2693034720 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd3257d700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c12d250 0x7fdd2c11a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 -- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c12d250 msgr2=0x7fdd2c11a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c12d250 0x7fdd2c11a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 -- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 msgr2=0x7fdd2c119ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 0x7fdd2c119ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 -- 172.21.15.125:0/2693034720 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009a20 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd3157b700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 0x7fdd2c119ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.225+0000 7fdd31d7c700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdd1c00c4c0 tx=0x7fdd1c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.226+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00ce30 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.226+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c0072e0 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.226+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c092410 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.226+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0057a0 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.226+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c11bc20 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.227+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c11d8b0 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.227+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdd1c005bd0 con 0x7fdd2c093950 2023-10-03T10:09:11.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.227+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fdd1c03a270 con 0x7fdd2c093950 2023-10-03T10:09:11.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.231+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdd2c11d8b0 con 0x7fdd2c093950 2023-10-03T10:09:11.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.428+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd2c11d8b0 con 0x7fdd2c093950 2023-10-03T10:09:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.428+0000 7fdd21ffb700 1 -- 172.21.15.125:0/2693034720 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7fdd2c11d8b0 con 0x7fdd2c093950 2023-10-03T10:09:11.428 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:11.428 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 >> v1:172.21.15.125:6816/118167 conn(0x7fdd1002bb60 legacy=0x7fdd1002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 msgr2=0x7fdd2c11de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdd1c00c4c0 tx=0x7fdd1c007c10).stop 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 shutdown_connections 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd2c12d250 0x7fdd2c11a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c093950 0x7fdd2c11de70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 --2- 172.21.15.125:0/2693034720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd2c095e70 0x7fdd2c119ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 >> 172.21.15.125:0/2693034720 conn(0x7fdd2c09aa50 msgr2=0x7fdd2c069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 shutdown_connections 2023-10-03T10:09:11.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.430+0000 7fdd33fe0700 1 -- 172.21.15.125:0/2693034720 wait complete. 2023-10-03T10:09:11.431 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 2 2023-10-03T10:09:11.441 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:11.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 Processor -- start 2023-10-03T10:09:11.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 -- start start 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7958093950 0x7f7958095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795812e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7958094ba0 con 0x7f7958093950 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7958092e90 con 0x7f795812c240 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f795dd70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7958096b60 con 0x7f7958095c50 2023-10-03T10:09:11.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f7956ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f79577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7958093950 0x7f7958095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f7956ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58156/0 (socket says 172.21.15.125:58156) 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f7956ffd700 1 -- 172.21.15.125:0/2803408314 learned_addr learned my addr 172.21.15.125:0/2803408314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.557+0000 7f7957fff700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 -- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 msgr2=0x7f7958096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 -- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 msgr2=0x7f795812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795812e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 -- 172.21.15.125:0/2803408314 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958093150 con 0x7f7958093950 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f7956ffd700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f7957fff700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79577fe700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f7958095760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7948009760 tx=0x7f7948009060).ready entity=mon.0 client_cookie=3f72155737e6b62c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79567fc700 1 -- 172.21.15.125:0/2803408314 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480090d0 con 0x7f7958093950 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79567fc700 1 -- 172.21.15.125:0/2803408314 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800d4a0 con 0x7f7958093950 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f79567fc700 1 -- 172.21.15.125:0/2803408314 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800d820 con 0x7f7958093950 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f795dd70700 1 -- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 msgr2=0x7f7958095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.558+0000 7f795dd70700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f7958095760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7948009760 tx=0x7f7948009060).stop 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 -- 172.21.15.125:0/2803408314 shutdown_connections 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f7958095760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 --2- 172.21.15.125:0/2803408314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f7958096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 -- 172.21.15.125:0/2803408314 >> 172.21.15.125:0/2803408314 conn(0x7f795809aa50 msgr2=0x7f795809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 -- 172.21.15.125:0/2803408314 shutdown_connections 2023-10-03T10:09:11.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 -- 172.21.15.125:0/2803408314 wait complete. 2023-10-03T10:09:11.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.559+0000 7f795dd70700 1 Processor -- start 2023-10-03T10:09:11.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 -- start start 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f795811a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795811b200 con 0x7f7958093950 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795811eae0 con 0x7f795812c240 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f795dd70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79580635d0 con 0x7f7958095c50 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f7957fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34676/0 (socket says 172.21.15.125:34676) 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f7957fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43010/0 (socket says 172.21.15.125:43010) 2023-10-03T10:09:11.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 -- 172.21.15.125:0/3858122910 learned_addr learned my addr 172.21.15.125:0/3858122910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f7956ffd700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f795811a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 -- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 msgr2=0x7f795811a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f795811a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 -- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 msgr2=0x7f795811ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f79577fe700 1 -- 172.21.15.125:0/3858122910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c00b610 con 0x7f7958093950 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f7957fff700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.560+0000 7f7956ffd700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f795811a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f79577fe700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7948009d50 tx=0x7f7948016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948006990 con 0x7f7958093950 2023-10-03T10:09:11.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948012950 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948012cd0 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7950009a20 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79480092a0 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f794801c630 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.561+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f794803bfa0 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.562+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795809a720 con 0x7f7958093950 2023-10-03T10:09:11.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.566+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7948026460 con 0x7f7958093950 2023-10-03T10:09:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.725+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f795809a320 con 0x7f7958093950 2023-10-03T10:09:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.726+0000 7f793f7fe700 1 -- 172.21.15.125:0/3858122910 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8156 (secure 0 0 0) 0x7f79480253c0 con 0x7f7958093950 2023-10-03T10:09:11.726 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:11.726 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":13,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:11.176349+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:11.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 >> v1:172.21.15.125:6816/118167 conn(0x7f794402bb90 legacy=0x7f794402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 msgr2=0x7f795811a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7948009d50 tx=0x7f7948016000).stop 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 shutdown_connections 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f795812c240 0x7f795811ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7958093950 0x7f795811a330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 --2- 172.21.15.125:0/3858122910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7958095c50 0x7f795811a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 >> 172.21.15.125:0/3858122910 conn(0x7f795809aa50 msgr2=0x7f7958069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 shutdown_connections 2023-10-03T10:09:11.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.728+0000 7f795dd70700 1 -- 172.21.15.125:0/3858122910 wait complete. 2023-10-03T10:09:11.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:11.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:11.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 Processor -- start 2023-10-03T10:09:11.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 -- start start 2023-10-03T10:09:11.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb0094ba0 con 0x7f8fb012c240 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0092e90 con 0x7f8fb0095c50 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb67e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0096b60 con 0x7f8fb0093950 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8faffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb4d7d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8fb012c240 0x7f8fb012e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43916/0 (socket says 172.21.15.125:43916) 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43024/0 (socket says 172.21.15.125:43024) 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8fb4d7d700 1 -- 172.21.15.125:0/2618325224 learned_addr learned my addr 172.21.15.125:0/2618325224 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.857+0000 7f8faffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58176/0 (socket says 172.21.15.125:58176) 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faffff700 1 -- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 msgr2=0x7f8fb0096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:11.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faffff700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faffff700 1 -- 172.21.15.125:0/2618325224 >> v1:172.21.15.125:6789/0 conn(0x7f8fb012c240 legacy=0x7f8fb012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faeffd700 1 -- 172.21.15.125:0/2618325224 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631386838 0 0) 0x7f8fb0094ba0 con 0x7f8fb012c240 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faffff700 1 -- 172.21.15.125:0/2618325224 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0093150 con 0x7f8fb0093950 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faf7fe700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faffff700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8fa0009790 tx=0x7f8fa0009060).ready entity=mon.2 client_cookie=284a1fac93a319fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faeffd700 1 -- 172.21.15.125:0/2618325224 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00090d0 con 0x7f8fb0093950 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faeffd700 1 -- 172.21.15.125:0/2618325224 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000f510 con 0x7f8fb0093950 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8faeffd700 1 -- 172.21.15.125:0/2618325224 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000f890 con 0x7f8fb0093950 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 msgr2=0x7f8fb0095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.858+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8fa0009790 tx=0x7f8fa0009060).stop 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2618325224 shutdown_connections 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0093950 0x7f8fb0095760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2618325224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb0095c50 0x7f8fb0096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2618325224 >> 172.21.15.125:0/2618325224 conn(0x7f8fb009aa50 msgr2=0x7f8fb009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:11.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2618325224 shutdown_connections 2023-10-03T10:09:11.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2618325224 wait complete. 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.859+0000 7f8fb67e0700 1 Processor -- start 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 -- start start 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 0x7f8fb0125bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01260c0 con 0x7f8fb0093950 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0126a90 con 0x7f8fb012c240 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb67e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0126cb0 con 0x7f8fb0095c50 2023-10-03T10:09:11.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34678/0 (socket says 172.21.15.125:34678) 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58182/0 (socket says 172.21.15.125:58182) 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 -- 172.21.15.125:0/2534554696 learned_addr learned my addr 172.21.15.125:0/2534554696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb4d7d700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 0x7f8fb0125bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 -- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 msgr2=0x7f8fb01256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 -- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 msgr2=0x7f8fb0125bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 0x7f8fb0125bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faffff700 1 -- 172.21.15.125:0/2534554696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40092a0 con 0x7f8fb0093950 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8faf7fe700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.860+0000 7f8fb4d7d700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 0x7f8fb0125bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:11.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8faffff700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fa0009e30 tx=0x7f8fa0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000f890 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0006910 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000fea0 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa00092a0 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0129a20 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.861+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8fa001b620 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.862+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f8fa003c420 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.862+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb005a260 con 0x7f8fb0093950 2023-10-03T10:09:11.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:11.866+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8fa002b940 con 0x7f8fb0093950 2023-10-03T10:09:12.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.023+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8fb0046c20 con 0x7f8fb0093950 2023-10-03T10:09:12.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.024+0000 7f8f97fff700 1 -- 172.21.15.125:0/2534554696 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8fa002b350 con 0x7f8fb0093950 2023-10-03T10:09:12.024 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.025+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 >> v1:172.21.15.125:6816/118167 conn(0x7f8f9c02bb60 legacy=0x7f8f9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 msgr2=0x7f8fb01251f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fa0009e30 tx=0x7f8fa0017000).stop 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 shutdown_connections 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fb012c240 0x7f8fb0125bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fb0093950 0x7f8fb01251f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 --2- 172.21.15.125:0/2534554696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fb0095c50 0x7f8fb01256e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 >> 172.21.15.125:0/2534554696 conn(0x7f8fb009aa50 msgr2=0x7f8fb0062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 shutdown_connections 2023-10-03T10:09:12.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.026+0000 7f8fb67e0700 1 -- 172.21.15.125:0/2534554696 wait complete. 2023-10-03T10:09:12.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:12.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.155+0000 7feb8fe45700 1 Processor -- start 2023-10-03T10:09:12.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.155+0000 7feb8fe45700 1 -- start start 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb88095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb8812c240 0x7feb8812e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb88094ba0 con 0x7feb8812c240 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb88092e90 con 0x7feb88095c50 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8fe45700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb88096b60 con 0x7feb88093950 2023-10-03T10:09:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb8812c240 0x7feb8812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8d3e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb8812c240 0x7feb8812e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34686/0 (socket says 172.21.15.125:34686) 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 -- 172.21.15.125:0/1137738 learned_addr learned my addr 172.21.15.125:0/1137738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8d3e0700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43036/0 (socket says 172.21.15.125:43036) 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8dbe1700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb88095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 -- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 msgr2=0x7feb88095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb88095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 -- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 msgr2=0x7feb88096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 -- 172.21.15.125:0/1137738 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88093150 con 0x7feb8812c240 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8d3e0700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8e3e2700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8812e630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb80009f20 tx=0x7feb80009840).ready entity=mon.0 client_cookie=883f32f6b95b360d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8cbdf700 1 -- 172.21.15.125:0/1137738 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000e070 con 0x7feb8812c240 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8cbdf700 1 -- 172.21.15.125:0/1137738 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000b970 con 0x7feb8812c240 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.156+0000 7feb8cbdf700 1 -- 172.21.15.125:0/1137738 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000bcf0 con 0x7feb8812c240 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 -- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 msgr2=0x7feb8812e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8812e630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb80009f20 tx=0x7feb80009840).stop 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 -- 172.21.15.125:0/1137738 shutdown_connections 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8812e630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb88095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 --2- 172.21.15.125:0/1137738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 -- 172.21.15.125:0/1137738 >> 172.21.15.125:0/1137738 conn(0x7feb8809aa50 msgr2=0x7feb8809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 -- 172.21.15.125:0/1137738 shutdown_connections 2023-10-03T10:09:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.157+0000 7feb8fe45700 1 -- 172.21.15.125:0/1137738 wait complete. 2023-10-03T10:09:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 Processor -- start 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 -- start start 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8811a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8811cfc0 con 0x7feb8812c240 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8811d460 con 0x7feb88095c50 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8fe45700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb8811d1b0 con 0x7feb88093950 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8dbe1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8d3e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8dbe1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58208/0 (socket says 172.21.15.125:58208) 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8e3e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8811a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.158+0000 7feb8dbe1700 1 -- 172.21.15.125:0/2144029664 learned_addr learned my addr 172.21.15.125:0/2144029664 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 -- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 msgr2=0x7feb8811df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 -- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 msgr2=0x7feb8811a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8811a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 -- 172.21.15.125:0/2144029664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8400b540 con 0x7feb88095c50 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8e3e2700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8811a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8dbe1700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8d3e0700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88119fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7feb8400eb00 tx=0x7feb8400b300).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400da50 con 0x7feb88095c50 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400dbb0 con 0x7feb88095c50 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb80009ae0 con 0x7feb88095c50 2023-10-03T10:09:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84010440 con 0x7feb88095c50 2023-10-03T10:09:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.159+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8811ba80 con 0x7feb88095c50 2023-10-03T10:09:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.160+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb840107b0 con 0x7feb88095c50 2023-10-03T10:09:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.160+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7feb8403b470 con 0x7feb88095c50 2023-10-03T10:09:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.160+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8809a060 con 0x7feb88095c50 2023-10-03T10:09:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.165+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb84019400 con 0x7feb88095c50 2023-10-03T10:09:12.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.321+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb8805a260 con 0x7feb88095c50 2023-10-03T10:09:12.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.321+0000 7feb7dffb700 1 -- 172.21.15.125:0/2144029664 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb84017310 con 0x7feb88095c50 2023-10-03T10:09:12.321 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 >> v1:172.21.15.125:6816/118167 conn(0x7feb6c02bb90 legacy=0x7feb6c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 msgr2=0x7feb88119fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88119fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7feb8400eb00 tx=0x7feb8400b300).stop 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 shutdown_connections 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb8812c240 0x7feb8811a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb88093950 0x7feb8811df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 --2- 172.21.15.125:0/2144029664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb88095c50 0x7feb88119fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 >> 172.21.15.125:0/2144029664 conn(0x7feb8809aa50 msgr2=0x7feb88069140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 shutdown_connections 2023-10-03T10:09:12.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.323+0000 7feb8fe45700 1 -- 172.21.15.125:0/2144029664 wait complete. 2023-10-03T10:09:12.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T10:09:12.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 Processor -- start 2023-10-03T10:09:12.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 -- start start 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0923f0 con 0x7fcffc127a00 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc093090 con 0x7fcffc067f40 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fd000beb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc091e90 con 0x7fcffc069790 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcff9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43044/0 (socket says 172.21.15.125:43044) 2023-10-03T10:09:12.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcffad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcffc127a00 0x7fcffc127eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43924/0 (socket says 172.21.15.125:43924) 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcff9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58220/0 (socket says 172.21.15.125:58220) 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.450+0000 7fcffa59c700 1 -- 172.21.15.125:0/2110364024 learned_addr learned my addr 172.21.15.125:0/2110364024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcff959a700 1 -- 172.21.15.125:0/2110364024 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152730887 0 0) 0x7fcffc0923f0 con 0x7fcffc127a00 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcffa59c700 1 -- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 msgr2=0x7fcffc068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcffa59c700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcffa59c700 1 -- 172.21.15.125:0/2110364024 >> v1:172.21.15.125:6789/0 conn(0x7fcffc127a00 legacy=0x7fcffc127eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcffa59c700 1 -- 172.21.15.125:0/2110364024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc093350 con 0x7fcffc067f40 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcff9d9b700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcffa59c700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fcfec009830 tx=0x7fcfec0090f0).ready entity=mon.1 client_cookie=788bb68356c9d068 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcff959a700 1 -- 172.21.15.125:0/2110364024 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00b580 con 0x7fcffc067f40 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcff959a700 1 -- 172.21.15.125:0/2110364024 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec00b6e0 con 0x7fcffc067f40 2023-10-03T10:09:12.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fcff959a700 1 -- 172.21.15.125:0/2110364024 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00ba80 con 0x7fcffc067f40 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fd000beb700 1 -- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 msgr2=0x7fcffc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.451+0000 7fd000beb700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fcfec009830 tx=0x7fcfec0090f0).stop 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 -- 172.21.15.125:0/2110364024 shutdown_connections 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc068320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 --2- 172.21.15.125:0/2110364024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc069790 0x7fcffc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 -- 172.21.15.125:0/2110364024 >> 172.21.15.125:0/2110364024 conn(0x7fcffc09a230 msgr2=0x7fcffc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 -- 172.21.15.125:0/2110364024 shutdown_connections 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 -- 172.21.15.125:0/2110364024 wait complete. 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 Processor -- start 2023-10-03T10:09:12.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.452+0000 7fd000beb700 1 -- start start 2023-10-03T10:09:12.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 0x7fcffc138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc127a00 0x7fcffc138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc12ec00 con 0x7fcffc069790 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc098080 con 0x7fcffc067f40 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fd000beb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc091b90 con 0x7fcffc127a00 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43056/0 (socket says 172.21.15.125:43056) 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 -- 172.21.15.125:0/1652907220 learned_addr learned my addr 172.21.15.125:0/1652907220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffad9d700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc127a00 0x7fcffc138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcff9d9b700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 0x7fcffc138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 -- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc127a00 msgr2=0x7fcffc138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc127a00 0x7fcffc138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 -- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 msgr2=0x7fcffc138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 0x7fcffc138730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 -- 172.21.15.125:0/1652907220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40092a0 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcff9d9b700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 0x7fcffc138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcffa59c700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fcfec009ed0 tx=0x7fcfec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.453+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00b580 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.454+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec006990 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.454+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec009370 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.454+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00ba80 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.454+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc130250 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.454+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc05a260 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.455+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcfec01c630 con 0x7fcffc067f40 2023-10-03T10:09:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.455+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fcfec03cb50 con 0x7fcffc067f40 2023-10-03T10:09:12.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.459+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcfec00be40 con 0x7fcffc067f40 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.622+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcffc068d00 con 0x7fcffc067f40 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.622+0000 7fcff27fc700 1 -- 172.21.15.125:0/1652907220 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcfec02a030 con 0x7fcffc067f40 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "device_health_metrics" 2023-10-03T10:09:12.622 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:09:12.623 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:09:12.623 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-03T10:09:12.623 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-03T10:09:12.623 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:09:12.623 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 >> v1:172.21.15.125:6816/118167 conn(0x7fcfdc02bb60 legacy=0x7fcfdc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 msgr2=0x7fcffc138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fcfec009ed0 tx=0x7fcfec017000).stop 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 shutdown_connections 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcffc127a00 0x7fcffc138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcffc067f40 0x7fcffc138240 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 --2- 172.21.15.125:0/1652907220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcffc069790 0x7fcffc138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 >> 172.21.15.125:0/1652907220 conn(0x7fcffc09a230 msgr2=0x7fcffc066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 shutdown_connections 2023-10-03T10:09:12.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.624+0000 7fd000beb700 1 -- 172.21.15.125:0/1652907220 wait complete. 2023-10-03T10:09:12.635 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T10:09:12.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T10:09:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.754+0000 7f537bcb8700 1 Processor -- start 2023-10-03T10:09:12.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.754+0000 7f537bcb8700 1 -- start start 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537bcb8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53740967d0 0x7f5374096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537bcb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374067540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537bcb8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53740697f0 con 0x7f5374068870 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537bcb8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53740943c0 con 0x7f53740967d0 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537bcb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53740945b0 con 0x7f53740970a0 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53740967d0 0x7f5374096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537a255700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53740967d0 0x7f5374096bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34700/0 (socket says 172.21.15.125:34700) 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 -- 172.21.15.125:0/186567085 learned_addr learned my addr 172.21.15.125:0/186567085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379253700 1 --1- 172.21.15.125:0/186567085 >> v1:172.21.15.125:6789/0 conn(0x7f5374068870 0x7f5374066e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43930/0 (socket says 172.21.15.125:43930) 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 -- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 msgr2=0x7f5374067540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374067540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 -- 172.21.15.125:0/186567085 >> v1:172.21.15.125:6789/0 conn(0x7f5374068870 legacy=0x7f5374066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 -- 172.21.15.125:0/186567085 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740974e0 con 0x7f53740967d0 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5378a52700 1 -- 172.21.15.125:0/186567085 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023283705 0 0) 0x7f53740697f0 con 0x7f5374068870 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f537a255700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374067540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5379a54700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53740967d0 0x7f5374096bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5364006fd0 tx=0x7f53640090f0).ready entity=mon.0 client_cookie=bcb7982f7ff51aff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5378a52700 1 -- 172.21.15.125:0/186567085 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536400b580 con 0x7f53740967d0 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5378a52700 1 -- 172.21.15.125:0/186567085 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536400b6e0 con 0x7f53740967d0 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.755+0000 7f5378a52700 1 -- 172.21.15.125:0/186567085 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536400ba80 con 0x7f53740967d0 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 -- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53740967d0 msgr2=0x7f5374096bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53740967d0 0x7f5374096bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5364006fd0 tx=0x7f53640090f0).stop 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 -- 172.21.15.125:0/186567085 shutdown_connections 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374067540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 --2- 172.21.15.125:0/186567085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53740967d0 0x7f5374096bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 -- 172.21.15.125:0/186567085 >> 172.21.15.125:0/186567085 conn(0x7f5374063720 msgr2=0x7f537409a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 -- 172.21.15.125:0/186567085 shutdown_connections 2023-10-03T10:09:12.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.756+0000 7f537bcb8700 1 -- 172.21.15.125:0/186567085 wait complete. 2023-10-03T10:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.757+0000 7f537bcb8700 1 Processor -- start 2023-10-03T10:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.757+0000 7f537bcb8700 1 -- start start 2023-10-03T10:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 0x7f53741149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 0x7f5374128120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5374117eb0 con 0x7f5374115390 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53741157d0 con 0x7f53740967d0 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53741166c0 con 0x7f53740970a0 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5379a54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 0x7f53741149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5379253700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 0x7f5374128120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5379a54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 0x7f53741149b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43066/0 (socket says 172.21.15.125:43066) 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5379a54700 1 -- 172.21.15.125:0/1849418301 learned_addr learned my addr 172.21.15.125:0/1849418301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 -- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 msgr2=0x7f5374114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374114ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 -- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 msgr2=0x7f53741149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 0x7f53741149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 -- 172.21.15.125:0/1849418301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c009a20 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537a255700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 0x7f5374128120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f536c009f10 tx=0x7f536c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00cb70 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c00f040 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5364009370 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.758+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c013400 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.759+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53740693d0 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.759+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f536c0137f0 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.759+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f536c03b510 con 0x7f5374115390 2023-10-03T10:09:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.760+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537405a260 con 0x7f5374115390 2023-10-03T10:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.764+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f536c013aa0 con 0x7f5374115390 2023-10-03T10:09:12.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:12.923+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5374068cf0 con 0x7f5374115390 2023-10-03T10:09:13.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.304+0000 7f5369ffb700 1 -- 172.21.15.125:0/1849418301 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7f536c01b7e0 con 0x7f5374115390 2023-10-03T10:09:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.309+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 >> v1:172.21.15.125:6816/118167 conn(0x7f535802bb60 legacy=0x7f535802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.309+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 msgr2=0x7f5374128120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.309+0000 7f537bcb8700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 0x7f5374128120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f536c009f10 tx=0x7f536c00b040).stop 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 shutdown_connections 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5374115390 0x7f5374128120 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53740967d0 0x7f53741149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 --2- 172.21.15.125:0/1849418301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53740970a0 0x7f5374114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 >> 172.21.15.125:0/1849418301 conn(0x7f5374068870 msgr2=0x7f5374065e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 shutdown_connections 2023-10-03T10:09:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.311+0000 7f537bcb8700 1 -- 172.21.15.125:0/1849418301 wait complete. 2023-10-03T10:09:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-03T10:09:13.323 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T10:09:13.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.446+0000 7fb3759fc700 1 Processor -- start 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.446+0000 7fb3759fc700 1 -- start start 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.446+0000 7fb3759fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 0x7fb37012b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb3759fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb370127c70 0x7fb3701280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb3759fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37012ae10 con 0x7fb37012b540 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb3759fc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37012b940 con 0x7fb370127c70 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb3759fc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370064b30 con 0x7fb370097790 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb370127c70 0x7fb3701280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:13.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 0x7fb37012b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb370127c70 0x7fb3701280e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34728/0 (socket says 172.21.15.125:34728) 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb37012b540 0x7fb370127560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43944/0 (socket says 172.21.15.125:43944) 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 -- 172.21.15.125:0/2787306103 learned_addr learned my addr 172.21.15.125:0/2787306103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 -- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 msgr2=0x7fb37012b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 0x7fb37012b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 -- 172.21.15.125:0/2787306103 >> v1:172.21.15.125:6789/0 conn(0x7fb37012b540 legacy=0x7fb370127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 -- 172.21.15.125:0/2787306103 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370065750 con 0x7fb370127c70 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36dffb700 1 -- 172.21.15.125:0/2787306103 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155443146 0 0) 0x7fb360001110 con 0x7fb37012b540 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36effd700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 0x7fb37012b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36f7fe700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370127c70 0x7fb3701280e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb368009f20 tx=0x7fb368009840).ready entity=mon.0 client_cookie=5853006c0136c46a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36dffb700 1 -- 172.21.15.125:0/2787306103 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800e070 con 0x7fb370127c70 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36dffb700 1 -- 172.21.15.125:0/2787306103 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36800b9d0 con 0x7fb370127c70 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.447+0000 7fb36dffb700 1 -- 172.21.15.125:0/2787306103 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800bd50 con 0x7fb370127c70 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 -- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370127c70 msgr2=0x7fb3701280e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370127c70 0x7fb3701280e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb368009f20 tx=0x7fb368009840).stop 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 -- 172.21.15.125:0/2787306103 shutdown_connections 2023-10-03T10:09:13.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370127c70 0x7fb3701280e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 --2- 172.21.15.125:0/2787306103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370097790 0x7fb37012b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 -- 172.21.15.125:0/2787306103 >> 172.21.15.125:0/2787306103 conn(0x7fb37009bad0 msgr2=0x7fb37009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:13.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 -- 172.21.15.125:0/2787306103 shutdown_connections 2023-10-03T10:09:13.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.448+0000 7fb3759fc700 1 -- 172.21.15.125:0/2787306103 wait complete. 2023-10-03T10:09:13.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 Processor -- start 2023-10-03T10:09:13.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 -- start start 2023-10-03T10:09:13.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb37012b540 0x7fb3701144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370115f00 con 0x7fb370097790 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370124b70 con 0x7fb370127c70 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb3759fc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb370065130 con 0x7fb37012b540 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:13.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34730/0 (socket says 172.21.15.125:34730) 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43078/0 (socket says 172.21.15.125:43078) 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36effd700 1 -- 172.21.15.125:0/1555336969 learned_addr learned my addr 172.21.15.125:0/1555336969 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.449+0000 7fb36f7fe700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb37012b540 0x7fb3701144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 -- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb37012b540 msgr2=0x7fb3701144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb37012b540 0x7fb3701144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 -- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 msgr2=0x7fb370113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 -- 172.21.15.125:0/1555336969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640092a0 con 0x7fb370127c70 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36effd700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:13.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb36e7fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb37009ba30 tx=0x7fb3600079f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600070d0 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360007250 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600056e0 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368009ae0 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.450+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb370117c20 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.451+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb360005a90 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.451+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7fb36003a020 con 0x7fb370127c70 2023-10-03T10:09:13.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.451+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37012ae10 con 0x7fb370127c70 2023-10-03T10:09:13.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.455+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb37012ae10 con 0x7fb370127c70 2023-10-03T10:09:13.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:13.614+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3701171c0 con 0x7fb370127c70 2023-10-03T10:09:14.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.315+0000 7fb356ffd700 1 -- 172.21.15.125:0/1555336969 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3701171c0 con 0x7fb370127c70 2023-10-03T10:09:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.317+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 >> v1:172.21.15.125:6816/118167 conn(0x7fb35c02bb90 legacy=0x7fb35c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.317+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 msgr2=0x7fb370113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.317+0000 7fb3759fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb37009ba30 tx=0x7fb3600079f0).stop 2023-10-03T10:09:14.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.321+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 shutdown_connections 2023-10-03T10:09:14.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.321+0000 7fb3759fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb37012b540 0x7fb3701144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.321+0000 7fb3759fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb370097790 0x7fb370113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.321+0000 7fb3759fc700 1 --2- 172.21.15.125:0/1555336969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb370127c70 0x7fb370113fe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.321+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 >> 172.21.15.125:0/1555336969 conn(0x7fb37009bad0 msgr2=0x7fb370129020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:14.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.322+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 shutdown_connections 2023-10-03T10:09:14.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.324+0000 7fb3759fc700 1 -- 172.21.15.125:0/1555336969 wait complete. 2023-10-03T10:09:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-03T10:09:14.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T10:09:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.474+0000 7f0320cab700 1 Processor -- start 2023-10-03T10:09:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.474+0000 7f0320cab700 1 -- start start 2023-10-03T10:09:14.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c095b80 0x7f031c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c0973f0 con 0x7f031c096490 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c062ee0 con 0x7f031c062b00 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0320cab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f031c091980 con 0x7f031c095b80 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f031ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f031a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c095b80 0x7f031c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f031a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43092/0 (socket says 172.21.15.125:43092) 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f031ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34742/0 (socket says 172.21.15.125:34742) 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.475+0000 7f031a59c700 1 -- 172.21.15.125:0/808761164 learned_addr learned my addr 172.21.15.125:0/808761164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 -- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c095b80 msgr2=0x7f031c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 --2- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c095b80 0x7f031c095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 -- 172.21.15.125:0/808761164 >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 msgr2=0x7f031c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 --2- 172.21.15.125:0/808761164 >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 -- 172.21.15.125:0/808761164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c092310 con 0x7f031c062b00 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031ad9d700 1 --2- 172.21.15.125:0/808761164 >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031a59c700 1 --2- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0310009860 tx=0x7f03100090f0).ready entity=mon.1 client_cookie=bab6937ee6436c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031959a700 1 -- 172.21.15.125:0/808761164 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000f510 con 0x7f031c062b00 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031959a700 1 -- 172.21.15.125:0/808761164 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031000f670 con 0x7f031c062b00 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f031959a700 1 -- 172.21.15.125:0/808761164 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000f9f0 con 0x7f031c062b00 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 -- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 msgr2=0x7f031c095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 --2- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0310009860 tx=0x7f03100090f0).stop 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 -- 172.21.15.125:0/808761164 shutdown_connections 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 --2- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c095690 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 --2- 172.21.15.125:0/808761164 >> v2:172.21.15.125:3300/0 conn(0x7f031c096490 0x7f031c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 --2- 172.21.15.125:0/808761164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c095b80 0x7f031c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 -- 172.21.15.125:0/808761164 >> 172.21.15.125:0/808761164 conn(0x7f031c09aa50 msgr2=0x7f031c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:14.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 -- 172.21.15.125:0/808761164 shutdown_connections 2023-10-03T10:09:14.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.476+0000 7f0320cab700 1 -- 172.21.15.125:0/808761164 wait complete. 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.477+0000 7f0320cab700 1 Processor -- start 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.477+0000 7f0320cab700 1 -- start start 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c11aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c11a010 con 0x7f031c095b80 2023-10-03T10:09:14.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c099dc0 con 0x7f031c062b00 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f031c096da0 con 0x7f031c096490 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58240/0 (socket says 172.21.15.125:58240) 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34744/0 (socket says 172.21.15.125:34744) 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c11aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 -- 172.21.15.125:0/697020798 learned_addr learned my addr 172.21.15.125:0/697020798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 -- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 msgr2=0x7f031c11aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c11aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 -- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 msgr2=0x7f031c116a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 -- 172.21.15.125:0/697020798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009a20 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0319d9b700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f031ad9d700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0314009fc0 tx=0x7f031400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400cbd0 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400f040 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310009370 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.478+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314013400 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.479+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c1186a0 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.479+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f03140137f0 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.479+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f031403b910 con 0x7f031c096490 2023-10-03T10:09:14.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.480+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c05a260 con 0x7f031c096490 2023-10-03T10:09:14.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.484+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0314007da0 con 0x7f031c096490 2023-10-03T10:09:14.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.680+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f031c046c20 con 0x7f031c096490 2023-10-03T10:09:14.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.688+0000 7f030a7fc700 1 -- 172.21.15.125:0/697020798 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f031402c0c0 con 0x7f031c096490 2023-10-03T10:09:14.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.691+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 >> v1:172.21.15.125:6816/118167 conn(0x7f02fc02bb90 legacy=0x7f02fc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 msgr2=0x7f031c116f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0314009fc0 tx=0x7f031400b040).stop 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 shutdown_connections 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f031c096490 0x7f031c116f70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f031c062b00 0x7f031c11aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 --2- 172.21.15.125:0/697020798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f031c095b80 0x7f031c116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.692+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 >> 172.21.15.125:0/697020798 conn(0x7f031c09aa50 msgr2=0x7f031c1300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.693+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 shutdown_connections 2023-10-03T10:09:14.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.693+0000 7f0320cab700 1 -- 172.21.15.125:0/697020798 wait complete. 2023-10-03T10:09:14.694 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T10:09:14.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:14.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.837+0000 7f1d60e72700 1 Processor -- start 2023-10-03T10:09:14.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.837+0000 7f1d60e72700 1 -- start start 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d60e72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d60e72700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d5c12db90 0x7f1d5c12ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d60e72700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5c063230 con 0x7f1d5c125820 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d60e72700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5c062ee0 con 0x7f1d5c12db90 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d60e72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c097010 con 0x7f1d5c062b00 2023-10-03T10:09:14.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d5c12db90 0x7f1d5c12ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d5c12db90 0x7f1d5c12ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34746/0 (socket says 172.21.15.125:34746) 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58248/0 (socket says 172.21.15.125:58248) 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d59d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1d5c125820 0x7f1d5c125c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43960/0 (socket says 172.21.15.125:43960) 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 -- 172.21.15.125:0/2693223663 learned_addr learned my addr 172.21.15.125:0/2693223663 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 -- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 msgr2=0x7f1d5c125270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 -- 172.21.15.125:0/2693223663 >> v1:172.21.15.125:6789/0 conn(0x7f1d5c125820 legacy=0x7f1d5c125c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5959a700 1 -- 172.21.15.125:0/2693223663 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219750695 0 0) 0x7f1d5c063230 con 0x7f1d5c125820 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5ad9d700 1 -- 172.21.15.125:0/2693223663 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c0972e0 con 0x7f1d5c12db90 2023-10-03T10:09:14.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.838+0000 7f1d5a59c700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d5ad9d700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c12db90 0x7f1d5c12ff80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d54009f50 tx=0x7f1d54009840).ready entity=mon.0 client_cookie=5deeddd56291c72a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d5959a700 1 -- 172.21.15.125:0/2693223663 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400e070 con 0x7f1d5c12db90 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d5959a700 1 -- 172.21.15.125:0/2693223663 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5400b9c0 con 0x7f1d5c12db90 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d5959a700 1 -- 172.21.15.125:0/2693223663 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400bd40 con 0x7f1d5c12db90 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 -- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c12db90 msgr2=0x7f1d5c12ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c12db90 0x7f1d5c12ff80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d54009f50 tx=0x7f1d54009840).stop 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 -- 172.21.15.125:0/2693223663 shutdown_connections 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c12db90 0x7f1d5c12ff80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2693223663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c062b00 0x7f1d5c125270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 -- 172.21.15.125:0/2693223663 >> 172.21.15.125:0/2693223663 conn(0x7f1d5c0974f0 msgr2=0x7f1d5c097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 -- 172.21.15.125:0/2693223663 shutdown_connections 2023-10-03T10:09:14.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.839+0000 7f1d60e72700 1 -- 172.21.15.125:0/2693223663 wait complete. 2023-10-03T10:09:14.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.840+0000 7f1d60e72700 1 Processor -- start 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.840+0000 7f1d60e72700 1 -- start start 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.840+0000 7f1d60e72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.840+0000 7f1d60e72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 0x7f1d5c12c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c125270 con 0x7f1d5c062b00 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c12d7a0 con 0x7f1d5c12db90 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c12b280 con 0x7f1d5c125820 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d59d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34758/0 (socket says 172.21.15.125:34758) 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d59d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58264/0 (socket says 172.21.15.125:58264) 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 -- 172.21.15.125:0/2819096383 learned_addr learned my addr 172.21.15.125:0/2819096383 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5ad9d700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 0x7f1d5c12c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 -- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 msgr2=0x7f1d5c12be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 -- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 msgr2=0x7f1d5c12c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 0x7f1d5c12c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 -- 172.21.15.125:0/2819096383 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500092a0 con 0x7f1d5c062b00 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d59d9b700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5ad9d700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 0x7f1d5c12c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d5a59c700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d5000ea20 tx=0x7f1d50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:14.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000ee60 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5000c850 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54009ae0 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000cbd0 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.841+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c06a050 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.842+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1d5001b400 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.842+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1d5003b510 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.842+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c12ac40 con 0x7f1d5c062b00 2023-10-03T10:09:14.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:14.847+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1d50019900 con 0x7f1d5c062b00 2023-10-03T10:09:15.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.004+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d5c05a260 con 0x7f1d5c062b00 2023-10-03T10:09:15.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.005+0000 7f1d4a7fc700 1 -- 172.21.15.125:0/2819096383 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11386 (secure 0 0 0) 0x7f1d5002a090 con 0x7f1d5c062b00 2023-10-03T10:09:15.004 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:15.004 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:14.681808+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:15.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 >> v1:172.21.15.125:6816/118167 conn(0x7f1d3c02bb60 legacy=0x7f1d3c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 msgr2=0x7f1d5c12b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d5000ea20 tx=0x7f1d50009060).stop 2023-10-03T10:09:15.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 shutdown_connections 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d5c12db90 0x7f1d5c12c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d5c062b00 0x7f1d5c12b780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 --2- 172.21.15.125:0/2819096383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d5c125820 0x7f1d5c12be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 >> 172.21.15.125:0/2819096383 conn(0x7f1d5c0974f0 msgr2=0x7f1d5c12f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 shutdown_connections 2023-10-03T10:09:15.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.006+0000 7f1d60e72700 1 -- 172.21.15.125:0/2819096383 wait complete. 2023-10-03T10:09:15.017 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:15.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 Processor -- start 2023-10-03T10:09:15.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 -- start start 2023-10-03T10:09:15.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa070094ba0 con 0x7fa07012c240 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa070092e90 con 0x7fa070093950 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa0777ab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa070096b60 con 0x7fa070095c50 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa074d46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa075547700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa075547700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34766/0 (socket says 172.21.15.125:34766) 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa074d46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58280/0 (socket says 172.21.15.125:58280) 2023-10-03T10:09:15.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa075547700 1 -- 172.21.15.125:0/3153842178 learned_addr learned my addr 172.21.15.125:0/3153842178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.133+0000 7fa075d48700 1 --1- 172.21.15.125:0/3153842178 >> v1:172.21.15.125:6789/0 conn(0x7fa07012c240 0x7fa07012e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43972/0 (socket says 172.21.15.125:43972) 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa074d46700 1 -- 172.21.15.125:0/3153842178 >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 msgr2=0x7fa070095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa074d46700 1 --2- 172.21.15.125:0/3153842178 >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa074d46700 1 -- 172.21.15.125:0/3153842178 >> v1:172.21.15.125:6789/0 conn(0x7fa07012c240 legacy=0x7fa07012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa074d46700 1 -- 172.21.15.125:0/3153842178 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070093150 con 0x7fa070095c50 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa067fff700 1 -- 172.21.15.125:0/3153842178 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584120081 0 0) 0x7fa070094ba0 con 0x7fa07012c240 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa075547700 1 --2- 172.21.15.125:0/3153842178 >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa074d46700 1 --2- 172.21.15.125:0/3153842178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa060009760 tx=0x7fa060009060).ready entity=mon.2 client_cookie=7436c6219f3a29a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa067fff700 1 -- 172.21.15.125:0/3153842178 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600090d0 con 0x7fa070095c50 2023-10-03T10:09:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa067fff700 1 -- 172.21.15.125:0/3153842178 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000f510 con 0x7fa070095c50 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa067fff700 1 -- 172.21.15.125:0/3153842178 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000f890 con 0x7fa070095c50 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa0777ab700 1 -- 172.21.15.125:0/3153842178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 msgr2=0x7fa070096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3153842178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa060009760 tx=0x7fa060009060).stop 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa0777ab700 1 -- 172.21.15.125:0/3153842178 shutdown_connections 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3153842178 >> v2:172.21.15.125:3300/0 conn(0x7fa070093950 0x7fa070095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.134+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3153842178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070096030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.135+0000 7fa0777ab700 1 -- 172.21.15.125:0/3153842178 >> 172.21.15.125:0/3153842178 conn(0x7fa07009aa50 msgr2=0x7fa07009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.135+0000 7fa0777ab700 1 -- 172.21.15.125:0/3153842178 shutdown_connections 2023-10-03T10:09:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.135+0000 7fa0777ab700 1 -- 172.21.15.125:0/3153842178 wait complete. 2023-10-03T10:09:15.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.135+0000 7fa0777ab700 1 Processor -- start 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.135+0000 7fa0777ab700 1 -- start start 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa07012c240 0x7fa070116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa070092410 con 0x7fa070093950 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa070099030 con 0x7fa07012c240 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa0777ab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa070115c60 con 0x7fa070095c50 2023-10-03T10:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa075547700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58288/0 (socket says 172.21.15.125:58288) 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa075547700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34770/0 (socket says 172.21.15.125:34770) 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 -- 172.21.15.125:0/3754481728 learned_addr learned my addr 172.21.15.125:0/3754481728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa075d48700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa07012c240 0x7fa070116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 -- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa07012c240 msgr2=0x7fa070116940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa07012c240 0x7fa070116940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 -- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 msgr2=0x7fa070115f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa074d46700 1 -- 172.21.15.125:0/3754481728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c009370 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.136+0000 7fa075547700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa074d46700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa070096ca0 tx=0x7fa060017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000f890 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060006910 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600092a0 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000fea0 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0701199b0 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.137+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa06001b620 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.138+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa06003cae0 con 0x7fa070095c50 2023-10-03T10:09:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.138+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07005a260 con 0x7fa070095c50 2023-10-03T10:09:15.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.142+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa060028070 con 0x7fa070095c50 2023-10-03T10:09:15.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.301+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa070046c20 con 0x7fa070095c50 2023-10-03T10:09:15.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.302+0000 7fa0657fa700 1 -- 172.21.15.125:0/3754481728 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11386 (secure 0 0 0) 0x7fa060032090 con 0x7fa070095c50 2023-10-03T10:09:15.302 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:15.302 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:14.681808+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 >> v1:172.21.15.125:6816/118167 conn(0x7fa05402bb60 legacy=0x7fa05402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 msgr2=0x7fa070116450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa070096ca0 tx=0x7fa060017000).stop 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 shutdown_connections 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa07012c240 0x7fa070116940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa070093950 0x7fa070115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 --2- 172.21.15.125:0/3754481728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa070095c50 0x7fa070116450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 >> 172.21.15.125:0/3754481728 conn(0x7fa07009aa50 msgr2=0x7fa070062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 shutdown_connections 2023-10-03T10:09:15.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.304+0000 7fa0777ab700 1 -- 172.21.15.125:0/3754481728 wait complete. 2023-10-03T10:09:15.316 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.434+0000 7f611649b700 1 Processor -- start 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.434+0000 7f611649b700 1 -- start start 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f611649b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f611649b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f611649b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6110066f90 con 0x7f611012b370 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f611649b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611005f940 con 0x7f611012b790 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f611649b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6110067650 con 0x7f611005f560 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f6114a38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40124/0 (socket says 172.21.15.125:40124) 2023-10-03T10:09:15.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f6114a38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53994/0 (socket says 172.21.15.125:53994) 2023-10-03T10:09:15.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 -- 172.21.15.125:0/997344591 learned_addr learned my addr 172.21.15.125:0/997344591 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610f7fe700 1 --1- 172.21.15.125:0/997344591 >> v1:172.21.15.125:6789/0 conn(0x7f611012b370 0x7f6110095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40188/0 (socket says 172.21.15.125:40188) 2023-10-03T10:09:15.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 -- 172.21.15.125:0/997344591 >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 msgr2=0x7f61100964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 --2- 172.21.15.125:0/997344591 >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 -- 172.21.15.125:0/997344591 >> v1:172.21.15.125:6789/0 conn(0x7f611012b370 legacy=0x7f6110095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 -- 172.21.15.125:0/997344591 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110067910 con 0x7f611005f560 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610effd700 1 -- 172.21.15.125:0/997344591 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883188042 0 0) 0x7f6110066f90 con 0x7f611012b370 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f6114a38700 1 --2- 172.21.15.125:0/997344591 >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.435+0000 7f610ffff700 1 --2- 172.21.15.125:0/997344591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6100009830 tx=0x7f61000090f0).ready entity=mon.2 client_cookie=bdb490abbc3ca580 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f610effd700 1 -- 172.21.15.125:0/997344591 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000b580 con 0x7f611005f560 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f610effd700 1 -- 172.21.15.125:0/997344591 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000b6e0 con 0x7f611005f560 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f610effd700 1 -- 172.21.15.125:0/997344591 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000ba60 con 0x7f611005f560 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 -- 172.21.15.125:0/997344591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 msgr2=0x7f611012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 --2- 172.21.15.125:0/997344591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6100009830 tx=0x7f61000090f0).stop 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 -- 172.21.15.125:0/997344591 shutdown_connections 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 --2- 172.21.15.125:0/997344591 >> v2:172.21.15.125:3300/0 conn(0x7f611012b790 0x7f61100964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 --2- 172.21.15.125:0/997344591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611005f560 0x7f611012ae80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 -- 172.21.15.125:0/997344591 >> 172.21.15.125:0/997344591 conn(0x7f611009a1c0 msgr2=0x7f611009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 -- 172.21.15.125:0/997344591 shutdown_connections 2023-10-03T10:09:15.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.436+0000 7f611649b700 1 -- 172.21.15.125:0/997344591 wait complete. 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.437+0000 7f611649b700 1 Processor -- start 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 -- start start 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 0x7f611013ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 0x7f6110113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110116110 con 0x7f611012b790 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6110129330 con 0x7f611005f560 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f611649b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61100671c0 con 0x7f611012b370 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f610ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f610f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 0x7f611013ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f610ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45670/0 (socket says 172.21.15.125:45670) 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f610ffff700 1 -- 172.21.15.125:0/359418841 learned_addr learned my addr 172.21.15.125:0/359418841 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.438+0000 7f6114a38700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 0x7f6110113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 -- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 msgr2=0x7f611013ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 0x7f611013ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 -- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 msgr2=0x7f6110113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 0x7f6110113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 -- 172.21.15.125:0/359418841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108009a20 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610f7fe700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 0x7f611013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f6114a38700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 0x7f6110113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f610ffff700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6100009ed0 tx=0x7f6100017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000b850 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000b9b0 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100009370 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610001c630 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.439+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110116fc0 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.440+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f610001c9e0 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.440+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f610003cd60 con 0x7f611005f560 2023-10-03T10:09:15.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.440+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61101171c0 con 0x7f611005f560 2023-10-03T10:09:15.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.444+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f61101171c0 con 0x7f611005f560 2023-10-03T10:09:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.639+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f61101171c0 con 0x7f611005f560 2023-10-03T10:09:15.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.691+0000 7f6107fff700 1 -- 172.21.15.125:0/359418841 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f61101171c0 con 0x7f611005f560 2023-10-03T10:09:15.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 >> v1:172.21.15.125:6816/118167 conn(0x7f60f002bb90 legacy=0x7f60f002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 msgr2=0x7f611013a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6100009ed0 tx=0x7f6100017000).stop 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 shutdown_connections 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f611012b790 0x7f6110113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f611005f560 0x7f611013a610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 --2- 172.21.15.125:0/359418841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f611012b370 0x7f611013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 >> 172.21.15.125:0/359418841 conn(0x7f611009a1c0 msgr2=0x7f611012e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 shutdown_connections 2023-10-03T10:09:15.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.693+0000 7f611649b700 1 -- 172.21.15.125:0/359418841 wait complete. 2023-10-03T10:09:15.704 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T10:09:15.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:09:15.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 Processor -- start 2023-10-03T10:09:15.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 -- start start 2023-10-03T10:09:15.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fe4098600 0x7f2fe40989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 0x7f2fe412f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe409a410 con 0x7f2fe4098600 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4096510 con 0x7f2fe4098ed0 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe96d2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4095540 con 0x7f2fe412f9a0 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fe4098600 0x7f2fe40989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 0x7f2fe412f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fe4098600 0x7f2fe40989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54016/0 (socket says 172.21.15.125:54016) 2023-10-03T10:09:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40136/0 (socket says 172.21.15.125:40136) 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.822+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/956270972 learned_addr learned my addr 172.21.15.125:0/956270972 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 msgr2=0x7f2fe4131d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 msgr2=0x7f2fe412f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 0x7f2fe412f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/956270972 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4096790 con 0x7f2fe4098600 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe27fc700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 0x7f2fe412f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe37fe700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098600 0x7f2fe40989e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd40090f0).ready entity=mon.0 client_cookie=54dc509544ed6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe1ffb700 1 -- 172.21.15.125:0/956270972 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400f510 con 0x7f2fe4098600 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe1ffb700 1 -- 172.21.15.125:0/956270972 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400f670 con 0x7f2fe4098600 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe1ffb700 1 -- 172.21.15.125:0/956270972 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400fa10 con 0x7f2fe4098600 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe96d2700 1 -- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098600 msgr2=0x7f2fe40989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.823+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098600 0x7f2fe40989e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd40090f0).stop 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 -- 172.21.15.125:0/956270972 shutdown_connections 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe4131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098600 0x7f2fe40989e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/956270972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098ed0 0x7f2fe412f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 -- 172.21.15.125:0/956270972 >> 172.21.15.125:0/956270972 conn(0x7f2fe409a720 msgr2=0x7f2fe409ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 -- 172.21.15.125:0/956270972 shutdown_connections 2023-10-03T10:09:15.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.824+0000 7f2fe96d2700 1 -- 172.21.15.125:0/956270972 wait complete. 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 Processor -- start 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 -- start start 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098ed0 0x7f2fe411a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe411aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe411d5e0 con 0x7f2fe4098ed0 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe409cb50 con 0x7f2fe4098600 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe96d2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe409a110 con 0x7f2fe412f9a0 2023-10-03T10:09:15.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe411aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098ed0 0x7f2fe411a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45680/0 (socket says 172.21.15.125:45680) 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/698668964 learned_addr learned my addr 172.21.15.125:0/698668964 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 msgr2=0x7f2fe411aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe411aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098ed0 msgr2=0x7f2fe411a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098ed0 0x7f2fe411a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.825+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/698668964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80092a0 con 0x7f2fe4098600 2023-10-03T10:09:15.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2fe4095190 tx=0x7f2fd4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4006910 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4000bc0 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400fa10 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc009a20 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd4009370 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.826+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2fd4021070 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.827+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2fd403c8e0 con 0x7f2fe4098600 2023-10-03T10:09:15.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.827+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe411dcb0 con 0x7f2fe4098600 2023-10-03T10:09:15.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:15.831+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2fe411dcb0 con 0x7f2fe4098600 2023-10-03T10:09:16.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.026+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2fe411dcb0 con 0x7f2fe4098600 2023-10-03T10:09:16.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.688+0000 7f2fcaffd700 1 -- 172.21.15.125:0/698668964 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2fe411dcb0 con 0x7f2fe4098600 2023-10-03T10:09:16.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.690+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 >> v1:172.21.15.125:6816/118167 conn(0x7f2fd002bb30 legacy=0x7f2fd002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:16.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.690+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 msgr2=0x7f2fe411e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:16.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.690+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2fe4095190 tx=0x7f2fd4015000).stop 2023-10-03T10:09:16.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 shutdown_connections 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2fe412f9a0 0x7f2fe411aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fe4098600 0x7f2fe411e530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 --2- 172.21.15.125:0/698668964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fe4098ed0 0x7f2fe411a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 >> 172.21.15.125:0/698668964 conn(0x7f2fe409a720 msgr2=0x7f2fe409bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 shutdown_connections 2023-10-03T10:09:16.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.691+0000 7f2fe96d2700 1 -- 172.21.15.125:0/698668964 wait complete. 2023-10-03T10:09:16.704 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T10:09:16.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:16.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.826+0000 7f0e7cc11700 1 Processor -- start 2023-10-03T10:09:16.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.826+0000 7f0e7cc11700 1 -- start start 2023-10-03T10:09:16.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e78062b00 0x7f0e78095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 0x7f0e78095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780973f0 con 0x7f0e78062b00 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78062ee0 con 0x7f0e78095b80 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7cc11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78091980 con 0x7f0e78096490 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e78062b00 0x7f0e78095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e75d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 0x7f0e78095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e78062b00 0x7f0e78095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54040/0 (socket says 172.21.15.125:54040) 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 -- 172.21.15.125:0/1149747797 learned_addr learned my addr 172.21.15.125:0/1149747797 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40152/0 (socket says 172.21.15.125:40152) 2023-10-03T10:09:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 -- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 msgr2=0x7f0e78131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 -- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 msgr2=0x7f0e78095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 0x7f0e78095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 -- 172.21.15.125:0/1149747797 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78092310 con 0x7f0e78062b00 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e76d9d700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e75d9b700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 0x7f0e78095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7659c700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78095690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0e6c009830 tx=0x7f0e6c0090f0).ready entity=mon.0 client_cookie=18eeca4be68bb932 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7559a700 1 -- 172.21.15.125:0/1149747797 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00f510 con 0x7f0e78062b00 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7559a700 1 -- 172.21.15.125:0/1149747797 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c00f670 con 0x7f0e78062b00 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.827+0000 7f0e7559a700 1 -- 172.21.15.125:0/1149747797 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00f9f0 con 0x7f0e78062b00 2023-10-03T10:09:16.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 msgr2=0x7f0e78095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78095690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0e6c009830 tx=0x7f0e6c0090f0).stop 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1149747797 shutdown_connections 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78096490 0x7f0e78131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78095690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1149747797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78095b80 0x7f0e78095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1149747797 >> 172.21.15.125:0/1149747797 conn(0x7f0e7809aa50 msgr2=0x7f0e7809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1149747797 shutdown_connections 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.828+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1149747797 wait complete. 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 Processor -- start 2023-10-03T10:09:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 -- start start 2023-10-03T10:09:16.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 0x7f0e781169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 0x7f0e78116e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:16.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78119f30 con 0x7f0e78062b00 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78117da0 con 0x7f0e78096490 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7cc11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7811ac20 con 0x7f0e78095b80 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e75d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 0x7f0e781169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e76d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 0x7f0e78116e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e75d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 0x7f0e781169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40158/0 (socket says 172.21.15.125:40158) 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e7659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54046/0 (socket says 172.21.15.125:54046) 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.829+0000 7f0e75d9b700 1 -- 172.21.15.125:0/1754897976 learned_addr learned my addr 172.21.15.125:0/1754897976 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 -- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 msgr2=0x7f0e781169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 0x7f0e781169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 -- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 msgr2=0x7f0e78119970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 -- 172.21.15.125:0/1754897976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680092a0 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e7659c700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e76d9d700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 0x7f0e78116e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0e70009f10 tx=0x7f0e7000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000cb70 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7000f040 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e70009a20 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70013400 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.830+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c009370 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.831+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0e700137f0 con 0x7f0e78096490 2023-10-03T10:09:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.831+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0e7003b840 con 0x7f0e78096490 2023-10-03T10:09:16.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.831+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7805a260 con 0x7f0e78096490 2023-10-03T10:09:16.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:16.835+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0e70013aa0 con 0x7f0e78096490 2023-10-03T10:09:17.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.030+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e781177a0 con 0x7f0e78096490 2023-10-03T10:09:17.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.030+0000 7f0e667fc700 1 -- 172.21.15.125:0/1754897976 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f0e7001b7e0 con 0x7f0e78096490 2023-10-03T10:09:17.030 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:17.030 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:16.686162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:17.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 >> v1:172.21.15.125:6816/118167 conn(0x7f0e5802bb60 legacy=0x7f0e5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 msgr2=0x7f0e78116e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 0x7f0e78116e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0e70009f10 tx=0x7f0e7000b040).stop 2023-10-03T10:09:17.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 shutdown_connections 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e78096490 0x7f0e78116e90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e78062b00 0x7f0e78119970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 --2- 172.21.15.125:0/1754897976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e78095b80 0x7f0e781169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 >> 172.21.15.125:0/1754897976 conn(0x7f0e7809aa50 msgr2=0x7f0e78130120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 shutdown_connections 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.032+0000 7f0e7cc11700 1 -- 172.21.15.125:0/1754897976 wait complete. 2023-10-03T10:09:17.033 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 5 2023-10-03T10:09:17.043 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:17.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.158+0000 7f478c2dc700 1 Processor -- start 2023-10-03T10:09:17.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 -- start start 2023-10-03T10:09:17.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4784068c10 con 0x7f4784126fe0 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4784092770 con 0x7f4784123a90 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478c2dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784069550 con 0x7f4784092390 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f4789877700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478a078700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f4789877700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54060/0 (socket says 172.21.15.125:54060) 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478a078700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45706/0 (socket says 172.21.15.125:45706) 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f4789877700 1 -- 172.21.15.125:0/2494901625 learned_addr learned my addr 172.21.15.125:0/2494901625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.159+0000 7f478a879700 1 --1- 172.21.15.125:0/2494901625 >> v1:172.21.15.125:6789/0 conn(0x7f4784126fe0 0x7f4784127490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40196/0 (socket says 172.21.15.125:40196) 2023-10-03T10:09:17.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478a078700 1 -- 172.21.15.125:0/2494901625 >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 msgr2=0x7f4784123f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478a078700 1 --2- 172.21.15.125:0/2494901625 >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478a078700 1 -- 172.21.15.125:0/2494901625 >> v1:172.21.15.125:6789/0 conn(0x7f4784126fe0 legacy=0x7f4784127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478a078700 1 -- 172.21.15.125:0/2494901625 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784124550 con 0x7f4784092390 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f4789076700 1 -- 172.21.15.125:0/2494901625 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553357695 0 0) 0x7f4784068c10 con 0x7f4784126fe0 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f4789877700 1 --2- 172.21.15.125:0/2494901625 >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478a078700 1 --2- 172.21.15.125:0/2494901625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4778009760 tx=0x7f4778009060).ready entity=mon.1 client_cookie=4080fe16274ffd1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f4789076700 1 -- 172.21.15.125:0/2494901625 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800f510 con 0x7f4784092390 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f4789076700 1 -- 172.21.15.125:0/2494901625 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800f670 con 0x7f4784092390 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f4789076700 1 -- 172.21.15.125:0/2494901625 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800f9f0 con 0x7f4784092390 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 -- 172.21.15.125:0/2494901625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 msgr2=0x7f4784097aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 --2- 172.21.15.125:0/2494901625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4778009760 tx=0x7f4778009060).stop 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 -- 172.21.15.125:0/2494901625 shutdown_connections 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 --2- 172.21.15.125:0/2494901625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784097aa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 --2- 172.21.15.125:0/2494901625 >> v2:172.21.15.125:3300/0 conn(0x7f4784123a90 0x7f4784123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 -- 172.21.15.125:0/2494901625 >> 172.21.15.125:0/2494901625 conn(0x7f478409a230 msgr2=0x7f478409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.160+0000 7f478c2dc700 1 -- 172.21.15.125:0/2494901625 shutdown_connections 2023-10-03T10:09:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.161+0000 7f478c2dc700 1 -- 172.21.15.125:0/2494901625 wait complete. 2023-10-03T10:09:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.161+0000 7f478c2dc700 1 Processor -- start 2023-10-03T10:09:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.161+0000 7f478c2dc700 1 -- start start 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4784123a90 0x7f4784110d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 0x7f4784111270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784069780 con 0x7f4784126fe0 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784113d70 con 0x7f4784092390 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47840977e0 con 0x7f4784123a90 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a879700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 0x7f4784111270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f4789877700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4784123a90 0x7f4784110d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45712/0 (socket says 172.21.15.125:45712) 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 -- 172.21.15.125:0/1341237673 learned_addr learned my addr 172.21.15.125:0/1341237673 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 -- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4784123a90 msgr2=0x7f4784110d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4784123a90 0x7f4784110d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 -- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 msgr2=0x7f4784111270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 0x7f4784111270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 -- 172.21.15.125:0/1341237673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478000b610 con 0x7f4784092390 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a879700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 0x7f4784111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478a078700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4778006d70 tx=0x7f4778017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800f7e0 con 0x7f4784092390 2023-10-03T10:09:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800f940 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47780092a0 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477801b690 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.162+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784111cd0 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.163+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f477801ba80 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.163+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f477803c5a0 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.164+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478405a260 con 0x7f4784092390 2023-10-03T10:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.168+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4778018350 con 0x7f4784092390 2023-10-03T10:09:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.327+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4784046c20 con 0x7f4784092390 2023-10-03T10:09:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.327+0000 7f47767fc700 1 -- 172.21.15.125:0/1341237673 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f4778024bb0 con 0x7f4784092390 2023-10-03T10:09:17.327 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:17.327 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:17.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 >> v1:172.21.15.125:6816/118167 conn(0x7f476802bb60 legacy=0x7f476802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 msgr2=0x7f4784110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4778006d70 tx=0x7f4778017000).stop 2023-10-03T10:09:17.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 shutdown_connections 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4784126fe0 0x7f4784111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4784092390 0x7f4784110890 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 --2- 172.21.15.125:0/1341237673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4784123a90 0x7f4784110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 >> 172.21.15.125:0/1341237673 conn(0x7f478409a230 msgr2=0x7f4784066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 shutdown_connections 2023-10-03T10:09:17.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.329+0000 7f478c2dc700 1 -- 172.21.15.125:0/1341237673 wait complete. 2023-10-03T10:09:17.340 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T10:09:17.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:17.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 Processor -- start 2023-10-03T10:09:17.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 -- start start 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 0x7f22f812dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22f8126010 0x7f22f8130180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80963d0 con 0x7f22f8062b00 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f8062ee0 con 0x7f22f8126010 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fe39a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8095a50 con 0x7f22f8125400 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22f7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f22f8062b00 0x7f22f8125900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40202/0 (socket says 172.21.15.125:40202) 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22f77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 0x7f22f812dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22f7fff700 1 -- 172.21.15.125:0/1731911574 learned_addr learned my addr 172.21.15.125:0/1731911574 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.456+0000 7f22fc937700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22f8126010 0x7f22f8130180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fc937700 1 -- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 msgr2=0x7f22f812dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fc937700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 0x7f22f812dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fc937700 1 -- 172.21.15.125:0/1731911574 >> v1:172.21.15.125:6789/0 conn(0x7f22f8062b00 legacy=0x7f22f8125900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fc937700 1 -- 172.21.15.125:0/1731911574 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8063840 con 0x7f22f8126010 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22f6ffd700 1 -- 172.21.15.125:0/1731911574 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292408457 0 0) 0x7f22f80963d0 con 0x7f22f8062b00 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22f77fe700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 0x7f22f812dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fc937700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8126010 0x7f22f8130180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f22f0009e60 tx=0x7f22f0009780).ready entity=mon.0 client_cookie=8d366a0029fb0064 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22f6ffd700 1 -- 172.21.15.125:0/1731911574 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000e070 con 0x7f22f8126010 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22f6ffd700 1 -- 172.21.15.125:0/1731911574 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000bb60 con 0x7f22f8126010 2023-10-03T10:09:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22f6ffd700 1 -- 172.21.15.125:0/1731911574 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0012410 con 0x7f22f8126010 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fe39a700 1 -- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8126010 msgr2=0x7f22f8130180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fe39a700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8126010 0x7f22f8130180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f22f0009e60 tx=0x7f22f0009780).stop 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.457+0000 7f22fe39a700 1 -- 172.21.15.125:0/1731911574 shutdown_connections 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8126010 0x7f22f8130180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 --2- 172.21.15.125:0/1731911574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8125400 0x7f22f812dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 -- 172.21.15.125:0/1731911574 >> 172.21.15.125:0/1731911574 conn(0x7f22f809aa50 msgr2=0x7f22f809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 -- 172.21.15.125:0/1731911574 shutdown_connections 2023-10-03T10:09:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 -- 172.21.15.125:0/1731911574 wait complete. 2023-10-03T10:09:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.458+0000 7f22fe39a700 1 Processor -- start 2023-10-03T10:09:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 -- start start 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f8062b00 0x7f22f812f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8125400 0x7f22f8091980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8111920 con 0x7f22f8125400 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8124220 con 0x7f22f8062b00 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fe39a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22f812fc20 con 0x7f22f8126010 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f8062b00 0x7f22f812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40182/0 (socket says 172.21.15.125:40182) 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22f77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8125400 0x7f22f8091980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 -- 172.21.15.125:0/182813643 learned_addr learned my addr 172.21.15.125:0/182813643 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 -- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f8062b00 msgr2=0x7f22f812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f8062b00 0x7f22f812f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 -- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8125400 msgr2=0x7f22f8091980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8125400 0x7f22f8091980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.459+0000 7f22fc937700 1 -- 172.21.15.125:0/182813643 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0092a0 con 0x7f22f8126010 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22fc937700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f22f0011000 tx=0x7f22f0009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0012410 con 0x7f22f8126010 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f001d630 con 0x7f22f8126010 2023-10-03T10:09:17.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f001d9f0 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f0009a20 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8093180 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.460+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f22f0003040 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.461+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f22f003ccc0 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.461+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f8095ba0 con 0x7f22f8126010 2023-10-03T10:09:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.465+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f22f001bb50 con 0x7f22f8126010 2023-10-03T10:09:17.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.619+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22f805a260 con 0x7f22e402bb60 2023-10-03T10:09:17.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.625+0000 7f22dffff700 1 -- 172.21.15.125:0/182813643 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242442 (unknown 2965378022 0 377718411) 0x7f22f805a260 con 0x7f22e402bb60 2023-10-03T10:09:17.627 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 >> v1:172.21.15.125:6816/118167 conn(0x7f22e402bb60 legacy=0x7f22e402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 msgr2=0x7f22f8091e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f22f0011000 tx=0x7f22f0009780).stop 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 shutdown_connections 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22f8126010 0x7f22f8091e70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f8062b00 0x7f22f812f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 --2- 172.21.15.125:0/182813643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f8125400 0x7f22f8091980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 >> 172.21.15.125:0/182813643 conn(0x7f22f809aa50 msgr2=0x7f22f8099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 shutdown_connections 2023-10-03T10:09:17.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.628+0000 7f22fe39a700 1 -- 172.21.15.125:0/182813643 wait complete. 2023-10-03T10:09:17.631 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:17.639 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:17.142073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298536,"statfs":{"total":386547056640,"available":385329700864,"internally_reserved":0,"allocated":450560,"data_stored":117448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477542+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:10.477542+0000","last_peered":"2023-10-03T10:09:10.477542+0000","last_clean":"2023-10-03T10:09:10.477542+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:10.477542+0000","last_undegraded":"2023-10-03T10:09:10.477542+0000","last_fullsized":"2023-10-03T10:09:10.477542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.193841+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:10.193841+0000","last_peered":"2023-10-03T10:09:10.193841+0000","last_clean":"2023-10-03T10:09:10.193841+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:10.193841+0000","last_undegraded":"2023-10-03T10:09:10.193841+0000","last_fullsized":"2023-10-03T10:09:10.193841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.185369+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:10.185369+0000","last_peered":"2023-10-03T10:09:10.185369+0000","last_clean":"2023-10-03T10:09:10.185369+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:10.185369+0000","last_undegraded":"2023-10-03T10:09:10.185369+0000","last_fullsized":"2023-10-03T10:09:10.185369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186602+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:10.186602+0000","last_peered":"2023-10-03T10:09:10.186602+0000","last_clean":"2023-10-03T10:09:10.186602+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:10.186602+0000","last_undegraded":"2023-10-03T10:09:10.186602+0000","last_fullsized":"2023-10-03T10:09:10.186602+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.182704+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:10.182704+0000","last_peered":"2023-10-03T10:09:10.182704+0000","last_clean":"2023-10-03T10:09:10.182704+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:10.182704+0000","last_undegraded":"2023-10-03T10:09:10.182704+0000","last_fullsized":"2023-10-03T10:09:10.182704+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186554+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:10.186554+0000","last_peered":"2023-10-03T10:09:10.186554+0000","last_clean":"2023-10-03T10:09:10.186554+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:10.186554+0000","last_undegraded":"2023-10-03T10:09:10.186554+0000","last_fullsized":"2023-10-03T10:09:10.186554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477035+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:10.477035+0000","last_peered":"2023-10-03T10:09:10.477035+0000","last_clean":"2023-10-03T10:09:10.477035+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:10.477035+0000","last_undegraded":"2023-10-03T10:09:10.477035+0000","last_fullsized":"2023-10-03T10:09:10.477035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477540+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:10.477540+0000","last_peered":"2023-10-03T10:09:10.477540+0000","last_clean":"2023-10-03T10:09:10.477540+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:10.477540+0000","last_undegraded":"2023-10-03T10:09:10.477540+0000","last_fullsized":"2023-10-03T10:09:10.477540+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.478236+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:10.478236+0000","last_peered":"2023-10-03T10:09:10.478236+0000","last_clean":"2023-10-03T10:09:10.478236+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:10.478236+0000","last_undegraded":"2023-10-03T10:09:10.478236+0000","last_fullsized":"2023-10-03T10:09:10.478236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:17.645 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.795+0000 7fd6be61e700 1 Processor -- start 2023-10-03T10:09:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.795+0000 7fd6be61e700 1 -- start start 2023-10-03T10:09:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6be61e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6be61e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 0x7fd6b8132b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6be61e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b8066e30 con 0x7fd6b812afd0 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6be61e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b812ab10 con 0x7fd6b8130770 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6be61e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8067500 con 0x7fd6b812de90 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40184/0 (socket says 172.21.15.125:40184) 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6bcbbb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 0x7fd6b8132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 -- 172.21.15.125:0/3221053906 learned_addr learned my addr 172.21.15.125:0/3221053906 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 -- 172.21.15.125:0/3221053906 >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 msgr2=0x7fd6b8132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 --2- 172.21.15.125:0/3221053906 >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 0x7fd6b8132b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 -- 172.21.15.125:0/3221053906 >> v1:172.21.15.125:6789/0 conn(0x7fd6b812afd0 legacy=0x7fd6b812b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 -- 172.21.15.125:0/3221053906 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b812adb0 con 0x7fd6b812de90 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b6ffd700 1 -- 172.21.15.125:0/3221053906 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880673292 0 0) 0x7fd6b8066e30 con 0x7fd6b812afd0 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6bcbbb700 1 --2- 172.21.15.125:0/3221053906 >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 0x7fd6b8132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.796+0000 7fd6b77fe700 1 --2- 172.21.15.125:0/3221053906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd6ac006fd0 tx=0x7fd6ac0090f0).ready entity=mon.2 client_cookie=b5e5c27b26f1f053 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6b6ffd700 1 -- 172.21.15.125:0/3221053906 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00b580 con 0x7fd6b812de90 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6b6ffd700 1 -- 172.21.15.125:0/3221053906 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00b6e0 con 0x7fd6b812de90 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6b6ffd700 1 -- 172.21.15.125:0/3221053906 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00ba60 con 0x7fd6b812de90 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 -- 172.21.15.125:0/3221053906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 msgr2=0x7fd6b8130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 --2- 172.21.15.125:0/3221053906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd6ac006fd0 tx=0x7fd6ac0090f0).stop 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 -- 172.21.15.125:0/3221053906 shutdown_connections 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 --2- 172.21.15.125:0/3221053906 >> v2:172.21.15.125:3300/0 conn(0x7fd6b8130770 0x7fd6b8132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 --2- 172.21.15.125:0/3221053906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b8130280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 -- 172.21.15.125:0/3221053906 >> 172.21.15.125:0/3221053906 conn(0x7fd6b809a230 msgr2=0x7fd6b809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 -- 172.21.15.125:0/3221053906 shutdown_connections 2023-10-03T10:09:17.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.797+0000 7fd6be61e700 1 -- 172.21.15.125:0/3221053906 wait complete. 2023-10-03T10:09:17.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 Processor -- start 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 -- start start 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 0x7fd6b81142f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6b8130770 0x7fd6b8114cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b812a410 con 0x7fd6b812afd0 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.798+0000 7fd6be61e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8116920 con 0x7fd6b8130770 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6be61e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8067040 con 0x7fd6b812de90 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 0x7fd6b81142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40192/0 (socket says 172.21.15.125:40192) 2023-10-03T10:09:17.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 -- 172.21.15.125:0/4116872920 learned_addr learned my addr 172.21.15.125:0/4116872920 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6bcbbb700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6b8130770 0x7fd6b8114cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 -- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6b8130770 msgr2=0x7fd6b8114cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6b8130770 0x7fd6b8114cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 -- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 msgr2=0x7fd6b81142f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 0x7fd6b81142f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 -- 172.21.15.125:0/4116872920 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009a20 con 0x7fd6b812de90 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b7fff700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 0x7fd6b81142f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6b77fe700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd6ac009fd0 tx=0x7fd6ac017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00b850 con 0x7fd6b812de90 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00b9b0 con 0x7fd6b812de90 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac009370 con 0x7fd6b812de90 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac01c670 con 0x7fd6b812de90 2023-10-03T10:09:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.799+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b8118470 con 0x7fd6b812de90 2023-10-03T10:09:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.800+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd6ac01caa0 con 0x7fd6b812de90 2023-10-03T10:09:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.800+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd6ac03cd40 con 0x7fd6b812de90 2023-10-03T10:09:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.800+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8130390 con 0x7fd6b812de90 2023-10-03T10:09:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.805+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd6ac02a080 con 0x7fd6b812de90 2023-10-03T10:09:17.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.958+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6b8118660 con 0x7fd6a402bb60 2023-10-03T10:09:17.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.965+0000 7fd69ffff700 1 -- 172.21.15.125:0/4116872920 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242442 (unknown 2965378022 0 377718411) 0x7fd6b8118660 con 0x7fd6a402bb60 2023-10-03T10:09:17.968 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 >> v1:172.21.15.125:6816/118167 conn(0x7fd6a402bb60 legacy=0x7fd6a402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 msgr2=0x7fd6b81147e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd6ac009fd0 tx=0x7fd6ac017000).stop 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 shutdown_connections 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6b8130770 0x7fd6b8114cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6b812afd0 0x7fd6b81142f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 --2- 172.21.15.125:0/4116872920 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6b812de90 0x7fd6b81147e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 >> 172.21.15.125:0/4116872920 conn(0x7fd6b809a230 msgr2=0x7fd6b812f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 shutdown_connections 2023-10-03T10:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:17.968+0000 7fd6be61e700 1 -- 172.21.15.125:0/4116872920 wait complete. 2023-10-03T10:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:17.979 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:17.142073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298536,"statfs":{"total":386547056640,"available":385329700864,"internally_reserved":0,"allocated":450560,"data_stored":117448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477542+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:10.477542+0000","last_peered":"2023-10-03T10:09:10.477542+0000","last_clean":"2023-10-03T10:09:10.477542+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:10.477542+0000","last_undegraded":"2023-10-03T10:09:10.477542+0000","last_fullsized":"2023-10-03T10:09:10.477542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.193841+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:10.193841+0000","last_peered":"2023-10-03T10:09:10.193841+0000","last_clean":"2023-10-03T10:09:10.193841+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:10.193841+0000","last_undegraded":"2023-10-03T10:09:10.193841+0000","last_fullsized":"2023-10-03T10:09:10.193841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.185369+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:10.185369+0000","last_peered":"2023-10-03T10:09:10.185369+0000","last_clean":"2023-10-03T10:09:10.185369+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:10.185369+0000","last_undegraded":"2023-10-03T10:09:10.185369+0000","last_fullsized":"2023-10-03T10:09:10.185369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186602+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:10.186602+0000","last_peered":"2023-10-03T10:09:10.186602+0000","last_clean":"2023-10-03T10:09:10.186602+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:10.186602+0000","last_undegraded":"2023-10-03T10:09:10.186602+0000","last_fullsized":"2023-10-03T10:09:10.186602+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.182704+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:10.182704+0000","last_peered":"2023-10-03T10:09:10.182704+0000","last_clean":"2023-10-03T10:09:10.182704+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:10.182704+0000","last_undegraded":"2023-10-03T10:09:10.182704+0000","last_fullsized":"2023-10-03T10:09:10.182704+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186554+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:10.186554+0000","last_peered":"2023-10-03T10:09:10.186554+0000","last_clean":"2023-10-03T10:09:10.186554+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:10.186554+0000","last_undegraded":"2023-10-03T10:09:10.186554+0000","last_fullsized":"2023-10-03T10:09:10.186554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477035+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:10.477035+0000","last_peered":"2023-10-03T10:09:10.477035+0000","last_clean":"2023-10-03T10:09:10.477035+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:10.477035+0000","last_undegraded":"2023-10-03T10:09:10.477035+0000","last_fullsized":"2023-10-03T10:09:10.477035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477540+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:10.477540+0000","last_peered":"2023-10-03T10:09:10.477540+0000","last_clean":"2023-10-03T10:09:10.477540+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:10.477540+0000","last_undegraded":"2023-10-03T10:09:10.477540+0000","last_fullsized":"2023-10-03T10:09:10.477540+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.478236+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:10.478236+0000","last_peered":"2023-10-03T10:09:10.478236+0000","last_clean":"2023-10-03T10:09:10.478236+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:10.478236+0000","last_undegraded":"2023-10-03T10:09:10.478236+0000","last_fullsized":"2023-10-03T10:09:10.478236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:17.983 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:18.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 Processor -- start 2023-10-03T10:09:18.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 -- start start 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 0x7fe89c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe89c0931b0 0x7fe89c12b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0677f0 con 0x7fe89c091980 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c067c60 con 0x7fe89c0931b0 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a26fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c092ba0 con 0x7fe89c12ae30 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe89b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe89c0931b0 0x7fe89c12b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 0x7fe89c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe89b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe89c0931b0 0x7fe89c12b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54128/0 (socket says 172.21.15.125:54128) 2023-10-03T10:09:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe89b7fe700 1 -- 172.21.15.125:0/375904038 learned_addr learned my addr 172.21.15.125:0/375904038 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.135+0000 7fe8a0c9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe89c091980 0x7fe89c091df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40222/0 (socket says 172.21.15.125:40222) 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89b7fe700 1 -- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 msgr2=0x7fe89c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89b7fe700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 0x7fe89c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89b7fe700 1 -- 172.21.15.125:0/375904038 >> v1:172.21.15.125:6789/0 conn(0x7fe89c091980 legacy=0x7fe89c091df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89b7fe700 1 -- 172.21.15.125:0/375904038 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c12ac10 con 0x7fe89c0931b0 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89affd700 1 -- 172.21.15.125:0/375904038 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203579519 0 0) 0x7fe89c0677f0 con 0x7fe89c091980 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89bfff700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 0x7fe89c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89b7fe700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c12b700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe890006fd0 tx=0x7fe8900090f0).ready entity=mon.0 client_cookie=31d0a146a8d66846 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89affd700 1 -- 172.21.15.125:0/375904038 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000b580 con 0x7fe89c0931b0 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89affd700 1 -- 172.21.15.125:0/375904038 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000b6e0 con 0x7fe89c0931b0 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe89affd700 1 -- 172.21.15.125:0/375904038 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000ba80 con 0x7fe89c0931b0 2023-10-03T10:09:18.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 -- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 msgr2=0x7fe89c12b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c12b700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe890006fd0 tx=0x7fe8900090f0).stop 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 -- 172.21.15.125:0/375904038 shutdown_connections 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c12ae30 0x7fe89c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/375904038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c12b700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 -- 172.21.15.125:0/375904038 >> 172.21.15.125:0/375904038 conn(0x7fe89c09a230 msgr2=0x7fe89c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.136+0000 7fe8a26fe700 1 -- 172.21.15.125:0/375904038 shutdown_connections 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.137+0000 7fe8a26fe700 1 -- 172.21.15.125:0/375904038 wait complete. 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.137+0000 7fe8a26fe700 1 Processor -- start 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.137+0000 7fe8a26fe700 1 -- start start 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 0x7fe89c11b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 0x7fe89c117c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c118bb0 con 0x7fe89c0931b0 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c11a5c0 con 0x7fe89c091980 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a26fe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c11ab50 con 0x7fe89c12ae30 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54136/0 (socket says 172.21.15.125:54136) 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a0c9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 0x7fe89c117c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 -- 172.21.15.125:0/410922698 learned_addr learned my addr 172.21.15.125:0/410922698 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89bfff700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 0x7fe89c11b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 -- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 msgr2=0x7fe89c117c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 0x7fe89c117c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 -- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 msgr2=0x7fe89c11b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 0x7fe89c11b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 -- 172.21.15.125:0/410922698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0092a0 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89bfff700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 0x7fe89c11b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe8a0c9b700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 0x7fe89c117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.138+0000 7fe89b7fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe890011000 tx=0x7fe890017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890006d90 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000be40 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe890009370 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89001c420 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c1199d0 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.139+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe89001c790 con 0x7fe89c0931b0 2023-10-03T10:09:18.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.140+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe89003cb90 con 0x7fe89c0931b0 2023-10-03T10:09:18.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.140+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c128b90 con 0x7fe89c0931b0 2023-10-03T10:09:18.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.144+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe89002a020 con 0x7fe89c0931b0 2023-10-03T10:09:18.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.301+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe89c05a260 con 0x7fe88802bb60 2023-10-03T10:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.307+0000 7fe883fff700 1 -- 172.21.15.125:0/410922698 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242442 (unknown 2965378022 0 377718411) 0x7fe89c05a260 con 0x7fe88802bb60 2023-10-03T10:09:18.309 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.309+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 >> v1:172.21.15.125:6816/118167 conn(0x7fe88802bb60 legacy=0x7fe88802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.309+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 msgr2=0x7fe89c117710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.309+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe890011000 tx=0x7fe890017000).stop 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.309+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 shutdown_connections 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.309+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe89c12ae30 0x7fe89c117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.310+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe89c091980 0x7fe89c11b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.310+0000 7fe8a26fe700 1 --2- 172.21.15.125:0/410922698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe89c0931b0 0x7fe89c117710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.310+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 >> 172.21.15.125:0/410922698 conn(0x7fe89c09a230 msgr2=0x7fe89c098810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.310+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 shutdown_connections 2023-10-03T10:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.310+0000 7fe8a26fe700 1 -- 172.21.15.125:0/410922698 wait complete. 2023-10-03T10:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:18.320 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:17.142073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298536,"statfs":{"total":386547056640,"available":385329700864,"internally_reserved":0,"allocated":450560,"data_stored":117448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477542+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:10.477542+0000","last_peered":"2023-10-03T10:09:10.477542+0000","last_clean":"2023-10-03T10:09:10.477542+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:10.477542+0000","last_undegraded":"2023-10-03T10:09:10.477542+0000","last_fullsized":"2023-10-03T10:09:10.477542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.193841+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:10.193841+0000","last_peered":"2023-10-03T10:09:10.193841+0000","last_clean":"2023-10-03T10:09:10.193841+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:10.193841+0000","last_undegraded":"2023-10-03T10:09:10.193841+0000","last_fullsized":"2023-10-03T10:09:10.193841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.185369+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:10.185369+0000","last_peered":"2023-10-03T10:09:10.185369+0000","last_clean":"2023-10-03T10:09:10.185369+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:10.185369+0000","last_undegraded":"2023-10-03T10:09:10.185369+0000","last_fullsized":"2023-10-03T10:09:10.185369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186602+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:10.186602+0000","last_peered":"2023-10-03T10:09:10.186602+0000","last_clean":"2023-10-03T10:09:10.186602+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:10.186602+0000","last_undegraded":"2023-10-03T10:09:10.186602+0000","last_fullsized":"2023-10-03T10:09:10.186602+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.182704+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:10.182704+0000","last_peered":"2023-10-03T10:09:10.182704+0000","last_clean":"2023-10-03T10:09:10.182704+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:10.182704+0000","last_undegraded":"2023-10-03T10:09:10.182704+0000","last_fullsized":"2023-10-03T10:09:10.182704+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186554+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:10.186554+0000","last_peered":"2023-10-03T10:09:10.186554+0000","last_clean":"2023-10-03T10:09:10.186554+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:10.186554+0000","last_undegraded":"2023-10-03T10:09:10.186554+0000","last_fullsized":"2023-10-03T10:09:10.186554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477035+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:10.477035+0000","last_peered":"2023-10-03T10:09:10.477035+0000","last_clean":"2023-10-03T10:09:10.477035+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:10.477035+0000","last_undegraded":"2023-10-03T10:09:10.477035+0000","last_fullsized":"2023-10-03T10:09:10.477035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477540+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:10.477540+0000","last_peered":"2023-10-03T10:09:10.477540+0000","last_clean":"2023-10-03T10:09:10.477540+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:10.477540+0000","last_undegraded":"2023-10-03T10:09:10.477540+0000","last_fullsized":"2023-10-03T10:09:10.477540+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.478236+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:10.478236+0000","last_peered":"2023-10-03T10:09:10.478236+0000","last_clean":"2023-10-03T10:09:10.478236+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:10.478236+0000","last_undegraded":"2023-10-03T10:09:10.478236+0000","last_fullsized":"2023-10-03T10:09:10.478236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:18.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-10-03T10:09:18.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-03T10:09:18.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-03T10:09:18.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-03T10:09:18.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-03T10:09:18.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-03T10:09:18.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:13.299973+0000', 'last_change': '2023-10-03T10:09:13.299973+0000', 'last_active': '2023-10-03T10:09:13.299973+0000', 'last_peered': '2023-10-03T10:09:13.299973+0000', 'last_clean': '2023-10-03T10:09:13.299973+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:13.299973+0000', 'last_undegraded': '2023-10-03T10:09:13.299973+0000', 'last_fullsized': '2023-10-03T10:09:13.299973+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:13.299973+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-10-03T10:09:18.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:14.303267+0000', 'last_change': '2023-10-03T10:09:14.303267+0000', 'last_active': '2023-10-03T10:09:14.303267+0000', 'last_peered': '2023-10-03T10:09:14.303267+0000', 'last_clean': '2023-10-03T10:09:14.303267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:14.303267+0000', 'last_undegraded': '2023-10-03T10:09:14.303267+0000', 'last_fullsized': '2023-10-03T10:09:14.303267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:14.303267+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:18.345 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T10:09:18.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.476+0000 7fe83a2cc700 1 Processor -- start 2023-10-03T10:09:18.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 -- start start 2023-10-03T10:09:18.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe834091980 con 0x7fe834062b00 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340973f0 con 0x7fe834095da0 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe83a2cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe834062ee0 con 0x7fe8340966b0 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe8337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe838869700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe8337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54146/0 (socket says 172.21.15.125:54146) 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe8337fe700 1 -- 172.21.15.125:0/3048610120 learned_addr learned my addr 172.21.15.125:0/3048610120 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe833fff700 1 --1- 172.21.15.125:0/3048610120 >> v1:172.21.15.125:6789/0 conn(0x7fe834062b00 0x7fe834095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40234/0 (socket says 172.21.15.125:40234) 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe838869700 1 -- 172.21.15.125:0/3048610120 >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 msgr2=0x7fe8340961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe838869700 1 --2- 172.21.15.125:0/3048610120 >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe838869700 1 -- 172.21.15.125:0/3048610120 >> v1:172.21.15.125:6789/0 conn(0x7fe834062b00 legacy=0x7fe834095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe838869700 1 -- 172.21.15.125:0/3048610120 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834092310 con 0x7fe8340966b0 2023-10-03T10:09:18.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe832ffd700 1 -- 172.21.15.125:0/3048610120 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594253468 0 0) 0x7fe834091980 con 0x7fe834062b00 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.477+0000 7fe8337fe700 1 --2- 172.21.15.125:0/3048610120 >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe838869700 1 --2- 172.21.15.125:0/3048610120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834132290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe82c009e60 tx=0x7fe82c009780).ready entity=mon.1 client_cookie=5094c75b6d06cc34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe832ffd700 1 -- 172.21.15.125:0/3048610120 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00e070 con 0x7fe8340966b0 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe832ffd700 1 -- 172.21.15.125:0/3048610120 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00bb60 con 0x7fe8340966b0 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe832ffd700 1 -- 172.21.15.125:0/3048610120 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c012410 con 0x7fe8340966b0 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3048610120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 msgr2=0x7fe834132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3048610120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834132290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe82c009e60 tx=0x7fe82c009780).stop 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3048610120 shutdown_connections 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3048610120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834132290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3048610120 >> v2:172.21.15.125:3300/0 conn(0x7fe834095da0 0x7fe8340961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3048610120 >> 172.21.15.125:0/3048610120 conn(0x7fe83409aa50 msgr2=0x7fe83409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:18.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3048610120 shutdown_connections 2023-10-03T10:09:18.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.478+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3048610120 wait complete. 2023-10-03T10:09:18.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.479+0000 7fe83a2cc700 1 Processor -- start 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.479+0000 7fe83a2cc700 1 -- start start 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 0x7fe834115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 0x7fe834115610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83412d260 con 0x7fe834062b00 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe834117750 con 0x7fe8340966b0 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe834096da0 con 0x7fe834095da0 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 0x7fe834115610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45762/0 (socket says 172.21.15.125:45762) 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 -- 172.21.15.125:0/3560485739 learned_addr learned my addr 172.21.15.125:0/3560485739 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe833fff700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 0x7fe834115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 -- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 msgr2=0x7fe834115610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 0x7fe834115610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 -- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 msgr2=0x7fe834115120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 0x7fe834115120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 -- 172.21.15.125:0/3560485739 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009370 con 0x7fe8340966b0 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe8337fe700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 0x7fe834115610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe833fff700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 0x7fe834115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe838869700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe82c00b6c0 tx=0x7fe82c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c01d630 con 0x7fe8340966b0 2023-10-03T10:09:18.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c01d790 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c01db30 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c009a20 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.480+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8341192a0 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.481+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe82c003040 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.481+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe82c03cd60 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.482+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8340997e0 con 0x7fe8340966b0 2023-10-03T10:09:18.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.486+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe82c01bce0 con 0x7fe8340966b0 2023-10-03T10:09:18.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.705+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe8341326c0 con 0x7fe8340966b0 2023-10-03T10:09:18.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.706+0000 7fe81bfff700 1 -- 172.21.15.125:0/3560485739 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7fe82c01bb00 con 0x7fe8340966b0 2023-10-03T10:09:18.705 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:18.706 INFO:teuthology.orchestra.run.smithi125.stdout:{"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1696327747,"num_in_osds":4,"osd_in_since":1696327740,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":1217355776,"bytes_avail":385329700864,"bytes_total":386547056640,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4180}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-03T10:08:57.995045+0000","services":{}},"progress_events":{}} 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 >> v1:172.21.15.125:6816/118167 conn(0x7fe82002bb30 legacy=0x7fe82002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 msgr2=0x7fe834115b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe82c00b6c0 tx=0x7fe82c009780).stop 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 shutdown_connections 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8340966b0 0x7fe834115b00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe834062b00 0x7fe834115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 --2- 172.21.15.125:0/3560485739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe834095da0 0x7fe834115610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 >> 172.21.15.125:0/3560485739 conn(0x7fe83409aa50 msgr2=0x7fe834131fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 shutdown_connections 2023-10-03T10:09:18.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.708+0000 7fe83a2cc700 1 -- 172.21.15.125:0/3560485739 wait complete. 2023-10-03T10:09:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T10:09:18.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:18.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.834+0000 7f86607d0700 1 Processor -- start 2023-10-03T10:09:18.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.834+0000 7f86607d0700 1 -- start start 2023-10-03T10:09:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 0x7f8658096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8658094ba0 con 0x7f8658095c50 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8658092e90 con 0x7f865812c240 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f86607d0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8658096b60 con 0x7f8658093950 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f865e56c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f865ed6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.835+0000 7f865dd6b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 0x7f8658096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40218/0 (socket says 172.21.15.125:40218) 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865ed6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45774/0 (socket says 172.21.15.125:45774) 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 -- 172.21.15.125:0/1085966442 learned_addr learned my addr 172.21.15.125:0/1085966442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 -- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 msgr2=0x7f865812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 -- 172.21.15.125:0/1085966442 >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 msgr2=0x7f8658096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 --2- 172.21.15.125:0/1085966442 >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 0x7f8658096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 -- 172.21.15.125:0/1085966442 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658093150 con 0x7f8658093950 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865dd6b700 1 --2- 172.21.15.125:0/1085966442 >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 0x7f8658096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865ed6d700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865e56c700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8648006fd0 tx=0x7f86480090f0).ready entity=mon.2 client_cookie=50b3bffa4f34074a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865d56a700 1 -- 172.21.15.125:0/1085966442 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864800f510 con 0x7f8658093950 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865d56a700 1 -- 172.21.15.125:0/1085966442 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864800f670 con 0x7f8658093950 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.836+0000 7f865d56a700 1 -- 172.21.15.125:0/1085966442 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864800fa10 con 0x7f8658093950 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 -- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 msgr2=0x7f8658095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8648006fd0 tx=0x7f86480090f0).stop 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 -- 172.21.15.125:0/1085966442 shutdown_connections 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f865812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 --2- 172.21.15.125:0/1085966442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658095760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 --2- 172.21.15.125:0/1085966442 >> v2:172.21.15.125:3300/0 conn(0x7f8658095c50 0x7f8658096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 -- 172.21.15.125:0/1085966442 >> 172.21.15.125:0/1085966442 conn(0x7f865809aa50 msgr2=0x7f865809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 -- 172.21.15.125:0/1085966442 shutdown_connections 2023-10-03T10:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.837+0000 7f86607d0700 1 -- 172.21.15.125:0/1085966442 wait complete. 2023-10-03T10:09:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 Processor -- start 2023-10-03T10:09:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 -- start start 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f86581193c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865809a380 con 0x7f8658095c50 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8658092410 con 0x7f865812c240 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.838+0000 7f86607d0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f865811afb0 con 0x7f8658093950 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865dd6b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865ed6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f86581193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865dd6b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54174/0 (socket says 172.21.15.125:54174) 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865dd6b700 1 -- 172.21.15.125:0/3215410172 learned_addr learned my addr 172.21.15.125:0/3215410172 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 -- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 msgr2=0x7f86581193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f86581193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 -- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 msgr2=0x7f8658118ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 -- 172.21.15.125:0/3215410172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540092a0 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865dd6b700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f865e56c700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658062b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8648014000 tx=0x7f8648017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648006930 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8648000bc0 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8650009a20 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648024470 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.839+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8648009370 con 0x7f8658093950 2023-10-03T10:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.840+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8648021070 con 0x7f8658093950 2023-10-03T10:09:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.840+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f864803c840 con 0x7f8658093950 2023-10-03T10:09:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.840+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865811b790 con 0x7f8658093950 2023-10-03T10:09:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.845+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8648010990 con 0x7f8658093950 2023-10-03T10:09:18.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:18.999+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f865805a260 con 0x7f863c02bb60 2023-10-03T10:09:19.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.005+0000 7f864e7fc700 1 -- 172.21.15.125:0/3215410172 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242442 (unknown 2965378022 0 377718411) 0x7f865805a260 con 0x7f863c02bb60 2023-10-03T10:09:19.007 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:19.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 >> v1:172.21.15.125:6816/118167 conn(0x7f863c02bb60 legacy=0x7f863c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:19.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 msgr2=0x7f8658062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:19.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658062b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8648014000 tx=0x7f8648017000).stop 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 shutdown_connections 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865812c240 0x7f86581193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8658093950 0x7f8658062b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 --2- 172.21.15.125:0/3215410172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8658095c50 0x7f8658118ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 >> 172.21.15.125:0/3215410172 conn(0x7f865809aa50 msgr2=0x7f86581110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 shutdown_connections 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:19.008+0000 7f86607d0700 1 -- 172.21.15.125:0/3215410172 wait complete. 2023-10-03T10:09:19.010 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:19.019 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:17.142073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298536,"statfs":{"total":386547056640,"available":385329700864,"internally_reserved":0,"allocated":450560,"data_stored":117448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477542+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:10.477542+0000","last_peered":"2023-10-03T10:09:10.477542+0000","last_clean":"2023-10-03T10:09:10.477542+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:10.477542+0000","last_undegraded":"2023-10-03T10:09:10.477542+0000","last_fullsized":"2023-10-03T10:09:10.477542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.193841+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:10.193841+0000","last_peered":"2023-10-03T10:09:10.193841+0000","last_clean":"2023-10-03T10:09:10.193841+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:10.193841+0000","last_undegraded":"2023-10-03T10:09:10.193841+0000","last_fullsized":"2023-10-03T10:09:10.193841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.185369+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:10.185369+0000","last_peered":"2023-10-03T10:09:10.185369+0000","last_clean":"2023-10-03T10:09:10.185369+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:10.185369+0000","last_undegraded":"2023-10-03T10:09:10.185369+0000","last_fullsized":"2023-10-03T10:09:10.185369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186602+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:10.186602+0000","last_peered":"2023-10-03T10:09:10.186602+0000","last_clean":"2023-10-03T10:09:10.186602+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:10.186602+0000","last_undegraded":"2023-10-03T10:09:10.186602+0000","last_fullsized":"2023-10-03T10:09:10.186602+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.182704+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:10.182704+0000","last_peered":"2023-10-03T10:09:10.182704+0000","last_clean":"2023-10-03T10:09:10.182704+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:10.182704+0000","last_undegraded":"2023-10-03T10:09:10.182704+0000","last_fullsized":"2023-10-03T10:09:10.182704+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.186554+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:10.186554+0000","last_peered":"2023-10-03T10:09:10.186554+0000","last_clean":"2023-10-03T10:09:10.186554+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:10.186554+0000","last_undegraded":"2023-10-03T10:09:10.186554+0000","last_fullsized":"2023-10-03T10:09:10.186554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477035+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:10.477035+0000","last_peered":"2023-10-03T10:09:10.477035+0000","last_clean":"2023-10-03T10:09:10.477035+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:10.477035+0000","last_undegraded":"2023-10-03T10:09:10.477035+0000","last_fullsized":"2023-10-03T10:09:10.477035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.477540+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:10.477540+0000","last_peered":"2023-10-03T10:09:10.477540+0000","last_clean":"2023-10-03T10:09:10.477540+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:10.477540+0000","last_undegraded":"2023-10-03T10:09:10.477540+0000","last_fullsized":"2023-10-03T10:09:10.477540+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:10.478236+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:10.478236+0000","last_peered":"2023-10-03T10:09:10.478236+0000","last_clean":"2023-10-03T10:09:10.478236+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:10.478236+0000","last_undegraded":"2023-10-03T10:09:10.478236+0000","last_fullsized":"2023-10-03T10:09:10.478236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:13.299973+0000","last_change":"2023-10-03T10:09:13.299973+0000","last_active":"2023-10-03T10:09:13.299973+0000","last_peered":"2023-10-03T10:09:13.299973+0000","last_clean":"2023-10-03T10:09:13.299973+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:13.299973+0000","last_undegraded":"2023-10-03T10:09:13.299973+0000","last_fullsized":"2023-10-03T10:09:13.299973+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:14.303267+0000","last_change":"2023-10-03T10:09:14.303267+0000","last_active":"2023-10-03T10:09:14.303267+0000","last_peered":"2023-10-03T10:09:14.303267+0000","last_clean":"2023-10-03T10:09:14.303267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:14.303267+0000","last_undegraded":"2023-10-03T10:09:14.303267+0000","last_fullsized":"2023-10-03T10:09:14.303267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:20.301 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-10-03T10:09:20.301+0000 7fa076768700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T10:09:22.023 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 Processor -- start 2023-10-03T10:09:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 -- start start 2023-10-03T10:09:22.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f088012fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0880130390 0x7f0880132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0880097ac0 con 0x7f088005f560 2023-10-03T10:09:22.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088005f940 con 0x7f0880130390 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.149+0000 7f0884ca3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088012ab20 con 0x7f088012b470 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0880130390 0x7f0880132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f088012fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f088005f560 0x7f088012ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40236/0 (socket says 172.21.15.125:40236) 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087e59c700 1 -- 172.21.15.125:0/1692877864 learned_addr learned my addr 172.21.15.125:0/1692877864 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 -- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 msgr2=0x7f088012fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f088012fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 -- 172.21.15.125:0/1692877864 >> v1:172.21.15.125:6789/0 conn(0x7f088005f560 legacy=0x7f088012ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 -- 172.21.15.125:0/1692877864 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880066f90 con 0x7f0880130390 2023-10-03T10:09:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087d59a700 1 -- 172.21.15.125:0/1692877864 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94521681 0 0) 0x7f0880097ac0 con 0x7f088005f560 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087dd9b700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f088012fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087ed9d700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0880130390 0x7f0880132780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0878009e60 tx=0x7f0878009780).ready entity=mon.0 client_cookie=f8b59596d00d53e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087d59a700 1 -- 172.21.15.125:0/1692877864 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800e070 con 0x7f0880130390 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087d59a700 1 -- 172.21.15.125:0/1692877864 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087800bb60 con 0x7f0880130390 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.150+0000 7f087d59a700 1 -- 172.21.15.125:0/1692877864 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878012410 con 0x7f0880130390 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 -- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0880130390 msgr2=0x7f0880132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0880130390 0x7f0880132780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0878009e60 tx=0x7f0878009780).stop 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 -- 172.21.15.125:0/1692877864 shutdown_connections 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0880130390 0x7f0880132780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 --2- 172.21.15.125:0/1692877864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f088012fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 -- 172.21.15.125:0/1692877864 >> 172.21.15.125:0/1692877864 conn(0x7f088009a1c0 msgr2=0x7f088009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 -- 172.21.15.125:0/1692877864 shutdown_connections 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.151+0000 7f0884ca3700 1 -- 172.21.15.125:0/1692877864 wait complete. 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 Processor -- start 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 -- start start 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 0x7f0880129550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0880130390 0x7f08801139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08801148c0 con 0x7f088005f560 2023-10-03T10:09:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800671c0 con 0x7f088012b470 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f0884ca3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08801169d0 con 0x7f0880130390 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 0x7f0880129550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45798/0 (socket says 172.21.15.125:45798) 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087dd9b700 1 -- 172.21.15.125:0/2809996148 learned_addr learned my addr 172.21.15.125:0/2809996148 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087ed9d700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0880130390 0x7f08801139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 -- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0880130390 msgr2=0x7f08801139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0880130390 0x7f08801139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 -- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 msgr2=0x7f08801134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087e59c700 1 -- 172.21.15.125:0/2809996148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740092a0 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.152+0000 7f087dd9b700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f087e59c700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 0x7f0880129550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0870000c00 tx=0x7f0870007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700070d0 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870007250 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0878009a20 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870007610 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0880117690 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.153+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f08700059b0 con 0x7f088005f560 2023-10-03T10:09:22.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.154+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f087003a470 con 0x7f088005f560 2023-10-03T10:09:22.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.154+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880117690 con 0x7f088005f560 2023-10-03T10:09:22.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.158+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0880117690 con 0x7f088005f560 2023-10-03T10:09:22.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.315+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0880116eb0 con 0x7f086002bb60 2023-10-03T10:09:22.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.322+0000 7f086e7fc700 1 -- 172.21.15.125:0/2809996148 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250023 (unknown 2965378022 0 2705381957) 0x7f0880116eb0 con 0x7f086002bb60 2023-10-03T10:09:22.325 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 >> v1:172.21.15.125:6816/118167 conn(0x7f086002bb60 legacy=0x7f086002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 msgr2=0x7f0880129550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 0x7f0880129550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0870000c00 tx=0x7f0870007b90).stop 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 shutdown_connections 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0880130390 0x7f08801139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f088005f560 0x7f0880129550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 --2- 172.21.15.125:0/2809996148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f088012b470 0x7f08801134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 >> 172.21.15.125:0/2809996148 conn(0x7f088009a1c0 msgr2=0x7f0880098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:22.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 shutdown_connections 2023-10-03T10:09:22.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.324+0000 7f0884ca3700 1 -- 172.21.15.125:0/2809996148 wait complete. 2023-10-03T10:09:22.328 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:22.336 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:09:21.143039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189016,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298344,"statfs":{"total":386547056640,"available":385329504256,"internally_reserved":0,"allocated":647168,"data_stored":189135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000570"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715818+0000","last_change":"2023-10-03T10:09:14.714603+0000","last_active":"2023-10-03T10:09:14.715818+0000","last_peered":"2023-10-03T10:09:14.715818+0000","last_clean":"2023-10-03T10:09:14.715818+0000","last_became_active":"2023-10-03T10:09:14.714337+0000","last_became_peered":"2023-10-03T10:09:14.714337+0000","last_unstale":"2023-10-03T10:09:14.715818+0000","last_undegraded":"2023-10-03T10:09:14.715818+0000","last_fullsized":"2023-10-03T10:09:14.715818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709275+0000","last_change":"2023-10-03T10:09:14.705544+0000","last_active":"2023-10-03T10:09:14.709275+0000","last_peered":"2023-10-03T10:09:14.709275+0000","last_clean":"2023-10-03T10:09:14.709275+0000","last_became_active":"2023-10-03T10:09:14.705240+0000","last_became_peered":"2023-10-03T10:09:14.705240+0000","last_unstale":"2023-10-03T10:09:14.709275+0000","last_undegraded":"2023-10-03T10:09:14.709275+0000","last_fullsized":"2023-10-03T10:09:14.709275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721157+0000","last_change":"2023-10-03T10:09:14.715211+0000","last_active":"2023-10-03T10:09:14.721157+0000","last_peered":"2023-10-03T10:09:14.721157+0000","last_clean":"2023-10-03T10:09:14.721157+0000","last_became_active":"2023-10-03T10:09:14.714965+0000","last_became_peered":"2023-10-03T10:09:14.714965+0000","last_unstale":"2023-10-03T10:09:14.721157+0000","last_undegraded":"2023-10-03T10:09:14.721157+0000","last_fullsized":"2023-10-03T10:09:14.721157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720890+0000","last_change":"2023-10-03T10:09:14.710747+0000","last_active":"2023-10-03T10:09:14.720890+0000","last_peered":"2023-10-03T10:09:14.720890+0000","last_clean":"2023-10-03T10:09:14.720890+0000","last_became_active":"2023-10-03T10:09:14.710471+0000","last_became_peered":"2023-10-03T10:09:14.710471+0000","last_unstale":"2023-10-03T10:09:14.720890+0000","last_undegraded":"2023-10-03T10:09:14.720890+0000","last_fullsized":"2023-10-03T10:09:14.720890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722101+0000","last_change":"2023-10-03T10:09:14.719560+0000","last_active":"2023-10-03T10:09:14.722101+0000","last_peered":"2023-10-03T10:09:14.722101+0000","last_clean":"2023-10-03T10:09:14.722101+0000","last_became_active":"2023-10-03T10:09:14.719359+0000","last_became_peered":"2023-10-03T10:09:14.719359+0000","last_unstale":"2023-10-03T10:09:14.722101+0000","last_undegraded":"2023-10-03T10:09:14.722101+0000","last_fullsized":"2023-10-03T10:09:14.722101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722554+0000","last_change":"2023-10-03T10:09:14.719561+0000","last_active":"2023-10-03T10:09:14.722554+0000","last_peered":"2023-10-03T10:09:14.722554+0000","last_clean":"2023-10-03T10:09:14.722554+0000","last_became_active":"2023-10-03T10:09:14.719264+0000","last_became_peered":"2023-10-03T10:09:14.719264+0000","last_unstale":"2023-10-03T10:09:14.722554+0000","last_undegraded":"2023-10-03T10:09:14.722554+0000","last_fullsized":"2023-10-03T10:09:14.722554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729401+0000","last_change":"2023-10-03T10:09:14.723496+0000","last_active":"2023-10-03T10:09:14.729401+0000","last_peered":"2023-10-03T10:09:14.729401+0000","last_clean":"2023-10-03T10:09:14.729401+0000","last_became_active":"2023-10-03T10:09:14.723260+0000","last_became_peered":"2023-10-03T10:09:14.723260+0000","last_unstale":"2023-10-03T10:09:14.729401+0000","last_undegraded":"2023-10-03T10:09:14.729401+0000","last_fullsized":"2023-10-03T10:09:14.729401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730975+0000","last_change":"2023-10-03T10:09:14.728885+0000","last_active":"2023-10-03T10:09:14.730975+0000","last_peered":"2023-10-03T10:09:14.730975+0000","last_clean":"2023-10-03T10:09:14.730975+0000","last_became_active":"2023-10-03T10:09:14.720610+0000","last_became_peered":"2023-10-03T10:09:14.720610+0000","last_unstale":"2023-10-03T10:09:14.730975+0000","last_undegraded":"2023-10-03T10:09:14.730975+0000","last_fullsized":"2023-10-03T10:09:14.730975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721091+0000","last_change":"2023-10-03T10:09:14.713481+0000","last_active":"2023-10-03T10:09:14.721091+0000","last_peered":"2023-10-03T10:09:14.721091+0000","last_clean":"2023-10-03T10:09:14.721091+0000","last_became_active":"2023-10-03T10:09:14.711120+0000","last_became_peered":"2023-10-03T10:09:14.711120+0000","last_unstale":"2023-10-03T10:09:14.721091+0000","last_undegraded":"2023-10-03T10:09:14.721091+0000","last_fullsized":"2023-10-03T10:09:14.721091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730834+0000","last_change":"2023-10-03T10:09:14.726303+0000","last_active":"2023-10-03T10:09:14.730834+0000","last_peered":"2023-10-03T10:09:14.730834+0000","last_clean":"2023-10-03T10:09:14.730834+0000","last_became_active":"2023-10-03T10:09:14.726049+0000","last_became_peered":"2023-10-03T10:09:14.726049+0000","last_unstale":"2023-10-03T10:09:14.730834+0000","last_undegraded":"2023-10-03T10:09:14.730834+0000","last_fullsized":"2023-10-03T10:09:14.730834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730903+0000","last_change":"2023-10-03T10:09:14.726200+0000","last_active":"2023-10-03T10:09:14.730903+0000","last_peered":"2023-10-03T10:09:14.730903+0000","last_clean":"2023-10-03T10:09:14.730903+0000","last_became_active":"2023-10-03T10:09:14.725948+0000","last_became_peered":"2023-10-03T10:09:14.725948+0000","last_unstale":"2023-10-03T10:09:14.730903+0000","last_undegraded":"2023-10-03T10:09:14.730903+0000","last_fullsized":"2023-10-03T10:09:14.730903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720401+0000","last_change":"2023-10-03T10:09:14.714843+0000","last_active":"2023-10-03T10:09:14.720401+0000","last_peered":"2023-10-03T10:09:14.720401+0000","last_clean":"2023-10-03T10:09:14.720401+0000","last_became_active":"2023-10-03T10:09:14.714579+0000","last_became_peered":"2023-10-03T10:09:14.714579+0000","last_unstale":"2023-10-03T10:09:14.720401+0000","last_undegraded":"2023-10-03T10:09:14.720401+0000","last_fullsized":"2023-10-03T10:09:14.720401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730712+0000","last_change":"2023-10-03T10:09:14.724414+0000","last_active":"2023-10-03T10:09:14.730712+0000","last_peered":"2023-10-03T10:09:14.730712+0000","last_clean":"2023-10-03T10:09:14.730712+0000","last_became_active":"2023-10-03T10:09:14.723833+0000","last_became_peered":"2023-10-03T10:09:14.723833+0000","last_unstale":"2023-10-03T10:09:14.730712+0000","last_undegraded":"2023-10-03T10:09:14.730712+0000","last_fullsized":"2023-10-03T10:09:14.730712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710054+0000","last_change":"2023-10-03T10:09:14.708491+0000","last_active":"2023-10-03T10:09:14.710054+0000","last_peered":"2023-10-03T10:09:14.710054+0000","last_clean":"2023-10-03T10:09:14.710054+0000","last_became_active":"2023-10-03T10:09:14.705272+0000","last_became_peered":"2023-10-03T10:09:14.705272+0000","last_unstale":"2023-10-03T10:09:14.710054+0000","last_undegraded":"2023-10-03T10:09:14.710054+0000","last_fullsized":"2023-10-03T10:09:14.710054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721043+0000","last_change":"2023-10-03T10:09:14.713611+0000","last_active":"2023-10-03T10:09:14.721043+0000","last_peered":"2023-10-03T10:09:14.721043+0000","last_clean":"2023-10-03T10:09:14.721043+0000","last_became_active":"2023-10-03T10:09:14.713350+0000","last_became_peered":"2023-10-03T10:09:14.713350+0000","last_unstale":"2023-10-03T10:09:14.721043+0000","last_undegraded":"2023-10-03T10:09:14.721043+0000","last_fullsized":"2023-10-03T10:09:14.721043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719062+0000","last_change":"2023-10-03T10:09:14.717325+0000","last_active":"2023-10-03T10:09:14.719062+0000","last_peered":"2023-10-03T10:09:14.719062+0000","last_clean":"2023-10-03T10:09:14.719062+0000","last_became_active":"2023-10-03T10:09:14.717060+0000","last_became_peered":"2023-10-03T10:09:14.717060+0000","last_unstale":"2023-10-03T10:09:14.719062+0000","last_undegraded":"2023-10-03T10:09:14.719062+0000","last_fullsized":"2023-10-03T10:09:14.719062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721108+0000","last_change":"2023-10-03T10:09:14.713656+0000","last_active":"2023-10-03T10:09:14.721108+0000","last_peered":"2023-10-03T10:09:14.721108+0000","last_clean":"2023-10-03T10:09:14.721108+0000","last_became_active":"2023-10-03T10:09:14.711482+0000","last_became_peered":"2023-10-03T10:09:14.711482+0000","last_unstale":"2023-10-03T10:09:14.721108+0000","last_undegraded":"2023-10-03T10:09:14.721108+0000","last_fullsized":"2023-10-03T10:09:14.721108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.717202+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.716379+0000","last_became_peered":"2023-10-03T10:09:14.716379+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.728377+0000","last_change":"2023-10-03T10:09:14.723512+0000","last_active":"2023-10-03T10:09:14.728377+0000","last_peered":"2023-10-03T10:09:14.728377+0000","last_clean":"2023-10-03T10:09:14.728377+0000","last_became_active":"2023-10-03T10:09:14.723235+0000","last_became_peered":"2023-10-03T10:09:14.723235+0000","last_unstale":"2023-10-03T10:09:14.728377+0000","last_undegraded":"2023-10-03T10:09:14.728377+0000","last_fullsized":"2023-10-03T10:09:14.728377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727701+0000","last_change":"2023-10-03T10:09:14.718233+0000","last_active":"2023-10-03T10:09:14.727701+0000","last_peered":"2023-10-03T10:09:14.727701+0000","last_clean":"2023-10-03T10:09:14.727701+0000","last_became_active":"2023-10-03T10:09:14.717964+0000","last_became_peered":"2023-10-03T10:09:14.717964+0000","last_unstale":"2023-10-03T10:09:14.727701+0000","last_undegraded":"2023-10-03T10:09:14.727701+0000","last_fullsized":"2023-10-03T10:09:14.727701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727625+0000","last_change":"2023-10-03T10:09:14.721092+0000","last_active":"2023-10-03T10:09:14.727625+0000","last_peered":"2023-10-03T10:09:14.727625+0000","last_clean":"2023-10-03T10:09:14.727625+0000","last_became_active":"2023-10-03T10:09:14.720802+0000","last_became_peered":"2023-10-03T10:09:14.720802+0000","last_unstale":"2023-10-03T10:09:14.727625+0000","last_undegraded":"2023-10-03T10:09:14.727625+0000","last_fullsized":"2023-10-03T10:09:14.727625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721034+0000","last_change":"2023-10-03T10:09:14.712170+0000","last_active":"2023-10-03T10:09:14.721034+0000","last_peered":"2023-10-03T10:09:14.721034+0000","last_clean":"2023-10-03T10:09:14.721034+0000","last_became_active":"2023-10-03T10:09:14.711964+0000","last_became_peered":"2023-10-03T10:09:14.711964+0000","last_unstale":"2023-10-03T10:09:14.721034+0000","last_undegraded":"2023-10-03T10:09:14.721034+0000","last_fullsized":"2023-10-03T10:09:14.721034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719896+0000","last_change":"2023-10-03T10:09:14.717587+0000","last_active":"2023-10-03T10:09:14.719896+0000","last_peered":"2023-10-03T10:09:14.719896+0000","last_clean":"2023-10-03T10:09:14.719896+0000","last_became_active":"2023-10-03T10:09:14.717339+0000","last_became_peered":"2023-10-03T10:09:14.717339+0000","last_unstale":"2023-10-03T10:09:14.719896+0000","last_undegraded":"2023-10-03T10:09:14.719896+0000","last_fullsized":"2023-10-03T10:09:14.719896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730956+0000","last_change":"2023-10-03T10:09:14.728847+0000","last_active":"2023-10-03T10:09:14.730956+0000","last_peered":"2023-10-03T10:09:14.730956+0000","last_clean":"2023-10-03T10:09:14.730956+0000","last_became_active":"2023-10-03T10:09:14.725404+0000","last_became_peered":"2023-10-03T10:09:14.725404+0000","last_unstale":"2023-10-03T10:09:14.730956+0000","last_undegraded":"2023-10-03T10:09:14.730956+0000","last_fullsized":"2023-10-03T10:09:14.730956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727848+0000","last_change":"2023-10-03T10:09:14.718621+0000","last_active":"2023-10-03T10:09:14.727848+0000","last_peered":"2023-10-03T10:09:14.727848+0000","last_clean":"2023-10-03T10:09:14.727848+0000","last_became_active":"2023-10-03T10:09:14.718361+0000","last_became_peered":"2023-10-03T10:09:14.718361+0000","last_unstale":"2023-10-03T10:09:14.727848+0000","last_undegraded":"2023-10-03T10:09:14.727848+0000","last_fullsized":"2023-10-03T10:09:14.727848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710082+0000","last_change":"2023-10-03T10:09:14.707751+0000","last_active":"2023-10-03T10:09:14.710082+0000","last_peered":"2023-10-03T10:09:14.710082+0000","last_clean":"2023-10-03T10:09:14.710082+0000","last_became_active":"2023-10-03T10:09:14.707489+0000","last_became_peered":"2023-10-03T10:09:14.707489+0000","last_unstale":"2023-10-03T10:09:14.710082+0000","last_undegraded":"2023-10-03T10:09:14.710082+0000","last_fullsized":"2023-10-03T10:09:14.710082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731804+0000","last_change":"2023-10-03T10:09:14.724017+0000","last_active":"2023-10-03T10:09:14.731804+0000","last_peered":"2023-10-03T10:09:14.731804+0000","last_clean":"2023-10-03T10:09:14.731804+0000","last_became_active":"2023-10-03T10:09:14.723540+0000","last_became_peered":"2023-10-03T10:09:14.723540+0000","last_unstale":"2023-10-03T10:09:14.731804+0000","last_undegraded":"2023-10-03T10:09:14.731804+0000","last_fullsized":"2023-10-03T10:09:14.731804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710268+0000","last_change":"2023-10-03T10:09:14.354052+0000","last_active":"2023-10-03T10:09:14.710268+0000","last_peered":"2023-10-03T10:09:14.710268+0000","last_clean":"2023-10-03T10:09:14.710268+0000","last_became_active":"2023-10-03T10:09:14.353765+0000","last_became_peered":"2023-10-03T10:09:14.353765+0000","last_unstale":"2023-10-03T10:09:14.710268+0000","last_undegraded":"2023-10-03T10:09:14.710268+0000","last_fullsized":"2023-10-03T10:09:14.710268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734524+0000","last_change":"2023-10-03T10:09:14.731372+0000","last_active":"2023-10-03T10:09:14.734524+0000","last_peered":"2023-10-03T10:09:14.734524+0000","last_clean":"2023-10-03T10:09:14.734524+0000","last_became_active":"2023-10-03T10:09:14.730476+0000","last_became_peered":"2023-10-03T10:09:14.730476+0000","last_unstale":"2023-10-03T10:09:14.734524+0000","last_undegraded":"2023-10-03T10:09:14.734524+0000","last_fullsized":"2023-10-03T10:09:14.734524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699867+0000","last_change":"2023-10-03T10:09:14.340525+0000","last_active":"2023-10-03T10:09:14.699867+0000","last_peered":"2023-10-03T10:09:14.699867+0000","last_clean":"2023-10-03T10:09:14.699867+0000","last_became_active":"2023-10-03T10:09:14.340215+0000","last_became_peered":"2023-10-03T10:09:14.340215+0000","last_unstale":"2023-10-03T10:09:14.699867+0000","last_undegraded":"2023-10-03T10:09:14.699867+0000","last_fullsized":"2023-10-03T10:09:14.699867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721514+0000","last_change":"2023-10-03T10:09:14.717045+0000","last_active":"2023-10-03T10:09:14.721514+0000","last_peered":"2023-10-03T10:09:14.721514+0000","last_clean":"2023-10-03T10:09:14.721514+0000","last_became_active":"2023-10-03T10:09:14.716120+0000","last_became_peered":"2023-10-03T10:09:14.716120+0000","last_unstale":"2023-10-03T10:09:14.721514+0000","last_undegraded":"2023-10-03T10:09:14.721514+0000","last_fullsized":"2023-10-03T10:09:14.721514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.704177+0000","last_change":"2023-10-03T10:09:14.345802+0000","last_active":"2023-10-03T10:09:14.704177+0000","last_peered":"2023-10-03T10:09:14.704177+0000","last_clean":"2023-10-03T10:09:14.704177+0000","last_became_active":"2023-10-03T10:09:14.345529+0000","last_became_peered":"2023-10-03T10:09:14.345529+0000","last_unstale":"2023-10-03T10:09:14.704177+0000","last_undegraded":"2023-10-03T10:09:14.704177+0000","last_fullsized":"2023-10-03T10:09:14.704177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734388+0000","last_change":"2023-10-03T10:09:14.729797+0000","last_active":"2023-10-03T10:09:14.734388+0000","last_peered":"2023-10-03T10:09:14.734388+0000","last_clean":"2023-10-03T10:09:14.734388+0000","last_became_active":"2023-10-03T10:09:14.729212+0000","last_became_peered":"2023-10-03T10:09:14.729212+0000","last_unstale":"2023-10-03T10:09:14.734388+0000","last_undegraded":"2023-10-03T10:09:14.734388+0000","last_fullsized":"2023-10-03T10:09:14.734388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.692378+0000","last_change":"2023-10-03T10:09:14.343788+0000","last_active":"2023-10-03T10:09:14.692378+0000","last_peered":"2023-10-03T10:09:14.692378+0000","last_clean":"2023-10-03T10:09:14.692378+0000","last_became_active":"2023-10-03T10:09:14.343495+0000","last_became_peered":"2023-10-03T10:09:14.343495+0000","last_unstale":"2023-10-03T10:09:14.692378+0000","last_undegraded":"2023-10-03T10:09:14.692378+0000","last_fullsized":"2023-10-03T10:09:14.692378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734891+0000","last_change":"2023-10-03T10:09:14.734087+0000","last_active":"2023-10-03T10:09:14.734891+0000","last_peered":"2023-10-03T10:09:14.734891+0000","last_clean":"2023-10-03T10:09:14.734891+0000","last_became_active":"2023-10-03T10:09:14.733689+0000","last_became_peered":"2023-10-03T10:09:14.733689+0000","last_unstale":"2023-10-03T10:09:14.734891+0000","last_undegraded":"2023-10-03T10:09:14.734891+0000","last_fullsized":"2023-10-03T10:09:14.734891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695756+0000","last_change":"2023-10-03T10:09:14.339768+0000","last_active":"2023-10-03T10:09:14.695756+0000","last_peered":"2023-10-03T10:09:14.695756+0000","last_clean":"2023-10-03T10:09:14.695756+0000","last_became_active":"2023-10-03T10:09:14.339501+0000","last_became_peered":"2023-10-03T10:09:14.339501+0000","last_unstale":"2023-10-03T10:09:14.695756+0000","last_undegraded":"2023-10-03T10:09:14.695756+0000","last_fullsized":"2023-10-03T10:09:14.695756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729384+0000","last_change":"2023-10-03T10:09:14.723237+0000","last_active":"2023-10-03T10:09:14.729384+0000","last_peered":"2023-10-03T10:09:14.729384+0000","last_clean":"2023-10-03T10:09:14.729384+0000","last_became_active":"2023-10-03T10:09:14.722881+0000","last_became_peered":"2023-10-03T10:09:14.722881+0000","last_unstale":"2023-10-03T10:09:14.729384+0000","last_undegraded":"2023-10-03T10:09:14.729384+0000","last_fullsized":"2023-10-03T10:09:14.729384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715565+0000","last_change":"2023-10-03T10:09:14.339824+0000","last_active":"2023-10-03T10:09:14.715565+0000","last_peered":"2023-10-03T10:09:14.715565+0000","last_clean":"2023-10-03T10:09:14.715565+0000","last_became_active":"2023-10-03T10:09:14.339560+0000","last_became_peered":"2023-10-03T10:09:14.339560+0000","last_unstale":"2023-10-03T10:09:14.715565+0000","last_undegraded":"2023-10-03T10:09:14.715565+0000","last_fullsized":"2023-10-03T10:09:14.715565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727816+0000","last_change":"2023-10-03T10:09:14.721025+0000","last_active":"2023-10-03T10:09:14.727816+0000","last_peered":"2023-10-03T10:09:14.727816+0000","last_clean":"2023-10-03T10:09:14.727816+0000","last_became_active":"2023-10-03T10:09:14.720762+0000","last_became_peered":"2023-10-03T10:09:14.720762+0000","last_unstale":"2023-10-03T10:09:14.727816+0000","last_undegraded":"2023-10-03T10:09:14.727816+0000","last_fullsized":"2023-10-03T10:09:14.727816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731374+0000","last_change":"2023-10-03T10:09:14.346629+0000","last_active":"2023-10-03T10:09:14.731374+0000","last_peered":"2023-10-03T10:09:14.731374+0000","last_clean":"2023-10-03T10:09:14.731374+0000","last_became_active":"2023-10-03T10:09:14.346335+0000","last_became_peered":"2023-10-03T10:09:14.346335+0000","last_unstale":"2023-10-03T10:09:14.731374+0000","last_undegraded":"2023-10-03T10:09:14.731374+0000","last_fullsized":"2023-10-03T10:09:14.731374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730730+0000","last_change":"2023-10-03T10:09:14.724074+0000","last_active":"2023-10-03T10:09:14.730730+0000","last_peered":"2023-10-03T10:09:14.730730+0000","last_clean":"2023-10-03T10:09:14.730730+0000","last_became_active":"2023-10-03T10:09:14.723284+0000","last_became_peered":"2023-10-03T10:09:14.723284+0000","last_unstale":"2023-10-03T10:09:14.730730+0000","last_undegraded":"2023-10-03T10:09:14.730730+0000","last_fullsized":"2023-10-03T10:09:14.730730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.725102+0000","last_change":"2023-10-03T10:09:14.353282+0000","last_active":"2023-10-03T10:09:14.725102+0000","last_peered":"2023-10-03T10:09:14.725102+0000","last_clean":"2023-10-03T10:09:14.725102+0000","last_became_active":"2023-10-03T10:09:14.352586+0000","last_became_peered":"2023-10-03T10:09:14.352586+0000","last_unstale":"2023-10-03T10:09:14.725102+0000","last_undegraded":"2023-10-03T10:09:14.725102+0000","last_fullsized":"2023-10-03T10:09:14.725102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734301+0000","last_change":"2023-10-03T10:09:14.729509+0000","last_active":"2023-10-03T10:09:14.734301+0000","last_peered":"2023-10-03T10:09:14.734301+0000","last_clean":"2023-10-03T10:09:14.734301+0000","last_became_active":"2023-10-03T10:09:14.729254+0000","last_became_peered":"2023-10-03T10:09:14.729254+0000","last_unstale":"2023-10-03T10:09:14.734301+0000","last_undegraded":"2023-10-03T10:09:14.734301+0000","last_fullsized":"2023-10-03T10:09:14.734301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690235+0000","last_change":"2023-10-03T10:09:14.343728+0000","last_active":"2023-10-03T10:09:14.690235+0000","last_peered":"2023-10-03T10:09:14.690235+0000","last_clean":"2023-10-03T10:09:14.690235+0000","last_became_active":"2023-10-03T10:09:14.343444+0000","last_became_peered":"2023-10-03T10:09:14.343444+0000","last_unstale":"2023-10-03T10:09:14.690235+0000","last_undegraded":"2023-10-03T10:09:14.690235+0000","last_fullsized":"2023-10-03T10:09:14.690235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731815+0000","last_change":"2023-10-03T10:09:14.724168+0000","last_active":"2023-10-03T10:09:14.731815+0000","last_peered":"2023-10-03T10:09:14.731815+0000","last_clean":"2023-10-03T10:09:14.731815+0000","last_became_active":"2023-10-03T10:09:14.723777+0000","last_became_peered":"2023-10-03T10:09:14.723777+0000","last_unstale":"2023-10-03T10:09:14.731815+0000","last_undegraded":"2023-10-03T10:09:14.731815+0000","last_fullsized":"2023-10-03T10:09:14.731815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.705446+0000","last_change":"2023-10-03T10:09:14.346628+0000","last_active":"2023-10-03T10:09:14.705446+0000","last_peered":"2023-10-03T10:09:14.705446+0000","last_clean":"2023-10-03T10:09:14.705446+0000","last_became_active":"2023-10-03T10:09:14.346352+0000","last_became_peered":"2023-10-03T10:09:14.346352+0000","last_unstale":"2023-10-03T10:09:14.705446+0000","last_undegraded":"2023-10-03T10:09:14.705446+0000","last_fullsized":"2023-10-03T10:09:14.705446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721547+0000","last_change":"2023-10-03T10:09:14.717361+0000","last_active":"2023-10-03T10:09:14.721547+0000","last_peered":"2023-10-03T10:09:14.721547+0000","last_clean":"2023-10-03T10:09:14.721547+0000","last_became_active":"2023-10-03T10:09:14.716635+0000","last_became_peered":"2023-10-03T10:09:14.716635+0000","last_unstale":"2023-10-03T10:09:14.721547+0000","last_undegraded":"2023-10-03T10:09:14.721547+0000","last_fullsized":"2023-10-03T10:09:14.721547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729991+0000","last_change":"2023-10-03T10:09:14.344594+0000","last_active":"2023-10-03T10:09:14.729991+0000","last_peered":"2023-10-03T10:09:14.729991+0000","last_clean":"2023-10-03T10:09:14.729991+0000","last_became_active":"2023-10-03T10:09:14.344319+0000","last_became_peered":"2023-10-03T10:09:14.344319+0000","last_unstale":"2023-10-03T10:09:14.729991+0000","last_undegraded":"2023-10-03T10:09:14.729991+0000","last_fullsized":"2023-10-03T10:09:14.729991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734410+0000","last_change":"2023-10-03T10:09:14.729964+0000","last_active":"2023-10-03T10:09:14.734410+0000","last_peered":"2023-10-03T10:09:14.734410+0000","last_clean":"2023-10-03T10:09:14.734410+0000","last_became_active":"2023-10-03T10:09:14.729548+0000","last_became_peered":"2023-10-03T10:09:14.729548+0000","last_unstale":"2023-10-03T10:09:14.734410+0000","last_undegraded":"2023-10-03T10:09:14.734410+0000","last_fullsized":"2023-10-03T10:09:14.734410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731124+0000","last_change":"2023-10-03T10:09:14.344297+0000","last_active":"2023-10-03T10:09:14.731124+0000","last_peered":"2023-10-03T10:09:14.731124+0000","last_clean":"2023-10-03T10:09:14.731124+0000","last_became_active":"2023-10-03T10:09:14.344040+0000","last_became_peered":"2023-10-03T10:09:14.344040+0000","last_unstale":"2023-10-03T10:09:14.731124+0000","last_undegraded":"2023-10-03T10:09:14.731124+0000","last_fullsized":"2023-10-03T10:09:14.731124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734907+0000","last_change":"2023-10-03T10:09:14.734141+0000","last_active":"2023-10-03T10:09:14.734907+0000","last_peered":"2023-10-03T10:09:14.734907+0000","last_clean":"2023-10-03T10:09:14.734907+0000","last_became_active":"2023-10-03T10:09:14.733955+0000","last_became_peered":"2023-10-03T10:09:14.733955+0000","last_unstale":"2023-10-03T10:09:14.734907+0000","last_undegraded":"2023-10-03T10:09:14.734907+0000","last_fullsized":"2023-10-03T10:09:14.734907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720183+0000","last_change":"2023-10-03T10:09:14.345399+0000","last_active":"2023-10-03T10:09:14.720183+0000","last_peered":"2023-10-03T10:09:14.720183+0000","last_clean":"2023-10-03T10:09:14.720183+0000","last_became_active":"2023-10-03T10:09:14.345110+0000","last_became_peered":"2023-10-03T10:09:14.345110+0000","last_unstale":"2023-10-03T10:09:14.720183+0000","last_undegraded":"2023-10-03T10:09:14.720183+0000","last_fullsized":"2023-10-03T10:09:14.720183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727567+0000","last_change":"2023-10-03T10:09:14.716249+0000","last_active":"2023-10-03T10:09:14.727567+0000","last_peered":"2023-10-03T10:09:14.727567+0000","last_clean":"2023-10-03T10:09:14.727567+0000","last_became_active":"2023-10-03T10:09:14.715990+0000","last_became_peered":"2023-10-03T10:09:14.715990+0000","last_unstale":"2023-10-03T10:09:14.727567+0000","last_undegraded":"2023-10-03T10:09:14.727567+0000","last_fullsized":"2023-10-03T10:09:14.727567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731734+0000","last_change":"2023-10-03T10:09:14.345375+0000","last_active":"2023-10-03T10:09:14.731734+0000","last_peered":"2023-10-03T10:09:14.731734+0000","last_clean":"2023-10-03T10:09:14.731734+0000","last_became_active":"2023-10-03T10:09:14.343897+0000","last_became_peered":"2023-10-03T10:09:14.343897+0000","last_unstale":"2023-10-03T10:09:14.731734+0000","last_undegraded":"2023-10-03T10:09:14.731734+0000","last_fullsized":"2023-10-03T10:09:14.731734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.715812+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.715548+0000","last_became_peered":"2023-10-03T10:09:14.715548+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690536+0000","last_change":"2023-10-03T10:09:14.343714+0000","last_active":"2023-10-03T10:09:14.690536+0000","last_peered":"2023-10-03T10:09:14.690536+0000","last_clean":"2023-10-03T10:09:14.690536+0000","last_became_active":"2023-10-03T10:09:14.343419+0000","last_became_peered":"2023-10-03T10:09:14.343419+0000","last_unstale":"2023-10-03T10:09:14.690536+0000","last_undegraded":"2023-10-03T10:09:14.690536+0000","last_fullsized":"2023-10-03T10:09:14.690536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722064+0000","last_change":"2023-10-03T10:09:14.710007+0000","last_active":"2023-10-03T10:09:14.722064+0000","last_peered":"2023-10-03T10:09:14.722064+0000","last_clean":"2023-10-03T10:09:14.722064+0000","last_became_active":"2023-10-03T10:09:14.708147+0000","last_became_peered":"2023-10-03T10:09:14.708147+0000","last_unstale":"2023-10-03T10:09:14.722064+0000","last_undegraded":"2023-10-03T10:09:14.722064+0000","last_fullsized":"2023-10-03T10:09:14.722064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724797+0000","last_change":"2023-10-03T10:09:14.353447+0000","last_active":"2023-10-03T10:09:14.724797+0000","last_peered":"2023-10-03T10:09:14.724797+0000","last_clean":"2023-10-03T10:09:14.724797+0000","last_became_active":"2023-10-03T10:09:14.352906+0000","last_became_peered":"2023-10-03T10:09:14.352906+0000","last_unstale":"2023-10-03T10:09:14.724797+0000","last_undegraded":"2023-10-03T10:09:14.724797+0000","last_fullsized":"2023-10-03T10:09:14.724797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720993+0000","last_change":"2023-10-03T10:09:14.711315+0000","last_active":"2023-10-03T10:09:14.720993+0000","last_peered":"2023-10-03T10:09:14.720993+0000","last_clean":"2023-10-03T10:09:14.720993+0000","last_became_active":"2023-10-03T10:09:14.711126+0000","last_became_peered":"2023-10-03T10:09:14.711126+0000","last_unstale":"2023-10-03T10:09:14.720993+0000","last_undegraded":"2023-10-03T10:09:14.720993+0000","last_fullsized":"2023-10-03T10:09:14.720993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700797+0000","last_change":"2023-10-03T10:09:14.347268+0000","last_active":"2023-10-03T10:09:14.700797+0000","last_peered":"2023-10-03T10:09:14.700797+0000","last_clean":"2023-10-03T10:09:14.700797+0000","last_became_active":"2023-10-03T10:09:14.346969+0000","last_became_peered":"2023-10-03T10:09:14.346969+0000","last_unstale":"2023-10-03T10:09:14.700797+0000","last_undegraded":"2023-10-03T10:09:14.700797+0000","last_fullsized":"2023-10-03T10:09:14.700797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734541+0000","last_change":"2023-10-03T10:09:14.731503+0000","last_active":"2023-10-03T10:09:14.734541+0000","last_peered":"2023-10-03T10:09:14.734541+0000","last_clean":"2023-10-03T10:09:14.734541+0000","last_became_active":"2023-10-03T10:09:14.730811+0000","last_became_peered":"2023-10-03T10:09:14.730811+0000","last_unstale":"2023-10-03T10:09:14.734541+0000","last_undegraded":"2023-10-03T10:09:14.734541+0000","last_fullsized":"2023-10-03T10:09:14.734541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703830+0000","last_change":"2023-10-03T10:09:14.346668+0000","last_active":"2023-10-03T10:09:14.703830+0000","last_peered":"2023-10-03T10:09:14.703830+0000","last_clean":"2023-10-03T10:09:14.703830+0000","last_became_active":"2023-10-03T10:09:14.346390+0000","last_became_peered":"2023-10-03T10:09:14.346390+0000","last_unstale":"2023-10-03T10:09:14.703830+0000","last_undegraded":"2023-10-03T10:09:14.703830+0000","last_fullsized":"2023-10-03T10:09:14.703830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723208+0000","last_change":"2023-10-03T10:09:14.716337+0000","last_active":"2023-10-03T10:09:14.723208+0000","last_peered":"2023-10-03T10:09:14.723208+0000","last_clean":"2023-10-03T10:09:14.723208+0000","last_became_active":"2023-10-03T10:09:14.716083+0000","last_became_peered":"2023-10-03T10:09:14.716083+0000","last_unstale":"2023-10-03T10:09:14.723208+0000","last_undegraded":"2023-10-03T10:09:14.723208+0000","last_fullsized":"2023-10-03T10:09:14.723208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703747+0000","last_change":"2023-10-03T10:09:14.344515+0000","last_active":"2023-10-03T10:09:14.703747+0000","last_peered":"2023-10-03T10:09:14.703747+0000","last_clean":"2023-10-03T10:09:14.703747+0000","last_became_active":"2023-10-03T10:09:14.344244+0000","last_became_peered":"2023-10-03T10:09:14.344244+0000","last_unstale":"2023-10-03T10:09:14.703747+0000","last_undegraded":"2023-10-03T10:09:14.703747+0000","last_fullsized":"2023-10-03T10:09:14.703747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727919+0000","last_change":"2023-10-03T10:09:14.723005+0000","last_active":"2023-10-03T10:09:14.727919+0000","last_peered":"2023-10-03T10:09:14.727919+0000","last_clean":"2023-10-03T10:09:14.727919+0000","last_became_active":"2023-10-03T10:09:14.720579+0000","last_became_peered":"2023-10-03T10:09:14.720579+0000","last_unstale":"2023-10-03T10:09:14.727919+0000","last_undegraded":"2023-10-03T10:09:14.727919+0000","last_fullsized":"2023-10-03T10:09:14.727919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700288+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:14.700288+0000","last_peered":"2023-10-03T10:09:14.700288+0000","last_clean":"2023-10-03T10:09:14.700288+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:14.700288+0000","last_undegraded":"2023-10-03T10:09:14.700288+0000","last_fullsized":"2023-10-03T10:09:14.700288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695969+0000","last_change":"2023-10-03T10:09:14.344817+0000","last_active":"2023-10-03T10:09:14.695969+0000","last_peered":"2023-10-03T10:09:14.695969+0000","last_clean":"2023-10-03T10:09:14.695969+0000","last_became_active":"2023-10-03T10:09:14.344547+0000","last_became_peered":"2023-10-03T10:09:14.344547+0000","last_unstale":"2023-10-03T10:09:14.695969+0000","last_undegraded":"2023-10-03T10:09:14.695969+0000","last_fullsized":"2023-10-03T10:09:14.695969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727798+0000","last_change":"2023-10-03T10:09:14.721039+0000","last_active":"2023-10-03T10:09:14.727798+0000","last_peered":"2023-10-03T10:09:14.727798+0000","last_clean":"2023-10-03T10:09:14.727798+0000","last_became_active":"2023-10-03T10:09:14.720876+0000","last_became_peered":"2023-10-03T10:09:14.720876+0000","last_unstale":"2023-10-03T10:09:14.727798+0000","last_undegraded":"2023-10-03T10:09:14.727798+0000","last_fullsized":"2023-10-03T10:09:14.727798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703725+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:14.703725+0000","last_peered":"2023-10-03T10:09:14.703725+0000","last_clean":"2023-10-03T10:09:14.703725+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:14.703725+0000","last_undegraded":"2023-10-03T10:09:14.703725+0000","last_fullsized":"2023-10-03T10:09:14.703725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690358+0000","last_change":"2023-10-03T10:09:14.351814+0000","last_active":"2023-10-03T10:09:14.690358+0000","last_peered":"2023-10-03T10:09:14.690358+0000","last_clean":"2023-10-03T10:09:14.690358+0000","last_became_active":"2023-10-03T10:09:14.351588+0000","last_became_peered":"2023-10-03T10:09:14.351588+0000","last_unstale":"2023-10-03T10:09:14.690358+0000","last_undegraded":"2023-10-03T10:09:14.690358+0000","last_fullsized":"2023-10-03T10:09:14.690358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710632+0000","last_change":"2023-10-03T10:09:14.708011+0000","last_active":"2023-10-03T10:09:14.710632+0000","last_peered":"2023-10-03T10:09:14.710632+0000","last_clean":"2023-10-03T10:09:14.710632+0000","last_became_active":"2023-10-03T10:09:14.707425+0000","last_became_peered":"2023-10-03T10:09:14.707425+0000","last_unstale":"2023-10-03T10:09:14.710632+0000","last_undegraded":"2023-10-03T10:09:14.710632+0000","last_fullsized":"2023-10-03T10:09:14.710632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695432+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:14.695432+0000","last_peered":"2023-10-03T10:09:14.695432+0000","last_clean":"2023-10-03T10:09:14.695432+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:14.695432+0000","last_undegraded":"2023-10-03T10:09:14.695432+0000","last_fullsized":"2023-10-03T10:09:14.695432+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699908+0000","last_change":"2023-10-03T10:09:14.351636+0000","last_active":"2023-10-03T10:09:14.699908+0000","last_peered":"2023-10-03T10:09:14.699908+0000","last_clean":"2023-10-03T10:09:14.699908+0000","last_became_active":"2023-10-03T10:09:14.351360+0000","last_became_peered":"2023-10-03T10:09:14.351360+0000","last_unstale":"2023-10-03T10:09:14.699908+0000","last_undegraded":"2023-10-03T10:09:14.699908+0000","last_fullsized":"2023-10-03T10:09:14.699908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730928+0000","last_change":"2023-10-03T10:09:14.726543+0000","last_active":"2023-10-03T10:09:14.730928+0000","last_peered":"2023-10-03T10:09:14.730928+0000","last_clean":"2023-10-03T10:09:14.730928+0000","last_became_active":"2023-10-03T10:09:14.726287+0000","last_became_peered":"2023-10-03T10:09:14.726287+0000","last_unstale":"2023-10-03T10:09:14.730928+0000","last_undegraded":"2023-10-03T10:09:14.730928+0000","last_fullsized":"2023-10-03T10:09:14.730928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711633+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:14.711633+0000","last_peered":"2023-10-03T10:09:14.711633+0000","last_clean":"2023-10-03T10:09:14.711633+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:14.711633+0000","last_undegraded":"2023-10-03T10:09:14.711633+0000","last_fullsized":"2023-10-03T10:09:14.711633+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699816+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:14.699816+0000","last_peered":"2023-10-03T10:09:14.699816+0000","last_clean":"2023-10-03T10:09:14.699816+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:14.699816+0000","last_undegraded":"2023-10-03T10:09:14.699816+0000","last_fullsized":"2023-10-03T10:09:14.699816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700703+0000","last_change":"2023-10-03T10:09:14.347133+0000","last_active":"2023-10-03T10:09:14.700703+0000","last_peered":"2023-10-03T10:09:14.700703+0000","last_clean":"2023-10-03T10:09:14.700703+0000","last_became_active":"2023-10-03T10:09:14.346671+0000","last_became_peered":"2023-10-03T10:09:14.346671+0000","last_unstale":"2023-10-03T10:09:14.700703+0000","last_undegraded":"2023-10-03T10:09:14.700703+0000","last_fullsized":"2023-10-03T10:09:14.700703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734555+0000","last_change":"2023-10-03T10:09:14.731621+0000","last_active":"2023-10-03T10:09:14.734555+0000","last_peered":"2023-10-03T10:09:14.734555+0000","last_clean":"2023-10-03T10:09:14.734555+0000","last_became_active":"2023-10-03T10:09:14.731155+0000","last_became_peered":"2023-10-03T10:09:14.731155+0000","last_unstale":"2023-10-03T10:09:14.734555+0000","last_undegraded":"2023-10-03T10:09:14.734555+0000","last_fullsized":"2023-10-03T10:09:14.734555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703928+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:14.703928+0000","last_peered":"2023-10-03T10:09:14.703928+0000","last_clean":"2023-10-03T10:09:14.703928+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:14.703928+0000","last_undegraded":"2023-10-03T10:09:14.703928+0000","last_fullsized":"2023-10-03T10:09:14.703928+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.689385+0000","last_change":"2023-10-03T10:09:14.345534+0000","last_active":"2023-10-03T10:09:14.689385+0000","last_peered":"2023-10-03T10:09:14.689385+0000","last_clean":"2023-10-03T10:09:14.689385+0000","last_became_active":"2023-10-03T10:09:14.344896+0000","last_became_peered":"2023-10-03T10:09:14.344896+0000","last_unstale":"2023-10-03T10:09:14.689385+0000","last_undegraded":"2023-10-03T10:09:14.689385+0000","last_fullsized":"2023-10-03T10:09:14.689385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721494+0000","last_change":"2023-10-03T10:09:14.716877+0000","last_active":"2023-10-03T10:09:14.721494+0000","last_peered":"2023-10-03T10:09:14.721494+0000","last_clean":"2023-10-03T10:09:14.721494+0000","last_became_active":"2023-10-03T10:09:14.715861+0000","last_became_peered":"2023-10-03T10:09:14.715861+0000","last_unstale":"2023-10-03T10:09:14.721494+0000","last_undegraded":"2023-10-03T10:09:14.721494+0000","last_fullsized":"2023-10-03T10:09:14.721494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709500+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:14.709500+0000","last_peered":"2023-10-03T10:09:14.709500+0000","last_clean":"2023-10-03T10:09:14.709500+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:14.709500+0000","last_undegraded":"2023-10-03T10:09:14.709500+0000","last_fullsized":"2023-10-03T10:09:14.709500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700064+0000","last_change":"2023-10-03T10:09:14.352568+0000","last_active":"2023-10-03T10:09:14.700064+0000","last_peered":"2023-10-03T10:09:14.700064+0000","last_clean":"2023-10-03T10:09:14.700064+0000","last_became_active":"2023-10-03T10:09:14.352349+0000","last_became_peered":"2023-10-03T10:09:14.352349+0000","last_unstale":"2023-10-03T10:09:14.700064+0000","last_undegraded":"2023-10-03T10:09:14.700064+0000","last_fullsized":"2023-10-03T10:09:14.700064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722084+0000","last_change":"2023-10-03T10:09:14.710656+0000","last_active":"2023-10-03T10:09:14.722084+0000","last_peered":"2023-10-03T10:09:14.722084+0000","last_clean":"2023-10-03T10:09:14.722084+0000","last_became_active":"2023-10-03T10:09:14.710425+0000","last_became_peered":"2023-10-03T10:09:14.710425+0000","last_unstale":"2023-10-03T10:09:14.722084+0000","last_undegraded":"2023-10-03T10:09:14.722084+0000","last_fullsized":"2023-10-03T10:09:14.722084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730248+0000","last_change":"2023-10-03T10:09:14.346884+0000","last_active":"2023-10-03T10:09:14.730248+0000","last_peered":"2023-10-03T10:09:14.730248+0000","last_clean":"2023-10-03T10:09:14.730248+0000","last_became_active":"2023-10-03T10:09:14.346598+0000","last_became_peered":"2023-10-03T10:09:14.346598+0000","last_unstale":"2023-10-03T10:09:14.730248+0000","last_undegraded":"2023-10-03T10:09:14.730248+0000","last_fullsized":"2023-10-03T10:09:14.730248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.701425+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:14.701425+0000","last_peered":"2023-10-03T10:09:14.701425+0000","last_clean":"2023-10-03T10:09:14.701425+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:14.701425+0000","last_undegraded":"2023-10-03T10:09:14.701425+0000","last_fullsized":"2023-10-03T10:09:14.701425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734872+0000","last_change":"2023-10-03T10:09:14.733924+0000","last_active":"2023-10-03T10:09:14.734872+0000","last_peered":"2023-10-03T10:09:14.734872+0000","last_clean":"2023-10-03T10:09:14.734872+0000","last_became_active":"2023-10-03T10:09:14.733635+0000","last_became_peered":"2023-10-03T10:09:14.733635+0000","last_unstale":"2023-10-03T10:09:14.734872+0000","last_undegraded":"2023-10-03T10:09:14.734872+0000","last_fullsized":"2023-10-03T10:09:14.734872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709169+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:14.709169+0000","last_peered":"2023-10-03T10:09:14.709169+0000","last_clean":"2023-10-03T10:09:14.709169+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:14.709169+0000","last_undegraded":"2023-10-03T10:09:14.709169+0000","last_fullsized":"2023-10-03T10:09:14.709169+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690821+0000","last_change":"2023-10-03T10:09:14.350895+0000","last_active":"2023-10-03T10:09:14.690821+0000","last_peered":"2023-10-03T10:09:14.690821+0000","last_clean":"2023-10-03T10:09:14.690821+0000","last_became_active":"2023-10-03T10:09:14.350426+0000","last_became_peered":"2023-10-03T10:09:14.350426+0000","last_unstale":"2023-10-03T10:09:14.690821+0000","last_undegraded":"2023-10-03T10:09:14.690821+0000","last_fullsized":"2023-10-03T10:09:14.690821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715702+0000","last_change":"2023-10-03T10:09:14.714464+0000","last_active":"2023-10-03T10:09:14.715702+0000","last_peered":"2023-10-03T10:09:14.715702+0000","last_clean":"2023-10-03T10:09:14.715702+0000","last_became_active":"2023-10-03T10:09:14.714221+0000","last_became_peered":"2023-10-03T10:09:14.714221+0000","last_unstale":"2023-10-03T10:09:14.715702+0000","last_undegraded":"2023-10-03T10:09:14.715702+0000","last_fullsized":"2023-10-03T10:09:14.715702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719633+0000","last_change":"2023-10-03T10:09:14.351366+0000","last_active":"2023-10-03T10:09:14.719633+0000","last_peered":"2023-10-03T10:09:14.719633+0000","last_clean":"2023-10-03T10:09:14.719633+0000","last_became_active":"2023-10-03T10:09:14.350445+0000","last_became_peered":"2023-10-03T10:09:14.350445+0000","last_unstale":"2023-10-03T10:09:14.719633+0000","last_undegraded":"2023-10-03T10:09:14.719633+0000","last_fullsized":"2023-10-03T10:09:14.719633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.712724+0000","last_change":"2023-10-03T10:09:14.707995+0000","last_active":"2023-10-03T10:09:14.712724+0000","last_peered":"2023-10-03T10:09:14.712724+0000","last_clean":"2023-10-03T10:09:14.712724+0000","last_became_active":"2023-10-03T10:09:14.707723+0000","last_became_peered":"2023-10-03T10:09:14.707723+0000","last_unstale":"2023-10-03T10:09:14.712724+0000","last_undegraded":"2023-10-03T10:09:14.712724+0000","last_fullsized":"2023-10-03T10:09:14.712724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714950+0000","last_change":"2023-10-03T10:09:14.345357+0000","last_active":"2023-10-03T10:09:14.714950+0000","last_peered":"2023-10-03T10:09:14.714950+0000","last_clean":"2023-10-03T10:09:14.714950+0000","last_became_active":"2023-10-03T10:09:14.344951+0000","last_became_peered":"2023-10-03T10:09:14.344951+0000","last_unstale":"2023-10-03T10:09:14.714950+0000","last_undegraded":"2023-10-03T10:09:14.714950+0000","last_fullsized":"2023-10-03T10:09:14.714950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730690+0000","last_change":"2023-10-03T10:09:14.724291+0000","last_active":"2023-10-03T10:09:14.730690+0000","last_peered":"2023-10-03T10:09:14.730690+0000","last_clean":"2023-10-03T10:09:14.730690+0000","last_became_active":"2023-10-03T10:09:14.723559+0000","last_became_peered":"2023-10-03T10:09:14.723559+0000","last_unstale":"2023-10-03T10:09:14.730690+0000","last_undegraded":"2023-10-03T10:09:14.730690+0000","last_fullsized":"2023-10-03T10:09:14.730690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724427+0000","last_change":"2023-10-03T10:09:14.345918+0000","last_active":"2023-10-03T10:09:14.724427+0000","last_peered":"2023-10-03T10:09:14.724427+0000","last_clean":"2023-10-03T10:09:14.724427+0000","last_became_active":"2023-10-03T10:09:14.345634+0000","last_became_peered":"2023-10-03T10:09:14.345634+0000","last_unstale":"2023-10-03T10:09:14.724427+0000","last_undegraded":"2023-10-03T10:09:14.724427+0000","last_fullsized":"2023-10-03T10:09:14.724427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722402+0000","last_change":"2023-10-03T10:09:14.718860+0000","last_active":"2023-10-03T10:09:14.722402+0000","last_peered":"2023-10-03T10:09:14.722402+0000","last_clean":"2023-10-03T10:09:14.722402+0000","last_became_active":"2023-10-03T10:09:14.716545+0000","last_became_peered":"2023-10-03T10:09:14.716545+0000","last_unstale":"2023-10-03T10:09:14.722402+0000","last_undegraded":"2023-10-03T10:09:14.722402+0000","last_fullsized":"2023-10-03T10:09:14.722402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711557+0000","last_change":"2023-10-03T10:09:14.351568+0000","last_active":"2023-10-03T10:09:14.711557+0000","last_peered":"2023-10-03T10:09:14.711557+0000","last_clean":"2023-10-03T10:09:14.711557+0000","last_became_active":"2023-10-03T10:09:14.351293+0000","last_became_peered":"2023-10-03T10:09:14.351293+0000","last_unstale":"2023-10-03T10:09:14.711557+0000","last_undegraded":"2023-10-03T10:09:14.711557+0000","last_fullsized":"2023-10-03T10:09:14.711557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723070+0000","last_change":"2023-10-03T10:09:14.720328+0000","last_active":"2023-10-03T10:09:14.723070+0000","last_peered":"2023-10-03T10:09:14.723070+0000","last_clean":"2023-10-03T10:09:14.723070+0000","last_became_active":"2023-10-03T10:09:14.720033+0000","last_became_peered":"2023-10-03T10:09:14.720033+0000","last_unstale":"2023-10-03T10:09:14.723070+0000","last_undegraded":"2023-10-03T10:09:14.723070+0000","last_fullsized":"2023-10-03T10:09:14.723070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714114+0000","last_change":"2023-10-03T10:09:14.352301+0000","last_active":"2023-10-03T10:09:14.714114+0000","last_peered":"2023-10-03T10:09:14.714114+0000","last_clean":"2023-10-03T10:09:14.714114+0000","last_became_active":"2023-10-03T10:09:14.352027+0000","last_became_peered":"2023-10-03T10:09:14.352027+0000","last_unstale":"2023-10-03T10:09:14.714114+0000","last_undegraded":"2023-10-03T10:09:14.714114+0000","last_fullsized":"2023-10-03T10:09:14.714114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715738+0000","last_change":"2023-10-03T10:09:14.713576+0000","last_active":"2023-10-03T10:09:14.715738+0000","last_peered":"2023-10-03T10:09:14.715738+0000","last_clean":"2023-10-03T10:09:14.715738+0000","last_became_active":"2023-10-03T10:09:14.713175+0000","last_became_peered":"2023-10-03T10:09:14.713175+0000","last_unstale":"2023-10-03T10:09:14.715738+0000","last_undegraded":"2023-10-03T10:09:14.715738+0000","last_fullsized":"2023-10-03T10:09:14.715738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730038+0000","last_change":"2023-10-03T10:09:14.712406+0000","last_active":"2023-10-03T10:09:14.730038+0000","last_peered":"2023-10-03T10:09:14.730038+0000","last_clean":"2023-10-03T10:09:14.730038+0000","last_became_active":"2023-10-03T10:09:14.712076+0000","last_became_peered":"2023-10-03T10:09:14.712076+0000","last_unstale":"2023-10-03T10:09:14.730038+0000","last_undegraded":"2023-10-03T10:09:14.730038+0000","last_fullsized":"2023-10-03T10:09:14.730038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.733844+0000","last_change":"2023-10-03T10:09:14.729293+0000","last_active":"2023-10-03T10:09:14.733844+0000","last_peered":"2023-10-03T10:09:14.733844+0000","last_clean":"2023-10-03T10:09:14.733844+0000","last_became_active":"2023-10-03T10:09:14.729022+0000","last_became_peered":"2023-10-03T10:09:14.729022+0000","last_unstale":"2023-10-03T10:09:14.733844+0000","last_undegraded":"2023-10-03T10:09:14.733844+0000","last_fullsized":"2023-10-03T10:09:14.733844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721016+0000","last_change":"2023-10-03T10:09:14.710814+0000","last_active":"2023-10-03T10:09:14.721016+0000","last_peered":"2023-10-03T10:09:14.721016+0000","last_clean":"2023-10-03T10:09:14.721016+0000","last_became_active":"2023-10-03T10:09:14.710640+0000","last_became_peered":"2023-10-03T10:09:14.710640+0000","last_unstale":"2023-10-03T10:09:14.721016+0000","last_undegraded":"2023-10-03T10:09:14.721016+0000","last_fullsized":"2023-10-03T10:09:14.721016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734690+0000","last_change":"2023-10-03T10:09:14.732180+0000","last_active":"2023-10-03T10:09:14.734690+0000","last_peered":"2023-10-03T10:09:14.734690+0000","last_clean":"2023-10-03T10:09:14.734690+0000","last_became_active":"2023-10-03T10:09:14.731970+0000","last_became_peered":"2023-10-03T10:09:14.731970+0000","last_unstale":"2023-10-03T10:09:14.734690+0000","last_undegraded":"2023-10-03T10:09:14.734690+0000","last_fullsized":"2023-10-03T10:09:14.734690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710652+0000","last_change":"2023-10-03T10:09:14.708167+0000","last_active":"2023-10-03T10:09:14.710652+0000","last_peered":"2023-10-03T10:09:14.710652+0000","last_clean":"2023-10-03T10:09:14.710652+0000","last_became_active":"2023-10-03T10:09:14.707761+0000","last_became_peered":"2023-10-03T10:09:14.707761+0000","last_unstale":"2023-10-03T10:09:14.710652+0000","last_undegraded":"2023-10-03T10:09:14.710652+0000","last_fullsized":"2023-10-03T10:09:14.710652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":43626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:22.341 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T10:09:22.341 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:09:22.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:09:22.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:09:22.342 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T10:09:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 Processor -- start 2023-10-03T10:09:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 -- start start 2023-10-03T10:09:22.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 0x7f7b5c131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c09a3f0 con 0x7f7b5c12f980 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0964f0 con 0x7f7b5c098eb0 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b614f0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c095100 con 0x7f7b5c0985e0 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b5affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.491+0000 7f7b5a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 0x7f7b5c131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40238/0 (socket says 172.21.15.125:40238) 2023-10-03T10:09:22.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45800/0 (socket says 172.21.15.125:45800) 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 -- 172.21.15.125:0/3056129318 learned_addr learned my addr 172.21.15.125:0/3056129318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 -- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 msgr2=0x7f7b5c12f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 -- 172.21.15.125:0/3056129318 >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 msgr2=0x7f7b5c131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 --2- 172.21.15.125:0/3056129318 >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 0x7f7b5c131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 -- 172.21.15.125:0/3056129318 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c099e70 con 0x7f7b5c0985e0 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5a7fc700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5b7fe700 1 --2- 172.21.15.125:0/3056129318 >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 0x7f7b5c131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b5affd700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7b50009830 tx=0x7f7b500090f0).ready entity=mon.2 client_cookie=96d06151ba0b7df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b59ffb700 1 -- 172.21.15.125:0/3056129318 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000f510 con 0x7f7b5c0985e0 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b59ffb700 1 -- 172.21.15.125:0/3056129318 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000f670 con 0x7f7b5c0985e0 2023-10-03T10:09:22.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.492+0000 7f7b59ffb700 1 -- 172.21.15.125:0/3056129318 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000fa10 con 0x7f7b5c0985e0 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 -- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 msgr2=0x7f7b5c0989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7b50009830 tx=0x7f7b500090f0).stop 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 -- 172.21.15.125:0/3056129318 shutdown_connections 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 --2- 172.21.15.125:0/3056129318 >> v2:172.21.15.125:3300/0 conn(0x7f7b5c12f980 0x7f7b5c131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c0985e0 0x7f7b5c0989c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 --2- 172.21.15.125:0/3056129318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c098eb0 0x7f7b5c12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 -- 172.21.15.125:0/3056129318 >> 172.21.15.125:0/3056129318 conn(0x7f7b5c09dc40 msgr2=0x7f7b5c09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 -- 172.21.15.125:0/3056129318 shutdown_connections 2023-10-03T10:09:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.493+0000 7f7b614f0700 1 -- 172.21.15.125:0/3056129318 wait complete. 2023-10-03T10:09:22.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.494+0000 7f7b614f0700 1 Processor -- start 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.494+0000 7f7b614f0700 1 -- start start 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c098eb0 0x7f7b5c11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b5c12f980 0x7f7b5c11aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c11daa0 con 0x7f7b5c12f980 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c11d640 con 0x7f7b5c0985e0 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c09cf50 con 0x7f7b5c098eb0 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45814/0 (socket says 172.21.15.125:45814) 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 -- 172.21.15.125:0/702001873 learned_addr learned my addr 172.21.15.125:0/702001873 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5a7fc700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c098eb0 0x7f7b5c11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5b7fe700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b5c12f980 0x7f7b5c11aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 -- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c098eb0 msgr2=0x7f7b5c11a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c098eb0 0x7f7b5c11a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 -- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b5c12f980 msgr2=0x7f7b5c11aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b5c12f980 0x7f7b5c11aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 -- 172.21.15.125:0/702001873 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0092a0 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b5affd700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7b5c095290 tx=0x7f7b50015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50006910 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50000bc0 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b54009a20 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50024470 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.495+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b50009370 con 0x7f7b5c0985e0 2023-10-03T10:09:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.496+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7b50021070 con 0x7f7b5c0985e0 2023-10-03T10:09:22.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.496+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7b5003c8e0 con 0x7f7b5c0985e0 2023-10-03T10:09:22.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.496+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c11df50 con 0x7f7b5c0985e0 2023-10-03T10:09:22.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.501+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7b50029030 con 0x7f7b5c0985e0 2023-10-03T10:09:22.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.698+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7b5c05a260 con 0x7f7b5c0985e0 2023-10-03T10:09:22.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.700+0000 7f7b42ffd700 1 -- 172.21.15.125:0/702001873 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64132 (secure 0 0 0) 0x7f7b50029020 con 0x7f7b5c0985e0 2023-10-03T10:09:22.702 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:22.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 >> v1:172.21.15.125:6816/118167 conn(0x7f7b4802bb60 legacy=0x7f7b4802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 msgr2=0x7f7b5c11e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7b5c095290 tx=0x7f7b50015000).stop 2023-10-03T10:09:22.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 shutdown_connections 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b5c12f980 0x7f7b5c11aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5c0985e0 0x7f7b5c11e540 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 --2- 172.21.15.125:0/702001873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b5c098eb0 0x7f7b5c11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 >> 172.21.15.125:0/702001873 conn(0x7f7b5c09dc40 msgr2=0x7f7b5c114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 shutdown_connections 2023-10-03T10:09:22.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.702+0000 7f7b614f0700 1 -- 172.21.15.125:0/702001873 wait complete. 2023-10-03T10:09:22.715 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6816","nonce":118167}]},"active_addr":"172.21.15.125:6816/118167","active_change":"2023-10-03T10:09:03.135490+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":386436796}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":677301661}]}]} 2023-10-03T10:09:22.717 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:09:22.717 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:09:22.717 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:22.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 Processor -- start 2023-10-03T10:09:22.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 -- start start 2023-10-03T10:09:22.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00964f0 con 0x7f91b00985e0 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00994b0 con 0x7f91b0130990 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91b54e3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b009a3f0 con 0x7f91b00990d0 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91af7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91ae7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91af7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54222/0 (socket says 172.21.15.125:54222) 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91ae7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40252/0 (socket says 172.21.15.125:40252) 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91aeffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f91b00985e0 0x7f91b00989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40240/0 (socket says 172.21.15.125:40240) 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.832+0000 7f91af7fe700 1 -- 172.21.15.125:0/2565753230 learned_addr learned my addr 172.21.15.125:0/2565753230 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:22.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91ae7fc700 1 -- 172.21.15.125:0/2565753230 >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 msgr2=0x7f91b0132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91ae7fc700 1 --2- 172.21.15.125:0/2565753230 >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91ae7fc700 1 -- 172.21.15.125:0/2565753230 >> v1:172.21.15.125:6789/0 conn(0x7f91b00985e0 legacy=0x7f91b00989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91ae7fc700 1 -- 172.21.15.125:0/2565753230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0095100 con 0x7f91b00990d0 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91af7fe700 1 --2- 172.21.15.125:0/2565753230 >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91ae7fc700 1 --2- 172.21.15.125:0/2565753230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4009060).ready entity=mon.2 client_cookie=c98323a05b26cd16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91adffb700 1 -- 172.21.15.125:0/2565753230 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40090d0 con 0x7f91b00990d0 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91adffb700 1 -- 172.21.15.125:0/2565753230 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400f510 con 0x7f91b00990d0 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91adffb700 1 -- 172.21.15.125:0/2565753230 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400f890 con 0x7f91b00990d0 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 -- 172.21.15.125:0/2565753230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 msgr2=0x7f91b01304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 --2- 172.21.15.125:0/2565753230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f91a4009760 tx=0x7f91a4009060).stop 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 -- 172.21.15.125:0/2565753230 shutdown_connections 2023-10-03T10:09:22.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 --2- 172.21.15.125:0/2565753230 >> v2:172.21.15.125:3300/0 conn(0x7f91b0130990 0x7f91b0132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 --2- 172.21.15.125:0/2565753230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00990d0 0x7f91b01304a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 -- 172.21.15.125:0/2565753230 >> 172.21.15.125:0/2565753230 conn(0x7f91b009dc40 msgr2=0x7f91b009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:22.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 -- 172.21.15.125:0/2565753230 shutdown_connections 2023-10-03T10:09:22.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.833+0000 7f91b54e3700 1 -- 172.21.15.125:0/2565753230 wait complete. 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.834+0000 7f91b54e3700 1 Processor -- start 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.834+0000 7f91b54e3700 1 -- start start 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 0x7f91b0118680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 0x7f91b0118b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:22.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0119fa0 con 0x7f91b0130990 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0119060 con 0x7f91b00990d0 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91b54e3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0119db0 con 0x7f91b00985e0 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91ae7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 0x7f91b0118680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91af7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 0x7f91b0118b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40266/0 (socket says 172.21.15.125:40266) 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91ae7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 0x7f91b0118680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45822/0 (socket says 172.21.15.125:45822) 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 -- 172.21.15.125:0/3635727109 learned_addr learned my addr 172.21.15.125:0/3635727109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 -- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 msgr2=0x7f91b0118680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 0x7f91b0118680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 -- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 msgr2=0x7f91b0118b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:22.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 0x7f91b0118b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 -- 172.21.15.125:0/3635727109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009ae0 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91af7fe700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 0x7f91b0118b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f91aeffd700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f91a000c490 tx=0x7f91a0007df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000ce00 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.835+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00072e0 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.836+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a40092a0 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.836+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00056e0 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.836+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b009d210 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.836+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b005a260 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.837+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f91a0005ad0 con 0x7f91b00985e0 2023-10-03T10:09:22.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.837+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f91a003ade0 con 0x7f91b00985e0 2023-10-03T10:09:22.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:22.841+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f91a001c9f0 con 0x7f91b00985e0 2023-10-03T10:09:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.004+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91b0099e70 con 0x7f91b00985e0 2023-10-03T10:09:23.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.004+0000 7f9196ffd700 1 -- 172.21.15.125:0/3635727109 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f91a001c3a0 con 0x7f91b00985e0 2023-10-03T10:09:23.005 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:23.005 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.006+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 >> v1:172.21.15.125:6816/118167 conn(0x7f919c02bb60 legacy=0x7f919c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 msgr2=0x7f91b0118190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f91a000c490 tx=0x7f91a0007df0).stop 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 shutdown_connections 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91b0130990 0x7f91b0118b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91b00985e0 0x7f91b0118190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 --2- 172.21.15.125:0/3635727109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91b00990d0 0x7f91b0118680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 >> 172.21.15.125:0/3635727109 conn(0x7f91b009dc40 msgr2=0x7f91b0092800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 shutdown_connections 2023-10-03T10:09:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.007+0000 7f91b54e3700 1 -- 172.21.15.125:0/3635727109 wait complete. 2023-10-03T10:09:23.019 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:09:23.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 Processor -- start 2023-10-03T10:09:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 -- start start 2023-10-03T10:09:23.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 0x7f3988132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3988091980 con 0x7f3988062b00 2023-10-03T10:09:23.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880973f0 con 0x7f39880966b0 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.133+0000 7f398f3b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988062ee0 con 0x7f3988095da0 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398d94d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 0x7f3988132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45834/0 (socket says 172.21.15.125:45834) 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 -- 172.21.15.125:0/2360062583 learned_addr learned my addr 172.21.15.125:0/2360062583 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398d14c700 1 --1- 172.21.15.125:0/2360062583 >> v1:172.21.15.125:6789/0 conn(0x7f3988062b00 0x7f3988095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40246/0 (socket says 172.21.15.125:40246) 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 -- 172.21.15.125:0/2360062583 >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 msgr2=0x7f3988132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 --2- 172.21.15.125:0/2360062583 >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 0x7f3988132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 -- 172.21.15.125:0/2360062583 >> v1:172.21.15.125:6789/0 conn(0x7f3988062b00 legacy=0x7f3988095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 -- 172.21.15.125:0/2360062583 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988092310 con 0x7f3988095da0 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398d94d700 1 --2- 172.21.15.125:0/2360062583 >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 0x7f3988132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f398c94b700 1 --2- 172.21.15.125:0/2360062583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3978009830 tx=0x7f39780090f0).ready entity=mon.1 client_cookie=9f127e1d71e3fbbd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f397ffff700 1 -- 172.21.15.125:0/2360062583 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800b580 con 0x7f3988095da0 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f397ffff700 1 -- 172.21.15.125:0/2360062583 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b6e0 con 0x7f3988095da0 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.134+0000 7f397ffff700 1 -- 172.21.15.125:0/2360062583 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ba60 con 0x7f3988095da0 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 -- 172.21.15.125:0/2360062583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 msgr2=0x7f39880961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 --2- 172.21.15.125:0/2360062583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3978009830 tx=0x7f39780090f0).stop 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 -- 172.21.15.125:0/2360062583 shutdown_connections 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 --2- 172.21.15.125:0/2360062583 >> v2:172.21.15.125:3300/0 conn(0x7f39880966b0 0x7f3988132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 --2- 172.21.15.125:0/2360062583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988095da0 0x7f39880961c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 -- 172.21.15.125:0/2360062583 >> 172.21.15.125:0/2360062583 conn(0x7f398809aa50 msgr2=0x7f398809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 -- 172.21.15.125:0/2360062583 shutdown_connections 2023-10-03T10:09:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.135+0000 7f398f3b0700 1 -- 172.21.15.125:0/2360062583 wait complete. 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 Processor -- start 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 -- start start 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 0x7f3988115e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3988095da0 0x7f3988116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988116ce0 con 0x7f39880966b0 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988117860 con 0x7f3988062b00 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398f3b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3988119500 con 0x7f3988095da0 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398d14c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 0x7f3988115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398d94d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398d94d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54244/0 (socket says 172.21.15.125:54244) 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398d94d700 1 -- 172.21.15.125:0/250179281 learned_addr learned my addr 172.21.15.125:0/250179281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.136+0000 7f398c94b700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3988095da0 0x7f3988116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 -- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3988095da0 msgr2=0x7f3988116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3988095da0 0x7f3988116300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 -- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 msgr2=0x7f39881167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 -- 172.21.15.125:0/250179281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009a20 con 0x7f3988062b00 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d94d700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398d14c700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 0x7f3988115e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f398400c410 tx=0x7f3984007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840070d0 con 0x7f3988062b00 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984007230 con 0x7f3988062b00 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3978009370 con 0x7f3988062b00 2023-10-03T10:09:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840075b0 con 0x7f3988062b00 2023-10-03T10:09:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.137+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3988118fa0 con 0x7f3988062b00 2023-10-03T10:09:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.138+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f39840058f0 con 0x7f3988062b00 2023-10-03T10:09:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.138+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f398403a570 con 0x7f3988062b00 2023-10-03T10:09:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.138+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3988096da0 con 0x7f3988062b00 2023-10-03T10:09:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.142+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3984013970 con 0x7f3988062b00 2023-10-03T10:09:23.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.304+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3988093870 con 0x7f3988062b00 2023-10-03T10:09:23.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.304+0000 7f397d7fa700 1 -- 172.21.15.125:0/250179281 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f398401c350 con 0x7f3988062b00 2023-10-03T10:09:23.305 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:23.305 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 >> v1:172.21.15.125:6816/118167 conn(0x7f396c02bb60 legacy=0x7f396c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 msgr2=0x7f3988115e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 0x7f3988115e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f398400c410 tx=0x7f3984007d30).stop 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 shutdown_connections 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39880966b0 0x7f39881167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3988062b00 0x7f3988115e10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 --2- 172.21.15.125:0/250179281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3988095da0 0x7f3988116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 >> 172.21.15.125:0/250179281 conn(0x7f398809aa50 msgr2=0x7f39881300f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 shutdown_connections 2023-10-03T10:09:23.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.306+0000 7f398f3b0700 1 -- 172.21.15.125:0/250179281 wait complete. 2023-10-03T10:09:23.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:09:23.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:09:23.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:09:23.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:09:23.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.444+0000 7f0fabe4f700 1 Processor -- start 2023-10-03T10:09:23.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.444+0000 7f41fc520700 1 Processor -- start 2023-10-03T10:09:23.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.444+0000 7f0fabe4f700 1 -- start start 2023-10-03T10:09:23.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.444+0000 7f41fc520700 1 -- start start 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa40970f0 0x7f0fa4067f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0fa4068430 0x7f0fa40688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa4069530 con 0x7f0fa4068430 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4068da0 con 0x7f0fa40970f0 2023-10-03T10:09:23.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fabe4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40926d0 con 0x7f0fa4096820 2023-10-03T10:09:23.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fc520700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fc520700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41f4069790 0x7f41f4068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40298/0 (socket says 172.21.15.125:40298) 2023-10-03T10:09:23.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 -- 172.21.15.125:0/614152186 learned_addr learned my addr 172.21.15.125:0/614152186 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fc520700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f4069160 con 0x7f41f4127a00 2023-10-03T10:09:23.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fc520700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f4092820 con 0x7f41f4069790 2023-10-03T10:09:23.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fc520700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40923b0 con 0x7f41f4067f40 2023-10-03T10:09:23.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa93ea700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa40970f0 0x7f0fa4067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40308/0 (socket says 172.21.15.125:40308) 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 -- 172.21.15.125:0/2119939504 learned_addr learned my addr 172.21.15.125:0/2119939504 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 -- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa40970f0 msgr2=0x7f0fa4067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa40970f0 0x7f0fa4067f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 -- 172.21.15.125:0/614152186 >> v2:172.21.15.125:3300/0 conn(0x7f0fa4068430 msgr2=0x7f0fa40688b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/614152186 >> v2:172.21.15.125:3300/0 conn(0x7f0fa4068430 0x7f0fa40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 -- 172.21.15.125:0/614152186 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4091980 con 0x7f0fa4096820 2023-10-03T10:09:23.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0fa0006fd0 tx=0x7f0fa00090f0).ready entity=mon.2 client_cookie=289b8414518b16bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 -- 172.21.15.125:0/2119939504 >> v2:172.21.15.125:3300/0 conn(0x7f41f4069790 msgr2=0x7f41f4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 --2- 172.21.15.125:0/2119939504 >> v2:172.21.15.125:3300/0 conn(0x7f41f4069790 0x7f41f4068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 -- 172.21.15.125:0/2119939504 >> v1:172.21.15.125:6789/0 conn(0x7f41f4127a00 legacy=0x7f41f4127e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.445+0000 7f41fa2bc700 1 -- 172.21.15.125:0/2119939504 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4093310 con 0x7f41f4067f40 2023-10-03T10:09:23.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f0fa8be9700 1 -- 172.21.15.125:0/614152186 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000b5a0 con 0x7f0fa4096820 2023-10-03T10:09:23.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f41fa2bc700 1 --2- 172.21.15.125:0/2119939504 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f41f0006fd0 tx=0x7f41f00090f0).ready entity=mon.2 client_cookie=185f9e3f799e9782 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f0fa8be9700 1 -- 172.21.15.125:0/614152186 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000b700 con 0x7f0fa4096820 2023-10-03T10:09:23.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f0fa8be9700 1 -- 172.21.15.125:0/614152186 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000ba80 con 0x7f0fa4096820 2023-10-03T10:09:23.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f41f92ba700 1 -- 172.21.15.125:0/2119939504 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000f6b0 con 0x7f41f4067f40 2023-10-03T10:09:23.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f41f92ba700 1 -- 172.21.15.125:0/2119939504 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000f810 con 0x7f41f4067f40 2023-10-03T10:09:23.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f41f92ba700 1 -- 172.21.15.125:0/2119939504 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000fbd0 con 0x7f41f4067f40 2023-10-03T10:09:23.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.446+0000 7f0fabe4f700 1 -- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 msgr2=0x7f0fa4096c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0fa0006fd0 tx=0x7f0fa00090f0).stop 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 -- 172.21.15.125:0/614152186 shutdown_connections 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 --2- 172.21.15.125:0/614152186 >> v2:172.21.15.125:3300/0 conn(0x7f0fa4068430 0x7f0fa40688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa4096820 0x7f0fa4096c00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f41fc520700 1 -- 172.21.15.125:0/2119939504 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 msgr2=0x7f41f4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f41fc520700 1 --2- 172.21.15.125:0/2119939504 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f41f0006fd0 tx=0x7f41f00090f0).stop 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 --2- 172.21.15.125:0/614152186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa40970f0 0x7f0fa4067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 -- 172.21.15.125:0/614152186 >> 172.21.15.125:0/614152186 conn(0x7f0fa409a230 msgr2=0x7f0fa409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 -- 172.21.15.125:0/614152186 shutdown_connections 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.447+0000 7f0fabe4f700 1 -- 172.21.15.125:0/614152186 wait complete. 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 Processor -- start 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 -- start start 2023-10-03T10:09:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 0x7f0fa4118720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa4096820 0x7f0fa4118c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa40970f0 0x7f0fa4119100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4066810 con 0x7f0fa4068430 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4091b90 con 0x7f0fa4096820 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fabe4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4118460 con 0x7f0fa40970f0 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.448+0000 7f0fa9beb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 0x7f0fa4118720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 0x7f0fa4118720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54260/0 (socket says 172.21.15.125:54260) 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 -- 172.21.15.125:0/2292772581 learned_addr learned my addr 172.21.15.125:0/2292772581 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0faa3ec700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa40970f0 0x7f0fa4119100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 -- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa40970f0 msgr2=0x7f0fa4119100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa40970f0 0x7f0fa4119100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 -- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa4096820 msgr2=0x7f0fa4118c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fa4096820 0x7f0fa4118c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 -- 172.21.15.125:0/2292772581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009370 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0faa3ec700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fa40970f0 0x7f0fa4119100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fa9beb700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 0x7f0fa4118720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0fa4092860 tx=0x7f0fa0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000b870 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000b9d0 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa411b620 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa001b660 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.449+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa411c440 con 0x7f0fa4068430 2023-10-03T10:09:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.450+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fa4069850 con 0x7f0fa4068430 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.450+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0fa001b9d0 con 0x7f0fa4068430 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.450+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0fa003c980 con 0x7f0fa4068430 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 --> v1:172.21.15.125:6800/118765 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f880383e0 con 0x7f0f880346f0 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa0006a40 con 0x7f0fa4068430 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 -- 172.21.15.125:0/2119939504 shutdown_connections 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 --2- 172.21.15.125:0/2119939504 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4067f40 0x7f41f4068320 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 --2- 172.21.15.125:0/2119939504 >> v2:172.21.15.125:3300/0 conn(0x7f41f4069790 0x7f41f4068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 -- 172.21.15.125:0/2119939504 >> 172.21.15.125:0/2119939504 conn(0x7f41f409a230 msgr2=0x7f41f409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 -- 172.21.15.125:0/2119939504 shutdown_connections 2023-10-03T10:09:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.451+0000 7f41fc520700 1 -- 172.21.15.125:0/2119939504 wait complete. 2023-10-03T10:09:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.452+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== osd.1 v1:172.21.15.125:6800/118765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f0f880383e0 con 0x7f0f880346f0 2023-10-03T10:09:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.452+0000 7f41fc520700 1 Processor -- start 2023-10-03T10:09:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.452+0000 7f41fc520700 1 -- start start 2023-10-03T10:09:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 0x7f41f41191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41f4069790 0x7f41f4115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4127a00 0x7f41f4115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4098460 con 0x7f41f4067f40 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4091b90 con 0x7f41f4069790 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fc520700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4127330 con 0x7f41f4127a00 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 0x7f41f41191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 0x7f41f41191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54266/0 (socket says 172.21.15.125:54266) 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 -- 172.21.15.125:0/3098149513 learned_addr learned my addr 172.21.15.125:0/3098149513 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41f9abb700 1 --2- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41f4069790 0x7f41f4115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 -- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4127a00 msgr2=0x7f41f4115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 --2- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41f4127a00 0x7f41f4115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 -- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41f4069790 msgr2=0x7f41f4115320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 --2- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41f4069790 0x7f41f4115320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 -- 172.21.15.125:0/3098149513 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009370 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41fa2bc700 1 --2- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 0x7f41f41191f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f41f0009f50 tx=0x7f41f0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f001f070 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.453+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0002f70 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.454+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000f6b0 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.454+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f4118a10 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.454+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f4116d70 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.454+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f41f00198f0 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.455+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f41f003e3a0 con 0x7f41f4067f40 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.455+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 --> v1:172.21.15.125:6808/118796 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f41186b0 con 0x7f41f4116560 2023-10-03T10:09:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.456+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== osd.3 v1:172.21.15.125:6808/118796 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f41ec002ee0 con 0x7f41f4116560 2023-10-03T10:09:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.457+0000 7f4f6814d700 1 Processor -- start 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.457+0000 7f4f6814d700 1 -- start start 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f6814d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f6012b590 0x7f4f6012fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f6814d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f601303d0 0x7f4f601327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f6814d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f60066f90 con 0x7f4f6005f560 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f6814d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6005f940 con 0x7f4f601303d0 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f6814d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60067650 con 0x7f4f6012b590 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f601303d0 0x7f4f601327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f601303d0 0x7f4f601327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54272/0 (socket says 172.21.15.125:54272) 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 -- 172.21.15.125:0/3832605836 learned_addr learned my addr 172.21.15.125:0/3832605836 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f656e8700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f6012b590 0x7f4f6012fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 -- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f6012b590 msgr2=0x7f4f6012fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f6012b590 0x7f4f6012fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 -- 172.21.15.125:0/3832605836 >> v1:172.21.15.125:6789/0 conn(0x7f4f6005f560 legacy=0x7f4f6012ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 -- 172.21.15.125:0/3832605836 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60067910 con 0x7f4f601303d0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.458+0000 7f4f666ea700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f601303d0 0x7f4f601327c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4f58009f20 tx=0x7f4f58009840).ready entity=mon.0 client_cookie=def1b6d1226f823c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f64ee7700 1 -- 172.21.15.125:0/3832605836 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800e070 con 0x7f4f601303d0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f64ee7700 1 -- 172.21.15.125:0/3832605836 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800b990 con 0x7f4f601303d0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f64ee7700 1 -- 172.21.15.125:0/3832605836 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800bd10 con 0x7f4f601303d0 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 -- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f601303d0 msgr2=0x7f4f601327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f601303d0 0x7f4f601327c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4f58009f20 tx=0x7f4f58009840).stop 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 -- 172.21.15.125:0/3832605836 shutdown_connections 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f601303d0 0x7f4f601327c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 --2- 172.21.15.125:0/3832605836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f6012b590 0x7f4f6012fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.459+0000 7f4f6814d700 1 -- 172.21.15.125:0/3832605836 >> 172.21.15.125:0/3832605836 conn(0x7f4f6009a1c0 msgr2=0x7f4f6009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.460+0000 7f4f6814d700 1 -- 172.21.15.125:0/3832605836 shutdown_connections 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.460+0000 7f4f6814d700 1 -- 172.21.15.125:0/3832605836 wait complete. 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 Processor -- start 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 -- start start 2023-10-03T10:09:23.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 0x7f4f601164f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f6012b590 0x7f4f601125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f601303d0 0x7f4f60112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60116060 con 0x7f4f6005f560 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600671c0 con 0x7f4f601303d0 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f6814d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6012ffa0 con 0x7f4f6012b590 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.461+0000 7f4f65ee9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 0x7f4f601164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 0x7f4f601164f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54282/0 (socket says 172.21.15.125:54282) 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 -- 172.21.15.125:0/3151774833 learned_addr learned my addr 172.21.15.125:0/3151774833 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f666ea700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f601303d0 0x7f4f60112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f656e8700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f6012b590 0x7f4f601125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 -- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f6012b590 msgr2=0x7f4f601125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f6012b590 0x7f4f601125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 -- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f601303d0 msgr2=0x7f4f60112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f601303d0 0x7f4f60112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 -- 172.21.15.125:0/3151774833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58009ae0 con 0x7f4f6005f560 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f65ee9700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 0x7f4f601164f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4f5c00b490 tx=0x7f4f5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00be40 con 0x7f4f6005f560 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c012410 con 0x7f4f6005f560 2023-10-03T10:09:23.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.463+0000 7fb89e8b9700 1 Processor -- start 2023-10-03T10:09:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0127d0 con 0x7f4f6005f560 2023-10-03T10:09:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.462+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f601136a0 con 0x7f4f6005f560 2023-10-03T10:09:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.463+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f601140e0 con 0x7f4f6005f560 2023-10-03T10:09:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.463+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f6005a260 con 0x7f4f6005f560 2023-10-03T10:09:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4f5c012b80 con 0x7f4f6005f560 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.463+0000 7fb89e8b9700 1 -- start start 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89e8b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89e8b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb898068680 0x7fb898067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89e8b9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8980694e0 con 0x7fb89812f200 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89e8b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb898069a10 con 0x7fb898068680 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89e8b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb898068b00 con 0x7fb898066e30 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40336/0 (socket says 172.21.15.125:40336) 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 -- 172.21.15.125:0/303578210 learned_addr learned my addr 172.21.15.125:0/303578210 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb89ce56700 1 --1- 172.21.15.125:0/303578210 >> v1:172.21.15.125:6789/0 conn(0x7fb89812f200 0x7fb89812f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40268/0 (socket says 172.21.15.125:40268) 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 -- 172.21.15.125:0/303578210 >> v2:172.21.15.125:3300/0 conn(0x7fb898068680 msgr2=0x7fb898067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 --2- 172.21.15.125:0/303578210 >> v2:172.21.15.125:3300/0 conn(0x7fb898068680 0x7fb898067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 -- 172.21.15.125:0/303578210 >> v1:172.21.15.125:6789/0 conn(0x7fb89812f200 legacy=0x7fb89812f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f5c03ac30 con 0x7f4f6005f560 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 --> v1:172.21.15.125:6804/118766 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f44038490 con 0x7f4f440347a0 2023-10-03T10:09:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.464+0000 7fb897fff700 1 -- 172.21.15.125:0/303578210 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898092120 con 0x7fb898066e30 2023-10-03T10:09:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.465+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f5c00d3d0 con 0x7f4f6005f560 2023-10-03T10:09:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.465+0000 7fb897fff700 1 --2- 172.21.15.125:0/303578210 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb88c006fd0 tx=0x7fb88c0090f0).ready entity=mon.2 client_cookie=d87f4cd3391fde33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.465+0000 7fb896ffd700 1 -- 172.21.15.125:0/303578210 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00b600 con 0x7fb898066e30 2023-10-03T10:09:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.465+0000 7fb896ffd700 1 -- 172.21.15.125:0/303578210 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00b760 con 0x7fb898066e30 2023-10-03T10:09:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.465+0000 7fb896ffd700 1 -- 172.21.15.125:0/303578210 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00bae0 con 0x7fb898066e30 2023-10-03T10:09:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== osd.2 v1:172.21.15.125:6804/118766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f4f44038490 con 0x7f4f440347a0 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 -- 172.21.15.125:0/303578210 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 msgr2=0x7fb898067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 --2- 172.21.15.125:0/303578210 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb88c006fd0 tx=0x7fb88c0090f0).stop 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 -- 172.21.15.125:0/303578210 shutdown_connections 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 --2- 172.21.15.125:0/303578210 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb898066e30 0x7fb898067210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 --2- 172.21.15.125:0/303578210 >> v2:172.21.15.125:3300/0 conn(0x7fb898068680 0x7fb898067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 -- 172.21.15.125:0/303578210 >> 172.21.15.125:0/303578210 conn(0x7fb89809a230 msgr2=0x7fb89809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 -- 172.21.15.125:0/303578210 shutdown_connections 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.466+0000 7fb89e8b9700 1 -- 172.21.15.125:0/303578210 wait complete. 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 Processor -- start 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 -- start start 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb898066e30 0x7fb898136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb898068680 0x7fb898136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 0x7fb8981311e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898134c70 con 0x7fb898068680 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb898134ed0 con 0x7fb898066e30 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.467+0000 7fb89e8b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb898133d50 con 0x7fb89812f200 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 0x7fb8981311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb8977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb898068680 0x7fb898136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 0x7fb8981311e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40348/0 (socket says 172.21.15.125:40348) 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 -- 172.21.15.125:0/1288419213 learned_addr learned my addr 172.21.15.125:0/1288419213 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb897fff700 1 --2- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb898066e30 0x7fb898136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 -- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb898066e30 msgr2=0x7fb898136590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 --2- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb898066e30 0x7fb898136590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 -- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb898068680 msgr2=0x7fb898136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 --2- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb898068680 0x7fb898136a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 -- 172.21.15.125:0/1288419213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c009370 con 0x7fb89812f200 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89ce56700 1 --2- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 0x7fb8981311e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb88800c410 tx=0x7fb888007d70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880070d0 con 0x7fb89812f200 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888007230 con 0x7fb89812f200 2023-10-03T10:09:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880056e0 con 0x7fb89812f200 2023-10-03T10:09:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.468+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb898135130 con 0x7fb89812f200 2023-10-03T10:09:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.469+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb898096d10 con 0x7fb89812f200 2023-10-03T10:09:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.469+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb898137030 con 0x7fb89812f200 2023-10-03T10:09:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.469+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb888005ad0 con 0x7fb89812f200 2023-10-03T10:09:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.470+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 --> v1:172.21.15.125:6800/118765 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fa411c440 con 0x7f0f880346f0 2023-10-03T10:09:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.470+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb88803a610 con 0x7fb89812f200 2023-10-03T10:09:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.470+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 --> v1:172.21.15.125:6812/118795 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb884038460 con 0x7fb884034770 2023-10-03T10:09:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.470+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb888013450 con 0x7fb89812f200 2023-10-03T10:09:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.471+0000 7f0f99ffb700 1 -- 172.21.15.125:0/2292772581 <== osd.1 v1:172.21.15.125:6800/118765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f0fa411c440 con 0x7f0f880346f0 2023-10-03T10:09:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.471+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== osd.0 v1:172.21.15.125:6812/118795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fb884038460 con 0x7fb884034770 2023-10-03T10:09:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 >> v1:172.21.15.125:6800/118765 conn(0x7f0f880346f0 legacy=0x7f0f88036b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 >> v1:172.21.15.125:6816/118167 conn(0x7f0f8802bb60 legacy=0x7f0f8802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 msgr2=0x7f0fa4118720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 --2- 172.21.15.125:0/2292772581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fa4068430 0x7f0fa4118720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0fa4092860 tx=0x7f0fa0017000).stop 2023-10-03T10:09:23.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0faa3ec700 1 -- 172.21.15.125:0/2292772581 reap_dead start 2023-10-03T10:09:23.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 shutdown_connections 2023-10-03T10:09:23.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.473+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 >> 172.21.15.125:0/2292772581 conn(0x7f0fa409a230 msgr2=0x7f0fa4098ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.474+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 --> v1:172.21.15.125:6808/118796 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41f40285d0 con 0x7f41f4116560 2023-10-03T10:09:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.474+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 shutdown_connections 2023-10-03T10:09:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.474+0000 7f0fabe4f700 1 -- 172.21.15.125:0/2292772581 wait complete. 2023-10-03T10:09:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.474+0000 7f41ea7fc700 1 -- 172.21.15.125:0/3098149513 <== osd.3 v1:172.21.15.125:6808/118796 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f41f40285d0 con 0x7f41f4116560 2023-10-03T10:09:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.475+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 >> v1:172.21.15.125:6808/118796 conn(0x7f41f4116560 legacy=0x7f41f4059070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.476+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 >> v1:172.21.15.125:6816/118167 conn(0x7f41d802bb60 legacy=0x7f41d802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.476+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 msgr2=0x7f41f41191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.476+0000 7f41fc520700 1 --2- 172.21.15.125:0/3098149513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f4067f40 0x7f41f41191f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f41f0009f50 tx=0x7f41f0019000).stop 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.476+0000 7f41faabd700 1 -- 172.21.15.125:0/3098149513 reap_dead start 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.477+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 shutdown_connections 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.477+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 >> 172.21.15.125:0/3098149513 conn(0x7f41f409a230 msgr2=0x7f41f4096b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.483+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 shutdown_connections 2023-10-03T10:09:23.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.483+0000 7f41fc520700 1 -- 172.21.15.125:0/3098149513 wait complete. 2023-10-03T10:09:23.489 INFO:teuthology.orchestra.run.smithi125.stdout:38654705670 2023-10-03T10:09:23.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.492+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 --> v1:172.21.15.125:6804/118766 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f6012b9b0 con 0x7f4f440347a0 2023-10-03T10:09:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.492+0000 7f4f55ffb700 1 -- 172.21.15.125:0/3151774833 <== osd.2 v1:172.21.15.125:6804/118766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f4f6012b9b0 con 0x7f4f440347a0 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 >> v1:172.21.15.125:6804/118766 conn(0x7f4f440347a0 legacy=0x7f4f44036c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 >> v1:172.21.15.125:6816/118167 conn(0x7f4f4402bb90 legacy=0x7f4f4402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 msgr2=0x7f4f601164f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 --2- 172.21.15.125:0/3151774833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f6005f560 0x7f4f601164f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4f5c00b490 tx=0x7f4f5c009060).stop 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f666ea700 1 -- 172.21.15.125:0/3151774833 reap_dead start 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 shutdown_connections 2023-10-03T10:09:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.493+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 >> 172.21.15.125:0/3151774833 conn(0x7f4f6009a1c0 msgr2=0x7f4f60095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.494+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 shutdown_connections 2023-10-03T10:09:23.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.494+0000 7f4f6814d700 1 -- 172.21.15.125:0/3151774833 wait complete. 2023-10-03T10:09:23.496 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:23.496 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.499+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 --> v1:172.21.15.125:6812/118795 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb898099e00 con 0x7fb884034770 2023-10-03T10:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.499+0000 7fb87ffff700 1 -- 172.21.15.125:0/1288419213 <== osd.0 v1:172.21.15.125:6812/118795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fb898099e00 con 0x7fb884034770 2023-10-03T10:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.499+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 >> v1:172.21.15.125:6812/118795 conn(0x7fb884034770 legacy=0x7fb884036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 >> v1:172.21.15.125:6816/118167 conn(0x7fb88402bb60 legacy=0x7fb88402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 msgr2=0x7fb8981311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 --2- 172.21.15.125:0/1288419213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb89812f200 0x7fb8981311e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb88800c410 tx=0x7fb888007d70).stop 2023-10-03T10:09:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89ce56700 1 -- 172.21.15.125:0/1288419213 reap_dead start 2023-10-03T10:09:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 shutdown_connections 2023-10-03T10:09:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 >> 172.21.15.125:0/1288419213 conn(0x7fb89809a230 msgr2=0x7fb898098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 shutdown_connections 2023-10-03T10:09:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.500+0000 7fb89e8b9700 1 -- 172.21.15.125:0/1288419213 wait complete. 2023-10-03T10:09:23.510 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:23.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:23.514 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:23.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:23.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 Processor -- start 2023-10-03T10:09:23.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 -- start start 2023-10-03T10:09:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 0x7ff52012f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff520094ba0 con 0x7ff520093950 2023-10-03T10:09:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff520092e90 con 0x7ff52012d250 2023-10-03T10:09:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff525fe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff520096b60 con 0x7ff520095e70 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff51effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff51effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40354/0 (socket says 172.21.15.125:40354) 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff51effd700 1 -- 172.21.15.125:0/3456241038 learned_addr learned my addr 172.21.15.125:0/3456241038 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff51f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff520093950 0x7ff520095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40274/0 (socket says 172.21.15.125:40274) 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.623+0000 7ff51ffff700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 0x7ff52012f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51ffff700 1 -- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 msgr2=0x7ff520096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51ffff700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51ffff700 1 -- 172.21.15.125:0/3456241038 >> v1:172.21.15.125:6789/0 conn(0x7ff520093950 legacy=0x7ff520095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51ffff700 1 -- 172.21.15.125:0/3456241038 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520093150 con 0x7ff52012d250 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51effd700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51ffff700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 0x7ff52012f640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff518009e90 tx=0x7ff518009780).ready entity=mon.1 client_cookie=74b865139907f21b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51e7fc700 1 -- 172.21.15.125:0/3456241038 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800e070 con 0x7ff52012d250 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51e7fc700 1 -- 172.21.15.125:0/3456241038 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800bb00 con 0x7ff52012d250 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.624+0000 7ff51e7fc700 1 -- 172.21.15.125:0/3456241038 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800be80 con 0x7ff52012d250 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 -- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 msgr2=0x7ff52012f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 0x7ff52012f640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff518009e90 tx=0x7ff518009780).stop 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 -- 172.21.15.125:0/3456241038 shutdown_connections 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff52012d250 0x7ff52012f640 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3456241038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff520096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 -- 172.21.15.125:0/3456241038 >> 172.21.15.125:0/3456241038 conn(0x7ff52009aa50 msgr2=0x7ff52009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 -- 172.21.15.125:0/3456241038 shutdown_connections 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.625+0000 7ff525fe0700 1 -- 172.21.15.125:0/3456241038 wait complete. 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.626+0000 7ff525fe0700 1 Processor -- start 2023-10-03T10:09:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.626+0000 7ff525fe0700 1 -- start start 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff520093950 0x7ff5201139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 0x7ff52012c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5201260c0 con 0x7ff52012d250 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff520092410 con 0x7ff520093950 2023-10-03T10:09:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff525fe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff520125b50 con 0x7ff520095e70 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40364/0 (socket says 172.21.15.125:40364) 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 -- 172.21.15.125:0/3367370651 learned_addr learned my addr 172.21.15.125:0/3367370651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51ffff700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 0x7ff52012c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 -- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff520093950 msgr2=0x7ff5201139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff520093950 0x7ff5201139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 -- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 msgr2=0x7ff52012c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 0x7ff52012c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51effd700 1 -- 172.21.15.125:0/3367370651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009370 con 0x7ff520095e70 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.627+0000 7ff51ffff700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 0x7ff52012c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff51effd700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff51400ea20 tx=0x7ff5140090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400c7f0 con 0x7ff520095e70 2023-10-03T10:09:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400c950 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400ccd0 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518009a20 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.628+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff520112f30 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.629+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff514012600 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.629+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52005a260 con 0x7ff520095e70 2023-10-03T10:09:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.629+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff51403b730 con 0x7ff520095e70 2023-10-03T10:09:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.634+0000 7f8d53837700 1 Processor -- start 2023-10-03T10:09:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.634+0000 7f8d53837700 1 -- start start 2023-10-03T10:09:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d53837700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 0x7f8d4c12fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d53837700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d53837700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c0677f0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d53837700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c067c60 con 0x7f8d4c130390 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d53837700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c092ba0 con 0x7f8d4c0931b0 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d515d3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8d4c12ae30 0x7f8d4c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40278/0 (socket says 172.21.15.125:40278) 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d515d3700 1 -- 172.21.15.125:0/1811696412 learned_addr learned my addr 172.21.15.125:0/1811696412 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 0x7f8d4c12fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d51dd4700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d50dd2700 1 -- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 msgr2=0x7f8d4c132780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c132780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d50dd2700 1 -- 172.21.15.125:0/1811696412 >> v1:172.21.15.125:6789/0 conn(0x7f8d4c12ae30 legacy=0x7f8d4c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d43fff700 1 -- 172.21.15.125:0/1811696412 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761819630 0 0) 0x7f8d4c0677f0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.635+0000 7f8d50dd2700 1 -- 172.21.15.125:0/1811696412 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c12ac10 con 0x7f8d4c0931b0 2023-10-03T10:09:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 0x7f8d4c12fea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8d3c009790 tx=0x7f8d3c009060).ready entity=mon.2 client_cookie=2fe7f4238afb7133 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff51400ce30 con 0x7ff520095e70 2023-10-03T10:09:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d43fff700 1 -- 172.21.15.125:0/1811696412 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0090d0 con 0x7f8d4c0931b0 2023-10-03T10:09:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d43fff700 1 -- 172.21.15.125:0/1811696412 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00b5a0 con 0x7f8d4c0931b0 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d43fff700 1 -- 172.21.15.125:0/1811696412 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00b920 con 0x7f8d4c0931b0 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d53837700 1 -- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 msgr2=0x7f8d4c12fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.636+0000 7f8d53837700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 0x7f8d4c12fea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8d3c009790 tx=0x7f8d3c009060).stop 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.637+0000 7f8d53837700 1 -- 172.21.15.125:0/1811696412 shutdown_connections 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.637+0000 7f8d53837700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c132780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.637+0000 7f8d53837700 1 --2- 172.21.15.125:0/1811696412 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c0931b0 0x7f8d4c12fea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.637+0000 7f8d53837700 1 -- 172.21.15.125:0/1811696412 >> 172.21.15.125:0/1811696412 conn(0x7f8d4c09a230 msgr2=0x7f8d4c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.639+0000 7f8d53837700 1 -- 172.21.15.125:0/1811696412 shutdown_connections 2023-10-03T10:09:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.639+0000 7f8d53837700 1 -- 172.21.15.125:0/1811696412 wait complete. 2023-10-03T10:09:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 Processor -- start 2023-10-03T10:09:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 -- start start 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d4c0931b0 0x7f8d4c116a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1171e0 con 0x7f8d4c0931b0 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1150f0 con 0x7f8d4c130390 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d53837700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c116590 con 0x7f8d4c12ae30 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d50dd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d50dd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40384/0 (socket says 172.21.15.125:40384) 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.640+0000 7f8d50dd2700 1 -- 172.21.15.125:0/2411853421 learned_addr learned my addr 172.21.15.125:0/2411853421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d51dd4700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 -- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 msgr2=0x7f8d4c113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 -- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d4c0931b0 msgr2=0x7f8d4c116a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d4c0931b0 0x7f8d4c116a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 -- 172.21.15.125:0/2411853421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c0092a0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d50dd2700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8d3c011000 tx=0x7f8d3c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c006970 con 0x7f8d4c12ae30 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00b710 con 0x7f8d4c12ae30 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c115fc0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00bee0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.641+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c1146d0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.642+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8d3c01b620 con 0x7f8d4c12ae30 2023-10-03T10:09:23.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.642+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8d3c03c930 con 0x7f8d4c12ae30 2023-10-03T10:09:23.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.642+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c0692a0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.647+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8d3c01f020 con 0x7f8d4c12ae30 2023-10-03T10:09:23.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.680+0000 7f7c13e15700 1 Processor -- start 2023-10-03T10:09:23.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.680+0000 7f7c13e15700 1 -- start start 2023-10-03T10:09:23.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c13e15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c13e15700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0685a0 0x7f7c0c12fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c13e15700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0933d0 con 0x7f7c0c097170 2023-10-03T10:09:23.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c13e15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c093670 con 0x7f7c0c0968a0 2023-10-03T10:09:23.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c13e15700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c091b90 con 0x7f7c0c0685a0 2023-10-03T10:09:23.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45944/0 (socket says 172.21.15.125:45944) 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 -- 172.21.15.125:0/1563678728 learned_addr learned my addr 172.21.15.125:0/1563678728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c113b0700 1 --1- 172.21.15.125:0/1563678728 >> v1:172.21.15.125:6789/0 conn(0x7f7c0c097170 0x7f7c0c067e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40290/0 (socket says 172.21.15.125:40290) 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 -- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0685a0 msgr2=0x7f7c0c12fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 --2- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0685a0 0x7f7c0c12fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 -- 172.21.15.125:0/1563678728 >> v1:172.21.15.125:6789/0 conn(0x7f7c0c097170 legacy=0x7f7c0c067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 -- 172.21.15.125:0/1563678728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c092250 con 0x7f7c0c0968a0 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c11bb1700 1 --2- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7c08009830 tx=0x7f7c080090f0).ready entity=mon.1 client_cookie=2d87ff724107def4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.681+0000 7f7c10baf700 1 -- 172.21.15.125:0/1563678728 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800b640 con 0x7f7c0c0968a0 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c10baf700 1 -- 172.21.15.125:0/1563678728 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b7a0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c10baf700 1 -- 172.21.15.125:0/1563678728 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800bb40 con 0x7f7c0c0968a0 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 -- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 msgr2=0x7f7c0c096c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7c08009830 tx=0x7f7c080090f0).stop 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 -- 172.21.15.125:0/1563678728 shutdown_connections 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0685a0 0x7f7c0c12fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1563678728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c0968a0 0x7f7c0c096c80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 -- 172.21.15.125:0/1563678728 >> 172.21.15.125:0/1563678728 conn(0x7f7c0c09a1c0 msgr2=0x7f7c0c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 -- 172.21.15.125:0/1563678728 shutdown_connections 2023-10-03T10:09:23.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.682+0000 7f7c13e15700 1 -- 172.21.15.125:0/1563678728 wait complete. 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.683+0000 7f7c13e15700 1 Processor -- start 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.683+0000 7f7c13e15700 1 -- start start 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c0c0685a0 0x7f7c0c119a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 0x7f7c0c131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c11a180 con 0x7f7c0c0685a0 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c118090 con 0x7f7c0c097170 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c13e15700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c091df0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40410/0 (socket says 172.21.15.125:40410) 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 -- 172.21.15.125:0/1649914222 learned_addr learned my addr 172.21.15.125:0/1649914222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c123b2700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 0x7f7c0c131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c11bb1700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c0c0685a0 0x7f7c0c119a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 -- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 msgr2=0x7f7c0c131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 0x7f7c0c131ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 -- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c0c0685a0 msgr2=0x7f7c0c119a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c0c0685a0 0x7f7c0c119a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 -- 172.21.15.125:0/1649914222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009370 con 0x7f7c0c0968a0 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c123b2700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 0x7f7c0c131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:23.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.684+0000 7f7c113b0700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7bfc00c4c0 tx=0x7f7bfc007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0070d0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc007230 con 0x7f7c0c0968a0 2023-10-03T10:09:23.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c119500 con 0x7f7c0c0968a0 2023-10-03T10:09:23.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0075b0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c1177b0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.685+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7bfc0058f0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.686+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7bfc03a5f0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.686+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c05a260 con 0x7f7c0c0968a0 2023-10-03T10:09:23.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.691+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7bfc0137d0 con 0x7f7c0c0968a0 2023-10-03T10:09:23.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.705+0000 7fc09a42d700 1 Processor -- start 2023-10-03T10:09:23.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.705+0000 7fc09a42d700 1 -- start start 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc09a42d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc094062b00 0x7fc0941279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc09a42d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09412b230 0x7fc094132e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc09a42d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094092c50 con 0x7fc094127ee0 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc09a42d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094062ee0 con 0x7fc094062b00 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc09a42d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094097310 con 0x7fc09412b230 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc093fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc094062b00 0x7fc0941279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc093fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc094062b00 0x7fc0941279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54332/0 (socket says 172.21.15.125:54332) 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc093fff700 1 -- 172.21.15.125:0/1073676209 learned_addr learned my addr 172.21.15.125:0/1073676209 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.706+0000 7fc0989ca700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09412b230 0x7fc094132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc093fff700 1 -- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09412b230 msgr2=0x7fc094132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc093fff700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09412b230 0x7fc094132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc093fff700 1 -- 172.21.15.125:0/1073676209 >> v1:172.21.15.125:6789/0 conn(0x7fc094127ee0 legacy=0x7fc09412ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc093fff700 1 -- 172.21.15.125:0/1073676209 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940919f0 con 0x7fc094062b00 2023-10-03T10:09:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc093fff700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc094062b00 0x7fc0941279f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc084006fd0 tx=0x7fc0840090f0).ready entity=mon.0 client_cookie=b70f3bbd35fc063e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc092ffd700 1 -- 172.21.15.125:0/1073676209 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400b580 con 0x7fc094062b00 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc092ffd700 1 -- 172.21.15.125:0/1073676209 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400b6e0 con 0x7fc094062b00 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.707+0000 7fc092ffd700 1 -- 172.21.15.125:0/1073676209 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400ba60 con 0x7fc094062b00 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 -- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc094062b00 msgr2=0x7fc0941279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc094062b00 0x7fc0941279f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc084006fd0 tx=0x7fc0840090f0).stop 2023-10-03T10:09:23.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 -- 172.21.15.125:0/1073676209 shutdown_connections 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09412b230 0x7fc094132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 --2- 172.21.15.125:0/1073676209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc094062b00 0x7fc0941279f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 -- 172.21.15.125:0/1073676209 >> 172.21.15.125:0/1073676209 conn(0x7fc09409aa50 msgr2=0x7fc09409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 -- 172.21.15.125:0/1073676209 shutdown_connections 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.708+0000 7fc09a42d700 1 -- 172.21.15.125:0/1073676209 wait complete. 2023-10-03T10:09:23.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.710+0000 7fc09a42d700 1 Processor -- start 2023-10-03T10:09:23.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.710+0000 7fc09a42d700 1 -- start start 2023-10-03T10:09:23.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc094127ee0 0x7fc094124470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc09412b230 0x7fc0941198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411b6e0 con 0x7fc09412b230 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411c8b0 con 0x7fc094062b00 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc09a42d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411cb50 con 0x7fc094127ee0 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45976/0 (socket says 172.21.15.125:45976) 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 -- 172.21.15.125:0/694445081 learned_addr learned my addr 172.21.15.125:0/694445081 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:23.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc0989ca700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc09412b230 0x7fc0941198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc0937fe700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc094127ee0 0x7fc094124470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 -- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc094127ee0 msgr2=0x7fc094124470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc094127ee0 0x7fc094124470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 -- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc09412b230 msgr2=0x7fc0941198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc09412b230 0x7fc0941198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 -- 172.21.15.125:0/694445081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009370 con 0x7fc094062b00 2023-10-03T10:09:23.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.711+0000 7fc093fff700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc084009ea0 tx=0x7fc084017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.712+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084000bc0 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.712+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400b850 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.712+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084000d20 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.712+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094096da0 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.712+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09411b930 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.713+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc08401cb10 con 0x7fc094062b00 2023-10-03T10:09:23.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.713+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc08403ce90 con 0x7fc094062b00 2023-10-03T10:09:23.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.713+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09411bac0 con 0x7fc094062b00 2023-10-03T10:09:23.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.718+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc09411bac0 con 0x7fc094062b00 2023-10-03T10:09:23.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.824+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d4c05a260 con 0x7f8d4c12ae30 2023-10-03T10:09:23.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.824+0000 7f8d417fa700 1 -- 172.21.15.125:0/2411853421 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d3c0193c0 con 0x7f8d4c12ae30 2023-10-03T10:09:23.825 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:23.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 >> v1:172.21.15.125:6816/118167 conn(0x7f8d3002bb90 legacy=0x7f8d3002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 msgr2=0x7f8d4c112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8d3c011000 tx=0x7f8d3c015000).stop 2023-10-03T10:09:23.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 shutdown_connections 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d4c130390 0x7f8d4c113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d4c0931b0 0x7f8d4c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 --2- 172.21.15.125:0/2411853421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d4c12ae30 0x7f8d4c112b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 >> 172.21.15.125:0/2411853421 conn(0x7f8d4c09a230 msgr2=0x7f8d4c091980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 shutdown_connections 2023-10-03T10:09:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.826+0000 7f8d53837700 1 -- 172.21.15.125:0/2411853421 wait complete. 2023-10-03T10:09:23.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2023-10-03T10:09:23.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.842+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff52012c9d0 con 0x7ff520095e70 2023-10-03T10:09:23.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.842+0000 7ff5077fe700 1 -- 172.21.15.125:0/3367370651 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff514011350 con 0x7ff520095e70 2023-10-03T10:09:23.843 INFO:teuthology.orchestra.run.smithi125.stdout:38654705668 2023-10-03T10:09:23.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 >> v1:172.21.15.125:6816/118167 conn(0x7ff50c02bb60 legacy=0x7ff50c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 msgr2=0x7ff52012bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff51400ea20 tx=0x7ff5140090f0).stop 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 shutdown_connections 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff52012d250 0x7ff52012c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff520093950 0x7ff5201139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 --2- 172.21.15.125:0/3367370651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff520095e70 0x7ff52012bbd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 >> 172.21.15.125:0/3367370651 conn(0x7ff52009aa50 msgr2=0x7ff520062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 shutdown_connections 2023-10-03T10:09:23.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.844+0000 7ff525fe0700 1 -- 172.21.15.125:0/3367370651 wait complete. 2023-10-03T10:09:23.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.1 2023-10-03T10:09:23.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.862+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c0c046c20 con 0x7f7c0c0968a0 2023-10-03T10:09:23.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.862+0000 7f7c01ffb700 1 -- 172.21.15.125:0/1649914222 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bfc018020 con 0x7f7c0c0968a0 2023-10-03T10:09:23.863 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:23.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 >> v1:172.21.15.125:6816/118167 conn(0x7f7bf002bb90 legacy=0x7f7bf002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 msgr2=0x7f7c0c1316b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7bfc00c4c0 tx=0x7f7bfc007dc0).stop 2023-10-03T10:09:23.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 shutdown_connections 2023-10-03T10:09:23.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c0c097170 0x7f7c0c131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c0c0685a0 0x7f7c0c119a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 --2- 172.21.15.125:0/1649914222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c0c0968a0 0x7f7c0c1316b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 >> 172.21.15.125:0/1649914222 conn(0x7f7c0c09a1c0 msgr2=0x7f7c0c098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 shutdown_connections 2023-10-03T10:09:23.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.864+0000 7f7c13e15700 1 -- 172.21.15.125:0/1649914222 wait complete. 2023-10-03T10:09:23.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2023-10-03T10:09:23.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.894+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc09411bac0 con 0x7fc094062b00 2023-10-03T10:09:23.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.894+0000 7fc07bfff700 1 -- 172.21.15.125:0/694445081 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc09411bac0 con 0x7fc094062b00 2023-10-03T10:09:23.895 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:23.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 >> v1:172.21.15.125:6816/118167 conn(0x7fc08002bb60 legacy=0x7fc08002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 msgr2=0x7fc094123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:23.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc084009ea0 tx=0x7fc084017000).stop 2023-10-03T10:09:23.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 shutdown_connections 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc09412b230 0x7fc0941198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc094062b00 0x7fc094123f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 --2- 172.21.15.125:0/694445081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc094127ee0 0x7fc094124470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 >> 172.21.15.125:0/694445081 conn(0x7fc09409aa50 msgr2=0x7fc094126810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 shutdown_connections 2023-10-03T10:09:23.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:23.896+0000 7fc09a42d700 1 -- 172.21.15.125:0/694445081 wait complete. 2023-10-03T10:09:23.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-10-03T10:09:24.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:24.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:24.877 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:24.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.988+0000 7f6510332700 1 Processor -- start 2023-10-03T10:09:24.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.988+0000 7f6510332700 1 -- start start 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f6510332700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650812de90 0x7f6508130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f6510332700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6508130770 0x7f6508132b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f6510332700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6508066e30 con 0x7f650812afd0 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f6510332700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650812ab10 con 0x7f6508130770 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f6510332700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6508067500 con 0x7f650812de90 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f650e0ce700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f650812afd0 0x7f650812b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40320/0 (socket says 172.21.15.125:40320) 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f650e0ce700 1 -- 172.21.15.125:0/735690591 learned_addr learned my addr 172.21.15.125:0/735690591 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f650e8cf700 1 --2- 172.21.15.125:0/735690591 >> v2:172.21.15.125:3300/0 conn(0x7f6508130770 0x7f6508132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:24.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.989+0000 7f650d8cd700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650812de90 0x7f6508130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650e8cf700 1 -- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650812de90 msgr2=0x7f6508130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650e8cf700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650812de90 0x7f6508130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650e8cf700 1 -- 172.21.15.125:0/735690591 >> v1:172.21.15.125:6789/0 conn(0x7f650812afd0 legacy=0x7f650812b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650e8cf700 1 -- 172.21.15.125:0/735690591 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650812adb0 con 0x7f6508130770 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650d0cc700 1 -- 172.21.15.125:0/735690591 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463670693 0 0) 0x7f6508066e30 con 0x7f650812afd0 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650e8cf700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6508130770 0x7f6508132b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6500009e60 tx=0x7f6500009780).ready entity=mon.0 client_cookie=acf87c46276e7cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650d0cc700 1 -- 172.21.15.125:0/735690591 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000e070 con 0x7f6508130770 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650d0cc700 1 -- 172.21.15.125:0/735690591 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000bb60 con 0x7f6508130770 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.990+0000 7f650d0cc700 1 -- 172.21.15.125:0/735690591 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500012410 con 0x7f6508130770 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 -- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6508130770 msgr2=0x7f6508132b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:24.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6508130770 0x7f6508132b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6500009e60 tx=0x7f6500009780).stop 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 -- 172.21.15.125:0/735690591 shutdown_connections 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6508130770 0x7f6508132b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 --2- 172.21.15.125:0/735690591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650812de90 0x7f6508130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 -- 172.21.15.125:0/735690591 >> 172.21.15.125:0/735690591 conn(0x7f650809a230 msgr2=0x7f650809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 -- 172.21.15.125:0/735690591 shutdown_connections 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.991+0000 7f6510332700 1 -- 172.21.15.125:0/735690591 wait complete. 2023-10-03T10:09:24.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.992+0000 7f6510332700 1 Processor -- start 2023-10-03T10:09:24.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 -- start start 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650812afd0 0x7f650812a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6508130770 0x7f65081146e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081156b0 con 0x7f650812afd0 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6508116820 con 0x7f6508130770 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f6510332700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6508067040 con 0x7f650812de90 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f650d8cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f650d8cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40420/0 (socket says 172.21.15.125:40420) 2023-10-03T10:09:24.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f650d8cd700 1 -- 172.21.15.125:0/1153625575 learned_addr learned my addr 172.21.15.125:0/1153625575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f650e0ce700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650812afd0 0x7f650812a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.993+0000 7f650e8cf700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6508130770 0x7f65081146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 -- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6508130770 msgr2=0x7f65081146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6508130770 0x7f65081146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 -- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650812afd0 msgr2=0x7f650812a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650812afd0 0x7f650812a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 -- 172.21.15.125:0/1153625575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009a20 con 0x7f650812de90 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f650d8cd700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f64f8009fd0 tx=0x7f64f8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8012600 con 0x7f650812de90 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f8012760 con 0x7f650812de90 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6508117c90 con 0x7f650812de90 2023-10-03T10:09:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8012ae0 con 0x7f650812de90 2023-10-03T10:09:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.994+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508118370 con 0x7f650812de90 2023-10-03T10:09:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.996+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650805a260 con 0x7f650812de90 2023-10-03T10:09:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.996+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f64f801b400 con 0x7f650812de90 2023-10-03T10:09:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:24.996+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f64f803b300 con 0x7f650812de90 2023-10-03T10:09:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.001+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f64f8019310 con 0x7f650812de90 2023-10-03T10:09:25.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 Processor -- start 2023-10-03T10:09:25.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 Processor -- start 2023-10-03T10:09:25.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 -- start start 2023-10-03T10:09:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 -- start start 2023-10-03T10:09:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60096970 0x7f9e60096d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e60068660 0x7f9e60067320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e60094350 con 0x7f9e60068660 2023-10-03T10:09:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60094150 con 0x7f9e60097240 2023-10-03T10:09:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7f9e64a0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60069aa0 con 0x7f9e60096970 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 0x7fcb24096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb24094ba0 con 0x7fcb2412c240 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb24092e90 con 0x7fcb24095c50 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.018+0000 7fcb2c7ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24096b60 con 0x7fcb24093950 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46010/0 (socket says 172.21.15.125:46010) 2023-10-03T10:09:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 -- 172.21.15.125:0/2586204928 learned_addr learned my addr 172.21.15.125:0/2586204928 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46006/0 (socket says 172.21.15.125:46006) 2023-10-03T10:09:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 -- 172.21.15.125:0/3029616691 learned_addr learned my addr 172.21.15.125:0/3029616691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5e59c700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60096970 0x7f9e60096d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 -- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60096970 msgr2=0x7f9e60096d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60096970 0x7f9e60096d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 -- 172.21.15.125:0/2586204928 >> v2:172.21.15.125:3300/0 conn(0x7f9e60068660 msgr2=0x7f9e60067320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 --2- 172.21.15.125:0/2586204928 >> v2:172.21.15.125:3300/0 conn(0x7f9e60068660 0x7f9e60067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 -- 172.21.15.125:0/2586204928 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60094540 con 0x7f9e60097240 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5dd9b700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9e48009860 tx=0x7f9e480090f0).ready entity=mon.1 client_cookie=3bbd78f1b9a98c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb29d88700 1 --2- 172.21.15.125:0/3029616691 >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 0x7fcb24096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5d59a700 1 -- 172.21.15.125:0/2586204928 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800b600 con 0x7f9e60097240 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 -- 172.21.15.125:0/3029616691 >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 msgr2=0x7fcb24096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 --2- 172.21.15.125:0/3029616691 >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 0x7fcb24096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb29587700 1 -- 172.21.15.125:0/3029616691 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994780988 0 0) 0x7fcb24094ba0 con 0x7fcb2412c240 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 -- 172.21.15.125:0/3029616691 >> v1:172.21.15.125:6789/0 conn(0x7fcb2412c240 legacy=0x7fcb2412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb2a589700 1 -- 172.21.15.125:0/3029616691 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24093150 con 0x7fcb24093950 2023-10-03T10:09:25.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7fcb29d88700 1 --2- 172.21.15.125:0/3029616691 >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 0x7fcb24096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5d59a700 1 -- 172.21.15.125:0/2586204928 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4800b760 con 0x7f9e60097240 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.019+0000 7f9e5d59a700 1 -- 172.21.15.125:0/2586204928 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800bae0 con 0x7f9e60097240 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 -- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 msgr2=0x7f9e60066e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9e48009860 tx=0x7f9e480090f0).stop 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb2a589700 1 --2- 172.21.15.125:0/3029616691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb20006fd0 tx=0x7fcb200090f0).ready entity=mon.1 client_cookie=26cb1238a106d8ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb29587700 1 -- 172.21.15.125:0/3029616691 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000b600 con 0x7fcb24093950 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb29587700 1 -- 172.21.15.125:0/3029616691 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2000b760 con 0x7fcb24093950 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb29587700 1 -- 172.21.15.125:0/3029616691 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000bb00 con 0x7fcb24093950 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 -- 172.21.15.125:0/2586204928 shutdown_connections 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/2586204928 >> v2:172.21.15.125:3300/0 conn(0x7f9e60068660 0x7f9e60067320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60096970 0x7f9e60096d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/2586204928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60097240 0x7f9e60066e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 -- 172.21.15.125:0/2586204928 >> 172.21.15.125:0/2586204928 conn(0x7f9e6009a230 msgr2=0x7f9e6009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/3029616691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 msgr2=0x7fcb24095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/3029616691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb20006fd0 tx=0x7fcb200090f0).stop 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.020+0000 7f9e64a0c700 1 -- 172.21.15.125:0/2586204928 shutdown_connections 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/3029616691 shutdown_connections 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/3029616691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24095760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/3029616691 >> v2:172.21.15.125:3300/0 conn(0x7fcb24095c50 0x7fcb24096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/3029616691 >> 172.21.15.125:0/3029616691 conn(0x7fcb2409aa50 msgr2=0x7fcb2409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7f9e64a0c700 1 -- 172.21.15.125:0/2586204928 wait complete. 2023-10-03T10:09:25.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7f9e64a0c700 1 Processor -- start 2023-10-03T10:09:25.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/3029616691 shutdown_connections 2023-10-03T10:09:25.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/3029616691 wait complete. 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7f9e64a0c700 1 -- start start 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e60068660 0x7f9e60138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60096970 0x7f9e60138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6011a900 con 0x7f9e60068660 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6012d100 con 0x7f9e60096970 2023-10-03T10:09:25.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e64a0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600691c0 con 0x7f9e60138d20 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 Processor -- start 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.021+0000 7fcb2c7ed700 1 -- start start 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb24095c50 0x7fcb24130d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2412c240 0x7fcb24131210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24132c60 con 0x7fcb2412c240 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24092410 con 0x7fcb24093950 2023-10-03T10:09:25.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2c7ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241323c0 con 0x7fcb24095c50 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40434/0 (socket says 172.21.15.125:40434) 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 -- 172.21.15.125:0/655730269 learned_addr learned my addr 172.21.15.125:0/655730269 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5dd9b700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60096970 0x7f9e60138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5e59c700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e60068660 0x7f9e60138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 -- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60096970 msgr2=0x7f9e60138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60096970 0x7f9e60138830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 -- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e60068660 msgr2=0x7f9e60138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e60068660 0x7f9e60138340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7f9e5ed9d700 1 -- 172.21.15.125:0/655730269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48009370 con 0x7f9e60138d20 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e5ed9d700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e5800bb90 tx=0x7f9e58009810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2a589700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2a589700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46018/0 (socket says 172.21.15.125:46018) 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2a589700 1 -- 172.21.15.125:0/1805647777 learned_addr learned my addr 172.21.15.125:0/1805647777 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.022+0000 7fcb2ad8a700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2412c240 0x7fcb24131210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7fcb2a589700 1 -- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb24095c50 msgr2=0x7fcb24130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5800c8c0 con 0x7f9e60138d20 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7fcb2a589700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb24095c50 0x7fcb24130d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7fcb2a589700 1 -- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2412c240 msgr2=0x7fcb24131210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7fcb2a589700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2412c240 0x7fcb24131210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7fcb2a589700 1 -- 172.21.15.125:0/1805647777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009370 con 0x7fcb24093950 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5800ca40 con 0x7f9e60138d20 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6011a4b0 con 0x7f9e60138d20 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5800cbf0 con 0x7f9e60138d20 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.023+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e60119e60 con 0x7f9e60138d20 2023-10-03T10:09:25.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.024+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9e58012020 con 0x7f9e60138d20 2023-10-03T10:09:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.024+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6005a260 con 0x7f9e60138d20 2023-10-03T10:09:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.024+0000 7fcb2a589700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcb20009130 tx=0x7fcb20017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.024+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9e5803aef0 con 0x7f9e60138d20 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.024+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000bec0 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.025+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20006910 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.025+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000bb00 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.025+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2411b2a0 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.025+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb24119f80 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.026+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcb20021070 con 0x7fcb24093950 2023-10-03T10:09:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.026+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcb2003f180 con 0x7fcb24093950 2023-10-03T10:09:25.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.026+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2405a260 con 0x7fcb24093950 2023-10-03T10:09:25.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.029+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9e5801d350 con 0x7f9e60138d20 2023-10-03T10:09:25.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.031+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcb20041060 con 0x7fcb24093950 2023-10-03T10:09:25.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 Processor -- start 2023-10-03T10:09:25.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 -- start start 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec12dee0 0x7f3dec1302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec069a10 con 0x7f3dec066e30 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.084+0000 7f3df19cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec069090 con 0x7f3dec068680 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3df19cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0694e0 con 0x7f3dec12dee0 2023-10-03T10:09:25.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46022/0 (socket says 172.21.15.125:46022) 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 -- 172.21.15.125:0/2753344427 learned_addr learned my addr 172.21.15.125:0/2753344427 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3deaffd700 1 --1- 172.21.15.125:0/2753344427 >> v1:172.21.15.125:6789/0 conn(0x7f3dec066e30 0x7f3dec067210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40332/0 (socket says 172.21.15.125:40332) 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3deb7fe700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec12dee0 0x7f3dec1302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 -- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec12dee0 msgr2=0x7f3dec1302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec12dee0 0x7f3dec1302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 -- 172.21.15.125:0/2753344427 >> v1:172.21.15.125:6789/0 conn(0x7f3dec066e30 legacy=0x7f3dec067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 -- 172.21.15.125:0/2753344427 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec068b00 con 0x7f3dec068680 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3dea7fc700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3de0009830 tx=0x7f3de00090f0).ready entity=mon.1 client_cookie=b9226c85217e7a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3de9ffb700 1 -- 172.21.15.125:0/2753344427 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000b640 con 0x7f3dec068680 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3de9ffb700 1 -- 172.21.15.125:0/2753344427 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000b7a0 con 0x7f3dec068680 2023-10-03T10:09:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.085+0000 7f3de9ffb700 1 -- 172.21.15.125:0/2753344427 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000bb40 con 0x7f3dec068680 2023-10-03T10:09:25.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.086+0000 7f3df19cd700 1 -- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 msgr2=0x7f3dec067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.086+0000 7f3df19cd700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3de0009830 tx=0x7f3de00090f0).stop 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.086+0000 7f3df19cd700 1 -- 172.21.15.125:0/2753344427 shutdown_connections 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.086+0000 7f3df19cd700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec12dee0 0x7f3dec1302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.086+0000 7f3df19cd700 1 --2- 172.21.15.125:0/2753344427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec068680 0x7f3dec067920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.087+0000 7f3df19cd700 1 -- 172.21.15.125:0/2753344427 >> 172.21.15.125:0/2753344427 conn(0x7f3dec09a230 msgr2=0x7f3dec09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.087+0000 7f3df19cd700 1 -- 172.21.15.125:0/2753344427 shutdown_connections 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.087+0000 7f3df19cd700 1 -- 172.21.15.125:0/2753344427 wait complete. 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.088+0000 7f3df19cd700 1 Processor -- start 2023-10-03T10:09:25.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.088+0000 7f3df19cd700 1 -- start start 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec12dee0 0x7f3dec092390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec092880 con 0x7f3dec066e30 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec093500 con 0x7f3dec12dee0 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3df19cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec12e450 con 0x7f3dec068680 2023-10-03T10:09:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54402/0 (socket says 172.21.15.125:54402) 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:40452/0 (socket says 172.21.15.125:40452) 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3deaffd700 1 -- 172.21.15.125:0/3313898648 learned_addr learned my addr 172.21.15.125:0/3313898648 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3deb7fe700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec12dee0 0x7f3dec092390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 -- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec12dee0 msgr2=0x7f3dec092390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec12dee0 0x7f3dec092390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 -- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 msgr2=0x7f3dec0919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.089+0000 7f3dea7fc700 1 -- 172.21.15.125:0/3313898648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0009370 con 0x7f3dec068680 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3deaffd700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3dea7fc700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3de0014000 tx=0x7f3de0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0006d90 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0006970 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0691e0 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011d10 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.090+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec116a30 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.091+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec05a260 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.091+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3de0021070 con 0x7f3dec068680 2023-10-03T10:09:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.092+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3de003cc40 con 0x7f3dec068680 2023-10-03T10:09:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.099+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3de0024680 con 0x7f3dec068680 2023-10-03T10:09:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.201+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6508114ff0 con 0x7f650812de90 2023-10-03T10:09:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.201+0000 7f64fe7fc700 1 -- 172.21.15.125:0/1153625575 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64f8016030 con 0x7f650812de90 2023-10-03T10:09:25.202 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 >> v1:172.21.15.125:6816/118167 conn(0x7f64ec02bb60 legacy=0x7f64ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 msgr2=0x7f65081141f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f64f8009fd0 tx=0x7f64f8009060).stop 2023-10-03T10:09:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 shutdown_connections 2023-10-03T10:09:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6508130770 0x7f65081146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650812afd0 0x7f650812a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 --2- 172.21.15.125:0/1153625575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650812de90 0x7f65081141f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 >> 172.21.15.125:0/1153625575 conn(0x7f650809a230 msgr2=0x7f65080997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 shutdown_connections 2023-10-03T10:09:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.203+0000 7f6510332700 1 -- 172.21.15.125:0/1153625575 wait complete. 2023-10-03T10:09:25.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2023-10-03T10:09:25.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.222+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e60068ae0 con 0x7f9e60138d20 2023-10-03T10:09:25.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.222+0000 7f9e567fc700 1 -- 172.21.15.125:0/655730269 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e58013b20 con 0x7f9e60138d20 2023-10-03T10:09:25.223 INFO:teuthology.orchestra.run.smithi125.stdout:38654705668 2023-10-03T10:09:25.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 >> v1:172.21.15.125:6816/118167 conn(0x7f9e4002bb60 legacy=0x7f9e4002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 msgr2=0x7f9e60116d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e5800bb90 tx=0x7f9e58009810).stop 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 shutdown_connections 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e60138d20 0x7f9e60116d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e60068660 0x7f9e60138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 --2- 172.21.15.125:0/655730269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e60096970 0x7f9e60138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.225+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 >> 172.21.15.125:0/655730269 conn(0x7f9e6009a230 msgr2=0x7f9e6012bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.226+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 shutdown_connections 2023-10-03T10:09:25.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.226+0000 7f9e64a0c700 1 -- 172.21.15.125:0/655730269 wait complete. 2023-10-03T10:09:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.233+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb24046c20 con 0x7fcb24093950 2023-10-03T10:09:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.233+0000 7fcb1a7fc700 1 -- 172.21.15.125:0/1805647777 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb2001b410 con 0x7fcb24093950 2023-10-03T10:09:25.234 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 >> v1:172.21.15.125:6816/118167 conn(0x7fcb0802bb60 legacy=0x7fcb0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 msgr2=0x7fcb24130830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcb20009130 tx=0x7fcb20017000).stop 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 shutdown_connections 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2412c240 0x7fcb24131210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb24093950 0x7fcb24130830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 --2- 172.21.15.125:0/1805647777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb24095c50 0x7fcb24130d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 >> 172.21.15.125:0/1805647777 conn(0x7fcb2409aa50 msgr2=0x7fcb24062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 shutdown_connections 2023-10-03T10:09:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.236+0000 7fcb2c7ed700 1 -- 172.21.15.125:0/1805647777 wait complete. 2023-10-03T10:09:25.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.1 2023-10-03T10:09:25.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2023-10-03T10:09:25.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.269+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3dec05f720 con 0x7f3dec068680 2023-10-03T10:09:25.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.269+0000 7f3dd2ffd700 1 -- 172.21.15.125:0/3313898648 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3de0029020 con 0x7f3dec068680 2023-10-03T10:09:25.270 INFO:teuthology.orchestra.run.smithi125.stdout:38654705667 2023-10-03T10:09:25.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 >> v1:172.21.15.125:6816/118167 conn(0x7f3dd802bb30 legacy=0x7f3dd802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 msgr2=0x7f3dec091ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:25.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3de0014000 tx=0x7f3de0017000).stop 2023-10-03T10:09:25.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 shutdown_connections 2023-10-03T10:09:25.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dec12dee0 0x7f3dec092390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec066e30 0x7f3dec0919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 --2- 172.21.15.125:0/3313898648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3dec068680 0x7f3dec091ea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 >> 172.21.15.125:0/3313898648 conn(0x7f3dec09a230 msgr2=0x7f3dec098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 shutdown_connections 2023-10-03T10:09:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:25.271+0000 7f3df19cd700 1 -- 172.21.15.125:0/3313898648 wait complete. 2023-10-03T10:09:25.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-10-03T10:09:26.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:26.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:26.250 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:26.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.357+0000 7facccff4700 1 Processor -- start 2023-10-03T10:09:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.357+0000 7facccff4700 1 -- start start 2023-10-03T10:09:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facccff4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 0x7facc80961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facccff4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facc80966b0 0x7facc8132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facccff4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc8091980 con 0x7facc8062b00 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facccff4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80973f0 con 0x7facc80966b0 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facccff4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8062ee0 con 0x7facc8095da0 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7facc8062b00 0x7facc8095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43640/0 (socket says 172.21.15.125:43640) 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc659c700 1 -- 172.21.15.125:0/2761050476 learned_addr learned my addr 172.21.15.125:0/2761050476 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc5d9b700 1 --2- 172.21.15.125:0/2761050476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 0x7facc80961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc6d9d700 1 --2- 172.21.15.125:0/2761050476 >> v2:172.21.15.125:3300/0 conn(0x7facc80966b0 0x7facc8132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc5d9b700 1 -- 172.21.15.125:0/2761050476 >> v2:172.21.15.125:3300/0 conn(0x7facc80966b0 msgr2=0x7facc8132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc5d9b700 1 --2- 172.21.15.125:0/2761050476 >> v2:172.21.15.125:3300/0 conn(0x7facc80966b0 0x7facc8132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc5d9b700 1 -- 172.21.15.125:0/2761050476 >> v1:172.21.15.125:6789/0 conn(0x7facc8062b00 legacy=0x7facc8095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.358+0000 7facc5d9b700 1 -- 172.21.15.125:0/2761050476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8092310 con 0x7facc8095da0 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.359+0000 7facc5d9b700 1 --2- 172.21.15.125:0/2761050476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 0x7facc80961c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7facbc009790 tx=0x7facbc009060).ready entity=mon.1 client_cookie=b578e45951cfde0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.359+0000 7facc559a700 1 -- 172.21.15.125:0/2761050476 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00f510 con 0x7facc8095da0 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.359+0000 7facc559a700 1 -- 172.21.15.125:0/2761050476 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00f670 con 0x7facc8095da0 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.359+0000 7facc559a700 1 -- 172.21.15.125:0/2761050476 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00f9f0 con 0x7facc8095da0 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 -- 172.21.15.125:0/2761050476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 msgr2=0x7facc80961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 --2- 172.21.15.125:0/2761050476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 0x7facc80961c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7facbc009790 tx=0x7facbc009060).stop 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 -- 172.21.15.125:0/2761050476 shutdown_connections 2023-10-03T10:09:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 --2- 172.21.15.125:0/2761050476 >> v2:172.21.15.125:3300/0 conn(0x7facc80966b0 0x7facc8132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 --2- 172.21.15.125:0/2761050476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8095da0 0x7facc80961c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 -- 172.21.15.125:0/2761050476 >> 172.21.15.125:0/2761050476 conn(0x7facc809aa50 msgr2=0x7facc809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 -- 172.21.15.125:0/2761050476 shutdown_connections 2023-10-03T10:09:26.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.360+0000 7facccff4700 1 -- 172.21.15.125:0/2761050476 wait complete. 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.361+0000 7facccff4700 1 Processor -- start 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.361+0000 7facccff4700 1 -- start start 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facc8095da0 0x7facc8115ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 0x7facc8115fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8118b70 con 0x7facc80966b0 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8099dd0 con 0x7facc8062b00 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facccff4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc8096da0 con 0x7facc8095da0 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facc659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facc659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40434/0 (socket says 172.21.15.125:40434) 2023-10-03T10:09:26.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facc659c700 1 -- 172.21.15.125:0/912776555 learned_addr learned my addr 172.21.15.125:0/912776555 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facc5d9b700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facc8095da0 0x7facc8115ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.362+0000 7facc6d9d700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 0x7facc8115fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 -- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facc8095da0 msgr2=0x7facc8115ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facc8095da0 0x7facc8115ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 -- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 msgr2=0x7facc8115fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 0x7facc8115fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 -- 172.21.15.125:0/912776555 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0092a0 con 0x7facc8062b00 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc6d9d700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 0x7facc8115fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facc659c700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7facb8007fd0 tx=0x7facb8007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb80072e0 con 0x7facc8062b00 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8007440 con 0x7facc8062b00 2023-10-03T10:09:26.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8117fc0 con 0x7facc8062b00 2023-10-03T10:09:26.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb80057a0 con 0x7facc8062b00 2023-10-03T10:09:26.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.363+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8117800 con 0x7facc8062b00 2023-10-03T10:09:26.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.364+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc81191d0 con 0x7facc8062b00 2023-10-03T10:09:26.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.364+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7facb8005bd0 con 0x7facc8062b00 2023-10-03T10:09:26.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.365+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7facb803a8b0 con 0x7facc8062b00 2023-10-03T10:09:26.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.372+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7facb801a2f0 con 0x7facc8062b00 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.394+0000 7f6bd708d700 1 Processor -- start 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.394+0000 7f6bd708d700 1 -- start start 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd708d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd0062b00 0x7f6bd0095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd708d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bd00966b0 0x7f6bd0132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd708d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd0091980 con 0x7f6bd0095b80 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd708d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd00973f0 con 0x7f6bd00966b0 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd708d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0062ee0 con 0x7f6bd0062b00 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bd00966b0 0x7f6bd0132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bd00966b0 0x7f6bd0132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41984/0 (socket says 172.21.15.125:41984) 2023-10-03T10:09:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 -- 172.21.15.125:0/2721063075 learned_addr learned my addr 172.21.15.125:0/2721063075 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd4e29700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd0062b00 0x7f6bd0095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 -- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd0062b00 msgr2=0x7f6bd0095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd0062b00 0x7f6bd0095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 -- 172.21.15.125:0/2721063075 >> v1:172.21.15.125:6789/0 conn(0x7f6bd0095b80 legacy=0x7f6bd0095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 -- 172.21.15.125:0/2721063075 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0092310 con 0x7f6bd00966b0 2023-10-03T10:09:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.395+0000 7f6bd562a700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd00966b0 0x7f6bd0132290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6bc8009f50 tx=0x7f6bc8009840).ready entity=mon.0 client_cookie=68f3cbfe17dda552 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.397+0000 7f6bcf7fe700 1 -- 172.21.15.125:0/2721063075 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800e070 con 0x7f6bd00966b0 2023-10-03T10:09:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.397+0000 7f6bcf7fe700 1 -- 172.21.15.125:0/2721063075 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc800ba70 con 0x7f6bd00966b0 2023-10-03T10:09:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.397+0000 7f6bcf7fe700 1 -- 172.21.15.125:0/2721063075 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800bdf0 con 0x7f6bd00966b0 2023-10-03T10:09:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f0d8e13b700 1 Processor -- start 2023-10-03T10:09:26.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 -- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd00966b0 msgr2=0x7f6bd0132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd00966b0 0x7f6bd0132290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6bc8009f50 tx=0x7f6bc8009840).stop 2023-10-03T10:09:26.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f0d8e13b700 1 -- start start 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 -- 172.21.15.125:0/2721063075 shutdown_connections 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd00966b0 0x7f6bd0132290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2721063075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd0062b00 0x7f6bd0095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 -- 172.21.15.125:0/2721063075 >> 172.21.15.125:0/2721063075 conn(0x7f6bd009aa50 msgr2=0x7f6bd009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 -- 172.21.15.125:0/2721063075 shutdown_connections 2023-10-03T10:09:26.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.398+0000 7f6bd708d700 1 -- 172.21.15.125:0/2721063075 wait complete. 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d8e13b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d88096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d8e13b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d880970e0 0x7f0d88068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d8e13b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d88092160 con 0x7f0d88096d00 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d8e13b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880933f0 con 0x7f0d880970e0 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d8e13b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88092420 con 0x7f0d8805f560 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d7effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0d88096d00 0x7f0d88067f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43660/0 (socket says 172.21.15.125:43660) 2023-10-03T10:09:26.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d7effd700 1 -- 172.21.15.125:0/3940647172 learned_addr learned my addr 172.21.15.125:0/3940647172 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:26.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f6bd708d700 1 Processor -- start 2023-10-03T10:09:26.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.399+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517820854 0 0) 0x7f0d88092160 con 0x7f0d88096d00 2023-10-03T10:09:26.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d740033f0 con 0x7f0d88096d00 2023-10-03T10:09:26.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 -- start start 2023-10-03T10:09:26.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176873459 0 0) 0x7f0d740033f0 con 0x7f0d88096d00 2023-10-03T10:09:26.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 msgr2=0x7f0d88096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d88096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 >> v2:172.21.15.125:3300/0 conn(0x7f0d880970e0 msgr2=0x7f0d88068650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3940647172 >> v2:172.21.15.125:3300/0 conn(0x7f0d880970e0 0x7f0d88068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88069bf0 con 0x7f0d88096d00 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2079740769 0 0) 0x7f0d70001470 con 0x7f0d88096d00 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 >> v1:172.21.15.125:6789/0 conn(0x7f0d88096d00 legacy=0x7f0d88067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d74003960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d74004020 0x7f0d74004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d74004ca0 0x7f0d74005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880933f0 con 0x7f0d74004ca0 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88092420 con 0x7f0d8805f560 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7400bbf0 con 0x7f0d74004020 2023-10-03T10:09:26.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d877fe700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d74003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d7effd700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d74004020 0x7f0d74004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 0x7f6bd011a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0095b80 0x7f6bd011a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd011aee0 con 0x7f6bd0095b80 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd011df70 con 0x7f6bd00966b0 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd708d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0096da0 con 0x7f6bd0062b00 2023-10-03T10:09:26.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd562a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd562a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40456/0 (socket says 172.21.15.125:40456) 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd562a700 1 -- 172.21.15.125:0/2596620422 learned_addr learned my addr 172.21.15.125:0/2596620422 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bd4e29700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 0x7f6bd011a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f6bcffff700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0095b80 0x7f6bd011a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d877fe700 1 -- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d74004020 msgr2=0x7f0d74004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.400+0000 7f0d877fe700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d74004020 0x7f0d74004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d877fe700 1 -- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d74004ca0 msgr2=0x7f0d74005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d877fe700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d74004ca0 0x7f0d74005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d877fe700 1 -- 172.21.15.125:0/3940647172 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740033f0 con 0x7f0d8805f560 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 -- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 msgr2=0x7f6bd011a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 -- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0095b80 msgr2=0x7f6bd011a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0095b80 0x7f6bd011a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 -- 172.21.15.125:0/2596620422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8009ae0 con 0x7f6bd0062b00 2023-10-03T10:09:26.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd562a700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:26.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d877fe700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d74003960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d78009870 tx=0x7f0d78006e50).ready entity=mon.1 client_cookie=519860658f612822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78011400 con 0x7f0d8805f560 2023-10-03T10:09:26.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78011560 con 0x7f0d8805f560 2023-10-03T10:09:26.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3940647172 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78011900 con 0x7f0d8805f560 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd4e29700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 0x7f6bd011a010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6bc400d890 tx=0x7f6bc4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011590 con 0x7f6bd0062b00 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40116f0 con 0x7f6bd0062b00 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011a70 con 0x7f6bd0062b00 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd011cdf0 con 0x7f6bd0062b00 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.401+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd011d160 con 0x7f6bd0062b00 2023-10-03T10:09:26.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 msgr2=0x7f0d74003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d8e13b700 1 --2- 172.21.15.125:0/3940647172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d74003960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0d78009870 tx=0x7f0d78006e50).stop 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d87fff700 1 -- 172.21.15.125:0/3940647172 reap_dead start 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3940647172 shutdown_connections 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3940647172 >> 172.21.15.125:0/3940647172 conn(0x7f0d8809a230 msgr2=0x7f0d8809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6bc4012420 con 0x7f6bd0062b00 2023-10-03T10:09:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.403+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd011d3c0 con 0x7f6bd0062b00 2023-10-03T10:09:26.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.402+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3940647172 shutdown_connections 2023-10-03T10:09:26.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.403+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6bc403a9d0 con 0x7f6bd0062b00 2023-10-03T10:09:26.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.403+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3940647172 wait complete. 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.404+0000 7f0d8e13b700 1 Processor -- start 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.404+0000 7f0d8e13b700 1 -- start start 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d88130570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d88130a60 0x7f0d8812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88130f60 con 0x7f0d88130a60 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8812e8b0 con 0x7f0d8805f560 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d8e13b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8812eea0 con 0x7f0d8812df60 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55286/0 (socket says 172.21.15.125:55286) 2023-10-03T10:09:26.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 -- 172.21.15.125:0/3678954264 learned_addr learned my addr 172.21.15.125:0/3678954264 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 -- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 msgr2=0x7f0d88130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d88130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 -- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d88130a60 msgr2=0x7f0d8812da70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d88130a60 0x7f0d8812da70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 -- 172.21.15.125:0/3678954264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8812f5f0 con 0x7f0d8812df60 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.405+0000 7f0d87fff700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0d880974c0 tx=0x7f0d8000a1a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80005dc0 con 0x7f0d8812df60 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80007110 con 0x7f0d8812df60 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800074d0 con 0x7f0d8812df60 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d880672a0 con 0x7f0d8812df60 2023-10-03T10:09:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d88131500 con 0x7f0d8812df60 2023-10-03T10:09:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.408+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6bc40108d0 con 0x7f6bd0062b00 2023-10-03T10:09:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.409+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d881320e0 con 0x7f0d8812df60 2023-10-03T10:09:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.412+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0d800078c0 con 0x7f0d8812df60 2023-10-03T10:09:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.412+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0d8003afd0 con 0x7f0d8812df60 2023-10-03T10:09:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.413+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0d800135f0 con 0x7f0d8812df60 2023-10-03T10:09:26.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.435+0000 7f5e094ef700 1 Processor -- start 2023-10-03T10:09:26.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.435+0000 7f5e094ef700 1 -- start start 2023-10-03T10:09:26.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04062b00 0x7f5e04128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 0x7f5e04094500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04062ee0 con 0x7f5e04094080 2023-10-03T10:09:26.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040949f0 con 0x7f5e04062b00 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e094ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040969d0 con 0x7f5e041291f0 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55288/0 (socket says 172.21.15.125:55288) 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 -- 172.21.15.125:0/771041990 learned_addr learned my addr 172.21.15.125:0/771041990 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e02ffd700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04062b00 0x7f5e04128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e037fe700 1 --2- 172.21.15.125:0/771041990 >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 0x7f5e04094500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 -- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04062b00 msgr2=0x7f5e04128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04062b00 0x7f5e04128d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 -- 172.21.15.125:0/771041990 >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 msgr2=0x7f5e04094500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 --2- 172.21.15.125:0/771041990 >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 0x7f5e04094500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e027fc700 1 -- 172.21.15.125:0/771041990 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040972e0 con 0x7f5e041291f0 2023-10-03T10:09:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.436+0000 7f5e037fe700 1 --2- 172.21.15.125:0/771041990 >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 0x7f5e04094500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e027fc700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5df8009860 tx=0x7f5df80090f0).ready entity=mon.2 client_cookie=fd78484d51c86509 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e01ffb700 1 -- 172.21.15.125:0/771041990 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800b580 con 0x7f5e041291f0 2023-10-03T10:09:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e01ffb700 1 -- 172.21.15.125:0/771041990 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df800b6e0 con 0x7f5e041291f0 2023-10-03T10:09:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e01ffb700 1 -- 172.21.15.125:0/771041990 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800ba60 con 0x7f5e041291f0 2023-10-03T10:09:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e094ef700 1 -- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 msgr2=0x7f5e04093b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.437+0000 7f5e094ef700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5df8009860 tx=0x7f5df80090f0).stop 2023-10-03T10:09:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 -- 172.21.15.125:0/771041990 shutdown_connections 2023-10-03T10:09:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04062b00 0x7f5e04128d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 --2- 172.21.15.125:0/771041990 >> v2:172.21.15.125:3300/0 conn(0x7f5e04094080 0x7f5e04094500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 --2- 172.21.15.125:0/771041990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e041291f0 0x7f5e04093b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 -- 172.21.15.125:0/771041990 >> 172.21.15.125:0/771041990 conn(0x7f5e0409aa50 msgr2=0x7f5e0409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 -- 172.21.15.125:0/771041990 shutdown_connections 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.438+0000 7f5e094ef700 1 -- 172.21.15.125:0/771041990 wait complete. 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 Processor -- start 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 -- start start 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e04062b00 0x7f5e04068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04094080 0x7f5e04068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e04069960 con 0x7f5e041291f0 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0406a7e0 con 0x7f5e04094080 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e094ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e04069ed0 con 0x7f5e04062b00 2023-10-03T10:09:26.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42012/0 (socket says 172.21.15.125:42012) 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e037fe700 1 -- 172.21.15.125:0/1554340870 learned_addr learned my addr 172.21.15.125:0/1554340870 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.439+0000 7f5e027fc700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04094080 0x7f5e04068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 -- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e04062b00 msgr2=0x7f5e04068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e04062b00 0x7f5e04068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 -- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04094080 msgr2=0x7f5e04068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04094080 0x7f5e04068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 -- 172.21.15.125:0/1554340870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8009370 con 0x7f5e041291f0 2023-10-03T10:09:26.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e037fe700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5dfc00d1b0 tx=0x7f5dfc009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00dda0 con 0x7f5e041291f0 2023-10-03T10:09:26.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00f040 con 0x7f5e041291f0 2023-10-03T10:09:26.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e04097da0 con 0x7f5e041291f0 2023-10-03T10:09:26.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc013600 con 0x7f5e041291f0 2023-10-03T10:09:26.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.440+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0411ab90 con 0x7f5e041291f0 2023-10-03T10:09:26.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.441+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5dfc0139f0 con 0x7f5e041291f0 2023-10-03T10:09:26.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.442+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e04093bb0 con 0x7f5e041291f0 2023-10-03T10:09:26.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.442+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5dfc03b700 con 0x7f5e041291f0 2023-10-03T10:09:26.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.450+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5dfc01b9b0 con 0x7f5e041291f0 2023-10-03T10:09:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.549+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facc805a260 con 0x7facc8062b00 2023-10-03T10:09:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.549+0000 7facb67fc700 1 -- 172.21.15.125:0/912776555 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facb8018070 con 0x7facc8062b00 2023-10-03T10:09:26.550 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 >> v1:172.21.15.125:6816/118167 conn(0x7faca802bb60 legacy=0x7faca802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 msgr2=0x7facc8119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7facb8007fd0 tx=0x7facb8007df0).stop 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 shutdown_connections 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facc80966b0 0x7facc8115fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facc8062b00 0x7facc8119a50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 --2- 172.21.15.125:0/912776555 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facc8095da0 0x7facc8115ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 >> 172.21.15.125:0/912776555 conn(0x7facc809aa50 msgr2=0x7facc81300f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 shutdown_connections 2023-10-03T10:09:26.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.551+0000 7facccff4700 1 -- 172.21.15.125:0/912776555 wait complete. 2023-10-03T10:09:26.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-10-03T10:09:26.564 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:26.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.579+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bd0046c20 con 0x7f6bd0062b00 2023-10-03T10:09:26.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.579+0000 7f6bccff9700 1 -- 172.21.15.125:0/2596620422 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bc4019310 con 0x7f6bd0062b00 2023-10-03T10:09:26.580 INFO:teuthology.orchestra.run.smithi125.stdout:38654705670 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 >> v1:172.21.15.125:6816/118167 conn(0x7f6bb402bb30 legacy=0x7f6bb402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 msgr2=0x7f6bd011a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 0x7f6bd011a010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6bc400d890 tx=0x7f6bc4008040).stop 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 shutdown_connections 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00966b0 0x7f6bd011a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd0062b00 0x7f6bd011a010 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 --2- 172.21.15.125:0/2596620422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0095b80 0x7f6bd011a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 >> 172.21.15.125:0/2596620422 conn(0x7f6bd009aa50 msgr2=0x7f6bd0097540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 shutdown_connections 2023-10-03T10:09:26.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.581+0000 7f6bd708d700 1 -- 172.21.15.125:0/2596620422 wait complete. 2023-10-03T10:09:26.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.587+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d8805a260 con 0x7f0d8812df60 2023-10-03T10:09:26.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.587+0000 7f0d7ffff700 1 -- 172.21.15.125:0/3678954264 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d8001a300 con 0x7f0d8812df60 2023-10-03T10:09:26.588 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:26.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 >> v1:172.21.15.125:6816/118167 conn(0x7f0d6802bbb0 legacy=0x7f0d6802e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 msgr2=0x7f0d8812e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0d880974c0 tx=0x7f0d8000a1a0).stop 2023-10-03T10:09:26.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 shutdown_connections 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d8812df60 0x7f0d8812e3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d8805f560 0x7f0d88130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 --2- 172.21.15.125:0/3678954264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d88130a60 0x7f0d8812da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 >> 172.21.15.125:0/3678954264 conn(0x7f0d8809a230 msgr2=0x7f0d880960d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 shutdown_connections 2023-10-03T10:09:26.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.589+0000 7f0d8e13b700 1 -- 172.21.15.125:0/3678954264 wait complete. 2023-10-03T10:09:26.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-10-03T10:09:26.593 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:26.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2023-10-03T10:09:26.602 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.619+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e0405a260 con 0x7f5e041291f0 2023-10-03T10:09:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.620+0000 7f5deaffd700 1 -- 172.21.15.125:0/1554340870 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dfc01b360 con 0x7f5e041291f0 2023-10-03T10:09:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:38654705669 2023-10-03T10:09:26.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.621+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 >> v1:172.21.15.125:6816/118167 conn(0x7f5df002bb60 legacy=0x7f5df002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.621+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 msgr2=0x7f5e04069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.621+0000 7f5e094ef700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5dfc00d1b0 tx=0x7f5dfc009a50).stop 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 shutdown_connections 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e041291f0 0x7f5e04069470 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e04062b00 0x7f5e04068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 --2- 172.21.15.125:0/1554340870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e04094080 0x7f5e04068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 >> 172.21.15.125:0/1554340870 conn(0x7f5e0409aa50 msgr2=0x7f5e041276e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 shutdown_connections 2023-10-03T10:09:26.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.622+0000 7f5e094ef700 1 -- 172.21.15.125:0/1554340870 wait complete. 2023-10-03T10:09:26.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-10-03T10:09:26.633 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:26.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:09:26.634 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:26.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.788+0000 7f8b438b6700 1 Processor -- start 2023-10-03T10:09:26.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.788+0000 7f8b438b6700 1 -- start start 2023-10-03T10:09:26.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c094ba0 con 0x7f8b3c093950 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c092e90 con 0x7f8b3c095c50 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b438b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c096b60 con 0x7f8b3c12c240 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b40e51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41652700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b40e51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40504/0 (socket says 172.21.15.125:40504) 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41652700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42014/0 (socket says 172.21.15.125:42014) 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b40e51700 1 -- 172.21.15.125:0/3660275505 learned_addr learned my addr 172.21.15.125:0/3660275505 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55320/0 (socket says 172.21.15.125:55320) 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 -- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 msgr2=0x7f8b3c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 -- 172.21.15.125:0/3660275505 >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 msgr2=0x7f8b3c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 --2- 172.21.15.125:0/3660275505 >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 -- 172.21.15.125:0/3660275505 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c093150 con 0x7f8b3c12c240 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b40e51700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41652700 1 --2- 172.21.15.125:0/3660275505 >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.789+0000 7f8b41e53700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8b34009e60 tx=0x7f8b34009780).ready entity=mon.2 client_cookie=56a836aea09c796d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b33fff700 1 -- 172.21.15.125:0/3660275505 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400e070 con 0x7f8b3c12c240 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b33fff700 1 -- 172.21.15.125:0/3660275505 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3400bab0 con 0x7f8b3c12c240 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b33fff700 1 -- 172.21.15.125:0/3660275505 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400be30 con 0x7f8b3c12c240 2023-10-03T10:09:26.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 -- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 msgr2=0x7f8b3c12e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8b34009e60 tx=0x7f8b34009780).stop 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 -- 172.21.15.125:0/3660275505 shutdown_connections 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c12c240 0x7f8b3c12e630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 --2- 172.21.15.125:0/3660275505 >> v2:172.21.15.125:3300/0 conn(0x7f8b3c093950 0x7f8b3c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 --2- 172.21.15.125:0/3660275505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c095c50 0x7f8b3c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 -- 172.21.15.125:0/3660275505 >> 172.21.15.125:0/3660275505 conn(0x7f8b3c09aa50 msgr2=0x7f8b3c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 -- 172.21.15.125:0/3660275505 shutdown_connections 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.790+0000 7f8b438b6700 1 -- 172.21.15.125:0/3660275505 wait complete. 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.791+0000 7f8b438b6700 1 Processor -- start 2023-10-03T10:09:26.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.791+0000 7f8b438b6700 1 -- start start 2023-10-03T10:09:26.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 0x7f8b3c116f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 0x7f8b3c117430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1190c0 con 0x7f8b3c093950 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c12bb60 con 0x7f8b3c12c240 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c092410 con 0x7f8b3c095c50 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41e53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 0x7f8b3c117430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b40e51700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 0x7f8b3c116f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42030/0 (socket says 172.21.15.125:42030) 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 -- 172.21.15.125:0/4174779348 learned_addr learned my addr 172.21.15.125:0/4174779348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 -- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 msgr2=0x7f8b3c116f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 0x7f8b3c116f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 -- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 msgr2=0x7f8b3c117430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 0x7f8b3c117430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 -- 172.21.15.125:0/4174779348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0092a0 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41e53700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 0x7f8b3c117430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b40e51700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 0x7f8b3c116f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b41652700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8b2c00ea50 tx=0x7f8b2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00ee90 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c00c850 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38009370 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00cbd0 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.792+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b34009a20 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.793+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8b2c01b400 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.793+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8b2c03b4e0 con 0x7f8b3c093950 2023-10-03T10:09:26.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.793+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c11a450 con 0x7f8b3c093950 2023-10-03T10:09:26.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.798+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8b2c0123f0 con 0x7f8b3c093950 2023-10-03T10:09:26.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.951+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b3c05a260 con 0x7f8b2002bb60 2023-10-03T10:09:26.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.957+0000 7f8b317fa700 1 -- 172.21.15.125:0/4174779348 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249933 (unknown 2965378022 0 1101446894) 0x7f8b3c05a260 con 0x7f8b2002bb60 2023-10-03T10:09:26.961 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:26.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.959+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 >> v1:172.21.15.125:6816/118167 conn(0x7f8b2002bb60 legacy=0x7f8b2002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.959+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 msgr2=0x7f8b3c116a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:26.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.959+0000 7f8b438b6700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8b2c00ea50 tx=0x7f8b2c009060).stop 2023-10-03T10:09:26.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.959+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 shutdown_connections 2023-10-03T10:09:26.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3c12c240 0x7f8b3c117430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c093950 0x7f8b3c116a50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 --2- 172.21.15.125:0/4174779348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b3c095c50 0x7f8b3c116f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 >> 172.21.15.125:0/4174779348 conn(0x7f8b3c09aa50 msgr2=0x7f8b3c0692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 shutdown_connections 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:26.960+0000 7f8b438b6700 1 -- 172.21.15.125:0/4174779348 wait complete. 2023-10-03T10:09:26.964 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:26.972 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-03T10:09:25.143720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001252"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715818+0000","last_change":"2023-10-03T10:09:14.714603+0000","last_active":"2023-10-03T10:09:14.715818+0000","last_peered":"2023-10-03T10:09:14.715818+0000","last_clean":"2023-10-03T10:09:14.715818+0000","last_became_active":"2023-10-03T10:09:14.714337+0000","last_became_peered":"2023-10-03T10:09:14.714337+0000","last_unstale":"2023-10-03T10:09:14.715818+0000","last_undegraded":"2023-10-03T10:09:14.715818+0000","last_fullsized":"2023-10-03T10:09:14.715818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709275+0000","last_change":"2023-10-03T10:09:14.705544+0000","last_active":"2023-10-03T10:09:14.709275+0000","last_peered":"2023-10-03T10:09:14.709275+0000","last_clean":"2023-10-03T10:09:14.709275+0000","last_became_active":"2023-10-03T10:09:14.705240+0000","last_became_peered":"2023-10-03T10:09:14.705240+0000","last_unstale":"2023-10-03T10:09:14.709275+0000","last_undegraded":"2023-10-03T10:09:14.709275+0000","last_fullsized":"2023-10-03T10:09:14.709275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721157+0000","last_change":"2023-10-03T10:09:14.715211+0000","last_active":"2023-10-03T10:09:14.721157+0000","last_peered":"2023-10-03T10:09:14.721157+0000","last_clean":"2023-10-03T10:09:14.721157+0000","last_became_active":"2023-10-03T10:09:14.714965+0000","last_became_peered":"2023-10-03T10:09:14.714965+0000","last_unstale":"2023-10-03T10:09:14.721157+0000","last_undegraded":"2023-10-03T10:09:14.721157+0000","last_fullsized":"2023-10-03T10:09:14.721157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720890+0000","last_change":"2023-10-03T10:09:14.710747+0000","last_active":"2023-10-03T10:09:14.720890+0000","last_peered":"2023-10-03T10:09:14.720890+0000","last_clean":"2023-10-03T10:09:14.720890+0000","last_became_active":"2023-10-03T10:09:14.710471+0000","last_became_peered":"2023-10-03T10:09:14.710471+0000","last_unstale":"2023-10-03T10:09:14.720890+0000","last_undegraded":"2023-10-03T10:09:14.720890+0000","last_fullsized":"2023-10-03T10:09:14.720890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722101+0000","last_change":"2023-10-03T10:09:14.719560+0000","last_active":"2023-10-03T10:09:14.722101+0000","last_peered":"2023-10-03T10:09:14.722101+0000","last_clean":"2023-10-03T10:09:14.722101+0000","last_became_active":"2023-10-03T10:09:14.719359+0000","last_became_peered":"2023-10-03T10:09:14.719359+0000","last_unstale":"2023-10-03T10:09:14.722101+0000","last_undegraded":"2023-10-03T10:09:14.722101+0000","last_fullsized":"2023-10-03T10:09:14.722101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722554+0000","last_change":"2023-10-03T10:09:14.719561+0000","last_active":"2023-10-03T10:09:14.722554+0000","last_peered":"2023-10-03T10:09:14.722554+0000","last_clean":"2023-10-03T10:09:14.722554+0000","last_became_active":"2023-10-03T10:09:14.719264+0000","last_became_peered":"2023-10-03T10:09:14.719264+0000","last_unstale":"2023-10-03T10:09:14.722554+0000","last_undegraded":"2023-10-03T10:09:14.722554+0000","last_fullsized":"2023-10-03T10:09:14.722554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729401+0000","last_change":"2023-10-03T10:09:14.723496+0000","last_active":"2023-10-03T10:09:14.729401+0000","last_peered":"2023-10-03T10:09:14.729401+0000","last_clean":"2023-10-03T10:09:14.729401+0000","last_became_active":"2023-10-03T10:09:14.723260+0000","last_became_peered":"2023-10-03T10:09:14.723260+0000","last_unstale":"2023-10-03T10:09:14.729401+0000","last_undegraded":"2023-10-03T10:09:14.729401+0000","last_fullsized":"2023-10-03T10:09:14.729401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730975+0000","last_change":"2023-10-03T10:09:14.728885+0000","last_active":"2023-10-03T10:09:14.730975+0000","last_peered":"2023-10-03T10:09:14.730975+0000","last_clean":"2023-10-03T10:09:14.730975+0000","last_became_active":"2023-10-03T10:09:14.720610+0000","last_became_peered":"2023-10-03T10:09:14.720610+0000","last_unstale":"2023-10-03T10:09:14.730975+0000","last_undegraded":"2023-10-03T10:09:14.730975+0000","last_fullsized":"2023-10-03T10:09:14.730975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721091+0000","last_change":"2023-10-03T10:09:14.713481+0000","last_active":"2023-10-03T10:09:14.721091+0000","last_peered":"2023-10-03T10:09:14.721091+0000","last_clean":"2023-10-03T10:09:14.721091+0000","last_became_active":"2023-10-03T10:09:14.711120+0000","last_became_peered":"2023-10-03T10:09:14.711120+0000","last_unstale":"2023-10-03T10:09:14.721091+0000","last_undegraded":"2023-10-03T10:09:14.721091+0000","last_fullsized":"2023-10-03T10:09:14.721091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730834+0000","last_change":"2023-10-03T10:09:14.726303+0000","last_active":"2023-10-03T10:09:14.730834+0000","last_peered":"2023-10-03T10:09:14.730834+0000","last_clean":"2023-10-03T10:09:14.730834+0000","last_became_active":"2023-10-03T10:09:14.726049+0000","last_became_peered":"2023-10-03T10:09:14.726049+0000","last_unstale":"2023-10-03T10:09:14.730834+0000","last_undegraded":"2023-10-03T10:09:14.730834+0000","last_fullsized":"2023-10-03T10:09:14.730834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730903+0000","last_change":"2023-10-03T10:09:14.726200+0000","last_active":"2023-10-03T10:09:14.730903+0000","last_peered":"2023-10-03T10:09:14.730903+0000","last_clean":"2023-10-03T10:09:14.730903+0000","last_became_active":"2023-10-03T10:09:14.725948+0000","last_became_peered":"2023-10-03T10:09:14.725948+0000","last_unstale":"2023-10-03T10:09:14.730903+0000","last_undegraded":"2023-10-03T10:09:14.730903+0000","last_fullsized":"2023-10-03T10:09:14.730903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720401+0000","last_change":"2023-10-03T10:09:14.714843+0000","last_active":"2023-10-03T10:09:14.720401+0000","last_peered":"2023-10-03T10:09:14.720401+0000","last_clean":"2023-10-03T10:09:14.720401+0000","last_became_active":"2023-10-03T10:09:14.714579+0000","last_became_peered":"2023-10-03T10:09:14.714579+0000","last_unstale":"2023-10-03T10:09:14.720401+0000","last_undegraded":"2023-10-03T10:09:14.720401+0000","last_fullsized":"2023-10-03T10:09:14.720401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730712+0000","last_change":"2023-10-03T10:09:14.724414+0000","last_active":"2023-10-03T10:09:14.730712+0000","last_peered":"2023-10-03T10:09:14.730712+0000","last_clean":"2023-10-03T10:09:14.730712+0000","last_became_active":"2023-10-03T10:09:14.723833+0000","last_became_peered":"2023-10-03T10:09:14.723833+0000","last_unstale":"2023-10-03T10:09:14.730712+0000","last_undegraded":"2023-10-03T10:09:14.730712+0000","last_fullsized":"2023-10-03T10:09:14.730712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710054+0000","last_change":"2023-10-03T10:09:14.708491+0000","last_active":"2023-10-03T10:09:14.710054+0000","last_peered":"2023-10-03T10:09:14.710054+0000","last_clean":"2023-10-03T10:09:14.710054+0000","last_became_active":"2023-10-03T10:09:14.705272+0000","last_became_peered":"2023-10-03T10:09:14.705272+0000","last_unstale":"2023-10-03T10:09:14.710054+0000","last_undegraded":"2023-10-03T10:09:14.710054+0000","last_fullsized":"2023-10-03T10:09:14.710054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721043+0000","last_change":"2023-10-03T10:09:14.713611+0000","last_active":"2023-10-03T10:09:14.721043+0000","last_peered":"2023-10-03T10:09:14.721043+0000","last_clean":"2023-10-03T10:09:14.721043+0000","last_became_active":"2023-10-03T10:09:14.713350+0000","last_became_peered":"2023-10-03T10:09:14.713350+0000","last_unstale":"2023-10-03T10:09:14.721043+0000","last_undegraded":"2023-10-03T10:09:14.721043+0000","last_fullsized":"2023-10-03T10:09:14.721043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719062+0000","last_change":"2023-10-03T10:09:14.717325+0000","last_active":"2023-10-03T10:09:14.719062+0000","last_peered":"2023-10-03T10:09:14.719062+0000","last_clean":"2023-10-03T10:09:14.719062+0000","last_became_active":"2023-10-03T10:09:14.717060+0000","last_became_peered":"2023-10-03T10:09:14.717060+0000","last_unstale":"2023-10-03T10:09:14.719062+0000","last_undegraded":"2023-10-03T10:09:14.719062+0000","last_fullsized":"2023-10-03T10:09:14.719062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721108+0000","last_change":"2023-10-03T10:09:14.713656+0000","last_active":"2023-10-03T10:09:14.721108+0000","last_peered":"2023-10-03T10:09:14.721108+0000","last_clean":"2023-10-03T10:09:14.721108+0000","last_became_active":"2023-10-03T10:09:14.711482+0000","last_became_peered":"2023-10-03T10:09:14.711482+0000","last_unstale":"2023-10-03T10:09:14.721108+0000","last_undegraded":"2023-10-03T10:09:14.721108+0000","last_fullsized":"2023-10-03T10:09:14.721108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.717202+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.716379+0000","last_became_peered":"2023-10-03T10:09:14.716379+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.728377+0000","last_change":"2023-10-03T10:09:14.723512+0000","last_active":"2023-10-03T10:09:14.728377+0000","last_peered":"2023-10-03T10:09:14.728377+0000","last_clean":"2023-10-03T10:09:14.728377+0000","last_became_active":"2023-10-03T10:09:14.723235+0000","last_became_peered":"2023-10-03T10:09:14.723235+0000","last_unstale":"2023-10-03T10:09:14.728377+0000","last_undegraded":"2023-10-03T10:09:14.728377+0000","last_fullsized":"2023-10-03T10:09:14.728377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727701+0000","last_change":"2023-10-03T10:09:14.718233+0000","last_active":"2023-10-03T10:09:14.727701+0000","last_peered":"2023-10-03T10:09:14.727701+0000","last_clean":"2023-10-03T10:09:14.727701+0000","last_became_active":"2023-10-03T10:09:14.717964+0000","last_became_peered":"2023-10-03T10:09:14.717964+0000","last_unstale":"2023-10-03T10:09:14.727701+0000","last_undegraded":"2023-10-03T10:09:14.727701+0000","last_fullsized":"2023-10-03T10:09:14.727701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727625+0000","last_change":"2023-10-03T10:09:14.721092+0000","last_active":"2023-10-03T10:09:14.727625+0000","last_peered":"2023-10-03T10:09:14.727625+0000","last_clean":"2023-10-03T10:09:14.727625+0000","last_became_active":"2023-10-03T10:09:14.720802+0000","last_became_peered":"2023-10-03T10:09:14.720802+0000","last_unstale":"2023-10-03T10:09:14.727625+0000","last_undegraded":"2023-10-03T10:09:14.727625+0000","last_fullsized":"2023-10-03T10:09:14.727625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721034+0000","last_change":"2023-10-03T10:09:14.712170+0000","last_active":"2023-10-03T10:09:14.721034+0000","last_peered":"2023-10-03T10:09:14.721034+0000","last_clean":"2023-10-03T10:09:14.721034+0000","last_became_active":"2023-10-03T10:09:14.711964+0000","last_became_peered":"2023-10-03T10:09:14.711964+0000","last_unstale":"2023-10-03T10:09:14.721034+0000","last_undegraded":"2023-10-03T10:09:14.721034+0000","last_fullsized":"2023-10-03T10:09:14.721034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719896+0000","last_change":"2023-10-03T10:09:14.717587+0000","last_active":"2023-10-03T10:09:14.719896+0000","last_peered":"2023-10-03T10:09:14.719896+0000","last_clean":"2023-10-03T10:09:14.719896+0000","last_became_active":"2023-10-03T10:09:14.717339+0000","last_became_peered":"2023-10-03T10:09:14.717339+0000","last_unstale":"2023-10-03T10:09:14.719896+0000","last_undegraded":"2023-10-03T10:09:14.719896+0000","last_fullsized":"2023-10-03T10:09:14.719896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730956+0000","last_change":"2023-10-03T10:09:14.728847+0000","last_active":"2023-10-03T10:09:14.730956+0000","last_peered":"2023-10-03T10:09:14.730956+0000","last_clean":"2023-10-03T10:09:14.730956+0000","last_became_active":"2023-10-03T10:09:14.725404+0000","last_became_peered":"2023-10-03T10:09:14.725404+0000","last_unstale":"2023-10-03T10:09:14.730956+0000","last_undegraded":"2023-10-03T10:09:14.730956+0000","last_fullsized":"2023-10-03T10:09:14.730956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727848+0000","last_change":"2023-10-03T10:09:14.718621+0000","last_active":"2023-10-03T10:09:14.727848+0000","last_peered":"2023-10-03T10:09:14.727848+0000","last_clean":"2023-10-03T10:09:14.727848+0000","last_became_active":"2023-10-03T10:09:14.718361+0000","last_became_peered":"2023-10-03T10:09:14.718361+0000","last_unstale":"2023-10-03T10:09:14.727848+0000","last_undegraded":"2023-10-03T10:09:14.727848+0000","last_fullsized":"2023-10-03T10:09:14.727848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710082+0000","last_change":"2023-10-03T10:09:14.707751+0000","last_active":"2023-10-03T10:09:14.710082+0000","last_peered":"2023-10-03T10:09:14.710082+0000","last_clean":"2023-10-03T10:09:14.710082+0000","last_became_active":"2023-10-03T10:09:14.707489+0000","last_became_peered":"2023-10-03T10:09:14.707489+0000","last_unstale":"2023-10-03T10:09:14.710082+0000","last_undegraded":"2023-10-03T10:09:14.710082+0000","last_fullsized":"2023-10-03T10:09:14.710082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731804+0000","last_change":"2023-10-03T10:09:14.724017+0000","last_active":"2023-10-03T10:09:14.731804+0000","last_peered":"2023-10-03T10:09:14.731804+0000","last_clean":"2023-10-03T10:09:14.731804+0000","last_became_active":"2023-10-03T10:09:14.723540+0000","last_became_peered":"2023-10-03T10:09:14.723540+0000","last_unstale":"2023-10-03T10:09:14.731804+0000","last_undegraded":"2023-10-03T10:09:14.731804+0000","last_fullsized":"2023-10-03T10:09:14.731804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710268+0000","last_change":"2023-10-03T10:09:14.354052+0000","last_active":"2023-10-03T10:09:14.710268+0000","last_peered":"2023-10-03T10:09:14.710268+0000","last_clean":"2023-10-03T10:09:14.710268+0000","last_became_active":"2023-10-03T10:09:14.353765+0000","last_became_peered":"2023-10-03T10:09:14.353765+0000","last_unstale":"2023-10-03T10:09:14.710268+0000","last_undegraded":"2023-10-03T10:09:14.710268+0000","last_fullsized":"2023-10-03T10:09:14.710268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734524+0000","last_change":"2023-10-03T10:09:14.731372+0000","last_active":"2023-10-03T10:09:14.734524+0000","last_peered":"2023-10-03T10:09:14.734524+0000","last_clean":"2023-10-03T10:09:14.734524+0000","last_became_active":"2023-10-03T10:09:14.730476+0000","last_became_peered":"2023-10-03T10:09:14.730476+0000","last_unstale":"2023-10-03T10:09:14.734524+0000","last_undegraded":"2023-10-03T10:09:14.734524+0000","last_fullsized":"2023-10-03T10:09:14.734524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699867+0000","last_change":"2023-10-03T10:09:14.340525+0000","last_active":"2023-10-03T10:09:14.699867+0000","last_peered":"2023-10-03T10:09:14.699867+0000","last_clean":"2023-10-03T10:09:14.699867+0000","last_became_active":"2023-10-03T10:09:14.340215+0000","last_became_peered":"2023-10-03T10:09:14.340215+0000","last_unstale":"2023-10-03T10:09:14.699867+0000","last_undegraded":"2023-10-03T10:09:14.699867+0000","last_fullsized":"2023-10-03T10:09:14.699867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721514+0000","last_change":"2023-10-03T10:09:14.717045+0000","last_active":"2023-10-03T10:09:14.721514+0000","last_peered":"2023-10-03T10:09:14.721514+0000","last_clean":"2023-10-03T10:09:14.721514+0000","last_became_active":"2023-10-03T10:09:14.716120+0000","last_became_peered":"2023-10-03T10:09:14.716120+0000","last_unstale":"2023-10-03T10:09:14.721514+0000","last_undegraded":"2023-10-03T10:09:14.721514+0000","last_fullsized":"2023-10-03T10:09:14.721514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.704177+0000","last_change":"2023-10-03T10:09:14.345802+0000","last_active":"2023-10-03T10:09:14.704177+0000","last_peered":"2023-10-03T10:09:14.704177+0000","last_clean":"2023-10-03T10:09:14.704177+0000","last_became_active":"2023-10-03T10:09:14.345529+0000","last_became_peered":"2023-10-03T10:09:14.345529+0000","last_unstale":"2023-10-03T10:09:14.704177+0000","last_undegraded":"2023-10-03T10:09:14.704177+0000","last_fullsized":"2023-10-03T10:09:14.704177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734388+0000","last_change":"2023-10-03T10:09:14.729797+0000","last_active":"2023-10-03T10:09:14.734388+0000","last_peered":"2023-10-03T10:09:14.734388+0000","last_clean":"2023-10-03T10:09:14.734388+0000","last_became_active":"2023-10-03T10:09:14.729212+0000","last_became_peered":"2023-10-03T10:09:14.729212+0000","last_unstale":"2023-10-03T10:09:14.734388+0000","last_undegraded":"2023-10-03T10:09:14.734388+0000","last_fullsized":"2023-10-03T10:09:14.734388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.692378+0000","last_change":"2023-10-03T10:09:14.343788+0000","last_active":"2023-10-03T10:09:14.692378+0000","last_peered":"2023-10-03T10:09:14.692378+0000","last_clean":"2023-10-03T10:09:14.692378+0000","last_became_active":"2023-10-03T10:09:14.343495+0000","last_became_peered":"2023-10-03T10:09:14.343495+0000","last_unstale":"2023-10-03T10:09:14.692378+0000","last_undegraded":"2023-10-03T10:09:14.692378+0000","last_fullsized":"2023-10-03T10:09:14.692378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734891+0000","last_change":"2023-10-03T10:09:14.734087+0000","last_active":"2023-10-03T10:09:14.734891+0000","last_peered":"2023-10-03T10:09:14.734891+0000","last_clean":"2023-10-03T10:09:14.734891+0000","last_became_active":"2023-10-03T10:09:14.733689+0000","last_became_peered":"2023-10-03T10:09:14.733689+0000","last_unstale":"2023-10-03T10:09:14.734891+0000","last_undegraded":"2023-10-03T10:09:14.734891+0000","last_fullsized":"2023-10-03T10:09:14.734891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695756+0000","last_change":"2023-10-03T10:09:14.339768+0000","last_active":"2023-10-03T10:09:14.695756+0000","last_peered":"2023-10-03T10:09:14.695756+0000","last_clean":"2023-10-03T10:09:14.695756+0000","last_became_active":"2023-10-03T10:09:14.339501+0000","last_became_peered":"2023-10-03T10:09:14.339501+0000","last_unstale":"2023-10-03T10:09:14.695756+0000","last_undegraded":"2023-10-03T10:09:14.695756+0000","last_fullsized":"2023-10-03T10:09:14.695756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729384+0000","last_change":"2023-10-03T10:09:14.723237+0000","last_active":"2023-10-03T10:09:14.729384+0000","last_peered":"2023-10-03T10:09:14.729384+0000","last_clean":"2023-10-03T10:09:14.729384+0000","last_became_active":"2023-10-03T10:09:14.722881+0000","last_became_peered":"2023-10-03T10:09:14.722881+0000","last_unstale":"2023-10-03T10:09:14.729384+0000","last_undegraded":"2023-10-03T10:09:14.729384+0000","last_fullsized":"2023-10-03T10:09:14.729384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715565+0000","last_change":"2023-10-03T10:09:14.339824+0000","last_active":"2023-10-03T10:09:14.715565+0000","last_peered":"2023-10-03T10:09:14.715565+0000","last_clean":"2023-10-03T10:09:14.715565+0000","last_became_active":"2023-10-03T10:09:14.339560+0000","last_became_peered":"2023-10-03T10:09:14.339560+0000","last_unstale":"2023-10-03T10:09:14.715565+0000","last_undegraded":"2023-10-03T10:09:14.715565+0000","last_fullsized":"2023-10-03T10:09:14.715565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727816+0000","last_change":"2023-10-03T10:09:14.721025+0000","last_active":"2023-10-03T10:09:14.727816+0000","last_peered":"2023-10-03T10:09:14.727816+0000","last_clean":"2023-10-03T10:09:14.727816+0000","last_became_active":"2023-10-03T10:09:14.720762+0000","last_became_peered":"2023-10-03T10:09:14.720762+0000","last_unstale":"2023-10-03T10:09:14.727816+0000","last_undegraded":"2023-10-03T10:09:14.727816+0000","last_fullsized":"2023-10-03T10:09:14.727816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731374+0000","last_change":"2023-10-03T10:09:14.346629+0000","last_active":"2023-10-03T10:09:14.731374+0000","last_peered":"2023-10-03T10:09:14.731374+0000","last_clean":"2023-10-03T10:09:14.731374+0000","last_became_active":"2023-10-03T10:09:14.346335+0000","last_became_peered":"2023-10-03T10:09:14.346335+0000","last_unstale":"2023-10-03T10:09:14.731374+0000","last_undegraded":"2023-10-03T10:09:14.731374+0000","last_fullsized":"2023-10-03T10:09:14.731374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730730+0000","last_change":"2023-10-03T10:09:14.724074+0000","last_active":"2023-10-03T10:09:14.730730+0000","last_peered":"2023-10-03T10:09:14.730730+0000","last_clean":"2023-10-03T10:09:14.730730+0000","last_became_active":"2023-10-03T10:09:14.723284+0000","last_became_peered":"2023-10-03T10:09:14.723284+0000","last_unstale":"2023-10-03T10:09:14.730730+0000","last_undegraded":"2023-10-03T10:09:14.730730+0000","last_fullsized":"2023-10-03T10:09:14.730730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.725102+0000","last_change":"2023-10-03T10:09:14.353282+0000","last_active":"2023-10-03T10:09:14.725102+0000","last_peered":"2023-10-03T10:09:14.725102+0000","last_clean":"2023-10-03T10:09:14.725102+0000","last_became_active":"2023-10-03T10:09:14.352586+0000","last_became_peered":"2023-10-03T10:09:14.352586+0000","last_unstale":"2023-10-03T10:09:14.725102+0000","last_undegraded":"2023-10-03T10:09:14.725102+0000","last_fullsized":"2023-10-03T10:09:14.725102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734301+0000","last_change":"2023-10-03T10:09:14.729509+0000","last_active":"2023-10-03T10:09:14.734301+0000","last_peered":"2023-10-03T10:09:14.734301+0000","last_clean":"2023-10-03T10:09:14.734301+0000","last_became_active":"2023-10-03T10:09:14.729254+0000","last_became_peered":"2023-10-03T10:09:14.729254+0000","last_unstale":"2023-10-03T10:09:14.734301+0000","last_undegraded":"2023-10-03T10:09:14.734301+0000","last_fullsized":"2023-10-03T10:09:14.734301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690235+0000","last_change":"2023-10-03T10:09:14.343728+0000","last_active":"2023-10-03T10:09:14.690235+0000","last_peered":"2023-10-03T10:09:14.690235+0000","last_clean":"2023-10-03T10:09:14.690235+0000","last_became_active":"2023-10-03T10:09:14.343444+0000","last_became_peered":"2023-10-03T10:09:14.343444+0000","last_unstale":"2023-10-03T10:09:14.690235+0000","last_undegraded":"2023-10-03T10:09:14.690235+0000","last_fullsized":"2023-10-03T10:09:14.690235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731815+0000","last_change":"2023-10-03T10:09:14.724168+0000","last_active":"2023-10-03T10:09:14.731815+0000","last_peered":"2023-10-03T10:09:14.731815+0000","last_clean":"2023-10-03T10:09:14.731815+0000","last_became_active":"2023-10-03T10:09:14.723777+0000","last_became_peered":"2023-10-03T10:09:14.723777+0000","last_unstale":"2023-10-03T10:09:14.731815+0000","last_undegraded":"2023-10-03T10:09:14.731815+0000","last_fullsized":"2023-10-03T10:09:14.731815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.705446+0000","last_change":"2023-10-03T10:09:14.346628+0000","last_active":"2023-10-03T10:09:14.705446+0000","last_peered":"2023-10-03T10:09:14.705446+0000","last_clean":"2023-10-03T10:09:14.705446+0000","last_became_active":"2023-10-03T10:09:14.346352+0000","last_became_peered":"2023-10-03T10:09:14.346352+0000","last_unstale":"2023-10-03T10:09:14.705446+0000","last_undegraded":"2023-10-03T10:09:14.705446+0000","last_fullsized":"2023-10-03T10:09:14.705446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721547+0000","last_change":"2023-10-03T10:09:14.717361+0000","last_active":"2023-10-03T10:09:14.721547+0000","last_peered":"2023-10-03T10:09:14.721547+0000","last_clean":"2023-10-03T10:09:14.721547+0000","last_became_active":"2023-10-03T10:09:14.716635+0000","last_became_peered":"2023-10-03T10:09:14.716635+0000","last_unstale":"2023-10-03T10:09:14.721547+0000","last_undegraded":"2023-10-03T10:09:14.721547+0000","last_fullsized":"2023-10-03T10:09:14.721547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729991+0000","last_change":"2023-10-03T10:09:14.344594+0000","last_active":"2023-10-03T10:09:14.729991+0000","last_peered":"2023-10-03T10:09:14.729991+0000","last_clean":"2023-10-03T10:09:14.729991+0000","last_became_active":"2023-10-03T10:09:14.344319+0000","last_became_peered":"2023-10-03T10:09:14.344319+0000","last_unstale":"2023-10-03T10:09:14.729991+0000","last_undegraded":"2023-10-03T10:09:14.729991+0000","last_fullsized":"2023-10-03T10:09:14.729991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734410+0000","last_change":"2023-10-03T10:09:14.729964+0000","last_active":"2023-10-03T10:09:14.734410+0000","last_peered":"2023-10-03T10:09:14.734410+0000","last_clean":"2023-10-03T10:09:14.734410+0000","last_became_active":"2023-10-03T10:09:14.729548+0000","last_became_peered":"2023-10-03T10:09:14.729548+0000","last_unstale":"2023-10-03T10:09:14.734410+0000","last_undegraded":"2023-10-03T10:09:14.734410+0000","last_fullsized":"2023-10-03T10:09:14.734410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731124+0000","last_change":"2023-10-03T10:09:14.344297+0000","last_active":"2023-10-03T10:09:14.731124+0000","last_peered":"2023-10-03T10:09:14.731124+0000","last_clean":"2023-10-03T10:09:14.731124+0000","last_became_active":"2023-10-03T10:09:14.344040+0000","last_became_peered":"2023-10-03T10:09:14.344040+0000","last_unstale":"2023-10-03T10:09:14.731124+0000","last_undegraded":"2023-10-03T10:09:14.731124+0000","last_fullsized":"2023-10-03T10:09:14.731124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734907+0000","last_change":"2023-10-03T10:09:14.734141+0000","last_active":"2023-10-03T10:09:14.734907+0000","last_peered":"2023-10-03T10:09:14.734907+0000","last_clean":"2023-10-03T10:09:14.734907+0000","last_became_active":"2023-10-03T10:09:14.733955+0000","last_became_peered":"2023-10-03T10:09:14.733955+0000","last_unstale":"2023-10-03T10:09:14.734907+0000","last_undegraded":"2023-10-03T10:09:14.734907+0000","last_fullsized":"2023-10-03T10:09:14.734907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720183+0000","last_change":"2023-10-03T10:09:14.345399+0000","last_active":"2023-10-03T10:09:14.720183+0000","last_peered":"2023-10-03T10:09:14.720183+0000","last_clean":"2023-10-03T10:09:14.720183+0000","last_became_active":"2023-10-03T10:09:14.345110+0000","last_became_peered":"2023-10-03T10:09:14.345110+0000","last_unstale":"2023-10-03T10:09:14.720183+0000","last_undegraded":"2023-10-03T10:09:14.720183+0000","last_fullsized":"2023-10-03T10:09:14.720183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727567+0000","last_change":"2023-10-03T10:09:14.716249+0000","last_active":"2023-10-03T10:09:14.727567+0000","last_peered":"2023-10-03T10:09:14.727567+0000","last_clean":"2023-10-03T10:09:14.727567+0000","last_became_active":"2023-10-03T10:09:14.715990+0000","last_became_peered":"2023-10-03T10:09:14.715990+0000","last_unstale":"2023-10-03T10:09:14.727567+0000","last_undegraded":"2023-10-03T10:09:14.727567+0000","last_fullsized":"2023-10-03T10:09:14.727567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731734+0000","last_change":"2023-10-03T10:09:14.345375+0000","last_active":"2023-10-03T10:09:14.731734+0000","last_peered":"2023-10-03T10:09:14.731734+0000","last_clean":"2023-10-03T10:09:14.731734+0000","last_became_active":"2023-10-03T10:09:14.343897+0000","last_became_peered":"2023-10-03T10:09:14.343897+0000","last_unstale":"2023-10-03T10:09:14.731734+0000","last_undegraded":"2023-10-03T10:09:14.731734+0000","last_fullsized":"2023-10-03T10:09:14.731734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.715812+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.715548+0000","last_became_peered":"2023-10-03T10:09:14.715548+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690536+0000","last_change":"2023-10-03T10:09:14.343714+0000","last_active":"2023-10-03T10:09:14.690536+0000","last_peered":"2023-10-03T10:09:14.690536+0000","last_clean":"2023-10-03T10:09:14.690536+0000","last_became_active":"2023-10-03T10:09:14.343419+0000","last_became_peered":"2023-10-03T10:09:14.343419+0000","last_unstale":"2023-10-03T10:09:14.690536+0000","last_undegraded":"2023-10-03T10:09:14.690536+0000","last_fullsized":"2023-10-03T10:09:14.690536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722064+0000","last_change":"2023-10-03T10:09:14.710007+0000","last_active":"2023-10-03T10:09:14.722064+0000","last_peered":"2023-10-03T10:09:14.722064+0000","last_clean":"2023-10-03T10:09:14.722064+0000","last_became_active":"2023-10-03T10:09:14.708147+0000","last_became_peered":"2023-10-03T10:09:14.708147+0000","last_unstale":"2023-10-03T10:09:14.722064+0000","last_undegraded":"2023-10-03T10:09:14.722064+0000","last_fullsized":"2023-10-03T10:09:14.722064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724797+0000","last_change":"2023-10-03T10:09:14.353447+0000","last_active":"2023-10-03T10:09:14.724797+0000","last_peered":"2023-10-03T10:09:14.724797+0000","last_clean":"2023-10-03T10:09:14.724797+0000","last_became_active":"2023-10-03T10:09:14.352906+0000","last_became_peered":"2023-10-03T10:09:14.352906+0000","last_unstale":"2023-10-03T10:09:14.724797+0000","last_undegraded":"2023-10-03T10:09:14.724797+0000","last_fullsized":"2023-10-03T10:09:14.724797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720993+0000","last_change":"2023-10-03T10:09:14.711315+0000","last_active":"2023-10-03T10:09:14.720993+0000","last_peered":"2023-10-03T10:09:14.720993+0000","last_clean":"2023-10-03T10:09:14.720993+0000","last_became_active":"2023-10-03T10:09:14.711126+0000","last_became_peered":"2023-10-03T10:09:14.711126+0000","last_unstale":"2023-10-03T10:09:14.720993+0000","last_undegraded":"2023-10-03T10:09:14.720993+0000","last_fullsized":"2023-10-03T10:09:14.720993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700797+0000","last_change":"2023-10-03T10:09:14.347268+0000","last_active":"2023-10-03T10:09:14.700797+0000","last_peered":"2023-10-03T10:09:14.700797+0000","last_clean":"2023-10-03T10:09:14.700797+0000","last_became_active":"2023-10-03T10:09:14.346969+0000","last_became_peered":"2023-10-03T10:09:14.346969+0000","last_unstale":"2023-10-03T10:09:14.700797+0000","last_undegraded":"2023-10-03T10:09:14.700797+0000","last_fullsized":"2023-10-03T10:09:14.700797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734541+0000","last_change":"2023-10-03T10:09:14.731503+0000","last_active":"2023-10-03T10:09:14.734541+0000","last_peered":"2023-10-03T10:09:14.734541+0000","last_clean":"2023-10-03T10:09:14.734541+0000","last_became_active":"2023-10-03T10:09:14.730811+0000","last_became_peered":"2023-10-03T10:09:14.730811+0000","last_unstale":"2023-10-03T10:09:14.734541+0000","last_undegraded":"2023-10-03T10:09:14.734541+0000","last_fullsized":"2023-10-03T10:09:14.734541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703830+0000","last_change":"2023-10-03T10:09:14.346668+0000","last_active":"2023-10-03T10:09:14.703830+0000","last_peered":"2023-10-03T10:09:14.703830+0000","last_clean":"2023-10-03T10:09:14.703830+0000","last_became_active":"2023-10-03T10:09:14.346390+0000","last_became_peered":"2023-10-03T10:09:14.346390+0000","last_unstale":"2023-10-03T10:09:14.703830+0000","last_undegraded":"2023-10-03T10:09:14.703830+0000","last_fullsized":"2023-10-03T10:09:14.703830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723208+0000","last_change":"2023-10-03T10:09:14.716337+0000","last_active":"2023-10-03T10:09:14.723208+0000","last_peered":"2023-10-03T10:09:14.723208+0000","last_clean":"2023-10-03T10:09:14.723208+0000","last_became_active":"2023-10-03T10:09:14.716083+0000","last_became_peered":"2023-10-03T10:09:14.716083+0000","last_unstale":"2023-10-03T10:09:14.723208+0000","last_undegraded":"2023-10-03T10:09:14.723208+0000","last_fullsized":"2023-10-03T10:09:14.723208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703747+0000","last_change":"2023-10-03T10:09:14.344515+0000","last_active":"2023-10-03T10:09:14.703747+0000","last_peered":"2023-10-03T10:09:14.703747+0000","last_clean":"2023-10-03T10:09:14.703747+0000","last_became_active":"2023-10-03T10:09:14.344244+0000","last_became_peered":"2023-10-03T10:09:14.344244+0000","last_unstale":"2023-10-03T10:09:14.703747+0000","last_undegraded":"2023-10-03T10:09:14.703747+0000","last_fullsized":"2023-10-03T10:09:14.703747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727919+0000","last_change":"2023-10-03T10:09:14.723005+0000","last_active":"2023-10-03T10:09:14.727919+0000","last_peered":"2023-10-03T10:09:14.727919+0000","last_clean":"2023-10-03T10:09:14.727919+0000","last_became_active":"2023-10-03T10:09:14.720579+0000","last_became_peered":"2023-10-03T10:09:14.720579+0000","last_unstale":"2023-10-03T10:09:14.727919+0000","last_undegraded":"2023-10-03T10:09:14.727919+0000","last_fullsized":"2023-10-03T10:09:14.727919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700288+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:14.700288+0000","last_peered":"2023-10-03T10:09:14.700288+0000","last_clean":"2023-10-03T10:09:14.700288+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:14.700288+0000","last_undegraded":"2023-10-03T10:09:14.700288+0000","last_fullsized":"2023-10-03T10:09:14.700288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695969+0000","last_change":"2023-10-03T10:09:14.344817+0000","last_active":"2023-10-03T10:09:14.695969+0000","last_peered":"2023-10-03T10:09:14.695969+0000","last_clean":"2023-10-03T10:09:14.695969+0000","last_became_active":"2023-10-03T10:09:14.344547+0000","last_became_peered":"2023-10-03T10:09:14.344547+0000","last_unstale":"2023-10-03T10:09:14.695969+0000","last_undegraded":"2023-10-03T10:09:14.695969+0000","last_fullsized":"2023-10-03T10:09:14.695969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727798+0000","last_change":"2023-10-03T10:09:14.721039+0000","last_active":"2023-10-03T10:09:14.727798+0000","last_peered":"2023-10-03T10:09:14.727798+0000","last_clean":"2023-10-03T10:09:14.727798+0000","last_became_active":"2023-10-03T10:09:14.720876+0000","last_became_peered":"2023-10-03T10:09:14.720876+0000","last_unstale":"2023-10-03T10:09:14.727798+0000","last_undegraded":"2023-10-03T10:09:14.727798+0000","last_fullsized":"2023-10-03T10:09:14.727798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703725+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:14.703725+0000","last_peered":"2023-10-03T10:09:14.703725+0000","last_clean":"2023-10-03T10:09:14.703725+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:14.703725+0000","last_undegraded":"2023-10-03T10:09:14.703725+0000","last_fullsized":"2023-10-03T10:09:14.703725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690358+0000","last_change":"2023-10-03T10:09:14.351814+0000","last_active":"2023-10-03T10:09:14.690358+0000","last_peered":"2023-10-03T10:09:14.690358+0000","last_clean":"2023-10-03T10:09:14.690358+0000","last_became_active":"2023-10-03T10:09:14.351588+0000","last_became_peered":"2023-10-03T10:09:14.351588+0000","last_unstale":"2023-10-03T10:09:14.690358+0000","last_undegraded":"2023-10-03T10:09:14.690358+0000","last_fullsized":"2023-10-03T10:09:14.690358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710632+0000","last_change":"2023-10-03T10:09:14.708011+0000","last_active":"2023-10-03T10:09:14.710632+0000","last_peered":"2023-10-03T10:09:14.710632+0000","last_clean":"2023-10-03T10:09:14.710632+0000","last_became_active":"2023-10-03T10:09:14.707425+0000","last_became_peered":"2023-10-03T10:09:14.707425+0000","last_unstale":"2023-10-03T10:09:14.710632+0000","last_undegraded":"2023-10-03T10:09:14.710632+0000","last_fullsized":"2023-10-03T10:09:14.710632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695432+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:14.695432+0000","last_peered":"2023-10-03T10:09:14.695432+0000","last_clean":"2023-10-03T10:09:14.695432+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:14.695432+0000","last_undegraded":"2023-10-03T10:09:14.695432+0000","last_fullsized":"2023-10-03T10:09:14.695432+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699908+0000","last_change":"2023-10-03T10:09:14.351636+0000","last_active":"2023-10-03T10:09:14.699908+0000","last_peered":"2023-10-03T10:09:14.699908+0000","last_clean":"2023-10-03T10:09:14.699908+0000","last_became_active":"2023-10-03T10:09:14.351360+0000","last_became_peered":"2023-10-03T10:09:14.351360+0000","last_unstale":"2023-10-03T10:09:14.699908+0000","last_undegraded":"2023-10-03T10:09:14.699908+0000","last_fullsized":"2023-10-03T10:09:14.699908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730928+0000","last_change":"2023-10-03T10:09:14.726543+0000","last_active":"2023-10-03T10:09:14.730928+0000","last_peered":"2023-10-03T10:09:14.730928+0000","last_clean":"2023-10-03T10:09:14.730928+0000","last_became_active":"2023-10-03T10:09:14.726287+0000","last_became_peered":"2023-10-03T10:09:14.726287+0000","last_unstale":"2023-10-03T10:09:14.730928+0000","last_undegraded":"2023-10-03T10:09:14.730928+0000","last_fullsized":"2023-10-03T10:09:14.730928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711633+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:14.711633+0000","last_peered":"2023-10-03T10:09:14.711633+0000","last_clean":"2023-10-03T10:09:14.711633+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:14.711633+0000","last_undegraded":"2023-10-03T10:09:14.711633+0000","last_fullsized":"2023-10-03T10:09:14.711633+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699816+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:14.699816+0000","last_peered":"2023-10-03T10:09:14.699816+0000","last_clean":"2023-10-03T10:09:14.699816+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:14.699816+0000","last_undegraded":"2023-10-03T10:09:14.699816+0000","last_fullsized":"2023-10-03T10:09:14.699816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700703+0000","last_change":"2023-10-03T10:09:14.347133+0000","last_active":"2023-10-03T10:09:14.700703+0000","last_peered":"2023-10-03T10:09:14.700703+0000","last_clean":"2023-10-03T10:09:14.700703+0000","last_became_active":"2023-10-03T10:09:14.346671+0000","last_became_peered":"2023-10-03T10:09:14.346671+0000","last_unstale":"2023-10-03T10:09:14.700703+0000","last_undegraded":"2023-10-03T10:09:14.700703+0000","last_fullsized":"2023-10-03T10:09:14.700703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734555+0000","last_change":"2023-10-03T10:09:14.731621+0000","last_active":"2023-10-03T10:09:14.734555+0000","last_peered":"2023-10-03T10:09:14.734555+0000","last_clean":"2023-10-03T10:09:14.734555+0000","last_became_active":"2023-10-03T10:09:14.731155+0000","last_became_peered":"2023-10-03T10:09:14.731155+0000","last_unstale":"2023-10-03T10:09:14.734555+0000","last_undegraded":"2023-10-03T10:09:14.734555+0000","last_fullsized":"2023-10-03T10:09:14.734555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703928+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:14.703928+0000","last_peered":"2023-10-03T10:09:14.703928+0000","last_clean":"2023-10-03T10:09:14.703928+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:14.703928+0000","last_undegraded":"2023-10-03T10:09:14.703928+0000","last_fullsized":"2023-10-03T10:09:14.703928+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.689385+0000","last_change":"2023-10-03T10:09:14.345534+0000","last_active":"2023-10-03T10:09:14.689385+0000","last_peered":"2023-10-03T10:09:14.689385+0000","last_clean":"2023-10-03T10:09:14.689385+0000","last_became_active":"2023-10-03T10:09:14.344896+0000","last_became_peered":"2023-10-03T10:09:14.344896+0000","last_unstale":"2023-10-03T10:09:14.689385+0000","last_undegraded":"2023-10-03T10:09:14.689385+0000","last_fullsized":"2023-10-03T10:09:14.689385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721494+0000","last_change":"2023-10-03T10:09:14.716877+0000","last_active":"2023-10-03T10:09:14.721494+0000","last_peered":"2023-10-03T10:09:14.721494+0000","last_clean":"2023-10-03T10:09:14.721494+0000","last_became_active":"2023-10-03T10:09:14.715861+0000","last_became_peered":"2023-10-03T10:09:14.715861+0000","last_unstale":"2023-10-03T10:09:14.721494+0000","last_undegraded":"2023-10-03T10:09:14.721494+0000","last_fullsized":"2023-10-03T10:09:14.721494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709500+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:14.709500+0000","last_peered":"2023-10-03T10:09:14.709500+0000","last_clean":"2023-10-03T10:09:14.709500+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:14.709500+0000","last_undegraded":"2023-10-03T10:09:14.709500+0000","last_fullsized":"2023-10-03T10:09:14.709500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700064+0000","last_change":"2023-10-03T10:09:14.352568+0000","last_active":"2023-10-03T10:09:14.700064+0000","last_peered":"2023-10-03T10:09:14.700064+0000","last_clean":"2023-10-03T10:09:14.700064+0000","last_became_active":"2023-10-03T10:09:14.352349+0000","last_became_peered":"2023-10-03T10:09:14.352349+0000","last_unstale":"2023-10-03T10:09:14.700064+0000","last_undegraded":"2023-10-03T10:09:14.700064+0000","last_fullsized":"2023-10-03T10:09:14.700064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722084+0000","last_change":"2023-10-03T10:09:14.710656+0000","last_active":"2023-10-03T10:09:14.722084+0000","last_peered":"2023-10-03T10:09:14.722084+0000","last_clean":"2023-10-03T10:09:14.722084+0000","last_became_active":"2023-10-03T10:09:14.710425+0000","last_became_peered":"2023-10-03T10:09:14.710425+0000","last_unstale":"2023-10-03T10:09:14.722084+0000","last_undegraded":"2023-10-03T10:09:14.722084+0000","last_fullsized":"2023-10-03T10:09:14.722084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730248+0000","last_change":"2023-10-03T10:09:14.346884+0000","last_active":"2023-10-03T10:09:14.730248+0000","last_peered":"2023-10-03T10:09:14.730248+0000","last_clean":"2023-10-03T10:09:14.730248+0000","last_became_active":"2023-10-03T10:09:14.346598+0000","last_became_peered":"2023-10-03T10:09:14.346598+0000","last_unstale":"2023-10-03T10:09:14.730248+0000","last_undegraded":"2023-10-03T10:09:14.730248+0000","last_fullsized":"2023-10-03T10:09:14.730248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.701425+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:14.701425+0000","last_peered":"2023-10-03T10:09:14.701425+0000","last_clean":"2023-10-03T10:09:14.701425+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:14.701425+0000","last_undegraded":"2023-10-03T10:09:14.701425+0000","last_fullsized":"2023-10-03T10:09:14.701425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734872+0000","last_change":"2023-10-03T10:09:14.733924+0000","last_active":"2023-10-03T10:09:14.734872+0000","last_peered":"2023-10-03T10:09:14.734872+0000","last_clean":"2023-10-03T10:09:14.734872+0000","last_became_active":"2023-10-03T10:09:14.733635+0000","last_became_peered":"2023-10-03T10:09:14.733635+0000","last_unstale":"2023-10-03T10:09:14.734872+0000","last_undegraded":"2023-10-03T10:09:14.734872+0000","last_fullsized":"2023-10-03T10:09:14.734872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709169+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:14.709169+0000","last_peered":"2023-10-03T10:09:14.709169+0000","last_clean":"2023-10-03T10:09:14.709169+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:14.709169+0000","last_undegraded":"2023-10-03T10:09:14.709169+0000","last_fullsized":"2023-10-03T10:09:14.709169+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:09:17.450630+0000","last_change":"2023-10-03T10:09:14.350895+0000","last_active":"2023-10-03T10:09:17.450630+0000","last_peered":"2023-10-03T10:09:17.450630+0000","last_clean":"2023-10-03T10:09:17.450630+0000","last_became_active":"2023-10-03T10:09:14.350426+0000","last_became_peered":"2023-10-03T10:09:14.350426+0000","last_unstale":"2023-10-03T10:09:17.450630+0000","last_undegraded":"2023-10-03T10:09:17.450630+0000","last_fullsized":"2023-10-03T10:09:17.450630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715702+0000","last_change":"2023-10-03T10:09:14.714464+0000","last_active":"2023-10-03T10:09:14.715702+0000","last_peered":"2023-10-03T10:09:14.715702+0000","last_clean":"2023-10-03T10:09:14.715702+0000","last_became_active":"2023-10-03T10:09:14.714221+0000","last_became_peered":"2023-10-03T10:09:14.714221+0000","last_unstale":"2023-10-03T10:09:14.715702+0000","last_undegraded":"2023-10-03T10:09:14.715702+0000","last_fullsized":"2023-10-03T10:09:14.715702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719633+0000","last_change":"2023-10-03T10:09:14.351366+0000","last_active":"2023-10-03T10:09:14.719633+0000","last_peered":"2023-10-03T10:09:14.719633+0000","last_clean":"2023-10-03T10:09:14.719633+0000","last_became_active":"2023-10-03T10:09:14.350445+0000","last_became_peered":"2023-10-03T10:09:14.350445+0000","last_unstale":"2023-10-03T10:09:14.719633+0000","last_undegraded":"2023-10-03T10:09:14.719633+0000","last_fullsized":"2023-10-03T10:09:14.719633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.712724+0000","last_change":"2023-10-03T10:09:14.707995+0000","last_active":"2023-10-03T10:09:14.712724+0000","last_peered":"2023-10-03T10:09:14.712724+0000","last_clean":"2023-10-03T10:09:14.712724+0000","last_became_active":"2023-10-03T10:09:14.707723+0000","last_became_peered":"2023-10-03T10:09:14.707723+0000","last_unstale":"2023-10-03T10:09:14.712724+0000","last_undegraded":"2023-10-03T10:09:14.712724+0000","last_fullsized":"2023-10-03T10:09:14.712724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714950+0000","last_change":"2023-10-03T10:09:14.345357+0000","last_active":"2023-10-03T10:09:14.714950+0000","last_peered":"2023-10-03T10:09:14.714950+0000","last_clean":"2023-10-03T10:09:14.714950+0000","last_became_active":"2023-10-03T10:09:14.344951+0000","last_became_peered":"2023-10-03T10:09:14.344951+0000","last_unstale":"2023-10-03T10:09:14.714950+0000","last_undegraded":"2023-10-03T10:09:14.714950+0000","last_fullsized":"2023-10-03T10:09:14.714950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730690+0000","last_change":"2023-10-03T10:09:14.724291+0000","last_active":"2023-10-03T10:09:14.730690+0000","last_peered":"2023-10-03T10:09:14.730690+0000","last_clean":"2023-10-03T10:09:14.730690+0000","last_became_active":"2023-10-03T10:09:14.723559+0000","last_became_peered":"2023-10-03T10:09:14.723559+0000","last_unstale":"2023-10-03T10:09:14.730690+0000","last_undegraded":"2023-10-03T10:09:14.730690+0000","last_fullsized":"2023-10-03T10:09:14.730690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724427+0000","last_change":"2023-10-03T10:09:14.345918+0000","last_active":"2023-10-03T10:09:14.724427+0000","last_peered":"2023-10-03T10:09:14.724427+0000","last_clean":"2023-10-03T10:09:14.724427+0000","last_became_active":"2023-10-03T10:09:14.345634+0000","last_became_peered":"2023-10-03T10:09:14.345634+0000","last_unstale":"2023-10-03T10:09:14.724427+0000","last_undegraded":"2023-10-03T10:09:14.724427+0000","last_fullsized":"2023-10-03T10:09:14.724427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722402+0000","last_change":"2023-10-03T10:09:14.718860+0000","last_active":"2023-10-03T10:09:14.722402+0000","last_peered":"2023-10-03T10:09:14.722402+0000","last_clean":"2023-10-03T10:09:14.722402+0000","last_became_active":"2023-10-03T10:09:14.716545+0000","last_became_peered":"2023-10-03T10:09:14.716545+0000","last_unstale":"2023-10-03T10:09:14.722402+0000","last_undegraded":"2023-10-03T10:09:14.722402+0000","last_fullsized":"2023-10-03T10:09:14.722402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711557+0000","last_change":"2023-10-03T10:09:14.351568+0000","last_active":"2023-10-03T10:09:14.711557+0000","last_peered":"2023-10-03T10:09:14.711557+0000","last_clean":"2023-10-03T10:09:14.711557+0000","last_became_active":"2023-10-03T10:09:14.351293+0000","last_became_peered":"2023-10-03T10:09:14.351293+0000","last_unstale":"2023-10-03T10:09:14.711557+0000","last_undegraded":"2023-10-03T10:09:14.711557+0000","last_fullsized":"2023-10-03T10:09:14.711557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723070+0000","last_change":"2023-10-03T10:09:14.720328+0000","last_active":"2023-10-03T10:09:14.723070+0000","last_peered":"2023-10-03T10:09:14.723070+0000","last_clean":"2023-10-03T10:09:14.723070+0000","last_became_active":"2023-10-03T10:09:14.720033+0000","last_became_peered":"2023-10-03T10:09:14.720033+0000","last_unstale":"2023-10-03T10:09:14.723070+0000","last_undegraded":"2023-10-03T10:09:14.723070+0000","last_fullsized":"2023-10-03T10:09:14.723070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714114+0000","last_change":"2023-10-03T10:09:14.352301+0000","last_active":"2023-10-03T10:09:14.714114+0000","last_peered":"2023-10-03T10:09:14.714114+0000","last_clean":"2023-10-03T10:09:14.714114+0000","last_became_active":"2023-10-03T10:09:14.352027+0000","last_became_peered":"2023-10-03T10:09:14.352027+0000","last_unstale":"2023-10-03T10:09:14.714114+0000","last_undegraded":"2023-10-03T10:09:14.714114+0000","last_fullsized":"2023-10-03T10:09:14.714114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715738+0000","last_change":"2023-10-03T10:09:14.713576+0000","last_active":"2023-10-03T10:09:14.715738+0000","last_peered":"2023-10-03T10:09:14.715738+0000","last_clean":"2023-10-03T10:09:14.715738+0000","last_became_active":"2023-10-03T10:09:14.713175+0000","last_became_peered":"2023-10-03T10:09:14.713175+0000","last_unstale":"2023-10-03T10:09:14.715738+0000","last_undegraded":"2023-10-03T10:09:14.715738+0000","last_fullsized":"2023-10-03T10:09:14.715738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730038+0000","last_change":"2023-10-03T10:09:14.712406+0000","last_active":"2023-10-03T10:09:14.730038+0000","last_peered":"2023-10-03T10:09:14.730038+0000","last_clean":"2023-10-03T10:09:14.730038+0000","last_became_active":"2023-10-03T10:09:14.712076+0000","last_became_peered":"2023-10-03T10:09:14.712076+0000","last_unstale":"2023-10-03T10:09:14.730038+0000","last_undegraded":"2023-10-03T10:09:14.730038+0000","last_fullsized":"2023-10-03T10:09:14.730038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.733844+0000","last_change":"2023-10-03T10:09:14.729293+0000","last_active":"2023-10-03T10:09:14.733844+0000","last_peered":"2023-10-03T10:09:14.733844+0000","last_clean":"2023-10-03T10:09:14.733844+0000","last_became_active":"2023-10-03T10:09:14.729022+0000","last_became_peered":"2023-10-03T10:09:14.729022+0000","last_unstale":"2023-10-03T10:09:14.733844+0000","last_undegraded":"2023-10-03T10:09:14.733844+0000","last_fullsized":"2023-10-03T10:09:14.733844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721016+0000","last_change":"2023-10-03T10:09:14.710814+0000","last_active":"2023-10-03T10:09:14.721016+0000","last_peered":"2023-10-03T10:09:14.721016+0000","last_clean":"2023-10-03T10:09:14.721016+0000","last_became_active":"2023-10-03T10:09:14.710640+0000","last_became_peered":"2023-10-03T10:09:14.710640+0000","last_unstale":"2023-10-03T10:09:14.721016+0000","last_undegraded":"2023-10-03T10:09:14.721016+0000","last_fullsized":"2023-10-03T10:09:14.721016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734690+0000","last_change":"2023-10-03T10:09:14.732180+0000","last_active":"2023-10-03T10:09:14.734690+0000","last_peered":"2023-10-03T10:09:14.734690+0000","last_clean":"2023-10-03T10:09:14.734690+0000","last_became_active":"2023-10-03T10:09:14.731970+0000","last_became_peered":"2023-10-03T10:09:14.731970+0000","last_unstale":"2023-10-03T10:09:14.734690+0000","last_undegraded":"2023-10-03T10:09:14.734690+0000","last_fullsized":"2023-10-03T10:09:14.734690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710652+0000","last_change":"2023-10-03T10:09:14.708167+0000","last_active":"2023-10-03T10:09:14.710652+0000","last_peered":"2023-10-03T10:09:14.710652+0000","last_clean":"2023-10-03T10:09:14.710652+0000","last_became_active":"2023-10-03T10:09:14.707761+0000","last_became_peered":"2023-10-03T10:09:14.707761+0000","last_unstale":"2023-10-03T10:09:14.710652+0000","last_undegraded":"2023-10-03T10:09:14.710652+0000","last_fullsized":"2023-10-03T10:09:14.710652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:26.977 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.127+0000 7f0fb107d700 1 Processor -- start 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.127+0000 7f0fb107d700 1 -- start start 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fb107d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fb107d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac132740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fb107d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac096c90 con 0x7f0fac092990 2023-10-03T10:09:27.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fb107d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac092d70 con 0x7f0fac130350 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fb107d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac097820 con 0x7f0fac065ae0 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fab59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac132740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0fac092990 0x7f0fac065fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43666/0 (socket says 172.21.15.125:43666) 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faad9d700 1 -- 172.21.15.125:0/1098896979 learned_addr learned my addr 172.21.15.125:0/1098896979 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fa9d9b700 1 -- 172.21.15.125:0/1098896979 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020273069 0 0) 0x7f0fac096c90 con 0x7f0fac092990 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fa9d9b700 1 -- 172.21.15.125:0/1098896979 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f980033f0 con 0x7f0fac092990 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 -- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 msgr2=0x7f0fac132740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac132740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 -- 172.21.15.125:0/1098896979 >> v1:172.21.15.125:6789/0 conn(0x7f0fac092990 legacy=0x7f0fac065fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 -- 172.21.15.125:0/1098896979 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac097080 con 0x7f0fac065ae0 2023-10-03T10:09:27.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fab59e700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac132740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0faa59c700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0f9c009790 tx=0x7f0f9c009060).ready entity=mon.2 client_cookie=a505cb24aaa31c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.128+0000 7f0fa9d9b700 1 -- 172.21.15.125:0/1098896979 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0090d0 con 0x7f0fac065ae0 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fa9d9b700 1 -- 172.21.15.125:0/1098896979 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00f510 con 0x7f0fac065ae0 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fa9d9b700 1 -- 172.21.15.125:0/1098896979 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00f890 con 0x7f0fac065ae0 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 -- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 msgr2=0x7f0fac12fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0f9c009790 tx=0x7f0f9c009060).stop 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 -- 172.21.15.125:0/1098896979 shutdown_connections 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac132740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 --2- 172.21.15.125:0/1098896979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12fe60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 -- 172.21.15.125:0/1098896979 >> 172.21.15.125:0/1098896979 conn(0x7f0fac09bba0 msgr2=0x7f0fac09bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 -- 172.21.15.125:0/1098896979 shutdown_connections 2023-10-03T10:09:27.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.129+0000 7f0fb107d700 1 -- 172.21.15.125:0/1098896979 wait complete. 2023-10-03T10:09:27.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 Processor -- start 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 -- start start 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 0x7f0fac12e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac12e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac12d1e0 con 0x7f0fac092990 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac12ca20 con 0x7f0fac130350 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.130+0000 7f0fb107d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac12ccd0 con 0x7f0fac065ae0 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 0x7f0fac12e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55338/0 (socket says 172.21.15.125:55338) 2023-10-03T10:09:27.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faad9d700 1 -- 172.21.15.125:0/736182591 learned_addr learned my addr 172.21.15.125:0/736182591 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fab59e700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac12e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 -- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 msgr2=0x7f0fac12d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 -- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 msgr2=0x7f0fac12e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac12e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 -- 172.21.15.125:0/736182591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4009a20 con 0x7f0fac092990 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faad9d700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fab59e700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac12e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0faa59c700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 0x7f0fac12e0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0f9c014000 tx=0x7f0f9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c006910 con 0x7f0fac092990 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c011a10 con 0x7f0fac092990 2023-10-03T10:09:27.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c011dd0 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0092a0 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.131+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac06a710 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.132+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0f9c01b620 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.132+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0f9c03c660 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.132+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac05a260 con 0x7f0fac092990 2023-10-03T10:09:27.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.136+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0f9c02b940 con 0x7f0fac092990 2023-10-03T10:09:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.289+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 --> v1:172.21.15.125:6816/118167 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fac046c20 con 0x7f0f8c02bb60 2023-10-03T10:09:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.296+0000 7f0fa2ffd700 1 -- 172.21.15.125:0/736182591 <== mgr.4102 v1:172.21.15.125:6816/118167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249933 (unknown 2965378022 0 1733476552) 0x7f0fac046c20 con 0x7f0f8c02bb60 2023-10-03T10:09:27.299 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 >> v1:172.21.15.125:6816/118167 conn(0x7f0f8c02bb60 legacy=0x7f0f8c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 msgr2=0x7f0fac12e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 0x7f0fac12e0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0f9c014000 tx=0x7f0f9c017000).stop 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 shutdown_connections 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac130350 0x7f0fac12e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac065ae0 0x7f0fac12d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 --2- 172.21.15.125:0/736182591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac092990 0x7f0fac12e0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.298+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 >> 172.21.15.125:0/736182591 conn(0x7f0fac09bba0 msgr2=0x7f0fac09b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.299+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 shutdown_connections 2023-10-03T10:09:27.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.299+0000 7f0fb107d700 1 -- 172.21.15.125:0/736182591 wait complete. 2023-10-03T10:09:27.302 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:09:27.311 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-03T10:09:27.144266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001798"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715818+0000","last_change":"2023-10-03T10:09:14.714603+0000","last_active":"2023-10-03T10:09:14.715818+0000","last_peered":"2023-10-03T10:09:14.715818+0000","last_clean":"2023-10-03T10:09:14.715818+0000","last_became_active":"2023-10-03T10:09:14.714337+0000","last_became_peered":"2023-10-03T10:09:14.714337+0000","last_unstale":"2023-10-03T10:09:14.715818+0000","last_undegraded":"2023-10-03T10:09:14.715818+0000","last_fullsized":"2023-10-03T10:09:14.715818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709275+0000","last_change":"2023-10-03T10:09:14.705544+0000","last_active":"2023-10-03T10:09:14.709275+0000","last_peered":"2023-10-03T10:09:14.709275+0000","last_clean":"2023-10-03T10:09:14.709275+0000","last_became_active":"2023-10-03T10:09:14.705240+0000","last_became_peered":"2023-10-03T10:09:14.705240+0000","last_unstale":"2023-10-03T10:09:14.709275+0000","last_undegraded":"2023-10-03T10:09:14.709275+0000","last_fullsized":"2023-10-03T10:09:14.709275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721157+0000","last_change":"2023-10-03T10:09:14.715211+0000","last_active":"2023-10-03T10:09:14.721157+0000","last_peered":"2023-10-03T10:09:14.721157+0000","last_clean":"2023-10-03T10:09:14.721157+0000","last_became_active":"2023-10-03T10:09:14.714965+0000","last_became_peered":"2023-10-03T10:09:14.714965+0000","last_unstale":"2023-10-03T10:09:14.721157+0000","last_undegraded":"2023-10-03T10:09:14.721157+0000","last_fullsized":"2023-10-03T10:09:14.721157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720890+0000","last_change":"2023-10-03T10:09:14.710747+0000","last_active":"2023-10-03T10:09:14.720890+0000","last_peered":"2023-10-03T10:09:14.720890+0000","last_clean":"2023-10-03T10:09:14.720890+0000","last_became_active":"2023-10-03T10:09:14.710471+0000","last_became_peered":"2023-10-03T10:09:14.710471+0000","last_unstale":"2023-10-03T10:09:14.720890+0000","last_undegraded":"2023-10-03T10:09:14.720890+0000","last_fullsized":"2023-10-03T10:09:14.720890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722101+0000","last_change":"2023-10-03T10:09:14.719560+0000","last_active":"2023-10-03T10:09:14.722101+0000","last_peered":"2023-10-03T10:09:14.722101+0000","last_clean":"2023-10-03T10:09:14.722101+0000","last_became_active":"2023-10-03T10:09:14.719359+0000","last_became_peered":"2023-10-03T10:09:14.719359+0000","last_unstale":"2023-10-03T10:09:14.722101+0000","last_undegraded":"2023-10-03T10:09:14.722101+0000","last_fullsized":"2023-10-03T10:09:14.722101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722554+0000","last_change":"2023-10-03T10:09:14.719561+0000","last_active":"2023-10-03T10:09:14.722554+0000","last_peered":"2023-10-03T10:09:14.722554+0000","last_clean":"2023-10-03T10:09:14.722554+0000","last_became_active":"2023-10-03T10:09:14.719264+0000","last_became_peered":"2023-10-03T10:09:14.719264+0000","last_unstale":"2023-10-03T10:09:14.722554+0000","last_undegraded":"2023-10-03T10:09:14.722554+0000","last_fullsized":"2023-10-03T10:09:14.722554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729401+0000","last_change":"2023-10-03T10:09:14.723496+0000","last_active":"2023-10-03T10:09:14.729401+0000","last_peered":"2023-10-03T10:09:14.729401+0000","last_clean":"2023-10-03T10:09:14.729401+0000","last_became_active":"2023-10-03T10:09:14.723260+0000","last_became_peered":"2023-10-03T10:09:14.723260+0000","last_unstale":"2023-10-03T10:09:14.729401+0000","last_undegraded":"2023-10-03T10:09:14.729401+0000","last_fullsized":"2023-10-03T10:09:14.729401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730975+0000","last_change":"2023-10-03T10:09:14.728885+0000","last_active":"2023-10-03T10:09:14.730975+0000","last_peered":"2023-10-03T10:09:14.730975+0000","last_clean":"2023-10-03T10:09:14.730975+0000","last_became_active":"2023-10-03T10:09:14.720610+0000","last_became_peered":"2023-10-03T10:09:14.720610+0000","last_unstale":"2023-10-03T10:09:14.730975+0000","last_undegraded":"2023-10-03T10:09:14.730975+0000","last_fullsized":"2023-10-03T10:09:14.730975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721091+0000","last_change":"2023-10-03T10:09:14.713481+0000","last_active":"2023-10-03T10:09:14.721091+0000","last_peered":"2023-10-03T10:09:14.721091+0000","last_clean":"2023-10-03T10:09:14.721091+0000","last_became_active":"2023-10-03T10:09:14.711120+0000","last_became_peered":"2023-10-03T10:09:14.711120+0000","last_unstale":"2023-10-03T10:09:14.721091+0000","last_undegraded":"2023-10-03T10:09:14.721091+0000","last_fullsized":"2023-10-03T10:09:14.721091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730834+0000","last_change":"2023-10-03T10:09:14.726303+0000","last_active":"2023-10-03T10:09:14.730834+0000","last_peered":"2023-10-03T10:09:14.730834+0000","last_clean":"2023-10-03T10:09:14.730834+0000","last_became_active":"2023-10-03T10:09:14.726049+0000","last_became_peered":"2023-10-03T10:09:14.726049+0000","last_unstale":"2023-10-03T10:09:14.730834+0000","last_undegraded":"2023-10-03T10:09:14.730834+0000","last_fullsized":"2023-10-03T10:09:14.730834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730903+0000","last_change":"2023-10-03T10:09:14.726200+0000","last_active":"2023-10-03T10:09:14.730903+0000","last_peered":"2023-10-03T10:09:14.730903+0000","last_clean":"2023-10-03T10:09:14.730903+0000","last_became_active":"2023-10-03T10:09:14.725948+0000","last_became_peered":"2023-10-03T10:09:14.725948+0000","last_unstale":"2023-10-03T10:09:14.730903+0000","last_undegraded":"2023-10-03T10:09:14.730903+0000","last_fullsized":"2023-10-03T10:09:14.730903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720401+0000","last_change":"2023-10-03T10:09:14.714843+0000","last_active":"2023-10-03T10:09:14.720401+0000","last_peered":"2023-10-03T10:09:14.720401+0000","last_clean":"2023-10-03T10:09:14.720401+0000","last_became_active":"2023-10-03T10:09:14.714579+0000","last_became_peered":"2023-10-03T10:09:14.714579+0000","last_unstale":"2023-10-03T10:09:14.720401+0000","last_undegraded":"2023-10-03T10:09:14.720401+0000","last_fullsized":"2023-10-03T10:09:14.720401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730712+0000","last_change":"2023-10-03T10:09:14.724414+0000","last_active":"2023-10-03T10:09:14.730712+0000","last_peered":"2023-10-03T10:09:14.730712+0000","last_clean":"2023-10-03T10:09:14.730712+0000","last_became_active":"2023-10-03T10:09:14.723833+0000","last_became_peered":"2023-10-03T10:09:14.723833+0000","last_unstale":"2023-10-03T10:09:14.730712+0000","last_undegraded":"2023-10-03T10:09:14.730712+0000","last_fullsized":"2023-10-03T10:09:14.730712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710054+0000","last_change":"2023-10-03T10:09:14.708491+0000","last_active":"2023-10-03T10:09:14.710054+0000","last_peered":"2023-10-03T10:09:14.710054+0000","last_clean":"2023-10-03T10:09:14.710054+0000","last_became_active":"2023-10-03T10:09:14.705272+0000","last_became_peered":"2023-10-03T10:09:14.705272+0000","last_unstale":"2023-10-03T10:09:14.710054+0000","last_undegraded":"2023-10-03T10:09:14.710054+0000","last_fullsized":"2023-10-03T10:09:14.710054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721043+0000","last_change":"2023-10-03T10:09:14.713611+0000","last_active":"2023-10-03T10:09:14.721043+0000","last_peered":"2023-10-03T10:09:14.721043+0000","last_clean":"2023-10-03T10:09:14.721043+0000","last_became_active":"2023-10-03T10:09:14.713350+0000","last_became_peered":"2023-10-03T10:09:14.713350+0000","last_unstale":"2023-10-03T10:09:14.721043+0000","last_undegraded":"2023-10-03T10:09:14.721043+0000","last_fullsized":"2023-10-03T10:09:14.721043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719062+0000","last_change":"2023-10-03T10:09:14.717325+0000","last_active":"2023-10-03T10:09:14.719062+0000","last_peered":"2023-10-03T10:09:14.719062+0000","last_clean":"2023-10-03T10:09:14.719062+0000","last_became_active":"2023-10-03T10:09:14.717060+0000","last_became_peered":"2023-10-03T10:09:14.717060+0000","last_unstale":"2023-10-03T10:09:14.719062+0000","last_undegraded":"2023-10-03T10:09:14.719062+0000","last_fullsized":"2023-10-03T10:09:14.719062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721108+0000","last_change":"2023-10-03T10:09:14.713656+0000","last_active":"2023-10-03T10:09:14.721108+0000","last_peered":"2023-10-03T10:09:14.721108+0000","last_clean":"2023-10-03T10:09:14.721108+0000","last_became_active":"2023-10-03T10:09:14.711482+0000","last_became_peered":"2023-10-03T10:09:14.711482+0000","last_unstale":"2023-10-03T10:09:14.721108+0000","last_undegraded":"2023-10-03T10:09:14.721108+0000","last_fullsized":"2023-10-03T10:09:14.721108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.717202+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.716379+0000","last_became_peered":"2023-10-03T10:09:14.716379+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.728377+0000","last_change":"2023-10-03T10:09:14.723512+0000","last_active":"2023-10-03T10:09:14.728377+0000","last_peered":"2023-10-03T10:09:14.728377+0000","last_clean":"2023-10-03T10:09:14.728377+0000","last_became_active":"2023-10-03T10:09:14.723235+0000","last_became_peered":"2023-10-03T10:09:14.723235+0000","last_unstale":"2023-10-03T10:09:14.728377+0000","last_undegraded":"2023-10-03T10:09:14.728377+0000","last_fullsized":"2023-10-03T10:09:14.728377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727701+0000","last_change":"2023-10-03T10:09:14.718233+0000","last_active":"2023-10-03T10:09:14.727701+0000","last_peered":"2023-10-03T10:09:14.727701+0000","last_clean":"2023-10-03T10:09:14.727701+0000","last_became_active":"2023-10-03T10:09:14.717964+0000","last_became_peered":"2023-10-03T10:09:14.717964+0000","last_unstale":"2023-10-03T10:09:14.727701+0000","last_undegraded":"2023-10-03T10:09:14.727701+0000","last_fullsized":"2023-10-03T10:09:14.727701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727625+0000","last_change":"2023-10-03T10:09:14.721092+0000","last_active":"2023-10-03T10:09:14.727625+0000","last_peered":"2023-10-03T10:09:14.727625+0000","last_clean":"2023-10-03T10:09:14.727625+0000","last_became_active":"2023-10-03T10:09:14.720802+0000","last_became_peered":"2023-10-03T10:09:14.720802+0000","last_unstale":"2023-10-03T10:09:14.727625+0000","last_undegraded":"2023-10-03T10:09:14.727625+0000","last_fullsized":"2023-10-03T10:09:14.727625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721034+0000","last_change":"2023-10-03T10:09:14.712170+0000","last_active":"2023-10-03T10:09:14.721034+0000","last_peered":"2023-10-03T10:09:14.721034+0000","last_clean":"2023-10-03T10:09:14.721034+0000","last_became_active":"2023-10-03T10:09:14.711964+0000","last_became_peered":"2023-10-03T10:09:14.711964+0000","last_unstale":"2023-10-03T10:09:14.721034+0000","last_undegraded":"2023-10-03T10:09:14.721034+0000","last_fullsized":"2023-10-03T10:09:14.721034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719896+0000","last_change":"2023-10-03T10:09:14.717587+0000","last_active":"2023-10-03T10:09:14.719896+0000","last_peered":"2023-10-03T10:09:14.719896+0000","last_clean":"2023-10-03T10:09:14.719896+0000","last_became_active":"2023-10-03T10:09:14.717339+0000","last_became_peered":"2023-10-03T10:09:14.717339+0000","last_unstale":"2023-10-03T10:09:14.719896+0000","last_undegraded":"2023-10-03T10:09:14.719896+0000","last_fullsized":"2023-10-03T10:09:14.719896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730956+0000","last_change":"2023-10-03T10:09:14.728847+0000","last_active":"2023-10-03T10:09:14.730956+0000","last_peered":"2023-10-03T10:09:14.730956+0000","last_clean":"2023-10-03T10:09:14.730956+0000","last_became_active":"2023-10-03T10:09:14.725404+0000","last_became_peered":"2023-10-03T10:09:14.725404+0000","last_unstale":"2023-10-03T10:09:14.730956+0000","last_undegraded":"2023-10-03T10:09:14.730956+0000","last_fullsized":"2023-10-03T10:09:14.730956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727848+0000","last_change":"2023-10-03T10:09:14.718621+0000","last_active":"2023-10-03T10:09:14.727848+0000","last_peered":"2023-10-03T10:09:14.727848+0000","last_clean":"2023-10-03T10:09:14.727848+0000","last_became_active":"2023-10-03T10:09:14.718361+0000","last_became_peered":"2023-10-03T10:09:14.718361+0000","last_unstale":"2023-10-03T10:09:14.727848+0000","last_undegraded":"2023-10-03T10:09:14.727848+0000","last_fullsized":"2023-10-03T10:09:14.727848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710082+0000","last_change":"2023-10-03T10:09:14.707751+0000","last_active":"2023-10-03T10:09:14.710082+0000","last_peered":"2023-10-03T10:09:14.710082+0000","last_clean":"2023-10-03T10:09:14.710082+0000","last_became_active":"2023-10-03T10:09:14.707489+0000","last_became_peered":"2023-10-03T10:09:14.707489+0000","last_unstale":"2023-10-03T10:09:14.710082+0000","last_undegraded":"2023-10-03T10:09:14.710082+0000","last_fullsized":"2023-10-03T10:09:14.710082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731804+0000","last_change":"2023-10-03T10:09:14.724017+0000","last_active":"2023-10-03T10:09:14.731804+0000","last_peered":"2023-10-03T10:09:14.731804+0000","last_clean":"2023-10-03T10:09:14.731804+0000","last_became_active":"2023-10-03T10:09:14.723540+0000","last_became_peered":"2023-10-03T10:09:14.723540+0000","last_unstale":"2023-10-03T10:09:14.731804+0000","last_undegraded":"2023-10-03T10:09:14.731804+0000","last_fullsized":"2023-10-03T10:09:14.731804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710268+0000","last_change":"2023-10-03T10:09:14.354052+0000","last_active":"2023-10-03T10:09:14.710268+0000","last_peered":"2023-10-03T10:09:14.710268+0000","last_clean":"2023-10-03T10:09:14.710268+0000","last_became_active":"2023-10-03T10:09:14.353765+0000","last_became_peered":"2023-10-03T10:09:14.353765+0000","last_unstale":"2023-10-03T10:09:14.710268+0000","last_undegraded":"2023-10-03T10:09:14.710268+0000","last_fullsized":"2023-10-03T10:09:14.710268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734524+0000","last_change":"2023-10-03T10:09:14.731372+0000","last_active":"2023-10-03T10:09:14.734524+0000","last_peered":"2023-10-03T10:09:14.734524+0000","last_clean":"2023-10-03T10:09:14.734524+0000","last_became_active":"2023-10-03T10:09:14.730476+0000","last_became_peered":"2023-10-03T10:09:14.730476+0000","last_unstale":"2023-10-03T10:09:14.734524+0000","last_undegraded":"2023-10-03T10:09:14.734524+0000","last_fullsized":"2023-10-03T10:09:14.734524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699867+0000","last_change":"2023-10-03T10:09:14.340525+0000","last_active":"2023-10-03T10:09:14.699867+0000","last_peered":"2023-10-03T10:09:14.699867+0000","last_clean":"2023-10-03T10:09:14.699867+0000","last_became_active":"2023-10-03T10:09:14.340215+0000","last_became_peered":"2023-10-03T10:09:14.340215+0000","last_unstale":"2023-10-03T10:09:14.699867+0000","last_undegraded":"2023-10-03T10:09:14.699867+0000","last_fullsized":"2023-10-03T10:09:14.699867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721514+0000","last_change":"2023-10-03T10:09:14.717045+0000","last_active":"2023-10-03T10:09:14.721514+0000","last_peered":"2023-10-03T10:09:14.721514+0000","last_clean":"2023-10-03T10:09:14.721514+0000","last_became_active":"2023-10-03T10:09:14.716120+0000","last_became_peered":"2023-10-03T10:09:14.716120+0000","last_unstale":"2023-10-03T10:09:14.721514+0000","last_undegraded":"2023-10-03T10:09:14.721514+0000","last_fullsized":"2023-10-03T10:09:14.721514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.704177+0000","last_change":"2023-10-03T10:09:14.345802+0000","last_active":"2023-10-03T10:09:14.704177+0000","last_peered":"2023-10-03T10:09:14.704177+0000","last_clean":"2023-10-03T10:09:14.704177+0000","last_became_active":"2023-10-03T10:09:14.345529+0000","last_became_peered":"2023-10-03T10:09:14.345529+0000","last_unstale":"2023-10-03T10:09:14.704177+0000","last_undegraded":"2023-10-03T10:09:14.704177+0000","last_fullsized":"2023-10-03T10:09:14.704177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734388+0000","last_change":"2023-10-03T10:09:14.729797+0000","last_active":"2023-10-03T10:09:14.734388+0000","last_peered":"2023-10-03T10:09:14.734388+0000","last_clean":"2023-10-03T10:09:14.734388+0000","last_became_active":"2023-10-03T10:09:14.729212+0000","last_became_peered":"2023-10-03T10:09:14.729212+0000","last_unstale":"2023-10-03T10:09:14.734388+0000","last_undegraded":"2023-10-03T10:09:14.734388+0000","last_fullsized":"2023-10-03T10:09:14.734388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.692378+0000","last_change":"2023-10-03T10:09:14.343788+0000","last_active":"2023-10-03T10:09:14.692378+0000","last_peered":"2023-10-03T10:09:14.692378+0000","last_clean":"2023-10-03T10:09:14.692378+0000","last_became_active":"2023-10-03T10:09:14.343495+0000","last_became_peered":"2023-10-03T10:09:14.343495+0000","last_unstale":"2023-10-03T10:09:14.692378+0000","last_undegraded":"2023-10-03T10:09:14.692378+0000","last_fullsized":"2023-10-03T10:09:14.692378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734891+0000","last_change":"2023-10-03T10:09:14.734087+0000","last_active":"2023-10-03T10:09:14.734891+0000","last_peered":"2023-10-03T10:09:14.734891+0000","last_clean":"2023-10-03T10:09:14.734891+0000","last_became_active":"2023-10-03T10:09:14.733689+0000","last_became_peered":"2023-10-03T10:09:14.733689+0000","last_unstale":"2023-10-03T10:09:14.734891+0000","last_undegraded":"2023-10-03T10:09:14.734891+0000","last_fullsized":"2023-10-03T10:09:14.734891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695756+0000","last_change":"2023-10-03T10:09:14.339768+0000","last_active":"2023-10-03T10:09:14.695756+0000","last_peered":"2023-10-03T10:09:14.695756+0000","last_clean":"2023-10-03T10:09:14.695756+0000","last_became_active":"2023-10-03T10:09:14.339501+0000","last_became_peered":"2023-10-03T10:09:14.339501+0000","last_unstale":"2023-10-03T10:09:14.695756+0000","last_undegraded":"2023-10-03T10:09:14.695756+0000","last_fullsized":"2023-10-03T10:09:14.695756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729384+0000","last_change":"2023-10-03T10:09:14.723237+0000","last_active":"2023-10-03T10:09:14.729384+0000","last_peered":"2023-10-03T10:09:14.729384+0000","last_clean":"2023-10-03T10:09:14.729384+0000","last_became_active":"2023-10-03T10:09:14.722881+0000","last_became_peered":"2023-10-03T10:09:14.722881+0000","last_unstale":"2023-10-03T10:09:14.729384+0000","last_undegraded":"2023-10-03T10:09:14.729384+0000","last_fullsized":"2023-10-03T10:09:14.729384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715565+0000","last_change":"2023-10-03T10:09:14.339824+0000","last_active":"2023-10-03T10:09:14.715565+0000","last_peered":"2023-10-03T10:09:14.715565+0000","last_clean":"2023-10-03T10:09:14.715565+0000","last_became_active":"2023-10-03T10:09:14.339560+0000","last_became_peered":"2023-10-03T10:09:14.339560+0000","last_unstale":"2023-10-03T10:09:14.715565+0000","last_undegraded":"2023-10-03T10:09:14.715565+0000","last_fullsized":"2023-10-03T10:09:14.715565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727816+0000","last_change":"2023-10-03T10:09:14.721025+0000","last_active":"2023-10-03T10:09:14.727816+0000","last_peered":"2023-10-03T10:09:14.727816+0000","last_clean":"2023-10-03T10:09:14.727816+0000","last_became_active":"2023-10-03T10:09:14.720762+0000","last_became_peered":"2023-10-03T10:09:14.720762+0000","last_unstale":"2023-10-03T10:09:14.727816+0000","last_undegraded":"2023-10-03T10:09:14.727816+0000","last_fullsized":"2023-10-03T10:09:14.727816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731374+0000","last_change":"2023-10-03T10:09:14.346629+0000","last_active":"2023-10-03T10:09:14.731374+0000","last_peered":"2023-10-03T10:09:14.731374+0000","last_clean":"2023-10-03T10:09:14.731374+0000","last_became_active":"2023-10-03T10:09:14.346335+0000","last_became_peered":"2023-10-03T10:09:14.346335+0000","last_unstale":"2023-10-03T10:09:14.731374+0000","last_undegraded":"2023-10-03T10:09:14.731374+0000","last_fullsized":"2023-10-03T10:09:14.731374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730730+0000","last_change":"2023-10-03T10:09:14.724074+0000","last_active":"2023-10-03T10:09:14.730730+0000","last_peered":"2023-10-03T10:09:14.730730+0000","last_clean":"2023-10-03T10:09:14.730730+0000","last_became_active":"2023-10-03T10:09:14.723284+0000","last_became_peered":"2023-10-03T10:09:14.723284+0000","last_unstale":"2023-10-03T10:09:14.730730+0000","last_undegraded":"2023-10-03T10:09:14.730730+0000","last_fullsized":"2023-10-03T10:09:14.730730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.725102+0000","last_change":"2023-10-03T10:09:14.353282+0000","last_active":"2023-10-03T10:09:14.725102+0000","last_peered":"2023-10-03T10:09:14.725102+0000","last_clean":"2023-10-03T10:09:14.725102+0000","last_became_active":"2023-10-03T10:09:14.352586+0000","last_became_peered":"2023-10-03T10:09:14.352586+0000","last_unstale":"2023-10-03T10:09:14.725102+0000","last_undegraded":"2023-10-03T10:09:14.725102+0000","last_fullsized":"2023-10-03T10:09:14.725102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734301+0000","last_change":"2023-10-03T10:09:14.729509+0000","last_active":"2023-10-03T10:09:14.734301+0000","last_peered":"2023-10-03T10:09:14.734301+0000","last_clean":"2023-10-03T10:09:14.734301+0000","last_became_active":"2023-10-03T10:09:14.729254+0000","last_became_peered":"2023-10-03T10:09:14.729254+0000","last_unstale":"2023-10-03T10:09:14.734301+0000","last_undegraded":"2023-10-03T10:09:14.734301+0000","last_fullsized":"2023-10-03T10:09:14.734301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690235+0000","last_change":"2023-10-03T10:09:14.343728+0000","last_active":"2023-10-03T10:09:14.690235+0000","last_peered":"2023-10-03T10:09:14.690235+0000","last_clean":"2023-10-03T10:09:14.690235+0000","last_became_active":"2023-10-03T10:09:14.343444+0000","last_became_peered":"2023-10-03T10:09:14.343444+0000","last_unstale":"2023-10-03T10:09:14.690235+0000","last_undegraded":"2023-10-03T10:09:14.690235+0000","last_fullsized":"2023-10-03T10:09:14.690235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731815+0000","last_change":"2023-10-03T10:09:14.724168+0000","last_active":"2023-10-03T10:09:14.731815+0000","last_peered":"2023-10-03T10:09:14.731815+0000","last_clean":"2023-10-03T10:09:14.731815+0000","last_became_active":"2023-10-03T10:09:14.723777+0000","last_became_peered":"2023-10-03T10:09:14.723777+0000","last_unstale":"2023-10-03T10:09:14.731815+0000","last_undegraded":"2023-10-03T10:09:14.731815+0000","last_fullsized":"2023-10-03T10:09:14.731815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.705446+0000","last_change":"2023-10-03T10:09:14.346628+0000","last_active":"2023-10-03T10:09:14.705446+0000","last_peered":"2023-10-03T10:09:14.705446+0000","last_clean":"2023-10-03T10:09:14.705446+0000","last_became_active":"2023-10-03T10:09:14.346352+0000","last_became_peered":"2023-10-03T10:09:14.346352+0000","last_unstale":"2023-10-03T10:09:14.705446+0000","last_undegraded":"2023-10-03T10:09:14.705446+0000","last_fullsized":"2023-10-03T10:09:14.705446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721547+0000","last_change":"2023-10-03T10:09:14.717361+0000","last_active":"2023-10-03T10:09:14.721547+0000","last_peered":"2023-10-03T10:09:14.721547+0000","last_clean":"2023-10-03T10:09:14.721547+0000","last_became_active":"2023-10-03T10:09:14.716635+0000","last_became_peered":"2023-10-03T10:09:14.716635+0000","last_unstale":"2023-10-03T10:09:14.721547+0000","last_undegraded":"2023-10-03T10:09:14.721547+0000","last_fullsized":"2023-10-03T10:09:14.721547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.729991+0000","last_change":"2023-10-03T10:09:14.344594+0000","last_active":"2023-10-03T10:09:14.729991+0000","last_peered":"2023-10-03T10:09:14.729991+0000","last_clean":"2023-10-03T10:09:14.729991+0000","last_became_active":"2023-10-03T10:09:14.344319+0000","last_became_peered":"2023-10-03T10:09:14.344319+0000","last_unstale":"2023-10-03T10:09:14.729991+0000","last_undegraded":"2023-10-03T10:09:14.729991+0000","last_fullsized":"2023-10-03T10:09:14.729991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734410+0000","last_change":"2023-10-03T10:09:14.729964+0000","last_active":"2023-10-03T10:09:14.734410+0000","last_peered":"2023-10-03T10:09:14.734410+0000","last_clean":"2023-10-03T10:09:14.734410+0000","last_became_active":"2023-10-03T10:09:14.729548+0000","last_became_peered":"2023-10-03T10:09:14.729548+0000","last_unstale":"2023-10-03T10:09:14.734410+0000","last_undegraded":"2023-10-03T10:09:14.734410+0000","last_fullsized":"2023-10-03T10:09:14.734410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731124+0000","last_change":"2023-10-03T10:09:14.344297+0000","last_active":"2023-10-03T10:09:14.731124+0000","last_peered":"2023-10-03T10:09:14.731124+0000","last_clean":"2023-10-03T10:09:14.731124+0000","last_became_active":"2023-10-03T10:09:14.344040+0000","last_became_peered":"2023-10-03T10:09:14.344040+0000","last_unstale":"2023-10-03T10:09:14.731124+0000","last_undegraded":"2023-10-03T10:09:14.731124+0000","last_fullsized":"2023-10-03T10:09:14.731124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734907+0000","last_change":"2023-10-03T10:09:14.734141+0000","last_active":"2023-10-03T10:09:14.734907+0000","last_peered":"2023-10-03T10:09:14.734907+0000","last_clean":"2023-10-03T10:09:14.734907+0000","last_became_active":"2023-10-03T10:09:14.733955+0000","last_became_peered":"2023-10-03T10:09:14.733955+0000","last_unstale":"2023-10-03T10:09:14.734907+0000","last_undegraded":"2023-10-03T10:09:14.734907+0000","last_fullsized":"2023-10-03T10:09:14.734907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720183+0000","last_change":"2023-10-03T10:09:14.345399+0000","last_active":"2023-10-03T10:09:14.720183+0000","last_peered":"2023-10-03T10:09:14.720183+0000","last_clean":"2023-10-03T10:09:14.720183+0000","last_became_active":"2023-10-03T10:09:14.345110+0000","last_became_peered":"2023-10-03T10:09:14.345110+0000","last_unstale":"2023-10-03T10:09:14.720183+0000","last_undegraded":"2023-10-03T10:09:14.720183+0000","last_fullsized":"2023-10-03T10:09:14.720183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727567+0000","last_change":"2023-10-03T10:09:14.716249+0000","last_active":"2023-10-03T10:09:14.727567+0000","last_peered":"2023-10-03T10:09:14.727567+0000","last_clean":"2023-10-03T10:09:14.727567+0000","last_became_active":"2023-10-03T10:09:14.715990+0000","last_became_peered":"2023-10-03T10:09:14.715990+0000","last_unstale":"2023-10-03T10:09:14.727567+0000","last_undegraded":"2023-10-03T10:09:14.727567+0000","last_fullsized":"2023-10-03T10:09:14.727567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.731734+0000","last_change":"2023-10-03T10:09:14.345375+0000","last_active":"2023-10-03T10:09:14.731734+0000","last_peered":"2023-10-03T10:09:14.731734+0000","last_clean":"2023-10-03T10:09:14.731734+0000","last_became_active":"2023-10-03T10:09:14.343897+0000","last_became_peered":"2023-10-03T10:09:14.343897+0000","last_unstale":"2023-10-03T10:09:14.731734+0000","last_undegraded":"2023-10-03T10:09:14.731734+0000","last_fullsized":"2023-10-03T10:09:14.731734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721530+0000","last_change":"2023-10-03T10:09:14.715812+0000","last_active":"2023-10-03T10:09:14.721530+0000","last_peered":"2023-10-03T10:09:14.721530+0000","last_clean":"2023-10-03T10:09:14.721530+0000","last_became_active":"2023-10-03T10:09:14.715548+0000","last_became_peered":"2023-10-03T10:09:14.715548+0000","last_unstale":"2023-10-03T10:09:14.721530+0000","last_undegraded":"2023-10-03T10:09:14.721530+0000","last_fullsized":"2023-10-03T10:09:14.721530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690536+0000","last_change":"2023-10-03T10:09:14.343714+0000","last_active":"2023-10-03T10:09:14.690536+0000","last_peered":"2023-10-03T10:09:14.690536+0000","last_clean":"2023-10-03T10:09:14.690536+0000","last_became_active":"2023-10-03T10:09:14.343419+0000","last_became_peered":"2023-10-03T10:09:14.343419+0000","last_unstale":"2023-10-03T10:09:14.690536+0000","last_undegraded":"2023-10-03T10:09:14.690536+0000","last_fullsized":"2023-10-03T10:09:14.690536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722064+0000","last_change":"2023-10-03T10:09:14.710007+0000","last_active":"2023-10-03T10:09:14.722064+0000","last_peered":"2023-10-03T10:09:14.722064+0000","last_clean":"2023-10-03T10:09:14.722064+0000","last_became_active":"2023-10-03T10:09:14.708147+0000","last_became_peered":"2023-10-03T10:09:14.708147+0000","last_unstale":"2023-10-03T10:09:14.722064+0000","last_undegraded":"2023-10-03T10:09:14.722064+0000","last_fullsized":"2023-10-03T10:09:14.722064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724797+0000","last_change":"2023-10-03T10:09:14.353447+0000","last_active":"2023-10-03T10:09:14.724797+0000","last_peered":"2023-10-03T10:09:14.724797+0000","last_clean":"2023-10-03T10:09:14.724797+0000","last_became_active":"2023-10-03T10:09:14.352906+0000","last_became_peered":"2023-10-03T10:09:14.352906+0000","last_unstale":"2023-10-03T10:09:14.724797+0000","last_undegraded":"2023-10-03T10:09:14.724797+0000","last_fullsized":"2023-10-03T10:09:14.724797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.720993+0000","last_change":"2023-10-03T10:09:14.711315+0000","last_active":"2023-10-03T10:09:14.720993+0000","last_peered":"2023-10-03T10:09:14.720993+0000","last_clean":"2023-10-03T10:09:14.720993+0000","last_became_active":"2023-10-03T10:09:14.711126+0000","last_became_peered":"2023-10-03T10:09:14.711126+0000","last_unstale":"2023-10-03T10:09:14.720993+0000","last_undegraded":"2023-10-03T10:09:14.720993+0000","last_fullsized":"2023-10-03T10:09:14.720993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700797+0000","last_change":"2023-10-03T10:09:14.347268+0000","last_active":"2023-10-03T10:09:14.700797+0000","last_peered":"2023-10-03T10:09:14.700797+0000","last_clean":"2023-10-03T10:09:14.700797+0000","last_became_active":"2023-10-03T10:09:14.346969+0000","last_became_peered":"2023-10-03T10:09:14.346969+0000","last_unstale":"2023-10-03T10:09:14.700797+0000","last_undegraded":"2023-10-03T10:09:14.700797+0000","last_fullsized":"2023-10-03T10:09:14.700797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734541+0000","last_change":"2023-10-03T10:09:14.731503+0000","last_active":"2023-10-03T10:09:14.734541+0000","last_peered":"2023-10-03T10:09:14.734541+0000","last_clean":"2023-10-03T10:09:14.734541+0000","last_became_active":"2023-10-03T10:09:14.730811+0000","last_became_peered":"2023-10-03T10:09:14.730811+0000","last_unstale":"2023-10-03T10:09:14.734541+0000","last_undegraded":"2023-10-03T10:09:14.734541+0000","last_fullsized":"2023-10-03T10:09:14.734541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703830+0000","last_change":"2023-10-03T10:09:14.346668+0000","last_active":"2023-10-03T10:09:14.703830+0000","last_peered":"2023-10-03T10:09:14.703830+0000","last_clean":"2023-10-03T10:09:14.703830+0000","last_became_active":"2023-10-03T10:09:14.346390+0000","last_became_peered":"2023-10-03T10:09:14.346390+0000","last_unstale":"2023-10-03T10:09:14.703830+0000","last_undegraded":"2023-10-03T10:09:14.703830+0000","last_fullsized":"2023-10-03T10:09:14.703830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723208+0000","last_change":"2023-10-03T10:09:14.716337+0000","last_active":"2023-10-03T10:09:14.723208+0000","last_peered":"2023-10-03T10:09:14.723208+0000","last_clean":"2023-10-03T10:09:14.723208+0000","last_became_active":"2023-10-03T10:09:14.716083+0000","last_became_peered":"2023-10-03T10:09:14.716083+0000","last_unstale":"2023-10-03T10:09:14.723208+0000","last_undegraded":"2023-10-03T10:09:14.723208+0000","last_fullsized":"2023-10-03T10:09:14.723208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703747+0000","last_change":"2023-10-03T10:09:14.344515+0000","last_active":"2023-10-03T10:09:14.703747+0000","last_peered":"2023-10-03T10:09:14.703747+0000","last_clean":"2023-10-03T10:09:14.703747+0000","last_became_active":"2023-10-03T10:09:14.344244+0000","last_became_peered":"2023-10-03T10:09:14.344244+0000","last_unstale":"2023-10-03T10:09:14.703747+0000","last_undegraded":"2023-10-03T10:09:14.703747+0000","last_fullsized":"2023-10-03T10:09:14.703747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727919+0000","last_change":"2023-10-03T10:09:14.723005+0000","last_active":"2023-10-03T10:09:14.727919+0000","last_peered":"2023-10-03T10:09:14.727919+0000","last_clean":"2023-10-03T10:09:14.727919+0000","last_became_active":"2023-10-03T10:09:14.720579+0000","last_became_peered":"2023-10-03T10:09:14.720579+0000","last_unstale":"2023-10-03T10:09:14.727919+0000","last_undegraded":"2023-10-03T10:09:14.727919+0000","last_fullsized":"2023-10-03T10:09:14.727919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700288+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:09:14.700288+0000","last_peered":"2023-10-03T10:09:14.700288+0000","last_clean":"2023-10-03T10:09:14.700288+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:09:14.700288+0000","last_undegraded":"2023-10-03T10:09:14.700288+0000","last_fullsized":"2023-10-03T10:09:14.700288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695969+0000","last_change":"2023-10-03T10:09:14.344817+0000","last_active":"2023-10-03T10:09:14.695969+0000","last_peered":"2023-10-03T10:09:14.695969+0000","last_clean":"2023-10-03T10:09:14.695969+0000","last_became_active":"2023-10-03T10:09:14.344547+0000","last_became_peered":"2023-10-03T10:09:14.344547+0000","last_unstale":"2023-10-03T10:09:14.695969+0000","last_undegraded":"2023-10-03T10:09:14.695969+0000","last_fullsized":"2023-10-03T10:09:14.695969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.727798+0000","last_change":"2023-10-03T10:09:14.721039+0000","last_active":"2023-10-03T10:09:14.727798+0000","last_peered":"2023-10-03T10:09:14.727798+0000","last_clean":"2023-10-03T10:09:14.727798+0000","last_became_active":"2023-10-03T10:09:14.720876+0000","last_became_peered":"2023-10-03T10:09:14.720876+0000","last_unstale":"2023-10-03T10:09:14.727798+0000","last_undegraded":"2023-10-03T10:09:14.727798+0000","last_fullsized":"2023-10-03T10:09:14.727798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703725+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:09:14.703725+0000","last_peered":"2023-10-03T10:09:14.703725+0000","last_clean":"2023-10-03T10:09:14.703725+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:09:14.703725+0000","last_undegraded":"2023-10-03T10:09:14.703725+0000","last_fullsized":"2023-10-03T10:09:14.703725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.690358+0000","last_change":"2023-10-03T10:09:14.351814+0000","last_active":"2023-10-03T10:09:14.690358+0000","last_peered":"2023-10-03T10:09:14.690358+0000","last_clean":"2023-10-03T10:09:14.690358+0000","last_became_active":"2023-10-03T10:09:14.351588+0000","last_became_peered":"2023-10-03T10:09:14.351588+0000","last_unstale":"2023-10-03T10:09:14.690358+0000","last_undegraded":"2023-10-03T10:09:14.690358+0000","last_fullsized":"2023-10-03T10:09:14.690358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710632+0000","last_change":"2023-10-03T10:09:14.708011+0000","last_active":"2023-10-03T10:09:14.710632+0000","last_peered":"2023-10-03T10:09:14.710632+0000","last_clean":"2023-10-03T10:09:14.710632+0000","last_became_active":"2023-10-03T10:09:14.707425+0000","last_became_peered":"2023-10-03T10:09:14.707425+0000","last_unstale":"2023-10-03T10:09:14.710632+0000","last_undegraded":"2023-10-03T10:09:14.710632+0000","last_fullsized":"2023-10-03T10:09:14.710632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.695432+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:09:14.695432+0000","last_peered":"2023-10-03T10:09:14.695432+0000","last_clean":"2023-10-03T10:09:14.695432+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:09:14.695432+0000","last_undegraded":"2023-10-03T10:09:14.695432+0000","last_fullsized":"2023-10-03T10:09:14.695432+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699908+0000","last_change":"2023-10-03T10:09:14.351636+0000","last_active":"2023-10-03T10:09:14.699908+0000","last_peered":"2023-10-03T10:09:14.699908+0000","last_clean":"2023-10-03T10:09:14.699908+0000","last_became_active":"2023-10-03T10:09:14.351360+0000","last_became_peered":"2023-10-03T10:09:14.351360+0000","last_unstale":"2023-10-03T10:09:14.699908+0000","last_undegraded":"2023-10-03T10:09:14.699908+0000","last_fullsized":"2023-10-03T10:09:14.699908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730928+0000","last_change":"2023-10-03T10:09:14.726543+0000","last_active":"2023-10-03T10:09:14.730928+0000","last_peered":"2023-10-03T10:09:14.730928+0000","last_clean":"2023-10-03T10:09:14.730928+0000","last_became_active":"2023-10-03T10:09:14.726287+0000","last_became_peered":"2023-10-03T10:09:14.726287+0000","last_unstale":"2023-10-03T10:09:14.730928+0000","last_undegraded":"2023-10-03T10:09:14.730928+0000","last_fullsized":"2023-10-03T10:09:14.730928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711633+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:09:14.711633+0000","last_peered":"2023-10-03T10:09:14.711633+0000","last_clean":"2023-10-03T10:09:14.711633+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:09:14.711633+0000","last_undegraded":"2023-10-03T10:09:14.711633+0000","last_fullsized":"2023-10-03T10:09:14.711633+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.699816+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:09:14.699816+0000","last_peered":"2023-10-03T10:09:14.699816+0000","last_clean":"2023-10-03T10:09:14.699816+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:09:14.699816+0000","last_undegraded":"2023-10-03T10:09:14.699816+0000","last_fullsized":"2023-10-03T10:09:14.699816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700703+0000","last_change":"2023-10-03T10:09:14.347133+0000","last_active":"2023-10-03T10:09:14.700703+0000","last_peered":"2023-10-03T10:09:14.700703+0000","last_clean":"2023-10-03T10:09:14.700703+0000","last_became_active":"2023-10-03T10:09:14.346671+0000","last_became_peered":"2023-10-03T10:09:14.346671+0000","last_unstale":"2023-10-03T10:09:14.700703+0000","last_undegraded":"2023-10-03T10:09:14.700703+0000","last_fullsized":"2023-10-03T10:09:14.700703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734555+0000","last_change":"2023-10-03T10:09:14.731621+0000","last_active":"2023-10-03T10:09:14.734555+0000","last_peered":"2023-10-03T10:09:14.734555+0000","last_clean":"2023-10-03T10:09:14.734555+0000","last_became_active":"2023-10-03T10:09:14.731155+0000","last_became_peered":"2023-10-03T10:09:14.731155+0000","last_unstale":"2023-10-03T10:09:14.734555+0000","last_undegraded":"2023-10-03T10:09:14.734555+0000","last_fullsized":"2023-10-03T10:09:14.734555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.703928+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:09:14.703928+0000","last_peered":"2023-10-03T10:09:14.703928+0000","last_clean":"2023-10-03T10:09:14.703928+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:09:14.703928+0000","last_undegraded":"2023-10-03T10:09:14.703928+0000","last_fullsized":"2023-10-03T10:09:14.703928+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.689385+0000","last_change":"2023-10-03T10:09:14.345534+0000","last_active":"2023-10-03T10:09:14.689385+0000","last_peered":"2023-10-03T10:09:14.689385+0000","last_clean":"2023-10-03T10:09:14.689385+0000","last_became_active":"2023-10-03T10:09:14.344896+0000","last_became_peered":"2023-10-03T10:09:14.344896+0000","last_unstale":"2023-10-03T10:09:14.689385+0000","last_undegraded":"2023-10-03T10:09:14.689385+0000","last_fullsized":"2023-10-03T10:09:14.689385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721494+0000","last_change":"2023-10-03T10:09:14.716877+0000","last_active":"2023-10-03T10:09:14.721494+0000","last_peered":"2023-10-03T10:09:14.721494+0000","last_clean":"2023-10-03T10:09:14.721494+0000","last_became_active":"2023-10-03T10:09:14.715861+0000","last_became_peered":"2023-10-03T10:09:14.715861+0000","last_unstale":"2023-10-03T10:09:14.721494+0000","last_undegraded":"2023-10-03T10:09:14.721494+0000","last_fullsized":"2023-10-03T10:09:14.721494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709500+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:09:14.709500+0000","last_peered":"2023-10-03T10:09:14.709500+0000","last_clean":"2023-10-03T10:09:14.709500+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:09:14.709500+0000","last_undegraded":"2023-10-03T10:09:14.709500+0000","last_fullsized":"2023-10-03T10:09:14.709500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.700064+0000","last_change":"2023-10-03T10:09:14.352568+0000","last_active":"2023-10-03T10:09:14.700064+0000","last_peered":"2023-10-03T10:09:14.700064+0000","last_clean":"2023-10-03T10:09:14.700064+0000","last_became_active":"2023-10-03T10:09:14.352349+0000","last_became_peered":"2023-10-03T10:09:14.352349+0000","last_unstale":"2023-10-03T10:09:14.700064+0000","last_undegraded":"2023-10-03T10:09:14.700064+0000","last_fullsized":"2023-10-03T10:09:14.700064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722084+0000","last_change":"2023-10-03T10:09:14.710656+0000","last_active":"2023-10-03T10:09:14.722084+0000","last_peered":"2023-10-03T10:09:14.722084+0000","last_clean":"2023-10-03T10:09:14.722084+0000","last_became_active":"2023-10-03T10:09:14.710425+0000","last_became_peered":"2023-10-03T10:09:14.710425+0000","last_unstale":"2023-10-03T10:09:14.722084+0000","last_undegraded":"2023-10-03T10:09:14.722084+0000","last_fullsized":"2023-10-03T10:09:14.722084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730248+0000","last_change":"2023-10-03T10:09:14.346884+0000","last_active":"2023-10-03T10:09:14.730248+0000","last_peered":"2023-10-03T10:09:14.730248+0000","last_clean":"2023-10-03T10:09:14.730248+0000","last_became_active":"2023-10-03T10:09:14.346598+0000","last_became_peered":"2023-10-03T10:09:14.346598+0000","last_unstale":"2023-10-03T10:09:14.730248+0000","last_undegraded":"2023-10-03T10:09:14.730248+0000","last_fullsized":"2023-10-03T10:09:14.730248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.701425+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:09:14.701425+0000","last_peered":"2023-10-03T10:09:14.701425+0000","last_clean":"2023-10-03T10:09:14.701425+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:09:14.701425+0000","last_undegraded":"2023-10-03T10:09:14.701425+0000","last_fullsized":"2023-10-03T10:09:14.701425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734872+0000","last_change":"2023-10-03T10:09:14.733924+0000","last_active":"2023-10-03T10:09:14.734872+0000","last_peered":"2023-10-03T10:09:14.734872+0000","last_clean":"2023-10-03T10:09:14.734872+0000","last_became_active":"2023-10-03T10:09:14.733635+0000","last_became_peered":"2023-10-03T10:09:14.733635+0000","last_unstale":"2023-10-03T10:09:14.734872+0000","last_undegraded":"2023-10-03T10:09:14.734872+0000","last_fullsized":"2023-10-03T10:09:14.734872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.709169+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:09:14.709169+0000","last_peered":"2023-10-03T10:09:14.709169+0000","last_clean":"2023-10-03T10:09:14.709169+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:09:14.709169+0000","last_undegraded":"2023-10-03T10:09:14.709169+0000","last_fullsized":"2023-10-03T10:09:14.709169+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:09:17.450630+0000","last_change":"2023-10-03T10:09:14.350895+0000","last_active":"2023-10-03T10:09:17.450630+0000","last_peered":"2023-10-03T10:09:17.450630+0000","last_clean":"2023-10-03T10:09:17.450630+0000","last_became_active":"2023-10-03T10:09:14.350426+0000","last_became_peered":"2023-10-03T10:09:14.350426+0000","last_unstale":"2023-10-03T10:09:17.450630+0000","last_undegraded":"2023-10-03T10:09:17.450630+0000","last_fullsized":"2023-10-03T10:09:17.450630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715702+0000","last_change":"2023-10-03T10:09:14.714464+0000","last_active":"2023-10-03T10:09:14.715702+0000","last_peered":"2023-10-03T10:09:14.715702+0000","last_clean":"2023-10-03T10:09:14.715702+0000","last_became_active":"2023-10-03T10:09:14.714221+0000","last_became_peered":"2023-10-03T10:09:14.714221+0000","last_unstale":"2023-10-03T10:09:14.715702+0000","last_undegraded":"2023-10-03T10:09:14.715702+0000","last_fullsized":"2023-10-03T10:09:14.715702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.719633+0000","last_change":"2023-10-03T10:09:14.351366+0000","last_active":"2023-10-03T10:09:14.719633+0000","last_peered":"2023-10-03T10:09:14.719633+0000","last_clean":"2023-10-03T10:09:14.719633+0000","last_became_active":"2023-10-03T10:09:14.350445+0000","last_became_peered":"2023-10-03T10:09:14.350445+0000","last_unstale":"2023-10-03T10:09:14.719633+0000","last_undegraded":"2023-10-03T10:09:14.719633+0000","last_fullsized":"2023-10-03T10:09:14.719633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.712724+0000","last_change":"2023-10-03T10:09:14.707995+0000","last_active":"2023-10-03T10:09:14.712724+0000","last_peered":"2023-10-03T10:09:14.712724+0000","last_clean":"2023-10-03T10:09:14.712724+0000","last_became_active":"2023-10-03T10:09:14.707723+0000","last_became_peered":"2023-10-03T10:09:14.707723+0000","last_unstale":"2023-10-03T10:09:14.712724+0000","last_undegraded":"2023-10-03T10:09:14.712724+0000","last_fullsized":"2023-10-03T10:09:14.712724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714950+0000","last_change":"2023-10-03T10:09:14.345357+0000","last_active":"2023-10-03T10:09:14.714950+0000","last_peered":"2023-10-03T10:09:14.714950+0000","last_clean":"2023-10-03T10:09:14.714950+0000","last_became_active":"2023-10-03T10:09:14.344951+0000","last_became_peered":"2023-10-03T10:09:14.344951+0000","last_unstale":"2023-10-03T10:09:14.714950+0000","last_undegraded":"2023-10-03T10:09:14.714950+0000","last_fullsized":"2023-10-03T10:09:14.714950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730690+0000","last_change":"2023-10-03T10:09:14.724291+0000","last_active":"2023-10-03T10:09:14.730690+0000","last_peered":"2023-10-03T10:09:14.730690+0000","last_clean":"2023-10-03T10:09:14.730690+0000","last_became_active":"2023-10-03T10:09:14.723559+0000","last_became_peered":"2023-10-03T10:09:14.723559+0000","last_unstale":"2023-10-03T10:09:14.730690+0000","last_undegraded":"2023-10-03T10:09:14.730690+0000","last_fullsized":"2023-10-03T10:09:14.730690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.724427+0000","last_change":"2023-10-03T10:09:14.345918+0000","last_active":"2023-10-03T10:09:14.724427+0000","last_peered":"2023-10-03T10:09:14.724427+0000","last_clean":"2023-10-03T10:09:14.724427+0000","last_became_active":"2023-10-03T10:09:14.345634+0000","last_became_peered":"2023-10-03T10:09:14.345634+0000","last_unstale":"2023-10-03T10:09:14.724427+0000","last_undegraded":"2023-10-03T10:09:14.724427+0000","last_fullsized":"2023-10-03T10:09:14.724427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.722402+0000","last_change":"2023-10-03T10:09:14.718860+0000","last_active":"2023-10-03T10:09:14.722402+0000","last_peered":"2023-10-03T10:09:14.722402+0000","last_clean":"2023-10-03T10:09:14.722402+0000","last_became_active":"2023-10-03T10:09:14.716545+0000","last_became_peered":"2023-10-03T10:09:14.716545+0000","last_unstale":"2023-10-03T10:09:14.722402+0000","last_undegraded":"2023-10-03T10:09:14.722402+0000","last_fullsized":"2023-10-03T10:09:14.722402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.711557+0000","last_change":"2023-10-03T10:09:14.351568+0000","last_active":"2023-10-03T10:09:14.711557+0000","last_peered":"2023-10-03T10:09:14.711557+0000","last_clean":"2023-10-03T10:09:14.711557+0000","last_became_active":"2023-10-03T10:09:14.351293+0000","last_became_peered":"2023-10-03T10:09:14.351293+0000","last_unstale":"2023-10-03T10:09:14.711557+0000","last_undegraded":"2023-10-03T10:09:14.711557+0000","last_fullsized":"2023-10-03T10:09:14.711557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.723070+0000","last_change":"2023-10-03T10:09:14.720328+0000","last_active":"2023-10-03T10:09:14.723070+0000","last_peered":"2023-10-03T10:09:14.723070+0000","last_clean":"2023-10-03T10:09:14.723070+0000","last_became_active":"2023-10-03T10:09:14.720033+0000","last_became_peered":"2023-10-03T10:09:14.720033+0000","last_unstale":"2023-10-03T10:09:14.723070+0000","last_undegraded":"2023-10-03T10:09:14.723070+0000","last_fullsized":"2023-10-03T10:09:14.723070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.714114+0000","last_change":"2023-10-03T10:09:14.352301+0000","last_active":"2023-10-03T10:09:14.714114+0000","last_peered":"2023-10-03T10:09:14.714114+0000","last_clean":"2023-10-03T10:09:14.714114+0000","last_became_active":"2023-10-03T10:09:14.352027+0000","last_became_peered":"2023-10-03T10:09:14.352027+0000","last_unstale":"2023-10-03T10:09:14.714114+0000","last_undegraded":"2023-10-03T10:09:14.714114+0000","last_fullsized":"2023-10-03T10:09:14.714114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.715738+0000","last_change":"2023-10-03T10:09:14.713576+0000","last_active":"2023-10-03T10:09:14.715738+0000","last_peered":"2023-10-03T10:09:14.715738+0000","last_clean":"2023-10-03T10:09:14.715738+0000","last_became_active":"2023-10-03T10:09:14.713175+0000","last_became_peered":"2023-10-03T10:09:14.713175+0000","last_unstale":"2023-10-03T10:09:14.715738+0000","last_undegraded":"2023-10-03T10:09:14.715738+0000","last_fullsized":"2023-10-03T10:09:14.715738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.730038+0000","last_change":"2023-10-03T10:09:14.712406+0000","last_active":"2023-10-03T10:09:14.730038+0000","last_peered":"2023-10-03T10:09:14.730038+0000","last_clean":"2023-10-03T10:09:14.730038+0000","last_became_active":"2023-10-03T10:09:14.712076+0000","last_became_peered":"2023-10-03T10:09:14.712076+0000","last_unstale":"2023-10-03T10:09:14.730038+0000","last_undegraded":"2023-10-03T10:09:14.730038+0000","last_fullsized":"2023-10-03T10:09:14.730038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.733844+0000","last_change":"2023-10-03T10:09:14.729293+0000","last_active":"2023-10-03T10:09:14.733844+0000","last_peered":"2023-10-03T10:09:14.733844+0000","last_clean":"2023-10-03T10:09:14.733844+0000","last_became_active":"2023-10-03T10:09:14.729022+0000","last_became_peered":"2023-10-03T10:09:14.729022+0000","last_unstale":"2023-10-03T10:09:14.733844+0000","last_undegraded":"2023-10-03T10:09:14.733844+0000","last_fullsized":"2023-10-03T10:09:14.733844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.721016+0000","last_change":"2023-10-03T10:09:14.710814+0000","last_active":"2023-10-03T10:09:14.721016+0000","last_peered":"2023-10-03T10:09:14.721016+0000","last_clean":"2023-10-03T10:09:14.721016+0000","last_became_active":"2023-10-03T10:09:14.710640+0000","last_became_peered":"2023-10-03T10:09:14.710640+0000","last_unstale":"2023-10-03T10:09:14.721016+0000","last_undegraded":"2023-10-03T10:09:14.721016+0000","last_fullsized":"2023-10-03T10:09:14.721016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.734690+0000","last_change":"2023-10-03T10:09:14.732180+0000","last_active":"2023-10-03T10:09:14.734690+0000","last_peered":"2023-10-03T10:09:14.734690+0000","last_clean":"2023-10-03T10:09:14.734690+0000","last_became_active":"2023-10-03T10:09:14.731970+0000","last_became_peered":"2023-10-03T10:09:14.731970+0000","last_unstale":"2023-10-03T10:09:14.734690+0000","last_undegraded":"2023-10-03T10:09:14.734690+0000","last_fullsized":"2023-10-03T10:09:14.734690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:14.710652+0000","last_change":"2023-10-03T10:09:14.708167+0000","last_active":"2023-10-03T10:09:14.710652+0000","last_peered":"2023-10-03T10:09:14.710652+0000","last_clean":"2023-10-03T10:09:14.710652+0000","last_became_active":"2023-10-03T10:09:14.707761+0000","last_became_peered":"2023-10-03T10:09:14.707761+0000","last_unstale":"2023-10-03T10:09:14.710652+0000","last_undegraded":"2023-10-03T10:09:14.710652+0000","last_fullsized":"2023-10-03T10:09:14.710652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:27.316 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:09:27.316 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:09:27.316 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:09:27.316 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:09:27.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 Processor -- start 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 -- start start 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9a4130990 0x7fc9a4132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40964f0 con 0x7fc9a40985e0 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40994b0 con 0x7fc9a4130990 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.465+0000 7fc9a94d7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a409a3f0 con 0x7fc9a40990d0 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55350/0 (socket says 172.21.15.125:55350) 2023-10-03T10:09:27.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 -- 172.21.15.125:0/1248883684 learned_addr learned my addr 172.21.15.125:0/1248883684 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/1248883684 >> v2:172.21.15.125:3300/0 conn(0x7fc9a4130990 0x7fc9a4132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 -- 172.21.15.125:0/1248883684 >> v2:172.21.15.125:3300/0 conn(0x7fc9a4130990 msgr2=0x7fc9a4132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 --2- 172.21.15.125:0/1248883684 >> v2:172.21.15.125:3300/0 conn(0x7fc9a4130990 0x7fc9a4132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 -- 172.21.15.125:0/1248883684 >> v1:172.21.15.125:6789/0 conn(0x7fc9a40985e0 legacy=0x7fc9a40989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 -- 172.21.15.125:0/1248883684 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4095100 con 0x7fc9a40990d0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a27fc700 1 --2- 172.21.15.125:0/1248883684 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc994006fd0 tx=0x7fc9940090f0).ready entity=mon.2 client_cookie=383ea768d1c7dc58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/1248883684 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400b580 con 0x7fc9a40990d0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/1248883684 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400b6e0 con 0x7fc9a40990d0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.466+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/1248883684 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ba80 con 0x7fc9a40990d0 2023-10-03T10:09:27.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1248883684 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 msgr2=0x7fc9a41304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1248883684 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc994006fd0 tx=0x7fc9940090f0).stop 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1248883684 shutdown_connections 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1248883684 >> v2:172.21.15.125:3300/0 conn(0x7fc9a4130990 0x7fc9a4132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1248883684 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40990d0 0x7fc9a41304a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1248883684 >> 172.21.15.125:0/1248883684 conn(0x7fc9a409dc40 msgr2=0x7fc9a409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1248883684 shutdown_connections 2023-10-03T10:09:27.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.467+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1248883684 wait complete. 2023-10-03T10:09:27.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 Processor -- start 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 -- start start 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 0x7fc9a41182d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9a40990d0 0x7fc9a41187c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 0x7fc9a4118cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4119ff0 con 0x7fc9a4130990 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a409d1e0 con 0x7fc9a40990d0 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a94d7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a409a0f0 con 0x7fc9a40985e0 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 0x7fc9a41182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 0x7fc9a4118cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9a40990d0 0x7fc9a41187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 0x7fc9a41182d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55362/0 (socket says 172.21.15.125:55362) 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a2ffd700 1 -- 172.21.15.125:0/1979398868 learned_addr learned my addr 172.21.15.125:0/1979398868 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a37fe700 1 -- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 msgr2=0x7fc9a41182d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.468+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 0x7fc9a41182d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a37fe700 1 -- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9a40990d0 msgr2=0x7fc9a41187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9a40990d0 0x7fc9a41187c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a37fe700 1 -- 172.21.15.125:0/1979398868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009370 con 0x7fc9a4130990 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 0x7fc9a4118cb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc9a40955f0 tx=0x7fc99c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c009bb0 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00f040 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a411bb10 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00ccd0 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a411a5f0 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.469+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc99c013610 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.470+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc99c03b6c0 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.470+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a411b740 con 0x7fc9a4130990 2023-10-03T10:09:27.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.474+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc99c007750 con 0x7fc9a4130990 2023-10-03T10:09:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.666+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc9a405a260 con 0x7fc9a4130990 2023-10-03T10:09:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.666+0000 7fc98affd700 1 -- 172.21.15.125:0/1979398868 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fc99c007340 con 0x7fc9a4130990 2023-10-03T10:09:27.667 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 >> v1:172.21.15.125:6816/118167 conn(0x7fc99002bb60 legacy=0x7fc99002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 msgr2=0x7fc9a4118cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 0x7fc9a4118cb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc9a40955f0 tx=0x7fc99c00b040).stop 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 shutdown_connections 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a4130990 0x7fc9a4118cb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9a40985e0 0x7fc9a41182d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 --2- 172.21.15.125:0/1979398868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9a40990d0 0x7fc9a41187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 >> 172.21.15.125:0/1979398868 conn(0x7fc9a409dc40 msgr2=0x7fc9a412e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 shutdown_connections 2023-10-03T10:09:27.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.668+0000 7fc9a94d7700 1 -- 172.21.15.125:0/1979398868 wait complete. 2023-10-03T10:09:27.680 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:09:27.680 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:09:27.681 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.796+0000 7f1a1946e700 1 Processor -- start 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.796+0000 7f1a1946e700 1 -- start start 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a1946e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 0x7f1a14095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a1946e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a1946e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a14094ba0 con 0x7f1a14095c50 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a1946e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a14092e90 con 0x7f1a1412d250 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a1946e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14096b60 con 0x7f1a14093950 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a137fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 0x7f1a14095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a137fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42074/0 (socket says 172.21.15.125:42074) 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a127fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1a14095c50 0x7f1a14096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43692/0 (socket says 172.21.15.125:43692) 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a137fe700 1 -- 172.21.15.125:0/177766015 learned_addr learned my addr 172.21.15.125:0/177766015 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 -- 172.21.15.125:0/177766015 >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 msgr2=0x7f1a1412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 --2- 172.21.15.125:0/177766015 >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 -- 172.21.15.125:0/177766015 >> v1:172.21.15.125:6789/0 conn(0x7f1a14095c50 legacy=0x7f1a14096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 -- 172.21.15.125:0/177766015 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14093150 con 0x7f1a14093950 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a11ffb700 1 -- 172.21.15.125:0/177766015 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113152446 0 0) 0x7f1a14094ba0 con 0x7f1a14095c50 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a137fe700 1 --2- 172.21.15.125:0/177766015 >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a12ffd700 1 --2- 172.21.15.125:0/177766015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 0x7f1a14095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a08009760 tx=0x7f1a08009060).ready entity=mon.2 client_cookie=f2dba66399a6ce82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a11ffb700 1 -- 172.21.15.125:0/177766015 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080090d0 con 0x7f1a14093950 2023-10-03T10:09:27.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a11ffb700 1 -- 172.21.15.125:0/177766015 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800f510 con 0x7f1a14093950 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.797+0000 7f1a11ffb700 1 -- 172.21.15.125:0/177766015 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800f890 con 0x7f1a14093950 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 -- 172.21.15.125:0/177766015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 msgr2=0x7f1a14095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 --2- 172.21.15.125:0/177766015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 0x7f1a14095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a08009760 tx=0x7f1a08009060).stop 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 -- 172.21.15.125:0/177766015 shutdown_connections 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 --2- 172.21.15.125:0/177766015 >> v2:172.21.15.125:3300/0 conn(0x7f1a1412d250 0x7f1a1412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 --2- 172.21.15.125:0/177766015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14093950 0x7f1a14095760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 -- 172.21.15.125:0/177766015 >> 172.21.15.125:0/177766015 conn(0x7f1a1409aa50 msgr2=0x7f1a1409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 -- 172.21.15.125:0/177766015 shutdown_connections 2023-10-03T10:09:27.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.798+0000 7f1a1946e700 1 -- 172.21.15.125:0/177766015 wait complete. 2023-10-03T10:09:27.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 Processor -- start 2023-10-03T10:09:27.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 -- start start 2023-10-03T10:09:27.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 0x7f1a14062b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 0x7f1a14119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1411baf0 con 0x7f1a1412d250 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1411b550 con 0x7f1a14093950 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a1946e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1411b810 con 0x7f1a14095c50 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.799+0000 7f1a127fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a12ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 0x7f1a14062b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 0x7f1a14119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a127fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55388/0 (socket says 172.21.15.125:55388) 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a127fc700 1 -- 172.21.15.125:0/2612484568 learned_addr learned my addr 172.21.15.125:0/2612484568 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 -- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 msgr2=0x7f1a141190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 -- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 msgr2=0x7f1a14062b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 0x7f1a14062b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 -- 172.21.15.125:0/2612484568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009ae0 con 0x7f1a1412d250 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a127fc700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a12ffd700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 0x7f1a14062b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a137fe700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 0x7f1a14119590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1a14092d80 tx=0x7f1a0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0092e0 con 0x7f1a1412d250 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00f040 con 0x7f1a1412d250 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080092a0 con 0x7f1a1412d250 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00cb70 con 0x7f1a1412d250 2023-10-03T10:09:27.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.800+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1411b1c0 con 0x7f1a1412d250 2023-10-03T10:09:27.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.801+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1a0c014460 con 0x7f1a1412d250 2023-10-03T10:09:27.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.801+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1a0c03af50 con 0x7f1a1412d250 2023-10-03T10:09:27.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.801+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1405a260 con 0x7f1a1412d250 2023-10-03T10:09:27.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.805+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1a0c012770 con 0x7f1a1412d250 2023-10-03T10:09:27.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.966+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a14066670 con 0x7f1a1412d250 2023-10-03T10:09:27.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.966+0000 7f19faffd700 1 -- 172.21.15.125:0/2612484568 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f1a0c01d3b0 con 0x7f1a1412d250 2023-10-03T10:09:27.967 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:27.967 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:27.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 >> v1:172.21.15.125:6816/118167 conn(0x7f1a0002bb60 legacy=0x7f1a0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 msgr2=0x7f1a14119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 0x7f1a14119590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1a14092d80 tx=0x7f1a0c00b040).stop 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 shutdown_connections 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a1412d250 0x7f1a14119590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a14093950 0x7f1a14062b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 --2- 172.21.15.125:0/2612484568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a14095c50 0x7f1a141190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 >> 172.21.15.125:0/2612484568 conn(0x7f1a1409aa50 msgr2=0x7f1a14098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.968+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 shutdown_connections 2023-10-03T10:09:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:27.969+0000 7f1a1946e700 1 -- 172.21.15.125:0/2612484568 wait complete. 2023-10-03T10:09:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:09:27.981 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.099+0000 7fe00a430700 1 Processor -- start 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.099+0000 7fe00a430700 1 -- start start 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe00a430700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe00a430700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 0x7fe00412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe00a430700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe004094ba0 con 0x7fe004093950 2023-10-03T10:09:28.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe00a430700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004092e90 con 0x7fe00412d250 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe00a430700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe004096b60 con 0x7fe004095e70 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0089cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 0x7fe00412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe003fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe004093950 0x7fe004095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43696/0 (socket says 172.21.15.125:43696) 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe003fff700 1 -- 172.21.15.125:0/2760427178 learned_addr learned my addr 172.21.15.125:0/2760427178 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 -- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 msgr2=0x7fe00412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe002ffd700 1 -- 172.21.15.125:0/2760427178 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484147068 0 0) 0x7fe004094ba0 con 0x7fe004093950 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 0x7fe00412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 -- 172.21.15.125:0/2760427178 >> v1:172.21.15.125:6789/0 conn(0x7fe004093950 legacy=0x7fe004095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 -- 172.21.15.125:0/2760427178 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004093150 con 0x7fe004095e70 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0089cd700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 0x7fe00412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.100+0000 7fe0037fe700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004096250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdff8009790 tx=0x7fdff8009060).ready entity=mon.2 client_cookie=5ea0950786af93fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe002ffd700 1 -- 172.21.15.125:0/2760427178 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80090d0 con 0x7fe004095e70 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe002ffd700 1 -- 172.21.15.125:0/2760427178 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800f510 con 0x7fe004095e70 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe002ffd700 1 -- 172.21.15.125:0/2760427178 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800f890 con 0x7fe004095e70 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 -- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 msgr2=0x7fe004096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004096250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdff8009790 tx=0x7fdff8009060).stop 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 -- 172.21.15.125:0/2760427178 shutdown_connections 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe00412d250 0x7fe00412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 --2- 172.21.15.125:0/2760427178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004096250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 -- 172.21.15.125:0/2760427178 >> 172.21.15.125:0/2760427178 conn(0x7fe00409aa50 msgr2=0x7fe00409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 -- 172.21.15.125:0/2760427178 shutdown_connections 2023-10-03T10:09:28.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.101+0000 7fe00a430700 1 -- 172.21.15.125:0/2760427178 wait complete. 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.102+0000 7fe00a430700 1 Processor -- start 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.102+0000 7fe00a430700 1 -- start start 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004117ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 0x7fe004118390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00411afa0 con 0x7fe00412d250 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00409a670 con 0x7fe004093950 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe004092410 con 0x7fe004095e70 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe0037fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004117ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe0089cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 0x7fe004118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40558/0 (socket says 172.21.15.125:40558) 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 -- 172.21.15.125:0/3543652590 learned_addr learned my addr 172.21.15.125:0/3543652590 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 -- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 msgr2=0x7fe004117ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004117ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 -- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 msgr2=0x7fe004118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 0x7fe004118390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 -- 172.21.15.125:0/3543652590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009a20 con 0x7fe004093950 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe0089cd700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 0x7fe004118390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe003fff700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdff400c4c0 tx=0x7fdff4007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400ce80 con 0x7fe004093950 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff40072e0 con 0x7fe004093950 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff80092a0 con 0x7fe004093950 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff40057a0 con 0x7fe004093950 2023-10-03T10:09:28.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.103+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041199d0 con 0x7fe004093950 2023-10-03T10:09:28.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.104+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdff4005bd0 con 0x7fe004093950 2023-10-03T10:09:28.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.104+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdff403a610 con 0x7fe004093950 2023-10-03T10:09:28.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.104+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00405a260 con 0x7fe004093950 2023-10-03T10:09:28.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.109+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdff401d3f0 con 0x7fe004093950 2023-10-03T10:09:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.269+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe004118ca0 con 0x7fe004093950 2023-10-03T10:09:28.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.269+0000 7fdfebfff700 1 -- 172.21.15.125:0/3543652590 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdff401c350 con 0x7fe004093950 2023-10-03T10:09:28.270 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 >> v1:172.21.15.125:6816/118167 conn(0x7fdff002bb60 legacy=0x7fdff002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 msgr2=0x7fe00411be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdff400c4c0 tx=0x7fdff4007c10).stop 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 shutdown_connections 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe00412d250 0x7fe004118390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004093950 0x7fe00411be50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 --2- 172.21.15.125:0/3543652590 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe004095e70 0x7fe004117ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 >> 172.21.15.125:0/3543652590 conn(0x7fe00409aa50 msgr2=0x7fe004062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 shutdown_connections 2023-10-03T10:09:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.271+0000 7fe00a430700 1 -- 172.21.15.125:0/3543652590 wait complete. 2023-10-03T10:09:28.283 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:28.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 Processor -- start 2023-10-03T10:09:28.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 -- start start 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f560c12ac40 0x7f560c12d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 0x7f560c12f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0692c0 con 0x7f560c0968b0 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c092540 con 0x7f560c12ac40 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.401+0000 7f5613fb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560c092210 con 0x7f560c12d520 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f560c12ac40 0x7f560c12d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561254f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 0x7f560c12f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5611d4e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f560c0968b0 0x7f560c096c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43712/0 (socket says 172.21.15.125:43712) 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5611d4e700 1 -- 172.21.15.125:0/2621979106 learned_addr learned my addr 172.21.15.125:0/2621979106 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 -- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 msgr2=0x7f560c12f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 0x7f560c12f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 -- 172.21.15.125:0/2621979106 >> v1:172.21.15.125:6789/0 conn(0x7f560c0968b0 legacy=0x7f560c096c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 -- 172.21.15.125:0/2621979106 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c093430 con 0x7f560c12ac40 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5610d4c700 1 -- 172.21.15.125:0/2621979106 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017115873 0 0) 0x7f560c0692c0 con 0x7f560c0968b0 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561254f700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 0x7f560c12f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f561154d700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c12ac40 0x7f560c12d030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f55fc009760 tx=0x7f55fc009060).ready entity=mon.0 client_cookie=164214963fa34f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5610d4c700 1 -- 172.21.15.125:0/2621979106 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00f510 con 0x7f560c12ac40 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5610d4c700 1 -- 172.21.15.125:0/2621979106 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc00f670 con 0x7f560c12ac40 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.402+0000 7f5610d4c700 1 -- 172.21.15.125:0/2621979106 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00f9f0 con 0x7f560c12ac40 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 -- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c12ac40 msgr2=0x7f560c12d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c12ac40 0x7f560c12d030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f55fc009760 tx=0x7f55fc009060).stop 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 -- 172.21.15.125:0/2621979106 shutdown_connections 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12d520 0x7f560c12f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 --2- 172.21.15.125:0/2621979106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c12ac40 0x7f560c12d030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 -- 172.21.15.125:0/2621979106 >> 172.21.15.125:0/2621979106 conn(0x7f560c09a1c0 msgr2=0x7f560c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 -- 172.21.15.125:0/2621979106 shutdown_connections 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.403+0000 7f5613fb2700 1 -- 172.21.15.125:0/2621979106 wait complete. 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 Processor -- start 2023-10-03T10:09:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 -- start start 2023-10-03T10:09:28.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c0968b0 0x7f560c113110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f560c12d520 0x7f560c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1282b0 con 0x7f560c0968b0 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c091dc0 con 0x7f560c12d520 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5613fb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560c116c40 con 0x7f560c12ac40 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55416/0 (socket says 172.21.15.125:55416) 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 -- 172.21.15.125:0/3000695836 learned_addr learned my addr 172.21.15.125:0/3000695836 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f5611d4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c0968b0 0x7f560c113110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561254f700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f560c12d520 0x7f560c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 -- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f560c12d520 msgr2=0x7f560c113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f560c12d520 0x7f560c113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 -- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c0968b0 msgr2=0x7f560c113110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c0968b0 0x7f560c113110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 -- 172.21.15.125:0/3000695836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009a20 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.404+0000 7f561154d700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f55fc009e00 tx=0x7f55fc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.405+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00f7e0 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.405+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc00f940 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.405+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc0092a0 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.405+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc01b640 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.405+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c117320 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.406+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c05a260 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.406+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f55fc01ba30 con 0x7f560c12ac40 2023-10-03T10:09:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.406+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f55fc03c980 con 0x7f560c12ac40 2023-10-03T10:09:28.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.410+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f55fc0193c0 con 0x7f560c12ac40 2023-10-03T10:09:28.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.566+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f560c093030 con 0x7f560c12ac40 2023-10-03T10:09:28.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.566+0000 7f5601ffb700 1 -- 172.21.15.125:0/3000695836 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55fc029070 con 0x7f560c12ac40 2023-10-03T10:09:28.567 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 >> v1:172.21.15.125:6816/118167 conn(0x7f55f002bb60 legacy=0x7f55f002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 msgr2=0x7f560c113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f55fc009e00 tx=0x7f55fc017000).stop 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 shutdown_connections 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f560c12d520 0x7f560c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560c0968b0 0x7f560c113110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 --2- 172.21.15.125:0/3000695836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f560c12ac40 0x7f560c113600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 >> 172.21.15.125:0/3000695836 conn(0x7f560c09a1c0 msgr2=0x7f560c12c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 shutdown_connections 2023-10-03T10:09:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.568+0000 7f5613fb2700 1 -- 172.21.15.125:0/3000695836 wait complete. 2023-10-03T10:09:28.580 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 Processor -- start 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 -- start start 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f807005f560 0x7f807012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070066f90 con 0x7f807012b370 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807005f940 con 0x7f807005f560 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.697+0000 7f8075f06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8070067650 con 0x7f807012b790 2023-10-03T10:09:28.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f807005f560 0x7f807012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55428/0 (socket says 172.21.15.125:55428) 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806ffff700 1 -- 172.21.15.125:0/1214641423 learned_addr learned my addr 172.21.15.125:0/1214641423 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806effd700 1 --1- 172.21.15.125:0/1214641423 >> v1:172.21.15.125:6789/0 conn(0x7f807012b370 0x7f8070095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43728/0 (socket says 172.21.15.125:43728) 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 -- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 msgr2=0x7f80700964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 -- 172.21.15.125:0/1214641423 >> v1:172.21.15.125:6789/0 conn(0x7f807012b370 legacy=0x7f8070095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 -- 172.21.15.125:0/1214641423 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070067910 con 0x7f807005f560 2023-10-03T10:09:28.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806e7fc700 1 -- 172.21.15.125:0/1214641423 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613393322 0 0) 0x7f8070066f90 con 0x7f807012b370 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806ffff700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806f7fe700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807005f560 0x7f807012ae80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8064009760 tx=0x7f8064009060).ready entity=mon.0 client_cookie=f9e47d65a83b43f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806e7fc700 1 -- 172.21.15.125:0/1214641423 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400f510 con 0x7f807005f560 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806e7fc700 1 -- 172.21.15.125:0/1214641423 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806400f670 con 0x7f807005f560 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.698+0000 7f806e7fc700 1 -- 172.21.15.125:0/1214641423 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400f9f0 con 0x7f807005f560 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 -- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807005f560 msgr2=0x7f807012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807005f560 0x7f807012ae80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8064009760 tx=0x7f8064009060).stop 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 -- 172.21.15.125:0/1214641423 shutdown_connections 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f80700964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 --2- 172.21.15.125:0/1214641423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807005f560 0x7f807012ae80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 -- 172.21.15.125:0/1214641423 >> 172.21.15.125:0/1214641423 conn(0x7f807009a1c0 msgr2=0x7f807009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 -- 172.21.15.125:0/1214641423 shutdown_connections 2023-10-03T10:09:28.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.699+0000 7f8075f06700 1 -- 172.21.15.125:0/1214641423 wait complete. 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 Processor -- start 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 -- start start 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f807005f560 0x7f8070115600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 0x7f8070115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701293d0 con 0x7f807012b370 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700671c0 con 0x7f807005f560 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f8075f06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8070118680 con 0x7f807012b790 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 0x7f8070115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55434/0 (socket says 172.21.15.125:55434) 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 0x7f8070115af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42122/0 (socket says 172.21.15.125:42122) 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806ffff700 1 -- 172.21.15.125:0/1050469705 learned_addr learned my addr 172.21.15.125:0/1050469705 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.700+0000 7f806f7fe700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f807005f560 0x7f8070115600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 -- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f807005f560 msgr2=0x7f8070115600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f807005f560 0x7f8070115600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 -- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 msgr2=0x7f8070115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 0x7f8070115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 -- 172.21.15.125:0/1050469705 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009ae0 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f806ffff700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8068009fa0 tx=0x7f806800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800c990 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800f040 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80640092a0 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800cd00 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.701+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070119040 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.702+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8068014670 con 0x7f807012b790 2023-10-03T10:09:28.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.702+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f806803afb0 con 0x7f807012b790 2023-10-03T10:09:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.702+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80701184d0 con 0x7f807012b790 2023-10-03T10:09:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.706+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8068014920 con 0x7f807012b790 2023-10-03T10:09:28.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.863+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80701287b0 con 0x7f807012b790 2023-10-03T10:09:28.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.864+0000 7f80577fe700 1 -- 172.21.15.125:0/1050469705 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f806801cb50 con 0x7f807012b790 2023-10-03T10:09:28.864 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:09:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 >> v1:172.21.15.125:6816/118167 conn(0x7f805c02bb90 legacy=0x7f805c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 msgr2=0x7f8070115fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8068009fa0 tx=0x7f806800b040).stop 2023-10-03T10:09:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 shutdown_connections 2023-10-03T10:09:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f807012b790 0x7f8070115fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f807005f560 0x7f8070115600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 --2- 172.21.15.125:0/1050469705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f807012b370 0x7f8070115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 >> 172.21.15.125:0/1050469705 conn(0x7f807009a1c0 msgr2=0x7f807012d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 shutdown_connections 2023-10-03T10:09:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.865+0000 7f8075f06700 1 -- 172.21.15.125:0/1050469705 wait complete. 2023-10-03T10:09:28.877 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:09:28.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.995+0000 7fc352f45700 1 Processor -- start 2023-10-03T10:09:28.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.995+0000 7fc352f45700 1 -- start start 2023-10-03T10:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc352f45700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc34c05f560 0x7fc34c12aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc352f45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc352f45700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c12ac80 con 0x7fc34c12b3d0 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc352f45700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c05f940 con 0x7fc34c05f560 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc352f45700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c097230 con 0x7fc34c12b850 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc34c05f560 0x7fc34c12aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc3514e2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc34c05f560 0x7fc34c12aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42132/0 (socket says 172.21.15.125:42132) 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc3514e2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40580/0 (socket says 172.21.15.125:40580) 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 -- 172.21.15.125:0/2490531276 learned_addr learned my addr 172.21.15.125:0/2490531276 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc34bfff700 1 --1- 172.21.15.125:0/2490531276 >> v1:172.21.15.125:6789/0 conn(0x7fc34c12b3d0 0x7fc34c095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43734/0 (socket says 172.21.15.125:43734) 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 -- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 msgr2=0x7fc34c0964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 -- 172.21.15.125:0/2490531276 >> v1:172.21.15.125:6789/0 conn(0x7fc34c12b3d0 legacy=0x7fc34c095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc34b7fe700 1 -- 172.21.15.125:0/2490531276 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605930519 0 0) 0x7fc34c12ac80 con 0x7fc34c12b3d0 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc350ce1700 1 -- 172.21.15.125:0/2490531276 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c097a10 con 0x7fc34c05f560 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.996+0000 7fc3514e2700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc350ce1700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c05f560 0x7fc34c12aee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc340006fd0 tx=0x7fc3400090f0).ready entity=mon.0 client_cookie=7f5add49cf82a045 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc34b7fe700 1 -- 172.21.15.125:0/2490531276 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000b580 con 0x7fc34c05f560 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc34b7fe700 1 -- 172.21.15.125:0/2490531276 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000b6e0 con 0x7fc34c05f560 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc34b7fe700 1 -- 172.21.15.125:0/2490531276 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ba80 con 0x7fc34c05f560 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 -- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c05f560 msgr2=0x7fc34c12aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c05f560 0x7fc34c12aee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc340006fd0 tx=0x7fc3400090f0).stop 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 -- 172.21.15.125:0/2490531276 shutdown_connections 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c12b850 0x7fc34c0964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 --2- 172.21.15.125:0/2490531276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c05f560 0x7fc34c12aee0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 -- 172.21.15.125:0/2490531276 >> 172.21.15.125:0/2490531276 conn(0x7fc34c09a1c0 msgr2=0x7fc34c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 -- 172.21.15.125:0/2490531276 shutdown_connections 2023-10-03T10:09:29.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.997+0000 7fc352f45700 1 -- 172.21.15.125:0/2490531276 wait complete. 2023-10-03T10:09:29.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.998+0000 7fc352f45700 1 Processor -- start 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.998+0000 7fc352f45700 1 -- start start 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc34c12b3d0 0x7fc34c13abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 0x7fc34c113ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c128610 con 0x7fc34c12b850 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c12f4b0 con 0x7fc34c05f560 2023-10-03T10:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c1163a0 con 0x7fc34c12b3d0 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc3514e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 0x7fc34c113ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40584/0 (socket says 172.21.15.125:40584) 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 -- 172.21.15.125:0/1514309471 learned_addr learned my addr 172.21.15.125:0/1514309471 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc34bfff700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc34c12b3d0 0x7fc34c13abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 -- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc34c12b3d0 msgr2=0x7fc34c13abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc34c12b3d0 0x7fc34c13abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 -- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 msgr2=0x7fc34c113ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 0x7fc34c113ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 -- 172.21.15.125:0/1514309471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009a20 con 0x7fc34c05f560 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc3514e2700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 0x7fc34c113ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc350ce1700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc34c12ae10 tx=0x7fc340017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340006950 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000be40 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ba80 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340009370 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:28.999+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c117f70 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.000+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc34001c630 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.000+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc34003ccb0 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.000+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c0671c0 con 0x7fc34c05f560 2023-10-03T10:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.005+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc34002a070 con 0x7fc34c05f560 2023-10-03T10:09:29.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.161+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc34c098d90 con 0x7fc34c05f560 2023-10-03T10:09:29.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.161+0000 7fc348ff9700 1 -- 172.21.15.125:0/1514309471 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc34002a020 con 0x7fc34c05f560 2023-10-03T10:09:29.162 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 >> v1:172.21.15.125:6816/118167 conn(0x7fc33002bb60 legacy=0x7fc33002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 msgr2=0x7fc34c13a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc34c12ae10 tx=0x7fc340017000).stop 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 shutdown_connections 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc34c12b850 0x7fc34c113ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc34c05f560 0x7fc34c13a6f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 --2- 172.21.15.125:0/1514309471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc34c12b3d0 0x7fc34c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 >> 172.21.15.125:0/1514309471 conn(0x7fc34c09a1c0 msgr2=0x7fc34c12e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 shutdown_connections 2023-10-03T10:09:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.163+0000 7fc352f45700 1 -- 172.21.15.125:0/1514309471 wait complete. 2023-10-03T10:09:29.175 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:29.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 Processor -- start 2023-10-03T10:09:29.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 -- start start 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 0x7fd6d012b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d0092d70 con 0x7fd6d0065ae0 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0097820 con 0x7fd6d0092990 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6d4867700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0096c90 con 0x7fd6d0066490 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6ce59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6cdd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6ce59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40590/0 (socket says 172.21.15.125:40590) 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6ced9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 0x7fd6d012b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6cdd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55454/0 (socket says 172.21.15.125:55454) 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.290+0000 7fd6ce59c700 1 -- 172.21.15.125:0/2026469842 learned_addr learned my addr 172.21.15.125:0/2026469842 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 -- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 msgr2=0x7fd6d012ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 -- 172.21.15.125:0/2026469842 >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 msgr2=0x7fd6d012b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 --2- 172.21.15.125:0/2026469842 >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 0x7fd6d012b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 -- 172.21.15.125:0/2026469842 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0097080 con 0x7fd6d0092990 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ced9d700 1 --2- 172.21.15.125:0/2026469842 >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 0x7fd6d012b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6cdd9b700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6ce59c700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6c4006fd0 tx=0x7fd6c40090f0).ready entity=mon.1 client_cookie=7459bb470cc7371d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6cd59a700 1 -- 172.21.15.125:0/2026469842 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400f510 con 0x7fd6d0092990 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6cd59a700 1 -- 172.21.15.125:0/2026469842 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400f670 con 0x7fd6d0092990 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6cd59a700 1 -- 172.21.15.125:0/2026469842 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400fa10 con 0x7fd6d0092990 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6d4867700 1 -- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 msgr2=0x7fd6d0065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.291+0000 7fd6d4867700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6c4006fd0 tx=0x7fd6c40090f0).stop 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 -- 172.21.15.125:0/2026469842 shutdown_connections 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0065fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 --2- 172.21.15.125:0/2026469842 >> v2:172.21.15.125:3300/0 conn(0x7fd6d0065ae0 0x7fd6d012b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 --2- 172.21.15.125:0/2026469842 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0066490 0x7fd6d012ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 -- 172.21.15.125:0/2026469842 >> 172.21.15.125:0/2026469842 conn(0x7fd6d009bba0 msgr2=0x7fd6d009bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 -- 172.21.15.125:0/2026469842 shutdown_connections 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 -- 172.21.15.125:0/2026469842 wait complete. 2023-10-03T10:09:29.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 Processor -- start 2023-10-03T10:09:29.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.292+0000 7fd6d4867700 1 -- start start 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 0x7fd6d0117570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0117a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d009b630 con 0x7fd6d0066490 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d006a710 con 0x7fd6d0092990 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6d4867700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d011abb0 con 0x7fd6d0065ae0 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 0x7fd6d0117570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55468/0 (socket says 172.21.15.125:55468) 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ce59c700 1 -- 172.21.15.125:0/1178642635 learned_addr learned my addr 172.21.15.125:0/1178642635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0117a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 -- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 msgr2=0x7fd6d0117080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 -- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 msgr2=0x7fd6d0117570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 0x7fd6d0117570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 -- 172.21.15.125:0/1178642635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009a20 con 0x7fd6d0092990 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6cdd9b700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 0x7fd6d0117570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ce59c700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6ced9d700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0117a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd6c8009f10 tx=0x7fd6c800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800cb70 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.293+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800f040 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.294+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c00092a0 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.294+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8013400 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.294+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c4009370 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.294+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd6c80137f0 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.294+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd6c803ba50 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.295+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d011a810 con 0x7fd6d0092990 2023-10-03T10:09:29.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.299+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd6d011a810 con 0x7fd6d0092990 2023-10-03T10:09:29.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.493+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d011a810 con 0x7fd6d0092990 2023-10-03T10:09:29.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.493+0000 7fd6be7fc700 1 -- 172.21.15.125:0/1178642635 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fd6d011a810 con 0x7fd6d0092990 2023-10-03T10:09:29.494 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:29.494 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:16.686162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 >> v1:172.21.15.125:6816/118167 conn(0x7fd6b002bb60 legacy=0x7fd6b002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 msgr2=0x7fd6d0117a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0117a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd6c8009f10 tx=0x7fd6c800b040).stop 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 shutdown_connections 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6d0092990 0x7fd6d0117a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6d0065ae0 0x7fd6d0117080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 --2- 172.21.15.125:0/1178642635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d0066490 0x7fd6d0117570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 >> 172.21.15.125:0/1178642635 conn(0x7fd6d009bba0 msgr2=0x7fd6d009ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 shutdown_connections 2023-10-03T10:09:29.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.495+0000 7fd6d4867700 1 -- 172.21.15.125:0/1178642635 wait complete. 2023-10-03T10:09:29.497 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 5 2023-10-03T10:09:29.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:29.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 Processor -- start 2023-10-03T10:09:29.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 -- start start 2023-10-03T10:09:29.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d0093340 con 0x7f31d005f560 2023-10-03T10:09:29.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d005f940 con 0x7f31d0092190 2023-10-03T10:09:29.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31d4fac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0097c30 con 0x7f31d012dd40 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31cdd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31ced9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31ced9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55480/0 (socket says 172.21.15.125:55480) 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31cdd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42192/0 (socket says 172.21.15.125:42192) 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31ced9d700 1 -- 172.21.15.125:0/2437222090 learned_addr learned my addr 172.21.15.125:0/2437222090 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.622+0000 7f31ce59c700 1 --1- 172.21.15.125:0/2437222090 >> v1:172.21.15.125:6789/0 conn(0x7f31d005f560 0x7f31d0128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43750/0 (socket says 172.21.15.125:43750) 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31ced9d700 1 -- 172.21.15.125:0/2437222090 >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 msgr2=0x7f31d01293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31ced9d700 1 --2- 172.21.15.125:0/2437222090 >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31ced9d700 1 -- 172.21.15.125:0/2437222090 >> v1:172.21.15.125:6789/0 conn(0x7f31d005f560 legacy=0x7f31d0128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31ced9d700 1 -- 172.21.15.125:0/2437222090 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00941f0 con 0x7f31d012dd40 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31cd59a700 1 -- 172.21.15.125:0/2437222090 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681553432 0 0) 0x7f31d0093340 con 0x7f31d005f560 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31cdd9b700 1 --2- 172.21.15.125:0/2437222090 >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31ced9d700 1 --2- 172.21.15.125:0/2437222090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f31c8009f20 tx=0x7f31c8009840).ready entity=mon.2 client_cookie=489d4006f539681b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31cd59a700 1 -- 172.21.15.125:0/2437222090 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800e070 con 0x7f31d012dd40 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31cd59a700 1 -- 172.21.15.125:0/2437222090 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c800b9d0 con 0x7f31d012dd40 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31cd59a700 1 -- 172.21.15.125:0/2437222090 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800bd50 con 0x7f31d012dd40 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 -- 172.21.15.125:0/2437222090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 msgr2=0x7f31d0130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 --2- 172.21.15.125:0/2437222090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f31c8009f20 tx=0x7f31c8009840).stop 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 -- 172.21.15.125:0/2437222090 shutdown_connections 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 --2- 172.21.15.125:0/2437222090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d012dd40 0x7f31d0130130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 --2- 172.21.15.125:0/2437222090 >> v2:172.21.15.125:3300/0 conn(0x7f31d0092190 0x7f31d01293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 -- 172.21.15.125:0/2437222090 >> 172.21.15.125:0/2437222090 conn(0x7f31d009a1c0 msgr2=0x7f31d009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.623+0000 7f31d4fac700 1 -- 172.21.15.125:0/2437222090 shutdown_connections 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.624+0000 7f31d4fac700 1 -- 172.21.15.125:0/2437222090 wait complete. 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 Processor -- start 2023-10-03T10:09:29.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 -- start start 2023-10-03T10:09:29.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 0x7f31d0128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 0x7f31d0110d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0097d80 con 0x7f31d0092190 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d01147a0 con 0x7f31d012dd40 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31d4fac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00990d0 con 0x7f31d005f560 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 0x7f31d0128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31ced9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 0x7f31d0110d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 0x7f31d0128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55488/0 (socket says 172.21.15.125:55488) 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42196/0 (socket says 172.21.15.125:42196) 2023-10-03T10:09:29.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.625+0000 7f31ce59c700 1 -- 172.21.15.125:0/662469301 learned_addr learned my addr 172.21.15.125:0/662469301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 -- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 msgr2=0x7f31d0128400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 0x7f31d0128400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 -- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 msgr2=0x7f31d0110820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 -- 172.21.15.125:0/662469301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00092a0 con 0x7f31d012dd40 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31cdd9b700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31ced9d700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 0x7f31d0110d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f31d006a150 tx=0x7f31c8009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007080 con 0x7f31d012dd40 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80092e0 con 0x7f31d012dd40 2023-10-03T10:09:29.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8009ae0 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007840 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.626+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d0113860 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.627+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f31c8003040 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.627+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f31c803ca60 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.627+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d0093560 con 0x7f31d012dd40 2023-10-03T10:09:29.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.631+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f31c80123c0 con 0x7f31d012dd40 2023-10-03T10:09:29.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.792+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31d0113a50 con 0x7f31d012dd40 2023-10-03T10:09:29.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.793+0000 7f31be7fc700 1 -- 172.21.15.125:0/662469301 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f31c8027b50 con 0x7f31d012dd40 2023-10-03T10:09:29.888 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:29.889 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:29.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 >> v1:172.21.15.125:6816/118167 conn(0x7f31b002bb90 legacy=0x7f31b002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 msgr2=0x7f31d0110d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:29.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 0x7f31d0110d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f31d006a150 tx=0x7f31c8009840).stop 2023-10-03T10:09:29.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 shutdown_connections 2023-10-03T10:09:29.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31d012dd40 0x7f31d0110d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31d005f560 0x7f31d0128400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 --2- 172.21.15.125:0/662469301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31d0092190 0x7f31d0110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 >> 172.21.15.125:0/662469301 conn(0x7f31d009a1c0 msgr2=0x7f31d012fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 shutdown_connections 2023-10-03T10:09:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:29.795+0000 7f31d4fac700 1 -- 172.21.15.125:0/662469301 wait complete. 2023-10-03T10:09:29.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:09:29.932 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:30.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.050+0000 7f1611405700 1 Processor -- start 2023-10-03T10:09:30.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.050+0000 7f1611405700 1 -- start start 2023-10-03T10:09:30.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1611405700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1611405700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1611405700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c091980 con 0x7f160c095b80 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1611405700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0973f0 con 0x7f160c062b00 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1611405700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f160c062ee0 con 0x7f160c0966b0 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f160c095b80 0x7f160c095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43754/0 (socket says 172.21.15.125:43754) 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40606/0 (socket says 172.21.15.125:40606) 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55494/0 (socket says 172.21.15.125:55494) 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160a7fc700 1 -- 172.21.15.125:0/528413661 learned_addr learned my addr 172.21.15.125:0/528413661 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1609ffb700 1 -- 172.21.15.125:0/528413661 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450386258 0 0) 0x7f160c091980 con 0x7f160c095b80 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f1609ffb700 1 -- 172.21.15.125:0/528413661 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f40033f0 con 0x7f160c095b80 2023-10-03T10:09:30.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 -- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 msgr2=0x7f160c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 -- 172.21.15.125:0/528413661 >> v1:172.21.15.125:6789/0 conn(0x7f160c095b80 legacy=0x7f160c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160b7fe700 1 -- 172.21.15.125:0/528413661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c092310 con 0x7f160c0966b0 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.051+0000 7f160affd700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f160b7fe700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1604009e90 tx=0x7f1604009780).ready entity=mon.2 client_cookie=547c292bf4f6c7fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1609ffb700 1 -- 172.21.15.125:0/528413661 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400e070 con 0x7f160c0966b0 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1609ffb700 1 -- 172.21.15.125:0/528413661 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160400bab0 con 0x7f160c0966b0 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1609ffb700 1 -- 172.21.15.125:0/528413661 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400be30 con 0x7f160c0966b0 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 -- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 msgr2=0x7f160c132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1604009e90 tx=0x7f1604009780).stop 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 -- 172.21.15.125:0/528413661 shutdown_connections 2023-10-03T10:09:30.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c0966b0 0x7f160c132290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 --2- 172.21.15.125:0/528413661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c062b00 0x7f160c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 -- 172.21.15.125:0/528413661 >> 172.21.15.125:0/528413661 conn(0x7f160c09aa50 msgr2=0x7f160c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 -- 172.21.15.125:0/528413661 shutdown_connections 2023-10-03T10:09:30.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.052+0000 7f1611405700 1 -- 172.21.15.125:0/528413661 wait complete. 2023-10-03T10:09:30.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.053+0000 7f1611405700 1 Processor -- start 2023-10-03T10:09:30.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.053+0000 7f1611405700 1 -- start start 2023-10-03T10:09:30.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c095b80 0x7f160c115000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f160c0966b0 0x7f160c1154f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1164c0 con 0x7f160c0966b0 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1175e0 con 0x7f160c095b80 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f160c096da0 con 0x7f160c062b00 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c095b80 0x7f160c115000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55498/0 (socket says 172.21.15.125:55498) 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 -- 172.21.15.125:0/1982297445 learned_addr learned my addr 172.21.15.125:0/1982297445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160b7fe700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f160c0966b0 0x7f160c1154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 -- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c095b80 msgr2=0x7f160c115000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c095b80 0x7f160c115000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 -- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f160c0966b0 msgr2=0x7f160c1154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f160c0966b0 0x7f160c1154f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 -- 172.21.15.125:0/1982297445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000092a0 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f160affd700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f160000ea20 tx=0x7f1600009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000ee60 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600009600 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000ca60 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1604009a20 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.054+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c12d5e0 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.055+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f160001b400 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.055+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f160003b460 con 0x7f160c062b00 2023-10-03T10:09:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.055+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c05a260 con 0x7f160c062b00 2023-10-03T10:09:30.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.060+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1600016020 con 0x7f160c062b00 2023-10-03T10:09:30.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.216+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f160c115e00 con 0x7f160c062b00 2023-10-03T10:09:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.216+0000 7f15f2ffd700 1 -- 172.21.15.125:0/1982297445 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1600011d20 con 0x7f160c062b00 2023-10-03T10:09:30.217 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:09:30.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 >> v1:172.21.15.125:6816/118167 conn(0x7f15f802bb60 legacy=0x7f15f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 msgr2=0x7f160c12d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f160000ea20 tx=0x7f1600009060).stop 2023-10-03T10:09:30.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 shutdown_connections 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f160c0966b0 0x7f160c1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f160c062b00 0x7f160c12d0f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 --2- 172.21.15.125:0/1982297445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f160c095b80 0x7f160c115000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 >> 172.21.15.125:0/1982297445 conn(0x7f160c09aa50 msgr2=0x7f160c131eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.218+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 shutdown_connections 2023-10-03T10:09:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.219+0000 7f1611405700 1 -- 172.21.15.125:0/1982297445 wait complete. 2023-10-03T10:09:30.231 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:30.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 Processor -- start 2023-10-03T10:09:30.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 -- start start 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 0x7f5e68095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 0x7f5e68132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e68091980 con 0x7f5e68095b80 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.349+0000 7f5e6e1bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680973f0 con 0x7f5e68062b00 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e6e1bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68062ee0 con 0x7f5e680966b0 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e677fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 0x7f5e68095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 0x7f5e68132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e66ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5e68095b80 0x7f5e68095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43770/0 (socket says 172.21.15.125:43770) 2023-10-03T10:09:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e677fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 0x7f5e68095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42222/0 (socket says 172.21.15.125:42222) 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e66ffd700 1 -- 172.21.15.125:0/1870536007 learned_addr learned my addr 172.21.15.125:0/1870536007 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 -- 172.21.15.125:0/1870536007 >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 msgr2=0x7f5e68095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 --2- 172.21.15.125:0/1870536007 >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 0x7f5e68095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e667fc700 1 -- 172.21.15.125:0/1870536007 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997135900 0 0) 0x7f5e68091980 con 0x7f5e68095b80 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 -- 172.21.15.125:0/1870536007 >> v1:172.21.15.125:6789/0 conn(0x7f5e68095b80 legacy=0x7f5e68095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 -- 172.21.15.125:0/1870536007 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68092310 con 0x7f5e680966b0 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e67fff700 1 --2- 172.21.15.125:0/1870536007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 0x7f5e68132290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5e60009760 tx=0x7f5e60009060).ready entity=mon.1 client_cookie=b7e411045ca5029e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e667fc700 1 -- 172.21.15.125:0/1870536007 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000f510 con 0x7f5e680966b0 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e667fc700 1 -- 172.21.15.125:0/1870536007 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000f670 con 0x7f5e680966b0 2023-10-03T10:09:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.350+0000 7f5e667fc700 1 -- 172.21.15.125:0/1870536007 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000f9f0 con 0x7f5e680966b0 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/1870536007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 msgr2=0x7f5e68132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/1870536007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 0x7f5e68132290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5e60009760 tx=0x7f5e60009060).stop 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/1870536007 shutdown_connections 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/1870536007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e680966b0 0x7f5e68132290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/1870536007 >> v2:172.21.15.125:3300/0 conn(0x7f5e68062b00 0x7f5e68095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/1870536007 >> 172.21.15.125:0/1870536007 conn(0x7f5e6809aa50 msgr2=0x7f5e6809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/1870536007 shutdown_connections 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.351+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/1870536007 wait complete. 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.352+0000 7f5e6e1bb700 1 Processor -- start 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.352+0000 7f5e6e1bb700 1 -- start start 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e68095b80 0x7f5e68066b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e680966b0 0x7f5e68067080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68068530 con 0x7f5e680966b0 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680997b0 con 0x7f5e68062b00 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e6e1bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68096da0 con 0x7f5e68095b80 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40638/0 (socket says 172.21.15.125:40638) 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 -- 172.21.15.125:0/4107204420 learned_addr learned my addr 172.21.15.125:0/4107204420 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e66ffd700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e68095b80 0x7f5e68066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e67fff700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e680966b0 0x7f5e68067080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 -- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e68095b80 msgr2=0x7f5e68066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e68095b80 0x7f5e68066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 -- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e680966b0 msgr2=0x7f5e68067080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e680966b0 0x7f5e68067080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.353+0000 7f5e677fe700 1 -- 172.21.15.125:0/4107204420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600092a0 con 0x7f5e68062b00 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e677fe700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5e58009f20 tx=0x7f5e5800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800cb70 con 0x7f5e68062b00 2023-10-03T10:09:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800f040 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6811d770 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800cee0 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6806a6d0 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.354+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5e58013610 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.355+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5e5803b7d0 con 0x7f5e68062b00 2023-10-03T10:09:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.355+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6805a260 con 0x7f5e68062b00 2023-10-03T10:09:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.359+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5e5801d460 con 0x7f5e68062b00 2023-10-03T10:09:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.516+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e68046c20 con 0x7f5e68062b00 2023-10-03T10:09:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.516+0000 7f5e5f7fe700 1 -- 172.21.15.125:0/4107204420 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e5801b360 con 0x7f5e68062b00 2023-10-03T10:09:30.517 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:09:30.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 >> v1:172.21.15.125:6816/118167 conn(0x7f5e4802bb30 legacy=0x7f5e4802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 msgr2=0x7f5e680666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5e58009f20 tx=0x7f5e5800b040).stop 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 shutdown_connections 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e680966b0 0x7f5e68067080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e68062b00 0x7f5e680666a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 --2- 172.21.15.125:0/4107204420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e68095b80 0x7f5e68066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 >> 172.21.15.125:0/4107204420 conn(0x7f5e6809aa50 msgr2=0x7f5e68131ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 shutdown_connections 2023-10-03T10:09:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.518+0000 7f5e6e1bb700 1 -- 172.21.15.125:0/4107204420 wait complete. 2023-10-03T10:09:30.530 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:09:30.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 Processor -- start 2023-10-03T10:09:30.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 -- start start 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4096c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 0x7f1ba412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba40692c0 con 0x7f1ba4097180 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4092540 con 0x7f1ba40968b0 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1baa416700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4092210 con 0x7f1ba40685a0 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1ba3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1ba89b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 0x7f1ba412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1ba37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1ba4097180 0x7f1ba4067e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43772/0 (socket says 172.21.15.125:43772) 2023-10-03T10:09:30.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.648+0000 7f1ba37fe700 1 -- 172.21.15.125:0/1473830940 learned_addr learned my addr 172.21.15.125:0/1473830940 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba3fff700 1 -- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 msgr2=0x7f1ba412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba3fff700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 0x7f1ba412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba2ffd700 1 -- 172.21.15.125:0/1473830940 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621508611 0 0) 0x7f1ba40692c0 con 0x7f1ba4097180 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba3fff700 1 -- 172.21.15.125:0/1473830940 >> v1:172.21.15.125:6789/0 conn(0x7f1ba4097180 legacy=0x7f1ba4067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba3fff700 1 -- 172.21.15.125:0/1473830940 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4093430 con 0x7f1ba40968b0 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba89b3700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 0x7f1ba412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba3fff700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4096c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1b94009790 tx=0x7f1b94009060).ready entity=mon.1 client_cookie=2d34c985946242c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba2ffd700 1 -- 172.21.15.125:0/1473830940 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400f510 con 0x7f1ba40968b0 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba2ffd700 1 -- 172.21.15.125:0/1473830940 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400f670 con 0x7f1ba40968b0 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1ba2ffd700 1 -- 172.21.15.125:0/1473830940 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400f9f0 con 0x7f1ba40968b0 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 -- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 msgr2=0x7f1ba4096c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4096c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1b94009790 tx=0x7f1b94009060).stop 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 -- 172.21.15.125:0/1473830940 shutdown_connections 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba40685a0 0x7f1ba412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 --2- 172.21.15.125:0/1473830940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4096c90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 -- 172.21.15.125:0/1473830940 >> 172.21.15.125:0/1473830940 conn(0x7f1ba409a1c0 msgr2=0x7f1ba409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 -- 172.21.15.125:0/1473830940 shutdown_connections 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.649+0000 7f1baa416700 1 -- 172.21.15.125:0/1473830940 wait complete. 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.650+0000 7f1baa416700 1 Processor -- start 2023-10-03T10:09:30.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.650+0000 7f1baa416700 1 -- start start 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 0x7f1ba4115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4117180 con 0x7f1ba40685a0 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4099800 con 0x7f1ba40968b0 2023-10-03T10:09:30.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1baa416700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba412c080 con 0x7f1ba4097180 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42232/0 (socket says 172.21.15.125:42232) 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 -- 172.21.15.125:0/2127021199 learned_addr learned my addr 172.21.15.125:0/2127021199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba89b3700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 0x7f1ba4115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba37fe700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 -- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 msgr2=0x7f1ba4115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 0x7f1ba4115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 -- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 msgr2=0x7f1ba4138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4138830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 -- 172.21.15.125:0/2127021199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c009a20 con 0x7f1ba40685a0 2023-10-03T10:09:30.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba89b3700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 0x7f1ba4115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.651+0000 7f1ba3fff700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1b94006d70 tx=0x7f1b94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400f7e0 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400f940 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940092a0 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9401b660 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba40679e0 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1b9401b9d0 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.652+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1b9403c970 con 0x7f1ba40685a0 2023-10-03T10:09:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.653+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba4091dc0 con 0x7f1ba40685a0 2023-10-03T10:09:30.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.657+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1b94029080 con 0x7f1ba40685a0 2023-10-03T10:09:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.820+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ba405a260 con 0x7f1ba40685a0 2023-10-03T10:09:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.821+0000 7f1b8bfff700 1 -- 172.21.15.125:0/2127021199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b9401f020 con 0x7f1ba40685a0 2023-10-03T10:09:30.822 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:09:30.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 >> v1:172.21.15.125:6816/118167 conn(0x7f1b9002bb60 legacy=0x7f1b9002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 msgr2=0x7f1ba4138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1b94006d70 tx=0x7f1b94017000).stop 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 shutdown_connections 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ba4097180 0x7f1ba4115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ba40685a0 0x7f1ba4138340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 --2- 172.21.15.125:0/2127021199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ba40968b0 0x7f1ba4138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.822+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 >> 172.21.15.125:0/2127021199 conn(0x7f1ba409a1c0 msgr2=0x7f1ba412ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.823+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 shutdown_connections 2023-10-03T10:09:30.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.823+0000 7f1baa416700 1 -- 172.21.15.125:0/2127021199 wait complete. 2023-10-03T10:09:30.835 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:09:30.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.951+0000 7f33a387b700 1 Processor -- start 2023-10-03T10:09:30.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 -- start start 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c094ba0 con 0x7f339c12c240 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c092e90 con 0x7f339c093950 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a387b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f339c096b60 con 0x7f339c095c50 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a0e16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a1617700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a1617700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40658/0 (socket says 172.21.15.125:40658) 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a0e16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55536/0 (socket says 172.21.15.125:55536) 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.952+0000 7f33a1617700 1 -- 172.21.15.125:0/4127911026 learned_addr learned my addr 172.21.15.125:0/4127911026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a1617700 1 -- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 msgr2=0x7f339c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a1617700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f338ffff700 1 -- 172.21.15.125:0/4127911026 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650646702 0 0) 0x7f339c094ba0 con 0x7f339c12c240 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a1617700 1 -- 172.21.15.125:0/4127911026 >> v1:172.21.15.125:6789/0 conn(0x7f339c12c240 legacy=0x7f339c12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a1617700 1 -- 172.21.15.125:0/4127911026 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c093150 con 0x7f339c093950 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a0e16700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a1617700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3390009830 tx=0x7f33900090f0).ready entity=mon.1 client_cookie=8b561d0ed7c56dce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f338ffff700 1 -- 172.21.15.125:0/4127911026 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000b580 con 0x7f339c093950 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f338ffff700 1 -- 172.21.15.125:0/4127911026 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339000b6e0 con 0x7f339c093950 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f338ffff700 1 -- 172.21.15.125:0/4127911026 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000ba80 con 0x7f339c093950 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 -- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 msgr2=0x7f339c095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3390009830 tx=0x7f33900090f0).stop 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 -- 172.21.15.125:0/4127911026 shutdown_connections 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c095760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 --2- 172.21.15.125:0/4127911026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c095c50 0x7f339c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 -- 172.21.15.125:0/4127911026 >> 172.21.15.125:0/4127911026 conn(0x7f339c09aa50 msgr2=0x7f339c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 -- 172.21.15.125:0/4127911026 shutdown_connections 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.953+0000 7f33a387b700 1 -- 172.21.15.125:0/4127911026 wait complete. 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.954+0000 7f33a387b700 1 Processor -- start 2023-10-03T10:09:30.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.954+0000 7f33a387b700 1 -- start start 2023-10-03T10:09:30.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c127850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c12b730 con 0x7f339c095c50 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c129cf0 con 0x7f339c093950 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a387b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f339c12a290 con 0x7f339c12c240 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a1e18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42242/0 (socket says 172.21.15.125:42242) 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a1e18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55540/0 (socket says 172.21.15.125:55540) 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 -- 172.21.15.125:0/3133351194 learned_addr learned my addr 172.21.15.125:0/3133351194 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a1617700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c127850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 -- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 msgr2=0x7f339c12b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 -- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 msgr2=0x7f339c127850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c127850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 -- 172.21.15.125:0/3133351194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980092a0 con 0x7f339c095c50 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a1617700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c127850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a1e18700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.955+0000 7f33a0e16700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f339800e9d0 tx=0x7f3398009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800c6a0 con 0x7f339c095c50 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339800c800 con 0x7f339c095c50 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3390009370 con 0x7f339c095c50 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800cb80 con 0x7f339c095c50 2023-10-03T10:09:30.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c12a060 con 0x7f339c095c50 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f339801b400 con 0x7f339c095c50 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f339803b4d0 con 0x7f339c095c50 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.956+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c05a260 con 0x7f339c095c50 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:30.961+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3398016030 con 0x7f339c095c50 2023-10-03T10:09:31.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.116+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f339c069a50 con 0x7f339c095c50 2023-10-03T10:09:31.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.117+0000 7f338d7fa700 1 -- 172.21.15.125:0/3133351194 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3398019900 con 0x7f339c095c50 2023-10-03T10:09:31.117 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:09:31.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 >> v1:172.21.15.125:6816/118167 conn(0x7f338002bb60 legacy=0x7f338002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 msgr2=0x7f339c12b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f339800e9d0 tx=0x7f3398009060).stop 2023-10-03T10:09:31.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 shutdown_connections 2023-10-03T10:09:31.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f339c12c240 0x7f339c12b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f339c093950 0x7f339c127850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 --2- 172.21.15.125:0/3133351194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f339c095c50 0x7f339c12b240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 >> 172.21.15.125:0/3133351194 conn(0x7f339c09aa50 msgr2=0x7f339c068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 shutdown_connections 2023-10-03T10:09:31.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.118+0000 7f33a387b700 1 -- 172.21.15.125:0/3133351194 wait complete. 2023-10-03T10:09:31.131 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.245+0000 7fed952ea700 1 Processor -- start 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.245+0000 7fed952ea700 1 -- start start 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900973f0 con 0x7fed90096490 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90062ee0 con 0x7fed90095b80 2023-10-03T10:09:31.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed952ea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed90091980 con 0x7fed90062b00 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42246/0 (socket says 172.21.15.125:42246) 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55548/0 (socket says 172.21.15.125:55548) 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8f7fe700 1 -- 172.21.15.125:0/4184951506 learned_addr learned my addr 172.21.15.125:0/4184951506 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 -- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 msgr2=0x7fed90095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 -- 172.21.15.125:0/4184951506 >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 msgr2=0x7fed90131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 --2- 172.21.15.125:0/4184951506 >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 -- 172.21.15.125:0/4184951506 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90092310 con 0x7fed90095b80 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8f7fe700 1 --2- 172.21.15.125:0/4184951506 >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8effd700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8e7fc700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90095fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fed800097c0 tx=0x7fed80009060).ready entity=mon.1 client_cookie=aa57a1f015355b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8dffb700 1 -- 172.21.15.125:0/4184951506 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000d4a0 con 0x7fed90095b80 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.246+0000 7fed8dffb700 1 -- 172.21.15.125:0/4184951506 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8000d600 con 0x7fed90095b80 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed8dffb700 1 -- 172.21.15.125:0/4184951506 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000d980 con 0x7fed90095b80 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 -- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 msgr2=0x7fed90095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90095fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fed800097c0 tx=0x7fed80009060).stop 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 -- 172.21.15.125:0/4184951506 shutdown_connections 2023-10-03T10:09:31.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 --2- 172.21.15.125:0/4184951506 >> v2:172.21.15.125:3300/0 conn(0x7fed90096490 0x7fed90131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90062b00 0x7fed90095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 --2- 172.21.15.125:0/4184951506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90095fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 -- 172.21.15.125:0/4184951506 >> 172.21.15.125:0/4184951506 conn(0x7fed9009aa50 msgr2=0x7fed9009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 -- 172.21.15.125:0/4184951506 shutdown_connections 2023-10-03T10:09:31.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.247+0000 7fed952ea700 1 -- 172.21.15.125:0/4184951506 wait complete. 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.248+0000 7fed952ea700 1 Processor -- start 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.248+0000 7fed952ea700 1 -- start start 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.248+0000 7fed952ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.248+0000 7fed952ea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90116a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.248+0000 7fed952ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 0x7fed90116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed952ea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90117ed0 con 0x7fed90062b00 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed952ea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90099ea0 con 0x7fed90095b80 2023-10-03T10:09:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed952ea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed90096da0 con 0x7fed90096490 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42260/0 (socket says 172.21.15.125:42260) 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 -- 172.21.15.125:0/2135577286 learned_addr learned my addr 172.21.15.125:0/2135577286 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8f7fe700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 0x7fed90116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8e7fc700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90116a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 -- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 msgr2=0x7fed90116f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 0x7fed90116f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 -- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 msgr2=0x7fed90116a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90116a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 -- 172.21.15.125:0/2135577286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed780092a0 con 0x7fed90062b00 2023-10-03T10:09:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8f7fe700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 0x7fed90116f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed8effd700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fed7800ea20 tx=0x7fed78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7800ee60 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7800c850 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed88009ae0 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7800cbd0 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.249+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed800092a0 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.250+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fed7801b400 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.250+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fed7803b4c0 con 0x7fed90062b00 2023-10-03T10:09:31.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.250+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9005a260 con 0x7fed90062b00 2023-10-03T10:09:31.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.254+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fed78019900 con 0x7fed90062b00 2023-10-03T10:09:31.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.448+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed90117830 con 0x7fed90062b00 2023-10-03T10:09:31.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.449+0000 7fed86ffd700 1 -- 172.21.15.125:0/2135577286 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fed78019310 con 0x7fed90062b00 2023-10-03T10:09:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:31.450 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:16.686162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 >> v1:172.21.15.125:6816/118167 conn(0x7fed7002bb90 legacy=0x7fed7002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 msgr2=0x7fed9011aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fed7800ea20 tx=0x7fed78009060).stop 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 shutdown_connections 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed90096490 0x7fed90116f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90062b00 0x7fed9011aa20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 --2- 172.21.15.125:0/2135577286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed90095b80 0x7fed90116a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 >> 172.21.15.125:0/2135577286 conn(0x7fed9009aa50 msgr2=0x7fed90130160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 shutdown_connections 2023-10-03T10:09:31.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.451+0000 7fed952ea700 1 -- 172.21.15.125:0/2135577286 wait complete. 2023-10-03T10:09:31.453 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 5 2023-10-03T10:09:31.463 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:31.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 Processor -- start 2023-10-03T10:09:31.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 -- start start 2023-10-03T10:09:31.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 0x7f51e40976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 0x7f51e41306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40982f0 con 0x7f51e4096810 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4068550 con 0x7f51e412e2d0 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e9f11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4069e20 con 0x7f51e4097300 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 0x7f51e40976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 0x7f51e41306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51e4096810 0x7f51e4096bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43780/0 (socket says 172.21.15.125:43780) 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.578+0000 7f51e37fe700 1 -- 172.21.15.125:0/1938588658 learned_addr learned my addr 172.21.15.125:0/1938588658 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e2ffd700 1 -- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 msgr2=0x7f51e41306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e27fc700 1 -- 172.21.15.125:0/1938588658 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826932838 0 0) 0x7f51e40982f0 con 0x7f51e4096810 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e2ffd700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 0x7f51e41306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e2ffd700 1 -- 172.21.15.125:0/1938588658 >> v1:172.21.15.125:6789/0 conn(0x7f51e4096810 legacy=0x7f51e4096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e2ffd700 1 -- 172.21.15.125:0/1938588658 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4097bd0 con 0x7f51e4097300 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e3fff700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 0x7f51e41306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e2ffd700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 0x7f51e40976e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f51d8009790 tx=0x7f51d8009060).ready entity=mon.2 client_cookie=8ded95cb9a56cc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e27fc700 1 -- 172.21.15.125:0/1938588658 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80090d0 con 0x7f51e4097300 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e27fc700 1 -- 172.21.15.125:0/1938588658 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800f510 con 0x7f51e4097300 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e27fc700 1 -- 172.21.15.125:0/1938588658 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800f890 con 0x7f51e4097300 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e9f11700 1 -- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 msgr2=0x7f51e40976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.579+0000 7f51e9f11700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 0x7f51e40976e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f51d8009790 tx=0x7f51d8009060).stop 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 -- 172.21.15.125:0/1938588658 shutdown_connections 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e412e2d0 0x7f51e41306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 --2- 172.21.15.125:0/1938588658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e4097300 0x7f51e40976e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 -- 172.21.15.125:0/1938588658 >> 172.21.15.125:0/1938588658 conn(0x7f51e409bad0 msgr2=0x7f51e409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 -- 172.21.15.125:0/1938588658 shutdown_connections 2023-10-03T10:09:31.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 -- 172.21.15.125:0/1938588658 wait complete. 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.580+0000 7f51e9f11700 1 Processor -- start 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 -- start start 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 0x7f51e4117c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e412e2d0 0x7f51e4118150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e406a040 con 0x7f51e4097300 2023-10-03T10:09:31.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e412dd30 con 0x7f51e4096810 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e9f11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51e411b6b0 con 0x7f51e412e2d0 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 0x7f51e4117c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40710/0 (socket says 172.21.15.125:40710) 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e412e2d0 0x7f51e4118150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 -- 172.21.15.125:0/2716375941 learned_addr learned my addr 172.21.15.125:0/2716375941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 -- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e412e2d0 msgr2=0x7f51e4118150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e412e2d0 0x7f51e4118150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 -- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 msgr2=0x7f51e4117c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 0x7f51e4117c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 -- 172.21.15.125:0/2716375941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009a20 con 0x7f51e4096810 2023-10-03T10:09:31.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e2ffd700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 0x7f51e4117c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.581+0000 7f51e37fe700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f51d400c4c0 tx=0x7f51d4007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40072e0 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4007440 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d80092a0 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40057a0 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e411b110 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f51d4005b90 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.582+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f51d403a8c0 con 0x7f51e4096810 2023-10-03T10:09:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.583+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e405a260 con 0x7f51e4096810 2023-10-03T10:09:31.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.587+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f51d4013970 con 0x7f51e4096810 2023-10-03T10:09:31.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.747+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e4118a60 con 0x7f51e4096810 2023-10-03T10:09:31.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.748+0000 7f51cb7fe700 1 -- 172.21.15.125:0/2716375941 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f51d401c3a0 con 0x7f51e4096810 2023-10-03T10:09:31.749 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:31.749 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:15.683296+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:31.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 >> v1:172.21.15.125:6816/118167 conn(0x7f51d002bb60 legacy=0x7f51d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 msgr2=0x7f51e411bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f51d400c4c0 tx=0x7f51d4007c10).stop 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 shutdown_connections 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51e412e2d0 0x7f51e4118150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51e4096810 0x7f51e411bbb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 --2- 172.21.15.125:0/2716375941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51e4097300 0x7f51e4117c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 >> 172.21.15.125:0/2716375941 conn(0x7f51e409bad0 msgr2=0x7f51e40949a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 shutdown_connections 2023-10-03T10:09:31.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.750+0000 7f51e9f11700 1 -- 172.21.15.125:0/2716375941 wait complete. 2023-10-03T10:09:31.762 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.876+0000 7f04e110e700 1 Processor -- start 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.876+0000 7f04e110e700 1 -- start start 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04e110e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04dc097790 0x7f04dc12b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04e110e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04e110e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc12ae10 con 0x7f04dc127a50 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04e110e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc12b940 con 0x7f04dc097790 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04e110e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc064b30 con 0x7f04dc12b540 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04dc097790 0x7f04dc12b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04db59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f04dc127a50 0x7f04dc127ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43782/0 (socket says 172.21.15.125:43782) 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04db59e700 1 -- 172.21.15.125:0/2420929661 learned_addr learned my addr 172.21.15.125:0/2420929661 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 -- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 msgr2=0x7f04dc127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc127560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 -- 172.21.15.125:0/2420929661 >> v1:172.21.15.125:6789/0 conn(0x7f04dc127a50 legacy=0x7f04dc127ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 -- 172.21.15.125:0/2420929661 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc065750 con 0x7f04dc097790 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04d9d9b700 1 -- 172.21.15.125:0/2420929661 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946879463 0 0) 0x7f04d4001490 con 0x7f04dc127a50 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04da59c700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.877+0000 7f04dad9d700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc12b050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04c4009760 tx=0x7f04c4009060).ready entity=mon.0 client_cookie=fde6b436730eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04d9d9b700 1 -- 172.21.15.125:0/2420929661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400f510 con 0x7f04dc097790 2023-10-03T10:09:31.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04d9d9b700 1 -- 172.21.15.125:0/2420929661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400f670 con 0x7f04dc097790 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04d9d9b700 1 -- 172.21.15.125:0/2420929661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400f9f0 con 0x7f04dc097790 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 -- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 msgr2=0x7f04dc12b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc12b050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04c4009760 tx=0x7f04c4009060).stop 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 -- 172.21.15.125:0/2420929661 shutdown_connections 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc12b050 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 --2- 172.21.15.125:0/2420929661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 -- 172.21.15.125:0/2420929661 >> 172.21.15.125:0/2420929661 conn(0x7f04dc09bad0 msgr2=0x7f04dc09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 -- 172.21.15.125:0/2420929661 shutdown_connections 2023-10-03T10:09:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.878+0000 7f04e110e700 1 -- 172.21.15.125:0/2420929661 wait complete. 2023-10-03T10:09:31.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.879+0000 7f04e110e700 1 Processor -- start 2023-10-03T10:09:31.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.879+0000 7f04e110e700 1 -- start start 2023-10-03T10:09:31.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.879+0000 7f04e110e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.879+0000 7f04e110e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04dc127a50 0x7f04dc13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.879+0000 7f04e110e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc12d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04e110e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc124d70 con 0x7f04dc097790 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04e110e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc112b20 con 0x7f04dc12b540 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04e110e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1139f0 con 0x7f04dc127a50 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42282/0 (socket says 172.21.15.125:42282) 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04da59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04dc127a50 0x7f04dc13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 -- 172.21.15.125:0/444375 learned_addr learned my addr 172.21.15.125:0/444375 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04db59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc12d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 -- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04dc127a50 msgr2=0x7f04dc13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04dc127a50 0x7f04dc13a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 -- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 msgr2=0x7f04dc12d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc12d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 -- 172.21.15.125:0/444375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0092a0 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04db59e700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc12d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04dad9d700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f04c4009e00 tx=0x7f04c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400f7e0 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400f940 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c40092a0 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c401b660 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.880+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc12f100 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.881+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f04c401ba50 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.881+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f04c403c7f0 con 0x7f04dc097790 2023-10-03T10:09:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.881+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc05a260 con 0x7f04dc097790 2023-10-03T10:09:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:31.886+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f04c4029020 con 0x7f04dc097790 2023-10-03T10:09:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.080+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04dc046c20 con 0x7f04dc097790 2023-10-03T10:09:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.081+0000 7f04d2ffd700 1 -- 172.21.15.125:0/444375 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f04c4033090 con 0x7f04dc097790 2023-10-03T10:09:32.081 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:32.082 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:16.686162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:32.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 >> v1:172.21.15.125:6816/118167 conn(0x7f04bc02bb60 legacy=0x7f04bc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 msgr2=0x7f04dc13a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f04c4009e00 tx=0x7f04c4017000).stop 2023-10-03T10:09:32.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 shutdown_connections 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc12b540 0x7f04dc12d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc097790 0x7f04dc13a3b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 --2- 172.21.15.125:0/444375 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04dc127a50 0x7f04dc13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 >> 172.21.15.125:0/444375 conn(0x7f04dc09bad0 msgr2=0x7f04dc128dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 shutdown_connections 2023-10-03T10:09:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.082+0000 7f04e110e700 1 -- 172.21.15.125:0/444375 wait complete. 2023-10-03T10:09:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 5 2023-10-03T10:09:32.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:14.682102+0000', 'modified': '2023-10-03T10:09:16.686162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6817/582467044', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.125:6817', 'nonce': 582467044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:09:32.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:09:32.196 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:09:32.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.311+0000 7fcfee362700 1 Processor -- start 2023-10-03T10:09:32.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.311+0000 7fcfee362700 1 -- start start 2023-10-03T10:09:32.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfee362700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfee362700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfe812b540 0x7fcfe8127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfee362700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe812ae10 con 0x7fcfe8127a50 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfee362700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe812b940 con 0x7fcfe812b540 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfee362700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8064b30 con 0x7fcfe8097790 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfe812b540 0x7fcfe8127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfe812b540 0x7fcfe8127560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42292/0 (socket says 172.21.15.125:42292) 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40742/0 (socket says 172.21.15.125:40742) 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 -- 172.21.15.125:0/1010479046 learned_addr learned my addr 172.21.15.125:0/1010479046 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 -- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 msgr2=0x7fcfe812b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 -- 172.21.15.125:0/1010479046 >> v1:172.21.15.125:6789/0 conn(0x7fcfe8127a50 legacy=0x7fcfe8127ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/1010479046 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012007643 0 0) 0x7fcfe0001490 con 0x7fcfe8127a50 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 -- 172.21.15.125:0/1010479046 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8065750 con 0x7fcfe812b540 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.312+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe812b540 0x7fcfe8127560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcfd8006fd0 tx=0x7fcfd80090f0).ready entity=mon.0 client_cookie=6406fe7afe402f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/1010479046 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800b580 con 0x7fcfe812b540 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/1010479046 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800b6e0 con 0x7fcfe812b540 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/1010479046 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800ba60 con 0x7fcfe812b540 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 -- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe812b540 msgr2=0x7fcfe8127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe812b540 0x7fcfe8127560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcfd8006fd0 tx=0x7fcfd80090f0).stop 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 -- 172.21.15.125:0/1010479046 shutdown_connections 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8097790 0x7fcfe812b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 --2- 172.21.15.125:0/1010479046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe812b540 0x7fcfe8127560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 -- 172.21.15.125:0/1010479046 >> 172.21.15.125:0/1010479046 conn(0x7fcfe809bad0 msgr2=0x7fcfe809bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 -- 172.21.15.125:0/1010479046 shutdown_connections 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.313+0000 7fcfee362700 1 -- 172.21.15.125:0/1010479046 wait complete. 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.314+0000 7fcfee362700 1 Processor -- start 2023-10-03T10:09:32.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.314+0000 7fcfee362700 1 -- start start 2023-10-03T10:09:32.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.314+0000 7fcfee362700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.314+0000 7fcfee362700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 0x7fcfe8113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.314+0000 7fcfee362700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812b540 0x7fcfe8113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfee362700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8117460 con 0x7fcfe8097790 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfee362700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe809a270 con 0x7fcfe8127a50 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfee362700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8065130 con 0x7fcfe812b540 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 0x7fcfe8113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42302/0 (socket says 172.21.15.125:42302) 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe7fff700 1 -- 172.21.15.125:0/647016673 learned_addr learned my addr 172.21.15.125:0/647016673 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812b540 0x7fcfe8113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 -- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812b540 msgr2=0x7fcfe8113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812b540 0x7fcfe8113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 -- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 msgr2=0x7fcfe8124a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 -- 172.21.15.125:0/647016673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0092a0 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 0x7fcfe8113950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcfd8014000 tx=0x7fcfd8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfcffff700 1 -- 172.21.15.125:0/647016673 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8000bc0 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfcffff700 1 -- 172.21.15.125:0/647016673 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800b850 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd8009370 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfcffff700 1 -- 172.21.15.125:0/647016673 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8000d20 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.315+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe8117c90 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.316+0000 7fcfcffff700 1 -- 172.21.15.125:0/647016673 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcfd801d950 con 0x7fcfe8127a50 2023-10-03T10:09:32.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.316+0000 7fcfcffff700 1 -- 172.21.15.125:0/647016673 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcfd803cb00 con 0x7fcfe8127a50 2023-10-03T10:09:32.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 Processor -- start 2023-10-03T10:09:32.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 -- start start 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6721f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd671e9610 con 0x55dd6721f170 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd6715fdb0 con 0x55dd672495b0 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd67175030 con 0x55dd6721fa40 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfec8ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55602/0 (socket says 172.21.15.125:55602) 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfe77fe700 1 -- 172.21.15.125:0/1595253539 learned_addr learned my addr 172.21.15.125:0/1595253539 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40764/0 (socket says 172.21.15.125:40764) 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.319+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6721f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 -- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 msgr2=0x55dd672490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 -- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 msgr2=0x55dd6721f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6721f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 -- 172.21.15.125:0/1595253539 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd67010710 con 0x55dd672495b0 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcfe0002a40 tx=0x7fcfe0007d40).ready entity=mon.1 client_cookie=ea16fd2eee37fed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfcd7fa700 1 -- 172.21.15.125:0/1595253539 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0002e20 con 0x55dd672495b0 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfcd7fa700 1 -- 172.21.15.125:0/1595253539 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000e860 con 0x55dd672495b0 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.320+0000 7fcfcd7fa700 1 -- 172.21.15.125:0/1595253539 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000ec00 con 0x55dd672495b0 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 msgr2=0x55dd6724b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcfe0002a40 tx=0x7fcfe0007d40).stop 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1595253539 shutdown_connections 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724b9a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6721f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1595253539 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd672490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1595253539 >> 172.21.15.125:0/1595253539 conn(0x55dd6708d940 msgr2=0x55dd6723fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1595253539 shutdown_connections 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1595253539 wait complete. 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 -- start start 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.321+0000 7fcfffd15b80 1 Processor -- start 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd67244970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd67175170 con 0x55dd6721f170 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd671753f0 con 0x55dd6721fa40 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd67140920 con 0x55dd672495b0 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 10 client.0 ll_register_callbacks cb 0x55dd67115ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd67244970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40768/0 (socket says 172.21.15.125:40768) 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfe77fe700 1 -- 172.21.15.125:0/4262287263 learned_addr learned my addr 172.21.15.125:0/4262287263 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 -- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 msgr2=0x55dd6724f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 -- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 msgr2=0x55dd6724ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 -- 172.21.15.125:0/4262287263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe000f040 con 0x55dd672495b0 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd67244970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcfe0016000 tx=0x7fcfe0019000).ready entity=mon.2 client_cookie=7cce4f8126540833 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfc67fc700 10 client.0 ms_handle_connect on v2:172.21.15.125:3302/0 2023-10-03T10:09:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000eba0 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mon.2 v2:172.21.15.125:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcfe00019d0 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd67217f20 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfe0001da0 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 10 client.4487 fetch_fsmap learned FSMap version 5 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.322+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x55dd67147b00 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mon.2 v2:172.21.15.125:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd67217f20 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mon.2 v2:172.21.15.125:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fcfe0026070 con 0x55dd672495b0 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfffd15b80 10 client.4487 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfffd15b80 10 client.4487 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfffd15b80 20 client.4487 populate_metadata read hostname 'smithi125' 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfffd15b80 4 client.4487 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:09:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd671ed250 con 0x55dd67245430 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.323+0000 7fcfc67fc700 10 client.4487 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfc67fc700 1 -- 172.21.15.125:0/4262287263 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55dd671ed250 con 0x55dd67245430 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfc67fc700 10 client.4487 handle_command_reply: tid=0 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 client.4487 shutdown 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 msgr2=0x55dd67244970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd67244970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcfe0016000 tx=0x7fcfe0019000).stop 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 shutdown_connections 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd67244970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfc67fc700 0 client.4487 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/4262287263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721fa40 0x55dd6724f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 >> 172.21.15.125:0/4262287263 conn(0x55dd6708d940 msgr2=0x55dd6723fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 shutdown_connections 2023-10-03T10:09:32.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 1 -- 172.21.15.125:0/4262287263 wait complete. 2023-10-03T10:09:32.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.324+0000 7fcfffd15b80 20 client.4487 trim_cache size 0 max 16384 2023-10-03T10:09:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.340+0000 7fcfffd15b80 1 Processor -- start 2023-10-03T10:09:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.340+0000 7fcfffd15b80 1 -- start start 2023-10-03T10:09:32.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.340+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.340+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 0x55dd6723b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.340+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd672221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd671e44c0 con 0x55dd6721fa40 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd671e9480 con 0x55dd6721f170 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd6723a1b0 con 0x55dd672495b0 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfec8ff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd672221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40784/0 (socket says 172.21.15.125:40784) 2023-10-03T10:09:32.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfec8ff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd672221f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55620/0 (socket says 172.21.15.125:55620) 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1292911331 learned_addr learned my addr 172.21.15.125:0/1292911331 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 0x55dd6723b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 msgr2=0x55dd672221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd672221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 msgr2=0x55dd6723b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 0x55dd6723b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1292911331 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6716df70 con 0x55dd6721f170 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 0x55dd6723b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcfdc009fd0 tx=0x7fcfdc0113d0).ready entity=mon.1 client_cookie=2914b124f6a1d122 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfcdffb700 1 -- 172.21.15.125:0/1292911331 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc019660 con 0x55dd6721f170 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfcdffb700 1 -- 172.21.15.125:0/1292911331 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc0197c0 con 0x55dd6721f170 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.341+0000 7fcfcdffb700 1 -- 172.21.15.125:0/1292911331 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc019b40 con 0x55dd6721f170 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 msgr2=0x55dd6723fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcfdc009fd0 tx=0x7fcfdc0113d0).stop 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1292911331 shutdown_connections 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd672495b0 0x55dd672221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd6721f170 0x55dd6723fc00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1292911331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721fa40 0x55dd6723b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1292911331 >> 172.21.15.125:0/1292911331 conn(0x55dd6708d940 msgr2=0x55dd67223390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1292911331 shutdown_connections 2023-10-03T10:09:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1292911331 wait complete. 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 -- start start 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.342+0000 7fcfffd15b80 1 Processor -- start 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd6724e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd67287eb0 con 0x55dd6721f170 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd6724d910 con 0x55dd672495b0 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd67247210 con 0x55dd6721fa40 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 10 client.0 ll_register_callbacks cb 0x55dd67115ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd6724e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42334/0 (socket says 172.21.15.125:42334) 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd6724e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55624/0 (socket says 172.21.15.125:55624) 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1519625605 learned_addr learned my addr 172.21.15.125:0/1519625605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 msgr2=0x55dd6724e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd6724e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 msgr2=0x55dd6724e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 -- 172.21.15.125:0/1519625605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc0092a0 con 0x55dd6721f170 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfec8ff700 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fcfdc0090a0 tx=0x7fcfdc01b000).ready entity=mon.0 client_cookie=7abbc1008e0ad1c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfc67fc700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc016610 con 0x55dd6721f170 2023-10-03T10:09:32.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcfdc016770 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.343+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfe000e860 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfdc016b40 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 10 client.4653 fetch_fsmap learned FSMap version 5 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7fcfdc011640 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000e860 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fcfdc011030 con 0x55dd6721f170 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 20 client.4653 populate_metadata read hostname 'smithi125' 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 4 client.4653 mds_command: new command op to 4180 tid=0[{"prefix": "status"}] 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dd66fddef0 con 0x55dd672a3fe0 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 10 client.4653 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:32.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 1 -- 172.21.15.125:0/1519625605 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 1802423064) 0x55dd66fddef0 con 0x55dd672a3fe0 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfc67fc700 10 client.4653 handle_command_reply: tid=0 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.344+0000 7fcfffd15b80 1 client.4653 shutdown 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 msgr2=0x55dd6724db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fcfdc0090a0 tx=0x7fcfdc01b000).stop 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 shutdown_connections 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55dd672495b0 0x55dd6724e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55dd6721f170 0x55dd6724db40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 --2- 172.21.15.125:0/1519625605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55dd6721fa40 0x55dd6724e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfc67fc700 0 client.4653 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 >> 172.21.15.125:0/1519625605 conn(0x55dd6708d940 msgr2=0x55dd6723fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 shutdown_connections 2023-10-03T10:09:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 1 -- 172.21.15.125:0/1519625605 wait complete. 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfffd15b80 20 client.4653 trim_cache size 0 max 16384 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "15b0d202-3c9c-40fb-bdbc-3890d84c122d", 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4180, 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 17.662403461, 2023-10-03T10:09:32.354 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 5, 2023-10-03T10:09:32.355 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 17, 2023-10-03T10:09:32.355 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:09:32.355 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 22.063316777000001 2023-10-03T10:09:32.355 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-03T10:09:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 >> v1:172.21.15.125:6816/118167 conn(0x7fcfd402bb90 legacy=0x7fcfd402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 msgr2=0x7fcfe8113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 0x7fcfe8113950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcfd8014000 tx=0x7fcfd8017000).stop 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 shutdown_connections 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812b540 0x7fcfe8113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe8097790 0x7fcfe8124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 --2- 172.21.15.125:0/647016673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8127a50 0x7fcfe8113950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 >> 172.21.15.125:0/647016673 conn(0x7fcfe809bad0 msgr2=0x7fcfe8129fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 shutdown_connections 2023-10-03T10:09:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.345+0000 7fcfee362700 1 -- 172.21.15.125:0/647016673 wait complete. 2023-10-03T10:09:32.358 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:09:32.367 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:09:32.367 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:09:32.367 DEBUG:teuthology.orchestra.run.smithi125:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-03T10:09:32.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 Processor -- start 2023-10-03T10:09:32.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 -- start start 2023-10-03T10:09:32.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f2578067220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578068060 con 0x7f2578067710 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780690a0 con 0x7f25781291e0 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f25806b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2578069400 con 0x7f2578066e40 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f257ec53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f257e452700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f2578067220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f257ec53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42346/0 (socket says 172.21.15.125:42346) 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f257ec53700 1 -- 172.21.15.125:0/4180821785 learned_addr learned my addr 172.21.15.125:0/4180821785 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.481+0000 7f257dc51700 1 --1- 172.21.15.125:0/4180821785 >> v1:172.21.15.125:6789/0 conn(0x7f2578067710 0x7f2578128ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43800/0 (socket says 172.21.15.125:43800) 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257e452700 1 -- 172.21.15.125:0/4180821785 >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 msgr2=0x7f2578130fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257e452700 1 --2- 172.21.15.125:0/4180821785 >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257e452700 1 -- 172.21.15.125:0/4180821785 >> v1:172.21.15.125:6789/0 conn(0x7f2578067710 legacy=0x7f2578128ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257e452700 1 -- 172.21.15.125:0/4180821785 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578069940 con 0x7f2578066e40 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257d450700 1 -- 172.21.15.125:0/4180821785 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389113529 0 0) 0x7f2578068060 con 0x7f2578067710 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257ec53700 1 --2- 172.21.15.125:0/4180821785 >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257e452700 1 --2- 172.21.15.125:0/4180821785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f2578067220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2574009760 tx=0x7f2574009060).ready entity=mon.2 client_cookie=2c5323eddb6bdd90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257d450700 1 -- 172.21.15.125:0/4180821785 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740090d0 con 0x7f2578066e40 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257d450700 1 -- 172.21.15.125:0/4180821785 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400f510 con 0x7f2578066e40 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f257d450700 1 -- 172.21.15.125:0/4180821785 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400f890 con 0x7f2578066e40 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f25806b6700 1 -- 172.21.15.125:0/4180821785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 msgr2=0x7f2578067220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.482+0000 7f25806b6700 1 --2- 172.21.15.125:0/4180821785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f2578067220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2574009760 tx=0x7f2574009060).stop 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 -- 172.21.15.125:0/4180821785 shutdown_connections 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 --2- 172.21.15.125:0/4180821785 >> v2:172.21.15.125:3300/0 conn(0x7f25781291e0 0x7f2578130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 --2- 172.21.15.125:0/4180821785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f2578067220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 -- 172.21.15.125:0/4180821785 >> 172.21.15.125:0/4180821785 conn(0x7f25780635d0 msgr2=0x7f257809a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 -- 172.21.15.125:0/4180821785 shutdown_connections 2023-10-03T10:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 -- 172.21.15.125:0/4180821785 wait complete. 2023-10-03T10:09:32.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 Processor -- start 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.483+0000 7f25806b6700 1 -- start start 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 0x7f2578117220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 0x7f2578117710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780691f0 con 0x7f25781291e0 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578118690 con 0x7f2578067710 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f25806b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f257811acb0 con 0x7f2578066e40 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257e452700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257dc51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 0x7f2578117220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257e452700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55642/0 (socket says 172.21.15.125:55642) 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257dc51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 0x7f2578117220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40790/0 (socket says 172.21.15.125:40790) 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257e452700 1 -- 172.21.15.125:0/3496367452 learned_addr learned my addr 172.21.15.125:0/3496367452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 0x7f2578117710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 -- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 msgr2=0x7f25781282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 -- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 msgr2=0x7f2578117220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 0x7f2578117220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 -- 172.21.15.125:0/3496367452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009ae0 con 0x7f25781291e0 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257e452700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f257ec53700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 0x7f2578117710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2570009f10 tx=0x7f257000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.484+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700092e0 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000f040 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25740092a0 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000cb70 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257811b390 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2570014460 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f257003af70 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.485+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257805a260 con 0x7f25781291e0 2023-10-03T10:09:32.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.490+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f257001cd30 con 0x7f25781291e0 2023-10-03T10:09:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.657+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f2578118020 con 0x7f25781291e0 2023-10-03T10:09:32.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.740+0000 7f256e7fc700 1 -- 172.21.15.125:0/3496367452 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7f2570026070 con 0x7f25781291e0 2023-10-03T10:09:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 >> v1:172.21.15.125:6816/118167 conn(0x7f255c02bb60 legacy=0x7f255c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 msgr2=0x7f2578117710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 0x7f2578117710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2570009f10 tx=0x7f257000b040).stop 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 shutdown_connections 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781291e0 0x7f2578117710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2578066e40 0x7f25781282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 --2- 172.21.15.125:0/3496367452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2578067710 0x7f2578117220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 >> 172.21.15.125:0/3496367452 conn(0x7f25780635d0 msgr2=0x7f2578095950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 shutdown_connections 2023-10-03T10:09:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:32.744+0000 7f25806b6700 1 -- 172.21.15.125:0/3496367452 wait complete. 2023-10-03T10:09:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:set require_min_compat_client to pacific 2023-10-03T10:09:32.756 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:09:32.764 INFO:teuthology.task.print:**** done ceph 2023-10-03T10:09:32.764 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T10:09:32.796 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T10:09:32.796 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-03T10:09:32.796 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T10:09:32.796 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T10:09:32.797 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:32.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:32.797 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-10-03T10:09:32.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:32.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-10-03T10:09:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2023-10-03T10:09:32.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:09:32.899 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T10:09:32.899 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T10:09:33.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.016+0000 7fbbe5cbd700 1 Processor -- start 2023-10-03T10:09:33.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.016+0000 7fbbe5cbd700 1 -- start start 2023-10-03T10:09:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbe5cbd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbe5cbd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbe012dd40 0x7fbbe0130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbe5cbd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe0093340 con 0x7fbbe005f560 2023-10-03T10:09:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbe5cbd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe005f940 con 0x7fbbe012dd40 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbe5cbd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0097c30 con 0x7fbbe0092190 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbe012dd40 0x7fbbe0130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40802/0 (socket says 172.21.15.125:40802) 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbbe005f560 0x7fbbe0128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43810/0 (socket says 172.21.15.125:43810) 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdeffd700 1 -- 172.21.15.125:0/4253987775 learned_addr learned my addr 172.21.15.125:0/4253987775 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbe012dd40 0x7fbbe0130130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42358/0 (socket says 172.21.15.125:42358) 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 -- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 msgr2=0x7fbbe01293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 -- 172.21.15.125:0/4253987775 >> v1:172.21.15.125:6789/0 conn(0x7fbbe005f560 legacy=0x7fbbe0128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbde7fc700 1 -- 172.21.15.125:0/4253987775 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283367976 0 0) 0x7fbbe0093340 con 0x7fbbe005f560 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdffff700 1 -- 172.21.15.125:0/4253987775 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00941f0 con 0x7fbbe012dd40 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.017+0000 7fbbdeffd700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbdffff700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0130130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbbd8009e60 tx=0x7fbbd8009780).ready entity=mon.0 client_cookie=6253597492e02647 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbde7fc700 1 -- 172.21.15.125:0/4253987775 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800e070 con 0x7fbbe012dd40 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbde7fc700 1 -- 172.21.15.125:0/4253987775 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800bb60 con 0x7fbbe012dd40 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbde7fc700 1 -- 172.21.15.125:0/4253987775 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8012410 con 0x7fbbe012dd40 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 msgr2=0x7fbbe0130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0130130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbbd8009e60 tx=0x7fbbd8009780).stop 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/4253987775 shutdown_connections 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0130130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/4253987775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe01293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/4253987775 >> 172.21.15.125:0/4253987775 conn(0x7fbbe009a1c0 msgr2=0x7fbbe009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/4253987775 shutdown_connections 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.018+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/4253987775 wait complete. 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.019+0000 7fbbe5cbd700 1 Processor -- start 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.019+0000 7fbbe5cbd700 1 -- start start 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbe005f560 0x7fbbe01282d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0113ca0 con 0x7fbbe012dd40 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0097d80 con 0x7fbbe0092190 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00991b0 con 0x7fbbe005f560 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbe005f560 0x7fbbe01282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40806/0 (socket says 172.21.15.125:40806) 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42362/0 (socket says 172.21.15.125:42362) 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 -- 172.21.15.125:0/3738385817 learned_addr learned my addr 172.21.15.125:0/3738385817 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 -- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbe005f560 msgr2=0x7fbbe01282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbe005f560 0x7fbbe01282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 -- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 msgr2=0x7fbbe0110d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 -- 172.21.15.125:0/3738385817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8009370 con 0x7fbbe0092190 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdffff700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbdeffd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbbc800ea50 tx=0x7fbbc80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800ee90 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800c7f0 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8009a20 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800cb70 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.020+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe0114310 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.021+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbbc801b400 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.021+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbbc803b560 con 0x7fbbe0092190 2023-10-03T10:09:33.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.021+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe0128980 con 0x7fbbe0092190 2023-10-03T10:09:33.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.026+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbbe0128980 con 0x7fbbe0092190 2023-10-03T10:09:33.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.225+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbbe0128980 con 0x7fbbe0092190 2023-10-03T10:09:33.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.225+0000 7fbbd77fe700 1 -- 172.21.15.125:0/3738385817 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbbe0128980 con 0x7fbbe0092190 2023-10-03T10:09:33.226 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 >> v1:172.21.15.125:6816/118167 conn(0x7fbbc002bb60 legacy=0x7fbbc002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 msgr2=0x7fbbe0110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbbc800ea50 tx=0x7fbbc80090f0).stop 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 shutdown_connections 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe012dd40 0x7fbbe0110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbe005f560 0x7fbbe01282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 --2- 172.21.15.125:0/3738385817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe0092190 0x7fbbe0110820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 >> 172.21.15.125:0/3738385817 conn(0x7fbbe009a1c0 msgr2=0x7fbbe012fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:33.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 shutdown_connections 2023-10-03T10:09:33.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:33.227+0000 7fbbe5cbd700 1 -- 172.21.15.125:0/3738385817 wait complete. 2023-10-03T10:09:33.239 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T10:09:33.240 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:09:33.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.241 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-10-03T10:09:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T10:09:33.263 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:09:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42554sec preferred_lft 42554sec 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:09:33.265 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T10:09:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T10:09:33.266 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-10-03T10:09:33.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.442 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T10:09:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-10-03T10:09:33.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.475 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-10-03T10:09:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-10-03T10:09:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T10:09:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T10:09:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T10:09:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T10:09:33.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T10:09:33.553 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-10-03T10:09:33.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.813 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-10-03T10:09:33.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.831 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-10-03T10:09:33.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-10-03T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-10-03T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-10-03T10:09:33.983 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T10:09:33.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:33.983 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T10:09:33.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T10:09:33.985 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-10-03T10:09:34.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.168 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-10-03T10:09:34.168 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-10-03T10:09:34.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2023-10-03T10:09:34.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T10:09:34.169 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-10-03T10:09:34.266 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T10:09:34.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:09:34.266 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:09:34.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:09:34.284 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:34.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-10-03T10:09:34.409 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-10-03T10:09:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/memory 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:09:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/devices 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/pids 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-10-03T10:09:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:09:34.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.471 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-10-03T10:09:34.526 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T10:09:34.526 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T10:09:34.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-10-03T10:09:34.595 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:09:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-10-03T10:09:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:09:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/memory 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/devices 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup/pids 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-10-03T10:09:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:09:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:09:34.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.659 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-10-03T10:09:34.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:2023-10-03T10:09:34.657+0000 7f39864d43c0 -1 init, newargv = 0x5608c7b06230 newargc=15 2023-10-03T10:09:34.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[112268]: starting ceph client 2023-10-03T10:09:34.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[112268]: starting fuse 2023-10-03T10:09:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:46 2023-10-03T10:09:34.677 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-03T10:09:34.677 DEBUG:teuthology.orchestra.run.smithi167:> sudo stdin-killer -- python3 -c ' 2023-10-03T10:09:34.677 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-10-03T10:09:34.678 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.0")) 2023-10-03T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-10-03T10:09:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.0.112268.asok 2023-10-03T10:09:34.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-03T10:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-03T10:09:34.811 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112268.asok 2023-10-03T10:09:34.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112268.asok status 2023-10-03T10:09:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-03T10:09:34.972 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-10-03T10:09:34.972 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-03T10:09:34.972 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-03T10:09:34.972 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "0", 2023-10-03T10:09:34.972 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "112268", 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-10-03T10:09:34.973 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4504, 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4504 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-10-03T10:09:34.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:0", 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 605701452 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:0", 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 605701452 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4504 172.21.15.167:0/605701452", 2023-10-03T10:09:34.975 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "172.21.15.167:0/605701452", 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 5, 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 18, 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-10-03T10:09:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-03T10:09:34.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.977 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-10-03T10:09:34.977 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-10-03T10:09:34.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:09:34.996 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:09:35.064 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-03T10:09:35.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:35.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.205+0000 7f93738cc700 1 Processor -- start 2023-10-03T10:09:35.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.205+0000 7f93738cc700 1 -- start start 2023-10-03T10:09:35.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c096490 0x7f936c131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0973f0 con 0x7f936c062b00 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c062ee0 con 0x7f936c096490 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f93738cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f936c091980 con 0x7f936c095b80 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9371668700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9371e69700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c096490 0x7f936c131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9371668700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42376/0 (socket says 172.21.15.125:42376) 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55656/0 (socket says 172.21.15.125:55656) 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9371668700 1 -- 172.21.15.125:0/2862289774 learned_addr learned my addr 172.21.15.125:0/2862289774 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 -- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c096490 msgr2=0x7f936c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 --2- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c096490 0x7f936c131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 -- 172.21.15.125:0/2862289774 >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 msgr2=0x7f936c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 --2- 172.21.15.125:0/2862289774 >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 -- 172.21.15.125:0/2862289774 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c092310 con 0x7f936c095b80 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9371668700 1 --2- 172.21.15.125:0/2862289774 >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9370e67700 1 --2- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9368009790 tx=0x7f9368009060).ready entity=mon.2 client_cookie=1520496da0e89979 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9363fff700 1 -- 172.21.15.125:0/2862289774 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800d4a0 con 0x7f936c095b80 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9363fff700 1 -- 172.21.15.125:0/2862289774 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800d600 con 0x7f936c095b80 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.206+0000 7f9363fff700 1 -- 172.21.15.125:0/2862289774 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800d980 con 0x7f936c095b80 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 -- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 msgr2=0x7f936c095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 --2- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9368009790 tx=0x7f9368009060).stop 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 -- 172.21.15.125:0/2862289774 shutdown_connections 2023-10-03T10:09:35.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 --2- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c096490 0x7f936c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 --2- 172.21.15.125:0/2862289774 >> v2:172.21.15.125:3300/0 conn(0x7f936c062b00 0x7f936c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 --2- 172.21.15.125:0/2862289774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c095fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 -- 172.21.15.125:0/2862289774 >> 172.21.15.125:0/2862289774 conn(0x7f936c09aa50 msgr2=0x7f936c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 -- 172.21.15.125:0/2862289774 shutdown_connections 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.207+0000 7f93738cc700 1 -- 172.21.15.125:0/2862289774 wait complete. 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.208+0000 7f93738cc700 1 Processor -- start 2023-10-03T10:09:35.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.208+0000 7f93738cc700 1 -- start start 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c116a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 0x7f936c116ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c117ea0 con 0x7f936c096490 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c096da0 con 0x7f936c062b00 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f936c119f90 con 0x7f936c095b80 2023-10-03T10:09:35.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9370e67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c116a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371e69700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 0x7f936c116ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40826/0 (socket says 172.21.15.125:40826) 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 -- 172.21.15.125:0/3504699496 learned_addr learned my addr 172.21.15.125:0/3504699496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 -- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 msgr2=0x7f936c116a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c116a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 -- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 msgr2=0x7f936c116ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 0x7f936c116ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 -- 172.21.15.125:0/3504699496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009370 con 0x7f936c062b00 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371e69700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 0x7f936c116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9370e67700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c116a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f9371668700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f935c00ea50 tx=0x7f935c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00ee90 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00c850 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680092a0 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00cbd0 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.209+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c118620 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.210+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f935c01b400 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.210+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f935c03b510 con 0x7f936c062b00 2023-10-03T10:09:35.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.210+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c118810 con 0x7f936c062b00 2023-10-03T10:09:35.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.215+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f935c016020 con 0x7f936c062b00 2023-10-03T10:09:35.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.374+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936c05a260 con 0x7f936c062b00 2023-10-03T10:09:35.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.375+0000 7f93617fa700 1 -- 172.21.15.125:0/3504699496 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f935c01be60 con 0x7f936c062b00 2023-10-03T10:09:35.375 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:35.376 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:32.737182+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 >> v1:172.21.15.125:6816/118167 conn(0x7f935002bb60 legacy=0x7f935002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 msgr2=0x7f936c11aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f935c00ea50 tx=0x7f935c0090f0).stop 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 shutdown_connections 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f936c096490 0x7f936c116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f936c062b00 0x7f936c11aa30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 --2- 172.21.15.125:0/3504699496 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f936c095b80 0x7f936c116a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 >> 172.21.15.125:0/3504699496 conn(0x7f936c09aa50 msgr2=0x7f936c1300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 shutdown_connections 2023-10-03T10:09:35.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.377+0000 7f93738cc700 1 -- 172.21.15.125:0/3504699496 wait complete. 2023-10-03T10:09:35.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:09:35.389 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.506+0000 7fb6aebae700 1 Processor -- start 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.506+0000 7fb6aebae700 1 -- start start 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 0x7fb6a8127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a812ae10 con 0x7fb6a8127a50 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a812b940 con 0x7fb6a8097790 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6aebae700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8064b30 con 0x7fb6a812b540 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 0x7fb6a8127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ad14b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ad14b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56480/0 (socket says 172.21.15.125:56480) 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34514/0 (socket says 172.21.15.125:34514) 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ad14b700 1 -- 172.21.15.125:0/4152030784 learned_addr learned my addr 172.21.15.125:0/4152030784 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 0x7fb6a8127560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41328/0 (socket says 172.21.15.125:41328) 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 -- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 msgr2=0x7fb6a8127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 0x7fb6a8127560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 -- 172.21.15.125:0/4152030784 >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 msgr2=0x7fb6a8127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/4152030784 >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 -- 172.21.15.125:0/4152030784 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8065750 con 0x7fb6a8097790 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ad14b700 1 --2- 172.21.15.125:0/4152030784 >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.507+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb69c009760 tx=0x7fb69c009060).ready entity=mon.1 client_cookie=1fb0f669373f9928 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6a77fe700 1 -- 172.21.15.125:0/4152030784 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00d4a0 con 0x7fb6a8097790 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6a77fe700 1 -- 172.21.15.125:0/4152030784 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00d600 con 0x7fb6a8097790 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6a77fe700 1 -- 172.21.15.125:0/4152030784 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00d980 con 0x7fb6a8097790 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 -- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 msgr2=0x7fb6a812b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 --2- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb69c009760 tx=0x7fb69c009060).stop 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 -- 172.21.15.125:0/4152030784 shutdown_connections 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 --2- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a8097790 0x7fb6a812b050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 --2- 172.21.15.125:0/4152030784 >> v2:172.21.15.125:3300/0 conn(0x7fb6a8127a50 0x7fb6a8127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 --2- 172.21.15.125:0/4152030784 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a812b540 0x7fb6a8127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 -- 172.21.15.125:0/4152030784 >> 172.21.15.125:0/4152030784 conn(0x7fb6a809bad0 msgr2=0x7fb6a809bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 -- 172.21.15.125:0/4152030784 shutdown_connections 2023-10-03T10:09:35.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.508+0000 7fb6aebae700 1 -- 172.21.15.125:0/4152030784 wait complete. 2023-10-03T10:09:35.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.509+0000 7fb6aebae700 1 Processor -- start 2023-10-03T10:09:35.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 -- start start 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 0x7fb6a8113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 0x7fb6a81142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8065130 con 0x7fb6a8127a50 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8117e00 con 0x7fb6a812b540 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6aebae700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8118080 con 0x7fb6a8097790 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ac94a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ac94a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41332/0 (socket says 172.21.15.125:41332) 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ac94a700 1 -- 172.21.15.125:0/2091512890 learned_addr learned my addr 172.21.15.125:0/2091512890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ad14b700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 0x7fb6a81142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6a7fff700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 0x7fb6a8113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ac94a700 1 -- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 msgr2=0x7fb6a81142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.510+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 0x7fb6a81142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6ac94a700 1 -- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 msgr2=0x7fb6a8113dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 0x7fb6a8113dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6ac94a700 1 -- 172.21.15.125:0/2091512890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009ae0 con 0x7fb6a8097790 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6a7fff700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 0x7fb6a8113dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6ad14b700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 0x7fb6a81142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6ac94a700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb69c011fb0 tx=0x7fb69c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00dd30 con 0x7fb6a8097790 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00de90 con 0x7fb6a8097790 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00d980 con 0x7fb6a8097790 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c0092a0 con 0x7fb6a8097790 2023-10-03T10:09:35.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.511+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a81159f0 con 0x7fb6a8097790 2023-10-03T10:09:35.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.512+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a81177e0 con 0x7fb6a8097790 2023-10-03T10:09:35.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.512+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb69c01d640 con 0x7fb6a8097790 2023-10-03T10:09:35.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.512+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb69c03d040 con 0x7fb6a8097790 2023-10-03T10:09:35.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.516+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb69c010950 con 0x7fb6a8097790 2023-10-03T10:09:35.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.672+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb6a8128080 con 0x7fb6a8097790 2023-10-03T10:09:35.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.673+0000 7fb6a4ff9700 1 -- 172.21.15.125:0/2091512890 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb69c0303e0 con 0x7fb6a8097790 2023-10-03T10:09:35.674 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:09:35.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 >> v1:172.21.15.125:6816/118167 conn(0x7fb68c02bb60 legacy=0x7fb68c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 msgr2=0x7fb6a8116da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb69c011fb0 tx=0x7fb69c016000).stop 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 shutdown_connections 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6a812b540 0x7fb6a81142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6a8097790 0x7fb6a8116da0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 --2- 172.21.15.125:0/2091512890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6a8127a50 0x7fb6a8113dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 >> 172.21.15.125:0/2091512890 conn(0x7fb6a809bad0 msgr2=0x7fb6a812a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 shutdown_connections 2023-10-03T10:09:35.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.675+0000 7fb6aebae700 1 -- 172.21.15.125:0/2091512890 wait complete. 2023-10-03T10:09:35.687 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 Processor -- start 2023-10-03T10:09:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 -- start start 2023-10-03T10:09:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 0x7f43401304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 0x7f4340132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400964f0 con 0x7f43400985e0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400994b0 con 0x7f43400990d0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f434765f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f434009a3f0 con 0x7f4340130990 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f4344bfa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 0x7f43401304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f43453fb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f43400985e0 0x7f43400989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33790/0 (socket says 172.21.15.125:33790) 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f4345bfc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 0x7f4340132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.806+0000 7f43453fb700 1 -- 172.21.15.125:0/3749545483 learned_addr learned my addr 172.21.15.125:0/3749545483 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4337fff700 1 -- 172.21.15.125:0/3749545483 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633114683 0 0) 0x7f43400964f0 con 0x7f43400985e0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4337fff700 1 -- 172.21.15.125:0/3749545483 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c0033f0 con 0x7f43400985e0 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4345bfc700 1 -- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 msgr2=0x7f43401304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4345bfc700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 0x7f43401304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4345bfc700 1 -- 172.21.15.125:0/3749545483 >> v1:172.21.15.125:6789/0 conn(0x7f43400985e0 legacy=0x7f43400989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4345bfc700 1 -- 172.21.15.125:0/3749545483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340095100 con 0x7f4340130990 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4344bfa700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 0x7f43401304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4345bfc700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 0x7f4340132d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4338009e90 tx=0x7f4338009780).ready entity=mon.2 client_cookie=4876a570a8f5b4f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4337fff700 1 -- 172.21.15.125:0/3749545483 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800e070 con 0x7f4340130990 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4337fff700 1 -- 172.21.15.125:0/3749545483 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800bab0 con 0x7f4340130990 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.807+0000 7f4337fff700 1 -- 172.21.15.125:0/3749545483 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800be30 con 0x7f4340130990 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 -- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 msgr2=0x7f4340132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 0x7f4340132d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4338009e90 tx=0x7f4338009780).stop 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 -- 172.21.15.125:0/3749545483 shutdown_connections 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4340130990 0x7f4340132d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 --2- 172.21.15.125:0/3749545483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43400990d0 0x7f43401304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 -- 172.21.15.125:0/3749545483 >> 172.21.15.125:0/3749545483 conn(0x7f434009dc40 msgr2=0x7f434009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 -- 172.21.15.125:0/3749545483 shutdown_connections 2023-10-03T10:09:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.808+0000 7f434765f700 1 -- 172.21.15.125:0/3749545483 wait complete. 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 Processor -- start 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 -- start start 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 0x7f434011a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 0x7f434011a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434009a0f0 con 0x7f43400990d0 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434011e770 con 0x7f4340130990 2023-10-03T10:09:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f434765f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f434011e390 con 0x7f43400985e0 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f43453fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f4344bfa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 0x7f434011a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f43453fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41356/0 (socket says 172.21.15.125:41356) 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f43453fb700 1 -- 172.21.15.125:0/151282476 learned_addr learned my addr 172.21.15.125:0/151282476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.809+0000 7f4345bfc700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 0x7f434011a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 -- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 msgr2=0x7f43401303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 -- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 msgr2=0x7f434011a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 0x7f434011a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 -- 172.21.15.125:0/151282476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300092a0 con 0x7f43400990d0 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f43453fb700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4345bfc700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 0x7f434011a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f4344bfa700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 0x7f434011a2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f433000e950 tx=0x7f4330009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330009580 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330012600 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4338009a20 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300129a0 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434011b6f0 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.810+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4330012d10 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.811+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f433003b410 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.811+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434011dc10 con 0x7f43400990d0 2023-10-03T10:09:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.815+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4330019310 con 0x7f43400990d0 2023-10-03T10:09:35.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.970+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f434005a260 con 0x7f43400990d0 2023-10-03T10:09:35.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.971+0000 7f43357fa700 1 -- 172.21.15.125:0/151282476 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4330011b40 con 0x7f43400990d0 2023-10-03T10:09:35.972 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:09:35.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 >> v1:172.21.15.125:6816/118167 conn(0x7f432402bb60 legacy=0x7f432402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 msgr2=0x7f434011a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 0x7f434011a2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f433000e950 tx=0x7f4330009060).stop 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 shutdown_connections 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4340130990 0x7f434011a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43400985e0 0x7f43401303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 --2- 172.21.15.125:0/151282476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43400990d0 0x7f434011a2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 >> 172.21.15.125:0/151282476 conn(0x7f434009dc40 msgr2=0x7f434009ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 shutdown_connections 2023-10-03T10:09:35.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:35.973+0000 7f434765f700 1 -- 172.21.15.125:0/151282476 wait complete. 2023-10-03T10:09:35.985 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.103+0000 7f5bdaefc700 1 Processor -- start 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.103+0000 7f5bdaefc700 1 -- start start 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bdaefc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bdaefc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bdaefc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd4066f90 con 0x7f5bd412b370 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bdaefc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd405f940 con 0x7f5bd405f560 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bdaefc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4067650 con 0x7f5bd412b790 2023-10-03T10:09:36.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd9499700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd9499700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41362/0 (socket says 172.21.15.125:41362) 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34550/0 (socket says 172.21.15.125:34550) 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5bd412b370 0x7f5bd4095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33796/0 (socket says 172.21.15.125:33796) 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd9499700 1 -- 172.21.15.125:0/2664603617 learned_addr learned my addr 172.21.15.125:0/2664603617 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd37fe700 1 -- 172.21.15.125:0/2664603617 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640616618 0 0) 0x7f5bd4066f90 con 0x7f5bd412b370 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 -- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 msgr2=0x7f5bd40964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 -- 172.21.15.125:0/2664603617 >> v1:172.21.15.125:6789/0 conn(0x7f5bd412b370 legacy=0x7f5bd4095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 -- 172.21.15.125:0/2664603617 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4067910 con 0x7f5bd405f560 2023-10-03T10:09:36.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd9499700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.104+0000 7f5bd8c98700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5bc8009790 tx=0x7f5bc8009060).ready entity=mon.1 client_cookie=a3b27677a4381a25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bd37fe700 1 -- 172.21.15.125:0/2664603617 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800f510 con 0x7f5bd405f560 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bd37fe700 1 -- 172.21.15.125:0/2664603617 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc800f670 con 0x7f5bd405f560 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bd37fe700 1 -- 172.21.15.125:0/2664603617 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800f9f0 con 0x7f5bd405f560 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 -- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 msgr2=0x7f5bd412ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5bc8009790 tx=0x7f5bc8009060).stop 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 -- 172.21.15.125:0/2664603617 shutdown_connections 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd412b790 0x7f5bd40964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/2664603617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd405f560 0x7f5bd412ae80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 -- 172.21.15.125:0/2664603617 >> 172.21.15.125:0/2664603617 conn(0x7f5bd409a1c0 msgr2=0x7f5bd409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 -- 172.21.15.125:0/2664603617 shutdown_connections 2023-10-03T10:09:36.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.105+0000 7f5bdaefc700 1 -- 172.21.15.125:0/2664603617 wait complete. 2023-10-03T10:09:36.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.106+0000 7f5bdaefc700 1 Processor -- start 2023-10-03T10:09:36.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.106+0000 7f5bdaefc700 1 -- start start 2023-10-03T10:09:36.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 0x7f5bd41143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 0x7f5bd41148d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 0x7f5bd4114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40671c0 con 0x7f5bd412b790 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41171c0 con 0x7f5bd412b370 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4129430 con 0x7f5bd405f560 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd8c98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 0x7f5bd41143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd8c98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 0x7f5bd41143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41364/0 (socket says 172.21.15.125:41364) 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd8c98700 1 -- 172.21.15.125:0/1795415010 learned_addr learned my addr 172.21.15.125:0/1795415010 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 0x7f5bd4114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd3fff700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 0x7f5bd41148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 -- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 msgr2=0x7f5bd41143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 0x7f5bd41143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 -- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 msgr2=0x7f5bd41148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 0x7f5bd41148d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 -- 172.21.15.125:0/1795415010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc009ae0 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd3fff700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 0x7f5bd41148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd9499700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 0x7f5bd4114dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5bd412bbe0 tx=0x7f5bcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0092e0 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc00f040 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc80092a0 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00cb70 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.107+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd41158c0 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.108+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5bcc014460 con 0x7f5bd412b790 2023-10-03T10:09:36.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.108+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5bcc03af10 con 0x7f5bd412b790 2023-10-03T10:09:36.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.108+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd405a260 con 0x7f5bd412b790 2023-10-03T10:09:36.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.113+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5bcc012360 con 0x7f5bd412b790 2023-10-03T10:09:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.271+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5bd412ac00 con 0x7f5bd412b790 2023-10-03T10:09:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.271+0000 7f5bd0ff9700 1 -- 172.21.15.125:0/1795415010 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bcc01cb10 con 0x7f5bd412b790 2023-10-03T10:09:36.272 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 >> v1:172.21.15.125:6816/118167 conn(0x7f5bb802bb60 legacy=0x7f5bb802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 msgr2=0x7f5bd4114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 0x7f5bd4114dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5bd412bbe0 tx=0x7f5bcc00b040).stop 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 shutdown_connections 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bd412b790 0x7f5bd4114dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bd405f560 0x7f5bd41143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 --2- 172.21.15.125:0/1795415010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bd412b370 0x7f5bd41148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 >> 172.21.15.125:0/1795415010 conn(0x7f5bd409a1c0 msgr2=0x7f5bd412df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 shutdown_connections 2023-10-03T10:09:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.273+0000 7f5bdaefc700 1 -- 172.21.15.125:0/1795415010 wait complete. 2023-10-03T10:09:36.285 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:09:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.402+0000 7fdbcaba9700 1 Processor -- start 2023-10-03T10:09:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.402+0000 7fdbcaba9700 1 -- start start 2023-10-03T10:09:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbcaba9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc4095e70 0x7fdbc4096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbcaba9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbcaba9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc4094ba0 con 0x7fdbc4093950 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbcaba9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc4092e90 con 0x7fdbc4095e70 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbcaba9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4096b60 con 0x7fdbc412d250 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc4095e70 0x7fdbc4096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc9146700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc9146700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc412f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41374/0 (socket says 172.21.15.125:41374) 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc4095e70 0x7fdbc4096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56500/0 (socket says 172.21.15.125:56500) 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc9146700 1 -- 172.21.15.125:0/927280277 learned_addr learned my addr 172.21.15.125:0/927280277 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc8945700 1 --1- 172.21.15.125:0/927280277 >> v1:172.21.15.125:6789/0 conn(0x7fdbc4093950 0x7fdbc4095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33808/0 (socket says 172.21.15.125:33808) 2023-10-03T10:09:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 -- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 msgr2=0x7fdbc412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 --2- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 -- 172.21.15.125:0/927280277 >> v1:172.21.15.125:6789/0 conn(0x7fdbc4093950 legacy=0x7fdbc4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 -- 172.21.15.125:0/927280277 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4093150 con 0x7fdbc4095e70 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc37fe700 1 -- 172.21.15.125:0/927280277 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804523926 0 0) 0x7fdbc4094ba0 con 0x7fdbc4093950 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.403+0000 7fdbc3fff700 1 --2- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4096250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdbb0009760 tx=0x7fdbb0009060).ready entity=mon.0 client_cookie=833d330ac0d172b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbc37fe700 1 -- 172.21.15.125:0/927280277 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00090d0 con 0x7fdbc4095e70 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbc37fe700 1 -- 172.21.15.125:0/927280277 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000f510 con 0x7fdbc4095e70 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbc37fe700 1 -- 172.21.15.125:0/927280277 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000f890 con 0x7fdbc4095e70 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 -- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 msgr2=0x7fdbc4096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4096250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdbb0009760 tx=0x7fdbb0009060).stop 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 -- 172.21.15.125:0/927280277 shutdown_connections 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/927280277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4096250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 -- 172.21.15.125:0/927280277 >> 172.21.15.125:0/927280277 conn(0x7fdbc409aa50 msgr2=0x7fdbc409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 -- 172.21.15.125:0/927280277 shutdown_connections 2023-10-03T10:09:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.404+0000 7fdbcaba9700 1 -- 172.21.15.125:0/927280277 wait complete. 2023-10-03T10:09:36.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.405+0000 7fdbcaba9700 1 Processor -- start 2023-10-03T10:09:36.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 -- start start 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbc4093950 0x7fdbc4119c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41191b0 con 0x7fdbc4095e70 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4116e00 con 0x7fdbc4093950 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbcaba9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc406a290 con 0x7fdbc412d250 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbc9146700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbc8945700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbc4093950 0x7fdbc4119c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbc9146700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41378/0 (socket says 172.21.15.125:41378) 2023-10-03T10:09:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbc9146700 1 -- 172.21.15.125:0/4105197261 learned_addr learned my addr 172.21.15.125:0/4105197261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.406+0000 7fdbc3fff700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 -- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbc4093950 msgr2=0x7fdbc4119c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbc4093950 0x7fdbc4119c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 -- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 msgr2=0x7fdbc4115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 -- 172.21.15.125:0/4105197261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00092a0 con 0x7fdbc412d250 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc9146700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fdbbc00e1c0 tx=0x7fdbbc00d040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00ed00 con 0x7fdbc412d250 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc011040 con 0x7fdbc412d250 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00b320 con 0x7fdbc412d250 2023-10-03T10:09:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4092410 con 0x7fdbc412d250 2023-10-03T10:09:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4116650 con 0x7fdbc412d250 2023-10-03T10:09:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.407+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdbbc009820 con 0x7fdbc412d250 2023-10-03T10:09:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.408+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdbbc03d370 con 0x7fdbc412d250 2023-10-03T10:09:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.408+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc405a260 con 0x7fdbc412d250 2023-10-03T10:09:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.412+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdbbc016410 con 0x7fdbc412d250 2023-10-03T10:09:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.568+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbc4046c20 con 0x7fdbc412d250 2023-10-03T10:09:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.568+0000 7fdbc0ff9700 1 -- 172.21.15.125:0/4105197261 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbbc01e360 con 0x7fdbc412d250 2023-10-03T10:09:36.569 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 >> v1:172.21.15.125:6816/118167 conn(0x7fdba802bb90 legacy=0x7fdba802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 msgr2=0x7fdbc4116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fdbbc00e1c0 tx=0x7fdbbc00d040).stop 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 shutdown_connections 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbc412d250 0x7fdbc4116160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbc4093950 0x7fdbc4119c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 --2- 172.21.15.125:0/4105197261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4095e70 0x7fdbc4115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 >> 172.21.15.125:0/4105197261 conn(0x7fdbc409aa50 msgr2=0x7fdbc40694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 shutdown_connections 2023-10-03T10:09:36.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.570+0000 7fdbcaba9700 1 -- 172.21.15.125:0/4105197261 wait complete. 2023-10-03T10:09:36.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 Processor -- start 2023-10-03T10:09:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 -- start start 2023-10-03T10:09:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0973f0 con 0x7f7e6c062b00 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c062ee0 con 0x7f7e6c096490 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e711c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c091980 con 0x7f7e6c095b80 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34578/0 (socket says 172.21.15.125:34578) 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56522/0 (socket says 172.21.15.125:56522) 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.697+0000 7f7e6b59e700 1 -- 172.21.15.125:0/500465311 learned_addr learned my addr 172.21.15.125:0/500465311 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 -- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 msgr2=0x7f7e6c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 -- 172.21.15.125:0/500465311 >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 msgr2=0x7f7e6c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 --2- 172.21.15.125:0/500465311 >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 -- 172.21.15.125:0/500465311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c092310 con 0x7f7e6c095b80 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6b59e700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6ad9d700 1 --2- 172.21.15.125:0/500465311 >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e6a59c700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c095fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7e60009790 tx=0x7f7e60009060).ready entity=mon.2 client_cookie=ea6dd630f85ebfc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e69d9b700 1 -- 172.21.15.125:0/500465311 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000d4a0 con 0x7f7e6c095b80 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e69d9b700 1 -- 172.21.15.125:0/500465311 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000d600 con 0x7f7e6c095b80 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e69d9b700 1 -- 172.21.15.125:0/500465311 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000d980 con 0x7f7e6c095b80 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 -- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 msgr2=0x7f7e6c095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c095fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7e60009790 tx=0x7f7e60009060).stop 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 -- 172.21.15.125:0/500465311 shutdown_connections 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 --2- 172.21.15.125:0/500465311 >> v2:172.21.15.125:3300/0 conn(0x7f7e6c062b00 0x7f7e6c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 --2- 172.21.15.125:0/500465311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c095fa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 -- 172.21.15.125:0/500465311 >> 172.21.15.125:0/500465311 conn(0x7f7e6c09aa50 msgr2=0x7f7e6c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 -- 172.21.15.125:0/500465311 shutdown_connections 2023-10-03T10:09:36.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.698+0000 7f7e711c6700 1 -- 172.21.15.125:0/500465311 wait complete. 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 Processor -- start 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 -- start start 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c1170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c1175b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c1189e0 con 0x7f7e6c062b00 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c117aa0 con 0x7f7e6c096490 2023-10-03T10:09:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.700+0000 7f7e711c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c1187f0 con 0x7f7e6c095b80 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56526/0 (socket says 172.21.15.125:56526) 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 -- 172.21.15.125:0/1691284892 learned_addr learned my addr 172.21.15.125:0/1691284892 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6a59c700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c1170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6b59e700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c1175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 -- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 msgr2=0x7f7e6c1170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c1170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 -- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 msgr2=0x7f7e6c1175b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c1175b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 -- 172.21.15.125:0/1691284892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c0092a0 con 0x7f7e6c062b00 2023-10-03T10:09:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6a59c700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c1170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e6ad9d700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7e5c00ea20 tx=0x7f7e5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00ee60 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00c850 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00cbd0 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e64009ae0 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.701+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e600092a0 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.702+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c062770 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.702+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7e5c01b400 con 0x7f7e6c062b00 2023-10-03T10:09:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.703+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7e5c03bab0 con 0x7f7e6c062b00 2023-10-03T10:09:36.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.707+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7e5c01be60 con 0x7f7e6c062b00 2023-10-03T10:09:36.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.903+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e6c098350 con 0x7f7e6c062b00 2023-10-03T10:09:36.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.904+0000 7f7e52ffd700 1 -- 172.21.15.125:0/1691284892 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f7e5c029030 con 0x7f7e6c062b00 2023-10-03T10:09:36.905 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:36.905 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:16.686162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 >> v1:172.21.15.125:6816/118167 conn(0x7f7e5802bb60 legacy=0x7f7e5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 msgr2=0x7f7e6c116bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7e5c00ea20 tx=0x7f7e5c009060).stop 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 shutdown_connections 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e6c096490 0x7f7e6c1175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e6c062b00 0x7f7e6c116bd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 --2- 172.21.15.125:0/1691284892 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e6c095b80 0x7f7e6c1170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 >> 172.21.15.125:0/1691284892 conn(0x7f7e6c09aa50 msgr2=0x7f7e6c130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 shutdown_connections 2023-10-03T10:09:36.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:36.906+0000 7f7e711c6700 1 -- 172.21.15.125:0/1691284892 wait complete. 2023-10-03T10:09:36.908 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 5 2023-10-03T10:09:36.918 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:37.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.032+0000 7f99b5133700 1 Processor -- start 2023-10-03T10:09:37.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.032+0000 7f99b5133700 1 -- start start 2023-10-03T10:09:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99b5133700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b01301a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99b5133700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0132a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99b5133700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b012ae10 con 0x7f99b0097790 2023-10-03T10:09:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99b5133700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0064b30 con 0x7f99b012ddb0 2023-10-03T10:09:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99b5133700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0065750 con 0x7f99b0130690 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b01301a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99aed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f99b0097790 0x7f99b012b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33810/0 (socket says 172.21.15.125:33810) 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99af59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99aed9d700 1 -- 172.21.15.125:0/3947561759 learned_addr learned my addr 172.21.15.125:0/3947561759 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99add9b700 1 -- 172.21.15.125:0/3947561759 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389219688 0 0) 0x7f99a4001110 con 0x7f99b0097790 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99add9b700 1 -- 172.21.15.125:0/3947561759 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99980033f0 con 0x7f99b0097790 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 -- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 msgr2=0x7f99b0132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0132a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 -- 172.21.15.125:0/3947561759 >> v1:172.21.15.125:6789/0 conn(0x7f99b0097790 legacy=0x7f99b012b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 -- 172.21.15.125:0/3947561759 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0064f00 con 0x7f99b012ddb0 2023-10-03T10:09:37.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99af59e700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.033+0000 7f99ae59c700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b01301a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f99a0009790 tx=0x7f99a0009060).ready entity=mon.1 client_cookie=ae6808dca69e2553 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99add9b700 1 -- 172.21.15.125:0/3947561759 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000f510 con 0x7f99b012ddb0 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99add9b700 1 -- 172.21.15.125:0/3947561759 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000f670 con 0x7f99b012ddb0 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99add9b700 1 -- 172.21.15.125:0/3947561759 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000f9f0 con 0x7f99b012ddb0 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 -- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 msgr2=0x7f99b01301a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b01301a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f99a0009790 tx=0x7f99a0009060).stop 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 -- 172.21.15.125:0/3947561759 shutdown_connections 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 --2- 172.21.15.125:0/3947561759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b01301a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 -- 172.21.15.125:0/3947561759 >> 172.21.15.125:0/3947561759 conn(0x7f99b009bad0 msgr2=0x7f99b009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 -- 172.21.15.125:0/3947561759 shutdown_connections 2023-10-03T10:09:37.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.034+0000 7f99b5133700 1 -- 172.21.15.125:0/3947561759 wait complete. 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.035+0000 7f99b5133700 1 Processor -- start 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.035+0000 7f99b5133700 1 -- start start 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0125490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0128530 con 0x7f99b0097790 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0126560 con 0x7f99b012ddb0 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01301e0 con 0x7f99b0130690 2023-10-03T10:09:37.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99ae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99af59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0125490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56534/0 (socket says 172.21.15.125:56534) 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99ae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34596/0 (socket says 172.21.15.125:34596) 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 -- 172.21.15.125:0/1512476932 learned_addr learned my addr 172.21.15.125:0/1512476932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 -- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 msgr2=0x7f99b0125490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0125490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 -- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 msgr2=0x7f99b0124fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 -- 172.21.15.125:0/1512476932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009a20 con 0x7f99b0097790 2023-10-03T10:09:37.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99ae59c700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99af59e700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0125490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99aed9d700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f99a400c4a0 tx=0x7f99a4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40072e0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4007440 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00092a0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40057a0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.036+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b01271d0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.037+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f99a4005bd0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.037+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f99a403a2a0 con 0x7f99b0097790 2023-10-03T10:09:37.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.037+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b012ae10 con 0x7f99b0097790 2023-10-03T10:09:37.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.042+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f99b012ae10 con 0x7f99b0097790 2023-10-03T10:09:37.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.199+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b012ae10 con 0x7f99b0097790 2023-10-03T10:09:37.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.200+0000 7f9996ffd700 1 -- 172.21.15.125:0/1512476932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f99b012ae10 con 0x7f99b0097790 2023-10-03T10:09:37.201 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:37.201 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:09:32.737182+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 >> v1:172.21.15.125:6816/118167 conn(0x7f999c02bb90 legacy=0x7f999c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 msgr2=0x7f99b0112ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f99a400c4a0 tx=0x7f99a4007af0).stop 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 shutdown_connections 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99b0130690 0x7f99b0125490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99b0097790 0x7f99b0112ec0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 --2- 172.21.15.125:0/1512476932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99b012ddb0 0x7f99b0124fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 >> 172.21.15.125:0/1512476932 conn(0x7f99b009bad0 msgr2=0x7f99b012bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 shutdown_connections 2023-10-03T10:09:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.202+0000 7f99b5133700 1 -- 172.21.15.125:0/1512476932 wait complete. 2023-10-03T10:09:37.215 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 Processor -- start 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 -- start start 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 0x7f83cc1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 0x7f83cc132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0964f0 con 0x7f83cc0985e0 2023-10-03T10:09:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0994b0 con 0x7f83cc130990 2023-10-03T10:09:37.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.332+0000 7f83d1321700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc09a3f0 con 0x7f83cc0990d0 2023-10-03T10:09:37.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83cb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 0x7f83cc132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 0x7f83cc1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83caffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83cc0985e0 0x7f83cc0989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33818/0 (socket says 172.21.15.125:33818) 2023-10-03T10:09:37.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83caffd700 1 -- 172.21.15.125:0/2992909565 learned_addr learned my addr 172.21.15.125:0/2992909565 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 -- 172.21.15.125:0/2992909565 >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 msgr2=0x7f83cc132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 --2- 172.21.15.125:0/2992909565 >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 0x7f83cc132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 -- 172.21.15.125:0/2992909565 >> v1:172.21.15.125:6789/0 conn(0x7f83cc0985e0 legacy=0x7f83cc0989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83c9ffb700 1 -- 172.21.15.125:0/2992909565 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075569666 0 0) 0x7f83cc0964f0 con 0x7f83cc0985e0 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 -- 172.21.15.125:0/2992909565 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc095100 con 0x7f83cc0990d0 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83cb7fe700 1 --2- 172.21.15.125:0/2992909565 >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 0x7f83cc132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83ca7fc700 1 --2- 172.21.15.125:0/2992909565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 0x7f83cc1304a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f83bc009760 tx=0x7f83bc009060).ready entity=mon.1 client_cookie=793d49ace86c979d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83c9ffb700 1 -- 172.21.15.125:0/2992909565 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0090d0 con 0x7f83cc0990d0 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83c9ffb700 1 -- 172.21.15.125:0/2992909565 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00f510 con 0x7f83cc0990d0 2023-10-03T10:09:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.333+0000 7f83c9ffb700 1 -- 172.21.15.125:0/2992909565 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00f890 con 0x7f83cc0990d0 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 -- 172.21.15.125:0/2992909565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 msgr2=0x7f83cc1304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 --2- 172.21.15.125:0/2992909565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 0x7f83cc1304a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f83bc009760 tx=0x7f83bc009060).stop 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 -- 172.21.15.125:0/2992909565 shutdown_connections 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 --2- 172.21.15.125:0/2992909565 >> v2:172.21.15.125:3300/0 conn(0x7f83cc130990 0x7f83cc132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 --2- 172.21.15.125:0/2992909565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0990d0 0x7f83cc1304a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 -- 172.21.15.125:0/2992909565 >> 172.21.15.125:0/2992909565 conn(0x7f83cc09dc40 msgr2=0x7f83cc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 -- 172.21.15.125:0/2992909565 shutdown_connections 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.334+0000 7f83d1321700 1 -- 172.21.15.125:0/2992909565 wait complete. 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 Processor -- start 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 -- start start 2023-10-03T10:09:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 0x7f83cc11a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 0x7f83cc11a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc09a0f0 con 0x7f83cc130990 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc11da20 con 0x7f83cc0985e0 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83d1321700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc11e4c0 con 0x7f83cc0990d0 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83caffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83caffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34610/0 (socket says 172.21.15.125:34610) 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83ca7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 0x7f83cc11a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83caffd700 1 -- 172.21.15.125:0/2351833630 learned_addr learned my addr 172.21.15.125:0/2351833630 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.335+0000 7f83cb7fe700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 0x7f83cc11a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 -- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 msgr2=0x7f83cc11a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 0x7f83cc11a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 -- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 msgr2=0x7f83cc11a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 0x7f83cc11a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 -- 172.21.15.125:0/2351833630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009a20 con 0x7f83cc0985e0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83ca7fc700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 0x7f83cc11a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83cb7fe700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 0x7f83cc11a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83caffd700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f83c000c4c0 tx=0x7f83c0007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00072e0 con 0x7f83cc0985e0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0007460 con 0x7f83cc0985e0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0092a0 con 0x7f83cc0985e0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00059f0 con 0x7f83cc0985e0 2023-10-03T10:09:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.336+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc11c0b0 con 0x7f83cc0985e0 2023-10-03T10:09:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.337+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f83c0013450 con 0x7f83cc0985e0 2023-10-03T10:09:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.337+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f83c003a7e0 con 0x7f83cc0985e0 2023-10-03T10:09:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.337+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc11c2a0 con 0x7f83cc0985e0 2023-10-03T10:09:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.341+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f83c0013700 con 0x7f83cc0985e0 2023-10-03T10:09:37.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.535+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f83cc05a260 con 0x7f83cc0985e0 2023-10-03T10:09:37.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.755+0000 7f83b2ffd700 1 -- 172.21.15.125:0/2351833630 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f83c001de60 con 0x7f83cc0985e0 2023-10-03T10:09:37.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 >> v1:172.21.15.125:6816/118167 conn(0x7f83b802bb60 legacy=0x7f83b802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 msgr2=0x7f83cc11d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f83c000c4c0 tx=0x7f83c0007c10).stop 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 shutdown_connections 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83cc130990 0x7f83cc11a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83cc0985e0 0x7f83cc11d460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 --2- 172.21.15.125:0/2351833630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83cc0990d0 0x7f83cc11a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 >> 172.21.15.125:0/2351833630 conn(0x7f83cc09dc40 msgr2=0x7f83cc114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 shutdown_connections 2023-10-03T10:09:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.757+0000 7f83d1321700 1 -- 172.21.15.125:0/2351833630 wait complete. 2023-10-03T10:09:37.769 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-03T10:09:37.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.886+0000 7f9877500700 1 Processor -- start 2023-10-03T10:09:37.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 -- start start 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9870095da0 0x7f98700961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9870091980 con 0x7f9870062b00 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700973f0 con 0x7f9870095da0 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9877500700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9870062ee0 con 0x7f98700966b0 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9874a9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9870095da0 0x7f98700961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9875a9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f987529c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9870062b00 0x7f9870095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33830/0 (socket says 172.21.15.125:33830) 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f987529c700 1 -- 172.21.15.125:0/1497563526 learned_addr learned my addr 172.21.15.125:0/1497563526 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9874a9b700 1 -- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 msgr2=0x7f9870132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9874a9b700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9874a9b700 1 -- 172.21.15.125:0/1497563526 >> v1:172.21.15.125:6789/0 conn(0x7f9870062b00 legacy=0x7f9870095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9867fff700 1 -- 172.21.15.125:0/1497563526 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345279406 0 0) 0x7f9870091980 con 0x7f9870062b00 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.887+0000 7f9874a9b700 1 -- 172.21.15.125:0/1497563526 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870092310 con 0x7f9870095da0 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9875a9d700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9874a9b700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f98700961c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f986c009790 tx=0x7f986c009060).ready entity=mon.0 client_cookie=867ce1904788391e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9867fff700 1 -- 172.21.15.125:0/1497563526 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00f510 con 0x7f9870095da0 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9867fff700 1 -- 172.21.15.125:0/1497563526 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00f670 con 0x7f9870095da0 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9867fff700 1 -- 172.21.15.125:0/1497563526 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00f9f0 con 0x7f9870095da0 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 -- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 msgr2=0x7f98700961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f98700961c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f986c009790 tx=0x7f986c009060).stop 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 -- 172.21.15.125:0/1497563526 shutdown_connections 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 --2- 172.21.15.125:0/1497563526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f98700961c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 -- 172.21.15.125:0/1497563526 >> 172.21.15.125:0/1497563526 conn(0x7f987009aa50 msgr2=0x7f987009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 -- 172.21.15.125:0/1497563526 shutdown_connections 2023-10-03T10:09:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.888+0000 7f9877500700 1 -- 172.21.15.125:0/1497563526 wait complete. 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.889+0000 7f9877500700 1 Processor -- start 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 -- start start 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f9870115710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870119180 con 0x7f9870095da0 2023-10-03T10:09:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9870099a10 con 0x7f98700966b0 2023-10-03T10:09:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9877500700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9870096da0 con 0x7f9870062b00 2023-10-03T10:09:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f987529c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f987529c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41434/0 (socket says 172.21.15.125:41434) 2023-10-03T10:09:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9875a9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f987529c700 1 -- 172.21.15.125:0/2179066265 learned_addr learned my addr 172.21.15.125:0/2179066265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.890+0000 7f9874a9b700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f9870115710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 -- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 msgr2=0x7f9870115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 -- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 msgr2=0x7f9870115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f9870115710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 -- 172.21.15.125:0/2179066265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009a20 con 0x7f9870062b00 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f9874a9b700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f9870115710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f9875a9d700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f987529c700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f986000c4f0 tx=0x7f9860007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000ce20 con 0x7f9870062b00 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98600072e0 con 0x7f9870062b00 2023-10-03T10:09:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0092a0 con 0x7f9870062b00 2023-10-03T10:09:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600057a0 con 0x7f9870062b00 2023-10-03T10:09:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.891+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9870117200 con 0x7f9870062b00 2023-10-03T10:09:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.892+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9870118fc0 con 0x7f9870062b00 2023-10-03T10:09:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.892+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9860005bd0 con 0x7f9870062b00 2023-10-03T10:09:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.892+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f986003ad00 con 0x7f9870062b00 2023-10-03T10:09:37.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:37.896+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9860013630 con 0x7f9870062b00 2023-10-03T10:09:38.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.096+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f9870116bc0 con 0x7f9870062b00 2023-10-03T10:09:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.967+0000 7f98657fa700 1 -- 172.21.15.125:0/2179066265 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f986001c350 con 0x7f9870062b00 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 >> v1:172.21.15.125:6816/118167 conn(0x7f985402bb60 legacy=0x7f985402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 msgr2=0x7f987012d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f986000c4f0 tx=0x7f9860007c10).stop 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 shutdown_connections 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98700966b0 0x7f9870115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9870062b00 0x7f987012d710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 --2- 172.21.15.125:0/2179066265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9870095da0 0x7f9870115710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 >> 172.21.15.125:0/2179066265 conn(0x7f987009aa50 msgr2=0x7f9870097540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 shutdown_connections 2023-10-03T10:09:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:38.969+0000 7f9877500700 1 -- 172.21.15.125:0/2179066265 wait complete. 2023-10-03T10:09:38.983 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.098+0000 7f2165b5b700 1 Processor -- start 2023-10-03T10:09:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.098+0000 7f2165b5b700 1 -- start start 2023-10-03T10:09:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2160094ba0 con 0x7f216012c240 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160092e90 con 0x7f2160093950 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f2165b5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2160096b60 con 0x7f2160095c50 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56572/0 (socket says 172.21.15.125:56572) 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215ffff700 1 -- 172.21.15.125:0/3644363756 learned_addr learned my addr 172.21.15.125:0/3644363756 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34632/0 (socket says 172.21.15.125:34632) 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 -- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 msgr2=0x7f2160096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 -- 172.21.15.125:0/3644363756 >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 msgr2=0x7f216012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 --2- 172.21.15.125:0/3644363756 >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 -- 172.21.15.125:0/3644363756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160093150 con 0x7f2160093950 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215effd700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215ffff700 1 --2- 172.21.15.125:0/3644363756 >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.099+0000 7f215f7fe700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2148009760 tx=0x7f2148009060).ready entity=mon.1 client_cookie=c35be381fdfea275 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f215e7fc700 1 -- 172.21.15.125:0/3644363756 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21480090d0 con 0x7f2160093950 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f215e7fc700 1 -- 172.21.15.125:0/3644363756 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214800d4a0 con 0x7f2160093950 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f215e7fc700 1 -- 172.21.15.125:0/3644363756 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800d820 con 0x7f2160093950 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 -- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 msgr2=0x7f2160095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2148009760 tx=0x7f2148009060).stop 2023-10-03T10:09:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 -- 172.21.15.125:0/3644363756 shutdown_connections 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2160093950 0x7f2160095760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 --2- 172.21.15.125:0/3644363756 >> v2:172.21.15.125:3300/0 conn(0x7f216012c240 0x7f216012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 --2- 172.21.15.125:0/3644363756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 -- 172.21.15.125:0/3644363756 >> 172.21.15.125:0/3644363756 conn(0x7f216009aa50 msgr2=0x7f216009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 -- 172.21.15.125:0/3644363756 shutdown_connections 2023-10-03T10:09:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.100+0000 7f2165b5b700 1 -- 172.21.15.125:0/3644363756 wait complete. 2023-10-03T10:09:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.101+0000 7f2165b5b700 1 Processor -- start 2023-10-03T10:09:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.101+0000 7f2165b5b700 1 -- start start 2023-10-03T10:09:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160116df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160092410 con 0x7f2160093950 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216011a640 con 0x7f216012c240 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f2165b5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f216011a380 con 0x7f2160095c50 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56576/0 (socket says 172.21.15.125:56576) 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 -- 172.21.15.125:0/4254202887 learned_addr learned my addr 172.21.15.125:0/4254202887 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34646/0 (socket says 172.21.15.125:34646) 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160116df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 -- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 msgr2=0x7f2160116df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160116df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 -- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 msgr2=0x7f21601172e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.102+0000 7f215f7fe700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f215f7fe700 1 -- 172.21.15.125:0/4254202887 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500092a0 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f215ffff700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f215f7fe700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2148009d50 tx=0x7f2148016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21480069b0 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21480127f0 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2158009ae0 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148012b90 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21480092a0 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.103+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2148026460 con 0x7f2160093950 2023-10-03T10:09:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.104+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f214803c390 con 0x7f2160093950 2023-10-03T10:09:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.104+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216005a260 con 0x7f2160093950 2023-10-03T10:09:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.108+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2148024950 con 0x7f2160093950 2023-10-03T10:09:39.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.304+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2160117bf0 con 0x7f2160093950 2023-10-03T10:09:39.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.304+0000 7f21577fe700 1 -- 172.21.15.125:0/4254202887 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f2148024360 con 0x7f2160093950 2023-10-03T10:09:39.305 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:09:39.305 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:38.961227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 >> v1:172.21.15.125:6816/118167 conn(0x7f214002bb90 legacy=0x7f214002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 msgr2=0x7f216011ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2148009d50 tx=0x7f2148016000).stop 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 shutdown_connections 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f216012c240 0x7f21601172e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2160093950 0x7f216011ae20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 --2- 172.21.15.125:0/4254202887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2160095c50 0x7f2160116df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 >> 172.21.15.125:0/4254202887 conn(0x7f216009aa50 msgr2=0x7f21600990a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 shutdown_connections 2023-10-03T10:09:39.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.306+0000 7f2165b5b700 1 -- 172.21.15.125:0/4254202887 wait complete. 2023-10-03T10:09:39.308 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-03T10:09:39.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:14.682102+0000', 'modified': '2023-10-03T10:09:38.961227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6817/582467044', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.125:6817', 'nonce': 582467044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:09:39.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:09:39.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 Processor -- start 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 -- start start 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 0x7f4f781302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78069a10 con 0x7f4f78068680 2023-10-03T10:09:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f78069090 con 0x7f4f7812dee0 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7d058700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780694e0 con 0x7f4f78066e30 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 0x7f4f781302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f78068680 0x7f4f78067700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33844/0 (socket says 172.21.15.125:33844) 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34648/0 (socket says 172.21.15.125:34648) 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.535+0000 7f4f7659c700 1 -- 172.21.15.125:0/3638066627 learned_addr learned my addr 172.21.15.125:0/3638066627 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3638066627 >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 msgr2=0x7f4f781302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3638066627 >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 0x7f4f781302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3638066627 >> v1:172.21.15.125:6789/0 conn(0x7f4f78068680 legacy=0x7f4f78067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f75d9b700 1 -- 172.21.15.125:0/3638066627 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148080850 0 0) 0x7f4f78069a10 con 0x7f4f78068680 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3638066627 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78068b00 con 0x7f4f78066e30 2023-10-03T10:09:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7759e700 1 --2- 172.21.15.125:0/3638066627 >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 0x7f4f781302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3638066627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f68009790 tx=0x7f4f68009060).ready entity=mon.1 client_cookie=a8c87b0360e913d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f75d9b700 1 -- 172.21.15.125:0/3638066627 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680090d0 con 0x7f4f78066e30 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f75d9b700 1 -- 172.21.15.125:0/3638066627 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6800f510 con 0x7f4f78066e30 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f75d9b700 1 -- 172.21.15.125:0/3638066627 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800f890 con 0x7f4f78066e30 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 -- 172.21.15.125:0/3638066627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 msgr2=0x7f4f78067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 --2- 172.21.15.125:0/3638066627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f68009790 tx=0x7f4f68009060).stop 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 -- 172.21.15.125:0/3638066627 shutdown_connections 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 --2- 172.21.15.125:0/3638066627 >> v2:172.21.15.125:3300/0 conn(0x7f4f7812dee0 0x7f4f781302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 --2- 172.21.15.125:0/3638066627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78066e30 0x7f4f78067210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 -- 172.21.15.125:0/3638066627 >> 172.21.15.125:0/3638066627 conn(0x7f4f7809a230 msgr2=0x7f4f7809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 -- 172.21.15.125:0/3638066627 shutdown_connections 2023-10-03T10:09:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.536+0000 7f4f7d058700 1 -- 172.21.15.125:0/3638066627 wait complete. 2023-10-03T10:09:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.537+0000 7f4f7d058700 1 Processor -- start 2023-10-03T10:09:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.537+0000 7f4f7d058700 1 -- start start 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78068680 0x7f4f78138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f7812dee0 0x7f4f78138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78117070 con 0x7f4f78066e30 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78116d80 con 0x7f4f78068680 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7d058700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781172c0 con 0x7f4f7812dee0 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56594/0 (socket says 172.21.15.125:56594) 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1801548691 learned_addr learned my addr 172.21.15.125:0/1801548691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7659c700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78068680 0x7f4f78138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f7759e700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f7812dee0 0x7f4f78138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f7812dee0 msgr2=0x7f4f78138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f7812dee0 0x7f4f78138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78068680 msgr2=0x7f4f78138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78068680 0x7f4f78138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1801548691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009a20 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.538+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4f780697e0 tx=0x7f4f68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f5effd700 1 -- 172.21.15.125:0/1801548691 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800f890 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f5effd700 1 -- 172.21.15.125:0/1801548691 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68006930 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f680092a0 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f5effd700 1 -- 172.21.15.125:0/1801548691 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800fea0 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78115e10 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f5effd700 1 -- 172.21.15.125:0/1801548691 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4f6801b620 con 0x7f4f78066e30 2023-10-03T10:09:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.539+0000 7f4f5effd700 1 -- 172.21.15.125:0/1801548691 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f6803c900 con 0x7f4f78066e30 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.542+0000 7f4f8ea0bb80 1 Processor -- start 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.542+0000 7f4f8ea0bb80 1 -- start start 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 0x5590fcb4b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcb4d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590fcaeb610 con 0x5590fcb21170 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590fca61db0 con 0x5590fcb4b5b0 2023-10-03T10:09:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x5590fca77030 con 0x5590fcb21a40 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f7759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcb4d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56608/0 (socket says 172.21.15.125:56608) 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3073964956 learned_addr learned my addr 172.21.15.125:0/3073964956 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f7659c700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 0x5590fcb4b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 msgr2=0x5590fcb4b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 0x5590fcb4b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 msgr2=0x5590fcb4d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcb4d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3073964956 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590fc912710 con 0x5590fcb21170 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f7659c700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 0x5590fcb4b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f7759e700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcb4d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4f68010630 tx=0x7f4f6801c000).ready entity=mon.0 client_cookie=5362bb3720589f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f57fff700 1 -- 172.21.15.125:0/3073964956 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68006b10 con 0x5590fcb21170 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f57fff700 1 -- 172.21.15.125:0/3073964956 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68039070 con 0x5590fcb21170 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.543+0000 7f4f57fff700 1 -- 172.21.15.125:0/3073964956 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6802ccc0 con 0x5590fcb21170 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 msgr2=0x5590fcb21550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4f68010630 tx=0x7f4f6801c000).stop 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3073964956 shutdown_connections 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcb4d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21170 0x5590fcb21550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3073964956 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21a40 0x5590fcb4b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3073964956 >> 172.21.15.125:0/3073964956 conn(0x5590fc98f940 msgr2=0x5590fcb41cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3073964956 shutdown_connections 2023-10-03T10:09:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.544+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3073964956 wait complete. 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 -- start start 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 Processor -- start 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21a40 0x5590fcb51150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb4b5b0 0x5590fcb46df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590fca77170 con 0x5590fcb4b5b0 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590fca773f0 con 0x5590fcb21a40 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x5590fca42920 con 0x5590fcb21170 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f8ea0bb80 10 client.0 ll_register_callbacks cb 0x5590fca17ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41502/0 (socket says 172.21.15.125:41502) 2023-10-03T10:09:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1943335238 learned_addr learned my addr 172.21.15.125:0/1943335238 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f7659c700 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21a40 0x5590fcb51150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.545+0000 7f4f7759e700 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb4b5b0 0x5590fcb46df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21a40 msgr2=0x5590fcb51150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21a40 0x5590fcb51150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb4b5b0 msgr2=0x5590fcb46df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb4b5b0 0x5590fcb46df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 -- 172.21.15.125:0/1943335238 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78115e10 con 0x5590fcb21170 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f68010b50 tx=0x7f4f68037070).ready entity=mon.2 client_cookie=1d13d7808f03adc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3302/0 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6802cd90 con 0x5590fcb21170 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mon.2 v2:172.21.15.125:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f6802c3a0 con 0x5590fcb21170 2023-10-03T10:09:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590fcb19f20 con 0x5590fcb21170 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6802c560 con 0x5590fcb21170 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 10 client.4571 fetch_fsmap learned FSMap version 7 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5590fca49b00 con 0x5590fcb21170 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mon.2 v2:172.21.15.125:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590fcb19f20 con 0x5590fcb21170 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mon.2 v2:172.21.15.125:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f4f6804b050 con 0x5590fcb21170 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 10 client.4571 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 10 client.4571 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 20 client.4571 populate_metadata read hostname 'smithi125' 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 4 client.4571 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.546+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590fcaef250 con 0x5590fcb477d0 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f557fa700 10 client.4571 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f557fa700 1 -- 172.21.15.125:0/1943335238 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x5590fcaef250 con 0x5590fcb477d0 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f557fa700 10 client.4571 handle_command_reply: tid=0 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f8ea0bb80 1 client.4571 shutdown 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 msgr2=0x5590fcb50c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.547+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f68010b50 tx=0x7f4f68037070).stop 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 shutdown_connections 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb4b5b0 0x5590fcb46df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f557fa700 0 client.4571 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcb50c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/1943335238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21a40 0x5590fcb51150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 >> 172.21.15.125:0/1943335238 conn(0x5590fc98f940 msgr2=0x5590fcb41c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 shutdown_connections 2023-10-03T10:09:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/1943335238 wait complete. 2023-10-03T10:09:39.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.548+0000 7f4f8ea0bb80 20 client.4571 trim_cache size 0 max 16384 2023-10-03T10:09:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 Processor -- start 2023-10-03T10:09:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 -- start start 2023-10-03T10:09:39.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcb3f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590fcb23690 con 0x5590fcb21a40 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590fcb22140 con 0x5590fcb21170 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x5590fcae64c0 con 0x5590fcb4b5b0 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f7759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34688/0 (socket says 172.21.15.125:34688) 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f7759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41516/0 (socket says 172.21.15.125:41516) 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 -- 172.21.15.125:0/136315971 learned_addr learned my addr 172.21.15.125:0/136315971 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f7659c700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcb3f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 -- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 msgr2=0x5590fcb20980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 -- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 msgr2=0x5590fcb3f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcb3f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f76d9d700 1 -- 172.21.15.125:0/136315971 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590fca6ff70 con 0x5590fcb21170 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f7759e700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.564+0000 7f4f7659c700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcb3f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4f68010510 tx=0x7f4f68041000).ready entity=mon.1 client_cookie=da6b89eaaaac8f77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f5cbcf700 1 -- 172.21.15.125:0/136315971 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68052070 con 0x5590fcb21170 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f5cbcf700 1 -- 172.21.15.125:0/136315971 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6801ada0 con 0x5590fcb21170 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f5cbcf700 1 -- 172.21.15.125:0/136315971 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6802ccc0 con 0x5590fcb21170 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 msgr2=0x5590fcb22de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4f68010510 tx=0x7f4f68041000).stop 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/136315971 shutdown_connections 2023-10-03T10:09:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb4b5b0 0x5590fcb20980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb21170 0x5590fcb22de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/136315971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcb3f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/136315971 >> 172.21.15.125:0/136315971 conn(0x5590fc98f940 msgr2=0x5590fcb1d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/136315971 shutdown_connections 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.565+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/136315971 wait complete. 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 -- start start 2023-10-03T10:09:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 Processor -- start 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcba5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcba5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.566+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590fcb460e0 con 0x5590fcb21a40 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590fcb22aa0 con 0x5590fcb4b5b0 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x5590fcb490d0 con 0x5590fcb21170 2023-10-03T10:09:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 10 client.0 ll_register_callbacks cb 0x5590fca17ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41528/0 (socket says 172.21.15.125:41528) 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3027430533 learned_addr learned my addr 172.21.15.125:0/3027430533 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f7759e700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcba5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f7659c700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcba5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 msgr2=0x5590fcba5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcba5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 msgr2=0x5590fcba5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcba5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 -- 172.21.15.125:0/3027430533 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c00f040 con 0x5590fcb21170 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f7759e700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcba5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f7659c700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcba5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f76d9d700 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4f6801be70 tx=0x7f4f68045000).ready entity=mon.2 client_cookie=a2ed5c068eb6a1b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3302/0 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68052070 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mon.2 v2:172.21.15.125:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f68006b10 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f68039070 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6802ccc0 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 10 client.4577 fetch_fsmap learned FSMap version 7 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f4f70011660 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mon.2 v2:172.21.15.125:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68039070 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.567+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mon.2 v2:172.21.15.125:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f4f6805d070 con 0x5590fcb21170 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 10 client.4577 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 10 client.4577 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:09:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 20 client.4577 populate_metadata read hostname 'smithi125' 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 4 client.4577 mds_command: new command op to 4180 tid=0[{"prefix": "status"}] 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590fc8dfef0 con 0x5590fcb4df20 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f557fa700 10 client.4577 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f557fa700 1 -- 172.21.15.125:0/3027430533 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 3646326336) 0x5590fc8dfef0 con 0x5590fcb4df20 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f557fa700 10 client.4577 handle_command_reply: tid=0 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 client.4577 shutdown 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 msgr2=0x5590fcba5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4f6801be70 tx=0x7f4f68045000).stop 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 shutdown_connections 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590fcb4b5b0 0x5590fcba5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f557fa700 0 client.4577 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:09:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x5590fcb21170 0x5590fcba5020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 --2- 172.21.15.125:0/3027430533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590fcb21a40 0x5590fcba5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 >> 172.21.15.125:0/3027430533 conn(0x5590fc98f940 msgr2=0x5590fcb20980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.568+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 shutdown_connections 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f8ea0bb80 1 -- 172.21.15.125:0/3027430533 wait complete. 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f8ea0bb80 20 client.4577 trim_cache size 0 max 16384 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "15b0d202-3c9c-40fb-bdbc-3890d84c122d", 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-03T10:09:39.576 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4180, 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 24.886146050000001, 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 7, 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 18, 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 29.287059116999998 2023-10-03T10:09:39.577 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 >> v1:172.21.15.125:6816/118167 conn(0x7f4f6402bb90 legacy=0x7f4f6402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 msgr2=0x7f4f78138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4f780697e0 tx=0x7f4f68017000).stop 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 shutdown_connections 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f7812dee0 0x7f4f78138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f78066e30 0x7f4f78138440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 --2- 172.21.15.125:0/1801548691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f78068680 0x7f4f78138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 >> 172.21.15.125:0/1801548691 conn(0x7f4f7809a230 msgr2=0x7f4f78098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 shutdown_connections 2023-10-03T10:09:39.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:09:39.569+0000 7f4f7d058700 1 -- 172.21.15.125:0/1801548691 wait complete. 2023-10-03T10:09:39.581 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:09:39.590 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-03T10:09:39.590 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-03T10:09:39.601 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:09:39.601 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-03T10:09:39.601 INFO:teuthology.task.install:remote ubuntu@smithi125.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-03T10:09:39.601 INFO:teuthology.task.install:extra packages: [] 2023-10-03T10:09:39.607 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:09:39.607 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-03T10:09:39.607 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:39.630 INFO:teuthology.orchestra.run.smithi125.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:39.630 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:39.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:09:39.958 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-507.g7cd99ce4 2023-10-03T10:09:39.958 INFO:teuthology.task.install.rpm:Host smithi125 is: centos 8 x86_64 2023-10-03T10:09:39.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:09:40.197 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/ 2023-10-03T10:09:40.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-03T10:09:40.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:09:40.332 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-03T10:09:40.332 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:09:40.361 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:09:40.429 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:09:40.497 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:09:40.554 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-10-03T10:09:40.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-10-03T10:09:40.834 INFO:teuthology.orchestra.run.smithi125.stdout:71 files removed 2023-10-03T10:09:40.862 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-03T10:09:42.030 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 107 kB/s | 80 kB 00:00 2023-10-03T10:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-10-03T10:09:43.156 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 3.7 kB/s | 1.5 kB 00:00 2023-10-03T10:09:44.239 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - AppStream 32 MB/s | 33 MB 00:01 2023-10-03T10:09:52.506 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T10:09:59.765 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-10-03T10:10:00.091 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras common packages 46 kB/s | 6.9 kB 00:00 2023-10-03T10:10:00.859 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:10:02.261 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:10:04.164 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-10-03T10:10:08.011 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 420 kB/s | 24 kB 00:00 2023-10-03T10:10:12.243 INFO:teuthology.orchestra.run.smithi125.stderr:Package cephadm available, but not installed. 2023-10-03T10:10:12.244 INFO:teuthology.orchestra.run.smithi125.stdout:No match for argument: cephadm 2023-10-03T10:10:12.244 INFO:teuthology.orchestra.run.smithi125.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-03T10:10:12.244 INFO:teuthology.orchestra.run.smithi125.stdout:No match for argument: ceph-immutable-object-cache 2023-10-03T10:10:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-03T10:10:12.258 INFO:teuthology.orchestra.run.smithi125.stdout:No match for argument: ceph-mgr-cephadm 2023-10-03T10:10:12.261 INFO:teuthology.orchestra.run.smithi125.stderr:Package ceph-volume available, but not installed. 2023-10-03T10:10:12.261 INFO:teuthology.orchestra.run.smithi125.stdout:No match for argument: ceph-volume 2023-10-03T10:10:12.537 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi125.stdout:====================================================================================== 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout:====================================================================================== 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.4 k 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 5.4 M 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 22 M 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 847 k 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 23 k 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 2.3 M 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 1.5 M 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 1.7 M 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 7.4 M 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 241 k 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 47 k 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 4.6 M 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 18 M 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 15 k 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 13 M 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 24 k 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 47 M 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 30 k 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 769 k 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 137 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 139 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.7 M 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 474 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.6 M 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.5 M 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 45 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 123 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 190 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 370 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 364 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 107 k 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 94 k 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.4 M 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 179 k 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout:====================================================================================== 2023-10-03T10:10:12.547 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2023-10-03T10:10:12.548 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 34 Packages 2023-10-03T10:10:12.548 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:10:12.548 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 145 M 2023-10-03T10:10:12.548 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-03T10:10:12.929 INFO:teuthology.orchestra.run.smithi125.stdout:(1/35): ceph-18.2.0-507.g7cd99ce4.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2023-10-03T10:10:13.529 INFO:teuthology.orchestra.run.smithi125.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 1.9 MB/s | 1.7 MB 00:00 2023-10-03T10:10:13.963 INFO:teuthology.orchestra.run.smithi125.stdout:(3/35): ceph-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.9 MB/s | 847 kB 00:00 2023-10-03T10:10:14.313 INFO:teuthology.orchestra.run.smithi125.stdout:(4/35): ceph-mds-18.2.0-507.g7cd99ce4.el8.x86_6 6.5 MB/s | 2.3 MB 00:00 2023-10-03T10:10:14.481 INFO:teuthology.orchestra.run.smithi125.stdout:(5/35): ceph-mgr-18.2.0-507.g7cd99ce4.el8.x86_6 9.3 MB/s | 1.5 MB 00:00 2023-10-03T10:10:14.631 INFO:teuthology.orchestra.run.smithi125.stdout:(6/35): ceph-base-18.2.0-507.g7cd99ce4.el8.x86_ 2.6 MB/s | 5.4 MB 00:02 2023-10-03T10:10:15.206 INFO:teuthology.orchestra.run.smithi125.stdout:(7/35): ceph-mon-18.2.0-507.g7cd99ce4.el8.x86_6 6.4 MB/s | 4.6 MB 00:00 2023-10-03T10:10:18.464 INFO:teuthology.orchestra.run.smithi125.stdout:(8/35): ceph-osd-18.2.0-507.g7cd99ce4.el8.x86_6 4.6 MB/s | 18 MB 00:03 2023-10-03T10:10:18.564 INFO:teuthology.orchestra.run.smithi125.stdout:(9/35): ceph-selinux-18.2.0-507.g7cd99ce4.el8.x 243 kB/s | 24 kB 00:00 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi125.stdout:(10/35): ceph-common-18.2.0-507.g7cd99ce4.el8.x 2.7 MB/s | 22 MB 00:08 2023-10-03T10:10:21.086 INFO:teuthology.orchestra.run.smithi125.stdout:(11/35): libcephfs-devel-18.2.0-507.g7cd99ce4.e 197 kB/s | 30 kB 00:00 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi125.stdout:(12/35): libcephfs2-18.2.0-507.g7cd99ce4.el8.x8 1.2 MB/s | 769 kB 00:00 2023-10-03T10:10:22.066 INFO:teuthology.orchestra.run.smithi125.stdout:(13/35): libcephsqlite-18.2.0-507.g7cd99ce4.el8 375 kB/s | 137 kB 00:00 2023-10-03T10:10:22.190 INFO:teuthology.orchestra.run.smithi125.stdout:(14/35): librados-devel-18.2.0-507.g7cd99ce4.el 1.1 MB/s | 139 kB 00:00 2023-10-03T10:10:23.257 INFO:teuthology.orchestra.run.smithi125.stdout:(15/35): ceph-radosgw-18.2.0-507.g7cd99ce4.el8. 1.6 MB/s | 13 MB 00:08 2023-10-03T10:10:23.441 INFO:teuthology.orchestra.run.smithi125.stdout:(16/35): librados2-18.2.0-507.g7cd99ce4.el8.x86 2.9 MB/s | 3.7 MB 00:01 2023-10-03T10:10:23.900 INFO:teuthology.orchestra.run.smithi125.stdout:(17/35): ceph-test-18.2.0-507.g7cd99ce4.el8.x86 8.7 MB/s | 47 MB 00:05 2023-10-03T10:10:23.925 INFO:teuthology.orchestra.run.smithi125.stdout:(18/35): libradosstriper1-18.2.0-507.g7cd99ce4. 711 kB/s | 474 kB 00:00 2023-10-03T10:10:24.058 INFO:teuthology.orchestra.run.smithi125.stdout:(19/35): python3-ceph-argparse-18.2.0-507.g7cd9 335 kB/s | 45 kB 00:00 2023-10-03T10:10:24.167 INFO:teuthology.orchestra.run.smithi125.stdout:(20/35): python3-ceph-common-18.2.0-507.g7cd99c 1.1 MB/s | 123 kB 00:00 2023-10-03T10:10:24.309 INFO:teuthology.orchestra.run.smithi125.stdout:(21/35): python3-cephfs-18.2.0-507.g7cd99ce4.el 1.3 MB/s | 190 kB 00:00 2023-10-03T10:10:24.451 INFO:teuthology.orchestra.run.smithi125.stdout:(22/35): librbd1-18.2.0-507.g7cd99ce4.el8.x86_6 3.5 MB/s | 3.6 MB 00:01 2023-10-03T10:10:24.485 INFO:teuthology.orchestra.run.smithi125.stdout:(23/35): python3-rados-18.2.0-507.g7cd99ce4.el8 2.1 MB/s | 370 kB 00:00 2023-10-03T10:10:24.569 INFO:teuthology.orchestra.run.smithi125.stdout:(24/35): librgw2-18.2.0-507.g7cd99ce4.el8.x86_6 9.7 MB/s | 6.5 MB 00:00 2023-10-03T10:10:24.585 INFO:teuthology.orchestra.run.smithi125.stdout:(25/35): python3-rgw-18.2.0-507.g7cd99ce4.el8.x 1.0 MB/s | 107 kB 00:00 2023-10-03T10:10:24.611 INFO:teuthology.orchestra.run.smithi125.stdout:(26/35): python3-rbd-18.2.0-507.g7cd99ce4.el8.x 2.2 MB/s | 364 kB 00:00 2023-10-03T10:10:24.628 INFO:teuthology.orchestra.run.smithi125.stdout:(27/35): rbd-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.6 MB/s | 94 kB 00:00 2023-10-03T10:10:24.695 INFO:teuthology.orchestra.run.smithi125.stdout:(28/35): rbd-nbd-18.2.0-507.g7cd99ce4.el8.x86_6 2.1 MB/s | 179 kB 00:00 2023-10-03T10:10:24.712 INFO:teuthology.orchestra.run.smithi125.stdout:(29/35): ceph-grafana-dashboards-18.2.0-507.g7c 275 kB/s | 23 kB 00:00 2023-10-03T10:10:25.071 INFO:teuthology.orchestra.run.smithi125.stdout:(30/35): ceph-mgr-dashboard-18.2.0-507.g7cd99ce 4.6 MB/s | 1.7 MB 00:00 2023-10-03T10:10:25.137 INFO:teuthology.orchestra.run.smithi125.stdout:(31/35): ceph-mgr-modules-core-18.2.0-507.g7cd9 3.5 MB/s | 241 kB 00:00 2023-10-03T10:10:25.246 INFO:teuthology.orchestra.run.smithi125.stdout:(32/35): rbd-mirror-18.2.0-507.g7cd99ce4.el8.x8 5.2 MB/s | 3.4 MB 00:00 2023-10-03T10:10:25.263 INFO:teuthology.orchestra.run.smithi125.stdout:(33/35): ceph-mgr-rook-18.2.0-507.g7cd99ce4.el8 378 kB/s | 47 kB 00:00 2023-10-03T10:10:25.347 INFO:teuthology.orchestra.run.smithi125.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.0-5 12 MB/s | 7.4 MB 00:00 2023-10-03T10:10:25.388 INFO:teuthology.orchestra.run.smithi125.stdout:(35/35): ceph-prometheus-alerts-18.2.0-507.g7cd 102 kB/s | 15 kB 00:00 2023-10-03T10:10:25.392 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:10:25.392 INFO:teuthology.orchestra.run.smithi125.stdout:Total 11 MB/s | 145 MB 00:12 2023-10-03T10:10:25.393 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-03T10:10:25.458 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-03T10:10:25.458 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-03T10:10:26.124 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-03T10:10:26.126 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-03T10:10:28.352 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-03T10:10:28.525 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-03T10:10:29.056 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:10:29.286 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:10:29.687 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:10:29.869 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:10:30.001 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:10:30.186 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:10:31.122 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:10:31.635 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:10:31.725 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:10:31.923 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:10:32.118 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:10:32.209 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:10:32.377 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:10:32.457 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:10:32.655 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 9/69 2023-10-03T10:10:32.888 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:10:33.098 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 11/69 2023-10-03T10:10:33.351 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:10:33.538 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 13/69 2023-10-03T10:10:33.640 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 14/69 2023-10-03T10:10:33.853 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 15/69 2023-10-03T10:10:34.052 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 16/69 2023-10-03T10:10:36.462 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:10:36.905 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:10:37.557 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:10:37.789 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:10:37.889 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:10:38.029 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:10:55.631 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:10:55.852 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:10:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:10:57.226 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:10:57.325 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:10:57.742 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 22/69 2023-10-03T10:10:57.953 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:10:57.978 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:10:58.180 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:10:58.648 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:10:59.170 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:10:59.414 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:01.171 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:01.469 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:01.479 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:02.951 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:03.210 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:03.621 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:03.888 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:08.978 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:09.234 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 31/69 2023-10-03T10:11:09.471 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:09.670 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 33/69 2023-10-03T10:11:09.995 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:10.226 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 35/69 2023-10-03T10:11:10.348 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-03T10:11:10.613 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:10.622 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:10.623 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:10.920 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:11.055 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:11.055 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:11.234 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:11.241 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:11.242 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:11.481 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:11.676 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-03T10:11:11.855 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-03T10:11:11.861 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:11.862 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:12.080 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:12.230 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:12.230 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:12.433 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:12.633 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:12.640 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:12.641 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:12.991 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:12.991 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:13.235 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:13.241 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:13.241 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:13.433 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:13.439 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:13.439 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:13.646 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:13.646 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:13.797 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:13.820 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:13.821 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:14.154 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:14.155 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:14.380 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:14.380 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:14.639 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:14.821 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-03T10:11:15.013 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:15.013 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:15.297 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:15.471 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-03T10:11:15.471 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:15.734 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:15.912 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-03T10:11:15.912 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:16.172 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:16.329 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-03T10:11:16.455 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-03T10:11:16.679 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-03T10:11:16.795 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-03T10:11:16.889 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-03T10:11:16.889 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:17.042 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:17.042 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:17.818 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-03T10:11:17.819 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 14/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 16/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 20/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 22/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 24/69 2023-10-03T10:11:17.820 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-03T10:11:17.821 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:17.821 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-03T10:11:17.821 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:17.821 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-03T10:11:17.821 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 36/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 38/69 2023-10-03T10:11:17.824 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 40/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 42/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 44/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 46/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 48/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 50/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 52/69 2023-10-03T10:11:17.825 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 54/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 56/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 58/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 60/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 62/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 64/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-03T10:11:17.826 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 66/69 2023-10-03T10:11:17.827 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-03T10:11:17.827 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 68/69 2023-10-03T10:11:19.456 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-03T10:11:19.456 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:19.456 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-10-03T10:11:19.456 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.457 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.458 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:19.459 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-03T10:11:19.460 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-03T10:11:19.460 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:19.460 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-03T10:11:19.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:11:19.813 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:11:19.836 INFO:teuthology.orchestra.run.smithi125.stdout:18.2.0-507.g7cd99ce4.el8 2023-10-03T10:11:19.836 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-507.g7cd99ce4.el8 2023-10-03T10:11:19.836 INFO:teuthology.task.install:The correct ceph version 18.2.0-507.g7cd99ce4 is installed. 2023-10-03T10:11:19.837 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:11:19.846 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-03T10:11:19.846 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:11:19.857 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:11:19.857 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:19.886 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:11:19.886 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:11:19.887 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:11:19.929 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:11:19.930 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:11:19.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:19.941 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:11:19.941 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:11:19.941 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:11:19.983 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:11:19.983 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:11:19.983 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:19.995 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:11:19.995 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:11:19.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:11:20.037 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:11:20.037 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:11:20.038 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:20.062 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:11:20.062 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:11:20.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:11:20.104 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:11:20.104 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:11:20.114 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:11:20.114 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:11:20.114 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:11:20.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 Processor -- start 2023-10-03T10:11:20.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 -- start start 2023-10-03T10:11:20.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba006b2d0 con 0x7fdba0133ad0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0133610 con 0x7fdba01300a0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba6562700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba009a500 con 0x7fdba01309f0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdb9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba4aff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba4aff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36112/0 (socket says 172.21.15.125:36112) 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdb9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46142/0 (socket says 172.21.15.125:46142) 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdb9f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.241+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 learned_addr learned my addr 172.21.15.125:0/3700871429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 msgr2=0x7fdba013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 msgr2=0x7fdba013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9f7fe700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 msgr2=0x7fdba01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9f7fe700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 msgr2=0x7fdba01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9f7fe700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9f7fe700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9ffff700 1 -- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 msgr2=0x7fdba0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9ffff700 1 -- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 msgr2=0x7fdba0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:20.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.242+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:20.414 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:20.415+0000 7f63b1944240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9f7fe700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 msgr2=0x7fdba01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 msgr2=0x7fdba0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 -- 172.21.15.125:0/3700871429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba01338b0 con 0x7fdba01309f0 2023-10-03T10:11:20.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9f7fe700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:20.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdba4aff700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb980096d0 tx=0x7fdb98009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c9b40a3f6f66377 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:20.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9effd700 1 -- 172.21.15.125:0/3700871429 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98003e30 con 0x7fdba01309f0 2023-10-03T10:11:20.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9effd700 1 -- 172.21.15.125:0/3700871429 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800f040 con 0x7fdba01309f0 2023-10-03T10:11:20.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.443+0000 7fdb9effd700 1 -- 172.21.15.125:0/3700871429 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98007b20 con 0x7fdba01309f0 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 -- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 msgr2=0x7fdba013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb980096d0 tx=0x7fdb98009e40 comp rx=0 tx=0).stop 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 -- 172.21.15.125:0/3700871429 shutdown_connections 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01309f0 0x7fdba013a980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 --2- 172.21.15.125:0/3700871429 >> v2:172.21.15.125:3300/0 conn(0x7fdba0133ad0 0x7fdba0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 --2- 172.21.15.125:0/3700871429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba01300a0 0x7fdba01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 -- 172.21.15.125:0/3700871429 >> 172.21.15.125:0/3700871429 conn(0x7fdba0099c40 msgr2=0x7fdba00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 -- 172.21.15.125:0/3700871429 shutdown_connections 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.444+0000 7fdba6562700 1 -- 172.21.15.125:0/3700871429 wait complete. 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.445+0000 7fdba6562700 1 Processor -- start 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.445+0000 7fdba6562700 1 -- start start 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba0133ad0 0x7fdba011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0120950 con 0x7fdba01309f0 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0072080 con 0x7fdba0133ad0 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba6562700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba012f890 con 0x7fdba01300a0 2023-10-03T10:11:20.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46174/0 (socket says 172.21.15.125:46174) 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36174/0 (socket says 172.21.15.125:36174) 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9f7fe700 1 -- 172.21.15.125:0/2529431245 learned_addr learned my addr 172.21.15.125:0/2529431245 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdba4aff700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba0133ad0 0x7fdba011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 -- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba0133ad0 msgr2=0x7fdba011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba0133ad0 0x7fdba011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 -- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 msgr2=0x7fdba011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 -- 172.21.15.125:0/2529431245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94009500 con 0x7fdba01300a0 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9f7fe700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9ffff700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009750 tx=0x7fdb90009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.446+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90014610 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90014770 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980097c0 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90014b20 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba011fd00 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fdb90014c80 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fdb9003baa0 con 0x7fdba01300a0 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.447+0000 7fdb9f7fe700 1 -- 172.21.15.125:0/2529431245 >> v1:172.21.15.125:6816/118167 conn(0x7fdb8c02c1b0 legacy=0x7fdb8c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:20.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.448+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba006be10 con 0x7fdba01300a0 2023-10-03T10:11:20.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.452+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fdb90024b80 con 0x7fdba01300a0 2023-10-03T10:11:20.577 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:20.569+0000 7f63b1944240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:11:20.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.648+0000 7fdb9f7fe700 1 -- 172.21.15.125:0/2529431245 >> v1:172.21.15.125:6816/118167 conn(0x7fdb8c02c1b0 legacy=0x7fdb8c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.698+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdba004f2a0 con 0x7fdba01300a0 2023-10-03T10:11:20.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.699+0000 7fdb9cff9700 1 -- 172.21.15.125:0/2529431245 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64284 (secure 0 0 0) 0x7fdb90013e60 con 0x7fdba01300a0 2023-10-03T10:11:20.700 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:20.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 >> v1:172.21.15.125:6816/118167 conn(0x7fdb8c02c1b0 legacy=0x7fdb8c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:20.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 msgr2=0x7fdba011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009750 tx=0x7fdb90009a60 comp rx=0 tx=0).stop 2023-10-03T10:11:20.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 shutdown_connections 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba0133ad0 0x7fdba011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdba01300a0 0x7fdba011da40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.701+0000 7fdba6562700 1 --2- 172.21.15.125:0/2529431245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba01309f0 0x7fdba011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.702+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 >> 172.21.15.125:0/2529431245 conn(0x7fdba0099c40 msgr2=0x7fdba012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.702+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 shutdown_connections 2023-10-03T10:11:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.702+0000 7fdba6562700 1 -- 172.21.15.125:0/2529431245 wait complete. 2023-10-03T10:11:20.713 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6816","nonce":118167}]},"active_addr":"172.21.15.125:6816/118167","active_change":"2023-10-03T10:09:03.135490+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":386436796}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":677301661}]}]} 2023-10-03T10:11:20.715 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:11:20.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:11:20.716 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:20.831 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:20.830+0000 7f63b1944240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:11:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.839+0000 7fa69d75b700 1 Processor -- start 2023-10-03T10:11:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.839+0000 7fa69d75b700 1 -- start start 2023-10-03T10:11:20.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.839+0000 7fa69d75b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 0x7fa698133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.839+0000 7fa69d75b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 0x7fa6981304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.839+0000 7fa69d75b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69806b2d0 con 0x7fa6981309f0 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa69d75b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa698133610 con 0x7fa698133ad0 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa69d75b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa69809a500 con 0x7fa6981300a0 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 0x7fa6981304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa696ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 0x7fa698133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6977fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6981309f0 0x7fa69813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56426/0 (socket says 172.21.15.125:56426) 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6977fe700 1 -- 172.21.15.125:0/2381223852 learned_addr learned my addr 172.21.15.125:0/2381223852 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 -- 172.21.15.125:0/2381223852 >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 msgr2=0x7fa698133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:20.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 --2- 172.21.15.125:0/2381223852 >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 0x7fa698133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 -- 172.21.15.125:0/2381223852 >> v1:172.21.15.125:6789/0 conn(0x7fa6981309f0 legacy=0x7fa69813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 -- 172.21.15.125:0/2381223852 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6981338b0 con 0x7fa6981300a0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa695ffb700 1 -- 172.21.15.125:0/2381223852 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153959560 0 0) 0x7fa69806b2d0 con 0x7fa6981309f0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa696ffd700 1 --2- 172.21.15.125:0/2381223852 >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 0x7fa698133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa6967fc700 1 --2- 172.21.15.125:0/2381223852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 0x7fa6981304b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009840 tx=0x7fa68c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44866a1497247450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa695ffb700 1 -- 172.21.15.125:0/2381223852 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c011830 con 0x7fa6981300a0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa695ffb700 1 -- 172.21.15.125:0/2381223852 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c011990 con 0x7fa6981300a0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.840+0000 7fa695ffb700 1 -- 172.21.15.125:0/2381223852 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c011d20 con 0x7fa6981300a0 2023-10-03T10:11:20.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 -- 172.21.15.125:0/2381223852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 msgr2=0x7fa6981304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 --2- 172.21.15.125:0/2381223852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 0x7fa6981304b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009840 tx=0x7fa68c009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 -- 172.21.15.125:0/2381223852 shutdown_connections 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 --2- 172.21.15.125:0/2381223852 >> v2:172.21.15.125:3300/0 conn(0x7fa698133ad0 0x7fa698133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 --2- 172.21.15.125:0/2381223852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6981300a0 0x7fa6981304b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 -- 172.21.15.125:0/2381223852 >> 172.21.15.125:0/2381223852 conn(0x7fa698099c40 msgr2=0x7fa6980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 -- 172.21.15.125:0/2381223852 shutdown_connections 2023-10-03T10:11:20.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.841+0000 7fa69d75b700 1 -- 172.21.15.125:0/2381223852 wait complete. 2023-10-03T10:11:20.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.842+0000 7fa69d75b700 1 Processor -- start 2023-10-03T10:11:20.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 -- start start 2023-10-03T10:11:20.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 0x7fa69811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 0x7fa69811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69811fe30 con 0x7fa6981300a0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa698120010 con 0x7fa6981309f0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa69d75b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa69811eb60 con 0x7fa698133ad0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa6977fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 0x7fa69811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa6967fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 0x7fa69811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46202/0 (socket says 172.21.15.125:46202) 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.843+0000 7fa696ffd700 1 -- 172.21.15.125:0/1282691066 learned_addr learned my addr 172.21.15.125:0/1282691066 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 -- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 msgr2=0x7fa69811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 0x7fa69811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 -- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 msgr2=0x7fa69811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:20.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 0x7fa69811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 -- 172.21.15.125:0/1282691066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6880094a0 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa6977fe700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 0x7fa69811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa6967fc700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 0x7fa69811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa696ffd700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa68800ec10 tx=0x7fa68800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800c850 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800c9b0 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0094a0 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800cd20 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.844+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69811fa70 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.845+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa688013470 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.845+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fa68803b910 con 0x7fa6981300a0 2023-10-03T10:11:20.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.845+0000 7fa6967fc700 1 -- 172.21.15.125:0/1282691066 >> v1:172.21.15.125:6816/118167 conn(0x7fa68402c1b0 legacy=0x7fa68402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:20.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.845+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69811fc60 con 0x7fa6981300a0 2023-10-03T10:11:20.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:20.850+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa688017080 con 0x7fa6981300a0 2023-10-03T10:11:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.046+0000 7fa6967fc700 1 -- 172.21.15.125:0/1282691066 >> v1:172.21.15.125:6816/118167 conn(0x7fa68402c1b0 legacy=0x7fa68402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.047+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa69804f2a0 con 0x7fa6981300a0 2023-10-03T10:11:21.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.048+0000 7fa67f7fe700 1 -- 172.21.15.125:0/1282691066 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12720 (secure 0 0 0) 0x7fa688021030 con 0x7fa6981300a0 2023-10-03T10:11:21.049 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:21.049 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":20,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:10:04.971642+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:21.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 >> v1:172.21.15.125:6816/118167 conn(0x7fa68402c1b0 legacy=0x7fa68402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 msgr2=0x7fa69811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa68800ec10 tx=0x7fa68800ef20 comp rx=0 tx=0).stop 2023-10-03T10:11:21.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 shutdown_connections 2023-10-03T10:11:21.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa698133ad0 0x7fa69811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6981300a0 0x7fa69811da40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 --2- 172.21.15.125:0/1282691066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6981309f0 0x7fa69811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 >> 172.21.15.125:0/1282691066 conn(0x7fa698099c40 msgr2=0x7fa69812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 shutdown_connections 2023-10-03T10:11:21.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.050+0000 7fa69d75b700 1 -- 172.21.15.125:0/1282691066 wait complete. 2023-10-03T10:11:21.063 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:11:21.063 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 Processor -- start 2023-10-03T10:11:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 -- start start 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 0x7f576c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c06bec0 con 0x7f576c1341d0 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c06ce60 con 0x7f576c09f180 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.187+0000 7f5773f6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c09fa00 con 0x7f576c09e870 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771505700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 0x7f576c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58884/0 (socket says 172.21.15.125:58884) 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 -- 172.21.15.125:0/686142292 learned_addr learned my addr 172.21.15.125:0/686142292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 -- 172.21.15.125:0/686142292 >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 msgr2=0x7f576c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 --2- 172.21.15.125:0/686142292 >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 0x7f576c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 -- 172.21.15.125:0/686142292 >> v1:172.21.15.125:6789/0 conn(0x7f576c1341d0 legacy=0x7f576c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 -- 172.21.15.125:0/686142292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c09ad80 con 0x7f576c09e870 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771505700 1 --2- 172.21.15.125:0/686142292 >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 0x7f576c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5771d06700 1 --2- 172.21.15.125:0/686142292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57680098f0 tx=0x7f5768009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16c70dca71d2e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5770d04700 1 -- 172.21.15.125:0/686142292 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768011830 con 0x7f576c09e870 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5770d04700 1 -- 172.21.15.125:0/686142292 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768011990 con 0x7f576c09e870 2023-10-03T10:11:21.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.188+0000 7f5770d04700 1 -- 172.21.15.125:0/686142292 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768011d20 con 0x7f576c09e870 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 -- 172.21.15.125:0/686142292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 msgr2=0x7f576c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 --2- 172.21.15.125:0/686142292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57680098f0 tx=0x7f5768009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 -- 172.21.15.125:0/686142292 shutdown_connections 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 --2- 172.21.15.125:0/686142292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09e870 0x7f576c09ec40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 --2- 172.21.15.125:0/686142292 >> v2:172.21.15.125:3300/0 conn(0x7f576c09f180 0x7f576c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 -- 172.21.15.125:0/686142292 >> 172.21.15.125:0/686142292 conn(0x7f576c0a4430 msgr2=0x7f576c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 -- 172.21.15.125:0/686142292 shutdown_connections 2023-10-03T10:11:21.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.189+0000 7f5773f6a700 1 -- 172.21.15.125:0/686142292 wait complete. 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 Processor -- start 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 -- start start 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 0x7f576c123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 0x7f576c123640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c06d010 con 0x7f576c09e870 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c06fbf0 con 0x7f576c09f180 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5773f6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f576c124ff0 con 0x7f576c1341d0 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5771d06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5771505700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 0x7f576c123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5771d06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46218/0 (socket says 172.21.15.125:46218) 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5772507700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 0x7f576c123640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.190+0000 7f5771d06700 1 -- 172.21.15.125:0/181820232 learned_addr learned my addr 172.21.15.125:0/181820232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 -- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 msgr2=0x7f576c123640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 0x7f576c123640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 -- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 msgr2=0x7f576c123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 0x7f576c123100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 -- 172.21.15.125:0/181820232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0094a0 con 0x7f576c09e870 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5772507700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 0x7f576c123640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771505700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 0x7f576c123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5771d06700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5768000c00 tx=0x7f5768004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768004400 con 0x7f576c09e870 2023-10-03T10:11:21.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576801f070 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768009550 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680038e0 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.191+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c124830 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.192+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f5768021030 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.192+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c04f2a0 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.192+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f576803cb70 con 0x7f576c09e870 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.192+0000 7f5771505700 1 -- 172.21.15.125:0/181820232 >> v1:172.21.15.125:6816/118167 conn(0x7f575002c1b0 legacy=0x7f575002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.196+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5768015070 con 0x7f576c09e870 2023-10-03T10:11:21.348 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:21.348+0000 7f63b1944240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:11:21.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.371+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576c072d60 con 0x7f576c09e870 2023-10-03T10:11:21.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.372+0000 7f57627fc700 1 -- 172.21.15.125:0/181820232 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12720 (secure 0 0 0) 0x7f5768015020 con 0x7f576c09e870 2023-10-03T10:11:21.372 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:21.372 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":20,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:10:04.971642+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:21.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 >> v1:172.21.15.125:6816/118167 conn(0x7f575002c1b0 legacy=0x7f575002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 msgr2=0x7f576c122bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5768000c00 tx=0x7f5768004750 comp rx=0 tx=0).stop 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 shutdown_connections 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f576c1341d0 0x7f576c123640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f576c09e870 0x7f576c122bc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 --2- 172.21.15.125:0/181820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f576c09f180 0x7f576c123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 >> 172.21.15.125:0/181820232 conn(0x7f576c0a4430 msgr2=0x7f576c071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 shutdown_connections 2023-10-03T10:11:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.374+0000 7f5773f6a700 1 -- 172.21.15.125:0/181820232 wait complete. 2023-10-03T10:11:21.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:11:21.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:11:21.388 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:11:21.388 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:11:21.484 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:21.484+0000 7f63b1944240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:11:21.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.525+0000 7f8e6f670700 1 Processor -- start 2023-10-03T10:11:21.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.525+0000 7f98668e9700 1 Processor -- start 2023-10-03T10:11:21.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.525+0000 7f8e6f670700 1 -- start start 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.525+0000 7f98668e9700 1 -- start start 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98600a1380 0x7f9860133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f9860134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986009e9d0 con 0x7f98600a1380 2023-10-03T10:11:21.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986009dc00 con 0x7f98600a0a70 2023-10-03T10:11:21.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f98668e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f986009dec0 con 0x7f9860133f50 2023-10-03T10:11:21.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f985ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f985ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58906/0 (socket says 172.21.15.125:58906) 2023-10-03T10:11:21.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f985ffff700 1 -- 172.21.15.125:0/1211897048 learned_addr learned my addr 172.21.15.125:0/1211897048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681300a0 0x7f8e681304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e681309f0 0x7f8e6813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6806b2d0 con 0x7f8e681309f0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68133610 con 0x7f8e681300a0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6f670700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6809a500 con 0x7f8e68133ad0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6d40c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6d40c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36208/0 (socket says 172.21.15.125:36208) 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6d40c700 1 -- 172.21.15.125:0/478236800 learned_addr learned my addr 172.21.15.125:0/478236800 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.526+0000 7f8e6cc0b700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681300a0 0x7f8e681304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6dc0d700 1 --2- 172.21.15.125:0/478236800 >> v2:172.21.15.125:3300/0 conn(0x7f8e681309f0 0x7f8e6813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 -- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 msgr2=0x7f9860134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 --2- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f9860134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 -- 172.21.15.125:0/1211897048 >> v2:172.21.15.125:3300/0 conn(0x7f98600a1380 msgr2=0x7f9860133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 -- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681300a0 msgr2=0x7f8e681304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681300a0 0x7f8e681304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 -- 172.21.15.125:0/478236800 >> v2:172.21.15.125:3300/0 conn(0x7f8e681309f0 msgr2=0x7f8e6813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 --2- 172.21.15.125:0/478236800 >> v2:172.21.15.125:3300/0 conn(0x7f8e681309f0 0x7f8e6813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 --2- 172.21.15.125:0/1211897048 >> v2:172.21.15.125:3300/0 conn(0x7f98600a1380 0x7f9860133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 -- 172.21.15.125:0/1211897048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986009e6a0 con 0x7f98600a0a70 2023-10-03T10:11:21.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 -- 172.21.15.125:0/478236800 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e681338b0 con 0x7f8e68133ad0 2023-10-03T10:11:21.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985ffff700 1 --2- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98500098f0 tx=0x7f9850009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75efe442d9280596 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e6d40c700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e640098f0 tx=0x7f8e64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556b81e5b48d9cb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e5ffff700 1 -- 172.21.15.125:0/478236800 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011830 con 0x7f8e68133ad0 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985effd700 1 -- 172.21.15.125:0/1211897048 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000b8a0 con 0x7f98600a0a70 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985effd700 1 -- 172.21.15.125:0/1211897048 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985000ba00 con 0x7f98600a0a70 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e5ffff700 1 -- 172.21.15.125:0/478236800 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64011990 con 0x7f8e68133ad0 2023-10-03T10:11:21.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f8e5ffff700 1 -- 172.21.15.125:0/478236800 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011d20 con 0x7f8e68133ad0 2023-10-03T10:11:21.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.527+0000 7f985effd700 1 -- 172.21.15.125:0/1211897048 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000bd90 con 0x7f98600a0a70 2023-10-03T10:11:21.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 -- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 msgr2=0x7f98600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 --2- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98500098f0 tx=0x7f9850009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 -- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 msgr2=0x7f8e68133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e640098f0 tx=0x7f8e64009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 -- 172.21.15.125:0/1211897048 shutdown_connections 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 --2- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98600a0e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 --2- 172.21.15.125:0/1211897048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f9860134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 --2- 172.21.15.125:0/1211897048 >> v2:172.21.15.125:3300/0 conn(0x7f98600a1380 0x7f9860133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 -- 172.21.15.125:0/1211897048 >> 172.21.15.125:0/1211897048 conn(0x7f98600a6610 msgr2=0x7f98600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 -- 172.21.15.125:0/1211897048 shutdown_connections 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 -- 172.21.15.125:0/478236800 shutdown_connections 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 --2- 172.21.15.125:0/478236800 >> v2:172.21.15.125:3300/0 conn(0x7f8e681309f0 0x7f8e6813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e68133ad0 0x7f8e68133ea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 --2- 172.21.15.125:0/478236800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681300a0 0x7f8e681304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 -- 172.21.15.125:0/478236800 >> 172.21.15.125:0/478236800 conn(0x7f8e68099c40 msgr2=0x7f8e680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 -- 172.21.15.125:0/478236800 shutdown_connections 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f8e6f670700 1 -- 172.21.15.125:0/478236800 wait complete. 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.529+0000 7f8e6f670700 1 Processor -- start 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.529+0000 7f8e6f670700 1 -- start start 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.528+0000 7f98668e9700 1 -- 172.21.15.125:0/1211897048 wait complete. 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 Processor -- start 2023-10-03T10:11:21.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 -- start start 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e681300a0 0x7f8e6811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 0x7f8e6811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e68133ad0 0x7f8e6811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6811fde0 con 0x7f8e68133ad0 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6811f850 con 0x7f8e681309f0 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6f670700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e681200c0 con 0x7f8e681300a0 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6cc0b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 0x7f8e6811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6cc0b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 0x7f8e6811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58926/0 (socket says 172.21.15.125:58926) 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6cc0b700 1 -- 172.21.15.125:0/1800259226 learned_addr learned my addr 172.21.15.125:0/1800259226 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f8e6d40c700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e681300a0 0x7f8e6811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98601d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 0x7f98601d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f98601d5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9860132830 con 0x7f98600a1380 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9860133a10 con 0x7f98600a0a70 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.530+0000 7f98668e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98600a03e0 con 0x7f9860133f50 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 0x7f98601d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 0x7f98601d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46246/0 (socket says 172.21.15.125:46246) 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 -- 172.21.15.125:0/1809845833 learned_addr learned my addr 172.21.15.125:0/1809845833 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6dc0d700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e68133ad0 0x7f8e6811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 -- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e681300a0 msgr2=0x7f8e6811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e681300a0 0x7f8e6811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 -- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e68133ad0 msgr2=0x7f8e6811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e68133ad0 0x7f8e6811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 -- 172.21.15.125:0/1800259226 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64009550 con 0x7f8e681309f0 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f9864e86700 1 --2- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f98601d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 -- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 msgr2=0x7f98601d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 --2- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9860133f50 0x7f98601d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 -- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 msgr2=0x7f98601d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 --2- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98600a0a70 0x7f98601d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 -- 172.21.15.125:0/1809845833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009550 con 0x7f98600a1380 2023-10-03T10:11:21.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6cc0b700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 0x7f8e6811df80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e840 tx=0x7f8e5800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f985f7fe700 1 --2- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 0x7f98601d25a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f985400b500 tx=0x7f985400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58009590 con 0x7f8e681309f0 2023-10-03T10:11:21.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e58013680 con 0x7f8e681309f0 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854011830 con 0x7f98600a1380 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854011990 con 0x7f98600a1380 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98601d2ae0 con 0x7f98600a1380 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854011d40 con 0x7f98600a1380 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9860130e50 con 0x7f98600a1380 2023-10-03T10:11:21.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.531+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6811fb20 con 0x7f8e681309f0 2023-10-03T10:11:21.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58013a10 con 0x7f8e681309f0 2023-10-03T10:11:21.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.532+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6812fe10 con 0x7f8e681309f0 2023-10-03T10:11:21.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.533+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f985401a400 con 0x7f98600a1380 2023-10-03T10:11:21.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.533+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f985403b870 con 0x7f98600a1380 2023-10-03T10:11:21.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.533+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 --> v1:172.21.15.125:6800/118765 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98600621a0 con 0x7f9860099f90 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.534+0000 7f985ffff700 1 -- 172.21.15.125:0/1809845833 >> v1:172.21.15.125:6816/118167 conn(0x7f984c02c1b0 legacy=0x7f984c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.534+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8e58013b70 con 0x7f8e681309f0 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.534+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e6811ff50 con 0x7f8e681309f0 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.534+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f8e5803bab0 con 0x7f8e681309f0 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.534+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 --> v1:172.21.15.125:6808/118796 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e4c038e60 con 0x7f8e4c035160 2023-10-03T10:11:21.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.535+0000 7f8e6d40c700 1 -- 172.21.15.125:0/1800259226 >> v1:172.21.15.125:6816/118167 conn(0x7f8e4c02c200 legacy=0x7f8e4c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.535+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== osd.1 v1:172.21.15.125:6800/118765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f98600621a0 con 0x7f9860099f90 2023-10-03T10:11:21.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.535+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e58013e70 con 0x7f8e681309f0 2023-10-03T10:11:21.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.536+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== osd.3 v1:172.21.15.125:6808/118796 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f8e4c038e60 con 0x7f8e4c035160 2023-10-03T10:11:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.549+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 --> v1:172.21.15.125:6800/118765 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f986009d8c0 con 0x7f9860099f90 2023-10-03T10:11:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f985cff9700 1 -- 172.21.15.125:0/1809845833 <== osd.1 v1:172.21.15.125:6800/118765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7f9858009aa0 con 0x7f9860099f90 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 >> v1:172.21.15.125:6800/118765 conn(0x7f9860099f90 legacy=0x7f98601d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 >> v1:172.21.15.125:6816/118167 conn(0x7f984c02c1b0 legacy=0x7f984c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 msgr2=0x7f98601d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 --2- 172.21.15.125:0/1809845833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98600a1380 0x7f98601d25a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f985400b500 tx=0x7f985400b810 comp rx=0 tx=0).stop 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f9864e86700 1 -- 172.21.15.125:0/1809845833 reap_dead start 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 shutdown_connections 2023-10-03T10:11:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.550+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 >> 172.21.15.125:0/1809845833 conn(0x7f98600a6610 msgr2=0x7f986009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.551+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 shutdown_connections 2023-10-03T10:11:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.551+0000 7f98668e9700 1 -- 172.21.15.125:0/1809845833 wait complete. 2023-10-03T10:11:21.567 INFO:teuthology.orchestra.run.smithi125.stdout:38654705694 2023-10-03T10:11:21.567 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:21.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.567+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 --> v1:172.21.15.125:6808/118796 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e6806a9e0 con 0x7f8e4c035160 2023-10-03T10:11:21.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.567+0000 7f8e5dffb700 1 -- 172.21.15.125:0/1800259226 <== osd.3 v1:172.21.15.125:6808/118796 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f8e600083a0 con 0x7f8e4c035160 2023-10-03T10:11:21.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.567+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 >> v1:172.21.15.125:6808/118796 conn(0x7f8e4c035160 legacy=0x7f8e4c0375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 >> v1:172.21.15.125:6816/118167 conn(0x7f8e4c02c200 legacy=0x7f8e4c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 msgr2=0x7f8e6811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 --2- 172.21.15.125:0/1800259226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e681309f0 0x7f8e6811df80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e840 tx=0x7f8e5800eb50 comp rx=0 tx=0).stop 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6dc0d700 1 -- 172.21.15.125:0/1800259226 reap_dead start 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 shutdown_connections 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 >> 172.21.15.125:0/1800259226 conn(0x7f8e68099c40 msgr2=0x7f8e6812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 shutdown_connections 2023-10-03T10:11:21.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.568+0000 7f8e6f670700 1 -- 172.21.15.125:0/1800259226 wait complete. 2023-10-03T10:11:21.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 Processor -- start 2023-10-03T10:11:21.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 -- start start 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9bec133a70 0x7f9bec133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 0x7f9bec0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec133640 con 0x7f9bec0a1290 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0a1d50 con 0x7f9bec133a70 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.570+0000 7f9bf1350700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0a1710 con 0x7f9bec0a08e0 2023-10-03T10:11:21.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9beb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9bec0a1290 0x7f9bec13a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56446/0 (socket says 172.21.15.125:56446) 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 0x7f9bec0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9beb7fe700 1 -- 172.21.15.125:0/2851228398 learned_addr learned my addr 172.21.15.125:0/2851228398 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9beaffd700 1 --2- 172.21.15.125:0/2851228398 >> v2:172.21.15.125:3300/0 conn(0x7f9bec133a70 0x7f9bec133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 -- 172.21.15.125:0/2851228398 >> v2:172.21.15.125:3300/0 conn(0x7f9bec133a70 msgr2=0x7f9bec133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 --2- 172.21.15.125:0/2851228398 >> v2:172.21.15.125:3300/0 conn(0x7f9bec133a70 0x7f9bec133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 -- 172.21.15.125:0/2851228398 >> v1:172.21.15.125:6789/0 conn(0x7f9bec0a1290 legacy=0x7f9bec13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9be9ffb700 1 -- 172.21.15.125:0/2851228398 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875728557 0 0) 0x7f9bec133640 con 0x7f9bec0a1290 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 -- 172.21.15.125:0/2851228398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec09b620 con 0x7f9bec0a08e0 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9bea7fc700 1 --2- 172.21.15.125:0/2851228398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 0x7f9bec0a0d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009840 tx=0x7f9be0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=430d27851d07c6d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9be9ffb700 1 -- 172.21.15.125:0/2851228398 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0011830 con 0x7f9bec0a08e0 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9be9ffb700 1 -- 172.21.15.125:0/2851228398 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0011990 con 0x7f9bec0a08e0 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.571+0000 7f9be9ffb700 1 -- 172.21.15.125:0/2851228398 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0011d20 con 0x7f9bec0a08e0 2023-10-03T10:11:21.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 -- 172.21.15.125:0/2851228398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 msgr2=0x7f9bec0a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 --2- 172.21.15.125:0/2851228398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 0x7f9bec0a0d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009840 tx=0x7f9be0009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 -- 172.21.15.125:0/2851228398 shutdown_connections 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 --2- 172.21.15.125:0/2851228398 >> v2:172.21.15.125:3300/0 conn(0x7f9bec133a70 0x7f9bec133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 --2- 172.21.15.125:0/2851228398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec0a08e0 0x7f9bec0a0d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.572+0000 7f9bf1350700 1 -- 172.21.15.125:0/2851228398 >> 172.21.15.125:0/2851228398 conn(0x7f9bec0a2980 msgr2=0x7f9bec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.573+0000 7f9bf1350700 1 -- 172.21.15.125:0/2851228398 shutdown_connections 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.573+0000 7f9bf1350700 1 -- 172.21.15.125:0/2851228398 wait complete. 2023-10-03T10:11:21.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 Processor -- start 2023-10-03T10:11:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f30abdc7700 1 Processor -- start 2023-10-03T10:11:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f30abdc7700 1 -- start start 2023-10-03T10:11:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 -- start start 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bec0a08e0 0x7f9bec06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 0x7f9bec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec133a70 0x7f9bec06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec070930 con 0x7f9bec0a08e0 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec070400 con 0x7f9bec0a1290 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.574+0000 7f9bf1350700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec12dc80 con 0x7f9bec133a70 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9bea7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 0x7f9bec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9bea7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 0x7f9bec06e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58940/0 (socket says 172.21.15.125:58940) 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9bea7fc700 1 -- 172.21.15.125:0/2218739688 learned_addr learned my addr 172.21.15.125:0/2218739688 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec133a70 0x7f9bec06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f30abdc7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f30abdc7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30a41300a0 0x7f30a41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30abdc7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a406b2d0 con 0x7f30a41309f0 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30abdc7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a4133610 con 0x7f30a41300a0 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30abdc7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30a409a500 con 0x7f30a4133ad0 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 -- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 msgr2=0x7f9bec06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 0x7f9bec06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 -- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bec0a08e0 msgr2=0x7f9bec06e230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bec0a08e0 0x7f9bec06e230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.575+0000 7f9beb7fe700 1 -- 172.21.15.125:0/2218739688 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00094a0 con 0x7f9bec133a70 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9beb7fe700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec133a70 0x7f9bec06ecb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be400cbe0 tx=0x7f9be400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bea7fc700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bec0a1290 0x7f9bec06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30a41300a0 0x7f30a41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30a41300a0 0x7f30a41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46254/0 (socket says 172.21.15.125:46254) 2023-10-03T10:11:21.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 -- 172.21.15.125:0/453509785 learned_addr learned my addr 172.21.15.125:0/453509785 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400aaf0 con 0x7f9bec133a70 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400ac50 con 0x7f9bec133a70 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40070d0 con 0x7f9bec133a70 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 -- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 msgr2=0x7f30a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 --2- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f30a9362700 1 -- 172.21.15.125:0/453509785 >> v1:172.21.15.125:6789/0 conn(0x7f30a41309f0 legacy=0x7f30a413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.577+0000 7f30a9362700 1 -- 172.21.15.125:0/453509785 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a41338b0 con 0x7f30a41300a0 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.577+0000 7f30a9362700 1 --2- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a41304b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30a00098f0 tx=0x7f30a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5ef142d4e9c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec071a40 con 0x7f9bec133a70 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.576+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec071500 con 0x7f9bec133a70 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.577+0000 7f30a8b61700 1 -- 172.21.15.125:0/453509785 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0004230 con 0x7f30a41300a0 2023-10-03T10:11:21.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.577+0000 7f30a8b61700 1 -- 172.21.15.125:0/453509785 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a0004390 con 0x7f30a41300a0 2023-10-03T10:11:21.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.577+0000 7f30a8b61700 1 -- 172.21.15.125:0/453509785 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00036a0 con 0x7f30a41300a0 2023-10-03T10:11:21.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9be4007230 con 0x7f9bec133a70 2023-10-03T10:11:21.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f9be403b470 con 0x7f9bec133a70 2023-10-03T10:11:21.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f9beaffd700 1 -- 172.21.15.125:0/2218739688 >> v1:172.21.15.125:6816/118167 conn(0x7f9bd802c230 legacy=0x7f9bd802e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 -- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 msgr2=0x7f30a41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 --2- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a41304b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30a00098f0 tx=0x7f30a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 -- 172.21.15.125:0/453509785 shutdown_connections 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 --2- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 --2- 172.21.15.125:0/453509785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a41304b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 -- 172.21.15.125:0/453509785 >> 172.21.15.125:0/453509785 conn(0x7f30a4099c40 msgr2=0x7f30a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.578+0000 7f30abdc7700 1 -- 172.21.15.125:0/453509785 shutdown_connections 2023-10-03T10:11:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.579+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 --> v1:172.21.15.125:6812/118795 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bec1bb0b0 con 0x7f9bec061190 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.579+0000 7f30abdc7700 1 -- 172.21.15.125:0/453509785 wait complete. 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.579+0000 7f30abdc7700 1 Processor -- start 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.580+0000 7f30abdc7700 1 -- start start 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.580+0000 7f30abdc7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30abdc7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30a41309f0 0x7f30a411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30abdc7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30abdc7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4120090 con 0x7f30a41300a0 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30abdc7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a412dd00 con 0x7f30a41309f0 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30abdc7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4072580 con 0x7f30a4133ad0 2023-10-03T10:11:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46264/0 (socket says 172.21.15.125:46264) 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 -- 172.21.15.125:0/1363761078 learned_addr learned my addr 172.21.15.125:0/1363761078 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9362700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30a41309f0 0x7f30a411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30aa364700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 -- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 msgr2=0x7f30a411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 -- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30a41309f0 msgr2=0x7f30a411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30a41309f0 0x7f30a411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 -- 172.21.15.125:0/1363761078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0009550 con 0x7f30a41300a0 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30a9b63700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a411da40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f309400b530 tx=0x7f309400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f30aa364700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30a4133ad0 0x7f30a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.581+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094011830 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094011990 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094011d40 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a409a150 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4120370 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30a4130e90 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.582+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f309401a400 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.583+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f3094044400 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.583+0000 7f30a9362700 1 -- 172.21.15.125:0/1363761078 >> v1:172.21.15.125:6816/118167 conn(0x7f308802c1b0 legacy=0x7f308802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.583+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 --> v1:172.21.15.125:6804/118766 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3088038e10 con 0x7f3088035110 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.583+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3094044680 con 0x7f30a41300a0 2023-10-03T10:11:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.584+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== osd.2 v1:172.21.15.125:6804/118766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f3088038e10 con 0x7f3088035110 2023-10-03T10:11:21.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.585+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== osd.0 v1:172.21.15.125:6812/118795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9bec1bb0b0 con 0x7f9bec061190 2023-10-03T10:11:21.591 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:21.592 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 --> v1:172.21.15.125:6812/118795 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bec133870 con 0x7f9bec061190 2023-10-03T10:11:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 --> v1:172.21.15.125:6804/118766 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30a4071b70 con 0x7f3088035110 2023-10-03T10:11:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bd37fe700 1 -- 172.21.15.125:0/2218739688 <== osd.0 v1:172.21.15.125:6812/118795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f9be0011630 con 0x7f9bec061190 2023-10-03T10:11:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f309a7fc700 1 -- 172.21.15.125:0/1363761078 <== osd.2 v1:172.21.15.125:6804/118766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f30a4071b70 con 0x7f3088035110 2023-10-03T10:11:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 >> v1:172.21.15.125:6812/118795 conn(0x7f9bec061190 legacy=0x7f9bec061560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 >> v1:172.21.15.125:6816/118167 conn(0x7f9bd802c230 legacy=0x7f9bd802e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec133a70 msgr2=0x7f9bec06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 --2- 172.21.15.125:0/2218739688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bec133a70 0x7f9bec06ecb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be400cbe0 tx=0x7f9be400cef0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9beb7fe700 1 -- 172.21.15.125:0/2218739688 reap_dead start 2023-10-03T10:11:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 >> v1:172.21.15.125:6804/118766 conn(0x7f3088035110 legacy=0x7f30880375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.614+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 shutdown_connections 2023-10-03T10:11:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 >> 172.21.15.125:0/2218739688 conn(0x7f9bec0a2980 msgr2=0x7f9bec12f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 >> v1:172.21.15.125:6816/118167 conn(0x7f308802c1b0 legacy=0x7f308802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 msgr2=0x7f30a411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 --2- 172.21.15.125:0/1363761078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30a41300a0 0x7f30a411da40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f309400b530 tx=0x7f309400b840 comp rx=0 tx=0).stop 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30aa364700 1 -- 172.21.15.125:0/1363761078 reap_dead start 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 shutdown_connections 2023-10-03T10:11:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 shutdown_connections 2023-10-03T10:11:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 >> 172.21.15.125:0/1363761078 conn(0x7f30a4099c40 msgr2=0x7f30a4132040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f9bf1350700 1 -- 172.21.15.125:0/2218739688 wait complete. 2023-10-03T10:11:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 shutdown_connections 2023-10-03T10:11:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.615+0000 7f30abdc7700 1 -- 172.21.15.125:0/1363761078 wait complete. 2023-10-03T10:11:21.631 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:21.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:21.637 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:21.637 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:21.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 Processor -- start 2023-10-03T10:11:21.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 -- start start 2023-10-03T10:11:21.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06f409d860 0x7f06f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f409aaa0 con 0x7f06f4130ce0 2023-10-03T10:11:21.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f409f870 con 0x7f06f409d860 2023-10-03T10:11:21.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.713+0000 7f06fabcd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f409b360 con 0x7f06f409e170 2023-10-03T10:11:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36280/0 (socket says 172.21.15.125:36280) 2023-10-03T10:11:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 -- 172.21.15.125:0/982794726 learned_addr learned my addr 172.21.15.125:0/982794726 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 -- 172.21.15.125:0/982794726 >> v2:172.21.15.125:3300/0 conn(0x7f06f409d860 msgr2=0x7f06f409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 --2- 172.21.15.125:0/982794726 >> v2:172.21.15.125:3300/0 conn(0x7f06f409d860 0x7f06f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 -- 172.21.15.125:0/982794726 >> v1:172.21.15.125:6789/0 conn(0x7f06f4130ce0 legacy=0x7f06f41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.714+0000 7f06f3fff700 1 -- 172.21.15.125:0/982794726 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f409b620 con 0x7f06f409e170 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06f3fff700 1 --2- 172.21.15.125:0/982794726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098f0 tx=0x7f06e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd86f0ed767963c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06f37fe700 1 -- 172.21.15.125:0/982794726 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0004230 con 0x7f06f409e170 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06f37fe700 1 -- 172.21.15.125:0/982794726 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0004390 con 0x7f06f409e170 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06f37fe700 1 -- 172.21.15.125:0/982794726 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00036a0 con 0x7f06f409e170 2023-10-03T10:11:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06fabcd700 1 -- 172.21.15.125:0/982794726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 msgr2=0x7f06f41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.715+0000 7f06fabcd700 1 --2- 172.21.15.125:0/982794726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098f0 tx=0x7f06e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.716+0000 7f06fabcd700 1 -- 172.21.15.125:0/982794726 shutdown_connections 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.716+0000 7f06fabcd700 1 --2- 172.21.15.125:0/982794726 >> v2:172.21.15.125:3300/0 conn(0x7f06f409d860 0x7f06f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.716+0000 7f06fabcd700 1 --2- 172.21.15.125:0/982794726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41307a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.716+0000 7f06fabcd700 1 -- 172.21.15.125:0/982794726 >> 172.21.15.125:0/982794726 conn(0x7f06f4099c40 msgr2=0x7f06f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.717+0000 7f06fabcd700 1 -- 172.21.15.125:0/982794726 shutdown_connections 2023-10-03T10:11:21.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.717+0000 7f06fabcd700 1 -- 172.21.15.125:0/982794726 wait complete. 2023-10-03T10:11:21.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 Processor -- start 2023-10-03T10:11:21.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 -- start start 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06f4130ce0 0x7f06f41c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4136e10 con 0x7f06f409d860 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4136b50 con 0x7f06f4130ce0 2023-10-03T10:11:21.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06fabcd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f409c8b0 con 0x7f06f409e170 2023-10-03T10:11:21.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.718+0000 7f06f8969700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f8969700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46286/0 (socket says 172.21.15.125:46286) 2023-10-03T10:11:21.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f8969700 1 -- 172.21.15.125:0/170937026 learned_addr learned my addr 172.21.15.125:0/170937026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f916a700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06f4130ce0 0x7f06f41c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 -- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06f4130ce0 msgr2=0x7f06f41c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06f4130ce0 0x7f06f41c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 -- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 msgr2=0x7f06f4138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 -- 172.21.15.125:0/170937026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009550 con 0x7f06f409e170 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f8969700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f3fff700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41387c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f06f409f3a0 tx=0x7f06e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.719+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000b660 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.720+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000b7c0 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.720+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000bb50 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.720+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f4135780 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.720+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f413bd60 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.721+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f06e0021070 con 0x7f06f409e170 2023-10-03T10:11:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.721+0000 7f06f8969700 1 -- 172.21.15.125:0/170937026 >> v1:172.21.15.125:6816/118167 conn(0x7f06d802c1b0 legacy=0x7f06d802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.721+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f06e003ce00 con 0x7f06f409e170 2023-10-03T10:11:21.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.722+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f4136f60 con 0x7f06f409e170 2023-10-03T10:11:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.726+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f06e0029080 con 0x7f06f409e170 2023-10-03T10:11:21.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 Processor -- start 2023-10-03T10:11:21.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 -- start start 2023-10-03T10:11:21.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 0x7fb9781349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb97813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97809eca0 con 0x7fb978134f00 2023-10-03T10:11:21.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97806b2e0 con 0x7fb97809e070 2023-10-03T10:11:21.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.753+0000 7fb97d717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb97809f720 con 0x7fb97806a770 2023-10-03T10:11:21.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb9767fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb978134f00 0x7fb97809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56486/0 (socket says 172.21.15.125:56486) 2023-10-03T10:11:21.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb9767fc700 1 -- 172.21.15.125:0/1053105823 learned_addr learned my addr 172.21.15.125:0/1053105823 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:21.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 0x7fb9781349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb9777fe700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb97813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb975ffb700 1 -- 172.21.15.125:0/1053105823 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48263539 0 0) 0x7fb97809eca0 con 0x7fb978134f00 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 -- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 msgr2=0x7fb97813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb97813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 -- 172.21.15.125:0/1053105823 >> v1:172.21.15.125:6789/0 conn(0x7fb978134f00 legacy=0x7fb97809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 -- 172.21.15.125:0/1053105823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97806b480 con 0x7fb97806a770 2023-10-03T10:11:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb9777fe700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb97813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb976ffd700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 0x7fb9781349c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb968009870 tx=0x7fb968009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d02f990689174ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb975ffb700 1 -- 172.21.15.125:0/1053105823 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011830 con 0x7fb97806a770 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb975ffb700 1 -- 172.21.15.125:0/1053105823 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968011990 con 0x7fb97806a770 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.754+0000 7fb975ffb700 1 -- 172.21.15.125:0/1053105823 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011d20 con 0x7fb97806a770 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 -- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 msgr2=0x7fb9781349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 0x7fb9781349c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb968009870 tx=0x7fb968009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 -- 172.21.15.125:0/1053105823 shutdown_connections 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb97813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 --2- 172.21.15.125:0/1053105823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb97806a770 0x7fb9781349c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 -- 172.21.15.125:0/1053105823 >> 172.21.15.125:0/1053105823 conn(0x7fb978099c40 msgr2=0x7fb9780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 -- 172.21.15.125:0/1053105823 shutdown_connections 2023-10-03T10:11:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.755+0000 7fb97d717700 1 -- 172.21.15.125:0/1053105823 wait complete. 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 Processor -- start 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 -- start start 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb978135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb978134f00 0x7fb9781362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978138c20 con 0x7fb97806a770 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978139590 con 0x7fb97809e070 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb97d717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb978136dd0 con 0x7fb978134f00 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb976ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb976ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46302/0 (socket says 172.21.15.125:46302) 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb976ffd700 1 -- 172.21.15.125:0/3058182384 learned_addr learned my addr 172.21.15.125:0/3058182384 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.757+0000 7fb9767fc700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb978135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 -- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb978134f00 msgr2=0x7fb9781362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb978134f00 0x7fb9781362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 -- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 msgr2=0x7fb978135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb978135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 -- 172.21.15.125:0/3058182384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680094a0 con 0x7fb97806a770 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb976ffd700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9680090b0 tx=0x7fb968004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680043c0 con 0x7fb97806a770 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96801e070 con 0x7fb97806a770 2023-10-03T10:11:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb978140ea0 con 0x7fb97806a770 2023-10-03T10:11:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680036a0 con 0x7fb97806a770 2023-10-03T10:11:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.758+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb978138680 con 0x7fb97806a770 2023-10-03T10:11:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.759+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb968020030 con 0x7fb97806a770 2023-10-03T10:11:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.759+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978138870 con 0x7fb97806a770 2023-10-03T10:11:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.759+0000 7fb9767fc700 1 -- 172.21.15.125:0/3058182384 >> v1:172.21.15.125:6816/118167 conn(0x7fb96402c1b0 legacy=0x7fb96402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.759+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fb96803c800 con 0x7fb97806a770 2023-10-03T10:11:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.764+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb968010970 con 0x7fb97806a770 2023-10-03T10:11:21.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.862+0000 7fea5430d700 1 Processor -- start 2023-10-03T10:11:21.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.862+0000 7fea5430d700 1 -- start start 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c09ad40 0x7fea4c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 0x7fea4c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c0a3b60 con 0x7fea4c133f70 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1348e0 con 0x7fea4c0a0a70 2023-10-03T10:11:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.863+0000 7fea5430d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c09b110 con 0x7fea4c09ad40 2023-10-03T10:11:21.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58986/0 (socket says 172.21.15.125:58986) 2023-10-03T10:11:21.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 -- 172.21.15.125:0/4205139564 learned_addr learned my addr 172.21.15.125:0/4205139564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7ff4e059b700 1 Processor -- start 2023-10-03T10:11:21.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea518a8700 1 --2- 172.21.15.125:0/4205139564 >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 0x7fea4c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7ff4e059b700 1 -- start start 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 -- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c09ad40 msgr2=0x7fea4c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 --2- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c09ad40 0x7fea4c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 -- 172.21.15.125:0/4205139564 >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 msgr2=0x7fea4c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 --2- 172.21.15.125:0/4205139564 >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 0x7fea4c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 -- 172.21.15.125:0/4205139564 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0a2fa0 con 0x7fea4c0a0a70 2023-10-03T10:11:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea518a8700 1 --2- 172.21.15.125:0/4205139564 >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 0x7fea4c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.864+0000 7fea528aa700 1 --2- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fea44009e50 tx=0x7fea4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfb46698badb8b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4e059b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4d8138040 0x7ff4d8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4e059b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a08e0 0x7ff4d80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4e059b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d81379e0 con 0x7ff4d80a1230 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4e059b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80a2100 con 0x7ff4d8138040 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4e059b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8138950 con 0x7ff4d80a08e0 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4d8138040 0x7ff4d8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4d8138040 0x7ff4d8138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46328/0 (socket says 172.21.15.125:46328) 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 -- 172.21.15.125:0/2810409978 learned_addr learned my addr 172.21.15.125:0/2810409978 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 -- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a08e0 msgr2=0x7ff4d80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 --2- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a08e0 0x7ff4d80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 -- 172.21.15.125:0/2810409978 >> v1:172.21.15.125:6789/0 conn(0x7ff4d80a1230 legacy=0x7ff4d813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 -- 172.21.15.125:0/2810409978 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d809b9b0 con 0x7ff4d8138040 2023-10-03T10:11:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7ff4de337700 1 --2- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d8138040 0x7ff4d8138410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40098f0 tx=0x7ff4d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaaf081b67f2e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7fea510a7700 1 -- 172.21.15.125:0/4205139564 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400e070 con 0x7fea4c0a0a70 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7fea510a7700 1 -- 172.21.15.125:0/4205139564 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400b9c0 con 0x7fea4c0a0a70 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.865+0000 7fea510a7700 1 -- 172.21.15.125:0/4205139564 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400bd70 con 0x7fea4c0a0a70 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 -- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 msgr2=0x7fea4c0a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 --2- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fea44009e50 tx=0x7fea4400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 -- 172.21.15.125:0/4205139564 shutdown_connections 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7ff4dd335700 1 -- 172.21.15.125:0/2810409978 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4005e30 con 0x7ff4d8138040 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 --2- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c0a0ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 --2- 172.21.15.125:0/4205139564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c09ad40 0x7fea4c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 --2- 172.21.15.125:0/4205139564 >> v2:172.21.15.125:3300/0 conn(0x7fea4c133f70 0x7fea4c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 -- 172.21.15.125:0/4205139564 >> 172.21.15.125:0/4205139564 conn(0x7fea4c099c40 msgr2=0x7fea4c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7ff4dd335700 1 -- 172.21.15.125:0/2810409978 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4004030 con 0x7ff4d8138040 2023-10-03T10:11:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7ff4dd335700 1 -- 172.21.15.125:0/2810409978 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40043e0 con 0x7ff4d8138040 2023-10-03T10:11:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 -- 172.21.15.125:0/4205139564 shutdown_connections 2023-10-03T10:11:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7fea5430d700 1 -- 172.21.15.125:0/4205139564 wait complete. 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7ff4e059b700 1 -- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d8138040 msgr2=0x7ff4d8138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.866+0000 7ff4e059b700 1 --2- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d8138040 0x7ff4d8138410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40098f0 tx=0x7ff4d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 -- 172.21.15.125:0/2810409978 shutdown_connections 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 --2- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d8138040 0x7ff4d8138410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 --2- 172.21.15.125:0/2810409978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a08e0 0x7ff4d80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 -- 172.21.15.125:0/2810409978 >> 172.21.15.125:0/2810409978 conn(0x7ff4d80a2980 msgr2=0x7ff4d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 -- 172.21.15.125:0/2810409978 shutdown_connections 2023-10-03T10:11:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7ff4e059b700 1 -- 172.21.15.125:0/2810409978 wait complete. 2023-10-03T10:11:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7fea5430d700 1 Processor -- start 2023-10-03T10:11:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.867+0000 7fea5430d700 1 -- start start 2023-10-03T10:11:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c09ad40 0x7fea4c1cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c1ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c138980 con 0x7fea4c09ad40 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c09c7e0 con 0x7fea4c0a0a70 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea5430d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c09bb50 con 0x7fea4c133f70 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36330/0 (socket says 172.21.15.125:36330) 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 -- 172.21.15.125:0/2285003531 learned_addr learned my addr 172.21.15.125:0/2285003531 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7ff4e059b700 1 Processor -- start 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea518a8700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c1ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 -- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 msgr2=0x7fea4c1ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c1ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 -- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c09ad40 msgr2=0x7fea4c1cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c09ad40 0x7fea4c1cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 -- 172.21.15.125:0/2285003531 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44009b30 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.868+0000 7fea528aa700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea44003f80 tx=0x7fea44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440042d0 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44004450 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c137ae0 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44004800 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c13a0a0 con 0x7fea4c133f70 2023-10-03T10:11:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 -- start start 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d80a08e0 0x7ff4d81265a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 0x7ff4d8127020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d812a030 con 0x7ff4d80a08e0 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8128120 con 0x7ff4d80a1230 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7ff4e059b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d809c9c0 con 0x7ff4d8138040 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.869+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fea4401c440 con 0x7fea4c133f70 2023-10-03T10:11:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fea4403cd60 con 0x7fea4c133f70 2023-10-03T10:11:21.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ddb36700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ddb36700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59008/0 (socket says 172.21.15.125:59008) 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ddb36700 1 -- 172.21.15.125:0/3468546234 learned_addr learned my addr 172.21.15.125:0/3468546234 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 0x7ff4d8127020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 -- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 msgr2=0x7ff4d8126ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 -- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d80a08e0 msgr2=0x7ff4d81265a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d80a08e0 0x7ff4d81265a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 -- 172.21.15.125:0/3468546234 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4009500 con 0x7ff4d8138040 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ddb36700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4deb38700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 0x7ff4d8127020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cae0 tx=0x7ff4d000cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0003c00 con 0x7ff4d8138040 2023-10-03T10:11:21.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0003d60 con 0x7ff4d8138040 2023-10-03T10:11:21.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.870+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000aae0 con 0x7ff4d8138040 2023-10-03T10:11:21.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.871+0000 7fea520a9700 1 -- 172.21.15.125:0/2285003531 >> v1:172.21.15.125:6816/118167 conn(0x7fea3002c1b0 legacy=0x7fea3002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.871+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d809a240 con 0x7ff4d8138040 2023-10-03T10:11:21.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.871+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d812a530 con 0x7ff4d8138040 2023-10-03T10:11:21.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.871+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea340052e0 con 0x7fea4c133f70 2023-10-03T10:11:21.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.872+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d804f2a0 con 0x7ff4d8138040 2023-10-03T10:11:21.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.872+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff4d000ac40 con 0x7ff4d8138040 2023-10-03T10:11:21.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.872+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7ff4d003b7d0 con 0x7ff4d8138040 2023-10-03T10:11:21.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.876+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fea44020080 con 0x7fea4c133f70 2023-10-03T10:11:21.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.877+0000 7ff4de337700 1 -- 172.21.15.125:0/3468546234 >> v1:172.21.15.125:6816/118167 conn(0x7ff4bc02c1b0 legacy=0x7ff4bc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.880+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff4d00198f0 con 0x7ff4d8138040 2023-10-03T10:11:21.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.922+0000 7f06f8969700 1 -- 172.21.15.125:0/170937026 >> v1:172.21.15.125:6816/118167 conn(0x7f06d802c1b0 legacy=0x7f06d802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.929 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:21.929+0000 7f63b1944240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:11:21.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.960+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06f404f2a0 con 0x7f06f409e170 2023-10-03T10:11:21.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.961+0000 7f06f17fa700 1 -- 172.21.15.125:0/170937026 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06e002d3a0 con 0x7f06f409e170 2023-10-03T10:11:21.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.961+0000 7fb9767fc700 1 -- 172.21.15.125:0/3058182384 >> v1:172.21.15.125:6816/118167 conn(0x7fb96402c1b0 legacy=0x7fb96402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:21.962 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 >> v1:172.21.15.125:6816/118167 conn(0x7f06d802c1b0 legacy=0x7f06d802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 msgr2=0x7f06f41387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41387c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f06f409f3a0 tx=0x7f06e0004750 comp rx=0 tx=0).stop 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 shutdown_connections 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06f4130ce0 0x7f06f41c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06f409d860 0x7f06f4138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 --2- 172.21.15.125:0/170937026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06f409e170 0x7f06f41387c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 >> 172.21.15.125:0/170937026 conn(0x7f06f4099c40 msgr2=0x7f06f41396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 shutdown_connections 2023-10-03T10:11:21.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:21.963+0000 7f06fabcd700 1 -- 172.21.15.125:0/170937026 wait complete. 2023-10-03T10:11:21.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:22.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.000+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb97804f2a0 con 0x7fb97806a770 2023-10-03T10:11:22.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.001+0000 7fb95f7fe700 1 -- 172.21.15.125:0/3058182384 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9680223d0 con 0x7fb97806a770 2023-10-03T10:11:22.001 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:22.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.003+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 >> v1:172.21.15.125:6816/118167 conn(0x7fb96402c1b0 legacy=0x7fb96402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:22.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.003+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 msgr2=0x7fb978135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.003+0000 7fb97d717700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9680090b0 tx=0x7fb968004750 comp rx=0 tx=0).stop 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 shutdown_connections 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb978134f00 0x7fb9781362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb97806a770 0x7fb978135850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 --2- 172.21.15.125:0/3058182384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb97809e070 0x7fb978135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 >> 172.21.15.125:0/3058182384 conn(0x7fb978099c40 msgr2=0x7fb97811cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 shutdown_connections 2023-10-03T10:11:22.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.004+0000 7fb97d717700 1 -- 172.21.15.125:0/3058182384 wait complete. 2023-10-03T10:11:22.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:22.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.072+0000 7fea520a9700 1 -- 172.21.15.125:0/2285003531 >> v1:172.21.15.125:6816/118167 conn(0x7fea3002c1b0 legacy=0x7fea3002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.078+0000 7ff4de337700 1 -- 172.21.15.125:0/3468546234 >> v1:172.21.15.125:6816/118167 conn(0x7ff4bc02c1b0 legacy=0x7ff4bc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.078+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea34005590 con 0x7fea4c133f70 2023-10-03T10:11:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.078+0000 7fea42ffd700 1 -- 172.21.15.125:0/2285003531 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea44019940 con 0x7fea4c133f70 2023-10-03T10:11:22.079 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:22.080 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.080+0000 7f63b1944240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:11:22.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 >> v1:172.21.15.125:6816/118167 conn(0x7fea3002c1b0 legacy=0x7fea3002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 msgr2=0x7fea4c1cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea44003f80 tx=0x7fea44004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 shutdown_connections 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4c133f70 0x7fea4c1cd160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c09ad40 0x7fea4c1cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 --2- 172.21.15.125:0/2285003531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0a0a70 0x7fea4c1ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 >> 172.21.15.125:0/2285003531 conn(0x7fea4c099c40 msgr2=0x7fea4c0a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 shutdown_connections 2023-10-03T10:11:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.080+0000 7fea5430d700 1 -- 172.21.15.125:0/2285003531 wait complete. 2023-10-03T10:11:22.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:22.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.114+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4d8137460 con 0x7ff4d8138040 2023-10-03T10:11:22.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.114+0000 7ff4ceffd700 1 -- 172.21.15.125:0/3468546234 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4d00050d0 con 0x7ff4d8138040 2023-10-03T10:11:22.115 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:22.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 >> v1:172.21.15.125:6816/118167 conn(0x7ff4bc02c1b0 legacy=0x7ff4bc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 msgr2=0x7ff4d8127020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 0x7ff4d8127020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cae0 tx=0x7ff4d000cdf0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 shutdown_connections 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4d8138040 0x7ff4d8127020 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d80a08e0 0x7ff4d81265a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 --2- 172.21.15.125:0/3468546234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4d80a1230 0x7ff4d8126ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 >> 172.21.15.125:0/3468546234 conn(0x7ff4d80a2980 msgr2=0x7ff4d809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 shutdown_connections 2023-10-03T10:11:22.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:22.116+0000 7ff4e059b700 1 -- 172.21.15.125:0/3468546234 wait complete. 2023-10-03T10:11:22.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:22.157 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.157+0000 7f63b1944240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:11:22.293 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.292+0000 7f63b1944240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:11:22.365 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.364+0000 7f63b1944240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:11:22.522 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.521+0000 7f63b1944240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:11:22.600 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.600+0000 7f63b1944240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:11:22.676 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.676+0000 7f63b1944240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:11:22.773 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:22.772+0000 7f63b1944240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:11:22.977 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:23.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:23.037 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:23.037+0000 7f63b1944240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:11:23.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:23.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.105+0000 7f8a8c2a8700 1 Processor -- start 2023-10-03T10:11:23.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.105+0000 7f8a8c2a8700 1 -- start start 2023-10-03T10:11:23.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.105+0000 7f8a8c2a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 0x7f8a8409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8c2a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8c2a8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8c2a8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8409bf50 con 0x7f8a84130890 2023-10-03T10:11:23.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8c2a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84099a60 con 0x7f8a84099e20 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8c2a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8409b230 con 0x7f8a8409a730 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a845700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a044700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 0x7f8a8409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a044700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 0x7f8a8409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59024/0 (socket says 172.21.15.125:59024) 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a845700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46350/0 (socket says 172.21.15.125:46350) 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a044700 1 -- 172.21.15.125:0/2986110662 learned_addr learned my addr 172.21.15.125:0/2986110662 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 -- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 msgr2=0x7f8a8409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 0x7f8a8409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 -- 172.21.15.125:0/2986110662 >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 msgr2=0x7f8a84130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 --2- 172.21.15.125:0/2986110662 >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 -- 172.21.15.125:0/2986110662 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8409bb90 con 0x7f8a8409a730 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a8a845700 1 --2- 172.21.15.125:0/2986110662 >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.106+0000 7f8a89843700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84130350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009840 tx=0x7f8a74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e200c57db96630e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.107+0000 7f8a89042700 1 -- 172.21.15.125:0/2986110662 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74011830 con 0x7f8a8409a730 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.107+0000 7f8a89042700 1 -- 172.21.15.125:0/2986110662 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74011990 con 0x7f8a8409a730 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.107+0000 7f8a89042700 1 -- 172.21.15.125:0/2986110662 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74011d20 con 0x7f8a8409a730 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.107+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 msgr2=0x7f8a84130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.107+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84130350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009840 tx=0x7f8a74009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:23.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/2986110662 shutdown_connections 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84099e20 0x7f8a8409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/2986110662 >> v2:172.21.15.125:3300/0 conn(0x7f8a84130890 0x7f8a84130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/2986110662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84130350 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/2986110662 >> 172.21.15.125:0/2986110662 conn(0x7f8a840a2980 msgr2=0x7f8a840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/2986110662 shutdown_connections 2023-10-03T10:11:23.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.108+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/2986110662 wait complete. 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.109+0000 7f8a8c2a8700 1 Processor -- start 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.109+0000 7f8a8c2a8700 1 -- start start 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 0x7f8a84119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8411a180 con 0x7f8a84099e20 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840a1390 con 0x7f8a84130890 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8c2a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8409b470 con 0x7f8a8409a730 2023-10-03T10:11:23.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a044700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a044700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46366/0 (socket says 172.21.15.125:46366) 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a044700 1 -- 172.21.15.125:0/3824343709 learned_addr learned my addr 172.21.15.125:0/3824343709 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 0x7f8a84119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a89843700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 -- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 msgr2=0x7f8a84119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 -- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 msgr2=0x7f8a84118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 -- 172.21.15.125:0/3824343709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c009a70 con 0x7f8a84130890 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a044700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.110+0000 7f8a8a845700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 0x7f8a84119870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00efc0 tx=0x7f8a7c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.111+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00ca90 con 0x7f8a84130890 2023-10-03T10:11:23.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.111+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c00f040 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.111+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740094a0 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.111+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8411a8b0 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.111+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00ce30 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.112+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c0052e0 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.112+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8a7c014480 con 0x7f8a84130890 2023-10-03T10:11:23.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.112+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f8a7c03bdc0 con 0x7f8a84130890 2023-10-03T10:11:23.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.112+0000 7f8a8a044700 1 -- 172.21.15.125:0/3824343709 >> v1:172.21.15.125:6816/118167 conn(0x7f8a6802c1b0 legacy=0x7f8a6802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.120+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f8a7c012930 con 0x7f8a84130890 2023-10-03T10:11:23.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:23.132 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:23.131+0000 7f63b1944240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:11:23.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.158+0000 7f6babdc7700 1 Processor -- start 2023-10-03T10:11:23.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.158+0000 7f6babdc7700 1 -- start start 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6babdc7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ba4136960 0x7f6ba4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6babdc7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6babdc7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba406b2d0 con 0x7f6ba4133ad0 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6babdc7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba41345b0 con 0x7f6ba4136960 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6babdc7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4133610 con 0x7f6ba4139280 2023-10-03T10:11:23.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.159+0000 7f6baa364700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59048/0 (socket says 172.21.15.125:59048) 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 -- 172.21.15.125:0/1223417103 learned_addr learned my addr 172.21.15.125:0/1223417103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6ba9362700 1 --2- 172.21.15.125:0/1223417103 >> v2:172.21.15.125:3300/0 conn(0x7f6ba4136960 0x7f6ba4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 -- 172.21.15.125:0/1223417103 >> v2:172.21.15.125:3300/0 conn(0x7f6ba4136960 msgr2=0x7f6ba4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 --2- 172.21.15.125:0/1223417103 >> v2:172.21.15.125:3300/0 conn(0x7f6ba4136960 0x7f6ba4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 -- 172.21.15.125:0/1223417103 >> v1:172.21.15.125:6789/0 conn(0x7f6ba4133ad0 legacy=0x7f6ba4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 -- 172.21.15.125:0/1223417103 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba409a500 con 0x7f6ba4139280 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6baa364700 1 --2- 172.21.15.125:0/1223417103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009e50 tx=0x7f6b9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122171665ab28f61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6ba8b61700 1 -- 172.21.15.125:0/1223417103 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00e070 con 0x7f6ba4139280 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6ba8b61700 1 -- 172.21.15.125:0/1223417103 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c00b910 con 0x7f6ba4139280 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.160+0000 7f6ba8b61700 1 -- 172.21.15.125:0/1223417103 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00bcc0 con 0x7f6ba4139280 2023-10-03T10:11:23.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.161+0000 7f6babdc7700 1 -- 172.21.15.125:0/1223417103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 msgr2=0x7f6ba413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.161+0000 7f6babdc7700 1 --2- 172.21.15.125:0/1223417103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009e50 tx=0x7f6b9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.161+0000 7f6babdc7700 1 -- 172.21.15.125:0/1223417103 shutdown_connections 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.161+0000 7f6babdc7700 1 --2- 172.21.15.125:0/1223417103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4139280 0x7f6ba413b660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.161+0000 7f6babdc7700 1 --2- 172.21.15.125:0/1223417103 >> v2:172.21.15.125:3300/0 conn(0x7f6ba4136960 0x7f6ba4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.162+0000 7f6babdc7700 1 -- 172.21.15.125:0/1223417103 >> 172.21.15.125:0/1223417103 conn(0x7f6ba4099c40 msgr2=0x7f6ba40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.162+0000 7f6babdc7700 1 -- 172.21.15.125:0/1223417103 shutdown_connections 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.162+0000 7f6babdc7700 1 -- 172.21.15.125:0/1223417103 wait complete. 2023-10-03T10:11:23.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.163+0000 7f6babdc7700 1 Processor -- start 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 -- start start 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4133ad0 0x7f6ba4070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba4136960 0x7f6ba40714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40700f0 con 0x7f6ba4136960 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4072060 con 0x7f6ba4133ad0 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6babdc7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba412dd00 con 0x7f6ba4139280 2023-10-03T10:11:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6baa364700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6baa364700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36360/0 (socket says 172.21.15.125:36360) 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.164+0000 7f6baa364700 1 -- 172.21.15.125:0/906772429 learned_addr learned my addr 172.21.15.125:0/906772429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6ba9b63700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4133ad0 0x7f6ba4070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 -- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4133ad0 msgr2=0x7f6ba4070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4133ad0 0x7f6ba4070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 -- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba4136960 msgr2=0x7f6ba40714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba4136960 0x7f6ba40714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 -- 172.21.15.125:0/906772429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009b30 con 0x7f6ba4139280 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.165+0000 7f6baa364700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c012000 tx=0x7f6b9c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.166+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0048f0 con 0x7f6ba4139280 2023-10-03T10:11:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.166+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0092e0 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.166+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c01c630 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.167+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba406fe30 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.167+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba4070b60 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.168+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba404f2a0 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.168+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6b9c01c790 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.168+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f6b9c03d3e0 con 0x7f6ba4139280 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.168+0000 7f6ba9b63700 1 -- 172.21.15.125:0/906772429 >> v1:172.21.15.125:6816/118167 conn(0x7f6b8802c200 legacy=0x7f6b8802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.176+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6b9c01a970 con 0x7f6ba4139280 2023-10-03T10:11:23.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.244+0000 7fc94c928700 1 Processor -- start 2023-10-03T10:11:23.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.244+0000 7fc94c928700 1 -- start start 2023-10-03T10:11:23.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.245+0000 7fc94c928700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.245+0000 7fc94c928700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 0x7fc9481400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.245+0000 7fc94c928700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9481379e0 con 0x7fc948138040 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.245+0000 7fc94c928700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480a2100 con 0x7fc94813dd10 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.245+0000 7fc94c928700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94809b9b0 con 0x7fc948138410 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc94659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc948138040 0x7fc9480a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56512/0 (socket says 172.21.15.125:56512) 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36372/0 (socket says 172.21.15.125:36372) 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc94659c700 1 -- 172.21.15.125:0/2834134439 learned_addr learned my addr 172.21.15.125:0/2834134439 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc946d9d700 1 --2- 172.21.15.125:0/2834134439 >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 0x7fc9481400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 -- 172.21.15.125:0/2834134439 >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 msgr2=0x7fc9481400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 --2- 172.21.15.125:0/2834134439 >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 0x7fc9481400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 -- 172.21.15.125:0/2834134439 >> v1:172.21.15.125:6789/0 conn(0x7fc948138040 legacy=0x7fc9480a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 -- 172.21.15.125:0/2834134439 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948137c10 con 0x7fc948138410 2023-10-03T10:11:23.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc946d9d700 1 --2- 172.21.15.125:0/2834134439 >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 0x7fc9481400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.246+0000 7fc945d9b700 1 --2- 172.21.15.125:0/2834134439 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591d2baeafca8f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.247+0000 7fc94559a700 1 -- 172.21.15.125:0/2834134439 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011830 con 0x7fc948138410 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.247+0000 7fc94559a700 1 -- 172.21.15.125:0/2834134439 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c011990 con 0x7fc948138410 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.247+0000 7fc94559a700 1 -- 172.21.15.125:0/2834134439 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011d20 con 0x7fc948138410 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 -- 172.21.15.125:0/2834134439 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 msgr2=0x7fc9480a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 --2- 172.21.15.125:0/2834134439 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 -- 172.21.15.125:0/2834134439 shutdown_connections 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 --2- 172.21.15.125:0/2834134439 >> v2:172.21.15.125:3300/0 conn(0x7fc94813dd10 0x7fc9481400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 --2- 172.21.15.125:0/2834134439 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc948138410 0x7fc9480a0ff0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 -- 172.21.15.125:0/2834134439 >> 172.21.15.125:0/2834134439 conn(0x7fc9480a2980 msgr2=0x7fc9480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 -- 172.21.15.125:0/2834134439 shutdown_connections 2023-10-03T10:11:23.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.248+0000 7fc94c928700 1 -- 172.21.15.125:0/2834134439 wait complete. 2023-10-03T10:11:23.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 Processor -- start 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 -- start start 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc948138040 0x7fc948121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 0x7fc948121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948124e60 con 0x7fc948138040 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94809ef60 con 0x7fc948138410 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.250+0000 7fc94c928700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94809a240 con 0x7fc94813dd10 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc945d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 0x7fc948121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36382/0 (socket says 172.21.15.125:36382) 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 -- 172.21.15.125:0/2890857098 learned_addr learned my addr 172.21.15.125:0/2890857098 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc945d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 0x7fc948121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59064/0 (socket says 172.21.15.125:59064) 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc94659c700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc948138040 0x7fc948121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 -- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 msgr2=0x7fc948121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 0x7fc948121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 -- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc948138040 msgr2=0x7fc948121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc948138040 0x7fc948121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 -- 172.21.15.125:0/2890857098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940009a70 con 0x7fc94813dd10 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc946d9d700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc94000ef90 tx=0x7fc94000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.251+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000cd40 con 0x7fc94813dd10 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.252+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94000f040 con 0x7fc94813dd10 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.252+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400146c0 con 0x7fc94813dd10 2023-10-03T10:11:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.253+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0094a0 con 0x7fc94813dd10 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.253+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9481236b0 con 0x7fc94813dd10 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.254+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc948124ae0 con 0x7fc94813dd10 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.254+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc940014820 con 0x7fc94813dd10 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.254+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fc94003c6d0 con 0x7fc94813dd10 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.254+0000 7fc94659c700 1 -- 172.21.15.125:0/2890857098 >> v1:172.21.15.125:6816/118167 conn(0x7fc92802c1b0 legacy=0x7fc92802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.262+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc948124ae0 con 0x7fc94813dd10 2023-10-03T10:11:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.286+0000 7f4f9613c700 1 Processor -- start 2023-10-03T10:11:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.286+0000 7f4f9613c700 1 -- start start 2023-10-03T10:11:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f9006a770 0x7f4f901349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f90134f00 0x7f4f9009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9009dea0 0x7f4f9009e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9006b2e0 con 0x7f4f9006a770 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9009eca0 con 0x7f4f9009dea0 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f9613c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9009f720 con 0x7f4f90134f00 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f9006a770 0x7f4f901349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f9006a770 0x7f4f901349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46420/0 (socket says 172.21.15.125:46420) 2023-10-03T10:11:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.287+0000 7f4f8f7fe700 1 -- 172.21.15.125:0/1535503212 learned_addr learned my addr 172.21.15.125:0/1535503212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 -- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f90134f00 msgr2=0x7f4f9009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f90134f00 0x7f4f9009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 -- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9009dea0 msgr2=0x7f4f9009e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9009dea0 0x7f4f9009e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 -- 172.21.15.125:0/1535503212 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9006b480 con 0x7f4f9006a770 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8f7fe700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f9006a770 0x7f4f901349c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098f0 tx=0x7f4f80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8e48973c484840 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8e7fc700 1 -- 172.21.15.125:0/1535503212 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000b8a0 con 0x7f4f9006a770 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8e7fc700 1 -- 172.21.15.125:0/1535503212 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000ba00 con 0x7f4f9006a770 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.288+0000 7f4f8e7fc700 1 -- 172.21.15.125:0/1535503212 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000bd90 con 0x7f4f9006a770 2023-10-03T10:11:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 -- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f9006a770 msgr2=0x7f4f901349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f9006a770 0x7f4f901349c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098f0 tx=0x7f4f80009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:23.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 -- 172.21.15.125:0/1535503212 shutdown_connections 2023-10-03T10:11:23.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9009dea0 0x7f4f9009e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f9006a770 0x7f4f901349c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1535503212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f90134f00 0x7f4f9009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 -- 172.21.15.125:0/1535503212 >> 172.21.15.125:0/1535503212 conn(0x7f4f90099c40 msgr2=0x7f4f900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 -- 172.21.15.125:0/1535503212 shutdown_connections 2023-10-03T10:11:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.289+0000 7f4f9613c700 1 -- 172.21.15.125:0/1535503212 wait complete. 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 Processor -- start 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 -- start start 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 0x7f4f9006f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f9009dea0 0x7f4f9006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90133ef0 con 0x7f4f90134f00 2023-10-03T10:11:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9009f290 con 0x7f4f9006a770 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.290+0000 7f4f9613c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901267b0 con 0x7f4f9009dea0 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46422/0 (socket says 172.21.15.125:46422) 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 -- 172.21.15.125:0/1982363346 learned_addr learned my addr 172.21.15.125:0/1982363346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8f7fe700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 0x7f4f9006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 -- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f9009dea0 msgr2=0x7f4f9006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f9009dea0 0x7f4f9006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 -- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 msgr2=0x7f4f9006f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 0x7f4f9006f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 -- 172.21.15.125:0/1982363346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009550 con 0x7f4f90134f00 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8f7fe700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 0x7f4f9006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f8ffff700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b9a0 tx=0x7f4f8800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.291+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800d8e0 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.292+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f901264f0 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.292+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f90126f90 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.292+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800da40 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.292+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800ddb0 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.292+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f4f88015420 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.293+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f4f88011070 con 0x7f4f90134f00 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.293+0000 7f4f8f7fe700 1 -- 172.21.15.125:0/1982363346 >> v1:172.21.15.125:6816/118167 conn(0x7f4f7c02c1b0 legacy=0x7f4f7c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.293+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f700052e0 con 0x7f4f90134f00 2023-10-03T10:11:23.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.297+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4f88013920 con 0x7f4f90134f00 2023-10-03T10:11:23.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.313+0000 7f8a8a044700 1 -- 172.21.15.125:0/3824343709 >> v1:172.21.15.125:6816/118167 conn(0x7f8a6802c1b0 legacy=0x7f8a6802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.323+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a6c005590 con 0x7f8a84130890 2023-10-03T10:11:23.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.324+0000 7f8a7affd700 1 -- 172.21.15.125:0/3824343709 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a7c009cc0 con 0x7f8a84130890 2023-10-03T10:11:23.324 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:23.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 >> v1:172.21.15.125:6816/118167 conn(0x7f8a6802c1b0 legacy=0x7f8a6802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:23.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 msgr2=0x7f8a84119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 0x7f8a84119870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00efc0 tx=0x7f8a7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 shutdown_connections 2023-10-03T10:11:23.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84130890 0x7f8a84119870 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a84099e20 0x7f8a84118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 --2- 172.21.15.125:0/3824343709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a8409a730 0x7f8a84119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.326+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 >> 172.21.15.125:0/3824343709 conn(0x7f8a840a2980 msgr2=0x7f8a8412d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.327+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 shutdown_connections 2023-10-03T10:11:23.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.330+0000 7f8a8c2a8700 1 -- 172.21.15.125:0/3824343709 wait complete. 2023-10-03T10:11:23.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:23.366 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:23.365+0000 7f63b1944240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:11:23.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.369+0000 7f6ba9b63700 1 -- 172.21.15.125:0/906772429 >> v1:172.21.15.125:6816/118167 conn(0x7f6b8802c200 legacy=0x7f6b8802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.382+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ba406c3b0 con 0x7f6ba4139280 2023-10-03T10:11:23.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.382+0000 7f6b9a7fc700 1 -- 172.21.15.125:0/906772429 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b9c02c390 con 0x7f6ba4139280 2023-10-03T10:11:23.383 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:23.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 >> v1:172.21.15.125:6816/118167 conn(0x7f6b8802c200 legacy=0x7f6b8802e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 msgr2=0x7f6ba4071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c012000 tx=0x7f6b9c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 shutdown_connections 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ba4139280 0x7f6ba4071a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba4133ad0 0x7f6ba4070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 --2- 172.21.15.125:0/906772429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba4136960 0x7f6ba40714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.384+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 >> 172.21.15.125:0/906772429 conn(0x7f6ba4099c40 msgr2=0x7f6ba4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.385+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 shutdown_connections 2023-10-03T10:11:23.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.385+0000 7f6babdc7700 1 -- 172.21.15.125:0/906772429 wait complete. 2023-10-03T10:11:23.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:23.444 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:23.444+0000 7f63b1944240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.456+0000 7fc94659c700 1 -- 172.21.15.125:0/2890857098 >> v1:172.21.15.125:6816/118167 conn(0x7fc92802c1b0 legacy=0x7fc92802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.472+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f70005590 con 0x7f4f90134f00 2023-10-03T10:11:23.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.473+0000 7f4f77fff700 1 -- 172.21.15.125:0/1982363346 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f88013330 con 0x7f4f90134f00 2023-10-03T10:11:23.473 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 >> v1:172.21.15.125:6816/118167 conn(0x7f4f7c02c1b0 legacy=0x7f4f7c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 msgr2=0x7f4f900703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b9a0 tx=0x7f4f8800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 shutdown_connections 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f90134f00 0x7f4f900703d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f9006a770 0x7f4f9006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 --2- 172.21.15.125:0/1982363346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f9009dea0 0x7f4f9006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 >> 172.21.15.125:0/1982363346 conn(0x7f4f90099c40 msgr2=0x7f4f9009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 shutdown_connections 2023-10-03T10:11:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.475+0000 7f4f9613c700 1 -- 172.21.15.125:0/1982363346 wait complete. 2023-10-03T10:11:23.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.488+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc948124ae0 con 0x7fc94813dd10 2023-10-03T10:11:23.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.488+0000 7fc936ffd700 1 -- 172.21.15.125:0/2890857098 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc948124ae0 con 0x7fc94813dd10 2023-10-03T10:11:23.489 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 >> v1:172.21.15.125:6816/118167 conn(0x7fc92802c1b0 legacy=0x7fc92802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 msgr2=0x7fc948122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc94000ef90 tx=0x7fc94000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 shutdown_connections 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc94813dd10 0x7fc948122080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc948138040 0x7fc948121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 --2- 172.21.15.125:0/2890857098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc948138410 0x7fc948121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 >> 172.21.15.125:0/2890857098 conn(0x7fc9480a2980 msgr2=0x7fc94809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 shutdown_connections 2023-10-03T10:11:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:23.490+0000 7fc94c928700 1 -- 172.21.15.125:0/2890857098 wait complete. 2023-10-03T10:11:23.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:24.085 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:24.084+0000 7f63b1944240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:11:24.205 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:24.205+0000 7f63b1944240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:11:24.321 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:24.320+0000 7f63b1944240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:24.345 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:24.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:24.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.471+0000 7f9057c7a700 1 Processor -- start 2023-10-03T10:11:24.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 -- start start 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 0x7f9050138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90501393a0 0x7f905013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905009fa00 con 0x7f905009e870 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500a0370 con 0x7f90501393a0 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9057c7a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f905006bec0 con 0x7f905009f350 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9056217700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90501393a0 0x7f905013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9055a16700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f905009e870 0x7f905009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56520/0 (socket says 172.21.15.125:56520) 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.472+0000 7f9055a16700 1 -- 172.21.15.125:0/2614628923 learned_addr learned my addr 172.21.15.125:0/2614628923 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9055215700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 0x7f9050138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9054a14700 1 -- 172.21.15.125:0/2614628923 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649421508 0 0) 0x7f905009fa00 con 0x7f905009e870 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9054a14700 1 -- 172.21.15.125:0/2614628923 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f903c0035b0 con 0x7f905009e870 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9056217700 1 -- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 msgr2=0x7f9050138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9056217700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 0x7f9050138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9056217700 1 -- 172.21.15.125:0/2614628923 >> v1:172.21.15.125:6789/0 conn(0x7f905009e870 legacy=0x7f905009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9056217700 1 -- 172.21.15.125:0/2614628923 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905009ada0 con 0x7f90501393a0 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9055215700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 0x7f9050138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9056217700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90501393a0 0x7f905013b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9048009d90 tx=0x7f904800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec18fb4109532a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9054a14700 1 -- 172.21.15.125:0/2614628923 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800e070 con 0x7f90501393a0 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9054a14700 1 -- 172.21.15.125:0/2614628923 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904800bb20 con 0x7f90501393a0 2023-10-03T10:11:24.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.473+0000 7f9054a14700 1 -- 172.21.15.125:0/2614628923 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048012430 con 0x7f90501393a0 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 -- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90501393a0 msgr2=0x7f905013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90501393a0 0x7f905013b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9048009d90 tx=0x7f904800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 -- 172.21.15.125:0/2614628923 shutdown_connections 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90501393a0 0x7f905013b780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 --2- 172.21.15.125:0/2614628923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f905009f350 0x7f9050138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 -- 172.21.15.125:0/2614628923 >> 172.21.15.125:0/2614628923 conn(0x7f90500a4430 msgr2=0x7f90500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 -- 172.21.15.125:0/2614628923 shutdown_connections 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.474+0000 7f9057c7a700 1 -- 172.21.15.125:0/2614628923 wait complete. 2023-10-03T10:11:24.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 Processor -- start 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 -- start start 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f905009e870 0x7f90501219c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90501393a0 0x7f9050122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905006fb10 con 0x7f905009f350 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90501255f0 con 0x7f905009e870 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9057c7a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9050124c90 con 0x7f90501393a0 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9055215700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9055215700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46446/0 (socket says 172.21.15.125:46446) 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9055215700 1 -- 172.21.15.125:0/1014061492 learned_addr learned my addr 172.21.15.125:0/1014061492 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.475+0000 7f9056217700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90501393a0 0x7f9050122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055a16700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f905009e870 0x7f90501219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 -- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90501393a0 msgr2=0x7f9050122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90501393a0 0x7f9050122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 -- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f905009e870 msgr2=0x7f90501219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f905009e870 0x7f90501219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 -- 172.21.15.125:0/1014061492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048009a70 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9055215700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f904000e840 tx=0x7f904000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040013610 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040013770 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040013b20 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050124f40 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.476+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9050123d80 con 0x7f905009f350 2023-10-03T10:11:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.477+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9040013c80 con 0x7f905009f350 2023-10-03T10:11:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.477+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f904003b620 con 0x7f905009f350 2023-10-03T10:11:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.477+0000 7f9055a16700 1 -- 172.21.15.125:0/1014061492 >> v1:172.21.15.125:6816/118167 conn(0x7f903402c1b0 legacy=0x7f903402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.479+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905006ad00 con 0x7f905009f350 2023-10-03T10:11:24.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.483+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9040021080 con 0x7f905009f350 2023-10-03T10:11:24.488 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:24.504 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:24.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.524+0000 7fa07c7f0700 1 Processor -- start 2023-10-03T10:11:24.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.524+0000 7fa07c7f0700 1 -- start start 2023-10-03T10:11:24.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07c7f0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa074138410 0x7fa0740a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07c7f0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa0741400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07c7f0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0741379e0 con 0x7fa074138040 2023-10-03T10:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07c7f0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740a2100 con 0x7fa074138410 2023-10-03T10:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07c7f0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07409b9b0 con 0x7fa07413dd10 2023-10-03T10:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa074138410 0x7fa0740a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa074138410 0x7fa0740a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46456/0 (socket says 172.21.15.125:46456) 2023-10-03T10:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 -- 172.21.15.125:0/1822020893 learned_addr learned my addr 172.21.15.125:0/1822020893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07ad8d700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa0741400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 -- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 msgr2=0x7fa0741400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa0741400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa079d8b700 1 -- 172.21.15.125:0/1822020893 >> v1:172.21.15.125:6789/0 conn(0x7fa074138040 legacy=0x7fa0740a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.526+0000 7fa079d8b700 1 -- 172.21.15.125:0/1822020893 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074137c10 con 0x7fa074138410 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.525+0000 7fa07958a700 1 -- 172.21.15.125:0/1822020893 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378260985 0 0) 0x7fa0741379e0 con 0x7fa074138040 2023-10-03T10:11:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.526+0000 7fa079d8b700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa0740a0ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0640098f0 tx=0x7fa064009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450237a5951f13b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.526+0000 7fa07958a700 1 -- 172.21.15.125:0/1822020893 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064011830 con 0x7fa074138410 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.526+0000 7fa07958a700 1 -- 172.21.15.125:0/1822020893 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064011990 con 0x7fa074138410 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.526+0000 7fa07958a700 1 -- 172.21.15.125:0/1822020893 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064011d20 con 0x7fa074138410 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 -- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 msgr2=0x7fa0740a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa0740a0ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0640098f0 tx=0x7fa064009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:24.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 -- 172.21.15.125:0/1822020893 shutdown_connections 2023-10-03T10:11:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa0741400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/1822020893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa0740a0ff0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.527+0000 7fa07c7f0700 1 -- 172.21.15.125:0/1822020893 >> 172.21.15.125:0/1822020893 conn(0x7fa0740a2980 msgr2=0x7fa0740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.528+0000 7fa07c7f0700 1 -- 172.21.15.125:0/1822020893 shutdown_connections 2023-10-03T10:11:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.528+0000 7fa07c7f0700 1 -- 172.21.15.125:0/1822020893 wait complete. 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.529+0000 7fa07c7f0700 1 Processor -- start 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.529+0000 7fa07c7f0700 1 -- start start 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa074138040 0x7fa07413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa074137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07413c3e0 con 0x7fa074138410 2023-10-03T10:11:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07413c1f0 con 0x7fa074138040 2023-10-03T10:11:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa07c7f0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07413cac0 con 0x7fa07413dd10 2023-10-03T10:11:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46458/0 (socket says 172.21.15.125:46458) 2023-10-03T10:11:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 -- 172.21.15.125:0/693363743 learned_addr learned my addr 172.21.15.125:0/693363743 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 -- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 msgr2=0x7fa074137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa074137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 -- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa074138040 msgr2=0x7fa07413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa074138040 0x7fa07413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.530+0000 7fa079d8b700 1 -- 172.21.15.125:0/693363743 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064009550 con 0x7fa074138410 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.531+0000 7fa079d8b700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa064000c00 tx=0x7fa064004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.531+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064019a30 con 0x7fa074138410 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.531+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064019b90 con 0x7fa074138410 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.531+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064025460 con 0x7fa074138410 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.532+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07409a240 con 0x7fa074138410 2023-10-03T10:11:24.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.532+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa074119970 con 0x7fa074138410 2023-10-03T10:11:24.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.533+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07404f2a0 con 0x7fa074138410 2023-10-03T10:11:24.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.533+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa0640255c0 con 0x7fa074138410 2023-10-03T10:11:24.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.534+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fa06403cf60 con 0x7fa074138410 2023-10-03T10:11:24.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.534+0000 7fa07a58c700 1 -- 172.21.15.125:0/693363743 >> v1:172.21.15.125:6816/118167 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.541+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa064010380 con 0x7fa074138410 2023-10-03T10:11:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.619+0000 7f8aa4f18700 1 Processor -- start 2023-10-03T10:11:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.619+0000 7f8aa4f18700 1 -- start start 2023-10-03T10:11:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8aa4f18700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8aa009ef80 0x7f8aa013d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8aa4f18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009f3b0 0x7f8aa013f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8aa4f18700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0072b30 con 0x7f8aa009a130 2023-10-03T10:11:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8aa4f18700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa009a500 con 0x7f8aa009ef80 2023-10-03T10:11:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8aa4f18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa009ada0 con 0x7f8aa009f3b0 2023-10-03T10:11:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8aa009ef80 0x7f8aa013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8aa009ef80 0x7f8aa013d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46472/0 (socket says 172.21.15.125:46472) 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 -- 172.21.15.125:0/3858491126 learned_addr learned my addr 172.21.15.125:0/3858491126 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9ed9d700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009f3b0 0x7f8aa013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 -- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009f3b0 msgr2=0x7f8aa013f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009f3b0 0x7f8aa013f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 -- 172.21.15.125:0/3858491126 >> v1:172.21.15.125:6789/0 conn(0x7f8aa009a130 legacy=0x7f8aa009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 -- 172.21.15.125:0/3858491126 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa009fe00 con 0x7f8aa009ef80 2023-10-03T10:11:24.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.620+0000 7f8a9dd9b700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009ef80 0x7f8aa013d420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8a940098f0 tx=0x7f8a94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b759974ddae3df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.621+0000 7f8a9d59a700 1 -- 172.21.15.125:0/3858491126 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004230 con 0x7f8aa009ef80 2023-10-03T10:11:24.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.621+0000 7f8a9d59a700 1 -- 172.21.15.125:0/3858491126 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94004390 con 0x7f8aa009ef80 2023-10-03T10:11:24.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.621+0000 7f8a9d59a700 1 -- 172.21.15.125:0/3858491126 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940036a0 con 0x7f8aa009ef80 2023-10-03T10:11:24.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.621+0000 7f8aa4f18700 1 -- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009ef80 msgr2=0x7f8aa013d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.621+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009ef80 0x7f8aa013d420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8a940098f0 tx=0x7f8a94009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:24.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 -- 172.21.15.125:0/3858491126 shutdown_connections 2023-10-03T10:11:24.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009f3b0 0x7f8aa013f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/3858491126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009ef80 0x7f8aa013d420 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 -- 172.21.15.125:0/3858491126 >> 172.21.15.125:0/3858491126 conn(0x7f8aa00a4430 msgr2=0x7f8aa00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 -- 172.21.15.125:0/3858491126 shutdown_connections 2023-10-03T10:11:24.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.622+0000 7f8aa4f18700 1 -- 172.21.15.125:0/3858491126 wait complete. 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 Processor -- start 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 -- start start 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009a130 0x7f8aa011a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8aa009ef80 0x7f8aa011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa011c050 con 0x7f8aa009f3b0 2023-10-03T10:11:24.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa011cc80 con 0x7f8aa009ef80 2023-10-03T10:11:24.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8aa4f18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa009e280 con 0x7f8aa009a130 2023-10-03T10:11:24.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.623+0000 7f8a9ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46488/0 (socket says 172.21.15.125:46488) 2023-10-03T10:11:24.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 -- 172.21.15.125:0/1963389798 learned_addr learned my addr 172.21.15.125:0/1963389798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9e59c700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009a130 0x7f8aa011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9dd9b700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8aa009ef80 0x7f8aa011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 -- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009a130 msgr2=0x7f8aa011a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009a130 0x7f8aa011a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 -- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8aa009ef80 msgr2=0x7f8aa011ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8aa009ef80 0x7f8aa011ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 -- 172.21.15.125:0/1963389798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94009550 con 0x7f8aa009f3b0 2023-10-03T10:11:24.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a9ed9d700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a98007e40 tx=0x7f8a9800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800ed30 con 0x7f8aa009f3b0 2023-10-03T10:11:24.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9800ee90 con 0x7f8aa009f3b0 2023-10-03T10:11:24.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98014640 con 0x7f8aa009f3b0 2023-10-03T10:11:24.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa00a00f0 con 0x7f8aa009f3b0 2023-10-03T10:11:24.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.624+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa011e550 con 0x7f8aa009f3b0 2023-10-03T10:11:24.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.626+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa004f2a0 con 0x7f8aa009f3b0 2023-10-03T10:11:24.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.626+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8a980147a0 con 0x7f8aa009f3b0 2023-10-03T10:11:24.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.626+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f8a9803bf20 con 0x7f8aa009f3b0 2023-10-03T10:11:24.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.626+0000 7f8a9e59c700 1 -- 172.21.15.125:0/1963389798 >> v1:172.21.15.125:6816/118167 conn(0x7f8a8002c1b0 legacy=0x7f8a8002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.630+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f8a98014a50 con 0x7f8aa009f3b0 2023-10-03T10:11:24.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.678+0000 7f9055a16700 1 -- 172.21.15.125:0/1014061492 >> v1:172.21.15.125:6816/118167 conn(0x7f903402c1b0 legacy=0x7f903402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.682+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f905004f2a0 con 0x7f905009f350 2023-10-03T10:11:24.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.682+0000 7f90467fc700 1 -- 172.21.15.125:0/1014061492 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9040012370 con 0x7f905009f350 2023-10-03T10:11:24.683 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:24.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 >> v1:172.21.15.125:6816/118167 conn(0x7f903402c1b0 legacy=0x7f903402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:24.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 msgr2=0x7f9050121f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f904000e840 tx=0x7f904000eb50 comp rx=0 tx=0).stop 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 shutdown_connections 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90501393a0 0x7f9050122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f905009e870 0x7f90501219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 --2- 172.21.15.125:0/1014061492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905009f350 0x7f9050121f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 >> 172.21.15.125:0/1014061492 conn(0x7f90500a4430 msgr2=0x7f905009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 shutdown_connections 2023-10-03T10:11:24.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.684+0000 7f9057c7a700 1 -- 172.21.15.125:0/1014061492 wait complete. 2023-10-03T10:11:24.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.716+0000 7ff5f64b6700 1 Processor -- start 2023-10-03T10:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.716+0000 7ff5f64b6700 1 -- start start 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f64b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 0x7ff5f009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f64b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 0x7ff5f0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f64b6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f009aaa0 con 0x7ff5f009e170 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f64b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f009f870 con 0x7ff5f009d860 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f64b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f009b360 con 0x7ff5f0130eb0 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 0x7ff5f009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 0x7ff5f009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46504/0 (socket says 172.21.15.125:46504) 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5effff700 1 -- 172.21.15.125:0/4113492517 learned_addr learned my addr 172.21.15.125:0/4113492517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.717+0000 7ff5f4a53700 1 --2- 172.21.15.125:0/4113492517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 0x7ff5f0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5f4a53700 1 -- 172.21.15.125:0/4113492517 >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 msgr2=0x7ff5f009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5f4a53700 1 --2- 172.21.15.125:0/4113492517 >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 0x7ff5f009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5f4a53700 1 -- 172.21.15.125:0/4113492517 >> v1:172.21.15.125:6789/0 conn(0x7ff5f009e170 legacy=0x7ff5f01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5f4a53700 1 -- 172.21.15.125:0/4113492517 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f009b620 con 0x7ff5f0130eb0 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5f4a53700 1 --2- 172.21.15.125:0/4113492517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 0x7ff5f0138a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009d90 tx=0x7ff5e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77fb6dda581e3b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5eeffd700 1 -- 172.21.15.125:0/4113492517 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800e070 con 0x7ff5f0130eb0 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5eeffd700 1 -- 172.21.15.125:0/4113492517 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800bb20 con 0x7ff5f0130eb0 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.718+0000 7ff5eeffd700 1 -- 172.21.15.125:0/4113492517 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8012430 con 0x7ff5f0130eb0 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 -- 172.21.15.125:0/4113492517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 msgr2=0x7ff5f0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/4113492517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 0x7ff5f0138a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009d90 tx=0x7ff5e800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 -- 172.21.15.125:0/4113492517 shutdown_connections 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/4113492517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f0130eb0 0x7ff5f0138a00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/4113492517 >> v2:172.21.15.125:3300/0 conn(0x7ff5f009d860 0x7ff5f009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 -- 172.21.15.125:0/4113492517 >> 172.21.15.125:0/4113492517 conn(0x7ff5f0099c40 msgr2=0x7ff5f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 -- 172.21.15.125:0/4113492517 shutdown_connections 2023-10-03T10:11:24.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.719+0000 7ff5f64b6700 1 -- 172.21.15.125:0/4113492517 wait complete. 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.720+0000 7ff5f64b6700 1 Processor -- start 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 -- start start 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 0x7ff5f013aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 0x7ff5f0135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f0130eb0 0x7ff5f0136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0137030 con 0x7ff5f009d860 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f009c8b0 con 0x7ff5f009e170 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f64b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0138040 con 0x7ff5f0130eb0 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 0x7ff5f013aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 0x7ff5f013aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46518/0 (socket says 172.21.15.125:46518) 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5effff700 1 -- 172.21.15.125:0/784703288 learned_addr learned my addr 172.21.15.125:0/784703288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5ef7fe700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 0x7ff5f0135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.721+0000 7ff5f4a53700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f0130eb0 0x7ff5f0136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 -- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f0130eb0 msgr2=0x7ff5f0136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f0130eb0 0x7ff5f0136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 -- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 msgr2=0x7ff5f013aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 0x7ff5f013aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 -- 172.21.15.125:0/784703288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009a70 con 0x7ff5f009e170 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ef7fe700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 0x7ff5f0135bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5f009ee50 tx=0x7ff5e400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40052d0 con 0x7ff5f009e170 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4005430 con 0x7ff5f009e170 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f01396f0 con 0x7ff5f009e170 2023-10-03T10:11:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40038c0 con 0x7ff5f009e170 2023-10-03T10:11:24.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.722+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0138e80 con 0x7ff5f009e170 2023-10-03T10:11:24.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.723+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f0132a50 con 0x7ff5f009e170 2023-10-03T10:11:24.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.724+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff5e4003a20 con 0x7ff5f009e170 2023-10-03T10:11:24.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.724+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7ff5e403a990 con 0x7ff5f009e170 2023-10-03T10:11:24.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.724+0000 7ff5effff700 1 -- 172.21.15.125:0/784703288 >> v1:172.21.15.125:6816/118167 conn(0x7ff5dc02c1b0 legacy=0x7ff5dc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.732+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff5e4019d20 con 0x7ff5f009e170 2023-10-03T10:11:24.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.735+0000 7fa07a58c700 1 -- 172.21.15.125:0/693363743 >> v1:172.21.15.125:6816/118167 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/118167 2023-10-03T10:11:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.807+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa074119140 con 0x7fa074138410 2023-10-03T10:11:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.808+0000 7fa06affd700 1 -- 172.21.15.125:0/693363743 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa06402a070 con 0x7fa074138410 2023-10-03T10:11:24.808 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:24.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.809+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8aa006be20 con 0x7f8aa009f3b0 2023-10-03T10:11:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.809+0000 7f8a8effd700 1 -- 172.21.15.125:0/1963389798 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a9801b310 con 0x7f8aa009f3b0 2023-10-03T10:11:24.810 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.810+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 >> v1:172.21.15.125:6816/118167 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.810+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 msgr2=0x7fa074137050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.810+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa064000c00 tx=0x7fa064004750 comp rx=0 tx=0).stop 2023-10-03T10:11:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 shutdown_connections 2023-10-03T10:11:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa07413dd10 0x7fa074137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa074138040 0x7fa07413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 --2- 172.21.15.125:0/693363743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa074138410 0x7fa074137050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 >> 172.21.15.125:0/693363743 conn(0x7fa0740a2980 msgr2=0x7fa074140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 shutdown_connections 2023-10-03T10:11:24.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 >> v1:172.21.15.125:6816/118167 conn(0x7f8a8002c1b0 legacy=0x7f8a8002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:24.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 msgr2=0x7f8aa011b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a98007e40 tx=0x7f8a9800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 shutdown_connections 2023-10-03T10:11:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8aa009f3b0 0x7f8aa011b140 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8aa009a130 0x7f8aa011a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 --2- 172.21.15.125:0/1963389798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8aa009ef80 0x7f8aa011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 >> 172.21.15.125:0/1963389798 conn(0x7f8aa00a4430 msgr2=0x7f8aa00a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7fa07c7f0700 1 -- 172.21.15.125:0/693363743 wait complete. 2023-10-03T10:11:24.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 shutdown_connections 2023-10-03T10:11:24.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.811+0000 7f8aa4f18700 1 -- 172.21.15.125:0/1963389798 wait complete. 2023-10-03T10:11:24.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:24.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.914+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5f004f2a0 con 0x7ff5f009e170 2023-10-03T10:11:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.915+0000 7ff5ecff9700 1 -- 172.21.15.125:0/784703288 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5e4017030 con 0x7ff5f009e170 2023-10-03T10:11:24.915 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 >> v1:172.21.15.125:6816/118167 conn(0x7ff5dc02c1b0 legacy=0x7ff5dc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 msgr2=0x7ff5f0135bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 0x7ff5f0135bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5f009ee50 tx=0x7ff5e400c730 comp rx=0 tx=0).stop 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 shutdown_connections 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f0130eb0 0x7ff5f0136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f009d860 0x7ff5f013aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 --2- 172.21.15.125:0/784703288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f009e170 0x7ff5f0135bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 >> 172.21.15.125:0/784703288 conn(0x7ff5f0099c40 msgr2=0x7ff5f013b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 shutdown_connections 2023-10-03T10:11:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:24.917+0000 7ff5f64b6700 1 -- 172.21.15.125:0/784703288 wait complete. 2023-10-03T10:11:24.920 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:24.920+0000 7f63b1944240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:11:24.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:25.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.041+0000 7f63b1944240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:25.195 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.195+0000 7f63b1944240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:11:25.297 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.297+0000 7f63b1944240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:25.445 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.445+0000 7f345e715240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:11:25.600 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.589+0000 7f345e715240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:11:25.698 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:25.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 Processor -- start 2023-10-03T10:11:25.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 -- start start 2023-10-03T10:11:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003409fa00 con 0x7f0034134160 2023-10-03T10:11:25.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340a0370 con 0x7f003409f180 2023-10-03T10:11:25.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.825+0000 7f0038c50700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f003406bec0 con 0x7f003409e870 2023-10-03T10:11:25.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:52896/0 (socket says 172.21.15.125:52896) 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54038/0 (socket says 172.21.15.125:54038) 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 -- 172.21.15.125:0/120957317 learned_addr learned my addr 172.21.15.125:0/120957317 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 -- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 msgr2=0x7f003409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 -- 172.21.15.125:0/120957317 >> v1:172.21.15.125:6789/0 conn(0x7f0034134160 legacy=0x7f003413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003159a700 1 -- 172.21.15.125:0/120957317 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072195461 0 0) 0x7f003409fa00 con 0x7f0034134160 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 -- 172.21.15.125:0/120957317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003409ada0 con 0x7f003409f180 2023-10-03T10:11:25.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003259c700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f0031d9b700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0028009920 tx=0x7f0028009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54460cab34bcc91e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003159a700 1 -- 172.21.15.125:0/120957317 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028011830 con 0x7f003409f180 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003159a700 1 -- 172.21.15.125:0/120957317 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0028011990 con 0x7f003409f180 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.826+0000 7f003159a700 1 -- 172.21.15.125:0/120957317 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028011d20 con 0x7f003409f180 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 -- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 msgr2=0x7f0034133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0028009920 tx=0x7f0028009c30 comp rx=0 tx=0).stop 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 -- 172.21.15.125:0/120957317 shutdown_connections 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f003409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 --2- 172.21.15.125:0/120957317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034133c20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 -- 172.21.15.125:0/120957317 >> 172.21.15.125:0/120957317 conn(0x7f00340a4430 msgr2=0x7f00340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 -- 172.21.15.125:0/120957317 shutdown_connections 2023-10-03T10:11:25.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.827+0000 7f0038c50700 1 -- 172.21.15.125:0/120957317 wait complete. 2023-10-03T10:11:25.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 Processor -- start 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 -- start start 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f0034122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0034134160 0x7f0034123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034126510 con 0x7f0034134160 2023-10-03T10:11:25.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0034124600 con 0x7f003409f180 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.828+0000 7f0038c50700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00340a16a0 con 0x7f003409e870 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0032d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0034134160 0x7f0034123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:52902/0 (socket says 172.21.15.125:52902) 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 -- 172.21.15.125:0/1515275550 learned_addr learned my addr 172.21.15.125:0/1515275550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f003259c700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f0034122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 -- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 msgr2=0x7f0034122a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f0034122a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 -- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0034134160 msgr2=0x7f0034123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0034134160 0x7f0034123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 -- 172.21.15.125:0/1515275550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240094a0 con 0x7f003409f180 2023-10-03T10:11:25.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0031d9b700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0028009c70 tx=0x7f0028004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028004240 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002801f070 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0028009550 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00280045a0 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.829+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034133510 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.830+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f0028021030 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.830+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f00280406b0 con 0x7f003409f180 2023-10-03T10:11:25.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.830+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003404f2a0 con 0x7f003409f180 2023-10-03T10:11:25.836 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:25.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.834+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f002801a450 con 0x7f003409f180 2023-10-03T10:11:25.846 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:25.846+0000 7f345e715240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:11:25.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:25.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.972+0000 7f459c613700 1 Processor -- start 2023-10-03T10:11:25.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.972+0000 7f459c613700 1 -- start start 2023-10-03T10:11:25.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f459409e200 0x7f45941380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45941385f0 0x7f4594138a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4594098680 con 0x7f459409e200 2023-10-03T10:11:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4594099560 con 0x7f45941385f0 2023-10-03T10:11:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459c613700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4594098bb0 con 0x7f459409d8f0 2023-10-03T10:11:25.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.973+0000 7f459a3af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54050/0 (socket says 172.21.15.125:54050) 2023-10-03T10:11:25.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 -- 172.21.15.125:0/3623895619 learned_addr learned my addr 172.21.15.125:0/3623895619 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 -- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45941385f0 msgr2=0x7f4594138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 --2- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45941385f0 0x7f4594138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 -- 172.21.15.125:0/3623895619 >> v2:172.21.15.125:3300/0 conn(0x7f459409e200 msgr2=0x7f45941380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 --2- 172.21.15.125:0/3623895619 >> v2:172.21.15.125:3300/0 conn(0x7f459409e200 0x7f45941380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 -- 172.21.15.125:0/3623895619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940980f0 con 0x7f459409d8f0 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f459a3af700 1 --2- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b435943382d151 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f45993ad700 1 -- 172.21.15.125:0/3623895619 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590005e30 con 0x7f459409d8f0 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f45993ad700 1 -- 172.21.15.125:0/3623895619 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590004030 con 0x7f459409d8f0 2023-10-03T10:11:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.974+0000 7f45993ad700 1 -- 172.21.15.125:0/3623895619 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900043e0 con 0x7f459409d8f0 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 -- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 msgr2=0x7f459409dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 --2- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590009bd0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 -- 172.21.15.125:0/3623895619 shutdown_connections 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 --2- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45941385f0 0x7f4594138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 --2- 172.21.15.125:0/3623895619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f459409d8f0 0x7f459409dcc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 --2- 172.21.15.125:0/3623895619 >> v2:172.21.15.125:3300/0 conn(0x7f459409e200 0x7f45941380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 -- 172.21.15.125:0/3623895619 >> 172.21.15.125:0/3623895619 conn(0x7f45940a2b30 msgr2=0x7f459409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 -- 172.21.15.125:0/3623895619 shutdown_connections 2023-10-03T10:11:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.975+0000 7f459c613700 1 -- 172.21.15.125:0/3623895619 wait complete. 2023-10-03T10:11:25.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 Processor -- start 2023-10-03T10:11:25.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 -- start start 2023-10-03T10:11:25.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f459409d8f0 0x7f4594126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f459409e200 0x7f45941274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459412a730 con 0x7f459409d8f0 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45941290b0 con 0x7f459409e200 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.977+0000 7f459c613700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f459409d550 con 0x7f45941385f0 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54056/0 (socket says 172.21.15.125:54056) 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 -- 172.21.15.125:0/3711711835 learned_addr learned my addr 172.21.15.125:0/3711711835 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f4599bae700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f459409e200 0x7f45941274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 -- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f459409e200 msgr2=0x7f45941274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f459409e200 0x7f45941274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 -- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f459409d8f0 msgr2=0x7f4594126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f459409d8f0 0x7f4594126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 -- 172.21.15.125:0/3711711835 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590009500 con 0x7f45941385f0 2023-10-03T10:11:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.978+0000 7f459abb0700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b9a0 tx=0x7f458c00bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.979+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00c930 con 0x7f45941385f0 2023-10-03T10:11:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.979+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00cab0 con 0x7f45941385f0 2023-10-03T10:11:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.979+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00ce60 con 0x7f45941385f0 2023-10-03T10:11:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.979+0000 7fa363a34700 1 Processor -- start 2023-10-03T10:11:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 -- start start 2023-10-03T10:11:25.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4594128840 con 0x7f45941385f0 2023-10-03T10:11:25.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4594137b60 con 0x7f45941385f0 2023-10-03T10:11:25.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa35c130eb0 0x7fa35c139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c09aaa0 con 0x7fa35c09e170 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c09f870 con 0x7fa35c130eb0 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa363a34700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c09b360 con 0x7fa35c09d860 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa3617d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa3617d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:52918/0 (socket says 172.21.15.125:52918) 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.980+0000 7fa3617d0700 1 -- 172.21.15.125:0/3738559145 learned_addr learned my addr 172.21.15.125:0/3738559145 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa3617d0700 1 -- 172.21.15.125:0/3738559145 >> v2:172.21.15.125:3300/0 conn(0x7fa35c130eb0 msgr2=0x7fa35c139c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa3617d0700 1 --2- 172.21.15.125:0/3738559145 >> v2:172.21.15.125:3300/0 conn(0x7fa35c130eb0 0x7fa35c139c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa3617d0700 1 -- 172.21.15.125:0/3738559145 >> v1:172.21.15.125:6789/0 conn(0x7fa35c09e170 legacy=0x7fa35c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa3617d0700 1 -- 172.21.15.125:0/3738559145 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c09b620 con 0x7fa35c09d860 2023-10-03T10:11:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f458c01d3b0 con 0x7f45941385f0 2023-10-03T10:11:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa3617d0700 1 --2- 172.21.15.125:0/3738559145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3580098f0 tx=0x7fa358009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7e1e268fe5195e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459409e610 con 0x7f45941385f0 2023-10-03T10:11:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f458c006e40 con 0x7f45941385f0 2023-10-03T10:11:25.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa353fff700 1 -- 172.21.15.125:0/3738559145 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358004230 con 0x7fa35c09d860 2023-10-03T10:11:25.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa353fff700 1 -- 172.21.15.125:0/3738559145 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358004390 con 0x7fa35c09d860 2023-10-03T10:11:25.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.981+0000 7fa353fff700 1 -- 172.21.15.125:0/3738559145 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580036a0 con 0x7fa35c09d860 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 -- 172.21.15.125:0/3738559145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 msgr2=0x7fa35c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 --2- 172.21.15.125:0/3738559145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3580098f0 tx=0x7fa358009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 -- 172.21.15.125:0/3738559145 shutdown_connections 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 --2- 172.21.15.125:0/3738559145 >> v2:172.21.15.125:3300/0 conn(0x7fa35c130eb0 0x7fa35c139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 --2- 172.21.15.125:0/3738559145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c09d860 0x7fa35c09dc30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 -- 172.21.15.125:0/3738559145 >> 172.21.15.125:0/3738559145 conn(0x7fa35c099c40 msgr2=0x7fa35c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.982+0000 7fa363a34700 1 -- 172.21.15.125:0/3738559145 shutdown_connections 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.983+0000 7fa363a34700 1 -- 172.21.15.125:0/3738559145 wait complete. 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.984+0000 7fa363a34700 1 Processor -- start 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.984+0000 7fa363a34700 1 -- start start 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.984+0000 7fa363a34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.984+0000 7fa363a34700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35c09e170 0x7fa35c07b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa363a34700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c130eb0 0x7fa35c120ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa363a34700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c07de50 con 0x7fa35c09e170 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa363a34700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c09c8b0 con 0x7fa35c130eb0 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa363a34700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c072730 con 0x7fa35c09d860 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54066/0 (socket says 172.21.15.125:54066) 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 -- 172.21.15.125:0/4228036919 learned_addr learned my addr 172.21.15.125:0/4228036919 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa361fd1700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c130eb0 0x7fa35c120ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 -- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c130eb0 msgr2=0x7fa35c120ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c130eb0 0x7fa35c120ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 -- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35c09e170 msgr2=0x7fa35c07b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35c09e170 0x7fa35c07b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 -- 172.21.15.125:0/4228036919 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009550 con 0x7fa35c09d860 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.985+0000 7fa3617d0700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa358000c00 tx=0x7fa358004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.989+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358003d00 con 0x7fa35c09d860 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.989+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358063070 con 0x7fa35c09d860 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.989+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800b8a0 con 0x7fa35c09d860 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.989+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c07b940 con 0x7fa35c09d860 2023-10-03T10:11:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.990+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f459409e610 con 0x7f45941385f0 2023-10-03T10:11:25.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.990+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c07e7c0 con 0x7fa35c09d860 2023-10-03T10:11:25.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.990+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fa358065070 con 0x7fa35c09d860 2023-10-03T10:11:25.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.991+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fa3580849e0 con 0x7fa35c09d860 2023-10-03T10:11:25.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.991+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c07c700 con 0x7fa35c09d860 2023-10-03T10:11:25.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:25.999+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa358003e60 con 0x7fa35c09d860 2023-10-03T10:11:26.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.030+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00341260b0 con 0x7f003409f180 2023-10-03T10:11:26.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.030+0000 7f0022ffd700 1 -- 172.21.15.125:0/1515275550 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00341260b0 con 0x7f003409f180 2023-10-03T10:11:26.031 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:26.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 msgr2=0x7f0034122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0028009c70 tx=0x7f0028004750 comp rx=0 tx=0).stop 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 shutdown_connections 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0034134160 0x7f0034123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f003409e870 0x7f0034122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 --2- 172.21.15.125:0/1515275550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f003409f180 0x7f0034122fd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 >> 172.21.15.125:0/1515275550 conn(0x7f00340a4430 msgr2=0x7f0034070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 shutdown_connections 2023-10-03T10:11:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.032+0000 7f0038c50700 1 -- 172.21.15.125:0/1515275550 wait complete. 2023-10-03T10:11:26.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:26.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.089+0000 7f4d1127f700 1 Processor -- start 2023-10-03T10:11:26.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.089+0000 7f4d1127f700 1 -- start start 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d1127f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d0c099a60 0x7f4d0c1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d1127f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c138e30 0x7f4d0c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d1127f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c09aa00 con 0x7f4d0c133b80 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d1127f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c09a080 con 0x7f4d0c099a60 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d1127f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c133750 con 0x7f4d0c138e30 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d0c099a60 0x7f4d0c1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d0c099a60 0x7f4d0c1388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34108/0 (socket says 172.21.15.125:34108) 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 -- 172.21.15.125:0/1838705443 learned_addr learned my addr 172.21.15.125:0/1838705443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0b7fe700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c138e30 0x7f4d0c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:26.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 -- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c138e30 msgr2=0x7f4d0c13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c138e30 0x7f4d0c13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 -- 172.21.15.125:0/1838705443 >> v1:172.21.15.125:6789/0 conn(0x7f4d0c133b80 legacy=0x7f4d0c133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.090+0000 7f4d0a7fc700 1 -- 172.21.15.125:0/1838705443 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c09a760 con 0x7f4d0c099a60 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d0a7fc700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c099a60 0x7f4d0c1388f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d000098f0 tx=0x7f4d00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baebe534be8d138 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d09ffb700 1 -- 172.21.15.125:0/1838705443 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011830 con 0x7f4d0c099a60 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d09ffb700 1 -- 172.21.15.125:0/1838705443 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00011990 con 0x7f4d0c099a60 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d09ffb700 1 -- 172.21.15.125:0/1838705443 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011d20 con 0x7f4d0c099a60 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 -- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c099a60 msgr2=0x7f4d0c1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c099a60 0x7f4d0c1388f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d000098f0 tx=0x7f4d00009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 -- 172.21.15.125:0/1838705443 shutdown_connections 2023-10-03T10:11:26.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c138e30 0x7f4d0c13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 --2- 172.21.15.125:0/1838705443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c099a60 0x7f4d0c1388f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.091+0000 7f4d1127f700 1 -- 172.21.15.125:0/1838705443 >> 172.21.15.125:0/1838705443 conn(0x7f4d0c0a2980 msgr2=0x7f4d0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.092+0000 7f4d1127f700 1 -- 172.21.15.125:0/1838705443 shutdown_connections 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.092+0000 7f4d1127f700 1 -- 172.21.15.125:0/1838705443 wait complete. 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.093+0000 7f4d1127f700 1 Processor -- start 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.093+0000 7f4d1127f700 1 -- start start 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 0x7f4d0c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 0x7f4d0c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c11b6a0 con 0x7f4d0c138e30 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c11b8f0 con 0x7f4d0c133b80 2023-10-03T10:11:26.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d1127f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c11a7e0 con 0x7f4d0c119870 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54090/0 (socket says 172.21.15.125:54090) 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 -- 172.21.15.125:0/790526869 learned_addr learned my addr 172.21.15.125:0/790526869 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0affd700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 0x7f4d0c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0a7fc700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 0x7f4d0c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 -- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 msgr2=0x7f4d0c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 0x7f4d0c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 -- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 msgr2=0x7f4d0c119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 0x7f4d0c119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 -- 172.21.15.125:0/790526869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009550 con 0x7f4d0c119870 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0affd700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 0x7f4d0c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0a7fc700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 0x7f4d0c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.094+0000 7f4d0b7fe700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400ef90 tx=0x7f4d0400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.095+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04009ca0 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.095+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0400f040 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.095+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04014480 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.095+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c138a30 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.095+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c138410 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.096+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f4d040145e0 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.096+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f4d0403ff00 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.096+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c11b290 con 0x7f4d0c119870 2023-10-03T10:11:26.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.100+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4d0c11b290 con 0x7f4d0c119870 2023-10-03T10:11:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.198+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f459409e610 con 0x7f45941385f0 2023-10-03T10:11:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.199+0000 7f458affd700 1 -- 172.21.15.125:0/3711711835 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f459409e610 con 0x7f45941385f0 2023-10-03T10:11:26.270 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 msgr2=0x7f4594127a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b9a0 tx=0x7f458c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 shutdown_connections 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45941385f0 0x7f4594127a20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f459409d8f0 0x7f4594126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 --2- 172.21.15.125:0/3711711835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f459409e200 0x7f45941274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 >> 172.21.15.125:0/3711711835 conn(0x7f45940a2b30 msgr2=0x7f45940a1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 shutdown_connections 2023-10-03T10:11:26.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.201+0000 7f459c613700 1 -- 172.21.15.125:0/3711711835 wait complete. 2023-10-03T10:11:26.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.220+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa35c07dc90 con 0x7fa35c09d860 2023-10-03T10:11:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.220+0000 7fa351ffb700 1 -- 172.21.15.125:0/4228036919 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa35c07dc90 con 0x7fa35c09d860 2023-10-03T10:11:26.273 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 msgr2=0x7fa35c07ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa358000c00 tx=0x7fa358004750 comp rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 shutdown_connections 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35c130eb0 0x7fa35c120ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35c09d860 0x7fa35c07ae60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 --2- 172.21.15.125:0/4228036919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35c09e170 0x7fa35c07b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 >> 172.21.15.125:0/4228036919 conn(0x7fa35c099c40 msgr2=0x7fa35c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 shutdown_connections 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.223+0000 7fa363a34700 1 -- 172.21.15.125:0/4228036919 wait complete. 2023-10-03T10:11:26.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:26.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.284+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d0c11b4e0 con 0x7f4d0c119870 2023-10-03T10:11:26.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.284+0000 7f4cf37fe700 1 -- 172.21.15.125:0/790526869 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d0c11b4e0 con 0x7f4d0c119870 2023-10-03T10:11:26.285 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 msgr2=0x7f4d0c12e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400ef90 tx=0x7f4d0400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 shutdown_connections 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d0c119870 0x7f4d0c12e7f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d0c133b80 0x7f4d0c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 --2- 172.21.15.125:0/790526869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d0c138e30 0x7f4d0c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 >> 172.21.15.125:0/790526869 conn(0x7f4d0c0a2980 msgr2=0x7f4d0c09b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 shutdown_connections 2023-10-03T10:11:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:26.286+0000 7f4d1127f700 1 -- 172.21.15.125:0/790526869 wait complete. 2023-10-03T10:11:26.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:26.336 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:26.336+0000 7f345e715240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:11:26.454 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:26.454+0000 7f345e715240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:11:26.764 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:26.764+0000 7f345e715240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:11:26.898 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:26.898+0000 7f345e715240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:11:26.967 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:26.967+0000 7f345e715240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:11:27.046 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:27.095 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.095+0000 7f345e715240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:11:27.169 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.169+0000 7f345e715240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:11:27.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.171+0000 7f8585e6a700 1 Processor -- start 2023-10-03T10:11:27.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 -- start start 2023-10-03T10:11:27.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 0x7f8580138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134570 0x7f858013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858009b110 con 0x7f858009ad40 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85800a3b60 con 0x7f8580134140 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f8585e6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85800a1a80 con 0x7f8580134570 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f857effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 0x7f8580138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f857ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134570 0x7f858013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f857f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f858009ad40 0x7f8580133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49394/0 (socket says 172.21.15.125:49394) 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.172+0000 7f857f7fe700 1 -- 172.21.15.125:0/4120497397 learned_addr learned my addr 172.21.15.125:0/4120497397 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:27.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857effd700 1 -- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134570 msgr2=0x7f858013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857effd700 1 --2- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134570 0x7f858013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857effd700 1 -- 172.21.15.125:0/4120497397 >> v1:172.21.15.125:6789/0 conn(0x7f858009ad40 legacy=0x7f8580133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857e7fc700 1 -- 172.21.15.125:0/4120497397 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967839206 0 0) 0x7f858009b110 con 0x7f858009ad40 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857effd700 1 -- 172.21.15.125:0/4120497397 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85800a2fa0 con 0x7f8580134140 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857effd700 1 --2- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 0x7f8580138e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85680098a0 tx=0x7f8568009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d209e929c9314c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857e7fc700 1 -- 172.21.15.125:0/4120497397 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011830 con 0x7f8580134140 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857e7fc700 1 -- 172.21.15.125:0/4120497397 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568011990 con 0x7f8580134140 2023-10-03T10:11:27.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.173+0000 7f857e7fc700 1 -- 172.21.15.125:0/4120497397 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011d20 con 0x7f8580134140 2023-10-03T10:11:27.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 -- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 msgr2=0x7f8580138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 --2- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 0x7f8580138e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85680098a0 tx=0x7f8568009bb0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 -- 172.21.15.125:0/4120497397 shutdown_connections 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 --2- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134570 0x7f858013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 --2- 172.21.15.125:0/4120497397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134140 0x7f8580138e80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 -- 172.21.15.125:0/4120497397 >> 172.21.15.125:0/4120497397 conn(0x7f8580099c40 msgr2=0x7f858006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 -- 172.21.15.125:0/4120497397 shutdown_connections 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.174+0000 7f8585e6a700 1 -- 172.21.15.125:0/4120497397 wait complete. 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 Processor -- start 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 -- start start 2023-10-03T10:11:27.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 0x7f858011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 0x7f858011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134570 0x7f858011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8580133780 con 0x7f858009ad40 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858011d9f0 con 0x7f8580134570 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f8585e6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858011e1a0 con 0x7f8580134140 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f857effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 0x7f858011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f857f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 0x7f858011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f857effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 0x7f858011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54098/0 (socket says 172.21.15.125:54098) 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f857effd700 1 -- 172.21.15.125:0/2141395049 learned_addr learned my addr 172.21.15.125:0/2141395049 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.175+0000 7f857ffff700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134570 0x7f858011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 -- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 msgr2=0x7f858011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 0x7f858011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 -- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134570 msgr2=0x7f858011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134570 0x7f858011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 -- 172.21.15.125:0/2141395049 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680094a0 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f857f7fe700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 0x7f858011c8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f857800c3c0 tx=0x7f857800c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578004a70 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578004bf0 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858011f7d0 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780070d0 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.176+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858009c7e0 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.177+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f8578007230 con 0x7f858009ad40 2023-10-03T10:11:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.177+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f857803f140 con 0x7f858009ad40 2023-10-03T10:11:27.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.177+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858004f2a0 con 0x7f858009ad40 2023-10-03T10:11:27.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.181+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f85780074e0 con 0x7f858009ad40 2023-10-03T10:11:27.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:27.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:27.299 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:27.337 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.337+0000 7f345e715240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:11:27.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.365+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f858011e820 con 0x7f858009ad40 2023-10-03T10:11:27.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.365+0000 7f8577fff700 1 -- 172.21.15.125:0/2141395049 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f857801b340 con 0x7f858009ad40 2023-10-03T10:11:27.415 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:27.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.372+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 msgr2=0x7f858011c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.372+0000 7f8585e6a700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 0x7f858011c8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f857800c3c0 tx=0x7f857800c6d0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 shutdown_connections 2023-10-03T10:11:27.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8580134570 0x7f858011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858009ad40 0x7f858011c8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 --2- 172.21.15.125:0/2141395049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8580134140 0x7f858011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 >> 172.21.15.125:0/2141395049 conn(0x7f8580099c40 msgr2=0x7f858009b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 shutdown_connections 2023-10-03T10:11:27.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.373+0000 7f8585e6a700 1 -- 172.21.15.125:0/2141395049 wait complete. 2023-10-03T10:11:27.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:27.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.408+0000 7fcad2007700 1 Processor -- start 2023-10-03T10:11:27.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.408+0000 7fcad2007700 1 -- start start 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc099e20 0x7fcacc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcacc130890 0x7fcacc130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc09bf50 con 0x7fcacc130890 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc099a60 con 0x7fcacc09a730 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcad2007700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc09b230 con 0x7fcacc099e20 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc099e20 0x7fcacc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:52950/0 (socket says 172.21.15.125:52950) 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacaffd700 1 -- 172.21.15.125:0/972441288 learned_addr learned my addr 172.21.15.125:0/972441288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacbfff700 1 --2- 172.21.15.125:0/972441288 >> v2:172.21.15.125:3300/0 conn(0x7fcacc130890 0x7fcacc130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacaffd700 1 -- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc099e20 msgr2=0x7fcacc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.409+0000 7fcacaffd700 1 --2- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc099e20 0x7fcacc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcacaffd700 1 -- 172.21.15.125:0/972441288 >> v2:172.21.15.125:3300/0 conn(0x7fcacc130890 msgr2=0x7fcacc130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcacaffd700 1 --2- 172.21.15.125:0/972441288 >> v2:172.21.15.125:3300/0 conn(0x7fcacc130890 0x7fcacc130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcacaffd700 1 -- 172.21.15.125:0/972441288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc09bb90 con 0x7fcacc09a730 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcacaffd700 1 --2- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcac000bb90 tx=0x7fcac000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d3147db481e2cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcaca7fc700 1 -- 172.21.15.125:0/972441288 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000dd30 con 0x7fcacc09a730 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcaca7fc700 1 -- 172.21.15.125:0/972441288 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000de90 con 0x7fcacc09a730 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.410+0000 7fcaca7fc700 1 -- 172.21.15.125:0/972441288 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0010690 con 0x7fcacc09a730 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 -- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 msgr2=0x7fcacc130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 --2- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcac000bb90 tx=0x7fcac000bea0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 -- 172.21.15.125:0/972441288 shutdown_connections 2023-10-03T10:11:27.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 --2- 172.21.15.125:0/972441288 >> v2:172.21.15.125:3300/0 conn(0x7fcacc130890 0x7fcacc130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 --2- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc099e20 0x7fcacc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 --2- 172.21.15.125:0/972441288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc09a730 0x7fcacc130350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 -- 172.21.15.125:0/972441288 >> 172.21.15.125:0/972441288 conn(0x7fcacc0a2980 msgr2=0x7fcacc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 -- 172.21.15.125:0/972441288 shutdown_connections 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.411+0000 7fcad2007700 1 -- 172.21.15.125:0/972441288 wait complete. 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 Processor -- start 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 -- start start 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc09a730 0x7fcacc11bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc130890 0x7fcacc11c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc11d370 con 0x7fcacc099e20 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc11e5c0 con 0x7fcacc130890 2023-10-03T10:11:27.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcad2007700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc11d950 con 0x7fcacc09a730 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcacb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcacb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34158/0 (socket says 172.21.15.125:34158) 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcacb7fe700 1 -- 172.21.15.125:0/4198308880 learned_addr learned my addr 172.21.15.125:0/4198308880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.412+0000 7fcacbfff700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc130890 0x7fcacc11c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 -- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc09a730 msgr2=0x7fcacc11bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc09a730 0x7fcacc11bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 -- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc130890 msgr2=0x7fcacc11c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc130890 0x7fcacc11c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 -- 172.21.15.125:0/4198308880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac000b7f0 con 0x7fcacc099e20 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcacb7fe700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0096f0 con 0x7fcacc099e20 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00c850 con 0x7fcacc099e20 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00cbc0 con 0x7fcacc099e20 2023-10-03T10:11:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc11efa0 con 0x7fcacc099e20 2023-10-03T10:11:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.413+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc09b470 con 0x7fcacc099e20 2023-10-03T10:11:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.414+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fcabc00cd20 con 0x7fcacc099e20 2023-10-03T10:11:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.414+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fcabc03f9c0 con 0x7fcacc099e20 2023-10-03T10:11:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.414+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc04f2a0 con 0x7fcacc099e20 2023-10-03T10:11:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.419+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fcabc017080 con 0x7fcacc099e20 2023-10-03T10:11:27.426 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.426+0000 7f345e715240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:11:27.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 Processor -- start 2023-10-03T10:11:27.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 -- start start 2023-10-03T10:11:27.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c09a7c0 0x7f989c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989c130890 0x7f989c130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c09b930 con 0x7f989c130890 2023-10-03T10:11:27.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c072410 con 0x7f989c09a7c0 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.490+0000 7f98a1e08700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f989c09cd30 con 0x7f989c099eb0 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989c130890 0x7f989c130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989c130890 0x7f989c130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34170/0 (socket says 172.21.15.125:34170) 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 -- 172.21.15.125:0/2033681817 learned_addr learned my addr 172.21.15.125:0/2033681817 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989b7fe700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989affd700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c09a7c0 0x7f989c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 -- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 msgr2=0x7f989c09a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c09a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 -- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c09a7c0 msgr2=0x7f989c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c09a7c0 0x7f989c130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 -- 172.21.15.125:0/2033681817 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c099a60 con 0x7f989c130890 2023-10-03T10:11:27.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989bfff700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c130890 0x7f989c130d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9894009e50 tx=0x7f989400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08124c67b29aba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989a7fc700 1 -- 172.21.15.125:0/2033681817 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400e070 con 0x7f989c130890 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989a7fc700 1 -- 172.21.15.125:0/2033681817 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400b910 con 0x7f989c130890 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.491+0000 7f989a7fc700 1 -- 172.21.15.125:0/2033681817 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400bcc0 con 0x7f989c130890 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 -- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c130890 msgr2=0x7f989c130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c130890 0x7f989c130d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9894009e50 tx=0x7f989400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 -- 172.21.15.125:0/2033681817 shutdown_connections 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c130890 0x7f989c130d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c09a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2033681817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c09a7c0 0x7f989c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 -- 172.21.15.125:0/2033681817 >> 172.21.15.125:0/2033681817 conn(0x7f989c0a2980 msgr2=0x7f989c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.492+0000 7f98a1e08700 1 -- 172.21.15.125:0/2033681817 shutdown_connections 2023-10-03T10:11:27.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.493+0000 7f98a1e08700 1 -- 172.21.15.125:0/2033681817 wait complete. 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.493+0000 7f98a1e08700 1 Processor -- start 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 -- start start 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c09a7c0 0x7f989c11e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c130890 0x7f989c11e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c121640 con 0x7f989c09a7c0 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c11f730 con 0x7f989c130890 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f98a1e08700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f989c12ffd0 con 0x7f989c099eb0 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54130/0 (socket says 172.21.15.125:54130) 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 -- 172.21.15.125:0/2668003124 learned_addr learned my addr 172.21.15.125:0/2668003124 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989bfff700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c130890 0x7f989c11e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989affd700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c09a7c0 0x7f989c11e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 -- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c130890 msgr2=0x7f989c11e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c130890 0x7f989c11e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 -- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c09a7c0 msgr2=0x7f989c11e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c09a7c0 0x7f989c11e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.494+0000 7f989b7fe700 1 -- 172.21.15.125:0/2668003124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009b30 con 0x7f989c099eb0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f989b7fe700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f988c00e900 tx=0x7f988c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c013680 con 0x7f989c099eb0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c0137e0 con 0x7f989c099eb0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c013b50 con 0x7f989c099eb0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c09b490 con 0x7f989c099eb0 2023-10-03T10:11:27.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.495+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c11ff20 con 0x7f989c099eb0 2023-10-03T10:11:27.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.496+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f988c013cb0 con 0x7f989c099eb0 2023-10-03T10:11:27.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.496+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c04f2a0 con 0x7f989c099eb0 2023-10-03T10:11:27.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.496+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f988c03f8f0 con 0x7f989c099eb0 2023-10-03T10:11:27.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.497+0000 7f2a65502700 1 Processor -- start 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 -- start start 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60066410 0x7f2a601319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a60131f30 0x7f2a6009c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a600a0f20 con 0x7f2a601314b0 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600667e0 con 0x7f2a60131f30 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a65502700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600a23c0 con 0x7f2a60066410 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a5f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a60131f30 0x7f2a6009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a5e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2a601314b0 0x7f2a6009bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49406/0 (socket says 172.21.15.125:49406) 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.498+0000 7f2a5e7fc700 1 -- 172.21.15.125:0/1685086475 learned_addr learned my addr 172.21.15.125:0/1685086475 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5dffb700 1 -- 172.21.15.125:0/1685086475 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134604447 0 0) 0x7f2a600a0f20 con 0x7f2a601314b0 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5dffb700 1 -- 172.21.15.125:0/1685086475 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a480035b0 con 0x7f2a601314b0 2023-10-03T10:11:27.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5f7fe700 1 -- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60066410 msgr2=0x7f2a601319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5f7fe700 1 --2- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60066410 0x7f2a601319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5f7fe700 1 -- 172.21.15.125:0/1685086475 >> v1:172.21.15.125:6789/0 conn(0x7f2a601314b0 legacy=0x7f2a6009bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5f7fe700 1 -- 172.21.15.125:0/1685086475 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600a16e0 con 0x7f2a60131f30 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5f7fe700 1 --2- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60131f30 0x7f2a6009c380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009dc0 tx=0x7f2a5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431a3d865312a629 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5dffb700 1 -- 172.21.15.125:0/1685086475 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800e070 con 0x7f2a60131f30 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5dffb700 1 -- 172.21.15.125:0/1685086475 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800bae0 con 0x7f2a60131f30 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.499+0000 7f2a5dffb700 1 -- 172.21.15.125:0/1685086475 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800be90 con 0x7f2a60131f30 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 -- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60131f30 msgr2=0x7f2a6009c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 --2- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60131f30 0x7f2a6009c380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009dc0 tx=0x7f2a5800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 -- 172.21.15.125:0/1685086475 shutdown_connections 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 --2- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60131f30 0x7f2a6009c380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 --2- 172.21.15.125:0/1685086475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60066410 0x7f2a601319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 -- 172.21.15.125:0/1685086475 >> 172.21.15.125:0/1685086475 conn(0x7f2a600a2980 msgr2=0x7f2a600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 -- 172.21.15.125:0/1685086475 shutdown_connections 2023-10-03T10:11:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.500+0000 7f2a65502700 1 -- 172.21.15.125:0/1685086475 wait complete. 2023-10-03T10:11:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.501+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f988c01adc0 con 0x7f989c099eb0 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 Processor -- start 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 -- start start 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a601314b0 0x7f2a6012bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60131f30 0x7f2a6012c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601329a0 con 0x7f2a60066410 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600a1d50 con 0x7f2a601314b0 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.502+0000 7f2a65502700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6009fcb0 con 0x7f2a60131f30 2023-10-03T10:11:27.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34198/0 (socket says 172.21.15.125:34198) 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 -- 172.21.15.125:0/3440380127 learned_addr learned my addr 172.21.15.125:0/3440380127 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5e7fc700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a601314b0 0x7f2a6012bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 -- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60131f30 msgr2=0x7f2a6012c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60131f30 0x7f2a6012c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 -- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a601314b0 msgr2=0x7f2a6012bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a601314b0 0x7f2a6012bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 -- 172.21.15.125:0/3440380127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009a70 con 0x7f2a60066410 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a5effd700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000b550 tx=0x7f2a5000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50005aa0 con 0x7f2a60066410 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6012c600 con 0x7f2a60066410 2023-10-03T10:11:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50005c00 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011630 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.503+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a60139550 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.504+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f2a50011790 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.505+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f2a50006330 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.505+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6004f2a0 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.513+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f2a50011a40 con 0x7f2a60066410 2023-10-03T10:11:27.534 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.518+0000 7f345e715240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:11:27.598 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.598+0000 7f345e715240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:11:27.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.600+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcacc06bce0 con 0x7fcacc099e20 2023-10-03T10:11:27.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.601+0000 7fcab3fff700 1 -- 172.21.15.125:0/4198308880 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcabc01b3b0 con 0x7fcacc099e20 2023-10-03T10:11:27.601 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 msgr2=0x7fcacc11b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ecd0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 shutdown_connections 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcacc130890 0x7fcacc11c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcacc099e20 0x7fcacc11b840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 --2- 172.21.15.125:0/4198308880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcacc09a730 0x7fcacc11bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.602+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 >> 172.21.15.125:0/4198308880 conn(0x7fcacc0a2980 msgr2=0x7fcacc09df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.603+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 shutdown_connections 2023-10-03T10:11:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.603+0000 7fcad2007700 1 -- 172.21.15.125:0/4198308880 wait complete. 2023-10-03T10:11:27.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:27.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.688+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f989c121130 con 0x7f989c099eb0 2023-10-03T10:11:27.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.689+0000 7f9883fff700 1 -- 172.21.15.125:0/2668003124 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f988c017030 con 0x7f989c099eb0 2023-10-03T10:11:27.689 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:27.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.690+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 msgr2=0x7f989c11db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.690+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f988c00e900 tx=0x7f988c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:11:27.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 shutdown_connections 2023-10-03T10:11:27.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f989c130890 0x7f989c11e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989c099eb0 0x7f989c11db20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 --2- 172.21.15.125:0/2668003124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989c09a7c0 0x7f989c11e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 >> 172.21.15.125:0/2668003124 conn(0x7f989c0a2980 msgr2=0x7f989c09f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 shutdown_connections 2023-10-03T10:11:27.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.691+0000 7f98a1e08700 1 -- 172.21.15.125:0/2668003124 wait complete. 2023-10-03T10:11:27.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.699+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a600724c0 con 0x7f2a60066410 2023-10-03T10:11:27.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.699+0000 7f2a477fe700 1 -- 172.21.15.125:0/3440380127 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a50032020 con 0x7f2a60066410 2023-10-03T10:11:27.699 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:27.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 msgr2=0x7f2a6012b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000b550 tx=0x7f2a5000b910 comp rx=0 tx=0).stop 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 shutdown_connections 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60131f30 0x7f2a6012c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a60066410 0x7f2a6012b640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 --2- 172.21.15.125:0/3440380127 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a601314b0 0x7f2a6012bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 >> 172.21.15.125:0/3440380127 conn(0x7f2a600a2980 msgr2=0x7f2a6006f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 shutdown_connections 2023-10-03T10:11:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:27.701+0000 7f2a65502700 1 -- 172.21.15.125:0/3440380127 wait complete. 2023-10-03T10:11:27.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:27.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:27.738 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.737+0000 7f345e715240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:11:27.920 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:27.920+0000 7f345e715240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:11:28.068 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:28.067+0000 7f345e715240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:11:28.138 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:28.137+0000 7f345e715240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:28.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:28.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.547+0000 7efe47cc3700 1 Processor -- start 2023-10-03T10:11:28.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.547+0000 7efe47cc3700 1 -- start start 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe47cc3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe47cc3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe40139200 0x7efe4013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe47cc3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4009e9d0 con 0x7efe400a0a70 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe47cc3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4009dc00 con 0x7efe40139200 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe47cc3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe4009dec0 con 0x7efe400a1550 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe40139200 0x7efe4013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe4525e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe4525e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54154/0 (socket says 172.21.15.125:54154) 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe40139200 0x7efe4013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34212/0 (socket says 172.21.15.125:34212) 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe4525e700 1 -- 172.21.15.125:0/1908119003 learned_addr learned my addr 172.21.15.125:0/1908119003 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe45a5f700 1 --1- 172.21.15.125:0/1908119003 >> v1:172.21.15.125:6789/0 conn(0x7efe400a0a70 0x7efe400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49420/0 (socket says 172.21.15.125:49420) 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 -- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 msgr2=0x7efe40138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 -- 172.21.15.125:0/1908119003 >> v1:172.21.15.125:6789/0 conn(0x7efe400a0a70 legacy=0x7efe400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 -- 172.21.15.125:0/1908119003 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4009e6a0 con 0x7efe40139200 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe44a5d700 1 -- 172.21.15.125:0/1908119003 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450267591 0 0) 0x7efe4009e9d0 con 0x7efe400a0a70 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe4525e700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe46260700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe40139200 0x7efe4013b5e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe38009d90 tx=0x7efe3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3848fcec1e869d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.548+0000 7efe44a5d700 1 -- 172.21.15.125:0/1908119003 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800e070 con 0x7efe40139200 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe44a5d700 1 -- 172.21.15.125:0/1908119003 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800bb20 con 0x7efe40139200 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe44a5d700 1 -- 172.21.15.125:0/1908119003 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38012430 con 0x7efe40139200 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 -- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe40139200 msgr2=0x7efe4013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe40139200 0x7efe4013b5e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe38009d90 tx=0x7efe3800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 -- 172.21.15.125:0/1908119003 shutdown_connections 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe40139200 0x7efe4013b5e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1908119003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe400a1550 0x7efe40138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.549+0000 7efe47cc3700 1 -- 172.21.15.125:0/1908119003 >> 172.21.15.125:0/1908119003 conn(0x7efe400a6610 msgr2=0x7efe400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.550+0000 7efe47cc3700 1 -- 172.21.15.125:0/1908119003 shutdown_connections 2023-10-03T10:11:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.550+0000 7efe47cc3700 1 -- 172.21.15.125:0/1908119003 wait complete. 2023-10-03T10:11:28.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.551+0000 7efe47cc3700 1 Processor -- start 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.551+0000 7efe47cc3700 1 -- start start 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe40139200 0x7efe40121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401222a0 con 0x7efe400a0a70 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401228c0 con 0x7efe400a1550 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe47cc3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe400a0450 con 0x7efe40139200 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe4525e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34222/0 (socket says 172.21.15.125:34222) 2023-10-03T10:11:28.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe4525e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53028/0 (socket says 172.21.15.125:53028) 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 -- 172.21.15.125:0/1057050198 learned_addr learned my addr 172.21.15.125:0/1057050198 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe46260700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe40139200 0x7efe40121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 -- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe40139200 msgr2=0x7efe40121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe40139200 0x7efe40121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 -- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 msgr2=0x7efe40120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 -- 172.21.15.125:0/1057050198 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009550 con 0x7efe400a0a70 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe4525e700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe45a5f700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00c550 tx=0x7efe3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.552+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c004c80 con 0x7efe400a0a70 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c004e00 con 0x7efe400a0a70 2023-10-03T10:11:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe38009a70 con 0x7efe400a0a70 2023-10-03T10:11:28.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c007310 con 0x7efe400a0a70 2023-10-03T10:11:28.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe40123ed0 con 0x7efe400a0a70 2023-10-03T10:11:28.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7efe3c007470 con 0x7efe400a0a70 2023-10-03T10:11:28.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.553+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7efe3c03f180 con 0x7efe400a0a70 2023-10-03T10:11:28.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.554+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4004f2a0 con 0x7efe400a0a70 2023-10-03T10:11:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.558+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7efe3c0123b0 con 0x7efe400a0a70 2023-10-03T10:11:28.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:28.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:28.715 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:28.738 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:28.737+0000 7f345e715240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:11:28.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.747+0000 7fd86cdcd700 1 Processor -- start 2023-10-03T10:11:28.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.747+0000 7fd86cdcd700 1 -- start start 2023-10-03T10:11:28.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.748+0000 7fd86cdcd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8681350d0 0x7fd86813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.748+0000 7fd86cdcd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.748+0000 7fd86cdcd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86809eca0 con 0x7fd86806a770 2023-10-03T10:11:28.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.748+0000 7fd86cdcd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86806b2e0 con 0x7fd8681350d0 2023-10-03T10:11:28.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.748+0000 7fd86cdcd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86809f720 con 0x7fd86813d210 2023-10-03T10:11:28.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53034/0 (socket says 172.21.15.125:53034) 2023-10-03T10:11:28.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 -- 172.21.15.125:0/661147634 learned_addr learned my addr 172.21.15.125:0/661147634 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd865d9b700 1 --2- 172.21.15.125:0/661147634 >> v2:172.21.15.125:3300/0 conn(0x7fd8681350d0 0x7fd86813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd86559a700 1 -- 172.21.15.125:0/661147634 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607285076 0 0) 0x7fd86809eca0 con 0x7fd86806a770 2023-10-03T10:11:28.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd86559a700 1 -- 172.21.15.125:0/661147634 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8500035b0 con 0x7fd86806a770 2023-10-03T10:11:28.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 -- 172.21.15.125:0/661147634 >> v2:172.21.15.125:3300/0 conn(0x7fd8681350d0 msgr2=0x7fd86813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 --2- 172.21.15.125:0/661147634 >> v2:172.21.15.125:3300/0 conn(0x7fd8681350d0 0x7fd86813ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 -- 172.21.15.125:0/661147634 >> v1:172.21.15.125:6789/0 conn(0x7fd86806a770 legacy=0x7fd8681349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 -- 172.21.15.125:0/661147634 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86806b480 con 0x7fd86813d210 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7fd866d9d700 1 --2- 172.21.15.125:0/661147634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd860009e80 tx=0x7fd86000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d68ea885062158 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86559a700 1 -- 172.21.15.125:0/661147634 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86000e070 con 0x7fd86813d210 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86559a700 1 -- 172.21.15.125:0/661147634 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86000b8d0 con 0x7fd86813d210 2023-10-03T10:11:28.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86559a700 1 -- 172.21.15.125:0/661147634 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86000bc80 con 0x7fd86813d210 2023-10-03T10:11:28.752 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:28.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 -- 172.21.15.125:0/661147634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 msgr2=0x7fd86813f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/661147634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd860009e80 tx=0x7fd86000b330 comp rx=0 tx=0).stop 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 -- 172.21.15.125:0/661147634 shutdown_connections 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/661147634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813f5f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/661147634 >> v2:172.21.15.125:3300/0 conn(0x7fd8681350d0 0x7fd86813ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7fd86cdcd700 1 -- 172.21.15.125:0/661147634 >> 172.21.15.125:0/661147634 conn(0x7fd868099c40 msgr2=0x7fd8680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.751+0000 7fd86cdcd700 1 -- 172.21.15.125:0/661147634 shutdown_connections 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.751+0000 7fd86cdcd700 1 -- 172.21.15.125:0/661147634 wait complete. 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.749+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe40122a90 con 0x7efe400a0a70 2023-10-03T10:11:28.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.750+0000 7efe367fc700 1 -- 172.21.15.125:0/1057050198 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe3c011360 con 0x7efe400a0a70 2023-10-03T10:11:28.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.752+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 msgr2=0x7efe40120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.752+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00c550 tx=0x7efe3c00c860 comp rx=0 tx=0).stop 2023-10-03T10:11:28.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.752+0000 7fd86cdcd700 1 Processor -- start 2023-10-03T10:11:28.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.752+0000 7fd86cdcd700 1 -- start start 2023-10-03T10:11:28.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 0x7fd86813ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8681350d0 0x7fd86813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86813c8e0 con 0x7fd8681350d0 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868139280 con 0x7fd86813d210 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86cdcd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd868072550 con 0x7fd86806a770 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 0x7fd86813ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53042/0 (socket says 172.21.15.125:53042) 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 -- 172.21.15.125:0/2543017317 learned_addr learned my addr 172.21.15.125:0/2543017317 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 -- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 msgr2=0x7fd86813ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 0x7fd86813ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 -- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8681350d0 msgr2=0x7fd86813b1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8681350d0 0x7fd86813b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 -- 172.21.15.125:0/2543017317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009b30 con 0x7fd86813d210 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd86659c700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 0x7fd86813ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd866d9d700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd86809f860 tx=0x7fd860004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600048b0 con 0x7fd86813d210 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600092e0 con 0x7fd86813d210 2023-10-03T10:11:28.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.753+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86001c630 con 0x7fd86813d210 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 shutdown_connections 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe40139200 0x7efe40121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe400a0a70 0x7efe40120690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 --2- 172.21.15.125:0/1057050198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe400a1550 0x7efe40120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 >> 172.21.15.125:0/1057050198 conn(0x7efe400a6610 msgr2=0x7efe400a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 shutdown_connections 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86809b0f0 con 0x7fd86813d210 2023-10-03T10:11:28.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86813a0f0 con 0x7fd86813d210 2023-10-03T10:11:28.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.754+0000 7efe47cc3700 1 -- 172.21.15.125:0/1057050198 wait complete. 2023-10-03T10:11:28.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.755+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86813a8d0 con 0x7fd86813d210 2023-10-03T10:11:28.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.755+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fd86001c790 con 0x7fd86813d210 2023-10-03T10:11:28.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.755+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fd860041190 con 0x7fd86813d210 2023-10-03T10:11:28.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.761+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd86001ca40 con 0x7fd86813d210 2023-10-03T10:11:28.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:28.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.840+0000 7f93cf1c1700 1 Processor -- start 2023-10-03T10:11:28.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.840+0000 7f93cf1c1700 1 -- start start 2023-10-03T10:11:28.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cf1c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cf1c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93c8131ec0 0x7f93c8139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cf1c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c809da80 con 0x7f93c806b080 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cf1c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c809dce0 con 0x7f93c8131ec0 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cf1c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c809eb20 con 0x7f93c806a770 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53052/0 (socket says 172.21.15.125:53052) 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2187803107 learned_addr learned my addr 172.21.15.125:0/2187803107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93cd75e700 1 --2- 172.21.15.125:0/2187803107 >> v2:172.21.15.125:3300/0 conn(0x7f93c8131ec0 0x7f93c8139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2187803107 >> v2:172.21.15.125:3300/0 conn(0x7f93c8131ec0 msgr2=0x7f93c8139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 --2- 172.21.15.125:0/2187803107 >> v2:172.21.15.125:3300/0 conn(0x7f93c8131ec0 0x7f93c8139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2187803107 >> v1:172.21.15.125:6789/0 conn(0x7f93c806b080 legacy=0x7f93c81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2187803107 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c809d860 con 0x7f93c806a770 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93c77fe700 1 -- 172.21.15.125:0/2187803107 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575716304 0 0) 0x7f93c809da80 con 0x7f93c806b080 2023-10-03T10:11:28.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.841+0000 7f93ccf5d700 1 --2- 172.21.15.125:0/2187803107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0098f0 tx=0x7f93bc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ee4cebaa407cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93c77fe700 1 -- 172.21.15.125:0/2187803107 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00b8a0 con 0x7f93c806a770 2023-10-03T10:11:28.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93c77fe700 1 -- 172.21.15.125:0/2187803107 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00ba00 con 0x7f93c806a770 2023-10-03T10:11:28.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93c77fe700 1 -- 172.21.15.125:0/2187803107 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00bd90 con 0x7f93c806a770 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2187803107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 msgr2=0x7f93c806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2187803107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0098f0 tx=0x7f93bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2187803107 shutdown_connections 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2187803107 >> v2:172.21.15.125:3300/0 conn(0x7f93c8131ec0 0x7f93c8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2187803107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c806ab40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2187803107 >> 172.21.15.125:0/2187803107 conn(0x7f93c8099c40 msgr2=0x7f93c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2187803107 shutdown_connections 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.842+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2187803107 wait complete. 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.844+0000 7f93cf1c1700 1 Processor -- start 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.844+0000 7f93cf1c1700 1 -- start start 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.844+0000 7f93cf1c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c806b080 0x7f93c812f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 0x7f93c811b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c811ebc0 con 0x7f93c8131ec0 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8071e10 con 0x7f93c806a770 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c811d360 con 0x7f93c806b080 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53068/0 (socket says 172.21.15.125:53068) 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2212762473 learned_addr learned my addr 172.21.15.125:0/2212762473 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cd75e700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 0x7f93c811b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c806b080 msgr2=0x7f93c812f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c806b080 0x7f93c812f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 msgr2=0x7f93c811b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 0x7f93c811b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 -- 172.21.15.125:0/2212762473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009550 con 0x7f93c806a770 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cd75e700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 0x7f93c811b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93ccf5d700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009c40 tx=0x7f93bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc004510 con 0x7f93c806a770 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc0036a0 con 0x7f93c806a770 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc003a50 con 0x7f93c806a770 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c811da40 con 0x7f93c806a770 2023-10-03T10:11:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.845+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c811f8f0 con 0x7f93c806a770 2023-10-03T10:11:28.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.846+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f93bc021070 con 0x7f93c806a770 2023-10-03T10:11:28.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.846+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f93bc0409e0 con 0x7f93c806a770 2023-10-03T10:11:28.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.847+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c804f2a0 con 0x7f93c806a770 2023-10-03T10:11:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.851+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f93bc029080 con 0x7f93c806a770 2023-10-03T10:11:28.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.878+0000 7fe827214700 1 Processor -- start 2023-10-03T10:11:28.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.878+0000 7fe827214700 1 -- start start 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe8200a1380 0x7fe820133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe820133f50 0x7fe8201343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82009e9d0 con 0x7fe820133f50 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82009dc00 con 0x7fe8200a0a70 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe827214700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe82009dec0 con 0x7fe8200a1380 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53076/0 (socket says 172.21.15.125:53076) 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 -- 172.21.15.125:0/3442278841 learned_addr learned my addr 172.21.15.125:0/3442278841 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe81ffff700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe8200a1380 0x7fe820133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 -- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe8200a1380 msgr2=0x7fe820133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe8200a1380 0x7fe820133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 -- 172.21.15.125:0/3442278841 >> v2:172.21.15.125:3300/0 conn(0x7fe820133f50 msgr2=0x7fe8201343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 --2- 172.21.15.125:0/3442278841 >> v2:172.21.15.125:3300/0 conn(0x7fe820133f50 0x7fe8201343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 -- 172.21.15.125:0/3442278841 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82009e6a0 con 0x7fe8200a0a70 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe824fb0700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8140098f0 tx=0x7fe814009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a469e225b6eec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.879+0000 7fe81f7fe700 1 -- 172.21.15.125:0/3442278841 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400b8a0 con 0x7fe8200a0a70 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe81f7fe700 1 -- 172.21.15.125:0/3442278841 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400ba00 con 0x7fe8200a0a70 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe81f7fe700 1 -- 172.21.15.125:0/3442278841 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400bd90 con 0x7fe8200a0a70 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 -- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 msgr2=0x7fe8200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8140098f0 tx=0x7fe814009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:28.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 -- 172.21.15.125:0/3442278841 shutdown_connections 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a0a70 0x7fe8200a0e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 --2- 172.21.15.125:0/3442278841 >> v2:172.21.15.125:3300/0 conn(0x7fe820133f50 0x7fe8201343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 --2- 172.21.15.125:0/3442278841 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe8200a1380 0x7fe820133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 -- 172.21.15.125:0/3442278841 >> 172.21.15.125:0/3442278841 conn(0x7fe8200a6610 msgr2=0x7fe8200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 -- 172.21.15.125:0/3442278841 shutdown_connections 2023-10-03T10:11:28.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.880+0000 7fe827214700 1 -- 172.21.15.125:0/3442278841 wait complete. 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.881+0000 7fe827214700 1 Processor -- start 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.881+0000 7fe827214700 1 -- start start 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8200a0a70 0x7fe820121510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe820133f50 0x7fe820121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe820123f90 con 0x7fe8200a0a70 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe820132850 con 0x7fe8200a1380 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe827214700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200a03e0 con 0x7fe820133f50 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53084/0 (socket says 172.21.15.125:53084) 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 -- 172.21.15.125:0/3065086265 learned_addr learned my addr 172.21.15.125:0/3065086265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe824fb0700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8200a0a70 0x7fe820121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe8257b1700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe820133f50 0x7fe820121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 -- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe820133f50 msgr2=0x7fe820121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe820133f50 0x7fe820121f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 -- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8200a0a70 msgr2=0x7fe820121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8200a0a70 0x7fe820121510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 -- 172.21.15.125:0/3065086265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009550 con 0x7fe8200a1380 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.882+0000 7fe81ffff700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00e7e0 tx=0x7fe80c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.883+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00c070 con 0x7fe8200a1380 2023-10-03T10:11:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.883+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c013610 con 0x7fe8200a1380 2023-10-03T10:11:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.883+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe820122900 con 0x7fe8200a1380 2023-10-03T10:11:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.883+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c013980 con 0x7fe8200a1380 2023-10-03T10:11:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.883+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe820124a00 con 0x7fe8200a1380 2023-10-03T10:11:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.884+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8201242e0 con 0x7fe8200a1380 2023-10-03T10:11:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.887+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fe80c013ae0 con 0x7fe8200a1380 2023-10-03T10:11:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.888+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fe80c03f970 con 0x7fe8200a1380 2023-10-03T10:11:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:28.889+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe80c024940 con 0x7fe8200a1380 2023-10-03T10:11:28.929 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:28.929+0000 7f345e715240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:11:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.015+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd86804f2a0 con 0x7fd86813d210 2023-10-03T10:11:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.015+0000 7fd856ffd700 1 -- 172.21.15.125:0/2543017317 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd860033090 con 0x7fd86813d210 2023-10-03T10:11:29.016 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 msgr2=0x7fd86813b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd86809f860 tx=0x7fd860004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 shutdown_connections 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd86813d210 0x7fd86813b6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd86806a770 0x7fd86813ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 --2- 172.21.15.125:0/2543017317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8681350d0 0x7fd86813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 >> 172.21.15.125:0/2543017317 conn(0x7fd868099c40 msgr2=0x7fd86809c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 shutdown_connections 2023-10-03T10:11:29.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.018+0000 7fd86cdcd700 1 -- 172.21.15.125:0/2543017317 wait complete. 2023-10-03T10:11:29.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.033+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93c809d300 con 0x7f93c806a770 2023-10-03T10:11:29.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:29.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.034+0000 7f93c57fa700 1 -- 172.21.15.125:0/2212762473 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93bc015020 con 0x7f93c806a770 2023-10-03T10:11:29.035 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 msgr2=0x7f93c812f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009c40 tx=0x7f93bc004750 comp rx=0 tx=0).stop 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 shutdown_connections 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c8131ec0 0x7f93c811b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c806a770 0x7f93c812f440 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 --2- 172.21.15.125:0/2212762473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c806b080 0x7f93c812f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 >> 172.21.15.125:0/2212762473 conn(0x7f93c8099c40 msgr2=0x7f93c81b9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 shutdown_connections 2023-10-03T10:11:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.036+0000 7f93cf1c1700 1 -- 172.21.15.125:0/2212762473 wait complete. 2023-10-03T10:11:29.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:29.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.060+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8201247f0 con 0x7fe8200a1380 2023-10-03T10:11:29.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.061+0000 7fe81d7fa700 1 -- 172.21.15.125:0/3065086265 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe80c02a070 con 0x7fe8200a1380 2023-10-03T10:11:29.061 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:29.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 msgr2=0x7fe820121a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00e7e0 tx=0x7fe80c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 shutdown_connections 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe820133f50 0x7fe820121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8200a0a70 0x7fe820121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 --2- 172.21.15.125:0/3065086265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8200a1380 0x7fe820121a50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 >> 172.21.15.125:0/3065086265 conn(0x7fe8200a6610 msgr2=0x7fe820133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 shutdown_connections 2023-10-03T10:11:29.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.063+0000 7fe827214700 1 -- 172.21.15.125:0/3065086265 wait complete. 2023-10-03T10:11:29.064 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:29.063+0000 7f345e715240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:29.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:29.596 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:29.595+0000 7f345e715240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:11:29.712 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:29.711+0000 7f345e715240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:29.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:29.864 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:29.864+0000 7f345e715240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:11:29.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 Processor -- start 2023-10-03T10:11:29.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 -- start start 2023-10-03T10:11:29.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd0c09f180 0x7efd0c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c09c970 con 0x7efd0c131d70 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0a0920 con 0x7efd0c09f180 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.897+0000 7efd1181e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c09f9c0 con 0x7efd0c09e870 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53100/0 (socket says 172.21.15.125:53100) 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 -- 172.21.15.125:0/1792389241 learned_addr learned my addr 172.21.15.125:0/1792389241 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0a7fc700 1 --2- 172.21.15.125:0/1792389241 >> v2:172.21.15.125:3300/0 conn(0x7efd0c09f180 0x7efd0c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 -- 172.21.15.125:0/1792389241 >> v2:172.21.15.125:3300/0 conn(0x7efd0c09f180 msgr2=0x7efd0c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 --2- 172.21.15.125:0/1792389241 >> v2:172.21.15.125:3300/0 conn(0x7efd0c09f180 0x7efd0c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 -- 172.21.15.125:0/1792389241 >> v1:172.21.15.125:6789/0 conn(0x7efd0c131d70 legacy=0x7efd0c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 -- 172.21.15.125:0/1792389241 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c09bab0 con 0x7efd0c09e870 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd0affd700 1 --2- 172.21.15.125:0/1792389241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098f0 tx=0x7efcfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd7257dcc63c684 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd09ffb700 1 -- 172.21.15.125:0/1792389241 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc011830 con 0x7efd0c09e870 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd09ffb700 1 -- 172.21.15.125:0/1792389241 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc011990 con 0x7efd0c09e870 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.898+0000 7efd09ffb700 1 -- 172.21.15.125:0/1792389241 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc011d20 con 0x7efd0c09e870 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 -- 172.21.15.125:0/1792389241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 msgr2=0x7efd0c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 --2- 172.21.15.125:0/1792389241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098f0 tx=0x7efcfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 -- 172.21.15.125:0/1792389241 shutdown_connections 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 --2- 172.21.15.125:0/1792389241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09e870 0x7efd0c09ec40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 --2- 172.21.15.125:0/1792389241 >> v2:172.21.15.125:3300/0 conn(0x7efd0c09f180 0x7efd0c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 -- 172.21.15.125:0/1792389241 >> 172.21.15.125:0/1792389241 conn(0x7efd0c0a4430 msgr2=0x7efd0c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 -- 172.21.15.125:0/1792389241 shutdown_connections 2023-10-03T10:11:29.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.899+0000 7efd1181e700 1 -- 172.21.15.125:0/1792389241 wait complete. 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.900+0000 7efd1181e700 1 Processor -- start 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.900+0000 7efd1181e700 1 -- start start 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 0x7efd0c1203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 0x7efd0c120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:29.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c121800 con 0x7efd0c131d70 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c09dba0 con 0x7efd0c09f180 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd1181e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a2d10 con 0x7efd0c09e870 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53106/0 (socket says 172.21.15.125:53106) 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 0x7efd0c1203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 -- 172.21.15.125:0/1311331314 learned_addr learned my addr 172.21.15.125:0/1311331314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0b7fe700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 0x7efd0c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 -- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 msgr2=0x7efd0c1203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 0x7efd0c1203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 -- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 msgr2=0x7efd0c120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 0x7efd0c120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0a7fc700 1 -- 172.21.15.125:0/1311331314 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc009550 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0b7fe700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 0x7efd0c120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.901+0000 7efd0affd700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 0x7efd0c1203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efd0a7fc700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e980 tx=0x7efd0000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00009710 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000c690 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c122810 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000ca20 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c122000 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.902+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7efd0000cb80 con 0x7efd0c09f180 2023-10-03T10:11:29.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.903+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7efd0003f990 con 0x7efd0c09f180 2023-10-03T10:11:29.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.903+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c132820 con 0x7efd0c09f180 2023-10-03T10:11:29.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.907+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7efd00017080 con 0x7efd0c09f180 2023-10-03T10:11:29.969 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:29.969+0000 7f345e715240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:29.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:29.988+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7efd00013990 con 0x7efd0c09f180 2023-10-03T10:11:30.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:30.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.041+0000 7f33de6c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.041+0000 7f33de6c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.041+0000 7f33de6c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.041+0000 7f33de6c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.042 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.041+0000 7f33de6c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.050 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:30.050 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.050+0000 7f33db6bb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.051 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.050+0000 7f33db6bb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.051 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.050+0000 7f33db6bb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.051 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.050+0000 7f33db6bb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.051 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.050+0000 7f33db6bb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:30.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:30.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.120+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd0c04f2a0 con 0x7efd0c09f180 2023-10-03T10:11:30.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.121+0000 7efcf3fff700 1 -- 172.21.15.125:0/1311331314 <== mon.1 v2:172.21.15.125:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd00011350 con 0x7efd0c09f180 2023-10-03T10:11:30.122 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:30.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.123+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 msgr2=0x7efd0c1208e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.123+0000 7efd1181e700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e980 tx=0x7efd0000ec90 comp rx=0 tx=0).stop 2023-10-03T10:11:30.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 shutdown_connections 2023-10-03T10:11:30.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd0c131d70 0x7efd0c120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd0c09e870 0x7efd0c1203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 --2- 172.21.15.125:0/1311331314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd0c09f180 0x7efd0c1208e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 >> 172.21.15.125:0/1311331314 conn(0x7efd0c0a4430 msgr2=0x7efd0c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 shutdown_connections 2023-10-03T10:11:30.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.124+0000 7efd1181e700 1 -- 172.21.15.125:0/1311331314 wait complete. 2023-10-03T10:11:30.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:30.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.172+0000 7fe0552fb700 1 Processor -- start 2023-10-03T10:11:30.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.172+0000 7fe0552fb700 1 -- start start 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe0552fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe05009dec0 0x7fe05006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe0552fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 0x7fe050139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe0552fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05006e900 con 0x7fe05006a770 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe0552fb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05009d180 con 0x7fe05009dec0 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe0552fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe05009e780 con 0x7fe050136cb0 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe04effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe05006a770 0x7fe05006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49470/0 (socket says 172.21.15.125:49470) 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe04effd700 1 -- 172.21.15.125:0/1505450621 learned_addr learned my addr 172.21.15.125:0/1505450621 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe04e7fc700 1 --2- 172.21.15.125:0/1505450621 >> v2:172.21.15.125:3300/0 conn(0x7fe05009dec0 0x7fe05006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.173+0000 7fe04f7fe700 1 --2- 172.21.15.125:0/1505450621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 0x7fe050139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04f7fe700 1 -- 172.21.15.125:0/1505450621 >> v2:172.21.15.125:3300/0 conn(0x7fe05009dec0 msgr2=0x7fe05006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04f7fe700 1 --2- 172.21.15.125:0/1505450621 >> v2:172.21.15.125:3300/0 conn(0x7fe05009dec0 0x7fe05006b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04f7fe700 1 -- 172.21.15.125:0/1505450621 >> v1:172.21.15.125:6789/0 conn(0x7fe05006a770 legacy=0x7fe05006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04f7fe700 1 -- 172.21.15.125:0/1505450621 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05009d3c0 con 0x7fe050136cb0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04dffb700 1 -- 172.21.15.125:0/1505450621 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533253245 0 0) 0x7fe05006e900 con 0x7fe05006a770 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04f7fe700 1 --2- 172.21.15.125:0/1505450621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 0x7fe050139090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe048009d90 tx=0x7fe04800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca490be5da4a7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04dffb700 1 -- 172.21.15.125:0/1505450621 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800e070 con 0x7fe050136cb0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04dffb700 1 -- 172.21.15.125:0/1505450621 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800bb20 con 0x7fe050136cb0 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.174+0000 7fe04dffb700 1 -- 172.21.15.125:0/1505450621 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048012430 con 0x7fe050136cb0 2023-10-03T10:11:30.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 -- 172.21.15.125:0/1505450621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 msgr2=0x7fe050139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 --2- 172.21.15.125:0/1505450621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 0x7fe050139090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe048009d90 tx=0x7fe04800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:30.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 -- 172.21.15.125:0/1505450621 shutdown_connections 2023-10-03T10:11:30.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 --2- 172.21.15.125:0/1505450621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe050136cb0 0x7fe050139090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 --2- 172.21.15.125:0/1505450621 >> v2:172.21.15.125:3300/0 conn(0x7fe05009dec0 0x7fe05006b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 -- 172.21.15.125:0/1505450621 >> 172.21.15.125:0/1505450621 conn(0x7fe050099c40 msgr2=0x7fe0500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 -- 172.21.15.125:0/1505450621 shutdown_connections 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.175+0000 7fe0552fb700 1 -- 172.21.15.125:0/1505450621 wait complete. 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.176+0000 7fe0552fb700 1 Processor -- start 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.176+0000 7fe0552fb700 1 -- start start 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05006a770 0x7fe050134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe050136cb0 0x7fe050134c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050139290 con 0x7fe05006a770 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe050135e20 con 0x7fe050136cb0 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe0552fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe050119750 con 0x7fe05009dec0 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54344/0 (socket says 172.21.15.125:54344) 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 -- 172.21.15.125:0/4189618943 learned_addr learned my addr 172.21.15.125:0/4189618943 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04effd700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05006a770 0x7fe050134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04f7fe700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe050136cb0 0x7fe050134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 -- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe050136cb0 msgr2=0x7fe050134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe050136cb0 0x7fe050134c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 -- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05006a770 msgr2=0x7fe050134210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05006a770 0x7fe050134210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.177+0000 7fe04e7fc700 1 -- 172.21.15.125:0/4189618943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048009a70 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe04e7fc700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e9e0 tx=0x7fe04400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044009710 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400ee80 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05011a710 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400ca50 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.178+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe050136810 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.179+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05004f2a0 con 0x7fe05009dec0 2023-10-03T10:11:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.179+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fe04400cbb0 con 0x7fe05009dec0 2023-10-03T10:11:30.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.179+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fe044047350 con 0x7fe05009dec0 2023-10-03T10:11:30.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.183+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe044044060 con 0x7fe05009dec0 2023-10-03T10:11:30.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.185+0000 7f54920be700 1 Processor -- start 2023-10-03T10:11:30.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.185+0000 7f54920be700 1 -- start start 2023-10-03T10:11:30.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f54920be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c1319f0 0x7f548c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f54920be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f548c09c7b0 0x7f548c139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f54920be700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0a2590 con 0x7f548c09bc70 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f54920be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c06eaa0 con 0x7f548c09c7b0 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f54920be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1315c0 con 0x7f548c1319f0 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f548c09c7b0 0x7f548c139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f548c09bc70 0x7f548c09c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49482/0 (socket says 172.21.15.125:49482) 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548affd700 1 -- 172.21.15.125:0/1640255963 learned_addr learned my addr 172.21.15.125:0/1640255963 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548b7fe700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c1319f0 0x7f548c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548bfff700 1 -- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c1319f0 msgr2=0x7f548c131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548bfff700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c1319f0 0x7f548c131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548bfff700 1 -- 172.21.15.125:0/1640255963 >> v1:172.21.15.125:6789/0 conn(0x7f548c09bc70 legacy=0x7f548c09c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548bfff700 1 -- 172.21.15.125:0/1640255963 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0a1640 con 0x7f548c09c7b0 2023-10-03T10:11:30.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.186+0000 7f548a7fc700 1 -- 172.21.15.125:0/1640255963 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116002221 0 0) 0x7f548c0a2590 con 0x7f548c09bc70 2023-10-03T10:11:30.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f548bfff700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09c7b0 0x7f548c139780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5484009d90 tx=0x7f548400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb57a95fe3408c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f548a7fc700 1 -- 172.21.15.125:0/1640255963 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e070 con 0x7f548c09c7b0 2023-10-03T10:11:30.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f548a7fc700 1 -- 172.21.15.125:0/1640255963 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400bb20 con 0x7f548c09c7b0 2023-10-03T10:11:30.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f548a7fc700 1 -- 172.21.15.125:0/1640255963 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484012430 con 0x7f548c09c7b0 2023-10-03T10:11:30.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 -- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09c7b0 msgr2=0x7f548c139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09c7b0 0x7f548c139780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5484009d90 tx=0x7f548400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 -- 172.21.15.125:0/1640255963 shutdown_connections 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09c7b0 0x7f548c139780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 --2- 172.21.15.125:0/1640255963 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c1319f0 0x7f548c131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 -- 172.21.15.125:0/1640255963 >> 172.21.15.125:0/1640255963 conn(0x7f548c0a2980 msgr2=0x7f548c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.187+0000 7f54920be700 1 -- 172.21.15.125:0/1640255963 shutdown_connections 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.188+0000 7f54920be700 1 -- 172.21.15.125:0/1640255963 wait complete. 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.188+0000 7f54920be700 1 Processor -- start 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 -- start start 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 0x7f548c1c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 0x7f548c1c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c12e240 con 0x7f548c09bc70 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c12deb0 con 0x7f548c1319f0 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f54920be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f548c12c320 con 0x7f548c09c7b0 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 0x7f548c1c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34398/0 (socket says 172.21.15.125:34398) 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 0x7f548c1c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54374/0 (socket says 172.21.15.125:54374) 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548b7fe700 1 -- 172.21.15.125:0/1774820064 learned_addr learned my addr 172.21.15.125:0/1774820064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 0x7f548c1c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 -- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 msgr2=0x7f548c1c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 0x7f548c1c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 -- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 msgr2=0x7f548c1c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548bfff700 1 -- 172.21.15.125:0/1774820064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009a70 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.189+0000 7f548b7fe700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f548bfff700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 0x7f548c1c8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5484016000 tx=0x7f5484004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484012430 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484020070 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484004280 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c12d0f0 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.190+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c12e840 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.191+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f54840043e0 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.191+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c13aa40 con 0x7f548c1319f0 2023-10-03T10:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.191+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f5484022070 con 0x7f548c1319f0 2023-10-03T10:11:30.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.199+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f54840269d0 con 0x7f548c1319f0 2023-10-03T10:11:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.227+0000 7fb725da4700 1 Processor -- start 2023-10-03T10:11:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 -- start start 2023-10-03T10:11:30.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb720136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 0x7fb7201393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72009b6d0 con 0x7fb72009e950 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72009afb0 con 0x7fb720137010 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb725da4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200a0970 con 0x7fb72009f430 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb71ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 0x7fb7201393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb71f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb72009e950 0x7fb72009ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49496/0 (socket says 172.21.15.125:49496) 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb71f7fe700 1 -- 172.21.15.125:0/187827761 learned_addr learned my addr 172.21.15.125:0/187827761 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.228+0000 7fb71effd700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb720136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71e7fc700 1 -- 172.21.15.125:0/187827761 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578838312 0 0) 0x7fb72009b6d0 con 0x7fb72009e950 2023-10-03T10:11:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71effd700 1 -- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 msgr2=0x7fb7201393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:30.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71effd700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 0x7fb7201393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71effd700 1 -- 172.21.15.125:0/187827761 >> v1:172.21.15.125:6789/0 conn(0x7fb72009e950 legacy=0x7fb72009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71effd700 1 -- 172.21.15.125:0/187827761 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200a0320 con 0x7fb72009f430 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71ffff700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 0x7fb7201393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71effd700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb720136ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7140098a0 tx=0x7fb714009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1682b35ce390c8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71e7fc700 1 -- 172.21.15.125:0/187827761 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714011830 con 0x7fb72009f430 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71e7fc700 1 -- 172.21.15.125:0/187827761 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714011990 con 0x7fb72009f430 2023-10-03T10:11:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.229+0000 7fb71e7fc700 1 -- 172.21.15.125:0/187827761 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714011d20 con 0x7fb72009f430 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 -- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 msgr2=0x7fb720136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb720136ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7140098a0 tx=0x7fb714009bb0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 -- 172.21.15.125:0/187827761 shutdown_connections 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb720137010 0x7fb7201393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 --2- 172.21.15.125:0/187827761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb720136ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 -- 172.21.15.125:0/187827761 >> 172.21.15.125:0/187827761 conn(0x7fb7200a0f70 msgr2=0x7fb7200a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 -- 172.21.15.125:0/187827761 shutdown_connections 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.230+0000 7fb725da4700 1 -- 172.21.15.125:0/187827761 wait complete. 2023-10-03T10:11:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 Processor -- start 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 -- start start 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb72011cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 0x7fb72011d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72011ff40 con 0x7fb720137010 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72009da40 con 0x7fb72009e950 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb725da4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb72011e420 con 0x7fb72009f430 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb71f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb71f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53260/0 (socket says 172.21.15.125:53260) 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb71f7fe700 1 -- 172.21.15.125:0/2912773923 learned_addr learned my addr 172.21.15.125:0/2912773923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb71ffff700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 0x7fb72011d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.231+0000 7fb71effd700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb72011cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:30.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 -- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 msgr2=0x7fb72011cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb72011cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 -- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 msgr2=0x7fb72011d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 0x7fb72011d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 -- 172.21.15.125:0/2912773923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009a70 con 0x7fb72009e950 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71effd700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb72011cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71ffff700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 0x7fb72011d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb71f7fe700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c6d0 tx=0x7fb71000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100074e0 con 0x7fb72009e950 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710007640 con 0x7fb72009e950 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140094a0 con 0x7fb72009e950 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710005a70 con 0x7fb72009e950 2023-10-03T10:11:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.232+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7201209b0 con 0x7fb72009e950 2023-10-03T10:11:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.233+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fb710005bd0 con 0x7fb72009e950 2023-10-03T10:11:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.233+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fb71003e9d0 con 0x7fb72009e950 2023-10-03T10:11:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.234+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72011fbe0 con 0x7fb72009e950 2023-10-03T10:11:30.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.242+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb710018260 con 0x7fb72009e950 2023-10-03T10:11:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.367+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe05009e380 con 0x7fe05009dec0 2023-10-03T10:11:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.367+0000 7fe0377fe700 1 -- 172.21.15.125:0/4189618943 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe04403de60 con 0x7fe05009dec0 2023-10-03T10:11:30.368 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 msgr2=0x7fe050134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e9e0 tx=0x7fe04400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 shutdown_connections 2023-10-03T10:11:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe050136cb0 0x7fe050134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05006a770 0x7fe050134210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 --2- 172.21.15.125:0/4189618943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe05009dec0 0x7fe050134750 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.369+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 >> 172.21.15.125:0/4189618943 conn(0x7fe050099c40 msgr2=0x7fe0500a2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.370+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 shutdown_connections 2023-10-03T10:11:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.370+0000 7fe0552fb700 1 -- 172.21.15.125:0/4189618943 wait complete. 2023-10-03T10:11:30.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.378+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f548c12d0f0 con 0x7f548c1319f0 2023-10-03T10:11:30.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.379+0000 7f5473fff700 1 -- 172.21.15.125:0/1774820064 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f548c12d0f0 con 0x7f548c1319f0 2023-10-03T10:11:30.379 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:30.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 msgr2=0x7f548c1c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 0x7f548c1c8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5484016000 tx=0x7f5484004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 shutdown_connections 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f548c1319f0 0x7f548c1c8a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f548c09bc70 0x7f548c1c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 --2- 172.21.15.125:0/1774820064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f548c09c7b0 0x7f548c1c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 >> 172.21.15.125:0/1774820064 conn(0x7f548c0a2980 msgr2=0x7f548c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 shutdown_connections 2023-10-03T10:11:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.381+0000 7f54920be700 1 -- 172.21.15.125:0/1774820064 wait complete. 2023-10-03T10:11:30.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:30.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:30.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.418+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb72004f2a0 con 0x7fb72009e950 2023-10-03T10:11:30.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.418+0000 7fb707fff700 1 -- 172.21.15.125:0/2912773923 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb710017020 con 0x7fb72009e950 2023-10-03T10:11:30.419 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:30.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 msgr2=0x7fb72011c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c6d0 tx=0x7fb71000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 shutdown_connections 2023-10-03T10:11:30.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720137010 0x7fb72011d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb72009e950 0x7fb72011c700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 --2- 172.21.15.125:0/2912773923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb72009f430 0x7fb72011cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:30.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.420+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 >> 172.21.15.125:0/2912773923 conn(0x7fb7200a0f70 msgr2=0x7fb720134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.421+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 shutdown_connections 2023-10-03T10:11:30.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:30.421+0000 7fb725da4700 1 -- 172.21.15.125:0/2912773923 wait complete. 2023-10-03T10:11:30.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:30.996 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.996+0000 7f341fbd7700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-03T10:11:30.997 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.997+0000 7f341fbd7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:11:30.998 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-10-03T10:11:30.998+0000 7f341fbd7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:11:31.138 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:31.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.263+0000 7f475cb24700 1 Processor -- start 2023-10-03T10:11:31.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.263+0000 7f475cb24700 1 -- start start 2023-10-03T10:11:31.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 0x7f4758133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 0x7f4758134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580a0370 con 0x7f475809f180 2023-10-03T10:11:31.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475809fa00 con 0x7f475809e870 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475cb24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475809ada0 con 0x7f4758134160 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f4755d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 0x7f4758133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53272/0 (socket says 172.21.15.125:53272) 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 -- 172.21.15.125:0/220525351 learned_addr learned my addr 172.21.15.125:0/220525351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f4756d9d700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 0x7f4758134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 -- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 msgr2=0x7f4758134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 0x7f4758134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 -- 172.21.15.125:0/220525351 >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 msgr2=0x7f4758133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 --2- 172.21.15.125:0/220525351 >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 0x7f4758133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f475659c700 1 -- 172.21.15.125:0/220525351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475806bec0 con 0x7f475809e870 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.264+0000 7f4756d9d700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 0x7f4758134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f4755d9b700 1 --2- 172.21.15.125:0/220525351 >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 0x7f4758133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475659c700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f474c0098f0 tx=0x7f474c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=591cf3b59315b4f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475559a700 1 -- 172.21.15.125:0/220525351 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011830 con 0x7f475809e870 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475559a700 1 -- 172.21.15.125:0/220525351 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c011990 con 0x7f475809e870 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475559a700 1 -- 172.21.15.125:0/220525351 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011d20 con 0x7f475809e870 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 -- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 msgr2=0x7f475809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f474c0098f0 tx=0x7f474c009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 -- 172.21.15.125:0/220525351 shutdown_connections 2023-10-03T10:11:31.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f475809ec40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 --2- 172.21.15.125:0/220525351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4758134160 0x7f4758134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 --2- 172.21.15.125:0/220525351 >> v2:172.21.15.125:3300/0 conn(0x7f475809f180 0x7f4758133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 -- 172.21.15.125:0/220525351 >> 172.21.15.125:0/220525351 conn(0x7f47580a4430 msgr2=0x7f47580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 -- 172.21.15.125:0/220525351 shutdown_connections 2023-10-03T10:11:31.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.265+0000 7f475cb24700 1 -- 172.21.15.125:0/220525351 wait complete. 2023-10-03T10:11:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.266+0000 7f475cb24700 1 Processor -- start 2023-10-03T10:11:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 -- start start 2023-10-03T10:11:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 0x7f4758122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 0x7f4758122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47581240c0 con 0x7f4758134160 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4758123960 con 0x7f475809e870 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475cb24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4758124f50 con 0x7f475809f180 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f4755d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 0x7f4758122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f4756d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 0x7f4758122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53286/0 (socket says 172.21.15.125:53286) 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 -- 172.21.15.125:0/226870616 learned_addr learned my addr 172.21.15.125:0/226870616 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f4755d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 0x7f4758122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54400/0 (socket says 172.21.15.125:54400) 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f4756d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 0x7f4758122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34424/0 (socket says 172.21.15.125:34424) 2023-10-03T10:11:31.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 -- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 msgr2=0x7f4758122a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 0x7f4758122a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 -- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 msgr2=0x7f4758122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 0x7f4758122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 -- 172.21.15.125:0/226870616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480094a0 con 0x7f475809e870 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.267+0000 7f475659c700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f474c009130 tx=0x7f474c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c004450 con 0x7f475809e870 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c01e070 con 0x7f475809e870 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4750009a70 con 0x7f475809e870 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0038e0 con 0x7f475809e870 2023-10-03T10:11:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c009550 con 0x7f475809e870 2023-10-03T10:11:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f474c003a40 con 0x7f475809e870 2023-10-03T10:11:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.268+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f474c0404c0 con 0x7f475809e870 2023-10-03T10:11:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.269+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47580a3c70 con 0x7f475809e870 2023-10-03T10:11:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.273+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f474c015080 con 0x7f475809e870 2023-10-03T10:11:31.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:31.396 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:31.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:31.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.465+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f475806cfa0 con 0x7f475809e870 2023-10-03T10:11:31.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.465+0000 7f4746ffd700 1 -- 172.21.15.125:0/226870616 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f474c003cf0 con 0x7f475809e870 2023-10-03T10:11:31.466 INFO:teuthology.orchestra.run.smithi125.stdout:38654705693 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 >> v1:172.21.15.125:6816/126957 conn(0x7f473802f270 legacy=0x7f4738031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 msgr2=0x7f4758122500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f474c009130 tx=0x7f474c004750 comp rx=0 tx=0).stop 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 shutdown_connections 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4758134160 0x7f4758122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475809e870 0x7f4758122500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 --2- 172.21.15.125:0/226870616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f475809f180 0x7f4758122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 >> 172.21.15.125:0/226870616 conn(0x7f47580a4430 msgr2=0x7f47580709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 shutdown_connections 2023-10-03T10:11:31.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.468+0000 7f475cb24700 1 -- 172.21.15.125:0/226870616 wait complete. 2023-10-03T10:11:31.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:11:31.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.510+0000 7f34aefbb700 1 Processor -- start 2023-10-03T10:11:31.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.510+0000 7f34aefbb700 1 -- start start 2023-10-03T10:11:31.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.510+0000 7f34aefbb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 0x7f34a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.510+0000 7f34aefbb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34aefbb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a806b5c0 con 0x7f34a8131a00 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34aefbb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a806e900 con 0x7f34a806a770 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34aefbb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a809d180 con 0x7f34a809dec0 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53296/0 (socket says 172.21.15.125:53296) 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 -- 172.21.15.125:0/3931743029 learned_addr learned my addr 172.21.15.125:0/3931743029 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34ad558700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f34a8131a00 0x7f34a8131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49500/0 (socket says 172.21.15.125:49500) 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34acd57700 1 --2- 172.21.15.125:0/3931743029 >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 0x7f34a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 -- 172.21.15.125:0/3931743029 >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 msgr2=0x7f34a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 --2- 172.21.15.125:0/3931743029 >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 0x7f34a806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 -- 172.21.15.125:0/3931743029 >> v1:172.21.15.125:6789/0 conn(0x7f34a8131a00 legacy=0x7f34a8131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 -- 172.21.15.125:0/3931743029 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a809e780 con 0x7f34a809dec0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34acd57700 1 --2- 172.21.15.125:0/3931743029 >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 0x7f34a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a7fff700 1 --2- 172.21.15.125:0/3931743029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34940098f0 tx=0x7f3494009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71e3eed28f5264d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a77fe700 1 -- 172.21.15.125:0/3931743029 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011830 con 0x7f34a809dec0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a77fe700 1 -- 172.21.15.125:0/3931743029 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494011990 con 0x7f34a809dec0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.511+0000 7f34a77fe700 1 -- 172.21.15.125:0/3931743029 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011d20 con 0x7f34a809dec0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 -- 172.21.15.125:0/3931743029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 msgr2=0x7f34a806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 --2- 172.21.15.125:0/3931743029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34940098f0 tx=0x7f3494009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 -- 172.21.15.125:0/3931743029 shutdown_connections 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 --2- 172.21.15.125:0/3931743029 >> v2:172.21.15.125:3300/0 conn(0x7f34a806a770 0x7f34a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 --2- 172.21.15.125:0/3931743029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a809dec0 0x7f34a806b080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 -- 172.21.15.125:0/3931743029 >> 172.21.15.125:0/3931743029 conn(0x7f34a8099c40 msgr2=0x7f34a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 -- 172.21.15.125:0/3931743029 shutdown_connections 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.512+0000 7f34aefbb700 1 -- 172.21.15.125:0/3931743029 wait complete. 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.513+0000 7f34aefbb700 1 Processor -- start 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.513+0000 7f34aefbb700 1 -- start start 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 0x7f34a811c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 0x7f34a811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a811f6b0 con 0x7f34a806a770 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a811db90 con 0x7f34a8131a00 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34aefbb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8130df0 con 0x7f34a809dec0 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34acd57700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 0x7f34a811c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34acd57700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34430/0 (socket says 172.21.15.125:34430) 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34acd57700 1 -- 172.21.15.125:0/4040578623 learned_addr learned my addr 172.21.15.125:0/4040578623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.514+0000 7f34ad558700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 0x7f34a811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 -- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 msgr2=0x7f34a811c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 0x7f34a811c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 -- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 msgr2=0x7f34a811bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 -- 172.21.15.125:0/4040578623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094a0 con 0x7f34a809dec0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34ad558700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 0x7f34a811c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34acd57700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a7fff700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 0x7f34a811c400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3494016000 tx=0x7f3494004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940036a0 con 0x7f34a809dec0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494003800 con 0x7f34a809dec0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494009550 con 0x7f34a809dec0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494003b90 con 0x7f34a809dec0 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.515+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a811ecd0 con 0x7f34a809dec0 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.516+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f3494021070 con 0x7f34a809dec0 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.516+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a804f2a0 con 0x7f34a809dec0 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.516+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f3494040a90 con 0x7f34a809dec0 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.525+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3494029020 con 0x7f34a809dec0 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.555+0000 7f61e75f7700 1 Processor -- start 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 -- start start 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e009fa00 con 0x7f61e009e870 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00a0370 con 0x7f61e01393a0 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e75f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61e006bec0 con 0x7f61e009f350 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e4b92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e5393700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f61e009e870 0x7f61e009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49504/0 (socket says 172.21.15.125:49504) 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e5393700 1 -- 172.21.15.125:0/217324627 learned_addr learned my addr 172.21.15.125:0/217324627 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e4b92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54428/0 (socket says 172.21.15.125:54428) 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e5b94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e4b92700 1 -- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 msgr2=0x7f61e013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61e4b92700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.556+0000 7f61d7fff700 1 -- 172.21.15.125:0/217324627 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780905030 0 0) 0x7f61e009fa00 con 0x7f61e009e870 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61e4b92700 1 -- 172.21.15.125:0/217324627 >> v1:172.21.15.125:6789/0 conn(0x7f61e009e870 legacy=0x7f61e009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61e4b92700 1 -- 172.21.15.125:0/217324627 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e009ada0 con 0x7f61e009f350 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61e5b94700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61e4b92700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3896a707f3061da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61d7fff700 1 -- 172.21.15.125:0/217324627 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011830 con 0x7f61e009f350 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61d7fff700 1 -- 172.21.15.125:0/217324627 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0011990 con 0x7f61e009f350 2023-10-03T10:11:31.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.557+0000 7f61d7fff700 1 -- 172.21.15.125:0/217324627 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011d20 con 0x7f61e009f350 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 -- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 msgr2=0x7f61e0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 -- 172.21.15.125:0/217324627 shutdown_connections 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 --2- 172.21.15.125:0/217324627 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e0138e60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 -- 172.21.15.125:0/217324627 >> 172.21.15.125:0/217324627 conn(0x7f61e00a4430 msgr2=0x7f61e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 -- 172.21.15.125:0/217324627 shutdown_connections 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.558+0000 7f61e75f7700 1 -- 172.21.15.125:0/217324627 wait complete. 2023-10-03T10:11:31.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 Processor -- start 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 -- start start 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61e009e870 0x7f61e011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01347f0 con 0x7f61e009e870 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00a17e0 con 0x7f61e01393a0 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e75f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0120d70 con 0x7f61e009f350 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54438/0 (socket says 172.21.15.125:54438) 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 -- 172.21.15.125:0/631445617 learned_addr learned my addr 172.21.15.125:0/631445617 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e5b94700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e5393700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61e009e870 0x7f61e011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 -- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 msgr2=0x7f61e011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 -- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61e009e870 msgr2=0x7f61e011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61e009e870 0x7f61e011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.559+0000 7f61e4b92700 1 -- 172.21.15.125:0/631445617 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8009a70 con 0x7f61e009f350 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61e5b94700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61e4b92700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61d00090b0 tx=0x7f61d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00044d0 con 0x7f61e009f350 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d001f070 con 0x7f61e009f350 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00094a0 con 0x7f61e009f350 2023-10-03T10:11:31.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00038a0 con 0x7f61e009f350 2023-10-03T10:11:31.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.560+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e006cfa0 con 0x7f61e009f350 2023-10-03T10:11:31.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.561+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e004f2a0 con 0x7f61e009f350 2023-10-03T10:11:31.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.561+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f61d0003a00 con 0x7f61e009f350 2023-10-03T10:11:31.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.561+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f61d0021070 con 0x7f61e009f350 2023-10-03T10:11:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.570+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61d0010380 con 0x7f61e009f350 2023-10-03T10:11:31.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.598+0000 7f50d5ef0700 1 Processor -- start 2023-10-03T10:11:31.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.598+0000 7f50d5ef0700 1 -- start start 2023-10-03T10:11:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50d5ef0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 0x7f50d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50d5ef0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50d5ef0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d009dc00 con 0x7f50d00a1380 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50d5ef0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d009ea90 con 0x7f50d00a0a70 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50d5ef0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d009dec0 con 0x7f50d0134120 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 0x7f50d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53338/0 (socket says 172.21.15.125:53338) 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 -- 172.21.15.125:0/931009688 learned_addr learned my addr 172.21.15.125:0/931009688 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 -- 172.21.15.125:0/931009688 >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 msgr2=0x7f50d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 --2- 172.21.15.125:0/931009688 >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 0x7f50d00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 -- 172.21.15.125:0/931009688 >> v1:172.21.15.125:6789/0 conn(0x7f50d00a1380 legacy=0x7f50d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 -- 172.21.15.125:0/931009688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d009e6a0 con 0x7f50d0134120 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cf7fe700 1 --2- 172.21.15.125:0/931009688 >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 0x7f50d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50cffff700 1 --2- 172.21.15.125:0/931009688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098f0 tx=0x7f50c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7b47cbdd63e7a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.599+0000 7f50ce7fc700 1 -- 172.21.15.125:0/931009688 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011830 con 0x7f50d0134120 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50ce7fc700 1 -- 172.21.15.125:0/931009688 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8011990 con 0x7f50d0134120 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50ce7fc700 1 -- 172.21.15.125:0/931009688 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011d20 con 0x7f50d0134120 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 -- 172.21.15.125:0/931009688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 msgr2=0x7f50d013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/931009688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098f0 tx=0x7f50c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 -- 172.21.15.125:0/931009688 shutdown_connections 2023-10-03T10:11:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/931009688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d013bce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/931009688 >> v2:172.21.15.125:3300/0 conn(0x7f50d00a0a70 0x7f50d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 -- 172.21.15.125:0/931009688 >> 172.21.15.125:0/931009688 conn(0x7f50d00a6610 msgr2=0x7f50d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 -- 172.21.15.125:0/931009688 shutdown_connections 2023-10-03T10:11:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.600+0000 7f50d5ef0700 1 -- 172.21.15.125:0/931009688 wait complete. 2023-10-03T10:11:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.601+0000 7f50d5ef0700 1 Processor -- start 2023-10-03T10:11:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.601+0000 7f50d5ef0700 1 -- start start 2023-10-03T10:11:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 0x7f50d0122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d0123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0133850 con 0x7f50d00a1380 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0133a80 con 0x7f50d0134120 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50d5ef0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50d01260d0 con 0x7f50d00a0a70 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54454/0 (socket says 172.21.15.125:54454) 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 -- 172.21.15.125:0/2408188 learned_addr learned my addr 172.21.15.125:0/2408188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50ceffd700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 0x7f50d0122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cffff700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d0123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 -- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 msgr2=0x7f50d0123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d0123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 -- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 msgr2=0x7f50d0122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 0x7f50d0122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 -- 172.21.15.125:0/2408188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0009a70 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50ceffd700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 0x7f50d0122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cffff700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d0123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.602+0000 7f50cf7fe700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50c000efc0 tx=0x7f50c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c000cd70 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c000f040 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8009550 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00146a0 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d0125e10 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.603+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d004f2a0 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.604+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f50c0014800 con 0x7f50d00a0a70 2023-10-03T10:11:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.604+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f50c0040c00 con 0x7f50d00a0a70 2023-10-03T10:11:31.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.608+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50c0025350 con 0x7f50d00a0a70 2023-10-03T10:11:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.727+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34a809e380 con 0x7f34a809dec0 2023-10-03T10:11:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.728+0000 7f34a57fa700 1 -- 172.21.15.125:0/4040578623 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3494015070 con 0x7f34a809dec0 2023-10-03T10:11:31.728 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 >> v1:172.21.15.125:6816/126957 conn(0x7f348c02f240 legacy=0x7f348c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 msgr2=0x7f34a811c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 0x7f34a811c400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3494016000 tx=0x7f3494004750 comp rx=0 tx=0).stop 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 shutdown_connections 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a8131a00 0x7f34a811c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a806a770 0x7f34a811bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 --2- 172.21.15.125:0/4040578623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34a809dec0 0x7f34a811c400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 >> 172.21.15.125:0/4040578623 conn(0x7f34a8099c40 msgr2=0x7f34a81b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 shutdown_connections 2023-10-03T10:11:31.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.730+0000 7f34aefbb700 1 -- 172.21.15.125:0/4040578623 wait complete. 2023-10-03T10:11:31.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-10-03T10:11:31.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.773+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61e0072d60 con 0x7f61e009f350 2023-10-03T10:11:31.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.773+0000 7f61d5ffb700 1 -- 172.21.15.125:0/631445617 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61d0040e60 con 0x7f61e009f350 2023-10-03T10:11:31.774 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:31.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 >> v1:172.21.15.125:6816/126957 conn(0x7f61c402f240 legacy=0x7f61c40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 msgr2=0x7f61e011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61d00090b0 tx=0x7f61d0004750 comp rx=0 tx=0).stop 2023-10-03T10:11:31.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 shutdown_connections 2023-10-03T10:11:31.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61e01393a0 0x7f61e011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61e009e870 0x7f61e011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 --2- 172.21.15.125:0/631445617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61e009f350 0x7f61e011f010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 >> 172.21.15.125:0/631445617 conn(0x7f61e00a4430 msgr2=0x7f61e009ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 shutdown_connections 2023-10-03T10:11:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.775+0000 7f61e75f7700 1 -- 172.21.15.125:0/631445617 wait complete. 2023-10-03T10:11:31.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:11:31.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.801+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50d0126ba0 con 0x7f50d00a0a70 2023-10-03T10:11:31.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.801+0000 7f50c7fff700 1 -- 172.21.15.125:0/2408188 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50c0026bd0 con 0x7f50d00a0a70 2023-10-03T10:11:31.801 INFO:teuthology.orchestra.run.smithi125.stdout:38654705692 2023-10-03T10:11:31.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 >> v1:172.21.15.125:6816/126957 conn(0x7f50b002f240 legacy=0x7f50b00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 msgr2=0x7f50d0122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50c000efc0 tx=0x7f50c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 shutdown_connections 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50d0134120 0x7f50d0123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50d00a0a70 0x7f50d0122910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 --2- 172.21.15.125:0/2408188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50d00a1380 0x7f50d0122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 >> 172.21.15.125:0/2408188 conn(0x7f50d00a6610 msgr2=0x7f50d009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 shutdown_connections 2023-10-03T10:11:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:31.803+0000 7f50d5ef0700 1 -- 172.21.15.125:0/2408188 wait complete. 2023-10-03T10:11:31.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:11:32.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:32.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.611+0000 7f7f5695b700 1 Processor -- start 2023-10-03T10:11:32.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.611+0000 7f7f5695b700 1 -- start start 2023-10-03T10:11:32.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.611+0000 7f7f5695b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009ef80 0x7f7f50138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f5695b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f5009f370 0x7f7f5013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f5695b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5009af80 con 0x7f7f5009a150 2023-10-03T10:11:32.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f5695b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5009fe00 con 0x7f7f5009f370 2023-10-03T10:11:32.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f5695b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5006bec0 con 0x7f7f5009ef80 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f5009f370 0x7f7f5013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7f5009a150 0x7f7f5009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49516/0 (socket says 172.21.15.125:49516) 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4ffff700 1 -- 172.21.15.125:0/2659288962 learned_addr learned my addr 172.21.15.125:0/2659288962 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f5009f370 0x7f7f5013b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34488/0 (socket says 172.21.15.125:34488) 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4f7fe700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009ef80 0x7f7f50138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 -- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009ef80 msgr2=0x7f7f50138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009ef80 0x7f7f50138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 -- 172.21.15.125:0/2659288962 >> v1:172.21.15.125:6789/0 conn(0x7f7f5009a150 legacy=0x7f7f5009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 -- 172.21.15.125:0/2659288962 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5006bc20 con 0x7f7f5009f370 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f54ef8700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f5013b3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009d90 tx=0x7f7f4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a384703389b57e4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4effd700 1 -- 172.21.15.125:0/2659288962 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800e070 con 0x7f7f5009f370 2023-10-03T10:11:32.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4effd700 1 -- 172.21.15.125:0/2659288962 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800bb20 con 0x7f7f5009f370 2023-10-03T10:11:32.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.612+0000 7f7f4effd700 1 -- 172.21.15.125:0/2659288962 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48012430 con 0x7f7f5009f370 2023-10-03T10:11:32.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 -- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 msgr2=0x7f7f5013b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f5013b3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009d90 tx=0x7f7f4800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:32.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 -- 172.21.15.125:0/2659288962 shutdown_connections 2023-10-03T10:11:32.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f5013b3b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 --2- 172.21.15.125:0/2659288962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009ef80 0x7f7f50138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 -- 172.21.15.125:0/2659288962 >> 172.21.15.125:0/2659288962 conn(0x7f7f500a4430 msgr2=0x7f7f500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 -- 172.21.15.125:0/2659288962 shutdown_connections 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.613+0000 7f7f5695b700 1 -- 172.21.15.125:0/2659288962 wait complete. 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.614+0000 7f7f5695b700 1 Processor -- start 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 -- start start 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 0x7f7f50139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 0x7f7f501399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5009b8b0 con 0x7f7f5009f370 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500a0440 con 0x7f7f5009ef80 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f5695b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5011f0a0 con 0x7f7f5009a150 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 0x7f7f50139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 0x7f7f50139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54508/0 (socket says 172.21.15.125:54508) 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34502/0 (socket says 172.21.15.125:34502) 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f4ffff700 1 -- 172.21.15.125:0/3809435190 learned_addr learned my addr 172.21.15.125:0/3809435190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f4f7fe700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 0x7f7f501399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 -- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 msgr2=0x7f7f50139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 0x7f7f50139490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 -- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 msgr2=0x7f7f501399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 0x7f7f501399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f54ef8700 1 -- 172.21.15.125:0/3809435190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009a70 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.615+0000 7f7f4f7fe700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 0x7f7f501399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f54ef8700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f48016000 tx=0x7f7f48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48012430 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48020070 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48004280 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5011f920 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.616+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f50120920 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.617+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f7f480043e0 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.617+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f7f48022070 con 0x7f7f5009f370 2023-10-03T10:11:32.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.617+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5009fa30 con 0x7f7f5009f370 2023-10-03T10:11:32.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.622+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f4802c020 con 0x7f7f5009f370 2023-10-03T10:11:32.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:32.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:32.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:32.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.819+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f5011fb10 con 0x7f7f5009f370 2023-10-03T10:11:32.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.819+0000 7f7f4cff9700 1 -- 172.21.15.125:0/3809435190 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f48036090 con 0x7f7f5009f370 2023-10-03T10:11:32.820 INFO:teuthology.orchestra.run.smithi125.stdout:38654705695 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 >> v1:172.21.15.125:6816/126957 conn(0x7f7f3c02f240 legacy=0x7f7f3c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 msgr2=0x7f7f50139f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f48016000 tx=0x7f7f48004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 shutdown_connections 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f5009f370 0x7f7f50139f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f5009a150 0x7f7f50139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 --2- 172.21.15.125:0/3809435190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f5009ef80 0x7f7f501399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 >> 172.21.15.125:0/3809435190 conn(0x7f7f500a4430 msgr2=0x7f7f5009d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 shutdown_connections 2023-10-03T10:11:32.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.821+0000 7f7f5695b700 1 -- 172.21.15.125:0/3809435190 wait complete. 2023-10-03T10:11:32.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.1 2023-10-03T10:11:32.837 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:32.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.874+0000 7f39ad739700 1 Processor -- start 2023-10-03T10:11:32.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.874+0000 7f39ad739700 1 -- start start 2023-10-03T10:11:32.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39ad739700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39ad739700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39a8130eb0 0x7f39a8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39ad739700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a809aaa0 con 0x7f39a809e170 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39ad739700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a809f870 con 0x7f39a8130eb0 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39ad739700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39a809b360 con 0x7f39a809d860 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39a67fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f39a809e170 0x7f39a81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49520/0 (socket says 172.21.15.125:49520) 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39a67fc700 1 -- 172.21.15.125:0/855886851 learned_addr learned my addr 172.21.15.125:0/855886851 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39a77fe700 1 --2- 172.21.15.125:0/855886851 >> v2:172.21.15.125:3300/0 conn(0x7f39a8130eb0 0x7f39a8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39a6ffd700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.875+0000 7f39a5ffb700 1 -- 172.21.15.125:0/855886851 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511335360 0 0) 0x7f39a809aaa0 con 0x7f39a809e170 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a5ffb700 1 -- 172.21.15.125:0/855886851 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39900035b0 con 0x7f39a809e170 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a77fe700 1 -- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 msgr2=0x7f39a809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:32.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a77fe700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a77fe700 1 -- 172.21.15.125:0/855886851 >> v1:172.21.15.125:6789/0 conn(0x7f39a809e170 legacy=0x7f39a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a77fe700 1 -- 172.21.15.125:0/855886851 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a809b620 con 0x7f39a8130eb0 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a6ffd700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a77fe700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a8138a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39a000be30 tx=0x7f39a0009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24c9659bb164819 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a5ffb700 1 -- 172.21.15.125:0/855886851 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000c890 con 0x7f39a8130eb0 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a5ffb700 1 -- 172.21.15.125:0/855886851 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000c9f0 con 0x7f39a8130eb0 2023-10-03T10:11:32.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.876+0000 7f39a5ffb700 1 -- 172.21.15.125:0/855886851 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000cd60 con 0x7f39a8130eb0 2023-10-03T10:11:32.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 -- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 msgr2=0x7f39a8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a8138a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39a000be30 tx=0x7f39a0009290 comp rx=0 tx=0).stop 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 -- 172.21.15.125:0/855886851 shutdown_connections 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a8138a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 --2- 172.21.15.125:0/855886851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 -- 172.21.15.125:0/855886851 >> 172.21.15.125:0/855886851 conn(0x7f39a8099c40 msgr2=0x7f39a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 -- 172.21.15.125:0/855886851 shutdown_connections 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.877+0000 7f39ad739700 1 -- 172.21.15.125:0/855886851 wait complete. 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 Processor -- start 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 -- start start 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a809e170 0x7f39a811e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a811ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81219c0 con 0x7f39a8130eb0 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8121790 con 0x7f39a809e170 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39ad739700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8120c20 con 0x7f39a809d860 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39a6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39a6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54514/0 (socket says 172.21.15.125:54514) 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39a6ffd700 1 -- 172.21.15.125:0/502238213 learned_addr learned my addr 172.21.15.125:0/502238213 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39a67fc700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a809e170 0x7f39a811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.878+0000 7f39a77fe700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a811ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 -- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a809e170 msgr2=0x7f39a811e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a809e170 0x7f39a811e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 -- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 msgr2=0x7f39a811ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a811ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 -- 172.21.15.125:0/502238213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399800d940 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39a6ffd700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3998012fc0 tx=0x7f39980103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998010b00 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a000ba90 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3998013040 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998010e80 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.879+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80a2690 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.880+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f3998018480 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.880+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f39980436c0 con 0x7f39a809d860 2023-10-03T10:11:32.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.880+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a804f2a0 con 0x7f39a809d860 2023-10-03T10:11:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.885+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3998016930 con 0x7f39a809d860 2023-10-03T10:11:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.919+0000 7f27252d4700 1 Processor -- start 2023-10-03T10:11:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.919+0000 7f27252d4700 1 -- start start 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f27252d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27200a0a70 0x7f27200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f27252d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720134120 0x7f272013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f27252d4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272009dc00 con 0x7f27200a1380 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f27252d4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272009ea90 con 0x7f27200a0a70 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f27252d4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272009dec0 con 0x7f2720134120 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27200a0a70 0x7f27200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f27200a1380 0x7f2720133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49524/0 (socket says 172.21.15.125:49524) 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271e7fc700 1 -- 172.21.15.125:0/341873654 learned_addr learned my addr 172.21.15.125:0/341873654 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271f7fe700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720134120 0x7f272013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 -- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720134120 msgr2=0x7f272013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720134120 0x7f272013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 -- 172.21.15.125:0/341873654 >> v1:172.21.15.125:6789/0 conn(0x7f27200a1380 legacy=0x7f2720133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 -- 172.21.15.125:0/341873654 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272009e6a0 con 0x7f27200a0a70 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.920+0000 7f271effd700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27200a0a70 0x7f27200a0e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2710009840 tx=0x7f2710009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dfb846f9fb65d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.921+0000 7f271dffb700 1 -- 172.21.15.125:0/341873654 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011830 con 0x7f27200a0a70 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.921+0000 7f271dffb700 1 -- 172.21.15.125:0/341873654 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710011990 con 0x7f27200a0a70 2023-10-03T10:11:32.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.921+0000 7f271dffb700 1 -- 172.21.15.125:0/341873654 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011d20 con 0x7f27200a0a70 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.921+0000 7f27252d4700 1 -- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27200a0a70 msgr2=0x7f27200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.921+0000 7f27252d4700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27200a0a70 0x7f27200a0e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2710009840 tx=0x7f2710009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 -- 172.21.15.125:0/341873654 shutdown_connections 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720134120 0x7f272013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 --2- 172.21.15.125:0/341873654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27200a0a70 0x7f27200a0e40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 -- 172.21.15.125:0/341873654 >> 172.21.15.125:0/341873654 conn(0x7f27200a6610 msgr2=0x7f27200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 -- 172.21.15.125:0/341873654 shutdown_connections 2023-10-03T10:11:32.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.922+0000 7f27252d4700 1 -- 172.21.15.125:0/341873654 wait complete. 2023-10-03T10:11:32.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.923+0000 7f27252d4700 1 Processor -- start 2023-10-03T10:11:32.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.923+0000 7f27252d4700 1 -- start start 2023-10-03T10:11:32.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27200a1380 0x7f2720122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720134120 0x7f2720123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720126160 con 0x7f2720134120 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2720133aa0 con 0x7f27200a1380 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f27252d4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27201334b0 con 0x7f27200a0a70 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54530/0 (socket says 172.21.15.125:54530) 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 -- 172.21.15.125:0/4229367408 learned_addr learned my addr 172.21.15.125:0/4229367408 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271e7fc700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27200a1380 0x7f2720122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271f7fe700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720134120 0x7f2720123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 -- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27200a1380 msgr2=0x7f2720122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27200a1380 0x7f2720122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 -- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720134120 msgr2=0x7f2720123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720134120 0x7f2720123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.924+0000 7f271effd700 1 -- 172.21.15.125:0/4229367408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094a0 con 0x7f27200a0a70 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f271effd700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27100090b0 tx=0x7f2710004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004400 con 0x7f27200a0a70 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271001f070 con 0x7f27200a0a70 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2720125ea0 con 0x7f27200a0a70 2023-10-03T10:11:32.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100038e0 con 0x7f27200a0a70 2023-10-03T10:11:32.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.925+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f2710021030 con 0x7f27200a0a70 2023-10-03T10:11:32.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.926+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2720126b40 con 0x7f27200a0a70 2023-10-03T10:11:32.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.926+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f2710004580 con 0x7f27200a0a70 2023-10-03T10:11:32.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.927+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27201263a0 con 0x7f27200a0a70 2023-10-03T10:11:32.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.931+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2710015070 con 0x7f27200a0a70 2023-10-03T10:11:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.947+0000 7f85762e4700 1 Processor -- start 2023-10-03T10:11:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.947+0000 7f85762e4700 1 -- start start 2023-10-03T10:11:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f85762e4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 0x7f857013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f85762e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f85762e4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857009eca0 con 0x7f857006a770 2023-10-03T10:11:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f85762e4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857006b2e0 con 0x7f85701350d0 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f85762e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857009f720 con 0x7f857013d210 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f856f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 0x7f857013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54540/0 (socket says 172.21.15.125:54540) 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 -- 172.21.15.125:0/272466291 learned_addr learned my addr 172.21.15.125:0/272466291 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 -- 172.21.15.125:0/272466291 >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 msgr2=0x7f857013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 --2- 172.21.15.125:0/272466291 >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 0x7f857013ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 -- 172.21.15.125:0/272466291 >> v1:172.21.15.125:6789/0 conn(0x7f857006a770 legacy=0x7f85701349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 -- 172.21.15.125:0/272466291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857006b480 con 0x7f857013d210 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f856f7fe700 1 --2- 172.21.15.125:0/272466291 >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 0x7f857013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.948+0000 7f8574881700 1 --2- 172.21.15.125:0/272466291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8568009e80 tx=0x7f856800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ce9bdc097becb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f856effd700 1 -- 172.21.15.125:0/272466291 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800e070 con 0x7f857013d210 2023-10-03T10:11:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f856effd700 1 -- 172.21.15.125:0/272466291 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800b8d0 con 0x7f857013d210 2023-10-03T10:11:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f856effd700 1 -- 172.21.15.125:0/272466291 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800bc80 con 0x7f857013d210 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 -- 172.21.15.125:0/272466291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 msgr2=0x7f857013f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 --2- 172.21.15.125:0/272466291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8568009e80 tx=0x7f856800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 -- 172.21.15.125:0/272466291 shutdown_connections 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 --2- 172.21.15.125:0/272466291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f857013f5f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 --2- 172.21.15.125:0/272466291 >> v2:172.21.15.125:3300/0 conn(0x7f85701350d0 0x7f857013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 -- 172.21.15.125:0/272466291 >> 172.21.15.125:0/272466291 conn(0x7f8570099c40 msgr2=0x7f85700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 -- 172.21.15.125:0/272466291 shutdown_connections 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.949+0000 7f85762e4700 1 -- 172.21.15.125:0/272466291 wait complete. 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.950+0000 7f85762e4700 1 Processor -- start 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.950+0000 7f85762e4700 1 -- start start 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 0x7f857006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 0x7f85700700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f8570070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8570138ba0 con 0x7f857006a770 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700715a0 con 0x7f85701350d0 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f85762e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857009f220 con 0x7f857013d210 2023-10-03T10:11:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f856ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 0x7f857006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f856ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 0x7f857006fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34574/0 (socket says 172.21.15.125:34574) 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f856ffff700 1 -- 172.21.15.125:0/1713461704 learned_addr learned my addr 172.21.15.125:0/1713461704 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f856f7fe700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 0x7f85700700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f8570070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 -- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 msgr2=0x7f85700700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 0x7f85700700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 -- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 msgr2=0x7f857006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 0x7f857006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f8574881700 1 -- 172.21.15.125:0/1713461704 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640094a0 con 0x7f857013d210 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.951+0000 7f856f7fe700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 0x7f85700700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f8574881700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f8570070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8568015000 tx=0x7f8568004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568004800 con 0x7f857013d210 2023-10-03T10:11:32.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680092e0 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856801c650 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8568009b30 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.952+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857009b0f0 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.953+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857004f2a0 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.953+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f856801c7b0 con 0x7f857013d210 2023-10-03T10:11:32.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.953+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f85680413a0 con 0x7f857013d210 2023-10-03T10:11:32.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:32.958+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f856802d9b0 con 0x7f857013d210 2023-10-03T10:11:33.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.002+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f856802e480 con 0x7f857013d210 2023-10-03T10:11:33.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.003+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f399800b450 con 0x7f39a809d860 2023-10-03T10:11:33.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.007+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f271001a450 con 0x7f27200a0a70 2023-10-03T10:11:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.087+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39a806c3b0 con 0x7f39a809d860 2023-10-03T10:11:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.088+0000 7f398f7fe700 1 -- 172.21.15.125:0/502238213 <== mon.2 v2:172.21.15.125:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3998016930 con 0x7f39a809d860 2023-10-03T10:11:33.088 INFO:teuthology.orchestra.run.smithi125.stdout:38654705694 2023-10-03T10:11:33.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 >> v1:172.21.15.125:6816/126957 conn(0x7f399402f240 legacy=0x7f39940316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 msgr2=0x7f39a811e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3998012fc0 tx=0x7f39980103a0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 shutdown_connections 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a8130eb0 0x7f39a811ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a809d860 0x7f39a811e180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 --2- 172.21.15.125:0/502238213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a809e170 0x7f39a811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 >> 172.21.15.125:0/502238213 conn(0x7f39a8099c40 msgr2=0x7f39a80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 shutdown_connections 2023-10-03T10:11:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.090+0000 7f39ad739700 1 -- 172.21.15.125:0/502238213 wait complete. 2023-10-03T10:11:33.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.2 2023-10-03T10:11:33.102 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:33.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.166+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f272004f2a0 con 0x7f27200a0a70 2023-10-03T10:11:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.166+0000 7f27077fe700 1 -- 172.21.15.125:0/4229367408 <== mon.2 v2:172.21.15.125:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2710015070 con 0x7f27200a0a70 2023-10-03T10:11:33.167 INFO:teuthology.orchestra.run.smithi125.stdout:38654705694 2023-10-03T10:11:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 >> v1:172.21.15.125:6816/126957 conn(0x7f270c02f240 legacy=0x7f270c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 msgr2=0x7f27201229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27100090b0 tx=0x7f2710004750 comp rx=0 tx=0).stop 2023-10-03T10:11:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 shutdown_connections 2023-10-03T10:11:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720134120 0x7f2720123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27200a0a70 0x7f27201229b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 --2- 172.21.15.125:0/4229367408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27200a1380 0x7f2720122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 >> 172.21.15.125:0/4229367408 conn(0x7f27200a6610 msgr2=0x7f27200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 shutdown_connections 2023-10-03T10:11:33.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.168+0000 7f27252d4700 1 -- 172.21.15.125:0/4229367408 wait complete. 2023-10-03T10:11:33.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.0 2023-10-03T10:11:33.181 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:33.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.194+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8570072210 con 0x7f857013d210 2023-10-03T10:11:33.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.194+0000 7f856cff9700 1 -- 172.21.15.125:0/1713461704 <== mon.2 v2:172.21.15.125:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8568029070 con 0x7f857013d210 2023-10-03T10:11:33.195 INFO:teuthology.orchestra.run.smithi125.stdout:38654705694 2023-10-03T10:11:33.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 >> v1:172.21.15.125:6816/126957 conn(0x7f855c02f240 legacy=0x7f855c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 msgr2=0x7f8570070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f8570070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8568015000 tx=0x7f8568004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 shutdown_connections 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f857013d210 0x7f8570070630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857006a770 0x7f857006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 --2- 172.21.15.125:0/1713461704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85701350d0 0x7f85700700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.196+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 >> 172.21.15.125:0/1713461704 conn(0x7f8570099c40 msgr2=0x7f857009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.197+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 shutdown_connections 2023-10-03T10:11:33.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.197+0000 7f85762e4700 1 -- 172.21.15.125:0/1713461704 wait complete. 2023-10-03T10:11:33.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.3 2023-10-03T10:11:33.209 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:33.209 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:11:33.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.370+0000 7fee01c7a700 1 Processor -- start 2023-10-03T10:11:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.370+0000 7fee01c7a700 1 -- start start 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.370+0000 7fee01c7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 0x7fedfc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.370+0000 7fee01c7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.370+0000 7fee01c7a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc06b2d0 con 0x7fedfc1300a0 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fee01c7a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc133610 con 0x7fedfc130bc0 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fee01c7a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc09a500 con 0x7fedfc133ad0 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfaffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fedfc1300a0 0x7fedfc1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49542/0 (socket says 172.21.15.125:49542) 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34580/0 (socket says 172.21.15.125:34580) 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfaffd700 1 -- 172.21.15.125:0/3337032528 learned_addr learned my addr 172.21.15.125:0/3337032528 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 0x7fedfc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 -- 172.21.15.125:0/3337032528 >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 msgr2=0x7fedfc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 --2- 172.21.15.125:0/3337032528 >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 -- 172.21.15.125:0/3337032528 >> v1:172.21.15.125:6789/0 conn(0x7fedfc1300a0 legacy=0x7fedfc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 -- 172.21.15.125:0/3337032528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc1338b0 con 0x7fedfc133ad0 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfa7fc700 1 -- 172.21.15.125:0/3337032528 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569342996 0 0) 0x7fedfc06b2d0 con 0x7fedfc1300a0 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfbfff700 1 --2- 172.21.15.125:0/3337032528 >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfb7fe700 1 --2- 172.21.15.125:0/3337032528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 0x7fedfc133ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009840 tx=0x7fedf0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a07e109eea408d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfa7fc700 1 -- 172.21.15.125:0/3337032528 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0011830 con 0x7fedfc133ad0 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfa7fc700 1 -- 172.21.15.125:0/3337032528 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0011990 con 0x7fedfc133ad0 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.371+0000 7fedfa7fc700 1 -- 172.21.15.125:0/3337032528 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0011d20 con 0x7fedfc133ad0 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 -- 172.21.15.125:0/3337032528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 msgr2=0x7fedfc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3337032528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 0x7fedfc133ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009840 tx=0x7fedf0009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 -- 172.21.15.125:0/3337032528 shutdown_connections 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3337032528 >> v2:172.21.15.125:3300/0 conn(0x7fedfc130bc0 0x7fedfc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3337032528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc133ad0 0x7fedfc133ea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 -- 172.21.15.125:0/3337032528 >> 172.21.15.125:0/3337032528 conn(0x7fedfc099c40 msgr2=0x7fedfc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 -- 172.21.15.125:0/3337032528 shutdown_connections 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.372+0000 7fee01c7a700 1 -- 172.21.15.125:0/3337032528 wait complete. 2023-10-03T10:11:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 Processor -- start 2023-10-03T10:11:33.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 -- start start 2023-10-03T10:11:33.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedfc130bc0 0x7fedfc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 0x7fedfc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc120050 con 0x7fedfc133ad0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1209c0 con 0x7fedfc1300a0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fee01c7a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc071fd0 con 0x7fedfc130bc0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fedfb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fedfb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53430/0 (socket says 172.21.15.125:53430) 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fedfb7fe700 1 -- 172.21.15.125:0/3161793761 learned_addr learned my addr 172.21.15.125:0/3161793761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fedfbfff700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 0x7fedfc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.373+0000 7fedfaffd700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedfc130bc0 0x7fedfc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 -- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedfc130bc0 msgr2=0x7fedfc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedfc130bc0 0x7fedfc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 -- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 msgr2=0x7fedfc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 -- 172.21.15.125:0/3161793761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009a70 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfb7fe700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fedfbfff700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 0x7fedfc11e4c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf400efc0 tx=0x7fedf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400ca90 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400f040 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400ce30 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00094a0 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.374+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc12dd00 con 0x7fedfc133ad0 2023-10-03T10:11:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.375+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fedf4014480 con 0x7fedfc133ad0 2023-10-03T10:11:33.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.375+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fedf4040170 con 0x7fedfc133ad0 2023-10-03T10:11:33.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.375+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc11fa10 con 0x7fedfc133ad0 2023-10-03T10:11:33.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.380+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedfc11fa10 con 0x7fedfc133ad0 2023-10-03T10:11:33.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.560+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 --> v1:172.21.15.125:6816/126957 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedfc06a9e0 con 0x7fede802f480 2023-10-03T10:11:33.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.568+0000 7fede3fff700 1 -- 172.21.15.125:0/3161793761 <== mgr.14180 v1:172.21.15.125:6816/126957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270354 (unknown 2965378022 0 3420561004) 0x7fedf0011630 con 0x7fede802f480 2023-10-03T10:11:33.571 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:33.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.570+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 >> v1:172.21.15.125:6816/126957 conn(0x7fede802f480 legacy=0x7fede8031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.570+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 msgr2=0x7fedfc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.570+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 0x7fedfc11e4c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf400efc0 tx=0x7fedf400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 shutdown_connections 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedfc133ad0 0x7fedfc11e4c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedfc1300a0 0x7fedfc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 --2- 172.21.15.125:0/3161793761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedfc130bc0 0x7fedfc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 >> 172.21.15.125:0/3161793761 conn(0x7fedfc099c40 msgr2=0x7fedfc12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 shutdown_connections 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.571+0000 7fee01c7a700 1 -- 172.21.15.125:0/3161793761 wait complete. 2023-10-03T10:11:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:11:33.583 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:11:31.994455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189152,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298208,"statfs":{"total":386547056640,"available":385329364992,"internally_reserved":0,"allocated":786432,"data_stored":278466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.995213"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.160063+0000","last_change":"2023-10-03T10:09:14.714603+0000","last_active":"2023-10-03T10:11:27.160063+0000","last_peered":"2023-10-03T10:11:27.160063+0000","last_clean":"2023-10-03T10:11:27.160063+0000","last_became_active":"2023-10-03T10:09:14.714337+0000","last_became_peered":"2023-10-03T10:09:14.714337+0000","last_unstale":"2023-10-03T10:11:27.160063+0000","last_undegraded":"2023-10-03T10:11:27.160063+0000","last_fullsized":"2023-10-03T10:11:27.160063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159981+0000","last_change":"2023-10-03T10:09:14.705544+0000","last_active":"2023-10-03T10:11:27.159981+0000","last_peered":"2023-10-03T10:11:27.159981+0000","last_clean":"2023-10-03T10:11:27.159981+0000","last_became_active":"2023-10-03T10:09:14.705240+0000","last_became_peered":"2023-10-03T10:09:14.705240+0000","last_unstale":"2023-10-03T10:11:27.159981+0000","last_undegraded":"2023-10-03T10:11:27.159981+0000","last_fullsized":"2023-10-03T10:11:27.159981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136054+0000","last_change":"2023-10-03T10:09:14.715211+0000","last_active":"2023-10-03T10:11:26.136054+0000","last_peered":"2023-10-03T10:11:26.136054+0000","last_clean":"2023-10-03T10:11:26.136054+0000","last_became_active":"2023-10-03T10:09:14.714965+0000","last_became_peered":"2023-10-03T10:09:14.714965+0000","last_unstale":"2023-10-03T10:11:26.136054+0000","last_undegraded":"2023-10-03T10:11:26.136054+0000","last_fullsized":"2023-10-03T10:11:26.136054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135951+0000","last_change":"2023-10-03T10:09:14.710747+0000","last_active":"2023-10-03T10:11:26.135951+0000","last_peered":"2023-10-03T10:11:26.135951+0000","last_clean":"2023-10-03T10:11:26.135951+0000","last_became_active":"2023-10-03T10:09:14.710471+0000","last_became_peered":"2023-10-03T10:09:14.710471+0000","last_unstale":"2023-10-03T10:11:26.135951+0000","last_undegraded":"2023-10-03T10:11:26.135951+0000","last_fullsized":"2023-10-03T10:11:26.135951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136385+0000","last_change":"2023-10-03T10:09:14.719560+0000","last_active":"2023-10-03T10:11:26.136385+0000","last_peered":"2023-10-03T10:11:26.136385+0000","last_clean":"2023-10-03T10:11:26.136385+0000","last_became_active":"2023-10-03T10:09:14.719359+0000","last_became_peered":"2023-10-03T10:09:14.719359+0000","last_unstale":"2023-10-03T10:11:26.136385+0000","last_undegraded":"2023-10-03T10:11:26.136385+0000","last_fullsized":"2023-10-03T10:11:26.136385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135525+0000","last_change":"2023-10-03T10:10:04.994529+0000","last_active":"2023-10-03T10:11:26.135525+0000","last_peered":"2023-10-03T10:11:26.135525+0000","last_clean":"2023-10-03T10:11:26.135525+0000","last_became_active":"2023-10-03T10:10:04.994214+0000","last_became_peered":"2023-10-03T10:10:04.994214+0000","last_unstale":"2023-10-03T10:11:26.135525+0000","last_undegraded":"2023-10-03T10:11:26.135525+0000","last_fullsized":"2023-10-03T10:11:26.135525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318941+0000","last_change":"2023-10-03T10:09:14.723496+0000","last_active":"2023-10-03T10:11:25.318941+0000","last_peered":"2023-10-03T10:11:25.318941+0000","last_clean":"2023-10-03T10:11:25.318941+0000","last_became_active":"2023-10-03T10:09:14.723260+0000","last_became_peered":"2023-10-03T10:09:14.723260+0000","last_unstale":"2023-10-03T10:11:25.318941+0000","last_undegraded":"2023-10-03T10:11:25.318941+0000","last_fullsized":"2023-10-03T10:11:25.318941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409673+0000","last_change":"2023-10-03T10:09:14.728885+0000","last_active":"2023-10-03T10:11:26.409673+0000","last_peered":"2023-10-03T10:11:26.409673+0000","last_clean":"2023-10-03T10:11:26.409673+0000","last_became_active":"2023-10-03T10:09:14.720610+0000","last_became_peered":"2023-10-03T10:09:14.720610+0000","last_unstale":"2023-10-03T10:11:26.409673+0000","last_undegraded":"2023-10-03T10:11:26.409673+0000","last_fullsized":"2023-10-03T10:11:26.409673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137245+0000","last_change":"2023-10-03T10:09:14.713481+0000","last_active":"2023-10-03T10:11:26.137245+0000","last_peered":"2023-10-03T10:11:26.137245+0000","last_clean":"2023-10-03T10:11:26.137245+0000","last_became_active":"2023-10-03T10:09:14.711120+0000","last_became_peered":"2023-10-03T10:09:14.711120+0000","last_unstale":"2023-10-03T10:11:26.137245+0000","last_undegraded":"2023-10-03T10:11:26.137245+0000","last_fullsized":"2023-10-03T10:11:26.137245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410482+0000","last_change":"2023-10-03T10:09:14.726303+0000","last_active":"2023-10-03T10:11:26.410482+0000","last_peered":"2023-10-03T10:11:26.410482+0000","last_clean":"2023-10-03T10:11:26.410482+0000","last_became_active":"2023-10-03T10:09:14.726049+0000","last_became_peered":"2023-10-03T10:09:14.726049+0000","last_unstale":"2023-10-03T10:11:26.410482+0000","last_undegraded":"2023-10-03T10:11:26.410482+0000","last_fullsized":"2023-10-03T10:11:26.410482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410214+0000","last_change":"2023-10-03T10:09:14.726200+0000","last_active":"2023-10-03T10:11:26.410214+0000","last_peered":"2023-10-03T10:11:26.410214+0000","last_clean":"2023-10-03T10:11:26.410214+0000","last_became_active":"2023-10-03T10:09:14.725948+0000","last_became_peered":"2023-10-03T10:09:14.725948+0000","last_unstale":"2023-10-03T10:11:26.410214+0000","last_undegraded":"2023-10-03T10:11:26.410214+0000","last_fullsized":"2023-10-03T10:11:26.410214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159658+0000","last_change":"2023-10-03T10:09:14.714843+0000","last_active":"2023-10-03T10:11:27.159658+0000","last_peered":"2023-10-03T10:11:27.159658+0000","last_clean":"2023-10-03T10:11:27.159658+0000","last_became_active":"2023-10-03T10:09:14.714579+0000","last_became_peered":"2023-10-03T10:09:14.714579+0000","last_unstale":"2023-10-03T10:11:27.159658+0000","last_undegraded":"2023-10-03T10:11:27.159658+0000","last_fullsized":"2023-10-03T10:11:27.159658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159836+0000","last_change":"2023-10-03T10:09:14.724414+0000","last_active":"2023-10-03T10:11:27.159836+0000","last_peered":"2023-10-03T10:11:27.159836+0000","last_clean":"2023-10-03T10:11:27.159836+0000","last_became_active":"2023-10-03T10:09:14.723833+0000","last_became_peered":"2023-10-03T10:09:14.723833+0000","last_unstale":"2023-10-03T10:11:27.159836+0000","last_undegraded":"2023-10-03T10:11:27.159836+0000","last_fullsized":"2023-10-03T10:11:27.159836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409991+0000","last_change":"2023-10-03T10:09:14.708491+0000","last_active":"2023-10-03T10:11:26.409991+0000","last_peered":"2023-10-03T10:11:26.409991+0000","last_clean":"2023-10-03T10:11:26.409991+0000","last_became_active":"2023-10-03T10:09:14.705272+0000","last_became_peered":"2023-10-03T10:09:14.705272+0000","last_unstale":"2023-10-03T10:11:26.409991+0000","last_undegraded":"2023-10-03T10:11:26.409991+0000","last_fullsized":"2023-10-03T10:11:26.409991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135647+0000","last_change":"2023-10-03T10:09:14.713611+0000","last_active":"2023-10-03T10:11:26.135647+0000","last_peered":"2023-10-03T10:11:26.135647+0000","last_clean":"2023-10-03T10:11:26.135647+0000","last_became_active":"2023-10-03T10:09:14.713350+0000","last_became_peered":"2023-10-03T10:09:14.713350+0000","last_unstale":"2023-10-03T10:11:26.135647+0000","last_undegraded":"2023-10-03T10:11:26.135647+0000","last_fullsized":"2023-10-03T10:11:26.135647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318736+0000","last_change":"2023-10-03T10:09:14.717325+0000","last_active":"2023-10-03T10:11:25.318736+0000","last_peered":"2023-10-03T10:11:25.318736+0000","last_clean":"2023-10-03T10:11:25.318736+0000","last_became_active":"2023-10-03T10:09:14.717060+0000","last_became_peered":"2023-10-03T10:09:14.717060+0000","last_unstale":"2023-10-03T10:11:25.318736+0000","last_undegraded":"2023-10-03T10:11:25.318736+0000","last_fullsized":"2023-10-03T10:11:25.318736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137159+0000","last_change":"2023-10-03T10:09:14.713656+0000","last_active":"2023-10-03T10:11:26.137159+0000","last_peered":"2023-10-03T10:11:26.137159+0000","last_clean":"2023-10-03T10:11:26.137159+0000","last_became_active":"2023-10-03T10:09:14.711482+0000","last_became_peered":"2023-10-03T10:09:14.711482+0000","last_unstale":"2023-10-03T10:11:26.137159+0000","last_undegraded":"2023-10-03T10:11:26.137159+0000","last_fullsized":"2023-10-03T10:11:26.137159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136338+0000","last_change":"2023-10-03T10:09:14.717202+0000","last_active":"2023-10-03T10:11:26.136338+0000","last_peered":"2023-10-03T10:11:26.136338+0000","last_clean":"2023-10-03T10:11:26.136338+0000","last_became_active":"2023-10-03T10:09:14.716379+0000","last_became_peered":"2023-10-03T10:09:14.716379+0000","last_unstale":"2023-10-03T10:11:26.136338+0000","last_undegraded":"2023-10-03T10:11:26.136338+0000","last_fullsized":"2023-10-03T10:11:26.136338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159935+0000","last_change":"2023-10-03T10:09:14.723512+0000","last_active":"2023-10-03T10:11:27.159935+0000","last_peered":"2023-10-03T10:11:27.159935+0000","last_clean":"2023-10-03T10:11:27.159935+0000","last_became_active":"2023-10-03T10:09:14.723235+0000","last_became_peered":"2023-10-03T10:09:14.723235+0000","last_unstale":"2023-10-03T10:11:27.159935+0000","last_undegraded":"2023-10-03T10:11:27.159935+0000","last_fullsized":"2023-10-03T10:11:27.159935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410279+0000","last_change":"2023-10-03T10:09:14.718233+0000","last_active":"2023-10-03T10:11:26.410279+0000","last_peered":"2023-10-03T10:11:26.410279+0000","last_clean":"2023-10-03T10:11:26.410279+0000","last_became_active":"2023-10-03T10:09:14.717964+0000","last_became_peered":"2023-10-03T10:09:14.717964+0000","last_unstale":"2023-10-03T10:11:26.410279+0000","last_undegraded":"2023-10-03T10:11:26.410279+0000","last_fullsized":"2023-10-03T10:11:26.410279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409861+0000","last_change":"2023-10-03T10:09:14.721092+0000","last_active":"2023-10-03T10:11:26.409861+0000","last_peered":"2023-10-03T10:11:26.409861+0000","last_clean":"2023-10-03T10:11:26.409861+0000","last_became_active":"2023-10-03T10:09:14.720802+0000","last_became_peered":"2023-10-03T10:09:14.720802+0000","last_unstale":"2023-10-03T10:11:26.409861+0000","last_undegraded":"2023-10-03T10:11:26.409861+0000","last_fullsized":"2023-10-03T10:11:26.409861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135617+0000","last_change":"2023-10-03T10:09:14.712170+0000","last_active":"2023-10-03T10:11:26.135617+0000","last_peered":"2023-10-03T10:11:26.135617+0000","last_clean":"2023-10-03T10:11:26.135617+0000","last_became_active":"2023-10-03T10:09:14.711964+0000","last_became_peered":"2023-10-03T10:09:14.711964+0000","last_unstale":"2023-10-03T10:11:26.135617+0000","last_undegraded":"2023-10-03T10:11:26.135617+0000","last_fullsized":"2023-10-03T10:11:26.135617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318831+0000","last_change":"2023-10-03T10:09:14.717587+0000","last_active":"2023-10-03T10:11:25.318831+0000","last_peered":"2023-10-03T10:11:25.318831+0000","last_clean":"2023-10-03T10:11:25.318831+0000","last_became_active":"2023-10-03T10:09:14.717339+0000","last_became_peered":"2023-10-03T10:09:14.717339+0000","last_unstale":"2023-10-03T10:11:25.318831+0000","last_undegraded":"2023-10-03T10:11:25.318831+0000","last_fullsized":"2023-10-03T10:11:25.318831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409729+0000","last_change":"2023-10-03T10:09:14.728847+0000","last_active":"2023-10-03T10:11:26.409729+0000","last_peered":"2023-10-03T10:11:26.409729+0000","last_clean":"2023-10-03T10:11:26.409729+0000","last_became_active":"2023-10-03T10:09:14.725404+0000","last_became_peered":"2023-10-03T10:09:14.725404+0000","last_unstale":"2023-10-03T10:11:26.409729+0000","last_undegraded":"2023-10-03T10:11:26.409729+0000","last_fullsized":"2023-10-03T10:11:26.409729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410444+0000","last_change":"2023-10-03T10:09:14.718621+0000","last_active":"2023-10-03T10:11:26.410444+0000","last_peered":"2023-10-03T10:11:26.410444+0000","last_clean":"2023-10-03T10:11:26.410444+0000","last_became_active":"2023-10-03T10:09:14.718361+0000","last_became_peered":"2023-10-03T10:09:14.718361+0000","last_unstale":"2023-10-03T10:11:26.410444+0000","last_undegraded":"2023-10-03T10:11:26.410444+0000","last_fullsized":"2023-10-03T10:11:26.410444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410430+0000","last_change":"2023-10-03T10:09:14.707751+0000","last_active":"2023-10-03T10:11:26.410430+0000","last_peered":"2023-10-03T10:11:26.410430+0000","last_clean":"2023-10-03T10:11:26.410430+0000","last_became_active":"2023-10-03T10:09:14.707489+0000","last_became_peered":"2023-10-03T10:09:14.707489+0000","last_unstale":"2023-10-03T10:11:26.410430+0000","last_undegraded":"2023-10-03T10:11:26.410430+0000","last_fullsized":"2023-10-03T10:11:26.410430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319491+0000","last_change":"2023-10-03T10:09:14.724017+0000","last_active":"2023-10-03T10:11:25.319491+0000","last_peered":"2023-10-03T10:11:25.319491+0000","last_clean":"2023-10-03T10:11:25.319491+0000","last_became_active":"2023-10-03T10:09:14.723540+0000","last_became_peered":"2023-10-03T10:09:14.723540+0000","last_unstale":"2023-10-03T10:11:25.319491+0000","last_undegraded":"2023-10-03T10:11:25.319491+0000","last_fullsized":"2023-10-03T10:11:25.319491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409847+0000","last_change":"2023-10-03T10:09:14.354052+0000","last_active":"2023-10-03T10:11:26.409847+0000","last_peered":"2023-10-03T10:11:26.409847+0000","last_clean":"2023-10-03T10:11:26.409847+0000","last_became_active":"2023-10-03T10:09:14.353765+0000","last_became_peered":"2023-10-03T10:09:14.353765+0000","last_unstale":"2023-10-03T10:11:26.409847+0000","last_undegraded":"2023-10-03T10:11:26.409847+0000","last_fullsized":"2023-10-03T10:11:26.409847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319527+0000","last_change":"2023-10-03T10:09:14.731372+0000","last_active":"2023-10-03T10:11:25.319527+0000","last_peered":"2023-10-03T10:11:25.319527+0000","last_clean":"2023-10-03T10:11:25.319527+0000","last_became_active":"2023-10-03T10:09:14.730476+0000","last_became_peered":"2023-10-03T10:09:14.730476+0000","last_unstale":"2023-10-03T10:11:25.319527+0000","last_undegraded":"2023-10-03T10:11:25.319527+0000","last_fullsized":"2023-10-03T10:11:25.319527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409660+0000","last_change":"2023-10-03T10:09:14.340525+0000","last_active":"2023-10-03T10:11:26.409660+0000","last_peered":"2023-10-03T10:11:26.409660+0000","last_clean":"2023-10-03T10:11:26.409660+0000","last_became_active":"2023-10-03T10:09:14.340215+0000","last_became_peered":"2023-10-03T10:09:14.340215+0000","last_unstale":"2023-10-03T10:11:26.409660+0000","last_undegraded":"2023-10-03T10:11:26.409660+0000","last_fullsized":"2023-10-03T10:11:26.409660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136517+0000","last_change":"2023-10-03T10:09:14.717045+0000","last_active":"2023-10-03T10:11:26.136517+0000","last_peered":"2023-10-03T10:11:26.136517+0000","last_clean":"2023-10-03T10:11:26.136517+0000","last_became_active":"2023-10-03T10:09:14.716120+0000","last_became_peered":"2023-10-03T10:09:14.716120+0000","last_unstale":"2023-10-03T10:11:26.136517+0000","last_undegraded":"2023-10-03T10:11:26.136517+0000","last_fullsized":"2023-10-03T10:11:26.136517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318947+0000","last_change":"2023-10-03T10:09:14.345802+0000","last_active":"2023-10-03T10:11:25.318947+0000","last_peered":"2023-10-03T10:11:25.318947+0000","last_clean":"2023-10-03T10:11:25.318947+0000","last_became_active":"2023-10-03T10:09:14.345529+0000","last_became_peered":"2023-10-03T10:09:14.345529+0000","last_unstale":"2023-10-03T10:11:25.318947+0000","last_undegraded":"2023-10-03T10:11:25.318947+0000","last_fullsized":"2023-10-03T10:11:25.318947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319889+0000","last_change":"2023-10-03T10:09:14.729797+0000","last_active":"2023-10-03T10:11:25.319889+0000","last_peered":"2023-10-03T10:11:25.319889+0000","last_clean":"2023-10-03T10:11:25.319889+0000","last_became_active":"2023-10-03T10:09:14.729212+0000","last_became_peered":"2023-10-03T10:09:14.729212+0000","last_unstale":"2023-10-03T10:11:25.319889+0000","last_undegraded":"2023-10-03T10:11:25.319889+0000","last_fullsized":"2023-10-03T10:11:25.319889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136998+0000","last_change":"2023-10-03T10:09:14.343788+0000","last_active":"2023-10-03T10:11:26.136998+0000","last_peered":"2023-10-03T10:11:26.136998+0000","last_clean":"2023-10-03T10:11:26.136998+0000","last_became_active":"2023-10-03T10:09:14.343495+0000","last_became_peered":"2023-10-03T10:09:14.343495+0000","last_unstale":"2023-10-03T10:11:26.136998+0000","last_undegraded":"2023-10-03T10:11:26.136998+0000","last_fullsized":"2023-10-03T10:11:26.136998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159231+0000","last_change":"2023-10-03T10:10:04.994717+0000","last_active":"2023-10-03T10:11:27.159231+0000","last_peered":"2023-10-03T10:11:27.159231+0000","last_clean":"2023-10-03T10:11:27.159231+0000","last_became_active":"2023-10-03T10:10:04.994414+0000","last_became_peered":"2023-10-03T10:10:04.994414+0000","last_unstale":"2023-10-03T10:11:27.159231+0000","last_undegraded":"2023-10-03T10:11:27.159231+0000","last_fullsized":"2023-10-03T10:11:27.159231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159826+0000","last_change":"2023-10-03T10:09:14.339768+0000","last_active":"2023-10-03T10:11:27.159826+0000","last_peered":"2023-10-03T10:11:27.159826+0000","last_clean":"2023-10-03T10:11:27.159826+0000","last_became_active":"2023-10-03T10:09:14.339501+0000","last_became_peered":"2023-10-03T10:09:14.339501+0000","last_unstale":"2023-10-03T10:11:27.159826+0000","last_undegraded":"2023-10-03T10:11:27.159826+0000","last_fullsized":"2023-10-03T10:11:27.159826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319037+0000","last_change":"2023-10-03T10:09:14.723237+0000","last_active":"2023-10-03T10:11:25.319037+0000","last_peered":"2023-10-03T10:11:25.319037+0000","last_clean":"2023-10-03T10:11:25.319037+0000","last_became_active":"2023-10-03T10:09:14.722881+0000","last_became_peered":"2023-10-03T10:09:14.722881+0000","last_unstale":"2023-10-03T10:11:25.319037+0000","last_undegraded":"2023-10-03T10:11:25.319037+0000","last_fullsized":"2023-10-03T10:11:25.319037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135967+0000","last_change":"2023-10-03T10:09:14.339824+0000","last_active":"2023-10-03T10:11:26.135967+0000","last_peered":"2023-10-03T10:11:26.135967+0000","last_clean":"2023-10-03T10:11:26.135967+0000","last_became_active":"2023-10-03T10:09:14.339560+0000","last_became_peered":"2023-10-03T10:09:14.339560+0000","last_unstale":"2023-10-03T10:11:26.135967+0000","last_undegraded":"2023-10-03T10:11:26.135967+0000","last_fullsized":"2023-10-03T10:11:26.135967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409972+0000","last_change":"2023-10-03T10:09:14.721025+0000","last_active":"2023-10-03T10:11:26.409972+0000","last_peered":"2023-10-03T10:11:26.409972+0000","last_clean":"2023-10-03T10:11:26.409972+0000","last_became_active":"2023-10-03T10:09:14.720762+0000","last_became_peered":"2023-10-03T10:09:14.720762+0000","last_unstale":"2023-10-03T10:11:26.409972+0000","last_undegraded":"2023-10-03T10:11:26.409972+0000","last_fullsized":"2023-10-03T10:11:26.409972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'12","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T10:11:30.061160+0000","last_change":"2023-10-03T10:09:14.346629+0000","last_active":"2023-10-03T10:11:30.061160+0000","last_peered":"2023-10-03T10:11:30.061160+0000","last_clean":"2023-10-03T10:11:30.061160+0000","last_became_active":"2023-10-03T10:09:14.346335+0000","last_became_peered":"2023-10-03T10:09:14.346335+0000","last_unstale":"2023-10-03T10:11:30.061160+0000","last_undegraded":"2023-10-03T10:11:30.061160+0000","last_fullsized":"2023-10-03T10:11:30.061160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159696+0000","last_change":"2023-10-03T10:09:14.724074+0000","last_active":"2023-10-03T10:11:27.159696+0000","last_peered":"2023-10-03T10:11:27.159696+0000","last_clean":"2023-10-03T10:11:27.159696+0000","last_became_active":"2023-10-03T10:09:14.723284+0000","last_became_peered":"2023-10-03T10:09:14.723284+0000","last_unstale":"2023-10-03T10:11:27.159696+0000","last_undegraded":"2023-10-03T10:11:27.159696+0000","last_fullsized":"2023-10-03T10:11:27.159696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319275+0000","last_change":"2023-10-03T10:09:14.353282+0000","last_active":"2023-10-03T10:11:25.319275+0000","last_peered":"2023-10-03T10:11:25.319275+0000","last_clean":"2023-10-03T10:11:25.319275+0000","last_became_active":"2023-10-03T10:09:14.352586+0000","last_became_peered":"2023-10-03T10:09:14.352586+0000","last_unstale":"2023-10-03T10:11:25.319275+0000","last_undegraded":"2023-10-03T10:11:25.319275+0000","last_fullsized":"2023-10-03T10:11:25.319275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319481+0000","last_change":"2023-10-03T10:09:14.729509+0000","last_active":"2023-10-03T10:11:25.319481+0000","last_peered":"2023-10-03T10:11:25.319481+0000","last_clean":"2023-10-03T10:11:25.319481+0000","last_became_active":"2023-10-03T10:09:14.729254+0000","last_became_peered":"2023-10-03T10:09:14.729254+0000","last_unstale":"2023-10-03T10:11:25.319481+0000","last_undegraded":"2023-10-03T10:11:25.319481+0000","last_fullsized":"2023-10-03T10:11:25.319481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135700+0000","last_change":"2023-10-03T10:09:14.343728+0000","last_active":"2023-10-03T10:11:26.135700+0000","last_peered":"2023-10-03T10:11:26.135700+0000","last_clean":"2023-10-03T10:11:26.135700+0000","last_became_active":"2023-10-03T10:09:14.343444+0000","last_became_peered":"2023-10-03T10:09:14.343444+0000","last_unstale":"2023-10-03T10:11:26.135700+0000","last_undegraded":"2023-10-03T10:11:26.135700+0000","last_fullsized":"2023-10-03T10:11:26.135700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319572+0000","last_change":"2023-10-03T10:09:14.724168+0000","last_active":"2023-10-03T10:11:25.319572+0000","last_peered":"2023-10-03T10:11:25.319572+0000","last_clean":"2023-10-03T10:11:25.319572+0000","last_became_active":"2023-10-03T10:09:14.723777+0000","last_became_peered":"2023-10-03T10:09:14.723777+0000","last_unstale":"2023-10-03T10:11:25.319572+0000","last_undegraded":"2023-10-03T10:11:25.319572+0000","last_fullsized":"2023-10-03T10:11:25.319572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319034+0000","last_change":"2023-10-03T10:09:14.346628+0000","last_active":"2023-10-03T10:11:25.319034+0000","last_peered":"2023-10-03T10:11:25.319034+0000","last_clean":"2023-10-03T10:11:25.319034+0000","last_became_active":"2023-10-03T10:09:14.346352+0000","last_became_peered":"2023-10-03T10:09:14.346352+0000","last_unstale":"2023-10-03T10:11:25.319034+0000","last_undegraded":"2023-10-03T10:11:25.319034+0000","last_fullsized":"2023-10-03T10:11:25.319034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136656+0000","last_change":"2023-10-03T10:09:14.717361+0000","last_active":"2023-10-03T10:11:26.136656+0000","last_peered":"2023-10-03T10:11:26.136656+0000","last_clean":"2023-10-03T10:11:26.136656+0000","last_became_active":"2023-10-03T10:09:14.716635+0000","last_became_peered":"2023-10-03T10:09:14.716635+0000","last_unstale":"2023-10-03T10:11:26.136656+0000","last_undegraded":"2023-10-03T10:11:26.136656+0000","last_fullsized":"2023-10-03T10:11:26.136656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409929+0000","last_change":"2023-10-03T10:09:14.344594+0000","last_active":"2023-10-03T10:11:26.409929+0000","last_peered":"2023-10-03T10:11:26.409929+0000","last_clean":"2023-10-03T10:11:26.409929+0000","last_became_active":"2023-10-03T10:09:14.344319+0000","last_became_peered":"2023-10-03T10:09:14.344319+0000","last_unstale":"2023-10-03T10:11:26.409929+0000","last_undegraded":"2023-10-03T10:11:26.409929+0000","last_fullsized":"2023-10-03T10:11:26.409929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319881+0000","last_change":"2023-10-03T10:09:14.729964+0000","last_active":"2023-10-03T10:11:25.319881+0000","last_peered":"2023-10-03T10:11:25.319881+0000","last_clean":"2023-10-03T10:11:25.319881+0000","last_became_active":"2023-10-03T10:09:14.729548+0000","last_became_peered":"2023-10-03T10:09:14.729548+0000","last_unstale":"2023-10-03T10:11:25.319881+0000","last_undegraded":"2023-10-03T10:11:25.319881+0000","last_fullsized":"2023-10-03T10:11:25.319881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136820+0000","last_change":"2023-10-03T10:09:14.344297+0000","last_active":"2023-10-03T10:11:26.136820+0000","last_peered":"2023-10-03T10:11:26.136820+0000","last_clean":"2023-10-03T10:11:26.136820+0000","last_became_active":"2023-10-03T10:09:14.344040+0000","last_became_peered":"2023-10-03T10:09:14.344040+0000","last_unstale":"2023-10-03T10:11:26.136820+0000","last_undegraded":"2023-10-03T10:11:26.136820+0000","last_fullsized":"2023-10-03T10:11:26.136820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318979+0000","last_change":"2023-10-03T10:09:14.734141+0000","last_active":"2023-10-03T10:11:25.318979+0000","last_peered":"2023-10-03T10:11:25.318979+0000","last_clean":"2023-10-03T10:11:25.318979+0000","last_became_active":"2023-10-03T10:09:14.733955+0000","last_became_peered":"2023-10-03T10:09:14.733955+0000","last_unstale":"2023-10-03T10:11:25.318979+0000","last_undegraded":"2023-10-03T10:11:25.318979+0000","last_fullsized":"2023-10-03T10:11:25.318979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159902+0000","last_change":"2023-10-03T10:09:14.345399+0000","last_active":"2023-10-03T10:11:27.159902+0000","last_peered":"2023-10-03T10:11:27.159902+0000","last_clean":"2023-10-03T10:11:27.159902+0000","last_became_active":"2023-10-03T10:09:14.345110+0000","last_became_peered":"2023-10-03T10:09:14.345110+0000","last_unstale":"2023-10-03T10:11:27.159902+0000","last_undegraded":"2023-10-03T10:11:27.159902+0000","last_fullsized":"2023-10-03T10:11:27.159902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409687+0000","last_change":"2023-10-03T10:10:04.996928+0000","last_active":"2023-10-03T10:11:26.409687+0000","last_peered":"2023-10-03T10:11:26.409687+0000","last_clean":"2023-10-03T10:11:26.409687+0000","last_became_active":"2023-10-03T10:10:04.996578+0000","last_became_peered":"2023-10-03T10:10:04.996578+0000","last_unstale":"2023-10-03T10:11:26.409687+0000","last_undegraded":"2023-10-03T10:11:26.409687+0000","last_fullsized":"2023-10-03T10:11:26.409687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319672+0000","last_change":"2023-10-03T10:09:14.345375+0000","last_active":"2023-10-03T10:11:25.319672+0000","last_peered":"2023-10-03T10:11:25.319672+0000","last_clean":"2023-10-03T10:11:25.319672+0000","last_became_active":"2023-10-03T10:09:14.343897+0000","last_became_peered":"2023-10-03T10:09:14.343897+0000","last_unstale":"2023-10-03T10:11:25.319672+0000","last_undegraded":"2023-10-03T10:11:25.319672+0000","last_fullsized":"2023-10-03T10:11:25.319672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159597+0000","last_change":"2023-10-03T10:09:14.715812+0000","last_active":"2023-10-03T10:11:27.159597+0000","last_peered":"2023-10-03T10:11:27.159597+0000","last_clean":"2023-10-03T10:11:27.159597+0000","last_became_active":"2023-10-03T10:09:14.715548+0000","last_became_peered":"2023-10-03T10:09:14.715548+0000","last_unstale":"2023-10-03T10:11:27.159597+0000","last_undegraded":"2023-10-03T10:11:27.159597+0000","last_fullsized":"2023-10-03T10:11:27.159597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136156+0000","last_change":"2023-10-03T10:09:14.343714+0000","last_active":"2023-10-03T10:11:26.136156+0000","last_peered":"2023-10-03T10:11:26.136156+0000","last_clean":"2023-10-03T10:11:26.136156+0000","last_became_active":"2023-10-03T10:09:14.343419+0000","last_became_peered":"2023-10-03T10:09:14.343419+0000","last_unstale":"2023-10-03T10:11:26.136156+0000","last_undegraded":"2023-10-03T10:11:26.136156+0000","last_fullsized":"2023-10-03T10:11:26.136156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136710+0000","last_change":"2023-10-03T10:09:14.710007+0000","last_active":"2023-10-03T10:11:26.136710+0000","last_peered":"2023-10-03T10:11:26.136710+0000","last_clean":"2023-10-03T10:11:26.136710+0000","last_became_active":"2023-10-03T10:09:14.708147+0000","last_became_peered":"2023-10-03T10:09:14.708147+0000","last_unstale":"2023-10-03T10:11:26.136710+0000","last_undegraded":"2023-10-03T10:11:26.136710+0000","last_fullsized":"2023-10-03T10:11:26.136710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319181+0000","last_change":"2023-10-03T10:09:14.353447+0000","last_active":"2023-10-03T10:11:25.319181+0000","last_peered":"2023-10-03T10:11:25.319181+0000","last_clean":"2023-10-03T10:11:25.319181+0000","last_became_active":"2023-10-03T10:09:14.352906+0000","last_became_peered":"2023-10-03T10:09:14.352906+0000","last_unstale":"2023-10-03T10:11:25.319181+0000","last_undegraded":"2023-10-03T10:11:25.319181+0000","last_fullsized":"2023-10-03T10:11:25.319181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136080+0000","last_change":"2023-10-03T10:10:04.994710+0000","last_active":"2023-10-03T10:11:26.136080+0000","last_peered":"2023-10-03T10:11:26.136080+0000","last_clean":"2023-10-03T10:11:26.136080+0000","last_became_active":"2023-10-03T10:10:04.994236+0000","last_became_peered":"2023-10-03T10:10:04.994236+0000","last_unstale":"2023-10-03T10:11:26.136080+0000","last_undegraded":"2023-10-03T10:11:26.136080+0000","last_fullsized":"2023-10-03T10:11:26.136080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319099+0000","last_change":"2023-10-03T10:09:14.347268+0000","last_active":"2023-10-03T10:11:25.319099+0000","last_peered":"2023-10-03T10:11:25.319099+0000","last_clean":"2023-10-03T10:11:25.319099+0000","last_became_active":"2023-10-03T10:09:14.346969+0000","last_became_peered":"2023-10-03T10:09:14.346969+0000","last_unstale":"2023-10-03T10:11:25.319099+0000","last_undegraded":"2023-10-03T10:11:25.319099+0000","last_fullsized":"2023-10-03T10:11:25.319099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159697+0000","last_change":"2023-10-03T10:10:04.994243+0000","last_active":"2023-10-03T10:11:27.159697+0000","last_peered":"2023-10-03T10:11:27.159697+0000","last_clean":"2023-10-03T10:11:27.159697+0000","last_became_active":"2023-10-03T10:10:04.993946+0000","last_became_peered":"2023-10-03T10:10:04.993946+0000","last_unstale":"2023-10-03T10:11:27.159697+0000","last_undegraded":"2023-10-03T10:11:27.159697+0000","last_fullsized":"2023-10-03T10:11:27.159697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318942+0000","last_change":"2023-10-03T10:09:14.346668+0000","last_active":"2023-10-03T10:11:25.318942+0000","last_peered":"2023-10-03T10:11:25.318942+0000","last_clean":"2023-10-03T10:11:25.318942+0000","last_became_active":"2023-10-03T10:09:14.346390+0000","last_became_peered":"2023-10-03T10:09:14.346390+0000","last_unstale":"2023-10-03T10:11:25.318942+0000","last_undegraded":"2023-10-03T10:11:25.318942+0000","last_fullsized":"2023-10-03T10:11:25.318942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159943+0000","last_change":"2023-10-03T10:09:14.716337+0000","last_active":"2023-10-03T10:11:27.159943+0000","last_peered":"2023-10-03T10:11:27.159943+0000","last_clean":"2023-10-03T10:11:27.159943+0000","last_became_active":"2023-10-03T10:09:14.716083+0000","last_became_peered":"2023-10-03T10:09:14.716083+0000","last_unstale":"2023-10-03T10:11:27.159943+0000","last_undegraded":"2023-10-03T10:11:27.159943+0000","last_fullsized":"2023-10-03T10:11:27.159943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318733+0000","last_change":"2023-10-03T10:09:14.344515+0000","last_active":"2023-10-03T10:11:25.318733+0000","last_peered":"2023-10-03T10:11:25.318733+0000","last_clean":"2023-10-03T10:11:25.318733+0000","last_became_active":"2023-10-03T10:09:14.344244+0000","last_became_peered":"2023-10-03T10:09:14.344244+0000","last_unstale":"2023-10-03T10:11:25.318733+0000","last_undegraded":"2023-10-03T10:11:25.318733+0000","last_fullsized":"2023-10-03T10:11:25.318733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410370+0000","last_change":"2023-10-03T10:09:14.723005+0000","last_active":"2023-10-03T10:11:26.410370+0000","last_peered":"2023-10-03T10:11:26.410370+0000","last_clean":"2023-10-03T10:11:26.410370+0000","last_became_active":"2023-10-03T10:09:14.720579+0000","last_became_peered":"2023-10-03T10:09:14.720579+0000","last_unstale":"2023-10-03T10:11:26.410370+0000","last_undegraded":"2023-10-03T10:11:26.410370+0000","last_fullsized":"2023-10-03T10:11:26.410370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410285+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:11:26.410285+0000","last_peered":"2023-10-03T10:11:26.410285+0000","last_clean":"2023-10-03T10:11:26.410285+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:11:26.410285+0000","last_undegraded":"2023-10-03T10:11:26.410285+0000","last_fullsized":"2023-10-03T10:11:26.410285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159849+0000","last_change":"2023-10-03T10:09:14.344817+0000","last_active":"2023-10-03T10:11:27.159849+0000","last_peered":"2023-10-03T10:11:27.159849+0000","last_clean":"2023-10-03T10:11:27.159849+0000","last_became_active":"2023-10-03T10:09:14.344547+0000","last_became_peered":"2023-10-03T10:09:14.344547+0000","last_unstale":"2023-10-03T10:11:27.159849+0000","last_undegraded":"2023-10-03T10:11:27.159849+0000","last_fullsized":"2023-10-03T10:11:27.159849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409942+0000","last_change":"2023-10-03T10:09:14.721039+0000","last_active":"2023-10-03T10:11:26.409942+0000","last_peered":"2023-10-03T10:11:26.409942+0000","last_clean":"2023-10-03T10:11:26.409942+0000","last_became_active":"2023-10-03T10:09:14.720876+0000","last_became_peered":"2023-10-03T10:09:14.720876+0000","last_unstale":"2023-10-03T10:11:26.409942+0000","last_undegraded":"2023-10-03T10:11:26.409942+0000","last_fullsized":"2023-10-03T10:11:26.409942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319178+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:11:25.319178+0000","last_peered":"2023-10-03T10:11:25.319178+0000","last_clean":"2023-10-03T10:11:25.319178+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:11:25.319178+0000","last_undegraded":"2023-10-03T10:11:25.319178+0000","last_fullsized":"2023-10-03T10:11:25.319178+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136464+0000","last_change":"2023-10-03T10:09:14.351814+0000","last_active":"2023-10-03T10:11:26.136464+0000","last_peered":"2023-10-03T10:11:26.136464+0000","last_clean":"2023-10-03T10:11:26.136464+0000","last_became_active":"2023-10-03T10:09:14.351588+0000","last_became_peered":"2023-10-03T10:09:14.351588+0000","last_unstale":"2023-10-03T10:11:26.136464+0000","last_undegraded":"2023-10-03T10:11:26.136464+0000","last_fullsized":"2023-10-03T10:11:26.136464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410116+0000","last_change":"2023-10-03T10:09:14.708011+0000","last_active":"2023-10-03T10:11:26.410116+0000","last_peered":"2023-10-03T10:11:26.410116+0000","last_clean":"2023-10-03T10:11:26.410116+0000","last_became_active":"2023-10-03T10:09:14.707425+0000","last_became_peered":"2023-10-03T10:09:14.707425+0000","last_unstale":"2023-10-03T10:11:26.410116+0000","last_undegraded":"2023-10-03T10:11:26.410116+0000","last_fullsized":"2023-10-03T10:11:26.410116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159157+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:11:27.159157+0000","last_peered":"2023-10-03T10:11:27.159157+0000","last_clean":"2023-10-03T10:11:27.159157+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:11:27.159157+0000","last_undegraded":"2023-10-03T10:11:27.159157+0000","last_fullsized":"2023-10-03T10:11:27.159157+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409833+0000","last_change":"2023-10-03T10:09:14.351636+0000","last_active":"2023-10-03T10:11:26.409833+0000","last_peered":"2023-10-03T10:11:26.409833+0000","last_clean":"2023-10-03T10:11:26.409833+0000","last_became_active":"2023-10-03T10:09:14.351360+0000","last_became_peered":"2023-10-03T10:09:14.351360+0000","last_unstale":"2023-10-03T10:11:26.409833+0000","last_undegraded":"2023-10-03T10:11:26.409833+0000","last_fullsized":"2023-10-03T10:11:26.409833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410448+0000","last_change":"2023-10-03T10:09:14.726543+0000","last_active":"2023-10-03T10:11:26.410448+0000","last_peered":"2023-10-03T10:11:26.410448+0000","last_clean":"2023-10-03T10:11:26.410448+0000","last_became_active":"2023-10-03T10:09:14.726287+0000","last_became_peered":"2023-10-03T10:09:14.726287+0000","last_unstale":"2023-10-03T10:11:26.410448+0000","last_undegraded":"2023-10-03T10:11:26.410448+0000","last_fullsized":"2023-10-03T10:11:26.410448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319231+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:11:25.319231+0000","last_peered":"2023-10-03T10:11:25.319231+0000","last_clean":"2023-10-03T10:11:25.319231+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:11:25.319231+0000","last_undegraded":"2023-10-03T10:11:25.319231+0000","last_fullsized":"2023-10-03T10:11:25.319231+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409747+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:11:26.409747+0000","last_peered":"2023-10-03T10:11:26.409747+0000","last_clean":"2023-10-03T10:11:26.409747+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:11:26.409747+0000","last_undegraded":"2023-10-03T10:11:26.409747+0000","last_fullsized":"2023-10-03T10:11:26.409747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319055+0000","last_change":"2023-10-03T10:09:14.347133+0000","last_active":"2023-10-03T10:11:25.319055+0000","last_peered":"2023-10-03T10:11:25.319055+0000","last_clean":"2023-10-03T10:11:25.319055+0000","last_became_active":"2023-10-03T10:09:14.346671+0000","last_became_peered":"2023-10-03T10:09:14.346671+0000","last_unstale":"2023-10-03T10:11:25.319055+0000","last_undegraded":"2023-10-03T10:11:25.319055+0000","last_fullsized":"2023-10-03T10:11:25.319055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319743+0000","last_change":"2023-10-03T10:09:14.731621+0000","last_active":"2023-10-03T10:11:25.319743+0000","last_peered":"2023-10-03T10:11:25.319743+0000","last_clean":"2023-10-03T10:11:25.319743+0000","last_became_active":"2023-10-03T10:09:14.731155+0000","last_became_peered":"2023-10-03T10:09:14.731155+0000","last_unstale":"2023-10-03T10:11:25.319743+0000","last_undegraded":"2023-10-03T10:11:25.319743+0000","last_fullsized":"2023-10-03T10:11:25.319743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318848+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:11:25.318848+0000","last_peered":"2023-10-03T10:11:25.318848+0000","last_clean":"2023-10-03T10:11:25.318848+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:11:25.318848+0000","last_undegraded":"2023-10-03T10:11:25.318848+0000","last_fullsized":"2023-10-03T10:11:25.318848+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135567+0000","last_change":"2023-10-03T10:09:14.345534+0000","last_active":"2023-10-03T10:11:26.135567+0000","last_peered":"2023-10-03T10:11:26.135567+0000","last_clean":"2023-10-03T10:11:26.135567+0000","last_became_active":"2023-10-03T10:09:14.344896+0000","last_became_peered":"2023-10-03T10:09:14.344896+0000","last_unstale":"2023-10-03T10:11:26.135567+0000","last_undegraded":"2023-10-03T10:11:26.135567+0000","last_fullsized":"2023-10-03T10:11:26.135567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136740+0000","last_change":"2023-10-03T10:09:14.716877+0000","last_active":"2023-10-03T10:11:26.136740+0000","last_peered":"2023-10-03T10:11:26.136740+0000","last_clean":"2023-10-03T10:11:26.136740+0000","last_became_active":"2023-10-03T10:09:14.715861+0000","last_became_peered":"2023-10-03T10:09:14.715861+0000","last_unstale":"2023-10-03T10:11:26.136740+0000","last_undegraded":"2023-10-03T10:11:26.136740+0000","last_fullsized":"2023-10-03T10:11:26.136740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319643+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:11:25.319643+0000","last_peered":"2023-10-03T10:11:25.319643+0000","last_clean":"2023-10-03T10:11:25.319643+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:11:25.319643+0000","last_undegraded":"2023-10-03T10:11:25.319643+0000","last_fullsized":"2023-10-03T10:11:25.319643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410086+0000","last_change":"2023-10-03T10:09:14.352568+0000","last_active":"2023-10-03T10:11:26.410086+0000","last_peered":"2023-10-03T10:11:26.410086+0000","last_clean":"2023-10-03T10:11:26.410086+0000","last_became_active":"2023-10-03T10:09:14.352349+0000","last_became_peered":"2023-10-03T10:09:14.352349+0000","last_unstale":"2023-10-03T10:11:26.410086+0000","last_undegraded":"2023-10-03T10:11:26.410086+0000","last_fullsized":"2023-10-03T10:11:26.410086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136632+0000","last_change":"2023-10-03T10:09:14.710656+0000","last_active":"2023-10-03T10:11:26.136632+0000","last_peered":"2023-10-03T10:11:26.136632+0000","last_clean":"2023-10-03T10:11:26.136632+0000","last_became_active":"2023-10-03T10:09:14.710425+0000","last_became_peered":"2023-10-03T10:09:14.710425+0000","last_unstale":"2023-10-03T10:11:26.136632+0000","last_undegraded":"2023-10-03T10:11:26.136632+0000","last_fullsized":"2023-10-03T10:11:26.136632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319798+0000","last_change":"2023-10-03T10:09:14.346884+0000","last_active":"2023-10-03T10:11:25.319798+0000","last_peered":"2023-10-03T10:11:25.319798+0000","last_clean":"2023-10-03T10:11:25.319798+0000","last_became_active":"2023-10-03T10:09:14.346598+0000","last_became_peered":"2023-10-03T10:09:14.346598+0000","last_unstale":"2023-10-03T10:11:25.319798+0000","last_undegraded":"2023-10-03T10:11:25.319798+0000","last_fullsized":"2023-10-03T10:11:25.319798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410389+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:11:26.410389+0000","last_peered":"2023-10-03T10:11:26.410389+0000","last_clean":"2023-10-03T10:11:26.410389+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:11:26.410389+0000","last_undegraded":"2023-10-03T10:11:26.410389+0000","last_fullsized":"2023-10-03T10:11:26.410389+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318832+0000","last_change":"2023-10-03T10:09:14.733924+0000","last_active":"2023-10-03T10:11:25.318832+0000","last_peered":"2023-10-03T10:11:25.318832+0000","last_clean":"2023-10-03T10:11:25.318832+0000","last_became_active":"2023-10-03T10:09:14.733635+0000","last_became_peered":"2023-10-03T10:09:14.733635+0000","last_unstale":"2023-10-03T10:11:25.318832+0000","last_undegraded":"2023-10-03T10:11:25.318832+0000","last_fullsized":"2023-10-03T10:11:25.318832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319824+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:11:25.319824+0000","last_peered":"2023-10-03T10:11:25.319824+0000","last_clean":"2023-10-03T10:11:25.319824+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:11:25.319824+0000","last_undegraded":"2023-10-03T10:11:25.319824+0000","last_fullsized":"2023-10-03T10:11:25.319824+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136431+0000","last_change":"2023-10-03T10:09:14.350895+0000","last_active":"2023-10-03T10:11:26.136431+0000","last_peered":"2023-10-03T10:11:26.136431+0000","last_clean":"2023-10-03T10:11:26.136431+0000","last_became_active":"2023-10-03T10:09:14.350426+0000","last_became_peered":"2023-10-03T10:09:14.350426+0000","last_unstale":"2023-10-03T10:11:26.136431+0000","last_undegraded":"2023-10-03T10:11:26.136431+0000","last_fullsized":"2023-10-03T10:11:26.136431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159475+0000","last_change":"2023-10-03T10:09:14.714464+0000","last_active":"2023-10-03T10:11:27.159475+0000","last_peered":"2023-10-03T10:11:27.159475+0000","last_clean":"2023-10-03T10:11:27.159475+0000","last_became_active":"2023-10-03T10:09:14.714221+0000","last_became_peered":"2023-10-03T10:09:14.714221+0000","last_unstale":"2023-10-03T10:11:27.159475+0000","last_undegraded":"2023-10-03T10:11:27.159475+0000","last_fullsized":"2023-10-03T10:11:27.159475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136551+0000","last_change":"2023-10-03T10:09:14.351366+0000","last_active":"2023-10-03T10:11:26.136551+0000","last_peered":"2023-10-03T10:11:26.136551+0000","last_clean":"2023-10-03T10:11:26.136551+0000","last_became_active":"2023-10-03T10:09:14.350445+0000","last_became_peered":"2023-10-03T10:09:14.350445+0000","last_unstale":"2023-10-03T10:11:26.136551+0000","last_undegraded":"2023-10-03T10:11:26.136551+0000","last_fullsized":"2023-10-03T10:11:26.136551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159741+0000","last_change":"2023-10-03T10:09:14.707995+0000","last_active":"2023-10-03T10:11:27.159741+0000","last_peered":"2023-10-03T10:11:27.159741+0000","last_clean":"2023-10-03T10:11:27.159741+0000","last_became_active":"2023-10-03T10:09:14.707723+0000","last_became_peered":"2023-10-03T10:09:14.707723+0000","last_unstale":"2023-10-03T10:11:27.159741+0000","last_undegraded":"2023-10-03T10:11:27.159741+0000","last_fullsized":"2023-10-03T10:11:27.159741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410173+0000","last_change":"2023-10-03T10:09:14.345357+0000","last_active":"2023-10-03T10:11:26.410173+0000","last_peered":"2023-10-03T10:11:26.410173+0000","last_clean":"2023-10-03T10:11:26.410173+0000","last_became_active":"2023-10-03T10:09:14.344951+0000","last_became_peered":"2023-10-03T10:09:14.344951+0000","last_unstale":"2023-10-03T10:11:26.410173+0000","last_undegraded":"2023-10-03T10:11:26.410173+0000","last_fullsized":"2023-10-03T10:11:26.410173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159828+0000","last_change":"2023-10-03T10:09:14.724291+0000","last_active":"2023-10-03T10:11:27.159828+0000","last_peered":"2023-10-03T10:11:27.159828+0000","last_clean":"2023-10-03T10:11:27.159828+0000","last_became_active":"2023-10-03T10:09:14.723559+0000","last_became_peered":"2023-10-03T10:09:14.723559+0000","last_unstale":"2023-10-03T10:11:27.159828+0000","last_undegraded":"2023-10-03T10:11:27.159828+0000","last_fullsized":"2023-10-03T10:11:27.159828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319695+0000","last_change":"2023-10-03T10:09:14.345918+0000","last_active":"2023-10-03T10:11:25.319695+0000","last_peered":"2023-10-03T10:11:25.319695+0000","last_clean":"2023-10-03T10:11:25.319695+0000","last_became_active":"2023-10-03T10:09:14.345634+0000","last_became_peered":"2023-10-03T10:09:14.345634+0000","last_unstale":"2023-10-03T10:11:25.319695+0000","last_undegraded":"2023-10-03T10:11:25.319695+0000","last_fullsized":"2023-10-03T10:11:25.319695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159553+0000","last_change":"2023-10-03T10:09:14.718860+0000","last_active":"2023-10-03T10:11:27.159553+0000","last_peered":"2023-10-03T10:11:27.159553+0000","last_clean":"2023-10-03T10:11:27.159553+0000","last_became_active":"2023-10-03T10:09:14.716545+0000","last_became_peered":"2023-10-03T10:09:14.716545+0000","last_unstale":"2023-10-03T10:11:27.159553+0000","last_undegraded":"2023-10-03T10:11:27.159553+0000","last_fullsized":"2023-10-03T10:11:27.159553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319597+0000","last_change":"2023-10-03T10:09:14.351568+0000","last_active":"2023-10-03T10:11:25.319597+0000","last_peered":"2023-10-03T10:11:25.319597+0000","last_clean":"2023-10-03T10:11:25.319597+0000","last_became_active":"2023-10-03T10:09:14.351293+0000","last_became_peered":"2023-10-03T10:09:14.351293+0000","last_unstale":"2023-10-03T10:11:25.319597+0000","last_undegraded":"2023-10-03T10:11:25.319597+0000","last_fullsized":"2023-10-03T10:11:25.319597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319123+0000","last_change":"2023-10-03T10:09:14.720328+0000","last_active":"2023-10-03T10:11:25.319123+0000","last_peered":"2023-10-03T10:11:25.319123+0000","last_clean":"2023-10-03T10:11:25.319123+0000","last_became_active":"2023-10-03T10:09:14.720033+0000","last_became_peered":"2023-10-03T10:09:14.720033+0000","last_unstale":"2023-10-03T10:11:25.319123+0000","last_undegraded":"2023-10-03T10:11:25.319123+0000","last_fullsized":"2023-10-03T10:11:25.319123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137081+0000","last_change":"2023-10-03T10:09:14.352301+0000","last_active":"2023-10-03T10:11:26.137081+0000","last_peered":"2023-10-03T10:11:26.137081+0000","last_clean":"2023-10-03T10:11:26.137081+0000","last_became_active":"2023-10-03T10:09:14.352027+0000","last_became_peered":"2023-10-03T10:09:14.352027+0000","last_unstale":"2023-10-03T10:11:26.137081+0000","last_undegraded":"2023-10-03T10:11:26.137081+0000","last_fullsized":"2023-10-03T10:11:26.137081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159305+0000","last_change":"2023-10-03T10:09:14.713576+0000","last_active":"2023-10-03T10:11:27.159305+0000","last_peered":"2023-10-03T10:11:27.159305+0000","last_clean":"2023-10-03T10:11:27.159305+0000","last_became_active":"2023-10-03T10:09:14.713175+0000","last_became_peered":"2023-10-03T10:09:14.713175+0000","last_unstale":"2023-10-03T10:11:27.159305+0000","last_undegraded":"2023-10-03T10:11:27.159305+0000","last_fullsized":"2023-10-03T10:11:27.159305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409910+0000","last_change":"2023-10-03T10:09:14.712406+0000","last_active":"2023-10-03T10:11:26.409910+0000","last_peered":"2023-10-03T10:11:26.409910+0000","last_clean":"2023-10-03T10:11:26.409910+0000","last_became_active":"2023-10-03T10:09:14.712076+0000","last_became_peered":"2023-10-03T10:09:14.712076+0000","last_unstale":"2023-10-03T10:11:26.409910+0000","last_undegraded":"2023-10-03T10:11:26.409910+0000","last_fullsized":"2023-10-03T10:11:26.409910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159317+0000","last_change":"2023-10-03T10:10:04.994212+0000","last_active":"2023-10-03T10:11:27.159317+0000","last_peered":"2023-10-03T10:11:27.159317+0000","last_clean":"2023-10-03T10:11:27.159317+0000","last_became_active":"2023-10-03T10:10:04.993913+0000","last_became_peered":"2023-10-03T10:10:04.993913+0000","last_unstale":"2023-10-03T10:11:27.159317+0000","last_undegraded":"2023-10-03T10:11:27.159317+0000","last_fullsized":"2023-10-03T10:11:27.159317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135785+0000","last_change":"2023-10-03T10:09:14.710814+0000","last_active":"2023-10-03T10:11:26.135785+0000","last_peered":"2023-10-03T10:11:26.135785+0000","last_clean":"2023-10-03T10:11:26.135785+0000","last_became_active":"2023-10-03T10:09:14.710640+0000","last_became_peered":"2023-10-03T10:09:14.710640+0000","last_unstale":"2023-10-03T10:11:26.135785+0000","last_undegraded":"2023-10-03T10:11:26.135785+0000","last_fullsized":"2023-10-03T10:11:26.135785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319315+0000","last_change":"2023-10-03T10:10:04.997102+0000","last_active":"2023-10-03T10:11:25.319315+0000","last_peered":"2023-10-03T10:11:25.319315+0000","last_clean":"2023-10-03T10:11:25.319315+0000","last_became_active":"2023-10-03T10:10:04.996741+0000","last_became_peered":"2023-10-03T10:10:04.996741+0000","last_unstale":"2023-10-03T10:11:25.319315+0000","last_undegraded":"2023-10-03T10:11:25.319315+0000","last_fullsized":"2023-10-03T10:11:25.319315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410194+0000","last_change":"2023-10-03T10:09:14.708167+0000","last_active":"2023-10-03T10:11:26.410194+0000","last_peered":"2023-10-03T10:11:26.410194+0000","last_clean":"2023-10-03T10:11:26.410194+0000","last_became_active":"2023-10-03T10:09:14.707761+0000","last_became_peered":"2023-10-03T10:09:14.707761+0000","last_unstale":"2023-10-03T10:11:26.410194+0000","last_undegraded":"2023-10-03T10:11:26.410194+0000","last_fullsized":"2023-10-03T10:11:26.410194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":71207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28100000000000003},"min":{"1min":0.218,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29199999999999998},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.307,"15min":0.30399999999999999},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48199999999999998,"5min":0.495,"15min":0.495},"last":0.47899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":71013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27100000000000002},"min":{"1min":0.20000000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.245},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.307,"15min":0.307},"min":{"1min":0.22900000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30199999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":68150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29199999999999998},"min":{"1min":0.215,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.26400000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.22,"15min":0.22},"max":{"1min":0.45700000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.439,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.253}]},{"osd":3,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.318,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.307,"15min":0.30399999999999999},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.314}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":68096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27700000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28100000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:33.590 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:33.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 Processor -- start 2023-10-03T10:11:33.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 -- start start 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 0x7f6b301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3006b2d0 con 0x7f6b301300a0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30133610 con 0x7f6b30133ad0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b3863e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3009a500 con 0x7f6b301309f0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b363da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b35bd9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 0x7f6b301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.744+0000 7f6b36bdb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53432/0 (socket says 172.21.15.125:53432) 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b35bd9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 0x7f6b301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34588/0 (socket says 172.21.15.125:34588) 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b36bdb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54566/0 (socket says 172.21.15.125:54566) 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 -- 172.21.15.125:0/3913490160 learned_addr learned my addr 172.21.15.125:0/3913490160 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 -- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 msgr2=0x7f6b3013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 -- 172.21.15.125:0/3913490160 >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 msgr2=0x7f6b301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 --2- 172.21.15.125:0/3913490160 >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 0x7f6b301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 -- 172.21.15.125:0/3913490160 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b301338b0 con 0x7f6b30133ad0 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b36bdb700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b363da700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098f0 tx=0x7f6b24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b40fc3ba1db987a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b353d8700 1 -- 172.21.15.125:0/3913490160 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24011830 con 0x7f6b30133ad0 2023-10-03T10:11:33.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b353d8700 1 -- 172.21.15.125:0/3913490160 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24011990 con 0x7f6b30133ad0 2023-10-03T10:11:33.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.745+0000 7f6b353d8700 1 -- 172.21.15.125:0/3913490160 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24011d20 con 0x7f6b30133ad0 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 -- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 msgr2=0x7f6b30133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098f0 tx=0x7f6b24009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 -- 172.21.15.125:0/3913490160 shutdown_connections 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b30133ad0 0x7f6b30133ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 --2- 172.21.15.125:0/3913490160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b3013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 --2- 172.21.15.125:0/3913490160 >> v2:172.21.15.125:3300/0 conn(0x7f6b301300a0 0x7f6b301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 -- 172.21.15.125:0/3913490160 >> 172.21.15.125:0/3913490160 conn(0x7f6b30099c40 msgr2=0x7f6b300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 -- 172.21.15.125:0/3913490160 shutdown_connections 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.746+0000 7f6b3863e700 1 -- 172.21.15.125:0/3913490160 wait complete. 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 Processor -- start 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 -- start start 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b30071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b30133ad0 0x7f6b30071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3011ff50 con 0x7f6b30133ad0 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300a3300 con 0x7f6b301300a0 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b3863e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3011f6e0 con 0x7f6b301309f0 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b363da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b363da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53434/0 (socket says 172.21.15.125:53434) 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b363da700 1 -- 172.21.15.125:0/2023431236 learned_addr learned my addr 172.21.15.125:0/2023431236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b35bd9700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b30071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.747+0000 7f6b36bdb700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b30133ad0 0x7f6b30071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 -- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 msgr2=0x7f6b30071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b30071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 -- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b30133ad0 msgr2=0x7f6b30071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b30133ad0 0x7f6b30071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 -- 172.21.15.125:0/2023431236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28009a70 con 0x7f6b301300a0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b35bd9700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b30071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b363da700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009c40 tx=0x7f6b24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24004450 con 0x7f6b301300a0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b240045d0 con 0x7f6b301300a0 2023-10-03T10:11:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b24009550 con 0x7f6b301300a0 2023-10-03T10:11:33.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240038e0 con 0x7f6b301300a0 2023-10-03T10:11:33.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.748+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3011e040 con 0x7f6b301300a0 2023-10-03T10:11:33.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.749+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f6b24003a40 con 0x7f6b301300a0 2023-10-03T10:11:33.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.749+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f6b24040ed0 con 0x7f6b301300a0 2023-10-03T10:11:33.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.749+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3009cb20 con 0x7f6b301300a0 2023-10-03T10:11:33.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.754+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b24015080 con 0x7f6b301300a0 2023-10-03T10:11:33.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.932+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 --> v1:172.21.15.125:6816/126957 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b3009ea90 con 0x7f6b1402f480 2023-10-03T10:11:33.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.939+0000 7f6b22ffd700 1 -- 172.21.15.125:0/2023431236 <== mgr.14180 v1:172.21.15.125:6816/126957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270354 (unknown 2965378022 0 3420561004) 0x7f6b2c009c10 con 0x7f6b1402f480 2023-10-03T10:11:33.942 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:33.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 >> v1:172.21.15.125:6816/126957 conn(0x7f6b1402f480 legacy=0x7f6b14031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 msgr2=0x7f6b30071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009c40 tx=0x7f6b24004750 comp rx=0 tx=0).stop 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 shutdown_connections 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b30133ad0 0x7f6b30071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b301300a0 0x7f6b30071320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 --2- 172.21.15.125:0/2023431236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b301309f0 0x7f6b30071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 >> 172.21.15.125:0/2023431236 conn(0x7f6b30099c40 msgr2=0x7f6b30132a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 shutdown_connections 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:33.942+0000 7f6b3863e700 1 -- 172.21.15.125:0/2023431236 wait complete. 2023-10-03T10:11:33.944 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-03T10:11:33.954 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:11:31.994455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189152,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298208,"statfs":{"total":386547056640,"available":385329364992,"internally_reserved":0,"allocated":786432,"data_stored":278466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.995213"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.160063+0000","last_change":"2023-10-03T10:09:14.714603+0000","last_active":"2023-10-03T10:11:27.160063+0000","last_peered":"2023-10-03T10:11:27.160063+0000","last_clean":"2023-10-03T10:11:27.160063+0000","last_became_active":"2023-10-03T10:09:14.714337+0000","last_became_peered":"2023-10-03T10:09:14.714337+0000","last_unstale":"2023-10-03T10:11:27.160063+0000","last_undegraded":"2023-10-03T10:11:27.160063+0000","last_fullsized":"2023-10-03T10:11:27.160063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159981+0000","last_change":"2023-10-03T10:09:14.705544+0000","last_active":"2023-10-03T10:11:27.159981+0000","last_peered":"2023-10-03T10:11:27.159981+0000","last_clean":"2023-10-03T10:11:27.159981+0000","last_became_active":"2023-10-03T10:09:14.705240+0000","last_became_peered":"2023-10-03T10:09:14.705240+0000","last_unstale":"2023-10-03T10:11:27.159981+0000","last_undegraded":"2023-10-03T10:11:27.159981+0000","last_fullsized":"2023-10-03T10:11:27.159981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136054+0000","last_change":"2023-10-03T10:09:14.715211+0000","last_active":"2023-10-03T10:11:26.136054+0000","last_peered":"2023-10-03T10:11:26.136054+0000","last_clean":"2023-10-03T10:11:26.136054+0000","last_became_active":"2023-10-03T10:09:14.714965+0000","last_became_peered":"2023-10-03T10:09:14.714965+0000","last_unstale":"2023-10-03T10:11:26.136054+0000","last_undegraded":"2023-10-03T10:11:26.136054+0000","last_fullsized":"2023-10-03T10:11:26.136054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135951+0000","last_change":"2023-10-03T10:09:14.710747+0000","last_active":"2023-10-03T10:11:26.135951+0000","last_peered":"2023-10-03T10:11:26.135951+0000","last_clean":"2023-10-03T10:11:26.135951+0000","last_became_active":"2023-10-03T10:09:14.710471+0000","last_became_peered":"2023-10-03T10:09:14.710471+0000","last_unstale":"2023-10-03T10:11:26.135951+0000","last_undegraded":"2023-10-03T10:11:26.135951+0000","last_fullsized":"2023-10-03T10:11:26.135951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136385+0000","last_change":"2023-10-03T10:09:14.719560+0000","last_active":"2023-10-03T10:11:26.136385+0000","last_peered":"2023-10-03T10:11:26.136385+0000","last_clean":"2023-10-03T10:11:26.136385+0000","last_became_active":"2023-10-03T10:09:14.719359+0000","last_became_peered":"2023-10-03T10:09:14.719359+0000","last_unstale":"2023-10-03T10:11:26.136385+0000","last_undegraded":"2023-10-03T10:11:26.136385+0000","last_fullsized":"2023-10-03T10:11:26.136385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135525+0000","last_change":"2023-10-03T10:10:04.994529+0000","last_active":"2023-10-03T10:11:26.135525+0000","last_peered":"2023-10-03T10:11:26.135525+0000","last_clean":"2023-10-03T10:11:26.135525+0000","last_became_active":"2023-10-03T10:10:04.994214+0000","last_became_peered":"2023-10-03T10:10:04.994214+0000","last_unstale":"2023-10-03T10:11:26.135525+0000","last_undegraded":"2023-10-03T10:11:26.135525+0000","last_fullsized":"2023-10-03T10:11:26.135525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318941+0000","last_change":"2023-10-03T10:09:14.723496+0000","last_active":"2023-10-03T10:11:25.318941+0000","last_peered":"2023-10-03T10:11:25.318941+0000","last_clean":"2023-10-03T10:11:25.318941+0000","last_became_active":"2023-10-03T10:09:14.723260+0000","last_became_peered":"2023-10-03T10:09:14.723260+0000","last_unstale":"2023-10-03T10:11:25.318941+0000","last_undegraded":"2023-10-03T10:11:25.318941+0000","last_fullsized":"2023-10-03T10:11:25.318941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409673+0000","last_change":"2023-10-03T10:09:14.728885+0000","last_active":"2023-10-03T10:11:26.409673+0000","last_peered":"2023-10-03T10:11:26.409673+0000","last_clean":"2023-10-03T10:11:26.409673+0000","last_became_active":"2023-10-03T10:09:14.720610+0000","last_became_peered":"2023-10-03T10:09:14.720610+0000","last_unstale":"2023-10-03T10:11:26.409673+0000","last_undegraded":"2023-10-03T10:11:26.409673+0000","last_fullsized":"2023-10-03T10:11:26.409673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137245+0000","last_change":"2023-10-03T10:09:14.713481+0000","last_active":"2023-10-03T10:11:26.137245+0000","last_peered":"2023-10-03T10:11:26.137245+0000","last_clean":"2023-10-03T10:11:26.137245+0000","last_became_active":"2023-10-03T10:09:14.711120+0000","last_became_peered":"2023-10-03T10:09:14.711120+0000","last_unstale":"2023-10-03T10:11:26.137245+0000","last_undegraded":"2023-10-03T10:11:26.137245+0000","last_fullsized":"2023-10-03T10:11:26.137245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410482+0000","last_change":"2023-10-03T10:09:14.726303+0000","last_active":"2023-10-03T10:11:26.410482+0000","last_peered":"2023-10-03T10:11:26.410482+0000","last_clean":"2023-10-03T10:11:26.410482+0000","last_became_active":"2023-10-03T10:09:14.726049+0000","last_became_peered":"2023-10-03T10:09:14.726049+0000","last_unstale":"2023-10-03T10:11:26.410482+0000","last_undegraded":"2023-10-03T10:11:26.410482+0000","last_fullsized":"2023-10-03T10:11:26.410482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410214+0000","last_change":"2023-10-03T10:09:14.726200+0000","last_active":"2023-10-03T10:11:26.410214+0000","last_peered":"2023-10-03T10:11:26.410214+0000","last_clean":"2023-10-03T10:11:26.410214+0000","last_became_active":"2023-10-03T10:09:14.725948+0000","last_became_peered":"2023-10-03T10:09:14.725948+0000","last_unstale":"2023-10-03T10:11:26.410214+0000","last_undegraded":"2023-10-03T10:11:26.410214+0000","last_fullsized":"2023-10-03T10:11:26.410214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159658+0000","last_change":"2023-10-03T10:09:14.714843+0000","last_active":"2023-10-03T10:11:27.159658+0000","last_peered":"2023-10-03T10:11:27.159658+0000","last_clean":"2023-10-03T10:11:27.159658+0000","last_became_active":"2023-10-03T10:09:14.714579+0000","last_became_peered":"2023-10-03T10:09:14.714579+0000","last_unstale":"2023-10-03T10:11:27.159658+0000","last_undegraded":"2023-10-03T10:11:27.159658+0000","last_fullsized":"2023-10-03T10:11:27.159658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159836+0000","last_change":"2023-10-03T10:09:14.724414+0000","last_active":"2023-10-03T10:11:27.159836+0000","last_peered":"2023-10-03T10:11:27.159836+0000","last_clean":"2023-10-03T10:11:27.159836+0000","last_became_active":"2023-10-03T10:09:14.723833+0000","last_became_peered":"2023-10-03T10:09:14.723833+0000","last_unstale":"2023-10-03T10:11:27.159836+0000","last_undegraded":"2023-10-03T10:11:27.159836+0000","last_fullsized":"2023-10-03T10:11:27.159836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409991+0000","last_change":"2023-10-03T10:09:14.708491+0000","last_active":"2023-10-03T10:11:26.409991+0000","last_peered":"2023-10-03T10:11:26.409991+0000","last_clean":"2023-10-03T10:11:26.409991+0000","last_became_active":"2023-10-03T10:09:14.705272+0000","last_became_peered":"2023-10-03T10:09:14.705272+0000","last_unstale":"2023-10-03T10:11:26.409991+0000","last_undegraded":"2023-10-03T10:11:26.409991+0000","last_fullsized":"2023-10-03T10:11:26.409991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135647+0000","last_change":"2023-10-03T10:09:14.713611+0000","last_active":"2023-10-03T10:11:26.135647+0000","last_peered":"2023-10-03T10:11:26.135647+0000","last_clean":"2023-10-03T10:11:26.135647+0000","last_became_active":"2023-10-03T10:09:14.713350+0000","last_became_peered":"2023-10-03T10:09:14.713350+0000","last_unstale":"2023-10-03T10:11:26.135647+0000","last_undegraded":"2023-10-03T10:11:26.135647+0000","last_fullsized":"2023-10-03T10:11:26.135647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318736+0000","last_change":"2023-10-03T10:09:14.717325+0000","last_active":"2023-10-03T10:11:25.318736+0000","last_peered":"2023-10-03T10:11:25.318736+0000","last_clean":"2023-10-03T10:11:25.318736+0000","last_became_active":"2023-10-03T10:09:14.717060+0000","last_became_peered":"2023-10-03T10:09:14.717060+0000","last_unstale":"2023-10-03T10:11:25.318736+0000","last_undegraded":"2023-10-03T10:11:25.318736+0000","last_fullsized":"2023-10-03T10:11:25.318736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137159+0000","last_change":"2023-10-03T10:09:14.713656+0000","last_active":"2023-10-03T10:11:26.137159+0000","last_peered":"2023-10-03T10:11:26.137159+0000","last_clean":"2023-10-03T10:11:26.137159+0000","last_became_active":"2023-10-03T10:09:14.711482+0000","last_became_peered":"2023-10-03T10:09:14.711482+0000","last_unstale":"2023-10-03T10:11:26.137159+0000","last_undegraded":"2023-10-03T10:11:26.137159+0000","last_fullsized":"2023-10-03T10:11:26.137159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136338+0000","last_change":"2023-10-03T10:09:14.717202+0000","last_active":"2023-10-03T10:11:26.136338+0000","last_peered":"2023-10-03T10:11:26.136338+0000","last_clean":"2023-10-03T10:11:26.136338+0000","last_became_active":"2023-10-03T10:09:14.716379+0000","last_became_peered":"2023-10-03T10:09:14.716379+0000","last_unstale":"2023-10-03T10:11:26.136338+0000","last_undegraded":"2023-10-03T10:11:26.136338+0000","last_fullsized":"2023-10-03T10:11:26.136338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159935+0000","last_change":"2023-10-03T10:09:14.723512+0000","last_active":"2023-10-03T10:11:27.159935+0000","last_peered":"2023-10-03T10:11:27.159935+0000","last_clean":"2023-10-03T10:11:27.159935+0000","last_became_active":"2023-10-03T10:09:14.723235+0000","last_became_peered":"2023-10-03T10:09:14.723235+0000","last_unstale":"2023-10-03T10:11:27.159935+0000","last_undegraded":"2023-10-03T10:11:27.159935+0000","last_fullsized":"2023-10-03T10:11:27.159935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410279+0000","last_change":"2023-10-03T10:09:14.718233+0000","last_active":"2023-10-03T10:11:26.410279+0000","last_peered":"2023-10-03T10:11:26.410279+0000","last_clean":"2023-10-03T10:11:26.410279+0000","last_became_active":"2023-10-03T10:09:14.717964+0000","last_became_peered":"2023-10-03T10:09:14.717964+0000","last_unstale":"2023-10-03T10:11:26.410279+0000","last_undegraded":"2023-10-03T10:11:26.410279+0000","last_fullsized":"2023-10-03T10:11:26.410279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409861+0000","last_change":"2023-10-03T10:09:14.721092+0000","last_active":"2023-10-03T10:11:26.409861+0000","last_peered":"2023-10-03T10:11:26.409861+0000","last_clean":"2023-10-03T10:11:26.409861+0000","last_became_active":"2023-10-03T10:09:14.720802+0000","last_became_peered":"2023-10-03T10:09:14.720802+0000","last_unstale":"2023-10-03T10:11:26.409861+0000","last_undegraded":"2023-10-03T10:11:26.409861+0000","last_fullsized":"2023-10-03T10:11:26.409861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135617+0000","last_change":"2023-10-03T10:09:14.712170+0000","last_active":"2023-10-03T10:11:26.135617+0000","last_peered":"2023-10-03T10:11:26.135617+0000","last_clean":"2023-10-03T10:11:26.135617+0000","last_became_active":"2023-10-03T10:09:14.711964+0000","last_became_peered":"2023-10-03T10:09:14.711964+0000","last_unstale":"2023-10-03T10:11:26.135617+0000","last_undegraded":"2023-10-03T10:11:26.135617+0000","last_fullsized":"2023-10-03T10:11:26.135617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318831+0000","last_change":"2023-10-03T10:09:14.717587+0000","last_active":"2023-10-03T10:11:25.318831+0000","last_peered":"2023-10-03T10:11:25.318831+0000","last_clean":"2023-10-03T10:11:25.318831+0000","last_became_active":"2023-10-03T10:09:14.717339+0000","last_became_peered":"2023-10-03T10:09:14.717339+0000","last_unstale":"2023-10-03T10:11:25.318831+0000","last_undegraded":"2023-10-03T10:11:25.318831+0000","last_fullsized":"2023-10-03T10:11:25.318831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409729+0000","last_change":"2023-10-03T10:09:14.728847+0000","last_active":"2023-10-03T10:11:26.409729+0000","last_peered":"2023-10-03T10:11:26.409729+0000","last_clean":"2023-10-03T10:11:26.409729+0000","last_became_active":"2023-10-03T10:09:14.725404+0000","last_became_peered":"2023-10-03T10:09:14.725404+0000","last_unstale":"2023-10-03T10:11:26.409729+0000","last_undegraded":"2023-10-03T10:11:26.409729+0000","last_fullsized":"2023-10-03T10:11:26.409729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410444+0000","last_change":"2023-10-03T10:09:14.718621+0000","last_active":"2023-10-03T10:11:26.410444+0000","last_peered":"2023-10-03T10:11:26.410444+0000","last_clean":"2023-10-03T10:11:26.410444+0000","last_became_active":"2023-10-03T10:09:14.718361+0000","last_became_peered":"2023-10-03T10:09:14.718361+0000","last_unstale":"2023-10-03T10:11:26.410444+0000","last_undegraded":"2023-10-03T10:11:26.410444+0000","last_fullsized":"2023-10-03T10:11:26.410444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410430+0000","last_change":"2023-10-03T10:09:14.707751+0000","last_active":"2023-10-03T10:11:26.410430+0000","last_peered":"2023-10-03T10:11:26.410430+0000","last_clean":"2023-10-03T10:11:26.410430+0000","last_became_active":"2023-10-03T10:09:14.707489+0000","last_became_peered":"2023-10-03T10:09:14.707489+0000","last_unstale":"2023-10-03T10:11:26.410430+0000","last_undegraded":"2023-10-03T10:11:26.410430+0000","last_fullsized":"2023-10-03T10:11:26.410430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319491+0000","last_change":"2023-10-03T10:09:14.724017+0000","last_active":"2023-10-03T10:11:25.319491+0000","last_peered":"2023-10-03T10:11:25.319491+0000","last_clean":"2023-10-03T10:11:25.319491+0000","last_became_active":"2023-10-03T10:09:14.723540+0000","last_became_peered":"2023-10-03T10:09:14.723540+0000","last_unstale":"2023-10-03T10:11:25.319491+0000","last_undegraded":"2023-10-03T10:11:25.319491+0000","last_fullsized":"2023-10-03T10:11:25.319491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409847+0000","last_change":"2023-10-03T10:09:14.354052+0000","last_active":"2023-10-03T10:11:26.409847+0000","last_peered":"2023-10-03T10:11:26.409847+0000","last_clean":"2023-10-03T10:11:26.409847+0000","last_became_active":"2023-10-03T10:09:14.353765+0000","last_became_peered":"2023-10-03T10:09:14.353765+0000","last_unstale":"2023-10-03T10:11:26.409847+0000","last_undegraded":"2023-10-03T10:11:26.409847+0000","last_fullsized":"2023-10-03T10:11:26.409847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319527+0000","last_change":"2023-10-03T10:09:14.731372+0000","last_active":"2023-10-03T10:11:25.319527+0000","last_peered":"2023-10-03T10:11:25.319527+0000","last_clean":"2023-10-03T10:11:25.319527+0000","last_became_active":"2023-10-03T10:09:14.730476+0000","last_became_peered":"2023-10-03T10:09:14.730476+0000","last_unstale":"2023-10-03T10:11:25.319527+0000","last_undegraded":"2023-10-03T10:11:25.319527+0000","last_fullsized":"2023-10-03T10:11:25.319527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409660+0000","last_change":"2023-10-03T10:09:14.340525+0000","last_active":"2023-10-03T10:11:26.409660+0000","last_peered":"2023-10-03T10:11:26.409660+0000","last_clean":"2023-10-03T10:11:26.409660+0000","last_became_active":"2023-10-03T10:09:14.340215+0000","last_became_peered":"2023-10-03T10:09:14.340215+0000","last_unstale":"2023-10-03T10:11:26.409660+0000","last_undegraded":"2023-10-03T10:11:26.409660+0000","last_fullsized":"2023-10-03T10:11:26.409660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136517+0000","last_change":"2023-10-03T10:09:14.717045+0000","last_active":"2023-10-03T10:11:26.136517+0000","last_peered":"2023-10-03T10:11:26.136517+0000","last_clean":"2023-10-03T10:11:26.136517+0000","last_became_active":"2023-10-03T10:09:14.716120+0000","last_became_peered":"2023-10-03T10:09:14.716120+0000","last_unstale":"2023-10-03T10:11:26.136517+0000","last_undegraded":"2023-10-03T10:11:26.136517+0000","last_fullsized":"2023-10-03T10:11:26.136517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318947+0000","last_change":"2023-10-03T10:09:14.345802+0000","last_active":"2023-10-03T10:11:25.318947+0000","last_peered":"2023-10-03T10:11:25.318947+0000","last_clean":"2023-10-03T10:11:25.318947+0000","last_became_active":"2023-10-03T10:09:14.345529+0000","last_became_peered":"2023-10-03T10:09:14.345529+0000","last_unstale":"2023-10-03T10:11:25.318947+0000","last_undegraded":"2023-10-03T10:11:25.318947+0000","last_fullsized":"2023-10-03T10:11:25.318947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319889+0000","last_change":"2023-10-03T10:09:14.729797+0000","last_active":"2023-10-03T10:11:25.319889+0000","last_peered":"2023-10-03T10:11:25.319889+0000","last_clean":"2023-10-03T10:11:25.319889+0000","last_became_active":"2023-10-03T10:09:14.729212+0000","last_became_peered":"2023-10-03T10:09:14.729212+0000","last_unstale":"2023-10-03T10:11:25.319889+0000","last_undegraded":"2023-10-03T10:11:25.319889+0000","last_fullsized":"2023-10-03T10:11:25.319889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136998+0000","last_change":"2023-10-03T10:09:14.343788+0000","last_active":"2023-10-03T10:11:26.136998+0000","last_peered":"2023-10-03T10:11:26.136998+0000","last_clean":"2023-10-03T10:11:26.136998+0000","last_became_active":"2023-10-03T10:09:14.343495+0000","last_became_peered":"2023-10-03T10:09:14.343495+0000","last_unstale":"2023-10-03T10:11:26.136998+0000","last_undegraded":"2023-10-03T10:11:26.136998+0000","last_fullsized":"2023-10-03T10:11:26.136998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159231+0000","last_change":"2023-10-03T10:10:04.994717+0000","last_active":"2023-10-03T10:11:27.159231+0000","last_peered":"2023-10-03T10:11:27.159231+0000","last_clean":"2023-10-03T10:11:27.159231+0000","last_became_active":"2023-10-03T10:10:04.994414+0000","last_became_peered":"2023-10-03T10:10:04.994414+0000","last_unstale":"2023-10-03T10:11:27.159231+0000","last_undegraded":"2023-10-03T10:11:27.159231+0000","last_fullsized":"2023-10-03T10:11:27.159231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159826+0000","last_change":"2023-10-03T10:09:14.339768+0000","last_active":"2023-10-03T10:11:27.159826+0000","last_peered":"2023-10-03T10:11:27.159826+0000","last_clean":"2023-10-03T10:11:27.159826+0000","last_became_active":"2023-10-03T10:09:14.339501+0000","last_became_peered":"2023-10-03T10:09:14.339501+0000","last_unstale":"2023-10-03T10:11:27.159826+0000","last_undegraded":"2023-10-03T10:11:27.159826+0000","last_fullsized":"2023-10-03T10:11:27.159826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319037+0000","last_change":"2023-10-03T10:09:14.723237+0000","last_active":"2023-10-03T10:11:25.319037+0000","last_peered":"2023-10-03T10:11:25.319037+0000","last_clean":"2023-10-03T10:11:25.319037+0000","last_became_active":"2023-10-03T10:09:14.722881+0000","last_became_peered":"2023-10-03T10:09:14.722881+0000","last_unstale":"2023-10-03T10:11:25.319037+0000","last_undegraded":"2023-10-03T10:11:25.319037+0000","last_fullsized":"2023-10-03T10:11:25.319037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135967+0000","last_change":"2023-10-03T10:09:14.339824+0000","last_active":"2023-10-03T10:11:26.135967+0000","last_peered":"2023-10-03T10:11:26.135967+0000","last_clean":"2023-10-03T10:11:26.135967+0000","last_became_active":"2023-10-03T10:09:14.339560+0000","last_became_peered":"2023-10-03T10:09:14.339560+0000","last_unstale":"2023-10-03T10:11:26.135967+0000","last_undegraded":"2023-10-03T10:11:26.135967+0000","last_fullsized":"2023-10-03T10:11:26.135967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409972+0000","last_change":"2023-10-03T10:09:14.721025+0000","last_active":"2023-10-03T10:11:26.409972+0000","last_peered":"2023-10-03T10:11:26.409972+0000","last_clean":"2023-10-03T10:11:26.409972+0000","last_became_active":"2023-10-03T10:09:14.720762+0000","last_became_peered":"2023-10-03T10:09:14.720762+0000","last_unstale":"2023-10-03T10:11:26.409972+0000","last_undegraded":"2023-10-03T10:11:26.409972+0000","last_fullsized":"2023-10-03T10:11:26.409972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'12","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T10:11:30.061160+0000","last_change":"2023-10-03T10:09:14.346629+0000","last_active":"2023-10-03T10:11:30.061160+0000","last_peered":"2023-10-03T10:11:30.061160+0000","last_clean":"2023-10-03T10:11:30.061160+0000","last_became_active":"2023-10-03T10:09:14.346335+0000","last_became_peered":"2023-10-03T10:09:14.346335+0000","last_unstale":"2023-10-03T10:11:30.061160+0000","last_undegraded":"2023-10-03T10:11:30.061160+0000","last_fullsized":"2023-10-03T10:11:30.061160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159696+0000","last_change":"2023-10-03T10:09:14.724074+0000","last_active":"2023-10-03T10:11:27.159696+0000","last_peered":"2023-10-03T10:11:27.159696+0000","last_clean":"2023-10-03T10:11:27.159696+0000","last_became_active":"2023-10-03T10:09:14.723284+0000","last_became_peered":"2023-10-03T10:09:14.723284+0000","last_unstale":"2023-10-03T10:11:27.159696+0000","last_undegraded":"2023-10-03T10:11:27.159696+0000","last_fullsized":"2023-10-03T10:11:27.159696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319275+0000","last_change":"2023-10-03T10:09:14.353282+0000","last_active":"2023-10-03T10:11:25.319275+0000","last_peered":"2023-10-03T10:11:25.319275+0000","last_clean":"2023-10-03T10:11:25.319275+0000","last_became_active":"2023-10-03T10:09:14.352586+0000","last_became_peered":"2023-10-03T10:09:14.352586+0000","last_unstale":"2023-10-03T10:11:25.319275+0000","last_undegraded":"2023-10-03T10:11:25.319275+0000","last_fullsized":"2023-10-03T10:11:25.319275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319481+0000","last_change":"2023-10-03T10:09:14.729509+0000","last_active":"2023-10-03T10:11:25.319481+0000","last_peered":"2023-10-03T10:11:25.319481+0000","last_clean":"2023-10-03T10:11:25.319481+0000","last_became_active":"2023-10-03T10:09:14.729254+0000","last_became_peered":"2023-10-03T10:09:14.729254+0000","last_unstale":"2023-10-03T10:11:25.319481+0000","last_undegraded":"2023-10-03T10:11:25.319481+0000","last_fullsized":"2023-10-03T10:11:25.319481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135700+0000","last_change":"2023-10-03T10:09:14.343728+0000","last_active":"2023-10-03T10:11:26.135700+0000","last_peered":"2023-10-03T10:11:26.135700+0000","last_clean":"2023-10-03T10:11:26.135700+0000","last_became_active":"2023-10-03T10:09:14.343444+0000","last_became_peered":"2023-10-03T10:09:14.343444+0000","last_unstale":"2023-10-03T10:11:26.135700+0000","last_undegraded":"2023-10-03T10:11:26.135700+0000","last_fullsized":"2023-10-03T10:11:26.135700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319572+0000","last_change":"2023-10-03T10:09:14.724168+0000","last_active":"2023-10-03T10:11:25.319572+0000","last_peered":"2023-10-03T10:11:25.319572+0000","last_clean":"2023-10-03T10:11:25.319572+0000","last_became_active":"2023-10-03T10:09:14.723777+0000","last_became_peered":"2023-10-03T10:09:14.723777+0000","last_unstale":"2023-10-03T10:11:25.319572+0000","last_undegraded":"2023-10-03T10:11:25.319572+0000","last_fullsized":"2023-10-03T10:11:25.319572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319034+0000","last_change":"2023-10-03T10:09:14.346628+0000","last_active":"2023-10-03T10:11:25.319034+0000","last_peered":"2023-10-03T10:11:25.319034+0000","last_clean":"2023-10-03T10:11:25.319034+0000","last_became_active":"2023-10-03T10:09:14.346352+0000","last_became_peered":"2023-10-03T10:09:14.346352+0000","last_unstale":"2023-10-03T10:11:25.319034+0000","last_undegraded":"2023-10-03T10:11:25.319034+0000","last_fullsized":"2023-10-03T10:11:25.319034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136656+0000","last_change":"2023-10-03T10:09:14.717361+0000","last_active":"2023-10-03T10:11:26.136656+0000","last_peered":"2023-10-03T10:11:26.136656+0000","last_clean":"2023-10-03T10:11:26.136656+0000","last_became_active":"2023-10-03T10:09:14.716635+0000","last_became_peered":"2023-10-03T10:09:14.716635+0000","last_unstale":"2023-10-03T10:11:26.136656+0000","last_undegraded":"2023-10-03T10:11:26.136656+0000","last_fullsized":"2023-10-03T10:11:26.136656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409929+0000","last_change":"2023-10-03T10:09:14.344594+0000","last_active":"2023-10-03T10:11:26.409929+0000","last_peered":"2023-10-03T10:11:26.409929+0000","last_clean":"2023-10-03T10:11:26.409929+0000","last_became_active":"2023-10-03T10:09:14.344319+0000","last_became_peered":"2023-10-03T10:09:14.344319+0000","last_unstale":"2023-10-03T10:11:26.409929+0000","last_undegraded":"2023-10-03T10:11:26.409929+0000","last_fullsized":"2023-10-03T10:11:26.409929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319881+0000","last_change":"2023-10-03T10:09:14.729964+0000","last_active":"2023-10-03T10:11:25.319881+0000","last_peered":"2023-10-03T10:11:25.319881+0000","last_clean":"2023-10-03T10:11:25.319881+0000","last_became_active":"2023-10-03T10:09:14.729548+0000","last_became_peered":"2023-10-03T10:09:14.729548+0000","last_unstale":"2023-10-03T10:11:25.319881+0000","last_undegraded":"2023-10-03T10:11:25.319881+0000","last_fullsized":"2023-10-03T10:11:25.319881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136820+0000","last_change":"2023-10-03T10:09:14.344297+0000","last_active":"2023-10-03T10:11:26.136820+0000","last_peered":"2023-10-03T10:11:26.136820+0000","last_clean":"2023-10-03T10:11:26.136820+0000","last_became_active":"2023-10-03T10:09:14.344040+0000","last_became_peered":"2023-10-03T10:09:14.344040+0000","last_unstale":"2023-10-03T10:11:26.136820+0000","last_undegraded":"2023-10-03T10:11:26.136820+0000","last_fullsized":"2023-10-03T10:11:26.136820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318979+0000","last_change":"2023-10-03T10:09:14.734141+0000","last_active":"2023-10-03T10:11:25.318979+0000","last_peered":"2023-10-03T10:11:25.318979+0000","last_clean":"2023-10-03T10:11:25.318979+0000","last_became_active":"2023-10-03T10:09:14.733955+0000","last_became_peered":"2023-10-03T10:09:14.733955+0000","last_unstale":"2023-10-03T10:11:25.318979+0000","last_undegraded":"2023-10-03T10:11:25.318979+0000","last_fullsized":"2023-10-03T10:11:25.318979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159902+0000","last_change":"2023-10-03T10:09:14.345399+0000","last_active":"2023-10-03T10:11:27.159902+0000","last_peered":"2023-10-03T10:11:27.159902+0000","last_clean":"2023-10-03T10:11:27.159902+0000","last_became_active":"2023-10-03T10:09:14.345110+0000","last_became_peered":"2023-10-03T10:09:14.345110+0000","last_unstale":"2023-10-03T10:11:27.159902+0000","last_undegraded":"2023-10-03T10:11:27.159902+0000","last_fullsized":"2023-10-03T10:11:27.159902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409687+0000","last_change":"2023-10-03T10:10:04.996928+0000","last_active":"2023-10-03T10:11:26.409687+0000","last_peered":"2023-10-03T10:11:26.409687+0000","last_clean":"2023-10-03T10:11:26.409687+0000","last_became_active":"2023-10-03T10:10:04.996578+0000","last_became_peered":"2023-10-03T10:10:04.996578+0000","last_unstale":"2023-10-03T10:11:26.409687+0000","last_undegraded":"2023-10-03T10:11:26.409687+0000","last_fullsized":"2023-10-03T10:11:26.409687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319672+0000","last_change":"2023-10-03T10:09:14.345375+0000","last_active":"2023-10-03T10:11:25.319672+0000","last_peered":"2023-10-03T10:11:25.319672+0000","last_clean":"2023-10-03T10:11:25.319672+0000","last_became_active":"2023-10-03T10:09:14.343897+0000","last_became_peered":"2023-10-03T10:09:14.343897+0000","last_unstale":"2023-10-03T10:11:25.319672+0000","last_undegraded":"2023-10-03T10:11:25.319672+0000","last_fullsized":"2023-10-03T10:11:25.319672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159597+0000","last_change":"2023-10-03T10:09:14.715812+0000","last_active":"2023-10-03T10:11:27.159597+0000","last_peered":"2023-10-03T10:11:27.159597+0000","last_clean":"2023-10-03T10:11:27.159597+0000","last_became_active":"2023-10-03T10:09:14.715548+0000","last_became_peered":"2023-10-03T10:09:14.715548+0000","last_unstale":"2023-10-03T10:11:27.159597+0000","last_undegraded":"2023-10-03T10:11:27.159597+0000","last_fullsized":"2023-10-03T10:11:27.159597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136156+0000","last_change":"2023-10-03T10:09:14.343714+0000","last_active":"2023-10-03T10:11:26.136156+0000","last_peered":"2023-10-03T10:11:26.136156+0000","last_clean":"2023-10-03T10:11:26.136156+0000","last_became_active":"2023-10-03T10:09:14.343419+0000","last_became_peered":"2023-10-03T10:09:14.343419+0000","last_unstale":"2023-10-03T10:11:26.136156+0000","last_undegraded":"2023-10-03T10:11:26.136156+0000","last_fullsized":"2023-10-03T10:11:26.136156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136710+0000","last_change":"2023-10-03T10:09:14.710007+0000","last_active":"2023-10-03T10:11:26.136710+0000","last_peered":"2023-10-03T10:11:26.136710+0000","last_clean":"2023-10-03T10:11:26.136710+0000","last_became_active":"2023-10-03T10:09:14.708147+0000","last_became_peered":"2023-10-03T10:09:14.708147+0000","last_unstale":"2023-10-03T10:11:26.136710+0000","last_undegraded":"2023-10-03T10:11:26.136710+0000","last_fullsized":"2023-10-03T10:11:26.136710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319181+0000","last_change":"2023-10-03T10:09:14.353447+0000","last_active":"2023-10-03T10:11:25.319181+0000","last_peered":"2023-10-03T10:11:25.319181+0000","last_clean":"2023-10-03T10:11:25.319181+0000","last_became_active":"2023-10-03T10:09:14.352906+0000","last_became_peered":"2023-10-03T10:09:14.352906+0000","last_unstale":"2023-10-03T10:11:25.319181+0000","last_undegraded":"2023-10-03T10:11:25.319181+0000","last_fullsized":"2023-10-03T10:11:25.319181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136080+0000","last_change":"2023-10-03T10:10:04.994710+0000","last_active":"2023-10-03T10:11:26.136080+0000","last_peered":"2023-10-03T10:11:26.136080+0000","last_clean":"2023-10-03T10:11:26.136080+0000","last_became_active":"2023-10-03T10:10:04.994236+0000","last_became_peered":"2023-10-03T10:10:04.994236+0000","last_unstale":"2023-10-03T10:11:26.136080+0000","last_undegraded":"2023-10-03T10:11:26.136080+0000","last_fullsized":"2023-10-03T10:11:26.136080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319099+0000","last_change":"2023-10-03T10:09:14.347268+0000","last_active":"2023-10-03T10:11:25.319099+0000","last_peered":"2023-10-03T10:11:25.319099+0000","last_clean":"2023-10-03T10:11:25.319099+0000","last_became_active":"2023-10-03T10:09:14.346969+0000","last_became_peered":"2023-10-03T10:09:14.346969+0000","last_unstale":"2023-10-03T10:11:25.319099+0000","last_undegraded":"2023-10-03T10:11:25.319099+0000","last_fullsized":"2023-10-03T10:11:25.319099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159697+0000","last_change":"2023-10-03T10:10:04.994243+0000","last_active":"2023-10-03T10:11:27.159697+0000","last_peered":"2023-10-03T10:11:27.159697+0000","last_clean":"2023-10-03T10:11:27.159697+0000","last_became_active":"2023-10-03T10:10:04.993946+0000","last_became_peered":"2023-10-03T10:10:04.993946+0000","last_unstale":"2023-10-03T10:11:27.159697+0000","last_undegraded":"2023-10-03T10:11:27.159697+0000","last_fullsized":"2023-10-03T10:11:27.159697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318942+0000","last_change":"2023-10-03T10:09:14.346668+0000","last_active":"2023-10-03T10:11:25.318942+0000","last_peered":"2023-10-03T10:11:25.318942+0000","last_clean":"2023-10-03T10:11:25.318942+0000","last_became_active":"2023-10-03T10:09:14.346390+0000","last_became_peered":"2023-10-03T10:09:14.346390+0000","last_unstale":"2023-10-03T10:11:25.318942+0000","last_undegraded":"2023-10-03T10:11:25.318942+0000","last_fullsized":"2023-10-03T10:11:25.318942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159943+0000","last_change":"2023-10-03T10:09:14.716337+0000","last_active":"2023-10-03T10:11:27.159943+0000","last_peered":"2023-10-03T10:11:27.159943+0000","last_clean":"2023-10-03T10:11:27.159943+0000","last_became_active":"2023-10-03T10:09:14.716083+0000","last_became_peered":"2023-10-03T10:09:14.716083+0000","last_unstale":"2023-10-03T10:11:27.159943+0000","last_undegraded":"2023-10-03T10:11:27.159943+0000","last_fullsized":"2023-10-03T10:11:27.159943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318733+0000","last_change":"2023-10-03T10:09:14.344515+0000","last_active":"2023-10-03T10:11:25.318733+0000","last_peered":"2023-10-03T10:11:25.318733+0000","last_clean":"2023-10-03T10:11:25.318733+0000","last_became_active":"2023-10-03T10:09:14.344244+0000","last_became_peered":"2023-10-03T10:09:14.344244+0000","last_unstale":"2023-10-03T10:11:25.318733+0000","last_undegraded":"2023-10-03T10:11:25.318733+0000","last_fullsized":"2023-10-03T10:11:25.318733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410370+0000","last_change":"2023-10-03T10:09:14.723005+0000","last_active":"2023-10-03T10:11:26.410370+0000","last_peered":"2023-10-03T10:11:26.410370+0000","last_clean":"2023-10-03T10:11:26.410370+0000","last_became_active":"2023-10-03T10:09:14.720579+0000","last_became_peered":"2023-10-03T10:09:14.720579+0000","last_unstale":"2023-10-03T10:11:26.410370+0000","last_undegraded":"2023-10-03T10:11:26.410370+0000","last_fullsized":"2023-10-03T10:11:26.410370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410285+0000","last_change":"2023-10-03T10:09:10.476264+0000","last_active":"2023-10-03T10:11:26.410285+0000","last_peered":"2023-10-03T10:11:26.410285+0000","last_clean":"2023-10-03T10:11:26.410285+0000","last_became_active":"2023-10-03T10:09:10.475957+0000","last_became_peered":"2023-10-03T10:09:10.475957+0000","last_unstale":"2023-10-03T10:11:26.410285+0000","last_undegraded":"2023-10-03T10:11:26.410285+0000","last_fullsized":"2023-10-03T10:11:26.410285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159849+0000","last_change":"2023-10-03T10:09:14.344817+0000","last_active":"2023-10-03T10:11:27.159849+0000","last_peered":"2023-10-03T10:11:27.159849+0000","last_clean":"2023-10-03T10:11:27.159849+0000","last_became_active":"2023-10-03T10:09:14.344547+0000","last_became_peered":"2023-10-03T10:09:14.344547+0000","last_unstale":"2023-10-03T10:11:27.159849+0000","last_undegraded":"2023-10-03T10:11:27.159849+0000","last_fullsized":"2023-10-03T10:11:27.159849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409942+0000","last_change":"2023-10-03T10:09:14.721039+0000","last_active":"2023-10-03T10:11:26.409942+0000","last_peered":"2023-10-03T10:11:26.409942+0000","last_clean":"2023-10-03T10:11:26.409942+0000","last_became_active":"2023-10-03T10:09:14.720876+0000","last_became_peered":"2023-10-03T10:09:14.720876+0000","last_unstale":"2023-10-03T10:11:26.409942+0000","last_undegraded":"2023-10-03T10:11:26.409942+0000","last_fullsized":"2023-10-03T10:11:26.409942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319178+0000","last_change":"2023-10-03T10:09:10.188326+0000","last_active":"2023-10-03T10:11:25.319178+0000","last_peered":"2023-10-03T10:11:25.319178+0000","last_clean":"2023-10-03T10:11:25.319178+0000","last_became_active":"2023-10-03T10:09:10.187973+0000","last_became_peered":"2023-10-03T10:09:10.187973+0000","last_unstale":"2023-10-03T10:11:25.319178+0000","last_undegraded":"2023-10-03T10:11:25.319178+0000","last_fullsized":"2023-10-03T10:11:25.319178+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136464+0000","last_change":"2023-10-03T10:09:14.351814+0000","last_active":"2023-10-03T10:11:26.136464+0000","last_peered":"2023-10-03T10:11:26.136464+0000","last_clean":"2023-10-03T10:11:26.136464+0000","last_became_active":"2023-10-03T10:09:14.351588+0000","last_became_peered":"2023-10-03T10:09:14.351588+0000","last_unstale":"2023-10-03T10:11:26.136464+0000","last_undegraded":"2023-10-03T10:11:26.136464+0000","last_fullsized":"2023-10-03T10:11:26.136464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410116+0000","last_change":"2023-10-03T10:09:14.708011+0000","last_active":"2023-10-03T10:11:26.410116+0000","last_peered":"2023-10-03T10:11:26.410116+0000","last_clean":"2023-10-03T10:11:26.410116+0000","last_became_active":"2023-10-03T10:09:14.707425+0000","last_became_peered":"2023-10-03T10:09:14.707425+0000","last_unstale":"2023-10-03T10:11:26.410116+0000","last_undegraded":"2023-10-03T10:11:26.410116+0000","last_fullsized":"2023-10-03T10:11:26.410116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159157+0000","last_change":"2023-10-03T10:09:10.184344+0000","last_active":"2023-10-03T10:11:27.159157+0000","last_peered":"2023-10-03T10:11:27.159157+0000","last_clean":"2023-10-03T10:11:27.159157+0000","last_became_active":"2023-10-03T10:09:10.184033+0000","last_became_peered":"2023-10-03T10:09:10.184033+0000","last_unstale":"2023-10-03T10:11:27.159157+0000","last_undegraded":"2023-10-03T10:11:27.159157+0000","last_fullsized":"2023-10-03T10:11:27.159157+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409833+0000","last_change":"2023-10-03T10:09:14.351636+0000","last_active":"2023-10-03T10:11:26.409833+0000","last_peered":"2023-10-03T10:11:26.409833+0000","last_clean":"2023-10-03T10:11:26.409833+0000","last_became_active":"2023-10-03T10:09:14.351360+0000","last_became_peered":"2023-10-03T10:09:14.351360+0000","last_unstale":"2023-10-03T10:11:26.409833+0000","last_undegraded":"2023-10-03T10:11:26.409833+0000","last_fullsized":"2023-10-03T10:11:26.409833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410448+0000","last_change":"2023-10-03T10:09:14.726543+0000","last_active":"2023-10-03T10:11:26.410448+0000","last_peered":"2023-10-03T10:11:26.410448+0000","last_clean":"2023-10-03T10:11:26.410448+0000","last_became_active":"2023-10-03T10:09:14.726287+0000","last_became_peered":"2023-10-03T10:09:14.726287+0000","last_unstale":"2023-10-03T10:11:26.410448+0000","last_undegraded":"2023-10-03T10:11:26.410448+0000","last_fullsized":"2023-10-03T10:11:26.410448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319231+0000","last_change":"2023-10-03T10:09:10.184784+0000","last_active":"2023-10-03T10:11:25.319231+0000","last_peered":"2023-10-03T10:11:25.319231+0000","last_clean":"2023-10-03T10:11:25.319231+0000","last_became_active":"2023-10-03T10:09:10.184503+0000","last_became_peered":"2023-10-03T10:09:10.184503+0000","last_unstale":"2023-10-03T10:11:25.319231+0000","last_undegraded":"2023-10-03T10:11:25.319231+0000","last_fullsized":"2023-10-03T10:11:25.319231+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409747+0000","last_change":"2023-10-03T10:09:09.187656+0000","last_active":"2023-10-03T10:11:26.409747+0000","last_peered":"2023-10-03T10:11:26.409747+0000","last_clean":"2023-10-03T10:11:26.409747+0000","last_became_active":"2023-10-03T10:09:09.187339+0000","last_became_peered":"2023-10-03T10:09:09.187339+0000","last_unstale":"2023-10-03T10:11:26.409747+0000","last_undegraded":"2023-10-03T10:11:26.409747+0000","last_fullsized":"2023-10-03T10:11:26.409747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:08.158343+0000","last_clean_scrub_stamp":"2023-10-03T10:09:08.158343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319055+0000","last_change":"2023-10-03T10:09:14.347133+0000","last_active":"2023-10-03T10:11:25.319055+0000","last_peered":"2023-10-03T10:11:25.319055+0000","last_clean":"2023-10-03T10:11:25.319055+0000","last_became_active":"2023-10-03T10:09:14.346671+0000","last_became_peered":"2023-10-03T10:09:14.346671+0000","last_unstale":"2023-10-03T10:11:25.319055+0000","last_undegraded":"2023-10-03T10:11:25.319055+0000","last_fullsized":"2023-10-03T10:11:25.319055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319743+0000","last_change":"2023-10-03T10:09:14.731621+0000","last_active":"2023-10-03T10:11:25.319743+0000","last_peered":"2023-10-03T10:11:25.319743+0000","last_clean":"2023-10-03T10:11:25.319743+0000","last_became_active":"2023-10-03T10:09:14.731155+0000","last_became_peered":"2023-10-03T10:09:14.731155+0000","last_unstale":"2023-10-03T10:11:25.319743+0000","last_undegraded":"2023-10-03T10:11:25.319743+0000","last_fullsized":"2023-10-03T10:11:25.319743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318848+0000","last_change":"2023-10-03T10:09:10.184241+0000","last_active":"2023-10-03T10:11:25.318848+0000","last_peered":"2023-10-03T10:11:25.318848+0000","last_clean":"2023-10-03T10:11:25.318848+0000","last_became_active":"2023-10-03T10:09:10.183911+0000","last_became_peered":"2023-10-03T10:09:10.183911+0000","last_unstale":"2023-10-03T10:11:25.318848+0000","last_undegraded":"2023-10-03T10:11:25.318848+0000","last_fullsized":"2023-10-03T10:11:25.318848+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135567+0000","last_change":"2023-10-03T10:09:14.345534+0000","last_active":"2023-10-03T10:11:26.135567+0000","last_peered":"2023-10-03T10:11:26.135567+0000","last_clean":"2023-10-03T10:11:26.135567+0000","last_became_active":"2023-10-03T10:09:14.344896+0000","last_became_peered":"2023-10-03T10:09:14.344896+0000","last_unstale":"2023-10-03T10:11:26.135567+0000","last_undegraded":"2023-10-03T10:11:26.135567+0000","last_fullsized":"2023-10-03T10:11:26.135567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136740+0000","last_change":"2023-10-03T10:09:14.716877+0000","last_active":"2023-10-03T10:11:26.136740+0000","last_peered":"2023-10-03T10:11:26.136740+0000","last_clean":"2023-10-03T10:11:26.136740+0000","last_became_active":"2023-10-03T10:09:14.715861+0000","last_became_peered":"2023-10-03T10:09:14.715861+0000","last_unstale":"2023-10-03T10:11:26.136740+0000","last_undegraded":"2023-10-03T10:11:26.136740+0000","last_fullsized":"2023-10-03T10:11:26.136740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319643+0000","last_change":"2023-10-03T10:09:10.476235+0000","last_active":"2023-10-03T10:11:25.319643+0000","last_peered":"2023-10-03T10:11:25.319643+0000","last_clean":"2023-10-03T10:11:25.319643+0000","last_became_active":"2023-10-03T10:09:10.475933+0000","last_became_peered":"2023-10-03T10:09:10.475933+0000","last_unstale":"2023-10-03T10:11:25.319643+0000","last_undegraded":"2023-10-03T10:11:25.319643+0000","last_fullsized":"2023-10-03T10:11:25.319643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410086+0000","last_change":"2023-10-03T10:09:14.352568+0000","last_active":"2023-10-03T10:11:26.410086+0000","last_peered":"2023-10-03T10:11:26.410086+0000","last_clean":"2023-10-03T10:11:26.410086+0000","last_became_active":"2023-10-03T10:09:14.352349+0000","last_became_peered":"2023-10-03T10:09:14.352349+0000","last_unstale":"2023-10-03T10:11:26.410086+0000","last_undegraded":"2023-10-03T10:11:26.410086+0000","last_fullsized":"2023-10-03T10:11:26.410086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136632+0000","last_change":"2023-10-03T10:09:14.710656+0000","last_active":"2023-10-03T10:11:26.136632+0000","last_peered":"2023-10-03T10:11:26.136632+0000","last_clean":"2023-10-03T10:11:26.136632+0000","last_became_active":"2023-10-03T10:09:14.710425+0000","last_became_peered":"2023-10-03T10:09:14.710425+0000","last_unstale":"2023-10-03T10:11:26.136632+0000","last_undegraded":"2023-10-03T10:11:26.136632+0000","last_fullsized":"2023-10-03T10:11:26.136632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319798+0000","last_change":"2023-10-03T10:09:14.346884+0000","last_active":"2023-10-03T10:11:25.319798+0000","last_peered":"2023-10-03T10:11:25.319798+0000","last_clean":"2023-10-03T10:11:25.319798+0000","last_became_active":"2023-10-03T10:09:14.346598+0000","last_became_peered":"2023-10-03T10:09:14.346598+0000","last_unstale":"2023-10-03T10:11:25.319798+0000","last_undegraded":"2023-10-03T10:11:25.319798+0000","last_fullsized":"2023-10-03T10:11:25.319798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410389+0000","last_change":"2023-10-03T10:09:10.476239+0000","last_active":"2023-10-03T10:11:26.410389+0000","last_peered":"2023-10-03T10:11:26.410389+0000","last_clean":"2023-10-03T10:11:26.410389+0000","last_became_active":"2023-10-03T10:09:10.475998+0000","last_became_peered":"2023-10-03T10:09:10.475998+0000","last_unstale":"2023-10-03T10:11:26.410389+0000","last_undegraded":"2023-10-03T10:11:26.410389+0000","last_fullsized":"2023-10-03T10:11:26.410389+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.318832+0000","last_change":"2023-10-03T10:09:14.733924+0000","last_active":"2023-10-03T10:11:25.318832+0000","last_peered":"2023-10-03T10:11:25.318832+0000","last_clean":"2023-10-03T10:11:25.318832+0000","last_became_active":"2023-10-03T10:09:14.733635+0000","last_became_peered":"2023-10-03T10:09:14.733635+0000","last_unstale":"2023-10-03T10:11:25.318832+0000","last_undegraded":"2023-10-03T10:11:25.318832+0000","last_fullsized":"2023-10-03T10:11:25.318832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319824+0000","last_change":"2023-10-03T10:09:10.477149+0000","last_active":"2023-10-03T10:11:25.319824+0000","last_peered":"2023-10-03T10:11:25.319824+0000","last_clean":"2023-10-03T10:11:25.319824+0000","last_became_active":"2023-10-03T10:09:10.475958+0000","last_became_peered":"2023-10-03T10:09:10.475958+0000","last_unstale":"2023-10-03T10:11:25.319824+0000","last_undegraded":"2023-10-03T10:11:25.319824+0000","last_fullsized":"2023-10-03T10:11:25.319824+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:09.168697+0000","last_clean_scrub_stamp":"2023-10-03T10:09:09.168697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136431+0000","last_change":"2023-10-03T10:09:14.350895+0000","last_active":"2023-10-03T10:11:26.136431+0000","last_peered":"2023-10-03T10:11:26.136431+0000","last_clean":"2023-10-03T10:11:26.136431+0000","last_became_active":"2023-10-03T10:09:14.350426+0000","last_became_peered":"2023-10-03T10:09:14.350426+0000","last_unstale":"2023-10-03T10:11:26.136431+0000","last_undegraded":"2023-10-03T10:11:26.136431+0000","last_fullsized":"2023-10-03T10:11:26.136431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159475+0000","last_change":"2023-10-03T10:09:14.714464+0000","last_active":"2023-10-03T10:11:27.159475+0000","last_peered":"2023-10-03T10:11:27.159475+0000","last_clean":"2023-10-03T10:11:27.159475+0000","last_became_active":"2023-10-03T10:09:14.714221+0000","last_became_peered":"2023-10-03T10:09:14.714221+0000","last_unstale":"2023-10-03T10:11:27.159475+0000","last_undegraded":"2023-10-03T10:11:27.159475+0000","last_fullsized":"2023-10-03T10:11:27.159475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.136551+0000","last_change":"2023-10-03T10:09:14.351366+0000","last_active":"2023-10-03T10:11:26.136551+0000","last_peered":"2023-10-03T10:11:26.136551+0000","last_clean":"2023-10-03T10:11:26.136551+0000","last_became_active":"2023-10-03T10:09:14.350445+0000","last_became_peered":"2023-10-03T10:09:14.350445+0000","last_unstale":"2023-10-03T10:11:26.136551+0000","last_undegraded":"2023-10-03T10:11:26.136551+0000","last_fullsized":"2023-10-03T10:11:26.136551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159741+0000","last_change":"2023-10-03T10:09:14.707995+0000","last_active":"2023-10-03T10:11:27.159741+0000","last_peered":"2023-10-03T10:11:27.159741+0000","last_clean":"2023-10-03T10:11:27.159741+0000","last_became_active":"2023-10-03T10:09:14.707723+0000","last_became_peered":"2023-10-03T10:09:14.707723+0000","last_unstale":"2023-10-03T10:11:27.159741+0000","last_undegraded":"2023-10-03T10:11:27.159741+0000","last_fullsized":"2023-10-03T10:11:27.159741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410173+0000","last_change":"2023-10-03T10:09:14.345357+0000","last_active":"2023-10-03T10:11:26.410173+0000","last_peered":"2023-10-03T10:11:26.410173+0000","last_clean":"2023-10-03T10:11:26.410173+0000","last_became_active":"2023-10-03T10:09:14.344951+0000","last_became_peered":"2023-10-03T10:09:14.344951+0000","last_unstale":"2023-10-03T10:11:26.410173+0000","last_undegraded":"2023-10-03T10:11:26.410173+0000","last_fullsized":"2023-10-03T10:11:26.410173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159828+0000","last_change":"2023-10-03T10:09:14.724291+0000","last_active":"2023-10-03T10:11:27.159828+0000","last_peered":"2023-10-03T10:11:27.159828+0000","last_clean":"2023-10-03T10:11:27.159828+0000","last_became_active":"2023-10-03T10:09:14.723559+0000","last_became_peered":"2023-10-03T10:09:14.723559+0000","last_unstale":"2023-10-03T10:11:27.159828+0000","last_undegraded":"2023-10-03T10:11:27.159828+0000","last_fullsized":"2023-10-03T10:11:27.159828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319695+0000","last_change":"2023-10-03T10:09:14.345918+0000","last_active":"2023-10-03T10:11:25.319695+0000","last_peered":"2023-10-03T10:11:25.319695+0000","last_clean":"2023-10-03T10:11:25.319695+0000","last_became_active":"2023-10-03T10:09:14.345634+0000","last_became_peered":"2023-10-03T10:09:14.345634+0000","last_unstale":"2023-10-03T10:11:25.319695+0000","last_undegraded":"2023-10-03T10:11:25.319695+0000","last_fullsized":"2023-10-03T10:11:25.319695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159553+0000","last_change":"2023-10-03T10:09:14.718860+0000","last_active":"2023-10-03T10:11:27.159553+0000","last_peered":"2023-10-03T10:11:27.159553+0000","last_clean":"2023-10-03T10:11:27.159553+0000","last_became_active":"2023-10-03T10:09:14.716545+0000","last_became_peered":"2023-10-03T10:09:14.716545+0000","last_unstale":"2023-10-03T10:11:27.159553+0000","last_undegraded":"2023-10-03T10:11:27.159553+0000","last_fullsized":"2023-10-03T10:11:27.159553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319597+0000","last_change":"2023-10-03T10:09:14.351568+0000","last_active":"2023-10-03T10:11:25.319597+0000","last_peered":"2023-10-03T10:11:25.319597+0000","last_clean":"2023-10-03T10:11:25.319597+0000","last_became_active":"2023-10-03T10:09:14.351293+0000","last_became_peered":"2023-10-03T10:09:14.351293+0000","last_unstale":"2023-10-03T10:11:25.319597+0000","last_undegraded":"2023-10-03T10:11:25.319597+0000","last_fullsized":"2023-10-03T10:11:25.319597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319123+0000","last_change":"2023-10-03T10:09:14.720328+0000","last_active":"2023-10-03T10:11:25.319123+0000","last_peered":"2023-10-03T10:11:25.319123+0000","last_clean":"2023-10-03T10:11:25.319123+0000","last_became_active":"2023-10-03T10:09:14.720033+0000","last_became_peered":"2023-10-03T10:09:14.720033+0000","last_unstale":"2023-10-03T10:11:25.319123+0000","last_undegraded":"2023-10-03T10:11:25.319123+0000","last_fullsized":"2023-10-03T10:11:25.319123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.137081+0000","last_change":"2023-10-03T10:09:14.352301+0000","last_active":"2023-10-03T10:11:26.137081+0000","last_peered":"2023-10-03T10:11:26.137081+0000","last_clean":"2023-10-03T10:11:26.137081+0000","last_became_active":"2023-10-03T10:09:14.352027+0000","last_became_peered":"2023-10-03T10:09:14.352027+0000","last_unstale":"2023-10-03T10:11:26.137081+0000","last_undegraded":"2023-10-03T10:11:26.137081+0000","last_fullsized":"2023-10-03T10:11:26.137081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:13.299973+0000","last_clean_scrub_stamp":"2023-10-03T10:09:13.299973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159305+0000","last_change":"2023-10-03T10:09:14.713576+0000","last_active":"2023-10-03T10:11:27.159305+0000","last_peered":"2023-10-03T10:11:27.159305+0000","last_clean":"2023-10-03T10:11:27.159305+0000","last_became_active":"2023-10-03T10:09:14.713175+0000","last_became_peered":"2023-10-03T10:09:14.713175+0000","last_unstale":"2023-10-03T10:11:27.159305+0000","last_undegraded":"2023-10-03T10:11:27.159305+0000","last_fullsized":"2023-10-03T10:11:27.159305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.409910+0000","last_change":"2023-10-03T10:09:14.712406+0000","last_active":"2023-10-03T10:11:26.409910+0000","last_peered":"2023-10-03T10:11:26.409910+0000","last_clean":"2023-10-03T10:11:26.409910+0000","last_became_active":"2023-10-03T10:09:14.712076+0000","last_became_peered":"2023-10-03T10:09:14.712076+0000","last_unstale":"2023-10-03T10:11:26.409910+0000","last_undegraded":"2023-10-03T10:11:26.409910+0000","last_fullsized":"2023-10-03T10:11:26.409910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:27.159317+0000","last_change":"2023-10-03T10:10:04.994212+0000","last_active":"2023-10-03T10:11:27.159317+0000","last_peered":"2023-10-03T10:11:27.159317+0000","last_clean":"2023-10-03T10:11:27.159317+0000","last_became_active":"2023-10-03T10:10:04.993913+0000","last_became_peered":"2023-10-03T10:10:04.993913+0000","last_unstale":"2023-10-03T10:11:27.159317+0000","last_undegraded":"2023-10-03T10:11:27.159317+0000","last_fullsized":"2023-10-03T10:11:27.159317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.135785+0000","last_change":"2023-10-03T10:09:14.710814+0000","last_active":"2023-10-03T10:11:26.135785+0000","last_peered":"2023-10-03T10:11:26.135785+0000","last_clean":"2023-10-03T10:11:26.135785+0000","last_became_active":"2023-10-03T10:09:14.710640+0000","last_became_peered":"2023-10-03T10:09:14.710640+0000","last_unstale":"2023-10-03T10:11:26.135785+0000","last_undegraded":"2023-10-03T10:11:26.135785+0000","last_fullsized":"2023-10-03T10:11:26.135785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:25.319315+0000","last_change":"2023-10-03T10:10:04.997102+0000","last_active":"2023-10-03T10:11:25.319315+0000","last_peered":"2023-10-03T10:11:25.319315+0000","last_clean":"2023-10-03T10:11:25.319315+0000","last_became_active":"2023-10-03T10:10:04.996741+0000","last_became_peered":"2023-10-03T10:10:04.996741+0000","last_unstale":"2023-10-03T10:11:25.319315+0000","last_undegraded":"2023-10-03T10:11:25.319315+0000","last_fullsized":"2023-10-03T10:11:25.319315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:11:26.410194+0000","last_change":"2023-10-03T10:09:14.708167+0000","last_active":"2023-10-03T10:11:26.410194+0000","last_peered":"2023-10-03T10:11:26.410194+0000","last_clean":"2023-10-03T10:11:26.410194+0000","last_became_active":"2023-10-03T10:09:14.707761+0000","last_became_peered":"2023-10-03T10:09:14.707761+0000","last_unstale":"2023-10-03T10:11:26.410194+0000","last_undegraded":"2023-10-03T10:11:26.410194+0000","last_fullsized":"2023-10-03T10:11:26.410194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:14.303267+0000","last_clean_scrub_stamp":"2023-10-03T10:09:14.303267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":71207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28100000000000003},"min":{"1min":0.218,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29199999999999998},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.45300000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.307,"15min":0.30399999999999999},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Oct 3 10:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48199999999999998,"5min":0.495,"15min":0.495},"last":0.47899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":71013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27100000000000002},"min":{"1min":0.20000000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.245},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.307,"15min":0.307},"min":{"1min":0.22900000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30199999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":68150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29199999999999998},"min":{"1min":0.215,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.26400000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.22,"15min":0.22},"max":{"1min":0.45700000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.439,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.253}]},{"osd":3,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.318,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.307,"15min":0.30399999999999999},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45000000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.314}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":68096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27700000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28100000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:33.960 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:11:33.960 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:11:33.960 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:11:33.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:11:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.114+0000 7fe116887700 1 Processor -- start 2023-10-03T10:11:34.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.114+0000 7fe116887700 1 -- start start 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe116887700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe116887700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe116887700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11009a760 con 0x7fe110134210 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe116887700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1101336e0 con 0x7fe110133900 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe116887700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe11009a080 con 0x7fe1100a10b0 2023-10-03T10:11:34.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34608/0 (socket says 172.21.15.125:34608) 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe110134210 0x7fe1100a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49550/0 (socket says 172.21.15.125:49550) 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54594/0 (socket says 172.21.15.125:54594) 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10ffff700 1 -- 172.21.15.125:0/663012351 learned_addr learned my addr 172.21.15.125:0/663012351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 -- 172.21.15.125:0/663012351 >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 msgr2=0x7fe110133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 --2- 172.21.15.125:0/663012351 >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 -- 172.21.15.125:0/663012351 >> v1:172.21.15.125:6789/0 conn(0x7fe110134210 legacy=0x7fe1100a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 -- 172.21.15.125:0/663012351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100a23e0 con 0x7fe1100a10b0 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10effd700 1 -- 172.21.15.125:0/663012351 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555702750 0 0) 0x7fe11009a760 con 0x7fe110134210 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10ffff700 1 --2- 172.21.15.125:0/663012351 >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe114e24700 1 --2- 172.21.15.125:0/663012351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe108009d90 tx=0x7fe10800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a338c5e53c78a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10effd700 1 -- 172.21.15.125:0/663012351 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800e070 con 0x7fe1100a10b0 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10effd700 1 -- 172.21.15.125:0/663012351 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800bb20 con 0x7fe1100a10b0 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.115+0000 7fe10effd700 1 -- 172.21.15.125:0/663012351 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108012430 con 0x7fe1100a10b0 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 -- 172.21.15.125:0/663012351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 msgr2=0x7fe11013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 --2- 172.21.15.125:0/663012351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe108009d90 tx=0x7fe10800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 -- 172.21.15.125:0/663012351 shutdown_connections 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 --2- 172.21.15.125:0/663012351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11013b910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 --2- 172.21.15.125:0/663012351 >> v2:172.21.15.125:3300/0 conn(0x7fe110133900 0x7fe110133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 -- 172.21.15.125:0/663012351 >> 172.21.15.125:0/663012351 conn(0x7fe1100a2980 msgr2=0x7fe1100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:34.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 -- 172.21.15.125:0/663012351 shutdown_connections 2023-10-03T10:11:34.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.116+0000 7fe116887700 1 -- 172.21.15.125:0/663012351 wait complete. 2023-10-03T10:11:34.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.117+0000 7fe116887700 1 Processor -- start 2023-10-03T10:11:34.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.117+0000 7fe116887700 1 -- start start 2023-10-03T10:11:34.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.117+0000 7fe116887700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110121b90 con 0x7fe110134210 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101209d0 con 0x7fe110133900 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe110132cb0 con 0x7fe1100a10b0 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34618/0 (socket says 172.21.15.125:34618) 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53438/0 (socket says 172.21.15.125:53438) 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 -- 172.21.15.125:0/3929520337 learned_addr learned my addr 172.21.15.125:0/3929520337 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10ffff700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 -- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 msgr2=0x7fe11011d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11011d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 -- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 msgr2=0x7fe11011dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 -- 172.21.15.125:0/3929520337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104009500 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10ffff700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10f7fe700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe114e24700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe10800b680 tx=0x7fe108004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108012430 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108020070 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe108009a70 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108004280 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.118+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110120ef0 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.119+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fe1080043e0 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.119+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe108022070 con 0x7fe110134210 2023-10-03T10:11:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.119+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11011a590 con 0x7fe110134210 2023-10-03T10:11:34.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.124+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe108012e10 con 0x7fe110134210 2023-10-03T10:11:34.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.354+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe11004f2a0 con 0x7fe110134210 2023-10-03T10:11:34.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.354+0000 7fe10cff9700 1 -- 172.21.15.125:0/3929520337 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe10801a380 con 0x7fe110134210 2023-10-03T10:11:34.355 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:34.355 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:11:34.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 >> v1:172.21.15.125:6816/126957 conn(0x7fe0fc02f480 legacy=0x7fe0fc031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 msgr2=0x7fe11011e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe10800b680 tx=0x7fe108004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 shutdown_connections 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe110134210 0x7fe11011e290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe1100a10b0 0x7fe11011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 --2- 172.21.15.125:0/3929520337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe110133900 0x7fe11011dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 >> 172.21.15.125:0/3929520337 conn(0x7fe1100a2980 msgr2=0x7fe1101bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 shutdown_connections 2023-10-03T10:11:34.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.356+0000 7fe116887700 1 -- 172.21.15.125:0/3929520337 wait complete. 2023-10-03T10:11:34.368 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:11:34.368 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:34.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 Processor -- start 2023-10-03T10:11:34.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 -- start start 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0f581368e0 0x7f0f58138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 0x7f0f5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5809a760 con 0x7f0f58133900 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f581336e0 con 0x7f0f581368e0 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.491+0000 7f0f5e98b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809a080 con 0x7f0f58139200 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0f581368e0 0x7f0f58138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f5cf28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 0x7f0f5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f57fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0f58133900 0x7f0f58133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49554/0 (socket says 172.21.15.125:49554) 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f57fff700 1 -- 172.21.15.125:0/966902335 learned_addr learned my addr 172.21.15.125:0/966902335 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f56ffd700 1 -- 172.21.15.125:0/966902335 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577270128 0 0) 0x7f0f5809a760 con 0x7f0f58133900 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f56ffd700 1 -- 172.21.15.125:0/966902335 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f400035b0 con 0x7f0f58133900 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 -- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 msgr2=0x7f0f5813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 0x7f0f5813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 -- 172.21.15.125:0/966902335 >> v1:172.21.15.125:6789/0 conn(0x7f0f58133900 legacy=0x7f0f58133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 -- 172.21.15.125:0/966902335 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580a23e0 con 0x7f0f581368e0 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f5cf28700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 0x7f0f5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f577fe700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f581368e0 0x7f0f58138cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009840 tx=0x7f0f48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ee0ecf2a678d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f56ffd700 1 -- 172.21.15.125:0/966902335 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48011830 con 0x7f0f581368e0 2023-10-03T10:11:34.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f56ffd700 1 -- 172.21.15.125:0/966902335 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f48011990 con 0x7f0f581368e0 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.492+0000 7f0f56ffd700 1 -- 172.21.15.125:0/966902335 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48011d20 con 0x7f0f581368e0 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 -- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f581368e0 msgr2=0x7f0f58138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f581368e0 0x7f0f58138cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009840 tx=0x7f0f48009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 -- 172.21.15.125:0/966902335 shutdown_connections 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58139200 0x7f0f5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/966902335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f581368e0 0x7f0f58138cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 -- 172.21.15.125:0/966902335 >> 172.21.15.125:0/966902335 conn(0x7f0f580a2980 msgr2=0x7f0f580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 -- 172.21.15.125:0/966902335 shutdown_connections 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.493+0000 7f0f5e98b700 1 -- 172.21.15.125:0/966902335 wait complete. 2023-10-03T10:11:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 Processor -- start 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 -- start start 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 0x7f0f5811b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5811e9d0 con 0x7f0f58139200 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5811d0e0 con 0x7f0f581368e0 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5e98b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809a2c0 con 0x7f0f58133900 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f57fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5cf28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f577fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 0x7f0f5811b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f57fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54616/0 (socket says 172.21.15.125:54616) 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f5cf28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34628/0 (socket says 172.21.15.125:34628) 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.494+0000 7f0f57fff700 1 -- 172.21.15.125:0/2222055288 learned_addr learned my addr 172.21.15.125:0/2222055288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 -- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 msgr2=0x7f0f5811aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 -- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 msgr2=0x7f0f5811b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 -- 172.21.15.125:0/2222055288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50009a70 con 0x7f0f581368e0 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f5cf28700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f57fff700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f577fe700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 0x7f0f5811b3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f48016000 tx=0x7f0f48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48004550 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4801f070 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f480094a0 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480038e0 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.495+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5811e430 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.496+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0f48003a40 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.496+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f0f48021070 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.496+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5811d310 con 0x7f0f581368e0 2023-10-03T10:11:34.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.501+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f4802b030 con 0x7f0f581368e0 2023-10-03T10:11:34.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.684+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f5804f2a0 con 0x7f0f581368e0 2023-10-03T10:11:34.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.685+0000 7f0f54ff9700 1 -- 172.21.15.125:0/2222055288 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12897 (secure 0 0 0) 0x7f0f4802b070 con 0x7f0f581368e0 2023-10-03T10:11:34.686 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:34.686 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:31.987149+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:34.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 >> v1:172.21.15.125:6816/126957 conn(0x7f0f4402f510 legacy=0x7f0f440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 msgr2=0x7f0f5811b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 0x7f0f5811b3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f48016000 tx=0x7f0f48004750 comp rx=0 tx=0).stop 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 shutdown_connections 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f58139200 0x7f0f5811b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.687+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0f58133900 0x7f0f5811aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.688+0000 7f0f5e98b700 1 --2- 172.21.15.125:0/2222055288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f581368e0 0x7f0f5811b3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.688+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 >> 172.21.15.125:0/2222055288 conn(0x7f0f580a2980 msgr2=0x7f0f58131a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.688+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 shutdown_connections 2023-10-03T10:11:34.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.688+0000 7f0f5e98b700 1 -- 172.21.15.125:0/2222055288 wait complete. 2023-10-03T10:11:34.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:11:34.701 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:11:34.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.824+0000 7f5a95a66700 1 Processor -- start 2023-10-03T10:11:34.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.824+0000 7f5a95a66700 1 -- start start 2023-10-03T10:11:34.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a95a66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a95a66700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a9009ad70 0x7f5a9009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a95a66700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9009a590 con 0x7f5a90133a80 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a95a66700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9009e5d0 con 0x7f5a9009ad70 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a95a66700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9006b450 con 0x7f5a9009d780 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a9009ad70 0x7f5a9009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5a90133a80 0x7f5a90133ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49562/0 (socket says 172.21.15.125:49562) 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8ffff700 1 -- 172.21.15.125:0/69209554 learned_addr learned my addr 172.21.15.125:0/69209554 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8effd700 1 -- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 msgr2=0x7f5a9009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8effd700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9009db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8effd700 1 -- 172.21.15.125:0/69209554 >> v1:172.21.15.125:6789/0 conn(0x7f5a90133a80 legacy=0x7f5a90133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8e7fc700 1 -- 172.21.15.125:0/69209554 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895782170 0 0) 0x7f5a9009a590 con 0x7f5a90133a80 2023-10-03T10:11:34.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8effd700 1 -- 172.21.15.125:0/69209554 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9006a9e0 con 0x7f5a9009ad70 2023-10-03T10:11:34.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.825+0000 7f5a8f7fe700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a8effd700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9009e090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009840 tx=0x7f5a78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5fb7956ea066b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a8e7fc700 1 -- 172.21.15.125:0/69209554 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011830 con 0x7f5a9009ad70 2023-10-03T10:11:34.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a8e7fc700 1 -- 172.21.15.125:0/69209554 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78011990 con 0x7f5a9009ad70 2023-10-03T10:11:34.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a8e7fc700 1 -- 172.21.15.125:0/69209554 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011d20 con 0x7f5a9009ad70 2023-10-03T10:11:34.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 -- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 msgr2=0x7f5a9009e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9009e090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009840 tx=0x7f5a78009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 -- 172.21.15.125:0/69209554 shutdown_connections 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 --2- 172.21.15.125:0/69209554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9009e090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 -- 172.21.15.125:0/69209554 >> 172.21.15.125:0/69209554 conn(0x7f5a9009f980 msgr2=0x7f5a9009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 -- 172.21.15.125:0/69209554 shutdown_connections 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.826+0000 7f5a95a66700 1 -- 172.21.15.125:0/69209554 wait complete. 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.827+0000 7f5a95a66700 1 Processor -- start 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.827+0000 7f5a95a66700 1 -- start start 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 0x7f5a9011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:34.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a90122550 con 0x7f5a9009ad70 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9011fc80 con 0x7f5a90133a80 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a901202a0 con 0x7f5a9009d780 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 0x7f5a9011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34650/0 (socket says 172.21.15.125:34650) 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54634/0 (socket says 172.21.15.125:54634) 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 0x7f5a9011eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53446/0 (socket says 172.21.15.125:53446) 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 -- 172.21.15.125:0/1226466438 learned_addr learned my addr 172.21.15.125:0/1226466438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 -- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 msgr2=0x7f5a9011e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 -- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 msgr2=0x7f5a9011eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:34.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 0x7f5a9011eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 -- 172.21.15.125:0/1226466438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800094a0 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8effd700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a8f7fe700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000ebe0 tx=0x7f5a8000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000c850 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8000c9b0 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000cd40 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.828+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a780094a0 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.829+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a90121320 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.829+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5a80013470 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.829+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f5a8003fd00 con 0x7f5a9009ad70 2023-10-03T10:11:34.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.830+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a900a1330 con 0x7f5a9009ad70 2023-10-03T10:11:34.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:34.834+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a80021020 con 0x7f5a9009ad70 2023-10-03T10:11:35.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.017+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a9009c710 con 0x7f5a9009ad70 2023-10-03T10:11:35.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.017+0000 7f5a87fff700 1 -- 172.21.15.125:0/1226466438 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a80013720 con 0x7f5a9009ad70 2023-10-03T10:11:35.018 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:11:35.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.019+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 >> v1:172.21.15.125:6816/126957 conn(0x7f5a7002f510 legacy=0x7f5a700319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.019+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 msgr2=0x7f5a9011e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.019+0000 7f5a95a66700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000ebe0 tx=0x7f5a8000eef0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 shutdown_connections 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a90133a80 0x7f5a9011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a9009ad70 0x7f5a9011e0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 --2- 172.21.15.125:0/1226466438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a9009d780 0x7f5a9011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 >> 172.21.15.125:0/1226466438 conn(0x7f5a9009f980 msgr2=0x7f5a90132fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 shutdown_connections 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.020+0000 7f5a95a66700 1 -- 172.21.15.125:0/1226466438 wait complete. 2023-10-03T10:11:35.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.155+0000 7f9229989700 1 Processor -- start 2023-10-03T10:11:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.155+0000 7f9229989700 1 -- start start 2023-10-03T10:11:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9229989700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409e260 0x7f9224135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9229989700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9224136010 0x7f92241383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9229989700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922409e690 con 0x7f922409d780 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9229989700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922409d430 con 0x7f9224136010 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9229989700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922409e910 con 0x7f922409e260 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9224136010 0x7f92241383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9222ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f922409d780 0x7f922409db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49570/0 (socket says 172.21.15.125:49570) 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92227fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409e260 0x7f9224135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9222ffd700 1 -- 172.21.15.125:0/2876525961 learned_addr learned my addr 172.21.15.125:0/2876525961 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 -- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409e260 msgr2=0x7f9224135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 --2- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409e260 0x7f9224135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 -- 172.21.15.125:0/2876525961 >> v1:172.21.15.125:6789/0 conn(0x7f922409d780 legacy=0x7f922409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 -- 172.21.15.125:0/2876525961 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922409b380 con 0x7f9224136010 2023-10-03T10:11:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9221ffb700 1 -- 172.21.15.125:0/2876525961 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221147015 0 0) 0x7f922409e690 con 0x7f922409d780 2023-10-03T10:11:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f92237fe700 1 --2- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f92241383f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f921c009d90 tx=0x7f921c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7ca19cf8bbd54b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.156+0000 7f9221ffb700 1 -- 172.21.15.125:0/2876525961 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00e070 con 0x7f9224136010 2023-10-03T10:11:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9221ffb700 1 -- 172.21.15.125:0/2876525961 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00bb20 con 0x7f9224136010 2023-10-03T10:11:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9221ffb700 1 -- 172.21.15.125:0/2876525961 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c012430 con 0x7f9224136010 2023-10-03T10:11:35.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 -- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 msgr2=0x7f92241383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 --2- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f92241383f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f921c009d90 tx=0x7f921c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 -- 172.21.15.125:0/2876525961 shutdown_connections 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 --2- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f92241383f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 --2- 172.21.15.125:0/2876525961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409e260 0x7f9224135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 -- 172.21.15.125:0/2876525961 >> 172.21.15.125:0/2876525961 conn(0x7f922409f980 msgr2=0x7f922409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 -- 172.21.15.125:0/2876525961 shutdown_connections 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.157+0000 7f9229989700 1 -- 172.21.15.125:0/2876525961 wait complete. 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 Processor -- start 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 -- start start 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 0x7f922411f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f922411ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92241358e0 con 0x7f9224136010 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92241350c0 con 0x7f922409d780 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.158+0000 7f9229989700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922406b300 con 0x7f922409e260 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f92227fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 0x7f922411f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53460/0 (socket says 172.21.15.125:53460) 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f92227fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 0x7f922411f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:54644/0 (socket says 172.21.15.125:54644) 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f92237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f922411ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 -- 172.21.15.125:0/3706375557 learned_addr learned my addr 172.21.15.125:0/3706375557 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 -- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 msgr2=0x7f922411f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 0x7f922411f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 -- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 msgr2=0x7f922411ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f922411ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 -- 172.21.15.125:0/3706375557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c009a70 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f92237fe700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f922411ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9222ffd700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f921800c520 tx=0x7f921800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218004c80 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218004e00 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9224125cb0 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218007310 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.159+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922406a950 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.160+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922404f2a0 con 0x7f922409d780 2023-10-03T10:11:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.160+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9218007470 con 0x7f922409d780 2023-10-03T10:11:35.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.161+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f921803fd90 con 0x7f922409d780 2023-10-03T10:11:35.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.165+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92180133c0 con 0x7f922409d780 2023-10-03T10:11:35.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.348+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f922409b5a0 con 0x7f922409d780 2023-10-03T10:11:35.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.348+0000 7f920bfff700 1 -- 172.21.15.125:0/3706375557 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92180102c0 con 0x7f922409d780 2023-10-03T10:11:35.349 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:11:35.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 >> v1:172.21.15.125:6816/126957 conn(0x7f921002f510 legacy=0x7f92100319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 msgr2=0x7f922411f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f921800c520 tx=0x7f921800c830 comp rx=0 tx=0).stop 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 shutdown_connections 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9224136010 0x7f922411ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922409d780 0x7f922411f490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 --2- 172.21.15.125:0/3706375557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922409e260 0x7f922411f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.350+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 >> 172.21.15.125:0/3706375557 conn(0x7f922409f980 msgr2=0x7f92240a1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.351+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 shutdown_connections 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.351+0000 7f9229989700 1 -- 172.21.15.125:0/3706375557 wait complete. 2023-10-03T10:11:35.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:35.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.486+0000 7fa0fa091700 1 Processor -- start 2023-10-03T10:11:35.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.486+0000 7fa0fa091700 1 -- start start 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0fa091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f4135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0fa091700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa0f4136010 0x7fa0f41383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0fa091700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f409e690 con 0x7fa0f409d780 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa0f4136010 0x7fa0f41383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0fa091700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f409d430 con 0x7fa0f4136010 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0fa091700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f409e910 con 0x7fa0f409e260 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa0f409d780 0x7fa0f409db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36896/0 (socket says 172.21.15.125:36896) 2023-10-03T10:11:35.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f37fe700 1 -- 172.21.15.125:0/3331068175 learned_addr learned my addr 172.21.15.125:0/3331068175 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f2ffd700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f4135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f3fff700 1 -- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 msgr2=0x7fa0f4135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f3fff700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f4135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f3fff700 1 -- 172.21.15.125:0/3331068175 >> v1:172.21.15.125:6789/0 conn(0x7fa0f409d780 legacy=0x7fa0f409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f3fff700 1 -- 172.21.15.125:0/3331068175 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f409b380 con 0x7fa0f4136010 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.487+0000 7fa0f27fc700 1 -- 172.21.15.125:0/3331068175 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375100796 0 0) 0x7fa0f409e690 con 0x7fa0f409d780 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0f2ffd700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f4135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0f3fff700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f4136010 0x7fa0f41383f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00bfa0 tx=0x7fa0ec00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4787fdecc440bbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0f27fc700 1 -- 172.21.15.125:0/3331068175 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec010070 con 0x7fa0f4136010 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0f27fc700 1 -- 172.21.15.125:0/3331068175 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00b2e0 con 0x7fa0f4136010 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0f27fc700 1 -- 172.21.15.125:0/3331068175 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00dc40 con 0x7fa0f4136010 2023-10-03T10:11:35.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 -- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f4136010 msgr2=0x7fa0f41383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f4136010 0x7fa0f41383f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00bfa0 tx=0x7fa0ec00d330 comp rx=0 tx=0).stop 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 -- 172.21.15.125:0/3331068175 shutdown_connections 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f4136010 0x7fa0f41383f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 --2- 172.21.15.125:0/3331068175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f4135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 -- 172.21.15.125:0/3331068175 >> 172.21.15.125:0/3331068175 conn(0x7fa0f409f980 msgr2=0x7fa0f409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 -- 172.21.15.125:0/3331068175 shutdown_connections 2023-10-03T10:11:35.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.488+0000 7fa0fa091700 1 -- 172.21.15.125:0/3331068175 wait complete. 2023-10-03T10:11:35.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.489+0000 7fa0fa091700 1 Processor -- start 2023-10-03T10:11:35.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.489+0000 7fa0fa091700 1 -- start start 2023-10-03T10:11:35.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 0x7fa0f411e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0f4136010 0x7fa0f411ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f411fff0 con 0x7fa0f409d780 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41217e0 con 0x7fa0f409e260 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0fa091700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41206d0 con 0x7fa0f4136010 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0f4136010 0x7fa0f411ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47714/0 (socket says 172.21.15.125:47714) 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 -- 172.21.15.125:0/2819297683 learned_addr learned my addr 172.21.15.125:0/2819297683 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:35.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f37fe700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 0x7fa0f411e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 -- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0f4136010 msgr2=0x7fa0f411ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0f4136010 0x7fa0f411ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 -- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 msgr2=0x7fa0f411e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 0x7fa0f411e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f2ffd700 1 -- 172.21.15.125:0/2819297683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40094a0 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.490+0000 7fa0f37fe700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 0x7fa0f411e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0f2ffd700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400ec10 tx=0x7fa0e400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400c850 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400c9b0 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec00bc80 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400cd40 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f41210c0 con 0x7fa0f409e260 2023-10-03T10:11:35.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.491+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa0e4013470 con 0x7fa0f409e260 2023-10-03T10:11:35.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.492+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa0e4040050 con 0x7fa0f409e260 2023-10-03T10:11:35.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.492+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f404f2a0 con 0x7fa0f409e260 2023-10-03T10:11:35.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.496+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0e4017070 con 0x7fa0f409e260 2023-10-03T10:11:35.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.678+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0f409b5a0 con 0x7fa0f409e260 2023-10-03T10:11:35.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.678+0000 7fa0dbfff700 1 -- 172.21.15.125:0/2819297683 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0e4013720 con 0x7fa0f409e260 2023-10-03T10:11:35.679 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:11:35.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 >> v1:172.21.15.125:6816/126957 conn(0x7fa0e002f510 legacy=0x7fa0e00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 msgr2=0x7fa0f411e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400ec10 tx=0x7fa0e400ef20 comp rx=0 tx=0).stop 2023-10-03T10:11:35.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 shutdown_connections 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0f4136010 0x7fa0f411ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f409d780 0x7fa0f411e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 --2- 172.21.15.125:0/2819297683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f409e260 0x7fa0f411e830 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.680+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 >> 172.21.15.125:0/2819297683 conn(0x7fa0f409f980 msgr2=0x7fa0f4070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.681+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 shutdown_connections 2023-10-03T10:11:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.681+0000 7fa0fa091700 1 -- 172.21.15.125:0/2819297683 wait complete. 2023-10-03T10:11:35.693 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 Processor -- start 2023-10-03T10:11:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 -- start start 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac09a590 con 0x7f1fac09d780 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09e5d0 con 0x7f1fac09ad70 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb349e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac06b450 con 0x7f1fac133a80 2023-10-03T10:11:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb0a39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb1a3b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb123a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb1a3b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50138/0 (socket says 172.21.15.125:50138) 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb123a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43276/0 (socket says 172.21.15.125:43276) 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb0a39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47720/0 (socket says 172.21.15.125:47720) 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.816+0000 7f1fb1a3b700 1 -- 172.21.15.125:0/1104628150 learned_addr learned my addr 172.21.15.125:0/1104628150 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 -- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 msgr2=0x7f1fac133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 -- 172.21.15.125:0/1104628150 >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 msgr2=0x7f1fac09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/1104628150 >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 -- 172.21.15.125:0/1104628150 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac06a9e0 con 0x7f1fac09ad70 2023-10-03T10:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb123a700 1 --2- 172.21.15.125:0/1104628150 >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb1a3b700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009840 tx=0x7f1f9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a41003439ebe3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fa3fff700 1 -- 172.21.15.125:0/1104628150 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c011830 con 0x7f1fac09ad70 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fa3fff700 1 -- 172.21.15.125:0/1104628150 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c011990 con 0x7f1fac09ad70 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.817+0000 7f1fa3fff700 1 -- 172.21.15.125:0/1104628150 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c011d20 con 0x7f1fac09ad70 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 -- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 msgr2=0x7f1fac09e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009840 tx=0x7f1f9c009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 -- 172.21.15.125:0/1104628150 shutdown_connections 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac133a80 0x7f1fac133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 --2- 172.21.15.125:0/1104628150 >> v2:172.21.15.125:3300/0 conn(0x7f1fac09d780 0x7f1fac09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 --2- 172.21.15.125:0/1104628150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac09ad70 0x7f1fac09e090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 -- 172.21.15.125:0/1104628150 >> 172.21.15.125:0/1104628150 conn(0x7f1fac09f980 msgr2=0x7f1fac09fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 -- 172.21.15.125:0/1104628150 shutdown_connections 2023-10-03T10:11:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.818+0000 7f1fb349e700 1 -- 172.21.15.125:0/1104628150 wait complete. 2023-10-03T10:11:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 Processor -- start 2023-10-03T10:11:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 -- start start 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 0x7f1fac11e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac133a80 0x7f1fac11ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac120360 con 0x7f1fac09ad70 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac121420 con 0x7f1fac133a80 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb349e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09c710 con 0x7f1fac09d780 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb123a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 0x7f1fac11e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50148/0 (socket says 172.21.15.125:50148) 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 -- 172.21.15.125:0/4194177872 learned_addr learned my addr 172.21.15.125:0/4194177872 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:35.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb1a3b700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac133a80 0x7f1fac11ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 -- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac133a80 msgr2=0x7f1fac11ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac133a80 0x7f1fac11ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 -- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 msgr2=0x7f1fac11e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 0x7f1fac11e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb0a39700 1 -- 172.21.15.125:0/4194177872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80094a0 con 0x7f1fac09d780 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.819+0000 7f1fb123a700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 0x7f1fac11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fb0a39700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0090b0 tx=0x7f1f9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c004450 con 0x7f1fac09d780 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c01f070 con 0x7f1fac09d780 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa4009b30 con 0x7f1fac09d780 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0038e0 con 0x7f1fac09d780 2023-10-03T10:11:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.820+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c0094a0 con 0x7f1fac09d780 2023-10-03T10:11:35.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.821+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1f9c003a40 con 0x7f1fac09d780 2023-10-03T10:11:35.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.821+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f1f9c021070 con 0x7f1fac09d780 2023-10-03T10:11:35.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.821+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac04f2a0 con 0x7f1fac09d780 2023-10-03T10:11:35.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:35.825+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f9c01a7b0 con 0x7f1fac09d780 2023-10-03T10:11:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.007+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fac11fd80 con 0x7f1fac09d780 2023-10-03T10:11:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.008+0000 7f1fa1ffb700 1 -- 172.21.15.125:0/4194177872 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f9c015030 con 0x7f1fac09d780 2023-10-03T10:11:36.008 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:11:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 >> v1:172.21.15.125:6816/126957 conn(0x7f1f9002f510 legacy=0x7f1f900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 msgr2=0x7f1fac11e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0090b0 tx=0x7f1f9c004750 comp rx=0 tx=0).stop 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 shutdown_connections 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fac133a80 0x7f1fac11ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fac09ad70 0x7f1fac11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 --2- 172.21.15.125:0/4194177872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fac09d780 0x7f1fac11e6b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 >> 172.21.15.125:0/4194177872 conn(0x7f1fac09f980 msgr2=0x7f1fac1330b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 shutdown_connections 2023-10-03T10:11:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.010+0000 7f1fb349e700 1 -- 172.21.15.125:0/4194177872 wait complete. 2023-10-03T10:11:36.022 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:36.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.142+0000 7f81cb9a0700 1 Processor -- start 2023-10-03T10:11:36.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.142+0000 7f81cb9a0700 1 -- start start 2023-10-03T10:11:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81cb9a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c409e340 0x7f81c41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81cb9a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 0x7f81c4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81cb9a0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c409aaa0 con 0x7f81c409d860 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81cb9a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c409e730 con 0x7f81c409e340 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81cb9a0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c409f870 con 0x7f81c4135f20 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c973c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f81c409d860 0x7f81c409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36902/0 (socket says 172.21.15.125:36902) 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c973c700 1 -- 172.21.15.125:0/2307605634 learned_addr learned my addr 172.21.15.125:0/2307605634 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 0x7f81c4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c8f3b700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c409e340 0x7f81c41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81bbfff700 1 -- 172.21.15.125:0/2307605634 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658097708 0 0) 0x7f81c409aaa0 con 0x7f81c409d860 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 -- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c409e340 msgr2=0x7f81c41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c409e340 0x7f81c41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 -- 172.21.15.125:0/2307605634 >> v1:172.21.15.125:6789/0 conn(0x7f81c409d860 legacy=0x7f81c409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 -- 172.21.15.125:0/2307605634 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c409b360 con 0x7f81c4135f20 2023-10-03T10:11:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81c9f3d700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 0x7f81c4138300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009df0 tx=0x7f81bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79abd50e19b3c6be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81bbfff700 1 -- 172.21.15.125:0/2307605634 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00e070 con 0x7f81c4135f20 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81bbfff700 1 -- 172.21.15.125:0/2307605634 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc00bae0 con 0x7f81c4135f20 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.143+0000 7f81bbfff700 1 -- 172.21.15.125:0/2307605634 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00be90 con 0x7f81c4135f20 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 msgr2=0x7f81c4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 0x7f81c4138300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009df0 tx=0x7f81bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2307605634 shutdown_connections 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c4135f20 0x7f81c4138300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2307605634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c409e340 0x7f81c41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2307605634 >> 172.21.15.125:0/2307605634 conn(0x7f81c4099c40 msgr2=0x7f81c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2307605634 shutdown_connections 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.144+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2307605634 wait complete. 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 Processor -- start 2023-10-03T10:11:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 -- start start 2023-10-03T10:11:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 0x7f81c41c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c4135f20 0x7f81c41c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4125160 con 0x7f81c409d860 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4125340 con 0x7f81c4135f20 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81cb9a0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c411e4c0 con 0x7f81c409e340 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81c8f3b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81c973c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 0x7f81c41c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81c8f3b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50164/0 (socket says 172.21.15.125:50164) 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81c8f3b700 1 -- 172.21.15.125:0/2670533547 learned_addr learned my addr 172.21.15.125:0/2670533547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.145+0000 7f81c9f3d700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c4135f20 0x7f81c41c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 -- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c4135f20 msgr2=0x7f81c41c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c4135f20 0x7f81c41c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 -- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 msgr2=0x7f81c41c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 0x7f81c41c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 -- 172.21.15.125:0/2670533547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009a70 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c973c700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 0x7f81c41c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81c8f3b700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e9e0 tx=0x7f81c000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0009710 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000ee80 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40a0740 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000ca50 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.146+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c406b280 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.147+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f81c000cbb0 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.147+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f81c003ff60 con 0x7f81c409e340 2023-10-03T10:11:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.147+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c404f2a0 con 0x7f81c409e340 2023-10-03T10:11:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.152+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c0021080 con 0x7f81c409e340 2023-10-03T10:11:36.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.373+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c406c3b0 con 0x7f81c409e340 2023-10-03T10:11:36.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.373+0000 7f81b9ffb700 1 -- 172.21.15.125:0/2670533547 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f81c0017020 con 0x7f81c409e340 2023-10-03T10:11:36.374 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:36.374 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:38.961227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 >> v1:172.21.15.125:6816/126957 conn(0x7f81a802f510 legacy=0x7f81a80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 msgr2=0x7f81c41c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e9e0 tx=0x7f81c000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 shutdown_connections 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c4135f20 0x7f81c41c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c409d860 0x7f81c41c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 --2- 172.21.15.125:0/2670533547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c409e340 0x7f81c41c8680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 >> 172.21.15.125:0/2670533547 conn(0x7f81c4099c40 msgr2=0x7f81c40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 shutdown_connections 2023-10-03T10:11:36.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.375+0000 7f81cb9a0700 1 -- 172.21.15.125:0/2670533547 wait complete. 2023-10-03T10:11:36.377 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-03T10:11:36.388 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:36.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 Processor -- start 2023-10-03T10:11:36.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 -- start start 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 0x7f4b0812d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 0x7f4b08130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b08130f20 con 0x7f4b08130ab0 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0809b180 con 0x7f4b08130120 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b10694700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0809ebd0 con 0x7f4b0809e800 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b0dc2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 0x7f4b08130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b0e430700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 0x7f4b0812d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b0ec31700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b08130ab0 0x7f4b08137470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36910/0 (socket says 172.21.15.125:36910) 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.508+0000 7f4b0ec31700 1 -- 172.21.15.125:0/169959014 learned_addr learned my addr 172.21.15.125:0/169959014 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0e430700 1 -- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 msgr2=0x7f4b08130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0d42e700 1 -- 172.21.15.125:0/169959014 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026571263 0 0) 0x7f4b08130f20 con 0x7f4b08130ab0 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0e430700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 0x7f4b08130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0e430700 1 -- 172.21.15.125:0/169959014 >> v1:172.21.15.125:6789/0 conn(0x7f4b08130ab0 legacy=0x7f4b08137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0e430700 1 -- 172.21.15.125:0/169959014 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0809b440 con 0x7f4b0809e800 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0dc2f700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 0x7f4b08130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0e430700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 0x7f4b0812d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009870 tx=0x7f4b04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88fba36cdd605c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0d42e700 1 -- 172.21.15.125:0/169959014 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04011830 con 0x7f4b0809e800 2023-10-03T10:11:36.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0d42e700 1 -- 172.21.15.125:0/169959014 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04011990 con 0x7f4b0809e800 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.509+0000 7f4b0d42e700 1 -- 172.21.15.125:0/169959014 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04011d20 con 0x7f4b0809e800 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 -- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 msgr2=0x7f4b0812d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 0x7f4b0812d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009870 tx=0x7f4b04009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 -- 172.21.15.125:0/169959014 shutdown_connections 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0809e800 0x7f4b0812d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 --2- 172.21.15.125:0/169959014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130120 0x7f4b08130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 -- 172.21.15.125:0/169959014 >> 172.21.15.125:0/169959014 conn(0x7f4b080a2ef0 msgr2=0x7f4b080a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 -- 172.21.15.125:0/169959014 shutdown_connections 2023-10-03T10:11:36.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.510+0000 7f4b10694700 1 -- 172.21.15.125:0/169959014 wait complete. 2023-10-03T10:11:36.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 Processor -- start 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 -- start start 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b08130120 0x7f4b08119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0811bbc0 con 0x7f4b0809e800 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0811a750 con 0x7f4b08130ab0 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b10694700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0811af00 con 0x7f4b08130120 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0e430700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0e430700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43298/0 (socket says 172.21.15.125:43298) 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0e430700 1 -- 172.21.15.125:0/4294512529 learned_addr learned my addr 172.21.15.125:0/4294512529 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47770/0 (socket says 172.21.15.125:47770) 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0dc2f700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b08130120 0x7f4b08119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 -- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b08130120 msgr2=0x7f4b08119a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b08130120 0x7f4b08119a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 -- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 msgr2=0x7f4b08119540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0ec31700 1 -- 172.21.15.125:0/4294512529 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80094a0 con 0x7f4b08130ab0 2023-10-03T10:11:36.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.511+0000 7f4b0e430700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4b0ec31700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000cc10 tx=0x7f4b0000cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000aa00 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000ab80 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b040094a0 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000070d0 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0812a810 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.512+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4b00007230 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.513+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f4b0003f880 con 0x7f4b08130ab0 2023-10-03T10:11:36.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.513+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0804f2a0 con 0x7f4b08130ab0 2023-10-03T10:11:36.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.517+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b00018080 con 0x7f4b08130ab0 2023-10-03T10:11:36.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.702+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b0812a480 con 0x7f4b08130ab0 2023-10-03T10:11:36.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.703+0000 7f4afeffd700 1 -- 172.21.15.125:0/4294512529 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12897 (secure 0 0 0) 0x7f4b000074e0 con 0x7f4b08130ab0 2023-10-03T10:11:36.704 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:36.704 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:31.987149+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 >> v1:172.21.15.125:6816/126957 conn(0x7f4aec02f510 legacy=0x7f4aec0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 msgr2=0x7f4b08119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000cc10 tx=0x7f4b0000cf20 comp rx=0 tx=0).stop 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 shutdown_connections 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b08130ab0 0x7f4b08119fc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0809e800 0x7f4b08119540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 --2- 172.21.15.125:0/4294512529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b08130120 0x7f4b08119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 >> 172.21.15.125:0/4294512529 conn(0x7f4b080a2ef0 msgr2=0x7f4b0809c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 shutdown_connections 2023-10-03T10:11:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.705+0000 7f4b10694700 1 -- 172.21.15.125:0/4294512529 wait complete. 2023-10-03T10:11:36.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:11:36.718 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:11:36.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.840+0000 7f20524ec700 1 Processor -- start 2023-10-03T10:11:36.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.840+0000 7f20524ec700 1 -- start start 2023-10-03T10:11:36.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f20524ec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 0x7f204c136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f20524ec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 0x7f204c138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f20524ec700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c131340 con 0x7f204c131730 2023-10-03T10:11:36.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f20524ec700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c06e690 con 0x7f204c09ed40 2023-10-03T10:11:36.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f20524ec700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c09b3d0 con 0x7f204c136ba0 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f204b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 0x7f204c136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 0x7f204c138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f204bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f204c131730 0x7f204c131b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36924/0 (socket says 172.21.15.125:36924) 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f204bfff700 1 -- 172.21.15.125:0/4220532341 learned_addr learned my addr 172.21.15.125:0/4220532341 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 -- 172.21.15.125:0/4220532341 >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 msgr2=0x7f204c136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 --2- 172.21.15.125:0/4220532341 >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 0x7f204c136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 -- 172.21.15.125:0/4220532341 >> v1:172.21.15.125:6789/0 conn(0x7f204c131730 legacy=0x7f204c131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 -- 172.21.15.125:0/4220532341 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c09a530 con 0x7f204c136ba0 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f204b7fe700 1 --2- 172.21.15.125:0/4220532341 >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 0x7f204c136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f204affd700 1 -- 172.21.15.125:0/4220532341 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517441956 0 0) 0x7f204c131340 con 0x7f204c131730 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.841+0000 7f2050a89700 1 --2- 172.21.15.125:0/4220532341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 0x7f204c138f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2044009d90 tx=0x7f204400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47eb7b6aca3a7ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f204affd700 1 -- 172.21.15.125:0/4220532341 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400e070 con 0x7f204c136ba0 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f204affd700 1 -- 172.21.15.125:0/4220532341 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400bb20 con 0x7f204c136ba0 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f204affd700 1 -- 172.21.15.125:0/4220532341 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044012430 con 0x7f204c136ba0 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 -- 172.21.15.125:0/4220532341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 msgr2=0x7f204c138f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 --2- 172.21.15.125:0/4220532341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 0x7f204c138f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2044009d90 tx=0x7f204400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 -- 172.21.15.125:0/4220532341 shutdown_connections 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 --2- 172.21.15.125:0/4220532341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c136ba0 0x7f204c138f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 --2- 172.21.15.125:0/4220532341 >> v2:172.21.15.125:3300/0 conn(0x7f204c09ed40 0x7f204c136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 -- 172.21.15.125:0/4220532341 >> 172.21.15.125:0/4220532341 conn(0x7f204c09f3f0 msgr2=0x7f204c09f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 -- 172.21.15.125:0/4220532341 shutdown_connections 2023-10-03T10:11:36.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.842+0000 7f20524ec700 1 -- 172.21.15.125:0/4220532341 wait complete. 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.843+0000 7f20524ec700 1 Processor -- start 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 -- start start 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 0x7f204c134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 0x7f204c134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c1353d0 con 0x7f204c09ed40 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c118f30 con 0x7f204c136ba0 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f20524ec700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c12ec80 con 0x7f204c131730 2023-10-03T10:11:36.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f204bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 0x7f204c134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f204bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43308/0 (socket says 172.21.15.125:43308) 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 0x7f204c134440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50202/0 (socket says 172.21.15.125:50202) 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f204bfff700 1 -- 172.21.15.125:0/191226717 learned_addr learned my addr 172.21.15.125:0/191226717 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.844+0000 7f2050a89700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 0x7f204c134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 -- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 msgr2=0x7f204c134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 0x7f204c134440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 -- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 msgr2=0x7f204c134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 0x7f204c134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 -- 172.21.15.125:0/191226717 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0094a0 con 0x7f204c09ed40 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f2050a89700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 0x7f204c134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f204bfff700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f204000c520 tx=0x7f204000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040004c80 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040004e00 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044009a70 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040007310 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.845+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c119b40 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.846+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2040007470 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.846+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f204003f730 con 0x7f204c09ed40 2023-10-03T10:11:36.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.846+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c09ce50 con 0x7f204c09ed40 2023-10-03T10:11:36.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:36.851+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20400123b0 con 0x7f204c09ed40 2023-10-03T10:11:37.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.034+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f204c04f2a0 con 0x7f204c09ed40 2023-10-03T10:11:37.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.034+0000 7f2048ff9700 1 -- 172.21.15.125:0/191226717 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2040011360 con 0x7f204c09ed40 2023-10-03T10:11:37.035 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 >> v1:172.21.15.125:6816/126957 conn(0x7f203802f510 legacy=0x7f20380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 msgr2=0x7f204c133f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f204000c520 tx=0x7f204000c830 comp rx=0 tx=0).stop 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 shutdown_connections 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f204c136ba0 0x7f204c134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f204c09ed40 0x7f204c133f00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 --2- 172.21.15.125:0/191226717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f204c131730 0x7f204c134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 >> 172.21.15.125:0/191226717 conn(0x7f204c09f3f0 msgr2=0x7f204c130fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 shutdown_connections 2023-10-03T10:11:37.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.036+0000 7f20524ec700 1 -- 172.21.15.125:0/191226717 wait complete. 2023-10-03T10:11:37.048 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:37.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 Processor -- start 2023-10-03T10:11:37.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 -- start start 2023-10-03T10:11:37.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f01320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.171+0000 7f76f7ce0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f009ec80 con 0x7f76f006b080 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f7ce0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009e020 con 0x7f76f0131c40 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f7ce0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009e8e0 con 0x7f76f006a770 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f527b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f627d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f01320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50214/0 (socket says 172.21.15.125:50214) 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 -- 172.21.15.125:0/475107369 learned_addr learned my addr 172.21.15.125:0/475107369 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f527b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43316/0 (socket says 172.21.15.125:43316) 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 -- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 msgr2=0x7f76f01320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f01320e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 -- 172.21.15.125:0/475107369 >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 msgr2=0x7f76f0131700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 --2- 172.21.15.125:0/475107369 >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 -- 172.21.15.125:0/475107369 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f009e250 con 0x7f76f006a770 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f527b700 1 --2- 172.21.15.125:0/475107369 >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f627d700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f01320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f5a7c700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098f0 tx=0x7f76ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08d3404ca725abc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f4a7a700 1 -- 172.21.15.125:0/475107369 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec011830 con 0x7f76f006a770 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f4a7a700 1 -- 172.21.15.125:0/475107369 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec011990 con 0x7f76f006a770 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.172+0000 7f76f4a7a700 1 -- 172.21.15.125:0/475107369 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec011d20 con 0x7f76f006a770 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 -- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 msgr2=0x7f76f006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098f0 tx=0x7f76ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 -- 172.21.15.125:0/475107369 shutdown_connections 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f01320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/475107369 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f006ab40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/475107369 >> v2:172.21.15.125:3300/0 conn(0x7f76f006b080 0x7f76f0131700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 -- 172.21.15.125:0/475107369 >> 172.21.15.125:0/475107369 conn(0x7f76f009f980 msgr2=0x7f76f009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 -- 172.21.15.125:0/475107369 shutdown_connections 2023-10-03T10:11:37.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.173+0000 7f76f7ce0700 1 -- 172.21.15.125:0/475107369 wait complete. 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 Processor -- start 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 -- start start 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f009aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009c1b0 con 0x7f76f006b080 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f01247c0 con 0x7f76f0131c40 2023-10-03T10:11:37.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f7ce0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0125e70 con 0x7f76f006a770 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f5a7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f527b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f627d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f009aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f5a7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50228/0 (socket says 172.21.15.125:50228) 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f5a7c700 1 -- 172.21.15.125:0/4130742457 learned_addr learned my addr 172.21.15.125:0/4130742457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.174+0000 7f76f527b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43322/0 (socket says 172.21.15.125:43322) 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 -- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 msgr2=0x7f76f009a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 -- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 msgr2=0x7f76f009aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f009aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 -- 172.21.15.125:0/4130742457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00094a0 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f5a7c700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f527b700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e980 tx=0x7f76e000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0004030 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0004190 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e8009a70 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0004520 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.175+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec009550 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.176+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f76e00036a0 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.176+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f76e003fbe0 con 0x7f76f006b080 2023-10-03T10:11:37.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.176+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0071f30 con 0x7f76f006b080 2023-10-03T10:11:37.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.180+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76e001bbe0 con 0x7f76f006b080 2023-10-03T10:11:37.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.365+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76f004f2a0 con 0x7f76f006b080 2023-10-03T10:11:37.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.365+0000 7f76e67fc700 1 -- 172.21.15.125:0/4130742457 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76e001b3b0 con 0x7f76f006b080 2023-10-03T10:11:37.366 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:11:37.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 >> v1:172.21.15.125:6816/126957 conn(0x7f76d402f510 legacy=0x7f76d40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 msgr2=0x7f76f009a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e980 tx=0x7f76e000ec90 comp rx=0 tx=0).stop 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 shutdown_connections 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f0131c40 0x7f76f009aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f006a770 0x7f76f009a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 --2- 172.21.15.125:0/4130742457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f006b080 0x7f76f009a960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 >> 172.21.15.125:0/4130742457 conn(0x7f76f009f980 msgr2=0x7f76f00a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 shutdown_connections 2023-10-03T10:11:37.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.367+0000 7f76f7ce0700 1 -- 172.21.15.125:0/4130742457 wait complete. 2023-10-03T10:11:37.380 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.502+0000 7ff80d750700 1 Processor -- start 2023-10-03T10:11:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.502+0000 7ff80d750700 1 -- start start 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff80d750700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 0x7ff8081300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff80d750700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff808130600 0x7ff80812c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff80d750700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80812f930 con 0x7ff80812c900 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff80d750700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80809e3e0 con 0x7ff808130600 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff80d750700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809aee0 con 0x7ff80812fcf0 2023-10-03T10:11:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8067fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff808130600 0x7ff80812c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff806ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 0x7ff8081300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8077fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff80812c900 0x7ff808136ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36930/0 (socket says 172.21.15.125:36930) 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8077fe700 1 -- 172.21.15.125:0/2459320666 learned_addr learned my addr 172.21.15.125:0/2459320666 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8067fc700 1 -- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 msgr2=0x7ff8081300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8067fc700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 0x7ff8081300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8067fc700 1 -- 172.21.15.125:0/2459320666 >> v1:172.21.15.125:6789/0 conn(0x7ff80812c900 legacy=0x7ff808136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff8067fc700 1 -- 172.21.15.125:0/2459320666 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80809b180 con 0x7ff808130600 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff805ffb700 1 -- 172.21.15.125:0/2459320666 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732336670 0 0) 0x7ff80812f930 con 0x7ff80812c900 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.503+0000 7ff806ffd700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 0x7ff8081300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff8067fc700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff808130600 0x7ff80812c3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80098a0 tx=0x7ff7f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b677583dfb8dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff805ffb700 1 -- 172.21.15.125:0/2459320666 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011830 con 0x7ff808130600 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff805ffb700 1 -- 172.21.15.125:0/2459320666 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8011990 con 0x7ff808130600 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff805ffb700 1 -- 172.21.15.125:0/2459320666 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011d20 con 0x7ff808130600 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 -- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff808130600 msgr2=0x7ff80812c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff808130600 0x7ff80812c3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80098a0 tx=0x7ff7f8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 -- 172.21.15.125:0/2459320666 shutdown_connections 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff80812fcf0 0x7ff8081300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 --2- 172.21.15.125:0/2459320666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff808130600 0x7ff80812c3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 -- 172.21.15.125:0/2459320666 >> 172.21.15.125:0/2459320666 conn(0x7ff8080a2200 msgr2=0x7ff8080a2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 -- 172.21.15.125:0/2459320666 shutdown_connections 2023-10-03T10:11:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.504+0000 7ff80d750700 1 -- 172.21.15.125:0/2459320666 wait complete. 2023-10-03T10:11:37.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.505+0000 7ff80d750700 1 Processor -- start 2023-10-03T10:11:37.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.505+0000 7ff80d750700 1 -- start start 2023-10-03T10:11:37.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 0x7ff808130a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 0x7ff808130fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 0x7ff8081314e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff808131ec0 con 0x7ff80812fcf0 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff808133c10 con 0x7ff808130600 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081325e0 con 0x7ff80812c900 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff806ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 0x7ff808130a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 0x7ff8081314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8067fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 0x7ff808130fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff806ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 0x7ff808130a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50242/0 (socket says 172.21.15.125:50242) 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff806ffd700 1 -- 172.21.15.125:0/4181188755 learned_addr learned my addr 172.21.15.125:0/4181188755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 -- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 msgr2=0x7ff808130a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 0x7ff808130a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 -- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 msgr2=0x7ff808130fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 0x7ff808130fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 -- 172.21.15.125:0/4181188755 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc009430 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8067fc700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 0x7ff808130fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff8077fe700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 0x7ff8081314e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff80000cbe0 tx=0x7ff80000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80000aa40 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80000abc0 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f80094a0 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.506+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000070d0 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.507+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8081398c0 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.507+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff800007230 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.507+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80804f2a0 con 0x7ff808130600 2023-10-03T10:11:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.507+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7ff80003f4a0 con 0x7ff808130600 2023-10-03T10:11:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.512+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff800019860 con 0x7ff808130600 2023-10-03T10:11:37.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.695+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff808133ed0 con 0x7ff808130600 2023-10-03T10:11:37.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.695+0000 7ff7ef7fe700 1 -- 172.21.15.125:0/4181188755 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff800018020 con 0x7ff808130600 2023-10-03T10:11:37.696 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 >> v1:172.21.15.125:6816/126957 conn(0x7ff7f402f540 legacy=0x7ff7f40319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 msgr2=0x7ff8081314e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 0x7ff8081314e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff80000cbe0 tx=0x7ff80000cef0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 shutdown_connections 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff808130600 0x7ff8081314e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff80812c900 0x7ff808130a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 --2- 172.21.15.125:0/4181188755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80812fcf0 0x7ff808130fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 >> 172.21.15.125:0/4181188755 conn(0x7ff8080a2200 msgr2=0x7ff8080a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 shutdown_connections 2023-10-03T10:11:37.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.697+0000 7ff80d750700 1 -- 172.21.15.125:0/4181188755 wait complete. 2023-10-03T10:11:37.709 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:37.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.832+0000 7feb591c6700 1 Processor -- start 2023-10-03T10:11:37.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.832+0000 7feb591c6700 1 -- start start 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb591c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 0x7feb54134c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb591c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb541375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb591c6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb540706f0 con 0x7feb5412f910 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb591c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb540709c0 con 0x7feb541303f0 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb591c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb54099a60 con 0x7feb541351d0 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 0x7feb54134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb541375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb52d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feb5412f910 0x7feb5412fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36932/0 (socket says 172.21.15.125:36932) 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb52d9d700 1 -- 172.21.15.125:0/799369659 learned_addr learned my addr 172.21.15.125:0/799369659 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 -- 172.21.15.125:0/799369659 >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 msgr2=0x7feb54134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 --2- 172.21.15.125:0/799369659 >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 0x7feb54134c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 -- 172.21.15.125:0/799369659 >> v1:172.21.15.125:6789/0 conn(0x7feb5412f910 legacy=0x7feb5412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb51d9b700 1 -- 172.21.15.125:0/799369659 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203734205 0 0) 0x7feb540706f0 con 0x7feb5412f910 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 -- 172.21.15.125:0/799369659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54072190 con 0x7feb541351d0 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5259c700 1 --2- 172.21.15.125:0/799369659 >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 0x7feb54134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.833+0000 7feb5359e700 1 --2- 172.21.15.125:0/799369659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb541375b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009d90 tx=0x7feb4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06ddd49d801e99e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb51d9b700 1 -- 172.21.15.125:0/799369659 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00e070 con 0x7feb541351d0 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb51d9b700 1 -- 172.21.15.125:0/799369659 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c00bb20 con 0x7feb541351d0 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb51d9b700 1 -- 172.21.15.125:0/799369659 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c012430 con 0x7feb541351d0 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 -- 172.21.15.125:0/799369659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 msgr2=0x7feb541375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 --2- 172.21.15.125:0/799369659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb541375b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009d90 tx=0x7feb4c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 -- 172.21.15.125:0/799369659 shutdown_connections 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 --2- 172.21.15.125:0/799369659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb541375b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 --2- 172.21.15.125:0/799369659 >> v2:172.21.15.125:3300/0 conn(0x7feb541303f0 0x7feb54134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 -- 172.21.15.125:0/799369659 >> 172.21.15.125:0/799369659 conn(0x7feb5409f3f0 msgr2=0x7feb5409f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 -- 172.21.15.125:0/799369659 shutdown_connections 2023-10-03T10:11:37.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.834+0000 7feb591c6700 1 -- 172.21.15.125:0/799369659 wait complete. 2023-10-03T10:11:37.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.835+0000 7feb591c6700 1 Processor -- start 2023-10-03T10:11:37.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.835+0000 7feb591c6700 1 -- start start 2023-10-03T10:11:37.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 0x7feb54099d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb5409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5409d3d0 con 0x7feb541303f0 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5409c950 con 0x7feb5412f910 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb591c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb54129fc0 con 0x7feb541351d0 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb5259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 0x7feb54099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb5359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb5409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb5259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43352/0 (socket says 172.21.15.125:43352) 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb5259c700 1 -- 172.21.15.125:0/350371265 learned_addr learned my addr 172.21.15.125:0/350371265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 -- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 msgr2=0x7feb5409a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb5409a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 -- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 msgr2=0x7feb5409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 -- 172.21.15.125:0/350371265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4400b740 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb5259c700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.836+0000 7feb52d9d700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 0x7feb54099d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb48000c00 tx=0x7feb4800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48005b80 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb48005ce0 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c009a70 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48007310 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5409c500 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feb48007470 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7feb4803eeb0 con 0x7feb5412f910 2023-10-03T10:11:37.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.837+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404f2a0 con 0x7feb5412f910 2023-10-03T10:11:37.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:37.842+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb48017020 con 0x7feb5412f910 2023-10-03T10:11:38.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.025+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb540717e0 con 0x7feb5412f910 2023-10-03T10:11:38.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.025+0000 7feb3b7fe700 1 -- 172.21.15.125:0/350371265 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb48019710 con 0x7feb5412f910 2023-10-03T10:11:38.026 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 >> v1:172.21.15.125:6816/126957 conn(0x7feb4002f510 legacy=0x7feb400319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 msgr2=0x7feb54099d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 0x7feb54099d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb48000c00 tx=0x7feb4800c730 comp rx=0 tx=0).stop 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 shutdown_connections 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb541351d0 0x7feb5409a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb5412f910 0x7feb54099d70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 --2- 172.21.15.125:0/350371265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb541303f0 0x7feb5409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 >> 172.21.15.125:0/350371265 conn(0x7feb5409f3f0 msgr2=0x7feb5406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 shutdown_connections 2023-10-03T10:11:38.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.027+0000 7feb591c6700 1 -- 172.21.15.125:0/350371265 wait complete. 2023-10-03T10:11:38.040 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.160+0000 7f2375238700 1 Processor -- start 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.160+0000 7f2375238700 1 -- start start 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f237009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237006eb30 con 0x7f2370131980 2023-10-03T10:11:38.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700a1640 con 0x7f237009bc70 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f2375238700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23700a22d0 con 0x7f237009c5c0 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f237009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43364/0 (socket says 172.21.15.125:43364) 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50268/0 (socket says 172.21.15.125:50268) 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236ed9d700 1 -- 172.21.15.125:0/1877767 learned_addr learned my addr 172.21.15.125:0/1877767 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 -- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 msgr2=0x7f237009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f237009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 -- 172.21.15.125:0/1877767 >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 msgr2=0x7f2370131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 --2- 172.21.15.125:0/1877767 >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 -- 172.21.15.125:0/1877767 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2370131550 con 0x7f237009c5c0 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236e59c700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f237009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236ed9d700 1 --2- 172.21.15.125:0/1877767 >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236f59e700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2368009dc0 tx=0x7f236800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98891133bb6efd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236dd9b700 1 -- 172.21.15.125:0/1877767 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800e070 con 0x7f237009c5c0 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236dd9b700 1 -- 172.21.15.125:0/1877767 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800bae0 con 0x7f237009c5c0 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.161+0000 7f236dd9b700 1 -- 172.21.15.125:0/1877767 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800be90 con 0x7f237009c5c0 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 -- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 msgr2=0x7f2370138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2368009dc0 tx=0x7f236800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 -- 172.21.15.125:0/1877767 shutdown_connections 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f237009c5c0 0x7f2370138700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 --2- 172.21.15.125:0/1877767 >> v2:172.21.15.125:3300/0 conn(0x7f2370131980 0x7f2370131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 --2- 172.21.15.125:0/1877767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f237009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 -- 172.21.15.125:0/1877767 >> 172.21.15.125:0/1877767 conn(0x7f23700a2980 msgr2=0x7f23700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 -- 172.21.15.125:0/1877767 shutdown_connections 2023-10-03T10:11:38.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.162+0000 7f2375238700 1 -- 172.21.15.125:0/1877767 wait complete. 2023-10-03T10:11:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 Processor -- start 2023-10-03T10:11:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 -- start start 2023-10-03T10:11:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 0x7f2370119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 0x7f237011a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237011abd0 con 0x7f237009c5c0 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237011b350 con 0x7f237009bc70 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f2375238700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f237011b970 con 0x7f2370131980 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f236ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f236e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 0x7f2370119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f236ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47834/0 (socket says 172.21.15.125:47834) 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f236ed9d700 1 -- 172.21.15.125:0/3589646183 learned_addr learned my addr 172.21.15.125:0/3589646183 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.164+0000 7f236f59e700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 0x7f237011a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 -- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 msgr2=0x7f237011a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 0x7f237011a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 -- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 msgr2=0x7f2370119740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 -- 172.21.15.125:0/3589646183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600094a0 con 0x7f237009c5c0 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236f59e700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 0x7f237011a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236ed9d700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f236e59c700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 0x7f2370119c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f236000e9b0 tx=0x7f236000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000ee50 con 0x7f237009c5c0 2023-10-03T10:11:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360004030 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236400d9a0 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23600043c0 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.165+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2368009a70 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.166+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f236000c7f0 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.166+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f236003f970 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.166+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237011ce70 con 0x7f237009c5c0 2023-10-03T10:11:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.170+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2360019d60 con 0x7f237009c5c0 2023-10-03T10:11:38.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.396+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23700a1c40 con 0x7f237009c5c0 2023-10-03T10:11:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.396+0000 7f23577fe700 1 -- 172.21.15.125:0/3589646183 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f2360019300 con 0x7f237009c5c0 2023-10-03T10:11:38.397 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:38.397 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:38.961227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 >> v1:172.21.15.125:6816/126957 conn(0x7f235c02f510 legacy=0x7f235c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 msgr2=0x7f2370119c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 0x7f2370119c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f236000e9b0 tx=0x7f236000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 shutdown_connections 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2370131980 0x7f237011a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f237009bc70 0x7f2370119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 --2- 172.21.15.125:0/3589646183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f237009c5c0 0x7f2370119c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 >> 172.21.15.125:0/3589646183 conn(0x7f23700a2980 msgr2=0x7f237012e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 shutdown_connections 2023-10-03T10:11:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.399+0000 7f2375238700 1 -- 172.21.15.125:0/3589646183 wait complete. 2023-10-03T10:11:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-03T10:11:38.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:38.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.532+0000 7fb8b3580700 1 Processor -- start 2023-10-03T10:11:38.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.532+0000 7fb8b3580700 1 -- start start 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b3580700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 0x7fb8ac138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b3580700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 0x7fb8ac13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b3580700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac06b2d0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b3580700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac1345b0 con 0x7fb8ac136960 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b3580700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac133610 con 0x7fb8ac139280 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 0x7fb8ac13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b0b1b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 0x7fb8ac138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b131c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb8ac133ad0 0x7fb8ac133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36942/0 (socket says 172.21.15.125:36942) 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b131c700 1 -- 172.21.15.125:0/1514352649 learned_addr learned my addr 172.21.15.125:0/1514352649 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 -- 172.21.15.125:0/1514352649 >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 msgr2=0x7fb8ac138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 --2- 172.21.15.125:0/1514352649 >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 0x7fb8ac138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 -- 172.21.15.125:0/1514352649 >> v1:172.21.15.125:6789/0 conn(0x7fb8ac133ad0 legacy=0x7fb8ac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 -- 172.21.15.125:0/1514352649 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac09a500 con 0x7fb8ac139280 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b0b1b700 1 --2- 172.21.15.125:0/1514352649 >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 0x7fb8ac138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8a3fff700 1 -- 172.21.15.125:0/1514352649 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483164547 0 0) 0x7fb8ac06b2d0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8b1b1d700 1 --2- 172.21.15.125:0/1514352649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 0x7fb8ac13b660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d90 tx=0x7fb8a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db331f6985dd8254 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.533+0000 7fb8a3fff700 1 -- 172.21.15.125:0/1514352649 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400e070 con 0x7fb8ac139280 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8a3fff700 1 -- 172.21.15.125:0/1514352649 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400bb20 con 0x7fb8ac139280 2023-10-03T10:11:38.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8a3fff700 1 -- 172.21.15.125:0/1514352649 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4012430 con 0x7fb8ac139280 2023-10-03T10:11:38.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 -- 172.21.15.125:0/1514352649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 msgr2=0x7fb8ac13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1514352649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 0x7fb8ac13b660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d90 tx=0x7fb8a400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:38.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 -- 172.21.15.125:0/1514352649 shutdown_connections 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1514352649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac139280 0x7fb8ac13b660 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1514352649 >> v2:172.21.15.125:3300/0 conn(0x7fb8ac136960 0x7fb8ac138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 -- 172.21.15.125:0/1514352649 >> 172.21.15.125:0/1514352649 conn(0x7fb8ac099c40 msgr2=0x7fb8ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 -- 172.21.15.125:0/1514352649 shutdown_connections 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.534+0000 7fb8b3580700 1 -- 172.21.15.125:0/1514352649 wait complete. 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 Processor -- start 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 -- start start 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 0x7fb8ac12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac06fe90 con 0x7fb8ac133ad0 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac072720 con 0x7fb8ac139280 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b3580700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac09f390 con 0x7fb8ac136960 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b0b1b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.535+0000 7fb8b131c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b0b1b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50306/0 (socket says 172.21.15.125:50306) 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b1b1d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 0x7fb8ac12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b0b1b700 1 -- 172.21.15.125:0/1454337469 learned_addr learned my addr 172.21.15.125:0/1454337469 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43380/0 (socket says 172.21.15.125:43380) 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 -- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 msgr2=0x7fb8ac12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 -- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 msgr2=0x7fb8ac12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 0x7fb8ac12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 -- 172.21.15.125:0/1454337469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0094a0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b0b1b700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b1b1d700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 0x7fb8ac12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b131c700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c3c0 tx=0x7fb8a800c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004a70 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8004bf0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a4009a70 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80070d0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.536+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac070bc0 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.537+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb8a8007230 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.537+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb8a803f740 con 0x7fb8ac133ad0 2023-10-03T10:11:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.537+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac06be10 con 0x7fb8ac133ad0 2023-10-03T10:11:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.542+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8a801bb70 con 0x7fb8ac133ad0 2023-10-03T10:11:38.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.727+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8ac070040 con 0x7fb8ac133ad0 2023-10-03T10:11:38.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.728+0000 7fb8a1ffb700 1 -- 172.21.15.125:0/1454337469 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12897 (secure 0 0 0) 0x7fb8a801b760 con 0x7fb8ac133ad0 2023-10-03T10:11:38.729 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:38.729 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:31.987149+0000","last_up_change":"2023-10-03T10:09:07.150639+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 >> v1:172.21.15.125:6816/126957 conn(0x7fb89002f510 legacy=0x7fb8900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 msgr2=0x7fb8ac12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c3c0 tx=0x7fb8a800c6d0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 shutdown_connections 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ac139280 0x7fb8ac12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ac133ad0 0x7fb8ac12cb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 --2- 172.21.15.125:0/1454337469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ac136960 0x7fb8ac12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 >> 172.21.15.125:0/1454337469 conn(0x7fb8ac099c40 msgr2=0x7fb8ac132980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 shutdown_connections 2023-10-03T10:11:38.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.730+0000 7fb8b3580700 1 -- 172.21.15.125:0/1454337469 wait complete. 2023-10-03T10:11:38.743 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:38.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.862+0000 7f76138df700 1 Processor -- start 2023-10-03T10:11:38.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.862+0000 7f76138df700 1 -- start start 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f76138df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f76138df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f76138df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0a1e70 con 0x7f760c0a1340 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f76138df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09a720 con 0x7f760c0a0a30 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f76138df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09b300 con 0x7f760c130670 2023-10-03T10:11:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f761167b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7610e7a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f760c0a1340 0x7f760c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36956/0 (socket says 172.21.15.125:36956) 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f761167b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47842/0 (socket says 172.21.15.125:47842) 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7610e7a700 1 -- 172.21.15.125:0/403691261 learned_addr learned my addr 172.21.15.125:0/403691261 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 -- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 msgr2=0x7f760c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 -- 172.21.15.125:0/403691261 >> v1:172.21.15.125:6789/0 conn(0x7f760c0a1340 legacy=0x7f760c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f75fffff700 1 -- 172.21.15.125:0/403691261 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906115077 0 0) 0x7f760c0a1e70 con 0x7f760c0a1340 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 -- 172.21.15.125:0/403691261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c09abc0 con 0x7f760c130670 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f761167b700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.863+0000 7f7611e7c700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1381c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7604009dc0 tx=0x7f760400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f764e925a67da6e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f75fffff700 1 -- 172.21.15.125:0/403691261 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400e070 con 0x7f760c130670 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f75fffff700 1 -- 172.21.15.125:0/403691261 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400bb20 con 0x7f760c130670 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f75fffff700 1 -- 172.21.15.125:0/403691261 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604012430 con 0x7f760c130670 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 -- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 msgr2=0x7f760c1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1381c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7604009dc0 tx=0x7f760400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 -- 172.21.15.125:0/403691261 shutdown_connections 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1381c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 --2- 172.21.15.125:0/403691261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 -- 172.21.15.125:0/403691261 >> 172.21.15.125:0/403691261 conn(0x7f760c0a2980 msgr2=0x7f760c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 -- 172.21.15.125:0/403691261 shutdown_connections 2023-10-03T10:11:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.864+0000 7f76138df700 1 -- 172.21.15.125:0/403691261 wait complete. 2023-10-03T10:11:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.865+0000 7f76138df700 1 Processor -- start 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.865+0000 7f76138df700 1 -- start start 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 0x7f760c120050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c122af0 con 0x7f760c0a1340 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c121410 con 0x7f760c0a0a30 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09ae00 con 0x7f760c130670 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f7611e7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47854/0 (socket says 172.21.15.125:47854) 2023-10-03T10:11:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 -- 172.21.15.125:0/1673257054 learned_addr learned my addr 172.21.15.125:0/1673257054 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f7610e7a700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 0x7f760c120050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 -- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 msgr2=0x7f760c1c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 -- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 msgr2=0x7f760c120050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 0x7f760c120050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 -- 172.21.15.125:0/1673257054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760800b6d0 con 0x7f760c0a0a30 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f7611e7c700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f7610e7a700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 0x7f760c120050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f761167b700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f760800ecf0 tx=0x7f760800d350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800dde0 con 0x7f760c0a0a30 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608005a20 con 0x7f760c0a0a30 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7604009a70 con 0x7f760c0a0a30 2023-10-03T10:11:38.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.866+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608005d90 con 0x7f760c0a0a30 2023-10-03T10:11:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.867+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c09fa70 con 0x7f760c0a0a30 2023-10-03T10:11:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.867+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7608006030 con 0x7f760c0a0a30 2023-10-03T10:11:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.867+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f7608040180 con 0x7f760c0a0a30 2023-10-03T10:11:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.868+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c04f2a0 con 0x7f760c0a0a30 2023-10-03T10:11:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:38.872+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f760801f8f0 con 0x7f760c0a0a30 2023-10-03T10:11:39.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.094+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760c11f670 con 0x7f760c0a0a30 2023-10-03T10:11:39.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.094+0000 7f75fdffb700 1 -- 172.21.15.125:0/1673257054 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f7608027090 con 0x7f760c0a0a30 2023-10-03T10:11:39.095 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:39.095 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:14.682102+0000","modified":"2023-10-03T10:09:38.961227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6817/582467044","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6817","nonce":582467044}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 >> v1:172.21.15.125:6816/126957 conn(0x7f75f002f510 legacy=0x7f75f00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 msgr2=0x7f760c11fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f760800ecf0 tx=0x7f760800d350 comp rx=0 tx=0).stop 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 shutdown_connections 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f760c130670 0x7f760c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f760c0a0a30 0x7f760c11fb10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 --2- 172.21.15.125:0/1673257054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760c0a1340 0x7f760c120050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 >> 172.21.15.125:0/1673257054 conn(0x7f760c0a2980 msgr2=0x7f760c1b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 shutdown_connections 2023-10-03T10:11:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.096+0000 7f76138df700 1 -- 172.21.15.125:0/1673257054 wait complete. 2023-10-03T10:11:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-03T10:11:39.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:14.682102+0000', 'modified': '2023-10-03T10:09:38.961227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6817/582467044', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.125:6817', 'nonce': 582467044}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T10:11:39.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:11:39.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:11:39.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.331+0000 7f4f461ad700 1 Processor -- start 2023-10-03T10:11:39.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.331+0000 7f4f461ad700 1 -- start start 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f461ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f40133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f461ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f461ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4006b2d0 con 0x7f4f401300a0 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f461ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f40133610 con 0x7f4f40130bc0 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f461ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4009a500 con 0x7f4f40133ad0 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f40133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43394/0 (socket says 172.21.15.125:43394) 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f401300a0 0x7f4f401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36958/0 (socket says 172.21.15.125:36958) 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3ffff700 1 -- 172.21.15.125:0/3985210738 learned_addr learned my addr 172.21.15.125:0/3985210738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/3985210738 >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 msgr2=0x7f4f4013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/3985210738 >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/3985210738 >> v1:172.21.15.125:6789/0 conn(0x7f4f401300a0 legacy=0x7f4f401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/3985210738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f401338b0 con 0x7f4f40133ad0 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/3985210738 >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/3985210738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f40133ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009840 tx=0x7f4f34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86c4f1f7bcf6c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3e7fc700 1 -- 172.21.15.125:0/3985210738 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011830 con 0x7f4f40133ad0 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3e7fc700 1 -- 172.21.15.125:0/3985210738 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34011990 con 0x7f4f40133ad0 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.332+0000 7f4f3e7fc700 1 -- 172.21.15.125:0/3985210738 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011d20 con 0x7f4f40133ad0 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 -- 172.21.15.125:0/3985210738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 msgr2=0x7f4f40133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 --2- 172.21.15.125:0/3985210738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f40133ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009840 tx=0x7f4f34009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 -- 172.21.15.125:0/3985210738 shutdown_connections 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 --2- 172.21.15.125:0/3985210738 >> v2:172.21.15.125:3300/0 conn(0x7f4f40130bc0 0x7f4f4013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 --2- 172.21.15.125:0/3985210738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f40133ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 -- 172.21.15.125:0/3985210738 >> 172.21.15.125:0/3985210738 conn(0x7f4f40099c40 msgr2=0x7f4f400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 -- 172.21.15.125:0/3985210738 shutdown_connections 2023-10-03T10:11:39.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.333+0000 7f4f461ad700 1 -- 172.21.15.125:0/3985210738 wait complete. 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 Processor -- start 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 -- start start 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 0x7f4f401c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40120bb0 con 0x7f4f40130bc0 2023-10-03T10:11:39.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401201b0 con 0x7f4f401300a0 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.334+0000 7f4f461ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40072160 con 0x7f4f40133ad0 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 0x7f4f401c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47858/0 (socket says 172.21.15.125:47858) 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50338/0 (socket says 172.21.15.125:50338) 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/789235286 learned_addr learned my addr 172.21.15.125:0/789235286 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 -- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 msgr2=0x7f4f401c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 -- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 msgr2=0x7f4f401c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 0x7f4f401c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 -- 172.21.15.125:0/789235286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38009b30 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3effd700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 0x7f4f401c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800efc0 tx=0x7f4f3800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f27fff700 1 -- 172.21.15.125:0/789235286 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38018070 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f27fff700 1 -- 172.21.15.125:0/789235286 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800f040 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f27fff700 1 -- 172.21.15.125:0/789235286 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38003c60 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f340094a0 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.335+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4011fed0 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.336+0000 7f4f27fff700 1 -- 172.21.15.125:0/789235286 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4f3800c880 con 0x7f4f40133ad0 2023-10-03T10:11:39.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.336+0000 7f4f27fff700 1 -- 172.21.15.125:0/789235286 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f4f3803fd30 con 0x7f4f40133ad0 2023-10-03T10:11:39.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 Processor -- start 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 -- start start 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f9796560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f96f8c60 con 0x55c0f97ac8f0 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f96f3a10 con 0x55c0f97b2100 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c0f96f1210 con 0x55c0f9795c50 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f9796560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43410/0 (socket says 172.21.15.125:43410) 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50348/0 (socket says 172.21.15.125:50348) 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.339+0000 7f4f3ffff700 1 -- 172.21.15.125:0/266896073 learned_addr learned my addr 172.21.15.125:0/266896073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 -- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 msgr2=0x55c0f9796020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 -- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 msgr2=0x55c0f9796560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f9796560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 -- 172.21.15.125:0/266896073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0f94e0790 con 0x55c0f97ac8f0 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3effd700 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f9796560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f3803e740 tx=0x7f4f38011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30dc90d2fe07933 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f257fa700 1 -- 172.21.15.125:0/266896073 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800cb30 con 0x55c0f97ac8f0 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f257fa700 1 -- 172.21.15.125:0/266896073 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800cc90 con 0x55c0f97ac8f0 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.340+0000 7f4f257fa700 1 -- 172.21.15.125:0/266896073 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800ce00 con 0x55c0f97ac8f0 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 msgr2=0x55c0f97acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f3803e740 tx=0x7f4f38011000 comp rx=0 tx=0).stop 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- 172.21.15.125:0/266896073 shutdown_connections 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97ac8f0 0x55c0f97acd60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9796020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 --2- 172.21.15.125:0/266896073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f9796560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- 172.21.15.125:0/266896073 >> 172.21.15.125:0/266896073 conn(0x55c0f979a0f0 msgr2=0x55c0f9799690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- 172.21.15.125:0/266896073 shutdown_connections 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- 172.21.15.125:0/266896073 wait complete. 2023-10-03T10:11:39.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 -- start start 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.341+0000 7f4f52350b80 1 Processor -- start 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 0x55c0f97b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f97b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f96ecb00 con 0x55c0f9795c50 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f9688770 con 0x55c0f97b2100 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c0f96ab6f0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 10 client.0 _ll_register_callbacks cb 0x55c0f94f45a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 0x55c0f97b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43412/0 (socket says 172.21.15.125:43412) 2023-10-03T10:11:39.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/1451056605 learned_addr learned my addr 172.21.15.125:0/1451056605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f97b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 -- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 msgr2=0x55c0f97b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f97b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 -- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 msgr2=0x55c0f97b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 -- 172.21.15.125:0/1451056605 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4006b2d0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f3effd700 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 0x55c0f97b5fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f30000f60 tx=0x7f4f30001920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb4d3cab4a833e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f1e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.125:3302/0 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30007780 con 0x55c0f97ac8f0 2023-10-03T10:11:39.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mon.2 v2:172.21.15.125:3302/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f4f300145b0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.342+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0f978e2b0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f30014770 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 10 client.14423 fetch_fsmap learned FSMap version 7 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7f4f4011fed0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mon.2 v2:172.21.15.125:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30024020 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mon.2 v2:172.21.15.125:3302/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f4f30012050 con 0x55c0f97ac8f0 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 10 client.14423 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 10 client.14423 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 20 client.14423 populate_metadata read hostname 'smithi125' 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 4 client.14423 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0f976af40 con 0x55c0f97cf130 2023-10-03T10:11:39.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.343+0000 7f4f1e7fc700 10 client.14423 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/1451056605 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55c0f976af40 con 0x55c0f97cf130 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f1e7fc700 10 client.14423 handle_command_reply: tid=0 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 client.14423 shutdown 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 msgr2=0x55c0f97b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 0x55c0f97b5fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f30000f60 tx=0x7f4f30001920 comp rx=0 tx=0).stop 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 shutdown_connections 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97b2100 0x55c0f97b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f1e7fc700 0 client.14423 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1451056605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97ac8f0 0x55c0f97b5fb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 >> 172.21.15.125:0/1451056605 conn(0x55c0f979a0f0 msgr2=0x55c0f97951b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 shutdown_connections 2023-10-03T10:11:39.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 1 -- 172.21.15.125:0/1451056605 wait complete. 2023-10-03T10:11:39.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.344+0000 7f4f52350b80 20 client.14423 trim_cache size 0 max 16384 2023-10-03T10:11:39.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.360+0000 7f4f52350b80 1 Processor -- start 2023-10-03T10:11:39.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 -- start start 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f9798b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 0x55c0f97bc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f94e1390 con 0x55c0f97b2100 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f97af7b0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c0f97b04d0 con 0x55c0f9795c50 2023-10-03T10:11:39.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 0x55c0f97bc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50366/0 (socket says 172.21.15.125:50366) 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/1693614570 learned_addr learned my addr 172.21.15.125:0/1693614570 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3effd700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f9798b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3ffff700 1 -- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 msgr2=0x55c0f9797460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3ffff700 1 -- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 msgr2=0x55c0f9798b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.361+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f9798b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f3ffff700 1 -- 172.21.15.125:0/1693614570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0f95cd0a0 con 0x55c0f97b2100 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f3effd700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f9798b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 0x55c0f97bc4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f38030000 tx=0x7f4f38009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468f89cf590411cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f25ffb700 1 -- 172.21.15.125:0/1693614570 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3802d070 con 0x55c0f97b2100 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f25ffb700 1 -- 172.21.15.125:0/1693614570 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3801c740 con 0x55c0f97b2100 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f25ffb700 1 -- 172.21.15.125:0/1693614570 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800ce00 con 0x55c0f97b2100 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 -- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 msgr2=0x55c0f97bc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 0x55c0f97bc4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f38030000 tx=0x7f4f38009000 comp rx=0 tx=0).stop 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 -- 172.21.15.125:0/1693614570 shutdown_connections 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f97b2100 0x55c0f97bc4b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f9795c50 0x55c0f9797460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 --2- 172.21.15.125:0/1693614570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f9798b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 -- 172.21.15.125:0/1693614570 >> 172.21.15.125:0/1693614570 conn(0x55c0f979a0f0 msgr2=0x55c0f9792210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.362+0000 7f4f52350b80 1 -- 172.21.15.125:0/1693614570 shutdown_connections 2023-10-03T10:11:39.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 -- 172.21.15.125:0/1693614570 wait complete. 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 -- start start 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 Processor -- start 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f97b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97b2100 0x55c0f97b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f97c00e0 con 0x55c0f9795c50 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f97b35e0 con 0x55c0f97ac8f0 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c0f97c0f30 con 0x55c0f97b2100 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.363+0000 7f4f52350b80 10 client.0 _ll_register_callbacks cb 0x7f4f4004f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:39.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43428/0 (socket says 172.21.15.125:43428) 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/704035366 learned_addr learned my addr 172.21.15.125:0/704035366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3effd700 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f97b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3ffff700 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97b2100 0x55c0f97b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97b2100 msgr2=0x55c0f97b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97b2100 0x55c0f97b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 msgr2=0x55c0f97b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f97b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 -- 172.21.15.125:0/704035366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f34004040 con 0x55c0f9795c50 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f3f7fe700 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009ea0 tx=0x7f4f340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed1b9887a945279 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-03T10:11:39.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34024040 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f4f34004590 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f3800cc90 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f34028280 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 10 client.14574 fetch_fsmap learned FSMap version 7 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7f4f4011fed0 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800cc90 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f4f34003ab0 con 0x55c0f9795c50 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 10 client.14574 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 10 client.14574 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.364+0000 7f4f52350b80 20 client.14574 populate_metadata read hostname 'smithi125' 2023-10-03T10:11:39.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 4 client.14574 mds_command: new command op to 4180 tid=0[{"prefix": "status"}] 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 --> v1:172.21.15.125:6817/582467044 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0f96e5ce0 con 0x55c0f9817f40 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f1e7fc700 10 client.14574 ms_handle_connect on v1:172.21.15.125:6817/582467044 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f1e7fc700 1 -- 172.21.15.125:0/704035366 <== mds.0 v1:172.21.15.125:6817/582467044 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 4277609505) 0x55c0f96e5ce0 con 0x55c0f9817f40 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f1e7fc700 10 client.14574 handle_command_reply: tid=0 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 client.14574 shutdown 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 msgr2=0x55c0f97b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009ea0 tx=0x7f4f340047c0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 shutdown_connections 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x55c0f97b2100 0x55c0f97b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c0f9795c50 0x55c0f97b59b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f1e7fc700 0 client.14574 ms_handle_reset on v1:172.21.15.125:6817/582467044 2023-10-03T10:11:39.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 --2- 172.21.15.125:0/704035366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c0f97ac8f0 0x55c0f97b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 >> 172.21.15.125:0/704035366 conn(0x55c0f979a0f0 msgr2=0x55c0f9798b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 shutdown_connections 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 1 -- 172.21.15.125:0/704035366 wait complete. 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.365+0000 7f4f52350b80 20 client.14574 trim_cache size 0 max 16384 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "15b0d202-3c9c-40fb-bdbc-3890d84c122d", 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4180, 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-03T10:11:39.373 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 144.683016506, 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 7, 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 24, 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 149.08392928699999 2023-10-03T10:11:39.374 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 >> v1:172.21.15.125:6816/126957 conn(0x7f4f2c02f510 legacy=0x7f4f2c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 msgr2=0x7f4f401c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800efc0 tx=0x7f4f3800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 shutdown_connections 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f40133ad0 0x7f4f401c91d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f401300a0 0x7f4f401c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 --2- 172.21.15.125:0/789235286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f40130bc0 0x7f4f401c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 >> 172.21.15.125:0/789235286 conn(0x7f4f40099c40 msgr2=0x7f4f4012e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 shutdown_connections 2023-10-03T10:11:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.366+0000 7f4f461ad700 1 -- 172.21.15.125:0/789235286 wait complete. 2023-10-03T10:11:39.378 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:11:39.392 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:11:39.392 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:39.425 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:11:39.425 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 Processor -- start 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 -- start start 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 0x7f849406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8494136cb0 0x7f8494139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849406e900 con 0x7f849406a770 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849409d180 con 0x7f8494136cb0 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f849a565700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849409e780 con 0x7f849409dec0 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.586+0000 7f8498b02700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8494136cb0 0x7f8494139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8493fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f849406a770 0x7f849406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36974/0 (socket says 172.21.15.125:36974) 2023-10-03T10:11:39.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f84937fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 0x7f849406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8493fff700 1 -- 172.21.15.125:0/911140025 learned_addr learned my addr 172.21.15.125:0/911140025 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8498b02700 1 -- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 msgr2=0x7f849406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8498b02700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 0x7f849406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8498b02700 1 -- 172.21.15.125:0/911140025 >> v1:172.21.15.125:6789/0 conn(0x7f849406a770 legacy=0x7f849406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8498b02700 1 -- 172.21.15.125:0/911140025 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849409d3c0 con 0x7f8494136cb0 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8492ffd700 1 -- 172.21.15.125:0/911140025 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713564520 0 0) 0x7f849406e900 con 0x7f849406a770 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f84937fe700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 0x7f849406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8498b02700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8494136cb0 0x7f8494139090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb5091605fc369d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8492ffd700 1 -- 172.21.15.125:0/911140025 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00e070 con 0x7f8494136cb0 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8492ffd700 1 -- 172.21.15.125:0/911140025 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00bb20 con 0x7f8494136cb0 2023-10-03T10:11:39.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.587+0000 7f8492ffd700 1 -- 172.21.15.125:0/911140025 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012430 con 0x7f8494136cb0 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 -- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8494136cb0 msgr2=0x7f8494139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8494136cb0 0x7f8494139090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 -- 172.21.15.125:0/911140025 shutdown_connections 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8494136cb0 0x7f8494139090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 --2- 172.21.15.125:0/911140025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f849409dec0 0x7f849406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 -- 172.21.15.125:0/911140025 >> 172.21.15.125:0/911140025 conn(0x7f8494099c40 msgr2=0x7f84940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 -- 172.21.15.125:0/911140025 shutdown_connections 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.588+0000 7f849a565700 1 -- 172.21.15.125:0/911140025 wait complete. 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 Processor -- start 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 -- start start 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 0x7f8494134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 0x7f8494134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494119c60 con 0x7f849406a770 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8494139140 con 0x7f8494136cb0 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f849a565700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f849411a430 con 0x7f849409dec0 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f8498b02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f8493fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 0x7f8494134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f8498b02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47906/0 (socket says 172.21.15.125:47906) 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f84937fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 0x7f8494134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.589+0000 7f8498b02700 1 -- 172.21.15.125:0/2406475615 learned_addr learned my addr 172.21.15.125:0/2406475615 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 -- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 msgr2=0x7f8494134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 0x7f8494134990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 -- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 msgr2=0x7f8494134ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 -- 172.21.15.125:0/2406475615 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84840094a0 con 0x7f849406a770 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8498b02700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f84937fe700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 0x7f8494134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8493fff700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 0x7f8494134450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f848800c470 tx=0x7f848800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488004c80 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488004de0 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488007310 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c009a70 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.590+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849411a9c0 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.591+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8488007470 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.591+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f848803f6e0 con 0x7f849406a770 2023-10-03T10:11:39.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.591+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849411a830 con 0x7f849406a770 2023-10-03T10:11:39.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.596+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8488007720 con 0x7f849406a770 2023-10-03T10:11:39.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:39.791+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f849404f2a0 con 0x7f849406a770 2023-10-03T10:11:39.792 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-03T10:11:39.791+0000 7fa5e1a2a700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:11:40.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.408+0000 7f8490ff9700 1 -- 172.21.15.125:0/2406475615 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f8488011360 con 0x7f849406a770 2023-10-03T10:11:40.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 >> v1:172.21.15.125:6816/126957 conn(0x7f848002f510 legacy=0x7f84800319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 msgr2=0x7f8494134450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 0x7f8494134450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f848800c470 tx=0x7f848800c780 comp rx=0 tx=0).stop 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 shutdown_connections 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8494136cb0 0x7f8494134ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f849406a770 0x7f8494134450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 --2- 172.21.15.125:0/2406475615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f849409dec0 0x7f8494134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 >> 172.21.15.125:0/2406475615 conn(0x7f8494099c40 msgr2=0x7f84940a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 shutdown_connections 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.413+0000 7f849a565700 1 -- 172.21.15.125:0/2406475615 wait complete. 2023-10-03T10:11:40.414 INFO:teuthology.orchestra.run.smithi125.stderr:marked down osd.0. 2023-10-03T10:11:40.428 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:11:40.428 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:11:40.431 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:11:40.431 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:11:40.431 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:40.467 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:11:40.467 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-03T10:11:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.627+0000 7f9023b07700 1 Processor -- start 2023-10-03T10:11:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 -- start start 2023-10-03T10:11:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 0x7f901c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 0x7f901c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c09c970 con 0x7f901c09e870 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0a0920 con 0x7f901c1371c0 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f9023b07700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c09f9c0 con 0x7f901c09f350 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90220a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 0x7f901c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90210a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 0x7f901c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90218a3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f901c09e870 0x7f901c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36994/0 (socket says 172.21.15.125:36994) 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90218a3700 1 -- 172.21.15.125:0/3438892303 learned_addr learned my addr 172.21.15.125:0/3438892303 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90210a2700 1 -- 172.21.15.125:0/3438892303 >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 msgr2=0x7f901c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90210a2700 1 --2- 172.21.15.125:0/3438892303 >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 0x7f901c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90210a2700 1 -- 172.21.15.125:0/3438892303 >> v1:172.21.15.125:6789/0 conn(0x7f901c09e870 legacy=0x7f901c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90210a2700 1 -- 172.21.15.125:0/3438892303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c09bab0 con 0x7f901c09f350 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90208a1700 1 -- 172.21.15.125:0/3438892303 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057286407 0 0) 0x7f901c09c970 con 0x7f901c09e870 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.628+0000 7f90220a4700 1 --2- 172.21.15.125:0/3438892303 >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 0x7f901c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f90210a2700 1 --2- 172.21.15.125:0/3438892303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 0x7f901c136c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9018009840 tx=0x7f9018009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf1aac1f2406849 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f90208a1700 1 -- 172.21.15.125:0/3438892303 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011830 con 0x7f901c09f350 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f90208a1700 1 -- 172.21.15.125:0/3438892303 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018011990 con 0x7f901c09f350 2023-10-03T10:11:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f90208a1700 1 -- 172.21.15.125:0/3438892303 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011d20 con 0x7f901c09f350 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 -- 172.21.15.125:0/3438892303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 msgr2=0x7f901c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 --2- 172.21.15.125:0/3438892303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 0x7f901c136c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9018009840 tx=0x7f9018009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 -- 172.21.15.125:0/3438892303 shutdown_connections 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 --2- 172.21.15.125:0/3438892303 >> v2:172.21.15.125:3300/0 conn(0x7f901c1371c0 0x7f901c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 --2- 172.21.15.125:0/3438892303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09f350 0x7f901c136c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 -- 172.21.15.125:0/3438892303 >> 172.21.15.125:0/3438892303 conn(0x7f901c0a4430 msgr2=0x7f901c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 -- 172.21.15.125:0/3438892303 shutdown_connections 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.629+0000 7f9023b07700 1 -- 172.21.15.125:0/3438892303 wait complete. 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 Processor -- start 2023-10-03T10:11:40.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 -- start start 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f901c09f350 0x7f901c120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 0x7f901c121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c123af0 con 0x7f901c1371c0 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c122c60 con 0x7f901c09e870 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f9023b07700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901c072250 con 0x7f901c09f350 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f90218a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f90220a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 0x7f901c121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f90218a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47940/0 (socket says 172.21.15.125:47940) 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f90218a3700 1 -- 172.21.15.125:0/624222583 learned_addr learned my addr 172.21.15.125:0/624222583 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.631+0000 7f90210a2700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f901c09f350 0x7f901c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 -- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f901c09f350 msgr2=0x7f901c120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f901c09f350 0x7f901c120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 -- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 msgr2=0x7f901c1208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 -- 172.21.15.125:0/624222583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014009a70 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90218a3700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90220a4700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 0x7f901c121360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f901400efc0 tx=0x7f901400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400cc90 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400f040 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90180094a0 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014014480 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.632+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c09dbf0 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.633+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9014014600 con 0x7f901c1371c0 2023-10-03T10:11:40.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.633+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c06ad00 con 0x7f901c1371c0 2023-10-03T10:11:40.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.633+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9014040490 con 0x7f901c1371c0 2023-10-03T10:11:40.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.637+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90140118b0 con 0x7f901c1371c0 2023-10-03T10:11:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:40.840+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f901c04f2a0 con 0x7f901c1371c0 2023-10-03T10:11:40.841 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-03T10:11:40.841+0000 7fa5e1a2a700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-03T10:11:41.031 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:11:41.030+0000 7fa405700680 -1 Falling back to public interface 2023-10-03T10:11:41.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.413+0000 7f90127fc700 1 -- 172.21.15.125:0/624222583 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f9014018080 con 0x7f901c1371c0 2023-10-03T10:11:41.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.416+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 >> v1:172.21.15.125:6816/126957 conn(0x7f900002f510 legacy=0x7f90000319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:41.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.416+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 msgr2=0x7f901c121360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:41.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.416+0000 7f9023b07700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 0x7f901c121360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f901400efc0 tx=0x7f901400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 shutdown_connections 2023-10-03T10:11:41.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f901c1371c0 0x7f901c121360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f901c09e870 0x7f901c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 --2- 172.21.15.125:0/624222583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f901c09f350 0x7f901c120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 >> 172.21.15.125:0/624222583 conn(0x7f901c0a4430 msgr2=0x7f901c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:41.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 shutdown_connections 2023-10-03T10:11:41.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.418+0000 7f9023b07700 1 -- 172.21.15.125:0/624222583 wait complete. 2023-10-03T10:11:41.420 INFO:teuthology.orchestra.run.smithi125.stderr:marked down osd.1. 2023-10-03T10:11:41.434 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:11:41.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:11:41.436 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:11:41.436 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:11:41.436 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:41.473 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:11:41.473 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-03T10:11:41.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 Processor -- start 2023-10-03T10:11:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 -- start start 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f806b2d0 con 0x7fc1f81309f0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8133610 con 0x7fc1f8133ad0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.636+0000 7fc2001fe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f809a500 con 0x7fc1f81300a0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fdf9a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fe79b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fdf9a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47964/0 (socket says 172.21.15.125:47964) 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fdf9a700 1 -- 172.21.15.125:0/1502739569 learned_addr learned my addr 172.21.15.125:0/1502739569 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fe79b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43500/0 (socket says 172.21.15.125:43500) 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50416/0 (socket says 172.21.15.125:50416) 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 -- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 msgr2=0x7fc1f8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 -- 172.21.15.125:0/1502739569 >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 msgr2=0x7fc1f813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1502739569 >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 -- 172.21.15.125:0/1502739569 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f81338b0 con 0x7fc1f81300a0 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fdf9a700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fe79b700 1 --2- 172.21.15.125:0/1502739569 >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009840 tx=0x7fc1e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6e0901846c197a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fcf98700 1 -- 172.21.15.125:0/1502739569 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8011830 con 0x7fc1f81300a0 2023-10-03T10:11:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fcf98700 1 -- 172.21.15.125:0/1502739569 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8011990 con 0x7fc1f81300a0 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.637+0000 7fc1fcf98700 1 -- 172.21.15.125:0/1502739569 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8011d20 con 0x7fc1f81300a0 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 -- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 msgr2=0x7fc1f81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009840 tx=0x7fc1e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 -- 172.21.15.125:0/1502739569 shutdown_connections 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1502739569 >> v2:172.21.15.125:3300/0 conn(0x7fc1f81309f0 0x7fc1f813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1502739569 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81300a0 0x7fc1f81304b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 -- 172.21.15.125:0/1502739569 >> 172.21.15.125:0/1502739569 conn(0x7fc1f8099c40 msgr2=0x7fc1f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 -- 172.21.15.125:0/1502739569 shutdown_connections 2023-10-03T10:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.638+0000 7fc2001fe700 1 -- 172.21.15.125:0/1502739569 wait complete. 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 Processor -- start 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 -- start start 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 0x7fc1f81c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f806e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8070cd0 con 0x7fc1f81300a0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8072310 con 0x7fc1f8133ad0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc2001fe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f812fe40 con 0x7fc1f81309f0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc1fdf9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc1fdf9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43516/0 (socket says 172.21.15.125:43516) 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc1fdf9a700 1 -- 172.21.15.125:0/1403202632 learned_addr learned my addr 172.21.15.125:0/1403202632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 0x7fc1f81c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.639+0000 7fc1fe79b700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f806e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 -- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 msgr2=0x7fc1f806e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f806e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 -- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 msgr2=0x7fc1f81c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 -- 172.21.15.125:0/1403202632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009a70 con 0x7fc1f81309f0 2023-10-03T10:11:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fdf9a700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1fd799700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 0x7fc1f81c8f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8016000 tx=0x7fc1e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004450 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e801e070 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f4009550 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80038a0 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.640+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e80094a0 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.641+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc1e8003a00 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.641+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fc1e8040690 con 0x7fc1f81309f0 2023-10-03T10:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.641+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f804f2a0 con 0x7fc1f81309f0 2023-10-03T10:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.646+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1e8015080 con 0x7fc1f81309f0 2023-10-03T10:11:41.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:41.844+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fc1f812a7b0 con 0x7fc1f81309f0 2023-10-03T10:11:41.845 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-03T10:11:41.845+0000 7fa5e1a2a700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-10-03T10:11:42.031 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:11:42.030+0000 7f6cdc23e680 -1 Falling back to public interface 2023-10-03T10:11:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.420+0000 7fc1ee7fc700 1 -- 172.21.15.125:0/1403202632 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc1e80045b0 con 0x7fc1f81309f0 2023-10-03T10:11:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.424+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 >> v1:172.21.15.125:6816/126957 conn(0x7fc1dc02f540 legacy=0x7fc1dc0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.424+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 msgr2=0x7fc1f81c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.424+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 0x7fc1f81c8f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8016000 tx=0x7fc1e8004750 comp rx=0 tx=0).stop 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 shutdown_connections 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f8133ad0 0x7fc1f806e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f81300a0 0x7fc1f81c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 --2- 172.21.15.125:0/1403202632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f81309f0 0x7fc1f81c8f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 >> 172.21.15.125:0/1403202632 conn(0x7fc1f8099c40 msgr2=0x7fc1f8131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 shutdown_connections 2023-10-03T10:11:42.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.425+0000 7fc2001fe700 1 -- 172.21.15.125:0/1403202632 wait complete. 2023-10-03T10:11:42.426 INFO:teuthology.orchestra.run.smithi125.stderr:marked down osd.2. 2023-10-03T10:11:42.440 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:11:42.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:11:42.442 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:11:42.442 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:11:42.443 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:42.485 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:11:42.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-03T10:11:42.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.610+0000 7fa706b98700 1 Processor -- start 2023-10-03T10:11:42.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.610+0000 7fa706b98700 1 -- start start 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa706b98700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa70006a770 0x7fa70006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa706b98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 0x7fa70006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa706b98700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70006b5c0 con 0x7fa700131a00 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa706b98700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70006e900 con 0x7fa70006a770 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa706b98700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70009d180 con 0x7fa70009dec0 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa6fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 0x7fa70006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa704934700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa70006a770 0x7fa70006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa705135700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa700131a00 0x7fa700131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37018/0 (socket says 172.21.15.125:37018) 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa705135700 1 -- 172.21.15.125:0/1668002673 learned_addr learned my addr 172.21.15.125:0/1668002673 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:42.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa704934700 1 -- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 msgr2=0x7fa70006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa704934700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 0x7fa70006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa704934700 1 -- 172.21.15.125:0/1668002673 >> v1:172.21.15.125:6789/0 conn(0x7fa700131a00 legacy=0x7fa700131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa704934700 1 -- 172.21.15.125:0/1668002673 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70009e780 con 0x7fa70006a770 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa6fffff700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 0x7fa70006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.611+0000 7fa6ff7fe700 1 -- 172.21.15.125:0/1668002673 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958318012 0 0) 0x7fa70006b5c0 con 0x7fa700131a00 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa704934700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70006a770 0x7fa70006ab40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009840 tx=0x7fa6f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7514cafb7be4263 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa6ff7fe700 1 -- 172.21.15.125:0/1668002673 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0011830 con 0x7fa70006a770 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa6ff7fe700 1 -- 172.21.15.125:0/1668002673 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0011990 con 0x7fa70006a770 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa6ff7fe700 1 -- 172.21.15.125:0/1668002673 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0011d20 con 0x7fa70006a770 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 -- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70006a770 msgr2=0x7fa70006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70006a770 0x7fa70006ab40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009840 tx=0x7fa6f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:42.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 -- 172.21.15.125:0/1668002673 shutdown_connections 2023-10-03T10:11:42.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70006a770 0x7fa70006ab40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 --2- 172.21.15.125:0/1668002673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa70009dec0 0x7fa70006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 -- 172.21.15.125:0/1668002673 >> 172.21.15.125:0/1668002673 conn(0x7fa700099c40 msgr2=0x7fa7000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:42.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 -- 172.21.15.125:0/1668002673 shutdown_connections 2023-10-03T10:11:42.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.612+0000 7fa706b98700 1 -- 172.21.15.125:0/1668002673 wait complete. 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.613+0000 7fa706b98700 1 Processor -- start 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.613+0000 7fa706b98700 1 -- start start 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa70006a770 0x7fa70011be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa700131a00 0x7fa70011c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70011e0d0 con 0x7fa70009dec0 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa700120350 con 0x7fa700131a00 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa706b98700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70011f990 con 0x7fa70006a770 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa6fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:42.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa705135700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa700131a00 0x7fa70011c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa6fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43536/0 (socket says 172.21.15.125:43536) 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa6fffff700 1 -- 172.21.15.125:0/3528596972 learned_addr learned my addr 172.21.15.125:0/3528596972 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.614+0000 7fa704934700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa70006a770 0x7fa70011be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 -- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa70006a770 msgr2=0x7fa70011be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa70006a770 0x7fa70011be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 -- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa700131a00 msgr2=0x7fa70011c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa700131a00 0x7fa70011c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 -- 172.21.15.125:0/3528596972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80094a0 con 0x7fa70009dec0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fffff700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800ec40 tx=0x7fa6e800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800c850 con 0x7fa70009dec0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e800c9b0 con 0x7fa70009dec0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00094a0 con 0x7fa70009dec0 2023-10-03T10:11:42.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800cd20 con 0x7fa70009dec0 2023-10-03T10:11:42.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.615+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70011ed30 con 0x7fa70009dec0 2023-10-03T10:11:42.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.616+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa6e8013470 con 0x7fa70009dec0 2023-10-03T10:11:42.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.616+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa6e803fb60 con 0x7fa70009dec0 2023-10-03T10:11:42.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.616+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70004f2a0 con 0x7fa70009dec0 2023-10-03T10:11:42.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.621+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6e8017080 con 0x7fa70009dec0 2023-10-03T10:11:42.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:42.817+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fa70011da80 con 0x7fa70009dec0 2023-10-03T10:11:42.818 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-03T10:11:42.818+0000 7fa5e1a2a700 -1 mon.a@0(leader).osd e27 definitely_dead 0 2023-10-03T10:11:43.036 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:11:43.035+0000 7f663fa4e680 -1 Falling back to public interface 2023-10-03T10:11:43.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.418+0000 7fa6fd7fa700 1 -- 172.21.15.125:0/3528596972 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v28) v1 ==== 89+0+0 (secure 0 0 0) 0x7fa6e800ce80 con 0x7fa70009dec0 2023-10-03T10:11:43.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 >> v1:172.21.15.125:6816/126957 conn(0x7fa6e002f510 legacy=0x7fa6e00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 msgr2=0x7fa70011c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800ec40 tx=0x7fa6e800ef50 comp rx=0 tx=0).stop 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 shutdown_connections 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa700131a00 0x7fa70011c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa70006a770 0x7fa70011be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 --2- 172.21.15.125:0/3528596972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa70009dec0 0x7fa70011c3b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 >> 172.21.15.125:0/3528596972 conn(0x7fa700099c40 msgr2=0x7fa7001b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:43.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.422+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 shutdown_connections 2023-10-03T10:11:43.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.424+0000 7fa706b98700 1 -- 172.21.15.125:0/3528596972 wait complete. 2023-10-03T10:11:43.425 INFO:teuthology.orchestra.run.smithi125.stderr:marked down osd.3. 2023-10-03T10:11:43.437 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:11:43.437 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:11:43.439 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:11:43.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:11:43.439 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.563+0000 7fa6e0fd4700 1 Processor -- start 2023-10-03T10:11:43.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.563+0000 7fa6e0fd4700 1 -- start start 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6e0fd4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 0x7fa6dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6e0fd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 0x7fa6dc13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6e0fd4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc09fa00 con 0x7fa6dc09f180 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6e0fd4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0a0370 con 0x7fa6dc09e870 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6e0fd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc06bec0 con 0x7fa6dc134330 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6da59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 0x7fa6dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 0x7fa6dc13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d9d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6dc09f180 0x7fa6dc133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37032/0 (socket says 172.21.15.125:37032) 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d9d9b700 1 -- 172.21.15.125:0/4141859090 learned_addr learned my addr 172.21.15.125:0/4141859090 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d959a700 1 -- 172.21.15.125:0/4141859090 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134269093 0 0) 0x7fa6dc09fa00 con 0x7fa6dc09f180 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d959a700 1 -- 172.21.15.125:0/4141859090 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c80035b0 con 0x7fa6dc09f180 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 -- 172.21.15.125:0/4141859090 >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 msgr2=0x7fa6dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 --2- 172.21.15.125:0/4141859090 >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 0x7fa6dc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 -- 172.21.15.125:0/4141859090 >> v1:172.21.15.125:6789/0 conn(0x7fa6dc09f180 legacy=0x7fa6dc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 -- 172.21.15.125:0/4141859090 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc09ada0 con 0x7fa6dc134330 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6da59c700 1 --2- 172.21.15.125:0/4141859090 >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 0x7fa6dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6dad9d700 1 --2- 172.21.15.125:0/4141859090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 0x7fa6dc13be80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdde83d7bfcd7afb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d959a700 1 -- 172.21.15.125:0/4141859090 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d400e070 con 0x7fa6dc134330 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d959a700 1 -- 172.21.15.125:0/4141859090 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d400bb20 con 0x7fa6dc134330 2023-10-03T10:11:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.564+0000 7fa6d959a700 1 -- 172.21.15.125:0/4141859090 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4012430 con 0x7fa6dc134330 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/4141859090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 msgr2=0x7fa6dc13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/4141859090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 0x7fa6dc13be80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/4141859090 shutdown_connections 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/4141859090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc134330 0x7fa6dc13be80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/4141859090 >> v2:172.21.15.125:3300/0 conn(0x7fa6dc09e870 0x7fa6dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/4141859090 >> 172.21.15.125:0/4141859090 conn(0x7fa6dc0a4430 msgr2=0x7fa6dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/4141859090 shutdown_connections 2023-10-03T10:11:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.565+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/4141859090 wait complete. 2023-10-03T10:11:43.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.566+0000 7fa6e0fd4700 1 Processor -- start 2023-10-03T10:11:43.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.566+0000 7fa6e0fd4700 1 -- start start 2023-10-03T10:11:43.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6dc09f180 0x7fa6dc122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 0x7fa6dc123290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc06d010 con 0x7fa6dc134330 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc123c50 con 0x7fa6dc09f180 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc125fb0 con 0x7fa6dc09e870 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50450/0 (socket says 172.21.15.125:50450) 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6dad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 0x7fa6dc123290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 -- 172.21.15.125:0/3976704413 learned_addr learned my addr 172.21.15.125:0/3976704413 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6d9d9b700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6dc09f180 0x7fa6dc122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 -- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6dc09f180 msgr2=0x7fa6dc122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6dc09f180 0x7fa6dc122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 -- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 msgr2=0x7fa6dc123290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 0x7fa6dc123290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 -- 172.21.15.125:0/3976704413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c40094a0 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6dad9d700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 0x7fa6dc123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6da59c700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ebe0 tx=0x7fa6c400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400c850 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c400c9b0 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d4009a70 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400cd40 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.567+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc124bf0 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.568+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc04f2a0 con 0x7fa6dc09e870 2023-10-03T10:11:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.568+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa6c4013470 con 0x7fa6dc09e870 2023-10-03T10:11:43.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.569+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa6c4040000 con 0x7fa6dc09e870 2023-10-03T10:11:43.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.573+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6c4013720 con 0x7fa6dc09e870 2023-10-03T10:11:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.767+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6dc133290 con 0x7fa6dc09e870 2023-10-03T10:11:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.768+0000 7fa6d2ffd700 1 -- 172.21.15.125:0/3976704413 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+11933 (secure 0 0 0) 0x7fa6c4021020 con 0x7fa6dc09e870 2023-10-03T10:11:43.768 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:43.768 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:43.415680+0000","last_up_change":"2023-10-03T10:11:43.415680+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":118795}]},"public_addr":"172.21.15.125:6812/118795","cluster_addr":"172.21.15.125:6813/118795","heartbeat_back_addr":"172.21.15.125:6815/118795","heartbeat_front_addr":"172.21.15.125:6814/118795","state":["exists"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 >> v1:172.21.15.125:6816/126957 conn(0x7fa6bc02f510 legacy=0x7fa6bc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 msgr2=0x7fa6dc122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ebe0 tx=0x7fa6c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 shutdown_connections 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6dc134330 0x7fa6dc123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6dc09e870 0x7fa6dc122810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 --2- 172.21.15.125:0/3976704413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6dc09f180 0x7fa6dc122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 >> 172.21.15.125:0/3976704413 conn(0x7fa6dc0a4430 msgr2=0x7fa6dc070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 shutdown_connections 2023-10-03T10:11:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:43.770+0000 7fa6e0fd4700 1 -- 172.21.15.125:0/3976704413 wait complete. 2023-10-03T10:11:44.035 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:11:44.034+0000 7fde783bc680 -1 Falling back to public interface 2023-10-03T10:11:44.818 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:11:44.817+0000 7fa405700680 -1 osd.0 24 log_to_monitors true 2023-10-03T10:11:45.881 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:11:45.880+0000 7f6cdc23e680 -1 osd.1 25 log_to_monitors true 2023-10-03T10:11:46.324 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-03T10:11:46.324+0000 7fa3f167b700 -1 osd.0 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:46.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:46.876 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:11:46.876+0000 7f663fa4e680 -1 osd.2 26 log_to_monitors true 2023-10-03T10:11:46.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.936+0000 7fb69159a700 1 Processor -- start 2023-10-03T10:11:46.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.936+0000 7fb69159a700 1 -- start start 2023-10-03T10:11:46.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb69159a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb68c133a70 0x7fb68c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:46.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb69159a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 0x7fb68c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:46.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb69159a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c133640 con 0x7fb68c0a1290 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb69159a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0a1d50 con 0x7fb68c133a70 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb69159a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a1710 con 0x7fb68c0a08e0 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb68c0a1290 0x7fb68c13a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41460/0 (socket says 172.21.15.125:41460) 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68b7fe700 1 -- 172.21.15.125:0/3028655901 learned_addr learned my addr 172.21.15.125:0/3028655901 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 --2- 172.21.15.125:0/3028655901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 0x7fb68c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb689ffb700 1 -- 172.21.15.125:0/3028655901 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979245460 0 0) 0x7fb68c133640 con 0x7fb68c0a1290 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb689ffb700 1 -- 172.21.15.125:0/3028655901 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6740035b0 con 0x7fb68c0a1290 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 -- 172.21.15.125:0/3028655901 >> v2:172.21.15.125:3300/0 conn(0x7fb68c133a70 msgr2=0x7fb68c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 --2- 172.21.15.125:0/3028655901 >> v2:172.21.15.125:3300/0 conn(0x7fb68c133a70 0x7fb68c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 -- 172.21.15.125:0/3028655901 >> v1:172.21.15.125:6789/0 conn(0x7fb68c0a1290 legacy=0x7fb68c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:46.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 -- 172.21.15.125:0/3028655901 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c09b620 con 0x7fb68c0a08e0 2023-10-03T10:11:46.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.937+0000 7fb68a7fc700 1 --2- 172.21.15.125:0/3028655901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 0x7fb68c0a0d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb680009840 tx=0x7fb680009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57da677c2844e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:46.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.938+0000 7fb689ffb700 1 -- 172.21.15.125:0/3028655901 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680011830 con 0x7fb68c0a08e0 2023-10-03T10:11:46.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.938+0000 7fb689ffb700 1 -- 172.21.15.125:0/3028655901 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680011990 con 0x7fb68c0a08e0 2023-10-03T10:11:46.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.938+0000 7fb689ffb700 1 -- 172.21.15.125:0/3028655901 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680011d20 con 0x7fb68c0a08e0 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.938+0000 7fb69159a700 1 -- 172.21.15.125:0/3028655901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 msgr2=0x7fb68c0a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.938+0000 7fb69159a700 1 --2- 172.21.15.125:0/3028655901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 0x7fb68c0a0d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb680009840 tx=0x7fb680009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 -- 172.21.15.125:0/3028655901 shutdown_connections 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 --2- 172.21.15.125:0/3028655901 >> v2:172.21.15.125:3300/0 conn(0x7fb68c133a70 0x7fb68c133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 --2- 172.21.15.125:0/3028655901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a08e0 0x7fb68c0a0d50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:46.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 -- 172.21.15.125:0/3028655901 >> 172.21.15.125:0/3028655901 conn(0x7fb68c0a2980 msgr2=0x7fb68c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:46.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 -- 172.21.15.125:0/3028655901 shutdown_connections 2023-10-03T10:11:46.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.939+0000 7fb69159a700 1 -- 172.21.15.125:0/3028655901 wait complete. 2023-10-03T10:11:46.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.940+0000 7fb69159a700 1 Processor -- start 2023-10-03T10:11:46.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 -- start start 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb68c0a08e0 0x7fb68c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 0x7fb68c11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 0x7fb68c11b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c11dec0 con 0x7fb68c133a70 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c11c1e0 con 0x7fb68c0a1290 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb69159a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c11e0c0 con 0x7fb68c0a08e0 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb68a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 0x7fb68c11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb68a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 0x7fb68c11ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54818/0 (socket says 172.21.15.125:54818) 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb68a7fc700 1 -- 172.21.15.125:0/3492190008 learned_addr learned my addr 172.21.15.125:0/3492190008 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb68affd700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb68c0a08e0 0x7fb68c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:46.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.941+0000 7fb68b7fe700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 0x7fb68c11b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 -- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb68c0a08e0 msgr2=0x7fb68c11a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb68c0a08e0 0x7fb68c11a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 -- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 msgr2=0x7fb68c11ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 0x7fb68c11ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 -- 172.21.15.125:0/3492190008 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800094a0 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb68b7fe700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 0x7fb68c11b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb68400ca80 tx=0x7fb68400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400a9e0 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400ab40 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684012400 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c131c70 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.942+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c09a3a0 con 0x7fb68c133a70 2023-10-03T10:11:46.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.943+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb684012560 con 0x7fb68c133a70 2023-10-03T10:11:46.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.943+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c11cf90 con 0x7fb68c133a70 2023-10-03T10:11:46.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.943+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb68403f780 con 0x7fb68c133a70 2023-10-03T10:11:46.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:46.948+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb684010710 con 0x7fb68c133a70 2023-10-03T10:11:47.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.193+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb68c04f2a0 con 0x7fb68c133a70 2023-10-03T10:11:47.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.193+0000 7fb6737fe700 1 -- 172.21.15.125:0/3492190008 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12721 (secure 0 0 0) 0x7fb684010300 con 0x7fb68c133a70 2023-10-03T10:11:47.194 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:47.194 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:46.432898+0000","last_up_change":"2023-10-03T10:11:46.432898+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":19,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":118765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":118765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":118765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":118765}]},"public_addr":"172.21.15.125:6800/118765","cluster_addr":"172.21.15.125:6801/118765","heartbeat_back_addr":"172.21.15.125:6803/118765","heartbeat_front_addr":"172.21.15.125:6802/118765","state":["exists"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":118766}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":118766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":118766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":118766}]},"public_addr":"172.21.15.125:6804/118766","cluster_addr":"172.21.15.125:6805/118766","heartbeat_back_addr":"172.21.15.125:6807/118766","heartbeat_front_addr":"172.21.15.125:6806/118766","state":["exists"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":118796}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":118796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":118796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":118796}]},"public_addr":"172.21.15.125:6808/118796","cluster_addr":"172.21.15.125:6809/118796","heartbeat_back_addr":"172.21.15.125:6811/118796","heartbeat_front_addr":"172.21.15.125:6810/118796","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:47.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 >> v1:172.21.15.125:6816/126957 conn(0x7fb67802f510 legacy=0x7fb6780319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 msgr2=0x7fb68c11b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 0x7fb68c11b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb68400ca80 tx=0x7fb68400cd90 comp rx=0 tx=0).stop 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 shutdown_connections 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb68c133a70 0x7fb68c11b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb68c0a08e0 0x7fb68c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 --2- 172.21.15.125:0/3492190008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb68c0a1290 0x7fb68c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 >> 172.21.15.125:0/3492190008 conn(0x7fb68c0a2980 msgr2=0x7fb68c12f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 shutdown_connections 2023-10-03T10:11:47.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:47.196+0000 7fb69159a700 1 -- 172.21.15.125:0/3492190008 wait complete. 2023-10-03T10:11:47.384 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-03T10:11:47.383+0000 7f6cc81b9700 -1 osd.1 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:47.905 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:11:47.904+0000 7fde783bc680 -1 osd.3 27 log_to_monitors true 2023-10-03T10:11:48.315 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-03T10:11:48.315+0000 7f662b9c9700 -1 osd.2 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:49.325 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-03T10:11:49.324+0000 7fde64337700 -1 osd.3 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:50.210 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:50.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.341+0000 7fdd5b619700 1 Processor -- start 2023-10-03T10:11:50.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.341+0000 7fdd5b619700 1 -- start start 2023-10-03T10:11:50.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd5409e870 0x7fdd5409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd541321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540a0920 con 0x7fdd5409e870 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5409c970 con 0x7fdd5409f180 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd5b619700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5409bab0 con 0x7fdd54131d70 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd59bb6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd541321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54826/0 (socket says 172.21.15.125:54826) 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 -- 172.21.15.125:0/3210713436 learned_addr learned my addr 172.21.15.125:0/3210713436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd593b5700 1 --2- 172.21.15.125:0/3210713436 >> v2:172.21.15.125:3300/0 conn(0x7fdd5409e870 0x7fdd5409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 -- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 msgr2=0x7fdd541321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd541321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 -- 172.21.15.125:0/3210713436 >> v2:172.21.15.125:3300/0 conn(0x7fdd5409e870 msgr2=0x7fdd5409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 --2- 172.21.15.125:0/3210713436 >> v2:172.21.15.125:3300/0 conn(0x7fdd5409e870 0x7fdd5409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 -- 172.21.15.125:0/3210713436 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5409f9c0 con 0x7fdd5409f180 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd59bb6700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd541321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd58bb4700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009920 tx=0x7fdd50009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=558859da7f6626fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd4bfff700 1 -- 172.21.15.125:0/3210713436 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50011830 con 0x7fdd5409f180 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd4bfff700 1 -- 172.21.15.125:0/3210713436 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50011990 con 0x7fdd5409f180 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.342+0000 7fdd4bfff700 1 -- 172.21.15.125:0/3210713436 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50011d20 con 0x7fdd5409f180 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 -- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 msgr2=0x7fdd54131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009920 tx=0x7fdd50009c30 comp rx=0 tx=0).stop 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 -- 172.21.15.125:0/3210713436 shutdown_connections 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd541321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 --2- 172.21.15.125:0/3210713436 >> v2:172.21.15.125:3300/0 conn(0x7fdd5409e870 0x7fdd5409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 --2- 172.21.15.125:0/3210713436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54131830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 -- 172.21.15.125:0/3210713436 >> 172.21.15.125:0/3210713436 conn(0x7fdd540a4430 msgr2=0x7fdd540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 -- 172.21.15.125:0/3210713436 shutdown_connections 2023-10-03T10:11:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.343+0000 7fdd5b619700 1 -- 172.21.15.125:0/3210713436 wait complete. 2023-10-03T10:11:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 Processor -- start 2023-10-03T10:11:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 -- start start 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd54120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5409b160 con 0x7fdd5409e870 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54122d00 con 0x7fdd5409f180 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd5b619700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54123580 con 0x7fdd54131d70 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd593b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd593b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41246/0 (socket says 172.21.15.125:41246) 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd58bb4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd593b5700 1 -- 172.21.15.125:0/919863939 learned_addr learned my addr 172.21.15.125:0/919863939 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.344+0000 7fdd59bb6700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd54120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 -- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 msgr2=0x7fdd54120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd54120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 -- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 msgr2=0x7fdd54120810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54120810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 -- 172.21.15.125:0/919863939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009a70 con 0x7fdd5409e870 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd58bb4700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd593b5700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400e930 tx=0x7fdd4400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400c640 con 0x7fdd5409e870 2023-10-03T10:11:50.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400c7a0 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd50009550 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400cb30 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.345+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54123e90 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.346+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdd4400cc90 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.346+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fdd4403fb10 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.346+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5409b640 con 0x7fdd5409e870 2023-10-03T10:11:50.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.351+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd44021080 con 0x7fdd5409e870 2023-10-03T10:11:50.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.555+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd5404f2a0 con 0x7fdd5409e870 2023-10-03T10:11:50.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.556+0000 7fdd49ffb700 1 -- 172.21.15.125:0/919863939 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12935 (secure 0 0 0) 0x7fdd44017070 con 0x7fdd5409e870 2023-10-03T10:11:50.556 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:50.557 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":34,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:50.443793+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 >> v1:172.21.15.125:6816/126957 conn(0x7fdd3802f510 legacy=0x7fdd380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 msgr2=0x7fdd541202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400e930 tx=0x7fdd4400ec40 comp rx=0 tx=0).stop 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 shutdown_connections 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd54131d70 0x7fdd54120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd5409e870 0x7fdd541202d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 --2- 172.21.15.125:0/919863939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd5409f180 0x7fdd54120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 >> 172.21.15.125:0/919863939 conn(0x7fdd540a4430 msgr2=0x7fdd540a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 shutdown_connections 2023-10-03T10:11:50.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:50.558+0000 7fdd5b619700 1 -- 172.21.15.125:0/919863939 wait complete. 2023-10-03T10:11:50.570 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:11:50.570 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-03T10:11:50.586 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:11:50.586 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:50.596 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:11:56.245 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-03T10:11:56.246 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:11:56.257 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-03T10:11:56.257 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:11:56.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:11:56.260 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:11:56.260 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:11:56.260 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:56.355 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-03T10:11:56.371 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-03T10:11:56.371+0000 7fa5e1a2a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T10:11:56.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 Processor -- start 2023-10-03T10:11:56.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 -- start start 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 0x7f2ed8131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed809afb0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a0970 con 0x7f2ed809f260 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2ee00f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a0320 con 0x7f2ed809e950 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2edde90700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2edd68f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 0x7f2ed8131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2edde90700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38252/0 (socket says 172.21.15.125:38252) 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.413+0000 7f2edde90700 1 -- 172.21.15.125:0/994907889 learned_addr learned my addr 172.21.15.125:0/994907889 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edce8e700 1 -- 172.21.15.125:0/994907889 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281319157 0 0) 0x7f2ed809afb0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edde90700 1 -- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 msgr2=0x7f2ed8131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edde90700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 0x7f2ed8131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edde90700 1 -- 172.21.15.125:0/994907889 >> v1:172.21.15.125:6789/0 conn(0x7f2ed8131dd0 legacy=0x7f2ed8138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edde90700 1 -- 172.21.15.125:0/994907889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80a0750 con 0x7f2ed809e950 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edd68f700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 0x7f2ed8131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edde90700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009ed0 tx=0x7f2ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bef607df194b981 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edce8e700 1 -- 172.21.15.125:0/994907889 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800e070 con 0x7f2ed809e950 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edce8e700 1 -- 172.21.15.125:0/994907889 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800b9d0 con 0x7f2ed809e950 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.414+0000 7f2edce8e700 1 -- 172.21.15.125:0/994907889 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800bd80 con 0x7f2ed809e950 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 -- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 msgr2=0x7f2ed809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009ed0 tx=0x7f2ec800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 -- 172.21.15.125:0/994907889 shutdown_connections 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809e950 0x7f2ed809ed20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/994907889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809f260 0x7f2ed8131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 -- 172.21.15.125:0/994907889 >> 172.21.15.125:0/994907889 conn(0x7f2ed80a0f70 msgr2=0x7f2ed80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 -- 172.21.15.125:0/994907889 shutdown_connections 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.415+0000 7f2ee00f4700 1 -- 172.21.15.125:0/994907889 wait complete. 2023-10-03T10:11:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 Processor -- start 2023-10-03T10:11:56.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 -- start start 2023-10-03T10:11:56.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 0x7f2ed8120a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 0x7f2ed8120fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81237d0 con 0x7f2ed809f260 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed809da40 con 0x7f2ed809e950 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ee00f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8123ac0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2edde90700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2edd68f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 0x7f2ed8120a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ede691700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 0x7f2ed8120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2edde90700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37380/0 (socket says 172.21.15.125:37380) 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2edd68f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 0x7f2ed8120a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48510/0 (socket says 172.21.15.125:48510) 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2edde90700 1 -- 172.21.15.125:0/1574079958 learned_addr learned my addr 172.21.15.125:0/1574079958 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.416+0000 7f2ede691700 1 -- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 msgr2=0x7f2ed8120540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ede691700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ede691700 1 -- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 msgr2=0x7f2ed8120a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ede691700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 0x7f2ed8120a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ede691700 1 -- 172.21.15.125:0/1574079958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0094a0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2edde90700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ede691700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 0x7f2ed8120fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00011e0 tx=0x7f2ed000c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00054e0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000ce10 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec8009b30 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00038c0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed81247f0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.417+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2ed0003a20 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.418+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2ed003efd0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.418+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8123c30 con 0x7f2ed8131dd0 2023-10-03T10:11:56.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.423+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ed0017020 con 0x7f2ed8131dd0 2023-10-03T10:11:56.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.613+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed804f2a0 con 0x7f2ed8131dd0 2023-10-03T10:11:56.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.614+0000 7f2ed67fc700 1 -- 172.21.15.125:0/1574079958 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13000 (secure 0 0 0) 0x7f2ed0019b40 con 0x7f2ed8131dd0 2023-10-03T10:11:56.615 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:56.615 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":35,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:11:56.371940+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6817/582467044":"2023-10-04T10:11:56.371913+0000","172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:56.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 >> v1:172.21.15.125:6816/126957 conn(0x7f2ec402f510 legacy=0x7f2ec40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 msgr2=0x7f2ed8120fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 0x7f2ed8120fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00011e0 tx=0x7f2ed000c710 comp rx=0 tx=0).stop 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 shutdown_connections 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed8131dd0 0x7f2ed8120fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809e950 0x7f2ed8120540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 --2- 172.21.15.125:0/1574079958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809f260 0x7f2ed8120a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 >> 172.21.15.125:0/1574079958 conn(0x7f2ed80a0f70 msgr2=0x7f2ed811a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 shutdown_connections 2023-10-03T10:11:56.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.617+0000 7f2ee00f4700 1 -- 172.21.15.125:0/1574079958 wait complete. 2023-10-03T10:11:56.629 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:11:56.629 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:11:56.640 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:11:56.640 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:11:56.640 DEBUG:teuthology.orchestra.run.smithi125:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 Processor -- start 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 -- start start 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c098bc0 0x7fce8c0905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce8c090f70 0x7fce8c08d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c06aa90 con 0x7fce8c090b20 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c09fa60 con 0x7fce8c090f70 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce92e94700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c09b020 con 0x7fce8c098bc0 2023-10-03T10:11:56.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce91431700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce8c090f70 0x7fce8c08d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.758+0000 7fce90c30700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c098bc0 0x7fce8c0905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.759+0000 7fce8bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fce8c090b20 0x7fce8c08a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57824/0 (socket says 172.21.15.125:57824) 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.759+0000 7fce8bfff700 1 -- 172.21.15.125:0/2093602424 learned_addr learned my addr 172.21.15.125:0/2093602424 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.759+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262950116 0 0) 0x7fce8c06aa90 con 0x7fce8c090b20 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c003590 con 0x7fce8c090b20 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce91431700 1 -- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c098bc0 msgr2=0x7fce8c0905e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce91431700 1 --2- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c098bc0 0x7fce8c0905e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1326027820 0 0) 0x7fce7c003590 con 0x7fce8c090b20 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce91431700 1 -- 172.21.15.125:0/2093602424 >> v1:172.21.15.125:6789/0 conn(0x7fce8c090b20 legacy=0x7fce8c08a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.765+0000 7fce91431700 1 -- 172.21.15.125:0/2093602424 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c091410 con 0x7fce8c090f70 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce91431700 1 --2- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c08d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fce84008d70 tx=0x7fce8400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fa8e5ab94820cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78001670 con 0x7fce8c090f70 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400e040 con 0x7fce8c090f70 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce8b7fe700 1 -- 172.21.15.125:0/2093602424 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400cce0 con 0x7fce8c090f70 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 -- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 msgr2=0x7fce8c08d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 --2- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c08d7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fce84008d70 tx=0x7fce8400c3b0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 -- 172.21.15.125:0/2093602424 shutdown_connections 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 --2- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c08d7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 --2- 172.21.15.125:0/2093602424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c098bc0 0x7fce8c0905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 -- 172.21.15.125:0/2093602424 >> 172.21.15.125:0/2093602424 conn(0x7fce8c0a2c70 msgr2=0x7fce8c09eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 -- 172.21.15.125:0/2093602424 shutdown_connections 2023-10-03T10:11:56.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.766+0000 7fce92e94700 1 -- 172.21.15.125:0/2093602424 wait complete. 2023-10-03T10:11:56.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.767+0000 7fce92e94700 1 Processor -- start 2023-10-03T10:11:56.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.767+0000 7fce92e94700 1 -- start start 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 0x7fce8c071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c092f20 con 0x7fce8c090f70 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c072770 con 0x7fce8c098bc0 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce92e94700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c098180 con 0x7fce8c090b20 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38270/0 (socket says 172.21.15.125:38270) 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 -- 172.21.15.125:0/1242897711 learned_addr learned my addr 172.21.15.125:0/1242897711 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:56.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce91431700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 0x7fce8c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 -- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 msgr2=0x7fce8c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 0x7fce8c071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 -- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 msgr2=0x7fce8c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 -- 172.21.15.125:0/1242897711 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840089d0 con 0x7fce8c090b20 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce91431700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 0x7fce8c071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce8bfff700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.768+0000 7fce90c30700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce80012fc0 tx=0x7fce800100c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000db90 con 0x7fce8c090b20 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80013040 con 0x7fce8c090b20 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c0918a0 con 0x7fce8c090b20 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80010b10 con 0x7fce8c090b20 2023-10-03T10:11:56.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c091ae0 con 0x7fce8c090b20 2023-10-03T10:11:56.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fce80010c70 con 0x7fce8c090b20 2023-10-03T10:11:56.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.769+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c06af70 con 0x7fce8c090b20 2023-10-03T10:11:56.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.770+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fce800442a0 con 0x7fce8c090b20 2023-10-03T10:11:56.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.774+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce80018480 con 0x7fce8c090b20 2023-10-03T10:11:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.958+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fce8c04ef70 con 0x7fce8c090b20 2023-10-03T10:11:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.960+0000 7fce897fa700 1 -- 172.21.15.125:0/1242897711 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+24190 (secure 0 0 0) 0x7fce800173e0 con 0x7fce8c090b20 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "epoch": 35, 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "fsid": "15b0d202-3c9c-40fb-bdbc-3890d84c122d", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "created": "2023-10-03T10:08:57.993987+0000", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "modified": "2023-10-03T10:11:56.371940+0000", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "last_up_change": "2023-10-03T10:11:49.442692+0000", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "last_in_change": "2023-10-03T10:09:00.288581+0000", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-03T10:11:56.961 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_num": 5799936, 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_set": [ 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "pglog_hardlimit", 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "purged_snapdirs", 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_deletes", 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "sortbitwise" 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_version": 8, 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "full_ratio": 0.94999998807907104, 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_snapshot": "", 2023-10-03T10:11:56.962 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_max": 4, 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "max_osd": 4, 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "require_min_compat_client": "pacific", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "min_compat_client": "luminous", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "require_osd_release": "pacific", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "allow_crimson": false, 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "pools": [ 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 1, 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_name": ".mgr", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "create_time": "2023-10-03T10:09:07.196311+0000", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "flags": 1, 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_names": "hashpspool", 2023-10-03T10:11:56.963 INFO:teuthology.orchestra.run.smithi125.stdout: "type": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "size": 2, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "min_size": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_rule": 0, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "object_hash": 2, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num_target": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_target": 1, 2023-10-03T10:11:56.964 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_pending": 1, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_pg_merge_meta": { 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "source_pgid": "0.0", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "ready_epoch": 0, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_started": 0, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_clean": 0, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "source_version": "0'0", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "target_version": "0'0" 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_change": "24", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend": "0", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "auid": 0, 2023-10-03T10:11:56.965 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_seq": 0, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_epoch": 0, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_snaps": [], 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "removed_snaps": "[]", 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_bytes": 0, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_objects": 0, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "tiers": [], 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "tier_of": -1, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "read_tier": -1, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "write_tier": -1, 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_mode": "none", 2023-10-03T10:11:56.966 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_bytes": 0, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_objects": 0, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_flush_age": 0, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_evict_age": 0, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "erasure_code_profile": "", 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_params": { 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "none" 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_period": 0, 2023-10-03T10:11:56.967 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_count": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "use_gmt_hitset": true, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "grade_table": [], 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "stripe_width": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "expected_num_objects": 0, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "fast_read": false, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "options": { 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_max": 32, 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_min": 1 2023-10-03T10:11:56.968 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "application_metadata": { 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": {}, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr_devicehealth": {} 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "read_balance": { 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "score_acting": 4, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "score_stable": 4, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "optimal_score": 0.5, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_acting": 2, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_stable": 2, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity": 1, 2023-10-03T10:11:56.969 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 2, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_name": "rbd", 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "create_time": "2023-10-03T10:09:08.208327+0000", 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "flags": 1, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_names": "hashpspool", 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "type": 1, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "size": 2, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "min_size": 1, 2023-10-03T10:11:56.970 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_rule": 0, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "object_hash": 2, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num": 8, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num": 8, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num_target": 8, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_target": 8, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_pending": 8, 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "last_pg_merge_meta": { 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "source_pgid": "0.0", 2023-10-03T10:11:56.971 INFO:teuthology.orchestra.run.smithi125.stdout: "ready_epoch": 0, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_started": 0, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_clean": 0, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "source_version": "0'0", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "target_version": "0'0" 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_change": "13", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend": "0", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "auid": 0, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_seq": 0, 2023-10-03T10:11:56.972 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_epoch": 0, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_snaps": [], 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "removed_snaps": "[]", 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_bytes": 0, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_objects": 0, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "tiers": [], 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "tier_of": -1, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "read_tier": -1, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "write_tier": -1, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_mode": "none", 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_bytes": 0, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_objects": 0, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:11:56.973 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_flush_age": 0, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_evict_age": 0, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "erasure_code_profile": "", 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_params": { 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "none" 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_period": 0, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_count": 0, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "use_gmt_hitset": true, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:11:56.974 INFO:teuthology.orchestra.run.smithi125.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "grade_table": [], 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "stripe_width": 0, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "expected_num_objects": 0, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "fast_read": false, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "options": {}, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "application_metadata": { 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "rbd": {} 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "read_balance": { 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "score_acting": 2.5, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "score_stable": 2.5, 2023-10-03T10:11:56.975 INFO:teuthology.orchestra.run.smithi125.stdout: "optimal_score": 1, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_acting": 2.5, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_stable": 2.5, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity": 1, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 3, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_name": "cephfs_metadata", 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "create_time": "2023-10-03T10:09:12.955356+0000", 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "flags": 1, 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_names": "hashpspool", 2023-10-03T10:11:56.976 INFO:teuthology.orchestra.run.smithi125.stdout: "type": 1, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "size": 2, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "min_size": 1, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_rule": 0, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "object_hash": 2, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num": 32, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num": 32, 2023-10-03T10:11:56.977 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num_target": 32, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_target": 32, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_pending": 32, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_pg_merge_meta": { 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "source_pgid": "0.0", 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "ready_epoch": 0, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_started": 0, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_clean": 0, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "source_version": "0'0", 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "target_version": "0'0" 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_change": "16", 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend": "0", 2023-10-03T10:11:56.978 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "auid": 0, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_seq": 0, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_epoch": 0, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_snaps": [], 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "removed_snaps": "[]", 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_bytes": 0, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_objects": 0, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "tiers": [], 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "tier_of": -1, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "read_tier": -1, 2023-10-03T10:11:56.979 INFO:teuthology.orchestra.run.smithi125.stdout: "write_tier": -1, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_mode": "none", 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_bytes": 0, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_objects": 0, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_flush_age": 0, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_evict_age": 0, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "erasure_code_profile": "", 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_params": { 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "none" 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_period": 0, 2023-10-03T10:11:56.980 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_count": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "use_gmt_hitset": true, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "grade_table": [], 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "stripe_width": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "expected_num_objects": 0, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "fast_read": false, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "options": { 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_autoscale_bias": 4, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_min": 16, 2023-10-03T10:11:56.981 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_priority": 5 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "application_metadata": { 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "cephfs": { 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": "cephfs" 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "read_balance": { 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "score_acting": 1.6299999952316284, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "score_stable": 1.6299999952316284, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "optimal_score": 1, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-03T10:11:56.982 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity": 1, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 4, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_name": "cephfs_data", 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "create_time": "2023-10-03T10:09:13.646123+0000", 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "flags": 1, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "flags_names": "hashpspool", 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "type": 1, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "size": 2, 2023-10-03T10:11:56.983 INFO:teuthology.orchestra.run.smithi125.stdout: "min_size": 1, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_rule": 0, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "object_hash": 2, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num": 64, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num": 64, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_placement_num_target": 64, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_target": 64, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_pending": 64, 2023-10-03T10:11:56.984 INFO:teuthology.orchestra.run.smithi125.stdout: "last_pg_merge_meta": { 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "source_pgid": "0.0", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "ready_epoch": 0, 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_started": 0, 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_epoch_clean": 0, 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "source_version": "0'0", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "target_version": "0'0" 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_change": "17", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend": "0", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "auid": 0, 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:11:56.985 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_seq": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "snap_epoch": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "pool_snaps": [], 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "removed_snaps": "[]", 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_bytes": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "quota_max_objects": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "tiers": [], 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "tier_of": -1, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "read_tier": -1, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "write_tier": -1, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_mode": "none", 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_bytes": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "target_max_objects": 0, 2023-10-03T10:11:56.986 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_flush_age": 0, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "cache_min_evict_age": 0, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "erasure_code_profile": "", 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_params": { 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "none" 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_period": 0, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_count": 0, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "use_gmt_hitset": true, 2023-10-03T10:11:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "grade_table": [], 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "stripe_width": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "expected_num_objects": 0, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "fast_read": false, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "options": { 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_num_min": 64, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "target_size_ratio": 0.89999997615814209 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "application_metadata": { 2023-10-03T10:11:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "cephfs": { 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "data": "cephfs" 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "read_balance": { 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "score_acting": 1.059999942779541, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "score_stable": 1.059999942779541, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "optimal_score": 1, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_acting": 1.059999942779541, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "raw_score_stable": 1.059999942779541, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity": 1, 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:11:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "osds": [ 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 0, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "uuid": "e46d0293-43a8-48d0-8115-65e8d17976fd", 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "up": 1, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "in": 1, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "weight": 1, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity": 1, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_begin": 9, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_end": 24, 2023-10-03T10:11:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "up_from": 30, 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "up_thru": 33, 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "down_at": 25, 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "lost_at": 0, 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addrs": { 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6800", 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130330 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addrs": { 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6801", 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130330 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addrs": { 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.992 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6803", 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130330 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addrs": { 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6802", 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130330 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.993 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addr": "172.21.15.125:6800/130330", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addr": "172.21.15.125:6801/130330", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addr": "172.21.15.125:6803/130330", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addr": "172.21.15.125:6802/130330", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "state": [ 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "exists", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "up" 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 1, 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "uuid": "900e5e55-9496-43ac-b8c8-a1c1305d5a2f", 2023-10-03T10:11:56.994 INFO:teuthology.orchestra.run.smithi125.stdout: "up": 1, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "in": 1, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "weight": 1, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity": 1, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_begin": 9, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_end": 25, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "up_from": 31, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "up_thru": 33, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "down_at": 26, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "lost_at": 0, 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addrs": { 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6804", 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130428 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addrs": { 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6805", 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130428 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.996 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addrs": { 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6807", 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130428 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addrs": { 2023-10-03T10:11:56.997 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6806", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130428 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addr": "172.21.15.125:6804/130428", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addr": "172.21.15.125:6805/130428", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addr": "172.21.15.125:6807/130428", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addr": "172.21.15.125:6806/130428", 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "state": [ 2023-10-03T10:11:56.998 INFO:teuthology.orchestra.run.smithi125.stdout: "exists", 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "up" 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 2, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "uuid": "7a1e1fe5-345d-4830-9c17-9662b63d17c2", 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "up": 1, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "in": 1, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "weight": 1, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity": 1, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_begin": 9, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_end": 26, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "up_from": 32, 2023-10-03T10:11:56.999 INFO:teuthology.orchestra.run.smithi125.stdout: "up_thru": 33, 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "down_at": 27, 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "lost_at": 0, 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addrs": { 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6808", 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130560 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addrs": { 2023-10-03T10:11:57.000 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6809", 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130560 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addrs": { 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6811", 2023-10-03T10:11:57.001 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130560 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addrs": { 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6810", 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130560 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.002 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addr": "172.21.15.125:6808/130560", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addr": "172.21.15.125:6809/130560", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addr": "172.21.15.125:6811/130560", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addr": "172.21.15.125:6810/130560", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "state": [ 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "exists", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "up" 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 3, 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "uuid": "337de985-5ba4-41db-9d64-832f9a8393ca", 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "up": 1, 2023-10-03T10:11:57.003 INFO:teuthology.orchestra.run.smithi125.stdout: "in": 1, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "weight": 1, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_affinity": 1, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_begin": 9, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "last_clean_end": 27, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "up_from": 33, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "up_thru": 33, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "down_at": 28, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "lost_at": 0, 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addrs": { 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.004 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6812", 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130878 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addrs": { 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6813", 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130878 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.005 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addrs": { 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6815", 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130878 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addrs": { 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "addrvec": [ 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.006 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:6814", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 130878 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "public_addr": "172.21.15.125:6812/130878", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_addr": "172.21.15.125:6813/130878", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_back_addr": "172.21.15.125:6815/130878", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "heartbeat_front_addr": "172.21.15.125:6814/130878", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "state": [ 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "exists", 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: "up" 2023-10-03T10:11:57.007 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_xinfo": [ 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 0, 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "down_stamp": "0.000000", 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_probability": 0, 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_interval": 0, 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "features": 4540138322906710015, 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "old_weight": 0, 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:05.541618+0000", 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: "dead_epoch": 25 2023-10-03T10:11:57.008 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 1, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "down_stamp": "0.000000", 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_probability": 0, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_interval": 0, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "features": 4540138322906710015, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "old_weight": 0, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:05.435543+0000", 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "dead_epoch": 26 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 2, 2023-10-03T10:11:57.009 INFO:teuthology.orchestra.run.smithi125.stdout: "down_stamp": "0.000000", 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_probability": 0, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_interval": 0, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "features": 4540138322906710015, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "old_weight": 0, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:05.427753+0000", 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "dead_epoch": 27 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": 3, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "down_stamp": "2023-10-03T10:11:43.415680+0000", 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_probability": 0, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "laggy_interval": 0, 2023-10-03T10:11:57.010 INFO:teuthology.orchestra.run.smithi125.stdout: "features": 4540138322906710015, 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "old_weight": 0, 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:05.492064+0000", 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "dead_epoch": 0 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_upmap": [], 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_upmap_items": [ 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.9", 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.011 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 0 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.c", 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 2 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.012 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.d", 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 2 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.10", 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.013 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 2 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.21", 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 2 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.014 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.23", 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 1, 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 2 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "pgid": "4.3a", 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "mappings": [ 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "from": 3, 2023-10-03T10:11:57.015 INFO:teuthology.orchestra.run.smithi125.stdout: "to": 0 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_upmap_primaries": [], 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "pg_temp": [], 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "primary_temp": [], 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklist": { 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "172.21.15.125:6817/582467044": "2023-10-04T10:11:56.371913+0000", 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "172.21.15.125:0/386436796": "2023-10-04T10:11:25.311631+0000", 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "172.21.15.125:6816/118167": "2023-10-04T10:11:25.311631+0000", 2023-10-03T10:11:57.016 INFO:teuthology.orchestra.run.smithi125.stdout: "172.21.15.125:0/677301661": "2023-10-04T10:11:25.311631+0000" 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "range_blocklist": {}, 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "erasure_code_profiles": { 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "default": { 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "crush-failure-domain": "osd", 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "k": "2", 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "m": "1", 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "plugin": "jerasure", 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "technique": "reed_sol_van" 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "removed_snaps_queue": [], 2023-10-03T10:11:57.017 INFO:teuthology.orchestra.run.smithi125.stdout: "new_removed_snaps": [], 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "new_purged_snaps": [], 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "crush_node_flags": {}, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "device_class_flags": {}, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "stretch_mode": { 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "stretch_mode_enabled": false, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "stretch_bucket_count": 0, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "degraded_stretch_mode": 0, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "recovering_stretch_mode": 0, 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: "stretch_mode_bucket": 0 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.018 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 >> v1:172.21.15.125:6816/126957 conn(0x7fce7002f510 legacy=0x7fce700319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 msgr2=0x7fce8c070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce80012fc0 tx=0x7fce800100c0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 shutdown_connections 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce8c098bc0 0x7fce8c071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce8c090b20 0x7fce8c070aa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 --2- 172.21.15.125:0/1242897711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce8c090f70 0x7fce8c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 >> 172.21.15.125:0/1242897711 conn(0x7fce8c0a2c70 msgr2=0x7fce8c09ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 shutdown_connections 2023-10-03T10:11:57.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:56.962+0000 7fce92e94700 1 -- 172.21.15.125:0/1242897711 wait complete. 2023-10-03T10:11:57.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-03T10:11:57.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.137+0000 7f3521fed700 1 Processor -- start 2023-10-03T10:11:57.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.137+0000 7f3521fed700 1 -- start start 2023-10-03T10:11:57.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f3521fed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 0x7f351c131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f3521fed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 0x7f351c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f3521fed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c0a2280 con 0x7f351c09bc50 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f3521fed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c131820 con 0x7f351c09c790 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f3521fed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0a1920 con 0x7f351c131a40 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 0x7f351c131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f351c09bc50 0x7f351c09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57828/0 (socket says 172.21.15.125:57828) 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 0x7f351c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351affd700 1 -- 172.21.15.125:0/4277405118 learned_addr learned my addr 172.21.15.125:0/4277405118 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351a7fc700 1 -- 172.21.15.125:0/4277405118 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883856488 0 0) 0x7f351c0a2280 con 0x7f351c09bc50 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 -- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 msgr2=0x7f351c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 0x7f351c139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 -- 172.21.15.125:0/4277405118 >> v1:172.21.15.125:6789/0 conn(0x7f351c09bc50 legacy=0x7f351c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 -- 172.21.15.125:0/4277405118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c131550 con 0x7f351c131a40 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351bfff700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 0x7f351c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351b7fe700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 0x7f351c131e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3510009870 tx=0x7f3510009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fee286a9987d8ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351a7fc700 1 -- 172.21.15.125:0/4277405118 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011830 con 0x7f351c131a40 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351a7fc700 1 -- 172.21.15.125:0/4277405118 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510011990 con 0x7f351c131a40 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.138+0000 7f351a7fc700 1 -- 172.21.15.125:0/4277405118 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510011d20 con 0x7f351c131a40 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 -- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 msgr2=0x7f351c131e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 0x7f351c131e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3510009870 tx=0x7f3510009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 -- 172.21.15.125:0/4277405118 shutdown_connections 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09c790 0x7f351c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 --2- 172.21.15.125:0/4277405118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131a40 0x7f351c131e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 -- 172.21.15.125:0/4277405118 >> 172.21.15.125:0/4277405118 conn(0x7f351c0a2b70 msgr2=0x7f351c0a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 -- 172.21.15.125:0/4277405118 shutdown_connections 2023-10-03T10:11:57.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.139+0000 7f3521fed700 1 -- 172.21.15.125:0/4277405118 wait complete. 2023-10-03T10:11:57.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 Processor -- start 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 -- start start 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 0x7f351c11e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c121810 con 0x7f351c09bc50 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c130ec0 con 0x7f351c131a40 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f3521fed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0a1b40 con 0x7f351c09c790 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.140+0000 7f351bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37404/0 (socket says 172.21.15.125:37404) 2023-10-03T10:11:57.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 -- 172.21.15.125:0/2744076638 learned_addr learned my addr 172.21.15.125:0/2744076638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48536/0 (socket says 172.21.15.125:48536) 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351affd700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 0x7f351c11e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 -- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 msgr2=0x7f351c11e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 0x7f351c11e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 -- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 msgr2=0x7f351c11dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 -- 172.21.15.125:0/2744076638 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514009a70 con 0x7f351c131a40 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351b7fe700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351affd700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 0x7f351c11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f351bfff700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f351400efc0 tx=0x7f351400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400ca90 con 0x7f351c131a40 2023-10-03T10:11:57.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400f040 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400ce10 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35100094a0 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.141+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c120ee0 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.142+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3514014480 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.142+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3514040340 con 0x7f351c131a40 2023-10-03T10:11:57.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.142+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c068580 con 0x7f351c131a40 2023-10-03T10:11:57.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.147+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3514018030 con 0x7f351c131a40 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.411+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f351c075190 con 0x7f351c131a40 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.411+0000 7f3503fff700 1 -- 172.21.15.125:0/2744076638 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7f3514018020 con 0x7f351c131a40 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": { 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 3 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": { 2023-10-03T10:11:57.412 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": { 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 4 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": { 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "overall": { 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 9 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-03T10:11:57.413 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-03T10:11:57.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 >> v1:172.21.15.125:6816/126957 conn(0x7f350802f510 legacy=0x7f35080319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 msgr2=0x7f351c11e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f351400efc0 tx=0x7f351400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 shutdown_connections 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c131a40 0x7f351c11e6b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c09bc50 0x7f351c11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 --2- 172.21.15.125:0/2744076638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09c790 0x7f351c11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.413+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 >> 172.21.15.125:0/2744076638 conn(0x7f351c0a2b70 msgr2=0x7f351c06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.414+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 shutdown_connections 2023-10-03T10:11:57.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.414+0000 7f3521fed700 1 -- 172.21.15.125:0/2744076638 wait complete. 2023-10-03T10:11:57.426 DEBUG:teuthology.orchestra.run.smithi125:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-03T10:11:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.544+0000 7fc28dc59700 1 Processor -- start 2023-10-03T10:11:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 -- start start 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 0x7fc2880988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28809d710 con 0x7fc2881337c0 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28809a400 con 0x7fc2880984f0 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc28dc59700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc28809d450 con 0x7fc2881340f0 2023-10-03T10:11:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 0x7fc2880988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc286ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38312/0 (socket says 172.21.15.125:38312) 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 0x7fc2880988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37408/0 (socket says 172.21.15.125:37408) 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 -- 172.21.15.125:0/2269630619 learned_addr learned my addr 172.21.15.125:0/2269630619 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc286ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48542/0 (socket says 172.21.15.125:48542) 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 -- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 msgr2=0x7fc2880988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 --2- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 0x7fc2880988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 -- 172.21.15.125:0/2269630619 >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 msgr2=0x7fc288133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 --2- 172.21.15.125:0/2269630619 >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc287fff700 1 -- 172.21.15.125:0/2269630619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28809c2d0 con 0x7fc2881340f0 2023-10-03T10:11:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.545+0000 7fc286ffd700 1 --2- 172.21.15.125:0/2269630619 >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc287fff700 1 --2- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc280009e50 tx=0x7fc28000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39920ad65ff5221 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc2867fc700 1 -- 172.21.15.125:0/2269630619 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28000e070 con 0x7fc2881340f0 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc2867fc700 1 -- 172.21.15.125:0/2269630619 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000b910 con 0x7fc2881340f0 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc2867fc700 1 -- 172.21.15.125:0/2269630619 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28000bcc0 con 0x7fc2881340f0 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 -- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 msgr2=0x7fc28813aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 --2- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc280009e50 tx=0x7fc28000b330 comp rx=0 tx=0).stop 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 -- 172.21.15.125:0/2269630619 shutdown_connections 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 --2- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2880984f0 0x7fc2880988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 --2- 172.21.15.125:0/2269630619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2881340f0 0x7fc28813aaf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 --2- 172.21.15.125:0/2269630619 >> v2:172.21.15.125:3300/0 conn(0x7fc2881337c0 0x7fc288133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 -- 172.21.15.125:0/2269630619 >> 172.21.15.125:0/2269630619 conn(0x7fc28806c950 msgr2=0x7fc28806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 -- 172.21.15.125:0/2269630619 shutdown_connections 2023-10-03T10:11:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.546+0000 7fc28dc59700 1 -- 172.21.15.125:0/2269630619 wait complete. 2023-10-03T10:11:57.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 Processor -- start 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 -- start start 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 0x7fc2881c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 0x7fc28812f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880a3840 con 0x7fc2881337c0 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc288132a00 con 0x7fc2881340f0 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc28dc59700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc288097cb0 con 0x7fc2880984f0 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.548+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38322/0 (socket says 172.21.15.125:38322) 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 -- 172.21.15.125:0/3386913458 learned_addr learned my addr 172.21.15.125:0/3386913458 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc286ffd700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 0x7fc2881c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc287fff700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 0x7fc28812f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 -- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 msgr2=0x7fc28812f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 0x7fc28812f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 -- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 msgr2=0x7fc2881c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 0x7fc2881c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 -- 172.21.15.125:0/3386913458 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780094a0 con 0x7fc2880984f0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc287fff700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 0x7fc28812f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc286ffd700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 0x7fc2881c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc2877fe700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc27000e990 tx=0x7fc27000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2700096f0 con 0x7fc2880984f0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000c690 con 0x7fc2880984f0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27000ca00 con 0x7fc2880984f0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc280009b30 con 0x7fc2880984f0 2023-10-03T10:11:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.549+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2881334a0 con 0x7fc2880984f0 2023-10-03T10:11:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.550+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc27000cb60 con 0x7fc2880984f0 2023-10-03T10:11:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.550+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc27003ff30 con 0x7fc2880984f0 2023-10-03T10:11:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.550+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc288075190 con 0x7fc2880984f0 2023-10-03T10:11:57.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.555+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc270017070 con 0x7fc2880984f0 2023-10-03T10:11:57.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.734+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fc288132c20 con 0x7fc2880984f0 2023-10-03T10:11:57.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.735+0000 7fc27ffff700 1 -- 172.21.15.125:0/3386913458 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v35) v1 ==== 59+0+37 (secure 0 0 0) 0x7fc288132c20 con 0x7fc2880984f0 2023-10-03T10:11:57.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 >> v1:172.21.15.125:6816/126957 conn(0x7fc26802f510 legacy=0x7fc2680319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 msgr2=0x7fc2881c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc27000e990 tx=0x7fc27000eca0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 shutdown_connections 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2881340f0 0x7fc28812f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2880984f0 0x7fc2881c8b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 --2- 172.21.15.125:0/3386913458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2881337c0 0x7fc2881c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 >> 172.21.15.125:0/3386913458 conn(0x7fc28806c950 msgr2=0x7fc2880a65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 shutdown_connections 2023-10-03T10:11:57.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.737+0000 7fc28dc59700 1 -- 172.21.15.125:0/3386913458 wait complete. 2023-10-03T10:11:57.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 Processor -- start 2023-10-03T10:11:57.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 -- start start 2023-10-03T10:11:57.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e8c139400 0x7f4e8c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c09e9e0 con 0x7f4e8c0a4360 2023-10-03T10:11:57.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c0a5210 con 0x7f4e8c139400 2023-10-03T10:11:57.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.844+0000 7f4e9134a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c09de00 con 0x7f4e8c0a4e40 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e8c139400 0x7f4e8c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e8c139400 0x7f4e8c13b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48556/0 (socket says 172.21.15.125:48556) 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/31076889 learned_addr learned my addr 172.21.15.125:0/31076889 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8affd700 1 --1- 172.21.15.125:0/31076889 >> v1:172.21.15.125:6789/0 conn(0x7f4e8c0a4360 0x7f4e8c0a4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57836/0 (socket says 172.21.15.125:57836) 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38324/0 (socket says 172.21.15.125:38324) 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 msgr2=0x7f4e8c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/31076889 >> v1:172.21.15.125:6789/0 conn(0x7f4e8c0a4360 legacy=0x7f4e8c0a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/31076889 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0a53e0 con 0x7f4e8c139400 2023-10-03T10:11:57.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8a7fc700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e89ffb700 1 -- 172.21.15.125:0/31076889 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905668248 0 0) 0x7f4e8c09e9e0 con 0x7f4e8c0a4360 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e8b7fe700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c139400 0x7f4e8c13b7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009e50 tx=0x7f4e8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1628f1615ccd50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e89ffb700 1 -- 172.21.15.125:0/31076889 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400e070 con 0x7f4e8c139400 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e89ffb700 1 -- 172.21.15.125:0/31076889 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8400b910 con 0x7f4e8c139400 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.845+0000 7f4e89ffb700 1 -- 172.21.15.125:0/31076889 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400bcc0 con 0x7f4e8c139400 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 -- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c139400 msgr2=0x7f4e8c13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c139400 0x7f4e8c13b7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009e50 tx=0x7f4e8400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 -- 172.21.15.125:0/31076889 shutdown_connections 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c139400 0x7f4e8c13b7e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 --2- 172.21.15.125:0/31076889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c0a4e40 0x7f4e8c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 -- 172.21.15.125:0/31076889 >> 172.21.15.125:0/31076889 conn(0x7f4e8c0a2f40 msgr2=0x7f4e8c0a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 -- 172.21.15.125:0/31076889 shutdown_connections 2023-10-03T10:11:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.846+0000 7f4e9134a700 1 -- 172.21.15.125:0/31076889 wait complete. 2023-10-03T10:11:57.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 Processor -- start 2023-10-03T10:11:57.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 -- start start 2023-10-03T10:11:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 0x7f4e8c11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e8c0a4e40 0x7f4e8c11eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c11fd30 con 0x7f4e8c0a4360 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c120470 con 0x7f4e8c0a4e40 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e9134a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c120a90 con 0x7f4e8c139400 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e8b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e8b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38334/0 (socket says 172.21.15.125:38334) 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/2083185771 learned_addr learned my addr 172.21.15.125:0/2083185771 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e8a7fc700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e8c0a4e40 0x7f4e8c11eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.847+0000 7f4e8affd700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 0x7f4e8c11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e8c0a4e40 msgr2=0x7f4e8c11eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e8c0a4e40 0x7f4e8c11eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 msgr2=0x7f4e8c11e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 0x7f4e8c11e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 -- 172.21.15.125:0/2083185771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0094a0 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8affd700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 0x7f4e8c11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e8b7fe700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400b680 tx=0x7f4e84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84004870 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840092e0 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e84009b30 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8401c660 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.848+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c1220a0 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.849+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c122290 con 0x7f4e8c139400 2023-10-03T10:11:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.849+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e8401c7c0 con 0x7f4e8c139400 2023-10-03T10:11:57.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.849+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4e84041f20 con 0x7f4e8c139400 2023-10-03T10:11:57.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:57.853+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e84025450 con 0x7f4e8c139400 2023-10-03T10:11:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.038+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f4e8c068580 con 0x7f4e8c139400 2023-10-03T10:11:58.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.406+0000 7f4e737fe700 1 -- 172.21.15.125:0/2083185771 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v36) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4e84033020 con 0x7f4e8c139400 2023-10-03T10:11:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 >> v1:172.21.15.125:6816/126957 conn(0x7f4e7802f510 legacy=0x7f4e780319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 msgr2=0x7f4e8c11f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400b680 tx=0x7f4e84004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 shutdown_connections 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e8c139400 0x7f4e8c11f2e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e8c0a4360 0x7f4e8c11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 --2- 172.21.15.125:0/2083185771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e8c0a4e40 0x7f4e8c11eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 >> 172.21.15.125:0/2083185771 conn(0x7f4e8c0a2f40 msgr2=0x7f4e8c0a0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 shutdown_connections 2023-10-03T10:11:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.409+0000 7f4e9134a700 1 -- 172.21.15.125:0/2083185771 wait complete. 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr:*** Caught signal (Aborted) ** 2023-10-03T10:11:58.411 INFO:tasks.ceph.mgr.x.smithi125.stderr: in thread 7f33cf663700 thread_name:ms_dispatch 2023-10-03T10:11:58.412 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 1 pg_autoscale_mode to off 2023-10-03T10:11:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.528+0000 7fdd0e2a7700 1 Processor -- start 2023-10-03T10:11:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.528+0000 7fdd0e2a7700 1 -- start start 2023-10-03T10:11:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd0e2a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd08066600 0x7fdd08133be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd0e2a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd0e2a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0809a9e0 con 0x7fdd080a10d0 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd0e2a7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0809a0f0 con 0x7fdd08066600 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd0e2a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080a25d0 con 0x7fdd08134120 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd08066600 0x7fdd08133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37432/0 (socket says 172.21.15.125:37432) 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd077fe700 1 -- 172.21.15.125:0/2928505574 learned_addr learned my addr 172.21.15.125:0/2928505574 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd08066600 0x7fdd08133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48566/0 (socket says 172.21.15.125:48566) 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 -- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 msgr2=0x7fdd080a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 -- 172.21.15.125:0/2928505574 >> v1:172.21.15.125:6789/0 conn(0x7fdd080a10d0 legacy=0x7fdd0813ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd07fff700 1 -- 172.21.15.125:0/2928505574 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08099bf0 con 0x7fdd08066600 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd06ffd700 1 -- 172.21.15.125:0/2928505574 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510027546 0 0) 0x7fdd0809a9e0 con 0x7fdd080a10d0 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.529+0000 7fdd077fe700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd07fff700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd08133be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db2488d50abceb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd06ffd700 1 -- 172.21.15.125:0/2928505574 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011830 con 0x7fdd08066600 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd06ffd700 1 -- 172.21.15.125:0/2928505574 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8011990 con 0x7fdd08066600 2023-10-03T10:11:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd06ffd700 1 -- 172.21.15.125:0/2928505574 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011d20 con 0x7fdd08066600 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 msgr2=0x7fdd08133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd08133be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf8009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.530+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/2928505574 shutdown_connections 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.531+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd08133be0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.531+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/2928505574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd08134120 0x7fdd080a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.531+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/2928505574 >> 172.21.15.125:0/2928505574 conn(0x7fdd080a2b70 msgr2=0x7fdd080a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.531+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/2928505574 shutdown_connections 2023-10-03T10:11:58.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.531+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/2928505574 wait complete. 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.532+0000 7fdd0e2a7700 1 Processor -- start 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.532+0000 7fdd0e2a7700 1 -- start start 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 0x7fdd0811e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08121d50 con 0x7fdd08066600 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0811f480 con 0x7fdd080a10d0 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0e2a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd081206d0 con 0x7fdd08134120 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37434/0 (socket says 172.21.15.125:37434) 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48570/0 (socket says 172.21.15.125:48570) 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd077fe700 1 -- 172.21.15.125:0/3882257857 learned_addr learned my addr 172.21.15.125:0/3882257857 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0c844700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 0x7fdd0811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 -- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 msgr2=0x7fdd0811e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 0x7fdd0811e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 -- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 msgr2=0x7fdd0811de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 -- 172.21.15.125:0/3882257857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009550 con 0x7fdd08066600 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd077fe700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd0c844700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 0x7fdd0811e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd07fff700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd08066a60 tx=0x7fdcf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8004400 con 0x7fdd08066600 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf801f070 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.533+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80038a0 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.534+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80094a0 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.534+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd081339b0 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.534+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdcf8021030 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.535+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0811a780 con 0x7fdd08066600 2023-10-03T10:11:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.535+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdcf8040cd0 con 0x7fdd08066600 2023-10-03T10:11:58.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.544+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcf80199a0 con 0x7fdd08066600 2023-10-03T10:11:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.666+0000 7fdd077fe700 1 -- 172.21.15.125:0/3882257857 >> v1:172.21.15.125:6816/126957 conn(0x7fdcf402f510 legacy=0x7fdcf40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=20 : -104 Unknown error -104 2023-10-03T10:11:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.666+0000 7fdd077fe700 1 -- 172.21.15.125:0/3882257857 >> v1:172.21.15.125:6816/126957 conn(0x7fdcf402f510 legacy=0x7fdcf40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T10:11:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.666+0000 7fdd077fe700 1 --1- 172.21.15.125:0/3882257857 >> v1:172.21.15.125:6816/126957 conn(0x7fdcf402f510 0x7fdcf40319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2023-10-03T10:11:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.666+0000 7fdd077fe700 1 --1- 172.21.15.125:0/3882257857 >> v1:172.21.15.125:6816/126957 conn(0x7fdcf402f510 0x7fdcf40319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2023-10-03T10:11:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.666+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 >> v1:172.21.15.125:6816/126957 conn(0x7fdcf402f510 legacy=0x7fdcf40319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T10:11:58.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:58.734+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fdce00051e0 con 0x7fdd08066600 2023-10-03T10:11:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.414+0000 7fdd04ff9700 1 -- 172.21.15.125:0/3882257857 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v37) v1 ==== 152+0+0 (secure 0 0 0) 0x7fdcf8015020 con 0x7fdd08066600 2023-10-03T10:11:59.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.418+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 msgr2=0x7fdd0811d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.418+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd08066a60 tx=0x7fdcf8004750 comp rx=0 tx=0).stop 2023-10-03T10:11:59.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 shutdown_connections 2023-10-03T10:11:59.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd08134120 0x7fdd0811e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd08066600 0x7fdd0811d900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 --2- 172.21.15.125:0/3882257857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd080a10d0 0x7fdd0811de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 >> 172.21.15.125:0/3882257857 conn(0x7fdd080a2b70 msgr2=0x7fdd081bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 shutdown_connections 2023-10-03T10:11:59.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.420+0000 7fdd0e2a7700 1 -- 172.21.15.125:0/3882257857 wait complete. 2023-10-03T10:11:59.421 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 2 pg_autoscale_mode to off 2023-10-03T10:11:59.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 Processor -- start 2023-10-03T10:11:59.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 -- start start 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7aa809fc40 0x7f7aa806b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80a0010 con 0x7f7aa809fc40 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8098670 con 0x7f7aa806bdc0 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aad66a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa806c6f0 con 0x7f7aa8138460 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aa67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.536+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37444/0 (socket says 172.21.15.125:37444) 2023-10-03T10:11:59.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38350/0 (socket says 172.21.15.125:38350) 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa67fc700 1 -- 172.21.15.125:0/3989594880 learned_addr learned my addr 172.21.15.125:0/3989594880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa6ffd700 1 --2- 172.21.15.125:0/3989594880 >> v2:172.21.15.125:3300/0 conn(0x7f7aa809fc40 0x7f7aa806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 -- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 msgr2=0x7f7aa806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 -- 172.21.15.125:0/3989594880 >> v2:172.21.15.125:3300/0 conn(0x7f7aa809fc40 msgr2=0x7f7aa806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/3989594880 >> v2:172.21.15.125:3300/0 conn(0x7f7aa809fc40 0x7f7aa806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 -- 172.21.15.125:0/3989594880 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa806d4e0 con 0x7f7aa8138460 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa67fc700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009df0 tx=0x7f7aa000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2219b193814c756a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa5ffb700 1 -- 172.21.15.125:0/3989594880 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000e070 con 0x7f7aa8138460 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa5ffb700 1 -- 172.21.15.125:0/3989594880 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000baa0 con 0x7f7aa8138460 2023-10-03T10:11:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.537+0000 7f7aa5ffb700 1 -- 172.21.15.125:0/3989594880 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000be50 con 0x7f7aa8138460 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 -- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 msgr2=0x7f7aa813a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009df0 tx=0x7f7aa000b330 comp rx=0 tx=0).stop 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 -- 172.21.15.125:0/3989594880 shutdown_connections 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa8138460 0x7f7aa813a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 --2- 172.21.15.125:0/3989594880 >> v2:172.21.15.125:3300/0 conn(0x7f7aa809fc40 0x7f7aa806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 --2- 172.21.15.125:0/3989594880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa806bdc0 0x7f7aa806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 -- 172.21.15.125:0/3989594880 >> 172.21.15.125:0/3989594880 conn(0x7f7aa80a4270 msgr2=0x7f7aa80a4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 -- 172.21.15.125:0/3989594880 shutdown_connections 2023-10-03T10:11:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.538+0000 7f7aad66a700 1 -- 172.21.15.125:0/3989594880 wait complete. 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 Processor -- start 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 -- start start 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 0x7f7aa81378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 0x7f7aa8137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8094a40 con 0x7f7aa809fc40 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8093150 con 0x7f7aa8138460 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aad66a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8094c70 con 0x7f7aa806bdc0 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 0x7f7aa81378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 0x7f7aa8137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 0x7f7aa81378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38362/0 (socket says 172.21.15.125:38362) 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 0x7f7aa8137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48596/0 (socket says 172.21.15.125:48596) 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa6ffd700 1 -- 172.21.15.125:0/898499388 learned_addr learned my addr 172.21.15.125:0/898499388 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.539+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37452/0 (socket says 172.21.15.125:37452) 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 -- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 msgr2=0x7f7aa81378b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 0x7f7aa81378b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 -- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 msgr2=0x7f7aa8137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 0x7f7aa8137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 -- 172.21.15.125:0/898499388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009550 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aa77fe700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0016000 tx=0x7f7aa0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00045d0 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0020070 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa0009a70 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0004970 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.540+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa8093640 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.541+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7aa0012430 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.541+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7aa0022070 con 0x7f7aa8138460 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.541+0000 7f7aa6ffd700 1 -- 172.21.15.125:0/898499388 >> v1:172.21.15.125:6816/126957 conn(0x7f7a9402f510 legacy=0x7f7a940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:11:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.541+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa8075190 con 0x7f7aa8138460 2023-10-03T10:11:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.546+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7aa002c020 con 0x7f7aa8138460 2023-10-03T10:11:59.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.727+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f7aa806d1a0 con 0x7f7aa8138460 2023-10-03T10:11:59.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:11:59.742+0000 7f7aa6ffd700 1 -- 172.21.15.125:0/898499388 >> v1:172.21.15.125:6816/126957 conn(0x7f7a9402f510 legacy=0x7f7a940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.143+0000 7f7aa6ffd700 1 -- 172.21.15.125:0/898499388 >> v1:172.21.15.125:6816/126957 conn(0x7f7a9402f510 legacy=0x7f7a940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:00.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.410+0000 7f7a8f7fe700 1 -- 172.21.15.125:0/898499388 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v38) v1 ==== 164+0+0 (secure 0 0 0) 0x7f7aa001c400 con 0x7f7aa8138460 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 >> v1:172.21.15.125:6816/126957 conn(0x7f7a9402f510 legacy=0x7f7a940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 msgr2=0x7f7aa8095b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0016000 tx=0x7f7aa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 shutdown_connections 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa8138460 0x7f7aa8095b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa806bdc0 0x7f7aa81378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 --2- 172.21.15.125:0/898499388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa809fc40 0x7f7aa8137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 >> 172.21.15.125:0/898499388 conn(0x7f7aa80a4270 msgr2=0x7f7aa809d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 shutdown_connections 2023-10-03T10:12:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.415+0000 7f7aad66a700 1 -- 172.21.15.125:0/898499388 wait complete. 2023-10-03T10:12:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 3 pg_autoscale_mode to off 2023-10-03T10:12:00.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 Processor -- start 2023-10-03T10:12:00.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 -- start start 2023-10-03T10:12:00.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3e5009fc20 0x7f3e5006b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e5013a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5009fff0 con 0x7f3e5009fc20 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5006cdb0 con 0x7f3e5006bdc0 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e55a6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50097f10 con 0x7f3e50138420 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3e5009fc20 0x7f3e5006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e5013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37454/0 (socket says 172.21.15.125:37454) 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3e5009fc20 0x7f3e5006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48598/0 (socket says 172.21.15.125:48598) 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e5013a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38370/0 (socket says 172.21.15.125:38370) 2023-10-03T10:12:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.530+0000 7f3e4effd700 1 -- 172.21.15.125:0/3680961508 learned_addr learned my addr 172.21.15.125:0/3680961508 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 msgr2=0x7f3e5013a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e5013a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 msgr2=0x7f3e5006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3680961508 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5006d270 con 0x7f3e5009fc20 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4effd700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4f7fe700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5009fc20 0x7f3e5006b880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009870 tx=0x7f3e40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a7f12ff4fac0db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3680961508 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011830 con 0x7f3e5009fc20 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3680961508 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40011990 con 0x7f3e5009fc20 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.531+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3680961508 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011d20 con 0x7f3e5009fc20 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5009fc20 msgr2=0x7f3e5006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5009fc20 0x7f3e5006b880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009870 tx=0x7f3e40009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3680961508 shutdown_connections 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e5013a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5009fc20 0x7f3e5006b880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3680961508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5006bdc0 0x7f3e5006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3680961508 >> 172.21.15.125:0/3680961508 conn(0x7f3e500a4230 msgr2=0x7f3e500a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3680961508 shutdown_connections 2023-10-03T10:12:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.532+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3680961508 wait complete. 2023-10-03T10:12:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 Processor -- start 2023-10-03T10:12:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 -- start start 2023-10-03T10:12:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 0x7f3e500915e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e501c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50093c80 con 0x7f3e5006bdc0 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50093e80 con 0x7f3e5009fc20 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e55a6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500948f0 con 0x7f3e50138420 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 0x7f3e500915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48602/0 (socket says 172.21.15.125:48602) 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3235449293 learned_addr learned my addr 172.21.15.125:0/3235449293 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.533+0000 7f3e4ffff700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e501c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 -- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 msgr2=0x7f3e501c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e501c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 -- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 msgr2=0x7f3e500910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 -- 172.21.15.125:0/3235449293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44009550 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4ffff700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e501c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4f7fe700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e4effd700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 0x7f3e500915e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e9d0 tx=0x7f3e4400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ee70 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44004030 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e400094a0 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440043c0 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.534+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e500a0550 con 0x7f3e5009fc20 2023-10-03T10:12:00.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.535+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3e4400c850 con 0x7f3e5009fc20 2023-10-03T10:12:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.535+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3e4403fa90 con 0x7f3e5009fc20 2023-10-03T10:12:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.535+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3235449293 >> v1:172.21.15.125:6816/126957 conn(0x7f3e3c02f510 legacy=0x7f3e3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.535+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5006ddf0 con 0x7f3e5009fc20 2023-10-03T10:12:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.540+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e44019d40 con 0x7f3e5009fc20 2023-10-03T10:12:00.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.721+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f3e50068580 con 0x7f3e5009fc20 2023-10-03T10:12:00.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:00.736+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3235449293 >> v1:172.21.15.125:6816/126957 conn(0x7f3e3c02f510 legacy=0x7f3e3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:01.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.137+0000 7f3e4f7fe700 1 -- 172.21.15.125:0/3235449293 >> v1:172.21.15.125:6816/126957 conn(0x7f3e3c02f510 legacy=0x7f3e3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:01.219 INFO:tasks.ceph.mgr.x.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-10-03T10:12:01.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.412+0000 7f3e37fff700 1 -- 172.21.15.125:0/3235449293 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v39) v1 ==== 160+0+0 (secure 0 0 0) 0x7f3e44019300 con 0x7f3e5009fc20 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 >> v1:172.21.15.125:6816/126957 conn(0x7f3e3c02f510 legacy=0x7f3e3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 msgr2=0x7f3e500915e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 0x7f3e500915e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e9d0 tx=0x7f3e4400ece0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 shutdown_connections 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e50138420 0x7f3e501c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e5006bdc0 0x7f3e500910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 --2- 172.21.15.125:0/3235449293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e5009fc20 0x7f3e500915e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 >> 172.21.15.125:0/3235449293 conn(0x7f3e500a4230 msgr2=0x7f3e50137640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 shutdown_connections 2023-10-03T10:12:01.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.416+0000 7f3e55a6d700 1 -- 172.21.15.125:0/3235449293 wait complete. 2023-10-03T10:12:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 4 pg_autoscale_mode to off 2023-10-03T10:12:01.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-03T10:12:01.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 Processor -- start 2023-10-03T10:12:01.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 -- start start 2023-10-03T10:12:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 0x7f357c136c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f357c137180 0x7f357c139560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0a2280 con 0x7f357c131a40 2023-10-03T10:12:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c131820 con 0x7f357c137180 2023-10-03T10:12:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f35834a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0a1920 con 0x7f357c134860 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f3580a41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 0x7f357c136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f3581a43700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f357c137180 0x7f357c139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f3581242700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f357c131a40 0x7f357c131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57856/0 (socket says 172.21.15.125:57856) 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.558+0000 7f3581242700 1 -- 172.21.15.125:0/3799909702 learned_addr learned my addr 172.21.15.125:0/3799909702 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3581a43700 1 -- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 msgr2=0x7f357c136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3581a43700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 0x7f357c136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3581a43700 1 -- 172.21.15.125:0/3799909702 >> v1:172.21.15.125:6789/0 conn(0x7f357c131a40 legacy=0x7f357c131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f356ffff700 1 -- 172.21.15.125:0/3799909702 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226435467 0 0) 0x7f357c0a2280 con 0x7f357c131a40 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3581a43700 1 -- 172.21.15.125:0/3799909702 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c131550 con 0x7f357c137180 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3580a41700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 0x7f357c136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f3581a43700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c139560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3574009d90 tx=0x7f357400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa218502d4c375ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f356ffff700 1 -- 172.21.15.125:0/3799909702 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400e070 con 0x7f357c137180 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f356ffff700 1 -- 172.21.15.125:0/3799909702 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357400bb20 con 0x7f357c137180 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f356ffff700 1 -- 172.21.15.125:0/3799909702 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574012430 con 0x7f357c137180 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f35834a6700 1 -- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 msgr2=0x7f357c139560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.559+0000 7f35834a6700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c139560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3574009d90 tx=0x7f357400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 -- 172.21.15.125:0/3799909702 shutdown_connections 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c139560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 --2- 172.21.15.125:0/3799909702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c134860 0x7f357c136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 -- 172.21.15.125:0/3799909702 >> 172.21.15.125:0/3799909702 conn(0x7f357c0a2b70 msgr2=0x7f357c0a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 -- 172.21.15.125:0/3799909702 shutdown_connections 2023-10-03T10:12:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 -- 172.21.15.125:0/3799909702 wait complete. 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 Processor -- start 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.560+0000 7f35834a6700 1 -- start start 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 0x7f357c119520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c119a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c11ba30 con 0x7f357c137180 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c11a2e0 con 0x7f357c134860 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f35834a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357c12f450 con 0x7f357c131a40 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38394/0 (socket says 172.21.15.125:38394) 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 -- 172.21.15.125:0/1341058081 learned_addr learned my addr 172.21.15.125:0/1341058081 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3580a41700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 0x7f357c119520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581a43700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c119a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 -- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 msgr2=0x7f357c119520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 0x7f357c119520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 -- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 msgr2=0x7f357c119a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c119a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 -- 172.21.15.125:0/1341058081 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780094a0 con 0x7f357c131a40 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581a43700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c119a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3580a41700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 0x7f357c119520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.561+0000 7f3581242700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f357000c580 tx=0x7f357000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570004c80 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570004de0 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570007310 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3574009a70 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c11b6b0 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.562+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3570007470 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.563+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f357003f690 con 0x7f357c131a40 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.563+0000 7f3580a41700 1 -- 172.21.15.125:0/1341058081 >> v1:172.21.15.125:6816/126957 conn(0x7f356002f510 legacy=0x7f35600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.563+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c072380 con 0x7f357c131a40 2023-10-03T10:12:01.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.567+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35700123b0 con 0x7f357c131a40 2023-10-03T10:12:01.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.760+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f357c12dd60 con 0x7f357c131a40 2023-10-03T10:12:01.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:01.764+0000 7f3580a41700 1 -- 172.21.15.125:0/1341058081 >> v1:172.21.15.125:6816/126957 conn(0x7f356002f510 legacy=0x7f35600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.165+0000 7f3580a41700 1 -- 172.21.15.125:0/1341058081 >> v1:172.21.15.125:6816/126957 conn(0x7f356002f510 legacy=0x7f35600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:02.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.422+0000 7f356dffb700 1 -- 172.21.15.125:0/1341058081 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v40) v1 ==== 90+0+0 (secure 0 0 0) 0x7f357001b340 con 0x7f357c131a40 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 >> v1:172.21.15.125:6816/126957 conn(0x7f356002f510 legacy=0x7f35600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 msgr2=0x7f357c118fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f357000c580 tx=0x7f357000c890 comp rx=0 tx=0).stop 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 shutdown_connections 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c137180 0x7f357c119a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c131a40 0x7f357c118fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 --2- 172.21.15.125:0/1341058081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c134860 0x7f357c119520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 >> 172.21.15.125:0/1341058081 conn(0x7f357c0a2b70 msgr2=0x7f357c12e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 shutdown_connections 2023-10-03T10:12:02.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.426+0000 7f35834a6700 1 -- 172.21.15.125:0/1341058081 wait complete. 2023-10-03T10:12:02.442 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:02.452 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:02.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:02.452 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:02.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.578+0000 7f0980d4f700 1 Processor -- start 2023-10-03T10:12:02.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.578+0000 7f0980d4f700 1 -- start start 2023-10-03T10:12:02.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 0x7f097c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c0a0920 con 0x7f097c09f180 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c09c970 con 0x7f097c09e870 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0980d4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097c09bab0 con 0x7f097c131d70 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f097a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f097ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f097ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38402/0 (socket says 172.21.15.125:38402) 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f097a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37486/0 (socket says 172.21.15.125:37486) 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f097ad9d700 1 -- 172.21.15.125:0/940233981 learned_addr learned my addr 172.21.15.125:0/940233981 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.579+0000 7f0979d9b700 1 --2- 172.21.15.125:0/940233981 >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 0x7f097c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 -- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 msgr2=0x7f097c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 -- 172.21.15.125:0/940233981 >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 msgr2=0x7f097c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 --2- 172.21.15.125:0/940233981 >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 0x7f097c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 -- 172.21.15.125:0/940233981 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c09f9c0 con 0x7f097c09e870 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0979d9b700 1 --2- 172.21.15.125:0/940233981 >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 0x7f097c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097ad9d700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097a59c700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f0970009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819e5bf500d74452 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097959a700 1 -- 172.21.15.125:0/940233981 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970011830 con 0x7f097c09e870 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097959a700 1 -- 172.21.15.125:0/940233981 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970011990 con 0x7f097c09e870 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f097959a700 1 -- 172.21.15.125:0/940233981 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970011d20 con 0x7f097c09e870 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 -- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 msgr2=0x7f097c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f0970009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 -- 172.21.15.125:0/940233981 shutdown_connections 2023-10-03T10:12:02.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c09ec40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 --2- 172.21.15.125:0/940233981 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c131d70 0x7f097c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 --2- 172.21.15.125:0/940233981 >> v2:172.21.15.125:3300/0 conn(0x7f097c09f180 0x7f097c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.580+0000 7f0980d4f700 1 -- 172.21.15.125:0/940233981 >> 172.21.15.125:0/940233981 conn(0x7f097c0a4430 msgr2=0x7f097c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.581+0000 7f0980d4f700 1 -- 172.21.15.125:0/940233981 shutdown_connections 2023-10-03T10:12:02.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.581+0000 7f0980d4f700 1 -- 172.21.15.125:0/940233981 wait complete. 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 Processor -- start 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 -- start start 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c09f180 0x7f097c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f097c131d70 0x7f097c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c124220 con 0x7f097c131d70 2023-10-03T10:12:02.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c131830 con 0x7f097c09e870 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0980d4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0a0210 con 0x7f097c09f180 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f0979d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c09f180 0x7f097c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37496/0 (socket says 172.21.15.125:37496) 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 -- 172.21.15.125:0/3524048815 learned_addr learned my addr 172.21.15.125:0/3524048815 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097ad9d700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f097c131d70 0x7f097c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 -- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c09f180 msgr2=0x7f097c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c09f180 0x7f097c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 -- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f097c131d70 msgr2=0x7f097c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f097c131d70 0x7f097c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 -- 172.21.15.125:0/3524048815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c0094a0 con 0x7f097c09e870 2023-10-03T10:12:02.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.582+0000 7f097a59c700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0970000c00 tx=0x7f0970004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970004450 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097001f070 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0974009b30 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700038a0 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700094a0 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.583+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0970003a00 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.584+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0970021070 con 0x7f097c09e870 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.584+0000 7f0979d9b700 1 -- 172.21.15.125:0/3524048815 >> v1:172.21.15.125:6816/126957 conn(0x7f095c02f510 legacy=0x7f095c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:02.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.584+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c11be60 con 0x7f097c09e870 2023-10-03T10:12:02.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.588+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0970015070 con 0x7f097c09e870 2023-10-03T10:12:02.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.785+0000 7f0979d9b700 1 -- 172.21.15.125:0/3524048815 >> v1:172.21.15.125:6816/126957 conn(0x7f095c02f510 legacy=0x7f095c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:02.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.821+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f097c04f2a0 con 0x7f097c09e870 2023-10-03T10:12:02.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.822+0000 7f096affd700 1 -- 172.21.15.125:0/3524048815 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+70491 (secure 0 0 0) 0x7f09700045b0 con 0x7f097c09e870 2023-10-03T10:12:02.824 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:12:02.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 >> v1:172.21.15.125:6816/126957 conn(0x7f095c02f510 legacy=0x7f095c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 msgr2=0x7f097c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0970000c00 tx=0x7f0970004750 comp rx=0 tx=0).stop 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 shutdown_connections 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f097c131d70 0x7f097c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f097c09e870 0x7f097c06b880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 --2- 172.21.15.125:0/3524048815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f097c09f180 0x7f097c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.824+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 >> 172.21.15.125:0/3524048815 conn(0x7f097c0a4430 msgr2=0x7f097c131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.825+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 shutdown_connections 2023-10-03T10:12:02.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.825+0000 7f0980d4f700 1 -- 172.21.15.125:0/3524048815 wait complete. 2023-10-03T10:12:02.837 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":10,"active_gid":14180,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6816","nonce":126957}]},"active_addr":"172.21.15.125:6816/126957","active_change":"2023-10-03T10:11:29.983614+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":22,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":4213304626}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":595985394}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1534821931}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":3516620713}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":507713441}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":3204617686}]}]} 2023-10-03T10:12:02.840 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:02.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:02.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.960+0000 7f3711909700 1 Processor -- start 2023-10-03T10:12:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.960+0000 7f3711909700 1 -- start start 2023-10-03T10:12:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f3711909700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 0x7f370c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f3711909700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 0x7f370c13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f3711909700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c06bec0 con 0x7f370c09f180 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f3711909700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c06ce60 con 0x7f370c1343a0 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f3711909700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c09fa00 con 0x7f370c09e870 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 0x7f370c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 0x7f370c13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f370c09f180 0x7f370c133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57872/0 (socket says 172.21.15.125:57872) 2023-10-03T10:12:02.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370a7fc700 1 -- 172.21.15.125:0/2710923394 learned_addr learned my addr 172.21.15.125:0/2710923394 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 -- 172.21.15.125:0/2710923394 >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 msgr2=0x7f370c13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 --2- 172.21.15.125:0/2710923394 >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 0x7f370c13bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 -- 172.21.15.125:0/2710923394 >> v1:172.21.15.125:6789/0 conn(0x7f370c09f180 legacy=0x7f370c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 -- 172.21.15.125:0/2710923394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c09ad80 con 0x7f370c09e870 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370b7fe700 1 --2- 172.21.15.125:0/2710923394 >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 0x7f370c13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.961+0000 7f370affd700 1 --2- 172.21.15.125:0/2710923394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 0x7f370c09ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3700009840 tx=0x7f3700009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=208903cf848eed27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3709ffb700 1 -- 172.21.15.125:0/2710923394 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700011830 con 0x7f370c09e870 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3709ffb700 1 -- 172.21.15.125:0/2710923394 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3700011990 con 0x7f370c09e870 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3709ffb700 1 -- 172.21.15.125:0/2710923394 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700011d20 con 0x7f370c09e870 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 -- 172.21.15.125:0/2710923394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 msgr2=0x7f370c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 --2- 172.21.15.125:0/2710923394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 0x7f370c09ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3700009840 tx=0x7f3700009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 -- 172.21.15.125:0/2710923394 shutdown_connections 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 --2- 172.21.15.125:0/2710923394 >> v2:172.21.15.125:3300/0 conn(0x7f370c1343a0 0x7f370c13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 --2- 172.21.15.125:0/2710923394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c09e870 0x7f370c09ec40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 -- 172.21.15.125:0/2710923394 >> 172.21.15.125:0/2710923394 conn(0x7f370c0a4430 msgr2=0x7f370c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 -- 172.21.15.125:0/2710923394 shutdown_connections 2023-10-03T10:12:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.962+0000 7f3711909700 1 -- 172.21.15.125:0/2710923394 wait complete. 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.963+0000 7f3711909700 1 Processor -- start 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.963+0000 7f3711909700 1 -- start start 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f370c09f180 0x7f370c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 0x7f370c123500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c1260e0 con 0x7f370c09e870 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c06f8f0 con 0x7f370c1343a0 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f370c1262c0 con 0x7f370c09f180 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48660/0 (socket says 172.21.15.125:48660) 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 0x7f370c123500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 -- 172.21.15.125:0/601694332 learned_addr learned my addr 172.21.15.125:0/601694332 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370a7fc700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f370c09f180 0x7f370c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 -- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f370c09f180 msgr2=0x7f370c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f370c09f180 0x7f370c122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 -- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 msgr2=0x7f370c123500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 0x7f370c123500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 -- 172.21.15.125:0/601694332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009a70 con 0x7f370c09e870 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370b7fe700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 0x7f370c123500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f370affd700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f3700004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000045d0 con 0x7f370c09e870 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370001f070 con 0x7f370c09e870 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000094a0 con 0x7f370c09e870 2023-10-03T10:12:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000038e0 con 0x7f370c09e870 2023-10-03T10:12:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.964+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c1339d0 con 0x7f370c09e870 2023-10-03T10:12:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.965+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3700003a40 con 0x7f370c09e870 2023-10-03T10:12:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.965+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c04f2a0 con 0x7f370c09e870 2023-10-03T10:12:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.965+0000 7f370a7fc700 1 -- 172.21.15.125:0/601694332 >> v1:172.21.15.125:6816/126957 conn(0x7f36f802f510 legacy=0x7f36f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.965+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3700021070 con 0x7f370c09e870 2023-10-03T10:12:02.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:02.970+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3700015070 con 0x7f370c09e870 2023-10-03T10:12:03.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.152+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f370c072d60 con 0x7f370c09e870 2023-10-03T10:12:03.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.153+0000 7f36f3fff700 1 -- 172.21.15.125:0/601694332 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12997 (secure 0 0 0) 0x7f3700010380 con 0x7f370c09e870 2023-10-03T10:12:03.154 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:12:03.154 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:12:02.417823+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6817/582467044":"2023-10-04T10:11:56.371913+0000","172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:03.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 >> v1:172.21.15.125:6816/126957 conn(0x7f36f802f510 legacy=0x7f36f80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 msgr2=0x7f370c122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f3700004750 comp rx=0 tx=0).stop 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 shutdown_connections 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f370c1343a0 0x7f370c123500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f370c09e870 0x7f370c122a80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 --2- 172.21.15.125:0/601694332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f370c09f180 0x7f370c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 >> 172.21.15.125:0/601694332 conn(0x7f370c0a4430 msgr2=0x7f370c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 shutdown_connections 2023-10-03T10:12:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.155+0000 7f3711909700 1 -- 172.21.15.125:0/601694332 wait complete. 2023-10-03T10:12:03.168 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:03.168 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:03.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.287+0000 7fdc7c533700 1 Processor -- start 2023-10-03T10:12:03.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.287+0000 7fdc7c533700 1 -- start start 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 0x7fdc7409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc7409f180 0x7fdc74131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740a0920 con 0x7fdc7409f180 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7409c970 con 0x7fdc7409e870 2023-10-03T10:12:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7c533700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7409bab0 con 0x7fdc74131d70 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7a2cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 0x7fdc7409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc7409f180 0x7fdc74131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7aad0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc7409f180 0x7fdc74131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48664/0 (socket says 172.21.15.125:48664) 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7aad0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38422/0 (socket says 172.21.15.125:38422) 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7a2cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 0x7fdc7409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37524/0 (socket says 172.21.15.125:37524) 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 -- 172.21.15.125:0/48985257 learned_addr learned my addr 172.21.15.125:0/48985257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 -- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 msgr2=0x7fdc74132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 -- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 msgr2=0x7fdc7409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 0x7fdc7409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 -- 172.21.15.125:0/48985257 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7409f9c0 con 0x7fdc7409f180 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc7aad0700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.288+0000 7fdc79ace700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409f180 0x7fdc74131830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009920 tx=0x7fdc70009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92ad4bd5140f058 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc792cd700 1 -- 172.21.15.125:0/48985257 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011830 con 0x7fdc7409f180 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc792cd700 1 -- 172.21.15.125:0/48985257 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70011990 con 0x7fdc7409f180 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc792cd700 1 -- 172.21.15.125:0/48985257 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011d20 con 0x7fdc7409f180 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 -- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409f180 msgr2=0x7fdc74131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409f180 0x7fdc74131830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009920 tx=0x7fdc70009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 -- 172.21.15.125:0/48985257 shutdown_connections 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7409e870 0x7fdc7409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc74131d70 0x7fdc74132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 --2- 172.21.15.125:0/48985257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409f180 0x7fdc74131830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 -- 172.21.15.125:0/48985257 >> 172.21.15.125:0/48985257 conn(0x7fdc740a4430 msgr2=0x7fdc740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 -- 172.21.15.125:0/48985257 shutdown_connections 2023-10-03T10:12:03.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.289+0000 7fdc7c533700 1 -- 172.21.15.125:0/48985257 wait complete. 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.290+0000 7fdc7c533700 1 Processor -- start 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.290+0000 7fdc7c533700 1 -- start start 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc7409f180 0x7fdc74120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 0x7fdc74120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74123ef0 con 0x7fdc7409e870 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740a0210 con 0x7fdc74131d70 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74122820 con 0x7fdc7409f180 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48668/0 (socket says 172.21.15.125:48668) 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 -- 172.21.15.125:0/2453899910 learned_addr learned my addr 172.21.15.125:0/2453899910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc79ace700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc7409f180 0x7fdc74120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7aad0700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 0x7fdc74120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 -- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc7409f180 msgr2=0x7fdc74120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc7409f180 0x7fdc74120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 -- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 msgr2=0x7fdc74120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 0x7fdc74120e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 -- 172.21.15.125:0/2453899910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009a70 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7aad0700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 0x7fdc74120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7a2cf700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400e930 tx=0x7fdc6400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400c5e0 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400c740 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70009550 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400cad0 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.291+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc74131320 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.292+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdc6400cc30 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.292+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7404f2a0 con 0x7fdc7409e870 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.292+0000 7fdc79ace700 1 -- 172.21.15.125:0/2453899910 >> v1:172.21.15.125:6816/126957 conn(0x7fdc5802f510 legacy=0x7fdc580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.292+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdc6403ff80 con 0x7fdc7409e870 2023-10-03T10:12:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.297+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc64013990 con 0x7fdc7409e870 2023-10-03T10:12:03.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.485+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc74123a70 con 0x7fdc7409e870 2023-10-03T10:12:03.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.486+0000 7fdc6affd700 1 -- 172.21.15.125:0/2453899910 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12997 (secure 0 0 0) 0x7fdc74123a70 con 0x7fdc7409e870 2023-10-03T10:12:03.487 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:12:03.487 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:12:02.417823+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6817/582467044":"2023-10-04T10:11:56.371913+0000","172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 >> v1:172.21.15.125:6816/126957 conn(0x7fdc5802f510 legacy=0x7fdc580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 msgr2=0x7fdc741203d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400e930 tx=0x7fdc6400ec40 comp rx=0 tx=0).stop 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 shutdown_connections 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc74131d70 0x7fdc74120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7409e870 0x7fdc741203d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 --2- 172.21.15.125:0/2453899910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc7409f180 0x7fdc74120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 >> 172.21.15.125:0/2453899910 conn(0x7fdc740a4430 msgr2=0x7fdc7411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 shutdown_connections 2023-10-03T10:12:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.488+0000 7fdc7c533700 1 -- 172.21.15.125:0/2453899910 wait complete. 2023-10-03T10:12:03.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:03.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:03.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:03.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.631+0000 7efd6026f700 1 Processor -- start 2023-10-03T10:12:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 -- start start 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5809aaa0 con 0x7efd58130ce0 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5809f870 con 0x7efd5809e170 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd6026f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd5809b360 con 0x7efd5809d860 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5d80a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5e00b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5e00b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38444/0 (socket says 172.21.15.125:38444) 2023-10-03T10:12:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5e80c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efd58130ce0 0x7efd581379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57874/0 (socket says 172.21.15.125:57874) 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5e00b700 1 -- 172.21.15.125:0/1149355105 learned_addr learned my addr 172.21.15.125:0/1149355105 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.632+0000 7efd5d80a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37536/0 (socket says 172.21.15.125:37536) 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5e00b700 1 -- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 msgr2=0x7efd581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5e00b700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5e00b700 1 -- 172.21.15.125:0/1149355105 >> v1:172.21.15.125:6789/0 conn(0x7efd58130ce0 legacy=0x7efd581379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5e00b700 1 -- 172.21.15.125:0/1149355105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5809b620 con 0x7efd5809d860 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5d80a700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5e00b700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd54009920 tx=0x7efd54009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da1a45aa7d527e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5d009700 1 -- 172.21.15.125:0/1149355105 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011830 con 0x7efd5809d860 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5d009700 1 -- 172.21.15.125:0/1149355105 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011990 con 0x7efd5809d860 2023-10-03T10:12:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.633+0000 7efd5d009700 1 -- 172.21.15.125:0/1149355105 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011d20 con 0x7efd5809d860 2023-10-03T10:12:03.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7f9ab4c8e700 1 Processor -- start 2023-10-03T10:12:03.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 -- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 msgr2=0x7efd5809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd54009920 tx=0x7efd54009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:03.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7f9ab4c8e700 1 -- start start 2023-10-03T10:12:03.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 -- 172.21.15.125:0/1149355105 shutdown_connections 2023-10-03T10:12:03.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809d860 0x7efd5809dc30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 --2- 172.21.15.125:0/1149355105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809e170 0x7efd581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 -- 172.21.15.125:0/1149355105 >> 172.21.15.125:0/1149355105 conn(0x7efd58099c40 msgr2=0x7efd580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 -- 172.21.15.125:0/1149355105 shutdown_connections 2023-10-03T10:12:03.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.634+0000 7efd6026f700 1 -- 172.21.15.125:0/1149355105 wait complete. 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 0x7f9ab0130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ab009d8f0 0x7f9ab009dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab009c1f0 con 0x7f9ab009d8f0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab009b1f0 con 0x7f9ab009e280 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9ab4c8e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0131300 con 0x7f9ab01309f0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9aae59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 0x7f9ab0130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37546/0 (socket says 172.21.15.125:37546) 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.635+0000 7f9aaed9d700 1 -- 172.21.15.125:0/2525696380 learned_addr learned my addr 172.21.15.125:0/2525696380 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 -- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 msgr2=0x7f9ab0137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 -- 172.21.15.125:0/2525696380 >> v2:172.21.15.125:3300/0 conn(0x7f9ab009d8f0 msgr2=0x7f9ab009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 --2- 172.21.15.125:0/2525696380 >> v2:172.21.15.125:3300/0 conn(0x7f9ab009d8f0 0x7f9ab009dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 Processor -- start 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 -- 172.21.15.125:0/2525696380 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab009e6f0 con 0x7f9ab01309f0 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aaed9d700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 -- start start 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aae59c700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 0x7f9ab0130dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009820 tx=0x7f9aa0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3898bfc8867511 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aad59a700 1 -- 172.21.15.125:0/2525696380 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0005e30 con 0x7f9ab01309f0 2023-10-03T10:12:03.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aad59a700 1 -- 172.21.15.125:0/2525696380 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0006030 con 0x7f9ab01309f0 2023-10-03T10:12:03.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7f9aad59a700 1 -- 172.21.15.125:0/2525696380 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00063c0 con 0x7f9ab01309f0 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 0x7efd58126c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809e170 0x7efd581271a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd58130ce0 0x7efd581276e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5812a120 con 0x7efd58130ce0 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5806ed60 con 0x7efd5809d860 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd6026f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd5812b030 con 0x7efd5809e170 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd5e00b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 0x7efd58126c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.636+0000 7efd5e00b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 0x7efd58126c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37552/0 (socket says 172.21.15.125:37552) 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 -- 172.21.15.125:0/4079832949 learned_addr learned my addr 172.21.15.125:0/4079832949 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5d80a700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809e170 0x7efd581271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e80c700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd58130ce0 0x7efd581276e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 -- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809e170 msgr2=0x7efd581271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd5809e170 0x7efd581271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 -- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd58130ce0 msgr2=0x7efd581276e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd58130ce0 0x7efd581276e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 -- 172.21.15.125:0/4079832949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480094a0 con 0x7efd5809d860 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 msgr2=0x7f9ab0130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 0x7f9ab0130dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009820 tx=0x7f9aa0009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd5e00b700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 0x7efd58126c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd5809fa30 tx=0x7efd54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/2525696380 shutdown_connections 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009e280 0x7f9ab0137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 --2- 172.21.15.125:0/2525696380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab01309f0 0x7f9ab0130dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 --2- 172.21.15.125:0/2525696380 >> v2:172.21.15.125:3300/0 conn(0x7f9ab009d8f0 0x7f9ab009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/2525696380 >> 172.21.15.125:0/2525696380 conn(0x7f9ab00a2b30 msgr2=0x7f9ab009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54004510 con 0x7efd5809d860 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540036a0 con 0x7efd5809d860 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54003a10 con 0x7efd5809d860 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd54009550 con 0x7efd5809d860 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/2525696380 shutdown_connections 2023-10-03T10:12:03.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.637+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5809c8b0 con 0x7efd5809d860 2023-10-03T10:12:03.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.638+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd5809c090 con 0x7efd5809d860 2023-10-03T10:12:03.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.638+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/2525696380 wait complete. 2023-10-03T10:12:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.638+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efd54021070 con 0x7efd5809d860 2023-10-03T10:12:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.639+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efd54040f80 con 0x7efd5809d860 2023-10-03T10:12:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.639+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 --> v1:172.21.15.125:6804/130428 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd3c03c2e0 con 0x7efd3c0385e0 2023-10-03T10:12:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.639+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd54043610 con 0x7efd5809d860 2023-10-03T10:12:03.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 Processor -- start 2023-10-03T10:12:03.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7efd5d80a700 1 -- 172.21.15.125:0/4079832949 >> v1:172.21.15.125:6816/126957 conn(0x7efd3c02f510 legacy=0x7efd3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 -- start start 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 0x7f9ab01c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab009e280 0x7f9ab01c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 0x7f9ab01c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01ba010 con 0x7f9ab01309f0 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01b8960 con 0x7f9ab009d8f0 2023-10-03T10:12:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9ab4c8e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01b86b0 con 0x7f9ab009e280 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 0x7f9ab01c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 0x7f9ab01c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 0x7f9ab01c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37560/0 (socket says 172.21.15.125:37560) 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aaed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 0x7f9ab01c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48692/0 (socket says 172.21.15.125:48692) 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aae59c700 1 -- 172.21.15.125:0/3672010442 learned_addr learned my addr 172.21.15.125:0/3672010442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.640+0000 7f9aadd9b700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab009e280 0x7f9ab01c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 -- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab009e280 msgr2=0x7f9ab01c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab009e280 0x7f9ab01c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 -- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 msgr2=0x7f9ab01c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 0x7f9ab01c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 -- 172.21.15.125:0/3672010442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa800bd40 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aadd9b700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ab009e280 0x7f9ab01c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aae59c700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ab009d8f0 0x7f9ab01c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9aaed9d700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 0x7f9ab01c9250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8007e60 tx=0x7f9aa800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8010040 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8003a20 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0009430 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8003dd0 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.641+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab01ba710 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.642+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ab009bb50 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.642+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9aa800e880 con 0x7f9ab01309f0 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.642+0000 7f9aae59c700 1 -- 172.21.15.125:0/3672010442 >> v1:172.21.15.125:6816/126957 conn(0x7f9a9002f510 legacy=0x7f9a900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.642+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9aa80145a0 con 0x7f9ab01309f0 2023-10-03T10:12:03.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.643+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== osd.1 v1:172.21.15.125:6804/130428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7efd3c03c2e0 con 0x7efd3c0385e0 2023-10-03T10:12:03.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.643+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 --> v1:172.21.15.125:6808/130560 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a9003c1e0 con 0x7f9a900384e0 2023-10-03T10:12:03.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.643+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa801d770 con 0x7f9ab01309f0 2023-10-03T10:12:03.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.644+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== osd.2 v1:172.21.15.125:6808/130560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f9a9003c1e0 con 0x7f9a900384e0 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.648+0000 7f3b3f17d700 1 Processor -- start 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.648+0000 7f3b3f17d700 1 -- start start 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 0x7f3b3809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b38130890 0x7f3b38130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3809bf50 con 0x7f3b38130890 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38099a60 con 0x7f3b3809a730 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3f17d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3809b230 con 0x7f3b38099e20 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3d71a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b38130890 0x7f3b38130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37572/0 (socket says 172.21.15.125:37572) 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 -- 172.21.15.125:0/965751545 learned_addr learned my addr 172.21.15.125:0/965751545 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3cf19700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 0x7f3b3809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 -- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 msgr2=0x7f3b3809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 0x7f3b3809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 -- 172.21.15.125:0/965751545 >> v2:172.21.15.125:3300/0 conn(0x7f3b38130890 msgr2=0x7f3b38130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 --2- 172.21.15.125:0/965751545 >> v2:172.21.15.125:3300/0 conn(0x7f3b38130890 0x7f3b38130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 -- 172.21.15.125:0/965751545 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3809bb90 con 0x7f3b3809a730 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b3cf19700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 0x7f3b3809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.649+0000 7f3b37fff700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009920 tx=0x7f3b24009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=503d4aef0f114efd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f3b377fe700 1 -- 172.21.15.125:0/965751545 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011830 con 0x7f3b3809a730 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f3b377fe700 1 -- 172.21.15.125:0/965751545 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24011990 con 0x7f3b3809a730 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f3b377fe700 1 -- 172.21.15.125:0/965751545 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011d00 con 0x7f3b3809a730 2023-10-03T10:12:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f6dc4714700 1 Processor -- start 2023-10-03T10:12:03.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f6dc4714700 1 -- start start 2023-10-03T10:12:03.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f3b3f17d700 1 -- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 msgr2=0x7f3b38130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.650+0000 7f3b3f17d700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009920 tx=0x7f3b24009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:03.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 -- 172.21.15.125:0/965751545 shutdown_connections 2023-10-03T10:12:03.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 --2- 172.21.15.125:0/965751545 >> v2:172.21.15.125:3300/0 conn(0x7f3b38130890 0x7f3b38130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b38099e20 0x7f3b3809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 --2- 172.21.15.125:0/965751545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3809a730 0x7f3b38130350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 -- 172.21.15.125:0/965751545 >> 172.21.15.125:0/965751545 conn(0x7f3b380a2980 msgr2=0x7f3b380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 -- 172.21.15.125:0/965751545 shutdown_connections 2023-10-03T10:12:03.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f3b3f17d700 1 -- 172.21.15.125:0/965751545 wait complete. 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc4714700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc4714700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6dbc09e410 0x7f6dbc13b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc4714700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc09acf0 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc4714700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc09aa30 con 0x7f6dbc09e410 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc4714700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc099870 con 0x7f6dbc09e000 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38484/0 (socket says 172.21.15.125:38484) 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 -- 172.21.15.125:0/86641667 learned_addr learned my addr 172.21.15.125:0/86641667 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 -- 172.21.15.125:0/86641667 >> v2:172.21.15.125:3300/0 conn(0x7f6dbc09e410 msgr2=0x7f6dbc13b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 --2- 172.21.15.125:0/86641667 >> v2:172.21.15.125:3300/0 conn(0x7f6dbc09e410 0x7f6dbc13b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 -- 172.21.15.125:0/86641667 >> v1:172.21.15.125:6789/0 conn(0x7f6dbc09f0f0 legacy=0x7f6dbc09d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 -- 172.21.15.125:0/86641667 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc09c2a0 con 0x7f6dbc09e000 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.651+0000 7f6dc1caf700 1 --2- 172.21.15.125:0/86641667 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098f0 tx=0x7f6dac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738a640db735d4cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc14ae700 1 -- 172.21.15.125:0/86641667 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004230 con 0x7f6dbc09e000 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc14ae700 1 -- 172.21.15.125:0/86641667 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac004390 con 0x7f6dbc09e000 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc14ae700 1 -- 172.21.15.125:0/86641667 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0036a0 con 0x7f6dbc09e000 2023-10-03T10:12:03.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f3b3f17d700 1 Processor -- start 2023-10-03T10:12:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f3b3f17d700 1 -- start start 2023-10-03T10:12:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 -- 172.21.15.125:0/86641667 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 msgr2=0x7f6dbc1390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 --2- 172.21.15.125:0/86641667 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098f0 tx=0x7f6dac009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 -- 172.21.15.125:0/86641667 shutdown_connections 2023-10-03T10:12:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 --2- 172.21.15.125:0/86641667 >> v2:172.21.15.125:3300/0 conn(0x7f6dbc09e410 0x7f6dbc13b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 --2- 172.21.15.125:0/86641667 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e000 0x7f6dbc1390a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.652+0000 7f6dc4714700 1 -- 172.21.15.125:0/86641667 >> 172.21.15.125:0/86641667 conn(0x7f6dbc0a2b30 msgr2=0x7f6dbc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f6dc4714700 1 -- 172.21.15.125:0/86641667 shutdown_connections 2023-10-03T10:12:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f6dc4714700 1 -- 172.21.15.125:0/86641667 wait complete. 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b38099e20 0x7f3b38133290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 0x7f3b381337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b38130890 0x7f3b38133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38135260 con 0x7f3b38130890 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3812de70 con 0x7f3b38099e20 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b3f17d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38119530 con 0x7f3b3809a730 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 0x7f3b381337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 0x7f3b381337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38486/0 (socket says 172.21.15.125:38486) 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 -- 172.21.15.125:0/3215227432 learned_addr learned my addr 172.21.15.125:0/3215227432 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 -- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b38099e20 msgr2=0x7f3b38133290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 --2- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b38099e20 0x7f3b38133290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 -- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b38130890 msgr2=0x7f3b38133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 --2- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b38130890 0x7f3b38133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.653+0000 7f3b37fff700 1 -- 172.21.15.125:0/3215227432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009550 con 0x7f3b3809a730 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b37fff700 1 --2- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 0x7f3b381337d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009c70 tx=0x7f3b24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24004380 con 0x7f3b3809a730 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f6dc4714700 1 Processor -- start 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f6dc4714700 1 -- start start 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 0x7f6dbc08f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e410 0x7f6dbc08f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc09f0f0 0x7f6dbc08fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0a1c30 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0923f0 con 0x7f6dbc09e000 2023-10-03T10:12:03.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc4714700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc09a080 con 0x7f6dbc09e410 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2401f070 con 0x7f3b3809a730 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240036a0 con 0x7f3b3809a730 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b380a1190 con 0x7f3b3809a730 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.654+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38119250 con 0x7f3b3809a730 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b38135750 con 0x7f3b3809a730 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc24b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 0x7f6dbc08f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc24b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 0x7f6dbc08f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37580/0 (socket says 172.21.15.125:37580) 2023-10-03T10:12:03.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc09f0f0 0x7f6dbc08fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc24b0700 1 -- 172.21.15.125:0/4098556137 learned_addr learned my addr 172.21.15.125:0/4098556137 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc1caf700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e410 0x7f6dbc08f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 -- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e410 msgr2=0x7f6dbc08f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6dbc09e410 0x7f6dbc08f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 -- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 msgr2=0x7f6dbc08f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 0x7f6dbc08f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc2cb1700 1 -- 172.21.15.125:0/4098556137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009550 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f6dc24b0700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6dbc09e000 0x7f6dbc08f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.655+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3b24021030 con 0x7f3b3809a730 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f3b3cf19700 1 -- 172.21.15.125:0/3215227432 >> v1:172.21.15.125:6816/126957 conn(0x7f3b1c02f510 legacy=0x7f3b1c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3b24040e30 con 0x7f3b3809a730 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6dc2cb1700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc09f0f0 0x7f6dbc08fe80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a430 tx=0x7f6db400a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 --> v1:172.21.15.125:6812/130878 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b1c03c360 con 0x7f3b1c038660 2023-10-03T10:12:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b240433d0 con 0x7f3b3809a730 2023-10-03T10:12:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4025b30 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400d050 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400f510 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc090e50 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.656+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc092970 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.657+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dbc0993e0 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== osd.3 v1:172.21.15.125:6812/130878 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f3b1c03c360 con 0x7f3b1c038660 2023-10-03T10:12:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6db400f670 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6db4006e40 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f6dc24b0700 1 -- 172.21.15.125:0/4098556137 >> v1:172.21.15.125:6816/126957 conn(0x7f6da002f510 legacy=0x7f6da00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 --> v1:172.21.15.125:6800/130330 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6da003c2e0 con 0x7f6da00385e0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.658+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6db4051bb0 con 0x7f6dbc09f0f0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.659+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== osd.0 v1:172.21.15.125:6800/130330 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f6da003c2e0 con 0x7f6da00385e0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 --> v1:172.21.15.125:6804/130428 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd5809c5a0 con 0x7efd3c0385e0 2023-10-03T10:12:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd4effd700 1 -- 172.21.15.125:0/4079832949 <== osd.1 v1:172.21.15.125:6804/130428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7efd50001a10 con 0x7efd3c0385e0 2023-10-03T10:12:03.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 >> v1:172.21.15.125:6804/130428 conn(0x7efd3c0385e0 legacy=0x7efd3c03aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 >> v1:172.21.15.125:6816/126957 conn(0x7efd3c02f510 legacy=0x7efd3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 msgr2=0x7efd58126c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.662+0000 7efd6026f700 1 --2- 172.21.15.125:0/4079832949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd5809d860 0x7efd58126c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd5809fa30 tx=0x7efd54004750 comp rx=0 tx=0).stop 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.663+0000 7efd5e80c700 1 -- 172.21.15.125:0/4079832949 reap_dead start 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.663+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 shutdown_connections 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.663+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 >> 172.21.15.125:0/4079832949 conn(0x7efd58099c40 msgr2=0x7efd580720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.663+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 --> v1:172.21.15.125:6808/130560 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ab01305a0 con 0x7f9a900384e0 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.664+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 shutdown_connections 2023-10-03T10:12:03.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.664+0000 7efd6026f700 1 -- 172.21.15.125:0/4079832949 wait complete. 2023-10-03T10:12:03.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.664+0000 7f9a9effd700 1 -- 172.21.15.125:0/3672010442 <== osd.2 v1:172.21.15.125:6808/130560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7f9aa4009730 con 0x7f9a900384e0 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.664+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 >> v1:172.21.15.125:6808/130560 conn(0x7f9a900384e0 legacy=0x7f9a9003a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 >> v1:172.21.15.125:6816/126957 conn(0x7f9a9002f510 legacy=0x7f9a900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 msgr2=0x7f9ab01c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 --2- 172.21.15.125:0/3672010442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab01309f0 0x7f9ab01c9250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8007e60 tx=0x7f9aa800e3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9aaed9d700 1 -- 172.21.15.125:0/3672010442 reap_dead start 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 shutdown_connections 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 >> 172.21.15.125:0/3672010442 conn(0x7f9ab00a2b30 msgr2=0x7f9ab009fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 shutdown_connections 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.665+0000 7f9ab4c8e700 1 -- 172.21.15.125:0/3672010442 wait complete. 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.674+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 --> v1:172.21.15.125:6812/130878 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b38066680 con 0x7f3b1c038660 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.675+0000 7f3b357fa700 1 -- 172.21.15.125:0/3215227432 <== osd.3 v1:172.21.15.125:6812/130878 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4282407164) 0x7f3b30007330 con 0x7f3b1c038660 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.675+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 >> v1:172.21.15.125:6812/130878 conn(0x7f3b1c038660 legacy=0x7f3b1c03aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 >> v1:172.21.15.125:6816/126957 conn(0x7f3b1c02f510 legacy=0x7f3b1c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 msgr2=0x7f3b381337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 --2- 172.21.15.125:0/3215227432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b3809a730 0x7f3b381337d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009c70 tx=0x7f3b24004750 comp rx=0 tx=0).stop 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3d71a700 1 -- 172.21.15.125:0/3215227432 reap_dead start 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 shutdown_connections 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 >> 172.21.15.125:0/3215227432 conn(0x7f3b380a2980 msgr2=0x7f3b3812f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 shutdown_connections 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f3b3f17d700 1 -- 172.21.15.125:0/3215227432 wait complete. 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 --> v1:172.21.15.125:6800/130330 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6dbc09bbb0 con 0x7f6da00385e0 2023-10-03T10:12:03.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.676+0000 7f6db2ffd700 1 -- 172.21.15.125:0/4098556137 <== osd.0 v1:172.21.15.125:6800/130330 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7f6dac0045e0 con 0x7f6da00385e0 2023-10-03T10:12:03.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 >> v1:172.21.15.125:6800/130330 conn(0x7f6da00385e0 legacy=0x7f6da003aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 >> v1:172.21.15.125:6816/126957 conn(0x7f6da002f510 legacy=0x7f6da00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc09f0f0 msgr2=0x7f6dbc08fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 --2- 172.21.15.125:0/4098556137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dbc09f0f0 0x7f6dbc08fe80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a430 tx=0x7f6db400a740 comp rx=0 tx=0).stop 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc2cb1700 1 -- 172.21.15.125:0/4098556137 reap_dead start 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 shutdown_connections 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 >> 172.21.15.125:0/4098556137 conn(0x7f6dbc0a2b30 msgr2=0x7f6dbc136100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 shutdown_connections 2023-10-03T10:12:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.677+0000 7f6dc4714700 1 -- 172.21.15.125:0/4098556137 wait complete. 2023-10-03T10:12:03.683 INFO:teuthology.orchestra.run.smithi125.stdout:137438953476 2023-10-03T10:12:03.683 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:03.684 INFO:teuthology.orchestra.run.smithi125.stdout:133143986180 2023-10-03T10:12:03.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:03.689 INFO:teuthology.orchestra.run.smithi125.stdout:141733920772 2023-10-03T10:12:03.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:03.691 INFO:teuthology.orchestra.run.smithi125.stdout:128849018884 2023-10-03T10:12:03.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:03.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.829+0000 7f11cb476700 1 Processor -- start 2023-10-03T10:12:03.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.829+0000 7f11cb476700 1 -- start start 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.829+0000 7f11cb476700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 0x7f11c409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11cb476700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4130eb0 0x7f11c4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11cb476700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c409aaa0 con 0x7f11c409e170 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11cb476700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c409f870 con 0x7f11c409d860 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11cb476700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c409b360 con 0x7f11c4130eb0 2023-10-03T10:12:03.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 0x7f11c409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c8a11700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f11c409e170 0x7f11c41307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57892/0 (socket says 172.21.15.125:57892) 2023-10-03T10:12:03.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c8a11700 1 -- 172.21.15.125:0/668657523 learned_addr learned my addr 172.21.15.125:0/668657523 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:03.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9a13700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4130eb0 0x7f11c4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11bbfff700 1 -- 172.21.15.125:0/668657523 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095194772 0 0) 0x7f11c409aaa0 con 0x7f11c409e170 2023-10-03T10:12:03.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 -- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4130eb0 msgr2=0x7f11c4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4130eb0 0x7f11c4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 -- 172.21.15.125:0/668657523 >> v1:172.21.15.125:6789/0 conn(0x7f11c409e170 legacy=0x7f11c41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 -- 172.21.15.125:0/668657523 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c409b620 con 0x7f11c409d860 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.830+0000 7f11c9212700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 0x7f11c409dc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11c000bb10 tx=0x7f11c000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e06d73c2e209aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11bbfff700 1 -- 172.21.15.125:0/668657523 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000dc70 con 0x7f11c409d860 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11bbfff700 1 -- 172.21.15.125:0/668657523 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000ddd0 con 0x7f11c409d860 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11bbfff700 1 -- 172.21.15.125:0/668657523 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0010690 con 0x7f11c409d860 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 -- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 msgr2=0x7f11c409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 0x7f11c409dc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11c000bb10 tx=0x7f11c000be20 comp rx=0 tx=0).stop 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 -- 172.21.15.125:0/668657523 shutdown_connections 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4130eb0 0x7f11c4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 --2- 172.21.15.125:0/668657523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409d860 0x7f11c409dc30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.831+0000 7f11cb476700 1 -- 172.21.15.125:0/668657523 >> 172.21.15.125:0/668657523 conn(0x7f11c4099c40 msgr2=0x7f11c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.832+0000 7f11cb476700 1 -- 172.21.15.125:0/668657523 shutdown_connections 2023-10-03T10:12:03.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.832+0000 7f11cb476700 1 -- 172.21.15.125:0/668657523 wait complete. 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.833+0000 7f11cb476700 1 Processor -- start 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.833+0000 7f11cb476700 1 -- start start 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.833+0000 7f11cb476700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409d860 0x7f11c4122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.833+0000 7f11cb476700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 0x7f11c4122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11cb476700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 0x7f11c4123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11cb476700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4125eb0 con 0x7f11c409d860 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11cb476700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c409c8b0 con 0x7f11c4130eb0 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11cb476700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4124390 con 0x7f11c409e170 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 0x7f11c4123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 0x7f11c4122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 0x7f11c4123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37602/0 (socket says 172.21.15.125:37602) 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c9a13700 1 -- 172.21.15.125:0/1274181928 learned_addr learned my addr 172.21.15.125:0/1274181928 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c9212700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409d860 0x7f11c4122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 -- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 msgr2=0x7f11c4123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 0x7f11c4123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 -- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409d860 msgr2=0x7f11c4122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409d860 0x7f11c4122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 -- 172.21.15.125:0/1274181928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c000b740 con 0x7f11c409e170 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11c8a11700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 0x7f11c4122c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11c409a100 tx=0x7f11b400c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.834+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004c80 con 0x7f11c409e170 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.835+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c40a07f0 con 0x7f11c409e170 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.835+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4004de0 con 0x7f11c409e170 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.835+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40072d0 con 0x7f11c409e170 2023-10-03T10:12:03.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.835+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c4126920 con 0x7f11c409e170 2023-10-03T10:12:03.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.836+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c404f2a0 con 0x7f11c409e170 2023-10-03T10:12:03.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.836+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f11b4007430 con 0x7f11c409e170 2023-10-03T10:12:03.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.837+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f11b403f550 con 0x7f11c409e170 2023-10-03T10:12:03.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.837+0000 7f11c9212700 1 -- 172.21.15.125:0/1274181928 >> v1:172.21.15.125:6816/126957 conn(0x7f11a802f510 legacy=0x7f11a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.845+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11b40076e0 con 0x7f11c409e170 2023-10-03T10:12:03.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.859+0000 7fa724ee7700 1 Processor -- start 2023-10-03T10:12:03.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.859+0000 7fa724ee7700 1 -- start start 2023-10-03T10:12:03.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.859+0000 7ff16a4dc700 1 Processor -- start 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.859+0000 7ff16a4dc700 1 -- start start 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff16a4dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 0x7ff1640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa724ee7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa720136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa724ee7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa724ee7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72009b6d0 con 0x7fa72009e950 2023-10-03T10:12:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa724ee7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72009afb0 con 0x7fa720137010 2023-10-03T10:12:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff16a4dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 0x7ff16412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa724ee7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200a0970 con 0x7fa72009f430 2023-10-03T10:12:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa72009e950 0x7fa72009ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57900/0 (socket says 172.21.15.125:57900) 2023-10-03T10:12:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71e59c700 1 -- 172.21.15.125:0/3475495831 learned_addr learned my addr 172.21.15.125:0/3475495831 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa720136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71ed9d700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71dd9b700 1 -- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 msgr2=0x7fa7201393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71dd9b700 1 -- 172.21.15.125:0/3475495831 >> v1:172.21.15.125:6789/0 conn(0x7fa72009e950 legacy=0x7fa72009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7fa71dd9b700 1 -- 172.21.15.125:0/3475495831 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200a0320 con 0x7fa72009f430 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff16a4dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1640a1e70 con 0x7ff1641304a0 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff16a4dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16409a720 con 0x7ff1640a1340 2023-10-03T10:12:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff16a4dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff16409b300 con 0x7ff1640a0a30 2023-10-03T10:12:03.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff163fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 0x7ff1640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff168a79700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff1641304a0 0x7ff1641371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57902/0 (socket says 172.21.15.125:57902) 2023-10-03T10:12:03.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.860+0000 7ff168a79700 1 -- 172.21.15.125:0/2224723356 learned_addr learned my addr 172.21.15.125:0/2224723356 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:03.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa720136ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7140098a0 tx=0x7fa714009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7872c1898a70835 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7fa71d59a700 1 -- 172.21.15.125:0/3475495831 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011830 con 0x7fa72009f430 2023-10-03T10:12:03.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7fa71d59a700 1 -- 172.21.15.125:0/3475495831 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa714011990 con 0x7fa72009f430 2023-10-03T10:12:03.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7fa71d59a700 1 -- 172.21.15.125:0/3475495831 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011d20 con 0x7fa72009f430 2023-10-03T10:12:03.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff163fff700 1 -- 172.21.15.125:0/2224723356 >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 msgr2=0x7ff16412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff1637fe700 1 --2- 172.21.15.125:0/2224723356 >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 0x7ff16412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff162ffd700 1 -- 172.21.15.125:0/2224723356 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779829004 0 0) 0x7ff1640a1e70 con 0x7ff1641304a0 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff163fff700 1 --2- 172.21.15.125:0/2224723356 >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 0x7ff16412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff163fff700 1 -- 172.21.15.125:0/2224723356 >> v1:172.21.15.125:6789/0 conn(0x7ff1641304a0 legacy=0x7ff1641371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.861+0000 7ff163fff700 1 -- 172.21.15.125:0/2224723356 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16409abc0 con 0x7ff1640a0a30 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7ff1637fe700 1 --2- 172.21.15.125:0/2224723356 >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 0x7ff16412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:03.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7ff163fff700 1 --2- 172.21.15.125:0/2224723356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 0x7ff1640a0e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009d70 tx=0x7ff15c00e430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e83827e5dcc3e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 -- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 msgr2=0x7fa720136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa720136ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7140098a0 tx=0x7fa714009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7ff162ffd700 1 -- 172.21.15.125:0/2224723356 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0133f0 con 0x7ff1640a0a30 2023-10-03T10:12:03.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7ff162ffd700 1 -- 172.21.15.125:0/2224723356 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c013550 con 0x7ff1640a0a30 2023-10-03T10:12:03.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7ff162ffd700 1 -- 172.21.15.125:0/2224723356 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0138e0 con 0x7ff1640a0a30 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 -- 172.21.15.125:0/3475495831 shutdown_connections 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 --2- 172.21.15.125:0/3475495831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa720136ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 -- 172.21.15.125:0/3475495831 >> 172.21.15.125:0/3475495831 conn(0x7fa7200a0f70 msgr2=0x7fa7200a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 -- 172.21.15.125:0/3475495831 shutdown_connections 2023-10-03T10:12:03.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.862+0000 7fa724ee7700 1 -- 172.21.15.125:0/3475495831 wait complete. 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 -- 172.21.15.125:0/2224723356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 msgr2=0x7ff1640a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/2224723356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 0x7ff1640a0e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009d70 tx=0x7ff15c00e430 comp rx=0 tx=0).stop 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 -- 172.21.15.125:0/2224723356 shutdown_connections 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/2224723356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1640a0a30 0x7ff1640a0e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/2224723356 >> v2:172.21.15.125:3300/0 conn(0x7ff1640a1340 0x7ff16412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 -- 172.21.15.125:0/2224723356 >> 172.21.15.125:0/2224723356 conn(0x7ff1640a2980 msgr2=0x7ff1640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 -- 172.21.15.125:0/2224723356 shutdown_connections 2023-10-03T10:12:03.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7ff16a4dc700 1 -- 172.21.15.125:0/2224723356 wait complete. 2023-10-03T10:12:03.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7fa724ee7700 1 Processor -- start 2023-10-03T10:12:03.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.863+0000 7fa724ee7700 1 -- start start 2023-10-03T10:12:03.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa72006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72009dad0 con 0x7fa72009e950 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720132320 con 0x7fa720137010 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa724ee7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72006be80 con 0x7fa72009f430 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa72006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48766/0 (socket says 172.21.15.125:48766) 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71e59c700 1 -- 172.21.15.125:0/1978003472 learned_addr learned my addr 172.21.15.125:0/1978003472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7ff16a4dc700 1 Processor -- start 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 -- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 msgr2=0x7fa7201c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 -- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 msgr2=0x7fa72006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.864+0000 7fa71dd9b700 1 -- 172.21.15.125:0/1978003472 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140094a0 con 0x7fa72009f430 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7fa71e59c700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7fa71dd9b700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa72006c940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa714016000 tx=0x7fa714004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 -- start start 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1640a0a30 0x7ff16411ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 0x7ff16411bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16411e5c0 con 0x7ff1640a1340 2023-10-03T10:12:03.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16412f940 con 0x7ff1640a0a30 2023-10-03T10:12:03.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff16a4dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff16411b470 con 0x7ff1641304a0 2023-10-03T10:12:03.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff168a79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714004240 con 0x7fa72009f430 2023-10-03T10:12:03.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71401f070 con 0x7fa72009f430 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72006d3d0 con 0x7fa72009f430 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140045a0 con 0x7fa72009f430 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7201221e0 con 0x7fa72009f430 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff168a79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38572/0 (socket says 172.21.15.125:38572) 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff168a79700 1 -- 172.21.15.125:0/4018190532 learned_addr learned my addr 172.21.15.125:0/4018190532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.865+0000 7ff163fff700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1640a0a30 0x7ff16411ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff1637fe700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 0x7ff16411bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 -- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1640a0a30 msgr2=0x7ff16411ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1640a0a30 0x7ff16411ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 -- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 msgr2=0x7ff16411bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 0x7ff16411bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 -- 172.21.15.125:0/4018190532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009980 con 0x7ff1641304a0 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff1637fe700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 0x7ff16411bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.866+0000 7ff168a79700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1540011e0 tx=0x7ff15400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400cea0 con 0x7ff1641304a0 2023-10-03T10:12:03.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72004f2a0 con 0x7fa72009f430 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa714021030 con 0x7fa72009f430 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa714040b90 con 0x7fa72009f430 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154015070 con 0x7ff1641304a0 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154004e80 con 0x7ff1641304a0 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16411e7f0 con 0x7ff1641304a0 2023-10-03T10:12:03.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.867+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16409f910 con 0x7ff1641304a0 2023-10-03T10:12:03.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.868+0000 7fa71e59c700 1 -- 172.21.15.125:0/1978003472 >> v1:172.21.15.125:6816/126957 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.868+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1440052e0 con 0x7ff1641304a0 2023-10-03T10:12:03.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.872+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa714003e00 con 0x7fa72009f430 2023-10-03T10:12:03.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.873+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff1540070d0 con 0x7ff1641304a0 2023-10-03T10:12:03.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.873+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff1540438d0 con 0x7ff1641304a0 2023-10-03T10:12:03.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.873+0000 7ff163fff700 1 -- 172.21.15.125:0/4018190532 >> v1:172.21.15.125:6816/126957 conn(0x7ff15002f510 legacy=0x7ff1500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.873+0000 7f9d44e79700 1 Processor -- start 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.873+0000 7f9d44e79700 1 -- start start 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d44e79700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d400a1550 0x7f9d40138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d44e79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 0x7f9d4013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d44e79700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4009e9d0 con 0x7f9d400a0a70 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d44e79700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4009dc00 con 0x7f9d400a1550 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d44e79700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4009dec0 con 0x7f9d40139200 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d3ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 0x7f9d4013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d3e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d400a0a70 0x7f9d400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57912/0 (socket says 172.21.15.125:57912) 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.874+0000 7f9d3e59c700 1 -- 172.21.15.125:0/1384192657 learned_addr learned my addr 172.21.15.125:0/1384192657 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3d59a700 1 -- 172.21.15.125:0/1384192657 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919603697 0 0) 0x7f9d4009e9d0 con 0x7f9d400a0a70 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3d59a700 1 -- 172.21.15.125:0/1384192657 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035b0 con 0x7f9d400a0a70 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/1384192657 >> v2:172.21.15.125:3300/0 conn(0x7f9d400a1550 msgr2=0x7f9d40138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3ed9d700 1 --2- 172.21.15.125:0/1384192657 >> v2:172.21.15.125:3300/0 conn(0x7f9d400a1550 0x7f9d40138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/1384192657 >> v1:172.21.15.125:6789/0 conn(0x7f9d400a0a70 legacy=0x7f9d400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/1384192657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4009e6a0 con 0x7f9d40139200 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.875+0000 7f9d3ed9d700 1 --2- 172.21.15.125:0/1384192657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 0x7f9d4013b5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a82972e7d1ee8f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.877+0000 7f9d3d59a700 1 -- 172.21.15.125:0/1384192657 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800e070 con 0x7f9d40139200 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.877+0000 7f9d3d59a700 1 -- 172.21.15.125:0/1384192657 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800bb20 con 0x7f9d40139200 2023-10-03T10:12:03.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.877+0000 7f9d3d59a700 1 -- 172.21.15.125:0/1384192657 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38012430 con 0x7f9d40139200 2023-10-03T10:12:03.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.877+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff154011560 con 0x7ff1641304a0 2023-10-03T10:12:03.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 -- 172.21.15.125:0/1384192657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 msgr2=0x7f9d4013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 --2- 172.21.15.125:0/1384192657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 0x7f9d4013b5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:03.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 -- 172.21.15.125:0/1384192657 shutdown_connections 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 --2- 172.21.15.125:0/1384192657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d40139200 0x7f9d4013b5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 --2- 172.21.15.125:0/1384192657 >> v2:172.21.15.125:3300/0 conn(0x7f9d400a1550 0x7f9d40138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 -- 172.21.15.125:0/1384192657 >> 172.21.15.125:0/1384192657 conn(0x7f9d400a6610 msgr2=0x7f9d400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 -- 172.21.15.125:0/1384192657 shutdown_connections 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.878+0000 7f9d44e79700 1 -- 172.21.15.125:0/1384192657 wait complete. 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.879+0000 7f9d44e79700 1 Processor -- start 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 -- start start 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d401217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1550 0x7f9d40121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40121280 con 0x7f9d400a0a70 2023-10-03T10:12:03.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40124270 con 0x7f9d40139200 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d44e79700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40124910 con 0x7f9d400a1550 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d3ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d3ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37634/0 (socket says 172.21.15.125:37634) 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/2182768723 learned_addr learned my addr 172.21.15.125:0/2182768723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.880+0000 7f9d3e59c700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d401217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1550 msgr2=0x7f9d40121d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1550 0x7f9d40121d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 msgr2=0x7f9d401217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d401217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 -- 172.21.15.125:0/2182768723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009a70 con 0x7f9d40139200 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3e59c700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d401217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d3ed9d700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d38013000 tx=0x7f9d38004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38004830 con 0x7f9d40139200 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38020070 con 0x7f9d40139200 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40122890 con 0x7f9d40139200 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380276c0 con 0x7f9d40139200 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.881+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d400a03e0 con 0x7f9d40139200 2023-10-03T10:12:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.883+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4006ccf0 con 0x7f9d40139200 2023-10-03T10:12:03.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.887+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9d38031430 con 0x7f9d40139200 2023-10-03T10:12:03.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.887+0000 7f9d3e59c700 1 -- 172.21.15.125:0/2182768723 >> v1:172.21.15.125:6816/126957 conn(0x7f9d2002f510 legacy=0x7f9d200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:03.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.887+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9d38022070 con 0x7f9d40139200 2023-10-03T10:12:03.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:03.892+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d38012430 con 0x7f9d40139200 2023-10-03T10:12:04.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.038+0000 7f11c9212700 1 -- 172.21.15.125:0/1274181928 >> v1:172.21.15.125:6816/126957 conn(0x7f11a802f510 legacy=0x7f11a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:04.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.046+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11c406c3b0 con 0x7f11c409e170 2023-10-03T10:12:04.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.047+0000 7f11b9ffb700 1 -- 172.21.15.125:0/1274181928 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11b401c3a0 con 0x7f11c409e170 2023-10-03T10:12:04.047 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:04.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 >> v1:172.21.15.125:6816/126957 conn(0x7f11a802f510 legacy=0x7f11a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:04.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 msgr2=0x7f11c4122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 0x7f11c4122c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11c409a100 tx=0x7f11b400c750 comp rx=0 tx=0).stop 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 shutdown_connections 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4130eb0 0x7f11c4123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409d860 0x7f11c4122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 --2- 172.21.15.125:0/1274181928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c409e170 0x7f11c4122c50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 >> 172.21.15.125:0/1274181928 conn(0x7f11c4099c40 msgr2=0x7f11c40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 shutdown_connections 2023-10-03T10:12:04.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.050+0000 7f11cb476700 1 -- 172.21.15.125:0/1274181928 wait complete. 2023-10-03T10:12:04.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:04.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.069+0000 7fa71e59c700 1 -- 172.21.15.125:0/1978003472 >> v1:172.21.15.125:6816/126957 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.073+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff144005860 con 0x7ff1641304a0 2023-10-03T10:12:04.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.073+0000 7ff160ff9700 1 -- 172.21.15.125:0/4018190532 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff154029090 con 0x7ff1641304a0 2023-10-03T10:12:04.074 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:04.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.074+0000 7ff163fff700 1 -- 172.21.15.125:0/4018190532 >> v1:172.21.15.125:6816/126957 conn(0x7ff15002f510 legacy=0x7ff1500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.075+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 >> v1:172.21.15.125:6816/126957 conn(0x7ff15002f510 legacy=0x7ff1500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.075+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 msgr2=0x7ff1641c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1540011e0 tx=0x7ff15400c800 comp rx=0 tx=0).stop 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 shutdown_connections 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1641304a0 0x7ff1641c3b70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1640a0a30 0x7ff16411ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 --2- 172.21.15.125:0/4018190532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1640a1340 0x7ff16411bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 >> 172.21.15.125:0/4018190532 conn(0x7ff1640a2980 msgr2=0x7ff1641b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 shutdown_connections 2023-10-03T10:12:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.076+0000 7ff16a4dc700 1 -- 172.21.15.125:0/4018190532 wait complete. 2023-10-03T10:12:04.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:04.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.088+0000 7f9d3e59c700 1 -- 172.21.15.125:0/2182768723 >> v1:172.21.15.125:6816/126957 conn(0x7f9d2002f510 legacy=0x7f9d200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:04.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.092+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa72009b8b0 con 0x7fa72009f430 2023-10-03T10:12:04.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.092+0000 7fa70effd700 1 -- 172.21.15.125:0/1978003472 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7140193b0 con 0x7fa72009f430 2023-10-03T10:12:04.093 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 >> v1:172.21.15.125:6816/126957 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 msgr2=0x7fa72006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa72006c940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa714016000 tx=0x7fa714004750 comp rx=0 tx=0).stop 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 shutdown_connections 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa720137010 0x7fa7201c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa72009e950 0x7fa72006c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 --2- 172.21.15.125:0/1978003472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa72009f430 0x7fa72006c940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 >> 172.21.15.125:0/1978003472 conn(0x7fa7200a0f70 msgr2=0x7fa7200708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 shutdown_connections 2023-10-03T10:12:04.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.094+0000 7fa724ee7700 1 -- 172.21.15.125:0/1978003472 wait complete. 2023-10-03T10:12:04.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:04.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.113+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d400a5f50 con 0x7f9d40139200 2023-10-03T10:12:04.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.114+0000 7f9d2effd700 1 -- 172.21.15.125:0/2182768723 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d3802c070 con 0x7f9d40139200 2023-10-03T10:12:04.114 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 >> v1:172.21.15.125:6816/126957 conn(0x7f9d2002f510 legacy=0x7f9d200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 msgr2=0x7f9d401c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d38013000 tx=0x7f9d38004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 shutdown_connections 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d40139200 0x7f9d401c8600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d401217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 --2- 172.21.15.125:0/2182768723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1550 0x7f9d40121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 >> 172.21.15.125:0/2182768723 conn(0x7f9d400a6610 msgr2=0x7f9d40136ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 shutdown_connections 2023-10-03T10:12:04.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:04.116+0000 7f9d44e79700 1 -- 172.21.15.125:0/2182768723 wait complete. 2023-10-03T10:12:04.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:05.063 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:05.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:05.107 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:05.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.212+0000 7fa050d43700 1 Processor -- start 2023-10-03T10:12:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.212+0000 7fa050d43700 1 -- start start 2023-10-03T10:12:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa050d43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa050d43700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa050d43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c09dc00 con 0x7fa04c0a1380 2023-10-03T10:12:05.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa050d43700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c09ea60 con 0x7fa04c134120 2023-10-03T10:12:05.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa050d43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c09dec0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa04a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa049d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa04c0a1380 0x7fa04c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57918/0 (socket says 172.21.15.125:57918) 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa049d9b700 1 -- 172.21.15.125:0/2453738323 learned_addr learned my addr 172.21.15.125:0/2453738323 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.213+0000 7fa04ad9d700 1 --2- 172.21.15.125:0/2453738323 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04a59c700 1 -- 172.21.15.125:0/2453738323 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 msgr2=0x7fa04c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04a59c700 1 --2- 172.21.15.125:0/2453738323 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04a59c700 1 -- 172.21.15.125:0/2453738323 >> v1:172.21.15.125:6789/0 conn(0x7fa04c0a1380 legacy=0x7fa04c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04a59c700 1 -- 172.21.15.125:0/2453738323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c09e6a0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04a59c700 1 --2- 172.21.15.125:0/2453738323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009840 tx=0x7fa03c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba9f11b1580bbe6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04959a700 1 -- 172.21.15.125:0/2453738323 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c011830 con 0x7fa04c0a0a70 2023-10-03T10:12:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04959a700 1 -- 172.21.15.125:0/2453738323 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c011990 con 0x7fa04c0a0a70 2023-10-03T10:12:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.214+0000 7fa04959a700 1 -- 172.21.15.125:0/2453738323 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c011d20 con 0x7fa04c0a0a70 2023-10-03T10:12:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 -- 172.21.15.125:0/2453738323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 msgr2=0x7fa04c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 --2- 172.21.15.125:0/2453738323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009840 tx=0x7fa03c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 -- 172.21.15.125:0/2453738323 shutdown_connections 2023-10-03T10:12:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 --2- 172.21.15.125:0/2453738323 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 --2- 172.21.15.125:0/2453738323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 -- 172.21.15.125:0/2453738323 >> 172.21.15.125:0/2453738323 conn(0x7fa04c0a6610 msgr2=0x7fa04c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 -- 172.21.15.125:0/2453738323 shutdown_connections 2023-10-03T10:12:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.215+0000 7fa050d43700 1 -- 172.21.15.125:0/2453738323 wait complete. 2023-10-03T10:12:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 Processor -- start 2023-10-03T10:12:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 -- start start 2023-10-03T10:12:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 0x7fa04c123470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c126160 con 0x7fa04c134120 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c127020 con 0x7fa04c0a1380 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.217+0000 7fa050d43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c123dc0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa049d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38600/0 (socket says 172.21.15.125:38600) 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa049d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:37646/0 (socket says 172.21.15.125:37646) 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 -- 172.21.15.125:0/3910690062 learned_addr learned my addr 172.21.15.125:0/3910690062 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04ad9d700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 0x7fa04c123470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 -- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 msgr2=0x7fa04c122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 -- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 msgr2=0x7fa04c123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 0x7fa04c123470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 -- 172.21.15.125:0/3910690062 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0094a0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa049d9b700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04ad9d700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 0x7fa04c123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa04a59c700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009fd0 tx=0x7fa03c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.218+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0036a0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.219+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c01f070 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.219+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c133b00 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.219+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c003a60 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.219+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c124cd0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.220+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa03c003bc0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.220+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa03c021070 con 0x7fa04c0a0a70 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.220+0000 7fa049d9b700 1 -- 172.21.15.125:0/3910690062 >> v1:172.21.15.125:6816/126957 conn(0x7fa02c02f510 legacy=0x7fa02c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.220+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c04f2a0 con 0x7fa04c0a0a70 2023-10-03T10:12:05.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.226+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa03c015080 con 0x7fa04c0a0a70 2023-10-03T10:12:05.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.243+0000 7fc5d4357700 1 Processor -- start 2023-10-03T10:12:05.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.243+0000 7fc5d4357700 1 -- start start 2023-10-03T10:12:05.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d4357700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5cc1350d0 0x7fc5cc13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d4357700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 0x7fc5cc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d4357700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc09eca0 con 0x7fc5cc06a770 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d4357700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc06b2e0 con 0x7fc5cc1350d0 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d4357700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc09f720 con 0x7fc5cc13d210 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d20f3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc5cc06a770 0x7fc5cc1349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57924/0 (socket says 172.21.15.125:57924) 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d20f3700 1 -- 172.21.15.125:0/58142191 learned_addr learned my addr 172.21.15.125:0/58142191 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 0x7fc5cc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d18f2700 1 --2- 172.21.15.125:0/58142191 >> v2:172.21.15.125:3300/0 conn(0x7fc5cc1350d0 0x7fc5cc13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d10f1700 1 -- 172.21.15.125:0/58142191 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119565912 0 0) 0x7fc5cc09eca0 con 0x7fc5cc06a770 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d10f1700 1 -- 172.21.15.125:0/58142191 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b80035b0 con 0x7fc5cc06a770 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d18f2700 1 -- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 msgr2=0x7fc5cc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d18f2700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 0x7fc5cc13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d18f2700 1 -- 172.21.15.125:0/58142191 >> v1:172.21.15.125:6789/0 conn(0x7fc5cc06a770 legacy=0x7fc5cc1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d18f2700 1 -- 172.21.15.125:0/58142191 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc06b480 con 0x7fc5cc1350d0 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.244+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 0x7fc5cc13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.245+0000 7fc5d18f2700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc1350d0 0x7fc5cc13ccd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009840 tx=0x7fc5bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108951578c519c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.245+0000 7fc5d10f1700 1 -- 172.21.15.125:0/58142191 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011830 con 0x7fc5cc1350d0 2023-10-03T10:12:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.245+0000 7fc5d10f1700 1 -- 172.21.15.125:0/58142191 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc011990 con 0x7fc5cc1350d0 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.245+0000 7fc5d10f1700 1 -- 172.21.15.125:0/58142191 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011d00 con 0x7fc5cc1350d0 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 -- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc1350d0 msgr2=0x7fc5cc13ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc1350d0 0x7fc5cc13ccd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009840 tx=0x7fc5bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 -- 172.21.15.125:0/58142191 shutdown_connections 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc13d210 0x7fc5cc13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 --2- 172.21.15.125:0/58142191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc1350d0 0x7fc5cc13ccd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 -- 172.21.15.125:0/58142191 >> 172.21.15.125:0/58142191 conn(0x7fc5cc099c40 msgr2=0x7fc5cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 -- 172.21.15.125:0/58142191 shutdown_connections 2023-10-03T10:12:05.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.246+0000 7fc5d4357700 1 -- 172.21.15.125:0/58142191 wait complete. 2023-10-03T10:12:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.247+0000 7fc5d4357700 1 Processor -- start 2023-10-03T10:12:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.247+0000 7fc5d4357700 1 -- start start 2023-10-03T10:12:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 Processor -- start 2023-10-03T10:12:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 -- start start 2023-10-03T10:12:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 0x7fc5cc13af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc1350d0 0x7fc5cc13b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 0x7fc5cc13b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc13a100 con 0x7fc5cc06a770 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc13c0c0 con 0x7fc5cc1350d0 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d4357700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0a2970 con 0x7fc5cc13d210 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d20f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 0x7fc5cc13af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe4133ad0 0x7fcbe4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcbe4130bc0 0x7fcbe413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe406b2d0 con 0x7fcbe41300a0 2023-10-03T10:12:05.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe4133610 con 0x7fcbe4130bc0 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbec326700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe409a500 con 0x7fcbe4133ad0 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbea8c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcbe4130bc0 0x7fcbe413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbea8c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcbe4130bc0 0x7fcbe413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48860/0 (socket says 172.21.15.125:48860) 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fcbea8c3700 1 -- 172.21.15.125:0/653067849 learned_addr learned my addr 172.21.15.125:0/653067849 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d20f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 0x7fc5cc13af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48846/0 (socket says 172.21.15.125:48846) 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.248+0000 7fc5d20f3700 1 -- 172.21.15.125:0/2546171624 learned_addr learned my addr 172.21.15.125:0/2546171624 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:05.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 0x7fc5cc13b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbea8c3700 1 -- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe4133ad0 msgr2=0x7fcbe4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbea8c3700 1 --2- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe4133ad0 0x7fcbe4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbea8c3700 1 -- 172.21.15.125:0/653067849 >> v1:172.21.15.125:6789/0 conn(0x7fcbe41300a0 legacy=0x7fcbe41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbea8c3700 1 -- 172.21.15.125:0/653067849 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe41338b0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbea8c3700 1 --2- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe413b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009e50 tx=0x7fcbdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902d16cbbfb55a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbe90c0700 1 -- 172.21.15.125:0/653067849 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00e070 con 0x7fcbe4130bc0 2023-10-03T10:12:05.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbe90c0700 1 -- 172.21.15.125:0/653067849 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00b9c0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fcbe90c0700 1 -- 172.21.15.125:0/653067849 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00bd70 con 0x7fcbe4130bc0 2023-10-03T10:12:05.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d18f2700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc1350d0 0x7fc5cc13b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 -- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc1350d0 msgr2=0x7fc5cc13b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc1350d0 0x7fc5cc13b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 -- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 msgr2=0x7fc5cc13af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 0x7fc5cc13af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 -- 172.21.15.125:0/2546171624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0094a0 con 0x7fc5cc13d210 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.249+0000 7fc5d28f4700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 0x7fc5cc13b9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc06b060 tx=0x7fc5c400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400ddd0 con 0x7fc5cc13d210 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400f040 con 0x7fc5cc13d210 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc09f220 con 0x7fc5cc13d210 2023-10-03T10:12:05.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc13aa50 con 0x7fc5cc13d210 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 -- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 msgr2=0x7fcbe413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 --2- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe413b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009e50 tx=0x7fcbdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 -- 172.21.15.125:0/653067849 shutdown_connections 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 --2- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe413b990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 --2- 172.21.15.125:0/653067849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe4133ad0 0x7fcbe4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fcbec326700 1 -- 172.21.15.125:0/653067849 >> 172.21.15.125:0/653067849 conn(0x7fcbe4099c40 msgr2=0x7fcbe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.250+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4015640 con 0x7fc5cc13d210 2023-10-03T10:12:05.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.251+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc5c401e3b0 con 0x7fc5cc13d210 2023-10-03T10:12:05.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.251+0000 7fcbec326700 1 -- 172.21.15.125:0/653067849 shutdown_connections 2023-10-03T10:12:05.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.251+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc071d20 con 0x7fc5cc13d210 2023-10-03T10:12:05.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.251+0000 7fcbec326700 1 -- 172.21.15.125:0/653067849 wait complete. 2023-10-03T10:12:05.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.252+0000 7fcbec326700 1 Processor -- start 2023-10-03T10:12:05.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.251+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc5c403fd80 con 0x7fc5cc13d210 2023-10-03T10:12:05.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.252+0000 7fc5d20f3700 1 -- 172.21.15.125:0/2546171624 >> v1:172.21.15.125:6816/126957 conn(0x7fc5b002f510 legacy=0x7fc5b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.252+0000 7fcbec326700 1 -- start start 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe41300a0 0x7fcbe411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbe4133ad0 0x7fcbe411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4072910 con 0x7fcbe4130bc0 2023-10-03T10:12:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40a2ea0 con 0x7fcbe41300a0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbec326700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe412dd00 con 0x7fcbe4133ad0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbe98c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbe98c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57460/0 (socket says 172.21.15.125:57460) 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbe98c1700 1 -- 172.21.15.125:0/2060580451 learned_addr learned my addr 172.21.15.125:0/2060580451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbea0c2700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe41300a0 0x7fcbe411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.253+0000 7fcbea8c3700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbe4133ad0 0x7fcbe411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 -- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbe4133ad0 msgr2=0x7fcbe411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbe4133ad0 0x7fcbe411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 -- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe41300a0 msgr2=0x7fcbe411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe41300a0 0x7fcbe411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 -- 172.21.15.125:0/2060580451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009b30 con 0x7fcbe4130bc0 2023-10-03T10:12:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbe98c1700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c420 tx=0x7fcbd400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40052d0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4005430 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe411fbb0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003880 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.254+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe41201f0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.255+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcbd40039e0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.255+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcbd403edd0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.255+0000 7fcbea0c2700 1 -- 172.21.15.125:0/2060580451 >> v1:172.21.15.125:6816/126957 conn(0x7fcbc802f510 legacy=0x7fcbc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.255+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc0052e0 con 0x7fcbe4130bc0 2023-10-03T10:12:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.257+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5c4043030 con 0x7fc5cc13d210 2023-10-03T10:12:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.260+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbd4017030 con 0x7fcbe4130bc0 2023-10-03T10:12:05.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.307+0000 7fa19374a700 1 Processor -- start 2023-10-03T10:12:05.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 -- start start 2023-10-03T10:12:05.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa18c138040 0x7fa18c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c1379e0 con 0x7fa18c0a1230 2023-10-03T10:12:05.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0a2100 con 0x7fa18c138040 2023-10-03T10:12:05.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.308+0000 7fa19374a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c138950 con 0x7fa18c0a08e0 2023-10-03T10:12:05.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa18c138040 0x7fa18c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa191ce7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa18c0a1230 0x7fa18c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36198/0 (socket says 172.21.15.125:36198) 2023-10-03T10:12:05.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa191ce7700 1 -- 172.21.15.125:0/3139594525 learned_addr learned my addr 172.21.15.125:0/3139594525 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:05.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa183fff700 1 -- 172.21.15.125:0/3139594525 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212878371 0 0) 0x7fa18c1379e0 con 0x7fa18c0a1230 2023-10-03T10:12:05.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa183fff700 1 -- 172.21.15.125:0/3139594525 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1780035b0 con 0x7fa18c0a1230 2023-10-03T10:12:05.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 -- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 msgr2=0x7fa18c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:05.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 --2- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 -- 172.21.15.125:0/3139594525 >> v1:172.21.15.125:6789/0 conn(0x7fa18c0a1230 legacy=0x7fa18c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 -- 172.21.15.125:0/3139594525 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c09b9b0 con 0x7fa18c138040 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.309+0000 7fa1914e6700 1 --2- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c138040 0x7fa18c138410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa188009850 tx=0x7fa188009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9403ce00bce91b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa183fff700 1 -- 172.21.15.125:0/3139594525 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188005e30 con 0x7fa18c138040 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa183fff700 1 -- 172.21.15.125:0/3139594525 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188006030 con 0x7fa18c138040 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa183fff700 1 -- 172.21.15.125:0/3139594525 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880063c0 con 0x7fa18c138040 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 -- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c138040 msgr2=0x7fa18c138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 --2- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c138040 0x7fa18c138410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa188009850 tx=0x7fa188009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 -- 172.21.15.125:0/3139594525 shutdown_connections 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 --2- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c138040 0x7fa18c138410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 --2- 172.21.15.125:0/3139594525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.310+0000 7fa19374a700 1 -- 172.21.15.125:0/3139594525 >> 172.21.15.125:0/3139594525 conn(0x7fa18c0a2980 msgr2=0x7fa18c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.311+0000 7fa19374a700 1 -- 172.21.15.125:0/3139594525 shutdown_connections 2023-10-03T10:12:05.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.311+0000 7fa19374a700 1 -- 172.21.15.125:0/3139594525 wait complete. 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 Processor -- start 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 -- start start 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c1262f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa18c138040 0x7fa18c126d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c127f00 con 0x7fa18c0a1230 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c129e10 con 0x7fa18c138040 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa19374a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c137690 con 0x7fa18c0a08e0 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa190ce5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa190ce5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57474/0 (socket says 172.21.15.125:57474) 2023-10-03T10:12:05.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa190ce5700 1 -- 172.21.15.125:0/1244562822 learned_addr learned my addr 172.21.15.125:0/1244562822 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.312+0000 7fa1914e6700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c1262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa191ce7700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa18c138040 0x7fa18c126d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 -- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 msgr2=0x7fa18c1262f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c1262f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 -- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa18c138040 msgr2=0x7fa18c126d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa18c138040 0x7fa18c126d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 -- 172.21.15.125:0/1244562822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009430 con 0x7fa18c0a1230 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa1914e6700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c1262f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa190ce5700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00b4a0 tx=0x7fa17c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011830 con 0x7fa18c0a1230 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c011990 con 0x7fa18c0a1230 2023-10-03T10:12:05.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c09a240 con 0x7fa18c0a1230 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011d40 con 0x7fa18c0a1230 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.313+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c136e60 con 0x7fa18c0a1230 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.314+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa17c01a400 con 0x7fa18c0a1230 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.314+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa17c03faa0 con 0x7fa18c0a1230 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.314+0000 7fa1914e6700 1 -- 172.21.15.125:0/1244562822 >> v1:172.21.15.125:6816/126957 conn(0x7fa17002f510 legacy=0x7fa1700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.315+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c129a50 con 0x7fa18c0a1230 2023-10-03T10:12:05.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.325+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa17c015020 con 0x7fa18c0a1230 2023-10-03T10:12:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.421+0000 7fa049d9b700 1 -- 172.21.15.125:0/3910690062 >> v1:172.21.15.125:6816/126957 conn(0x7fa02c02f510 legacy=0x7fa02c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.443+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa04c072980 con 0x7fa04c0a0a70 2023-10-03T10:12:05.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.443+0000 7fa03affd700 1 -- 172.21.15.125:0/3910690062 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa03c02b020 con 0x7fa04c0a0a70 2023-10-03T10:12:05.444 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.445+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 >> v1:172.21.15.125:6816/126957 conn(0x7fa02c02f510 legacy=0x7fa02c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.445+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 msgr2=0x7fa04c1229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.445+0000 7fa050d43700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009fd0 tx=0x7fa03c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 shutdown_connections 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c134120 0x7fa04c123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c0a0a70 0x7fa04c1229f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 --2- 172.21.15.125:0/3910690062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a1380 0x7fa04c122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 >> 172.21.15.125:0/3910690062 conn(0x7fa04c0a6610 msgr2=0x7fa04c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 shutdown_connections 2023-10-03T10:12:05.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.446+0000 7fa050d43700 1 -- 172.21.15.125:0/3910690062 wait complete. 2023-10-03T10:12:05.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.453+0000 7fc5d20f3700 1 -- 172.21.15.125:0/2546171624 >> v1:172.21.15.125:6816/126957 conn(0x7fc5b002f510 legacy=0x7fc5b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.456+0000 7fcbea0c2700 1 -- 172.21.15.125:0/2060580451 >> v1:172.21.15.125:6816/126957 conn(0x7fcbc802f510 legacy=0x7fcbc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:05.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.458+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5cc136ff0 con 0x7fc5cc13d210 2023-10-03T10:12:05.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.458+0000 7fc5c2ffd700 1 -- 172.21.15.125:0/2546171624 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5c401a090 con 0x7fc5cc13d210 2023-10-03T10:12:05.459 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 >> v1:172.21.15.125:6816/126957 conn(0x7fc5b002f510 legacy=0x7fc5b00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 msgr2=0x7fc5cc13b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 0x7fc5cc13b9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc06b060 tx=0x7fc5c400d3b0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 shutdown_connections 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5cc13d210 0x7fc5cc13b9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5cc06a770 0x7fc5cc13af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 --2- 172.21.15.125:0/2546171624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5cc1350d0 0x7fc5cc13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 >> 172.21.15.125:0/2546171624 conn(0x7fc5cc099c40 msgr2=0x7fc5cc09cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 shutdown_connections 2023-10-03T10:12:05.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.460+0000 7fc5d4357700 1 -- 172.21.15.125:0/2546171624 wait complete. 2023-10-03T10:12:05.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:05.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.507+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcbcc005860 con 0x7fcbe4130bc0 2023-10-03T10:12:05.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.507+0000 7fcbdaffd700 1 -- 172.21.15.125:0/2060580451 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbd4017030 con 0x7fcbe4130bc0 2023-10-03T10:12:05.508 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 >> v1:172.21.15.125:6816/126957 conn(0x7fcbc802f510 legacy=0x7fcbc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 msgr2=0x7fcbe411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c420 tx=0x7fcbd400c730 comp rx=0 tx=0).stop 2023-10-03T10:12:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 shutdown_connections 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbe4133ad0 0x7fcbe411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe41300a0 0x7fcbe411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 --2- 172.21.15.125:0/2060580451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe4130bc0 0x7fcbe411df80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 >> 172.21.15.125:0/2060580451 conn(0x7fcbe4099c40 msgr2=0x7fcbe412e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 shutdown_connections 2023-10-03T10:12:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.509+0000 7fcbec326700 1 -- 172.21.15.125:0/2060580451 wait complete. 2023-10-03T10:12:05.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.515+0000 7fa1914e6700 1 -- 172.21.15.125:0/1244562822 >> v1:172.21.15.125:6816/126957 conn(0x7fa17002f510 legacy=0x7fa1700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:05.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.550+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa18c04f2a0 con 0x7fa18c0a1230 2023-10-03T10:12:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.550+0000 7fa181ffb700 1 -- 172.21.15.125:0/1244562822 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa17c029090 con 0x7fa18c0a1230 2023-10-03T10:12:05.551 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 >> v1:172.21.15.125:6816/126957 conn(0x7fa17002f510 legacy=0x7fa1700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 msgr2=0x7fa18c126830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00b4a0 tx=0x7fa17c00b7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 shutdown_connections 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa18c138040 0x7fa18c126d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa18c0a08e0 0x7fa18c1262f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 --2- 172.21.15.125:0/1244562822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa18c0a1230 0x7fa18c126830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 >> 172.21.15.125:0/1244562822 conn(0x7fa18c0a2980 msgr2=0x7fa18c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 shutdown_connections 2023-10-03T10:12:05.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:05.552+0000 7fa19374a700 1 -- 172.21.15.125:0/1244562822 wait complete. 2023-10-03T10:12:05.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:06.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:06.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:06.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:06.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.601+0000 7efc5dbda700 1 Processor -- start 2023-10-03T10:12:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 -- start start 2023-10-03T10:12:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5809aaa0 con 0x7efc58130ce0 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5809f870 con 0x7efc5809e170 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.602+0000 7efc5dbda700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc5809b360 con 0x7efc5809d860 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc577fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42756/0 (socket says 172.21.15.125:42756) 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 -- 172.21.15.125:0/1744389229 learned_addr learned my addr 172.21.15.125:0/1744389229 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 -- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 msgr2=0x7efc5809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 --2- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 -- 172.21.15.125:0/1744389229 >> v1:172.21.15.125:6789/0 conn(0x7efc58130ce0 legacy=0x7efc581379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 -- 172.21.15.125:0/1744389229 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5809b620 con 0x7efc5809e170 2023-10-03T10:12:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc56ffd700 1 --2- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bbc0 tx=0x7efc4c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c8424aadd25670 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc567fc700 1 -- 172.21.15.125:0/1744389229 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00dd30 con 0x7efc5809e170 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc567fc700 1 -- 172.21.15.125:0/1744389229 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00de90 con 0x7efc5809e170 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.603+0000 7efc567fc700 1 -- 172.21.15.125:0/1744389229 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c010690 con 0x7efc5809e170 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 -- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 msgr2=0x7efc581307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 --2- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bbc0 tx=0x7efc4c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 -- 172.21.15.125:0/1744389229 shutdown_connections 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 --2- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 --2- 172.21.15.125:0/1744389229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc581307a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 -- 172.21.15.125:0/1744389229 >> 172.21.15.125:0/1744389229 conn(0x7efc58099c40 msgr2=0x7efc580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 -- 172.21.15.125:0/1744389229 shutdown_connections 2023-10-03T10:12:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.604+0000 7efc5dbda700 1 -- 172.21.15.125:0/1744389229 wait complete. 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.606+0000 7efc5dbda700 1 Processor -- start 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.606+0000 7efc5dbda700 1 -- start start 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5811e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 0x7efc5811f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58121eb0 con 0x7efc58130ce0 2023-10-03T10:12:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5809c8b0 con 0x7efc5809e170 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc5dbda700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc58120390 con 0x7efc5809d860 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42762/0 (socket says 172.21.15.125:42762) 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc56ffd700 1 -- 172.21.15.125:0/945621561 learned_addr learned my addr 172.21.15.125:0/945621561 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 0x7efc5811f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc577fe700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5811e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 -- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 msgr2=0x7efc5811e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5811e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 -- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 msgr2=0x7efc5811ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc57fff700 1 -- 172.21.15.125:0/945621561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c00b7f0 con 0x7efc58130ce0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc577fe700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5811e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.607+0000 7efc56ffd700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc57fff700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 0x7efc5811f130 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efc5000cb90 tx=0x7efc5000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50003c00 con 0x7efc58130ce0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50003d60 con 0x7efc58130ce0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000aaa0 con 0x7efc58130ce0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc58120830 con 0x7efc58130ce0 2023-10-03T10:12:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.608+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc58122920 con 0x7efc58130ce0 2023-10-03T10:12:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.609+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efc5000ac00 con 0x7efc58130ce0 2023-10-03T10:12:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.609+0000 7efc577fe700 1 -- 172.21.15.125:0/945621561 >> v1:172.21.15.125:6816/126957 conn(0x7efc4402f510 legacy=0x7efc440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.609+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efc5003fb50 con 0x7efc58130ce0 2023-10-03T10:12:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.610+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5804f2a0 con 0x7efc58130ce0 2023-10-03T10:12:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.618+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc500050d0 con 0x7efc58130ce0 2023-10-03T10:12:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.640+0000 7fc92581e700 1 Processor -- start 2023-10-03T10:12:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.640+0000 7fc92581e700 1 -- start start 2023-10-03T10:12:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a0a30 0x7fc9200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a1340 0x7fc92012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9201304a0 0x7fc9201308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc920130e30 con 0x7fc9201304a0 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200a1e70 con 0x7fc9200a0a30 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc92581e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92009a720 con 0x7fc9200a1340 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9201304a0 0x7fc9201308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9201304a0 0x7fc9201308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57482/0 (socket says 172.21.15.125:57482) 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 -- 172.21.15.125:0/1770818634 learned_addr learned my addr 172.21.15.125:0/1770818634 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91effd700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a0a30 0x7fc9200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 -- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a1340 msgr2=0x7fc92012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a1340 0x7fc92012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 -- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a0a30 msgr2=0x7fc9200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a0a30 0x7fc9200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 -- 172.21.15.125:0/1770818634 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92009b300 con 0x7fc9201304a0 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.641+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc9201308f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc918009e50 tx=0x7fc91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97bcc30974936ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.642+0000 7fc91dffb700 1 -- 172.21.15.125:0/1770818634 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800e070 con 0x7fc9201304a0 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.642+0000 7fc91dffb700 1 -- 172.21.15.125:0/1770818634 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800b910 con 0x7fc9201304a0 2023-10-03T10:12:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.642+0000 7fc91dffb700 1 -- 172.21.15.125:0/1770818634 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800bcc0 con 0x7fc9201304a0 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 -- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 msgr2=0x7fc9201308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc9201308f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc918009e50 tx=0x7fc91800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 -- 172.21.15.125:0/1770818634 shutdown_connections 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a0a30 0x7fc9200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc9201308f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 --2- 172.21.15.125:0/1770818634 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a1340 0x7fc92012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 -- 172.21.15.125:0/1770818634 >> 172.21.15.125:0/1770818634 conn(0x7fc9200a2980 msgr2=0x7fc9200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 -- 172.21.15.125:0/1770818634 shutdown_connections 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.643+0000 7fc92581e700 1 -- 172.21.15.125:0/1770818634 wait complete. 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.644+0000 7fc92581e700 1 Processor -- start 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.644+0000 7fc92581e700 1 -- start start 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 0x7fc92011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc92011b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92011d0a0 con 0x7fc9201304a0 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92011e3f0 con 0x7fc9200a1340 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc92581e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92011cc00 con 0x7fc9200a0a30 2023-10-03T10:12:06.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc91e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc91e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42786/0 (socket says 172.21.15.125:42786) 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc91e7fc700 1 -- 172.21.15.125:0/2487771313 learned_addr learned my addr 172.21.15.125:0/2487771313 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.645+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc92011b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91effd700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 0x7fc92011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 -- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 msgr2=0x7fc92011ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 0x7fc92011ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 -- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 msgr2=0x7fc92011b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 -- 172.21.15.125:0/2487771313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918009b30 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91effd700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 0x7fc92011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91e7fc700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc91f7fe700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc92011b8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc918015000 tx=0x7fc918004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918004450 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9180045b0 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92011e990 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918004960 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.646+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92011d270 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.647+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc91801c410 con 0x7fc9201304a0 2023-10-03T10:12:06.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.647+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92004f2a0 con 0x7fc9201304a0 2023-10-03T10:12:06.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.647+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc918041720 con 0x7fc9201304a0 2023-10-03T10:12:06.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.647+0000 7fc91effd700 1 -- 172.21.15.125:0/2487771313 >> v1:172.21.15.125:6816/126957 conn(0x7fc90c02f540 legacy=0x7fc90c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.652+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc91801a7d0 con 0x7fc9201304a0 2023-10-03T10:12:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.683+0000 7f9526886700 1 Processor -- start 2023-10-03T10:12:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.683+0000 7f9526886700 1 -- start start 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f952009e170 0x7f95201307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 0x7f9520131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952009aaa0 con 0x7f952009e170 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952009f870 con 0x7f9520130ce0 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9526886700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952009b360 con 0x7f952009d860 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42292/0 (socket says 172.21.15.125:42292) 2023-10-03T10:12:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 -- 172.21.15.125:0/488442743 learned_addr learned my addr 172.21.15.125:0/488442743 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9524e23700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 0x7f9520131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951f7fe700 1 --2- 172.21.15.125:0/488442743 >> v2:172.21.15.125:3300/0 conn(0x7f952009e170 0x7f95201307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 -- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 msgr2=0x7f9520131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 0x7f9520131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 -- 172.21.15.125:0/488442743 >> v2:172.21.15.125:3300/0 conn(0x7f952009e170 msgr2=0x7f95201307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 --2- 172.21.15.125:0/488442743 >> v2:172.21.15.125:3300/0 conn(0x7f952009e170 0x7f95201307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f951ffff700 1 -- 172.21.15.125:0/488442743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952009b620 con 0x7f952009d860 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.684+0000 7f9524e23700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 0x7f9520131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f951ffff700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9510009920 tx=0x7f9510009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aaf38c600b570e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f951effd700 1 -- 172.21.15.125:0/488442743 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510011830 con 0x7f952009d860 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f951effd700 1 -- 172.21.15.125:0/488442743 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9510011990 con 0x7f952009d860 2023-10-03T10:12:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f951effd700 1 -- 172.21.15.125:0/488442743 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510011d20 con 0x7f952009d860 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 -- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 msgr2=0x7f952009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9510009920 tx=0x7f9510009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 -- 172.21.15.125:0/488442743 shutdown_connections 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9520130ce0 0x7f9520131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 --2- 172.21.15.125:0/488442743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f952009d860 0x7f952009dc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 --2- 172.21.15.125:0/488442743 >> v2:172.21.15.125:3300/0 conn(0x7f952009e170 0x7f95201307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.685+0000 7f9526886700 1 -- 172.21.15.125:0/488442743 >> 172.21.15.125:0/488442743 conn(0x7f9520099c40 msgr2=0x7f95200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.686+0000 7f9526886700 1 -- 172.21.15.125:0/488442743 shutdown_connections 2023-10-03T10:12:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.686+0000 7f9526886700 1 -- 172.21.15.125:0/488442743 wait complete. 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.686+0000 7f9526886700 1 Processor -- start 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 -- start start 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f952009d860 0x7f95201cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 0x7f95201cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952009c8b0 con 0x7f952009d860 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9520130260 con 0x7f952009e170 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9526886700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95201280a0 con 0x7f9520130ce0 2023-10-03T10:12:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f951f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f951f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42804/0 (socket says 172.21.15.125:42804) 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f951f7fe700 1 -- 172.21.15.125:0/806319174 learned_addr learned my addr 172.21.15.125:0/806319174 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f951ffff700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f952009d860 0x7f95201cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.687+0000 7f9524e23700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 0x7f95201cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 -- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 msgr2=0x7f95201cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 0x7f95201cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 -- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f952009d860 msgr2=0x7f95201cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f952009d860 0x7f95201cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 -- 172.21.15.125:0/806319174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009a70 con 0x7f952009e170 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f9524e23700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 0x7f95201cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951f7fe700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f951400d990 tx=0x7f951400dca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514004440 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9510009550 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.688+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9520128710 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.689+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95140045a0 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.689+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95140038a0 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.689+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9514003a00 con 0x7f952009e170 2023-10-03T10:12:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.689+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95000052e0 con 0x7f952009e170 2023-10-03T10:12:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.690+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f951403ff10 con 0x7f952009e170 2023-10-03T10:12:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.690+0000 7f951ffff700 1 -- 172.21.15.125:0/806319174 >> v1:172.21.15.125:6816/126957 conn(0x7f950c02f510 legacy=0x7f950c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.694+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9514003cb0 con 0x7f952009e170 2023-10-03T10:12:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.726+0000 7f88c5207700 1 Processor -- start 2023-10-03T10:12:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.726+0000 7f88c5207700 1 -- start start 2023-10-03T10:12:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88c5207700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c0138040 0x7f88c0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88c5207700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88c5207700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c01379e0 con 0x7f88c00a08e0 2023-10-03T10:12:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88c5207700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00a2100 con 0x7f88c00a1400 2023-10-03T10:12:06.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88c5207700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0138950 con 0x7f88c0138040 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88be59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f88c00a08e0 0x7f88c00a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36210/0 (socket says 172.21.15.125:36210) 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88be59c700 1 -- 172.21.15.125:0/3529255977 learned_addr learned my addr 172.21.15.125:0/3529255977 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c0138040 0x7f88c0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bf59e700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bf59e700 1 -- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c0138040 msgr2=0x7f88c0138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bf59e700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c0138040 0x7f88c0138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bf59e700 1 -- 172.21.15.125:0/3529255977 >> v1:172.21.15.125:6789/0 conn(0x7f88c00a08e0 legacy=0x7f88c00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.727+0000 7f88bf59e700 1 -- 172.21.15.125:0/3529255977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c009b9b0 con 0x7f88c00a1400 2023-10-03T10:12:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88bf59e700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c013fd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009df0 tx=0x7f88b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ebf0ceda714aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88bdd9b700 1 -- 172.21.15.125:0/3529255977 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800e070 con 0x7f88c00a1400 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88bdd9b700 1 -- 172.21.15.125:0/3529255977 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8003a20 con 0x7f88c00a1400 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88bdd9b700 1 -- 172.21.15.125:0/3529255977 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8003db0 con 0x7f88c00a1400 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 -- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 msgr2=0x7f88c013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c013fd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009df0 tx=0x7f88b800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 -- 172.21.15.125:0/3529255977 shutdown_connections 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c013fd20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 --2- 172.21.15.125:0/3529255977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c0138040 0x7f88c0138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 -- 172.21.15.125:0/3529255977 >> 172.21.15.125:0/3529255977 conn(0x7f88c00a2980 msgr2=0x7f88c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 -- 172.21.15.125:0/3529255977 shutdown_connections 2023-10-03T10:12:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.728+0000 7f88c5207700 1 -- 172.21.15.125:0/3529255977 wait complete. 2023-10-03T10:12:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 Processor -- start 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 -- start start 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 0x7f88c0137010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 0x7f88c0135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0130200 con 0x7f88c0138040 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0119510 con 0x7f88c00a1400 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88c5207700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c009a240 con 0x7f88c00a08e0 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88be59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88be59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42828/0 (socket says 172.21.15.125:42828) 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88be59c700 1 -- 172.21.15.125:0/1117006370 learned_addr learned my addr 172.21.15.125:0/1117006370 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88bed9d700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 0x7f88c0137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.730+0000 7f88bf59e700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 0x7f88c0135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 -- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 msgr2=0x7f88c0137010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 0x7f88c0137010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 -- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 msgr2=0x7f88c0135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 -- 172.21.15.125:0/1117006370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009a70 con 0x7f88c0138040 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bed9d700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 0x7f88c0137010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88be59c700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88bf59e700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 0x7f88c0135fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009df0 tx=0x7f88b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80044c0 con 0x7f88c0138040 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8004660 con 0x7f88c0138040 2023-10-03T10:12:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c0140ae0 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c0119bc0 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.731+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8012450 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.732+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0119370 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.733+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f88b80125b0 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.733+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f88b8041070 con 0x7f88c0138040 2023-10-03T10:12:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.733+0000 7f88bed9d700 1 -- 172.21.15.125:0/1117006370 >> v1:172.21.15.125:6816/126957 conn(0x7f88ac02f510 legacy=0x7f88ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.742+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88c0119370 con 0x7f88c0138040 2023-10-03T10:12:06.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.810+0000 7efc577fe700 1 -- 172.21.15.125:0/945621561 >> v1:172.21.15.125:6816/126957 conn(0x7efc4402f510 legacy=0x7efc440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.816+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc5806c3b0 con 0x7efc58130ce0 2023-10-03T10:12:06.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.816+0000 7efc3ffff700 1 -- 172.21.15.125:0/945621561 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc50019300 con 0x7efc58130ce0 2023-10-03T10:12:06.817 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:06.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.819+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 >> v1:172.21.15.125:6816/126957 conn(0x7efc4402f510 legacy=0x7efc440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.819+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 msgr2=0x7efc5811f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.819+0000 7efc5dbda700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 0x7efc5811f130 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efc5000cb90 tx=0x7efc5000cea0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 shutdown_connections 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc58130ce0 0x7efc5811f130 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc5809d860 0x7efc5811e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 --2- 172.21.15.125:0/945621561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc5809e170 0x7efc5811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 >> 172.21.15.125:0/945621561 conn(0x7efc58099c40 msgr2=0x7efc580a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 shutdown_connections 2023-10-03T10:12:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.820+0000 7efc5dbda700 1 -- 172.21.15.125:0/945621561 wait complete. 2023-10-03T10:12:06.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.848+0000 7fc91effd700 1 -- 172.21.15.125:0/2487771313 >> v1:172.21.15.125:6816/126957 conn(0x7fc90c02f540 legacy=0x7fc90c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.868+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc92006bce0 con 0x7fc9201304a0 2023-10-03T10:12:06.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.869+0000 7fc907fff700 1 -- 172.21.15.125:0/2487771313 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc918011390 con 0x7fc9201304a0 2023-10-03T10:12:06.869 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:06.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.870+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 >> v1:172.21.15.125:6816/126957 conn(0x7fc90c02f540 legacy=0x7fc90c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:06.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.870+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 msgr2=0x7fc92011b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.870+0000 7fc92581e700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc92011b8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc918015000 tx=0x7fc918004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.870+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 shutdown_connections 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.870+0000 7fc92581e700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9201304a0 0x7fc92011b8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.871+0000 7fc92581e700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9200a0a30 0x7fc92011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.871+0000 7fc92581e700 1 --2- 172.21.15.125:0/2487771313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9200a1340 0x7fc92011b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.871+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 >> 172.21.15.125:0/2487771313 conn(0x7fc9200a2980 msgr2=0x7fc92006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.871+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 shutdown_connections 2023-10-03T10:12:06.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.871+0000 7fc92581e700 1 -- 172.21.15.125:0/2487771313 wait complete. 2023-10-03T10:12:06.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:06.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.890+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9500005860 con 0x7f952009e170 2023-10-03T10:12:06.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.890+0000 7f951cff9700 1 -- 172.21.15.125:0/806319174 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f951401f030 con 0x7f952009e170 2023-10-03T10:12:06.891 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:06.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.891+0000 7f951ffff700 1 -- 172.21.15.125:0/806319174 >> v1:172.21.15.125:6816/126957 conn(0x7f950c02f510 legacy=0x7f950c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 >> v1:172.21.15.125:6816/126957 conn(0x7f950c02f510 legacy=0x7f950c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 msgr2=0x7f95201ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f951400d990 tx=0x7f951400dca0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 shutdown_connections 2023-10-03T10:12:06.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9520130ce0 0x7f95201cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f952009d860 0x7f95201cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 --2- 172.21.15.125:0/806319174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f952009e170 0x7f95201ccbd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 >> 172.21.15.125:0/806319174 conn(0x7f9520099c40 msgr2=0x7f95200a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 shutdown_connections 2023-10-03T10:12:06.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.893+0000 7f9526886700 1 -- 172.21.15.125:0/806319174 wait complete. 2023-10-03T10:12:06.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:06.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.934+0000 7f88bed9d700 1 -- 172.21.15.125:0/1117006370 >> v1:172.21.15.125:6816/126957 conn(0x7f88ac02f510 legacy=0x7f88ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.953+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88c0119370 con 0x7f88c0138040 2023-10-03T10:12:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.954+0000 7f88a77fe700 1 -- 172.21.15.125:0/1117006370 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88c0119370 con 0x7f88c0138040 2023-10-03T10:12:06.955 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 >> v1:172.21.15.125:6816/126957 conn(0x7f88ac02f510 legacy=0x7f88ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 msgr2=0x7f88c0135fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 0x7f88c0135fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009df0 tx=0x7f88b8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 shutdown_connections 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88c0138040 0x7f88c0135fe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88c00a08e0 0x7f88c0137010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 --2- 172.21.15.125:0/1117006370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88c00a1400 0x7f88c0135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 >> 172.21.15.125:0/1117006370 conn(0x7f88c00a2980 msgr2=0x7f88c009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 shutdown_connections 2023-10-03T10:12:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:06.956+0000 7f88c5207700 1 -- 172.21.15.125:0/1117006370 wait complete. 2023-10-03T10:12:06.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:07.834 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:07.884 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:07.906 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:07.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.962+0000 7fab6155a700 1 Processor -- start 2023-10-03T10:12:07.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.962+0000 7fab6155a700 1 -- start start 2023-10-03T10:12:07.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab5c09d860 0x7fab5c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c130ce0 0x7fab5c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c131670 con 0x7fab5c09d860 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09aaa0 con 0x7fab5c09e170 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab6155a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09f870 con 0x7fab5c130ce0 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab5a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab5a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42832/0 (socket says 172.21.15.125:42832) 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab5a7fc700 1 -- 172.21.15.125:0/1746838186 learned_addr learned my addr 172.21.15.125:0/1746838186 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab5affd700 1 --2- 172.21.15.125:0/1746838186 >> v2:172.21.15.125:3300/0 conn(0x7fab5c09d860 0x7fab5c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.963+0000 7fab5b7fe700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c130ce0 0x7fab5c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 -- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c130ce0 msgr2=0x7fab5c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c130ce0 0x7fab5c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 -- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 msgr2=0x7fab5c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 -- 172.21.15.125:0/1746838186 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c09b360 con 0x7fab5c09d860 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5a7fc700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab5affd700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c09dc30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bb024132383a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab59ffb700 1 -- 172.21.15.125:0/1746838186 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011830 con 0x7fab5c09d860 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab59ffb700 1 -- 172.21.15.125:0/1746838186 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c011990 con 0x7fab5c09d860 2023-10-03T10:12:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.964+0000 7fab59ffb700 1 -- 172.21.15.125:0/1746838186 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011d20 con 0x7fab5c09d860 2023-10-03T10:12:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 -- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 msgr2=0x7fab5c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c09dc30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 -- 172.21.15.125:0/1746838186 shutdown_connections 2023-10-03T10:12:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c130ce0 0x7fab5c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c09dc30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 --2- 172.21.15.125:0/1746838186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c09e170 0x7fab5c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 -- 172.21.15.125:0/1746838186 >> 172.21.15.125:0/1746838186 conn(0x7fab5c099c40 msgr2=0x7fab5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 -- 172.21.15.125:0/1746838186 shutdown_connections 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.965+0000 7fab6155a700 1 -- 172.21.15.125:0/1746838186 wait complete. 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 Processor -- start 2023-10-03T10:12:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 -- start start 2023-10-03T10:12:07.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 0x7fab5c11c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 0x7fab5c1c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c11f1b0 con 0x7fab5c09d860 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c11f390 con 0x7fab5c130ce0 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab6155a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c130200 con 0x7fab5c09e170 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab5affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab5a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 0x7fab5c11c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.967+0000 7fab5affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57528/0 (socket says 172.21.15.125:57528) 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 -- 172.21.15.125:0/220253860 learned_addr learned my addr 172.21.15.125:0/220253860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5b7fe700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 0x7fab5c1c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 -- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 msgr2=0x7fab5c11c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 0x7fab5c11c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 -- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 msgr2=0x7fab5c1c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 0x7fab5c1c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 -- 172.21.15.125:0/220253860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009550 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5a7fc700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 0x7fab5c11c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5b7fe700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 0x7fab5c1c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab5affd700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009840 tx=0x7fab4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004450 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c01f070 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0038e0 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0094a0 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.968+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c09c8b0 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.969+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fab4c003a40 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.969+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c04f2a0 con 0x7fab5c09d860 2023-10-03T10:12:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.970+0000 7fab5a7fc700 1 -- 172.21.15.125:0/220253860 >> v1:172.21.15.125:6816/126957 conn(0x7fab4802f510 legacy=0x7fab480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.970+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fab4c021070 con 0x7fab5c09d860 2023-10-03T10:12:07.973 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:07.974+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab4c024be0 con 0x7fab5c09d860 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.024+0000 7f0247181700 1 Processor -- start 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.024+0000 7f0247181700 1 -- start start 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0247181700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 0x7f024006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0247181700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0247181700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024009da80 con 0x7f024006b080 2023-10-03T10:12:08.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0247181700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024009dce0 con 0x7f0240131ec0 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0247181700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f024009eb20 con 0x7f024006a770 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f024571e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f0244f1d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 0x7f024006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f024571e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57538/0 (socket says 172.21.15.125:57538) 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.025+0000 7f024571e700 1 -- 172.21.15.125:0/3969127906 learned_addr learned my addr 172.21.15.125:0/3969127906 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f02377fe700 1 -- 172.21.15.125:0/3969127906 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878135703 0 0) 0x7f024009da80 con 0x7f024006b080 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f0244f1d700 1 -- 172.21.15.125:0/3969127906 >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 msgr2=0x7f0240139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f0244f1d700 1 --2- 172.21.15.125:0/3969127906 >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f0244f1d700 1 -- 172.21.15.125:0/3969127906 >> v1:172.21.15.125:6789/0 conn(0x7f024006b080 legacy=0x7f02401317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f0244f1d700 1 -- 172.21.15.125:0/3969127906 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024009d860 con 0x7f024006a770 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f024571e700 1 --2- 172.21.15.125:0/3969127906 >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f0244f1d700 1 --2- 172.21.15.125:0/3969127906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 0x7f024006ab40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f370 tx=0x7f023c00f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a95c00830b2d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f02377fe700 1 -- 172.21.15.125:0/3969127906 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c012070 con 0x7f024006a770 2023-10-03T10:12:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f02377fe700 1 -- 172.21.15.125:0/3969127906 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c00fe70 con 0x7f024006a770 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.026+0000 7f02377fe700 1 -- 172.21.15.125:0/3969127906 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00d2f0 con 0x7f024006a770 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 -- 172.21.15.125:0/3969127906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 msgr2=0x7f024006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 --2- 172.21.15.125:0/3969127906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 0x7f024006ab40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f370 tx=0x7f023c00f680 comp rx=0 tx=0).stop 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 -- 172.21.15.125:0/3969127906 shutdown_connections 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 --2- 172.21.15.125:0/3969127906 >> v2:172.21.15.125:3300/0 conn(0x7f0240131ec0 0x7f0240139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 --2- 172.21.15.125:0/3969127906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f024006a770 0x7f024006ab40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 -- 172.21.15.125:0/3969127906 >> 172.21.15.125:0/3969127906 conn(0x7f0240099c40 msgr2=0x7f02400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 -- 172.21.15.125:0/3969127906 shutdown_connections 2023-10-03T10:12:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.027+0000 7f0247181700 1 -- 172.21.15.125:0/3969127906 wait complete. 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.028+0000 7f0247181700 1 Processor -- start 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.028+0000 7f0247181700 1 -- start start 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f024006b080 0x7f024011caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0240131ec0 0x7f02401c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024012f5b0 con 0x7f024006a770 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024011f470 con 0x7f024006b080 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0247181700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f024011c190 con 0x7f0240131ec0 2023-10-03T10:12:08.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0244f1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0244f1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57552/0 (socket says 172.21.15.125:57552) 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.029+0000 7f0244f1d700 1 -- 172.21.15.125:0/2484085401 learned_addr learned my addr 172.21.15.125:0/2484085401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f024571e700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0240131ec0 0x7f02401c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0237fff700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f024006b080 0x7f024011caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 -- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0240131ec0 msgr2=0x7f02401c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0240131ec0 0x7f02401c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 -- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f024006b080 msgr2=0x7f024011caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f024006b080 0x7f024011caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 -- 172.21.15.125:0/2484085401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238009550 con 0x7f024006a770 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0244f1d700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f9d0 tx=0x7f023c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00b950 con 0x7f024006a770 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c00baf0 con 0x7f024006a770 2023-10-03T10:12:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00bea0 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c00f050 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.030+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024011e440 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.032+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024004f2a0 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.032+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f023c004040 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.032+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f023c045480 con 0x7f024006a770 2023-10-03T10:12:08.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.032+0000 7f0237fff700 1 -- 172.21.15.125:0/2484085401 >> v1:172.21.15.125:6816/126957 conn(0x7f022c02f510 legacy=0x7f022c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.040+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f023c015980 con 0x7f024006a770 2023-10-03T10:12:08.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.061+0000 7f37598fb700 1 Processor -- start 2023-10-03T10:12:08.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 -- start start 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f375406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 0x7f3754139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375406e900 con 0x7f375406a770 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375409d180 con 0x7f3754136cb0 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f37598fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f375409e780 con 0x7f375409dec0 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f3752ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f375406a770 0x7f375406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36220/0 (socket says 172.21.15.125:36220) 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.062+0000 7f3752ffd700 1 -- 172.21.15.125:0/4011047398 learned_addr learned my addr 172.21.15.125:0/4011047398 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 0x7f3754139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37527fc700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f375406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 -- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 msgr2=0x7f375406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f375406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f3751ffb700 1 -- 172.21.15.125:0/4011047398 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177485338 0 0) 0x7f375406e900 con 0x7f375406a770 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 -- 172.21.15.125:0/4011047398 >> v1:172.21.15.125:6789/0 conn(0x7f375406a770 legacy=0x7f375406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 -- 172.21.15.125:0/4011047398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375409d3c0 con 0x7f3754136cb0 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37527fc700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f375406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f37537fe700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 0x7f3754139090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f374c009dc0 tx=0x7f374c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba14284a1a7b7da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f3751ffb700 1 -- 172.21.15.125:0/4011047398 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00e070 con 0x7f3754136cb0 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f3751ffb700 1 -- 172.21.15.125:0/4011047398 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00bbd0 con 0x7f3754136cb0 2023-10-03T10:12:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.063+0000 7f3751ffb700 1 -- 172.21.15.125:0/4011047398 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c012430 con 0x7f3754136cb0 2023-10-03T10:12:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 -- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 msgr2=0x7f3754139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 0x7f3754139090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f374c009dc0 tx=0x7f374c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 -- 172.21.15.125:0/4011047398 shutdown_connections 2023-10-03T10:12:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3754136cb0 0x7f3754139090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 --2- 172.21.15.125:0/4011047398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f375406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 -- 172.21.15.125:0/4011047398 >> 172.21.15.125:0/4011047398 conn(0x7f3754099c40 msgr2=0x7f37540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 -- 172.21.15.125:0/4011047398 shutdown_connections 2023-10-03T10:12:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.064+0000 7f37598fb700 1 -- 172.21.15.125:0/4011047398 wait complete. 2023-10-03T10:12:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 Processor -- start 2023-10-03T10:12:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 -- start start 2023-10-03T10:12:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f3754134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3754136cb0 0x7f3754134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754119630 con 0x7f3754136cb0 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37541357d0 con 0x7f375406a770 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.066+0000 7f37598fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3754119e10 con 0x7f375409dec0 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f37537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3754136cb0 0x7f3754134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42878/0 (socket says 172.21.15.125:42878) 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 -- 172.21.15.125:0/2515261362 learned_addr learned my addr 172.21.15.125:0/2515261362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f37527fc700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f3754134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 -- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 msgr2=0x7f3754134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f3754134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 -- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3754136cb0 msgr2=0x7f3754134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3754136cb0 0x7f3754134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 -- 172.21.15.125:0/2515261362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009a70 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f3752ffd700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f374400c550 tx=0x7f374400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744004c80 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744004e00 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744007310 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375411a9b0 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.067+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754071ce0 con 0x7f375406a770 2023-10-03T10:12:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.069+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375404f2a0 con 0x7f375406a770 2023-10-03T10:12:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.069+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3744007470 con 0x7f375406a770 2023-10-03T10:12:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.070+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f374403f8a0 con 0x7f375406a770 2023-10-03T10:12:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.070+0000 7f37527fc700 1 -- 172.21.15.125:0/2515261362 >> v1:172.21.15.125:6816/126957 conn(0x7f374002f510 legacy=0x7f37400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.078+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3744013e40 con 0x7f375406a770 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.107+0000 7f4b0665f700 1 Processor -- start 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 -- start start 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 0x7f4b00133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b001343a0 0x7f4b000a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0009b110 con 0x7f4b00133f70 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b000a3b60 con 0x7f4b001343a0 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b0665f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000a2fa0 con 0x7f4b0009ad40 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4aff7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b00133f70 0x7f4b000a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36226/0 (socket says 172.21.15.125:36226) 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4aff7fe700 1 -- 172.21.15.125:0/2543838818 learned_addr learned my addr 172.21.15.125:0/2543838818 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4afffff700 1 --2- 172.21.15.125:0/2543838818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 0x7f4b00133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.108+0000 7f4b04bfc700 1 --2- 172.21.15.125:0/2543838818 >> v2:172.21.15.125:3300/0 conn(0x7f4b001343a0 0x7f4b000a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afffff700 1 -- 172.21.15.125:0/2543838818 >> v2:172.21.15.125:3300/0 conn(0x7f4b001343a0 msgr2=0x7f4b000a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afffff700 1 --2- 172.21.15.125:0/2543838818 >> v2:172.21.15.125:3300/0 conn(0x7f4b001343a0 0x7f4b000a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afffff700 1 -- 172.21.15.125:0/2543838818 >> v1:172.21.15.125:6789/0 conn(0x7f4b00133f70 legacy=0x7f4b000a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afeffd700 1 -- 172.21.15.125:0/2543838818 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215734865 0 0) 0x7f4b0009b110 con 0x7f4b00133f70 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afffff700 1 -- 172.21.15.125:0/2543838818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0009a280 con 0x7f4b0009ad40 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afffff700 1 --2- 172.21.15.125:0/2543838818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 0x7f4b00133a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009870 tx=0x7f4af0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2ba6c618f89a2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afeffd700 1 -- 172.21.15.125:0/2543838818 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011830 con 0x7f4b0009ad40 2023-10-03T10:12:08.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afeffd700 1 -- 172.21.15.125:0/2543838818 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0011990 con 0x7f4b0009ad40 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.109+0000 7f4afeffd700 1 -- 172.21.15.125:0/2543838818 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011d20 con 0x7f4b0009ad40 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 -- 172.21.15.125:0/2543838818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 msgr2=0x7f4b00133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 --2- 172.21.15.125:0/2543838818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 0x7f4b00133a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009870 tx=0x7f4af0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 -- 172.21.15.125:0/2543838818 shutdown_connections 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 --2- 172.21.15.125:0/2543838818 >> v2:172.21.15.125:3300/0 conn(0x7f4b001343a0 0x7f4b000a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 --2- 172.21.15.125:0/2543838818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b0009ad40 0x7f4b00133a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 -- 172.21.15.125:0/2543838818 >> 172.21.15.125:0/2543838818 conn(0x7f4b00099c40 msgr2=0x7f4b0006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 -- 172.21.15.125:0/2543838818 shutdown_connections 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.110+0000 7f4b0665f700 1 -- 172.21.15.125:0/2543838818 wait complete. 2023-10-03T10:12:08.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 Processor -- start 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 -- start start 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0009ad40 0x7f4b0011d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 0x7f4b001c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b001307c0 con 0x7f4b00133f70 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0011d3f0 con 0x7f4b001343a0 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.111+0000 7f4b0665f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00120430 con 0x7f4b0009ad40 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57572/0 (socket says 172.21.15.125:57572) 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 -- 172.21.15.125:0/329618476 learned_addr learned my addr 172.21.15.125:0/329618476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4b04bfc700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 0x7f4b001c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 -- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0009ad40 msgr2=0x7f4b0011d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0009ad40 0x7f4b0011d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 -- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 msgr2=0x7f4b001c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 0x7f4b001c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 -- 172.21.15.125:0/329618476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00094a0 con 0x7f4b00133f70 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4b04bfc700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 0x7f4b001c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4aff7fe700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c520 tx=0x7f4af400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004c80 con 0x7f4b00133f70 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af4004de0 con 0x7f4b00133f70 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4007310 con 0x7f4b00133f70 2023-10-03T10:12:08.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b00120680 con 0x7f4b00133f70 2023-10-03T10:12:08.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.112+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b001210f0 con 0x7f4b00133f70 2023-10-03T10:12:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.114+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0004f2a0 con 0x7f4b00133f70 2023-10-03T10:12:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.114+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4af4007470 con 0x7f4b00133f70 2023-10-03T10:12:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.114+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4af403fe40 con 0x7f4b00133f70 2023-10-03T10:12:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.114+0000 7f4afffff700 1 -- 172.21.15.125:0/329618476 >> v1:172.21.15.125:6816/126957 conn(0x7f4aec02f510 legacy=0x7f4aec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.123+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4af40133c0 con 0x7f4b00133f70 2023-10-03T10:12:08.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.171+0000 7fab5a7fc700 1 -- 172.21.15.125:0/220253860 >> v1:172.21.15.125:6816/126957 conn(0x7fab4802f510 legacy=0x7fab480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.184+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab5c11d480 con 0x7fab5c09d860 2023-10-03T10:12:08.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.184+0000 7fab437fe700 1 -- 172.21.15.125:0/220253860 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab4c02b020 con 0x7fab5c09d860 2023-10-03T10:12:08.184 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 >> v1:172.21.15.125:6816/126957 conn(0x7fab4802f510 legacy=0x7fab480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 msgr2=0x7fab5c11c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009840 tx=0x7fab4c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 shutdown_connections 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab5c130ce0 0x7fab5c1c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab5c09d860 0x7fab5c11c240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 --2- 172.21.15.125:0/220253860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab5c09e170 0x7fab5c11c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 >> 172.21.15.125:0/220253860 conn(0x7fab5c099c40 msgr2=0x7fab5c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 shutdown_connections 2023-10-03T10:12:08.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.186+0000 7fab6155a700 1 -- 172.21.15.125:0/220253860 wait complete. 2023-10-03T10:12:08.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:08.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.233+0000 7f0237fff700 1 -- 172.21.15.125:0/2484085401 >> v1:172.21.15.125:6816/126957 conn(0x7f022c02f510 legacy=0x7f022c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.245+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f024011e8e0 con 0x7f024006a770 2023-10-03T10:12:08.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.246+0000 7f02357fa700 1 -- 172.21.15.125:0/2484085401 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f023c024090 con 0x7f024006a770 2023-10-03T10:12:08.246 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:08.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 >> v1:172.21.15.125:6816/126957 conn(0x7f022c02f510 legacy=0x7f022c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:08.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 msgr2=0x7f024011c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f9d0 tx=0x7f023c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 shutdown_connections 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0240131ec0 0x7f02401c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024006a770 0x7f024011c5b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 --2- 172.21.15.125:0/2484085401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f024006b080 0x7f024011caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 >> 172.21.15.125:0/2484085401 conn(0x7f0240099c40 msgr2=0x7f0240130de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 shutdown_connections 2023-10-03T10:12:08.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.248+0000 7f0247181700 1 -- 172.21.15.125:0/2484085401 wait complete. 2023-10-03T10:12:08.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:08.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.271+0000 7f37527fc700 1 -- 172.21.15.125:0/2515261362 >> v1:172.21.15.125:6816/126957 conn(0x7f374002f510 legacy=0x7f37400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.277+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f375411a530 con 0x7f375406a770 2023-10-03T10:12:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.277+0000 7f373bfff700 1 -- 172.21.15.125:0/2515261362 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f375411a530 con 0x7f375406a770 2023-10-03T10:12:08.278 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 >> v1:172.21.15.125:6816/126957 conn(0x7f374002f510 legacy=0x7f37400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 msgr2=0x7f3754134320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f374400c550 tx=0x7f374400c860 comp rx=0 tx=0).stop 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 shutdown_connections 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3754136cb0 0x7f3754134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375406a770 0x7f3754134320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 --2- 172.21.15.125:0/2515261362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f375409dec0 0x7f3754134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 >> 172.21.15.125:0/2515261362 conn(0x7f3754099c40 msgr2=0x7f375412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 shutdown_connections 2023-10-03T10:12:08.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.279+0000 7f37598fb700 1 -- 172.21.15.125:0/2515261362 wait complete. 2023-10-03T10:12:08.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.315+0000 7f4afffff700 1 -- 172.21.15.125:0/329618476 >> v1:172.21.15.125:6816/126957 conn(0x7f4aec02f510 legacy=0x7f4aec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.319+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b000729d0 con 0x7f4b00133f70 2023-10-03T10:12:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.319+0000 7f4afcff9700 1 -- 172.21.15.125:0/329618476 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4af4011360 con 0x7f4b00133f70 2023-10-03T10:12:08.319 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 >> v1:172.21.15.125:6816/126957 conn(0x7f4aec02f510 legacy=0x7f4aec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 msgr2=0x7f4b0011de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c520 tx=0x7f4af400c830 comp rx=0 tx=0).stop 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 shutdown_connections 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b001343a0 0x7f4b001c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b0009ad40 0x7f4b0011d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 --2- 172.21.15.125:0/329618476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b00133f70 0x7f4b0011de10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 >> 172.21.15.125:0/329618476 conn(0x7f4b00099c40 msgr2=0x7f4b000a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 shutdown_connections 2023-10-03T10:12:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:08.321+0000 7f4b0665f700 1 -- 172.21.15.125:0/329618476 wait complete. 2023-10-03T10:12:08.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:09.200 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:09.262 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:09.292 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:09.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:09.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.336+0000 7f1fad42e700 1 Processor -- start 2023-10-03T10:12:09.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.336+0000 7f1fad42e700 1 -- start start 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fad42e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 0x7f1fa8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fad42e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fa81393a0 0x7f1fa813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fad42e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa809fa00 con 0x7f1fa809e870 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fad42e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80a0370 con 0x7f1fa81393a0 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fad42e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa806bec0 con 0x7f1fa809f350 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 0x7f1fa8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fa81393a0 0x7f1fa813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 0x7f1fa8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42896/0 (socket says 172.21.15.125:42896) 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa67fc700 1 -- 172.21.15.125:0/3606931179 learned_addr learned my addr 172.21.15.125:0/3606931179 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa6ffd700 1 --1- 172.21.15.125:0/3606931179 >> v1:172.21.15.125:6789/0 conn(0x7f1fa809e870 0x7f1fa809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36228/0 (socket says 172.21.15.125:36228) 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 msgr2=0x7f1fa8138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa77fe700 1 --2- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 0x7f1fa8138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3606931179 >> v1:172.21.15.125:6789/0 conn(0x7f1fa809e870 legacy=0x7f1fa809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.337+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3606931179 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa809ada0 con 0x7f1fa81393a0 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.338+0000 7f1fa77fe700 1 --2- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa81393a0 0x7f1fa813b780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009d90 tx=0x7f1fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754aa146181b30ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.338+0000 7f1fa5ffb700 1 -- 172.21.15.125:0/3606931179 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000e070 con 0x7f1fa81393a0 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.338+0000 7f1fa5ffb700 1 -- 172.21.15.125:0/3606931179 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000bb20 con 0x7f1fa81393a0 2023-10-03T10:12:09.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.338+0000 7f1fa5ffb700 1 -- 172.21.15.125:0/3606931179 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0012430 con 0x7f1fa81393a0 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 -- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa81393a0 msgr2=0x7f1fa813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa81393a0 0x7f1fa813b780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009d90 tx=0x7f1fa000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 -- 172.21.15.125:0/3606931179 shutdown_connections 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa81393a0 0x7f1fa813b780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3606931179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa809f350 0x7f1fa8138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 -- 172.21.15.125:0/3606931179 >> 172.21.15.125:0/3606931179 conn(0x7f1fa80a4430 msgr2=0x7f1fa80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 -- 172.21.15.125:0/3606931179 shutdown_connections 2023-10-03T10:12:09.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.339+0000 7f1fad42e700 1 -- 172.21.15.125:0/3606931179 wait complete. 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.340+0000 7f1fad42e700 1 Processor -- start 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.340+0000 7f1fad42e700 1 -- start start 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fa809e870 0x7f1fa811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa809f350 0x7f1fa811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8121ca0 con 0x7f1fa809f350 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa806cfa0 con 0x7f1fa81393a0 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fad42e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8122160 con 0x7f1fa809e870 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42904/0 (socket says 172.21.15.125:42904) 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3385169100 learned_addr learned my addr 172.21.15.125:0/3385169100 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fa809e870 msgr2=0x7f1fa811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fa809e870 0x7f1fa811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa809f350 msgr2=0x7f1fa811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa809f350 0x7f1fa811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.341+0000 7f1fa77fe700 1 -- 172.21.15.125:0/3385169100 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009a70 con 0x7f1fa81393a0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1fa77fe700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0014040 tx=0x7f1fa0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0012430 con 0x7f1fa81393a0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0020070 con 0x7f1fa81393a0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa806f8f0 con 0x7f1fa81393a0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0003ea0 con 0x7f1fa81393a0 2023-10-03T10:12:09.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.342+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa8122bd0 con 0x7f1fa81393a0 2023-10-03T10:12:09.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.343+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa806ad00 con 0x7f1fa81393a0 2023-10-03T10:12:09.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.343+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1fa0004280 con 0x7f1fa81393a0 2023-10-03T10:12:09.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.344+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1fa0022070 con 0x7f1fa81393a0 2023-10-03T10:12:09.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.344+0000 7f1fa6ffd700 1 -- 172.21.15.125:0/3385169100 >> v1:172.21.15.125:6816/126957 conn(0x7f1f9402f510 legacy=0x7f1f940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.349+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fa0004530 con 0x7f1fa81393a0 2023-10-03T10:12:09.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.413+0000 7efced81a700 1 Processor -- start 2023-10-03T10:12:09.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.413+0000 7efced81a700 1 -- start start 2023-10-03T10:12:09.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efced81a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce8133a70 0x7efce8133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efced81a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efce80a08e0 0x7efce80a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efced81a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce8133640 con 0x7efce80a1290 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efced81a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce80a1d50 con 0x7efce80a08e0 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efced81a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce809b620 con 0x7efce8133a70 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efce80a08e0 0x7efce80a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efce80a08e0 0x7efce80a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57602/0 (socket says 172.21.15.125:57602) 2023-10-03T10:12:09.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 -- 172.21.15.125:0/946868885 learned_addr learned my addr 172.21.15.125:0/946868885 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 -- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce8133a70 msgr2=0x7efce8133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 --2- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce8133a70 0x7efce8133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 -- 172.21.15.125:0/946868885 >> v1:172.21.15.125:6789/0 conn(0x7efce80a1290 legacy=0x7efce813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.414+0000 7efce67fc700 1 -- 172.21.15.125:0/946868885 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8133870 con 0x7efce80a08e0 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efce67fc700 1 --2- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a08e0 0x7efce80a0d50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098f0 tx=0x7efcdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6967be918e833eec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efce5ffb700 1 -- 172.21.15.125:0/946868885 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00b8a0 con 0x7efce80a08e0 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efce5ffb700 1 -- 172.21.15.125:0/946868885 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00ba00 con 0x7efce80a08e0 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efce5ffb700 1 -- 172.21.15.125:0/946868885 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00bd90 con 0x7efce80a08e0 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efced81a700 1 -- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a08e0 msgr2=0x7efce80a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.415+0000 7efced81a700 1 --2- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a08e0 0x7efce80a0d50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098f0 tx=0x7efcdc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 -- 172.21.15.125:0/946868885 shutdown_connections 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 --2- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce8133a70 0x7efce8133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 --2- 172.21.15.125:0/946868885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a08e0 0x7efce80a0d50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 -- 172.21.15.125:0/946868885 >> 172.21.15.125:0/946868885 conn(0x7efce80a2980 msgr2=0x7efce80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 -- 172.21.15.125:0/946868885 shutdown_connections 2023-10-03T10:12:09.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 -- 172.21.15.125:0/946868885 wait complete. 2023-10-03T10:12:09.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.416+0000 7efced81a700 1 Processor -- start 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 -- start start 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce80a08e0 0x7efce811fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efce8133a70 0x7efce8120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8130880 con 0x7efce80a1290 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce8122f10 con 0x7efce80a08e0 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efced81a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce8123290 con 0x7efce8133a70 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efce67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efce67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57618/0 (socket says 172.21.15.125:57618) 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efce67fc700 1 -- 172.21.15.125:0/3468654932 learned_addr learned my addr 172.21.15.125:0/3468654932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.417+0000 7efce6ffd700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce80a08e0 0x7efce811fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 -- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efce8133a70 msgr2=0x7efce8120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efce8133a70 0x7efce8120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 -- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce80a08e0 msgr2=0x7efce811fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce80a08e0 0x7efce811fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 -- 172.21.15.125:0/3468654932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009550 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efce67fc700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efcdc013000 tx=0x7efcdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0036a0 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc003800 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce8072720 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc003b70 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.418+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce8121890 con 0x7efce80a1290 2023-10-03T10:12:09.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.419+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce804f2a0 con 0x7efce80a1290 2023-10-03T10:12:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.419+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efcdc003cd0 con 0x7efce80a1290 2023-10-03T10:12:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.420+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efcdc021030 con 0x7efce80a1290 2023-10-03T10:12:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.420+0000 7efce6ffd700 1 -- 172.21.15.125:0/3468654932 >> v1:172.21.15.125:6816/126957 conn(0x7efcd402f510 legacy=0x7efcd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.424+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcdc010380 con 0x7efce80a1290 2023-10-03T10:12:09.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.438+0000 7f332670f700 1 Processor -- start 2023-10-03T10:12:09.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.438+0000 7f332670f700 1 -- start start 2023-10-03T10:12:09.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f332670f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f33201349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f332670f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f332670f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332009eca0 con 0x7f332009dea0 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f332670f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332006b2e0 con 0x7f332006a770 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f332670f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f332009f720 con 0x7f3320134f00 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f3324cac700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f332009dea0 0x7f332013ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36250/0 (socket says 172.21.15.125:36250) 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f3324cac700 1 -- 172.21.15.125:0/1676894329 learned_addr learned my addr 172.21.15.125:0/1676894329 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331ffff700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f33201349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331f7fe700 1 -- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 msgr2=0x7f33201349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331f7fe700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f33201349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331f7fe700 1 -- 172.21.15.125:0/1676894329 >> v1:172.21.15.125:6789/0 conn(0x7f332009dea0 legacy=0x7f332013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.439+0000 7f331f7fe700 1 -- 172.21.15.125:0/1676894329 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332006b480 con 0x7f3320134f00 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f331f7fe700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332009d960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3314009870 tx=0x7f3314009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e04d3ee25d9b57b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f331effd700 1 -- 172.21.15.125:0/1676894329 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314011830 con 0x7f3320134f00 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f331effd700 1 -- 172.21.15.125:0/1676894329 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314011990 con 0x7f3320134f00 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f331effd700 1 -- 172.21.15.125:0/1676894329 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314011d20 con 0x7f3320134f00 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 -- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 msgr2=0x7f332009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332009d960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3314009870 tx=0x7f3314009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 -- 172.21.15.125:0/1676894329 shutdown_connections 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f33201349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 --2- 172.21.15.125:0/1676894329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332009d960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.440+0000 7f332670f700 1 -- 172.21.15.125:0/1676894329 >> 172.21.15.125:0/1676894329 conn(0x7f3320099c40 msgr2=0x7f33200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.441+0000 7f332670f700 1 -- 172.21.15.125:0/1676894329 shutdown_connections 2023-10-03T10:12:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.441+0000 7f332670f700 1 -- 172.21.15.125:0/1676894329 wait complete. 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.441+0000 7f332670f700 1 Processor -- start 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 -- start start 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f332011a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332011b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332011bd40 con 0x7f332009dea0 2023-10-03T10:12:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33200a3060 con 0x7f332006a770 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f332670f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f332009f220 con 0x7f3320134f00 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f331f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f331ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f332011a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f331f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57634/0 (socket says 172.21.15.125:57634) 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f331f7fe700 1 -- 172.21.15.125:0/359680137 learned_addr learned my addr 172.21.15.125:0/359680137 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.442+0000 7f3324cac700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332011b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 -- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 msgr2=0x7f332011b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332011b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 -- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 msgr2=0x7f332011a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f332011a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 -- 172.21.15.125:0/359680137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140094a0 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331f7fe700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3314000c00 tx=0x7f3314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314004510 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33140036a0 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314003a50 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3320126900 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.443+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332011ca00 con 0x7f332009dea0 2023-10-03T10:12:09.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.444+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3314003bb0 con 0x7f332009dea0 2023-10-03T10:12:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.444+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f33140407d0 con 0x7f332009dea0 2023-10-03T10:12:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.444+0000 7f331ffff700 1 -- 172.21.15.125:0/359680137 >> v1:172.21.15.125:6816/126957 conn(0x7f330c02f510 legacy=0x7f330c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.445+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332004f2a0 con 0x7f332009dea0 2023-10-03T10:12:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.453+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3314015080 con 0x7f332009dea0 2023-10-03T10:12:09.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.467+0000 7fafe2751700 1 Processor -- start 2023-10-03T10:12:09.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.467+0000 7fafe2751700 1 -- start start 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe2751700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc09f350 0x7fafdc138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe2751700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fafdc1393a0 0x7fafdc13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe2751700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc09fa00 con 0x7fafdc09e870 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe2751700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafdc0a0370 con 0x7fafdc1393a0 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe2751700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc06bec0 con 0x7fafdc09f350 2023-10-03T10:12:09.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafdb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc09f350 0x7fafdc138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafdbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fafdc09e870 0x7fafdc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36260/0 (socket says 172.21.15.125:36260) 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafdbfff700 1 -- 172.21.15.125:0/808263559 learned_addr learned my addr 172.21.15.125:0/808263559 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe0cee700 1 --2- 172.21.15.125:0/808263559 >> v2:172.21.15.125:3300/0 conn(0x7fafdc1393a0 0x7fafdc13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe0cee700 1 -- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc09f350 msgr2=0x7fafdc138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe0cee700 1 --2- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc09f350 0x7fafdc138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe0cee700 1 -- 172.21.15.125:0/808263559 >> v1:172.21.15.125:6789/0 conn(0x7fafdc09e870 legacy=0x7fafdc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafdaffd700 1 -- 172.21.15.125:0/808263559 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988305516 0 0) 0x7fafdc09fa00 con 0x7fafdc09e870 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.468+0000 7fafe0cee700 1 -- 172.21.15.125:0/808263559 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc09ada0 con 0x7fafdc1393a0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe0cee700 1 --2- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc1393a0 0x7fafdc13b780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009d90 tx=0x7fafd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987e112a9758d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafdaffd700 1 -- 172.21.15.125:0/808263559 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd400e070 con 0x7fafdc1393a0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafdaffd700 1 -- 172.21.15.125:0/808263559 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd400bb20 con 0x7fafdc1393a0 2023-10-03T10:12:09.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafdaffd700 1 -- 172.21.15.125:0/808263559 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4012430 con 0x7fafdc1393a0 2023-10-03T10:12:09.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 -- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc1393a0 msgr2=0x7fafdc13b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 --2- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc1393a0 0x7fafdc13b780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009d90 tx=0x7fafd400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 -- 172.21.15.125:0/808263559 shutdown_connections 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 --2- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc1393a0 0x7fafdc13b780 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 --2- 172.21.15.125:0/808263559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc09f350 0x7fafdc138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 -- 172.21.15.125:0/808263559 >> 172.21.15.125:0/808263559 conn(0x7fafdc0a4430 msgr2=0x7fafdc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.469+0000 7fafe2751700 1 -- 172.21.15.125:0/808263559 shutdown_connections 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.470+0000 7fafe2751700 1 -- 172.21.15.125:0/808263559 wait complete. 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.470+0000 7fafe2751700 1 Processor -- start 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 -- start start 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafdc09f350 0x7fafdc120db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc1393a0 0x7fafdc1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc122670 con 0x7fafdc09e870 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc122480 con 0x7fafdc1393a0 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe2751700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc1367f0 con 0x7fafdc09f350 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57660/0 (socket says 172.21.15.125:57660) 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafdbfff700 1 -- 172.21.15.125:0/774481459 learned_addr learned my addr 172.21.15.125:0/774481459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafdb7fe700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafdc09f350 0x7fafdc120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.471+0000 7fafe0cee700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc1393a0 0x7fafdc1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 -- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafdc09f350 msgr2=0x7fafdc120db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafdc09f350 0x7fafdc120db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 -- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc1393a0 msgr2=0x7fafdc1212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc1393a0 0x7fafdc1212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 -- 172.21.15.125:0/774481459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4009a70 con 0x7fafdc09e870 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafdbfff700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c550 tx=0x7fafcc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc004c80 con 0x7fafdc09e870 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc06cfa0 con 0x7fafdc09e870 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc004de0 con 0x7fafdc09e870 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc007310 con 0x7fafdc09e870 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.472+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc122c70 con 0x7fafdc09e870 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.473+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fafcc007470 con 0x7fafdc09e870 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.473+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fafcc03f730 con 0x7fafdc09e870 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.473+0000 7fafdb7fe700 1 -- 172.21.15.125:0/774481459 >> v1:172.21.15.125:6816/126957 conn(0x7fafc802f510 legacy=0x7fafc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.473+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc04f2a0 con 0x7fafdc09e870 2023-10-03T10:12:09.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.482+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafcc0123b0 con 0x7fafdc09e870 2023-10-03T10:12:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.545+0000 7f1fa6ffd700 1 -- 172.21.15.125:0/3385169100 >> v1:172.21.15.125:6816/126957 conn(0x7f1f9402f510 legacy=0x7f1f940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.597+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fa8121de0 con 0x7f1fa81393a0 2023-10-03T10:12:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.598+0000 7f1f8f7fe700 1 -- 172.21.15.125:0/3385169100 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fa8121de0 con 0x7f1fa81393a0 2023-10-03T10:12:09.597 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 >> v1:172.21.15.125:6816/126957 conn(0x7f1f9402f510 legacy=0x7f1f940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 msgr2=0x7f1fa811f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0014040 tx=0x7f1fa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 shutdown_connections 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fa81393a0 0x7f1fa811f550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fa809e870 0x7f1fa811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 --2- 172.21.15.125:0/3385169100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fa809f350 0x7f1fa811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 >> 172.21.15.125:0/3385169100 conn(0x7f1fa80a4430 msgr2=0x7f1fa8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 shutdown_connections 2023-10-03T10:12:09.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.601+0000 7f1fad42e700 1 -- 172.21.15.125:0/3385169100 wait complete. 2023-10-03T10:12:09.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:09.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.621+0000 7efce6ffd700 1 -- 172.21.15.125:0/3468654932 >> v1:172.21.15.125:6816/126957 conn(0x7efcd402f510 legacy=0x7efcd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.645+0000 7f331ffff700 1 -- 172.21.15.125:0/359680137 >> v1:172.21.15.125:6816/126957 conn(0x7f330c02f510 legacy=0x7f330c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.673+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f332006c3b0 con 0x7f332009dea0 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.674+0000 7f331cff9700 1 -- 172.21.15.125:0/359680137 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3314028030 con 0x7f332009dea0 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.674+0000 7fafdb7fe700 1 -- 172.21.15.125:0/774481459 >> v1:172.21.15.125:6816/126957 conn(0x7fafc802f510 legacy=0x7fafc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:09.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.674+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efce8131220 con 0x7efce80a1290 2023-10-03T10:12:09.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.675+0000 7efccffff700 1 -- 172.21.15.125:0/3468654932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcdc015090 con 0x7efce80a1290 2023-10-03T10:12:09.674 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:09.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 >> v1:172.21.15.125:6816/126957 conn(0x7f330c02f510 legacy=0x7f330c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:09.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 msgr2=0x7f332011ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3314000c00 tx=0x7f3314004750 comp rx=0 tx=0).stop 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 shutdown_connections 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3320134f00 0x7f332011b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f332006a770 0x7f332011a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 --2- 172.21.15.125:0/359680137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f332009dea0 0x7f332011ae20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 >> 172.21.15.125:0/359680137 conn(0x7f3320099c40 msgr2=0x7f332009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 shutdown_connections 2023-10-03T10:12:09.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.676+0000 7f332670f700 1 -- 172.21.15.125:0/359680137 wait complete. 2023-10-03T10:12:09.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 >> v1:172.21.15.125:6816/126957 conn(0x7efcd402f510 legacy=0x7efcd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:09.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 msgr2=0x7efce81201c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efcdc013000 tx=0x7efcdc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:09.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 shutdown_connections 2023-10-03T10:12:09.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efce8133a70 0x7efce8120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce80a08e0 0x7efce811fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 --2- 172.21.15.125:0/3468654932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce80a1290 0x7efce81201c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 >> 172.21.15.125:0/3468654932 conn(0x7efce80a2980 msgr2=0x7efce809e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 shutdown_connections 2023-10-03T10:12:09.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.677+0000 7efced81a700 1 -- 172.21.15.125:0/3468654932 wait complete. 2023-10-03T10:12:09.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:09.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:09.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.722+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fafdc072d60 con 0x7fafdc09e870 2023-10-03T10:12:09.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.722+0000 7fafd8ff9700 1 -- 172.21.15.125:0/774481459 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafcc0102c0 con 0x7fafdc09e870 2023-10-03T10:12:09.722 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 >> v1:172.21.15.125:6816/126957 conn(0x7fafc802f510 legacy=0x7fafc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 msgr2=0x7fafdc120870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c550 tx=0x7fafcc00c860 comp rx=0 tx=0).stop 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 shutdown_connections 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafdc1393a0 0x7fafdc1212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafdc09e870 0x7fafdc120870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 --2- 172.21.15.125:0/774481459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafdc09f350 0x7fafdc120db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 >> 172.21.15.125:0/774481459 conn(0x7fafdc0a4430 msgr2=0x7fafdc136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 shutdown_connections 2023-10-03T10:12:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:09.724+0000 7fafe2751700 1 -- 172.21.15.125:0/774481459 wait complete. 2023-10-03T10:12:09.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:10.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:10.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:10.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:10.737 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:10.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.746+0000 7f2c74ff1700 1 Processor -- start 2023-10-03T10:12:10.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.746+0000 7f2c74ff1700 1 -- start start 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c74ff1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7009a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c74ff1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c70130a60 0x7f2c70138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c74ff1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7009b930 con 0x7f2c7009a7c0 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c74ff1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c70072410 con 0x7f2c70130a60 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c74ff1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7009cd30 con 0x7f2c70099eb0 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c6ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c70130a60 0x7f2c70138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c6ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c70130a60 0x7f2c70138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57670/0 (socket says 172.21.15.125:57670) 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c6ed9d700 1 -- 172.21.15.125:0/2964425765 learned_addr learned my addr 172.21.15.125:0/2964425765 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.747+0000 7f2c6e59c700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7009a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6ed9d700 1 -- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 msgr2=0x7f2c7009a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6ed9d700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7009a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6ed9d700 1 -- 172.21.15.125:0/2964425765 >> v1:172.21.15.125:6789/0 conn(0x7f2c7009a7c0 legacy=0x7f2c70130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6ed9d700 1 -- 172.21.15.125:0/2964425765 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70099a60 con 0x7f2c70130a60 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6ed9d700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c70130a60 0x7f2c70138690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009e50 tx=0x7f2c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed10a6340bf010f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6d59a700 1 -- 172.21.15.125:0/2964425765 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800e070 con 0x7f2c70130a60 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6d59a700 1 -- 172.21.15.125:0/2964425765 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800b9c0 con 0x7f2c70130a60 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.748+0000 7f2c6d59a700 1 -- 172.21.15.125:0/2964425765 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800bd70 con 0x7f2c70130a60 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 -- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c70130a60 msgr2=0x7f2c70138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c70130a60 0x7f2c70138690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009e50 tx=0x7f2c6800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:10.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 -- 172.21.15.125:0/2964425765 shutdown_connections 2023-10-03T10:12:10.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c70130a60 0x7f2c70138690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/2964425765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7009a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 -- 172.21.15.125:0/2964425765 >> 172.21.15.125:0/2964425765 conn(0x7f2c700a2980 msgr2=0x7f2c700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 -- 172.21.15.125:0/2964425765 shutdown_connections 2023-10-03T10:12:10.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.749+0000 7f2c74ff1700 1 -- 172.21.15.125:0/2964425765 wait complete. 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.750+0000 7f2c74ff1700 1 Processor -- start 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 -- start start 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 0x7f2c7013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c70130a60 0x7f2c7013c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7013d2d0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7013e270 con 0x7f2c70099eb0 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c74ff1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7013d9a0 con 0x7f2c70130a60 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c6dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 0x7f2c7013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42986/0 (socket says 172.21.15.125:42986) 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c6e59c700 1 -- 172.21.15.125:0/3442707710 learned_addr learned my addr 172.21.15.125:0/3442707710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.751+0000 7f2c6ed9d700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c70130a60 0x7f2c7013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 -- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c70130a60 msgr2=0x7f2c7013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c70130a60 0x7f2c7013c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 -- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 msgr2=0x7f2c7013be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 -- 172.21.15.125:0/3442707710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009b30 con 0x7f2c7009a7c0 2023-10-03T10:12:10.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6e59c700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c6dd9b700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 0x7f2c7013c360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c700726d0 tx=0x7f2c6400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640052d0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64005430 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7013f8b0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640038c0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.752+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7009b490 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.753+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2c64003a20 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.753+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2c6403efb0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.753+0000 7f2c6e59c700 1 -- 172.21.15.125:0/3442707710 >> v1:172.21.15.125:6816/126957 conn(0x7f2c5002f510 legacy=0x7f2c500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:10.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.754+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c70071740 con 0x7f2c7009a7c0 2023-10-03T10:12:10.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.759+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c64019d00 con 0x7f2c7009a7c0 2023-10-03T10:12:10.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.823+0000 7f4af4ca5700 1 Processor -- start 2023-10-03T10:12:10.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.823+0000 7f4af4ca5700 1 -- start start 2023-10-03T10:12:10.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4af4ca5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af009d860 0x7f4af009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4af4ca5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 0x7f4af0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4af4ca5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af009aaa0 con 0x7f4af009e170 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4af4ca5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af009f870 con 0x7f4af0130eb0 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4af4ca5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4af009b360 con 0x7f4af009d860 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 0x7f4af0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aedd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4af009e170 0x7f4af01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36268/0 (socket says 172.21.15.125:36268) 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aedd9b700 1 -- 172.21.15.125:0/2997079903 learned_addr learned my addr 172.21.15.125:0/2997079903 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:10.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aee59c700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af009d860 0x7f4af009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 -- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af009d860 msgr2=0x7f4af009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af009d860 0x7f4af009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aed59a700 1 -- 172.21.15.125:0/2997079903 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092520821 0 0) 0x7f4af009aaa0 con 0x7f4af009e170 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 -- 172.21.15.125:0/2997079903 >> v1:172.21.15.125:6789/0 conn(0x7f4af009e170 legacy=0x7f4af01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 -- 172.21.15.125:0/2997079903 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af009b620 con 0x7f4af0130eb0 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.824+0000 7f4aeed9d700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 0x7f4af0138a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009dc0 tx=0x7f4ae800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15bab4d2d2bb4f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4aed59a700 1 -- 172.21.15.125:0/2997079903 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae800e070 con 0x7f4af0130eb0 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4aed59a700 1 -- 172.21.15.125:0/2997079903 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae800bb20 con 0x7f4af0130eb0 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4aed59a700 1 -- 172.21.15.125:0/2997079903 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8012430 con 0x7f4af0130eb0 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 msgr2=0x7f4af0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 0x7f4af0138a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009dc0 tx=0x7f4ae800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2997079903 shutdown_connections 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af0130eb0 0x7f4af0138a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2997079903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af009d860 0x7f4af009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2997079903 >> 172.21.15.125:0/2997079903 conn(0x7f4af0099c40 msgr2=0x7f4af00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2997079903 shutdown_connections 2023-10-03T10:12:10.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.825+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2997079903 wait complete. 2023-10-03T10:12:10.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.826+0000 7f4af4ca5700 1 Processor -- start 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 -- start start 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4af009d860 0x7f4af0120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 0x7f4af0120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 0x7f4af0120f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0123730 con 0x7f4af009d860 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0122110 con 0x7f4af009e170 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4af4ca5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01229d0 con 0x7f4af0130eb0 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aeed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 0x7f4af0120f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 0x7f4af0120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aeed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 0x7f4af0120f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42438/0 (socket says 172.21.15.125:42438) 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aeed9d700 1 -- 172.21.15.125:0/2661512394 learned_addr learned my addr 172.21.15.125:0/2661512394 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aee59c700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4af009d860 0x7f4af0120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 -- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 msgr2=0x7f4af0120f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 0x7f4af0120f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 -- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4af009d860 msgr2=0x7f4af0120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4af009d860 0x7f4af0120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.827+0000 7f4aedd9b700 1 -- 172.21.15.125:0/2661512394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae8009a70 con 0x7f4af009e170 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4aedd9b700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 0x7f4af0120a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4af009a100 tx=0x7f4ae400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004c80 con 0x7f4af009e170 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4004de0 con 0x7f4af009e170 2023-10-03T10:12:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af00a2110 con 0x7f4af009e170 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4007310 con 0x7f4af009e170 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.828+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af009c8b0 con 0x7f4af009e170 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.829+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4ae4007470 con 0x7f4af009e170 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.829+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af004f2a0 con 0x7f4af009e170 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.829+0000 7f4aee59c700 1 -- 172.21.15.125:0/2661512394 >> v1:172.21.15.125:6816/126957 conn(0x7f4ad002f510 legacy=0x7f4ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.829+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4ae403f7b0 con 0x7f4af009e170 2023-10-03T10:12:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 Processor -- start 2023-10-03T10:12:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 -- start start 2023-10-03T10:12:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f6208135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 0x7f6208138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6208099a60 con 0x7f6208099e20 2023-10-03T10:12:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620809bf50 con 0x7f6208133660 2023-10-03T10:12:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.833+0000 7f620e24d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f620809b230 con 0x7f6208135f80 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f6208135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f62077fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6208099e20 0x7f620809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36284/0 (socket says 172.21.15.125:36284) 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f62077fe700 1 -- 172.21.15.125:0/2262574903 learned_addr learned my addr 172.21.15.125:0/2262574903 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6207fff700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 0x7f6208138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f62067fc700 1 -- 172.21.15.125:0/2262574903 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736195628 0 0) 0x7f6208099a60 con 0x7f6208099e20 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 -- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 msgr2=0x7f6208138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 0x7f6208138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 -- 172.21.15.125:0/2262574903 >> v1:172.21.15.125:6789/0 conn(0x7f6208099e20 legacy=0x7f620809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 -- 172.21.15.125:0/2262574903 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620809bb90 con 0x7f6208133660 2023-10-03T10:12:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6207fff700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 0x7f6208138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.834+0000 7f6206ffd700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f6208135a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009870 tx=0x7f61fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10cfaeef228d30fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.838+0000 7f62067fc700 1 -- 172.21.15.125:0/2262574903 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc011830 con 0x7f6208133660 2023-10-03T10:12:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.838+0000 7f62067fc700 1 -- 172.21.15.125:0/2262574903 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc011990 con 0x7f6208133660 2023-10-03T10:12:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.838+0000 7f62067fc700 1 -- 172.21.15.125:0/2262574903 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc011d20 con 0x7f6208133660 2023-10-03T10:12:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.838+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ae4007720 con 0x7f4af009e170 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 -- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 msgr2=0x7f6208135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f6208135a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009870 tx=0x7f61fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 -- 172.21.15.125:0/2262574903 shutdown_connections 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208135f80 0x7f6208138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 --2- 172.21.15.125:0/2262574903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f6208135a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 -- 172.21.15.125:0/2262574903 >> 172.21.15.125:0/2262574903 conn(0x7f62080a2980 msgr2=0x7f62080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 -- 172.21.15.125:0/2262574903 shutdown_connections 2023-10-03T10:12:10.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.839+0000 7f620e24d700 1 -- 172.21.15.125:0/2262574903 wait complete. 2023-10-03T10:12:10.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.840+0000 7f620e24d700 1 Processor -- start 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.840+0000 7f620e24d700 1 -- start start 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208099e20 0x7f620812c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f620812cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 0x7f620812d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620809ecd0 con 0x7f6208135f80 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620813b7c0 con 0x7f6208133660 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f620e24d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f620809f4e0 con 0x7f6208099e20 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6207fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 0x7f620812d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6207fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 0x7f620812d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57680/0 (socket says 172.21.15.125:57680) 2023-10-03T10:12:10.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6207fff700 1 -- 172.21.15.125:0/129923635 learned_addr learned my addr 172.21.15.125:0/129923635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f620812cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f62077fe700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208099e20 0x7f620812c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 -- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208099e20 msgr2=0x7f620812c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208099e20 0x7f620812c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 -- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 msgr2=0x7f620812d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 0x7f620812d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.841+0000 7f6206ffd700 1 -- 172.21.15.125:0/129923635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6200009a70 con 0x7f6208133660 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f6206ffd700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f620812cee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61fc016000 tx=0x7f61fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc004300 con 0x7f6208133660 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc01f070 con 0x7f6208133660 2023-10-03T10:12:10.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc0094a0 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0036a0 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.842+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620809f8d0 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.843+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6208072480 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.843+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f61fc021030 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.843+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f61fc040e30 con 0x7f6208133660 2023-10-03T10:12:10.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.843+0000 7f62077fe700 1 -- 172.21.15.125:0/129923635 >> v1:172.21.15.125:6816/126957 conn(0x7f61f402f510 legacy=0x7f61f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:10.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.851+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61fc0239c0 con 0x7f6208133660 2023-10-03T10:12:10.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.893+0000 7f304beda700 1 Processor -- start 2023-10-03T10:12:10.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.893+0000 7f304beda700 1 -- start start 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304beda700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304beda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 0x7f3044134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304beda700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304409af80 con 0x7f304409edb0 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304beda700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304409a520 con 0x7f304409a150 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304beda700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f304409fe00 con 0x7f304409f1a0 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f3049c76700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f3049c76700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57686/0 (socket says 172.21.15.125:57686) 2023-10-03T10:12:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f3049c76700 1 -- 172.21.15.125:0/1589694173 learned_addr learned my addr 172.21.15.125:0/1589694173 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.894+0000 7f304a477700 1 --2- 172.21.15.125:0/1589694173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 0x7f3044134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f304a477700 1 -- 172.21.15.125:0/1589694173 >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 msgr2=0x7f304409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f304a477700 1 --2- 172.21.15.125:0/1589694173 >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f304a477700 1 -- 172.21.15.125:0/1589694173 >> v1:172.21.15.125:6789/0 conn(0x7f304409edb0 legacy=0x7f3044133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f304a477700 1 -- 172.21.15.125:0/1589694173 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304406bc20 con 0x7f304409f1a0 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f3048c74700 1 -- 172.21.15.125:0/1589694173 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257844061 0 0) 0x7f304409af80 con 0x7f304409edb0 2023-10-03T10:12:10.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f3049c76700 1 --2- 172.21.15.125:0/1589694173 >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f304a477700 1 --2- 172.21.15.125:0/1589694173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 0x7f3044134330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f303c009dc0 tx=0x7f303c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a5c49c418ab6cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f3048c74700 1 -- 172.21.15.125:0/1589694173 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00e070 con 0x7f304409f1a0 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f3048c74700 1 -- 172.21.15.125:0/1589694173 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c00bae0 con 0x7f304409f1a0 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.895+0000 7f3048c74700 1 -- 172.21.15.125:0/1589694173 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00be90 con 0x7f304409f1a0 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 -- 172.21.15.125:0/1589694173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 msgr2=0x7f3044134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 --2- 172.21.15.125:0/1589694173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 0x7f3044134330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f303c009dc0 tx=0x7f303c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 -- 172.21.15.125:0/1589694173 shutdown_connections 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 --2- 172.21.15.125:0/1589694173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409f1a0 0x7f3044134330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 --2- 172.21.15.125:0/1589694173 >> v2:172.21.15.125:3300/0 conn(0x7f304409a150 0x7f304409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 -- 172.21.15.125:0/1589694173 >> 172.21.15.125:0/1589694173 conn(0x7f30440a4430 msgr2=0x7f30440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 -- 172.21.15.125:0/1589694173 shutdown_connections 2023-10-03T10:12:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.896+0000 7f304beda700 1 -- 172.21.15.125:0/1589694173 wait complete. 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.897+0000 7f304beda700 1 Processor -- start 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.897+0000 7f304beda700 1 -- start start 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 0x7f30441c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409edb0 0x7f30441c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 0x7f30441c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30441b93b0 con 0x7f304409f1a0 2023-10-03T10:12:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30441a67b0 con 0x7f304409a150 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304beda700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f304409ba40 con 0x7f304409edb0 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f3049c76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 0x7f30441c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f3049c76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 0x7f30441c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43046/0 (socket says 172.21.15.125:43046) 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f3049c76700 1 -- 172.21.15.125:0/2631051163 learned_addr learned my addr 172.21.15.125:0/2631051163 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f3049475700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409edb0 0x7f30441c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.898+0000 7f304a477700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 0x7f30441c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 -- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409edb0 msgr2=0x7f30441c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409edb0 0x7f30441c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 -- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 msgr2=0x7f30441c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 0x7f30441c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 -- 172.21.15.125:0/2631051163 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009550 con 0x7f304409f1a0 2023-10-03T10:12:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f304a477700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 0x7f30441c8d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f304409b130 tx=0x7f303c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0045d0 con 0x7f304409f1a0 2023-10-03T10:12:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c020070 con 0x7f304409f1a0 2023-10-03T10:12:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.899+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c027480 con 0x7f304409f1a0 2023-10-03T10:12:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.900+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c009a70 con 0x7f304409f1a0 2023-10-03T10:12:10.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.900+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30441a6e20 con 0x7f304409f1a0 2023-10-03T10:12:10.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.901+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f303c012430 con 0x7f304409f1a0 2023-10-03T10:12:10.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.901+0000 7f3049c76700 1 -- 172.21.15.125:0/2631051163 >> v1:172.21.15.125:6816/126957 conn(0x7f302802f510 legacy=0x7f30280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:10.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.901+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f303c022070 con 0x7f304409f1a0 2023-10-03T10:12:10.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.901+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304409fa30 con 0x7f304409f1a0 2023-10-03T10:12:10.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.910+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f303c02c020 con 0x7f304409f1a0 2023-10-03T10:12:10.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.954+0000 7f2c6e59c700 1 -- 172.21.15.125:0/3442707710 >> v1:172.21.15.125:6816/126957 conn(0x7f2c5002f510 legacy=0x7f2c500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:10.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.980+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c7004f2a0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.980+0000 7f2c5effd700 1 -- 172.21.15.125:0/3442707710 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c640192c0 con 0x7f2c7009a7c0 2023-10-03T10:12:10.980 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:10.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 >> v1:172.21.15.125:6816/126957 conn(0x7f2c5002f510 legacy=0x7f2c500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:10.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 msgr2=0x7f2c7013c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 0x7f2c7013c360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c700726d0 tx=0x7f2c6400c730 comp rx=0 tx=0).stop 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 shutdown_connections 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c70130a60 0x7f2c7013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c70099eb0 0x7f2c7013be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 --2- 172.21.15.125:0/3442707710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c7009a7c0 0x7f2c7013c360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.982+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 >> 172.21.15.125:0/3442707710 conn(0x7f2c700a2980 msgr2=0x7f2c7009f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.983+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 shutdown_connections 2023-10-03T10:12:10.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:10.983+0000 7f2c74ff1700 1 -- 172.21.15.125:0/3442707710 wait complete. 2023-10-03T10:12:10.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.030+0000 7f4aee59c700 1 -- 172.21.15.125:0/2661512394 >> v1:172.21.15.125:6816/126957 conn(0x7f4ad002f510 legacy=0x7f4ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:11.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.034+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4af006c3b0 con 0x7f4af009e170 2023-10-03T10:12:11.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.035+0000 7f4adeffd700 1 -- 172.21.15.125:0/2661512394 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ae4014420 con 0x7f4af009e170 2023-10-03T10:12:11.034 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 >> v1:172.21.15.125:6816/126957 conn(0x7f4ad002f510 legacy=0x7f4ad00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 msgr2=0x7f4af0120a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 0x7f4af0120a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4af009a100 tx=0x7f4ae400c750 comp rx=0 tx=0).stop 2023-10-03T10:12:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 shutdown_connections 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4af0130eb0 0x7f4af0120f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4af009d860 0x7f4af0120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 --2- 172.21.15.125:0/2661512394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4af009e170 0x7f4af0120a40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.036+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 >> 172.21.15.125:0/2661512394 conn(0x7f4af0099c40 msgr2=0x7f4af0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.037+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 shutdown_connections 2023-10-03T10:12:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.037+0000 7f4af4ca5700 1 -- 172.21.15.125:0/2661512394 wait complete. 2023-10-03T10:12:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.045+0000 7f62077fe700 1 -- 172.21.15.125:0/129923635 >> v1:172.21.15.125:6816/126957 conn(0x7f61f402f510 legacy=0x7f61f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:11.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.049+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6208072480 con 0x7f6208133660 2023-10-03T10:12:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.050+0000 7f61effff700 1 -- 172.21.15.125:0/129923635 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6208072480 con 0x7f6208133660 2023-10-03T10:12:11.049 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 >> v1:172.21.15.125:6816/126957 conn(0x7f61f402f510 legacy=0x7f61f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 msgr2=0x7f620812cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f620812cee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61fc016000 tx=0x7f61fc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 shutdown_connections 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6208135f80 0x7f620812d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6208099e20 0x7f620812c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 --2- 172.21.15.125:0/129923635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6208133660 0x7f620812cee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 >> 172.21.15.125:0/129923635 conn(0x7f62080a2980 msgr2=0x7f62081324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 shutdown_connections 2023-10-03T10:12:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.052+0000 7f620e24d700 1 -- 172.21.15.125:0/129923635 wait complete. 2023-10-03T10:12:11.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:11.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.102+0000 7f3049c76700 1 -- 172.21.15.125:0/2631051163 >> v1:172.21.15.125:6816/126957 conn(0x7f302802f510 legacy=0x7f30280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:11.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.111+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30441a7f00 con 0x7f304409f1a0 2023-10-03T10:12:11.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.112+0000 7f303a7fc700 1 -- 172.21.15.125:0/2631051163 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30441a7f00 con 0x7f304409f1a0 2023-10-03T10:12:11.111 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:11.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 >> v1:172.21.15.125:6816/126957 conn(0x7f302802f510 legacy=0x7f30280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:11.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 msgr2=0x7f30441c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 0x7f30441c8d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f304409b130 tx=0x7f303c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 shutdown_connections 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f304409f1a0 0x7f30441c8d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f304409a150 0x7f30441c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 --2- 172.21.15.125:0/2631051163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f304409edb0 0x7f30441c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 >> 172.21.15.125:0/2631051163 conn(0x7f30440a4430 msgr2=0x7f304409c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 shutdown_connections 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:11.114+0000 7f304beda700 1 -- 172.21.15.125:0/2631051163 wait complete. 2023-10-03T10:12:11.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:11.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:12.050 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:12.064 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:12.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:12.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.133+0000 7fbcd8cd7700 1 Processor -- start 2023-10-03T10:12:12.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.133+0000 7fbcd8cd7700 1 -- start start 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd4133b80 0x7fbcd4133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd40a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd409aa00 con 0x7fbcd40a0e20 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd409a080 con 0x7fbcd4133b80 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd8cd7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4133750 con 0x7fbcd4099a60 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57706/0 (socket says 172.21.15.125:57706) 2023-10-03T10:12:12.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd2d9d700 1 -- 172.21.15.125:0/788360471 learned_addr learned my addr 172.21.15.125:0/788360471 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd259c700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd4133b80 0x7fbcd4133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd40a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 -- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd4133b80 msgr2=0x7fbcd4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd4133b80 0x7fbcd4133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 -- 172.21.15.125:0/788360471 >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 msgr2=0x7fbcd40a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 --2- 172.21.15.125:0/788360471 >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 -- 172.21.15.125:0/788360471 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd409a760 con 0x7fbcd4099a60 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd2d9d700 1 --2- 172.21.15.125:0/788360471 >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd1d9b700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd40a08e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009840 tx=0x7fbcc8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e5ecd2caaa373b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.134+0000 7fbcd159a700 1 -- 172.21.15.125:0/788360471 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8011830 con 0x7fbcd4099a60 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd159a700 1 -- 172.21.15.125:0/788360471 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8011990 con 0x7fbcd4099a60 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd159a700 1 -- 172.21.15.125:0/788360471 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8011d20 con 0x7fbcd4099a60 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 msgr2=0x7fbcd40a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd40a08e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009840 tx=0x7fbcc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/788360471 shutdown_connections 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd4133b80 0x7fbcd4133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/788360471 >> v2:172.21.15.125:3300/0 conn(0x7fbcd40a0e20 0x7fbcd40a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/788360471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd40a08e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/788360471 >> 172.21.15.125:0/788360471 conn(0x7fbcd40a2980 msgr2=0x7fbcd40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/788360471 shutdown_connections 2023-10-03T10:12:12.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.135+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/788360471 wait complete. 2023-10-03T10:12:12.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 Processor -- start 2023-10-03T10:12:12.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 -- start start 2023-10-03T10:12:12.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd40a0e20 0x7fbcd411cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 0x7fbcd411d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd411dbb0 con 0x7fbcd4133b80 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd411e280 con 0x7fbcd40a0e20 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd8cd7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd411f4d0 con 0x7fbcd4099a60 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 0x7fbcd411d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 0x7fbcd411d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57716/0 (socket says 172.21.15.125:57716) 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42494/0 (socket says 172.21.15.125:42494) 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.137+0000 7fbcd2d9d700 1 -- 172.21.15.125:0/2949493573 learned_addr learned my addr 172.21.15.125:0/2949493573 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd1d9b700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd40a0e20 0x7fbcd411cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 -- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd40a0e20 msgr2=0x7fbcd411cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd40a0e20 0x7fbcd411cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 -- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 msgr2=0x7fbcd411d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 0x7fbcd411d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 -- 172.21.15.125:0/2949493573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc009b30 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd259c700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400e900 tx=0x7fbcc400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400c640 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc400c7a0 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc80094a0 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd411ff00 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.138+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400cb10 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.139+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbcc400cc70 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.139+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbcc403f930 con 0x7fbcd4099a60 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.139+0000 7fbcd1d9b700 1 -- 172.21.15.125:0/2949493573 >> v1:172.21.15.125:6816/126957 conn(0x7fbcb402f510 legacy=0x7fbcb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.140+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb80052e0 con 0x7fbcd4099a60 2023-10-03T10:12:12.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.144+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcc4021080 con 0x7fbcd4099a60 2023-10-03T10:12:12.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.183+0000 7faf6b16f700 1 Processor -- start 2023-10-03T10:12:12.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 -- start start 2023-10-03T10:12:12.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 0x7faf64133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6406b2d0 con 0x7faf641300a0 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf64133610 con 0x7faf64133ad0 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6b16f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf6409a500 con 0x7faf64130bc0 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf68f0b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 0x7faf64133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6970c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf68f0b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 0x7faf64133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57726/0 (socket says 172.21.15.125:57726) 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf68f0b700 1 -- 172.21.15.125:0/1597750961 learned_addr learned my addr 172.21.15.125:0/1597750961 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.184+0000 7faf6970c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42496/0 (socket says 172.21.15.125:42496) 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf6970c700 1 -- 172.21.15.125:0/1597750961 >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 msgr2=0x7faf64133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf6970c700 1 --2- 172.21.15.125:0/1597750961 >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 0x7faf64133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf6970c700 1 -- 172.21.15.125:0/1597750961 >> v1:172.21.15.125:6789/0 conn(0x7faf641300a0 legacy=0x7faf641304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf6970c700 1 -- 172.21.15.125:0/1597750961 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf641338b0 con 0x7faf64130bc0 2023-10-03T10:12:12.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf6970c700 1 --2- 172.21.15.125:0/1597750961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009d90 tx=0x7faf5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2c7accdbb2b673 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf637fe700 1 -- 172.21.15.125:0/1597750961 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e070 con 0x7faf64130bc0 2023-10-03T10:12:12.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf637fe700 1 -- 172.21.15.125:0/1597750961 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00bb20 con 0x7faf64130bc0 2023-10-03T10:12:12.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.185+0000 7faf637fe700 1 -- 172.21.15.125:0/1597750961 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012430 con 0x7faf64130bc0 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 -- 172.21.15.125:0/1597750961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 msgr2=0x7faf6413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 --2- 172.21.15.125:0/1597750961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009d90 tx=0x7faf5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 -- 172.21.15.125:0/1597750961 shutdown_connections 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 --2- 172.21.15.125:0/1597750961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf64130bc0 0x7faf6413b990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 --2- 172.21.15.125:0/1597750961 >> v2:172.21.15.125:3300/0 conn(0x7faf64133ad0 0x7faf64133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 -- 172.21.15.125:0/1597750961 >> 172.21.15.125:0/1597750961 conn(0x7faf64099c40 msgr2=0x7faf640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 -- 172.21.15.125:0/1597750961 shutdown_connections 2023-10-03T10:12:12.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.186+0000 7faf6b16f700 1 -- 172.21.15.125:0/1597750961 wait complete. 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 Processor -- start 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 -- start start 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64130bc0 0x7faf6411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf64133ad0 0x7faf6411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6412da10 con 0x7faf64133ad0 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64120a30 con 0x7faf64130bc0 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf6b16f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf6412dd00 con 0x7faf641300a0 2023-10-03T10:12:12.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf68f0b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf68f0b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42508/0 (socket says 172.21.15.125:42508) 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.187+0000 7faf68f0b700 1 -- 172.21.15.125:0/2877089362 learned_addr learned my addr 172.21.15.125:0/2877089362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf6970c700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf64133ad0 0x7faf6411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf63fff700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64130bc0 0x7faf6411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 -- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64130bc0 msgr2=0x7faf6411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64130bc0 0x7faf6411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 -- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf64133ad0 msgr2=0x7faf6411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf64133ad0 0x7faf6411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 -- 172.21.15.125:0/2877089362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009a70 con 0x7faf641300a0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf68f0b700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e910 tx=0x7faf5800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf580096a0 con 0x7faf641300a0 2023-10-03T10:12:12.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58013680 con 0x7faf641300a0 2023-10-03T10:12:12.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6412fc20 con 0x7faf641300a0 2023-10-03T10:12:12.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58013a30 con 0x7faf641300a0 2023-10-03T10:12:12.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.188+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf64071840 con 0x7faf641300a0 2023-10-03T10:12:12.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.190+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6404f2a0 con 0x7faf641300a0 2023-10-03T10:12:12.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.190+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faf58013b90 con 0x7faf641300a0 2023-10-03T10:12:12.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.190+0000 7faf63fff700 1 -- 172.21.15.125:0/2877089362 >> v1:172.21.15.125:6816/126957 conn(0x7faf4802f510 legacy=0x7faf480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.190+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7faf5803fec0 con 0x7faf641300a0 2023-10-03T10:12:12.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.195+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf58011b80 con 0x7faf641300a0 2023-10-03T10:12:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.260+0000 7faa58b71700 1 Processor -- start 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.260+0000 7faa58b71700 1 -- start start 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa58b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 0x7faa54138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa58b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa5413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa58b71700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5409b110 con 0x7faa5409ad40 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa58b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540a3b60 con 0x7faa54134570 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa58b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa540a1a80 con 0x7faa54134140 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa51d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 0x7faa54138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa51d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 0x7faa54138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42514/0 (socket says 172.21.15.125:42514) 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa51d9b700 1 -- 172.21.15.125:0/1835215579 learned_addr learned my addr 172.21.15.125:0/1835215579 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.261+0000 7faa52d9d700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa5413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa5159a700 1 -- 172.21.15.125:0/1835215579 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867709920 0 0) 0x7faa5409b110 con 0x7faa5409ad40 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa52d9d700 1 -- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 msgr2=0x7faa54138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa52d9d700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 0x7faa54138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa52d9d700 1 -- 172.21.15.125:0/1835215579 >> v1:172.21.15.125:6789/0 conn(0x7faa5409ad40 legacy=0x7faa54133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa52d9d700 1 -- 172.21.15.125:0/1835215579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540a2fa0 con 0x7faa54134570 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa52d9d700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa5413b3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009df0 tx=0x7faa4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9c751b1529bb1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa5159a700 1 -- 172.21.15.125:0/1835215579 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00e070 con 0x7faa54134570 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa5159a700 1 -- 172.21.15.125:0/1835215579 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c00bae0 con 0x7faa54134570 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.262+0000 7faa5159a700 1 -- 172.21.15.125:0/1835215579 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00be90 con 0x7faa54134570 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 Processor -- start 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 -- start start 2023-10-03T10:12:12.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 -- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 msgr2=0x7faa5413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa5413b3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009df0 tx=0x7faa4c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 -- 172.21.15.125:0/1835215579 shutdown_connections 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa5413b3d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 --2- 172.21.15.125:0/1835215579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa54134140 0x7faa54138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 -- 172.21.15.125:0/1835215579 >> 172.21.15.125:0/1835215579 conn(0x7faa54099c40 msgr2=0x7faa5406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 -- 172.21.15.125:0/1835215579 shutdown_connections 2023-10-03T10:12:12.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7faa58b71700 1 -- 172.21.15.125:0/1835215579 wait complete. 2023-10-03T10:12:12.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdef4133900 0x7fdef4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef4134210 0x7fdef40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef40a0ee0 0x7fdef40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.263+0000 7fdefc5a6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef409a760 con 0x7fdef4133900 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefc5a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef41336e0 con 0x7fdef4134210 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefc5a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef409a080 con 0x7fdef40a0ee0 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdef4133900 0x7fdef4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdef4133900 0x7fdef4133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57752/0 (socket says 172.21.15.125:57752) 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 -- 172.21.15.125:0/608874741 learned_addr learned my addr 172.21.15.125:0/608874741 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdef9b41700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef4134210 0x7fdef40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 -- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef40a0ee0 msgr2=0x7fdef40a1340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef40a0ee0 0x7fdef40a1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 -- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef4134210 msgr2=0x7fdef40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef4134210 0x7fdef40a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 -- 172.21.15.125:0/608874741 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40a23e0 con 0x7fdef4133900 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdefa342700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4133900 0x7fdef4133cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdef0006fd0 tx=0x7fdef0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fbb93e728f35ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdef9340700 1 -- 172.21.15.125:0/608874741 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0005e30 con 0x7fdef4133900 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdef9340700 1 -- 172.21.15.125:0/608874741 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0004030 con 0x7fdef4133900 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.264+0000 7fdef9340700 1 -- 172.21.15.125:0/608874741 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef00043e0 con 0x7fdef4133900 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7faa58b71700 1 Processor -- start 2023-10-03T10:12:12.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7faa58b71700 1 -- start start 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 -- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4133900 msgr2=0x7fdef4133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4133900 0x7fdef4133cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdef0006fd0 tx=0x7fdef0009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 -- 172.21.15.125:0/608874741 shutdown_connections 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef40a0ee0 0x7fdef40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4133900 0x7fdef4133cd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/608874741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef4134210 0x7fdef40a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 -- 172.21.15.125:0/608874741 >> 172.21.15.125:0/608874741 conn(0x7fdef40a2980 msgr2=0x7fdef40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 -- 172.21.15.125:0/608874741 shutdown_connections 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.265+0000 7fdefc5a6700 1 -- 172.21.15.125:0/608874741 wait complete. 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa5409ad40 0x7faa54139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 0x7faa541399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409c7e0 con 0x7faa54134140 2023-10-03T10:12:12.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409e3b0 con 0x7faa54134570 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa58b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa5411d700 con 0x7faa5409ad40 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa52d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa52d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43092/0 (socket says 172.21.15.125:43092) 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa52d9d700 1 -- 172.21.15.125:0/2339925767 learned_addr learned my addr 172.21.15.125:0/2339925767 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 0x7faa541399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7fdefc5a6700 1 Processor -- start 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 -- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa5409ad40 msgr2=0x7faa54139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa5409ad40 0x7faa54139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 -- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 msgr2=0x7faa54139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa51d9b700 1 -- 172.21.15.125:0/2339925767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009a70 con 0x7faa54134140 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.266+0000 7faa52d9d700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7faa51d9b700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 0x7faa541399b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa4800e8a0 tx=0x7faa4800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 -- start start 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 0x7fdef406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 0x7fdef406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4071800 con 0x7fdef4134210 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4125020 con 0x7fdef40a0ee0 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefc5a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4132fc0 con 0x7fdef4133900 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefab43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefab43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57774/0 (socket says 172.21.15.125:57774) 2023-10-03T10:12:12.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefab43700 1 -- 172.21.15.125:0/2874432129 learned_addr learned my addr 172.21.15.125:0/2874432129 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:12.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48013680 con 0x7faa54134140 2023-10-03T10:12:12.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480137e0 con 0x7faa54134140 2023-10-03T10:12:12.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48013b70 con 0x7faa54134140 2023-10-03T10:12:12.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdefa342700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 0x7fdef406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.267+0000 7fdef9b41700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 0x7fdef406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 -- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 msgr2=0x7fdef406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 0x7fdef406e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 -- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 msgr2=0x7fdef406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 0x7fdef406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 -- 172.21.15.125:0/2874432129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009500 con 0x7fdef4134210 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5411e540 con 0x7faa54134140 2023-10-03T10:12:12.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5411f2b0 con 0x7faa54134140 2023-10-03T10:12:12.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefab43700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00b970 tx=0x7fdeec00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00d860 con 0x7fdef4134210 2023-10-03T10:12:12.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec00d9e0 con 0x7fdef4134210 2023-10-03T10:12:12.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00dd90 con 0x7fdef4134210 2023-10-03T10:12:12.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdefa342700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 0x7fdef406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.268+0000 7fdef9b41700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 0x7fdef406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef409a320 con 0x7fdef4134210 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef406f1f0 con 0x7fdef4134210 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa541361e0 con 0x7faa54134140 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faa48013cd0 con 0x7faa54134140 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7faa4803fe10 con 0x7faa54134140 2023-10-03T10:12:12.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.269+0000 7faa5259c700 1 -- 172.21.15.125:0/2339925767 >> v1:172.21.15.125:6816/126957 conn(0x7faa3402f510 legacy=0x7faa340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.270+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4070650 con 0x7fdef4134210 2023-10-03T10:12:12.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.274+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa48011d90 con 0x7faa54134140 2023-10-03T10:12:12.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.275+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdeec00e430 con 0x7fdef4134210 2023-10-03T10:12:12.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.275+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdeec040250 con 0x7fdef4134210 2023-10-03T10:12:12.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.275+0000 7fdefa342700 1 -- 172.21.15.125:0/2874432129 >> v1:172.21.15.125:6816/126957 conn(0x7fded802f560 legacy=0x7fded8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.279+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdeec0156c0 con 0x7fdef4134210 2023-10-03T10:12:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.340+0000 7fbcd1d9b700 1 -- 172.21.15.125:0/2949493573 >> v1:172.21.15.125:6816/126957 conn(0x7fbcb402f510 legacy=0x7fbcb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.391+0000 7faf63fff700 1 -- 172.21.15.125:0/2877089362 >> v1:172.21.15.125:6816/126957 conn(0x7faf4802f510 legacy=0x7faf480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.392+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf6406c3b0 con 0x7faf641300a0 2023-10-03T10:12:12.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.392+0000 7faf617fa700 1 -- 172.21.15.125:0/2877089362 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf58021070 con 0x7faf641300a0 2023-10-03T10:12:12.392 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:12.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 >> v1:172.21.15.125:6816/126957 conn(0x7faf4802f510 legacy=0x7faf480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 msgr2=0x7faf6411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e910 tx=0x7faf5800ec20 comp rx=0 tx=0).stop 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 shutdown_connections 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf64133ad0 0x7faf6411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf641300a0 0x7faf6411da40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 --2- 172.21.15.125:0/2877089362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64130bc0 0x7faf6411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 >> 172.21.15.125:0/2877089362 conn(0x7faf64099c40 msgr2=0x7faf64131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 shutdown_connections 2023-10-03T10:12:12.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.395+0000 7faf6b16f700 1 -- 172.21.15.125:0/2877089362 wait complete. 2023-10-03T10:12:12.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.416+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcb8005860 con 0x7fbcd4099a60 2023-10-03T10:12:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.416+0000 7fbcc2ffd700 1 -- 172.21.15.125:0/2949493573 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcc4013470 con 0x7fbcd4099a60 2023-10-03T10:12:12.416 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 >> v1:172.21.15.125:6816/126957 conn(0x7fbcb402f510 legacy=0x7fbcb40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 msgr2=0x7fbcd411c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400e900 tx=0x7fbcc400ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 shutdown_connections 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd4133b80 0x7fbcd411d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd4099a60 0x7fbcd411c700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 --2- 172.21.15.125:0/2949493573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd40a0e20 0x7fbcd411cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 >> 172.21.15.125:0/2949493573 conn(0x7fbcd40a2980 msgr2=0x7fbcd41bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 shutdown_connections 2023-10-03T10:12:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.418+0000 7fbcd8cd7700 1 -- 172.21.15.125:0/2949493573 wait complete. 2023-10-03T10:12:12.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:12.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.470+0000 7faa5259c700 1 -- 172.21.15.125:0/2339925767 >> v1:172.21.15.125:6816/126957 conn(0x7faa3402f510 legacy=0x7faa340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.471+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faa5411e770 con 0x7faa54134140 2023-10-03T10:12:12.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.471+0000 7faa42ffd700 1 -- 172.21.15.125:0/2339925767 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa48017070 con 0x7faa54134140 2023-10-03T10:12:12.471 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:12.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 >> v1:172.21.15.125:6816/126957 conn(0x7faa3402f510 legacy=0x7faa340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 msgr2=0x7faa541399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 0x7faa541399b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa4800e8a0 tx=0x7faa4800ebb0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 shutdown_connections 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa54134570 0x7faa54139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.473+0000 7faa58b71700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa5409ad40 0x7faa54139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.474+0000 7faa58b71700 1 --2- 172.21.15.125:0/2339925767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa54134140 0x7faa541399b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.474+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 >> 172.21.15.125:0/2339925767 conn(0x7faa54099c40 msgr2=0x7faa5413b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.474+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 shutdown_connections 2023-10-03T10:12:12.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.474+0000 7faa58b71700 1 -- 172.21.15.125:0/2339925767 wait complete. 2023-10-03T10:12:12.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.476+0000 7fdefa342700 1 -- 172.21.15.125:0/2874432129 >> v1:172.21.15.125:6816/126957 conn(0x7fded802f560 legacy=0x7fded8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:12.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:12.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.495+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdef4071940 con 0x7fdef4134210 2023-10-03T10:12:12.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.495+0000 7fdeeaffd700 1 -- 172.21.15.125:0/2874432129 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef4071940 con 0x7fdef4134210 2023-10-03T10:12:12.495 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 >> v1:172.21.15.125:6816/126957 conn(0x7fded802f560 legacy=0x7fded8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 msgr2=0x7fdef406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00b970 tx=0x7fdeec00bc80 comp rx=0 tx=0).stop 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 shutdown_connections 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef4134210 0x7fdef406ecb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef40a0ee0 0x7fdef406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 --2- 172.21.15.125:0/2874432129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdef4133900 0x7fdef406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 >> 172.21.15.125:0/2874432129 conn(0x7fdef40a2980 msgr2=0x7fdef41bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 shutdown_connections 2023-10-03T10:12:12.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:12.497+0000 7fdefc5a6700 1 -- 172.21.15.125:0/2874432129 wait complete. 2023-10-03T10:12:12.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:13.408 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:13.430 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:13.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:13.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:13.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.562+0000 7fbde3e38700 1 Processor -- start 2023-10-03T10:12:13.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 -- start start 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbddc099e20 0x7fbddc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc099a60 con 0x7fbddc09a730 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc09bf50 con 0x7fbddc099e20 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde3e38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc09b230 con 0x7fbddc130a60 2023-10-03T10:12:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde23d5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde23d5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42548/0 (socket says 172.21.15.125:42548) 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.563+0000 7fbde23d5700 1 -- 172.21.15.125:0/2541028691 learned_addr learned my addr 172.21.15.125:0/2541028691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde23d5700 1 -- 172.21.15.125:0/2541028691 >> v2:172.21.15.125:3300/0 conn(0x7fbddc099e20 msgr2=0x7fbddc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde23d5700 1 --2- 172.21.15.125:0/2541028691 >> v2:172.21.15.125:3300/0 conn(0x7fbddc099e20 0x7fbddc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde23d5700 1 -- 172.21.15.125:0/2541028691 >> v1:172.21.15.125:6789/0 conn(0x7fbddc09a730 legacy=0x7fbddc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde23d5700 1 -- 172.21.15.125:0/2541028691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc09bb90 con 0x7fbddc130a60 2023-10-03T10:12:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde23d5700 1 --2- 172.21.15.125:0/2541028691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400d150 tx=0x7fbdd400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d06d1a30140ba32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde0bd2700 1 -- 172.21.15.125:0/2541028691 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4010070 con 0x7fbddc130a60 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde0bd2700 1 -- 172.21.15.125:0/2541028691 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd400dd80 con 0x7fbddc130a60 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.564+0000 7fbde0bd2700 1 -- 172.21.15.125:0/2541028691 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd400b2f0 con 0x7fbddc130a60 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 -- 172.21.15.125:0/2541028691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 msgr2=0x7fbddc138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 --2- 172.21.15.125:0/2541028691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400d150 tx=0x7fbdd400d460 comp rx=0 tx=0).stop 2023-10-03T10:12:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 -- 172.21.15.125:0/2541028691 shutdown_connections 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 --2- 172.21.15.125:0/2541028691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc130a60 0x7fbddc138690 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 --2- 172.21.15.125:0/2541028691 >> v2:172.21.15.125:3300/0 conn(0x7fbddc099e20 0x7fbddc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.565+0000 7fbde3e38700 1 -- 172.21.15.125:0/2541028691 >> 172.21.15.125:0/2541028691 conn(0x7fbddc0a2980 msgr2=0x7fbddc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.566+0000 7fbde3e38700 1 -- 172.21.15.125:0/2541028691 shutdown_connections 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.566+0000 7fbde3e38700 1 -- 172.21.15.125:0/2541028691 wait complete. 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 Processor -- start 2023-10-03T10:12:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 -- start start 2023-10-03T10:12:13.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc099e20 0x7fbddc11eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 0x7fbddc11f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc12db30 con 0x7fbddc130a60 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc0a1300 con 0x7fbddc09a730 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.567+0000 7fbde3e38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1208b0 con 0x7fbddc099e20 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43116/0 (socket says 172.21.15.125:43116) 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 -- 172.21.15.125:0/3179652924 learned_addr learned my addr 172.21.15.125:0/3179652924 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde23d5700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 0x7fbddc11f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 -- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc099e20 msgr2=0x7fbddc11eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc099e20 0x7fbddc11eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 -- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 msgr2=0x7fbddc11f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 0x7fbddc11f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 -- 172.21.15.125:0/3179652924 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd400bd40 con 0x7fbddc09a730 2023-10-03T10:12:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde23d5700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 0x7fbddc11f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbde13d3700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c4a0 tx=0x7fbdcc00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.568+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0054e0 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.569+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc003680 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.569+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc122110 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.569+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc003a30 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.569+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc122e40 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.570+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbdcc003b90 con 0x7fbddc09a730 2023-10-03T10:12:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.570+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbdcc03f040 con 0x7fbddc09a730 2023-10-03T10:12:13.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.570+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc1308d0 con 0x7fbddc09a730 2023-10-03T10:12:13.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.571+0000 7fbde1bd4700 1 -- 172.21.15.125:0/3179652924 >> v1:172.21.15.125:6816/126957 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.579+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdcc017070 con 0x7fbddc09a730 2023-10-03T10:12:13.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.598+0000 7fd1c0596700 1 Processor -- start 2023-10-03T10:12:13.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.598+0000 7fd1c0596700 1 -- start start 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1c0596700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1c0596700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b8139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1c0596700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b806e900 con 0x7fd1b809dec0 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1c0596700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b809d180 con 0x7fd1b8136cb0 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1c0596700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b809e780 con 0x7fd1b806a770 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42564/0 (socket says 172.21.15.125:42564) 2023-10-03T10:12:13.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 -- 172.21.15.125:0/4270537076 learned_addr learned my addr 172.21.15.125:0/4270537076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1beb33700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 -- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 msgr2=0x7fd1b8139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b8139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 -- 172.21.15.125:0/4270537076 >> v1:172.21.15.125:6789/0 conn(0x7fd1b809dec0 legacy=0x7fd1b806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 -- 172.21.15.125:0/4270537076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b809d3c0 con 0x7fd1b806a770 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1beb33700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.599+0000 7fd1be332700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009920 tx=0x7fd1b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19d5ea1beedb8be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1bd330700 1 -- 172.21.15.125:0/4270537076 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400ba60 con 0x7fd1b806a770 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1bd330700 1 -- 172.21.15.125:0/4270537076 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400bbc0 con 0x7fd1b806a770 2023-10-03T10:12:13.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1bd330700 1 -- 172.21.15.125:0/4270537076 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4009e70 con 0x7fd1b806a770 2023-10-03T10:12:13.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 -- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 msgr2=0x7fd1b806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009920 tx=0x7fd1b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 -- 172.21.15.125:0/4270537076 shutdown_connections 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 --2- 172.21.15.125:0/4270537076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b806a770 0x7fd1b806ab40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 -- 172.21.15.125:0/4270537076 >> 172.21.15.125:0/4270537076 conn(0x7fd1b8099c40 msgr2=0x7fd1b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 -- 172.21.15.125:0/4270537076 shutdown_connections 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.600+0000 7fd1c0596700 1 -- 172.21.15.125:0/4270537076 wait complete. 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.601+0000 7fd1c0596700 1 Processor -- start 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.601+0000 7fd1c0596700 1 -- start start 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b809dec0 0x7fd1b8131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b81322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8135d40 con 0x7fd1b806a770 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8133ae0 con 0x7fd1b8136cb0 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1c0596700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80a2c50 con 0x7fd1b809dec0 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57796/0 (socket says 172.21.15.125:57796) 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 -- 172.21.15.125:0/2602691187 learned_addr learned my addr 172.21.15.125:0/2602691187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1bdb31700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b809dec0 0x7fd1b8131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1beb33700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b81322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 -- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b809dec0 msgr2=0x7fd1b8131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b809dec0 0x7fd1b8131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 -- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 msgr2=0x7fd1b81322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b81322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.602+0000 7fd1be332700 1 -- 172.21.15.125:0/2602691187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009550 con 0x7fd1b806a770 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1be332700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40098f0 tx=0x7fd1b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4004450 con 0x7fd1b806a770 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b401f070 con 0x7fd1b806a770 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b8135160 con 0x7fd1b806a770 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40045f0 con 0x7fd1b806a770 2023-10-03T10:12:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.603+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b8136520 con 0x7fd1b806a770 2023-10-03T10:12:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.604+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd1b40038e0 con 0x7fd1b806a770 2023-10-03T10:12:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.604+0000 7fd1bdb31700 1 -- 172.21.15.125:0/2602691187 >> v1:172.21.15.125:6816/126957 conn(0x7fd19c02f510 legacy=0x7fd19c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.604+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd1b4021070 con 0x7fd1b806a770 2023-10-03T10:12:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.604+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b804f2a0 con 0x7fd1b806a770 2023-10-03T10:12:13.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.609+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b4019590 con 0x7fd1b806a770 2023-10-03T10:12:13.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.672+0000 7f818e060700 1 Processor -- start 2023-10-03T10:12:13.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.672+0000 7feed7aa0700 1 Processor -- start 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.672+0000 7f818e060700 1 -- start start 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f818e060700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f818e060700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81881343a0 0x7f81880a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f818e060700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818809b110 con 0x7f8188133f70 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f818e060700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880a3b60 con 0x7f81881343a0 2023-10-03T10:12:13.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f818e060700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81880a2fa0 con 0x7f818809ad40 2023-10-03T10:12:13.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 -- start start 2023-10-03T10:12:13.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81881343a0 0x7f81880a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8186ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8188133f70 0x7f81880a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36322/0 (socket says 172.21.15.125:36322) 2023-10-03T10:12:13.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8186ffd700 1 -- 172.21.15.125:0/2272284001 learned_addr learned my addr 172.21.15.125:0/2272284001 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:13.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f81877fe700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 -- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 msgr2=0x7f8188133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 -- 172.21.15.125:0/2272284001 >> v1:172.21.15.125:6789/0 conn(0x7f8188133f70 legacy=0x7f81880a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 -- 172.21.15.125:0/2272284001 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818809a280 con 0x7f81881343a0 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 0x7feed009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7f8187fff700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f81880a1180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332239bdcb71a2ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 0x7feed01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feed0130ce0 0x7feed0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed009aaa0 con 0x7feed0130ce0 2023-10-03T10:12:13.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed009f870 con 0x7feed009e170 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.673+0000 7feed7aa0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feed009b360 con 0x7feed009d860 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed583c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 0x7feed009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed503b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 0x7feed01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feed0130ce0 0x7feed0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed583c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 0x7feed009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42578/0 (socket says 172.21.15.125:42578) 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed583c700 1 -- 172.21.15.125:0/2600160675 learned_addr learned my addr 172.21.15.125:0/2600160675 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed503b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 0x7feed01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43140/0 (socket says 172.21.15.125:43140) 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feed0130ce0 0x7feed0131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57808/0 (socket says 172.21.15.125:57808) 2023-10-03T10:12:13.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7f81867fc700 1 -- 172.21.15.125:0/2272284001 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000e070 con 0x7f81881343a0 2023-10-03T10:12:13.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7f81867fc700 1 -- 172.21.15.125:0/2272284001 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000bbd0 con 0x7f81881343a0 2023-10-03T10:12:13.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7f81867fc700 1 -- 172.21.15.125:0/2272284001 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180012430 con 0x7f81881343a0 2023-10-03T10:12:13.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 -- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 msgr2=0x7feed009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 0x7feed009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 -- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 msgr2=0x7feed01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 0x7feed01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 -- 172.21.15.125:0/2600160675 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed009b620 con 0x7feed0130ce0 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed603d700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed0130ce0 0x7feed0131150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e10 tx=0x7feec800d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafb671bd2724125 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed483a700 1 -- 172.21.15.125:0/2600160675 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011460 con 0x7feed0130ce0 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed483a700 1 -- 172.21.15.125:0/2600160675 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80115c0 con 0x7feed0130ce0 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.674+0000 7feed483a700 1 -- 172.21.15.125:0/2600160675 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011970 con 0x7feed0130ce0 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 -- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed0130ce0 msgr2=0x7feed0131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed0130ce0 0x7feed0131150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e10 tx=0x7feec800d540 comp rx=0 tx=0).stop 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 -- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 msgr2=0x7f81880a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f81880a1180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 -- 172.21.15.125:0/2272284001 shutdown_connections 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f81880a1180 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 --2- 172.21.15.125:0/2272284001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 -- 172.21.15.125:0/2272284001 >> 172.21.15.125:0/2272284001 conn(0x7f8188099c40 msgr2=0x7f818806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 -- 172.21.15.125:0/2272284001 shutdown_connections 2023-10-03T10:12:13.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7f818e060700 1 -- 172.21.15.125:0/2272284001 wait complete. 2023-10-03T10:12:13.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 -- 172.21.15.125:0/2600160675 shutdown_connections 2023-10-03T10:12:13.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed0130ce0 0x7feed0131150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009d860 0x7feed009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 --2- 172.21.15.125:0/2600160675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed009e170 0x7feed01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.675+0000 7feed7aa0700 1 -- 172.21.15.125:0/2600160675 >> 172.21.15.125:0/2600160675 conn(0x7feed0099c40 msgr2=0x7feed00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7feed7aa0700 1 -- 172.21.15.125:0/2600160675 shutdown_connections 2023-10-03T10:12:13.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7feed7aa0700 1 -- 172.21.15.125:0/2600160675 wait complete. 2023-10-03T10:12:13.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 Processor -- start 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 -- start start 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f8188126ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818809c850 con 0x7f81881343a0 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81881295c0 con 0x7f818809ad40 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.676+0000 7f818e060700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81881299f0 con 0x7f8188133f70 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42584/0 (socket says 172.21.15.125:42584) 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 -- 172.21.15.125:0/1357289854 learned_addr learned my addr 172.21.15.125:0/1357289854 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f81877fe700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8187fff700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f8188126ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 -- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 msgr2=0x7f8188126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188126120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 -- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 msgr2=0x7f8188126ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f8188126ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7feed7aa0700 1 Processor -- start 2023-10-03T10:12:13.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 -- 172.21.15.125:0/1357289854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009a70 con 0x7f8188133f70 2023-10-03T10:12:13.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8187fff700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f8188126ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:13.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7feed7aa0700 1 -- start start 2023-10-03T10:12:13.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f8186ffd700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c530 tx=0x7f817c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c005d70 con 0x7f8188133f70 2023-10-03T10:12:13.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c0070d0 con 0x7f8188133f70 2023-10-03T10:12:13.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.677+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c007440 con 0x7f8188133f70 2023-10-03T10:12:13.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8188129300 con 0x7f8188133f70 2023-10-03T10:12:13.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8188132840 con 0x7f8188133f70 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed009d860 0x7feed011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed0130ce0 0x7feed011b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed011f350 con 0x7feed009d860 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed011cb20 con 0x7feed0130ce0 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed7aa0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feed011e6b0 con 0x7feed009e170 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42586/0 (socket says 172.21.15.125:42586) 2023-10-03T10:12:13.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 -- 172.21.15.125:0/686848598 learned_addr learned my addr 172.21.15.125:0/686848598 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 -- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed0130ce0 msgr2=0x7feed011b8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed0130ce0 0x7feed011b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 -- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed009d860 msgr2=0x7feed011ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed009d860 0x7feed011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 -- 172.21.15.125:0/686848598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009a70 con 0x7feed009e170 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.678+0000 7feed503b700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feec400e9b0 tx=0x7feec400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400c850 con 0x7feed009e170 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400c9b0 con 0x7feed009e170 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400cd20 con 0x7feed009e170 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00a21b0 con 0x7feed009e170 2023-10-03T10:12:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed011dcd0 con 0x7feed009e170 2023-10-03T10:12:13.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f817c0075a0 con 0x7f8188133f70 2023-10-03T10:12:13.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f817c03f130 con 0x7f8188133f70 2023-10-03T10:12:13.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7f81877fe700 1 -- 172.21.15.125:0/1357289854 >> v1:172.21.15.125:6816/126957 conn(0x7f817402f510 legacy=0x7f81740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.679+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81881331b0 con 0x7f8188133f70 2023-10-03T10:12:13.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.680+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00710b0 con 0x7feed009e170 2023-10-03T10:12:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.684+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f817c017080 con 0x7f8188133f70 2023-10-03T10:12:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.684+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feec4004020 con 0x7feed009e170 2023-10-03T10:12:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.684+0000 7feed583c700 1 -- 172.21.15.125:0/686848598 >> v1:172.21.15.125:6816/126957 conn(0x7feeb402f510 legacy=0x7feeb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.684+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7feec4040170 con 0x7feed009e170 2023-10-03T10:12:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.688+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feec40042d0 con 0x7feed009e170 2023-10-03T10:12:13.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.772+0000 7fbde1bd4700 1 -- 172.21.15.125:0/3179652924 >> v1:172.21.15.125:6816/126957 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.805+0000 7fd1bdb31700 1 -- 172.21.15.125:0/2602691187 >> v1:172.21.15.125:6816/126957 conn(0x7fd19c02f510 legacy=0x7fd19c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.855+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbddc072480 con 0x7fbddc09a730 2023-10-03T10:12:13.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.856+0000 7fbdd27fc700 1 -- 172.21.15.125:0/3179652924 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbddc072480 con 0x7fbddc09a730 2023-10-03T10:12:13.855 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:13.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 >> v1:172.21.15.125:6816/126957 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 msgr2=0x7fbddc11f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c4a0 tx=0x7fbdcc00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 shutdown_connections 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbddc130a60 0x7fbddc11f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbddc099e20 0x7fbddc11eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 --2- 172.21.15.125:0/3179652924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbddc09a730 0x7fbddc11f0d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 >> 172.21.15.125:0/3179652924 conn(0x7fbddc0a2980 msgr2=0x7fbddc09fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 shutdown_connections 2023-10-03T10:12:13.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.858+0000 7fbde3e38700 1 -- 172.21.15.125:0/3179652924 wait complete. 2023-10-03T10:12:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.865+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1b809e3a0 con 0x7fd1b806a770 2023-10-03T10:12:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.866+0000 7fd1aeffd700 1 -- 172.21.15.125:0/2602691187 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1b40193b0 con 0x7fd1b806a770 2023-10-03T10:12:13.865 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:13.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 >> v1:172.21.15.125:6816/126957 conn(0x7fd19c02f510 legacy=0x7fd19c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 msgr2=0x7fd1b8131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40098f0 tx=0x7fd1b4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 shutdown_connections 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1b8136cb0 0x7fd1b81322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1b806a770 0x7fd1b8131860 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 --2- 172.21.15.125:0/2602691187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1b809dec0 0x7fd1b8131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 >> 172.21.15.125:0/2602691187 conn(0x7fd1b8099c40 msgr2=0x7fd1b812f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 shutdown_connections 2023-10-03T10:12:13.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.868+0000 7fd1c0596700 1 -- 172.21.15.125:0/2602691187 wait complete. 2023-10-03T10:12:13.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:13.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.880+0000 7f81877fe700 1 -- 172.21.15.125:0/1357289854 >> v1:172.21.15.125:6816/126957 conn(0x7f817402f510 legacy=0x7f81740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:13.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.885+0000 7feed583c700 1 -- 172.21.15.125:0/686848598 >> v1:172.21.15.125:6816/126957 conn(0x7feeb402f510 legacy=0x7feeb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:13.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.919+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feed004f2a0 con 0x7feed009e170 2023-10-03T10:12:13.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.920+0000 7feec27fc700 1 -- 172.21.15.125:0/686848598 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feec4017070 con 0x7feed009e170 2023-10-03T10:12:13.919 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:13.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 >> v1:172.21.15.125:6816/126957 conn(0x7feeb402f510 legacy=0x7feeb40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 msgr2=0x7feed011b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feec400e9b0 tx=0x7feec400ed70 comp rx=0 tx=0).stop 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 shutdown_connections 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feed0130ce0 0x7feed011b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed009d860 0x7feed011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 --2- 172.21.15.125:0/686848598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feed009e170 0x7feed011b3b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 >> 172.21.15.125:0/686848598 conn(0x7feed0099c40 msgr2=0x7feed012dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 shutdown_connections 2023-10-03T10:12:13.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.922+0000 7feed7aa0700 1 -- 172.21.15.125:0/686848598 wait complete. 2023-10-03T10:12:13.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:13.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.934+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f818804f2a0 con 0x7f8188133f70 2023-10-03T10:12:13.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.934+0000 7f816ffff700 1 -- 172.21.15.125:0/1357289854 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f817c019d20 con 0x7f8188133f70 2023-10-03T10:12:13.934 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:13.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 >> v1:172.21.15.125:6816/126957 conn(0x7f817402f510 legacy=0x7f81740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 msgr2=0x7f8188126660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c530 tx=0x7f817c00c840 comp rx=0 tx=0).stop 2023-10-03T10:12:13.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 shutdown_connections 2023-10-03T10:12:13.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81881343a0 0x7f8188126ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f818809ad40 0x7f8188126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 --2- 172.21.15.125:0/1357289854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8188133f70 0x7f8188126660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 >> 172.21.15.125:0/1357289854 conn(0x7f8188099c40 msgr2=0x7f818809df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.936+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 shutdown_connections 2023-10-03T10:12:13.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:13.937+0000 7f818e060700 1 -- 172.21.15.125:0/1357289854 wait complete. 2023-10-03T10:12:13.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:14.871 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:14.881 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:14.935 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:14.948 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:15.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 Processor -- start 2023-10-03T10:12:15.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 -- start start 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c133900 0x7f2e6c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 0x7f2e6c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c09a760 con 0x7f2e6c0a0ee0 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1336e0 con 0x7f2e6c133900 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e71830700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c09a080 con 0x7f2e6c134210 2023-10-03T10:12:15.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e6b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2e6c0a0ee0 0x7f2e6c13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36334/0 (socket says 172.21.15.125:36334) 2023-10-03T10:12:15.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.009+0000 7f2e6b7fe700 1 -- 172.21.15.125:0/554008950 learned_addr learned my addr 172.21.15.125:0/554008950 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:15.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 0x7f2e6c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6affd700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c133900 0x7f2e6c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e69ffb700 1 -- 172.21.15.125:0/554008950 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884895133 0 0) 0x7f2e6c09a760 con 0x7f2e6c0a0ee0 2023-10-03T10:12:15.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e69ffb700 1 -- 172.21.15.125:0/554008950 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e540035b0 con 0x7f2e6c0a0ee0 2023-10-03T10:12:15.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 -- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c133900 msgr2=0x7f2e6c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c133900 0x7f2e6c133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 -- 172.21.15.125:0/554008950 >> v1:172.21.15.125:6789/0 conn(0x7f2e6c0a0ee0 legacy=0x7f2e6c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 -- 172.21.15.125:0/554008950 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0a23e0 con 0x7f2e6c134210 2023-10-03T10:12:15.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e6a7fc700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 0x7f2e6c0a09a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009870 tx=0x7f2e60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18bdc8264484f20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e69ffb700 1 -- 172.21.15.125:0/554008950 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60011830 con 0x7f2e6c134210 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e69ffb700 1 -- 172.21.15.125:0/554008950 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e60011990 con 0x7f2e6c134210 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.010+0000 7f2e69ffb700 1 -- 172.21.15.125:0/554008950 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60011d20 con 0x7f2e6c134210 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 -- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 msgr2=0x7f2e6c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 0x7f2e6c0a09a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009870 tx=0x7f2e60009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 -- 172.21.15.125:0/554008950 shutdown_connections 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c133900 0x7f2e6c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 --2- 172.21.15.125:0/554008950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c134210 0x7f2e6c0a09a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 -- 172.21.15.125:0/554008950 >> 172.21.15.125:0/554008950 conn(0x7f2e6c0a2980 msgr2=0x7f2e6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 -- 172.21.15.125:0/554008950 shutdown_connections 2023-10-03T10:12:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.011+0000 7f2e71830700 1 -- 172.21.15.125:0/554008950 wait complete. 2023-10-03T10:12:15.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.013+0000 7f2e71830700 1 Processor -- start 2023-10-03T10:12:15.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.013+0000 7f2e71830700 1 -- start start 2023-10-03T10:12:15.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.013+0000 7f2e71830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e6c0a0ee0 0x7f2e6c11d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e71830700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c133900 0x7f2e6c11df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e71830700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e71830700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c11f620 con 0x7f2e6c0a0ee0 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e71830700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c121190 con 0x7f2e6c134210 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e71830700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c132bb0 con 0x7f2e6c133900 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43166/0 (socket says 172.21.15.125:43166) 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 -- 172.21.15.125:0/3548655343 learned_addr learned my addr 172.21.15.125:0/3548655343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6a7fc700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c133900 0x7f2e6c11df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 -- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c133900 msgr2=0x7f2e6c11df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c133900 0x7f2e6c11df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 -- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e6c0a0ee0 msgr2=0x7f2e6c11d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e6c0a0ee0 0x7f2e6c11d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 -- 172.21.15.125:0/3548655343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600094a0 con 0x7f2e6c134210 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e6b7fe700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cb40 tx=0x7f2e6400ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.014+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400aaa0 con 0x7f2e6c134210 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.015+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6400ac00 con 0x7f2e6c134210 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.015+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c09a2c0 con 0x7f2e6c134210 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.015+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c11fca0 con 0x7f2e6c134210 2023-10-03T10:12:15.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.015+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64012400 con 0x7f2e6c134210 2023-10-03T10:12:15.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.015+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e6401b3b0 con 0x7f2e6c134210 2023-10-03T10:12:15.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.016+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e6403f960 con 0x7f2e6c134210 2023-10-03T10:12:15.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.016+0000 7f2e6affd700 1 -- 172.21.15.125:0/3548655343 >> v1:172.21.15.125:6816/126957 conn(0x7f2e5802f510 legacy=0x7f2e580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.016+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c11a590 con 0x7f2e6c134210 2023-10-03T10:12:15.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.025+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e640113a0 con 0x7f2e6c134210 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 Processor -- start 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 -- start start 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd17006a770 0x7fd1701349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd17009dea0 0x7fd17009e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17006b2e0 con 0x7fd17009dea0 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17009eca0 con 0x7fd170134f00 2023-10-03T10:12:15.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.051+0000 7fd175688700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd17009f720 con 0x7fd17006a770 2023-10-03T10:12:15.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43170/0 (socket says 172.21.15.125:43170) 2023-10-03T10:12:15.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 -- 172.21.15.125:0/879702749 learned_addr learned my addr 172.21.15.125:0/879702749 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16f7fe700 1 --2- 172.21.15.125:0/879702749 >> v2:172.21.15.125:3300/0 conn(0x7fd17009dea0 0x7fd17009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 -- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd17006a770 msgr2=0x7fd1701349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 --2- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd17006a770 0x7fd1701349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 -- 172.21.15.125:0/879702749 >> v2:172.21.15.125:3300/0 conn(0x7fd17009dea0 msgr2=0x7fd17009e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 --2- 172.21.15.125:0/879702749 >> v2:172.21.15.125:3300/0 conn(0x7fd17009dea0 0x7fd17009e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 -- 172.21.15.125:0/879702749 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17006b480 con 0x7fd170134f00 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16e7fc700 1 --2- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1600098f0 tx=0x7fd160009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd2eb76a97609bc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16dffb700 1 -- 172.21.15.125:0/879702749 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160011830 con 0x7fd170134f00 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16dffb700 1 -- 172.21.15.125:0/879702749 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160011990 con 0x7fd170134f00 2023-10-03T10:12:15.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.052+0000 7fd16dffb700 1 -- 172.21.15.125:0/879702749 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160011d20 con 0x7fd170134f00 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 -- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 msgr2=0x7fd17009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 --2- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1600098f0 tx=0x7fd160009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 -- 172.21.15.125:0/879702749 shutdown_connections 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 --2- 172.21.15.125:0/879702749 >> v2:172.21.15.125:3300/0 conn(0x7fd17009dea0 0x7fd17009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 --2- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd17006a770 0x7fd1701349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 --2- 172.21.15.125:0/879702749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd170134f00 0x7fd17009d960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.053+0000 7fd175688700 1 -- 172.21.15.125:0/879702749 >> 172.21.15.125:0/879702749 conn(0x7fd170099c40 msgr2=0x7fd1700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.054+0000 7fd175688700 1 -- 172.21.15.125:0/879702749 shutdown_connections 2023-10-03T10:12:15.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.054+0000 7fd175688700 1 -- 172.21.15.125:0/879702749 wait complete. 2023-10-03T10:12:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.055+0000 7fd175688700 1 Processor -- start 2023-10-03T10:12:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.055+0000 7fd175688700 1 -- start start 2023-10-03T10:12:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd17009dea0 0x7fd17011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd170134f00 0x7fd17011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17009f220 con 0x7fd17009dea0 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17011d6a0 con 0x7fd17006a770 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd175688700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700a01f0 con 0x7fd170134f00 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43176/0 (socket says 172.21.15.125:43176) 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 -- 172.21.15.125:0/1728217942 learned_addr learned my addr 172.21.15.125:0/1728217942 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16f7fe700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd170134f00 0x7fd17011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 -- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd170134f00 msgr2=0x7fd17011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd170134f00 0x7fd17011b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 -- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd17009dea0 msgr2=0x7fd17011ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd17009dea0 0x7fd17011ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 -- 172.21.15.125:0/1728217942 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160009550 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.056+0000 7fd16effd700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b4a0 tx=0x7fd16400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.057+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011830 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.057+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164011990 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.057+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011d40 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.057+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170139410 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.057+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170138f00 con 0x7fd17006a770 2023-10-03T10:12:15.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.058+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17004f2a0 con 0x7fd17006a770 2023-10-03T10:12:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.060+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd16401a400 con 0x7fd17006a770 2023-10-03T10:12:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.060+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd1640401c0 con 0x7fd17006a770 2023-10-03T10:12:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.060+0000 7fd16e7fc700 1 -- 172.21.15.125:0/1728217942 >> v1:172.21.15.125:6816/126957 conn(0x7fd15c02f510 legacy=0x7fd15c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.067+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd16401ae60 con 0x7fd17006a770 2023-10-03T10:12:15.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 Processor -- start 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 -- start start 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d01379e0 con 0x7fa5d00a1230 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00a2100 con 0x7fa5d00a08e0 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5d70de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0138950 con 0x7fa5d0138040 2023-10-03T10:12:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.095+0000 7fa5cffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d567b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa5d00a1230 0x7fa5d013ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36344/0 (socket says 172.21.15.125:36344) 2023-10-03T10:12:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d567b700 1 -- 172.21.15.125:0/2020690901 learned_addr learned my addr 172.21.15.125:0/2020690901 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57860/0 (socket says 172.21.15.125:57860) 2023-10-03T10:12:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/2020690901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/2020690901 >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 msgr2=0x7fa5d00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/2020690901 >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/2020690901 >> v1:172.21.15.125:6789/0 conn(0x7fa5d00a1230 legacy=0x7fa5d013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/2020690901 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d009b9b0 con 0x7fa5d0138040 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cf7fe700 1 -- 172.21.15.125:0/2020690901 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408410523 0 0) 0x7fa5d01379e0 con 0x7fa5d00a1230 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cffff700 1 --2- 172.21.15.125:0/2020690901 >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/2020690901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0138410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009850 tx=0x7fa5c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283dddc9ca60e552 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cf7fe700 1 -- 172.21.15.125:0/2020690901 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4005e30 con 0x7fa5d0138040 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cf7fe700 1 -- 172.21.15.125:0/2020690901 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4006030 con 0x7fa5d0138040 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.096+0000 7fa5cf7fe700 1 -- 172.21.15.125:0/2020690901 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40063c0 con 0x7fa5d0138040 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 -- 172.21.15.125:0/2020690901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 msgr2=0x7fa5d0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 --2- 172.21.15.125:0/2020690901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0138410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009850 tx=0x7fa5c4009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 -- 172.21.15.125:0/2020690901 shutdown_connections 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 --2- 172.21.15.125:0/2020690901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0138410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 --2- 172.21.15.125:0/2020690901 >> v2:172.21.15.125:3300/0 conn(0x7fa5d00a08e0 0x7fa5d00a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 -- 172.21.15.125:0/2020690901 >> 172.21.15.125:0/2020690901 conn(0x7fa5d00a2980 msgr2=0x7fa5d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 -- 172.21.15.125:0/2020690901 shutdown_connections 2023-10-03T10:12:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.097+0000 7fa5d70de700 1 -- 172.21.15.125:0/2020690901 wait complete. 2023-10-03T10:12:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.098+0000 7fa5d70de700 1 Processor -- start 2023-10-03T10:12:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.098+0000 7fa5d70de700 1 -- start start 2023-10-03T10:12:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 0x7fa5d01327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0140010 con 0x7fa5d00a1230 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d009cb20 con 0x7fa5d0138040 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d70de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d009a240 con 0x7fa5d00a08e0 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42646/0 (socket says 172.21.15.125:42646) 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/4236120152 learned_addr learned my addr 172.21.15.125:0/4236120152 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d567b700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5cffff700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 0x7fa5d01327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 msgr2=0x7fa5d0132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0132d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 msgr2=0x7fa5d01327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 0x7fa5d01327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5d4e7a700 1 -- 172.21.15.125:0/4236120152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0094a0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.099+0000 7fa5cffff700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 0x7fa5d01327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5d4e7a700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4013040 tx=0x7fa5c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4025430 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4020070 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40257b0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c4009430 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.100+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d013f180 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.101+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d004f2a0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.101+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa5c4022030 con 0x7fa5d00a08e0 2023-10-03T10:12:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.101+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa5c4041270 con 0x7fa5d00a08e0 2023-10-03T10:12:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.101+0000 7fa5cffff700 1 -- 172.21.15.125:0/4236120152 >> v1:172.21.15.125:6816/126957 conn(0x7fa5b402f510 legacy=0x7fa5b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.106+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5c40197a0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 Processor -- start 2023-10-03T10:12:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 -- start start 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 0x7f121c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c09f180 0x7f121c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.108+0000 7f12217f3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c0a0920 con 0x7f121c131d70 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f12217f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c09c970 con 0x7f121c09f180 2023-10-03T10:12:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f12217f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121c09bab0 con 0x7f121c09e870 2023-10-03T10:12:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 0x7f121c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57874/0 (socket says 172.21.15.125:57874) 2023-10-03T10:12:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121b7fe700 1 -- 172.21.15.125:0/1279276413 learned_addr learned my addr 172.21.15.125:0/1279276413 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121a7fc700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c09f180 0x7f121c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 -- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c09f180 msgr2=0x7f121c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c09f180 0x7f121c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 -- 172.21.15.125:0/1279276413 >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 msgr2=0x7f121c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 --2- 172.21.15.125:0/1279276413 >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 -- 172.21.15.125:0/1279276413 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c09f9c0 con 0x7f121c09e870 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121b7fe700 1 --2- 172.21.15.125:0/1279276413 >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.109+0000 7f121affd700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 0x7f121c09ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f120c00f9b0 tx=0x7f120c00fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6704030ed4baff9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.110+0000 7f1219ffb700 1 -- 172.21.15.125:0/1279276413 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00fe50 con 0x7f121c09e870 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.110+0000 7f1219ffb700 1 -- 172.21.15.125:0/1279276413 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00f240 con 0x7f121c09e870 2023-10-03T10:12:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.110+0000 7f1219ffb700 1 -- 172.21.15.125:0/1279276413 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0098f0 con 0x7f121c09e870 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 -- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 msgr2=0x7f121c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 0x7f121c09ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f120c00f9b0 tx=0x7f120c00fcc0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 -- 172.21.15.125:0/1279276413 shutdown_connections 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 --2- 172.21.15.125:0/1279276413 >> v2:172.21.15.125:3300/0 conn(0x7f121c131d70 0x7f121c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09e870 0x7f121c09ec40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 --2- 172.21.15.125:0/1279276413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c09f180 0x7f121c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 -- 172.21.15.125:0/1279276413 >> 172.21.15.125:0/1279276413 conn(0x7f121c0a4430 msgr2=0x7f121c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 -- 172.21.15.125:0/1279276413 shutdown_connections 2023-10-03T10:12:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.111+0000 7f12217f3700 1 -- 172.21.15.125:0/1279276413 wait complete. 2023-10-03T10:12:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 Processor -- start 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 -- start start 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f121c09e870 0x7f121c1246e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c131d70 0x7f121c125160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c1268f0 con 0x7f121c09e870 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c09dc10 con 0x7f121c131d70 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.112+0000 7f12217f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0a2bd0 con 0x7f121c09f180 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:42666/0 (socket says 172.21.15.125:42666) 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 -- 172.21.15.125:0/4052927775 learned_addr learned my addr 172.21.15.125:0/4052927775 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121affd700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f121c09e870 0x7f121c1246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121b7fe700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c131d70 0x7f121c125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 -- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c131d70 msgr2=0x7f121c125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c131d70 0x7f121c125160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 -- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f121c09e870 msgr2=0x7f121c1246e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f121c09e870 0x7f121c1246e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 -- 172.21.15.125:0/4052927775 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009b30 con 0x7f121c09f180 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f121a7fc700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f121000e900 tx=0x7f121000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000ee50 con 0x7f121c09f180 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000c7f0 con 0x7f121c09f180 2023-10-03T10:12:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000cb80 con 0x7f121c09f180 2023-10-03T10:12:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.113+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c00f610 con 0x7f121c09f180 2023-10-03T10:12:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.114+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c126ac0 con 0x7f121c09f180 2023-10-03T10:12:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.114+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f121000cce0 con 0x7f121c09f180 2023-10-03T10:12:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.115+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f121003fcc0 con 0x7f121c09f180 2023-10-03T10:12:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.115+0000 7f121affd700 1 -- 172.21.15.125:0/4052927775 >> v1:172.21.15.125:6816/126957 conn(0x7f120802f560 legacy=0x7f1208031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.115+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c09b640 con 0x7f121c09f180 2023-10-03T10:12:15.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.124+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1210017020 con 0x7f121c09f180 2023-10-03T10:12:15.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.217+0000 7f2e6affd700 1 -- 172.21.15.125:0/3548655343 >> v1:172.21.15.125:6816/126957 conn(0x7f2e5802f510 legacy=0x7f2e580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.240+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e6c04f2a0 con 0x7f2e6c134210 2023-10-03T10:12:15.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.241+0000 7f2e53fff700 1 -- 172.21.15.125:0/3548655343 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e64017020 con 0x7f2e6c134210 2023-10-03T10:12:15.240 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 >> v1:172.21.15.125:6816/126957 conn(0x7f2e5802f510 legacy=0x7f2e580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 msgr2=0x7f2e6c11e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cb40 tx=0x7f2e6400ce50 comp rx=0 tx=0).stop 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 shutdown_connections 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e6c134210 0x7f2e6c11e450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e6c0a0ee0 0x7f2e6c11d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 --2- 172.21.15.125:0/3548655343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e6c133900 0x7f2e6c11df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 >> 172.21.15.125:0/3548655343 conn(0x7f2e6c0a2980 msgr2=0x7f2e6c1badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 shutdown_connections 2023-10-03T10:12:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.243+0000 7f2e71830700 1 -- 172.21.15.125:0/3548655343 wait complete. 2023-10-03T10:12:15.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:15.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.261+0000 7fd16e7fc700 1 -- 172.21.15.125:0/1728217942 >> v1:172.21.15.125:6816/126957 conn(0x7fd15c02f510 legacy=0x7fd15c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.278+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd17006c3b0 con 0x7fd17006a770 2023-10-03T10:12:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.279+0000 7fd1577fe700 1 -- 172.21.15.125:0/1728217942 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd164028090 con 0x7fd17006a770 2023-10-03T10:12:15.278 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:15.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 >> v1:172.21.15.125:6816/126957 conn(0x7fd15c02f510 legacy=0x7fd15c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 msgr2=0x7fd17011a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b4a0 tx=0x7fd16400b7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 shutdown_connections 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd170134f00 0x7fd17011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd17006a770 0x7fd17011a620 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 --2- 172.21.15.125:0/1728217942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd17009dea0 0x7fd17011ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 >> 172.21.15.125:0/1728217942 conn(0x7fd170099c40 msgr2=0x7fd17009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 shutdown_connections 2023-10-03T10:12:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.281+0000 7fd175688700 1 -- 172.21.15.125:0/1728217942 wait complete. 2023-10-03T10:12:15.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:15.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.302+0000 7fa5cffff700 1 -- 172.21.15.125:0/4236120152 >> v1:172.21.15.125:6816/126957 conn(0x7fa5b402f510 legacy=0x7fa5b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.304+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5d006bce0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.305+0000 7fa5cd7fa700 1 -- 172.21.15.125:0/4236120152 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5c40193b0 con 0x7fa5d00a08e0 2023-10-03T10:12:15.304 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:15.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 >> v1:172.21.15.125:6816/126957 conn(0x7fa5b402f510 legacy=0x7fa5b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 msgr2=0x7fa5d013e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4013040 tx=0x7fa5c4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 shutdown_connections 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5d0138040 0x7fa5d0132d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5d00a08e0 0x7fa5d013e580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 --2- 172.21.15.125:0/4236120152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5d00a1230 0x7fa5d01327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 >> 172.21.15.125:0/4236120152 conn(0x7fa5d00a2980 msgr2=0x7fa5d00719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 shutdown_connections 2023-10-03T10:12:15.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.307+0000 7fa5d70de700 1 -- 172.21.15.125:0/4236120152 wait complete. 2023-10-03T10:12:15.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.316+0000 7f121affd700 1 -- 172.21.15.125:0/4052927775 >> v1:172.21.15.125:6816/126957 conn(0x7f120802f560 legacy=0x7f1208031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:15.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.334+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f121c04f2a0 con 0x7f121c09f180 2023-10-03T10:12:15.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.334+0000 7f12037fe700 1 -- 172.21.15.125:0/4052927775 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12100232f0 con 0x7f121c09f180 2023-10-03T10:12:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 >> v1:172.21.15.125:6816/126957 conn(0x7f120802f560 legacy=0x7f1208031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 msgr2=0x7f121c124c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f121000e900 tx=0x7f121000ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 shutdown_connections 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f121c131d70 0x7f121c125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f121c09e870 0x7f121c1246e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 --2- 172.21.15.125:0/4052927775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f121c09f180 0x7f121c124c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 >> 172.21.15.125:0/4052927775 conn(0x7f121c0a4430 msgr2=0x7f121c130df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 shutdown_connections 2023-10-03T10:12:15.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:15.336+0000 7f12217f3700 1 -- 172.21.15.125:0/4052927775 wait complete. 2023-10-03T10:12:15.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:16.256 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:16.293 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:16.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:16.349 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:16.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.405+0000 7ff3f54f9700 1 Processor -- start 2023-10-03T10:12:16.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 -- start start 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0133900 0x7ff3f0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 0x7ff3f00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f009a760 con 0x7ff3f0134210 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01336e0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3f54f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f009a080 con 0x7ff3f0133900 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56658/0 (socket says 172.21.15.125:56658) 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3ef7fe700 1 -- 172.21.15.125:0/4211336351 learned_addr learned my addr 172.21.15.125:0/4211336351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.406+0000 7ff3ee7fc700 1 --2- 172.21.15.125:0/4211336351 >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 0x7ff3f00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 -- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0133900 msgr2=0x7ff3f0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 --2- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0133900 0x7ff3f0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 -- 172.21.15.125:0/4211336351 >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 msgr2=0x7ff3f00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 --2- 172.21.15.125:0/4211336351 >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 0x7ff3f00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 -- 172.21.15.125:0/4211336351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00a23e0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ee7fc700 1 --2- 172.21.15.125:0/4211336351 >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 0x7ff3f00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3ef7fe700 1 --2- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009e50 tx=0x7ff3e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808b12ef52e6157b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3edffb700 1 -- 172.21.15.125:0/4211336351 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800e070 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3edffb700 1 -- 172.21.15.125:0/4211336351 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800b9c0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.407+0000 7ff3edffb700 1 -- 172.21.15.125:0/4211336351 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800bd70 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 -- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 msgr2=0x7ff3f00a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009e50 tx=0x7ff3e800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:16.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 -- 172.21.15.125:0/4211336351 shutdown_connections 2023-10-03T10:12:16.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f00a0ee0 0x7ff3f00a1360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/4211336351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0133900 0x7ff3f0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/4211336351 >> v2:172.21.15.125:3300/0 conn(0x7ff3f0134210 0x7ff3f00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 -- 172.21.15.125:0/4211336351 >> 172.21.15.125:0/4211336351 conn(0x7ff3f00a2980 msgr2=0x7ff3f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 -- 172.21.15.125:0/4211336351 shutdown_connections 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.408+0000 7ff3f54f9700 1 -- 172.21.15.125:0/4211336351 wait complete. 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.409+0000 7ff3f54f9700 1 Processor -- start 2023-10-03T10:12:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.409+0000 7ff3f54f9700 1 -- start start 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f0133900 0x7ff3f011dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0134210 0x7ff3f011e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01205d0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f011ebb0 con 0x7ff3f0133900 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3f54f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0121020 con 0x7ff3f0134210 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52350/0 (socket says 172.21.15.125:52350) 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 -- 172.21.15.125:0/1168675307 learned_addr learned my addr 172.21.15.125:0/1168675307 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3ee7fc700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f0133900 0x7ff3f011dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3ef7fe700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0134210 0x7ff3f011e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 -- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0134210 msgr2=0x7ff3f011e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0134210 0x7ff3f011e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 -- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f0133900 msgr2=0x7ff3f011dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f0133900 0x7ff3f011dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 -- 172.21.15.125:0/1168675307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009b30 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.410+0000 7ff3eeffd700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b520 tx=0x7ff3e000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.411+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0005aa0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.411+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0005c20 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.411+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f0120110 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.411+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011630 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.411+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f009a2c0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.412+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f011a590 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.412+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff3e0011790 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.412+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff3e003ff60 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.412+0000 7ff3ee7fc700 1 -- 172.21.15.125:0/1168675307 >> v1:172.21.15.125:6816/126957 conn(0x7ff3dc02f510 legacy=0x7ff3dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.418+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3e006b750 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.440+0000 7fd4f228f700 1 Processor -- start 2023-10-03T10:12:16.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 -- start start 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 0x7fd4ec135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 0x7fd4ec138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec099a60 con 0x7fd4ec099e20 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec09bf50 con 0x7fd4ec133660 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f228f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec09b230 con 0x7fd4ec135f80 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4ebfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd4ec099e20 0x7fd4ec09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39522/0 (socket says 172.21.15.125:39522) 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4ebfff700 1 -- 172.21.15.125:0/3950022219 learned_addr learned my addr 172.21.15.125:0/3950022219 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4eb7fe700 1 --2- 172.21.15.125:0/3950022219 >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 0x7fd4ec135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.441+0000 7fd4f082c700 1 --2- 172.21.15.125:0/3950022219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 0x7fd4ec138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4f082c700 1 -- 172.21.15.125:0/3950022219 >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 msgr2=0x7fd4ec135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4f082c700 1 --2- 172.21.15.125:0/3950022219 >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 0x7fd4ec135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4f082c700 1 -- 172.21.15.125:0/3950022219 >> v1:172.21.15.125:6789/0 conn(0x7fd4ec099e20 legacy=0x7fd4ec09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4f082c700 1 -- 172.21.15.125:0/3950022219 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec09bb90 con 0x7fd4ec135f80 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4eb7fe700 1 --2- 172.21.15.125:0/3950022219 >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 0x7fd4ec135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4f082c700 1 --2- 172.21.15.125:0/3950022219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 0x7fd4ec138360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432e1271fec2f676 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4eaffd700 1 -- 172.21.15.125:0/3950022219 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400e070 con 0x7fd4ec135f80 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4eaffd700 1 -- 172.21.15.125:0/3950022219 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400bb20 con 0x7fd4ec135f80 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.442+0000 7fd4eaffd700 1 -- 172.21.15.125:0/3950022219 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4012430 con 0x7fd4ec135f80 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 -- 172.21.15.125:0/3950022219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 msgr2=0x7fd4ec138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3950022219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 0x7fd4ec138360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:16.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 -- 172.21.15.125:0/3950022219 shutdown_connections 2023-10-03T10:12:16.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3950022219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec135f80 0x7fd4ec138360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3950022219 >> v2:172.21.15.125:3300/0 conn(0x7fd4ec133660 0x7fd4ec135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 -- 172.21.15.125:0/3950022219 >> 172.21.15.125:0/3950022219 conn(0x7fd4ec0a2980 msgr2=0x7fd4ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 -- 172.21.15.125:0/3950022219 shutdown_connections 2023-10-03T10:12:16.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.443+0000 7fd4f228f700 1 -- 172.21.15.125:0/3950022219 wait complete. 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.444+0000 7fd4f228f700 1 Processor -- start 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 -- start start 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 0x7fd4ec118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4ec133660 0x7fd4ec119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec12db80 con 0x7fd4ec135f80 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec11c830 con 0x7fd4ec133660 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f228f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec11a8c0 con 0x7fd4ec099e20 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f082c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 0x7fd4ec118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f082c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52378/0 (socket says 172.21.15.125:52378) 2023-10-03T10:12:16.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.445+0000 7fd4f082c700 1 -- 172.21.15.125:0/3001690874 learned_addr learned my addr 172.21.15.125:0/3001690874 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 -- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4ec133660 msgr2=0x7fd4ec119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4ec133660 0x7fd4ec119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 -- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 msgr2=0x7fd4ec119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 -- 172.21.15.125:0/3001690874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00094a0 con 0x7fd4ec099e20 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4f082c700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4ebfff700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 0x7fd4ec118df0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c500 tx=0x7fd4dc00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0074e0 con 0x7fd4ec099e20 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc007640 con 0x7fd4ec099e20 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e4009a70 con 0x7fd4ec099e20 2023-10-03T10:12:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005a50 con 0x7fd4ec099e20 2023-10-03T10:12:16.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.446+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec11bea0 con 0x7fd4ec099e20 2023-10-03T10:12:16.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.447+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd4dc005bb0 con 0x7fd4ec099e20 2023-10-03T10:12:16.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.447+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec072480 con 0x7fd4ec099e20 2023-10-03T10:12:16.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.447+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd4dc03ee90 con 0x7fd4ec099e20 2023-10-03T10:12:16.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.448+0000 7fd4eb7fe700 1 -- 172.21.15.125:0/3001690874 >> v1:172.21.15.125:6816/126957 conn(0x7fd4d802f510 legacy=0x7fd4d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.452+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4ec072480 con 0x7fd4ec099e20 2023-10-03T10:12:16.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.486+0000 7f5f4594f700 1 Processor -- start 2023-10-03T10:12:16.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 -- start start 2023-10-03T10:12:16.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 0x7f5f40138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 0x7f5f4013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4009fa00 con 0x7f5f4009e870 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400a0370 con 0x7f5f401393a0 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f4594f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4006bec0 con 0x7f5f4009f350 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f3effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f4009e870 0x7f5f4009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39528/0 (socket says 172.21.15.125:39528) 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f3effd700 1 -- 172.21.15.125:0/842176152 learned_addr learned my addr 172.21.15.125:0/842176152 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.487+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/842176152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 0x7f5f40138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3f7fe700 1 --2- 172.21.15.125:0/842176152 >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 0x7f5f4013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/842176152 >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 msgr2=0x7f5f4013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/842176152 >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 0x7f5f4013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/842176152 >> v1:172.21.15.125:6789/0 conn(0x7f5f4009e870 legacy=0x7f5f4009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/842176152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4009ada0 con 0x7f5f4009f350 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3f7fe700 1 --2- 172.21.15.125:0/842176152 >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 0x7f5f4013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/842176152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 0x7f5f40138e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43631274ad163ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3dffb700 1 -- 172.21.15.125:0/842176152 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011830 con 0x7f5f4009f350 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3dffb700 1 -- 172.21.15.125:0/842176152 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34011990 con 0x7f5f4009f350 2023-10-03T10:12:16.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.488+0000 7f5f3dffb700 1 -- 172.21.15.125:0/842176152 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011d20 con 0x7f5f4009f350 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 -- 172.21.15.125:0/842176152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 msgr2=0x7f5f40138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 --2- 172.21.15.125:0/842176152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 0x7f5f40138e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 -- 172.21.15.125:0/842176152 shutdown_connections 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 --2- 172.21.15.125:0/842176152 >> v2:172.21.15.125:3300/0 conn(0x7f5f401393a0 0x7f5f4013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 --2- 172.21.15.125:0/842176152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009f350 0x7f5f40138e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 -- 172.21.15.125:0/842176152 >> 172.21.15.125:0/842176152 conn(0x7f5f400a4430 msgr2=0x7f5f400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 -- 172.21.15.125:0/842176152 shutdown_connections 2023-10-03T10:12:16.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.489+0000 7f5f4594f700 1 -- 172.21.15.125:0/842176152 wait complete. 2023-10-03T10:12:16.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.490+0000 7f5f4594f700 1 Processor -- start 2023-10-03T10:12:16.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.490+0000 7f5f4594f700 1 -- start start 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009e870 0x7f5f4011a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 0x7f5f401cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4011bb00 con 0x7f5f4009f350 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4011de90 con 0x7f5f4009e870 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f4594f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4011c350 con 0x7f5f401393a0 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f3e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f3e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52402/0 (socket says 172.21.15.125:52402) 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/2455220946 learned_addr learned my addr 172.21.15.125:0/2455220946 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.491+0000 7f5f3effd700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009e870 0x7f5f4011a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3f7fe700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 0x7f5f401cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 msgr2=0x7f5f401cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 0x7f5f401cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009e870 msgr2=0x7f5f4011a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009e870 0x7f5f4011a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 -- 172.21.15.125:0/2455220946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009a70 con 0x7f5f4009f350 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3f7fe700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 0x7f5f401cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f3e7fc700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f340090b0 tx=0x7f5f34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340036a0 con 0x7f5f4009f350 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3401f070 con 0x7f5f4009f350 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34003a20 con 0x7f5f4009f350 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f4594f700 1 -- 172.21.15.125:0/2455220946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340094a0 con 0x7f5f4009f350 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.492+0000 7f5f4594f700 1 -- 172.21.15.125:0/2455220946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4011c870 con 0x7f5f4009f350 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.493+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f180052e0 con 0x7f5f4009f350 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.494+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5f34003b80 con 0x7f5f4009f350 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.494+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5f34021070 con 0x7f5f4009f350 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.494+0000 7f5f3effd700 1 -- 172.21.15.125:0/2455220946 >> v1:172.21.15.125:6816/126957 conn(0x7f5f2c02f510 legacy=0x7f5f2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.502+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f340259d0 con 0x7f5f4009f350 2023-10-03T10:12:16.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.522+0000 7fd8c05c6700 1 Processor -- start 2023-10-03T10:12:16.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.522+0000 7fd8c05c6700 1 -- start start 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8c05c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8b809f350 0x7fd8b8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8c05c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8c05c6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b809c970 con 0x7fd8b809e870 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8c05c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80a0920 con 0x7fd8b809f350 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8c05c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b809f9c0 con 0x7fd8b81371c0 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35082/0 (socket says 172.21.15.125:35082) 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 -- 172.21.15.125:0/3231864397 learned_addr learned my addr 172.21.15.125:0/3231864397 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8bdb61700 1 --2- 172.21.15.125:0/3231864397 >> v2:172.21.15.125:3300/0 conn(0x7fd8b809f350 0x7fd8b8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 -- 172.21.15.125:0/3231864397 >> v2:172.21.15.125:3300/0 conn(0x7fd8b809f350 msgr2=0x7fd8b8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 --2- 172.21.15.125:0/3231864397 >> v2:172.21.15.125:3300/0 conn(0x7fd8b809f350 0x7fd8b8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 -- 172.21.15.125:0/3231864397 >> v1:172.21.15.125:6789/0 conn(0x7fd8b809e870 legacy=0x7fd8b809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.523+0000 7fd8beb63700 1 -- 172.21.15.125:0/3231864397 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b809bab0 con 0x7fd8b81371c0 2023-10-03T10:12:16.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.524+0000 7fd8beb63700 1 --2- 172.21.15.125:0/3231864397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009e50 tx=0x7fd8b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f9e40d07ef484b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.524+0000 7fd8bd360700 1 -- 172.21.15.125:0/3231864397 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000e070 con 0x7fd8b81371c0 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.524+0000 7fd8bd360700 1 -- 172.21.15.125:0/3231864397 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000b910 con 0x7fd8b81371c0 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.524+0000 7fd8bd360700 1 -- 172.21.15.125:0/3231864397 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000bcc0 con 0x7fd8b81371c0 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 -- 172.21.15.125:0/3231864397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 msgr2=0x7fd8b81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/3231864397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009e50 tx=0x7fd8b000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 -- 172.21.15.125:0/3231864397 shutdown_connections 2023-10-03T10:12:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/3231864397 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b81371c0 0x7fd8b81395a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/3231864397 >> v2:172.21.15.125:3300/0 conn(0x7fd8b809f350 0x7fd8b8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 -- 172.21.15.125:0/3231864397 >> 172.21.15.125:0/3231864397 conn(0x7fd8b80a4430 msgr2=0x7fd8b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 -- 172.21.15.125:0/3231864397 shutdown_connections 2023-10-03T10:12:16.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.525+0000 7fd8c05c6700 1 -- 172.21.15.125:0/3231864397 wait complete. 2023-10-03T10:12:16.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 Processor -- start 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 -- start start 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b809e870 0x7fd8b8124630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b81371c0 0x7fd8b81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b81367e0 con 0x7fd8b809e870 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b806cc50 con 0x7fd8b81371c0 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8c05c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8136cb0 con 0x7fd8b809f350 2023-10-03T10:12:16.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8bdb61700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8beb63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b81371c0 0x7fd8b81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8bdb61700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35084/0 (socket says 172.21.15.125:35084) 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8bdb61700 1 -- 172.21.15.125:0/1399648119 learned_addr learned my addr 172.21.15.125:0/1399648119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.526+0000 7fd8be362700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b809e870 0x7fd8b8124630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 -- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b81371c0 msgr2=0x7fd8b81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b81371c0 0x7fd8b81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 -- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b809e870 msgr2=0x7fd8b8124630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b809e870 0x7fd8b8124630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 -- 172.21.15.125:0/1399648119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009b30 con 0x7fd8b809f350 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8bdb61700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e9e0 tx=0x7fd8a800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800ee80 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a800c850 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8121c80 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800cbc0 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.527+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8122950 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.528+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd8a800cd20 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.528+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd8a803fbd0 con 0x7fd8b809f350 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.528+0000 7fd8be362700 1 -- 172.21.15.125:0/1399648119 >> v1:172.21.15.125:6816/126957 conn(0x7fd89c02f510 legacy=0x7fd89c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.529+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b804f2a0 con 0x7fd8b809f350 2023-10-03T10:12:16.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.533+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8a8017080 con 0x7fd8b809f350 2023-10-03T10:12:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.614+0000 7ff3ee7fc700 1 -- 172.21.15.125:0/1168675307 >> v1:172.21.15.125:6816/126957 conn(0x7ff3dc02f510 legacy=0x7ff3dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.649+0000 7fd4eb7fe700 1 -- 172.21.15.125:0/3001690874 >> v1:172.21.15.125:6816/126957 conn(0x7fd4d802f510 legacy=0x7fd4d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.655+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3f004f2a0 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.655+0000 7ff3d77fe700 1 -- 172.21.15.125:0/1168675307 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3e0029090 con 0x7ff3f00a0ee0 2023-10-03T10:12:16.655 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:16.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.657+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 >> v1:172.21.15.125:6816/126957 conn(0x7ff3dc02f510 legacy=0x7ff3dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.657+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 msgr2=0x7ff3f011d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.657+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b520 tx=0x7ff3e000b830 comp rx=0 tx=0).stop 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 shutdown_connections 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3f0134210 0x7ff3f011e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f00a0ee0 0x7ff3f011d700 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 --2- 172.21.15.125:0/1168675307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f0133900 0x7ff3f011dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 >> 172.21.15.125:0/1168675307 conn(0x7ff3f00a2980 msgr2=0x7ff3f01baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 shutdown_connections 2023-10-03T10:12:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.658+0000 7ff3f54f9700 1 -- 172.21.15.125:0/1168675307 wait complete. 2023-10-03T10:12:16.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:16.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.695+0000 7f5f3effd700 1 -- 172.21.15.125:0/2455220946 >> v1:172.21.15.125:6816/126957 conn(0x7f5f2c02f510 legacy=0x7f5f2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.706+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4ec072480 con 0x7fd4ec099e20 2023-10-03T10:12:16.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.707+0000 7fd4e8ff9700 1 -- 172.21.15.125:0/3001690874 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4ec072480 con 0x7fd4ec099e20 2023-10-03T10:12:16.706 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 >> v1:172.21.15.125:6816/126957 conn(0x7fd4d802f510 legacy=0x7fd4d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 msgr2=0x7fd4ec118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 0x7fd4ec118df0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c500 tx=0x7fd4dc00c810 comp rx=0 tx=0).stop 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 shutdown_connections 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4ec135f80 0x7fd4ec119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4ec099e20 0x7fd4ec118df0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 --2- 172.21.15.125:0/3001690874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4ec133660 0x7fd4ec119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 >> 172.21.15.125:0/3001690874 conn(0x7fd4ec0a2980 msgr2=0x7fd4ec0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 shutdown_connections 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.710+0000 7fd4f228f700 1 -- 172.21.15.125:0/3001690874 wait complete. 2023-10-03T10:12:16.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.730+0000 7fd8be362700 1 -- 172.21.15.125:0/1399648119 >> v1:172.21.15.125:6816/126957 conn(0x7fd89c02f510 legacy=0x7fd89c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:16.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.752+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f18005860 con 0x7f5f4009f350 2023-10-03T10:12:16.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.753+0000 7f5f27fff700 1 -- 172.21.15.125:0/2455220946 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f34015070 con 0x7f5f4009f350 2023-10-03T10:12:16.752 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:16.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 >> v1:172.21.15.125:6816/126957 conn(0x7f5f2c02f510 legacy=0x7f5f2c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 msgr2=0x7f5f4011ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f340090b0 tx=0x7f5f34004750 comp rx=0 tx=0).stop 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 shutdown_connections 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f401393a0 0x7f5f401cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4009e870 0x7f5f4011a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 --2- 172.21.15.125:0/2455220946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4009f350 0x7f5f4011ae70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 >> 172.21.15.125:0/2455220946 conn(0x7f5f400a4430 msgr2=0x7f5f400a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 shutdown_connections 2023-10-03T10:12:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.755+0000 7f5f25ffb700 1 -- 172.21.15.125:0/2455220946 wait complete. 2023-10-03T10:12:16.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.765+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8b806b2a0 con 0x7fd8b809f350 2023-10-03T10:12:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.765+0000 7fd8aeffd700 1 -- 172.21.15.125:0/1399648119 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8a801bbd0 con 0x7fd8b809f350 2023-10-03T10:12:16.765 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:16.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 >> v1:172.21.15.125:6816/126957 conn(0x7fd89c02f510 legacy=0x7fd89c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 msgr2=0x7fd8b8122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e9e0 tx=0x7fd8a800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 shutdown_connections 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b81371c0 0x7fd8b81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b809e870 0x7fd8b8124630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 --2- 172.21.15.125:0/1399648119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8b809f350 0x7fd8b8122da0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.767+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 >> 172.21.15.125:0/1399648119 conn(0x7fd8b80a4430 msgr2=0x7fd8b80a2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.768+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 shutdown_connections 2023-10-03T10:12:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:16.768+0000 7fd8c05c6700 1 -- 172.21.15.125:0/1399648119 wait complete. 2023-10-03T10:12:16.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:17.725 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:17.767 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:17.780 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.811+0000 7f127ed19700 1 Processor -- start 2023-10-03T10:12:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 -- start start 2023-10-03T10:12:17.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f127809d860 0x7f127809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809e170 0x7f12781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 0x7f1278131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1278131670 con 0x7f127809d860 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127809aaa0 con 0x7f127809e170 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127ed19700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127809f870 con 0x7f1278130ce0 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127cab5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f127809d860 0x7f127809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127d2b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 0x7f1278131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127cab5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f127809d860 0x7f127809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52440/0 (socket says 172.21.15.125:52440) 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127d2b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 0x7f1278131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35086/0 (socket says 172.21.15.125:35086) 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.812+0000 7f127cab5700 1 -- 172.21.15.125:0/1958119531 learned_addr learned my addr 172.21.15.125:0/1958119531 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f1277fff700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809e170 0x7f12781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 -- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 msgr2=0x7f1278131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 0x7f1278131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 -- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809e170 msgr2=0x7f12781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809e170 0x7f12781307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 -- 172.21.15.125:0/1958119531 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127809b360 con 0x7f127809d860 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f127cab5700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f127809d860 0x7f127809dc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f126c009920 tx=0x7f126c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224afbdf489091ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f12777fe700 1 -- 172.21.15.125:0/1958119531 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00f8a0 con 0x7f127809d860 2023-10-03T10:12:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f12777fe700 1 -- 172.21.15.125:0/1958119531 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00fa00 con 0x7f127809d860 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.813+0000 7f12777fe700 1 -- 172.21.15.125:0/1958119531 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00fd90 con 0x7f127809d860 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.814+0000 7f127ed19700 1 -- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f127809d860 msgr2=0x7f127809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.814+0000 7f127ed19700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f127809d860 0x7f127809dc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f126c009920 tx=0x7f126c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 -- 172.21.15.125:0/1958119531 shutdown_connections 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1278130ce0 0x7f1278131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f127809d860 0x7f127809dc30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 --2- 172.21.15.125:0/1958119531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809e170 0x7f12781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 -- 172.21.15.125:0/1958119531 >> 172.21.15.125:0/1958119531 conn(0x7f1278099c40 msgr2=0x7f12780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 -- 172.21.15.125:0/1958119531 shutdown_connections 2023-10-03T10:12:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.815+0000 7f127ed19700 1 -- 172.21.15.125:0/1958119531 wait complete. 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.816+0000 7f127ed19700 1 Processor -- start 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.816+0000 7f127ed19700 1 -- start start 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 0x7f1278122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1278130ce0 0x7f1278122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780a0740 con 0x7f1278130ce0 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127809c8b0 con 0x7f127809d860 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127ed19700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1278125620 con 0x7f127809e170 2023-10-03T10:12:17.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127cab5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127cab5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56736/0 (socket says 172.21.15.125:56736) 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127cab5700 1 -- 172.21.15.125:0/1682687701 learned_addr learned my addr 172.21.15.125:0/1682687701 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f1277fff700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 0x7f1278122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.817+0000 7f127d2b6700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1278130ce0 0x7f1278122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 -- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 msgr2=0x7f1278122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 0x7f1278122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 -- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1278130ce0 msgr2=0x7f1278122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1278130ce0 0x7f1278122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 -- 172.21.15.125:0/1682687701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009550 con 0x7f127809d860 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127cab5700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f126c009c70 tx=0x7f126c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f1277fff700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 0x7f1278122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c01d040 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0038a0 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c003c10 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1278125bb0 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.818+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1278126620 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.819+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f126c022440 con 0x7f127809d860 2023-10-03T10:12:17.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.819+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127804f2a0 con 0x7f127809d860 2023-10-03T10:12:17.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.819+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f126c040fe0 con 0x7f127809d860 2023-10-03T10:12:17.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.819+0000 7f1277fff700 1 -- 172.21.15.125:0/1682687701 >> v1:172.21.15.125:6816/126957 conn(0x7f125c02f510 legacy=0x7f125c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:17.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.824+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f126c003d70 con 0x7f127809d860 2023-10-03T10:12:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 Processor -- start 2023-10-03T10:12:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 -- start start 2023-10-03T10:12:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b40a1e70 con 0x7f77b41304a0 2023-10-03T10:12:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b409a720 con 0x7f77b40a0a30 2023-10-03T10:12:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b9b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77b409b300 con 0x7f77b40a1340 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77b41304a0 0x7f77b41371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39540/0 (socket says 172.21.15.125:39540) 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b3fff700 1 -- 172.21.15.125:0/4108905175 learned_addr learned my addr 172.21.15.125:0/4108905175 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.861+0000 7f77b37fe700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56744/0 (socket says 172.21.15.125:56744) 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b2ffd700 1 -- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 msgr2=0x7f77b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b2ffd700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b2ffd700 1 -- 172.21.15.125:0/4108905175 >> v1:172.21.15.125:6789/0 conn(0x7f77b41304a0 legacy=0x7f77b41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b2ffd700 1 -- 172.21.15.125:0/4108905175 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b409abc0 con 0x7f77b40a1340 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b27fc700 1 -- 172.21.15.125:0/4108905175 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137499906 0 0) 0x7f77b40a1e70 con 0x7f77b41304a0 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b37fe700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b2ffd700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b412ff60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77a800bb10 tx=0x7f77a800be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda7f42b4481a6ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b27fc700 1 -- 172.21.15.125:0/4108905175 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800dd30 con 0x7f77b40a1340 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b27fc700 1 -- 172.21.15.125:0/4108905175 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800de90 con 0x7f77b40a1340 2023-10-03T10:12:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.862+0000 7f77b27fc700 1 -- 172.21.15.125:0/4108905175 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8010690 con 0x7f77b40a1340 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 -- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 msgr2=0x7f77b412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b412ff60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77a800bb10 tx=0x7f77a800be20 comp rx=0 tx=0).stop 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 -- 172.21.15.125:0/4108905175 shutdown_connections 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b40a0a30 0x7f77b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 --2- 172.21.15.125:0/4108905175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b412ff60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 -- 172.21.15.125:0/4108905175 >> 172.21.15.125:0/4108905175 conn(0x7f77b40a2980 msgr2=0x7f77b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 -- 172.21.15.125:0/4108905175 shutdown_connections 2023-10-03T10:12:17.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.863+0000 7f77b9b71700 1 -- 172.21.15.125:0/4108905175 wait complete. 2023-10-03T10:12:17.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.865+0000 7f77b9b71700 1 Processor -- start 2023-10-03T10:12:17.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.865+0000 7f77b9b71700 1 -- start start 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 0x7f77b411ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b411e960 con 0x7f77b40a0a30 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b411b530 con 0x7f77b41304a0 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b9b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77b412fbe0 con 0x7f77b40a1340 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35120/0 (socket says 172.21.15.125:35120) 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56750/0 (socket says 172.21.15.125:56750) 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b2ffd700 1 -- 172.21.15.125:0/1148966535 learned_addr learned my addr 172.21.15.125:0/1148966535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b37fe700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 0x7f77b411ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 -- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 msgr2=0x7f77b411bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 -- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 msgr2=0x7f77b411ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 0x7f77b411ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 -- 172.21.15.125:0/1148966535 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a800b740 con 0x7f77b41304a0 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b2ffd700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b37fe700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 0x7f77b411ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.866+0000 7f77b3fff700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00ca70 tx=0x7f77ac00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.867+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac007480 con 0x7f77b41304a0 2023-10-03T10:12:17.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.867+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac007600 con 0x7f77b41304a0 2023-10-03T10:12:17.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.867+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0079b0 con 0x7f77b41304a0 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.867+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b409fbe0 con 0x7f77b41304a0 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.867+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b409ae50 con 0x7f77b41304a0 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.868+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f77ac01b3b0 con 0x7f77b41304a0 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.868+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f77ac03f590 con 0x7f77b41304a0 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.868+0000 7f77b37fe700 1 -- 172.21.15.125:0/1148966535 >> v1:172.21.15.125:6816/126957 conn(0x7f77a002f540 legacy=0x7f77a00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.868+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b411c500 con 0x7f77b41304a0 2023-10-03T10:12:17.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.873+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77ac00e280 con 0x7f77b41304a0 2023-10-03T10:12:17.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.902+0000 7f4378f41700 1 Processor -- start 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.902+0000 7f4378f41700 1 -- start start 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.902+0000 7f4378f41700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f437409a130 0x7f437409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.902+0000 7f4378f41700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.902+0000 7f4378f41700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4374072b30 con 0x7f437409edb0 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4378f41700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437409a500 con 0x7f437409a130 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4378f41700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437409ada0 con 0x7f437409f1e0 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4371d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f437409edb0 0x7f437413c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39548/0 (socket says 172.21.15.125:39548) 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f437409a130 0x7f437409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4371d9b700 1 -- 172.21.15.125:0/1625581976 learned_addr learned my addr 172.21.15.125:0/1625581976 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:17.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4372d9d700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 -- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 msgr2=0x7f437413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 -- 172.21.15.125:0/1625581976 >> v1:172.21.15.125:6789/0 conn(0x7f437409edb0 legacy=0x7f437413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437159a700 1 -- 172.21.15.125:0/1625581976 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498987098 0 0) 0x7f4374072b30 con 0x7f437409edb0 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 -- 172.21.15.125:0/1625581976 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437409fe00 con 0x7f437409a130 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f4372d9d700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437259c700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409a130 0x7f437409e870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4364009840 tx=0x7f4364009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f164b94c51f37f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437159a700 1 -- 172.21.15.125:0/1625581976 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011830 con 0x7f437409a130 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437159a700 1 -- 172.21.15.125:0/1625581976 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364011990 con 0x7f437409a130 2023-10-03T10:12:17.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.903+0000 7f437159a700 1 -- 172.21.15.125:0/1625581976 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011d20 con 0x7f437409a130 2023-10-03T10:12:17.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 -- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409a130 msgr2=0x7f437409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409a130 0x7f437409e870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4364009840 tx=0x7f4364009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 -- 172.21.15.125:0/1625581976 shutdown_connections 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 --2- 172.21.15.125:0/1625581976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409a130 0x7f437409e870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 -- 172.21.15.125:0/1625581976 >> 172.21.15.125:0/1625581976 conn(0x7f43740a4430 msgr2=0x7f43740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 -- 172.21.15.125:0/1625581976 shutdown_connections 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.904+0000 7f4378f41700 1 -- 172.21.15.125:0/1625581976 wait complete. 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.905+0000 7f4378f41700 1 Processor -- start 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.905+0000 7f4378f41700 1 -- start start 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f437409a130 0x7f437411c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437411d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437411bb90 con 0x7f437409edb0 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437411b5e0 con 0x7f437409f1e0 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4378f41700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f437409e370 con 0x7f437409a130 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52476/0 (socket says 172.21.15.125:52476) 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 -- 172.21.15.125:0/2006830165 learned_addr learned my addr 172.21.15.125:0/2006830165 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4372d9d700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437411d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f437259c700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f437409a130 0x7f437411c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 -- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f437409a130 msgr2=0x7f437411c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f437409a130 0x7f437411c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 -- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 msgr2=0x7f437411d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.906+0000 7f4371d9b700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437411d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4371d9b700 1 -- 172.21.15.125:0/2006830165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640094a0 con 0x7f437409edb0 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4372d9d700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437411d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4371d9b700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f436800c550 tx=0x7f436800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368004c80 con 0x7f437409edb0 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368004de0 con 0x7f437409edb0 2023-10-03T10:12:17.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43740a00f0 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368007310 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.907+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437411d690 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.908+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437411b430 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.908+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4368007470 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.908+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f436803f700 con 0x7f437409edb0 2023-10-03T10:12:17.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.910+0000 7f437259c700 1 -- 172.21.15.125:0/2006830165 >> v1:172.21.15.125:6816/126957 conn(0x7f435402f540 legacy=0x7f43540319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:17.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.913+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43680133c0 con 0x7f437409edb0 2023-10-03T10:12:17.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.943+0000 7f746a32f700 1 Processor -- start 2023-10-03T10:12:17.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.943+0000 7f746a32f700 1 -- start start 2023-10-03T10:12:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f746a32f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f746a32f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 0x7f746413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f746a32f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746409dc00 con 0x7f74640a1380 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f746a32f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746409ea60 con 0x7f7464134120 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f746a32f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746409dec0 con 0x7f74640a0a70 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f74688cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 0x7f746413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f74688cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 0x7f746413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52488/0 (socket says 172.21.15.125:52488) 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f74688cc700 1 -- 172.21.15.125:0/3327031605 learned_addr learned my addr 172.21.15.125:0/3327031605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 -- 172.21.15.125:0/3327031605 >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 msgr2=0x7f746413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 --2- 172.21.15.125:0/3327031605 >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 0x7f746413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 -- 172.21.15.125:0/3327031605 >> v1:172.21.15.125:6789/0 conn(0x7f74640a1380 legacy=0x7f7464133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7462ffd700 1 -- 172.21.15.125:0/3327031605 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553989009 0 0) 0x7f746409dc00 con 0x7f74640a1380 2023-10-03T10:12:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 -- 172.21.15.125:0/3327031605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746409e6a0 con 0x7f74640a0a70 2023-10-03T10:12:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.944+0000 7f7463fff700 1 --2- 172.21.15.125:0/3327031605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74640a0e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7454009840 tx=0x7f7454009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebadba24067bfe4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f7462ffd700 1 -- 172.21.15.125:0/3327031605 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454011830 con 0x7f74640a0a70 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f7462ffd700 1 -- 172.21.15.125:0/3327031605 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454011990 con 0x7f74640a0a70 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f7462ffd700 1 -- 172.21.15.125:0/3327031605 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454011d20 con 0x7f74640a0a70 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 -- 172.21.15.125:0/3327031605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 msgr2=0x7f74640a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 --2- 172.21.15.125:0/3327031605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74640a0e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7454009840 tx=0x7f7454009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 -- 172.21.15.125:0/3327031605 shutdown_connections 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 --2- 172.21.15.125:0/3327031605 >> v2:172.21.15.125:3300/0 conn(0x7f7464134120 0x7f746413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 --2- 172.21.15.125:0/3327031605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74640a0e40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 -- 172.21.15.125:0/3327031605 >> 172.21.15.125:0/3327031605 conn(0x7f74640a6610 msgr2=0x7f74640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 -- 172.21.15.125:0/3327031605 shutdown_connections 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.945+0000 7f746a32f700 1 -- 172.21.15.125:0/3327031605 wait complete. 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.946+0000 7f746a32f700 1 Processor -- start 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.946+0000 7f746a32f700 1 -- start start 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 0x7f7464122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7464134120 0x7f7464123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641258f0 con 0x7f74640a1380 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74641242e0 con 0x7f74640a0a70 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f746a32f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7464133280 con 0x7f7464134120 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56780/0 (socket says 172.21.15.125:56780) 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 -- 172.21.15.125:0/1202260707 learned_addr learned my addr 172.21.15.125:0/1202260707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f74637fe700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 0x7f7464122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f74688cc700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7464134120 0x7f7464123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 -- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7464134120 msgr2=0x7f7464123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7464134120 0x7f7464123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 -- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 msgr2=0x7f7464122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 0x7f7464122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 -- 172.21.15.125:0/1202260707 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540094a0 con 0x7f74640a0a70 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f74637fe700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 0x7f7464122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.947+0000 7f7463fff700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74540090b0 tx=0x7f7454004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.948+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540036a0 con 0x7f74640a0a70 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.948+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745401f070 con 0x7f74640a0a70 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.948+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454003a40 con 0x7f74640a0a70 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.948+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640a03e0 con 0x7f74640a0a70 2023-10-03T10:12:17.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.948+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464125c50 con 0x7f74640a0a70 2023-10-03T10:12:17.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.949+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7454003ba0 con 0x7f74640a0a70 2023-10-03T10:12:17.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.949+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7454021070 con 0x7f74640a0a70 2023-10-03T10:12:17.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.949+0000 7f74637fe700 1 -- 172.21.15.125:0/1202260707 >> v1:172.21.15.125:6816/126957 conn(0x7f745002f540 legacy=0x7f74500319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:17.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.949+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74641336b0 con 0x7f74640a0a70 2023-10-03T10:12:17.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:17.954+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7454026480 con 0x7f74640a0a70 2023-10-03T10:12:18.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.020+0000 7f1277fff700 1 -- 172.21.15.125:0/1682687701 >> v1:172.21.15.125:6816/126957 conn(0x7f125c02f510 legacy=0x7f125c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:18.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.069+0000 7f77b37fe700 1 -- 172.21.15.125:0/1148966535 >> v1:172.21.15.125:6816/126957 conn(0x7f77a002f540 legacy=0x7f77a00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:18.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.106+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f437404f2a0 con 0x7f437409edb0 2023-10-03T10:12:18.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.106+0000 7f4362ffd700 1 -- 172.21.15.125:0/2006830165 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43680102c0 con 0x7f437409edb0 2023-10-03T10:12:18.106 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:18.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 >> v1:172.21.15.125:6816/126957 conn(0x7f435402f540 legacy=0x7f43540319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:18.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 msgr2=0x7f437411cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f436800c550 tx=0x7f436800c860 comp rx=0 tx=0).stop 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 shutdown_connections 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f437409f1e0 0x7f437411d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f437409a130 0x7f437411c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 --2- 172.21.15.125:0/2006830165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f437409edb0 0x7f437411cc10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 >> 172.21.15.125:0/2006830165 conn(0x7f43740a4430 msgr2=0x7f43740a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.109+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 shutdown_connections 2023-10-03T10:12:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.110+0000 7f4378f41700 1 -- 172.21.15.125:0/2006830165 wait complete. 2023-10-03T10:12:18.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.133+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f127806c3b0 con 0x7f127809d860 2023-10-03T10:12:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.133+0000 7f12757fa700 1 -- 172.21.15.125:0/1682687701 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f126c0093b0 con 0x7f127809d860 2023-10-03T10:12:18.133 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 >> v1:172.21.15.125:6816/126957 conn(0x7f125c02f510 legacy=0x7f125c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 msgr2=0x7f1278122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f126c009c70 tx=0x7f126c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 shutdown_connections 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1278130ce0 0x7f1278122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f127809d860 0x7f1278122400 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 --2- 172.21.15.125:0/1682687701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f127809e170 0x7f1278122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 >> 172.21.15.125:0/1682687701 conn(0x7f1278099c40 msgr2=0x7f1278070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 shutdown_connections 2023-10-03T10:12:18.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.135+0000 7f127ed19700 1 -- 172.21.15.125:0/1682687701 wait complete. 2023-10-03T10:12:18.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:18.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.150+0000 7f74637fe700 1 -- 172.21.15.125:0/1202260707 >> v1:172.21.15.125:6816/126957 conn(0x7f745002f540 legacy=0x7f74500319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:18.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.155+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f746404f2a0 con 0x7f74640a0a70 2023-10-03T10:12:18.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.156+0000 7f7460ff9700 1 -- 172.21.15.125:0/1202260707 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f745402b070 con 0x7f74640a0a70 2023-10-03T10:12:18.155 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 >> v1:172.21.15.125:6816/126957 conn(0x7f745002f540 legacy=0x7f74500319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 msgr2=0x7f74641226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74540090b0 tx=0x7f7454004750 comp rx=0 tx=0).stop 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 shutdown_connections 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7464134120 0x7f7464123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74640a0a70 0x7f74641226d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 --2- 172.21.15.125:0/1202260707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74640a1380 0x7f7464122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 >> 172.21.15.125:0/1202260707 conn(0x7f74640a6610 msgr2=0x7f746411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 shutdown_connections 2023-10-03T10:12:18.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.158+0000 7f746a32f700 1 -- 172.21.15.125:0/1202260707 wait complete. 2023-10-03T10:12:18.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.180+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77b404f2a0 con 0x7f77b41304a0 2023-10-03T10:12:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.181+0000 7f779bfff700 1 -- 172.21.15.125:0/1148966535 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77ac017030 con 0x7f77b41304a0 2023-10-03T10:12:18.180 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:18.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 >> v1:172.21.15.125:6816/126957 conn(0x7f77a002f540 legacy=0x7f77a00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 msgr2=0x7f77b41c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00ca70 tx=0x7f77ac00caa0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 shutdown_connections 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77b41304a0 0x7f77b41c3ea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77b40a0a30 0x7f77b411ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 --2- 172.21.15.125:0/1148966535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77b40a1340 0x7f77b411bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 >> 172.21.15.125:0/1148966535 conn(0x7f77b40a2980 msgr2=0x7f77b41b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 shutdown_connections 2023-10-03T10:12:18.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:18.183+0000 7f77b9b71700 1 -- 172.21.15.125:0/1148966535 wait complete. 2023-10-03T10:12:18.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:19.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:19.148 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:19.171 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:19.195 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:19.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 Processor -- start 2023-10-03T10:12:19.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 -- start start 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb80a1550 0x7f7fb8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 0x7f7fb813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb809e9d0 con 0x7f7fb80a0a70 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb809dc00 con 0x7f7fb80a1550 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.289+0000 7f7fc0768700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb809dec0 con 0x7f7fb8139200 2023-10-03T10:12:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbdd03700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb80a1550 0x7f7fb8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbe504700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80a0a70 0x7f7fb80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39558/0 (socket says 172.21.15.125:39558) 2023-10-03T10:12:19.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbe504700 1 -- 172.21.15.125:0/2756311255 learned_addr learned my addr 172.21.15.125:0/2756311255 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:19.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 --2- 172.21.15.125:0/2756311255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 0x7f7fb813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbd502700 1 -- 172.21.15.125:0/2756311255 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816088062 0 0) 0x7f7fb809e9d0 con 0x7f7fb80a0a70 2023-10-03T10:12:19.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbd502700 1 -- 172.21.15.125:0/2756311255 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa40035b0 con 0x7f7fb80a0a70 2023-10-03T10:12:19.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 -- 172.21.15.125:0/2756311255 >> v2:172.21.15.125:3300/0 conn(0x7f7fb80a1550 msgr2=0x7f7fb8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 --2- 172.21.15.125:0/2756311255 >> v2:172.21.15.125:3300/0 conn(0x7f7fb80a1550 0x7f7fb8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 -- 172.21.15.125:0/2756311255 >> v1:172.21.15.125:6789/0 conn(0x7f7fb80a0a70 legacy=0x7f7fb80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 -- 172.21.15.125:0/2756311255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb809e6a0 con 0x7f7fb8139200 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbed05700 1 --2- 172.21.15.125:0/2756311255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 0x7f7fb813b5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009d90 tx=0x7f7fb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec64a981d81710e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbd502700 1 -- 172.21.15.125:0/2756311255 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000e070 con 0x7f7fb8139200 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbd502700 1 -- 172.21.15.125:0/2756311255 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000bb20 con 0x7f7fb8139200 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.290+0000 7f7fbd502700 1 -- 172.21.15.125:0/2756311255 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0012430 con 0x7f7fb8139200 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 -- 172.21.15.125:0/2756311255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 msgr2=0x7f7fb813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 --2- 172.21.15.125:0/2756311255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 0x7f7fb813b5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009d90 tx=0x7f7fb000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 -- 172.21.15.125:0/2756311255 shutdown_connections 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 --2- 172.21.15.125:0/2756311255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8139200 0x7f7fb813b5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 --2- 172.21.15.125:0/2756311255 >> v2:172.21.15.125:3300/0 conn(0x7f7fb80a1550 0x7f7fb8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 -- 172.21.15.125:0/2756311255 >> 172.21.15.125:0/2756311255 conn(0x7f7fb80a6610 msgr2=0x7f7fb80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 -- 172.21.15.125:0/2756311255 shutdown_connections 2023-10-03T10:12:19.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.291+0000 7f7fc0768700 1 -- 172.21.15.125:0/2756311255 wait complete. 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.292+0000 7f7fc0768700 1 Processor -- start 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.292+0000 7f7fc0768700 1 -- start start 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fb80a0a70 0x7f7fb8121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fb8139200 0x7f7fb81221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8125070 con 0x7f7fb8139200 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8125e50 con 0x7f7fb80a1550 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fc0768700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8137640 con 0x7f7fb80a0a70 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fbdd03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fbdd03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56796/0 (socket says 172.21.15.125:56796) 2023-10-03T10:12:19.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fbdd03700 1 -- 172.21.15.125:0/795512680 learned_addr learned my addr 172.21.15.125:0/795512680 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.293+0000 7f7fbed05700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fb8139200 0x7f7fb81221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 -- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fb80a0a70 msgr2=0x7f7fb8121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fb80a0a70 0x7f7fb8121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 -- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fb8139200 msgr2=0x7f7fb81221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fb8139200 0x7f7fb81221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 -- 172.21.15.125:0/795512680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0009a70 con 0x7f7fb80a1550 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fbdd03700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e840 tx=0x7f7fa800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8013610 con 0x7f7fb80a1550 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8013770 con 0x7f7fb80a1550 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb8125270 con 0x7f7fb80a1550 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8013b20 con 0x7f7fb80a1550 2023-10-03T10:12:19.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.294+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb81233b0 con 0x7f7fb80a1550 2023-10-03T10:12:19.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.295+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7fa8013c80 con 0x7f7fb80a1550 2023-10-03T10:12:19.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.295+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7fa803fa60 con 0x7f7fb80a1550 2023-10-03T10:12:19.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.295+0000 7f7fbe504700 1 -- 172.21.15.125:0/795512680 >> v1:172.21.15.125:6816/126957 conn(0x7f7f9c02f510 legacy=0x7f7f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.295+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb804f2a0 con 0x7f7fb80a1550 2023-10-03T10:12:19.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.303+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fa8021020 con 0x7f7fb80a1550 2023-10-03T10:12:19.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.316+0000 7f718ba17700 1 Processor -- start 2023-10-03T10:12:19.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 -- start start 2023-10-03T10:12:19.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7184138040 0x7f7184138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f71840a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71841379e0 con 0x7f71840a1230 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71840a2100 con 0x7f71840a08e0 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f718ba17700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7184138950 con 0x7f7184138040 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f7189fb4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f71840a1230 0x7f718413ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39574/0 (socket says 172.21.15.125:39574) 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f7189fb4700 1 -- 172.21.15.125:0/661943050 learned_addr learned my addr 172.21.15.125:0/661943050 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f7188fb2700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f71840a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.317+0000 7f71897b3700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7184138040 0x7f7184138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f717bfff700 1 -- 172.21.15.125:0/661943050 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999874856 0 0) 0x7f71841379e0 con 0x7f71840a1230 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f717bfff700 1 -- 172.21.15.125:0/661943050 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700035b0 con 0x7f71840a1230 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f7188fb2700 1 -- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7184138040 msgr2=0x7f7184138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f7188fb2700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7184138040 0x7f7184138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f7188fb2700 1 -- 172.21.15.125:0/661943050 >> v1:172.21.15.125:6789/0 conn(0x7f71840a1230 legacy=0x7f718413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f7188fb2700 1 -- 172.21.15.125:0/661943050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718409b9b0 con 0x7f71840a08e0 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f7188fb2700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f71840a0cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71740098a0 tx=0x7f7174009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=384da0df7fc39c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f717bfff700 1 -- 172.21.15.125:0/661943050 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174004230 con 0x7f71840a08e0 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f717bfff700 1 -- 172.21.15.125:0/661943050 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174004390 con 0x7f71840a08e0 2023-10-03T10:12:19.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.318+0000 7f717bfff700 1 -- 172.21.15.125:0/661943050 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740036a0 con 0x7f71840a08e0 2023-10-03T10:12:19.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 -- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 msgr2=0x7f71840a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f71840a0cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71740098a0 tx=0x7f7174009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 -- 172.21.15.125:0/661943050 shutdown_connections 2023-10-03T10:12:19.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7184138040 0x7f7184138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 --2- 172.21.15.125:0/661943050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f71840a0cf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 -- 172.21.15.125:0/661943050 >> 172.21.15.125:0/661943050 conn(0x7f71840a2980 msgr2=0x7f71840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 -- 172.21.15.125:0/661943050 shutdown_connections 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.319+0000 7f718ba17700 1 -- 172.21.15.125:0/661943050 wait complete. 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 Processor -- start 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 -- start start 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f7184137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71840a1230 0x7f7184135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718413f460 con 0x7f7184138040 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71840727d0 con 0x7f71840a08e0 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.320+0000 7f718ba17700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7184130200 con 0x7f71840a1230 2023-10-03T10:12:19.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52514/0 (socket says 172.21.15.125:52514) 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 -- 172.21.15.125:0/1604479100 learned_addr learned my addr 172.21.15.125:0/1604479100 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 -- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71840a1230 msgr2=0x7f7184135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71840a1230 0x7f7184135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 -- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 msgr2=0x7f7184137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f7184137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.321+0000 7f7189fb4700 1 -- 172.21.15.125:0/1604479100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740094a0 con 0x7f7184138040 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.322+0000 7f7189fb4700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f717c00cb90 tx=0x7f717c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.322+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00ab30 con 0x7f7184138040 2023-10-03T10:12:19.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.322+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00ac90 con 0x7f7184138040 2023-10-03T10:12:19.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.322+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0070d0 con 0x7f7184138040 2023-10-03T10:12:19.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.322+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7184119430 con 0x7f7184138040 2023-10-03T10:12:19.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.323+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7184140740 con 0x7f7184138040 2023-10-03T10:12:19.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.323+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f717c007230 con 0x7f7184138040 2023-10-03T10:12:19.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.323+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718404f2a0 con 0x7f7184138040 2023-10-03T10:12:19.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.324+0000 7f71897b3700 1 -- 172.21.15.125:0/1604479100 >> v1:172.21.15.125:6816/126957 conn(0x7f716802f510 legacy=0x7f71680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.324+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f717c0074e0 con 0x7f7184138040 2023-10-03T10:12:19.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.330+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f717c018070 con 0x7f7184138040 2023-10-03T10:12:19.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.333+0000 7fa57faf6700 1 Processor -- start 2023-10-03T10:12:19.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 -- start start 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 0x7fa578133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5781309f0 0x7fa57813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57806b2d0 con 0x7fa5781309f0 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa578133610 con 0x7fa5781300a0 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.334+0000 7fa57faf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa57809a500 con 0x7fa578133ad0 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56826/0 (socket says 172.21.15.125:56826) 2023-10-03T10:12:19.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 -- 172.21.15.125:0/1148696925 learned_addr learned my addr 172.21.15.125:0/1148696925 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57e093700 1 --2- 172.21.15.125:0/1148696925 >> v2:172.21.15.125:3300/0 conn(0x7fa5781309f0 0x7fa57813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d892700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 0x7fa578133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 -- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 msgr2=0x7fa578133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 0x7fa578133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 -- 172.21.15.125:0/1148696925 >> v2:172.21.15.125:3300/0 conn(0x7fa5781309f0 msgr2=0x7fa57813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 --2- 172.21.15.125:0/1148696925 >> v2:172.21.15.125:3300/0 conn(0x7fa5781309f0 0x7fa57813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 -- 172.21.15.125:0/1148696925 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5781338b0 con 0x7fa5781300a0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d892700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 0x7fa578133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57d091700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5680098f0 tx=0x7fa568009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366a1d6807b9732d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57c890700 1 -- 172.21.15.125:0/1148696925 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800b8a0 con 0x7fa5781300a0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57c890700 1 -- 172.21.15.125:0/1148696925 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800ba00 con 0x7fa5781300a0 2023-10-03T10:12:19.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.335+0000 7fa57c890700 1 -- 172.21.15.125:0/1148696925 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800bd90 con 0x7fa5781300a0 2023-10-03T10:12:19.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 -- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 msgr2=0x7fa5781304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5680098f0 tx=0x7fa568009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 -- 172.21.15.125:0/1148696925 shutdown_connections 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 --2- 172.21.15.125:0/1148696925 >> v2:172.21.15.125:3300/0 conn(0x7fa5781309f0 0x7fa57813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa578133ad0 0x7fa578133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 --2- 172.21.15.125:0/1148696925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5781300a0 0x7fa5781304b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 -- 172.21.15.125:0/1148696925 >> 172.21.15.125:0/1148696925 conn(0x7fa578099c40 msgr2=0x7fa5780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 -- 172.21.15.125:0/1148696925 shutdown_connections 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.336+0000 7fa57faf6700 1 -- 172.21.15.125:0/1148696925 wait complete. 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.337+0000 7fa57faf6700 1 Processor -- start 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 -- start start 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 0x7fa57811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 0x7fa57811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 0x7fa57811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57811f080 con 0x7fa5781309f0 2023-10-03T10:12:19.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5781200c0 con 0x7fa578133ad0 2023-10-03T10:12:19.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.338+0000 7fa57faf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa57811fb20 con 0x7fa5781300a0 2023-10-03T10:12:19.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d091700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 0x7fa57811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d091700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 0x7fa57811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52528/0 (socket says 172.21.15.125:52528) 2023-10-03T10:12:19.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d091700 1 -- 172.21.15.125:0/3308401312 learned_addr learned my addr 172.21.15.125:0/3308401312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 0x7fa57811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57e093700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 0x7fa57811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 -- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 msgr2=0x7fa57811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 0x7fa57811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 -- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 msgr2=0x7fa57811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 0x7fa57811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 -- 172.21.15.125:0/3308401312 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568009550 con 0x7fa5781300a0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.341+0000 7fa57d892700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 0x7fa57811da40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c7f0 tx=0x7fa57400cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.342+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574011800 con 0x7fa5781300a0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.342+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574011960 con 0x7fa5781300a0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.342+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574011cf0 con 0x7fa5781300a0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.342+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57811f850 con 0x7fa5781300a0 2023-10-03T10:12:19.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.342+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57812dd00 con 0x7fa5781300a0 2023-10-03T10:12:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.343+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa574018360 con 0x7fa5781300a0 2023-10-03T10:12:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.343+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa57403fcd0 con 0x7fa5781300a0 2023-10-03T10:12:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.343+0000 7fa57d091700 1 -- 172.21.15.125:0/3308401312 >> v1:172.21.15.125:6816/126957 conn(0x7fa55c02f510 legacy=0x7fa55c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.344+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57812d9d0 con 0x7fa5781300a0 2023-10-03T10:12:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.344+0000 7fa57e093700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 0x7fa57811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:19.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.349+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa57401f080 con 0x7fa5781300a0 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.358+0000 7f1f159ad700 1 Processor -- start 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.358+0000 7f1f159ad700 1 -- start start 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.358+0000 7f1f159ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f1009d860 0x7f1f1009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.358+0000 7f1f159ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f159ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1009aaa0 con 0x7f1f10130ce0 2023-10-03T10:12:19.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f159ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1009f870 con 0x7f1f1009d860 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f159ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1009b360 con 0x7f1f1009e170 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35188/0 (socket says 172.21.15.125:35188) 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 -- 172.21.15.125:0/3100074438 learned_addr learned my addr 172.21.15.125:0/3100074438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0effd700 1 --2- 172.21.15.125:0/3100074438 >> v2:172.21.15.125:3300/0 conn(0x7f1f1009d860 0x7f1f1009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 -- 172.21.15.125:0/3100074438 >> v2:172.21.15.125:3300/0 conn(0x7f1f1009d860 msgr2=0x7f1f1009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 --2- 172.21.15.125:0/3100074438 >> v2:172.21.15.125:3300/0 conn(0x7f1f1009d860 0x7f1f1009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 -- 172.21.15.125:0/3100074438 >> v1:172.21.15.125:6789/0 conn(0x7f1f10130ce0 legacy=0x7f1f101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 -- 172.21.15.125:0/3100074438 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1009b620 con 0x7f1f1009e170 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0e7fc700 1 --2- 172.21.15.125:0/3100074438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400bb90 tx=0x7f1f0400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e493c9a832ecff29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0dffb700 1 -- 172.21.15.125:0/3100074438 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400dd30 con 0x7f1f1009e170 2023-10-03T10:12:19.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.359+0000 7f1f0dffb700 1 -- 172.21.15.125:0/3100074438 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400de90 con 0x7f1f1009e170 2023-10-03T10:12:19.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f0dffb700 1 -- 172.21.15.125:0/3100074438 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04010690 con 0x7f1f1009e170 2023-10-03T10:12:19.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 -- 172.21.15.125:0/3100074438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 msgr2=0x7f1f101307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 --2- 172.21.15.125:0/3100074438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400bb90 tx=0x7f1f0400bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 -- 172.21.15.125:0/3100074438 shutdown_connections 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 --2- 172.21.15.125:0/3100074438 >> v2:172.21.15.125:3300/0 conn(0x7f1f1009d860 0x7f1f1009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 --2- 172.21.15.125:0/3100074438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009e170 0x7f1f101307a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 -- 172.21.15.125:0/3100074438 >> 172.21.15.125:0/3100074438 conn(0x7f1f10099c40 msgr2=0x7f1f100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 -- 172.21.15.125:0/3100074438 shutdown_connections 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.360+0000 7f1f159ad700 1 -- 172.21.15.125:0/3100074438 wait complete. 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.361+0000 7f1f159ad700 1 Processor -- start 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.361+0000 7f1f159ad700 1 -- start start 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 0x7f1f10126be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f1009e170 0x7f1f10127120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1012a420 con 0x7f1f1009e170 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100a2240 con 0x7f1f10130ce0 2023-10-03T10:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f159ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10128900 con 0x7f1f1009d860 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 0x7f1f10126be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56846/0 (socket says 172.21.15.125:56846) 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 0x7f1f10126be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35204/0 (socket says 172.21.15.125:35204) 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 -- 172.21.15.125:0/1088863031 learned_addr learned my addr 172.21.15.125:0/1088863031 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0e7fc700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f1009e170 0x7f1f10127120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 -- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 msgr2=0x7f1f10126be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 0x7f1f10126be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 -- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f1009e170 msgr2=0x7f1f10127120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f1009e170 0x7f1f10127120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 -- 172.21.15.125:0/1088863031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0400b7f0 con 0x7f1f10130ce0 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.362+0000 7f1f0f7fe700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800cc50 tx=0x7f1f0800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800ad80 con 0x7f1f10130ce0 2023-10-03T10:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1009c8b0 con 0x7f1f10130ce0 2023-10-03T10:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0800ce50 con 0x7f1f10130ce0 2023-10-03T10:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1012a1b0 con 0x7f1f10130ce0 2023-10-03T10:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08003c40 con 0x7f1f10130ce0 2023-10-03T10:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.363+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1f080050d0 con 0x7f1f10130ce0 2023-10-03T10:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.364+0000 7f1f0effd700 1 -- 172.21.15.125:0/1088863031 >> v1:172.21.15.125:6816/126957 conn(0x7f1efc02f510 legacy=0x7f1efc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.364+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1f0803fe70 con 0x7f1f10130ce0 2023-10-03T10:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.364+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1011add0 con 0x7f1f10130ce0 2023-10-03T10:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.369+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f08005380 con 0x7f1f10130ce0 2023-10-03T10:12:19.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.496+0000 7f7fbe504700 1 -- 172.21.15.125:0/795512680 >> v1:172.21.15.125:6816/126957 conn(0x7f7f9c02f510 legacy=0x7f7f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.525+0000 7f71897b3700 1 -- 172.21.15.125:0/1604479100 >> v1:172.21.15.125:6816/126957 conn(0x7f716802f510 legacy=0x7f71680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.525+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7184099ab0 con 0x7f7184138040 2023-10-03T10:12:19.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.526+0000 7f7179ffb700 1 -- 172.21.15.125:0/1604479100 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7184099ab0 con 0x7f7184138040 2023-10-03T10:12:19.525 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 >> v1:172.21.15.125:6816/126957 conn(0x7f716802f510 legacy=0x7f71680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 msgr2=0x7f7184136070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f717c00cb90 tx=0x7f717c00cf50 comp rx=0 tx=0).stop 2023-10-03T10:12:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 shutdown_connections 2023-10-03T10:12:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7184138040 0x7f7184136070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71840a08e0 0x7f7184137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 --2- 172.21.15.125:0/1604479100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71840a1230 0x7f7184135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 >> 172.21.15.125:0/1604479100 conn(0x7f71840a2980 msgr2=0x7f71840702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 shutdown_connections 2023-10-03T10:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.528+0000 7f718ba17700 1 -- 172.21.15.125:0/1604479100 wait complete. 2023-10-03T10:12:19.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:19.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.544+0000 7fa57d091700 1 -- 172.21.15.125:0/3308401312 >> v1:172.21.15.125:6816/126957 conn(0x7fa55c02f510 legacy=0x7fa55c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:19.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.545+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fb81248f0 con 0x7f7fb80a1550 2023-10-03T10:12:19.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.545+0000 7f7faeffd700 1 -- 172.21.15.125:0/795512680 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fa8012370 con 0x7f7fb80a1550 2023-10-03T10:12:19.545 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 >> v1:172.21.15.125:6816/126957 conn(0x7f7f9c02f510 legacy=0x7f7f9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 msgr2=0x7f7fb8121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e840 tx=0x7f7fa800eb50 comp rx=0 tx=0).stop 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 shutdown_connections 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fb8139200 0x7f7fb81221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fb80a0a70 0x7f7fb8121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 --2- 172.21.15.125:0/795512680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80a1550 0x7f7fb8121c90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 >> 172.21.15.125:0/795512680 conn(0x7f7fb80a6610 msgr2=0x7f7fb80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 shutdown_connections 2023-10-03T10:12:19.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.547+0000 7f7fc0768700 1 -- 172.21.15.125:0/795512680 wait complete. 2023-10-03T10:12:19.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.561+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f1004f2a0 con 0x7f1f10130ce0 2023-10-03T10:12:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.562+0000 7f1ef7fff700 1 -- 172.21.15.125:0/1088863031 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f08011380 con 0x7f1f10130ce0 2023-10-03T10:12:19.561 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 >> v1:172.21.15.125:6816/126957 conn(0x7f1efc02f510 legacy=0x7f1efc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 msgr2=0x7f1f10127660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800cc50 tx=0x7f1f0800a340 comp rx=0 tx=0).stop 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 shutdown_connections 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f10130ce0 0x7f1f10127660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f1009d860 0x7f1f10126be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 --2- 172.21.15.125:0/1088863031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f1009e170 0x7f1f10127120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 >> 172.21.15.125:0/1088863031 conn(0x7f1f10099c40 msgr2=0x7f1f10071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 shutdown_connections 2023-10-03T10:12:19.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.564+0000 7f1f159ad700 1 -- 172.21.15.125:0/1088863031 wait complete. 2023-10-03T10:12:19.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:19.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.580+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa57804f2a0 con 0x7fa5781300a0 2023-10-03T10:12:19.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.581+0000 7fa56e7fc700 1 -- 172.21.15.125:0/3308401312 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa574018610 con 0x7fa5781300a0 2023-10-03T10:12:19.580 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:19.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 >> v1:172.21.15.125:6816/126957 conn(0x7fa55c02f510 legacy=0x7fa55c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:19.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 msgr2=0x7fa57811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 0x7fa57811da40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c7f0 tx=0x7fa57400cb00 comp rx=0 tx=0).stop 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 shutdown_connections 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa578133ad0 0x7fa57811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5781300a0 0x7fa57811da40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 --2- 172.21.15.125:0/3308401312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5781309f0 0x7fa57811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 >> 172.21.15.125:0/3308401312 conn(0x7fa578099c40 msgr2=0x7fa578132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 shutdown_connections 2023-10-03T10:12:19.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:19.583+0000 7fa57faf6700 1 -- 172.21.15.125:0/3308401312 wait complete. 2023-10-03T10:12:19.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:20.541 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:20.560 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:20.576 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:20.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:20.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.678+0000 7fe0ed61d700 1 Processor -- start 2023-10-03T10:12:20.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 -- start start 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 0x7fe0e813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80a1fe0 con 0x7fe0e80a0a90 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80a3aa0 con 0x7fe0e81393c0 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0ed61d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e809a540 con 0x7fe0e80a1570 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0e77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 0x7fe0e813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0e6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe0e80a0a90 0x7fe0e80a0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39602/0 (socket says 172.21.15.125:39602) 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0e6ffd700 1 -- 172.21.15.125:0/2593329952 learned_addr learned my addr 172.21.15.125:0/2593329952 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.679+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2593329952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2593329952 >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 msgr2=0x7fe0e813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2593329952 >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 0x7fe0e813b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2593329952 >> v1:172.21.15.125:6789/0 conn(0x7fe0e80a0a90 legacy=0x7fe0e80a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2593329952 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e809a280 con 0x7fe0e80a1570 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e77fe700 1 --2- 172.21.15.125:0/2593329952 >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 0x7fe0e813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2593329952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8138e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009840 tx=0x7fe0dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d11c64a7f9ba778c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e5ffb700 1 -- 172.21.15.125:0/2593329952 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011830 con 0x7fe0e80a1570 2023-10-03T10:12:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e5ffb700 1 -- 172.21.15.125:0/2593329952 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc011990 con 0x7fe0e80a1570 2023-10-03T10:12:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.680+0000 7fe0e5ffb700 1 -- 172.21.15.125:0/2593329952 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011d20 con 0x7fe0e80a1570 2023-10-03T10:12:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2593329952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 msgr2=0x7fe0e8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2593329952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8138e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009840 tx=0x7fe0dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2593329952 shutdown_connections 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2593329952 >> v2:172.21.15.125:3300/0 conn(0x7fe0e81393c0 0x7fe0e813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2593329952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8138e80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2593329952 >> 172.21.15.125:0/2593329952 conn(0x7fe0e8099c40 msgr2=0x7fe0e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2593329952 shutdown_connections 2023-10-03T10:12:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.681+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2593329952 wait complete. 2023-10-03T10:12:20.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.682+0000 7fe0ed61d700 1 Processor -- start 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.682+0000 7fe0ed61d700 1 -- start start 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0e80a0a90 0x7fe0e81217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0e81393c0 0x7fe0e8122250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e81252f0 con 0x7fe0e80a0a90 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8124aa0 con 0x7fe0e80a1570 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0ed61d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8138c90 con 0x7fe0e81393c0 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56866/0 (socket says 172.21.15.125:56866) 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2921684895 learned_addr learned my addr 172.21.15.125:0/2921684895 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e6ffd700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0e80a0a90 0x7fe0e81217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0e81393c0 msgr2=0x7fe0e8122250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0e81393c0 0x7fe0e8122250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0e80a0a90 msgr2=0x7fe0e81217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0e80a0a90 0x7fe0e81217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 -- 172.21.15.125:0/2921684895 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009a70 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.683+0000 7fe0e67fc700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009fd0 tx=0x7fe0dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.684+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0036a0 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.684+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc01f070 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.684+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc0094a0 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.684+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc003a60 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.684+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e809b130 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.685+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e809c7e0 con 0x7fe0e80a1570 2023-10-03T10:12:20.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.685+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe0dc003bc0 con 0x7fe0e80a1570 2023-10-03T10:12:20.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.686+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe0dc021070 con 0x7fe0e80a1570 2023-10-03T10:12:20.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.686+0000 7fe0e6ffd700 1 -- 172.21.15.125:0/2921684895 >> v1:172.21.15.125:6816/126957 conn(0x7fe0d402f540 legacy=0x7fe0d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.690+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0dc0257f0 con 0x7fe0e80a1570 2023-10-03T10:12:20.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 Processor -- start 2023-10-03T10:12:20.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 -- start start 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc133ad0 0x7f59bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 0x7f59bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 0x7f59bc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc06b2d0 con 0x7f59bc1300a0 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc133610 con 0x7f59bc133ad0 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.720+0000 7f59c1051700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc09a500 con 0x7f59bc1309f0 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 0x7f59bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 0x7f59bc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 0x7f59bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52600/0 (socket says 172.21.15.125:52600) 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59ba59c700 1 -- 172.21.15.125:0/1252660145 learned_addr learned my addr 172.21.15.125:0/1252660145 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 -- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc133ad0 msgr2=0x7f59bc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 --2- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc133ad0 0x7f59bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 -- 172.21.15.125:0/1252660145 >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 msgr2=0x7f59bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 --2- 172.21.15.125:0/1252660145 >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 0x7f59bc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 -- 172.21.15.125:0/1252660145 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc1338b0 con 0x7f59bc1309f0 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59bb59e700 1 --2- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 0x7f59bc13a980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009d90 tx=0x7f59b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e850df230993298d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59b9d9b700 1 -- 172.21.15.125:0/1252660145 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400e070 con 0x7f59bc1309f0 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59b9d9b700 1 -- 172.21.15.125:0/1252660145 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b400bbd0 con 0x7f59bc1309f0 2023-10-03T10:12:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.721+0000 7f59b9d9b700 1 -- 172.21.15.125:0/1252660145 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4012430 con 0x7f59bc1309f0 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.722+0000 7f59c1051700 1 -- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 msgr2=0x7f59bc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.722+0000 7f59c1051700 1 --2- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 0x7f59bc13a980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009d90 tx=0x7f59b400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.724+0000 7f59c1051700 1 -- 172.21.15.125:0/1252660145 shutdown_connections 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.724+0000 7f59c1051700 1 --2- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc133ad0 0x7f59bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.724+0000 7f59c1051700 1 --2- 172.21.15.125:0/1252660145 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc1309f0 0x7f59bc13a980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.724+0000 7f59c1051700 1 --2- 172.21.15.125:0/1252660145 >> v2:172.21.15.125:3300/0 conn(0x7f59bc1300a0 0x7f59bc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.724+0000 7f59c1051700 1 -- 172.21.15.125:0/1252660145 >> 172.21.15.125:0/1252660145 conn(0x7f59bc099c40 msgr2=0x7f59bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.725+0000 7f59c1051700 1 -- 172.21.15.125:0/1252660145 shutdown_connections 2023-10-03T10:12:20.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.725+0000 7f59c1051700 1 -- 172.21.15.125:0/1252660145 wait complete. 2023-10-03T10:12:20.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.726+0000 7f6d60ac4700 1 Processor -- start 2023-10-03T10:12:20.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.726+0000 7f6d60ac4700 1 -- start start 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.726+0000 7f59c1051700 1 Processor -- start 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 -- start start 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 0x7f59bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 0x7f59bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 0x7f59bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc120950 con 0x7f59bc1309f0 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc12d930 con 0x7f59bc1300a0 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59c1051700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc11fd00 con 0x7f59bc133ad0 2023-10-03T10:12:20.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59bb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 0x7f59bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59bad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 0x7f59bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59bb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 0x7f59bc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35222/0 (socket says 172.21.15.125:35222) 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59bb59e700 1 -- 172.21.15.125:0/326296188 learned_addr learned my addr 172.21.15.125:0/326296188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59bad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 0x7f59bc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56878/0 (socket says 172.21.15.125:56878) 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f59ba59c700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 0x7f59bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f6d60ac4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 0x7f6d5c0a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f6d60ac4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 0x7f6d5c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f6d60ac4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c0a1e70 con 0x7f6d5c066410 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f6d60ac4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c09a720 con 0x7f6d5c0667e0 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.727+0000 7f6d60ac4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c09b300 con 0x7f6d5c131180 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d59d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 0x7f6d5c0a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d59d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 0x7f6d5c0a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52618/0 (socket says 172.21.15.125:52618) 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d59d9b700 1 -- 172.21.15.125:0/1265283685 learned_addr learned my addr 172.21.15.125:0/1265283685 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 --2- 172.21.15.125:0/1265283685 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 0x7f6d5c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 -- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 msgr2=0x7f59bc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 0x7f59bc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 -- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 msgr2=0x7f59bc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 0x7f59bc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 -- 172.21.15.125:0/326296188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009a70 con 0x7f59bc1309f0 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59ba59c700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 0x7f59bc11df80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f59b000e7e0 tx=0x7f59b000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 -- 172.21.15.125:0/1265283685 >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 msgr2=0x7f6d5c0a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 --2- 172.21.15.125:0/1265283685 >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 0x7f6d5c0a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 -- 172.21.15.125:0/1265283685 >> v1:172.21.15.125:6789/0 conn(0x7f6d5c066410 legacy=0x7f6d5c0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 -- 172.21.15.125:0/1265283685 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c09abc0 con 0x7f6d5c131180 2023-10-03T10:12:20.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00042f0 con 0x7f59bc1309f0 2023-10-03T10:12:20.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b0004450 con 0x7f59bc1309f0 2023-10-03T10:12:20.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc11fa40 con 0x7f59bc1309f0 2023-10-03T10:12:20.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f6d5ad9d700 1 --2- 172.21.15.125:0/1265283685 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 0x7f6d5c131600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009d90 tx=0x7f6d5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9946418b420d7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.728+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc12dd00 con 0x7f59bc1309f0 2023-10-03T10:12:20.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f6d5959a700 1 -- 172.21.15.125:0/1265283685 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400e070 con 0x7f6d5c131180 2023-10-03T10:12:20.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f6d5959a700 1 -- 172.21.15.125:0/1265283685 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5400bbd0 con 0x7f6d5c131180 2023-10-03T10:12:20.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f6d5959a700 1 -- 172.21.15.125:0/1265283685 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54012430 con 0x7f6d5c131180 2023-10-03T10:12:20.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f6d60ac4700 1 -- 172.21.15.125:0/1265283685 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 msgr2=0x7f6d5c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/1265283685 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 0x7f6d5c131600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009d90 tx=0x7f6d5400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:20.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00038c0 con 0x7f59bc1309f0 2023-10-03T10:12:20.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f59b0003a20 con 0x7f59bc1309f0 2023-10-03T10:12:20.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f59bad9d700 1 -- 172.21.15.125:0/326296188 >> v1:172.21.15.125:6816/126957 conn(0x7f59a802f560 legacy=0x7f59a8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.729+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f59b003f5a0 con 0x7f59bc1309f0 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 -- 172.21.15.125:0/1265283685 shutdown_connections 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/1265283685 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c131180 0x7f6d5c131600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/1265283685 >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0667e0 0x7f6d5c0a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 -- 172.21.15.125:0/1265283685 >> 172.21.15.125:0/1265283685 conn(0x7f6d5c0a2980 msgr2=0x7f6d5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 -- 172.21.15.125:0/1265283685 shutdown_connections 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f6d60ac4700 1 -- 172.21.15.125:0/1265283685 wait complete. 2023-10-03T10:12:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.730+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c0052e0 con 0x7f59bc1309f0 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 Processor -- start 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 -- start start 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c066410 0x7f6d5c11b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d5c131180 0x7f6d5c11c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c11cb40 con 0x7f6d5c0667e0 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c11d2a0 con 0x7f6d5c131180 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d60ac4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c11d8c0 con 0x7f6d5c066410 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d59d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d5a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c066410 0x7f6d5c11b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d59d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52630/0 (socket says 172.21.15.125:52630) 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.731+0000 7f6d59d9b700 1 -- 172.21.15.125:0/3687097600 learned_addr learned my addr 172.21.15.125:0/3687097600 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d5ad9d700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d5c131180 0x7f6d5c11c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 -- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c066410 msgr2=0x7f6d5c11b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c066410 0x7f6d5c11b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 -- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d5c131180 msgr2=0x7f6d5c11c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d5c131180 0x7f6d5c11c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 -- 172.21.15.125:0/3687097600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009a70 con 0x7f6d5c0667e0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.732+0000 7f6d59d9b700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d50011740 tx=0x7f6d500153b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50015de0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50017040 con 0x7f6d5c0667e0 2023-10-03T10:12:20.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5001d600 con 0x7f6d5c0667e0 2023-10-03T10:12:20.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59b001bbb0 con 0x7f59bc1309f0 2023-10-03T10:12:20.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c11eed0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.735+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c09fd50 con 0x7f6d5c0667e0 2023-10-03T10:12:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.736+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c04f2a0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.737+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6d5001d760 con 0x7f6d5c0667e0 2023-10-03T10:12:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.737+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6d500482c0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.738+0000 7f6d5a59c700 1 -- 172.21.15.125:0/3687097600 >> v1:172.21.15.125:6816/126957 conn(0x7f6d3c02f510 legacy=0x7f6d3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.745+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d5001b8f0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 Processor -- start 2023-10-03T10:12:20.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 -- start start 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d48133900 0x7f0d48133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d480a10b0 0x7f0d4813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4809a760 con 0x7f0d48134210 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d481336e0 con 0x7f0d48133900 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.786+0000 7f0d4f24a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4809a080 con 0x7f0d480a10b0 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d48133900 0x7f0d48133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d48133900 0x7f0d48133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52636/0 (socket says 172.21.15.125:52636) 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/4255821245 learned_addr learned my addr 172.21.15.125:0/4255821245 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4d7e7700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d480a10b0 0x7f0d4813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d480a10b0 msgr2=0x7f0d4813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d480a10b0 0x7f0d4813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/4255821245 >> v1:172.21.15.125:6789/0 conn(0x7f0d48134210 legacy=0x7f0d480a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/4255821245 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480a23e0 con 0x7f0d48133900 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d4cfe6700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d48133cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4e5623d8bbc055 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.787+0000 7f0d477fe700 1 -- 172.21.15.125:0/4255821245 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c005e30 con 0x7f0d48133900 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d477fe700 1 -- 172.21.15.125:0/4255821245 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c004030 con 0x7f0d48133900 2023-10-03T10:12:20.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d477fe700 1 -- 172.21.15.125:0/4255821245 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0043e0 con 0x7f0d48133900 2023-10-03T10:12:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 -- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 msgr2=0x7f0d48133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d48133cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 -- 172.21.15.125:0/4255821245 shutdown_connections 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d480a10b0 0x7f0d4813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/4255821245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d48133cd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 -- 172.21.15.125:0/4255821245 >> 172.21.15.125:0/4255821245 conn(0x7f0d480a2980 msgr2=0x7f0d480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 -- 172.21.15.125:0/4255821245 shutdown_connections 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.788+0000 7f0d4f24a700 1 -- 172.21.15.125:0/4255821245 wait complete. 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.789+0000 7f0d4f24a700 1 Processor -- start 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.789+0000 7f0d4f24a700 1 -- start start 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d480a10b0 0x7f0d481ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d48134210 0x7f0d4806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48125000 con 0x7f0d48133900 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48071ae0 con 0x7f0d48134210 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4f24a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480711c0 con 0x7f0d480a10b0 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52648/0 (socket says 172.21.15.125:52648) 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 -- 172.21.15.125:0/2350190626 learned_addr learned my addr 172.21.15.125:0/2350190626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d4d7e7700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d48134210 0x7f0d4806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 -- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d480a10b0 msgr2=0x7f0d481ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d480a10b0 0x7f0d481ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 -- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d48134210 msgr2=0x7f0d4806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d48134210 0x7f0d4806dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.790+0000 7f0d47fff700 1 -- 172.21.15.125:0/2350190626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009500 con 0x7f0d48133900 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d47fff700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c4e0 tx=0x7f0d3400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340052d0 con 0x7f0d48133900 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34005430 con 0x7f0d48133900 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340038c0 con 0x7f0d48133900 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48132f80 con 0x7f0d48133900 2023-10-03T10:12:20.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.791+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d48071540 con 0x7f0d48133900 2023-10-03T10:12:20.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.792+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0d34003a20 con 0x7f0d48133900 2023-10-03T10:12:20.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.792+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4804f2a0 con 0x7f0d48133900 2023-10-03T10:12:20.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.792+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/2350190626 >> v1:172.21.15.125:6816/126957 conn(0x7f0d2c02f510 legacy=0x7f0d2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.792+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0d3403f000 con 0x7f0d48133900 2023-10-03T10:12:20.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.801+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d34019910 con 0x7f0d48133900 2023-10-03T10:12:20.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.887+0000 7fe0e6ffd700 1 -- 172.21.15.125:0/2921684895 >> v1:172.21.15.125:6816/126957 conn(0x7fe0d402f540 legacy=0x7fe0d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.922+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0e804f2a0 con 0x7fe0e80a1570 2023-10-03T10:12:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.923+0000 7fe0cf7fe700 1 -- 172.21.15.125:0/2921684895 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0dc015090 con 0x7fe0e80a1570 2023-10-03T10:12:20.923 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 >> v1:172.21.15.125:6816/126957 conn(0x7fe0d402f540 legacy=0x7fe0d40319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 msgr2=0x7fe0e8121d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009fd0 tx=0x7fe0dc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 shutdown_connections 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0e81393c0 0x7fe0e8122250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0e80a0a90 0x7fe0e81217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 --2- 172.21.15.125:0/2921684895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0e80a1570 0x7fe0e8121d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 >> 172.21.15.125:0/2921684895 conn(0x7fe0e8099c40 msgr2=0x7fe0e8137c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 shutdown_connections 2023-10-03T10:12:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.925+0000 7fe0ed61d700 1 -- 172.21.15.125:0/2921684895 wait complete. 2023-10-03T10:12:20.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.930+0000 7f59bad9d700 1 -- 172.21.15.125:0/326296188 >> v1:172.21.15.125:6816/126957 conn(0x7f59a802f560 legacy=0x7f59a8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.939+0000 7f6d5a59c700 1 -- 172.21.15.125:0/3687097600 >> v1:172.21.15.125:6816/126957 conn(0x7f6d3c02f510 legacy=0x7f6d3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.940+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f599c005860 con 0x7f59bc1309f0 2023-10-03T10:12:20.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.941+0000 7f59a37fe700 1 -- 172.21.15.125:0/326296188 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59b002c090 con 0x7f59bc1309f0 2023-10-03T10:12:20.942 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:20.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.942+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d5c06bce0 con 0x7f6d5c0667e0 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 >> v1:172.21.15.125:6816/126957 conn(0x7f59a802f560 legacy=0x7f59a8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 msgr2=0x7f59bc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 0x7f59bc11df80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f59b000e7e0 tx=0x7f59b000eaf0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 shutdown_connections 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59bc133ad0 0x7f59bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59bc1300a0 0x7f59bc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 --2- 172.21.15.125:0/326296188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59bc1309f0 0x7f59bc11df80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 >> 172.21.15.125:0/326296188 conn(0x7f59bc099c40 msgr2=0x7f59bc132c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 shutdown_connections 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f59c1051700 1 -- 172.21.15.125:0/326296188 wait complete. 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.943+0000 7f6d4affd700 1 -- 172.21.15.125:0/3687097600 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d50022070 con 0x7f6d5c0667e0 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 >> v1:172.21.15.125:6816/126957 conn(0x7f6d3c02f510 legacy=0x7f6d3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 msgr2=0x7f6d5c11bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d50011740 tx=0x7f6d500153b0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 shutdown_connections 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d5c131180 0x7f6d5c11c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d5c066410 0x7f6d5c11b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 --2- 172.21.15.125:0/3687097600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0667e0 0x7f6d5c11bbd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 >> 172.21.15.125:0/3687097600 conn(0x7f6d5c0a2980 msgr2=0x7f6d5c130830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 shutdown_connections 2023-10-03T10:12:20.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.945+0000 7f6d60ac4700 1 -- 172.21.15.125:0/3687097600 wait complete. 2023-10-03T10:12:20.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:20.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:20.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.993+0000 7f0d4cfe6700 1 -- 172.21.15.125:0/2350190626 >> v1:172.21.15.125:6816/126957 conn(0x7f0d2c02f510 legacy=0x7f0d2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:20.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.998+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d4806bce0 con 0x7f0d48133900 2023-10-03T10:12:20.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:20.998+0000 7f0d457fa700 1 -- 172.21.15.125:0/2350190626 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d340192c0 con 0x7f0d48133900 2023-10-03T10:12:20.999 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 >> v1:172.21.15.125:6816/126957 conn(0x7f0d2c02f510 legacy=0x7f0d2c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 msgr2=0x7f0d481cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c4e0 tx=0x7f0d3400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 shutdown_connections 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d48134210 0x7f0d4806dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d480a10b0 0x7f0d481ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 --2- 172.21.15.125:0/2350190626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d48133900 0x7f0d481cd1b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 >> 172.21.15.125:0/2350190626 conn(0x7f0d480a2980 msgr2=0x7f0d481baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 shutdown_connections 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:21.000+0000 7f0d4f24a700 1 -- 172.21.15.125:0/2350190626 wait complete. 2023-10-03T10:12:21.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:21.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:21.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:21.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:22.014 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.073+0000 7f7f321ee700 1 Processor -- start 2023-10-03T10:12:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.073+0000 7f7f321ee700 1 -- start start 2023-10-03T10:12:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f321ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f2c133b80 0x7f7f2c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f321ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 0x7f7f2c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f321ee700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c09aa00 con 0x7f7f2c099a60 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f321ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c09a080 con 0x7f7f2c133b80 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f321ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c133750 con 0x7f7f2c0a0ff0 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7f2c099a60 0x7f7f2c0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39624/0 (socket says 172.21.15.125:39624) 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2affd700 1 -- 172.21.15.125:0/1741016761 learned_addr learned my addr 172.21.15.125:0/1741016761 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/1741016761 >> v2:172.21.15.125:3300/0 conn(0x7f7f2c133b80 0x7f7f2c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2bfff700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 0x7f7f2c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 msgr2=0x7f7f2c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2a7fc700 1 -- 172.21.15.125:0/1741016761 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759245798 0 0) 0x7f7f2c09aa00 con 0x7f7f2c099a60 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 0x7f7f2c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/1741016761 >> v1:172.21.15.125:6789/0 conn(0x7f7f2c099a60 legacy=0x7f7f2c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/1741016761 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c09a760 con 0x7f7f2c133b80 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2bfff700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 0x7f7f2c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.074+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c133b80 0x7f7f2c133f50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009820 tx=0x7f7f1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6921349e61c3009 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f2a7fc700 1 -- 172.21.15.125:0/1741016761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c005e30 con 0x7f7f2c133b80 2023-10-03T10:12:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f2a7fc700 1 -- 172.21.15.125:0/1741016761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c006030 con 0x7f7f2c133b80 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f2a7fc700 1 -- 172.21.15.125:0/1741016761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0063e0 con 0x7f7f2c133b80 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 -- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c133b80 msgr2=0x7f7f2c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c133b80 0x7f7f2c133f50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009820 tx=0x7f7f1c009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 -- 172.21.15.125:0/1741016761 shutdown_connections 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c0a0ff0 0x7f7f2c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 --2- 172.21.15.125:0/1741016761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c133b80 0x7f7f2c133f50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 -- 172.21.15.125:0/1741016761 >> 172.21.15.125:0/1741016761 conn(0x7f7f2c0a2980 msgr2=0x7f7f2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 -- 172.21.15.125:0/1741016761 shutdown_connections 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.075+0000 7f7f321ee700 1 -- 172.21.15.125:0/1741016761 wait complete. 2023-10-03T10:12:22.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.076+0000 7f7f321ee700 1 Processor -- start 2023-10-03T10:12:22.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 -- start start 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c0a0ff0 0x7f7f2c1c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c133b80 0x7f7f2c1c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c11ba00 con 0x7f7f2c0a0ff0 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1c5940 con 0x7f7f2c099a60 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f321ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c09a2c0 con 0x7f7f2c133b80 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f2b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f2b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56914/0 (socket says 172.21.15.125:56914) 2023-10-03T10:12:22.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/2809506327 learned_addr learned my addr 172.21.15.125:0/2809506327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f2affd700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c0a0ff0 0x7f7f2c1c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.077+0000 7f7f2bfff700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c133b80 0x7f7f2c1c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c133b80 msgr2=0x7f7f2c1c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c133b80 0x7f7f2c1c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c0a0ff0 msgr2=0x7f7f2c1c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c0a0ff0 0x7f7f2c1c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 -- 172.21.15.125:0/2809506327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c009430 con 0x7f7f2c099a60 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f2b7fe700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c000c00 tx=0x7f7f1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0069d0 con 0x7f7f2c099a60 2023-10-03T10:12:22.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c020070 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c11da70 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.078+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c11c1e0 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.079+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c004280 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.079+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7f1c022030 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.079+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7f1c041130 con 0x7f7f2c099a60 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.079+0000 7f7f2affd700 1 -- 172.21.15.125:0/2809506327 >> v1:172.21.15.125:6816/126957 conn(0x7f7f1802f510 legacy=0x7f7f180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.080+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c04f2a0 con 0x7f7f2c099a60 2023-10-03T10:12:22.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.084+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f1c02e440 con 0x7f7f2c099a60 2023-10-03T10:12:22.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.117+0000 7ff72677c700 1 Processor -- start 2023-10-03T10:12:22.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.117+0000 7ff72677c700 1 -- start start 2023-10-03T10:12:22.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff72677c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 0x7ff720138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff72677c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff72677c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72009b110 con 0x7ff72009ad40 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff72677c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200a3b60 con 0x7ff720134140 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff72677c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200a1a80 con 0x7ff7201345a0 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56926/0 (socket says 172.21.15.125:56926) 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 -- 172.21.15.125:0/442234458 learned_addr learned my addr 172.21.15.125:0/442234458 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff71f7fe700 1 --2- 172.21.15.125:0/442234458 >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 0x7ff720138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 -- 172.21.15.125:0/442234458 >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 msgr2=0x7ff720138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 --2- 172.21.15.125:0/442234458 >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 0x7ff720138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 -- 172.21.15.125:0/442234458 >> v1:172.21.15.125:6789/0 conn(0x7ff72009ad40 legacy=0x7ff720133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff71effd700 1 -- 172.21.15.125:0/442234458 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218672090 0 0) 0x7ff72009b110 con 0x7ff72009ad40 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff724d19700 1 -- 172.21.15.125:0/442234458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200a2fa0 con 0x7ff7201345a0 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.118+0000 7ff71f7fe700 1 --2- 172.21.15.125:0/442234458 >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 0x7ff720138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff724d19700 1 --2- 172.21.15.125:0/442234458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff718009e50 tx=0x7ff71800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7041a3d209cf8c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff71effd700 1 -- 172.21.15.125:0/442234458 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800e070 con 0x7ff7201345a0 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff71effd700 1 -- 172.21.15.125:0/442234458 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800b910 con 0x7ff7201345a0 2023-10-03T10:12:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff71effd700 1 -- 172.21.15.125:0/442234458 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800bcc0 con 0x7ff7201345a0 2023-10-03T10:12:22.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff72677c700 1 -- 172.21.15.125:0/442234458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 msgr2=0x7ff72013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.119+0000 7ff72677c700 1 --2- 172.21.15.125:0/442234458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff718009e50 tx=0x7ff71800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 -- 172.21.15.125:0/442234458 shutdown_connections 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 --2- 172.21.15.125:0/442234458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7201345a0 0x7ff72013b3d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 --2- 172.21.15.125:0/442234458 >> v2:172.21.15.125:3300/0 conn(0x7ff720134140 0x7ff720138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 -- 172.21.15.125:0/442234458 >> 172.21.15.125:0/442234458 conn(0x7ff720099c40 msgr2=0x7ff72006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 -- 172.21.15.125:0/442234458 shutdown_connections 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 -- 172.21.15.125:0/442234458 wait complete. 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.120+0000 7ff72677c700 1 Processor -- start 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 -- start start 2023-10-03T10:12:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff72009ad40 0x7ff72011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 0x7ff72011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72013a320 con 0x7ff7201345a0 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200a4430 con 0x7ff720134140 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff72677c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff72009c7e0 con 0x7ff72009ad40 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff724d19700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff724d19700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52702/0 (socket says 172.21.15.125:52702) 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff724d19700 1 -- 172.21.15.125:0/883890327 learned_addr learned my addr 172.21.15.125:0/883890327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff71ffff700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff72009ad40 0x7ff72011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.121+0000 7ff71f7fe700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 0x7ff72011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 -- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff72009ad40 msgr2=0x7ff72011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff72009ad40 0x7ff72011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 -- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 msgr2=0x7ff72011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 0x7ff72011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 -- 172.21.15.125:0/883890327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140094a0 con 0x7ff7201345a0 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff71f7fe700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 0x7ff72011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff724d19700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff71800b680 tx=0x7ff718004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718004960 con 0x7ff7201345a0 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180092e0 con 0x7ff7201345a0 2023-10-03T10:12:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71801c610 con 0x7ff7201345a0 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718009b30 con 0x7ff7201345a0 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.122+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72011d940 con 0x7ff7201345a0 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.123+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff71801c770 con 0x7ff7201345a0 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.123+0000 7ff71ffff700 1 -- 172.21.15.125:0/883890327 >> v1:172.21.15.125:6816/126957 conn(0x7ff70c02f510 legacy=0x7ff70c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.123+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff718041480 con 0x7ff7201345a0 2023-10-03T10:12:22.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.124+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72004f2a0 con 0x7ff7201345a0 2023-10-03T10:12:22.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 Processor -- start 2023-10-03T10:12:22.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 -- start start 2023-10-03T10:12:22.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 0x7f0af00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 0x7f0af01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00a1e70 con 0x7f0af00a1340 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af009a720 con 0x7f0af00a0a30 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0af5111700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af009b300 con 0x7f0af0130670 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0aeed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 0x7f0af00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.125+0000 7f0aee59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0af00a1340 0x7f0af012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39646/0 (socket says 172.21.15.125:39646) 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aee59c700 1 -- 172.21.15.125:0/323631335 learned_addr learned my addr 172.21.15.125:0/323631335 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 --2- 172.21.15.125:0/323631335 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 0x7f0af01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 -- 172.21.15.125:0/323631335 >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 msgr2=0x7f0af00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 --2- 172.21.15.125:0/323631335 >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 0x7f0af00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 -- 172.21.15.125:0/323631335 >> v1:172.21.15.125:6789/0 conn(0x7f0af00a1340 legacy=0x7f0af012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 -- 172.21.15.125:0/323631335 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af009abc0 con 0x7f0af0130670 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aeed9d700 1 --2- 172.21.15.125:0/323631335 >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 0x7f0af00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aef59e700 1 --2- 172.21.15.125:0/323631335 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 0x7f0af01381c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009d90 tx=0x7f0ae800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ac0acbcb45021f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aedd9b700 1 -- 172.21.15.125:0/323631335 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800e070 con 0x7f0af0130670 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aedd9b700 1 -- 172.21.15.125:0/323631335 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800bb20 con 0x7f0af0130670 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.126+0000 7f0aedd9b700 1 -- 172.21.15.125:0/323631335 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8012430 con 0x7f0af0130670 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 -- 172.21.15.125:0/323631335 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 msgr2=0x7f0af01381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 --2- 172.21.15.125:0/323631335 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 0x7f0af01381c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009d90 tx=0x7f0ae800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 -- 172.21.15.125:0/323631335 shutdown_connections 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 --2- 172.21.15.125:0/323631335 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af0130670 0x7f0af01381c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 --2- 172.21.15.125:0/323631335 >> v2:172.21.15.125:3300/0 conn(0x7f0af00a0a30 0x7f0af00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 -- 172.21.15.125:0/323631335 >> 172.21.15.125:0/323631335 conn(0x7f0af00a2980 msgr2=0x7f0af00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 -- 172.21.15.125:0/323631335 shutdown_connections 2023-10-03T10:12:22.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.127+0000 7f0af5111700 1 -- 172.21.15.125:0/323631335 wait complete. 2023-10-03T10:12:22.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.129+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff718029080 con 0x7ff7201345a0 2023-10-03T10:12:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.129+0000 7f0af5111700 1 Processor -- start 2023-10-03T10:12:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.129+0000 7f0af5111700 1 -- start start 2023-10-03T10:12:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 0x7f0af012fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 0x7f0af013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af013f810 con 0x7f0af0130670 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af009ae00 con 0x7f0af00a0a30 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0af5111700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af013b970 con 0x7f0af00a1340 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 0x7f0af012fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56962/0 (socket says 172.21.15.125:56962) 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aeed9d700 1 -- 172.21.15.125:0/2957207659 learned_addr learned my addr 172.21.15.125:0/2957207659 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aef59e700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 0x7f0af013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 -- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 msgr2=0x7f0af012f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 -- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 msgr2=0x7f0af013ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 0x7f0af013ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 -- 172.21.15.125:0/2957207659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0009430 con 0x7f0af00a1340 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aeed9d700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aef59e700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 0x7f0af013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.130+0000 7f0aee59c700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 0x7f0af012fc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c530 tx=0x7f0ae400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.131+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400cea0 con 0x7f0af00a1340 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.131+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4005d70 con 0x7f0af00a1340 2023-10-03T10:12:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.131+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8009a70 con 0x7f0af00a1340 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.131+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40072d0 con 0x7f0af00a1340 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.131+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af013f020 con 0x7f0af00a1340 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.132+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0ae4007430 con 0x7f0af00a1340 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.132+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0ae403ee80 con 0x7f0af00a1340 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.132+0000 7f0aeed9d700 1 -- 172.21.15.125:0/2957207659 >> v1:172.21.15.125:6816/126957 conn(0x7f0adc02f510 legacy=0x7f0adc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.132+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af004f2a0 con 0x7f0af00a1340 2023-10-03T10:12:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.141+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ae4017070 con 0x7f0af00a1340 2023-10-03T10:12:22.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 Processor -- start 2023-10-03T10:12:22.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 -- start start 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 0x7f39a009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39a009f180 0x7f39a0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a009fa00 con 0x7f39a0134160 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a00a0370 con 0x7f39a009f180 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a81cb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a006bec0 con 0x7f39a009e870 2023-10-03T10:12:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.165+0000 7f39a5f67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 0x7f39a009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5f67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 0x7f39a009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56974/0 (socket says 172.21.15.125:56974) 2023-10-03T10:12:22.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5f67700 1 -- 172.21.15.125:0/1935016436 learned_addr learned my addr 172.21.15.125:0/1935016436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 --2- 172.21.15.125:0/1935016436 >> v2:172.21.15.125:3300/0 conn(0x7f39a009f180 0x7f39a0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 -- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 msgr2=0x7f39a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 --2- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 0x7f39a009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 -- 172.21.15.125:0/1935016436 >> v1:172.21.15.125:6789/0 conn(0x7f39a0134160 legacy=0x7f39a013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a4f65700 1 -- 172.21.15.125:0/1935016436 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782851959 0 0) 0x7f39a009fa00 con 0x7f39a0134160 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 -- 172.21.15.125:0/1935016436 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a009ada0 con 0x7f39a009f180 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a5766700 1 --2- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0133c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3990009840 tx=0x7f3990009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca0d2c3525acc48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a4f65700 1 -- 172.21.15.125:0/1935016436 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011830 con 0x7f39a009f180 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a4f65700 1 -- 172.21.15.125:0/1935016436 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3990011990 con 0x7f39a009f180 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.166+0000 7f39a4f65700 1 -- 172.21.15.125:0/1935016436 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011d20 con 0x7f39a009f180 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 -- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 msgr2=0x7f39a0133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 --2- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0133c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3990009840 tx=0x7f3990009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 -- 172.21.15.125:0/1935016436 shutdown_connections 2023-10-03T10:12:22.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 --2- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a009e870 0x7f39a009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 --2- 172.21.15.125:0/1935016436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0133c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 -- 172.21.15.125:0/1935016436 >> 172.21.15.125:0/1935016436 conn(0x7f39a00a4430 msgr2=0x7f39a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 -- 172.21.15.125:0/1935016436 shutdown_connections 2023-10-03T10:12:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.167+0000 7f39a81cb700 1 -- 172.21.15.125:0/1935016436 wait complete. 2023-10-03T10:12:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.168+0000 7f39a81cb700 1 Processor -- start 2023-10-03T10:12:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 -- start start 2023-10-03T10:12:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a0134160 0x7f39a0123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0125b10 con 0x7f39a009f180 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0124500 con 0x7f39a0134160 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a81cb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0126410 con 0x7f39a009e870 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a5f67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a5f67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35292/0 (socket says 172.21.15.125:35292) 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a5f67700 1 -- 172.21.15.125:0/2764300302 learned_addr learned my addr 172.21.15.125:0/2764300302 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a5766700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.169+0000 7f39a6768700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a0134160 0x7f39a0123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 -- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a0134160 msgr2=0x7f39a0123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a0134160 0x7f39a0123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 -- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 msgr2=0x7f39a0122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 -- 172.21.15.125:0/2764300302 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900094a0 con 0x7f39a009e870 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5766700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a5f67700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f399c00e940 tx=0x7f399c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0096a0 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c013680 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c013a30 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a00a1540 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.170+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a0126130 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.171+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f399c013b90 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.171+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f399c03fc10 con 0x7f39a009e870 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.171+0000 7f39a5766700 1 -- 172.21.15.125:0/2764300302 >> v1:172.21.15.125:6816/126957 conn(0x7f398402f510 legacy=0x7f39840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.171+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a004f2a0 con 0x7f39a009e870 2023-10-03T10:12:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.180+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f399c017080 con 0x7f39a009e870 2023-10-03T10:12:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.280+0000 7f7f2affd700 1 -- 172.21.15.125:0/2809506327 >> v1:172.21.15.125:6816/126957 conn(0x7f7f1802f510 legacy=0x7f7f180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.293+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f2c06bce0 con 0x7f7f2c099a60 2023-10-03T10:12:22.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.293+0000 7f7f13fff700 1 -- 172.21.15.125:0/2809506327 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f1c01c410 con 0x7f7f2c099a60 2023-10-03T10:12:22.294 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 >> v1:172.21.15.125:6816/126957 conn(0x7f7f1802f510 legacy=0x7f7f180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 msgr2=0x7f7f2c1c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c000c00 tx=0x7f7f1c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 shutdown_connections 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c133b80 0x7f7f2c1c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c099a60 0x7f7f2c1c4ec0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 --2- 172.21.15.125:0/2809506327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c0a0ff0 0x7f7f2c1c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.296+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 >> 172.21.15.125:0/2809506327 conn(0x7f7f2c0a2980 msgr2=0x7f7f2c12f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.297+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 shutdown_connections 2023-10-03T10:12:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.297+0000 7f7f321ee700 1 -- 172.21.15.125:0/2809506327 wait complete. 2023-10-03T10:12:22.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:22.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.324+0000 7ff71ffff700 1 -- 172.21.15.125:0/883890327 >> v1:172.21.15.125:6816/126957 conn(0x7ff70c02f510 legacy=0x7ff70c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.333+0000 7f0aeed9d700 1 -- 172.21.15.125:0/2957207659 >> v1:172.21.15.125:6816/126957 conn(0x7f0adc02f510 legacy=0x7f0adc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.340+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0af006bce0 con 0x7f0af00a1340 2023-10-03T10:12:22.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.340+0000 7f0ad77fe700 1 -- 172.21.15.125:0/2957207659 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ae401b3b0 con 0x7f0af00a1340 2023-10-03T10:12:22.341 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:22.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 >> v1:172.21.15.125:6816/126957 conn(0x7f0adc02f510 legacy=0x7f0adc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 msgr2=0x7f0af012fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 0x7f0af012fc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c530 tx=0x7f0ae400c840 comp rx=0 tx=0).stop 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 shutdown_connections 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0af0130670 0x7f0af013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0af00a0a30 0x7f0af012f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 --2- 172.21.15.125:0/2957207659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0af00a1340 0x7f0af012fc20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 >> 172.21.15.125:0/2957207659 conn(0x7f0af00a2980 msgr2=0x7f0af009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 shutdown_connections 2023-10-03T10:12:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.342+0000 7f0af5111700 1 -- 172.21.15.125:0/2957207659 wait complete. 2023-10-03T10:12:22.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:22.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.359+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7200729d0 con 0x7ff7201345a0 2023-10-03T10:12:22.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.359+0000 7ff71cff9700 1 -- 172.21.15.125:0/883890327 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff718009900 con 0x7ff7201345a0 2023-10-03T10:12:22.359 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 >> v1:172.21.15.125:6816/126957 conn(0x7ff70c02f510 legacy=0x7ff70c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 msgr2=0x7ff72011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff71800b680 tx=0x7ff718004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 shutdown_connections 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7201345a0 0x7ff72011d340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff72009ad40 0x7ff72011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 --2- 172.21.15.125:0/883890327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff720134140 0x7ff72011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 >> 172.21.15.125:0/883890327 conn(0x7ff720099c40 msgr2=0x7ff72009f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 shutdown_connections 2023-10-03T10:12:22.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.361+0000 7ff72677c700 1 -- 172.21.15.125:0/883890327 wait complete. 2023-10-03T10:12:22.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.372+0000 7f39a5766700 1 -- 172.21.15.125:0/2764300302 >> v1:172.21.15.125:6816/126957 conn(0x7f398402f510 legacy=0x7f39840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:22.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:22.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.402+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39a006c9d0 con 0x7f39a009e870 2023-10-03T10:12:22.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.402+0000 7f39967fc700 1 -- 172.21.15.125:0/2764300302 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f399c021030 con 0x7f39a009e870 2023-10-03T10:12:22.403 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 >> v1:172.21.15.125:6816/126957 conn(0x7f398402f510 legacy=0x7f39840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 msgr2=0x7f39a01228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f399c00e940 tx=0x7f399c00ec50 comp rx=0 tx=0).stop 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 shutdown_connections 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39a0134160 0x7f39a0123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39a009e870 0x7f39a01228f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 --2- 172.21.15.125:0/2764300302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39a009f180 0x7f39a0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 >> 172.21.15.125:0/2764300302 conn(0x7f39a00a4430 msgr2=0x7f39a009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 shutdown_connections 2023-10-03T10:12:22.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:22.404+0000 7f39a81cb700 1 -- 172.21.15.125:0/2764300302 wait complete. 2023-10-03T10:12:22.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:23.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:23.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:23.374 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:23.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 Processor -- start 2023-10-03T10:12:23.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 -- start start 2023-10-03T10:12:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f61981356e0 0x7f6198137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980a1e70 con 0x7f61980a0a30 2023-10-03T10:12:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619809a720 con 0x7f61981356e0 2023-10-03T10:12:23.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f619d5ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619809b300 con 0x7f61980a1510 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f61967fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f61967fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56988/0 (socket says 172.21.15.125:56988) 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.457+0000 7f6196ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f61980a0a30 0x7f61980a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39664/0 (socket says 172.21.15.125:39664) 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61967fc700 1 -- 172.21.15.125:0/3406337197 learned_addr learned my addr 172.21.15.125:0/3406337197 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 --2- 172.21.15.125:0/3406337197 >> v2:172.21.15.125:3300/0 conn(0x7f61981356e0 0x7f6198137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 -- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 msgr2=0x7f61981351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 --2- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 -- 172.21.15.125:0/3406337197 >> v1:172.21.15.125:6789/0 conn(0x7f61980a0a30 legacy=0x7f61980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 -- 172.21.15.125:0/3406337197 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619809abc0 con 0x7f61981356e0 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f61977fe700 1 --2- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61981356e0 0x7f6198137ac0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6190009d90 tx=0x7f619000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37974f927f75b42b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f6195ffb700 1 -- 172.21.15.125:0/3406337197 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000e070 con 0x7f61981356e0 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f6195ffb700 1 -- 172.21.15.125:0/3406337197 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619000bb20 con 0x7f61981356e0 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.458+0000 7f6195ffb700 1 -- 172.21.15.125:0/3406337197 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190012430 con 0x7f61981356e0 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 -- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61981356e0 msgr2=0x7f6198137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 --2- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61981356e0 0x7f6198137ac0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6190009d90 tx=0x7f619000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 -- 172.21.15.125:0/3406337197 shutdown_connections 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 --2- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61981356e0 0x7f6198137ac0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 --2- 172.21.15.125:0/3406337197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 -- 172.21.15.125:0/3406337197 >> 172.21.15.125:0/3406337197 conn(0x7f61980a2980 msgr2=0x7f61980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 -- 172.21.15.125:0/3406337197 shutdown_connections 2023-10-03T10:12:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.459+0000 7f619d5ac700 1 -- 172.21.15.125:0/3406337197 wait complete. 2023-10-03T10:12:23.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.461+0000 7f619d5ac700 1 Processor -- start 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.461+0000 7f619d5ac700 1 -- start start 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 0x7f61981c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 0x7f6198118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619811c1f0 con 0x7f61980a0a30 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619809ae70 con 0x7f61980a1510 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f619d5ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61981c4c40 con 0x7f61981356e0 2023-10-03T10:12:23.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f6196ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 0x7f61981c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f6196ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 0x7f61981c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52752/0 (socket says 172.21.15.125:52752) 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f6196ffd700 1 -- 172.21.15.125:0/1573892331 learned_addr learned my addr 172.21.15.125:0/1573892331 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 0x7f6198118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61967fc700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 -- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 msgr2=0x7f61981c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 -- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 msgr2=0x7f61981c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 0x7f61981c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 -- 172.21.15.125:0/1573892331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009a70 con 0x7f61981356e0 2023-10-03T10:12:23.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.462+0000 7f61977fe700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 0x7f6198118df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6190016000 tx=0x7f6190004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.463+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190012430 con 0x7f61981356e0 2023-10-03T10:12:23.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.463+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190024070 con 0x7f61981356e0 2023-10-03T10:12:23.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.463+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61981c3d90 con 0x7f61981356e0 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.463+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900098f0 con 0x7f61981356e0 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.463+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619809fe00 con 0x7f61981356e0 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.464+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6190012810 con 0x7f61981356e0 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.464+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6190026070 con 0x7f61981356e0 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.464+0000 7f6196ffd700 1 -- 172.21.15.125:0/1573892331 >> v1:172.21.15.125:6816/126957 conn(0x7f618402f560 legacy=0x7f6184031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.464+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619804f2a0 con 0x7f61981356e0 2023-10-03T10:12:23.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.469+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6190004040 con 0x7f61981356e0 2023-10-03T10:12:23.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.495+0000 7faa8ef56700 1 Processor -- start 2023-10-03T10:12:23.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.495+0000 7faa8ef56700 1 -- start start 2023-10-03T10:12:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8ef56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8ef56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa8813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8ef56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa88133a60 con 0x7faa88133c80 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8ef56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8809a360 con 0x7faa88136a80 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8ef56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8809a880 con 0x7faa881393a0 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57000/0 (socket says 172.21.15.125:57000) 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 -- 172.21.15.125:0/1459993518 learned_addr learned my addr 172.21.15.125:0/1459993518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa8d4f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa8813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 -- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 msgr2=0x7faa8813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa8813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.496+0000 7faa87fff700 1 -- 172.21.15.125:0/1459993518 >> v1:172.21.15.125:6789/0 conn(0x7faa88133c80 legacy=0x7faa88134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa87fff700 1 -- 172.21.15.125:0/1459993518 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8809ab40 con 0x7faa88136a80 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa8d4f3700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa8813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa87fff700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa74009920 tx=0x7faa74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff6bed440fdbf9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa877fe700 1 -- 172.21.15.125:0/1459993518 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74011830 con 0x7faa88136a80 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa877fe700 1 -- 172.21.15.125:0/1459993518 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74011990 con 0x7faa88136a80 2023-10-03T10:12:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.497+0000 7faa877fe700 1 -- 172.21.15.125:0/1459993518 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74011d20 con 0x7faa88136a80 2023-10-03T10:12:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 -- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 msgr2=0x7faa88138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa74009920 tx=0x7faa74009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 -- 172.21.15.125:0/1459993518 shutdown_connections 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa8813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 --2- 172.21.15.125:0/1459993518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88138e60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 -- 172.21.15.125:0/1459993518 >> 172.21.15.125:0/1459993518 conn(0x7faa880a2980 msgr2=0x7faa880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 -- 172.21.15.125:0/1459993518 shutdown_connections 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.498+0000 7faa8ef56700 1 -- 172.21.15.125:0/1459993518 wait complete. 2023-10-03T10:12:23.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 Processor -- start 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 -- start start 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa88133c80 0x7faa88118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa88119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8812dbe0 con 0x7faa88133c80 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8809fdd0 con 0x7faa88136a80 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8ef56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa88139090 con 0x7faa881393a0 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa87fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa87fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57010/0 (socket says 172.21.15.125:57010) 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa87fff700 1 -- 172.21.15.125:0/557039013 learned_addr learned my addr 172.21.15.125:0/557039013 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.499+0000 7faa8d4f3700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa88119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 -- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 msgr2=0x7faa88119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa88119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 -- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa88133c80 msgr2=0x7faa88118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa88133c80 0x7faa88118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 -- 172.21.15.125:0/557039013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009a70 con 0x7faa88136a80 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa8d4f3700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa88119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa87fff700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa74000c00 tx=0x7faa74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74004510 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa740036a0 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74003a10 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa74009550 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.500+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8811b530 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.501+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faa74003b70 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.501+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7faa74021030 con 0x7faa88136a80 2023-10-03T10:12:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.501+0000 7faa8ccf2700 1 -- 172.21.15.125:0/557039013 >> v1:172.21.15.125:6816/126957 conn(0x7faa6c02f510 legacy=0x7faa6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.502+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8804f2a0 con 0x7faa88136a80 2023-10-03T10:12:23.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.506+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa7401a430 con 0x7faa88136a80 2023-10-03T10:12:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 Processor -- start 2023-10-03T10:12:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 -- start start 2023-10-03T10:12:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 0x7f6abc1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc09eca0 con 0x7f6abc134f00 2023-10-03T10:12:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc09f720 con 0x7f6abc09e070 2023-10-03T10:12:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.569+0000 7f6ac282f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc06b480 con 0x7f6abc06a770 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6ac0dcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6ac0dcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52776/0 (socket says 172.21.15.125:52776) 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6ac0dcc700 1 -- 172.21.15.125:0/880123982 learned_addr learned my addr 172.21.15.125:0/880123982 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 --2- 172.21.15.125:0/880123982 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 0x7f6abc1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 -- 172.21.15.125:0/880123982 >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 msgr2=0x7f6abc13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 --2- 172.21.15.125:0/880123982 >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 -- 172.21.15.125:0/880123982 >> v1:172.21.15.125:6789/0 conn(0x7f6abc134f00 legacy=0x7f6abc09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 -- 172.21.15.125:0/880123982 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc1352d0 con 0x7f6abc06a770 2023-10-03T10:12:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6ac0dcc700 1 --2- 172.21.15.125:0/880123982 >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abbfff700 1 --2- 172.21.15.125:0/880123982 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 0x7f6abc1349c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009840 tx=0x7f6aac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25330e62e11f396d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.570+0000 7f6abaffd700 1 -- 172.21.15.125:0/880123982 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac011830 con 0x7f6abc06a770 2023-10-03T10:12:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6abaffd700 1 -- 172.21.15.125:0/880123982 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac011990 con 0x7f6abc06a770 2023-10-03T10:12:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6abaffd700 1 -- 172.21.15.125:0/880123982 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac011d20 con 0x7f6abc06a770 2023-10-03T10:12:23.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 -- 172.21.15.125:0/880123982 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 msgr2=0x7f6abc1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 --2- 172.21.15.125:0/880123982 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 0x7f6abc1349c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009840 tx=0x7f6aac009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 -- 172.21.15.125:0/880123982 shutdown_connections 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 --2- 172.21.15.125:0/880123982 >> v2:172.21.15.125:3300/0 conn(0x7f6abc09e070 0x7f6abc13fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 --2- 172.21.15.125:0/880123982 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc06a770 0x7f6abc1349c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 -- 172.21.15.125:0/880123982 >> 172.21.15.125:0/880123982 conn(0x7f6abc099c40 msgr2=0x7f6abc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 -- 172.21.15.125:0/880123982 shutdown_connections 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.571+0000 7f6ac282f700 1 -- 172.21.15.125:0/880123982 wait complete. 2023-10-03T10:12:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.572+0000 7f6ac282f700 1 Processor -- start 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 -- start start 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6abc06a770 0x7f6abc11a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6abc09e070 0x7f6abc11ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0a01b0 con 0x7f6abc06a770 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc09f220 con 0x7f6abc09e070 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac282f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc11d5f0 con 0x7f6abc134f00 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac0dcc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac0dcc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35340/0 (socket says 172.21.15.125:35340) 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6ac0dcc700 1 -- 172.21.15.125:0/3175761502 learned_addr learned my addr 172.21.15.125:0/3175761502 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6abbfff700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6abc06a770 0x7f6abc11a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.573+0000 7f6abb7fe700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6abc09e070 0x7f6abc11ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 -- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6abc09e070 msgr2=0x7f6abc11ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6abc09e070 0x7f6abc11ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 -- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6abc06a770 msgr2=0x7f6abc11a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6abc06a770 0x7f6abc11a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 -- 172.21.15.125:0/3175761502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4009b30 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac0dcc700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400efc0 tx=0x7f6ab400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4018070 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab400f040 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac0094a0 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4003c20 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.574+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc11cc50 con 0x7f6abc134f00 2023-10-03T10:12:23.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.575+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc04f2a0 con 0x7f6abc134f00 2023-10-03T10:12:23.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.576+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6ab400c880 con 0x7f6abc134f00 2023-10-03T10:12:23.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.576+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6ab403fe00 con 0x7f6abc134f00 2023-10-03T10:12:23.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.576+0000 7f6abbfff700 1 -- 172.21.15.125:0/3175761502 >> v1:172.21.15.125:6816/126957 conn(0x7f6aa802f510 legacy=0x7f6aa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.578+0000 7f5e84c1f700 1 Processor -- start 2023-10-03T10:12:23.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.578+0000 7f5e84c1f700 1 -- start start 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e84c1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 0x7f5e80133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e84c1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e800a0ff0 0x7f5e8013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e84c1f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8009aa00 con 0x7f5e80099a60 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e84c1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8009a080 con 0x7f5e80133b80 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e84c1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80133750 con 0x7f5e800a0ff0 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5e80099a60 0x7f5e800a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39688/0 (socket says 172.21.15.125:39688) 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7dd9b700 1 -- 172.21.15.125:0/3648641396 learned_addr learned my addr 172.21.15.125:0/3648641396 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 0x7f5e80133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7d59a700 1 -- 172.21.15.125:0/3648641396 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361369884 0 0) 0x7f5e8009aa00 con 0x7f5e80099a60 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7d59a700 1 -- 172.21.15.125:0/3648641396 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e680035b0 con 0x7f5e80099a60 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7e59c700 1 -- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e800a0ff0 msgr2=0x7f5e8013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e800a0ff0 0x7f5e8013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7e59c700 1 -- 172.21.15.125:0/3648641396 >> v1:172.21.15.125:6789/0 conn(0x7f5e80099a60 legacy=0x7f5e800a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.579+0000 7f5e7e59c700 1 -- 172.21.15.125:0/3648641396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8009a760 con 0x7f5e80133b80 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 0x7f5e80133f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009850 tx=0x7f5e70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a066ca2bf72d64cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e7d59a700 1 -- 172.21.15.125:0/3648641396 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005e30 con 0x7f5e80133b80 2023-10-03T10:12:23.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e7d59a700 1 -- 172.21.15.125:0/3648641396 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70006030 con 0x7f5e80133b80 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e7d59a700 1 -- 172.21.15.125:0/3648641396 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700063e0 con 0x7f5e80133b80 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e84c1f700 1 -- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 msgr2=0x7f5e80133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.580+0000 7f5e84c1f700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 0x7f5e80133f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009850 tx=0x7f5e70009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 -- 172.21.15.125:0/3648641396 shutdown_connections 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e800a0ff0 0x7f5e8013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 --2- 172.21.15.125:0/3648641396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e80133b80 0x7f5e80133f50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 -- 172.21.15.125:0/3648641396 >> 172.21.15.125:0/3648641396 conn(0x7f5e800a2980 msgr2=0x7f5e800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 -- 172.21.15.125:0/3648641396 shutdown_connections 2023-10-03T10:12:23.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f5e84c1f700 1 -- 172.21.15.125:0/3648641396 wait complete. 2023-10-03T10:12:23.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.581+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ab400ce10 con 0x7f6abc134f00 2023-10-03T10:12:23.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.582+0000 7f5e84c1f700 1 Processor -- start 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.582+0000 7f5e84c1f700 1 -- start start 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e800a0ff0 0x7f5e8011ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e80133b80 0x7f5e8011b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8011c430 con 0x7f5e80133b80 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8011e340 con 0x7f5e800a0ff0 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e84c1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8011d6f0 con 0x7f5e80099a60 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35360/0 (socket says 172.21.15.125:35360) 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 -- 172.21.15.125:0/568301457 learned_addr learned my addr 172.21.15.125:0/568301457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7ed9d700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e80133b80 0x7f5e8011b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7dd9b700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e800a0ff0 0x7f5e8011ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 -- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e800a0ff0 msgr2=0x7f5e8011ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e800a0ff0 0x7f5e8011ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 -- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e80133b80 msgr2=0x7f5e8011b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e80133b80 0x7f5e8011b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.583+0000 7f5e7e59c700 1 -- 172.21.15.125:0/568301457 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009430 con 0x7f5e80099a60 2023-10-03T10:12:23.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e7e59c700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e70013040 tx=0x7f5e70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700063a0 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70020070 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70006740 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e84c1f700 1 -- 172.21.15.125:0/568301457 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e801309b0 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.584+0000 7f5e84c1f700 1 -- 172.21.15.125:0/568301457 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8011e060 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.585+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e580052e0 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.586+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5e70022030 con 0x7f5e80099a60 2023-10-03T10:12:23.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.586+0000 7f5e7dd9b700 1 -- 172.21.15.125:0/568301457 >> v1:172.21.15.125:6816/126957 conn(0x7f5e6002f510 legacy=0x7f5e600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.591+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5e70004570 con 0x7f5e80099a60 2023-10-03T10:12:23.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.594+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e700193b0 con 0x7f5e80099a60 2023-10-03T10:12:23.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.665+0000 7f6196ffd700 1 -- 172.21.15.125:0/1573892331 >> v1:172.21.15.125:6816/126957 conn(0x7f618402f560 legacy=0x7f6184031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.702+0000 7faa8ccf2700 1 -- 172.21.15.125:0/557039013 >> v1:172.21.15.125:6816/126957 conn(0x7faa6c02f510 legacy=0x7faa6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.705+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa8809f540 con 0x7faa88136a80 2023-10-03T10:12:23.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.705+0000 7faa857fa700 1 -- 172.21.15.125:0/557039013 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa7402b070 con 0x7faa88136a80 2023-10-03T10:12:23.705 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:23.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 >> v1:172.21.15.125:6816/126957 conn(0x7faa6c02f510 legacy=0x7faa6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 msgr2=0x7faa88119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa74000c00 tx=0x7faa74004750 comp rx=0 tx=0).stop 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 shutdown_connections 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa881393a0 0x7faa88119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa88133c80 0x7faa88118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 --2- 172.21.15.125:0/557039013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa88136a80 0x7faa88119330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 >> 172.21.15.125:0/557039013 conn(0x7faa880a2980 msgr2=0x7faa88134860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 shutdown_connections 2023-10-03T10:12:23.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.707+0000 7faa8ef56700 1 -- 172.21.15.125:0/557039013 wait complete. 2023-10-03T10:12:23.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.717+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f619811bd90 con 0x7f61981356e0 2023-10-03T10:12:23.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.717+0000 7f617f7fe700 1 -- 172.21.15.125:0/1573892331 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6190030020 con 0x7f61981356e0 2023-10-03T10:12:23.718 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:23.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 >> v1:172.21.15.125:6816/126957 conn(0x7f618402f560 legacy=0x7f6184031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 msgr2=0x7f6198118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 0x7f6198118df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6190016000 tx=0x7f6190004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 shutdown_connections 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61981356e0 0x7f6198118df0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61980a0a30 0x7f61981c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 --2- 172.21.15.125:0/1573892331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61980a1510 0x7f61981c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.720+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 >> 172.21.15.125:0/1573892331 conn(0x7f61980a2980 msgr2=0x7f6198130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.721+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 shutdown_connections 2023-10-03T10:12:23.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.721+0000 7f619d5ac700 1 -- 172.21.15.125:0/1573892331 wait complete. 2023-10-03T10:12:23.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.777+0000 7f6abbfff700 1 -- 172.21.15.125:0/3175761502 >> v1:172.21.15.125:6816/126957 conn(0x7f6aa802f510 legacy=0x7f6aa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.779+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6abc126f10 con 0x7f6abc134f00 2023-10-03T10:12:23.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.780+0000 7f6ab8ff9700 1 -- 172.21.15.125:0/3175761502 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ab4041030 con 0x7f6abc134f00 2023-10-03T10:12:23.780 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:23.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 >> v1:172.21.15.125:6816/126957 conn(0x7f6aa802f510 legacy=0x7f6aa80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 msgr2=0x7f6abc11b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400efc0 tx=0x7f6ab400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 shutdown_connections 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6abc134f00 0x7f6abc11b360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6abc06a770 0x7f6abc11a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 --2- 172.21.15.125:0/3175761502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6abc09e070 0x7f6abc11ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 >> 172.21.15.125:0/3175761502 conn(0x7f6abc099c40 msgr2=0x7f6abc0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 shutdown_connections 2023-10-03T10:12:23.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.782+0000 7f6ac282f700 1 -- 172.21.15.125:0/3175761502 wait complete. 2023-10-03T10:12:23.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.787+0000 7f5e7dd9b700 1 -- 172.21.15.125:0/568301457 >> v1:172.21.15.125:6816/126957 conn(0x7f5e6002f510 legacy=0x7f5e600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.790+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e58005860 con 0x7f5e80099a60 2023-10-03T10:12:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.790+0000 7f5e6effd700 1 -- 172.21.15.125:0/568301457 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e7001b410 con 0x7f5e80099a60 2023-10-03T10:12:23.791 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 >> v1:172.21.15.125:6816/126957 conn(0x7f5e6002f510 legacy=0x7f5e600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 msgr2=0x7f5e8011a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e70013040 tx=0x7f5e70004750 comp rx=0 tx=0).stop 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 shutdown_connections 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e80133b80 0x7f5e8011b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e80099a60 0x7f5e8011a820 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 --2- 172.21.15.125:0/568301457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e800a0ff0 0x7f5e8011ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 >> 172.21.15.125:0/568301457 conn(0x7f5e800a2980 msgr2=0x7f5e8012f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 shutdown_connections 2023-10-03T10:12:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:23.792+0000 7f5e6cff9700 1 -- 172.21.15.125:0/568301457 wait complete. 2023-10-03T10:12:23.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:23.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:24.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:24.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:24.795 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:24.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:24.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.878+0000 7f710a5b6700 1 Processor -- start 2023-10-03T10:12:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.878+0000 7f710a5b6700 1 -- start start 2023-10-03T10:12:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f710a5b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f710a5b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f710a5b6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710409aaa0 con 0x7f7104130ce0 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f710a5b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710409f870 con 0x7f710409e170 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f710a5b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f710409b360 con 0x7f710409d860 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f71037fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f71037fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57052/0 (socket says 172.21.15.125:57052) 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f71037fe700 1 -- 172.21.15.125:0/4134638298 learned_addr learned my addr 172.21.15.125:0/4134638298 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.879+0000 7f7102ffd700 1 -- 172.21.15.125:0/4134638298 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409016740 0 0) 0x7f710409aaa0 con 0x7f7104130ce0 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7102ffd700 1 -- 172.21.15.125:0/4134638298 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec0035b0 con 0x7f7104130ce0 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7103fff700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f71037fe700 1 -- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 msgr2=0x7f710409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f71037fe700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f71037fe700 1 -- 172.21.15.125:0/4134638298 >> v1:172.21.15.125:6789/0 conn(0x7f7104130ce0 legacy=0x7f71041379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f71037fe700 1 -- 172.21.15.125:0/4134638298 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710409b620 con 0x7f710409e170 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7103fff700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f71037fe700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bbc0 tx=0x7f70f800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee81d1275fcb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7102ffd700 1 -- 172.21.15.125:0/4134638298 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800dd30 con 0x7f710409e170 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7102ffd700 1 -- 172.21.15.125:0/4134638298 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800de90 con 0x7f710409e170 2023-10-03T10:12:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.880+0000 7f7102ffd700 1 -- 172.21.15.125:0/4134638298 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8010690 con 0x7f710409e170 2023-10-03T10:12:24.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 -- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 msgr2=0x7f71041307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bbc0 tx=0x7f70f800bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 -- 172.21.15.125:0/4134638298 shutdown_connections 2023-10-03T10:12:24.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 --2- 172.21.15.125:0/4134638298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f710409e170 0x7f71041307a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 -- 172.21.15.125:0/4134638298 >> 172.21.15.125:0/4134638298 conn(0x7f7104099c40 msgr2=0x7f71040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 -- 172.21.15.125:0/4134638298 shutdown_connections 2023-10-03T10:12:24.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.881+0000 7f710a5b6700 1 -- 172.21.15.125:0/4134638298 wait complete. 2023-10-03T10:12:24.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.882+0000 7f710a5b6700 1 Processor -- start 2023-10-03T10:12:24.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 -- start start 2023-10-03T10:12:24.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710411e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 0x7f710411e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7104130ce0 0x7f710411ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104121d00 con 0x7f710409e170 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710411fff0 con 0x7f7104130ce0 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.883+0000 7f710a5b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71041205a0 con 0x7f710409d860 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f7103fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f7103fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710411e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35376/0 (socket says 172.21.15.125:35376) 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f7103fff700 1 -- 172.21.15.125:0/2214005295 learned_addr learned my addr 172.21.15.125:0/2214005295 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 0x7f710411e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f7108b53700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7104130ce0 0x7f710411ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 -- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 msgr2=0x7f710411e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710411e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 -- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7104130ce0 msgr2=0x7f710411ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7104130ce0 0x7f710411ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 -- 172.21.15.125:0/2214005295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f800b7f0 con 0x7f710409e170 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.884+0000 7f71037fe700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 0x7f710411e9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70f8018000 tx=0x7f70f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.885+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f801f070 con 0x7f710409e170 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.885+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8003970 con 0x7f710409e170 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.885+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710409c8b0 con 0x7f710409e170 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.885+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8003d40 con 0x7f710409e170 2023-10-03T10:12:24.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.885+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104121f00 con 0x7f710409e170 2023-10-03T10:12:24.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.886+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f70f8019400 con 0x7f710409e170 2023-10-03T10:12:24.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.886+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f70f8042dc0 con 0x7f710409e170 2023-10-03T10:12:24.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.886+0000 7f7103fff700 1 -- 172.21.15.125:0/2214005295 >> v1:172.21.15.125:6816/126957 conn(0x7f70f002f510 legacy=0x7f70f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:24.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.886+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710404f2a0 con 0x7f710409e170 2023-10-03T10:12:24.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.891+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70f800f3d0 con 0x7f710409e170 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 Processor -- start 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 -- start start 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328133f70 0x7f43281343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43280a0a70 0x7f43280a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280a3b60 con 0x7f43280a0a70 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43281348e0 con 0x7f4328133f70 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.915+0000 7f432da5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432809b110 con 0x7f432809ad40 2023-10-03T10:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35380/0 (socket says 172.21.15.125:35380) 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 -- 172.21.15.125:0/3077332452 learned_addr learned my addr 172.21.15.125:0/3077332452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f43277fe700 1 --2- 172.21.15.125:0/3077332452 >> v2:172.21.15.125:3300/0 conn(0x7f43280a0a70 0x7f43280a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f43267fc700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328133f70 0x7f43281343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 -- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328133f70 msgr2=0x7f43281343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328133f70 0x7f43281343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 -- 172.21.15.125:0/3077332452 >> v2:172.21.15.125:3300/0 conn(0x7f43280a0a70 msgr2=0x7f43280a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 --2- 172.21.15.125:0/3077332452 >> v2:172.21.15.125:3300/0 conn(0x7f43280a0a70 0x7f43280a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 -- 172.21.15.125:0/3077332452 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280a2fa0 con 0x7f432809ad40 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4326ffd700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43180098f0 tx=0x7f4318009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=550c4675dd9c1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4325ffb700 1 -- 172.21.15.125:0/3077332452 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318011830 con 0x7f432809ad40 2023-10-03T10:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4325ffb700 1 -- 172.21.15.125:0/3077332452 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4318011990 con 0x7f432809ad40 2023-10-03T10:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.916+0000 7f4325ffb700 1 -- 172.21.15.125:0/3077332452 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318011d20 con 0x7f432809ad40 2023-10-03T10:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 -- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 msgr2=0x7f4328133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43180098f0 tx=0x7f4318009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 -- 172.21.15.125:0/3077332452 shutdown_connections 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 --2- 172.21.15.125:0/3077332452 >> v2:172.21.15.125:3300/0 conn(0x7f43280a0a70 0x7f43280a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f432809ad40 0x7f4328133a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 --2- 172.21.15.125:0/3077332452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328133f70 0x7f43281343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 -- 172.21.15.125:0/3077332452 >> 172.21.15.125:0/3077332452 conn(0x7f4328099c40 msgr2=0x7f432806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 -- 172.21.15.125:0/3077332452 shutdown_connections 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.917+0000 7f432da5d700 1 -- 172.21.15.125:0/3077332452 wait complete. 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.919+0000 7f432da5d700 1 Processor -- start 2023-10-03T10:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.919+0000 7f432da5d700 1 -- start start 2023-10-03T10:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.919+0000 7f432da5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 0x7f432811f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.919+0000 7f432da5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a0a70 0x7f432811f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f432da5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f432da5d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328122a40 con 0x7f432809ad40 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f432da5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4328120f20 con 0x7f43280a0a70 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f432da5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4328133a30 con 0x7f4328133f70 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35396/0 (socket says 172.21.15.125:35396) 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 -- 172.21.15.125:0/2826554736 learned_addr learned my addr 172.21.15.125:0/2826554736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f4326ffd700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 0x7f432811f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43267fc700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a0a70 0x7f432811f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 -- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a0a70 msgr2=0x7f432811f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a0a70 0x7f432811f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 -- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 msgr2=0x7f432811f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 0x7f432811f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 -- 172.21.15.125:0/2826554736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318009550 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f4326ffd700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 0x7f432811f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f43277fe700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f432000eed0 tx=0x7f432000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.920+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320010040 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.921+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000bd30 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.921+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432809c7e0 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.921+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000bea0 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.921+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4328122d20 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.922+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432804f2a0 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.922+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4320014620 con 0x7f4328133f70 2023-10-03T10:12:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.922+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f43200400b0 con 0x7f4328133f70 2023-10-03T10:12:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.922+0000 7f4326ffd700 1 -- 172.21.15.125:0/2826554736 >> v1:172.21.15.125:6816/126957 conn(0x7f431402f510 legacy=0x7f43140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.926+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4320009e40 con 0x7f4328133f70 2023-10-03T10:12:24.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 Processor -- start 2023-10-03T10:12:24.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 -- start start 2023-10-03T10:12:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 0x7f6ecc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0a1e70 con 0x7f6ecc0a0a30 2023-10-03T10:12:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc09a720 con 0x7f6ecc1356e0 2023-10-03T10:12:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ed1247700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc09b300 con 0x7f6ecc0a1510 2023-10-03T10:12:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6eca59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 0x7f6ecc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ecad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6ecc0a0a30 0x7f6ecc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39720/0 (socket says 172.21.15.125:39720) 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ecad9d700 1 -- 172.21.15.125:0/3153547502 learned_addr learned my addr 172.21.15.125:0/3153547502 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.947+0000 7f6ecb59e700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6eca59c700 1 -- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 msgr2=0x7f6ecc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6eca59c700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6eca59c700 1 -- 172.21.15.125:0/3153547502 >> v1:172.21.15.125:6789/0 conn(0x7f6ecc0a0a30 legacy=0x7f6ecc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6eca59c700 1 -- 172.21.15.125:0/3153547502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc09abc0 con 0x7f6ecc0a1510 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6ec9d9b700 1 -- 172.21.15.125:0/3153547502 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953549850 0 0) 0x7f6ecc0a1e70 con 0x7f6ecc0a0a30 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6eca59c700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 0x7f6ecc1351a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000bb10 tx=0x7f6ec000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1233ff175e91179e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6ec9d9b700 1 -- 172.21.15.125:0/3153547502 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000dc70 con 0x7f6ecc0a1510 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6ec9d9b700 1 -- 172.21.15.125:0/3153547502 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000ddd0 con 0x7f6ecc0a1510 2023-10-03T10:12:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.948+0000 7f6ec9d9b700 1 -- 172.21.15.125:0/3153547502 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0010690 con 0x7f6ecc0a1510 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 -- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 msgr2=0x7f6ecc1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 0x7f6ecc1351a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000bb10 tx=0x7f6ec000be20 comp rx=0 tx=0).stop 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 -- 172.21.15.125:0/3153547502 shutdown_connections 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3153547502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a1510 0x7f6ecc1351a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 -- 172.21.15.125:0/3153547502 >> 172.21.15.125:0/3153547502 conn(0x7f6ecc0a2980 msgr2=0x7f6ecc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 -- 172.21.15.125:0/3153547502 shutdown_connections 2023-10-03T10:12:24.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.949+0000 7f6ed1247700 1 -- 172.21.15.125:0/3153547502 wait complete. 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 Processor -- start 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 -- start start 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc0a1510 0x7f6ecc119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc09ae00 con 0x7f6ecc0a1510 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc11b060 con 0x7f6ecc1356e0 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.950+0000 7f6ed1247700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc11bf20 con 0x7f6ecc0a0a30 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57104/0 (socket says 172.21.15.125:57104) 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35410/0 (socket says 172.21.15.125:35410) 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 -- 172.21.15.125:0/3485479171 learned_addr learned my addr 172.21.15.125:0/3485479171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6eca59c700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc0a1510 0x7f6ecc119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 -- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 msgr2=0x7f6ecc118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 -- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc0a1510 msgr2=0x7f6ecc119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc0a1510 0x7f6ecc119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 -- 172.21.15.125:0/3485479171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec000b740 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecad9d700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ecb59e700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400efc0 tx=0x7f6ec400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4009ca0 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400f040 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc134e00 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4014480 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.951+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc11a180 con 0x7f6ecc1356e0 2023-10-03T10:12:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.953+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc04f2a0 con 0x7f6ecc1356e0 2023-10-03T10:12:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.953+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6ec40145e0 con 0x7f6ecc1356e0 2023-10-03T10:12:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.953+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6ec4040d90 con 0x7f6ecc1356e0 2023-10-03T10:12:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.953+0000 7f6ecad9d700 1 -- 172.21.15.125:0/3485479171 >> v1:172.21.15.125:6816/126957 conn(0x7f6eb802f510 legacy=0x7f6eb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.957+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ec4012730 con 0x7f6ecc1356e0 2023-10-03T10:12:24.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.979+0000 7fa3e65a2700 1 Processor -- start 2023-10-03T10:12:24.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 -- start start 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3e009f200 0x7fa3e0136860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 0x7fa3e0139180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e009bc40 con 0x7fa3e009e720 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e009b6a0 con 0x7fa3e009f200 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e65a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00a0480 con 0x7fa3e0136da0 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e5da1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 0x7fa3e0139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.980+0000 7fa3e55a0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa3e009e720 0x7fa3e009eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39722/0 (socket says 172.21.15.125:39722) 2023-10-03T10:12:24.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e55a0700 1 -- 172.21.15.125:0/2892755661 learned_addr learned my addr 172.21.15.125:0/2892755661 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:24.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e4d9f700 1 --2- 172.21.15.125:0/2892755661 >> v2:172.21.15.125:3300/0 conn(0x7fa3e009f200 0x7fa3e0136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2892755661 >> v2:172.21.15.125:3300/0 conn(0x7fa3e009f200 msgr2=0x7fa3e0136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2892755661 >> v2:172.21.15.125:3300/0 conn(0x7fa3e009f200 0x7fa3e0136860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2892755661 >> v1:172.21.15.125:6789/0 conn(0x7fa3e009e720 legacy=0x7fa3e009eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2892755661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e009fee0 con 0x7fa3e0136da0 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2892755661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 0x7fa3e0139180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeba7d7bf0217a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3d7fff700 1 -- 172.21.15.125:0/2892755661 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800e070 con 0x7fa3e0136da0 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3d7fff700 1 -- 172.21.15.125:0/2892755661 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800bb20 con 0x7fa3e0136da0 2023-10-03T10:12:24.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.981+0000 7fa3d7fff700 1 -- 172.21.15.125:0/2892755661 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8012430 con 0x7fa3e0136da0 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2892755661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 msgr2=0x7fa3e0139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 --2- 172.21.15.125:0/2892755661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 0x7fa3e0139180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2892755661 shutdown_connections 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 --2- 172.21.15.125:0/2892755661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e0136da0 0x7fa3e0139180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 --2- 172.21.15.125:0/2892755661 >> v2:172.21.15.125:3300/0 conn(0x7fa3e009f200 0x7fa3e0136860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2892755661 >> 172.21.15.125:0/2892755661 conn(0x7fa3e00a0d40 msgr2=0x7fa3e00a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2892755661 shutdown_connections 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.982+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2892755661 wait complete. 2023-10-03T10:12:24.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.983+0000 7fa3e65a2700 1 Processor -- start 2023-10-03T10:12:24.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.983+0000 7fa3e65a2700 1 -- start start 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 0x7fa3e011a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 0x7fa3e011a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 0x7fa3e011af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e011def0 con 0x7fa3e0136da0 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e011c870 con 0x7fa3e009e720 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e65a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009b0f0 con 0x7fa3e009f200 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e4d9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 0x7fa3e011a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e4d9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 0x7fa3e011a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35428/0 (socket says 172.21.15.125:35428) 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e4d9f700 1 -- 172.21.15.125:0/2135877255 learned_addr learned my addr 172.21.15.125:0/2135877255 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.984+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 0x7fa3e011af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 msgr2=0x7fa3e011a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 0x7fa3e011a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e55a0700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 0x7fa3e011a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 msgr2=0x7fa3e011a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 0x7fa3e011a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 -- 172.21.15.125:0/2135877255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009a70 con 0x7fa3e0136da0 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e55a0700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 0x7fa3e011a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e5da1700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 0x7fa3e011af30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8016000 tx=0x7fa3d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8012430 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2135877255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e009ae00 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8020070 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004280 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.985+0000 7fa3e65a2700 1 -- 172.21.15.125:0/2135877255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e011bfc0 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.986+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80052e0 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.987+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa3d80043e0 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.988+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa3d8022070 con 0x7fa3e0136da0 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.988+0000 7fa3e55a0700 1 -- 172.21.15.125:0/2135877255 >> v1:172.21.15.125:6816/126957 conn(0x7fa3c402f510 legacy=0x7fa3c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:24.996+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d801ad50 con 0x7fa3e0136da0 2023-10-03T10:12:25.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.087+0000 7f7103fff700 1 -- 172.21.15.125:0/2214005295 >> v1:172.21.15.125:6816/126957 conn(0x7f70f002f510 legacy=0x7f70f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:25.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.123+0000 7f4326ffd700 1 -- 172.21.15.125:0/2826554736 >> v1:172.21.15.125:6816/126957 conn(0x7f431402f510 legacy=0x7f43140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:25.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.130+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43280729d0 con 0x7f4328133f70 2023-10-03T10:12:25.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.131+0000 7f430ffff700 1 -- 172.21.15.125:0/2826554736 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4320018070 con 0x7f4328133f70 2023-10-03T10:12:25.131 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:25.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 >> v1:172.21.15.125:6816/126957 conn(0x7f431402f510 legacy=0x7f43140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 msgr2=0x7f432811fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f432000eed0 tx=0x7f432000b390 comp rx=0 tx=0).stop 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 shutdown_connections 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4328133f70 0x7f432811fc80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f432809ad40 0x7f432811f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 --2- 172.21.15.125:0/2826554736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a0a70 0x7f432811f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.134+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 >> 172.21.15.125:0/2826554736 conn(0x7f4328099c40 msgr2=0x7f432809e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.135+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 shutdown_connections 2023-10-03T10:12:25.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.135+0000 7f432da5d700 1 -- 172.21.15.125:0/2826554736 wait complete. 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.142+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7104130580 con 0x7f710409e170 2023-10-03T10:12:25.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.142+0000 7f7100ff9700 1 -- 172.21.15.125:0/2214005295 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70f800e360 con 0x7f710409e170 2023-10-03T10:12:25.143 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 >> v1:172.21.15.125:6816/126957 conn(0x7f70f002f510 legacy=0x7f70f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 msgr2=0x7f710411e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 0x7f710411e9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70f8018000 tx=0x7f70f8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 shutdown_connections 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7104130ce0 0x7f710411ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f710409d860 0x7f710411e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 --2- 172.21.15.125:0/2214005295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f710409e170 0x7f710411e9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 >> 172.21.15.125:0/2214005295 conn(0x7f7104099c40 msgr2=0x7f71040a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 shutdown_connections 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.146+0000 7f710a5b6700 1 -- 172.21.15.125:0/2214005295 wait complete. 2023-10-03T10:12:25.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.154+0000 7f6ecad9d700 1 -- 172.21.15.125:0/3485479171 >> v1:172.21.15.125:6816/126957 conn(0x7f6eb802f510 legacy=0x7f6eb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:25.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.164+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ecc11a180 con 0x7f6ecc1356e0 2023-10-03T10:12:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.165+0000 7f6eb37fe700 1 -- 172.21.15.125:0/3485479171 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ecc11a180 con 0x7f6ecc1356e0 2023-10-03T10:12:25.165 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 >> v1:172.21.15.125:6816/126957 conn(0x7f6eb802f510 legacy=0x7f6eb80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 msgr2=0x7f6ecc119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400efc0 tx=0x7f6ec400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 shutdown_connections 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1356e0 0x7f6ecc119870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ecc0a0a30 0x7f6ecc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 --2- 172.21.15.125:0/3485479171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc0a1510 0x7f6ecc119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 >> 172.21.15.125:0/3485479171 conn(0x7f6ecc0a2980 msgr2=0x7f6ecc130720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 shutdown_connections 2023-10-03T10:12:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.167+0000 7f6ed1247700 1 -- 172.21.15.125:0/3485479171 wait complete. 2023-10-03T10:12:25.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:25.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.189+0000 7fa3e55a0700 1 -- 172.21.15.125:0/2135877255 >> v1:172.21.15.125:6816/126957 conn(0x7fa3c402f510 legacy=0x7fa3c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:25.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.208+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3b8005860 con 0x7fa3e0136da0 2023-10-03T10:12:25.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.208+0000 7fa3d5ffb700 1 -- 172.21.15.125:0/2135877255 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d8034020 con 0x7fa3e0136da0 2023-10-03T10:12:25.209 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:25.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 >> v1:172.21.15.125:6816/126957 conn(0x7fa3c402f510 legacy=0x7fa3c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 msgr2=0x7fa3e011af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 0x7fa3e011af30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8016000 tx=0x7fa3d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 shutdown_connections 2023-10-03T10:12:25.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3e0136da0 0x7fa3e011af30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3e009e720 0x7fa3e011a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.210+0000 7fa3cb7fe700 1 --2- 172.21.15.125:0/2135877255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3e009f200 0x7fa3e011a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.211+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 >> 172.21.15.125:0/2135877255 conn(0x7fa3e00a0d40 msgr2=0x7fa3e00a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.211+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 shutdown_connections 2023-10-03T10:12:25.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:25.211+0000 7fa3cb7fe700 1 -- 172.21.15.125:0/2135877255 wait complete. 2023-10-03T10:12:25.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:26.150 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:26.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:26.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:26.224 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:26.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 Processor -- start 2023-10-03T10:12:26.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 -- start start 2023-10-03T10:12:26.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 0x7fc49409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 0x7fc4941307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49409aaa0 con 0x7fc494130ce0 2023-10-03T10:12:26.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49409f870 con 0x7fc49409e170 2023-10-03T10:12:26.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.297+0000 7fc498a38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc49409b360 con 0x7fc49409d860 2023-10-03T10:12:26.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc492d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc494130ce0 0x7fc4941379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33138/0 (socket says 172.21.15.125:33138) 2023-10-03T10:12:26.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc492d9d700 1 -- 172.21.15.125:0/959519065 learned_addr learned my addr 172.21.15.125:0/959519065 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:26.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 0x7fc4941307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc49259c700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 0x7fc49409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 -- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 msgr2=0x7fc49409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 0x7fc49409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 -- 172.21.15.125:0/959519065 >> v1:172.21.15.125:6789/0 conn(0x7fc494130ce0 legacy=0x7fc4941379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 -- 172.21.15.125:0/959519065 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49409b620 con 0x7fc49409e170 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc49259c700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 0x7fc49409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc491d9b700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 0x7fc4941307a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc488009870 tx=0x7fc488009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d04af5ae9166b616 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc49159a700 1 -- 172.21.15.125:0/959519065 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488011830 con 0x7fc49409e170 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc49159a700 1 -- 172.21.15.125:0/959519065 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488011990 con 0x7fc49409e170 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.298+0000 7fc49159a700 1 -- 172.21.15.125:0/959519065 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488011d20 con 0x7fc49409e170 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 -- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 msgr2=0x7fc4941307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 0x7fc4941307a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc488009870 tx=0x7fc488009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 -- 172.21.15.125:0/959519065 shutdown_connections 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409d860 0x7fc49409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 --2- 172.21.15.125:0/959519065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc49409e170 0x7fc4941307a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 -- 172.21.15.125:0/959519065 >> 172.21.15.125:0/959519065 conn(0x7fc494099c40 msgr2=0x7fc4940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 -- 172.21.15.125:0/959519065 shutdown_connections 2023-10-03T10:12:26.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.299+0000 7fc498a38700 1 -- 172.21.15.125:0/959519065 wait complete. 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 Processor -- start 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 -- start start 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 0x7fc4941c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409e170 0x7fc4941c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49411b090 con 0x7fc49409d860 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941199b0 con 0x7fc494130ce0 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc498a38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc49411b540 con 0x7fc49409e170 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc49259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 0x7fc4941c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc492d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc49259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 0x7fc4941c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52406/0 (socket says 172.21.15.125:52406) 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc492d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59398/0 (socket says 172.21.15.125:59398) 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc49259c700 1 -- 172.21.15.125:0/3234103318 learned_addr learned my addr 172.21.15.125:0/3234103318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.301+0000 7fc491d9b700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409e170 0x7fc4941c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 -- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409e170 msgr2=0x7fc4941c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409e170 0x7fc4941c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 -- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 msgr2=0x7fc4941c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 0x7fc4941c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 -- 172.21.15.125:0/3234103318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880094a0 con 0x7fc494130ce0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc492d9d700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cad0 tx=0x7fc48c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00a960 con 0x7fc494130ce0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c00aac0 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00ae30 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49409c8b0 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.302+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49411bfb0 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.303+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49404f2a0 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.304+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc48c01b3b0 con 0x7fc494130ce0 2023-10-03T10:12:26.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.305+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc48c03fcd0 con 0x7fc494130ce0 2023-10-03T10:12:26.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.305+0000 7fc49259c700 1 -- 172.21.15.125:0/3234103318 >> v1:172.21.15.125:6816/126957 conn(0x7fc47402f510 legacy=0x7fc4740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.309+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc48c0192c0 con 0x7fc494130ce0 2023-10-03T10:12:26.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.334+0000 7f825cf83700 1 Processor -- start 2023-10-03T10:12:26.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.334+0000 7f825cf83700 1 -- start start 2023-10-03T10:12:26.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f825cf83700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f825809e870 0x7f825809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f825cf83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f8258131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f825cf83700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825809c970 con 0x7f8258131d70 2023-10-03T10:12:26.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f825cf83700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580a0920 con 0x7f825809e870 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f825cf83700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825809f9c0 con 0x7f825809f180 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.335+0000 7f8255d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f8258131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f8256d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8258131d70 0x7f8258138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33140/0 (socket says 172.21.15.125:33140) 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f8256d9d700 1 -- 172.21.15.125:0/1569655774 learned_addr learned my addr 172.21.15.125:0/1569655774 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 --2- 172.21.15.125:0/1569655774 >> v2:172.21.15.125:3300/0 conn(0x7f825809e870 0x7f825809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 -- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 msgr2=0x7f8258131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f8258131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 -- 172.21.15.125:0/1569655774 >> v1:172.21.15.125:6789/0 conn(0x7f8258131d70 legacy=0x7f8258138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 -- 172.21.15.125:0/1569655774 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825809bab0 con 0x7f825809e870 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f8255d9b700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f8258131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825659c700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f825809e870 0x7f825809ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8248009840 tx=0x7f8248009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43049bffbb2a21b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825559a700 1 -- 172.21.15.125:0/1569655774 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248011830 con 0x7f825809e870 2023-10-03T10:12:26.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825559a700 1 -- 172.21.15.125:0/1569655774 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248011990 con 0x7f825809e870 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.336+0000 7f825559a700 1 -- 172.21.15.125:0/1569655774 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248011d20 con 0x7f825809e870 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 -- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f825809e870 msgr2=0x7f825809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f825809e870 0x7f825809ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8248009840 tx=0x7f8248009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 -- 172.21.15.125:0/1569655774 shutdown_connections 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f825809e870 0x7f825809ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 --2- 172.21.15.125:0/1569655774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f8258131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 -- 172.21.15.125:0/1569655774 >> 172.21.15.125:0/1569655774 conn(0x7f82580a4430 msgr2=0x7f82580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 -- 172.21.15.125:0/1569655774 shutdown_connections 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.337+0000 7f825cf83700 1 -- 172.21.15.125:0/1569655774 wait complete. 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.338+0000 7f825cf83700 1 Processor -- start 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.338+0000 7f825cf83700 1 -- start start 2023-10-03T10:12:26.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 0x7f825811f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f825811f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8258130630 con 0x7f8258131d70 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82581206c0 con 0x7f825809f180 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825cf83700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8258121d00 con 0x7f825809e870 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f8256d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 0x7f825811f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f8256d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52414/0 (socket says 172.21.15.125:52414) 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f8256d9d700 1 -- 172.21.15.125:0/2871945033 learned_addr learned my addr 172.21.15.125:0/2871945033 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:26.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f8255d9b700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f825811f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 -- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 msgr2=0x7f825811f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f825811f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 -- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 msgr2=0x7f825811fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f825659c700 1 -- 172.21.15.125:0/2871945033 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0094a0 con 0x7f825809e870 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.339+0000 7f8256d9d700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f825659c700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 0x7f825811f260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f825809afc0 tx=0x7f8248004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480036a0 con 0x7f825809e870 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824801e070 con 0x7f825809e870 2023-10-03T10:12:26.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82480094a0 con 0x7f825809e870 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248003a60 con 0x7f825809e870 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.340+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82580a2d30 con 0x7f825809e870 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.341+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8248003bc0 con 0x7f825809e870 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.341+0000 7f8255d9b700 1 -- 172.21.15.125:0/2871945033 >> v1:172.21.15.125:6816/126957 conn(0x7f823802f510 legacy=0x7f82380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.341+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f82480199f0 con 0x7f825809e870 2023-10-03T10:12:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.341+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82581228f0 con 0x7f825809e870 2023-10-03T10:12:26.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.345+0000 7f250ffb8700 1 Processor -- start 2023-10-03T10:12:26.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.345+0000 7f250ffb8700 1 -- start start 2023-10-03T10:12:26.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250ffb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250ffb8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508135f80 0x7f2508138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250ffb8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250809b930 con 0x7f2508099eb0 2023-10-03T10:12:26.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250ffb8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2508072410 con 0x7f2508135f80 2023-10-03T10:12:26.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250ffb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f250809cd30 con 0x7f2508133660 2023-10-03T10:12:26.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250d553700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250d553700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43562/0 (socket says 172.21.15.125:43562) 2023-10-03T10:12:26.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250d553700 1 -- 172.21.15.125:0/3919835972 learned_addr learned my addr 172.21.15.125:0/3919835972 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:26.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.346+0000 7f250e555700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508135f80 0x7f2508138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.347+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8248015070 con 0x7f825809e870 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.347+0000 7f250d553700 1 -- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508135f80 msgr2=0x7f2508138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.347+0000 7f250d553700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508135f80 0x7f2508138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.347+0000 7f250d553700 1 -- 172.21.15.125:0/3919835972 >> v1:172.21.15.125:6789/0 conn(0x7f2508099eb0 legacy=0x7f250809a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.347+0000 7f250d553700 1 -- 172.21.15.125:0/3919835972 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250809a990 con 0x7f2508133660 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.348+0000 7f250d553700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24f800bbc0 tx=0x7f24f800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f79921c8ee916f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.348+0000 7f250cd52700 1 -- 172.21.15.125:0/3919835972 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800dd30 con 0x7f2508133660 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.348+0000 7f250cd52700 1 -- 172.21.15.125:0/3919835972 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800de90 con 0x7f2508133660 2023-10-03T10:12:26.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.348+0000 7f250cd52700 1 -- 172.21.15.125:0/3919835972 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8010690 con 0x7f2508133660 2023-10-03T10:12:26.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 -- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 msgr2=0x7f2508135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24f800bbc0 tx=0x7f24f800bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 -- 172.21.15.125:0/3919835972 shutdown_connections 2023-10-03T10:12:26.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508135f80 0x7f2508138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 --2- 172.21.15.125:0/3919835972 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508133660 0x7f2508135a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 -- 172.21.15.125:0/3919835972 >> 172.21.15.125:0/3919835972 conn(0x7f25080a2980 msgr2=0x7f25080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 -- 172.21.15.125:0/3919835972 shutdown_connections 2023-10-03T10:12:26.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.349+0000 7f250ffb8700 1 -- 172.21.15.125:0/3919835972 wait complete. 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.350+0000 7f250ffb8700 1 Processor -- start 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.350+0000 7f250ffb8700 1 -- start start 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2508133660 0x7f2508070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508135f80 0x7f2508070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250811a840 con 0x7f2508133660 2023-10-03T10:12:26.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250811aa20 con 0x7f2508099eb0 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250ffb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2508071d90 con 0x7f2508135f80 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250dd54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250dd54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59438/0 (socket says 172.21.15.125:59438) 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250dd54700 1 -- 172.21.15.125:0/2712449445 learned_addr learned my addr 172.21.15.125:0/2712449445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250e555700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508135f80 0x7f2508070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.351+0000 7f250d553700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2508133660 0x7f2508070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 -- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508135f80 msgr2=0x7f2508070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508135f80 0x7f2508070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 -- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2508133660 msgr2=0x7f2508070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2508133660 0x7f2508070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 -- 172.21.15.125:0/2712449445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f800b7f0 con 0x7f2508099eb0 2023-10-03T10:12:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250dd54700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250400c460 tx=0x7f250400c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040054e0 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400ce30 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040038c0 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2508135b40 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.352+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508118df0 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.353+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2504003a20 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.353+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f250403eeb0 con 0x7f2508099eb0 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.353+0000 7f250d553700 1 -- 172.21.15.125:0/2712449445 >> v1:172.21.15.125:6816/126957 conn(0x7f24ec02f510 legacy=0x7f24ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.353+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250811a670 con 0x7f2508099eb0 2023-10-03T10:12:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.358+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2504017070 con 0x7f2508099eb0 2023-10-03T10:12:26.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.389+0000 7f333925e700 1 Processor -- start 2023-10-03T10:12:26.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 -- start start 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f3334138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f333413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333406b2d0 con 0x7f3334133ad0 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33341345b0 con 0x7f3334136960 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333925e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3334133610 con 0x7f3334139280 2023-10-03T10:12:26.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f3332d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3334133ad0 0x7f3334133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33166/0 (socket says 172.21.15.125:33166) 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f3332d9d700 1 -- 172.21.15.125:0/308249119 learned_addr learned my addr 172.21.15.125:0/308249119 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333359e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f333413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.390+0000 7f333259c700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f3334138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f333359e700 1 -- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 msgr2=0x7f3334138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f3331d9b700 1 -- 172.21.15.125:0/308249119 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563958493 0 0) 0x7f333406b2d0 con 0x7f3334133ad0 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f333359e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f3334138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f333359e700 1 -- 172.21.15.125:0/308249119 >> v1:172.21.15.125:6789/0 conn(0x7f3334133ad0 legacy=0x7f3334133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f333359e700 1 -- 172.21.15.125:0/308249119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333409a500 con 0x7f3334139280 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f333359e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f333413b660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f332c009dc0 tx=0x7f332c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39a84ba9c99268a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f3331d9b700 1 -- 172.21.15.125:0/308249119 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c00e070 con 0x7f3334139280 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f3331d9b700 1 -- 172.21.15.125:0/308249119 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c00bb20 con 0x7f3334139280 2023-10-03T10:12:26.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.391+0000 7f3331d9b700 1 -- 172.21.15.125:0/308249119 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c012430 con 0x7f3334139280 2023-10-03T10:12:26.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 -- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 msgr2=0x7f333413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f333413b660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f332c009dc0 tx=0x7f332c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:26.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 -- 172.21.15.125:0/308249119 shutdown_connections 2023-10-03T10:12:26.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f333413b660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 --2- 172.21.15.125:0/308249119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f3334138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 -- 172.21.15.125:0/308249119 >> 172.21.15.125:0/308249119 conn(0x7f3334099c40 msgr2=0x7f33340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 -- 172.21.15.125:0/308249119 shutdown_connections 2023-10-03T10:12:26.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.392+0000 7f333925e700 1 -- 172.21.15.125:0/308249119 wait complete. 2023-10-03T10:12:26.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 Processor -- start 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 -- start start 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3334133ad0 0x7f33341ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f33341cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334130a80 con 0x7f3334133ad0 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33341317a0 con 0x7f3334136960 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333925e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f333409f390 con 0x7f3334139280 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43590/0 (socket says 172.21.15.125:43590) 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333359e700 1 -- 172.21.15.125:0/643935059 learned_addr learned my addr 172.21.15.125:0/643935059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:26.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.394+0000 7f333259c700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f33341cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f3332d9d700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3334133ad0 0x7f33341ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 -- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 msgr2=0x7f33341cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f33341cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 -- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3334133ad0 msgr2=0x7f33341ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3334133ad0 0x7f33341ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 -- 172.21.15.125:0/643935059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009a70 con 0x7f3334139280 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333359e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f332c014040 tx=0x7f332c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c012430 con 0x7f3334139280 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c020070 con 0x7f3334139280 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333406fe70 con 0x7f3334139280 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c004280 con 0x7f3334139280 2023-10-03T10:12:26.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.395+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3334070ba0 con 0x7f3334139280 2023-10-03T10:12:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.396+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f332c0043e0 con 0x7f3334139280 2023-10-03T10:12:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.396+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f332c022070 con 0x7f3334139280 2023-10-03T10:12:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.396+0000 7f3332d9d700 1 -- 172.21.15.125:0/643935059 >> v1:172.21.15.125:6816/126957 conn(0x7f332002f510 legacy=0x7f33200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.396+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333404f2a0 con 0x7f3334139280 2023-10-03T10:12:26.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.401+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f332c046060 con 0x7f3334139280 2023-10-03T10:12:26.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.506+0000 7fc49259c700 1 -- 172.21.15.125:0/3234103318 >> v1:172.21.15.125:6816/126957 conn(0x7fc47402f510 legacy=0x7fc4740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.542+0000 7f8255d9b700 1 -- 172.21.15.125:0/2871945033 >> v1:172.21.15.125:6816/126957 conn(0x7f823802f510 legacy=0x7f82380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.554+0000 7f250d553700 1 -- 172.21.15.125:0/2712449445 >> v1:172.21.15.125:6816/126957 conn(0x7f24ec02f510 legacy=0x7f24ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.573+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f250804f2a0 con 0x7f2508099eb0 2023-10-03T10:12:26.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.574+0000 7f24fe7fc700 1 -- 172.21.15.125:0/2712449445 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2504019b40 con 0x7f2508099eb0 2023-10-03T10:12:26.574 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:26.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 >> v1:172.21.15.125:6816/126957 conn(0x7f24ec02f510 legacy=0x7f24ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 msgr2=0x7f25080700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250400c460 tx=0x7f250400c770 comp rx=0 tx=0).stop 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 shutdown_connections 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2508135f80 0x7f2508070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508099eb0 0x7f25080700e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 --2- 172.21.15.125:0/2712449445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2508133660 0x7f2508070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 >> 172.21.15.125:0/2712449445 conn(0x7f25080a2980 msgr2=0x7f25081324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 shutdown_connections 2023-10-03T10:12:26.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.577+0000 7f250ffb8700 1 -- 172.21.15.125:0/2712449445 wait complete. 2023-10-03T10:12:26.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.597+0000 7f3332d9d700 1 -- 172.21.15.125:0/643935059 >> v1:172.21.15.125:6816/126957 conn(0x7f332002f510 legacy=0x7f33200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.597+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f333409f0f0 con 0x7f3334139280 2023-10-03T10:12:26.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.597+0000 7f331b7fe700 1 -- 172.21.15.125:0/643935059 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f332c004690 con 0x7f3334139280 2023-10-03T10:12:26.598 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:26.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc49406c3b0 con 0x7fc494130ce0 2023-10-03T10:12:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 >> v1:172.21.15.125:6816/126957 conn(0x7f332002f510 legacy=0x7f33200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 msgr2=0x7f33341cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f332c014040 tx=0x7f332c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 shutdown_connections 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3334139280 0x7f33341cd650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3334133ad0 0x7f33341ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 --2- 172.21.15.125:0/643935059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3334136960 0x7f33341cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 >> 172.21.15.125:0/643935059 conn(0x7f3334099c40 msgr2=0x7f3334132890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 shutdown_connections 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.599+0000 7f333925e700 1 -- 172.21.15.125:0/643935059 wait complete. 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.600+0000 7fc482ffd700 1 -- 172.21.15.125:0/3234103318 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc48c017070 con 0x7fc494130ce0 2023-10-03T10:12:26.601 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 >> v1:172.21.15.125:6816/126957 conn(0x7fc47402f510 legacy=0x7fc4740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 msgr2=0x7fc4941c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cad0 tx=0x7fc48c00cde0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 shutdown_connections 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc494130ce0 0x7fc4941c8ca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc49409d860 0x7fc4941c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 --2- 172.21.15.125:0/3234103318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc49409e170 0x7fc4941c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 >> 172.21.15.125:0/3234103318 conn(0x7fc494099c40 msgr2=0x7fc49413b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 shutdown_connections 2023-10-03T10:12:26.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.602+0000 7fc498a38700 1 -- 172.21.15.125:0/3234103318 wait complete. 2023-10-03T10:12:26.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:26.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.627+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f825811be60 con 0x7f825809e870 2023-10-03T10:12:26.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.627+0000 7f8246ffd700 1 -- 172.21.15.125:0/2871945033 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f824801a420 con 0x7f825809e870 2023-10-03T10:12:26.628 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:26.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.629+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 >> v1:172.21.15.125:6816/126957 conn(0x7f823802f510 legacy=0x7f82380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:26.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.629+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 msgr2=0x7f825811f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.629+0000 7f825cf83700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 0x7f825811f260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f825809afc0 tx=0x7f8248004750 comp rx=0 tx=0).stop 2023-10-03T10:12:26.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 shutdown_connections 2023-10-03T10:12:26.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8258131d70 0x7f825811fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f825809e870 0x7f825811f260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 --2- 172.21.15.125:0/2871945033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f825809f180 0x7f825811f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 >> 172.21.15.125:0/2871945033 conn(0x7f82580a4430 msgr2=0x7f82581310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 shutdown_connections 2023-10-03T10:12:26.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:26.630+0000 7f825cf83700 1 -- 172.21.15.125:0/2871945033 wait complete. 2023-10-03T10:12:26.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:27.591 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:27.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:27.616 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:27.643 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:27.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.735+0000 7ff5fbb0d700 1 Processor -- start 2023-10-03T10:12:27.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.735+0000 7ff5fbb0d700 1 -- start start 2023-10-03T10:12:27.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f4133b80 0x7ff5f4133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 0x7ff5f40a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f409aa00 con 0x7ff5f4133b80 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f409a080 con 0x7ff5f40a0e20 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fbb0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4133750 con 0x7ff5f4099a60 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fa0aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fa0aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59456/0 (socket says 172.21.15.125:59456) 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fa0aa700 1 -- 172.21.15.125:0/2021280026 learned_addr learned my addr 172.21.15.125:0/2021280026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 --2- 172.21.15.125:0/2021280026 >> v2:172.21.15.125:3300/0 conn(0x7ff5f4133b80 0x7ff5f4133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f90a8700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 0x7ff5f40a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 -- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 msgr2=0x7ff5f40a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 0x7ff5f40a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 -- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 msgr2=0x7ff5f40a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 -- 172.21.15.125:0/2021280026 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f409a760 con 0x7ff5f4133b80 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f90a8700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 0x7ff5f40a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5fa0aa700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.736+0000 7ff5f98a9700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f4133b80 0x7ff5f4133f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009820 tx=0x7ff5f0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e0b74064bb544a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.737+0000 7ff5f88a7700 1 -- 172.21.15.125:0/2021280026 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005e30 con 0x7ff5f4133b80 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.737+0000 7ff5f88a7700 1 -- 172.21.15.125:0/2021280026 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0006030 con 0x7ff5f4133b80 2023-10-03T10:12:27.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.737+0000 7ff5f88a7700 1 -- 172.21.15.125:0/2021280026 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00063c0 con 0x7ff5f4133b80 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.737+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f4133b80 msgr2=0x7ff5f4133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.737+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f4133b80 0x7ff5f4133f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009820 tx=0x7ff5f0009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/2021280026 shutdown_connections 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f40a0e20 0x7ff5f40a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f4133b80 0x7ff5f4133f50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/2021280026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4099a60 0x7ff5f40a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/2021280026 >> 172.21.15.125:0/2021280026 conn(0x7ff5f40a2980 msgr2=0x7ff5f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/2021280026 shutdown_connections 2023-10-03T10:12:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.738+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/2021280026 wait complete. 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.739+0000 7ff5fbb0d700 1 Processor -- start 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.739+0000 7ff5fbb0d700 1 -- start start 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f4099a60 0x7ff5f411a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f40a0e20 0x7ff5f411ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f411e0e0 con 0x7ff5f40a0e20 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f409a2c0 con 0x7ff5f4099a60 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fbb0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f411c400 con 0x7ff5f4133b80 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43612/0 (socket says 172.21.15.125:43612) 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 -- 172.21.15.125:0/3728164580 learned_addr learned my addr 172.21.15.125:0/3728164580 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5f98a9700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f4099a60 0x7ff5f411a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5f90a8700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f40a0e20 0x7ff5f411ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 -- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f4099a60 msgr2=0x7ff5f411a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f4099a60 0x7ff5f411a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 -- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f40a0e20 msgr2=0x7ff5f411ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f40a0e20 0x7ff5f411ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.740+0000 7ff5fa0aa700 1 -- 172.21.15.125:0/3728164580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009b30 con 0x7ff5f4133b80 2023-10-03T10:12:27.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5fa0aa700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009f10 tx=0x7ff5ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec018070 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec00f040 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0009430 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec003c40 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.741+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f4130b10 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.742+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff5ec00c940 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.742+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff5ec03fd50 con 0x7ff5f4133b80 2023-10-03T10:12:27.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.742+0000 7ff5f98a9700 1 -- 172.21.15.125:0/3728164580 >> v1:172.21.15.125:6816/126957 conn(0x7ff5d802f510 legacy=0x7ff5d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.742+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f409e9b0 con 0x7ff5f4133b80 2023-10-03T10:12:27.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.747+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5ec012340 con 0x7ff5f4133b80 2023-10-03T10:12:27.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.773+0000 7fbc504fc700 1 Processor -- start 2023-10-03T10:12:27.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.773+0000 7fbc504fc700 1 -- start start 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc504fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc481388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc504fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc4813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc504fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4809aa00 con 0x7fbc48133b80 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc504fc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4809a080 con 0x7fbc48099a60 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc504fc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48133750 con 0x7fbc48138e30 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4da97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc481388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4da97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc481388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59480/0 (socket says 172.21.15.125:59480) 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4da97700 1 -- 172.21.15.125:0/2444224725 learned_addr learned my addr 172.21.15.125:0/2444224725 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc4813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 msgr2=0x7fbc481388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc481388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2444224725 >> v1:172.21.15.125:6789/0 conn(0x7fbc48133b80 legacy=0x7fbc48133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4d296700 1 -- 172.21.15.125:0/2444224725 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591621395 0 0) 0x7fbc4809aa00 con 0x7fbc48133b80 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2444224725 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4809a760 con 0x7fbc48138e30 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.774+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc4813b210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009dc0 tx=0x7fbc4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567284fd9729cac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc4d296700 1 -- 172.21.15.125:0/2444224725 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000e070 con 0x7fbc48138e30 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc4d296700 1 -- 172.21.15.125:0/2444224725 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000bac0 con 0x7fbc48138e30 2023-10-03T10:12:27.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc4d296700 1 -- 172.21.15.125:0/2444224725 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000be70 con 0x7fbc48138e30 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 -- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 msgr2=0x7fbc4813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc4813b210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009dc0 tx=0x7fbc4000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 -- 172.21.15.125:0/2444224725 shutdown_connections 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc4813b210 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2444224725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc481388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 -- 172.21.15.125:0/2444224725 >> 172.21.15.125:0/2444224725 conn(0x7fbc480a2980 msgr2=0x7fbc480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.775+0000 7fbc504fc700 1 -- 172.21.15.125:0/2444224725 shutdown_connections 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.776+0000 7fbc504fc700 1 -- 172.21.15.125:0/2444224725 wait complete. 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.776+0000 7fbc504fc700 1 Processor -- start 2023-10-03T10:12:27.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.776+0000 7fbc504fc700 1 -- start start 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc48118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 0x7fbc48119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4811ada0 con 0x7fbc48133b80 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4811c690 con 0x7fbc48099a60 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc504fc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4809a2c0 con 0x7fbc48138e30 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc4ea99700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc4ea99700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43636/0 (socket says 172.21.15.125:43636) 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2780214503 learned_addr learned my addr 172.21.15.125:0/2780214503 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.777+0000 7fbc4da97700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 0x7fbc48119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 msgr2=0x7fbc48118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc48118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 msgr2=0x7fbc48119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 0x7fbc48119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 -- 172.21.15.125:0/2780214503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009a70 con 0x7fbc48138e30 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4da97700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 0x7fbc48119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc4ea99700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbc40013000 tx=0x7fbc40004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40004610 con 0x7fbc48138e30 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40020070 con 0x7fbc48138e30 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc480a2490 con 0x7fbc48138e30 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40027480 con 0x7fbc48138e30 2023-10-03T10:12:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.778+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4811be20 con 0x7fbc48138e30 2023-10-03T10:12:27.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.780+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbc40012430 con 0x7fbc48138e30 2023-10-03T10:12:27.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.780+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbc40022070 con 0x7fbc48138e30 2023-10-03T10:12:27.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.780+0000 7fbc4e298700 1 -- 172.21.15.125:0/2780214503 >> v1:172.21.15.125:6816/126957 conn(0x7fbc2c02f510 legacy=0x7fbc2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.781+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4804f2a0 con 0x7fbc48138e30 2023-10-03T10:12:27.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.782+0000 7fea7c1d3700 1 Processor -- start 2023-10-03T10:12:27.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.782+0000 7fea7c1d3700 1 -- start start 2023-10-03T10:12:27.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7c1d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 0x7fea74138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7c1d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7413b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7c1d3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7409fd90 con 0x7fea7412d210 2023-10-03T10:12:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7c1d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7409f980 con 0x7fea74139090 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7c1d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7406f520 con 0x7fea74136770 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea79f6f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fea7412d210 0x7fea7412d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33192/0 (socket says 172.21.15.125:33192) 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea79f6f700 1 -- 172.21.15.125:0/3486902916 learned_addr learned my addr 172.21.15.125:0/3486902916 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7976e700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 0x7fea74138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.783+0000 7fea7a770700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7976e700 1 -- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 msgr2=0x7fea7413b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7976e700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7413b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7976e700 1 -- 172.21.15.125:0/3486902916 >> v1:172.21.15.125:6789/0 conn(0x7fea7412d210 legacy=0x7fea7412d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7976e700 1 -- 172.21.15.125:0/3486902916 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7406fbe0 con 0x7fea74136770 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea78f6d700 1 -- 172.21.15.125:0/3486902916 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544296801 0 0) 0x7fea7409fd90 con 0x7fea7412d210 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7a770700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.784+0000 7fea7976e700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 0x7fea74138b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea64009870 tx=0x7fea64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bb75e761895790 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.786+0000 7fea78f6d700 1 -- 172.21.15.125:0/3486902916 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64011830 con 0x7fea74136770 2023-10-03T10:12:27.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea78f6d700 1 -- 172.21.15.125:0/3486902916 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64011990 con 0x7fea74136770 2023-10-03T10:12:27.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea78f6d700 1 -- 172.21.15.125:0/3486902916 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64011d20 con 0x7fea74136770 2023-10-03T10:12:27.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc40011750 con 0x7fbc48138e30 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea7c1d3700 1 -- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 msgr2=0x7fea74138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 0x7fea74138b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea64009870 tx=0x7fea64009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea7c1d3700 1 -- 172.21.15.125:0/3486902916 shutdown_connections 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.787+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/3486902916 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea74136770 0x7fea74138b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.788+0000 7fea7c1d3700 1 -- 172.21.15.125:0/3486902916 >> 172.21.15.125:0/3486902916 conn(0x7fea740a2810 msgr2=0x7fea740a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.788+0000 7fea7c1d3700 1 -- 172.21.15.125:0/3486902916 shutdown_connections 2023-10-03T10:12:27.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.788+0000 7fea7c1d3700 1 -- 172.21.15.125:0/3486902916 wait complete. 2023-10-03T10:12:27.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.789+0000 7fea7c1d3700 1 Processor -- start 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.789+0000 7fea7c1d3700 1 -- start start 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea7412d210 0x7fea7409a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7409c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7409b1a0 con 0x7fea74136770 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea74136200 con 0x7fea74139090 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7c1d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7406f760 con 0x7fea7412d210 2023-10-03T10:12:27.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52484/0 (socket says 172.21.15.125:52484) 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 -- 172.21.15.125:0/1708903580 learned_addr learned my addr 172.21.15.125:0/1708903580 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea79f6f700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea7412d210 0x7fea7409a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7a770700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7409c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 -- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea7412d210 msgr2=0x7fea7409a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea7412d210 0x7fea7409a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 -- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 msgr2=0x7fea7409c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7409c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.790+0000 7fea7976e700 1 -- 172.21.15.125:0/1708903580 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009a70 con 0x7fea74136770 2023-10-03T10:12:27.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea7976e700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea64000c00 tx=0x7fea64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64004590 con 0x7fea74136770 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6401f070 con 0x7fea74136770 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640038e0 con 0x7fea74136770 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea640094a0 con 0x7fea74136770 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.791+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7409bed0 con 0x7fea74136770 2023-10-03T10:12:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.792+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea64003a40 con 0x7fea74136770 2023-10-03T10:12:27.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.792+0000 7fea79f6f700 1 -- 172.21.15.125:0/1708903580 >> v1:172.21.15.125:6816/126957 conn(0x7fea5802f560 legacy=0x7fea58031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.792+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fea64021070 con 0x7fea74136770 2023-10-03T10:12:27.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.792+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7404f2a0 con 0x7fea74136770 2023-10-03T10:12:27.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.797+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea64003cf0 con 0x7fea74136770 2023-10-03T10:12:27.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.831+0000 7f298a9bb700 1 Processor -- start 2023-10-03T10:12:27.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.831+0000 7f298a9bb700 1 -- start start 2023-10-03T10:12:27.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f298409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 0x7f29841307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 0x7f2984131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298409aaa0 con 0x7f298409e170 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298409f870 con 0x7f298409d860 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f298a9bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f298409b360 con 0x7f2984130ce0 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2983fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f298409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2983fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f298409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59520/0 (socket says 172.21.15.125:59520) 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2983fff700 1 -- 172.21.15.125:0/1571357610 learned_addr learned my addr 172.21.15.125:0/1571357610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f29837fe700 1 --2- 172.21.15.125:0/1571357610 >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 0x7f29841307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 0x7f2984131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 -- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 msgr2=0x7f298409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f298409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 -- 172.21.15.125:0/1571357610 >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 msgr2=0x7f29841307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 --2- 172.21.15.125:0/1571357610 >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 0x7f29841307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.832+0000 7f2988f58700 1 -- 172.21.15.125:0/1571357610 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298409b620 con 0x7f2984130ce0 2023-10-03T10:12:27.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.833+0000 7f29837fe700 1 --2- 172.21.15.125:0/1571357610 >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 0x7f29841307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.833+0000 7f2988f58700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 0x7f2984131180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f297c009dc0 tx=0x7f297c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140df2ceef48730f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.833+0000 7f2982ffd700 1 -- 172.21.15.125:0/1571357610 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00e070 con 0x7f2984130ce0 2023-10-03T10:12:27.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.833+0000 7f2982ffd700 1 -- 172.21.15.125:0/1571357610 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00bae0 con 0x7f2984130ce0 2023-10-03T10:12:27.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.833+0000 7f2982ffd700 1 -- 172.21.15.125:0/1571357610 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00be90 con 0x7f2984130ce0 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 -- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 msgr2=0x7f2984131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 0x7f2984131180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f297c009dc0 tx=0x7f297c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 -- 172.21.15.125:0/1571357610 shutdown_connections 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f298409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 --2- 172.21.15.125:0/1571357610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2984130ce0 0x7f2984131180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 --2- 172.21.15.125:0/1571357610 >> v2:172.21.15.125:3300/0 conn(0x7f298409e170 0x7f29841307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 -- 172.21.15.125:0/1571357610 >> 172.21.15.125:0/1571357610 conn(0x7f2984099c40 msgr2=0x7f29840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 -- 172.21.15.125:0/1571357610 shutdown_connections 2023-10-03T10:12:27.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.834+0000 7f298a9bb700 1 -- 172.21.15.125:0/1571357610 wait complete. 2023-10-03T10:12:27.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.835+0000 7f298a9bb700 1 Processor -- start 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 -- start start 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f29841363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 0x7f2984136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 0x7f2984136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841380b0 con 0x7f2984130ce0 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2984139e10 con 0x7f298409d860 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f298a9bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29840a0350 con 0x7f298409e170 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f29837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 0x7f2984136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f29837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 0x7f2984136920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43668/0 (socket says 172.21.15.125:43668) 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f29837fe700 1 -- 172.21.15.125:0/3022685223 learned_addr learned my addr 172.21.15.125:0/3022685223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f2988f58700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 0x7f2984136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.836+0000 7f2983fff700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f29841363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 -- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 msgr2=0x7f2984136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 0x7f2984136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 -- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 msgr2=0x7f29841363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f29841363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 -- 172.21.15.125:0/3022685223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780094a0 con 0x7f2984130ce0 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2983fff700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f29841363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2988f58700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 0x7f2984136e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f297c016000 tx=0x7f297c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0045d0 con 0x7f2984130ce0 2023-10-03T10:12:27.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c020070 con 0x7f2984130ce0 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c027480 con 0x7f2984130ce0 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c009a70 con 0x7f2984130ce0 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.837+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984138790 con 0x7f2984130ce0 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.838+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f297c0275e0 con 0x7f2984130ce0 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.838+0000 7f2983fff700 1 -- 172.21.15.125:0/3022685223 >> v1:172.21.15.125:6816/126957 conn(0x7f297002f510 legacy=0x7f29700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.839+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29841389e0 con 0x7f2984130ce0 2023-10-03T10:12:27.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.839+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f297c022070 con 0x7f2984130ce0 2023-10-03T10:12:27.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.843+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f297c046060 con 0x7f2984130ce0 2023-10-03T10:12:27.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.943+0000 7ff5f98a9700 1 -- 172.21.15.125:0/3728164580 >> v1:172.21.15.125:6816/126957 conn(0x7ff5d802f510 legacy=0x7ff5d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.956+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5f404f2a0 con 0x7ff5f4133b80 2023-10-03T10:12:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.956+0000 7ff5ea7fc700 1 -- 172.21.15.125:0/3728164580 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5ec01de00 con 0x7ff5f4133b80 2023-10-03T10:12:27.957 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 >> v1:172.21.15.125:6816/126957 conn(0x7ff5d802f510 legacy=0x7ff5d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 msgr2=0x7ff5f411b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009f10 tx=0x7ff5ec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 shutdown_connections 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f4133b80 0x7ff5f411b2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f4099a60 0x7ff5f411a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 --2- 172.21.15.125:0/3728164580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f40a0e20 0x7ff5f411ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 >> 172.21.15.125:0/3728164580 conn(0x7ff5f40a2980 msgr2=0x7ff5f412f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 shutdown_connections 2023-10-03T10:12:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.959+0000 7ff5fbb0d700 1 -- 172.21.15.125:0/3728164580 wait complete. 2023-10-03T10:12:27.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.981+0000 7fbc4e298700 1 -- 172.21.15.125:0/2780214503 >> v1:172.21.15.125:6816/126957 conn(0x7fbc2c02f510 legacy=0x7fbc2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.989+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc48132700 con 0x7fbc48138e30 2023-10-03T10:12:27.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.989+0000 7fbc3effd700 1 -- 172.21.15.125:0/2780214503 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc400303e0 con 0x7fbc48138e30 2023-10-03T10:12:27.990 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.992+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 >> v1:172.21.15.125:6816/126957 conn(0x7fbc2c02f510 legacy=0x7fbc2c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.992+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 msgr2=0x7fbc48119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.992+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbc40013000 tx=0x7fbc40004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.992+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 shutdown_connections 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc48138e30 0x7fbc48119870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc48099a60 0x7fbc48118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 --2- 172.21.15.125:0/2780214503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc48133b80 0x7fbc48119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 >> 172.21.15.125:0/2780214503 conn(0x7fbc480a2980 msgr2=0x7fbc48139740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fea79f6f700 1 -- 172.21.15.125:0/1708903580 >> v1:172.21.15.125:6816/126957 conn(0x7fea5802f560 legacy=0x7fea58031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 shutdown_connections 2023-10-03T10:12:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:27.993+0000 7fbc504fc700 1 -- 172.21.15.125:0/2780214503 wait complete. 2023-10-03T10:12:28.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.037+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea74072170 con 0x7fea74136770 2023-10-03T10:12:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.037+0000 7fea6a7fc700 1 -- 172.21.15.125:0/1708903580 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea640410c0 con 0x7fea74136770 2023-10-03T10:12:28.038 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 >> v1:172.21.15.125:6816/126957 conn(0x7fea5802f560 legacy=0x7fea58031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 msgr2=0x7fea7409c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea64000c00 tx=0x7fea64004750 comp rx=0 tx=0).stop 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 shutdown_connections 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea74139090 0x7fea7409c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea7412d210 0x7fea7409a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 --2- 172.21.15.125:0/1708903580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea74136770 0x7fea7409c320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 >> 172.21.15.125:0/1708903580 conn(0x7fea740a2810 msgr2=0x7fea74070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 shutdown_connections 2023-10-03T10:12:28.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.039+0000 7fea7c1d3700 1 -- 172.21.15.125:0/1708903580 wait complete. 2023-10-03T10:12:28.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.040+0000 7f2983fff700 1 -- 172.21.15.125:0/3022685223 >> v1:172.21.15.125:6816/126957 conn(0x7f297002f510 legacy=0x7f29700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:28.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:28.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.073+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f298404f2a0 con 0x7f2984130ce0 2023-10-03T10:12:28.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.073+0000 7f2980ff9700 1 -- 172.21.15.125:0/3022685223 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f297c02c030 con 0x7f2984130ce0 2023-10-03T10:12:28.073 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:28.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 >> v1:172.21.15.125:6816/126957 conn(0x7f297002f510 legacy=0x7f29700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 msgr2=0x7f2984136e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 0x7f2984136e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f297c016000 tx=0x7f297c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 shutdown_connections 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2984130ce0 0x7f2984136e60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f298409d860 0x7f29841363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 --2- 172.21.15.125:0/3022685223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f298409e170 0x7f2984136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 >> 172.21.15.125:0/3022685223 conn(0x7f2984099c40 msgr2=0x7f29840a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 shutdown_connections 2023-10-03T10:12:28.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:28.075+0000 7f298a9bb700 1 -- 172.21.15.125:0/3022685223 wait complete. 2023-10-03T10:12:28.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:28.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:29.011 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:29.053 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:29.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:29.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 Processor -- start 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 -- start start 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 0x7fbcb409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb409aaa0 con 0x7fbcb4130ce0 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb409f870 con 0x7fbcb409e170 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcbb18e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb409b360 con 0x7fbcb409d860 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52518/0 (socket says 172.21.15.125:52518) 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcb3fff700 1 -- 172.21.15.125:0/384936193 learned_addr learned my addr 172.21.15.125:0/384936193 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.127+0000 7fbcb8f2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 0x7fbcb409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/384936193 >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 msgr2=0x7fbcb41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/384936193 >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/384936193 >> v1:172.21.15.125:6789/0 conn(0x7fbcb4130ce0 legacy=0x7fbcb41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/384936193 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb409b620 con 0x7fbcb409d860 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb3fff700 1 --2- 172.21.15.125:0/384936193 >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/384936193 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 0x7fbcb409dc30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbca800bd90 tx=0x7fbca800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=135b7e58ea1a663c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb37fe700 1 -- 172.21.15.125:0/384936193 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8010070 con 0x7fbcb409d860 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb37fe700 1 -- 172.21.15.125:0/384936193 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8005c30 con 0x7fbcb409d860 2023-10-03T10:12:29.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.128+0000 7fbcb37fe700 1 -- 172.21.15.125:0/384936193 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800d910 con 0x7fbcb409d860 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 -- 172.21.15.125:0/384936193 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 msgr2=0x7fbcb409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/384936193 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 0x7fbcb409dc30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbca800bd90 tx=0x7fbca800d330 comp rx=0 tx=0).stop 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 -- 172.21.15.125:0/384936193 shutdown_connections 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/384936193 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409d860 0x7fbcb409dc30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/384936193 >> v2:172.21.15.125:3300/0 conn(0x7fbcb409e170 0x7fbcb41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 -- 172.21.15.125:0/384936193 >> 172.21.15.125:0/384936193 conn(0x7fbcb4099c40 msgr2=0x7fbcb40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 -- 172.21.15.125:0/384936193 shutdown_connections 2023-10-03T10:12:29.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.129+0000 7fbcbb18e700 1 -- 172.21.15.125:0/384936193 wait complete. 2023-10-03T10:12:29.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.130+0000 7fbcbb18e700 1 Processor -- start 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.130+0000 7fbcbb18e700 1 -- start start 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 0x7fbcb411e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 0x7fbcb411ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcb4130ce0 0x7fbcb411efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4122070 con 0x7fbcb409d860 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb409c8b0 con 0x7fbcb4130ce0 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcbb18e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41209c0 con 0x7fbcb409e170 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 0x7fbcb411ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 0x7fbcb411ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43696/0 (socket says 172.21.15.125:43696) 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb3fff700 1 -- 172.21.15.125:0/769374425 learned_addr learned my addr 172.21.15.125:0/769374425 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 0x7fbcb411e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb972b700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcb4130ce0 0x7fbcb411efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 msgr2=0x7fbcb411ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 0x7fbcb411ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcb4130ce0 msgr2=0x7fbcb411efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcb4130ce0 0x7fbcb411efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 -- 172.21.15.125:0/769374425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009550 con 0x7fbcb409d860 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.131+0000 7fbcb8f2a700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 0x7fbcb411e550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbca8015000 tx=0x7fbca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.132+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800d910 con 0x7fbcb409d860 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.132+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8004290 con 0x7fbcb409d860 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.132+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca800ba70 con 0x7fbcb409d860 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.132+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8008500 con 0x7fbcb409d860 2023-10-03T10:12:29.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.132+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb4072130 con 0x7fbcb409d860 2023-10-03T10:12:29.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.133+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbca8008660 con 0x7fbcb409d860 2023-10-03T10:12:29.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.133+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbca8041360 con 0x7fbcb409d860 2023-10-03T10:12:29.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.133+0000 7fbcb3fff700 1 -- 172.21.15.125:0/769374425 >> v1:172.21.15.125:6816/126957 conn(0x7fbc9802f510 legacy=0x7fbc980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.133+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb404f2a0 con 0x7fbcb409d860 2023-10-03T10:12:29.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.142+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbca80143c0 con 0x7fbcb409d860 2023-10-03T10:12:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 Processor -- start 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 -- start start 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a48138040 0x7f5a48138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a480a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a481379e0 con 0x7f5a480a1230 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480a2100 con 0x7f5a48138040 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4e7b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48138950 con 0x7f5a480a08e0 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4cd51700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5a480a1230 0x7f5a4813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33210/0 (socket says 172.21.15.125:33210) 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a4cd51700 1 -- 172.21.15.125:0/1131260226 learned_addr learned my addr 172.21.15.125:0/1131260226 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a477fe700 1 --2- 172.21.15.125:0/1131260226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a480a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.165+0000 7f5a47fff700 1 --2- 172.21.15.125:0/1131260226 >> v2:172.21.15.125:3300/0 conn(0x7f5a48138040 0x7f5a48138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a477fe700 1 -- 172.21.15.125:0/1131260226 >> v2:172.21.15.125:3300/0 conn(0x7f5a48138040 msgr2=0x7f5a48138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a477fe700 1 --2- 172.21.15.125:0/1131260226 >> v2:172.21.15.125:3300/0 conn(0x7f5a48138040 0x7f5a48138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a477fe700 1 -- 172.21.15.125:0/1131260226 >> v1:172.21.15.125:6789/0 conn(0x7f5a480a1230 legacy=0x7f5a4813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a477fe700 1 -- 172.21.15.125:0/1131260226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4809b9b0 con 0x7f5a480a08e0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a477fe700 1 --2- 172.21.15.125:0/1131260226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a480a0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009870 tx=0x7f5a3c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f486d2062c7594b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a46ffd700 1 -- 172.21.15.125:0/1131260226 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c011830 con 0x7f5a480a08e0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a46ffd700 1 -- 172.21.15.125:0/1131260226 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c011990 con 0x7f5a480a08e0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.166+0000 7f5a46ffd700 1 -- 172.21.15.125:0/1131260226 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c011d20 con 0x7f5a480a08e0 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/1131260226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 msgr2=0x7f5a480a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/1131260226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a480a0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009870 tx=0x7f5a3c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/1131260226 shutdown_connections 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/1131260226 >> v2:172.21.15.125:3300/0 conn(0x7f5a48138040 0x7f5a48138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/1131260226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a480a0cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/1131260226 >> 172.21.15.125:0/1131260226 conn(0x7f5a480a2980 msgr2=0x7f5a480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/1131260226 shutdown_connections 2023-10-03T10:12:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.167+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/1131260226 wait complete. 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.168+0000 7f5a4e7b4700 1 Processor -- start 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.168+0000 7f5a4e7b4700 1 -- start start 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a48136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 0x7f5a48135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48137840 con 0x7f5a480a1230 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4812ff90 con 0x7f5a48138040 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4e7b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481192c0 con 0x7f5a480a08e0 2023-10-03T10:12:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52532/0 (socket says 172.21.15.125:52532) 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 -- 172.21.15.125:0/2666095715 learned_addr learned my addr 172.21.15.125:0/2666095715 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a4cd51700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 0x7f5a48135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 -- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 msgr2=0x7f5a48136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a48136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 -- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 msgr2=0x7f5a48135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 0x7f5a48135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.169+0000 7f5a477fe700 1 -- 172.21.15.125:0/2666095715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0094a0 con 0x7f5a480a1230 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a4cd51700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 0x7f5a48135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a477fe700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c014040 tx=0x7f5a3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0036a0 con 0x7f5a480a1230 2023-10-03T10:12:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c01e070 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4809a240 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c003a20 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.170+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a481404e0 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.171+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4804f2a0 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.171+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5a3c003b80 con 0x7f5a480a1230 2023-10-03T10:12:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.172+0000 7f5a47fff700 1 -- 172.21.15.125:0/2666095715 >> v1:172.21.15.125:6816/126957 conn(0x7f5a3402f510 legacy=0x7f5a340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.172+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5a3c020070 con 0x7f5a480a1230 2023-10-03T10:12:29.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.180+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a3c046060 con 0x7f5a480a1230 2023-10-03T10:12:29.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.215+0000 7f72d5997700 1 Processor -- start 2023-10-03T10:12:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.215+0000 7f72d5997700 1 -- start start 2023-10-03T10:12:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.216+0000 7f72d5997700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 0x7f72d0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.216+0000 7f72d5997700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72d009c790 0x7f72d0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.216+0000 7f72d5997700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d00a1640 con 0x7f72d009bc70 2023-10-03T10:12:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.216+0000 7f72d5997700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d006eb30 con 0x7f72d009c790 2023-10-03T10:12:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.216+0000 7f72d5997700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72d00a22d0 con 0x7f72d0131980 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72ceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 0x7f72d0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72ceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 0x7f72d0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43722/0 (socket says 172.21.15.125:43722) 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72ceffd700 1 -- 172.21.15.125:0/1615804547 learned_addr learned my addr 172.21.15.125:0/1615804547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 --2- 172.21.15.125:0/1615804547 >> v2:172.21.15.125:3300/0 conn(0x7f72d009c790 0x7f72d0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cdffb700 1 -- 172.21.15.125:0/1615804547 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485326622 0 0) 0x7f72d00a1640 con 0x7f72d009bc70 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cdffb700 1 -- 172.21.15.125:0/1615804547 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b80035b0 con 0x7f72d009bc70 2023-10-03T10:12:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 -- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 msgr2=0x7f72d0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 --2- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 0x7f72d0131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 -- 172.21.15.125:0/1615804547 >> v1:172.21.15.125:6789/0 conn(0x7f72d009bc70 legacy=0x7f72d009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 -- 172.21.15.125:0/1615804547 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0131550 con 0x7f72d009c790 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.217+0000 7f72cf7fe700 1 --2- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d009c790 0x7f72d0139710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009d90 tx=0x7f72c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45c991be52110d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.218+0000 7f72cdffb700 1 -- 172.21.15.125:0/1615804547 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c800e070 con 0x7f72d009c790 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.218+0000 7f72cdffb700 1 -- 172.21.15.125:0/1615804547 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c800bb20 con 0x7f72d009c790 2023-10-03T10:12:29.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.218+0000 7f72cdffb700 1 -- 172.21.15.125:0/1615804547 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8012430 con 0x7f72d009c790 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 -- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d009c790 msgr2=0x7f72d0139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 --2- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d009c790 0x7f72d0139710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009d90 tx=0x7f72c800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 -- 172.21.15.125:0/1615804547 shutdown_connections 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 --2- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d009c790 0x7f72d0139710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 --2- 172.21.15.125:0/1615804547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d0131980 0x7f72d0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 -- 172.21.15.125:0/1615804547 >> 172.21.15.125:0/1615804547 conn(0x7f72d00a2980 msgr2=0x7f72d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 -- 172.21.15.125:0/1615804547 shutdown_connections 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.219+0000 7f72d5997700 1 -- 172.21.15.125:0/1615804547 wait complete. 2023-10-03T10:12:29.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 Processor -- start 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 -- start start 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 0x7f72d011d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 0x7f72d011e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d01202b0 con 0x7f72d0131980 2023-10-03T10:12:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d01212f0 con 0x7f72d009c790 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72d5997700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0120de0 con 0x7f72d009bc70 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72ce7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72ce7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59564/0 (socket says 172.21.15.125:59564) 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.220+0000 7f72ce7fc700 1 -- 172.21.15.125:0/61152114 learned_addr learned my addr 172.21.15.125:0/61152114 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ceffd700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 0x7f72d011d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72cf7fe700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 0x7f72d011e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 -- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 msgr2=0x7f72d011d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 0x7f72d011d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 -- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 msgr2=0x7f72d011e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 0x7f72d011e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 -- 172.21.15.125:0/61152114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8009a70 con 0x7f72d009c790 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ceffd700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 0x7f72d011d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72cf7fe700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 0x7f72d011e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72ce7fc700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c520 tx=0x7f72c400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40052d0 con 0x7f72d009c790 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4005430 con 0x7f72d009c790 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003880 con 0x7f72d009c790 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d011ed60 con 0x7f72d009c790 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.221+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d0120ae0 con 0x7f72d009c790 2023-10-03T10:12:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.222+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72c40039e0 con 0x7f72d009c790 2023-10-03T10:12:29.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.222+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d004f2a0 con 0x7f72d009c790 2023-10-03T10:12:29.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.223+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f72c403ee20 con 0x7f72d009c790 2023-10-03T10:12:29.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.223+0000 7f72ceffd700 1 -- 172.21.15.125:0/61152114 >> v1:172.21.15.125:6816/126957 conn(0x7f72bc02f510 legacy=0x7f72bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.230+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72c4003c90 con 0x7f72d009c790 2023-10-03T10:12:29.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.247+0000 7f9ea342a700 1 Processor -- start 2023-10-03T10:12:29.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.247+0000 7f9ea342a700 1 -- start start 2023-10-03T10:12:29.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea342a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 0x7f9e9c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea342a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea342a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c09b110 con 0x7f9e9c133f70 2023-10-03T10:12:29.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea342a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a3b60 con 0x7f9e9c09ad40 2023-10-03T10:12:29.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea342a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a2fa0 con 0x7f9e9c1343a0 2023-10-03T10:12:29.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea19c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea19c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43738/0 (socket says 172.21.15.125:43738) 2023-10-03T10:12:29.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea19c7700 1 -- 172.21.15.125:0/3664481596 learned_addr learned my addr 172.21.15.125:0/3664481596 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 0x7f9e9c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 msgr2=0x7f9e9c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3664481596 >> v1:172.21.15.125:6789/0 conn(0x7f9e9c133f70 legacy=0x7f9e9c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3664481596 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c09a280 con 0x7f9e9c09ad40 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.248+0000 7f9ea19c7700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 0x7f9e9c133a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009870 tx=0x7f9e98009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce07618d552a627 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9e93fff700 1 -- 172.21.15.125:0/3664481596 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98011830 con 0x7f9e9c09ad40 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9e93fff700 1 -- 172.21.15.125:0/3664481596 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98011990 con 0x7f9e9c09ad40 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9e93fff700 1 -- 172.21.15.125:0/3664481596 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98011d20 con 0x7f9e9c09ad40 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 -- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 msgr2=0x7f9e9c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 0x7f9e9c133a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009870 tx=0x7f9e98009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 -- 172.21.15.125:0/3664481596 shutdown_connections 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1343a0 0x7f9e9c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3664481596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09ad40 0x7f9e9c133a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.249+0000 7f9ea342a700 1 -- 172.21.15.125:0/3664481596 >> 172.21.15.125:0/3664481596 conn(0x7f9e9c099c40 msgr2=0x7f9e9c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.250+0000 7f9ea342a700 1 -- 172.21.15.125:0/3664481596 shutdown_connections 2023-10-03T10:12:29.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.250+0000 7f9ea342a700 1 -- 172.21.15.125:0/3664481596 wait complete. 2023-10-03T10:12:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.251+0000 7f9ea342a700 1 Processor -- start 2023-10-03T10:12:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.251+0000 7f9ea342a700 1 -- start start 2023-10-03T10:12:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c133f70 0x7f9e9c11e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1343a0 0x7f9e9c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1225d0 con 0x7f9e9c1343a0 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c11fd00 con 0x7f9e9c133f70 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea342a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c120320 con 0x7f9e9c09ad40 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43744/0 (socket says 172.21.15.125:43744) 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3410670395 learned_addr learned my addr 172.21.15.125:0/3410670395 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea19c7700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1343a0 0x7f9e9c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea09c5700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c133f70 0x7f9e9c11e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c133f70 msgr2=0x7f9e9c11e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c133f70 0x7f9e9c11e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1343a0 msgr2=0x7f9e9c11eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1343a0 0x7f9e9c11eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 -- 172.21.15.125:0/3410670395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009b30 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.252+0000 7f9ea11c6700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e980090b0 tx=0x7f9e98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.253+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98004450 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.253+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9801e070 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.253+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980038e0 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.253+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980094a0 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.253+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c09ec30 con 0x7f9e9c09ad40 2023-10-03T10:12:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.254+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9e98003a40 con 0x7f9e9c09ad40 2023-10-03T10:12:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.254+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9e98040aa0 con 0x7f9e9c09ad40 2023-10-03T10:12:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.254+0000 7f9ea09c5700 1 -- 172.21.15.125:0/3410670395 >> v1:172.21.15.125:6816/126957 conn(0x7f9e8002f560 legacy=0x7f9e80031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.254+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c0a58b0 con 0x7f9e9c09ad40 2023-10-03T10:12:29.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.259+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e98015070 con 0x7f9e9c09ad40 2023-10-03T10:12:29.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.334+0000 7fbcb3fff700 1 -- 172.21.15.125:0/769374425 >> v1:172.21.15.125:6816/126957 conn(0x7fbc9802f510 legacy=0x7fbc980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.347+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcb406c3b0 con 0x7fbcb409d860 2023-10-03T10:12:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.347+0000 7fbcb17fa700 1 -- 172.21.15.125:0/769374425 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbca8028bb0 con 0x7fbcb409d860 2023-10-03T10:12:29.347 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:29.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 >> v1:172.21.15.125:6816/126957 conn(0x7fbc9802f510 legacy=0x7fbc980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 msgr2=0x7fbcb411e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 0x7fbcb411e550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbca8015000 tx=0x7fbca8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 shutdown_connections 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcb4130ce0 0x7fbcb411efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcb409d860 0x7fbcb411e550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 --2- 172.21.15.125:0/769374425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcb409e170 0x7fbcb411ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 >> 172.21.15.125:0/769374425 conn(0x7fbcb4099c40 msgr2=0x7fbcb4070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 shutdown_connections 2023-10-03T10:12:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.349+0000 7fbcbb18e700 1 -- 172.21.15.125:0/769374425 wait complete. 2023-10-03T10:12:29.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:29.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.373+0000 7f5a47fff700 1 -- 172.21.15.125:0/2666095715 >> v1:172.21.15.125:6816/126957 conn(0x7f5a3402f510 legacy=0x7f5a340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.382+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5a48140d30 con 0x7f5a480a1230 2023-10-03T10:12:29.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.382+0000 7f5a44ff9700 1 -- 172.21.15.125:0/2666095715 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a3c046030 con 0x7f5a480a1230 2023-10-03T10:12:29.382 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 >> v1:172.21.15.125:6816/126957 conn(0x7f5a3402f510 legacy=0x7f5a340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 msgr2=0x7f5a48137300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c014040 tx=0x7f5a3c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 shutdown_connections 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a48138040 0x7f5a48135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a480a08e0 0x7f5a48136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 --2- 172.21.15.125:0/2666095715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a480a1230 0x7f5a48137300 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 >> 172.21.15.125:0/2666095715 conn(0x7f5a480a2980 msgr2=0x7f5a48071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 shutdown_connections 2023-10-03T10:12:29.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.384+0000 7f5a4e7b4700 1 -- 172.21.15.125:0/2666095715 wait complete. 2023-10-03T10:12:29.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.424+0000 7f72ceffd700 1 -- 172.21.15.125:0/61152114 >> v1:172.21.15.125:6816/126957 conn(0x7f72bc02f510 legacy=0x7f72bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.428+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72d0120ae0 con 0x7f72d009c790 2023-10-03T10:12:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.428+0000 7f72b7fff700 1 -- 172.21.15.125:0/61152114 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72d0120ae0 con 0x7f72d009c790 2023-10-03T10:12:29.428 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:29.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 >> v1:172.21.15.125:6816/126957 conn(0x7f72bc02f510 legacy=0x7f72bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 msgr2=0x7f72d011de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c520 tx=0x7f72c400c830 comp rx=0 tx=0).stop 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 shutdown_connections 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72d0131980 0x7f72d011e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72d009bc70 0x7f72d011d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 --2- 172.21.15.125:0/61152114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72d009c790 0x7f72d011de40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 >> 172.21.15.125:0/61152114 conn(0x7f72d00a2980 msgr2=0x7f72d006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 shutdown_connections 2023-10-03T10:12:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.430+0000 7f72d5997700 1 -- 172.21.15.125:0/61152114 wait complete. 2023-10-03T10:12:29.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.455+0000 7f9ea09c5700 1 -- 172.21.15.125:0/3410670395 >> v1:172.21.15.125:6816/126957 conn(0x7f9e8002f560 legacy=0x7f9e80031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.125:6816/126957 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.456+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9e9c09c7e0 con 0x7f9e9c09ad40 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.456+0000 7f9e91ffb700 1 -- 172.21.15.125:0/3410670395 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e9801a420 con 0x7f9e9c09ad40 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 >> v1:172.21.15.125:6816/126957 conn(0x7f9e8002f560 legacy=0x7f9e80031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 msgr2=0x7f9e9c11e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e980090b0 tx=0x7f9e98004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 shutdown_connections 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1343a0 0x7f9e9c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09ad40 0x7f9e9c11e0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 --2- 172.21.15.125:0/3410670395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c133f70 0x7f9e9c11e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 >> 172.21.15.125:0/3410670395 conn(0x7f9e9c099c40 msgr2=0x7f9e9c133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 shutdown_connections 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:29.458+0000 7f9ea342a700 1 -- 172.21.15.125:0/3410670395 wait complete. 2023-10-03T10:12:29.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:30.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:30.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:30.443 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:30.471 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:30.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.505+0000 7fed51285700 1 Processor -- start 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 -- start start 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 0x7fed4c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed4c130670 0x7fed4c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0a1e70 con 0x7fed4c0a1340 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c09a720 con 0x7fed4c130670 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed51285700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c09b300 con 0x7fed4c0a0a30 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed4a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fed4c0a1340 0x7fed4c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33242/0 (socket says 172.21.15.125:33242) 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed4a7fc700 1 -- 172.21.15.125:0/2619349400 learned_addr learned my addr 172.21.15.125:0/2619349400 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.506+0000 7fed4affd700 1 --2- 172.21.15.125:0/2619349400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 0x7fed4c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed4affd700 1 -- 172.21.15.125:0/2619349400 >> v2:172.21.15.125:3300/0 conn(0x7fed4c130670 msgr2=0x7fed4c1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed4affd700 1 --2- 172.21.15.125:0/2619349400 >> v2:172.21.15.125:3300/0 conn(0x7fed4c130670 0x7fed4c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed4affd700 1 -- 172.21.15.125:0/2619349400 >> v1:172.21.15.125:6789/0 conn(0x7fed4c0a1340 legacy=0x7fed4c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed4affd700 1 -- 172.21.15.125:0/2619349400 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c09abc0 con 0x7fed4c0a0a30 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed49ffb700 1 -- 172.21.15.125:0/2619349400 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707227530 0 0) 0x7fed4c0a1e70 con 0x7fed4c0a1340 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed4affd700 1 --2- 172.21.15.125:0/2619349400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 0x7fed4c0a0e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00a9c0 tx=0x7fed3c00acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e88db311bb9b783c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed49ffb700 1 -- 172.21.15.125:0/2619349400 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c005e30 con 0x7fed4c0a0a30 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed49ffb700 1 -- 172.21.15.125:0/2619349400 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00c760 con 0x7fed4c0a0a30 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.507+0000 7fed49ffb700 1 -- 172.21.15.125:0/2619349400 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00caf0 con 0x7fed4c0a0a30 2023-10-03T10:12:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 -- 172.21.15.125:0/2619349400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 msgr2=0x7fed4c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 --2- 172.21.15.125:0/2619349400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 0x7fed4c0a0e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00a9c0 tx=0x7fed3c00acd0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 -- 172.21.15.125:0/2619349400 shutdown_connections 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 --2- 172.21.15.125:0/2619349400 >> v2:172.21.15.125:3300/0 conn(0x7fed4c130670 0x7fed4c1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 --2- 172.21.15.125:0/2619349400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c0a0a30 0x7fed4c0a0e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 -- 172.21.15.125:0/2619349400 >> 172.21.15.125:0/2619349400 conn(0x7fed4c0a2980 msgr2=0x7fed4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 -- 172.21.15.125:0/2619349400 shutdown_connections 2023-10-03T10:12:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.508+0000 7fed51285700 1 -- 172.21.15.125:0/2619349400 wait complete. 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.509+0000 7fed51285700 1 Processor -- start 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.509+0000 7fed51285700 1 -- start start 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed4c0a1340 0x7fed4c120330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c130670 0x7fed4c1c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c09ae70 con 0x7fed4c0a0a30 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1221f0 con 0x7fed4c0a1340 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed51285700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c122a50 con 0x7fed4c130670 2023-10-03T10:12:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52578/0 (socket says 172.21.15.125:52578) 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 -- 172.21.15.125:0/2231514073 learned_addr learned my addr 172.21.15.125:0/2231514073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4b7fe700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c130670 0x7fed4c1c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4a7fc700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed4c0a1340 0x7fed4c120330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 -- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c130670 msgr2=0x7fed4c1c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c130670 0x7fed4c1c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 -- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed4c0a1340 msgr2=0x7fed4c120330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed4c0a1340 0x7fed4c120330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 -- 172.21.15.125:0/2231514073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c00a5d0 con 0x7fed4c0a0a30 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.510+0000 7fed4affd700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00ad10 tx=0x7fed3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.511+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c01f070 con 0x7fed4c0a0a30 2023-10-03T10:12:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.511+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c004020 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.511+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c120870 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.511+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c004390 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.511+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c123780 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.512+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed3c006370 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.512+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed3c040860 con 0x7fed4c0a0a30 2023-10-03T10:12:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.512+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c122f50 con 0x7fed4c0a0a30 2023-10-03T10:12:30.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.517+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed3c014070 con 0x7fed4c0a0a30 2023-10-03T10:12:30.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.548+0000 7fd9a9932700 1 Processor -- start 2023-10-03T10:12:30.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.548+0000 7fd9a9932700 1 -- start start 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a9932700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9a406a770 0x7fd9a41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a9932700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a9932700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a409eca0 con 0x7fd9a4134f00 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a9932700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a406b2e0 con 0x7fd9a406a770 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a9932700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a409f720 con 0x7fd9a409e070 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a27fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd9a4134f00 0x7fd9a409d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33244/0 (socket says 172.21.15.125:33244) 2023-10-03T10:12:30.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a27fc700 1 -- 172.21.15.125:0/1597082415 learned_addr learned my addr 172.21.15.125:0/1597082415 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:30.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 --2- 172.21.15.125:0/1597082415 >> v2:172.21.15.125:3300/0 conn(0x7fd9a406a770 0x7fd9a41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a37fe700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 -- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 msgr2=0x7fd9a413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a413fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 -- 172.21.15.125:0/1597082415 >> v1:172.21.15.125:6789/0 conn(0x7fd9a4134f00 legacy=0x7fd9a409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 -- 172.21.15.125:0/1597082415 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a406b480 con 0x7fd9a406a770 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.549+0000 7fd9a2ffd700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a406a770 0x7fd9a41349c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd994009840 tx=0x7fd994009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ccf1bc56f470c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.550+0000 7fd9a1ffb700 1 -- 172.21.15.125:0/1597082415 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994011830 con 0x7fd9a406a770 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.550+0000 7fd9a1ffb700 1 -- 172.21.15.125:0/1597082415 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994011990 con 0x7fd9a406a770 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.550+0000 7fd9a1ffb700 1 -- 172.21.15.125:0/1597082415 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994011d20 con 0x7fd9a406a770 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 -- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a406a770 msgr2=0x7fd9a41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a406a770 0x7fd9a41349c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd994009840 tx=0x7fd994009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 -- 172.21.15.125:0/1597082415 shutdown_connections 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 --2- 172.21.15.125:0/1597082415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a406a770 0x7fd9a41349c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 -- 172.21.15.125:0/1597082415 >> 172.21.15.125:0/1597082415 conn(0x7fd9a4099c40 msgr2=0x7fd9a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 -- 172.21.15.125:0/1597082415 shutdown_connections 2023-10-03T10:12:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.551+0000 7fd9a9932700 1 -- 172.21.15.125:0/1597082415 wait complete. 2023-10-03T10:12:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 Processor -- start 2023-10-03T10:12:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 -- start start 2023-10-03T10:12:30.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 0x7fd9a411a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a411ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 0x7fd9a411b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40a01f0 con 0x7fd9a4134f00 2023-10-03T10:12:30.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a409f220 con 0x7fd9a406a770 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.552+0000 7fd9a9932700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a411cb50 con 0x7fd9a409e070 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a411ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a411ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43790/0 (socket says 172.21.15.125:43790) 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a27fc700 1 -- 172.21.15.125:0/2788863910 learned_addr learned my addr 172.21.15.125:0/2788863910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 0x7fd9a411b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a2ffd700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 0x7fd9a411a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 -- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 msgr2=0x7fd9a411ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a411ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 -- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 msgr2=0x7fd9a411a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 0x7fd9a411a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 -- 172.21.15.125:0/2788863910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940094a0 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a2ffd700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 0x7fd9a411a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd9a37fe700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 0x7fd9a411b390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00efc0 tx=0x7fd99c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.553+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00cc90 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.554+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00f040 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.554+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a4127400 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.554+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0146c0 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.554+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4126440 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.555+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a404f2a0 con 0x7fd9a4134f00 2023-10-03T10:12:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.556+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd99c014820 con 0x7fd9a4134f00 2023-10-03T10:12:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.556+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd99c040790 con 0x7fd9a4134f00 2023-10-03T10:12:30.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.564+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd99c014ad0 con 0x7fd9a4134f00 2023-10-03T10:12:30.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.589+0000 7f9f500c6700 1 Processor -- start 2023-10-03T10:12:30.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.589+0000 7f9f500c6700 1 -- start start 2023-10-03T10:12:30.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.589+0000 7f9f500c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.589+0000 7f9f500c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f480a10b0 0x7f9f4813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.589+0000 7f9f500c6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4809a760 con 0x7f9f48134210 2023-10-03T10:12:30.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f500c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f481336e0 con 0x7f9f480a10b0 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f500c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4809a080 con 0x7f9f48133900 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4de62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4de62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43798/0 (socket says 172.21.15.125:43798) 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f480a10b0 0x7f9f4813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4de62700 1 -- 172.21.15.125:0/405158949 learned_addr learned my addr 172.21.15.125:0/405158949 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:30.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4d661700 1 --1- 172.21.15.125:0/405158949 >> v1:172.21.15.125:6789/0 conn(0x7f9f48134210 0x7f9f480a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33260/0 (socket says 172.21.15.125:33260) 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 -- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 msgr2=0x7f9f48133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 -- 172.21.15.125:0/405158949 >> v1:172.21.15.125:6789/0 conn(0x7f9f48134210 legacy=0x7f9f480a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4ce60700 1 -- 172.21.15.125:0/405158949 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368165694 0 0) 0x7f9f4809a760 con 0x7f9f48134210 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 -- 172.21.15.125:0/405158949 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480a23e0 con 0x7f9f480a10b0 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4de62700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.590+0000 7f9f4e663700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f480a10b0 0x7f9f4813b910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009d90 tx=0x7f9f4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e2480d8c4a0c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f4ce60700 1 -- 172.21.15.125:0/405158949 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000e070 con 0x7f9f480a10b0 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f4ce60700 1 -- 172.21.15.125:0/405158949 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000bb20 con 0x7f9f480a10b0 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f4ce60700 1 -- 172.21.15.125:0/405158949 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40012430 con 0x7f9f480a10b0 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 -- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f480a10b0 msgr2=0x7f9f4813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f480a10b0 0x7f9f4813b910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009d90 tx=0x7f9f4000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 -- 172.21.15.125:0/405158949 shutdown_connections 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f480a10b0 0x7f9f4813b910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 --2- 172.21.15.125:0/405158949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f48133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 -- 172.21.15.125:0/405158949 >> 172.21.15.125:0/405158949 conn(0x7f9f480a2980 msgr2=0x7f9f480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 -- 172.21.15.125:0/405158949 shutdown_connections 2023-10-03T10:12:30.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.591+0000 7f9f500c6700 1 -- 172.21.15.125:0/405158949 wait complete. 2023-10-03T10:12:30.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.592+0000 7f9f500c6700 1 Processor -- start 2023-10-03T10:12:30.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.592+0000 7f9f500c6700 1 -- start start 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f480a10b0 0x7f9f4811d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 0x7f9f4811e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48121be0 con 0x7f9f48134210 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4811f310 con 0x7f9f480a10b0 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f500c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48120560 con 0x7f9f48133900 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4e663700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 0x7f9f4811e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43802/0 (socket says 172.21.15.125:43802) 2023-10-03T10:12:30.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 -- 172.21.15.125:0/3528944460 learned_addr learned my addr 172.21.15.125:0/3528944460 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4e663700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 0x7f9f4811e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52624/0 (socket says 172.21.15.125:52624) 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4de62700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f480a10b0 0x7f9f4811d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 -- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f480a10b0 msgr2=0x7f9f4811d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f480a10b0 0x7f9f4811d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 -- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 msgr2=0x7f9f4811e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 0x7f9f4811e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.593+0000 7f9f4d661700 1 -- 172.21.15.125:0/3528944460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44009500 con 0x7f9f48133900 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f4d661700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c550 tx=0x7f9f3800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38004c80 con 0x7f9f48133900 2023-10-03T10:12:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38004de0 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f40009a70 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38007310 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.594+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f48132b60 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.595+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4811a590 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.595+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f38007470 con 0x7f9f48133900 2023-10-03T10:12:30.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.596+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f3803fae0 con 0x7f9f48133900 2023-10-03T10:12:30.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.600+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f380133c0 con 0x7f9f48133900 2023-10-03T10:12:30.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.634+0000 7f838653e700 1 Processor -- start 2023-10-03T10:12:30.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.634+0000 7f838653e700 1 -- start start 2023-10-03T10:12:30.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.634+0000 7f838653e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.634+0000 7f838653e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8380134120 0x7f838013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.634+0000 7f838653e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838009dc00 con 0x7f83800a1380 2023-10-03T10:12:30.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f838653e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838009ea90 con 0x7f83800a0a70 2023-10-03T10:12:30.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f838653e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838009dec0 con 0x7f8380134120 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83800a1380 0x7f8380133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33276/0 (socket says 172.21.15.125:33276) 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837f7fe700 1 -- 172.21.15.125:0/1649602449 learned_addr learned my addr 172.21.15.125:0/1649602449 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f8384adb700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8380134120 0x7f838013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 -- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8380134120 msgr2=0x7f838013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8380134120 0x7f838013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 -- 172.21.15.125:0/1649602449 >> v1:172.21.15.125:6789/0 conn(0x7f83800a1380 legacy=0x7f8380133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837effd700 1 -- 172.21.15.125:0/1649602449 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875352433 0 0) 0x7f838009dc00 con 0x7f83800a1380 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 -- 172.21.15.125:0/1649602449 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838009e6a0 con 0x7f83800a0a70 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837ffff700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8370009840 tx=0x7f8370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f4e6884ac2e58b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837effd700 1 -- 172.21.15.125:0/1649602449 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011830 con 0x7f83800a0a70 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.635+0000 7f837effd700 1 -- 172.21.15.125:0/1649602449 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370011990 con 0x7f83800a0a70 2023-10-03T10:12:30.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f837effd700 1 -- 172.21.15.125:0/1649602449 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011d20 con 0x7f83800a0a70 2023-10-03T10:12:30.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 -- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 msgr2=0x7f83800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8370009840 tx=0x7f8370009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 -- 172.21.15.125:0/1649602449 shutdown_connections 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8380134120 0x7f838013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 --2- 172.21.15.125:0/1649602449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 -- 172.21.15.125:0/1649602449 >> 172.21.15.125:0/1649602449 conn(0x7f83800a6610 msgr2=0x7f83800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 -- 172.21.15.125:0/1649602449 shutdown_connections 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.636+0000 7f838653e700 1 -- 172.21.15.125:0/1649602449 wait complete. 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.637+0000 7f838653e700 1 Processor -- start 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.637+0000 7f838653e700 1 -- start start 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380134120 0x7f83801231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83801259e0 con 0x7f83800a1380 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8380126270 con 0x7f83800a0a70 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f838653e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8380133aa0 con 0x7f8380134120 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59628/0 (socket says 172.21.15.125:59628) 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837ffff700 1 -- 172.21.15.125:0/2989053200 learned_addr learned my addr 172.21.15.125:0/2989053200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52650/0 (socket says 172.21.15.125:52650) 2023-10-03T10:12:30.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f8384adb700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380134120 0x7f83801231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 -- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380134120 msgr2=0x7f83801231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380134120 0x7f83801231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 -- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 msgr2=0x7f8380122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 -- 172.21.15.125:0/2989053200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700094a0 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837ffff700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.638+0000 7f837f7fe700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f837400c470 tx=0x7f837400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.639+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374004c80 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.639+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374004de0 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.639+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800a0440 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.639+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374007310 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.639+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8380125f90 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.640+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8374007470 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.640+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8374040bc0 con 0x7f83800a1380 2023-10-03T10:12:30.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.640+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838004f2a0 con 0x7f83800a1380 2023-10-03T10:12:30.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.645+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8374044060 con 0x7f83800a1380 2023-10-03T10:12:30.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.719+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed4c04f2a0 con 0x7fed4c0a0a30 2023-10-03T10:12:30.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.720+0000 7fed337fe700 1 -- 172.21.15.125:0/2231514073 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed3c0044f0 con 0x7fed4c0a0a30 2023-10-03T10:12:30.720 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:30.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 msgr2=0x7fed4c11fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00ad10 tx=0x7fed3c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:30.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 shutdown_connections 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed4c130670 0x7fed4c1c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed4c0a0a30 0x7fed4c11fdf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 --2- 172.21.15.125:0/2231514073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed4c0a1340 0x7fed4c120330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 >> 172.21.15.125:0/2231514073 conn(0x7fed4c0a2980 msgr2=0x7fed4c1b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 shutdown_connections 2023-10-03T10:12:30.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.722+0000 7fed51285700 1 -- 172.21.15.125:0/2231514073 wait complete. 2023-10-03T10:12:30.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.805+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f4804f2a0 con 0x7f9f48133900 2023-10-03T10:12:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.805+0000 7f9f3e7fc700 1 -- 172.21.15.125:0/3528944460 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f38011360 con 0x7f9f48133900 2023-10-03T10:12:30.806 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:30.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 msgr2=0x7f9f4811dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c550 tx=0x7f9f3800c860 comp rx=0 tx=0).stop 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 shutdown_connections 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f48134210 0x7f9f4811e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f480a10b0 0x7f9f4811d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 --2- 172.21.15.125:0/3528944460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f48133900 0x7f9f4811dc40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 >> 172.21.15.125:0/3528944460 conn(0x7f9f480a2980 msgr2=0x7f9f481baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 shutdown_connections 2023-10-03T10:12:30.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.808+0000 7f9f500c6700 1 -- 172.21.15.125:0/3528944460 wait complete. 2023-10-03T10:12:30.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.818+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9a406c3b0 con 0x7fd9a4134f00 2023-10-03T10:12:30.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.819+0000 7fd98bfff700 1 -- 172.21.15.125:0/2788863910 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd99c01c3b0 con 0x7fd9a4134f00 2023-10-03T10:12:30.819 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:30.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.820+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 msgr2=0x7fd9a411b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.820+0000 7fd9a9932700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 0x7fd9a411b390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00efc0 tx=0x7fd99c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.821+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 shutdown_connections 2023-10-03T10:12:30.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.821+0000 7fd9a9932700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9a4134f00 0x7fd9a411b390 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.821+0000 7fd9a9932700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9a406a770 0x7fd9a411a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.821+0000 7fd9a9932700 1 --2- 172.21.15.125:0/2788863910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9a409e070 0x7fd9a411ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.821+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 >> 172.21.15.125:0/2788863910 conn(0x7fd9a4099c40 msgr2=0x7fd9a409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.822+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 shutdown_connections 2023-10-03T10:12:30.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.822+0000 7fd9a9932700 1 -- 172.21.15.125:0/2788863910 wait complete. 2023-10-03T10:12:30.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:30.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.896+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8380072980 con 0x7f83800a1380 2023-10-03T10:12:30.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.897+0000 7f837cff9700 1 -- 172.21.15.125:0/2989053200 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8374007720 con 0x7f83800a1380 2023-10-03T10:12:30.897 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 msgr2=0x7f8380122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f837400c470 tx=0x7f837400c780 comp rx=0 tx=0).stop 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 shutdown_connections 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380134120 0x7f83801231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 --2- 172.21.15.125:0/2989053200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380122c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 >> 172.21.15.125:0/2989053200 conn(0x7f83800a6610 msgr2=0x7f838009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 shutdown_connections 2023-10-03T10:12:30.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:30.899+0000 7f838653e700 1 -- 172.21.15.125:0/2989053200 wait complete. 2023-10-03T10:12:30.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:31.735 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:31.821 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:31.835 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:31.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.877+0000 7f7de5e09700 1 Processor -- start 2023-10-03T10:12:31.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.877+0000 7f7de5e09700 1 -- start start 2023-10-03T10:12:31.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7de5e09700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7de0066410 0x7f7de01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7de5e09700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 0x7f7de0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7de5e09700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00a0f20 con 0x7f7de009bc70 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7de5e09700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00667e0 con 0x7f7de0066410 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7de5e09700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00a23c0 con 0x7f7de01314b0 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 0x7f7de0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7de0066410 0x7f7de01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 0x7f7de0131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59642/0 (socket says 172.21.15.125:59642) 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7de009bc70 0x7f7de009c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33284/0 (socket says 172.21.15.125:33284) 2023-10-03T10:12:31.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddeffd700 1 -- 172.21.15.125:0/4060788216 learned_addr learned my addr 172.21.15.125:0/4060788216 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddf7fe700 1 -- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 msgr2=0x7f7de0131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddf7fe700 1 --2- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 0x7f7de0131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.878+0000 7f7ddf7fe700 1 -- 172.21.15.125:0/4060788216 >> v1:172.21.15.125:6789/0 conn(0x7f7de009bc70 legacy=0x7f7de009c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7ddf7fe700 1 -- 172.21.15.125:0/4060788216 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00a16e0 con 0x7f7de0066410 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7dde7fc700 1 -- 172.21.15.125:0/4060788216 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794398422 0 0) 0x7f7de00a0f20 con 0x7f7de009bc70 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7ddf7fe700 1 --2- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de0066410 0x7f7de01319f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009850 tx=0x7f7dd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ccc713d512de00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7dde7fc700 1 -- 172.21.15.125:0/4060788216 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0005e30 con 0x7f7de0066410 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7dde7fc700 1 -- 172.21.15.125:0/4060788216 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0006030 con 0x7f7de0066410 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.879+0000 7f7dde7fc700 1 -- 172.21.15.125:0/4060788216 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00063c0 con 0x7f7de0066410 2023-10-03T10:12:31.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 -- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de0066410 msgr2=0x7f7de01319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 --2- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de0066410 0x7f7de01319f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009850 tx=0x7f7dd0009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 -- 172.21.15.125:0/4060788216 shutdown_connections 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 --2- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de0066410 0x7f7de01319f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 --2- 172.21.15.125:0/4060788216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de01314b0 0x7f7de0131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 -- 172.21.15.125:0/4060788216 >> 172.21.15.125:0/4060788216 conn(0x7f7de00a2980 msgr2=0x7f7de00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 -- 172.21.15.125:0/4060788216 shutdown_connections 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.880+0000 7f7de5e09700 1 -- 172.21.15.125:0/4060788216 wait complete. 2023-10-03T10:12:31.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 Processor -- start 2023-10-03T10:12:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 -- start start 2023-10-03T10:12:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 0x7f7de0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de011bd50 con 0x7f7de01314b0 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de011a410 con 0x7f7de0066410 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7de5e09700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7de011bfa0 con 0x7f7de009bc70 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7ddf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7ddf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59650/0 (socket says 172.21.15.125:59650) 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43820/0 (socket says 172.21.15.125:43820) 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.881+0000 7f7ddf7fe700 1 -- 172.21.15.125:0/2211769233 learned_addr learned my addr 172.21.15.125:0/2211769233 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddffff700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 0x7f7de0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 -- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 msgr2=0x7f7de0118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 -- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 msgr2=0x7f7de0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 0x7f7de0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 -- 172.21.15.125:0/2211769233 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009430 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddffff700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 0x7f7de0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddf7fe700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7ddeffd700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4012c40 tx=0x7f7dd4012f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4010980 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4013040 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4010d00 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de011a920 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.882+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de011cb60 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.883+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dd4018480 con 0x7f7de009bc70 2023-10-03T10:12:31.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.883+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7dd40439d0 con 0x7f7de009bc70 2023-10-03T10:12:31.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.884+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de01312d0 con 0x7f7de009bc70 2023-10-03T10:12:31.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.888+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dd4020950 con 0x7f7de009bc70 2023-10-03T10:12:31.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:31.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.956+0000 7faa185e8700 1 Processor -- start 2023-10-03T10:12:31.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.956+0000 7faa185e8700 1 -- start start 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa185e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa1012d380 0x7faa1012d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa185e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa10099a60 0x7faa10099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa185e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1009bb90 con 0x7faa1009a3d0 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa185e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1009c210 con 0x7faa1012d380 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa185e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa1009ced0 con 0x7faa10099a60 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa16384700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa1012d380 0x7faa1012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa16384700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa1012d380 0x7faa1012d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52662/0 (socket says 172.21.15.125:52662) 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa16384700 1 -- 172.21.15.125:0/1899811881 learned_addr learned my addr 172.21.15.125:0/1899811881 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.957+0000 7faa15b83700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa10099a60 0x7faa10099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa16384700 1 -- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa10099a60 msgr2=0x7faa10099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa16384700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa10099a60 0x7faa10099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa16384700 1 -- 172.21.15.125:0/1899811881 >> v1:172.21.15.125:6789/0 conn(0x7faa1009a3d0 legacy=0x7faa10137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa16384700 1 -- 172.21.15.125:0/1899811881 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1009ac30 con 0x7faa1012d380 2023-10-03T10:12:31.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa16384700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1012d380 0x7faa1012d750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faa0c006fd0 tx=0x7faa0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9967ee4a873af59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa15382700 1 -- 172.21.15.125:0/1899811881 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c005e30 con 0x7faa1012d380 2023-10-03T10:12:31.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa15382700 1 -- 172.21.15.125:0/1899811881 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c004030 con 0x7faa1012d380 2023-10-03T10:12:31.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.958+0000 7faa15382700 1 -- 172.21.15.125:0/1899811881 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0043e0 con 0x7faa1012d380 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 -- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1012d380 msgr2=0x7faa1012d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1012d380 0x7faa1012d750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faa0c006fd0 tx=0x7faa0c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 -- 172.21.15.125:0/1899811881 shutdown_connections 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1012d380 0x7faa1012d750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 --2- 172.21.15.125:0/1899811881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa10099a60 0x7faa10099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 -- 172.21.15.125:0/1899811881 >> 172.21.15.125:0/1899811881 conn(0x7faa100a2980 msgr2=0x7faa100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 -- 172.21.15.125:0/1899811881 shutdown_connections 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.959+0000 7faa185e8700 1 -- 172.21.15.125:0/1899811881 wait complete. 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 Processor -- start 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 -- start start 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa10099a60 0x7faa101c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 0x7faa101c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10138590 con 0x7faa1009a3d0 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.960+0000 7faa185e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1009b470 con 0x7faa10099a60 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa185e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa10138770 con 0x7faa1012d380 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43834/0 (socket says 172.21.15.125:43834) 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 -- 172.21.15.125:0/351585754 learned_addr learned my addr 172.21.15.125:0/351585754 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa15b83700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 0x7faa101c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 -- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa10099a60 msgr2=0x7faa101c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa10099a60 0x7faa101c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 -- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 msgr2=0x7faa101c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 0x7faa101c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 -- 172.21.15.125:0/351585754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009500 con 0x7faa1012d380 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa15b83700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 0x7faa101c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa16b85700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa0800ccb0 tx=0x7faa0800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.961+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08003c00 con 0x7faa1012d380 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.962+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa08003d60 con 0x7faa1012d380 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.962+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa101c5c70 con 0x7faa1012d380 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.962+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1013b980 con 0x7faa1012d380 2023-10-03T10:12:31.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.962+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800ab80 con 0x7faa1012d380 2023-10-03T10:12:31.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.963+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa0800ace0 con 0x7faa1012d380 2023-10-03T10:12:31.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.963+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa0803f670 con 0x7faa1012d380 2023-10-03T10:12:31.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.963+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f80052e0 con 0x7faa1012d380 2023-10-03T10:12:31.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.967+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa080198f0 con 0x7faa1012d380 2023-10-03T10:12:31.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 Processor -- start 2023-10-03T10:12:31.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 -- start start 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 0x7fd5a0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00a1640 con 0x7fd5a009bc70 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a006eb30 con 0x7fd5a009c790 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a7f3a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00a22d0 con 0x7fd5a0131980 2023-10-03T10:12:31.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a54d5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd5a009bc70 0x7fd5a009c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33300/0 (socket says 172.21.15.125:33300) 2023-10-03T10:12:32.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a54d5700 1 -- 172.21.15.125:0/1144343357 learned_addr learned my addr 172.21.15.125:0/1144343357 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:32.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.998+0000 7fd5a5cd6700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 0x7fd5a0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a64d7700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a5cd6700 1 -- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 msgr2=0x7fd5a0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a5cd6700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a5cd6700 1 -- 172.21.15.125:0/1144343357 >> v1:172.21.15.125:6789/0 conn(0x7fd5a009bc70 legacy=0x7fd5a009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a4cd4700 1 -- 172.21.15.125:0/1144343357 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641406400 0 0) 0x7fd5a00a1640 con 0x7fd5a009bc70 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a5cd6700 1 -- 172.21.15.125:0/1144343357 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0131550 con 0x7fd5a0131980 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a5cd6700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 0x7fd5a0131d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009850 tx=0x7fd59c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a155e148951deb23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a4cd4700 1 -- 172.21.15.125:0/1144343357 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c005e30 con 0x7fd5a0131980 2023-10-03T10:12:32.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a4cd4700 1 -- 172.21.15.125:0/1144343357 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c006030 con 0x7fd5a0131980 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:31.999+0000 7fd5a4cd4700 1 -- 172.21.15.125:0/1144343357 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0063e0 con 0x7fd5a0131980 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 msgr2=0x7fd5a0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 0x7fd5a0131d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009850 tx=0x7fd59c009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/1144343357 shutdown_connections 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/1144343357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a0131980 0x7fd5a0131d50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/1144343357 >> 172.21.15.125:0/1144343357 conn(0x7fd5a00a2980 msgr2=0x7fd5a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/1144343357 shutdown_connections 2023-10-03T10:12:32.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.000+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/1144343357 wait complete. 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.001+0000 7fd5a7f3a700 1 Processor -- start 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.001+0000 7fd5a7f3a700 1 -- start start 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 0x7fd5a0099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5a0131980 0x7fd5a009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a009af60 con 0x7fd5a0131980 2023-10-03T10:12:32.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01213c0 con 0x7fd5a009c790 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a7f3a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0120b50 con 0x7fd5a009bc70 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a5cd6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 0x7fd5a0099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a5cd6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 0x7fd5a0099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43860/0 (socket says 172.21.15.125:43860) 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a5cd6700 1 -- 172.21.15.125:0/3652687089 learned_addr learned my addr 172.21.15.125:0/3652687089 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a64d7700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5a0131980 0x7fd5a009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 -- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 msgr2=0x7fd5a0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 0x7fd5a0099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 -- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5a0131980 msgr2=0x7fd5a009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5a0131980 0x7fd5a009a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.002+0000 7fd5a54d5700 1 -- 172.21.15.125:0/3652687089 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009430 con 0x7fd5a009c790 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5a54d5700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0099fd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a0ee0 tx=0x7fd59000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590004c80 con 0x7fd5a009c790 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590004de0 con 0x7fd5a009c790 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a009b6a0 con 0x7fd5a009c790 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590007310 con 0x7fd5a009c790 2023-10-03T10:12:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.003+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a0130a60 con 0x7fd5a009c790 2023-10-03T10:12:32.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.004+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd590007470 con 0x7fd5a009c790 2023-10-03T10:12:32.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.004+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd590040bc0 con 0x7fd5a009c790 2023-10-03T10:12:32.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.004+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0120700 con 0x7fd5a009c790 2023-10-03T10:12:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.009+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd590044060 con 0x7fd5a009c790 2023-10-03T10:12:32.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.043+0000 7f3a841aa700 1 Processor -- start 2023-10-03T10:12:32.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.043+0000 7f3a841aa700 1 -- start start 2023-10-03T10:12:32.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c09e870 0x7f3a7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3a7c09f180 0x7f3a7c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c0a0920 con 0x7f3a7c09f180 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c09c970 con 0x7f3a7c131d70 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a841aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c09bab0 con 0x7f3a7c09e870 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59694/0 (socket says 172.21.15.125:59694) 2023-10-03T10:12:32.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 -- 172.21.15.125:0/3190479088 learned_addr learned my addr 172.21.15.125:0/3190479088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a81745700 1 --2- 172.21.15.125:0/3190479088 >> v2:172.21.15.125:3300/0 conn(0x7f3a7c09f180 0x7f3a7c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 -- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c09e870 msgr2=0x7f3a7c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 --2- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c09e870 0x7f3a7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 -- 172.21.15.125:0/3190479088 >> v2:172.21.15.125:3300/0 conn(0x7f3a7c09f180 msgr2=0x7f3a7c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 --2- 172.21.15.125:0/3190479088 >> v2:172.21.15.125:3300/0 conn(0x7f3a7c09f180 0x7f3a7c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 -- 172.21.15.125:0/3190479088 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c09f9c0 con 0x7f3a7c131d70 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.044+0000 7f3a82747700 1 --2- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e80 tx=0x7f3a7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ec1612118d012 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a80f44700 1 -- 172.21.15.125:0/3190479088 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400e070 con 0x7f3a7c131d70 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a80f44700 1 -- 172.21.15.125:0/3190479088 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400b8d0 con 0x7f3a7c131d70 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a80f44700 1 -- 172.21.15.125:0/3190479088 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400bc60 con 0x7f3a7c131d70 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 -- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 msgr2=0x7f3a7c132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e80 tx=0x7f3a7400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 -- 172.21.15.125:0/3190479088 shutdown_connections 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c131d70 0x7f3a7c132210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3190479088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c09e870 0x7f3a7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.045+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3190479088 >> v2:172.21.15.125:3300/0 conn(0x7f3a7c09f180 0x7f3a7c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.046+0000 7f3a841aa700 1 -- 172.21.15.125:0/3190479088 >> 172.21.15.125:0/3190479088 conn(0x7f3a7c0a4430 msgr2=0x7f3a7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.046+0000 7f3a841aa700 1 -- 172.21.15.125:0/3190479088 shutdown_connections 2023-10-03T10:12:32.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.046+0000 7f3a841aa700 1 -- 172.21.15.125:0/3190479088 wait complete. 2023-10-03T10:12:32.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.047+0000 7f3a841aa700 1 Processor -- start 2023-10-03T10:12:32.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.047+0000 7f3a841aa700 1 -- start start 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 0x7f3a7c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 0x7f3a7c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c130690 con 0x7f3a7c09e870 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c124860 con 0x7f3a7c09f180 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a841aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c123750 con 0x7f3a7c131d70 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59702/0 (socket says 172.21.15.125:59702) 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 -- 172.21.15.125:0/3722759821 learned_addr learned my addr 172.21.15.125:0/3722759821 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a82747700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 0x7f3a7c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81f46700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 0x7f3a7c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 -- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 msgr2=0x7f3a7c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 0x7f3a7c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 -- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 msgr2=0x7f3a7c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 0x7f3a7c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81745700 1 -- 172.21.15.125:0/3722759821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009b30 con 0x7f3a7c09f180 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a82747700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 0x7f3a7c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.048+0000 7f3a81f46700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 0x7f3a7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a81745700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00e9b0 tx=0x7f3a6c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c009710 con 0x7f3a7c09f180 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00ee50 con 0x7f3a7c09f180 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c124b20 con 0x7f3a7c09f180 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00ca70 con 0x7f3a7c09f180 2023-10-03T10:12:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.049+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c0a2bf0 con 0x7f3a7c09f180 2023-10-03T10:12:32.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.050+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a6c00cbd0 con 0x7f3a7c09f180 2023-10-03T10:12:32.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.050+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c11be60 con 0x7f3a7c09f180 2023-10-03T10:12:32.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.050+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a6c03fa60 con 0x7f3a7c09f180 2023-10-03T10:12:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.059+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a6c013470 con 0x7f3a7c09f180 2023-10-03T10:12:32.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.092+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7de004f2a0 con 0x7f7de009bc70 2023-10-03T10:12:32.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.092+0000 7f7dc7fff700 1 -- 172.21.15.125:0/2211769233 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dd4020360 con 0x7f7de009bc70 2023-10-03T10:12:32.093 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.095+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 msgr2=0x7f7de0119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.095+0000 7f7de5e09700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4012c40 tx=0x7f7dd4012f50 comp rx=0 tx=0).stop 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 shutdown_connections 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7de01314b0 0x7f7de0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7de0066410 0x7f7de0118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 --2- 172.21.15.125:0/2211769233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7de009bc70 0x7f7de0119330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 >> 172.21.15.125:0/2211769233 conn(0x7f7de00a2980 msgr2=0x7f7de012d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 shutdown_connections 2023-10-03T10:12:32.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.096+0000 7f7de5e09700 1 -- 172.21.15.125:0/2211769233 wait complete. 2023-10-03T10:12:32.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:32.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.174+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9f8005590 con 0x7faa1012d380 2023-10-03T10:12:32.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.175+0000 7faa06ffd700 1 -- 172.21.15.125:0/351585754 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa08001cb0 con 0x7faa1012d380 2023-10-03T10:12:32.175 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:32.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.176+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 msgr2=0x7faa101c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.176+0000 7faa185e8700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa0800ccb0 tx=0x7faa0800a060 comp rx=0 tx=0).stop 2023-10-03T10:12:32.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 shutdown_connections 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa1012d380 0x7faa101c8210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa10099a60 0x7faa101c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 --2- 172.21.15.125:0/351585754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa1009a3d0 0x7faa101c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 >> 172.21.15.125:0/351585754 conn(0x7faa100a2980 msgr2=0x7faa10130790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 shutdown_connections 2023-10-03T10:12:32.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.177+0000 7faa185e8700 1 -- 172.21.15.125:0/351585754 wait complete. 2023-10-03T10:12:32.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:32.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.209+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5a004f2a0 con 0x7fd5a009c790 2023-10-03T10:12:32.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.209+0000 7fd5967fc700 1 -- 172.21.15.125:0/3652687089 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd590007720 con 0x7fd5a009c790 2023-10-03T10:12:32.210 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 msgr2=0x7fd5a0099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0099fd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a0ee0 tx=0x7fd59000c750 comp rx=0 tx=0).stop 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 shutdown_connections 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5a0131980 0x7fd5a009a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5a009bc70 0x7fd5a0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 --2- 172.21.15.125:0/3652687089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5a009c790 0x7fd5a0099fd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 >> 172.21.15.125:0/3652687089 conn(0x7fd5a00a2980 msgr2=0x7fd5a01b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 shutdown_connections 2023-10-03T10:12:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.211+0000 7fd5a7f3a700 1 -- 172.21.15.125:0/3652687089 wait complete. 2023-10-03T10:12:32.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.256+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a7c124140 con 0x7f3a7c09f180 2023-10-03T10:12:32.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.256+0000 7f3a727fc700 1 -- 172.21.15.125:0/3722759821 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a6c017030 con 0x7f3a7c09f180 2023-10-03T10:12:32.257 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 msgr2=0x7f3a7c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00e9b0 tx=0x7f3a6c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 shutdown_connections 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a7c131d70 0x7f3a7c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a7c09e870 0x7f3a7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 --2- 172.21.15.125:0/3722759821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a7c09f180 0x7f3a7c06bdf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 >> 172.21.15.125:0/3722759821 conn(0x7f3a7c0a4430 msgr2=0x7f3a7c1310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 shutdown_connections 2023-10-03T10:12:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:32.258+0000 7f3a841aa700 1 -- 172.21.15.125:0/3722759821 wait complete. 2023-10-03T10:12:32.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:33.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:33.189 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:33.224 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 Processor -- start 2023-10-03T10:12:33.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 -- start start 2023-10-03T10:12:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9a0139280 0x7fa9a013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a006b2d0 con 0x7fa9a0133ad0 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a01345b0 con 0x7fa9a0139280 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.250+0000 7fa9a7968700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0133610 con 0x7fa9a0136960 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9a0139280 0x7fa9a013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9a0139280 0x7fa9a013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52704/0 (socket says 172.21.15.125:52704) 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 -- 172.21.15.125:0/3766666585 learned_addr learned my addr 172.21.15.125:0/3766666585 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a4f03700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 -- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 msgr2=0x7fa9a0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 -- 172.21.15.125:0/3766666585 >> v1:172.21.15.125:6789/0 conn(0x7fa9a0133ad0 legacy=0x7fa9a0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa997fff700 1 -- 172.21.15.125:0/3766666585 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338468664 0 0) 0x7fa9a006b2d0 con 0x7fa9a0133ad0 2023-10-03T10:12:33.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 -- 172.21.15.125:0/3766666585 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a009a500 con 0x7fa9a0139280 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a4f03700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa9a5f05700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a013b660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa998009e80 tx=0x7fa99800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c78046c04f5e041 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa997fff700 1 -- 172.21.15.125:0/3766666585 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800e070 con 0x7fa9a0139280 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa997fff700 1 -- 172.21.15.125:0/3766666585 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99800b8d0 con 0x7fa9a0139280 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.251+0000 7fa997fff700 1 -- 172.21.15.125:0/3766666585 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800bc80 con 0x7fa9a0139280 2023-10-03T10:12:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 -- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 msgr2=0x7fa9a013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a013b660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa998009e80 tx=0x7fa99800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 -- 172.21.15.125:0/3766666585 shutdown_connections 2023-10-03T10:12:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a013b660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3766666585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 -- 172.21.15.125:0/3766666585 >> 172.21.15.125:0/3766666585 conn(0x7fa9a0099c40 msgr2=0x7fa9a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 -- 172.21.15.125:0/3766666585 shutdown_connections 2023-10-03T10:12:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.252+0000 7fa9a7968700 1 -- 172.21.15.125:0/3766666585 wait complete. 2023-10-03T10:12:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 Processor -- start 2023-10-03T10:12:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 -- start start 2023-10-03T10:12:33.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0131830 con 0x7fa9a0139280 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a009f390 con 0x7fa9a0136960 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a7968700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0072270 con 0x7fa9a0133ad0 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a5704700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a4f03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.254+0000 7fa9a4f03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59720/0 (socket says 172.21.15.125:59720) 2023-10-03T10:12:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 -- 172.21.15.125:0/3157886217 learned_addr learned my addr 172.21.15.125:0/3157886217 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a5704700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43888/0 (socket says 172.21.15.125:43888) 2023-10-03T10:12:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a5f05700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 -- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 msgr2=0x7fa9a012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 -- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 msgr2=0x7fa9a012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 -- 172.21.15.125:0/3157886217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900094a0 con 0x7fa9a0136960 2023-10-03T10:12:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a5704700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a4f03700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa99000ebe0 tx=0x7fa99000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990009760 con 0x7fa9a0136960 2023-10-03T10:12:33.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000c850 con 0x7fa9a0136960 2023-10-03T10:12:33.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000cbe0 con 0x7fa9a0136960 2023-10-03T10:12:33.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.255+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa998009b30 con 0x7fa9a0136960 2023-10-03T10:12:33.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.256+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a0070c90 con 0x7fa9a0136960 2023-10-03T10:12:33.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.256+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa99000cd40 con 0x7fa9a0136960 2023-10-03T10:12:33.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.257+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa99003f710 con 0x7fa9a0136960 2023-10-03T10:12:33.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.257+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a004f2a0 con 0x7fa9a0136960 2023-10-03T10:12:33.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.262+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa990021080 con 0x7fa9a0136960 2023-10-03T10:12:33.271 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:33.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.328+0000 7efde755c700 1 Processor -- start 2023-10-03T10:12:33.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.328+0000 7efde755c700 1 -- start start 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 0x7efde0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 0x7efde00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde009a760 con 0x7efde0134210 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde01336e0 con 0x7efde00a0ee0 2023-10-03T10:12:33.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde755c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efde009a080 con 0x7efde0133900 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde52f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 0x7efde0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde52f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 0x7efde0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43894/0 (socket says 172.21.15.125:43894) 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59724/0 (socket says 172.21.15.125:59724) 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde52f8700 1 -- 172.21.15.125:0/1453995044 learned_addr learned my addr 172.21.15.125:0/1453995044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde4af7700 1 --2- 172.21.15.125:0/1453995044 >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 0x7efde00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 -- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 msgr2=0x7efde0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 --2- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 0x7efde0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 -- 172.21.15.125:0/1453995044 >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 msgr2=0x7efde00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 --2- 172.21.15.125:0/1453995044 >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 0x7efde00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 -- 172.21.15.125:0/1453995044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00a23e0 con 0x7efde00a0ee0 2023-10-03T10:12:33.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde4af7700 1 --2- 172.21.15.125:0/1453995044 >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 0x7efde00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.329+0000 7efde5af9700 1 --2- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009e10 tx=0x7efdd8013b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978c818834e8b1f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efdd7fff700 1 -- 172.21.15.125:0/1453995044 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8007540 con 0x7efde00a0ee0 2023-10-03T10:12:33.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efdd7fff700 1 -- 172.21.15.125:0/1453995044 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd80076a0 con 0x7efde00a0ee0 2023-10-03T10:12:33.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efdd7fff700 1 -- 172.21.15.125:0/1453995044 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8007a50 con 0x7efde00a0ee0 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 -- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 msgr2=0x7efde00a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 --2- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009e10 tx=0x7efdd8013b40 comp rx=0 tx=0).stop 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 -- 172.21.15.125:0/1453995044 shutdown_connections 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 --2- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde00a1360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 --2- 172.21.15.125:0/1453995044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0133900 0x7efde0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 --2- 172.21.15.125:0/1453995044 >> v2:172.21.15.125:3300/0 conn(0x7efde0134210 0x7efde00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.330+0000 7efde755c700 1 -- 172.21.15.125:0/1453995044 >> 172.21.15.125:0/1453995044 conn(0x7efde00a2980 msgr2=0x7efde00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.331+0000 7efde755c700 1 -- 172.21.15.125:0/1453995044 shutdown_connections 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.331+0000 7efde755c700 1 -- 172.21.15.125:0/1453995044 wait complete. 2023-10-03T10:12:33.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.332+0000 7efde755c700 1 Processor -- start 2023-10-03T10:12:33.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.332+0000 7efde755c700 1 -- start start 2023-10-03T10:12:33.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde0119570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 0x7efde0119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde011da50 con 0x7efde0133900 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde011b180 con 0x7efde00a0ee0 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde755c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efde011c3d0 con 0x7efde0134210 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde5af9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 0x7efde0119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52728/0 (socket says 172.21.15.125:52728) 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde5af9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 0x7efde0119ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43896/0 (socket says 172.21.15.125:43896) 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 -- 172.21.15.125:0/739000904 learned_addr learned my addr 172.21.15.125:0/739000904 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde52f8700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde0119570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 -- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 msgr2=0x7efde0119ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 0x7efde0119ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 -- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 msgr2=0x7efde0119570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde0119570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 -- 172.21.15.125:0/739000904 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00094a0 con 0x7efde0133900 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.333+0000 7efde4af7700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ebe0 tx=0x7efdd000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.334+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000c850 con 0x7efde0133900 2023-10-03T10:12:33.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.334+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000c9b0 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.334+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8009a70 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.334+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000cd40 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.334+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde009a2c0 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.335+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdd0013470 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.335+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde006f730 con 0x7efde0133900 2023-10-03T10:12:33.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.335+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdd003fa50 con 0x7efde0133900 2023-10-03T10:12:33.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.340+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdd0021020 con 0x7efde0133900 2023-10-03T10:12:33.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.367+0000 7f9e111b0700 1 Processor -- start 2023-10-03T10:12:33.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.367+0000 7f9e111b0700 1 -- start start 2023-10-03T10:12:33.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.367+0000 7f9e111b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a0a30 0x7f9e0c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.367+0000 7f9e111b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e111b0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0a1e70 con 0x7f9e0c0a1340 2023-10-03T10:12:33.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e111b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c09a720 con 0x7f9e0c130670 2023-10-03T10:12:33.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e111b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c09b300 con 0x7f9e0c0a0a30 2023-10-03T10:12:33.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a0a30 0x7f9e0c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9e0c0a1340 0x7f9e0c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33316/0 (socket says 172.21.15.125:33316) 2023-10-03T10:12:33.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0a59c700 1 -- 172.21.15.125:0/3683398317 learned_addr learned my addr 172.21.15.125:0/3683398317 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 -- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a0a30 msgr2=0x7f9e0c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 --2- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a0a30 0x7f9e0c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 -- 172.21.15.125:0/3683398317 >> v1:172.21.15.125:6789/0 conn(0x7f9e0c0a1340 legacy=0x7f9e0c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 -- 172.21.15.125:0/3683398317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c09abc0 con 0x7f9e0c130670 2023-10-03T10:12:33.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e0b59e700 1 --2- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1381c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400be60 tx=0x7f9e0400a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2382dccf3ad2688f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e09d9b700 1 -- 172.21.15.125:0/3683398317 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400cca0 con 0x7f9e0c130670 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e09d9b700 1 -- 172.21.15.125:0/3683398317 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0400ce00 con 0x7f9e0c130670 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.368+0000 7f9e09d9b700 1 -- 172.21.15.125:0/3683398317 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04013660 con 0x7f9e0c130670 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 -- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 msgr2=0x7f9e0c1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 --2- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1381c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400be60 tx=0x7f9e0400a400 comp rx=0 tx=0).stop 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 -- 172.21.15.125:0/3683398317 shutdown_connections 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 --2- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1381c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 --2- 172.21.15.125:0/3683398317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a0a30 0x7f9e0c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 -- 172.21.15.125:0/3683398317 >> 172.21.15.125:0/3683398317 conn(0x7f9e0c0a2980 msgr2=0x7f9e0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 -- 172.21.15.125:0/3683398317 shutdown_connections 2023-10-03T10:12:33.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.369+0000 7f9e111b0700 1 -- 172.21.15.125:0/3683398317 wait complete. 2023-10-03T10:12:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.370+0000 7f9e111b0700 1 Processor -- start 2023-10-03T10:12:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.370+0000 7f9e111b0700 1 -- start start 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 0x7f9e0c1c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 0x7f9e0c1c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c11bd70 con 0x7f9e0c0a0a30 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c11bb80 con 0x7f9e0c130670 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e111b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c09fe70 con 0x7f9e0c0a1340 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 0x7f9e0c1c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 0x7f9e0c1c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 0x7f9e0c1c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43916/0 (socket says 172.21.15.125:43916) 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59746/0 (socket says 172.21.15.125:59746) 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0a59c700 1 -- 172.21.15.125:0/143896115 learned_addr learned my addr 172.21.15.125:0/143896115 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 -- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 msgr2=0x7f9e0c1c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 0x7f9e0c1c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 -- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 msgr2=0x7f9e0c1c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 0x7f9e0c1c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.371+0000 7f9e0b59e700 1 -- 172.21.15.125:0/143896115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0400ba90 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9e0ad9d700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 0x7f9e0c1c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9e0b59e700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e04016000 tx=0x7f9e04004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04014cb0 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04014e10 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c09ae00 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04027650 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.372+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c11c7f0 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.373+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e040277b0 con 0x7f9e0c130670 2023-10-03T10:12:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.373+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e04041cc0 con 0x7f9e0c130670 2023-10-03T10:12:33.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.374+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c04f2a0 con 0x7f9e0c130670 2023-10-03T10:12:33.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.382+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e0402c080 con 0x7f9e0c130670 2023-10-03T10:12:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.404+0000 7f196dab1700 1 Processor -- start 2023-10-03T10:12:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.404+0000 7f196dab1700 1 -- start start 2023-10-03T10:12:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f196809dec0 0x7f196806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1968131a00 0x7f1968131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196806b5c0 con 0x7f196809dec0 2023-10-03T10:12:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196806e900 con 0x7f196806a770 2023-10-03T10:12:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f196dab1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f196809d180 con 0x7f1968131a00 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f19677fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.405+0000 7f19677fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59754/0 (socket says 172.21.15.125:59754) 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 -- 172.21.15.125:0/2323985793 learned_addr learned my addr 172.21.15.125:0/2323985793 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f1966ffd700 1 --2- 172.21.15.125:0/2323985793 >> v2:172.21.15.125:3300/0 conn(0x7f196809dec0 0x7f196806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f1967fff700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1968131a00 0x7f1968131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 -- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1968131a00 msgr2=0x7f1968131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1968131a00 0x7f1968131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 -- 172.21.15.125:0/2323985793 >> v2:172.21.15.125:3300/0 conn(0x7f196809dec0 msgr2=0x7f196806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 --2- 172.21.15.125:0/2323985793 >> v2:172.21.15.125:3300/0 conn(0x7f196809dec0 0x7f196806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 -- 172.21.15.125:0/2323985793 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196809e780 con 0x7f196806a770 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19677fe700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19580098f0 tx=0x7f1958009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612c73e65629de67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19667fc700 1 -- 172.21.15.125:0/2323985793 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958011830 con 0x7f196806a770 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19667fc700 1 -- 172.21.15.125:0/2323985793 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958011990 con 0x7f196806a770 2023-10-03T10:12:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.406+0000 7f19667fc700 1 -- 172.21.15.125:0/2323985793 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958011d20 con 0x7f196806a770 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 -- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 msgr2=0x7f196806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19580098f0 tx=0x7f1958009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 -- 172.21.15.125:0/2323985793 shutdown_connections 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196806a770 0x7f196806ab40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 --2- 172.21.15.125:0/2323985793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1968131a00 0x7f1968131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 --2- 172.21.15.125:0/2323985793 >> v2:172.21.15.125:3300/0 conn(0x7f196809dec0 0x7f196806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 -- 172.21.15.125:0/2323985793 >> 172.21.15.125:0/2323985793 conn(0x7f1968099c40 msgr2=0x7f19680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 -- 172.21.15.125:0/2323985793 shutdown_connections 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.407+0000 7f196dab1700 1 -- 172.21.15.125:0/2323985793 wait complete. 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.408+0000 7f196dab1700 1 Processor -- start 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.408+0000 7f196dab1700 1 -- start start 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196809dec0 0x7f196809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1968131a00 0x7f196809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196809b960 con 0x7f1968131a00 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196811eb40 con 0x7f196809dec0 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f196dab1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f196812d430 con 0x7f196806a770 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43930/0 (socket says 172.21.15.125:43930) 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 -- 172.21.15.125:0/2878468995 learned_addr learned my addr 172.21.15.125:0/2878468995 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f1967fff700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1968131a00 0x7f196809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f1966ffd700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196809dec0 0x7f196809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 -- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196809dec0 msgr2=0x7f196809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196809dec0 0x7f196809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 -- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1968131a00 msgr2=0x7f196809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1968131a00 0x7f196809af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.409+0000 7f19677fe700 1 -- 172.21.15.125:0/2878468995 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009550 con 0x7f196806a770 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f19677fe700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1958000c00 tx=0x7f1958004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958004240 con 0x7f196806a770 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195801f070 con 0x7f196806a770 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f196dab1700 1 -- 172.21.15.125:0/2878468995 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196811f5e0 con 0x7f196806a770 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19580045e0 con 0x7f196806a770 2023-10-03T10:12:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.410+0000 7f196dab1700 1 -- 172.21.15.125:0/2878468995 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1968071ce0 con 0x7f196806a770 2023-10-03T10:12:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.411+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1958021030 con 0x7f196806a770 2023-10-03T10:12:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.411+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1958040b30 con 0x7f196806a770 2023-10-03T10:12:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.411+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19400052e0 con 0x7f196806a770 2023-10-03T10:12:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.420+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1958015030 con 0x7f196806a770 2023-10-03T10:12:33.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.471+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9a009f0f0 con 0x7fa9a0136960 2023-10-03T10:12:33.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.472+0000 7fa995ffb700 1 -- 172.21.15.125:0/3157886217 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa990017020 con 0x7fa9a0136960 2023-10-03T10:12:33.473 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 msgr2=0x7fa9a012d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa99000ebe0 tx=0x7fa99000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 shutdown_connections 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a0139280 0x7fa9a012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9a0133ad0 0x7fa9a012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 --2- 172.21.15.125:0/3157886217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9a0136960 0x7fa9a012d070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 >> 172.21.15.125:0/3157886217 conn(0x7fa9a0099c40 msgr2=0x7fa9a01385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 shutdown_connections 2023-10-03T10:12:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.475+0000 7fa9a7968700 1 -- 172.21.15.125:0/3157886217 wait complete. 2023-10-03T10:12:33.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:33.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.544+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efde004f2a0 con 0x7efde0133900 2023-10-03T10:12:33.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.544+0000 7efdd5ffb700 1 -- 172.21.15.125:0/739000904 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdd000cea0 con 0x7efde0133900 2023-10-03T10:12:33.546 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 msgr2=0x7efde0119ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ebe0 tx=0x7efdd000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 shutdown_connections 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efde0134210 0x7efde0119ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efde00a0ee0 0x7efde0119570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 --2- 172.21.15.125:0/739000904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde0133900 0x7efde0119ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 >> 172.21.15.125:0/739000904 conn(0x7efde00a2980 msgr2=0x7efde01308b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 shutdown_connections 2023-10-03T10:12:33.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.547+0000 7efde755c700 1 -- 172.21.15.125:0/739000904 wait complete. 2023-10-03T10:12:33.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.579+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e0c06bce0 con 0x7f9e0c130670 2023-10-03T10:12:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.580+0000 7f9df37fe700 1 -- 172.21.15.125:0/143896115 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e04027a60 con 0x7f9e0c130670 2023-10-03T10:12:33.580 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 msgr2=0x7f9e0c1c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e04016000 tx=0x7f9e04004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 shutdown_connections 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e0c130670 0x7f9e0c1c4890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e0c0a0a30 0x7f9e0c1c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 --2- 172.21.15.125:0/143896115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e0c0a1340 0x7f9e0c1c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 >> 172.21.15.125:0/143896115 conn(0x7f9e0c0a2980 msgr2=0x7f9e0c12f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 shutdown_connections 2023-10-03T10:12:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.582+0000 7f9e111b0700 1 -- 172.21.15.125:0/143896115 wait complete. 2023-10-03T10:12:33.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:33.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.625+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1940005590 con 0x7f196806a770 2023-10-03T10:12:33.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.625+0000 7f194ffff700 1 -- 172.21.15.125:0/2878468995 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f195801a450 con 0x7f196806a770 2023-10-03T10:12:33.626 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 msgr2=0x7f196809a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1958000c00 tx=0x7f1958004750 comp rx=0 tx=0).stop 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 shutdown_connections 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1968131a00 0x7f196809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f196806a770 0x7f196809a490 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 --2- 172.21.15.125:0/2878468995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f196809dec0 0x7f196809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 >> 172.21.15.125:0/2878468995 conn(0x7f1968099c40 msgr2=0x7f196812ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.627+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 shutdown_connections 2023-10-03T10:12:33.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:33.628+0000 7f194dffb700 1 -- 172.21.15.125:0/2878468995 wait complete. 2023-10-03T10:12:33.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:34.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:34.565 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:34.595 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:34.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.630+0000 7ff2ec316700 1 Processor -- start 2023-10-03T10:12:34.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.630+0000 7ff2ec316700 1 -- start start 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.630+0000 7ff2ec316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 0x7ff2e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.630+0000 7ff2ec316700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ec316700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e409aaa0 con 0x7ff2e4130ce0 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ec316700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e409f870 con 0x7ff2e409e170 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ec316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e409b360 con 0x7ff2e409d860 2023-10-03T10:12:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e98b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 0x7ff2e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e98b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52776/0 (socket says 172.21.15.125:52776) 2023-10-03T10:12:34.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e98b1700 1 -- 172.21.15.125:0/3813421240 learned_addr learned my addr 172.21.15.125:0/3813421240 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/3813421240 >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 msgr2=0x7ff2e41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 --2- 172.21.15.125:0/3813421240 >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/3813421240 >> v1:172.21.15.125:6789/0 conn(0x7ff2e4130ce0 legacy=0x7ff2e41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e90b0700 1 -- 172.21.15.125:0/3813421240 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244931661 0 0) 0x7ff2e409aaa0 con 0x7ff2e4130ce0 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/3813421240 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e409b620 con 0x7ff2e409d860 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e98b1700 1 --2- 172.21.15.125:0/3813421240 >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2ea0b2700 1 --2- 172.21.15.125:0/3813421240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 0x7ff2e409dc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009840 tx=0x7ff2e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a3cd716b7acb0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e90b0700 1 -- 172.21.15.125:0/3813421240 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011830 con 0x7ff2e409d860 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e90b0700 1 -- 172.21.15.125:0/3813421240 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0011990 con 0x7ff2e409d860 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.631+0000 7ff2e90b0700 1 -- 172.21.15.125:0/3813421240 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011d20 con 0x7ff2e409d860 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 -- 172.21.15.125:0/3813421240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 msgr2=0x7ff2e409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 --2- 172.21.15.125:0/3813421240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 0x7ff2e409dc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009840 tx=0x7ff2e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 -- 172.21.15.125:0/3813421240 shutdown_connections 2023-10-03T10:12:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 --2- 172.21.15.125:0/3813421240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e409d860 0x7ff2e409dc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 --2- 172.21.15.125:0/3813421240 >> v2:172.21.15.125:3300/0 conn(0x7ff2e409e170 0x7ff2e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 -- 172.21.15.125:0/3813421240 >> 172.21.15.125:0/3813421240 conn(0x7ff2e4099c40 msgr2=0x7ff2e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 -- 172.21.15.125:0/3813421240 shutdown_connections 2023-10-03T10:12:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.632+0000 7ff2ec316700 1 -- 172.21.15.125:0/3813421240 wait complete. 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.633+0000 7ff2ec316700 1 Processor -- start 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.633+0000 7ff2ec316700 1 -- start start 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e409e170 0x7ff2e4135a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 0x7ff2e4135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4138a60 con 0x7ff2e409d860 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4138790 con 0x7ff2e409e170 2023-10-03T10:12:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ec316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41378e0 con 0x7ff2e4130ce0 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52788/0 (socket says 172.21.15.125:52788) 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/1344105682 learned_addr learned my addr 172.21.15.125:0/1344105682 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2e98b1700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e409e170 0x7ff2e4135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea8b3700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 0x7ff2e4135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 msgr2=0x7ff2e4135f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 0x7ff2e4135f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e409e170 msgr2=0x7ff2e4135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e409e170 0x7ff2e4135a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea0b2700 1 -- 172.21.15.125:0/1344105682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4009550 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.634+0000 7ff2ea8b3700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 0x7ff2e4135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2ea0b2700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fd0 tx=0x7ff2e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00036a0 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e001f070 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00094a0 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0003a20 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.635+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e41375c0 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.636+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2e0003b80 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.636+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2e0021070 con 0x7ff2e409d860 2023-10-03T10:12:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.636+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e404f2a0 con 0x7ff2e409d860 2023-10-03T10:12:34.641 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.641+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2e0003e30 con 0x7ff2e409d860 2023-10-03T10:12:34.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.701+0000 7f09f38ed700 1 Processor -- start 2023-10-03T10:12:34.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 -- start start 2023-10-03T10:12:34.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 0x7f09ec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec0a1640 con 0x7f09ec09bc70 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec06eb30 con 0x7f09ec09c790 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f38ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0a22d0 con 0x7f09ec131980 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f1e8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f1689700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 0x7f09ec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f1e8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59772/0 (socket says 172.21.15.125:59772) 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2867694596 learned_addr learned my addr 172.21.15.125:0/2867694596 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.702+0000 7f09f0e88700 1 --1- 172.21.15.125:0/2867694596 >> v1:172.21.15.125:6789/0 conn(0x7f09ec09bc70 0x7f09ec09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33342/0 (socket says 172.21.15.125:33342) 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09e3fff700 1 -- 172.21.15.125:0/2867694596 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888609321 0 0) 0x7f09ec0a1640 con 0x7f09ec09bc70 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09e3fff700 1 -- 172.21.15.125:0/2867694596 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d80035b0 con 0x7f09ec09bc70 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 msgr2=0x7f09ec131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1e8a700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 0x7f09ec131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2867694596 >> v1:172.21.15.125:6789/0 conn(0x7f09ec09bc70 legacy=0x7f09ec09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2867694596 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec131550 con 0x7f09ec09c790 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1689700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 0x7f09ec131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09f1e8a700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009e80 tx=0x7f09e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c5344c52c50125 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09e3fff700 1 -- 172.21.15.125:0/2867694596 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e400e070 con 0x7f09ec09c790 2023-10-03T10:12:34.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09e3fff700 1 -- 172.21.15.125:0/2867694596 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e400b910 con 0x7f09ec09c790 2023-10-03T10:12:34.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.703+0000 7f09e3fff700 1 -- 172.21.15.125:0/2867694596 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e400bc80 con 0x7f09ec09c790 2023-10-03T10:12:34.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 -- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 msgr2=0x7f09ec139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009e80 tx=0x7f09e400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:34.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 -- 172.21.15.125:0/2867694596 shutdown_connections 2023-10-03T10:12:34.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec139710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2867694596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec131980 0x7f09ec131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 -- 172.21.15.125:0/2867694596 >> 172.21.15.125:0/2867694596 conn(0x7f09ec0a2980 msgr2=0x7f09ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 -- 172.21.15.125:0/2867694596 shutdown_connections 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.704+0000 7f09f38ed700 1 -- 172.21.15.125:0/2867694596 wait complete. 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.705+0000 7f09f38ed700 1 Processor -- start 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.705+0000 7f09f38ed700 1 -- start start 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec09bc70 0x7f09ec1195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec119ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec11da80 con 0x7f09ec131980 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec11b1b0 con 0x7f09ec09c790 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f38ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec11b7d0 con 0x7f09ec09bc70 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f1e8a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f1e8a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52802/0 (socket says 172.21.15.125:52802) 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f1689700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec09bc70 0x7f09ec1195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2314666300 learned_addr learned my addr 172.21.15.125:0/2314666300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.706+0000 7f09f0e88700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec119ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec09bc70 msgr2=0x7f09ec1195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec09bc70 0x7f09ec1195a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 msgr2=0x7f09ec119ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec119ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 -- 172.21.15.125:0/2314666300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009430 con 0x7f09ec131980 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f1e8a700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09e400b680 tx=0x7f09e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40092e0 con 0x7f09ec131980 2023-10-03T10:12:34.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4003e10 con 0x7f09ec131980 2023-10-03T10:12:34.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e4009b30 con 0x7f09ec131980 2023-10-03T10:12:34.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40048d0 con 0x7f09ec131980 2023-10-03T10:12:34.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.707+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec130a60 con 0x7f09ec131980 2023-10-03T10:12:34.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.708+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09e401c440 con 0x7f09ec131980 2023-10-03T10:12:34.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.708+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec04f2a0 con 0x7f09ec131980 2023-10-03T10:12:34.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.709+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09e4040ea0 con 0x7f09ec131980 2023-10-03T10:12:34.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.717+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09e40249a0 con 0x7f09ec131980 2023-10-03T10:12:34.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.752+0000 7fcd50aeb700 1 Processor -- start 2023-10-03T10:12:34.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.752+0000 7fcd50aeb700 1 -- start start 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a1340 0x7fcd4c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c1304a0 0x7fcd4c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c130e30 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0a1e70 con 0x7fcd4c1304a0 2023-10-03T10:12:34.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd50aeb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c09a720 con 0x7fcd4c0a1340 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52812/0 (socket says 172.21.15.125:52812) 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd4a59c700 1 -- 172.21.15.125:0/425465603 learned_addr learned my addr 172.21.15.125:0/425465603 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd4ad9d700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c1304a0 0x7fcd4c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.753+0000 7fcd49d9b700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a1340 0x7fcd4c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 -- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a1340 msgr2=0x7fcd4c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a1340 0x7fcd4c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 -- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c1304a0 msgr2=0x7fcd4c1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c1304a0 0x7fcd4c1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 -- 172.21.15.125:0/425465603 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c09b300 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4a59c700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fd0 tx=0x7fcd3c00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498489391289277c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4959a700 1 -- 172.21.15.125:0/425465603 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c005e30 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4959a700 1 -- 172.21.15.125:0/425465603 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c004030 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.754+0000 7fcd4959a700 1 -- 172.21.15.125:0/425465603 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0043e0 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 -- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c0a0a30 msgr2=0x7fcd4c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fd0 tx=0x7fcd3c00ad70 comp rx=0 tx=0).stop 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 -- 172.21.15.125:0/425465603 shutdown_connections 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c1304a0 0x7fcd4c1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c0a0a30 0x7fcd4c0a0e00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/425465603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a1340 0x7fcd4c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 -- 172.21.15.125:0/425465603 >> 172.21.15.125:0/425465603 conn(0x7fcd4c0a2980 msgr2=0x7fcd4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 -- 172.21.15.125:0/425465603 shutdown_connections 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.755+0000 7fcd50aeb700 1 -- 172.21.15.125:0/425465603 wait complete. 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 Processor -- start 2023-10-03T10:12:34.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 -- start start 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 0x7fcd4c1c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 0x7fcd4c1c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 0x7fcd4c1c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c11fda0 con 0x7fcd4c1304a0 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c11fbb0 con 0x7fcd4c0a1340 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.756+0000 7fcd50aeb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c120890 con 0x7fcd4c0a0a30 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 0x7fcd4c1c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 0x7fcd4c1c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43958/0 (socket says 172.21.15.125:43958) 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4a59c700 1 -- 172.21.15.125:0/3700827763 learned_addr learned my addr 172.21.15.125:0/3700827763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 0x7fcd4c1c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd49d9b700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 0x7fcd4c1c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 -- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 msgr2=0x7fcd4c1c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 0x7fcd4c1c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 -- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 msgr2=0x7fcd4c1c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 0x7fcd4c1c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 -- 172.21.15.125:0/3700827763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c00a6a0 con 0x7fcd4c1304a0 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd49d9b700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 0x7fcd4c1c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd4ad9d700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 0x7fcd4c1c4850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44009c00 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4400f040 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44014480 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.757+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c09ae00 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.758+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1217e0 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.759+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c121480 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.759+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd440145e0 con 0x7fcd4c1304a0 2023-10-03T10:12:34.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.759+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd44040210 con 0x7fcd4c1304a0 2023-10-03T10:12:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.768+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd4c121480 con 0x7fcd4c1304a0 2023-10-03T10:12:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.778+0000 7f95cd111700 1 Processor -- start 2023-10-03T10:12:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.778+0000 7f95cd111700 1 -- start start 2023-10-03T10:12:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95cd111700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95c809f350 0x7f95c8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95cd111700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95cd111700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c806bec0 con 0x7f95c809e870 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95cd111700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c806ce60 con 0x7f95c809f350 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95cd111700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c809fa00 con 0x7f95c8139480 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59794/0 (socket says 172.21.15.125:59794) 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 -- 172.21.15.125:0/2243098063 learned_addr learned my addr 172.21.15.125:0/2243098063 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c659c700 1 --2- 172.21.15.125:0/2243098063 >> v2:172.21.15.125:3300/0 conn(0x7f95c809f350 0x7f95c8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 -- 172.21.15.125:0/2243098063 >> v2:172.21.15.125:3300/0 conn(0x7f95c809f350 msgr2=0x7f95c8138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 --2- 172.21.15.125:0/2243098063 >> v2:172.21.15.125:3300/0 conn(0x7f95c809f350 0x7f95c8138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 -- 172.21.15.125:0/2243098063 >> v1:172.21.15.125:6789/0 conn(0x7f95c809e870 legacy=0x7f95c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.779+0000 7f95c759e700 1 -- 172.21.15.125:0/2243098063 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c809ad80 con 0x7f95c8139480 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95c759e700 1 --2- 172.21.15.125:0/2243098063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009e50 tx=0x7f95c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3797d620c4b3035 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95c5d9b700 1 -- 172.21.15.125:0/2243098063 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c000e070 con 0x7f95c8139480 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95c5d9b700 1 -- 172.21.15.125:0/2243098063 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c000b910 con 0x7f95c8139480 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95c5d9b700 1 -- 172.21.15.125:0/2243098063 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c000bcc0 con 0x7f95c8139480 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 -- 172.21.15.125:0/2243098063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 msgr2=0x7f95c813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 --2- 172.21.15.125:0/2243098063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009e50 tx=0x7f95c000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:34.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 -- 172.21.15.125:0/2243098063 shutdown_connections 2023-10-03T10:12:34.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 --2- 172.21.15.125:0/2243098063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c813b860 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 --2- 172.21.15.125:0/2243098063 >> v2:172.21.15.125:3300/0 conn(0x7f95c809f350 0x7f95c8138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.780+0000 7f95cd111700 1 -- 172.21.15.125:0/2243098063 >> 172.21.15.125:0/2243098063 conn(0x7f95c80a4430 msgr2=0x7f95c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.781+0000 7f95cd111700 1 -- 172.21.15.125:0/2243098063 shutdown_connections 2023-10-03T10:12:34.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.781+0000 7f95cd111700 1 -- 172.21.15.125:0/2243098063 wait complete. 2023-10-03T10:12:34.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 Processor -- start 2023-10-03T10:12:34.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 -- start start 2023-10-03T10:12:34.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95c809e870 0x7f95c811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c806cfa0 con 0x7f95c809f350 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81206c0 con 0x7f95c8139480 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95cd111700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81221e0 con 0x7f95c809e870 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.782+0000 7f95c659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52856/0 (socket says 172.21.15.125:52856) 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 -- 172.21.15.125:0/2355702160 learned_addr learned my addr 172.21.15.125:0/2355702160 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c759e700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c6d9d700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95c809e870 0x7f95c811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 -- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95c809e870 msgr2=0x7f95c811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95c809e870 0x7f95c811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 -- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 msgr2=0x7f95c811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 -- 172.21.15.125:0/2355702160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0009b30 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95c659c700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e9e0 tx=0x7f95bc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc009710 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00ee80 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c806f8f0 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00ca50 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.783+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c8122c50 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.784+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c804f2a0 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.785+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95bc00cbb0 con 0x7f95c809f350 2023-10-03T10:12:34.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.785+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95bc03fa90 con 0x7f95c809f350 2023-10-03T10:12:34.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.794+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95bc01b3b0 con 0x7f95c809f350 2023-10-03T10:12:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.848+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2e406c3b0 con 0x7ff2e409d860 2023-10-03T10:12:34.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.849+0000 7ff2daffd700 1 -- 172.21.15.125:0/1344105682 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2e002eb90 con 0x7ff2e409d860 2023-10-03T10:12:34.849 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 msgr2=0x7ff2e41354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fd0 tx=0x7ff2e0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 shutdown_connections 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4130ce0 0x7ff2e4135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e409d860 0x7ff2e41354e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 --2- 172.21.15.125:0/1344105682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e409e170 0x7ff2e4135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 >> 172.21.15.125:0/1344105682 conn(0x7ff2e4099c40 msgr2=0x7ff2e41393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 shutdown_connections 2023-10-03T10:12:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.851+0000 7ff2ec316700 1 -- 172.21.15.125:0/1344105682 wait complete. 2023-10-03T10:12:34.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:34.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.929+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09ec06bce0 con 0x7f09ec131980 2023-10-03T10:12:34.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.929+0000 7f09e1ffb700 1 -- 172.21.15.125:0/2314666300 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09e40243b0 con 0x7f09ec131980 2023-10-03T10:12:34.930 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 msgr2=0x7f09ec11a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09e400b680 tx=0x7f09e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 shutdown_connections 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09ec131980 0x7f09ec11a020 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09ec09bc70 0x7f09ec1195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 --2- 172.21.15.125:0/2314666300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09ec09c790 0x7f09ec119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 >> 172.21.15.125:0/2314666300 conn(0x7f09ec0a2980 msgr2=0x7f09ec12e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 shutdown_connections 2023-10-03T10:12:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.932+0000 7f09f38ed700 1 -- 172.21.15.125:0/2314666300 wait complete. 2023-10-03T10:12:34.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.966+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd4c121480 con 0x7fcd4c1304a0 2023-10-03T10:12:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.967+0000 7fcd3affd700 1 -- 172.21.15.125:0/3700827763 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd4c121480 con 0x7fcd4c1304a0 2023-10-03T10:12:34.967 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 msgr2=0x7fcd4c1c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 0x7fcd4c1c4850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 shutdown_connections 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c1304a0 0x7fcd4c1c4850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd4c0a0a30 0x7fcd4c1c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 --2- 172.21.15.125:0/3700827763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0a1340 0x7fcd4c1c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 >> 172.21.15.125:0/3700827763 conn(0x7fcd4c0a2980 msgr2=0x7fcd4c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 shutdown_connections 2023-10-03T10:12:34.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.969+0000 7fcd50aeb700 1 -- 172.21.15.125:0/3700827763 wait complete. 2023-10-03T10:12:34.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.987+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95c8072d60 con 0x7f95c809f350 2023-10-03T10:12:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.987+0000 7f95af7fe700 1 -- 172.21.15.125:0/2355702160 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95bc017020 con 0x7f95c809f350 2023-10-03T10:12:34.987 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:34.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 msgr2=0x7f95c811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e9e0 tx=0x7f95bc00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 shutdown_connections 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95c8139480 0x7f95c811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95c809e870 0x7f95c811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 --2- 172.21.15.125:0/2355702160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95c809f350 0x7f95c811f010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 >> 172.21.15.125:0/2355702160 conn(0x7f95c80a4430 msgr2=0x7f95c80a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 shutdown_connections 2023-10-03T10:12:34.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:34.989+0000 7f95cd111700 1 -- 172.21.15.125:0/2355702160 wait complete. 2023-10-03T10:12:35.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:35.864 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:35.944 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:35.982 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:36.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 Processor -- start 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 -- start start 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 0x7f71f0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 0x7f71f013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f006b2d0 con 0x7f71f01300a0 2023-10-03T10:12:36.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f0133610 con 0x7f71f0133ad0 2023-10-03T10:12:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71f55d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f009a500 con 0x7f71f0130bc0 2023-10-03T10:12:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71eeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 0x7f71f0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71ef7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 0x7f71f013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71eeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 0x7f71f0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60602/0 (socket says 172.21.15.125:60602) 2023-10-03T10:12:36.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.006+0000 7f71eeffd700 1 -- 172.21.15.125:0/3288230877 learned_addr learned my addr 172.21.15.125:0/3288230877 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71ef7fe700 1 -- 172.21.15.125:0/3288230877 >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 msgr2=0x7f71f0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71ef7fe700 1 --2- 172.21.15.125:0/3288230877 >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 0x7f71f0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71ef7fe700 1 -- 172.21.15.125:0/3288230877 >> v1:172.21.15.125:6789/0 conn(0x7f71f01300a0 legacy=0x7f71f01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71ef7fe700 1 -- 172.21.15.125:0/3288230877 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f01338b0 con 0x7f71f0130bc0 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71edffb700 1 -- 172.21.15.125:0/3288230877 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304860569 0 0) 0x7f71f006b2d0 con 0x7f71f01300a0 2023-10-03T10:12:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71ef7fe700 1 --2- 172.21.15.125:0/3288230877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 0x7f71f013b990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb11ee20600cd7af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71edffb700 1 -- 172.21.15.125:0/3288230877 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800e070 con 0x7f71f0130bc0 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71edffb700 1 -- 172.21.15.125:0/3288230877 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e800bb20 con 0x7f71f0130bc0 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.007+0000 7f71edffb700 1 -- 172.21.15.125:0/3288230877 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8012430 con 0x7f71f0130bc0 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 -- 172.21.15.125:0/3288230877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 msgr2=0x7f71f013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 --2- 172.21.15.125:0/3288230877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 0x7f71f013b990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 -- 172.21.15.125:0/3288230877 shutdown_connections 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 --2- 172.21.15.125:0/3288230877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0130bc0 0x7f71f013b990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 --2- 172.21.15.125:0/3288230877 >> v2:172.21.15.125:3300/0 conn(0x7f71f0133ad0 0x7f71f0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.008+0000 7f71f55d8700 1 -- 172.21.15.125:0/3288230877 >> 172.21.15.125:0/3288230877 conn(0x7f71f0099c40 msgr2=0x7f71f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.009+0000 7f71f55d8700 1 -- 172.21.15.125:0/3288230877 shutdown_connections 2023-10-03T10:12:36.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.009+0000 7f71f55d8700 1 -- 172.21.15.125:0/3288230877 wait complete. 2023-10-03T10:12:36.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.010+0000 7f71f55d8700 1 Processor -- start 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.010+0000 7f71f55d8700 1 -- start start 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f01300a0 0x7f71f0071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 0x7f71f0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011dfb0 con 0x7f71f01300a0 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011ee20 con 0x7f71f0133ad0 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71f55d8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011f900 con 0x7f71f0130bc0 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38768/0 (socket says 172.21.15.125:38768) 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 -- 172.21.15.125:0/4151433451 learned_addr learned my addr 172.21.15.125:0/4151433451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71eeffd700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f01300a0 0x7f71f0071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ef7fe700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 0x7f71f0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 -- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 msgr2=0x7f71f0071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 0x7f71f0071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 -- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f01300a0 msgr2=0x7f71f0071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f01300a0 0x7f71f0071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 -- 172.21.15.125:0/4151433451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009a70 con 0x7f71f0130bc0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ef7fe700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 0x7f71f0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.011+0000 7f71ee7fc700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001eb0 tx=0x7f71e400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.012+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40054e0 con 0x7f71f0130bc0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.012+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4003680 con 0x7f71f0130bc0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.012+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f011f630 con 0x7f71f0130bc0 2023-10-03T10:12:36.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.012+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40039f0 con 0x7f71f0130bc0 2023-10-03T10:12:36.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.012+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f011fbc0 con 0x7f71f0130bc0 2023-10-03T10:12:36.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.013+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71e4003b50 con 0x7f71f0130bc0 2023-10-03T10:12:36.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.013+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71e403eb50 con 0x7f71f0130bc0 2023-10-03T10:12:36.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.013+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f009cb20 con 0x7f71f0130bc0 2023-10-03T10:12:36.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.020+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71e401b3b0 con 0x7f71f0130bc0 2023-10-03T10:12:36.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.079+0000 7ff1a2060700 1 Processor -- start 2023-10-03T10:12:36.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.079+0000 7ff1a2060700 1 -- start start 2023-10-03T10:12:36.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff1a2060700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 0x7ff19c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff1a2060700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c134570 0x7ff19c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff1a2060700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c09b110 con 0x7ff19c09ad40 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff1a2060700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0a3b60 con 0x7ff19c134140 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff1a2060700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0a1a80 con 0x7ff19c134570 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff19b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff19c09ad40 0x7ff19c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57942/0 (socket says 172.21.15.125:57942) 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff19b7fe700 1 -- 172.21.15.125:0/2460568690 learned_addr learned my addr 172.21.15.125:0/2460568690 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff19bfff700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c134570 0x7ff19c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.080+0000 7ff19affd700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 0x7ff19c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19affd700 1 -- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c134570 msgr2=0x7ff19c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19affd700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c134570 0x7ff19c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19affd700 1 -- 172.21.15.125:0/2460568690 >> v1:172.21.15.125:6789/0 conn(0x7ff19c09ad40 legacy=0x7ff19c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19affd700 1 -- 172.21.15.125:0/2460568690 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0a2fa0 con 0x7ff19c134140 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19affd700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 0x7ff19c138e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1900098a0 tx=0x7ff190009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2bff12e03e9998d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19a7fc700 1 -- 172.21.15.125:0/2460568690 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011830 con 0x7ff19c134140 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19a7fc700 1 -- 172.21.15.125:0/2460568690 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190011990 con 0x7ff19c134140 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.081+0000 7ff19a7fc700 1 -- 172.21.15.125:0/2460568690 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011d20 con 0x7ff19c134140 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 -- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 msgr2=0x7ff19c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 0x7ff19c138e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1900098a0 tx=0x7ff190009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 -- 172.21.15.125:0/2460568690 shutdown_connections 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c134570 0x7ff19c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 --2- 172.21.15.125:0/2460568690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134140 0x7ff19c138e80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 -- 172.21.15.125:0/2460568690 >> 172.21.15.125:0/2460568690 conn(0x7ff19c099c40 msgr2=0x7ff19c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 -- 172.21.15.125:0/2460568690 shutdown_connections 2023-10-03T10:12:36.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.082+0000 7ff1a2060700 1 -- 172.21.15.125:0/2460568690 wait complete. 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 Processor -- start 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 -- start start 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 0x7ff19c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff19c134140 0x7ff19c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c13a8a0 con 0x7ff19c134140 2023-10-03T10:12:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09e9c0 con 0x7ff19c134570 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.083+0000 7ff1a2060700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09c7e0 con 0x7ff19c09ad40 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59272/0 (socket says 172.21.15.125:59272) 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 -- 172.21.15.125:0/1028220099 learned_addr learned my addr 172.21.15.125:0/1028220099 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19affd700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff19c134140 0x7ff19c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19b7fe700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 0x7ff19c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 -- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 msgr2=0x7ff19c11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 0x7ff19c11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 -- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff19c134140 msgr2=0x7ff19c11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff19c134140 0x7ff19c11ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 -- 172.21.15.125:0/1028220099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900094a0 con 0x7ff19c134570 2023-10-03T10:12:36.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19b7fe700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 0x7ff19c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.084+0000 7ff19bfff700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff194009e30 tx=0x7ff19400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.085+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194009ca0 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.085+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19400f040 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.085+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194014480 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.085+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c11f9a0 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.085+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c11e370 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.086+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c04f2a0 con 0x7ff19c134570 2023-10-03T10:12:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.086+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1940145e0 con 0x7ff19c134570 2023-10-03T10:12:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.087+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff1940407c0 con 0x7ff19c134570 2023-10-03T10:12:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.095+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff194012930 con 0x7ff19c134570 2023-10-03T10:12:36.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.122+0000 7f0b5567b700 1 Processor -- start 2023-10-03T10:12:36.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.122+0000 7f0b5567b700 1 -- start start 2023-10-03T10:12:36.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0b501300a0 0x7f0b501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 0x7f0b5013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006b2d0 con 0x7f0b501300a0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50133610 con 0x7f0b50133ad0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b5567b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5009a500 con 0x7f0b501309f0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59282/0 (socket says 172.21.15.125:59282) 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4effd700 1 -- 172.21.15.125:0/2850158910 learned_addr learned my addr 172.21.15.125:0/2850158910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 0x7f0b5013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4e7fc700 1 --2- 172.21.15.125:0/2850158910 >> v2:172.21.15.125:3300/0 conn(0x7f0b501300a0 0x7f0b501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 -- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 msgr2=0x7f0b50133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 -- 172.21.15.125:0/2850158910 >> v2:172.21.15.125:3300/0 conn(0x7f0b501300a0 msgr2=0x7f0b501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 --2- 172.21.15.125:0/2850158910 >> v2:172.21.15.125:3300/0 conn(0x7f0b501300a0 0x7f0b501304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4f7fe700 1 -- 172.21.15.125:0/2850158910 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b501338b0 con 0x7f0b501309f0 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.123+0000 7f0b4effd700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b4f7fe700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 0x7f0b5013a980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99fd0b6bfffffab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b4dffb700 1 -- 172.21.15.125:0/2850158910 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800e070 con 0x7f0b501309f0 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b4dffb700 1 -- 172.21.15.125:0/2850158910 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4800bb20 con 0x7f0b501309f0 2023-10-03T10:12:36.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b4dffb700 1 -- 172.21.15.125:0/2850158910 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48012430 con 0x7f0b501309f0 2023-10-03T10:12:36.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 -- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 msgr2=0x7f0b5013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 0x7f0b5013a980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:36.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 -- 172.21.15.125:0/2850158910 shutdown_connections 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b50133ad0 0x7f0b50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 --2- 172.21.15.125:0/2850158910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b501309f0 0x7f0b5013a980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 --2- 172.21.15.125:0/2850158910 >> v2:172.21.15.125:3300/0 conn(0x7f0b501300a0 0x7f0b501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 -- 172.21.15.125:0/2850158910 >> 172.21.15.125:0/2850158910 conn(0x7f0b50099c40 msgr2=0x7f0b500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.124+0000 7f0b5567b700 1 -- 172.21.15.125:0/2850158910 shutdown_connections 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.125+0000 7f0b5567b700 1 -- 172.21.15.125:0/2850158910 wait complete. 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 Processor -- start 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 -- start start 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 0x7f0b5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b50133ad0 0x7f0b5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50120eb0 con 0x7f0b501309f0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501201d0 con 0x7f0b501300a0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b5567b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5012dd00 con 0x7f0b50133ad0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59290/0 (socket says 172.21.15.125:59290) 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b4effd700 1 -- 172.21.15.125:0/972277814 learned_addr learned my addr 172.21.15.125:0/972277814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b4e7fc700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 0x7f0b5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.126+0000 7f0b4f7fe700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b50133ad0 0x7f0b5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 -- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b50133ad0 msgr2=0x7f0b5011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b50133ad0 0x7f0b5011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 -- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 msgr2=0x7f0b5011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 0x7f0b5011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 -- 172.21.15.125:0/972277814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009550 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4e7fc700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 0x7f0b5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b4effd700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000ec10 tx=0x7f0b4000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000c850 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000c9b0 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000cd40 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b48009a70 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.127+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5012d4b0 con 0x7f0b501300a0 2023-10-03T10:12:36.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.128+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5009d270 con 0x7f0b501300a0 2023-10-03T10:12:36.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.129+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b40013470 con 0x7f0b501300a0 2023-10-03T10:12:36.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.129+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b40040000 con 0x7f0b501300a0 2023-10-03T10:12:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.133+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b40013720 con 0x7f0b501300a0 2023-10-03T10:12:36.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.144+0000 7fc0ea77d700 1 Processor -- start 2023-10-03T10:12:36.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.144+0000 7fc0ea77d700 1 -- start start 2023-10-03T10:12:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0ea77d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0e40a0a70 0x7fc0e40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0ea77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e4134120 0x7fc0e413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0ea77d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e409dc00 con 0x7fc0e40a1380 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0ea77d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e409ea90 con 0x7fc0e40a0a70 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0ea77d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e409dec0 con 0x7fc0e4134120 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0e40a0a70 0x7fc0e40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0e40a0a70 0x7fc0e40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60630/0 (socket says 172.21.15.125:60630) 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1037474053 learned_addr learned my addr 172.21.15.125:0/1037474053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e8d1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e4134120 0x7fc0e413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e4134120 msgr2=0x7fc0e413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 --2- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e4134120 0x7fc0e413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1037474053 >> v1:172.21.15.125:6789/0 conn(0x7fc0e40a1380 legacy=0x7fc0e4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.145+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1037474053 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e409e6a0 con 0x7fc0e40a0a70 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0e3fff700 1 --2- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e40a0e40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098f0 tx=0x7fc0d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dd596744be3ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0e2ffd700 1 -- 172.21.15.125:0/1037474053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8011830 con 0x7fc0e40a0a70 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0e2ffd700 1 -- 172.21.15.125:0/1037474053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8011990 con 0x7fc0e40a0a70 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0e2ffd700 1 -- 172.21.15.125:0/1037474053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8011d20 con 0x7fc0e40a0a70 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 msgr2=0x7fc0e40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e40a0e40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098f0 tx=0x7fc0d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1037474053 shutdown_connections 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e4134120 0x7fc0e413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1037474053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e40a0e40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1037474053 >> 172.21.15.125:0/1037474053 conn(0x7fc0e40a6610 msgr2=0x7fc0e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1037474053 shutdown_connections 2023-10-03T10:12:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.146+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1037474053 wait complete. 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 Processor -- start 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 -- start start 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 0x7fc0e4122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 0x7fc0e4123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4126160 con 0x7fc0e40a0a70 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4133aa0 con 0x7fc0e40a1380 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.148+0000 7fc0ea77d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41334b0 con 0x7fc0e4134120 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60632/0 (socket says 172.21.15.125:60632) 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e8d1a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 0x7fc0e4123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1206420254 learned_addr learned my addr 172.21.15.125:0/1206420254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e37fe700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 0x7fc0e4122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 msgr2=0x7fc0e4123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 0x7fc0e4123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 msgr2=0x7fc0e4122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 0x7fc0e4122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 -- 172.21.15.125:0/1206420254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009550 con 0x7fc0e40a0a70 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e8d1a700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 0x7fc0e4123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e37fe700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 0x7fc0e4122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.149+0000 7fc0e3fff700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009c40 tx=0x7fc0d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.150+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8004400 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.150+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d801f070 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.150+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80038e0 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.150+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e4125ea0 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.150+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e4126b40 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.151+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e404f2a0 con 0x7fc0e40a0a70 2023-10-03T10:12:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.152+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0d8021030 con 0x7fc0e40a0a70 2023-10-03T10:12:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.152+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0d8041120 con 0x7fc0e40a0a70 2023-10-03T10:12:36.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.160+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0d800b9d0 con 0x7fc0e40a0a70 2023-10-03T10:12:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.223+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71f004f2a0 con 0x7f71f0130bc0 2023-10-03T10:12:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.224+0000 7f71d77fe700 1 -- 172.21.15.125:0/4151433451 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71e4017020 con 0x7f71f0130bc0 2023-10-03T10:12:36.224 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 msgr2=0x7f71f00717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001eb0 tx=0x7f71e400c800 comp rx=0 tx=0).stop 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 shutdown_connections 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71f0133ad0 0x7f71f0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f01300a0 0x7f71f0071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 --2- 172.21.15.125:0/4151433451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71f0130bc0 0x7f71f00717c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 >> 172.21.15.125:0/4151433451 conn(0x7f71f0099c40 msgr2=0x7f71f0132860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 shutdown_connections 2023-10-03T10:12:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.226+0000 7f71f55d8700 1 -- 172.21.15.125:0/4151433451 wait complete. 2023-10-03T10:12:36.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:36.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.307+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff19c09a300 con 0x7ff19c134570 2023-10-03T10:12:36.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.307+0000 7ff183fff700 1 -- 172.21.15.125:0/1028220099 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff19c09a300 con 0x7ff19c134570 2023-10-03T10:12:36.308 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 msgr2=0x7ff19c11d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff194009e30 tx=0x7ff19400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 shutdown_connections 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19c134570 0x7ff19c11d340 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19c09ad40 0x7ff19c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 --2- 172.21.15.125:0/1028220099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff19c134140 0x7ff19c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 >> 172.21.15.125:0/1028220099 conn(0x7ff19c099c40 msgr2=0x7ff19c0a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 shutdown_connections 2023-10-03T10:12:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.309+0000 7ff1a2060700 1 -- 172.21.15.125:0/1028220099 wait complete. 2023-10-03T10:12:36.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:36.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.350+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b5012f500 con 0x7f0b501300a0 2023-10-03T10:12:36.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.350+0000 7f0b377fe700 1 -- 172.21.15.125:0/972277814 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b40017030 con 0x7f0b501300a0 2023-10-03T10:12:36.351 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 msgr2=0x7f0b5011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000ec10 tx=0x7f0b4000ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 shutdown_connections 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b50133ad0 0x7f0b5011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b501300a0 0x7f0b5011da40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 --2- 172.21.15.125:0/972277814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b501309f0 0x7f0b5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 >> 172.21.15.125:0/972277814 conn(0x7f0b50099c40 msgr2=0x7f0b50132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 shutdown_connections 2023-10-03T10:12:36.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.352+0000 7f0b5567b700 1 -- 172.21.15.125:0/972277814 wait complete. 2023-10-03T10:12:36.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:36.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.367+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0e4072980 con 0x7fc0e40a0a70 2023-10-03T10:12:36.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.367+0000 7fc0e0ff9700 1 -- 172.21.15.125:0/1206420254 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0d8015070 con 0x7fc0e40a0a70 2023-10-03T10:12:36.367 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 msgr2=0x7fc0e41229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009c40 tx=0x7fc0d8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 shutdown_connections 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0e4134120 0x7fc0e4123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0e40a0a70 0x7fc0e41229b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 --2- 172.21.15.125:0/1206420254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0e40a1380 0x7fc0e4122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 >> 172.21.15.125:0/1206420254 conn(0x7fc0e40a6610 msgr2=0x7fc0e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 shutdown_connections 2023-10-03T10:12:36.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:36.369+0000 7fc0ea77d700 1 -- 172.21.15.125:0/1206420254 wait complete. 2023-10-03T10:12:36.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:37.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:37.322 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:37.365 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:37.382 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:37.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.386+0000 7f5fa65b3700 1 Processor -- start 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.386+0000 7f5fa65b3700 1 -- start start 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa65b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fa009d860 0x7f5fa009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa65b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 0x7f5fa01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa65b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa009aaa0 con 0x7f5fa0130ce0 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa65b3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa009f870 con 0x7f5fa009d860 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa65b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa009b360 con 0x7f5fa009e170 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fa009d860 0x7f5fa009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fa009d860 0x7f5fa009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60644/0 (socket says 172.21.15.125:60644) 2023-10-03T10:12:37.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 -- 172.21.15.125:0/1405500812 learned_addr learned my addr 172.21.15.125:0/1405500812 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5fa4b50700 1 --1- 172.21.15.125:0/1405500812 >> v1:172.21.15.125:6789/0 conn(0x7f5fa0130ce0 0x7f5fa01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57956/0 (socket says 172.21.15.125:57956) 2023-10-03T10:12:37.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 0x7f5fa01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 -- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 msgr2=0x7f5fa01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 0x7f5fa01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 -- 172.21.15.125:0/1405500812 >> v1:172.21.15.125:6789/0 conn(0x7f5fa0130ce0 legacy=0x7f5fa01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9ffff700 1 -- 172.21.15.125:0/1405500812 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa009b620 con 0x7f5fa009d860 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9effd700 1 -- 172.21.15.125:0/1405500812 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533215003 0 0) 0x7f5fa009aaa0 con 0x7f5fa0130ce0 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.387+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 0x7f5fa01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.388+0000 7f5f9ffff700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009d860 0x7f5fa009dc30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098f0 tx=0x7f5f90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3db4b4ab4eef0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.388+0000 7f5f9effd700 1 -- 172.21.15.125:0/1405500812 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90011830 con 0x7f5fa009d860 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.388+0000 7f5f9effd700 1 -- 172.21.15.125:0/1405500812 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f90011990 con 0x7f5fa009d860 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.388+0000 7f5f9effd700 1 -- 172.21.15.125:0/1405500812 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90011d20 con 0x7f5fa009d860 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.388+0000 7f5fa65b3700 1 -- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009d860 msgr2=0x7f5fa009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009d860 0x7f5fa009dc30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098f0 tx=0x7f5f90009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 -- 172.21.15.125:0/1405500812 shutdown_connections 2023-10-03T10:12:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009d860 0x7f5fa009dc30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/1405500812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa009e170 0x7f5fa01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 -- 172.21.15.125:0/1405500812 >> 172.21.15.125:0/1405500812 conn(0x7f5fa0099c40 msgr2=0x7f5fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 -- 172.21.15.125:0/1405500812 shutdown_connections 2023-10-03T10:12:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.389+0000 7f5fa65b3700 1 -- 172.21.15.125:0/1405500812 wait complete. 2023-10-03T10:12:37.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.390+0000 7f5fa65b3700 1 Processor -- start 2023-10-03T10:12:37.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 -- start start 2023-10-03T10:12:37.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 0x7f5fa0137f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa0130ce0 0x7f5fa01384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa01368d0 con 0x7f5fa009e170 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0071ee0 con 0x7f5fa0130ce0 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5fa65b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa009c8b0 con 0x7f5fa009d860 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.391+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38814/0 (socket says 172.21.15.125:38814) 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9ffff700 1 -- 172.21.15.125:0/731406305 learned_addr learned my addr 172.21.15.125:0/731406305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5fa4b50700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa0130ce0 0x7f5fa01384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 0x7f5fa0137f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 -- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 msgr2=0x7f5fa0137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 -- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa0130ce0 msgr2=0x7f5fa01384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa0130ce0 0x7f5fa01384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 -- 172.21.15.125:0/731406305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940094a0 con 0x7f5fa009e170 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9ffff700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9f7fe700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 0x7f5fa0137f90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400e9b0 tx=0x7f5f9400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400ee50 con 0x7f5fa009e170 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400c850 con 0x7f5fa009e170 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90009550 con 0x7f5fa009e170 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.392+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400cc00 con 0x7f5fa009e170 2023-10-03T10:12:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.393+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa0137600 con 0x7f5fa009e170 2023-10-03T10:12:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.394+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f94013470 con 0x7f5fa009e170 2023-10-03T10:12:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.394+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa004f2a0 con 0x7f5fa009e170 2023-10-03T10:12:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.394+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f9403f7c0 con 0x7f5fa009e170 2023-10-03T10:12:37.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.403+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f94013720 con 0x7f5fa009e170 2023-10-03T10:12:37.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.462+0000 7faaf8d25700 1 Processor -- start 2023-10-03T10:12:37.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 -- start start 2023-10-03T10:12:37.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf412cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faaf4130630 0x7faaf4137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf409b700 con 0x7faaf412fab0 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf409c350 con 0x7faaf4130630 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf8d25700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf409abf0 con 0x7faaf412cb80 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf1d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faaf412fab0 0x7faaf412ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57958/0 (socket says 172.21.15.125:57958) 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf1d9b700 1 -- 172.21.15.125:0/3464955077 learned_addr learned my addr 172.21.15.125:0/3464955077 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.463+0000 7faaf2d9d700 1 --2- 172.21.15.125:0/3464955077 >> v2:172.21.15.125:3300/0 conn(0x7faaf4130630 0x7faaf4137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf259c700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf412cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf2d9d700 1 -- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 msgr2=0x7faaf412cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf2d9d700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf412cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf2d9d700 1 -- 172.21.15.125:0/3464955077 >> v1:172.21.15.125:6789/0 conn(0x7faaf412fab0 legacy=0x7faaf412ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf2d9d700 1 -- 172.21.15.125:0/3464955077 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf412d490 con 0x7faaf4130630 2023-10-03T10:12:37.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf2d9d700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf4130630 0x7faaf4137df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faaec00be90 tx=0x7faaec00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4e75326aaa1921 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf159a700 1 -- 172.21.15.125:0/3464955077 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec010070 con 0x7faaf4130630 2023-10-03T10:12:37.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf159a700 1 -- 172.21.15.125:0/3464955077 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00d9c0 con 0x7faaf4130630 2023-10-03T10:12:37.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.464+0000 7faaf159a700 1 -- 172.21.15.125:0/3464955077 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00dd70 con 0x7faaf4130630 2023-10-03T10:12:37.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 -- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf4130630 msgr2=0x7faaf4137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf4130630 0x7faaf4137df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faaec00be90 tx=0x7faaec00d330 comp rx=0 tx=0).stop 2023-10-03T10:12:37.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 -- 172.21.15.125:0/3464955077 shutdown_connections 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf4130630 0x7faaf4137df0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 --2- 172.21.15.125:0/3464955077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf412cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 -- 172.21.15.125:0/3464955077 >> 172.21.15.125:0/3464955077 conn(0x7faaf40a2eb0 msgr2=0x7faaf409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 -- 172.21.15.125:0/3464955077 shutdown_connections 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.465+0000 7faaf8d25700 1 -- 172.21.15.125:0/3464955077 wait complete. 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.466+0000 7faaf8d25700 1 Processor -- start 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.466+0000 7faaf8d25700 1 -- start start 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf4071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf412fab0 0x7faaf4071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf409b0c0 con 0x7faaf412fab0 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf412c3a0 con 0x7faaf4130630 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf8d25700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4071780 con 0x7faaf412cb80 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59326/0 (socket says 172.21.15.125:59326) 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf2d9d700 1 -- 172.21.15.125:0/554514661 learned_addr learned my addr 172.21.15.125:0/554514661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf4071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 -- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 msgr2=0x7faaf41c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 -- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf412fab0 msgr2=0x7faaf4071f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf412fab0 0x7faaf4071f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf259c700 1 -- 172.21.15.125:0/554514661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec00bb70 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.467+0000 7faaf2d9d700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faaf259c700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf4071a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faae400d5f0 tx=0x7faae400d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40125f0 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4128cb0 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4012750 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4012ae0 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.468+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40724b0 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.469+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae4012c40 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.469+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4074f10 con 0x7faaf412cb80 2023-10-03T10:12:37.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.469+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faae403f7a0 con 0x7faaf412cb80 2023-10-03T10:12:37.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.478+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae401a720 con 0x7faaf412cb80 2023-10-03T10:12:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.503+0000 7fc6dd03d700 1 Processor -- start 2023-10-03T10:12:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.503+0000 7fc6dd03d700 1 -- start start 2023-10-03T10:12:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6dd03d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d8133900 0x7fc6d8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6dd03d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d80a10b0 0x7fc6d813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6dd03d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d809a760 con 0x7fc6d8134210 2023-10-03T10:12:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6dd03d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d81336e0 con 0x7fc6d8133900 2023-10-03T10:12:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6dd03d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d809a080 con 0x7fc6d80a10b0 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6d6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d8133900 0x7fc6d8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6d759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d80a10b0 0x7fc6d813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6d6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d8133900 0x7fc6d8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60662/0 (socket says 172.21.15.125:60662) 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/2375894154 learned_addr learned my addr 172.21.15.125:0/2375894154 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.504+0000 7fc6d659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc6d8134210 0x7fc6d80a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57968/0 (socket says 172.21.15.125:57968) 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d80a10b0 msgr2=0x7fc6d813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d6d9d700 1 --2- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d80a10b0 0x7fc6d813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/2375894154 >> v1:172.21.15.125:6789/0 conn(0x7fc6d8134210 legacy=0x7fc6d80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/2375894154 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80a23e0 con 0x7fc6d8133900 2023-10-03T10:12:37.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d6d9d700 1 --2- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d8133cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8006fd0 tx=0x7fc6c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3354fd115411d383 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d5d9b700 1 -- 172.21.15.125:0/2375894154 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8005e30 con 0x7fc6d8133900 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d5d9b700 1 -- 172.21.15.125:0/2375894154 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c8004030 con 0x7fc6d8133900 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6d5d9b700 1 -- 172.21.15.125:0/2375894154 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80043e0 con 0x7fc6d8133900 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6dd03d700 1 -- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 msgr2=0x7fc6d8133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.505+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d8133cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8006fd0 tx=0x7fc6c8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 -- 172.21.15.125:0/2375894154 shutdown_connections 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d80a10b0 0x7fc6d813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/2375894154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d8133cd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 -- 172.21.15.125:0/2375894154 >> 172.21.15.125:0/2375894154 conn(0x7fc6d80a2980 msgr2=0x7fc6d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 -- 172.21.15.125:0/2375894154 shutdown_connections 2023-10-03T10:12:37.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.506+0000 7fc6dd03d700 1 -- 172.21.15.125:0/2375894154 wait complete. 2023-10-03T10:12:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.507+0000 7fc6dd03d700 1 Processor -- start 2023-10-03T10:12:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.507+0000 7fc6dd03d700 1 -- start start 2023-10-03T10:12:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d811cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d8134210 0x7fc6d811d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d81200e0 con 0x7fc6d8133900 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d812fbf0 con 0x7fc6d8134210 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6dd03d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d811f660 con 0x7fc6d80a10b0 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38832/0 (socket says 172.21.15.125:38832) 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/3151754230 learned_addr learned my addr 172.21.15.125:0/3151754230 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d659c700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d811cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d759e700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d8134210 0x7fc6d811d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d8134210 msgr2=0x7fc6d811d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d8134210 0x7fc6d811d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 msgr2=0x7fc6d811cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d811cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d6d9d700 1 -- 172.21.15.125:0/3151754230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009500 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.508+0000 7fc6d659c700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d811cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6d6d9d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8004000 tx=0x7fc6c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8003c30 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c8003d90 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c801c640 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d811e9f0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.509+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d809a2c0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.510+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6c801c7a0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.510+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d804f2a0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.510+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6c80406c0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.514+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6c8011420 con 0x7fc6d80a10b0 2023-10-03T10:12:37.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 Processor -- start 2023-10-03T10:12:37.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 -- start start 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fec136960 0x7f7fec138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 0x7f7fec13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fec06b2d0 con 0x7f7fec133ad0 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec1345b0 con 0x7f7fec136960 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.526+0000 7f7ff137a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec133610 con 0x7f7fec139280 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 0x7f7fec13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feaffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7fec133ad0 0x7f7fec133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57972/0 (socket says 172.21.15.125:57972) 2023-10-03T10:12:37.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feaffd700 1 -- 172.21.15.125:0/3119345326 learned_addr learned my addr 172.21.15.125:0/3119345326 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:37.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7fea7fc700 1 --2- 172.21.15.125:0/3119345326 >> v2:172.21.15.125:3300/0 conn(0x7f7fec136960 0x7f7fec138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 -- 172.21.15.125:0/3119345326 >> v2:172.21.15.125:3300/0 conn(0x7f7fec136960 msgr2=0x7f7fec138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 --2- 172.21.15.125:0/3119345326 >> v2:172.21.15.125:3300/0 conn(0x7f7fec136960 0x7f7fec138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 -- 172.21.15.125:0/3119345326 >> v1:172.21.15.125:6789/0 conn(0x7f7fec133ad0 legacy=0x7f7fec133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 -- 172.21.15.125:0/3119345326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec09a500 con 0x7f7fec139280 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7feb7fe700 1 --2- 172.21.15.125:0/3119345326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 0x7f7fec13b660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a76d50dd560d161 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7fe9ffb700 1 -- 172.21.15.125:0/3119345326 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400e070 con 0x7f7fec139280 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7fe9ffb700 1 -- 172.21.15.125:0/3119345326 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400bb20 con 0x7f7fec139280 2023-10-03T10:12:37.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.527+0000 7f7fe9ffb700 1 -- 172.21.15.125:0/3119345326 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4012430 con 0x7f7fec139280 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 -- 172.21.15.125:0/3119345326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 msgr2=0x7f7fec13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 --2- 172.21.15.125:0/3119345326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 0x7f7fec13b660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 -- 172.21.15.125:0/3119345326 shutdown_connections 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 --2- 172.21.15.125:0/3119345326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec139280 0x7f7fec13b660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 --2- 172.21.15.125:0/3119345326 >> v2:172.21.15.125:3300/0 conn(0x7f7fec136960 0x7f7fec138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 -- 172.21.15.125:0/3119345326 >> 172.21.15.125:0/3119345326 conn(0x7f7fec099c40 msgr2=0x7f7fec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 -- 172.21.15.125:0/3119345326 shutdown_connections 2023-10-03T10:12:37.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.528+0000 7f7ff137a700 1 -- 172.21.15.125:0/3119345326 wait complete. 2023-10-03T10:12:37.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.530+0000 7f7ff137a700 1 Processor -- start 2023-10-03T10:12:37.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.530+0000 7f7ff137a700 1 -- start start 2023-10-03T10:12:37.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 0x7f7fec12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 0x7f7fec12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec139280 0x7f7fec12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec06feb0 con 0x7f7fec139280 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec138fc0 con 0x7f7fec133ad0 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7ff137a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec06eda0 con 0x7f7fec136960 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7fea7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 0x7f7fec12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 0x7f7fec12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7fea7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 0x7f7fec12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38850/0 (socket says 172.21.15.125:38850) 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7fea7fc700 1 -- 172.21.15.125:0/1146214544 learned_addr learned my addr 172.21.15.125:0/1146214544 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:37.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feb7fe700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec139280 0x7f7fec12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 -- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 msgr2=0x7f7fec12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 0x7f7fec12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 -- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec139280 msgr2=0x7f7fec12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec139280 0x7f7fec12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 -- 172.21.15.125:0/1146214544 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009a70 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.531+0000 7f7feaffd700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 0x7f7fec12cb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00c3f0 tx=0x7f7fdc00c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.532+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc005b40 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.532+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc005ca0 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.532+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec12dd00 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.532+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0072f0 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.532+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec072800 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.533+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fdc007450 con 0x7f7fec133ad0 2023-10-03T10:12:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.533+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fdc03ea90 con 0x7f7fec133ad0 2023-10-03T10:12:37.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.533+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec04f2a0 con 0x7f7fec133ad0 2023-10-03T10:12:37.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.542+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fdc01b3b0 con 0x7f7fec133ad0 2023-10-03T10:12:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.606+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fa006c3b0 con 0x7f5fa009e170 2023-10-03T10:12:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.607+0000 7f5f9cff9700 1 -- 172.21.15.125:0/731406305 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f94011350 con 0x7f5fa009e170 2023-10-03T10:12:37.607 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 msgr2=0x7f5fa0137f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 0x7f5fa0137f90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400e9b0 tx=0x7f5f9400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 shutdown_connections 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fa0130ce0 0x7f5fa01384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5fa009d860 0x7f5fa0137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 --2- 172.21.15.125:0/731406305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fa009e170 0x7f5fa0137f90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 >> 172.21.15.125:0/731406305 conn(0x7f5fa0099c40 msgr2=0x7f5fa01393f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 shutdown_connections 2023-10-03T10:12:37.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.609+0000 7f5fa65b3700 1 -- 172.21.15.125:0/731406305 wait complete. 2023-10-03T10:12:37.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:37.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.704+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faaf404f2a0 con 0x7faaf412cb80 2023-10-03T10:12:37.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.705+0000 7faae2ffd700 1 -- 172.21.15.125:0/554514661 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faae401b360 con 0x7faaf412cb80 2023-10-03T10:12:37.705 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:37.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.706+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 msgr2=0x7faaf4071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.706+0000 7faaf8d25700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf4071a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faae400d5f0 tx=0x7faae400d900 comp rx=0 tx=0).stop 2023-10-03T10:12:37.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.706+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 shutdown_connections 2023-10-03T10:12:37.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf4130630 0x7faaf41c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf412cb80 0x7faaf4071a30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 --2- 172.21.15.125:0/554514661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf412fab0 0x7faaf4071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 >> 172.21.15.125:0/554514661 conn(0x7faaf40a2eb0 msgr2=0x7faaf41b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 shutdown_connections 2023-10-03T10:12:37.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.707+0000 7faaf8d25700 1 -- 172.21.15.125:0/554514661 wait complete. 2023-10-03T10:12:37.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.717+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6d811fce0 con 0x7fc6d80a10b0 2023-10-03T10:12:37.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.718+0000 7fc6bf7fe700 1 -- 172.21.15.125:0/3151754230 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6c802a030 con 0x7fc6d80a10b0 2023-10-03T10:12:37.718 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:37.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:37.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 msgr2=0x7fc6d811c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8004000 tx=0x7fc6c8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 shutdown_connections 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d8134210 0x7fc6d811d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d80a10b0 0x7fc6d811c800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 --2- 172.21.15.125:0/3151754230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d8133900 0x7fc6d811cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 >> 172.21.15.125:0/3151754230 conn(0x7fc6d80a2980 msgr2=0x7fc6d81bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 shutdown_connections 2023-10-03T10:12:37.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.720+0000 7fc6dd03d700 1 -- 172.21.15.125:0/3151754230 wait complete. 2023-10-03T10:12:37.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:37.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.754+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fec130c40 con 0x7f7fec133ad0 2023-10-03T10:12:37.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.755+0000 7f7fd37fe700 1 -- 172.21.15.125:0/1146214544 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fdc0192c0 con 0x7f7fec133ad0 2023-10-03T10:12:37.755 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:37.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 msgr2=0x7f7fec12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 0x7f7fec12cb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00c3f0 tx=0x7f7fdc00c700 comp rx=0 tx=0).stop 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 shutdown_connections 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec139280 0x7f7fec12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec133ad0 0x7f7fec12cb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 --2- 172.21.15.125:0/1146214544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec136960 0x7f7fec12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 >> 172.21.15.125:0/1146214544 conn(0x7f7fec099c40 msgr2=0x7f7fec134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 shutdown_connections 2023-10-03T10:12:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:37.757+0000 7f7ff137a700 1 -- 172.21.15.125:0/1146214544 wait complete. 2023-10-03T10:12:37.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:38.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:38.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:38.733 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:38.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 Processor -- start 2023-10-03T10:12:38.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 -- start start 2023-10-03T10:12:38.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178409e9d0 con 0x7f17840a0a70 2023-10-03T10:12:38.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178409dc00 con 0x7f1784139200 2023-10-03T10:12:38.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f178a824700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178409dec0 con 0x7f17840a1550 2023-10-03T10:12:38.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f17837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f1788dc1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f17837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38858/0 (socket says 172.21.15.125:38858) 2023-10-03T10:12:38.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f1788dc1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59366/0 (socket says 172.21.15.125:59366) 2023-10-03T10:12:38.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.764+0000 7f17837fe700 1 -- 172.21.15.125:0/851176595 learned_addr learned my addr 172.21.15.125:0/851176595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1788dc1700 1 -- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 msgr2=0x7f1784138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1788dc1700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1788dc1700 1 -- 172.21.15.125:0/851176595 >> v1:172.21.15.125:6789/0 conn(0x7f17840a0a70 legacy=0x7f17840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1788dc1700 1 -- 172.21.15.125:0/851176595 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178409e6a0 con 0x7f1784139200 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1782ffd700 1 -- 172.21.15.125:0/851176595 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047993308 0 0) 0x7f178409e9d0 con 0x7f17840a0a70 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f17837fe700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1788dc1700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f177c009dc0 tx=0x7f177c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c1630dc198dc11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1782ffd700 1 -- 172.21.15.125:0/851176595 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00e070 con 0x7f1784139200 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1782ffd700 1 -- 172.21.15.125:0/851176595 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00bb20 con 0x7f1784139200 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.765+0000 7f1782ffd700 1 -- 172.21.15.125:0/851176595 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012430 con 0x7f1784139200 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 -- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 msgr2=0x7f178413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f177c009dc0 tx=0x7f177c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 -- 172.21.15.125:0/851176595 shutdown_connections 2023-10-03T10:12:38.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1784139200 0x7f178413b5e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 --2- 172.21.15.125:0/851176595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17840a1550 0x7f1784138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 -- 172.21.15.125:0/851176595 >> 172.21.15.125:0/851176595 conn(0x7f17840a6610 msgr2=0x7f17840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 -- 172.21.15.125:0/851176595 shutdown_connections 2023-10-03T10:12:38.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.766+0000 7f178a824700 1 -- 172.21.15.125:0/851176595 wait complete. 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.767+0000 7f178a824700 1 Processor -- start 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 -- start start 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 0x7f178411e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1784139200 0x7f178411f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840a03e0 con 0x7f17840a0a70 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17841220d0 con 0x7f17840a1550 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f178a824700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17841205b0 con 0x7f1784139200 2023-10-03T10:12:38.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f17837fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f17837fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59380/0 (socket says 172.21.15.125:59380) 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f17837fe700 1 -- 172.21.15.125:0/3718092637 learned_addr learned my addr 172.21.15.125:0/3718092637 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f1788dc1700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1784139200 0x7f178411f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.768+0000 7f1783fff700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 0x7f178411e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 -- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1784139200 msgr2=0x7f178411f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1784139200 0x7f178411f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 -- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 msgr2=0x7f178411e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 0x7f178411e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 -- 172.21.15.125:0/3718092637 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778009550 con 0x7f17840a1550 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f1783fff700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 0x7f178411e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f17837fe700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f177800ebe0 tx=0x7f177800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177800c850 con 0x7f17840a1550 2023-10-03T10:12:38.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177800c9b0 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177800cd40 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c009a70 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.769+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784120e90 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.770+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1778013470 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.770+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f177803fc00 con 0x7f17840a1550 2023-10-03T10:12:38.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.771+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784122c00 con 0x7f17840a1550 2023-10-03T10:12:38.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:38.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.776+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f177801b3b0 con 0x7f17840a1550 2023-10-03T10:12:38.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.863+0000 7f5923c4f700 1 Processor -- start 2023-10-03T10:12:38.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.863+0000 7f5923c4f700 1 -- start start 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f5923c4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f5923c4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c130a60 0x7f591c138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f5923c4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c099a60 con 0x7f591c09a730 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f5923c4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09bf50 con 0x7f591c130a60 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f5923c4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09b230 con 0x7f591c099e20 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38872/0 (socket says 172.21.15.125:38872) 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 -- 172.21.15.125:0/4226178782 learned_addr learned my addr 172.21.15.125:0/4226178782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59221ec700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c130a60 0x7f591c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 -- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c130a60 msgr2=0x7f591c138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c130a60 0x7f591c138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 -- 172.21.15.125:0/4226178782 >> v1:172.21.15.125:6789/0 conn(0x7f591c09a730 legacy=0x7f591c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 -- 172.21.15.125:0/4226178782 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c09bb90 con 0x7f591c099e20 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.864+0000 7f59219eb700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f591800bb90 tx=0x7f591800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432f62042adbacab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f59209e9700 1 -- 172.21.15.125:0/4226178782 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918005e30 con 0x7f591c099e20 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f59209e9700 1 -- 172.21.15.125:0/4226178782 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918004030 con 0x7f591c099e20 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f59209e9700 1 -- 172.21.15.125:0/4226178782 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180043e0 con 0x7f591c099e20 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f5923c4f700 1 -- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 msgr2=0x7f591c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f5923c4f700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f591800bb90 tx=0x7f591800bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.865+0000 7f5923c4f700 1 -- 172.21.15.125:0/4226178782 shutdown_connections 2023-10-03T10:12:38.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.866+0000 7f5923c4f700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c130a60 0x7f591c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.866+0000 7f5923c4f700 1 --2- 172.21.15.125:0/4226178782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c099e20 0x7f591c09a1f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.866+0000 7f5923c4f700 1 -- 172.21.15.125:0/4226178782 >> 172.21.15.125:0/4226178782 conn(0x7f591c0a2980 msgr2=0x7f591c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.866+0000 7f5923c4f700 1 -- 172.21.15.125:0/4226178782 shutdown_connections 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.866+0000 7f5923c4f700 1 -- 172.21.15.125:0/4226178782 wait complete. 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.867+0000 7f5923c4f700 1 Processor -- start 2023-10-03T10:12:38.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.867+0000 7f5923c4f700 1 -- start start 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 0x7f591c11b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c09a730 0x7f591c11bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 0x7f591c11c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c11ccf0 con 0x7f591c099e20 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c11e2a0 con 0x7f591c09a730 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f5923c4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f591c12dd30 con 0x7f591c130a60 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59221ec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 0x7f591c11c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59221ec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 0x7f591c11c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38880/0 (socket says 172.21.15.125:38880) 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59221ec700 1 -- 172.21.15.125:0/3272082436 learned_addr learned my addr 172.21.15.125:0/3272082436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 0x7f591c11b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59211ea700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c09a730 0x7f591c11bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 -- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 msgr2=0x7f591c11c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 0x7f591c11c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 -- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c09a730 msgr2=0x7f591c11bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c09a730 0x7f591c11bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 -- 172.21.15.125:0/3272082436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591800b7a0 con 0x7f591c099e20 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59219eb700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 0x7f591c11b890 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5918016000 tx=0x7f5918004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.868+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918003ab0 con 0x7f591c099e20 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.869+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918003c50 con 0x7f591c099e20 2023-10-03T10:12:38.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.869+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180214e0 con 0x7f591c099e20 2023-10-03T10:12:38.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.869+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c0a1440 con 0x7f591c099e20 2023-10-03T10:12:38.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.869+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c11e760 con 0x7f591c099e20 2023-10-03T10:12:38.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.869+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5918027070 con 0x7f591c099e20 2023-10-03T10:12:38.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.870+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59180450b0 con 0x7f591c099e20 2023-10-03T10:12:38.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.870+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c072480 con 0x7f591c099e20 2023-10-03T10:12:38.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.875+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f591c072480 con 0x7f591c099e20 2023-10-03T10:12:38.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.894+0000 7fbe0b951700 1 Processor -- start 2023-10-03T10:12:38.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 -- start start 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe04099a60 0x7fbe04099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0409bb90 con 0x7fbe0409a3d0 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0409c210 con 0x7fbe04099a60 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.895+0000 7fbe0b951700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0409ced0 con 0x7fbe0412d380 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38890/0 (socket says 172.21.15.125:38890) 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 -- 172.21.15.125:0/1773401501 learned_addr learned my addr 172.21.15.125:0/1773401501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe08eec700 1 --2- 172.21.15.125:0/1773401501 >> v2:172.21.15.125:3300/0 conn(0x7fbe04099a60 0x7fbe04099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 -- 172.21.15.125:0/1773401501 >> v2:172.21.15.125:3300/0 conn(0x7fbe04099a60 msgr2=0x7fbe04099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 --2- 172.21.15.125:0/1773401501 >> v2:172.21.15.125:3300/0 conn(0x7fbe04099a60 0x7fbe04099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 -- 172.21.15.125:0/1773401501 >> v1:172.21.15.125:6789/0 conn(0x7fbe0409a3d0 legacy=0x7fbe04137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 -- 172.21.15.125:0/1773401501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0409ac30 con 0x7fbe0412d380 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbe096ed700 1 --2- 172.21.15.125:0/1773401501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe00006fd0 tx=0x7fbe0000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8005d59dfe01a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbdfbfff700 1 -- 172.21.15.125:0/1773401501 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00005e30 con 0x7fbe0412d380 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbdfbfff700 1 -- 172.21.15.125:0/1773401501 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00004030 con 0x7fbe0412d380 2023-10-03T10:12:38.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.896+0000 7fbdfbfff700 1 -- 172.21.15.125:0/1773401501 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000043e0 con 0x7fbe0412d380 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 -- 172.21.15.125:0/1773401501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 msgr2=0x7fbe0412d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 --2- 172.21.15.125:0/1773401501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe00006fd0 tx=0x7fbe0000be70 comp rx=0 tx=0).stop 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 -- 172.21.15.125:0/1773401501 shutdown_connections 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 --2- 172.21.15.125:0/1773401501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0412d380 0x7fbe0412d750 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 --2- 172.21.15.125:0/1773401501 >> v2:172.21.15.125:3300/0 conn(0x7fbe04099a60 0x7fbe04099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 -- 172.21.15.125:0/1773401501 >> 172.21.15.125:0/1773401501 conn(0x7fbe040a2980 msgr2=0x7fbe040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 -- 172.21.15.125:0/1773401501 shutdown_connections 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.897+0000 7fbe0b951700 1 -- 172.21.15.125:0/1773401501 wait complete. 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 Processor -- start 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 -- start start 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe04099a60 0x7fbe0411aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0409a3d0 0x7fbe0411b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0411e290 con 0x7fbe0412d380 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0411cf30 con 0x7fbe04099a60 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.898+0000 7fbe0b951700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040a1780 con 0x7fbe0409a3d0 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60722/0 (socket says 172.21.15.125:60722) 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 -- 172.21.15.125:0/2170308416 learned_addr learned my addr 172.21.15.125:0/2170308416 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe096ed700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe04099a60 0x7fbe0411aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 -- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0409a3d0 msgr2=0x7fbe0411b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0409a3d0 0x7fbe0411b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 -- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe04099a60 msgr2=0x7fbe0411aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe04099a60 0x7fbe0411aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 -- 172.21.15.125:0/2170308416 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0000b7a0 con 0x7fbe0412d380 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe09eee700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00cb50 tx=0x7fbdfc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc003c00 con 0x7fbe0412d380 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc003d60 con 0x7fbe0412d380 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0411cc10 con 0x7fbe0412d380 2023-10-03T10:12:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.899+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00aaa0 con 0x7fbe0412d380 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.900+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0411dd00 con 0x7fbe0412d380 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.900+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdfc00ac00 con 0x7fbe0412d380 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.901+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbdfc03f660 con 0x7fbe0412d380 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.901+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0404f2a0 con 0x7fbe0412d380 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 Processor -- start 2023-10-03T10:12:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 -- start start 2023-10-03T10:12:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0340a0a30 0x7fb0340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a1340 0x7fb03412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0340a1e70 con 0x7fb0341304a0 2023-10-03T10:12:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03409a720 con 0x7fb0340a0a30 2023-10-03T10:12:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.904+0000 7fb03c7c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03409b300 con 0x7fb0340a1340 2023-10-03T10:12:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0340a0a30 0x7fb0340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03ad61700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb0341304a0 0x7fb0341371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58012/0 (socket says 172.21.15.125:58012) 2023-10-03T10:12:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03ad61700 1 -- 172.21.15.125:0/3539875175 learned_addr learned my addr 172.21.15.125:0/3539875175 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb039d5f700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a1340 0x7fb03412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 -- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a1340 msgr2=0x7fb03412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a1340 0x7fb03412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 -- 172.21.15.125:0/3539875175 >> v1:172.21.15.125:6789/0 conn(0x7fb0341304a0 legacy=0x7fb0341371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 -- 172.21.15.125:0/3539875175 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03409abc0 con 0x7fb0340a0a30 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03a560700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a0a30 0x7fb0340a0e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb03000a9c0 tx=0x7fb03000acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44ddb8c95ddb5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.905+0000 7fb03955e700 1 -- 172.21.15.125:0/3539875175 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030005e30 con 0x7fb0340a0a30 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03955e700 1 -- 172.21.15.125:0/3539875175 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000c760 con 0x7fb0340a0a30 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03955e700 1 -- 172.21.15.125:0/3539875175 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000caf0 con 0x7fb0340a0a30 2023-10-03T10:12:38.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdfc0198f0 con 0x7fbe0412d380 2023-10-03T10:12:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a0a30 msgr2=0x7fb0340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a0a30 0x7fb0340a0e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb03000a9c0 tx=0x7fb03000acd0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3539875175 shutdown_connections 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a0a30 0x7fb0340a0e00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3539875175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a1340 0x7fb03412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3539875175 >> 172.21.15.125:0/3539875175 conn(0x7fb0340a2980 msgr2=0x7fb0340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3539875175 shutdown_connections 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.906+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3539875175 wait complete. 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.907+0000 7fb03c7c4700 1 Processor -- start 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.907+0000 7fb03c7c4700 1 -- start start 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 0x7fb0341c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0341304a0 0x7fb0341c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03412ef50 con 0x7fb0340a1340 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03409ae00 con 0x7fb0341304a0 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03c7c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03411e350 con 0x7fb0340a0a30 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38924/0 (socket says 172.21.15.125:38924) 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 -- 172.21.15.125:0/3966053074 learned_addr learned my addr 172.21.15.125:0/3966053074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03ad61700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0341304a0 0x7fb0341c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb039d5f700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 0x7fb0341c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 -- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0341304a0 msgr2=0x7fb0341c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0341304a0 0x7fb0341c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 -- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 msgr2=0x7fb0341c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 0x7fb0341c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb03a560700 1 -- 172.21.15.125:0/3966053074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03000a5d0 con 0x7fb0340a0a30 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.908+0000 7fb039d5f700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 0x7fb0341c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb03a560700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb03000ad10 tx=0x7fb030004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030004220 con 0x7fb0340a0a30 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03001f070 con 0x7fb0340a0a30 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03411ed30 con 0x7fb0340a0a30 2023-10-03T10:12:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03411d2e0 con 0x7fb0340a0a30 2023-10-03T10:12:38.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.909+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030019880 con 0x7fb0340a0a30 2023-10-03T10:12:38.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.910+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0300199e0 con 0x7fb0340a0a30 2023-10-03T10:12:38.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.910+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c0052e0 con 0x7fb0340a0a30 2023-10-03T10:12:38.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.910+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb030040b00 con 0x7fb0340a0a30 2023-10-03T10:12:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.915+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb030014080 con 0x7fb0340a0a30 2023-10-03T10:12:38.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.990+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f178404f2a0 con 0x7f17840a1550 2023-10-03T10:12:38.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.990+0000 7f1780ff9700 1 -- 172.21.15.125:0/3718092637 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1778024350 con 0x7f17840a1550 2023-10-03T10:12:38.991 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 msgr2=0x7f178411edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f177800ebe0 tx=0x7f177800eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 shutdown_connections 2023-10-03T10:12:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1784139200 0x7f178411f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17840a0a70 0x7f178411e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 --2- 172.21.15.125:0/3718092637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17840a1550 0x7f178411edd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 >> 172.21.15.125:0/3718092637 conn(0x7f17840a6610 msgr2=0x7f1784136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 shutdown_connections 2023-10-03T10:12:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:38.992+0000 7f178a824700 1 -- 172.21.15.125:0/3718092637 wait complete. 2023-10-03T10:12:39.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:39.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.072+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f591c072480 con 0x7f591c099e20 2023-10-03T10:12:39.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.072+0000 7f59127fc700 1 -- 172.21.15.125:0/3272082436 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f591c072480 con 0x7f591c099e20 2023-10-03T10:12:39.073 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 msgr2=0x7f591c11b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 0x7f591c11b890 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5918016000 tx=0x7f5918004750 comp rx=0 tx=0).stop 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 shutdown_connections 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f591c130a60 0x7f591c11c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f591c099e20 0x7f591c11b890 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 --2- 172.21.15.125:0/3272082436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f591c09a730 0x7f591c11bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 >> 172.21.15.125:0/3272082436 conn(0x7f591c0a2980 msgr2=0x7f591c09fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 shutdown_connections 2023-10-03T10:12:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.074+0000 7f5923c4f700 1 -- 172.21.15.125:0/3272082436 wait complete. 2023-10-03T10:12:39.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.108+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe0406bce0 con 0x7fbe0412d380 2023-10-03T10:12:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.109+0000 7fbdf9ffb700 1 -- 172.21.15.125:0/2170308416 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdfc011380 con 0x7fbe0412d380 2023-10-03T10:12:39.109 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:39.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.110+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb01c005590 con 0x7fb0340a0a30 2023-10-03T10:12:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.110+0000 7fb02affd700 1 -- 172.21.15.125:0/3966053074 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0300036a0 con 0x7fb0340a0a30 2023-10-03T10:12:39.111 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 msgr2=0x7fbe0411b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00cb50 tx=0x7fbdfc00ce60 comp rx=0 tx=0).stop 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 shutdown_connections 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe0412d380 0x7fbe0411b570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe04099a60 0x7fbe0411aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 --2- 172.21.15.125:0/2170308416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe0409a3d0 0x7fbe0411b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 >> 172.21.15.125:0/2170308416 conn(0x7fbe040a2980 msgr2=0x7fbe0409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 shutdown_connections 2023-10-03T10:12:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.111+0000 7fbe0b951700 1 -- 172.21.15.125:0/2170308416 wait complete. 2023-10-03T10:12:39.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 msgr2=0x7fb0341c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb03000ad10 tx=0x7fb030004750 comp rx=0 tx=0).stop 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 shutdown_connections 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0341304a0 0x7fb0341c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0340a0a30 0x7fb0341c0ff0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 --2- 172.21.15.125:0/3966053074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0340a1340 0x7fb0341c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 >> 172.21.15.125:0/3966053074 conn(0x7fb0340a2980 msgr2=0x7fb0341b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 shutdown_connections 2023-10-03T10:12:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:39.113+0000 7fb03c7c4700 1 -- 172.21.15.125:0/3966053074 wait complete. 2023-10-03T10:12:39.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:39.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:40.010 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:40.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:40.125 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:40.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:40.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 Processor -- start 2023-10-03T10:12:40.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 -- start start 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 0x7f729806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 0x7f72981317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729809f770 con 0x7f729806a770 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729809dce0 con 0x7f729806b080 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.160+0000 7f729c918700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f729809da80 con 0x7f7298131cf0 2023-10-03T10:12:40.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7296d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 0x7f72981317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7296d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38930/0 (socket says 172.21.15.125:38930) 2023-10-03T10:12:40.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7296d9d700 1 -- 172.21.15.125:0/2121685236 learned_addr learned my addr 172.21.15.125:0/2121685236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f729659c700 1 --2- 172.21.15.125:0/2121685236 >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 0x7f729806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 -- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 msgr2=0x7f7298132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 -- 172.21.15.125:0/2121685236 >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 msgr2=0x7f729806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 --2- 172.21.15.125:0/2121685236 >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 0x7f729806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 -- 172.21.15.125:0/2121685236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729809eb20 con 0x7f729806b080 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7296d9d700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f729659c700 1 --2- 172.21.15.125:0/2121685236 >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 0x7f729806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f7295d9b700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 0x7f72981317b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f728c009840 tx=0x7f728c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb474f49a0339d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f729559a700 1 -- 172.21.15.125:0/2121685236 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011830 con 0x7f729806b080 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.161+0000 7f729559a700 1 -- 172.21.15.125:0/2121685236 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c011990 con 0x7f729806b080 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729559a700 1 -- 172.21.15.125:0/2121685236 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011d20 con 0x7f729806b080 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 -- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 msgr2=0x7f72981317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 0x7f72981317b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f728c009840 tx=0x7f728c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 -- 172.21.15.125:0/2121685236 shutdown_connections 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7298131cf0 0x7f7298132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 --2- 172.21.15.125:0/2121685236 >> v2:172.21.15.125:3300/0 conn(0x7f729806a770 0x7f729806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 --2- 172.21.15.125:0/2121685236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806b080 0x7f72981317b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.162+0000 7f729c918700 1 -- 172.21.15.125:0/2121685236 >> 172.21.15.125:0/2121685236 conn(0x7f7298099c40 msgr2=0x7f72980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.163+0000 7f729c918700 1 -- 172.21.15.125:0/2121685236 shutdown_connections 2023-10-03T10:12:40.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.163+0000 7f729c918700 1 -- 172.21.15.125:0/2121685236 wait complete. 2023-10-03T10:12:40.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 Processor -- start 2023-10-03T10:12:40.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 -- start start 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 0x7f729809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f729806b080 0x7f729809b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 0x7f72981c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7298122410 con 0x7f7298131cf0 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7298131540 con 0x7f729806a770 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.164+0000 7f729c918700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f729809a950 con 0x7f729806b080 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f729659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 0x7f729809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f729659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 0x7f729809adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59434/0 (socket says 172.21.15.125:59434) 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f729659c700 1 -- 172.21.15.125:0/1644436901 learned_addr learned my addr 172.21.15.125:0/1644436901 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 0x7f72981c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7295d9b700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f729806b080 0x7f729809b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 -- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f729806b080 msgr2=0x7f729809b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f729806b080 0x7f729809b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 -- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 msgr2=0x7f729809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 0x7f729809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 -- 172.21.15.125:0/1644436901 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290009b30 con 0x7f7298131cf0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7296d9d700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 0x7f72981c80a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7290009e50 tx=0x7f729000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290018070 con 0x7f7298131cf0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729000f040 con 0x7f7298131cf0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.165+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c0094a0 con 0x7f7298131cf0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.166+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290003c40 con 0x7f7298131cf0 2023-10-03T10:12:40.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.166+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7298071e10 con 0x7f7298131cf0 2023-10-03T10:12:40.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.166+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f729000c880 con 0x7f7298131cf0 2023-10-03T10:12:40.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.167+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f729003f6c0 con 0x7f7298131cf0 2023-10-03T10:12:40.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.168+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7298122550 con 0x7f7298131cf0 2023-10-03T10:12:40.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.177+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7298122550 con 0x7f7298131cf0 2023-10-03T10:12:40.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.237+0000 7fe6002de700 1 Processor -- start 2023-10-03T10:12:40.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.237+0000 7fe6002de700 1 -- start start 2023-10-03T10:12:40.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe6002de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809d860 0x7fe5f809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe6002de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe6002de700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f809aaa0 con 0x7fe5f809e170 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe6002de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f809f870 con 0x7fe5f809d860 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe6002de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f809b360 con 0x7fe5f8130eb0 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38956/0 (socket says 172.21.15.125:38956) 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 -- 172.21.15.125:0/3356395294 learned_addr learned my addr 172.21.15.125:0/3356395294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe07a700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809d860 0x7fe5f809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 -- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809d860 msgr2=0x7fe5f809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fd078700 1 -- 172.21.15.125:0/3356395294 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723393575 0 0) 0x7fe5f809aaa0 con 0x7fe5f809e170 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809d860 0x7fe5f809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 -- 172.21.15.125:0/3356395294 >> v1:172.21.15.125:6789/0 conn(0x7fe5f809e170 legacy=0x7fe5f81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.238+0000 7fe5fe87b700 1 -- 172.21.15.125:0/3356395294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f809b620 con 0x7fe5f8130eb0 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.239+0000 7fe5fe87b700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000d180 tx=0x7fe5f000d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc0cd8a4eebc541 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.239+0000 7fe5fd078700 1 -- 172.21.15.125:0/3356395294 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0010070 con 0x7fe5f8130eb0 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.239+0000 7fe5fd078700 1 -- 172.21.15.125:0/3356395294 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000dd40 con 0x7fe5f8130eb0 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.239+0000 7fe5fd078700 1 -- 172.21.15.125:0/3356395294 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000b310 con 0x7fe5f8130eb0 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 -- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 msgr2=0x7fe5f8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000d180 tx=0x7fe5f000d490 comp rx=0 tx=0).stop 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 -- 172.21.15.125:0/3356395294 shutdown_connections 2023-10-03T10:12:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8130eb0 0x7fe5f8138a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 --2- 172.21.15.125:0/3356395294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809d860 0x7fe5f809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 -- 172.21.15.125:0/3356395294 >> 172.21.15.125:0/3356395294 conn(0x7fe5f8099c40 msgr2=0x7fe5f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 -- 172.21.15.125:0/3356395294 shutdown_connections 2023-10-03T10:12:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.240+0000 7fe6002de700 1 -- 172.21.15.125:0/3356395294 wait complete. 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.241+0000 7fe6002de700 1 Processor -- start 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.241+0000 7fe6002de700 1 -- start start 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 0x7fe5f8122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 0x7fe5f8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8130590 con 0x7fe5f8130eb0 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8124390 con 0x7fe5f809e170 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe6002de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8125bf0 con 0x7fe5f809d860 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe5fd879700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe5fd879700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59452/0 (socket says 172.21.15.125:59452) 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe5fd879700 1 -- 172.21.15.125:0/483408741 learned_addr learned my addr 172.21.15.125:0/483408741 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe5fe07a700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 0x7fe5f8122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.242+0000 7fe5fe87b700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 0x7fe5f8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 -- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 msgr2=0x7fe5f8122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 -- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 msgr2=0x7fe5f8123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 0x7fe5f8123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 -- 172.21.15.125:0/483408741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f000bd40 con 0x7fe5f809d860 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fd879700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe87b700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 0x7fe5f8123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5fe07a700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 0x7fe5f8122700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e900 tx=0x7fe5f400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4013680 con 0x7fe5f809d860 2023-10-03T10:12:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f40137e0 con 0x7fe5f809d860 2023-10-03T10:12:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8125eb0 con 0x7fe5f809d860 2023-10-03T10:12:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4013b50 con 0x7fe5f809d860 2023-10-03T10:12:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.243+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81247d0 con 0x7fe5f809d860 2023-10-03T10:12:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.244+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f804f2a0 con 0x7fe5f809d860 2023-10-03T10:12:40.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.245+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5f4013cb0 con 0x7fe5f809d860 2023-10-03T10:12:40.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.245+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5f4012de0 con 0x7fe5f809d860 2023-10-03T10:12:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.253+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5f401b7c0 con 0x7fe5f809d860 2023-10-03T10:12:40.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.269+0000 7fd8d189d700 1 Processor -- start 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.269+0000 7fd8d189d700 1 -- start start 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 0x7fd8cc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc0a2100 con 0x7fd8cc0a1230 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc138950 con 0x7fd8cc138040 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8d189d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1379e0 con 0x7fd8cc0a08e0 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8ca7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59462/0 (socket says 172.21.15.125:59462) 2023-10-03T10:12:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8caffd700 1 -- 172.21.15.125:0/3674338553 learned_addr learned my addr 172.21.15.125:0/3674338553 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.270+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/3674338553 >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 0x7fd8cc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 -- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 msgr2=0x7fd8cc0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 --2- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 -- 172.21.15.125:0/3674338553 >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 msgr2=0x7fd8cc13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 --2- 172.21.15.125:0/3674338553 >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 0x7fd8cc13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 -- 172.21.15.125:0/3674338553 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc09b9b0 con 0x7fd8cc138040 2023-10-03T10:12:40.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/3674338553 >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 0x7fd8cc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.271+0000 7fd8caffd700 1 --2- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009920 tx=0x7fd8bc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fa111ff70c64aa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.273+0000 7eff1eff5700 1 Processor -- start 2023-10-03T10:12:40.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.273+0000 7eff1eff5700 1 -- start start 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1eff5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff1806a770 0x7eff1806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1eff5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1eff5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1806b5c0 con 0x7eff18131a00 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1eff5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1806e900 con 0x7eff1806a770 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1eff5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff1809d180 con 0x7eff1809dec0 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38990/0 (socket says 172.21.15.125:38990) 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 -- 172.21.15.125:0/2499544201 learned_addr learned my addr 172.21.15.125:0/2499544201 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff1cd91700 1 --2- 172.21.15.125:0/2499544201 >> v2:172.21.15.125:3300/0 conn(0x7eff1806a770 0x7eff1806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7fd8c9ffb700 1 -- 172.21.15.125:0/3674338553 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc005e30 con 0x7fd8cc138040 2023-10-03T10:12:40.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 -- 172.21.15.125:0/2499544201 >> v2:172.21.15.125:3300/0 conn(0x7eff1806a770 msgr2=0x7eff1806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 --2- 172.21.15.125:0/2499544201 >> v2:172.21.15.125:3300/0 conn(0x7eff1806a770 0x7eff1806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7fd8c9ffb700 1 -- 172.21.15.125:0/3674338553 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc004030 con 0x7fd8cc138040 2023-10-03T10:12:40.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 -- 172.21.15.125:0/2499544201 >> v1:172.21.15.125:6789/0 conn(0x7eff18131a00 legacy=0x7eff18131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7eff17fff700 1 -- 172.21.15.125:0/2499544201 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1809e780 con 0x7eff1809dec0 2023-10-03T10:12:40.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.274+0000 7fd8c9ffb700 1 -- 172.21.15.125:0/3674338553 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0043e0 con 0x7fd8cc138040 2023-10-03T10:12:40.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 -- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 msgr2=0x7fd8cc138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 --2- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009920 tx=0x7fd8bc009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 -- 172.21.15.125:0/3674338553 shutdown_connections 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 --2- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc138040 0x7fd8cc138410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 --2- 172.21.15.125:0/3674338553 >> v2:172.21.15.125:3300/0 conn(0x7fd8cc0a1230 0x7fd8cc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 --2- 172.21.15.125:0/3674338553 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 -- 172.21.15.125:0/3674338553 >> 172.21.15.125:0/3674338553 conn(0x7fd8cc0a2980 msgr2=0x7fd8cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7eff17fff700 1 --2- 172.21.15.125:0/2499544201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7eff040098f0 tx=0x7eff04009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b0ab8e8cdeddf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 -- 172.21.15.125:0/3674338553 shutdown_connections 2023-10-03T10:12:40.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7fd8d189d700 1 -- 172.21.15.125:0/3674338553 wait complete. 2023-10-03T10:12:40.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.275+0000 7eff177fe700 1 -- 172.21.15.125:0/2499544201 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011830 con 0x7eff1809dec0 2023-10-03T10:12:40.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff177fe700 1 -- 172.21.15.125:0/2499544201 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04011990 con 0x7eff1809dec0 2023-10-03T10:12:40.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff177fe700 1 -- 172.21.15.125:0/2499544201 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011d20 con 0x7eff1809dec0 2023-10-03T10:12:40.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7fd8d189d700 1 Processor -- start 2023-10-03T10:12:40.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 -- 172.21.15.125:0/2499544201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 msgr2=0x7eff1806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 --2- 172.21.15.125:0/2499544201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7eff040098f0 tx=0x7eff04009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 -- 172.21.15.125:0/2499544201 shutdown_connections 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 --2- 172.21.15.125:0/2499544201 >> v2:172.21.15.125:3300/0 conn(0x7eff1806a770 0x7eff1806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 --2- 172.21.15.125:0/2499544201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1809dec0 0x7eff1806b080 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.276+0000 7eff1eff5700 1 -- 172.21.15.125:0/2499544201 >> 172.21.15.125:0/2499544201 conn(0x7eff18099c40 msgr2=0x7eff180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7eff1eff5700 1 -- 172.21.15.125:0/2499544201 shutdown_connections 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 -- start start 2023-10-03T10:12:40.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7eff1eff5700 1 -- 172.21.15.125:0/2499544201 wait complete. 2023-10-03T10:12:40.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc1263b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 0x7fd8cc126e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc129cd0 con 0x7fd8cc138040 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc127fc0 con 0x7fd8cc0a1230 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8d189d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc09a240 con 0x7fd8cc0a08e0 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59466/0 (socket says 172.21.15.125:59466) 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8ca7fc700 1 -- 172.21.15.125:0/1893089788 learned_addr learned my addr 172.21.15.125:0/1893089788 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.277+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 0x7fd8cc126e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 -- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 msgr2=0x7fd8cc1263b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc1263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 -- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 msgr2=0x7fd8cc1268f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 -- 172.21.15.125:0/1893089788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009a70 con 0x7fd8cc138040 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8ca7fc700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8cb7fe700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 0x7fd8cc126e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400efc0 tx=0x7fd8c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4009e80 con 0x7fd8cc138040 2023-10-03T10:12:40.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7eff1eff5700 1 Processor -- start 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400f040 con 0x7fd8cc138040 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc009500 con 0x7fd8cc138040 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400cd80 con 0x7fd8cc138040 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc12a660 con 0x7fd8cc138040 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc129b10 con 0x7fd8cc138040 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.278+0000 7eff1eff5700 1 -- start start 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 0x7eff181c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 0x7eff181c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 0x7eff181c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181c1a20 con 0x7eff1809dec0 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18071d50 con 0x7eff18131a00 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1eff5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff1811d530 con 0x7eff1806a770 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1cd91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 0x7eff181c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1cd91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 0x7eff181c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39000/0 (socket says 172.21.15.125:39000) 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1cd91700 1 -- 172.21.15.125:0/3777117472 learned_addr learned my addr 172.21.15.125:0/3777117472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7eff1d592700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 0x7eff181c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8c4014480 con 0x7fd8cc138040 2023-10-03T10:12:40.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.279+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8c403fd10 con 0x7fd8cc138040 2023-10-03T10:12:40.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff17fff700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 0x7eff181c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 -- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 msgr2=0x7eff181c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 0x7eff181c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 -- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 msgr2=0x7eff181c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 0x7eff181c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 -- 172.21.15.125:0/3777117472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009550 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff17fff700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 0x7eff181c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1d592700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 0x7eff181c3fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff1000cbc0 tx=0x7eff1000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10003c00 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10003d60 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000aaa0 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1811b900 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.280+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1811cb20 con 0x7eff18131a00 2023-10-03T10:12:40.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.281+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff1000ac00 con 0x7eff18131a00 2023-10-03T10:12:40.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.281+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff1003f710 con 0x7eff18131a00 2023-10-03T10:12:40.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.281+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1804f2a0 con 0x7eff18131a00 2023-10-03T10:12:40.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.284+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8c4012930 con 0x7fd8cc138040 2023-10-03T10:12:40.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.286+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff1001b400 con 0x7eff18131a00 2023-10-03T10:12:40.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.418+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7298122550 con 0x7f7298131cf0 2023-10-03T10:12:40.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.419+0000 7f7286ffd700 1 -- 172.21.15.125:0/1644436901 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7298122550 con 0x7f7298131cf0 2023-10-03T10:12:40.419 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:40.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 msgr2=0x7f72981c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 0x7f72981c80a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7290009e50 tx=0x7f729000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 shutdown_connections 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7298131cf0 0x7f72981c80a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f729806a770 0x7f729809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 --2- 172.21.15.125:0/1644436901 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f729806b080 0x7f729809b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 >> 172.21.15.125:0/1644436901 conn(0x7f7298099c40 msgr2=0x7f72981b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 shutdown_connections 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.421+0000 7f729c918700 1 -- 172.21.15.125:0/1644436901 wait complete. 2023-10-03T10:12:40.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:40.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.476+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8cc04f2a0 con 0x7fd8cc138040 2023-10-03T10:12:40.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.476+0000 7fd8b3fff700 1 -- 172.21.15.125:0/1893089788 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8c4012340 con 0x7fd8cc138040 2023-10-03T10:12:40.477 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:40.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.478+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff1811d670 con 0x7eff18131a00 2023-10-03T10:12:40.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.478+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 msgr2=0x7fd8cc126e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.478+0000 7fd8d189d700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 0x7fd8cc126e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400efc0 tx=0x7fd8c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 shutdown_connections 2023-10-03T10:12:40.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.478+0000 7eff157fa700 1 -- 172.21.15.125:0/3777117472 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff10029090 con 0x7eff18131a00 2023-10-03T10:12:40.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8cc138040 0x7fd8cc126e30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8cc0a08e0 0x7fd8cc1263b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 --2- 172.21.15.125:0/1893089788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8cc0a1230 0x7fd8cc1268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 >> 172.21.15.125:0/1893089788 conn(0x7fd8cc0a2980 msgr2=0x7fd8cc09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.480 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:40.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 shutdown_connections 2023-10-03T10:12:40.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.479+0000 7fd8d189d700 1 -- 172.21.15.125:0/1893089788 wait complete. 2023-10-03T10:12:40.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 msgr2=0x7eff181c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 0x7eff181c3fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff1000cbc0 tx=0x7eff1000ced0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 shutdown_connections 2023-10-03T10:12:40.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff18131a00 0x7eff181c3fe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff1806a770 0x7eff181c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 --2- 172.21.15.125:0/3777117472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff1809dec0 0x7eff181c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 >> 172.21.15.125:0/3777117472 conn(0x7eff18099c40 msgr2=0x7eff181b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 shutdown_connections 2023-10-03T10:12:40.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.481+0000 7eff1eff5700 1 -- 172.21.15.125:0/3777117472 wait complete. 2023-10-03T10:12:40.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:40.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:40.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.495+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5f806c3b0 con 0x7fe5f809d860 2023-10-03T10:12:40.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.495+0000 7fe5eeffd700 1 -- 172.21.15.125:0/483408741 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5f4017070 con 0x7fe5f809d860 2023-10-03T10:12:40.496 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:40.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 msgr2=0x7fe5f8122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 0x7fe5f8122700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e900 tx=0x7fe5f400ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:40.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 shutdown_connections 2023-10-03T10:12:40.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f8130eb0 0x7fe5f8123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f809d860 0x7fe5f8122700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 --2- 172.21.15.125:0/483408741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f809e170 0x7fe5f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 >> 172.21.15.125:0/483408741 conn(0x7fe5f8099c40 msgr2=0x7fe5f80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 shutdown_connections 2023-10-03T10:12:40.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:40.497+0000 7fe6002de700 1 -- 172.21.15.125:0/483408741 wait complete. 2023-10-03T10:12:40.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:41.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:41.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:41.494 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:41.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.578+0000 7fa838ffa700 1 Processor -- start 2023-10-03T10:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 -- start start 2023-10-03T10:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 0x7fa8340a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa83413dd10 0x7fa8341400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8341379e0 con 0x7fa834138040 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340a2100 con 0x7fa83413dd10 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa838ffa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83409b9b0 con 0x7fa834138410 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa83259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa834138040 0x7fa8340a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58038/0 (socket says 172.21.15.125:58038) 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.579+0000 7fa83259c700 1 -- 172.21.15.125:0/1021701505 learned_addr learned my addr 172.21.15.125:0/1021701505 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 0x7fa8340a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa832d9d700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa83413dd10 0x7fa8341400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa83159a700 1 -- 172.21.15.125:0/1021701505 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677180881 0 0) 0x7fa8341379e0 con 0x7fa834138040 2023-10-03T10:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa83159a700 1 -- 172.21.15.125:0/1021701505 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa81c0035b0 con 0x7fa834138040 2023-10-03T10:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 -- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa83413dd10 msgr2=0x7fa8341400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa83413dd10 0x7fa8341400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 -- 172.21.15.125:0/1021701505 >> v1:172.21.15.125:6789/0 conn(0x7fa834138040 legacy=0x7fa8340a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 -- 172.21.15.125:0/1021701505 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834137c10 con 0x7fa834138410 2023-10-03T10:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa831d9b700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 0x7fa8340a0ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8280098a0 tx=0x7fa828009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2384c5cf392588 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa83159a700 1 -- 172.21.15.125:0/1021701505 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828011830 con 0x7fa834138410 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa83159a700 1 -- 172.21.15.125:0/1021701505 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828011990 con 0x7fa834138410 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.580+0000 7fa83159a700 1 -- 172.21.15.125:0/1021701505 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828011d20 con 0x7fa834138410 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 -- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 msgr2=0x7fa8340a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 0x7fa8340a0ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8280098a0 tx=0x7fa828009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 -- 172.21.15.125:0/1021701505 shutdown_connections 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa83413dd10 0x7fa8341400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 --2- 172.21.15.125:0/1021701505 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa834138410 0x7fa8340a0ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 -- 172.21.15.125:0/1021701505 >> 172.21.15.125:0/1021701505 conn(0x7fa8340a2980 msgr2=0x7fa8340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 -- 172.21.15.125:0/1021701505 shutdown_connections 2023-10-03T10:12:41.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.581+0000 7fa838ffa700 1 -- 172.21.15.125:0/1021701505 wait complete. 2023-10-03T10:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.583+0000 7fa838ffa700 1 Processor -- start 2023-10-03T10:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.583+0000 7fa838ffa700 1 -- start start 2023-10-03T10:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa834138410 0x7fa8341375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa83413dd10 0x7fa834135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83409ebf0 con 0x7fa834138040 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83412ff40 con 0x7fa834138410 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa838ffa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83413bdd0 con 0x7fa83413dd10 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60816/0 (socket says 172.21.15.125:60816) 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 -- 172.21.15.125:0/728090199 learned_addr learned my addr 172.21.15.125:0/728090199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa831d9b700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa834138410 0x7fa8341375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa832d9d700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa83413dd10 0x7fa834135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 -- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa83413dd10 msgr2=0x7fa834135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa83413dd10 0x7fa834135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 -- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa834138410 msgr2=0x7fa8341375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa834138410 0x7fa8341375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 -- 172.21.15.125:0/728090199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280094a0 con 0x7fa834138040 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.584+0000 7fa83259c700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa82400c4d0 tx=0x7fa82400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.585+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82400cea0 con 0x7fa834138040 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.585+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8240074e0 con 0x7fa834138040 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.585+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83413b2e0 con 0x7fa834138040 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.585+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824005830 con 0x7fa834138040 2023-10-03T10:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.585+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83409a240 con 0x7fa834138040 2023-10-03T10:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.586+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83404f2a0 con 0x7fa834138040 2023-10-03T10:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.587+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa824005990 con 0x7fa834138040 2023-10-03T10:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.587+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa82403ef20 con 0x7fa834138040 2023-10-03T10:12:41.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.591+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa824019b40 con 0x7fa834138040 2023-10-03T10:12:41.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.630+0000 7f41e717d700 1 Processor -- start 2023-10-03T10:12:41.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.630+0000 7f41e717d700 1 -- start start 2023-10-03T10:12:41.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e717d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41e0133b80 0x7f41e0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e717d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e00a0ff0 0x7f41e013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e717d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e009aa00 con 0x7f41e0099a60 2023-10-03T10:12:41.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e717d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e009a080 con 0x7f41e0133b80 2023-10-03T10:12:41.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e717d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0133750 con 0x7f41e00a0ff0 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41e0133b80 0x7f41e0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e571a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e00a0ff0 0x7f41e013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41e0133b80 0x7f41e0133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60830/0 (socket says 172.21.15.125:60830) 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 -- 172.21.15.125:0/4123676711 learned_addr learned my addr 172.21.15.125:0/4123676711 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 -- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e00a0ff0 msgr2=0x7f41e013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 --2- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e00a0ff0 0x7f41e013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 -- 172.21.15.125:0/4123676711 >> v1:172.21.15.125:6789/0 conn(0x7f41e0099a60 legacy=0x7f41e00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41df7fe700 1 -- 172.21.15.125:0/4123676711 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200452840 0 0) 0x7f41e009aa00 con 0x7f41e0099a60 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 -- 172.21.15.125:0/4123676711 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e009a760 con 0x7f41e0133b80 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.631+0000 7f41e4f19700 1 --2- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e0133b80 0x7f41e0133f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006fd0 tx=0x7f41d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4b356a8015ad2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41df7fe700 1 -- 172.21.15.125:0/4123676711 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4005e30 con 0x7f41e0133b80 2023-10-03T10:12:41.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41df7fe700 1 -- 172.21.15.125:0/4123676711 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4004030 con 0x7f41e0133b80 2023-10-03T10:12:41.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41df7fe700 1 -- 172.21.15.125:0/4123676711 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40043e0 con 0x7f41e0133b80 2023-10-03T10:12:41.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 -- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e0133b80 msgr2=0x7f41e0133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 --2- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e0133b80 0x7f41e0133f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006fd0 tx=0x7f41d4009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 -- 172.21.15.125:0/4123676711 shutdown_connections 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 --2- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e00a0ff0 0x7f41e013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 --2- 172.21.15.125:0/4123676711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e0133b80 0x7f41e0133f50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 -- 172.21.15.125:0/4123676711 >> 172.21.15.125:0/4123676711 conn(0x7f41e00a2980 msgr2=0x7f41e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 -- 172.21.15.125:0/4123676711 shutdown_connections 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.632+0000 7f41e717d700 1 -- 172.21.15.125:0/4123676711 wait complete. 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 Processor -- start 2023-10-03T10:12:41.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 -- start start 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 0x7f41e011a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 0x7f41e011ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 0x7f41e011b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e011e3f0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.634+0000 7f41e717d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e011cac0 con 0x7f41e0099a60 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e717d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e011db80 con 0x7f41e0133b80 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e571a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 0x7f41e011b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e4f19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 0x7f41e011a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 0x7f41e011ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e571a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 0x7f41e011b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39032/0 (socket says 172.21.15.125:39032) 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e4f19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 0x7f41e011a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59490/0 (socket says 172.21.15.125:59490) 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41e571a700 1 -- 172.21.15.125:0/3765880517 learned_addr learned my addr 172.21.15.125:0/3765880517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 -- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 msgr2=0x7f41e011b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 0x7f41e011b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 -- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 msgr2=0x7f41e011a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 0x7f41e011a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 -- 172.21.15.125:0/3765880517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009500 con 0x7f41e00a0ff0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dffff700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 0x7f41e011ae10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c410 tx=0x7f41cc00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0052d0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.635+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc005430 con 0x7f41e00a0ff0 2023-10-03T10:12:41.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.636+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0038a0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.636+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e009a2c0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.636+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e012dcc0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.637+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e011ddb0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.637+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41cc003c10 con 0x7f41e00a0ff0 2023-10-03T10:12:41.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.637+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41cc03eba0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.640+0000 7f16ed01f700 1 Processor -- start 2023-10-03T10:12:41.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.640+0000 7f16ed01f700 1 -- start start 2023-10-03T10:12:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16ed01f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 0x7f16e809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16ed01f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16ed01f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e809aaa0 con 0x7f16e8130ce0 2023-10-03T10:12:41.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16ed01f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e809f870 con 0x7f16e809d860 2023-10-03T10:12:41.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16ed01f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16e809b360 con 0x7f16e809e170 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39048/0 (socket says 172.21.15.125:39048) 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 -- 172.21.15.125:0/148048581 learned_addr learned my addr 172.21.15.125:0/148048581 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e6d9d700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 0x7f16e809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 -- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 msgr2=0x7f16e809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 0x7f16e809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 -- 172.21.15.125:0/148048581 >> v1:172.21.15.125:6789/0 conn(0x7f16e8130ce0 legacy=0x7f16e81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 -- 172.21.15.125:0/148048581 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e809b620 con 0x7f16e809e170 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e6d9d700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 0x7f16e809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.641+0000 7f16e659c700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00bbc0 tx=0x7f16dc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2771f69e3824cf6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16e5d9b700 1 -- 172.21.15.125:0/148048581 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00dd30 con 0x7f16e809e170 2023-10-03T10:12:41.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16e5d9b700 1 -- 172.21.15.125:0/148048581 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00de90 con 0x7f16e809e170 2023-10-03T10:12:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16e5d9b700 1 -- 172.21.15.125:0/148048581 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc010690 con 0x7f16e809e170 2023-10-03T10:12:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 -- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 msgr2=0x7f16e81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00bbc0 tx=0x7f16dc00bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 -- 172.21.15.125:0/148048581 shutdown_connections 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809d860 0x7f16e809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 --2- 172.21.15.125:0/148048581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e809e170 0x7f16e81307a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 -- 172.21.15.125:0/148048581 >> 172.21.15.125:0/148048581 conn(0x7f16e8099c40 msgr2=0x7f16e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 -- 172.21.15.125:0/148048581 shutdown_connections 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.642+0000 7f16ed01f700 1 -- 172.21.15.125:0/148048581 wait complete. 2023-10-03T10:12:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.643+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41e011ddb0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.644+0000 7f16ed01f700 1 Processor -- start 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.644+0000 7f16ed01f700 1 -- start start 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e809d860 0x7f16e811e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809e170 0x7f16e811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8120410 con 0x7f16e809d860 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8120870 con 0x7f16e809e170 2023-10-03T10:12:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16ed01f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81221a0 con 0x7f16e8130ce0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39064/0 (socket says 172.21.15.125:39064) 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 -- 172.21.15.125:0/458252709 learned_addr learned my addr 172.21.15.125:0/458252709 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e6d9d700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e809d860 0x7f16e811e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e659c700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809e170 0x7f16e811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 -- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809e170 msgr2=0x7f16e811ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809e170 0x7f16e811ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 -- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e809d860 msgr2=0x7f16e811e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e809d860 0x7f16e811e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 -- 172.21.15.125:0/458252709 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80094a0 con 0x7f16e8130ce0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.645+0000 7f16e759e700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16e000cc80 tx=0x7f16e000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000ab10 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000ac70 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc00b7f0 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e809c8b0 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0012420 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.646+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16e0005080 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.647+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16e003f860 con 0x7f16e8130ce0 2023-10-03T10:12:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.647+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c80052e0 con 0x7f16e8130ce0 2023-10-03T10:12:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.652+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16e00108d0 con 0x7f16e8130ce0 2023-10-03T10:12:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.670+0000 7fa88871b700 1 Processor -- start 2023-10-03T10:12:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.670+0000 7fa88871b700 1 -- start start 2023-10-03T10:12:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa88871b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880136960 0x7fa880138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa88871b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa88013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa88871b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88006b2d0 con 0x7fa880133ad0 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa88871b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801345b0 con 0x7fa880139280 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa88871b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa880133610 con 0x7fa880136960 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa8864b7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa880133ad0 0x7fa880133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58078/0 (socket says 172.21.15.125:58078) 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa886cb8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa88013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa8864b7700 1 -- 172.21.15.125:0/759947649 learned_addr learned my addr 172.21.15.125:0/759947649 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.671+0000 7fa885cb6700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880136960 0x7fa880138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa886cb8700 1 -- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880136960 msgr2=0x7fa880138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa886cb8700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880136960 0x7fa880138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa886cb8700 1 -- 172.21.15.125:0/759947649 >> v1:172.21.15.125:6789/0 conn(0x7fa880133ad0 legacy=0x7fa880133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa886cb8700 1 -- 172.21.15.125:0/759947649 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88009a500 con 0x7fa880139280 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa886cb8700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa88013b660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa878009dc0 tx=0x7fa87800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=145e488aa2602e14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa8854b5700 1 -- 172.21.15.125:0/759947649 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800e070 con 0x7fa880139280 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa8854b5700 1 -- 172.21.15.125:0/759947649 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800bb20 con 0x7fa880139280 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.672+0000 7fa8854b5700 1 -- 172.21.15.125:0/759947649 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878012430 con 0x7fa880139280 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 -- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 msgr2=0x7fa88013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa88013b660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa878009dc0 tx=0x7fa87800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 -- 172.21.15.125:0/759947649 shutdown_connections 2023-10-03T10:12:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa88013b660 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 --2- 172.21.15.125:0/759947649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880136960 0x7fa880138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 -- 172.21.15.125:0/759947649 >> 172.21.15.125:0/759947649 conn(0x7fa880099c40 msgr2=0x7fa8800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 -- 172.21.15.125:0/759947649 shutdown_connections 2023-10-03T10:12:41.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.673+0000 7fa88871b700 1 -- 172.21.15.125:0/759947649 wait complete. 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 Processor -- start 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 -- start start 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 0x7fa880071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa880071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88009f390 con 0x7fa880136960 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88006feb0 con 0x7fa880139280 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa88871b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88006eda0 con 0x7fa880133ad0 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa8864b7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa8864b7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39082/0 (socket says 172.21.15.125:39082) 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa8864b7700 1 -- 172.21.15.125:0/3474520738 learned_addr learned my addr 172.21.15.125:0/3474520738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.674+0000 7fa886cb8700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa880071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 -- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 msgr2=0x7fa880071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa880071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa885cb6700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 0x7fa880071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 -- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 msgr2=0x7fa880071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 0x7fa880071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 -- 172.21.15.125:0/3474520738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009a70 con 0x7fa880133ad0 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa886cb8700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa880071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa885cb6700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 0x7fa880071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa8864b7700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c480 tx=0x7fa87c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c005d70 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0070d0 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88012efc0 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c007440 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.675+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa880130940 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.676+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa87c0075a0 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.676+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88004f2a0 con 0x7fa880133ad0 2023-10-03T10:12:41.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.676+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa87c03ea00 con 0x7fa880133ad0 2023-10-03T10:12:41.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.685+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa87c01b3b0 con 0x7fa880133ad0 2023-10-03T10:12:41.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.838+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa83406bce0 con 0x7fa834138040 2023-10-03T10:12:41.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.838+0000 7fa822ffd700 1 -- 172.21.15.125:0/728090199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa824017030 con 0x7fa834138040 2023-10-03T10:12:41.839 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:41.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 msgr2=0x7fa834137090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa82400c4d0 tx=0x7fa82400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 shutdown_connections 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa83413dd10 0x7fa834135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa834138040 0x7fa834137090 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 --2- 172.21.15.125:0/728090199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa834138410 0x7fa8341375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 >> 172.21.15.125:0/728090199 conn(0x7fa8340a2980 msgr2=0x7fa83413cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 shutdown_connections 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.842+0000 7fa838ffa700 1 -- 172.21.15.125:0/728090199 wait complete. 2023-10-03T10:12:41.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.843+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41e011ddb0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.844+0000 7f41dd7fa700 1 -- 172.21.15.125:0/3765880517 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41e011ddb0 con 0x7f41e00a0ff0 2023-10-03T10:12:41.844 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:41.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.846+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 msgr2=0x7f41e011ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.846+0000 7f41e717d700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 0x7f41e011ae10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c410 tx=0x7f41cc00c720 comp rx=0 tx=0).stop 2023-10-03T10:12:41.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 shutdown_connections 2023-10-03T10:12:41.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41e0133b80 0x7f41e011b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41e0099a60 0x7f41e011a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 --2- 172.21.15.125:0/3765880517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41e00a0ff0 0x7f41e011ae10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 >> 172.21.15.125:0/3765880517 conn(0x7f41e00a2980 msgr2=0x7f41e012f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 shutdown_connections 2023-10-03T10:12:41.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.847+0000 7f41e717d700 1 -- 172.21.15.125:0/3765880517 wait complete. 2023-10-03T10:12:41.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:41.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.888+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa88012efa0 con 0x7fa880133ad0 2023-10-03T10:12:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.888+0000 7fa876ffd700 1 -- 172.21.15.125:0/3474520738 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa87c017030 con 0x7fa880133ad0 2023-10-03T10:12:41.889 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.890+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16c8005590 con 0x7f16e8130ce0 2023-10-03T10:12:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.890+0000 7f16cf7fe700 1 -- 172.21.15.125:0/458252709 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16e00102e0 con 0x7f16e8130ce0 2023-10-03T10:12:41.890 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 msgr2=0x7fa880071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c480 tx=0x7fa87c00c840 comp rx=0 tx=0).stop 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 shutdown_connections 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa880139280 0x7fa880071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa880133ad0 0x7fa880071030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 --2- 172.21.15.125:0/3474520738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa880136960 0x7fa880071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 >> 172.21.15.125:0/3474520738 conn(0x7fa880099c40 msgr2=0x7fa880138720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 shutdown_connections 2023-10-03T10:12:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.891+0000 7fa88871b700 1 -- 172.21.15.125:0/3474520738 wait complete. 2023-10-03T10:12:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 msgr2=0x7f16e811f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16e000cc80 tx=0x7f16e000cf90 comp rx=0 tx=0).stop 2023-10-03T10:12:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 shutdown_connections 2023-10-03T10:12:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e8130ce0 0x7f16e811f100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e809d860 0x7f16e811e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 --2- 172.21.15.125:0/458252709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e809e170 0x7f16e811ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 >> 172.21.15.125:0/458252709 conn(0x7f16e8099c40 msgr2=0x7f16e80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 shutdown_connections 2023-10-03T10:12:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:41.892+0000 7f16ed01f700 1 -- 172.21.15.125:0/458252709 wait complete. 2023-10-03T10:12:41.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:41.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:42.861 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:42.861 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:42.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:42.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:43.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.008+0000 7f3f6cfd2700 1 Processor -- start 2023-10-03T10:12:43.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.008+0000 7f3f6cfd2700 1 -- start start 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6cfd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f68133ad0 0x7f3f68133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6cfd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6cfd2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6806b2d0 con 0x7f3f681300a0 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6cfd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f68133610 con 0x7f3f68133ad0 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6cfd2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6809a500 con 0x7f3f68130bc0 2023-10-03T10:12:43.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f6659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f68133ad0 0x7f3f68133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f65d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3f681300a0 0x7f3f681304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58086/0 (socket says 172.21.15.125:58086) 2023-10-03T10:12:43.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f65d9b700 1 -- 172.21.15.125:0/3040142720 learned_addr learned my addr 172.21.15.125:0/3040142720 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:43.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.009+0000 7f3f66d9d700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.010+0000 7f3f6659c700 1 -- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 msgr2=0x7f3f6813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.010+0000 7f3f6659c700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.010+0000 7f3f6659c700 1 -- 172.21.15.125:0/3040142720 >> v1:172.21.15.125:6789/0 conn(0x7f3f681300a0 legacy=0x7f3f681304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.010+0000 7f3f6659c700 1 -- 172.21.15.125:0/3040142720 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f681338b0 con 0x7f3f68133ad0 2023-10-03T10:12:43.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.010+0000 7f3f6659c700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f68133ea0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c613779b75190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.013+0000 7f3f6559a700 1 -- 172.21.15.125:0/3040142720 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011830 con 0x7f3f68133ad0 2023-10-03T10:12:43.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.013+0000 7f3f6559a700 1 -- 172.21.15.125:0/3040142720 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011990 con 0x7f3f68133ad0 2023-10-03T10:12:43.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.013+0000 7f3f6559a700 1 -- 172.21.15.125:0/3040142720 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011d20 con 0x7f3f68133ad0 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.013+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 msgr2=0x7f3f68133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.013+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f68133ea0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/3040142720 shutdown_connections 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/3040142720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f68133ea0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/3040142720 >> 172.21.15.125:0/3040142720 conn(0x7f3f68099c40 msgr2=0x7f3f680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/3040142720 shutdown_connections 2023-10-03T10:12:43.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.014+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/3040142720 wait complete. 2023-10-03T10:12:43.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.015+0000 7f3f6cfd2700 1 Processor -- start 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.015+0000 7f3f6cfd2700 1 -- start start 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f681300a0 0x7f3f6811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6812dd00 con 0x7f3f68133ad0 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68072330 con 0x7f3f681300a0 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f6cfd2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6811ffb0 con 0x7f3f68130bc0 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60874/0 (socket says 172.21.15.125:60874) 2023-10-03T10:12:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 -- 172.21.15.125:0/2571973992 learned_addr learned my addr 172.21.15.125:0/2571973992 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 -- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 msgr2=0x7f3f6811df80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6811df80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 -- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f681300a0 msgr2=0x7f3f6811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f681300a0 0x7f3f6811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.016+0000 7f3f66d9d700 1 -- 172.21.15.125:0/2571973992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094a0 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f66d9d700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009dd0 tx=0x7f3f6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000cd40 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6000f040 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f68120be0 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6812d290 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.017+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600146c0 con 0x7f3f68133ad0 2023-10-03T10:12:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.018+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f60014820 con 0x7f3f68133ad0 2023-10-03T10:12:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.018+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6804f2a0 con 0x7f3f68133ad0 2023-10-03T10:12:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.018+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f60040440 con 0x7f3f68133ad0 2023-10-03T10:12:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 Processor -- start 2023-10-03T10:12:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 -- start start 2023-10-03T10:12:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a0a30 0x7f32540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3254130670 0x7f32541381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32540a1e70 con 0x7f32540a1340 2023-10-03T10:12:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325409a720 con 0x7f3254130670 2023-10-03T10:12:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.021+0000 7f3259b09700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325409b300 con 0x7f32540a0a30 2023-10-03T10:12:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3254130670 0x7f32541381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3252ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f32540a1340 0x7f325412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58094/0 (socket says 172.21.15.125:58094) 2023-10-03T10:12:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3252ffd700 1 -- 172.21.15.125:0/3343145306 learned_addr learned my addr 172.21.15.125:0/3343145306 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 -- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a0a30 msgr2=0x7f32540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 --2- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a0a30 0x7f32540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 -- 172.21.15.125:0/3343145306 >> v1:172.21.15.125:6789/0 conn(0x7f32540a1340 legacy=0x7f325412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 -- 172.21.15.125:0/3343145306 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325409abc0 con 0x7f3254130670 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.023+0000 7f3253fff700 1 --2- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541381c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f324c00bfa0 tx=0x7f324c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a796a9b78a68aea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.024+0000 7f32527fc700 1 -- 172.21.15.125:0/3343145306 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c010070 con 0x7f3254130670 2023-10-03T10:12:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.024+0000 7f32527fc700 1 -- 172.21.15.125:0/3343145306 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00b2e0 con 0x7f3254130670 2023-10-03T10:12:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.024+0000 7f32527fc700 1 -- 172.21.15.125:0/3343145306 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00dcf0 con 0x7f3254130670 2023-10-03T10:12:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.024+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f60007920 con 0x7f3f68133ad0 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 -- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 msgr2=0x7f32541381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 --2- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541381c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f324c00bfa0 tx=0x7f324c00d330 comp rx=0 tx=0).stop 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 -- 172.21.15.125:0/3343145306 shutdown_connections 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 --2- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541381c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 --2- 172.21.15.125:0/3343145306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a0a30 0x7f32540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 -- 172.21.15.125:0/3343145306 >> 172.21.15.125:0/3343145306 conn(0x7f32540a2980 msgr2=0x7f32540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 -- 172.21.15.125:0/3343145306 shutdown_connections 2023-10-03T10:12:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.025+0000 7f3259b09700 1 -- 172.21.15.125:0/3343145306 wait complete. 2023-10-03T10:12:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.026+0000 7f3259b09700 1 Processor -- start 2023-10-03T10:12:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 -- start start 2023-10-03T10:12:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f32540a0a30 0x7f3254121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325412edb0 con 0x7f3254130670 2023-10-03T10:12:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3254124fa0 con 0x7f32540a1340 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.027+0000 7f3259b09700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3254125260 con 0x7f32540a0a30 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3252ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f32537fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f32540a0a30 0x7f3254121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3252ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59552/0 (socket says 172.21.15.125:59552) 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3252ffd700 1 -- 172.21.15.125:0/37965557 learned_addr learned my addr 172.21.15.125:0/37965557 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 -- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f32540a0a30 msgr2=0x7f3254121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f32540a0a30 0x7f3254121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 -- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 msgr2=0x7f3254121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 -- 172.21.15.125:0/37965557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c00bc80 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3252ffd700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f3253fff700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541224a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f324c017000 tx=0x7f324c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.028+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00dea0 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.029+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00b450 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.029+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325409fe40 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.029+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c009780 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.029+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325409ae50 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.029+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f324c009290 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.030+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f324c041100 con 0x7f3254130670 2023-10-03T10:12:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.030+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325411a590 con 0x7f3254130670 2023-10-03T10:12:43.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.038+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f324c021020 con 0x7f3254130670 2023-10-03T10:12:43.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 Processor -- start 2023-10-03T10:12:43.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 -- start start 2023-10-03T10:12:43.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e44131f40 0x7f1e44139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4409c970 con 0x7f1e4409f180 2023-10-03T10:12:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440a0920 con 0x7f1e44131f40 2023-10-03T10:12:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.048+0000 7f1e499db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4409f9c0 con 0x7f1e4409e870 2023-10-03T10:12:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e42ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e44131f40 0x7f1e44139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e44131f40 0x7f1e44139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60900/0 (socket says 172.21.15.125:60900) 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e42ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59556/0 (socket says 172.21.15.125:59556) 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 -- 172.21.15.125:0/2645684401 learned_addr learned my addr 172.21.15.125:0/2645684401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 -- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 msgr2=0x7f1e4409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 -- 172.21.15.125:0/2645684401 >> v1:172.21.15.125:6789/0 conn(0x7f1e4409f180 legacy=0x7f1e44131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 -- 172.21.15.125:0/2645684401 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4409bab0 con 0x7f1e44131f40 2023-10-03T10:12:43.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e42ffd700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e437fe700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44131f40 0x7f1e44139ca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00f370 tx=0x7f1e3c00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa60a52734756e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e41ffb700 1 -- 172.21.15.125:0/2645684401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c012070 con 0x7f1e44131f40 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e41ffb700 1 -- 172.21.15.125:0/2645684401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c003a20 con 0x7f1e44131f40 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.049+0000 7f1e41ffb700 1 -- 172.21.15.125:0/2645684401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c003dd0 con 0x7f1e44131f40 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 -- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44131f40 msgr2=0x7f1e44139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44131f40 0x7f1e44139ca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00f370 tx=0x7f1e3c00f680 comp rx=0 tx=0).stop 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 -- 172.21.15.125:0/2645684401 shutdown_connections 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44131f40 0x7f1e44139ca0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 --2- 172.21.15.125:0/2645684401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e4409e870 0x7f1e4409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 -- 172.21.15.125:0/2645684401 >> 172.21.15.125:0/2645684401 conn(0x7f1e440a4430 msgr2=0x7f1e440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 -- 172.21.15.125:0/2645684401 shutdown_connections 2023-10-03T10:12:43.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.050+0000 7f1e499db700 1 -- 172.21.15.125:0/2645684401 wait complete. 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 Processor -- start 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 -- start start 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e4409e870 0x7f1e4411e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e4409f180 0x7f1e4411e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44121a00 con 0x7f1e4409e870 2023-10-03T10:12:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440a2d20 con 0x7f1e44131f40 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.051+0000 7f1e499db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44121c50 con 0x7f1e4409f180 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59558/0 (socket says 172.21.15.125:59558) 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 -- 172.21.15.125:0/1573606977 learned_addr learned my addr 172.21.15.125:0/1573606977 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e42ffd700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e4409e870 0x7f1e4411e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 -- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e4409f180 msgr2=0x7f1e4411e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e4409f180 0x7f1e4411e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 -- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e4409e870 msgr2=0x7f1e4411e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e4409e870 0x7f1e4411e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.052+0000 7f1e437fe700 1 -- 172.21.15.125:0/1573606977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340094a0 con 0x7f1e44131f40 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e437fe700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e4409c8a0 tx=0x7f1e3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00bc10 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c00bd70 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004270 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c00f050 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.053+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e441216b0 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.054+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e3c0043d0 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.054+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4404f2a0 con 0x7f1e44131f40 2023-10-03T10:12:43.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.054+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e3c046ba0 con 0x7f1e44131f40 2023-10-03T10:12:43.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.060+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e3c04a060 con 0x7f1e44131f40 2023-10-03T10:12:43.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.062+0000 7f8938af1700 1 Processor -- start 2023-10-03T10:12:43.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.062+0000 7f8938af1700 1 -- start start 2023-10-03T10:12:43.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8938af1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409d860 0x7f893409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8938af1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8938af1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893409aaa0 con 0x7f8934130ce0 2023-10-03T10:12:43.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8938af1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893409f870 con 0x7f893409e170 2023-10-03T10:12:43.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8938af1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893409b360 con 0x7f893409d860 2023-10-03T10:12:43.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59570/0 (socket says 172.21.15.125:59570) 2023-10-03T10:12:43.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 -- 172.21.15.125:0/3704524126 learned_addr learned my addr 172.21.15.125:0/3704524126 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f893259c700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409d860 0x7f893409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 -- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409d860 msgr2=0x7f893409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409d860 0x7f893409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 -- 172.21.15.125:0/3704524126 >> v1:172.21.15.125:6789/0 conn(0x7f8934130ce0 legacy=0x7f89341379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 -- 172.21.15.125:0/3704524126 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893409b620 con 0x7f893409e170 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.063+0000 7f8931d9b700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8928009920 tx=0x7f8928009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8705d8790578d405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f893159a700 1 -- 172.21.15.125:0/3704524126 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800ba60 con 0x7f893409e170 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f893159a700 1 -- 172.21.15.125:0/3704524126 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800bbc0 con 0x7f893409e170 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f893159a700 1 -- 172.21.15.125:0/3704524126 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928009e70 con 0x7f893409e170 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 -- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 msgr2=0x7f89341307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8928009920 tx=0x7f8928009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 -- 172.21.15.125:0/3704524126 shutdown_connections 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409d860 0x7f893409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 --2- 172.21.15.125:0/3704524126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f893409e170 0x7f89341307a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 -- 172.21.15.125:0/3704524126 >> 172.21.15.125:0/3704524126 conn(0x7f8934099c40 msgr2=0x7f89340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 -- 172.21.15.125:0/3704524126 shutdown_connections 2023-10-03T10:12:43.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.064+0000 7f8938af1700 1 -- 172.21.15.125:0/3704524126 wait complete. 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 Processor -- start 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 -- start start 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f893409d860 0x7f893411b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409e170 0x7f893411baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893411f080 con 0x7f893409d860 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893412fef0 con 0x7f8934130ce0 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8938af1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893411d170 con 0x7f893409e170 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8931d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409e170 0x7f893411baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59580/0 (socket says 172.21.15.125:59580) 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 -- 172.21.15.125:0/1585358332 learned_addr learned my addr 172.21.15.125:0/1585358332 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 -- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409e170 msgr2=0x7f893411baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409e170 0x7f893411baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 -- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f893409d860 msgr2=0x7f893411b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f893409d860 0x7f893411b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.066+0000 7f8932d9d700 1 -- 172.21.15.125:0/1585358332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009550 con 0x7f8934130ce0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8932d9d700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f892c00cc50 tx=0x7f892c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c003c00 con 0x7f8934130ce0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c003d60 con 0x7f8934130ce0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00ab40 con 0x7f8934130ce0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8934130990 con 0x7f8934130ce0 2023-10-03T10:12:43.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.067+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893411d930 con 0x7f8934130ce0 2023-10-03T10:12:43.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.068+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f892c00aca0 con 0x7f8934130ce0 2023-10-03T10:12:43.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.068+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f892c03f890 con 0x7f8934130ce0 2023-10-03T10:12:43.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.068+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893404f2a0 con 0x7f8934130ce0 2023-10-03T10:12:43.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.073+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f892c0198f0 con 0x7f8934130ce0 2023-10-03T10:12:43.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.254+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e440a1fa0 con 0x7f1e44131f40 2023-10-03T10:12:43.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.255+0000 7f1e2bfff700 1 -- 172.21.15.125:0/1573606977 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e3c04a090 con 0x7f1e44131f40 2023-10-03T10:12:43.258 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.258+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 msgr2=0x7f1e4411ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.258+0000 7f1e499db700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e4409c8a0 tx=0x7f1e3c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 shutdown_connections 2023-10-03T10:12:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44131f40 0x7f1e4411ed20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e4409e870 0x7f1e4411e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 --2- 172.21.15.125:0/1573606977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e4409f180 0x7f1e4411e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 >> 172.21.15.125:0/1573606977 conn(0x7f1e440a4430 msgr2=0x7f1e4406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 shutdown_connections 2023-10-03T10:12:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.259+0000 7f1e499db700 1 -- 172.21.15.125:0/1573606977 wait complete. 2023-10-03T10:12:43.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.272+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f893406c3b0 con 0x7f8934130ce0 2023-10-03T10:12:43.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.272+0000 7f8922ffd700 1 -- 172.21.15.125:0/1585358332 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f892c011380 con 0x7f8934130ce0 2023-10-03T10:12:43.273 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:43.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.273+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f68120350 con 0x7f3f68133ad0 2023-10-03T10:12:43.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.273+0000 7f3f56ffd700 1 -- 172.21.15.125:0/2571973992 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f60020120 con 0x7f3f68133ad0 2023-10-03T10:12:43.274 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:43.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:43.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 msgr2=0x7f3f6811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009dd0 tx=0x7f3f6000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 shutdown_connections 2023-10-03T10:12:43.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f68133ad0 0x7f3f6811e4c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f681300a0 0x7f3f6811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 --2- 172.21.15.125:0/2571973992 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f68130bc0 0x7f3f6811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.275+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 >> 172.21.15.125:0/2571973992 conn(0x7f3f68099c40 msgr2=0x7f3f68131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 shutdown_connections 2023-10-03T10:12:43.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f3f6cfd2700 1 -- 172.21.15.125:0/2571973992 wait complete. 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 msgr2=0x7f893411c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f892c00cc50 tx=0x7f892c00cf60 comp rx=0 tx=0).stop 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 shutdown_connections 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8934130ce0 0x7f893411c030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f893409d860 0x7f893411b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 --2- 172.21.15.125:0/1585358332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f893409e170 0x7f893411baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 >> 172.21.15.125:0/1585358332 conn(0x7f8934099c40 msgr2=0x7f893406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 shutdown_connections 2023-10-03T10:12:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.276+0000 7f8938af1700 1 -- 172.21.15.125:0/1585358332 wait complete. 2023-10-03T10:12:43.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:43.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.292+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f325404f2a0 con 0x7f3254130670 2023-10-03T10:12:43.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.292+0000 7f323bfff700 1 -- 172.21.15.125:0/37965557 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f324c034090 con 0x7f3254130670 2023-10-03T10:12:43.293 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:43.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 msgr2=0x7f32541224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541224a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f324c017000 tx=0x7f324c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 shutdown_connections 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3254130670 0x7f32541224a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f32540a0a30 0x7f3254121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 --2- 172.21.15.125:0/37965557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32540a1340 0x7f3254121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 >> 172.21.15.125:0/37965557 conn(0x7f32540a2980 msgr2=0x7f325412f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 shutdown_connections 2023-10-03T10:12:43.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:43.295+0000 7f3259b09700 1 -- 172.21.15.125:0/37965557 wait complete. 2023-10-03T10:12:43.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:44.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:44.290 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:44.296 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:44.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:44.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.435+0000 7fa7a2aa9700 1 Processor -- start 2023-10-03T10:12:44.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.435+0000 7fa7a2aa9700 1 -- start start 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a2aa9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09d860 0x7fa79c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a2aa9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa79c130eb0 0x7fa79c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a2aa9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c09aaa0 con 0x7fa79c09e170 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a2aa9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c09f870 con 0x7fa79c130eb0 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a2aa9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c09b360 con 0x7fa79c09d860 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a1046700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa79c130eb0 0x7fa79c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a1046700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa79c130eb0 0x7fa79c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60932/0 (socket says 172.21.15.125:60932) 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a1046700 1 -- 172.21.15.125:0/1406825778 learned_addr learned my addr 172.21.15.125:0/1406825778 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.436+0000 7fa7a0845700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09d860 0x7fa79c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa7a1046700 1 -- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09d860 msgr2=0x7fa79c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa7a1046700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09d860 0x7fa79c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa7a1046700 1 -- 172.21.15.125:0/1406825778 >> v1:172.21.15.125:6789/0 conn(0x7fa79c09e170 legacy=0x7fa79c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa7a1046700 1 -- 172.21.15.125:0/1406825778 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c09b620 con 0x7fa79c130eb0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa7a1046700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c130eb0 0x7fa79c138a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e50 tx=0x7fa79400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94dd72a459e7196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1406825778 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400e070 con 0x7fa79c130eb0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1406825778 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794003a20 con 0x7fa79c130eb0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.437+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1406825778 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794003dd0 con 0x7fa79c130eb0 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c130eb0 msgr2=0x7fa79c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c130eb0 0x7fa79c138a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e50 tx=0x7fa79400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/1406825778 shutdown_connections 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c130eb0 0x7fa79c138a00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/1406825778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09d860 0x7fa79c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/1406825778 >> 172.21.15.125:0/1406825778 conn(0x7fa79c099c40 msgr2=0x7fa79c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/1406825778 shutdown_connections 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.438+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/1406825778 wait complete. 2023-10-03T10:12:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.440+0000 7fa7a2aa9700 1 Processor -- start 2023-10-03T10:12:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.440+0000 7fa7a2aa9700 1 -- start start 2023-10-03T10:12:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 0x7fa79c11f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 0x7fa79c120000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c06b280 con 0x7fa79c09d860 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c126550 con 0x7fa79c09e170 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a2aa9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c126120 con 0x7fa79c130eb0 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59600/0 (socket says 172.21.15.125:59600) 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa79bfff700 1 -- 172.21.15.125:0/4179668349 learned_addr learned my addr 172.21.15.125:0/4179668349 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 0x7fa79c120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a0845700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 0x7fa79c11f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 -- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 msgr2=0x7fa79c11fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 -- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 msgr2=0x7fa79c11f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 0x7fa79c11f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 -- 172.21.15.125:0/4179668349 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009b30 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a0845700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 0x7fa79c11f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa79bfff700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.441+0000 7fa7a1046700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 0x7fa79c120000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa794014000 tx=0x7fa794004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.442+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7940092e0 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.442+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794004240 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.442+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7940045f0 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.442+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c06a9e0 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.442+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1307f0 con 0x7fa79c130eb0 2023-10-03T10:12:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.443+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c04f2a0 con 0x7fa79c130eb0 2023-10-03T10:12:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.444+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa794019070 con 0x7fa79c130eb0 2023-10-03T10:12:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.444+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7940406e0 con 0x7fa79c130eb0 2023-10-03T10:12:44.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.448+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa79401b550 con 0x7fa79c130eb0 2023-10-03T10:12:44.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.463+0000 7fe3d3a94700 1 Processor -- start 2023-10-03T10:12:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.463+0000 7f3f9a374700 1 Processor -- start 2023-10-03T10:12:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.463+0000 7fe3d3a94700 1 -- start start 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.463+0000 7f3f9a374700 1 -- start start 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7f3f9a374700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f9409e340 0x7f3f941359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7f3f9a374700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f94138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7f3f9a374700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9409aaa0 con 0x7f3f9409d860 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7f3f9a374700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9409e730 con 0x7f3f9409e340 2023-10-03T10:12:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7f3f9a374700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9409f870 con 0x7f3f94135f20 2023-10-03T10:12:44.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7fe3d3a94700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3cc0a1550 0x7fe3cc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7fe3d3a94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7fe3d3a94700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc09e9d0 con 0x7fe3cc0a0a70 2023-10-03T10:12:44.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7fe3d3a94700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc09dc00 con 0x7fe3cc0a1550 2023-10-03T10:12:44.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.464+0000 7fe3d3a94700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc09dec0 con 0x7fe3cc139200 2023-10-03T10:12:44.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3cc0a1550 0x7fe3cc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7f3f93fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3f9409d860 0x7f3f9409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58126/0 (socket says 172.21.15.125:58126) 2023-10-03T10:12:44.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7f3f93fff700 1 -- 172.21.15.125:0/3841784832 learned_addr learned my addr 172.21.15.125:0/3841784832 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:44.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3cc0a1550 0x7fe3cc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60960/0 (socket says 172.21.15.125:60960) 2023-10-03T10:12:44.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 -- 172.21.15.125:0/1832958657 learned_addr learned my addr 172.21.15.125:0/1832958657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7f3f937fe700 1 --2- 172.21.15.125:0/3841784832 >> v2:172.21.15.125:3300/0 conn(0x7f3f9409e340 0x7f3f941359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 -- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 msgr2=0x7fe3cc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 --2- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 -- 172.21.15.125:0/1832958657 >> v1:172.21.15.125:6789/0 conn(0x7fe3cc0a0a70 legacy=0x7fe3cc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7f3f98911700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f94138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 -- 172.21.15.125:0/1832958657 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc09e6a0 con 0x7fe3cc0a1550 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d102f700 1 --2- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc138cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098f0 tx=0x7fe3bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359244b95576569 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d082e700 1 -- 172.21.15.125:0/1832958657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00b8a0 con 0x7fe3cc0a1550 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d082e700 1 -- 172.21.15.125:0/1832958657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00ba00 con 0x7fe3cc0a1550 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.466+0000 7fe3d082e700 1 -- 172.21.15.125:0/1832958657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00bd90 con 0x7fe3cc0a1550 2023-10-03T10:12:44.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7f3f937fe700 1 -- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 msgr2=0x7f3f94138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7f3f937fe700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f94138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7f3f937fe700 1 -- 172.21.15.125:0/3841784832 >> v1:172.21.15.125:6789/0 conn(0x7f3f9409d860 legacy=0x7f3f9409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7f3f937fe700 1 -- 172.21.15.125:0/3841784832 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9409b360 con 0x7f3f9409e340 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 -- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 msgr2=0x7fe3cc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc138cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098f0 tx=0x7fe3bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:44.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 -- 172.21.15.125:0/1832958657 shutdown_connections 2023-10-03T10:12:44.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/1832958657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc138cc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 -- 172.21.15.125:0/1832958657 >> 172.21.15.125:0/1832958657 conn(0x7fe3cc0a6610 msgr2=0x7fe3cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7f3f937fe700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f941359e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009840 tx=0x7f3f88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7a7f891eaeb8c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.467+0000 7fe3d3a94700 1 -- 172.21.15.125:0/1832958657 shutdown_connections 2023-10-03T10:12:44.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.468+0000 7f3f92ffd700 1 -- 172.21.15.125:0/3841784832 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88011830 con 0x7f3f9409e340 2023-10-03T10:12:44.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.468+0000 7f3f92ffd700 1 -- 172.21.15.125:0/3841784832 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88011990 con 0x7f3f9409e340 2023-10-03T10:12:44.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.468+0000 7f3f92ffd700 1 -- 172.21.15.125:0/3841784832 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88011d20 con 0x7f3f9409e340 2023-10-03T10:12:44.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.468+0000 7fe3d3a94700 1 -- 172.21.15.125:0/1832958657 wait complete. 2023-10-03T10:12:44.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.468+0000 7fe3d3a94700 1 Processor -- start 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 -- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 msgr2=0x7f3f941359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f941359e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009840 tx=0x7f3f88009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 -- 172.21.15.125:0/3841784832 shutdown_connections 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f94138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 --2- 172.21.15.125:0/3841784832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f941359e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 -- 172.21.15.125:0/3841784832 >> 172.21.15.125:0/3841784832 conn(0x7f3f94099c40 msgr2=0x7f3f940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 -- 172.21.15.125:0/3841784832 shutdown_connections 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7fe3d3a94700 1 -- start start 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7fe3d3a94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3cc0a0a70 0x7fe3cc12f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d3a94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc12fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d3a94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d3a94700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1309c0 con 0x7fe3cc0a1550 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d3a94700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1323e0 con 0x7fe3cc0a0a70 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d3a94700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0a5320 con 0x7fe3cc139200 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39140/0 (socket says 172.21.15.125:39140) 2023-10-03T10:12:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 -- 172.21.15.125:0/2226096962 learned_addr learned my addr 172.21.15.125:0/2226096962 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d1830700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3cc0a0a70 0x7fe3cc12f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 -- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3cc0a0a70 msgr2=0x7fe3cc12f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3cc0a0a70 0x7fe3cc12f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 -- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 msgr2=0x7fe3cc12fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc12fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 -- 172.21.15.125:0/2226096962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009550 con 0x7fe3cc139200 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.470+0000 7fe3d2031700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b9e0 tx=0x7fe3c400bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400c930 con 0x7fe3cc139200 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400cab0 con 0x7fe3cc139200 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400ce60 con 0x7fe3cc139200 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc1327c0 con 0x7fe3cc139200 2023-10-03T10:12:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc131910 con 0x7fe3cc139200 2023-10-03T10:12:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.469+0000 7f3f9a374700 1 -- 172.21.15.125:0/3841784832 wait complete. 2023-10-03T10:12:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.471+0000 7f3f9a374700 1 Processor -- start 2023-10-03T10:12:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 -- start start 2023-10-03T10:12:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc04f2a0 con 0x7fe3cc139200 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f9412a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f9412ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9412d530 con 0x7f3f9409e340 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9412c570 con 0x7f3f9409d860 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.472+0000 7f3f9a374700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9412ba40 con 0x7f3f94135f20 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59612/0 (socket says 172.21.15.125:59612) 2023-10-03T10:12:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 -- 172.21.15.125:0/1471254119 learned_addr learned my addr 172.21.15.125:0/1471254119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3c401c360 con 0x7fe3cc139200 2023-10-03T10:12:44.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f98911700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f9412ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe3c4006e40 con 0x7fe3cc139200 2023-10-03T10:12:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 -- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 msgr2=0x7f3f9412ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f9412ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 -- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 msgr2=0x7f3f9412a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f9412a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.473+0000 7f3f93fff700 1 -- 172.21.15.125:0/1471254119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880094a0 con 0x7f3f9409d860 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.474+0000 7f3f93fff700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c480 tx=0x7f3f8400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.474+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84005d70 con 0x7f3f9409d860 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.474+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840070d0 con 0x7f3f9409d860 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.474+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84007440 con 0x7f3f9409d860 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.475+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9412b0c0 con 0x7f3f9409d860 2023-10-03T10:12:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.475+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941d4df0 con 0x7f3f9409d860 2023-10-03T10:12:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.476+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9404f2a0 con 0x7f3f9409d860 2023-10-03T10:12:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.476+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f840075a0 con 0x7f3f9409d860 2023-10-03T10:12:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.476+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f8403ec40 con 0x7f3f9409d860 2023-10-03T10:12:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.479+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3c401d3b0 con 0x7fe3cc139200 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.481+0000 7fb8f0ccb700 1 Processor -- start 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.481+0000 7fb8f0ccb700 1 -- start start 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8f0ccb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8f0ccb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8ec0a1340 0x7fb8ec12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8f0ccb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0a1e70 con 0x7fb8ec1304a0 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8f0ccb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ec09a720 con 0x7fb8ec0a1340 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8f0ccb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec09b300 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39152/0 (socket says 172.21.15.125:39152) 2023-10-03T10:12:44.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 -- 172.21.15.125:0/2705661498 learned_addr learned my addr 172.21.15.125:0/2705661498 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f84019b40 con 0x7f3f9409d860 2023-10-03T10:12:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 -- 172.21.15.125:0/2705661498 >> v2:172.21.15.125:3300/0 conn(0x7fb8ec0a1340 msgr2=0x7fb8ec12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 --2- 172.21.15.125:0/2705661498 >> v2:172.21.15.125:3300/0 conn(0x7fb8ec0a1340 0x7fb8ec12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 -- 172.21.15.125:0/2705661498 >> v1:172.21.15.125:6789/0 conn(0x7fb8ec1304a0 legacy=0x7fb8ec1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.482+0000 7fb8ea59c700 1 -- 172.21.15.125:0/2705661498 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec09abc0 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.483+0000 7fb8ea59c700 1 --2- 172.21.15.125:0/2705661498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc006fd0 tx=0x7fb8dc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95790b1325aa515b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.483+0000 7fb8e959a700 1 -- 172.21.15.125:0/2705661498 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc005e30 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.483+0000 7fb8e959a700 1 -- 172.21.15.125:0/2705661498 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc006030 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.483+0000 7fb8e959a700 1 -- 172.21.15.125:0/2705661498 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0063c0 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/2705661498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 msgr2=0x7fb8ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/2705661498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc006fd0 tx=0x7fb8dc009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/2705661498 shutdown_connections 2023-10-03T10:12:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/2705661498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a0a30 0x7fb8ec0a0e00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/2705661498 >> v2:172.21.15.125:3300/0 conn(0x7fb8ec0a1340 0x7fb8ec12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/2705661498 >> 172.21.15.125:0/2705661498 conn(0x7fb8ec0a2980 msgr2=0x7fb8ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/2705661498 shutdown_connections 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.484+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/2705661498 wait complete. 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.485+0000 7fb8f0ccb700 1 Processor -- start 2023-10-03T10:12:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 -- start start 2023-10-03T10:12:44.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ec0a0a30 0x7fb8ec13adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ec1304a0 0x7fb8ec13b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec139510 con 0x7fb8ec1304a0 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec09ae00 con 0x7fb8ec0a0a30 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8f0ccb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec137b60 con 0x7fb8ec0a1340 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8e9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8e9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39154/0 (socket says 172.21.15.125:39154) 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8e9d9b700 1 -- 172.21.15.125:0/1412505223 learned_addr learned my addr 172.21.15.125:0/1412505223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.486+0000 7fb8ead9d700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ec1304a0 0x7fb8ec13b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 -- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ec0a0a30 msgr2=0x7fb8ec13adb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ec0a0a30 0x7fb8ec13adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 -- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ec1304a0 msgr2=0x7fb8ec13b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ec1304a0 0x7fb8ec13b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 -- 172.21.15.125:0/1412505223 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc009500 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8e9d9b700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b500 tx=0x7fb8e000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011830 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e00119b0 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011d60 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec13a1d0 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.487+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec13bd70 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.488+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8e001a400 con 0x7fb8ec0a1340 2023-10-03T10:12:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.489+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec04f2a0 con 0x7fb8ec0a1340 2023-10-03T10:12:44.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.489+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8e003f720 con 0x7fb8ec0a1340 2023-10-03T10:12:44.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.496+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e000f8d0 con 0x7fb8ec0a1340 2023-10-03T10:12:44.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.674+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3cc072980 con 0x7fe3cc139200 2023-10-03T10:12:44.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.674+0000 7fe3c27fc700 1 -- 172.21.15.125:0/2226096962 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3c4019030 con 0x7fe3cc139200 2023-10-03T10:12:44.675 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 msgr2=0x7fe3cc130050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b9e0 tx=0x7fe3c400bcf0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 shutdown_connections 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3cc139200 0x7fe3cc130050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3cc0a0a70 0x7fe3cc12f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 --2- 172.21.15.125:0/2226096962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3cc0a1550 0x7fe3cc12fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 >> 172.21.15.125:0/2226096962 conn(0x7fe3cc0a6610 msgr2=0x7fe3cc06da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 shutdown_connections 2023-10-03T10:12:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.676+0000 7fe3d3a94700 1 -- 172.21.15.125:0/2226096962 wait complete. 2023-10-03T10:12:44.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.680+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f9406c3b0 con 0x7f3f9409d860 2023-10-03T10:12:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.680+0000 7f3f90ff9700 1 -- 172.21.15.125:0/1471254119 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f84017030 con 0x7f3f9409d860 2023-10-03T10:12:44.681 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.683+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 msgr2=0x7f3f9412dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.683+0000 7f3f9a374700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c480 tx=0x7f3f8400c790 comp rx=0 tx=0).stop 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.684+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 shutdown_connections 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.684+0000 7f3f9a374700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f94135f20 0x7f3f9412ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.684+0000 7f3f9a374700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f9409d860 0x7f3f9412dd10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.684+0000 7f3f9a374700 1 --2- 172.21.15.125:0/1471254119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f9409e340 0x7f3f9412a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.684+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 >> 172.21.15.125:0/1471254119 conn(0x7f3f94099c40 msgr2=0x7f3f94071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.685+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 shutdown_connections 2023-10-03T10:12:44.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.687+0000 7f3f9a374700 1 -- 172.21.15.125:0/1471254119 wait complete. 2023-10-03T10:12:44.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.687+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa79c126340 con 0x7fa79c130eb0 2023-10-03T10:12:44.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.688+0000 7fa7997fa700 1 -- 172.21.15.125:0/4179668349 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa794033090 con 0x7fa79c130eb0 2023-10-03T10:12:44.688 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:44.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 msgr2=0x7fa79c120000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 0x7fa79c120000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa794014000 tx=0x7fa794004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 shutdown_connections 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79c130eb0 0x7fa79c120000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa79c09d860 0x7fa79c11f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 --2- 172.21.15.125:0/4179668349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa79c09e170 0x7fa79c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 >> 172.21.15.125:0/4179668349 conn(0x7fa79c099c40 msgr2=0x7fa79c119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 shutdown_connections 2023-10-03T10:12:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.691+0000 7fa7a2aa9700 1 -- 172.21.15.125:0/4179668349 wait complete. 2023-10-03T10:12:44.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:44.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:44.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.724+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8ec0a1750 con 0x7fb8ec0a1340 2023-10-03T10:12:44.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.725+0000 7fb8daffd700 1 -- 172.21.15.125:0/1412505223 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8ec0a1750 con 0x7fb8ec0a1340 2023-10-03T10:12:44.725 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:44.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 msgr2=0x7fb8ec13b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b500 tx=0x7fb8e000b810 comp rx=0 tx=0).stop 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 shutdown_connections 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8ec1304a0 0x7fb8ec13b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8ec0a0a30 0x7fb8ec13adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 --2- 172.21.15.125:0/1412505223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8ec0a1340 0x7fb8ec13b2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 >> 172.21.15.125:0/1412505223 conn(0x7fb8ec0a2980 msgr2=0x7fb8ec09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 shutdown_connections 2023-10-03T10:12:44.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:44.728+0000 7fb8f0ccb700 1 -- 172.21.15.125:0/1412505223 wait complete. 2023-10-03T10:12:44.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:45.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:45.703 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:45.706 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:45.741 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:45.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.837+0000 7f9d4c6a1700 1 Processor -- start 2023-10-03T10:12:45.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.837+0000 7f9d4c6a1700 1 -- start start 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.838+0000 7f9d4c6a1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.838+0000 7f9d4c6a1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d441300a0 0x7f9d441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.838+0000 7f9d4c6a1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4406b2d0 con 0x7f9d441309f0 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.838+0000 7f9d4c6a1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d44133610 con 0x7f9d441300a0 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.838+0000 7f9d4c6a1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4409a500 con 0x7f9d44133ad0 2023-10-03T10:12:45.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4ac3e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d441309f0 0x7f9d4413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47062/0 (socket says 172.21.15.125:47062) 2023-10-03T10:12:45.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46610/0 (socket says 172.21.15.125:46610) 2023-10-03T10:12:45.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4ac3e700 1 -- 172.21.15.125:0/1211449286 learned_addr learned my addr 172.21.15.125:0/1211449286 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:45.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d49c3c700 1 --2- 172.21.15.125:0/1211449286 >> v2:172.21.15.125:3300/0 conn(0x7f9d441300a0 0x7f9d441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 -- 172.21.15.125:0/1211449286 >> v2:172.21.15.125:3300/0 conn(0x7f9d441300a0 msgr2=0x7f9d441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 --2- 172.21.15.125:0/1211449286 >> v2:172.21.15.125:3300/0 conn(0x7f9d441300a0 0x7f9d441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 -- 172.21.15.125:0/1211449286 >> v1:172.21.15.125:6789/0 conn(0x7f9d441309f0 legacy=0x7f9d4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 -- 172.21.15.125:0/1211449286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d441338b0 con 0x7f9d44133ad0 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4a43d700 1 --2- 172.21.15.125:0/1211449286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009840 tx=0x7f9d40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1907a7b42735d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4943b700 1 -- 172.21.15.125:0/1211449286 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011830 con 0x7f9d44133ad0 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4943b700 1 -- 172.21.15.125:0/1211449286 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40011990 con 0x7f9d44133ad0 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.839+0000 7f9d4943b700 1 -- 172.21.15.125:0/1211449286 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011d20 con 0x7f9d44133ad0 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1211449286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 msgr2=0x7f9d44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1211449286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009840 tx=0x7f9d40009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1211449286 shutdown_connections 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1211449286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d44133ad0 0x7f9d44133ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1211449286 >> v2:172.21.15.125:3300/0 conn(0x7f9d441300a0 0x7f9d441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1211449286 >> 172.21.15.125:0/1211449286 conn(0x7f9d44099c40 msgr2=0x7f9d440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1211449286 shutdown_connections 2023-10-03T10:12:45.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.840+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1211449286 wait complete. 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.841+0000 7f9d4c6a1700 1 Processor -- start 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 -- start start 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 0x7f9d4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44133ad0 0x7f9d4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4411edb0 con 0x7f9d44133ad0 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441200c0 con 0x7f9d441300a0 2023-10-03T10:12:45.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4c6a1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4412dd00 con 0x7f9d441309f0 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4a43d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4a43d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46616/0 (socket says 172.21.15.125:46616) 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d49c3c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 0x7f9d4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4a43d700 1 -- 172.21.15.125:0/1153931064 learned_addr learned my addr 172.21.15.125:0/1153931064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.842+0000 7f9d4ac3e700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44133ad0 0x7f9d4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 -- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 msgr2=0x7f9d4411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 -- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44133ad0 msgr2=0x7f9d4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44133ad0 0x7f9d4411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 -- 172.21.15.125:0/1153931064 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400094a0 con 0x7f9d441309f0 2023-10-03T10:12:45.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d4a43d700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d49c3c700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 0x7f9d4411df80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400e900 tx=0x7f9d3400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34013680 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d340137e0 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4412d970 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34013b50 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.843+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4411f8c0 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.844+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d34013cb0 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.845+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d3403f620 con 0x7f9d441309f0 2023-10-03T10:12:45.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.845+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4409cb20 con 0x7f9d441309f0 2023-10-03T10:12:45.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.849+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d34017020 con 0x7f9d441309f0 2023-10-03T10:12:45.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.868+0000 7f50a49dc700 1 Processor -- start 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.868+0000 7f50a49dc700 1 -- start start 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f50a49dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50a00a0a30 0x7f50a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f50a49dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f50a49dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a00a1e70 con 0x7f50a00a1340 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f50a49dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a009a720 con 0x7f50a00a0a30 2023-10-03T10:12:45.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f50a49dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a009b300 con 0x7f50a0130670 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50a00a0a30 0x7f50a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f50a00a1340 0x7f50a012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47078/0 (socket says 172.21.15.125:47078) 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509dd9b700 1 -- 172.21.15.125:0/3237814468 learned_addr learned my addr 172.21.15.125:0/3237814468 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509ed9d700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 -- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 msgr2=0x7f50a01381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 -- 172.21.15.125:0/3237814468 >> v1:172.21.15.125:6789/0 conn(0x7f50a00a1340 legacy=0x7f50a012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 -- 172.21.15.125:0/3237814468 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a009abc0 con 0x7f50a00a0a30 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509d59a700 1 -- 172.21.15.125:0/3237814468 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715510242 0 0) 0x7f50a00a1e70 con 0x7f50a00a1340 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.869+0000 7f509e59c700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a0a30 0x7f50a00a0e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f509000bac0 tx=0x7f509000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729d383c153ab327 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f509d59a700 1 -- 172.21.15.125:0/3237814468 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090005e30 con 0x7f50a00a0a30 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f509d59a700 1 -- 172.21.15.125:0/3237814468 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000d860 con 0x7f50a00a0a30 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f509d59a700 1 -- 172.21.15.125:0/3237814468 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000dbf0 con 0x7f50a00a0a30 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 -- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a0a30 msgr2=0x7f50a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a0a30 0x7f50a00a0e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f509000bac0 tx=0x7f509000bdd0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 -- 172.21.15.125:0/3237814468 shutdown_connections 2023-10-03T10:12:45.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3237814468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a0a30 0x7f50a00a0e00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 -- 172.21.15.125:0/3237814468 >> 172.21.15.125:0/3237814468 conn(0x7f50a00a2980 msgr2=0x7f50a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 -- 172.21.15.125:0/3237814468 shutdown_connections 2023-10-03T10:12:45.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.870+0000 7f50a49dc700 1 -- 172.21.15.125:0/3237814468 wait complete. 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 Processor -- start 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 -- start start 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 0x7f50a01c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a011cd80 con 0x7f50a00a1340 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a011cb90 con 0x7f50a0130670 2023-10-03T10:12:45.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f50a49dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a011eaa0 con 0x7f50a00a0a30 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f509dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f509e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 0x7f50a01c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f509dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46350/0 (socket says 172.21.15.125:46350) 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f509dd9b700 1 -- 172.21.15.125:0/3795136547 learned_addr learned my addr 172.21.15.125:0/3795136547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.872+0000 7f509ed9d700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 -- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 msgr2=0x7f50a01c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 0x7f50a01c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 -- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 msgr2=0x7f50a01c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 -- 172.21.15.125:0/3795136547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509000b6d0 con 0x7f50a00a1340 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509e59c700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 0x7f50a01c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f509dd9b700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f509400c750 tx=0x7f509400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094005e20 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50940070d0 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094007480 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a009f920 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.873+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a011d380 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.874+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50940075e0 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.874+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f509403eb30 con 0x7f50a00a1340 2023-10-03T10:12:45.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.874+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a004f2a0 con 0x7f50a00a1340 2023-10-03T10:12:45.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.877+0000 7f1212c8a700 1 Processor -- start 2023-10-03T10:12:45.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 -- start start 2023-10-03T10:12:45.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 0x7f120c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 0x7f120c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120c09a760 con 0x7f120c133900 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c1336e0 con 0x7f120c1368e0 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1212c8a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f120c09a080 con 0x7f120c139200 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1210a26700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f120c133900 0x7f120c133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47080/0 (socket says 172.21.15.125:47080) 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1210a26700 1 -- 172.21.15.125:0/3067852175 learned_addr learned my addr 172.21.15.125:0/3067852175 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.878+0000 7f1211227700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 0x7f120c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f120bfff700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 0x7f120c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f1211227700 1 -- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 msgr2=0x7f120c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f1211227700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 0x7f120c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f1211227700 1 -- 172.21.15.125:0/3067852175 >> v1:172.21.15.125:6789/0 conn(0x7f120c133900 legacy=0x7f120c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f1211227700 1 -- 172.21.15.125:0/3067852175 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0a23e0 con 0x7f120c139200 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f120bfff700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 0x7f120c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f1211227700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 0x7f120c13b5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1204009dc0 tx=0x7f120400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf3d8595035ba1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f120b7fe700 1 -- 172.21.15.125:0/3067852175 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400e070 con 0x7f120c139200 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f120b7fe700 1 -- 172.21.15.125:0/3067852175 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400bbd0 con 0x7f120c139200 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f120b7fe700 1 -- 172.21.15.125:0/3067852175 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204012430 con 0x7f120c139200 2023-10-03T10:12:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.879+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5094017030 con 0x7f50a00a1340 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 -- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 msgr2=0x7f120c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 0x7f120c13b5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1204009dc0 tx=0x7f120400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 -- 172.21.15.125:0/3067852175 shutdown_connections 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c139200 0x7f120c13b5e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3067852175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c1368e0 0x7f120c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.880+0000 7f1212c8a700 1 -- 172.21.15.125:0/3067852175 >> 172.21.15.125:0/3067852175 conn(0x7f120c0a2980 msgr2=0x7f120c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.881+0000 7f1212c8a700 1 -- 172.21.15.125:0/3067852175 shutdown_connections 2023-10-03T10:12:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.881+0000 7f1212c8a700 1 -- 172.21.15.125:0/3067852175 wait complete. 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.881+0000 7f1212c8a700 1 Processor -- start 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 -- start start 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 0x7f120c119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 0x7f120c11a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c138ff0 con 0x7f120c139200 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c12f710 con 0x7f120c133900 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1212c8a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f120c11da10 con 0x7f120c1368e0 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f120bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f120bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43038/0 (socket says 172.21.15.125:43038) 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1210a26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 0x7f120c119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f120bfff700 1 -- 172.21.15.125:0/3921197600 learned_addr learned my addr 172.21.15.125:0/3921197600 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:45.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.882+0000 7f1211227700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 0x7f120c11a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 -- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 msgr2=0x7f120c119de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 0x7f120c119de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 -- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 msgr2=0x7f120c11a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 0x7f120c11a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 -- 172.21.15.125:0/3921197600 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1204009a70 con 0x7f120c1368e0 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f1210a26700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 0x7f120c119de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f1211227700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 0x7f120c11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f120bfff700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c750 tx=0x7f11f800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011800 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8011960 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c11bfa0 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011cd0 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.883+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c11d3c0 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.885+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c04f2a0 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.885+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11f8023480 con 0x7f120c1368e0 2023-10-03T10:12:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.886+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11f803fa60 con 0x7f120c1368e0 2023-10-03T10:12:45.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.893+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11f8011e30 con 0x7f120c1368e0 2023-10-03T10:12:45.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.920+0000 7f97e4f0c700 1 Processor -- start 2023-10-03T10:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.920+0000 7f97e4f0c700 1 -- start start 2023-10-03T10:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97e4f0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97e4f0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 0x7f97e013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97e4f0c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e009dc00 con 0x7f97e00a1380 2023-10-03T10:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97e4f0c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e009ea90 con 0x7f97e00a0a70 2023-10-03T10:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97e4f0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e009dec0 con 0x7f97e0134120 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97ded9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 0x7f97e013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46658/0 (socket says 172.21.15.125:46658) 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97ded9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 0x7f97e013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43054/0 (socket says 172.21.15.125:43054) 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 -- 172.21.15.125:0/2070143343 learned_addr learned my addr 172.21.15.125:0/2070143343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 -- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 msgr2=0x7f97e013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 --2- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 0x7f97e013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 -- 172.21.15.125:0/2070143343 >> v1:172.21.15.125:6789/0 conn(0x7f97e00a1380 legacy=0x7f97e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.921+0000 7f97de59c700 1 -- 172.21.15.125:0/2070143343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e009e6a0 con 0x7f97e00a0a70 2023-10-03T10:12:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97de59c700 1 --2- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009920 tx=0x7f97d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aefe84afd37b2b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97dd59a700 1 -- 172.21.15.125:0/2070143343 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0011830 con 0x7f97e00a0a70 2023-10-03T10:12:45.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97dd59a700 1 -- 172.21.15.125:0/2070143343 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0011990 con 0x7f97e00a0a70 2023-10-03T10:12:45.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97dd59a700 1 -- 172.21.15.125:0/2070143343 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0011d20 con 0x7f97e00a0a70 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 msgr2=0x7f97e00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009920 tx=0x7f97d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2070143343 shutdown_connections 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.922+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e0134120 0x7f97e013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.923+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2070143343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e00a0a70 0x7f97e00a0e40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.923+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2070143343 >> 172.21.15.125:0/2070143343 conn(0x7f97e00a6610 msgr2=0x7f97e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.923+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2070143343 shutdown_connections 2023-10-03T10:12:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.923+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2070143343 wait complete. 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 Processor -- start 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 -- start start 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e00a1380 0x7f97e0122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e0134120 0x7f97e0123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0133aa0 con 0x7f97e00a1380 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01333e0 con 0x7f97e0134120 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97e4f0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01245e0 con 0x7f97e00a0a70 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97de59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97ded9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e0134120 0x7f97e0123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97de59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43066/0 (socket says 172.21.15.125:43066) 2023-10-03T10:12:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97de59c700 1 -- 172.21.15.125:0/2981095844 learned_addr learned my addr 172.21.15.125:0/2981095844 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.924+0000 7f97ddd9b700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e00a1380 0x7f97e0122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 -- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e0134120 msgr2=0x7f97e0123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e0134120 0x7f97e0123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 -- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e00a1380 msgr2=0x7f97e0122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e00a1380 0x7f97e0122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 -- 172.21.15.125:0/2981095844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009550 con 0x7f97e00a0a70 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97de59c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0004450 con 0x7f97e00a0a70 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d00045b0 con 0x7f97e00a0a70 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e0124cd0 con 0x7f97e00a0a70 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00038c0 con 0x7f97e00a0a70 2023-10-03T10:12:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.925+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e0133810 con 0x7f97e00a0a70 2023-10-03T10:12:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.926+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d0003a20 con 0x7f97e00a0a70 2023-10-03T10:12:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.926+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97d0021030 con 0x7f97e00a0a70 2023-10-03T10:12:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.927+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e004f2a0 con 0x7f97e00a0a70 2023-10-03T10:12:45.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:45.931+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d001a7b0 con 0x7f97e00a0a70 2023-10-03T10:12:46.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.050+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d4404f2a0 con 0x7f9d441309f0 2023-10-03T10:12:46.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.051+0000 7f9d3affd700 1 -- 172.21.15.125:0/1153931064 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d3401b9c0 con 0x7f9d441309f0 2023-10-03T10:12:46.051 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:46.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 msgr2=0x7f9d4411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 0x7f9d4411df80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400e900 tx=0x7f9d3400ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 shutdown_connections 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44133ad0 0x7f9d4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d441300a0 0x7f9d4411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 --2- 172.21.15.125:0/1153931064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d441309f0 0x7f9d4411df80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 >> 172.21.15.125:0/1153931064 conn(0x7f9d44099c40 msgr2=0x7f9d4412f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 shutdown_connections 2023-10-03T10:12:46.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.054+0000 7f9d4c6a1700 1 -- 172.21.15.125:0/1153931064 wait complete. 2023-10-03T10:12:46.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:46.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.125+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97e0072980 con 0x7f97e00a0a70 2023-10-03T10:12:46.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.126+0000 7f97ceffd700 1 -- 172.21.15.125:0/2981095844 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97d002b070 con 0x7f97e00a0a70 2023-10-03T10:12:46.126 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 msgr2=0x7f97e01228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 shutdown_connections 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e0134120 0x7f97e0123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e00a0a70 0x7f97e01228c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 --2- 172.21.15.125:0/2981095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e00a1380 0x7f97e0122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 >> 172.21.15.125:0/2981095844 conn(0x7f97e00a6610 msgr2=0x7f97e00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 shutdown_connections 2023-10-03T10:12:46.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.128+0000 7f97e4f0c700 1 -- 172.21.15.125:0/2981095844 wait complete. 2023-10-03T10:12:46.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.135+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50a006bce0 con 0x7f50a00a1340 2023-10-03T10:12:46.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.136+0000 7f508effd700 1 -- 172.21.15.125:0/3795136547 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5094007890 con 0x7f50a00a1340 2023-10-03T10:12:46.136 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 msgr2=0x7f50a01c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f509400c750 tx=0x7f509400ca60 comp rx=0 tx=0).stop 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 shutdown_connections 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50a0130670 0x7f50a01c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50a00a0a30 0x7f50a01c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 --2- 172.21.15.125:0/3795136547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50a00a1340 0x7f50a01c4110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 >> 172.21.15.125:0/3795136547 conn(0x7f50a00a2980 msgr2=0x7f50a0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 shutdown_connections 2023-10-03T10:12:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f50a49dc700 1 -- 172.21.15.125:0/3795136547 wait complete. 2023-10-03T10:12:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.138+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f120c06bce0 con 0x7f120c1368e0 2023-10-03T10:12:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.139+0000 7f12097fa700 1 -- 172.21.15.125:0/3921197600 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11f801e020 con 0x7f120c1368e0 2023-10-03T10:12:46.140 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:46.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:46.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 msgr2=0x7f120c11a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c750 tx=0x7f11f800ca60 comp rx=0 tx=0).stop 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 shutdown_connections 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f120c139200 0x7f120c11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f120c133900 0x7f120c119de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 --2- 172.21.15.125:0/3921197600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f120c1368e0 0x7f120c11a320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 >> 172.21.15.125:0/3921197600 conn(0x7f120c0a2980 msgr2=0x7f120c0a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 shutdown_connections 2023-10-03T10:12:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:46.142+0000 7f1212c8a700 1 -- 172.21.15.125:0/3921197600 wait complete. 2023-10-03T10:12:46.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:46.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:47.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:47.143 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:47.153 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:47.156 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.215+0000 7f1314f1e700 1 Processor -- start 2023-10-03T10:12:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.215+0000 7f1314f1e700 1 -- start start 2023-10-03T10:12:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310133b80 0x7f1310133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 0x7f13100a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131009aa00 con 0x7f13100a0e20 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131009a080 con 0x7f1310133b80 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f1314f1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1310133750 con 0x7f1310099a60 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f130ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f130ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46382/0 (socket says 172.21.15.125:46382) 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f130ed9d700 1 -- 172.21.15.125:0/2077919500 learned_addr learned my addr 172.21.15.125:0/2077919500 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.216+0000 7f130dd9b700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 0x7f13100a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 -- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310133b80 msgr2=0x7f1310133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310133b80 0x7f1310133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 -- 172.21.15.125:0/2077919500 >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 msgr2=0x7f13100a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 --2- 172.21.15.125:0/2077919500 >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 -- 172.21.15.125:0/2077919500 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131009a760 con 0x7f1310099a60 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130ed9d700 1 --2- 172.21.15.125:0/2077919500 >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130dd9b700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 0x7f13100a08e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1304009840 tx=0x7f1304009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2554bc09290b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130d59a700 1 -- 172.21.15.125:0/2077919500 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011830 con 0x7f1310099a60 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130d59a700 1 -- 172.21.15.125:0/2077919500 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011990 con 0x7f1310099a60 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.217+0000 7f130d59a700 1 -- 172.21.15.125:0/2077919500 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011d20 con 0x7f1310099a60 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 -- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 msgr2=0x7f13100a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 0x7f13100a08e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1304009840 tx=0x7f1304009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 -- 172.21.15.125:0/2077919500 shutdown_connections 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310133b80 0x7f1310133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 --2- 172.21.15.125:0/2077919500 >> v2:172.21.15.125:3300/0 conn(0x7f13100a0e20 0x7f13100a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 --2- 172.21.15.125:0/2077919500 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310099a60 0x7f13100a08e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 -- 172.21.15.125:0/2077919500 >> 172.21.15.125:0/2077919500 conn(0x7f13100a2980 msgr2=0x7f13100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 -- 172.21.15.125:0/2077919500 shutdown_connections 2023-10-03T10:12:47.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.218+0000 7f1314f1e700 1 -- 172.21.15.125:0/2077919500 wait complete. 2023-10-03T10:12:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.219+0000 7f1314f1e700 1 Processor -- start 2023-10-03T10:12:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.219+0000 7f1314f1e700 1 -- start start 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310099a60 0x7f131011ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 0x7f131011d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131009a330 con 0x7f13100a0e20 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131009c4e0 con 0x7f1310099a60 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f1314f1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f131011ee20 con 0x7f1310133b80 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46390/0 (socket says 172.21.15.125:46390) 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 -- 172.21.15.125:0/3729726257 learned_addr learned my addr 172.21.15.125:0/3729726257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130ed9d700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 0x7f131011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 -- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 msgr2=0x7f131011d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 0x7f131011d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 -- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310099a60 msgr2=0x7f131011ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310099a60 0x7f131011ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130dd9b700 1 -- 172.21.15.125:0/3729726257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009b30 con 0x7f13100a0e20 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.220+0000 7f130ed9d700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 0x7f131011d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f130dd9b700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f13040090b0 tx=0x7f1304004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304004510 con 0x7f13100a0e20 2023-10-03T10:12:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130401f070 con 0x7f13100a0e20 2023-10-03T10:12:47.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040094a0 con 0x7f13100a0e20 2023-10-03T10:12:47.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040038e0 con 0x7f13100a0e20 2023-10-03T10:12:47.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.221+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131011ff30 con 0x7f13100a0e20 2023-10-03T10:12:47.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.222+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1304003a40 con 0x7f13100a0e20 2023-10-03T10:12:47.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.222+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1304021070 con 0x7f13100a0e20 2023-10-03T10:12:47.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.228+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131004f2a0 con 0x7f13100a0e20 2023-10-03T10:12:47.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.232+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f130402b080 con 0x7f13100a0e20 2023-10-03T10:12:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.308+0000 7f2cfe719700 1 Processor -- start 2023-10-03T10:12:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.308+0000 7f2cfe719700 1 -- start start 2023-10-03T10:12:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809c5c0 0x7f2cf8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf806eb30 con 0x7f2cf809bc70 2023-10-03T10:12:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80a1640 con 0x7f2cf809c5c0 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfe719700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80a22d0 con 0x7f2cf8131980 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46402/0 (socket says 172.21.15.125:46402) 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43108/0 (socket says 172.21.15.125:43108) 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf77fe700 1 -- 172.21.15.125:0/1285502188 learned_addr learned my addr 172.21.15.125:0/1285502188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cfccb6700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809c5c0 0x7f2cf8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 -- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809c5c0 msgr2=0x7f2cf8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809c5c0 0x7f2cf8138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 -- 172.21.15.125:0/1285502188 >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 msgr2=0x7f2cf809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 --2- 172.21.15.125:0/1285502188 >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 -- 172.21.15.125:0/1285502188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8131550 con 0x7f2cf8131980 2023-10-03T10:12:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf77fe700 1 --2- 172.21.15.125:0/1285502188 >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.309+0000 7f2cf7fff700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009850 tx=0x7f2ce8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8255a78f81b6fc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.310+0000 7f2cf6ffd700 1 -- 172.21.15.125:0/1285502188 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8005e30 con 0x7f2cf8131980 2023-10-03T10:12:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.310+0000 7f2cf6ffd700 1 -- 172.21.15.125:0/1285502188 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8006030 con 0x7f2cf8131980 2023-10-03T10:12:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.310+0000 7f2cf6ffd700 1 -- 172.21.15.125:0/1285502188 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80063c0 con 0x7f2cf8131980 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 -- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 msgr2=0x7f2cf8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009850 tx=0x7f2ce8009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 -- 172.21.15.125:0/1285502188 shutdown_connections 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809c5c0 0x7f2cf8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 --2- 172.21.15.125:0/1285502188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf8131980 0x7f2cf8131d50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 --2- 172.21.15.125:0/1285502188 >> v2:172.21.15.125:3300/0 conn(0x7f2cf809bc70 0x7f2cf809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 -- 172.21.15.125:0/1285502188 >> 172.21.15.125:0/1285502188 conn(0x7f2cf80a2980 msgr2=0x7f2cf80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 -- 172.21.15.125:0/1285502188 shutdown_connections 2023-10-03T10:12:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.311+0000 7f2cfe719700 1 -- 172.21.15.125:0/1285502188 wait complete. 2023-10-03T10:12:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.312+0000 7f2cfe719700 1 Processor -- start 2023-10-03T10:12:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.312+0000 7f2cfe719700 1 -- start start 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809bc70 0x7f2cf81190c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf809c5c0 0x7f2cf8119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80a1cb0 con 0x7f2cf8131980 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf811a420 con 0x7f2cf809bc70 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfe719700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf811c0c0 con 0x7f2cf809c5c0 2023-10-03T10:12:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfccb6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfccb6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46412/0 (socket says 172.21.15.125:46412) 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cfccb6700 1 -- 172.21.15.125:0/837748306 learned_addr learned my addr 172.21.15.125:0/837748306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cf77fe700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf809c5c0 0x7f2cf8119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.313+0000 7f2cf7fff700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809bc70 0x7f2cf81190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 -- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf809c5c0 msgr2=0x7f2cf8119600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf809c5c0 0x7f2cf8119600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 -- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809bc70 msgr2=0x7f2cf81190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809bc70 0x7f2cf81190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 -- 172.21.15.125:0/837748306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec009550 con 0x7f2cf8131980 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfccb6700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009dd0 tx=0x7f2cf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0009c40 con 0x7f2cf8131980 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000f040 con 0x7f2cf8131980 2023-10-03T10:12:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8009430 con 0x7f2cf8131980 2023-10-03T10:12:47.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0014480 con 0x7f2cf8131980 2023-10-03T10:12:47.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.314+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf811c5f0 con 0x7f2cf8131980 2023-10-03T10:12:47.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.315+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf00145e0 con 0x7f2cf8131980 2023-10-03T10:12:47.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.315+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cf00401f0 con 0x7f2cf8131980 2023-10-03T10:12:47.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.315+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf804f2a0 con 0x7f2cf8131980 2023-10-03T10:12:47.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.324+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cf0018030 con 0x7f2cf8131980 2023-10-03T10:12:47.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.332+0000 7f7edeb2d700 1 Processor -- start 2023-10-03T10:12:47.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.332+0000 7f7edeb2d700 1 -- start start 2023-10-03T10:12:47.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edeb2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ed8136960 0x7f7ed8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edeb2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 0x7f7ed813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edeb2d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed806b2d0 con 0x7f7ed8133ad0 2023-10-03T10:12:47.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edeb2d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed81345b0 con 0x7f7ed8136960 2023-10-03T10:12:47.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edeb2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8133610 con 0x7f7ed8139280 2023-10-03T10:12:47.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edc8c9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7ed8133ad0 0x7f7ed8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47098/0 (socket says 172.21.15.125:47098) 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edd0ca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 0x7f7ed813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edc8c9700 1 -- 172.21.15.125:0/3075524432 learned_addr learned my addr 172.21.15.125:0/3075524432 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 --2- 172.21.15.125:0/3075524432 >> v2:172.21.15.125:3300/0 conn(0x7f7ed8136960 0x7f7ed8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed77fe700 1 -- 172.21.15.125:0/3075524432 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497162724 0 0) 0x7f7ed806b2d0 con 0x7f7ed8133ad0 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 -- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 msgr2=0x7f7ed813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 0x7f7ed813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 -- 172.21.15.125:0/3075524432 >> v1:172.21.15.125:6789/0 conn(0x7f7ed8133ad0 legacy=0x7f7ed8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 -- 172.21.15.125:0/3075524432 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed809a500 con 0x7f7ed8136960 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7edd0ca700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 0x7f7ed813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.333+0000 7f7ed7fff700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8136960 0x7f7ed8138d40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009840 tx=0x7f7ec4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65626ae0ab5a4a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7ed77fe700 1 -- 172.21.15.125:0/3075524432 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011830 con 0x7f7ed8136960 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7ed77fe700 1 -- 172.21.15.125:0/3075524432 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4011990 con 0x7f7ed8136960 2023-10-03T10:12:47.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7ed77fe700 1 -- 172.21.15.125:0/3075524432 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011d20 con 0x7f7ed8136960 2023-10-03T10:12:47.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 -- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8136960 msgr2=0x7f7ed8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8136960 0x7f7ed8138d40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009840 tx=0x7f7ec4009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 -- 172.21.15.125:0/3075524432 shutdown_connections 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8139280 0x7f7ed813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/3075524432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8136960 0x7f7ed8138d40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.334+0000 7f7edeb2d700 1 -- 172.21.15.125:0/3075524432 >> 172.21.15.125:0/3075524432 conn(0x7f7ed8099c40 msgr2=0x7f7ed80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.335+0000 7f7edeb2d700 1 -- 172.21.15.125:0/3075524432 shutdown_connections 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.335+0000 7f7edeb2d700 1 -- 172.21.15.125:0/3075524432 wait complete. 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.336+0000 7f7edeb2d700 1 Processor -- start 2023-10-03T10:12:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.336+0000 7f7edeb2d700 1 -- start start 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 0x7f7ed8071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8136960 0x7f7ed8071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed806ec30 con 0x7f7ed8133ad0 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8072200 con 0x7f7ed8139280 2023-10-03T10:12:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edeb2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81317a0 con 0x7f7ed8136960 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edc8c9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 0x7f7ed8071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46724/0 (socket says 172.21.15.125:46724) 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 -- 172.21.15.125:0/2343482923 learned_addr learned my addr 172.21.15.125:0/2343482923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7ed7fff700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8136960 0x7f7ed8071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 -- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8136960 msgr2=0x7f7ed8071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8136960 0x7f7ed8071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 -- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 msgr2=0x7f7ed8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 0x7f7ed8071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 -- 172.21.15.125:0/2343482923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009a70 con 0x7f7ed8139280 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edc8c9700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 0x7f7ed8071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7edd0ca700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000efc0 tx=0x7f7ed000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.337+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000cd40 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.338+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000f040 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.338+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000cea0 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.338+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40094a0 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.338+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed806ee50 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.338+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ed00146a0 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.339+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ed00404c0 con 0x7f7ed8139280 2023-10-03T10:12:47.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.339+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed804f2a0 con 0x7f7ed8139280 2023-10-03T10:12:47.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.343+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ed0012700 con 0x7f7ed8139280 2023-10-03T10:12:47.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 Processor -- start 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 -- start start 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 0x7f7ef01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ef0134f00 0x7f7ef009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef009e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006b2e0 con 0x7f7ef0134f00 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef009eca0 con 0x7f7ef009dea0 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.353+0000 7f7ef5b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef009f720 con 0x7f7ef006a770 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 0x7f7ef01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ef0134f00 0x7f7ef009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 0x7f7ef01349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43144/0 (socket says 172.21.15.125:43144) 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eef7fe700 1 -- 172.21.15.125:0/3406745292 learned_addr learned my addr 172.21.15.125:0/3406745292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeffff700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 -- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 msgr2=0x7f7ef01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 0x7f7ef01349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 -- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 msgr2=0x7f7ef009e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef009e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 -- 172.21.15.125:0/3406745292 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef006b480 con 0x7f7ef0134f00 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eeeffd700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef0134f00 0x7f7ef009d960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009840 tx=0x7f7ee4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94255a49f034dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eee7fc700 1 -- 172.21.15.125:0/3406745292 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4011830 con 0x7f7ef0134f00 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eee7fc700 1 -- 172.21.15.125:0/3406745292 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4011990 con 0x7f7ef0134f00 2023-10-03T10:12:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.354+0000 7f7eee7fc700 1 -- 172.21.15.125:0/3406745292 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4011d20 con 0x7f7ef0134f00 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 -- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef0134f00 msgr2=0x7f7ef009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef0134f00 0x7f7ef009d960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009840 tx=0x7f7ee4009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 -- 172.21.15.125:0/3406745292 shutdown_connections 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef006a770 0x7f7ef01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/3406745292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef0134f00 0x7f7ef009d960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 -- 172.21.15.125:0/3406745292 >> 172.21.15.125:0/3406745292 conn(0x7f7ef0099c40 msgr2=0x7f7ef00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 -- 172.21.15.125:0/3406745292 shutdown_connections 2023-10-03T10:12:47.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.355+0000 7f7ef5b71700 1 -- 172.21.15.125:0/3406745292 wait complete. 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.356+0000 7f7ef5b71700 1 Processor -- start 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 -- start start 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef0134f00 0x7f7ef00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0138f60 con 0x7f7ef006a770 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0134250 con 0x7f7ef009dea0 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7ef5b71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00a0490 con 0x7f7ef0134f00 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7eef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7eef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46442/0 (socket says 172.21.15.125:46442) 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.357+0000 7f7eef7fe700 1 -- 172.21.15.125:0/4098230739 learned_addr learned my addr 172.21.15.125:0/4098230739 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:47.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eeffff700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef0134f00 0x7f7ef00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eeeffd700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 -- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef0134f00 msgr2=0x7f7ef00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef0134f00 0x7f7ef00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 -- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 msgr2=0x7f7ef006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 -- 172.21.15.125:0/4098230739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40094a0 con 0x7f7ef006a770 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eeeffd700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7eef7fe700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e8b0 tx=0x7f7ee000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0013680 con 0x7f7ef006a770 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee00137e0 con 0x7f7ef006a770 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef0071ce0 con 0x7f7ef006a770 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef0139450 con 0x7f7ef006a770 2023-10-03T10:12:47.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.358+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0013b70 con 0x7f7ef006a770 2023-10-03T10:12:47.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.359+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ee0013cd0 con 0x7f7ef006a770 2023-10-03T10:12:47.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.359+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ee003f600 con 0x7f7ef006a770 2023-10-03T10:12:47.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.359+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed00052e0 con 0x7f7ef006a770 2023-10-03T10:12:47.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.364+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ee001be10 con 0x7f7ef006a770 2023-10-03T10:12:47.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.518+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f131006bce0 con 0x7f13100a0e20 2023-10-03T10:12:47.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.519+0000 7f12feffd700 1 -- 172.21.15.125:0/3729726257 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1304015020 con 0x7f13100a0e20 2023-10-03T10:12:47.520 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:47.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 msgr2=0x7f131011cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f13040090b0 tx=0x7f1304004750 comp rx=0 tx=0).stop 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 shutdown_connections 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1310133b80 0x7f131011d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1310099a60 0x7f131011ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 --2- 172.21.15.125:0/3729726257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13100a0e20 0x7f131011cf40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 >> 172.21.15.125:0/3729726257 conn(0x7f13100a2980 msgr2=0x7f13101baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 shutdown_connections 2023-10-03T10:12:47.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.521+0000 7f1314f1e700 1 -- 172.21.15.125:0/3729726257 wait complete. 2023-10-03T10:12:47.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:47.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.538+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ed809f0f0 con 0x7f7ed8139280 2023-10-03T10:12:47.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.539+0000 7f7ed57fa700 1 -- 172.21.15.125:0/2343482923 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ed002c090 con 0x7f7ed8139280 2023-10-03T10:12:47.539 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:47.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.540+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 msgr2=0x7f7ed8071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.540+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000efc0 tx=0x7f7ed000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 shutdown_connections 2023-10-03T10:12:47.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ed8139280 0x7f7ed8071bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed8133ad0 0x7f7ed8071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 --2- 172.21.15.125:0/2343482923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ed8136960 0x7f7ed8071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 >> 172.21.15.125:0/2343482923 conn(0x7f7ed8099c40 msgr2=0x7f7ed80a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 shutdown_connections 2023-10-03T10:12:47.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.541+0000 7f7edeb2d700 1 -- 172.21.15.125:0/2343482923 wait complete. 2023-10-03T10:12:47.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:47.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.555+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ed0005590 con 0x7f7ef006a770 2023-10-03T10:12:47.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.556+0000 7f7ed7fff700 1 -- 172.21.15.125:0/4098230739 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ee0017030 con 0x7f7ef006a770 2023-10-03T10:12:47.556 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 msgr2=0x7f7ef0133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e8b0 tx=0x7f7ee000ebc0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 shutdown_connections 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ef0134f00 0x7f7ef00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef006a770 0x7f7ef0133d10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 --2- 172.21.15.125:0/4098230739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ef009dea0 0x7f7ef006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 >> 172.21.15.125:0/4098230739 conn(0x7f7ef0099c40 msgr2=0x7f7ef009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 shutdown_connections 2023-10-03T10:12:47.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.558+0000 7f7ef5b71700 1 -- 172.21.15.125:0/4098230739 wait complete. 2023-10-03T10:12:47.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.592+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cf806bce0 con 0x7f2cf8131980 2023-10-03T10:12:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.593+0000 7f2cf4ff9700 1 -- 172.21.15.125:0/837748306 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf00076f0 con 0x7f2cf8131980 2023-10-03T10:12:47.593 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 msgr2=0x7f2cf8119b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009dd0 tx=0x7f2cf000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 shutdown_connections 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf8131980 0x7f2cf8119b40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf809bc70 0x7f2cf81190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 --2- 172.21.15.125:0/837748306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf809c5c0 0x7f2cf8119600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 >> 172.21.15.125:0/837748306 conn(0x7f2cf80a2980 msgr2=0x7f2cf809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 shutdown_connections 2023-10-03T10:12:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:47.595+0000 7f2cfe719700 1 -- 172.21.15.125:0/837748306 wait complete. 2023-10-03T10:12:47.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:48.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:48.554 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:48.571 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:48.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.684+0000 7f5406794700 1 Processor -- start 2023-10-03T10:12:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.684+0000 7f5406794700 1 -- start start 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.684+0000 7f5406794700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f5406794700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5400130670 0x7f54001381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f5406794700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000a1e70 con 0x7f54000a1340 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f5406794700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540009a720 con 0x7f5400130670 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f5406794700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540009b300 con 0x7f54000a0a30 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46758/0 (socket says 172.21.15.125:46758) 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 -- 172.21.15.125:0/2671836472 learned_addr learned my addr 172.21.15.125:0/2671836472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f5404d31700 1 --2- 172.21.15.125:0/2671836472 >> v2:172.21.15.125:3300/0 conn(0x7f5400130670 0x7f54001381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 -- 172.21.15.125:0/2671836472 >> v2:172.21.15.125:3300/0 conn(0x7f5400130670 msgr2=0x7f54001381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 --2- 172.21.15.125:0/2671836472 >> v2:172.21.15.125:3300/0 conn(0x7f5400130670 0x7f54001381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 -- 172.21.15.125:0/2671836472 >> v1:172.21.15.125:6789/0 conn(0x7f54000a1340 legacy=0x7f540012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 -- 172.21.15.125:0/2671836472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540009abc0 con 0x7f54000a0a30 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53feffd700 1 -- 172.21.15.125:0/2671836472 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386271397 0 0) 0x7f54000a1e70 con 0x7f54000a1340 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.685+0000 7f53fffff700 1 --2- 172.21.15.125:0/2671836472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006fd0 tx=0x7f53f000be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9b694f77d3f2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f53feffd700 1 -- 172.21.15.125:0/2671836472 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0005c20 con 0x7f54000a0a30 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f53feffd700 1 -- 172.21.15.125:0/2671836472 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0005d80 con 0x7f54000a0a30 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f53feffd700 1 -- 172.21.15.125:0/2671836472 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000dc40 con 0x7f54000a0a30 2023-10-03T10:12:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 -- 172.21.15.125:0/2671836472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 msgr2=0x7f54000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 --2- 172.21.15.125:0/2671836472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006fd0 tx=0x7f53f000be70 comp rx=0 tx=0).stop 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 -- 172.21.15.125:0/2671836472 shutdown_connections 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 --2- 172.21.15.125:0/2671836472 >> v2:172.21.15.125:3300/0 conn(0x7f5400130670 0x7f54001381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 --2- 172.21.15.125:0/2671836472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54000a0a30 0x7f54000a0e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 -- 172.21.15.125:0/2671836472 >> 172.21.15.125:0/2671836472 conn(0x7f54000a2980 msgr2=0x7f54000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.686+0000 7f5406794700 1 -- 172.21.15.125:0/2671836472 shutdown_connections 2023-10-03T10:12:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.687+0000 7f5406794700 1 -- 172.21.15.125:0/2671836472 wait complete. 2023-10-03T10:12:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.688+0000 7f5406794700 1 Processor -- start 2023-10-03T10:12:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.688+0000 7f5406794700 1 -- start start 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 0x7f540011b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 0x7f540011b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540011d3d0 con 0x7f54000a0a30 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540011de30 con 0x7f5400130670 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5406794700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540009fb40 con 0x7f54000a1340 2023-10-03T10:12:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f53fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f53fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46454/0 (socket says 172.21.15.125:46454) 2023-10-03T10:12:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f53fffff700 1 -- 172.21.15.125:0/2123353710 learned_addr learned my addr 172.21.15.125:0/2123353710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f53ff7fe700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 0x7f540011b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 0x7f540011b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 -- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 msgr2=0x7f540011b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 0x7f540011b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 -- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 msgr2=0x7f540011af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.689+0000 7f5404d31700 1 -- 172.21.15.125:0/2123353710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f000b7a0 con 0x7f5400130670 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f53ff7fe700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 0x7f540011b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f53fffff700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f5404d31700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 0x7f540011b990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53f8007d90 tx=0x7f53f800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8018070 con 0x7f5400130670 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800eb30 con 0x7f5400130670 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8003a20 con 0x7f5400130670 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540009ae00 con 0x7f5400130670 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.690+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5400127ba0 con 0x7f5400130670 2023-10-03T10:12:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.691+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540004f2a0 con 0x7f5400130670 2023-10-03T10:12:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.691+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53f8014420 con 0x7f5400130670 2023-10-03T10:12:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.692+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53f803f690 con 0x7f5400130670 2023-10-03T10:12:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.696+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53f80126a0 con 0x7f5400130670 2023-10-03T10:12:48.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.722+0000 7f5163bdf700 1 Processor -- start 2023-10-03T10:12:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.722+0000 7f5163bdf700 1 -- start start 2023-10-03T10:12:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5163bdf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f515c09e340 0x7f515c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5163bdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5163bdf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c09aaa0 con 0x7f515c09d860 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5163bdf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c09e730 con 0x7f515c09e340 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5163bdf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c09f870 con 0x7f515c135f20 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516117a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f515c09e340 0x7f515c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516197b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f515c09d860 0x7f515c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47122/0 (socket says 172.21.15.125:47122) 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516197b700 1 -- 172.21.15.125:0/1881239427 learned_addr learned my addr 172.21.15.125:0/1881239427 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516217c700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516117a700 1 -- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 msgr2=0x7f515c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516117a700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516117a700 1 -- 172.21.15.125:0/1881239427 >> v1:172.21.15.125:6789/0 conn(0x7f515c09d860 legacy=0x7f515c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f516117a700 1 -- 172.21.15.125:0/1881239427 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c09b360 con 0x7f515c09e340 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.723+0000 7f5160979700 1 -- 172.21.15.125:0/1881239427 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202676852 0 0) 0x7f515c09aaa0 con 0x7f515c09d860 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f516117a700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09e340 0x7f515c1359e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f514c00bae0 tx=0x7f514c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30480d01d37c7d67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5160979700 1 -- 172.21.15.125:0/1881239427 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00dc70 con 0x7f515c09e340 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5160979700 1 -- 172.21.15.125:0/1881239427 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00ddd0 con 0x7f515c09e340 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5160979700 1 -- 172.21.15.125:0/1881239427 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c010690 con 0x7f515c09e340 2023-10-03T10:12:48.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 -- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09e340 msgr2=0x7f515c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09e340 0x7f515c1359e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f514c00bae0 tx=0x7f514c00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 -- 172.21.15.125:0/1881239427 shutdown_connections 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 --2- 172.21.15.125:0/1881239427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09e340 0x7f515c1359e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.724+0000 7f5163bdf700 1 -- 172.21.15.125:0/1881239427 >> 172.21.15.125:0/1881239427 conn(0x7f515c099c40 msgr2=0x7f515c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.725+0000 7f5163bdf700 1 -- 172.21.15.125:0/1881239427 shutdown_connections 2023-10-03T10:12:48.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.725+0000 7f5163bdf700 1 -- 172.21.15.125:0/1881239427 wait complete. 2023-10-03T10:12:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.725+0000 7f5163bdf700 1 Processor -- start 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 -- start start 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f515c09e340 0x7f515c11b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c11bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c11e940 con 0x7f515c09d860 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c11c740 con 0x7f515c09e340 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f5163bdf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0a2020 con 0x7f515c135f20 2023-10-03T10:12:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46472/0 (socket says 172.21.15.125:46472) 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 -- 172.21.15.125:0/3883254890 learned_addr learned my addr 172.21.15.125:0/3883254890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516217c700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c11bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 -- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 msgr2=0x7f515c11bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c11bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 -- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f515c09e340 msgr2=0x7f515c11b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f515c09e340 0x7f515c11b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516197b700 1 -- 172.21.15.125:0/3883254890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c00b740 con 0x7f515c09d860 2023-10-03T10:12:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.726+0000 7f516217c700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c11bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f516197b700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f515800c550 tx=0x7f515800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158004c80 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158004e00 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c09c8b0 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158007310 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.727+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c11eb20 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.728+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c04f2a0 con 0x7f515c09d860 2023-10-03T10:12:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.728+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5158007470 con 0x7f515c09d860 2023-10-03T10:12:48.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.728+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f515801ae70 con 0x7f515c09d860 2023-10-03T10:12:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.730+0000 7f2b83f5b700 1 Processor -- start 2023-10-03T10:12:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.730+0000 7f2b83f5b700 1 -- start start 2023-10-03T10:12:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b83f5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 0x7f2b7c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b83f5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b83f5b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c133640 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b83f5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0a1d50 con 0x7f2b7c133a70 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b83f5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c09b620 con 0x7f2b7c0a1460 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b824f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b824f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43184/0 (socket says 172.21.15.125:43184) 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b824f8700 1 -- 172.21.15.125:0/1923825903 learned_addr learned my addr 172.21.15.125:0/1923825903 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 0x7f2b7c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b81cf7700 1 -- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 msgr2=0x7f2b7c13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b81cf7700 1 -- 172.21.15.125:0/1923825903 >> v1:172.21.15.125:6789/0 conn(0x7f2b7c0a08e0 legacy=0x7f2b7c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b81cf7700 1 -- 172.21.15.125:0/1923825903 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c133870 con 0x7f2b7c133a70 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.731+0000 7f2b824f8700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 0x7f2b7c133e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009850 tx=0x7f2b78009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e2b313652ab7dda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b80cf5700 1 -- 172.21.15.125:0/1923825903 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78005e30 con 0x7f2b7c133a70 2023-10-03T10:12:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b80cf5700 1 -- 172.21.15.125:0/1923825903 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78004030 con 0x7f2b7c133a70 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b80cf5700 1 -- 172.21.15.125:0/1923825903 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780043c0 con 0x7f2b7c133a70 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 -- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 msgr2=0x7f2b7c133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 0x7f2b7c133e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009850 tx=0x7f2b78009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 -- 172.21.15.125:0/1923825903 shutdown_connections 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c0a1460 0x7f2b7c13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/1923825903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c133a70 0x7f2b7c133e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.732+0000 7f2b83f5b700 1 -- 172.21.15.125:0/1923825903 >> 172.21.15.125:0/1923825903 conn(0x7f2b7c0a2980 msgr2=0x7f2b7c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.733+0000 7f2b83f5b700 1 -- 172.21.15.125:0/1923825903 shutdown_connections 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.733+0000 7f2b83f5b700 1 -- 172.21.15.125:0/1923825903 wait complete. 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.733+0000 7f2b83f5b700 1 Processor -- start 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.733+0000 7f2b83f5b700 1 -- start start 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c0a1460 0x7f2b7c120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c133a70 0x7f2b7c1205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1230d0 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c123470 con 0x7f2b7c0a1460 2023-10-03T10:12:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b83f5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c120fb0 con 0x7f2b7c133a70 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46484/0 (socket says 172.21.15.125:46484) 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 -- 172.21.15.125:0/2424484053 learned_addr learned my addr 172.21.15.125:0/2424484053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b824f8700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c133a70 0x7f2b7c1205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b814f6700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c0a1460 0x7f2b7c120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 -- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c133a70 msgr2=0x7f2b7c1205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c133a70 0x7f2b7c1205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 -- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c0a1460 msgr2=0x7f2b7c120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c0a1460 0x7f2b7c120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.734+0000 7f2b81cf7700 1 -- 172.21.15.125:0/2424484053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009b30 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.735+0000 7f2b81cf7700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78003ab0 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78003c10 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b78009430 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78006030 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5158044060 con 0x7f515c09d860 2023-10-03T10:12:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.737+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c121800 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.738+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b78006190 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.738+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b780406f0 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.738+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c123290 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.747+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b78016080 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.770+0000 7fc88d73a700 1 Processor -- start 2023-10-03T10:12:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.770+0000 7fc88d73a700 1 -- start start 2023-10-03T10:12:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.770+0000 7fc88d73a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 0x7fc888136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.770+0000 7fc88d73a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc8881393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.770+0000 7fc88d73a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880a1640 con 0x7fc888131980 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc88d73a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88806eb30 con 0x7fc8881346e0 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc88d73a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880a22d0 con 0x7fc888137000 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8867fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 0x7fc888136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc886ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc888131980 0x7fc888131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47136/0 (socket says 172.21.15.125:47136) 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc886ffd700 1 -- 172.21.15.125:0/4145072850 learned_addr learned my addr 172.21.15.125:0/4145072850 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8867fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 0x7fc888136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46500/0 (socket says 172.21.15.125:46500) 2023-10-03T10:12:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 --2- 172.21.15.125:0/4145072850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc8881393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 -- 172.21.15.125:0/4145072850 >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 msgr2=0x7fc888136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 --2- 172.21.15.125:0/4145072850 >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 0x7fc888136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 -- 172.21.15.125:0/4145072850 >> v1:172.21.15.125:6789/0 conn(0x7fc888131980 legacy=0x7fc888131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 -- 172.21.15.125:0/4145072850 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888131550 con 0x7fc888137000 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc8877fe700 1 --2- 172.21.15.125:0/4145072850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc8881393e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc880009d90 tx=0x7fc88000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476625cde8e0a762 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc885ffb700 1 -- 172.21.15.125:0/4145072850 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000e070 con 0x7fc888137000 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc885ffb700 1 -- 172.21.15.125:0/4145072850 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000bb20 con 0x7fc888137000 2023-10-03T10:12:48.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.771+0000 7fc885ffb700 1 -- 172.21.15.125:0/4145072850 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880012430 con 0x7fc888137000 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 -- 172.21.15.125:0/4145072850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 msgr2=0x7fc8881393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 --2- 172.21.15.125:0/4145072850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc8881393e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc880009d90 tx=0x7fc88000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 -- 172.21.15.125:0/4145072850 shutdown_connections 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 --2- 172.21.15.125:0/4145072850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc8881393e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 --2- 172.21.15.125:0/4145072850 >> v2:172.21.15.125:3300/0 conn(0x7fc8881346e0 0x7fc888136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 -- 172.21.15.125:0/4145072850 >> 172.21.15.125:0/4145072850 conn(0x7fc8880a2980 msgr2=0x7fc8880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.772+0000 7fc88d73a700 1 -- 172.21.15.125:0/4145072850 shutdown_connections 2023-10-03T10:12:48.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.773+0000 7fc88d73a700 1 -- 172.21.15.125:0/4145072850 wait complete. 2023-10-03T10:12:48.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.774+0000 7fc88d73a700 1 Processor -- start 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.774+0000 7fc88d73a700 1 -- start start 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.774+0000 7fc88d73a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8881346e0 0x7fc888119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc888119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88811ca80 con 0x7fc888131980 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88811b330 con 0x7fc888137000 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc888136d60 con 0x7fc8881346e0 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46516/0 (socket says 172.21.15.125:46516) 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 -- 172.21.15.125:0/2221520494 learned_addr learned my addr 172.21.15.125:0/2221520494 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc8867fc700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8881346e0 0x7fc888119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc8877fe700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc888119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 -- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8881346e0 msgr2=0x7fc888119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8881346e0 0x7fc888119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 -- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 msgr2=0x7fc888119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc888119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 -- 172.21.15.125:0/2221520494 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880009a70 con 0x7fc888131980 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc886ffd700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c730 tx=0x7fc87800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780074e0 con 0x7fc888131980 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc878007640 con 0x7fc888131980 2023-10-03T10:12:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880a1c40 con 0x7fc888131980 2023-10-03T10:12:48.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.775+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878005a30 con 0x7fc888131980 2023-10-03T10:12:48.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.776+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88811c700 con 0x7fc888131980 2023-10-03T10:12:48.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.776+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc878005b90 con 0x7fc888131980 2023-10-03T10:12:48.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.777+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88811c350 con 0x7fc888131980 2023-10-03T10:12:48.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.777+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc878012730 con 0x7fc888131980 2023-10-03T10:12:48.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.781+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc878017070 con 0x7fc888131980 2023-10-03T10:12:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.904+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f540011eab0 con 0x7f5400130670 2023-10-03T10:12:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.905+0000 7f53fcff9700 1 -- 172.21.15.125:0/2123353710 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53f80122e0 con 0x7f5400130670 2023-10-03T10:12:48.905 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 msgr2=0x7f540011b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 0x7f540011b990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53f8007d90 tx=0x7f53f800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 shutdown_connections 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5400130670 0x7f540011b990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54000a0a30 0x7f540011af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 --2- 172.21.15.125:0/2123353710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54000a1340 0x7f540011b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 >> 172.21.15.125:0/2123353710 conn(0x7f54000a2980 msgr2=0x7f54001b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 shutdown_connections 2023-10-03T10:12:48.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.908+0000 7f5406794700 1 -- 172.21.15.125:0/2123353710 wait complete. 2023-10-03T10:12:48.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:48.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.946+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f515c09b670 con 0x7f515c09d860 2023-10-03T10:12:48.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.947+0000 7f51527fc700 1 -- 172.21.15.125:0/3883254890 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5158044020 con 0x7f515c09d860 2023-10-03T10:12:48.947 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.948+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b7c09a350 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.948+0000 7f2b727fc700 1 -- 172.21.15.125:0/2424484053 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b7802a030 con 0x7f2b7c0a08e0 2023-10-03T10:12:48.948 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:48.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 msgr2=0x7f515c11b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f515800c550 tx=0x7f515800c860 comp rx=0 tx=0).stop 2023-10-03T10:12:48.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 shutdown_connections 2023-10-03T10:12:48.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f515c135f20 0x7f515c11bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f515c09d860 0x7f515c11b2e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 msgr2=0x7f2b7c11fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 --2- 172.21.15.125:0/3883254890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f515c09e340 0x7f515c11b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b78004750 comp rx=0 tx=0).stop 2023-10-03T10:12:48.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 >> 172.21.15.125:0/3883254890 conn(0x7f515c099c40 msgr2=0x7f515c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 shutdown_connections 2023-10-03T10:12:48.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b7c133a70 0x7f2b7c1205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b7c0a08e0 0x7f2b7c11fb50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 --2- 172.21.15.125:0/2424484053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b7c0a1460 0x7f2b7c120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 >> 172.21.15.125:0/2424484053 conn(0x7f2b7c0a2980 msgr2=0x7f2b7c131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 shutdown_connections 2023-10-03T10:12:48.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f5163bdf700 1 -- 172.21.15.125:0/3883254890 wait complete. 2023-10-03T10:12:48.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 shutdown_connections 2023-10-03T10:12:48.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.950+0000 7f2b83f5b700 1 -- 172.21.15.125:0/2424484053 wait complete. 2023-10-03T10:12:48.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:48.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.983+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc88804f2a0 con 0x7fc888131980 2023-10-03T10:12:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.984+0000 7fc86f7fe700 1 -- 172.21.15.125:0/2221520494 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc878012400 con 0x7fc888131980 2023-10-03T10:12:48.984 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 msgr2=0x7fc888119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c730 tx=0x7fc87800ca40 comp rx=0 tx=0).stop 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 shutdown_connections 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc888137000 0x7fc888119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc888131980 0x7fc888119050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 --2- 172.21.15.125:0/2221520494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8881346e0 0x7fc888119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 >> 172.21.15.125:0/2221520494 conn(0x7fc8880a2980 msgr2=0x7fc888133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 shutdown_connections 2023-10-03T10:12:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:48.986+0000 7fc88d73a700 1 -- 172.21.15.125:0/2221520494 wait complete. 2023-10-03T10:12:48.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:49.927 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:49.965 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:49.970 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:49.999 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.071+0000 7fb8d223f700 1 Processor -- start 2023-10-03T10:12:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 -- start start 2023-10-03T10:12:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc09dec0 0x7fb8cc06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8cc131a00 0x7fb8cc131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc06b5c0 con 0x7fb8cc131a00 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc06e900 con 0x7fb8cc09dec0 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.072+0000 7fb8d223f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc09d180 con 0x7fb8cc06a770 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8cc131a00 0x7fb8cc131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8cc131a00 0x7fb8cc131e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46526/0 (socket says 172.21.15.125:46526) 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43212/0 (socket says 172.21.15.125:43212) 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 -- 172.21.15.125:0/3839206383 learned_addr learned my addr 172.21.15.125:0/3839206383 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8caffd700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc09dec0 0x7fb8cc06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 -- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 msgr2=0x7fb8cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 -- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc09dec0 msgr2=0x7fb8cc06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc09dec0 0x7fb8cc06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 -- 172.21.15.125:0/3839206383 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc09e780 con 0x7fb8cc131a00 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cb7fe700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.073+0000 7fb8cbfff700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc131a00 0x7fb8cc131e80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e8802524cbb6a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.074+0000 7fb8ca7fc700 1 -- 172.21.15.125:0/3839206383 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400bb10 con 0x7fb8cc131a00 2023-10-03T10:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.074+0000 7fb8ca7fc700 1 -- 172.21.15.125:0/3839206383 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c400bc70 con 0x7fb8cc131a00 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.074+0000 7fb8ca7fc700 1 -- 172.21.15.125:0/3839206383 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40104d0 con 0x7fb8cc131a00 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 -- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc131a00 msgr2=0x7fb8cc131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc131a00 0x7fb8cc131e80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 -- 172.21.15.125:0/3839206383 shutdown_connections 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc131a00 0x7fb8cc131e80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 --2- 172.21.15.125:0/3839206383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc09dec0 0x7fb8cc06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 -- 172.21.15.125:0/3839206383 >> 172.21.15.125:0/3839206383 conn(0x7fb8cc099c40 msgr2=0x7fb8cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 -- 172.21.15.125:0/3839206383 shutdown_connections 2023-10-03T10:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.075+0000 7fb8d223f700 1 -- 172.21.15.125:0/3839206383 wait complete. 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.076+0000 7fb8d223f700 1 Processor -- start 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.076+0000 7fb8d223f700 1 -- start start 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 0x7fb8cc11a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc12d5a0 con 0x7fb8cc09dec0 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc11b9c0 con 0x7fb8cc131a00 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8d223f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc071ce0 con 0x7fb8cc06a770 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46832/0 (socket says 172.21.15.125:46832) 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8cbfff700 1 -- 172.21.15.125:0/4246695834 learned_addr learned my addr 172.21.15.125:0/4246695834 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.077+0000 7fb8caffd700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 0x7fb8cc11a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8cb7fe700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 -- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 msgr2=0x7fb8cc119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 -- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 msgr2=0x7fb8cc11a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 -- 172.21.15.125:0/4246695834 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0094a0 con 0x7fb8cc09dec0 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8cbfff700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8caffd700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 0x7fb8cc11a380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e900 tx=0x7fb8c000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0013680 con 0x7fb8cc09dec0 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c00137e0 con 0x7fb8cc09dec0 2023-10-03T10:12:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.078+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0013b50 con 0x7fb8cc09dec0 2023-10-03T10:12:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.079+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4009b30 con 0x7fb8cc09dec0 2023-10-03T10:12:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.079+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc11c110 con 0x7fb8cc09dec0 2023-10-03T10:12:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.080+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8c0013cb0 con 0x7fb8cc09dec0 2023-10-03T10:12:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.080+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc11d490 con 0x7fb8cc09dec0 2023-10-03T10:12:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.080+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8c003f8f0 con 0x7fb8cc09dec0 2023-10-03T10:12:50.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.089+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8cc11d490 con 0x7fb8cc09dec0 2023-10-03T10:12:50.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.107+0000 7fa70c0ea700 1 Processor -- start 2023-10-03T10:12:50.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 -- start start 2023-10-03T10:12:50.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa704133ad0 0x7fa704133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70406b2d0 con 0x7fa7041300a0 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa704133610 con 0x7fa704133ad0 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70c0ea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70409a500 con 0x7fa704130bc0 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70a687700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70a687700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43234/0 (socket says 172.21.15.125:43234) 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.108+0000 7fa70a687700 1 -- 172.21.15.125:0/2923427712 learned_addr learned my addr 172.21.15.125:0/2923427712 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 --2- 172.21.15.125:0/2923427712 >> v2:172.21.15.125:3300/0 conn(0x7fa704133ad0 0x7fa704133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 -- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 msgr2=0x7fa70413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 --2- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 -- 172.21.15.125:0/2923427712 >> v1:172.21.15.125:6789/0 conn(0x7fa7041300a0 legacy=0x7fa7041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 -- 172.21.15.125:0/2923427712 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7041338b0 con 0x7fa704133ad0 2023-10-03T10:12:50.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.109+0000 7fa709e86700 1 --2- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa704133ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa700009840 tx=0x7fa700009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ab04f1dafab1aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa708e84700 1 -- 172.21.15.125:0/2923427712 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700011830 con 0x7fa704133ad0 2023-10-03T10:12:50.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa708e84700 1 -- 172.21.15.125:0/2923427712 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700011990 con 0x7fa704133ad0 2023-10-03T10:12:50.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa708e84700 1 -- 172.21.15.125:0/2923427712 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700011d20 con 0x7fa704133ad0 2023-10-03T10:12:50.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 -- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 msgr2=0x7fa704133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa704133ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa700009840 tx=0x7fa700009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 -- 172.21.15.125:0/2923427712 shutdown_connections 2023-10-03T10:12:50.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/2923427712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa704133ea0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.111+0000 7fa70c0ea700 1 -- 172.21.15.125:0/2923427712 >> 172.21.15.125:0/2923427712 conn(0x7fa704099c40 msgr2=0x7fa7040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.112+0000 7fa70c0ea700 1 -- 172.21.15.125:0/2923427712 shutdown_connections 2023-10-03T10:12:50.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.112+0000 7fa70c0ea700 1 -- 172.21.15.125:0/2923427712 wait complete. 2023-10-03T10:12:50.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 Processor -- start 2023-10-03T10:12:50.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 -- start start 2023-10-03T10:12:50.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7041300a0 0x7fa70411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa70411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.113+0000 7fa70c0ea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70411f0b0 con 0x7fa704133ad0 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa70c0ea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70411fde0 con 0x7fa7041300a0 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa70c0ea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70411f850 con 0x7fa704130bc0 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43250/0 (socket says 172.21.15.125:43250) 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 -- 172.21.15.125:0/3663643342 learned_addr learned my addr 172.21.15.125:0/3663643342 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa70a687700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa70411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 -- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7041300a0 msgr2=0x7fa70411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7041300a0 0x7fa70411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 -- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 msgr2=0x7fa70411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa70411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 -- 172.21.15.125:0/3663643342 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000094a0 con 0x7fa704130bc0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa70a687700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa70411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa709685700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c4e0 tx=0x7fa6f400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40052d0 con 0x7fa704130bc0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4005430 con 0x7fa704130bc0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70411fb20 con 0x7fa704130bc0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.114+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40038c0 con 0x7fa704130bc0 2023-10-03T10:12:50.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.115+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7041200c0 con 0x7fa704130bc0 2023-10-03T10:12:50.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.115+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6f4003a20 con 0x7fa704130bc0 2023-10-03T10:12:50.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.116+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6f403ec60 con 0x7fa704130bc0 2023-10-03T10:12:50.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.116+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70411ff20 con 0x7fa704130bc0 2023-10-03T10:12:50.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 Processor -- start 2023-10-03T10:12:50.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 -- start start 2023-10-03T10:12:50.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26880a13a0 0x7f2688133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26880a1fe0 con 0x7f2688133f70 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26880a3aa0 con 0x7f26880a13a0 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f268db4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268809a540 con 0x7f26880a0a90 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f26877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f26877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46838/0 (socket says 172.21.15.125:46838) 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f26877fe700 1 -- 172.21.15.125:0/2325847653 learned_addr learned my addr 172.21.15.125:0/2325847653 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f2687fff700 1 --1- 172.21.15.125:0/2325847653 >> v1:172.21.15.125:6789/0 conn(0x7f2688133f70 0x7f268813ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47160/0 (socket says 172.21.15.125:47160) 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.117+0000 7f2686ffd700 1 --2- 172.21.15.125:0/2325847653 >> v2:172.21.15.125:3300/0 conn(0x7f26880a13a0 0x7f2688133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26867fc700 1 -- 172.21.15.125:0/2325847653 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130793227 0 0) 0x7f26880a1fe0 con 0x7f2688133f70 2023-10-03T10:12:50.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26867fc700 1 -- 172.21.15.125:0/2325847653 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26700035b0 con 0x7f2688133f70 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f2686ffd700 1 -- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 msgr2=0x7f26880a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f2686ffd700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f2686ffd700 1 -- 172.21.15.125:0/2325847653 >> v1:172.21.15.125:6789/0 conn(0x7f2688133f70 legacy=0x7f268813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f2686ffd700 1 -- 172.21.15.125:0/2325847653 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268809a280 con 0x7f26880a13a0 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26877fe700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f2686ffd700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26880a13a0 0x7f2688133a30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f267c009840 tx=0x7f267c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3911b94a90f16cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26867fc700 1 -- 172.21.15.125:0/2325847653 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c011830 con 0x7f26880a13a0 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26867fc700 1 -- 172.21.15.125:0/2325847653 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c011990 con 0x7f26880a13a0 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.118+0000 7f26867fc700 1 -- 172.21.15.125:0/2325847653 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c011d20 con 0x7f26880a13a0 2023-10-03T10:12:50.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 -- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26880a13a0 msgr2=0x7f2688133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26880a13a0 0x7f2688133a30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f267c009840 tx=0x7f267c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 -- 172.21.15.125:0/2325847653 shutdown_connections 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a0a90 0x7f26880a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 --2- 172.21.15.125:0/2325847653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26880a13a0 0x7f2688133a30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 -- 172.21.15.125:0/2325847653 >> 172.21.15.125:0/2325847653 conn(0x7f2688099c40 msgr2=0x7f268806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 -- 172.21.15.125:0/2325847653 shutdown_connections 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.119+0000 7f268db4f700 1 -- 172.21.15.125:0/2325847653 wait complete. 2023-10-03T10:12:50.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.120+0000 7f268db4f700 1 Processor -- start 2023-10-03T10:12:50.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.120+0000 7f268db4f700 1 -- start start 2023-10-03T10:12:50.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26880a0a90 0x7f2688126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a13a0 0x7f2688126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268809c7e0 con 0x7f2688133f70 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2688129740 con 0x7f26880a13a0 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f268db4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2688127510 con 0x7f26880a0a90 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f2687fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f26877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26880a0a90 0x7f2688126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f2687fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46580/0 (socket says 172.21.15.125:46580) 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f2687fff700 1 -- 172.21.15.125:0/864824311 learned_addr learned my addr 172.21.15.125:0/864824311 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.121+0000 7f2686ffd700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a13a0 0x7f2688126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 -- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26880a0a90 msgr2=0x7f2688126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26880a0a90 0x7f2688126120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 -- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a13a0 msgr2=0x7f2688126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a13a0 0x7f2688126660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 -- 172.21.15.125:0/864824311 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009550 con 0x7f2688133f70 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f2687fff700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f268000cc50 tx=0x7f268000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268000aad0 con 0x7f2688133f70 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268000ac30 con 0x7f2688133f70 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680007070 con 0x7f2688133f70 2023-10-03T10:12:50.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0094a0 con 0x7f2688133f70 2023-10-03T10:12:50.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.122+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268812a0d0 con 0x7f2688133f70 2023-10-03T10:12:50.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.123+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26800071d0 con 0x7f2688133f70 2023-10-03T10:12:50.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.123+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f268003f560 con 0x7f2688133f70 2023-10-03T10:12:50.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.123+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268804f2a0 con 0x7f2688133f70 2023-10-03T10:12:50.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.124+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa70411ff20 con 0x7fa704130bc0 2023-10-03T10:12:50.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.131+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2680017020 con 0x7f2688133f70 2023-10-03T10:12:50.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.151+0000 7f9b308c8700 1 Processor -- start 2023-10-03T10:12:50.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.151+0000 7f9b308c8700 1 -- start start 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b308c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 0x7f9b2c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b308c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 0x7f9b2c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b308c8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c099a60 con 0x7f9b2c130890 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b308c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c09bf50 con 0x7f9b2c099e20 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b308c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c09b230 con 0x7f9b2c09a730 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b2a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 0x7f9b2c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b2a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 0x7f9b2c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46592/0 (socket says 172.21.15.125:46592) 2023-10-03T10:12:50.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b2a59c700 1 -- 172.21.15.125:0/1266194931 learned_addr learned my addr 172.21.15.125:0/1266194931 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.152+0000 7f9b29d9b700 1 --2- 172.21.15.125:0/1266194931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 0x7f9b2c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b29d9b700 1 -- 172.21.15.125:0/1266194931 >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 msgr2=0x7f9b2c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b29d9b700 1 --2- 172.21.15.125:0/1266194931 >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 0x7f9b2c09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b29d9b700 1 -- 172.21.15.125:0/1266194931 >> v1:172.21.15.125:6789/0 conn(0x7f9b2c130890 legacy=0x7f9b2c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b29d9b700 1 -- 172.21.15.125:0/1266194931 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c09bb90 con 0x7f9b2c09a730 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b29d9b700 1 --2- 172.21.15.125:0/1266194931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 0x7f9b2c130350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009840 tx=0x7f9b20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db61d3c379a7b288 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b2959a700 1 -- 172.21.15.125:0/1266194931 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20011830 con 0x7f9b2c09a730 2023-10-03T10:12:50.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b2959a700 1 -- 172.21.15.125:0/1266194931 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20011990 con 0x7f9b2c09a730 2023-10-03T10:12:50.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.153+0000 7f9b2959a700 1 -- 172.21.15.125:0/1266194931 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20011d20 con 0x7f9b2c09a730 2023-10-03T10:12:50.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 -- 172.21.15.125:0/1266194931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 msgr2=0x7f9b2c130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 --2- 172.21.15.125:0/1266194931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 0x7f9b2c130350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009840 tx=0x7f9b20009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 -- 172.21.15.125:0/1266194931 shutdown_connections 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 --2- 172.21.15.125:0/1266194931 >> v2:172.21.15.125:3300/0 conn(0x7f9b2c099e20 0x7f9b2c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 --2- 172.21.15.125:0/1266194931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c09a730 0x7f9b2c130350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 -- 172.21.15.125:0/1266194931 >> 172.21.15.125:0/1266194931 conn(0x7f9b2c0a2980 msgr2=0x7f9b2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 -- 172.21.15.125:0/1266194931 shutdown_connections 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.154+0000 7f9b308c8700 1 -- 172.21.15.125:0/1266194931 wait complete. 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.155+0000 7f9b308c8700 1 Processor -- start 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.155+0000 7f9b308c8700 1 -- start start 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 0x7f9b2c11b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b2c130890 0x7f9b2c11c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c11cdb0 con 0x7f9b2c130890 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c12dcc0 con 0x7f9b2c099e20 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b308c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c11e740 con 0x7f9b2c09a730 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b29d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b29d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43262/0 (socket says 172.21.15.125:43262) 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b29d9b700 1 -- 172.21.15.125:0/3244280024 learned_addr learned my addr 172.21.15.125:0/3244280024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:50.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 0x7f9b2c11b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 -- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 msgr2=0x7f9b2c11be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 -- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b2c130890 msgr2=0x7f9b2c11c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b2c130890 0x7f9b2c11c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 -- 172.21.15.125:0/3244280024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200094a0 con 0x7f9b2c099e20 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b29d9b700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.156+0000 7f9b2a59c700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 0x7f9b2c11b8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c006fd0 tx=0x7f9b1c00eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.157+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c013680 con 0x7f9b2c099e20 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.157+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0137e0 con 0x7f9b2c099e20 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.157+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c013b50 con 0x7f9b2c099e20 2023-10-03T10:12:50.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.158+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c11f120 con 0x7f9b2c099e20 2023-10-03T10:12:50.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.158+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c0a1270 con 0x7f9b2c099e20 2023-10-03T10:12:50.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.158+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b1c013cb0 con 0x7f9b2c099e20 2023-10-03T10:12:50.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.159+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b1c03f970 con 0x7f9b2c099e20 2023-10-03T10:12:50.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.159+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c11dab0 con 0x7f9b2c099e20 2023-10-03T10:12:50.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.163+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b1c017080 con 0x7f9b2c099e20 2023-10-03T10:12:50.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.289+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8cc11d490 con 0x7fb8cc09dec0 2023-10-03T10:12:50.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.290+0000 7fb8b3fff700 1 -- 172.21.15.125:0/4246695834 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8cc11d490 con 0x7fb8cc09dec0 2023-10-03T10:12:50.291 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:50.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 msgr2=0x7fb8cc11a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 0x7fb8cc11a380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e900 tx=0x7fb8c000ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:50.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 shutdown_connections 2023-10-03T10:12:50.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb8cc131a00 0x7fb8cc11a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb8cc06a770 0x7fb8cc119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 --2- 172.21.15.125:0/4246695834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8cc09dec0 0x7fb8cc11a380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 >> 172.21.15.125:0/4246695834 conn(0x7fb8cc099c40 msgr2=0x7fb8cc12ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 shutdown_connections 2023-10-03T10:12:50.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.292+0000 7fb8d223f700 1 -- 172.21.15.125:0/4246695834 wait complete. 2023-10-03T10:12:50.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.325+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa70411ff20 con 0x7fa704130bc0 2023-10-03T10:12:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.325+0000 7fa6fa7fc700 1 -- 172.21.15.125:0/3663643342 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa70411ff20 con 0x7fa704130bc0 2023-10-03T10:12:50.326 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 msgr2=0x7fa70411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c4e0 tx=0x7fa6f400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 shutdown_connections 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa704133ad0 0x7fa70411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7041300a0 0x7fa70411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 --2- 172.21.15.125:0/3663643342 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa704130bc0 0x7fa70411df80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 >> 172.21.15.125:0/3663643342 conn(0x7fa704099c40 msgr2=0x7fa7041321a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 shutdown_connections 2023-10-03T10:12:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.327+0000 7fa70c0ea700 1 -- 172.21.15.125:0/3663643342 wait complete. 2023-10-03T10:12:50.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.339+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26880729d0 con 0x7f2688133f70 2023-10-03T10:12:50.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:50.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.340+0000 7f266ffff700 1 -- 172.21.15.125:0/864824311 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2680012400 con 0x7f2688133f70 2023-10-03T10:12:50.341 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:50.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 msgr2=0x7f2688126ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f268000cc50 tx=0x7f268000cf60 comp rx=0 tx=0).stop 2023-10-03T10:12:50.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 shutdown_connections 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2688133f70 0x7f2688126ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26880a0a90 0x7f2688126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 --2- 172.21.15.125:0/864824311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26880a13a0 0x7f2688126660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 >> 172.21.15.125:0/864824311 conn(0x7f2688099c40 msgr2=0x7f268809f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 shutdown_connections 2023-10-03T10:12:50.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.342+0000 7f268db4f700 1 -- 172.21.15.125:0/864824311 wait complete. 2023-10-03T10:12:50.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:50.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.368+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b2c09b470 con 0x7f9b2c099e20 2023-10-03T10:12:50.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.368+0000 7f9b1affd700 1 -- 172.21.15.125:0/3244280024 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b1c021020 con 0x7f9b2c099e20 2023-10-03T10:12:50.369 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:50.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 msgr2=0x7f9b2c11b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 0x7f9b2c11b8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c006fd0 tx=0x7f9b1c00eb00 comp rx=0 tx=0).stop 2023-10-03T10:12:50.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 shutdown_connections 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b2c130890 0x7f9b2c11c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b2c099e20 0x7f9b2c11b8e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 --2- 172.21.15.125:0/3244280024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b2c09a730 0x7f9b2c11be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 >> 172.21.15.125:0/3244280024 conn(0x7f9b2c0a2980 msgr2=0x7f9b2c09e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 shutdown_connections 2023-10-03T10:12:50.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:50.370+0000 7f9b308c8700 1 -- 172.21.15.125:0/3244280024 wait complete. 2023-10-03T10:12:50.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:51.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:51.342 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:51.355 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:51.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:51.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.470+0000 7fc0b2d2a700 1 Processor -- start 2023-10-03T10:12:51.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.470+0000 7fc0b2d2a700 1 -- start start 2023-10-03T10:12:51.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 0x7fc0ac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 0x7fc0ac133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac09e9d0 con 0x7fc0ac133f50 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac09dc00 con 0x7fc0ac0a1380 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b2d2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac09dec0 con 0x7fc0ac0a0a70 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b12c7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b12c7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46612/0 (socket says 172.21.15.125:46612) 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 0x7fc0ac133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b12c7700 1 -- 172.21.15.125:0/1352299327 learned_addr learned my addr 172.21.15.125:0/1352299327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b0ac6700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 0x7fc0ac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 -- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 msgr2=0x7fc0ac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 0x7fc0ac0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 -- 172.21.15.125:0/1352299327 >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 msgr2=0x7fc0ac1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 --2- 172.21.15.125:0/1352299327 >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 -- 172.21.15.125:0/1352299327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac09e6a0 con 0x7fc0ac0a1380 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b0ac6700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 0x7fc0ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0b12c7700 1 --2- 172.21.15.125:0/1352299327 >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.471+0000 7fc0abfff700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 0x7fc0ac133a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc098009840 tx=0x7fc098009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9803da92e9f8cef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0ab7fe700 1 -- 172.21.15.125:0/1352299327 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011830 con 0x7fc0ac0a1380 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0ab7fe700 1 -- 172.21.15.125:0/1352299327 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098011990 con 0x7fc0ac0a1380 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0ab7fe700 1 -- 172.21.15.125:0/1352299327 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011d20 con 0x7fc0ac0a1380 2023-10-03T10:12:51.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 msgr2=0x7fc0ac133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 0x7fc0ac133a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc098009840 tx=0x7fc098009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/1352299327 shutdown_connections 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/1352299327 >> v2:172.21.15.125:3300/0 conn(0x7fc0ac133f50 0x7fc0ac1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.472+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a0a70 0x7fc0ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.473+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/1352299327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac0a1380 0x7fc0ac133a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.473+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/1352299327 >> 172.21.15.125:0/1352299327 conn(0x7fc0ac0a6610 msgr2=0x7fc0ac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.473+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/1352299327 shutdown_connections 2023-10-03T10:12:51.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.473+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/1352299327 wait complete. 2023-10-03T10:12:51.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 Processor -- start 2023-10-03T10:12:51.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 -- start start 2023-10-03T10:12:51.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ac0a0a70 0x7fc0ac11f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac133f50 0x7fc0ac1c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac11f0e0 con 0x7fc0ac0a0a70 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac133590 con 0x7fc0ac133f50 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0b2d2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac122440 con 0x7fc0ac0a1380 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.474+0000 7fc0abfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0b12c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac133f50 0x7fc0ac1c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43288/0 (socket says 172.21.15.125:43288) 2023-10-03T10:12:51.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 -- 172.21.15.125:0/270386187 learned_addr learned my addr 172.21.15.125:0/270386187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0b0ac6700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ac0a0a70 0x7fc0ac11f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 -- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac133f50 msgr2=0x7fc0ac1c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac133f50 0x7fc0ac1c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 -- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ac0a0a70 msgr2=0x7fc0ac11f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ac0a0a70 0x7fc0ac11f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 -- 172.21.15.125:0/270386187 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009b30 con 0x7fc0ac0a1380 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0abfff700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098004450 con 0x7fc0ac0a1380 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098030070 con 0x7fc0ac0a1380 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0980094a0 con 0x7fc0ac0a1380 2023-10-03T10:12:51.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980038e0 con 0x7fc0ac0a1380 2023-10-03T10:12:51.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.475+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac120810 con 0x7fc0ac0a1380 2023-10-03T10:12:51.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.476+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc098003a40 con 0x7fc0ac0a1380 2023-10-03T10:12:51.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.477+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc098032070 con 0x7fc0ac0a1380 2023-10-03T10:12:51.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.477+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac0a26d0 con 0x7fc0ac0a1380 2023-10-03T10:12:51.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.486+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc09803c020 con 0x7fc0ac0a1380 2023-10-03T10:12:51.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.501+0000 7fbea1198700 1 Processor -- start 2023-10-03T10:12:51.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.501+0000 7fbea1198700 1 -- start start 2023-10-03T10:12:51.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbea1198700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 0x7fbe9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbea1198700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a1340 0x7fbe9c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbea1198700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0a1e70 con 0x7fbe9c1304a0 2023-10-03T10:12:51.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbea1198700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c09a720 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbea1198700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c09b300 con 0x7fbe9c0a1340 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbe9c1304a0 0x7fbe9c1371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47182/0 (socket says 172.21.15.125:47182) 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9b59e700 1 -- 172.21.15.125:0/616972699 learned_addr learned my addr 172.21.15.125:0/616972699 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9a59c700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a1340 0x7fbe9c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 0x7fbe9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a1340 msgr2=0x7fbe9c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a1340 0x7fbe9c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.502+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/616972699 >> v1:172.21.15.125:6789/0 conn(0x7fbe9c1304a0 legacy=0x7fbe9c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/616972699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c09abc0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe99d9b700 1 -- 172.21.15.125:0/616972699 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405374849 0 0) 0x7fbe9c0a1e70 con 0x7fbe9c1304a0 2023-10-03T10:12:51.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 0x7fbe9c0a0e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009850 tx=0x7fbe8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf068a7410c07450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe99d9b700 1 -- 172.21.15.125:0/616972699 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c005e30 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe99d9b700 1 -- 172.21.15.125:0/616972699 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c006030 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.503+0000 7fbe99d9b700 1 -- 172.21.15.125:0/616972699 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0063e0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 -- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 msgr2=0x7fbe9c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 0x7fbe9c0a0e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009850 tx=0x7fbe8c009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 -- 172.21.15.125:0/616972699 shutdown_connections 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c0a0a30 0x7fbe9c0a0e00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 --2- 172.21.15.125:0/616972699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a1340 0x7fbe9c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 -- 172.21.15.125:0/616972699 >> 172.21.15.125:0/616972699 conn(0x7fbe9c0a2980 msgr2=0x7fbe9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 -- 172.21.15.125:0/616972699 shutdown_connections 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.504+0000 7fbea1198700 1 -- 172.21.15.125:0/616972699 wait complete. 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.505+0000 7fbea1198700 1 Processor -- start 2023-10-03T10:12:51.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.505+0000 7fbea1198700 1 -- start start 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe9c0a1340 0x7fbe9c124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 0x7fbe9c1253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c11aee0 con 0x7fbe9c0a1340 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c11b980 con 0x7fbe9c1304a0 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbea1198700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c09ae00 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbe9ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbe9ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43310/0 (socket says 172.21.15.125:43310) 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.506+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/2604868371 learned_addr learned my addr 172.21.15.125:0/2604868371 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9a59c700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe9c0a1340 0x7fbe9c124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9b59e700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 0x7fbe9c1253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 msgr2=0x7fbe9c1253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 0x7fbe9c1253d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe9c0a1340 msgr2=0x7fbe9c124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe9c0a1340 0x7fbe9c124e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 -- 172.21.15.125:0/2604868371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c009430 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9ad9d700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c013040 tx=0x7fbe8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe9b59e700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 0x7fbe9c1253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c006900 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c020070 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c11b580 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c025670 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.507+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c11c0b0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.508+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe8c022030 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.508+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c11b3e0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.509+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe8c040b60 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.517+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe9c11b3e0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.543+0000 7f22094db700 1 Processor -- start 2023-10-03T10:12:51.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.543+0000 7f22094db700 1 -- start start 2023-10-03T10:12:51.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22094db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2204133b80 0x7f2204133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22094db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2204099a60 0x7f22040a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22094db700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220409aa00 con 0x7f22040a0e20 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22094db700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220409a080 con 0x7f2204099a60 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22094db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2204133750 con 0x7f2204133b80 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2204099a60 0x7f22040a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2204099a60 0x7f22040a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46654/0 (socket says 172.21.15.125:46654) 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 -- 172.21.15.125:0/42283096 learned_addr learned my addr 172.21.15.125:0/42283096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f2202ffd700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2204133b80 0x7f2204133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 -- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2204133b80 msgr2=0x7f2204133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2204133b80 0x7f2204133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 -- 172.21.15.125:0/42283096 >> v1:172.21.15.125:6789/0 conn(0x7f22040a0e20 legacy=0x7f220413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.544+0000 7f22027fc700 1 -- 172.21.15.125:0/42283096 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220409a760 con 0x7f2204099a60 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.545+0000 7f22027fc700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f22040a08e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f21f80098f0 tx=0x7f21f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f093578cf0683eaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.545+0000 7f2201ffb700 1 -- 172.21.15.125:0/42283096 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8011830 con 0x7f2204099a60 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.545+0000 7f2201ffb700 1 -- 172.21.15.125:0/42283096 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8011990 con 0x7f2204099a60 2023-10-03T10:12:51.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.545+0000 7f2201ffb700 1 -- 172.21.15.125:0/42283096 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8011d20 con 0x7f2204099a60 2023-10-03T10:12:51.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 -- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 msgr2=0x7f22040a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f22040a08e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f21f80098f0 tx=0x7f21f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:51.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 -- 172.21.15.125:0/42283096 shutdown_connections 2023-10-03T10:12:51.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2204133b80 0x7f2204133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 --2- 172.21.15.125:0/42283096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f22040a08e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 -- 172.21.15.125:0/42283096 >> 172.21.15.125:0/42283096 conn(0x7f22040a2980 msgr2=0x7f22040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 -- 172.21.15.125:0/42283096 shutdown_connections 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.546+0000 7f22094db700 1 -- 172.21.15.125:0/42283096 wait complete. 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.547+0000 7f22094db700 1 Processor -- start 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.547+0000 7f22094db700 1 -- start start 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22040a0e20 0x7f2204120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 0x7f2204120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204130ff0 con 0x7f2204099a60 2023-10-03T10:12:51.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2204122900 con 0x7f2204133b80 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22094db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2204122540 con 0x7f22040a0e20 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f2202ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f2202ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46662/0 (socket says 172.21.15.125:46662) 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f2202ffd700 1 -- 172.21.15.125:0/1188877731 learned_addr learned my addr 172.21.15.125:0/1188877731 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22027fc700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22040a0e20 0x7f2204120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.548+0000 7f22037fe700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 0x7f2204120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 -- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22040a0e20 msgr2=0x7f2204120030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22040a0e20 0x7f2204120030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 -- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 msgr2=0x7f2204120570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 0x7f2204120570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 -- 172.21.15.125:0/1188877731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8009550 con 0x7f2204099a60 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f22037fe700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 0x7f2204120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f2202ffd700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21f400e9c0 tx=0x7f21f400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40096f0 con 0x7f2204099a60 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f400c850 con 0x7f2204099a60 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220409a2c0 con 0x7f2204099a60 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400cbc0 con 0x7f2204099a60 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.549+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22041232e0 con 0x7f2204099a60 2023-10-03T10:12:51.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.550+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21f400cd20 con 0x7f2204099a60 2023-10-03T10:12:51.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.550+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21f403fb60 con 0x7f2204099a60 2023-10-03T10:12:51.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.551+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220404f2a0 con 0x7f2204099a60 2023-10-03T10:12:51.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.555+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21f4017080 con 0x7f2204099a60 2023-10-03T10:12:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 Processor -- start 2023-10-03T10:12:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 -- start start 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f211c09d860 0x7f211c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c09aaa0 con 0x7f211c09e170 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c09f870 con 0x7f211c09d860 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.569+0000 7f21228ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211c09b360 con 0x7f211c130eb0 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43322/0 (socket says 172.21.15.125:43322) 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 -- 172.21.15.125:0/1599136918 learned_addr learned my addr 172.21.15.125:0/1599136918 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f211bfff700 1 --2- 172.21.15.125:0/1599136918 >> v2:172.21.15.125:3300/0 conn(0x7f211c09d860 0x7f211c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 -- 172.21.15.125:0/1599136918 >> v2:172.21.15.125:3300/0 conn(0x7f211c09d860 msgr2=0x7f211c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f211affd700 1 -- 172.21.15.125:0/1599136918 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547642423 0 0) 0x7f211c09aaa0 con 0x7f211c09e170 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 --2- 172.21.15.125:0/1599136918 >> v2:172.21.15.125:3300/0 conn(0x7f211c09d860 0x7f211c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 -- 172.21.15.125:0/1599136918 >> v1:172.21.15.125:6789/0 conn(0x7f211c09e170 legacy=0x7f211c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 -- 172.21.15.125:0/1599136918 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c09b620 con 0x7f211c130eb0 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f2120e8c700 1 --2- 172.21.15.125:0/1599136918 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f211400d150 tx=0x7f211400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73bc9cb2f8b6a3b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f211affd700 1 -- 172.21.15.125:0/1599136918 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114010070 con 0x7f211c130eb0 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f211affd700 1 -- 172.21.15.125:0/1599136918 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400ddc0 con 0x7f211c130eb0 2023-10-03T10:12:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.570+0000 7f211affd700 1 -- 172.21.15.125:0/1599136918 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400b310 con 0x7f211c130eb0 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 -- 172.21.15.125:0/1599136918 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 msgr2=0x7f211c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 --2- 172.21.15.125:0/1599136918 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f211400d150 tx=0x7f211400d460 comp rx=0 tx=0).stop 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 -- 172.21.15.125:0/1599136918 shutdown_connections 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 --2- 172.21.15.125:0/1599136918 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c138a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 --2- 172.21.15.125:0/1599136918 >> v2:172.21.15.125:3300/0 conn(0x7f211c09d860 0x7f211c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 -- 172.21.15.125:0/1599136918 >> 172.21.15.125:0/1599136918 conn(0x7f211c099c40 msgr2=0x7f211c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 -- 172.21.15.125:0/1599136918 shutdown_connections 2023-10-03T10:12:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.571+0000 7f21228ef700 1 -- 172.21.15.125:0/1599136918 wait complete. 2023-10-03T10:12:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.572+0000 7f21228ef700 1 Processor -- start 2023-10-03T10:12:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 -- start start 2023-10-03T10:12:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 0x7f211c11e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f211c09e170 0x7f211c11eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c11f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c072070 con 0x7f211c09d860 2023-10-03T10:12:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c120300 con 0x7f211c09e170 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f21228ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211c09c8b0 con 0x7f211c130eb0 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f211bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 0x7f211c11e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f2120e8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c11f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f211bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 0x7f211c11e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46678/0 (socket says 172.21.15.125:46678) 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.573+0000 7f211bfff700 1 -- 172.21.15.125:0/3443080307 learned_addr learned my addr 172.21.15.125:0/3443080307 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 -- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f211c09e170 msgr2=0x7f211c11eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f211c09e170 0x7f211c11eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 -- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 msgr2=0x7f211c11e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 0x7f211c11e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 -- 172.21.15.125:0/3443080307 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211400bd40 con 0x7f211c130eb0 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2120e8c700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c11f0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2114017000 tx=0x7f2114004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400b4c0 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114004040 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140043f0 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c130110 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.574+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c122870 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.575+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2114004550 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.575+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c121a10 con 0x7f211c130eb0 2023-10-03T10:12:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.575+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21140432c0 con 0x7f211c130eb0 2023-10-03T10:12:51.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.580+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f211402e350 con 0x7f211c130eb0 2023-10-03T10:12:51.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.715+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe9c11b3e0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.715+0000 7fbe837fe700 1 -- 172.21.15.125:0/2604868371 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe9c11b3e0 con 0x7fbe9c0a0a30 2023-10-03T10:12:51.716 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:51.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 msgr2=0x7fbe9c124950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c013040 tx=0x7fbe8c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:51.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 shutdown_connections 2023-10-03T10:12:51.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe9c1304a0 0x7fbe9c1253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe9c0a0a30 0x7fbe9c124950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 --2- 172.21.15.125:0/2604868371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe9c0a1340 0x7fbe9c124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 >> 172.21.15.125:0/2604868371 conn(0x7fbe9c0a2980 msgr2=0x7fbe9c126fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 shutdown_connections 2023-10-03T10:12:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.718+0000 7fbea1198700 1 -- 172.21.15.125:0/2604868371 wait complete. 2023-10-03T10:12:51.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:51.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.736+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0ac04f2a0 con 0x7fc0ac0a1380 2023-10-03T10:12:51.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.737+0000 7fc0a97fa700 1 -- 172.21.15.125:0/270386187 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc098015070 con 0x7fc0ac0a1380 2023-10-03T10:12:51.737 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:51.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.738+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 msgr2=0x7fc0ac11fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.738+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098004750 comp rx=0 tx=0).stop 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 shutdown_connections 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0ac133f50 0x7fc0ac1c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ac0a0a70 0x7fc0ac11f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 --2- 172.21.15.125:0/270386187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0ac0a1380 0x7fc0ac11fa60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 >> 172.21.15.125:0/270386187 conn(0x7fc0ac0a6610 msgr2=0x7fc0ac09bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 shutdown_connections 2023-10-03T10:12:51.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.739+0000 7fc0b2d2a700 1 -- 172.21.15.125:0/270386187 wait complete. 2023-10-03T10:12:51.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:51.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.775+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f211c121c90 con 0x7f211c130eb0 2023-10-03T10:12:51.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.776+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f220406bce0 con 0x7f2204099a60 2023-10-03T10:12:51.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.776+0000 7f2118ff9700 1 -- 172.21.15.125:0/3443080307 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f211401cb70 con 0x7f211c130eb0 2023-10-03T10:12:51.777 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:51.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.776+0000 7f21eb7fe700 1 -- 172.21.15.125:0/1188877731 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21f4021020 con 0x7f2204099a60 2023-10-03T10:12:51.777 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:51.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 msgr2=0x7f211c11f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c11f0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2114017000 tx=0x7f2114004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 msgr2=0x7f220411faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21f400e9c0 tx=0x7f21f400ecd0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 shutdown_connections 2023-10-03T10:12:51.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2204133b80 0x7f2204120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2204099a60 0x7f220411faf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 --2- 172.21.15.125:0/1188877731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22040a0e20 0x7f2204120030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 >> 172.21.15.125:0/1188877731 conn(0x7f22040a2980 msgr2=0x7f2204132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 shutdown_connections 2023-10-03T10:12:51.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f211c130eb0 0x7f211c11f0e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f211c09d860 0x7f211c11e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 --2- 172.21.15.125:0/3443080307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f211c09e170 0x7f211c11eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 >> 172.21.15.125:0/3443080307 conn(0x7f211c099c40 msgr2=0x7f211c070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 shutdown_connections 2023-10-03T10:12:51.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f22094db700 1 -- 172.21.15.125:0/1188877731 wait complete. 2023-10-03T10:12:51.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 shutdown_connections 2023-10-03T10:12:51.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:51.778+0000 7f21228ef700 1 -- 172.21.15.125:0/3443080307 wait complete. 2023-10-03T10:12:51.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:51.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:52.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:52.752 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:52.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:52.794 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.877+0000 7f986298e700 1 Processor -- start 2023-10-03T10:12:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.877+0000 7f986298e700 1 -- start start 2023-10-03T10:12:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.877+0000 7f986298e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.877+0000 7f986298e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 0x7f985c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f986298e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 0x7f985c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f986298e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c06b2d0 con 0x7f985c1300a0 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f986298e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c133610 con 0x7f985c133ad0 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f986298e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f985c09a500 con 0x7f985c1309f0 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46928/0 (socket says 172.21.15.125:46928) 2023-10-03T10:12:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985bfff700 1 -- 172.21.15.125:0/1294231561 learned_addr learned my addr 172.21.15.125:0/1294231561 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 0x7f985c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985b7fe700 1 --2- 172.21.15.125:0/1294231561 >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 0x7f985c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 -- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 msgr2=0x7f985c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 -- 172.21.15.125:0/1294231561 >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 msgr2=0x7f985c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 --2- 172.21.15.125:0/1294231561 >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 0x7f985c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 -- 172.21.15.125:0/1294231561 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c1338b0 con 0x7f985c1309f0 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985bfff700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f985b7fe700 1 --2- 172.21.15.125:0/1294231561 >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 0x7f985c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.878+0000 7f9860f2b700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 0x7f985c13a980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6697c47ed16d398b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f985affd700 1 -- 172.21.15.125:0/1294231561 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e070 con 0x7f985c1309f0 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f985affd700 1 -- 172.21.15.125:0/1294231561 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400bb20 con 0x7f985c1309f0 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f985affd700 1 -- 172.21.15.125:0/1294231561 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c1309f0 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 -- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 msgr2=0x7f985c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 0x7f985c13a980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 -- 172.21.15.125:0/1294231561 shutdown_connections 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c133ad0 0x7f985c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 --2- 172.21.15.125:0/1294231561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c1309f0 0x7f985c13a980 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 --2- 172.21.15.125:0/1294231561 >> v2:172.21.15.125:3300/0 conn(0x7f985c1300a0 0x7f985c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 -- 172.21.15.125:0/1294231561 >> 172.21.15.125:0/1294231561 conn(0x7f985c099c40 msgr2=0x7f985c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 -- 172.21.15.125:0/1294231561 shutdown_connections 2023-10-03T10:12:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.879+0000 7f986298e700 1 -- 172.21.15.125:0/1294231561 wait complete. 2023-10-03T10:12:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.881+0000 7f986298e700 1 Processor -- start 2023-10-03T10:12:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.881+0000 7f986298e700 1 -- start start 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 0x7f985c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 0x7f985c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c120eb0 con 0x7f985c1300a0 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1201d0 con 0x7f985c1309f0 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f986298e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f985c12dd00 con 0x7f985c133ad0 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46700/0 (socket says 172.21.15.125:46700) 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985bfff700 1 -- 172.21.15.125:0/189692772 learned_addr learned my addr 172.21.15.125:0/189692772 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 0x7f985c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985b7fe700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 0x7f985c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 -- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 msgr2=0x7f985c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 0x7f985c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 -- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 msgr2=0x7f985c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f9860f2b700 1 -- 172.21.15.125:0/189692772 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500094a0 con 0x7f985c133ad0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985b7fe700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 0x7f985c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.882+0000 7f985bfff700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f9860f2b700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 0x7f985c11e4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f985c06e4e0 tx=0x7f9854004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c133ad0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854020070 con 0x7f985c133ad0 2023-10-03T10:12:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854004280 con 0x7f985c133ad0 2023-10-03T10:12:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c009550 con 0x7f985c133ad0 2023-10-03T10:12:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.883+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9854009a70 con 0x7f985c133ad0 2023-10-03T10:12:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.884+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c09d270 con 0x7f985c133ad0 2023-10-03T10:12:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.885+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98540043e0 con 0x7f985c133ad0 2023-10-03T10:12:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.885+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9854022070 con 0x7f985c133ad0 2023-10-03T10:12:52.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.890+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9854012e10 con 0x7f985c133ad0 2023-10-03T10:12:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.916+0000 7fc45b787700 1 Processor -- start 2023-10-03T10:12:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.917+0000 7fc45b787700 1 -- start start 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.917+0000 7fc45b787700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc45412d280 0x7fc45412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.917+0000 7fc45b787700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc45b787700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45409ae40 con 0x7fc454130ce0 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc45b787700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45409b9a0 con 0x7fc45412d280 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc45b787700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc45409bbb0 con 0x7fc454130350 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc45412d280 0x7fc45412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc45412d280 0x7fc45412d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46706/0 (socket says 172.21.15.125:46706) 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 -- 172.21.15.125:0/777085568 learned_addr learned my addr 172.21.15.125:0/777085568 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc458d22700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 -- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 msgr2=0x7fc4541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 -- 172.21.15.125:0/777085568 >> v1:172.21.15.125:6789/0 conn(0x7fc454130ce0 legacy=0x7fc454137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 -- 172.21.15.125:0/777085568 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45409b250 con 0x7fc45412d280 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc44bfff700 1 -- 172.21.15.125:0/777085568 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726246277 0 0) 0x7fc45409ae40 con 0x7fc454130ce0 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc458d22700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc459523700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc45412d650 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc450006fd0 tx=0x7fc450009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74142ccfe0c7f5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc44bfff700 1 -- 172.21.15.125:0/777085568 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450005e30 con 0x7fc45412d280 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc44bfff700 1 -- 172.21.15.125:0/777085568 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450006030 con 0x7fc45412d280 2023-10-03T10:12:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.918+0000 7fc44bfff700 1 -- 172.21.15.125:0/777085568 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500063a0 con 0x7fc45412d280 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 -- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 msgr2=0x7fc45412d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc45412d650 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc450006fd0 tx=0x7fc450009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 -- 172.21.15.125:0/777085568 shutdown_connections 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc45412d650 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 --2- 172.21.15.125:0/777085568 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 -- 172.21.15.125:0/777085568 >> 172.21.15.125:0/777085568 conn(0x7fc4540a2980 msgr2=0x7fc4540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 -- 172.21.15.125:0/777085568 shutdown_connections 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.919+0000 7fc45b787700 1 -- 172.21.15.125:0/777085568 wait complete. 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 Processor -- start 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 -- start start 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc4541c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 0x7fc4541c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454138750 con 0x7fc45412d280 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454138930 con 0x7fc454130ce0 2023-10-03T10:12:52.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc45b787700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541c5de0 con 0x7fc454130350 2023-10-03T10:12:52.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc459523700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc4541c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc459523700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc4541c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46720/0 (socket says 172.21.15.125:46720) 2023-10-03T10:12:52.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc459d24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 0x7fc4541c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.921+0000 7fc459523700 1 -- 172.21.15.125:0/3682793662 learned_addr learned my addr 172.21.15.125:0/3682793662 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc458d22700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 -- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 msgr2=0x7fc4541c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 -- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 msgr2=0x7fc4541c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc4541c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 -- 172.21.15.125:0/3682793662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440094a0 con 0x7fc454130ce0 2023-10-03T10:12:52.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc459d24700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 0x7fc4541c8380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00c7c0 tx=0x7fc44c00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c003e30 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c005070 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc450009500 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.922+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454138390 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.923+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c005420 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.923+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc44c005580 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.923+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc44c03ec50 con 0x7fc454130ce0 2023-10-03T10:12:52.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.923+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340052e0 con 0x7fc454130ce0 2023-10-03T10:12:52.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.932+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc44c017020 con 0x7fc454130ce0 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 Processor -- start 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 -- start start 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c8133ad0 0x7fc8c8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8c81300a0 0x7fc8c81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c806b2d0 con 0x7fc8c81300a0 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8133610 con 0x7fc8c8133ad0 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ce6a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c809a500 con 0x7fc8c81309f0 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ccc3f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ccc3f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43366/0 (socket says 172.21.15.125:43366) 2023-10-03T10:12:52.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.958+0000 7fc8ccc3f700 1 -- 172.21.15.125:0/3906206975 learned_addr learned my addr 172.21.15.125:0/3906206975 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 -- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c8133ad0 msgr2=0x7fc8c8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 --2- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c8133ad0 0x7fc8c8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 -- 172.21.15.125:0/3906206975 >> v2:172.21.15.125:3300/0 conn(0x7fc8c81300a0 msgr2=0x7fc8c81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 --2- 172.21.15.125:0/3906206975 >> v2:172.21.15.125:3300/0 conn(0x7fc8c81300a0 0x7fc8c81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 -- 172.21.15.125:0/3906206975 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c81338b0 con 0x7fc8c81309f0 2023-10-03T10:12:52.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8ccc3f700 1 --2- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009e50 tx=0x7fc8c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3f7b83908eb039 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8c6ffd700 1 -- 172.21.15.125:0/3906206975 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000e070 con 0x7fc8c81309f0 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8c6ffd700 1 -- 172.21.15.125:0/3906206975 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000b9c0 con 0x7fc8c81309f0 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.959+0000 7fc8c6ffd700 1 -- 172.21.15.125:0/3906206975 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000bd70 con 0x7fc8c81309f0 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 msgr2=0x7fc8c813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009e50 tx=0x7fc8c000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/3906206975 shutdown_connections 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c8133ad0 0x7fc8c8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/3906206975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c813a980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/3906206975 >> v2:172.21.15.125:3300/0 conn(0x7fc8c81300a0 0x7fc8c81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/3906206975 >> 172.21.15.125:0/3906206975 conn(0x7fc8c8099c40 msgr2=0x7fc8c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/3906206975 shutdown_connections 2023-10-03T10:12:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.960+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/3906206975 wait complete. 2023-10-03T10:12:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 Processor -- start 2023-10-03T10:12:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 -- start start 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c81300a0 0x7fc8c811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c8133ad0 0x7fc8c811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c811f9a0 con 0x7fc8c8133ad0 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c812d390 con 0x7fc8c81300a0 2023-10-03T10:12:52.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8ce6a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8120300 con 0x7fc8c81309f0 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8c77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8c7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c81300a0 0x7fc8c811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8c77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43374/0 (socket says 172.21.15.125:43374) 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.961+0000 7fc8c77fe700 1 -- 172.21.15.125:0/2646976851 learned_addr learned my addr 172.21.15.125:0/2646976851 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8ccc3f700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c8133ad0 0x7fc8c811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 -- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c81300a0 msgr2=0x7fc8c811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c81300a0 0x7fc8c811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 -- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c8133ad0 msgr2=0x7fc8c811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c8133ad0 0x7fc8c811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 -- 172.21.15.125:0/2646976851 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009b30 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c77fe700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b530 tx=0x7fc8bc00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc011830 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0119b0 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc011d60 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c811fd60 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.962+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c812dd00 con 0x7fc8c81309f0 2023-10-03T10:12:52.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.963+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8bc01a400 con 0x7fc8c81309f0 2023-10-03T10:12:52.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.963+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c812d730 con 0x7fc8c81309f0 2023-10-03T10:12:52.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.963+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc8bc03f630 con 0x7fc8c81309f0 2023-10-03T10:12:52.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.968+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8bc015070 con 0x7fc8c81309f0 2023-10-03T10:12:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.987+0000 7f24a9ac5700 1 Processor -- start 2023-10-03T10:12:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.987+0000 7f24a9ac5700 1 -- start start 2023-10-03T10:12:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a9ac5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a9ac5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24a4130bc0 0x7f24a413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a9ac5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a406b2d0 con 0x7f24a41300a0 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a9ac5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a4133610 con 0x7f24a4130bc0 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a9ac5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a409a500 con 0x7f24a4133ad0 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46968/0 (socket says 172.21.15.125:46968) 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a37fe700 1 -- 172.21.15.125:0/2677920185 learned_addr learned my addr 172.21.15.125:0/2677920185 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.988+0000 7f24a3fff700 1 --2- 172.21.15.125:0/2677920185 >> v2:172.21.15.125:3300/0 conn(0x7f24a4130bc0 0x7f24a413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a37fe700 1 -- 172.21.15.125:0/2677920185 >> v2:172.21.15.125:3300/0 conn(0x7f24a4130bc0 msgr2=0x7f24a413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a37fe700 1 --2- 172.21.15.125:0/2677920185 >> v2:172.21.15.125:3300/0 conn(0x7f24a4130bc0 0x7f24a413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a37fe700 1 -- 172.21.15.125:0/2677920185 >> v1:172.21.15.125:6789/0 conn(0x7f24a41300a0 legacy=0x7f24a41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a37fe700 1 -- 172.21.15.125:0/2677920185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a41338b0 con 0x7f24a4133ad0 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a37fe700 1 --2- 172.21.15.125:0/2677920185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24940098f0 tx=0x7f2494009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd764811cb14dabc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a27fc700 1 -- 172.21.15.125:0/2677920185 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400b8a0 con 0x7f24a4133ad0 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a27fc700 1 -- 172.21.15.125:0/2677920185 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400ba00 con 0x7f24a4133ad0 2023-10-03T10:12:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.989+0000 7f24a27fc700 1 -- 172.21.15.125:0/2677920185 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400bd90 con 0x7f24a4133ad0 2023-10-03T10:12:52.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 -- 172.21.15.125:0/2677920185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 msgr2=0x7f24a4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/2677920185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24940098f0 tx=0x7f2494009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 -- 172.21.15.125:0/2677920185 shutdown_connections 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/2677920185 >> v2:172.21.15.125:3300/0 conn(0x7f24a4130bc0 0x7f24a413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/2677920185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4133ad0 0x7f24a4133ea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 -- 172.21.15.125:0/2677920185 >> 172.21.15.125:0/2677920185 conn(0x7f24a4099c40 msgr2=0x7f24a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 -- 172.21.15.125:0/2677920185 shutdown_connections 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.990+0000 7f24a9ac5700 1 -- 172.21.15.125:0/2677920185 wait complete. 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.991+0000 7f24a9ac5700 1 Processor -- start 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.991+0000 7f24a9ac5700 1 -- start start 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 0x7f24a411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4130bc0 0x7f24a411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a411fb90 con 0x7f24a4133ad0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a412da50 con 0x7f24a4130bc0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a9ac5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4072230 con 0x7f24a41300a0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4130bc0 0x7f24a411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46770/0 (socket says 172.21.15.125:46770) 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 0x7f24a411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.992+0000 7f24a3fff700 1 -- 172.21.15.125:0/3625590939 learned_addr learned my addr 172.21.15.125:0/3625590939 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:52.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 -- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4130bc0 msgr2=0x7f24a411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4130bc0 0x7f24a411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 -- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 msgr2=0x7f24a411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 -- 172.21.15.125:0/3625590939 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009550 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a3fff700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a37fe700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 0x7f24a411da40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a406e4e0 tx=0x7f2494004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494004300 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249401f070 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a411fe50 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940036a0 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.993+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a412fbb0 con 0x7f24a41300a0 2023-10-03T10:12:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.994+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2494021030 con 0x7f24a41300a0 2023-10-03T10:12:52.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.994+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a404f2a0 con 0x7f24a41300a0 2023-10-03T10:12:52.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.994+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2494040920 con 0x7f24a41300a0 2023-10-03T10:12:52.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:52.999+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2494023990 con 0x7f24a41300a0 2023-10-03T10:12:53.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.123+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f985c12f500 con 0x7f985c133ad0 2023-10-03T10:12:53.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.123+0000 7f9858ff9700 1 -- 172.21.15.125:0/189692772 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f985402c070 con 0x7f985c133ad0 2023-10-03T10:12:53.124 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 msgr2=0x7f985c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 0x7f985c11e4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f985c06e4e0 tx=0x7f9854004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 shutdown_connections 2023-10-03T10:12:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f985c133ad0 0x7f985c11e4c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f985c1300a0 0x7f985c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 --2- 172.21.15.125:0/189692772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f985c1309f0 0x7f985c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 >> 172.21.15.125:0/189692772 conn(0x7f985c099c40 msgr2=0x7f985c132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 shutdown_connections 2023-10-03T10:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.126+0000 7f986298e700 1 -- 172.21.15.125:0/189692772 wait complete. 2023-10-03T10:12:53.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.143+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc434005590 con 0x7fc454130ce0 2023-10-03T10:12:53.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:53.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.143+0000 7fc449ffb700 1 -- 172.21.15.125:0/3682793662 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc44c010d60 con 0x7fc454130ce0 2023-10-03T10:12:53.144 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:53.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 msgr2=0x7fc4541c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 0x7fc4541c8380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00c7c0 tx=0x7fc44c00cad0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 shutdown_connections 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc454130ce0 0x7fc4541c8380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc45412d280 0x7fc4541c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 --2- 172.21.15.125:0/3682793662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc454130350 0x7fc4541c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.145+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 >> 172.21.15.125:0/3682793662 conn(0x7fc4540a2980 msgr2=0x7fc45409f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.146+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 shutdown_connections 2023-10-03T10:12:53.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.146+0000 7fc45b787700 1 -- 172.21.15.125:0/3682793662 wait complete. 2023-10-03T10:12:53.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:53.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.163+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8c804f2a0 con 0x7fc8c81309f0 2023-10-03T10:12:53.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.163+0000 7fc8c4ff9700 1 -- 172.21.15.125:0/2646976851 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8bc00f8d0 con 0x7fc8c81309f0 2023-10-03T10:12:53.164 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:53.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 msgr2=0x7fc8c811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b530 tx=0x7fc8bc00b840 comp rx=0 tx=0).stop 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 shutdown_connections 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c8133ad0 0x7fc8c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8c81300a0 0x7fc8c811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 --2- 172.21.15.125:0/2646976851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8c81309f0 0x7fc8c811df80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 >> 172.21.15.125:0/2646976851 conn(0x7fc8c8099c40 msgr2=0x7fc8c812e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 shutdown_connections 2023-10-03T10:12:53.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.166+0000 7fc8ce6a2700 1 -- 172.21.15.125:0/2646976851 wait complete. 2023-10-03T10:12:53.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:53.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.194+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24a406c3b0 con 0x7f24a41300a0 2023-10-03T10:12:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.194+0000 7f248bfff700 1 -- 172.21.15.125:0/3625590939 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2494015020 con 0x7f24a41300a0 2023-10-03T10:12:53.195 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:53.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 msgr2=0x7f24a411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 0x7f24a411da40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a406e4e0 tx=0x7f2494004750 comp rx=0 tx=0).stop 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 shutdown_connections 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4133ad0 0x7f24a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a41300a0 0x7f24a411da40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 --2- 172.21.15.125:0/3625590939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4130bc0 0x7f24a411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 >> 172.21.15.125:0/3625590939 conn(0x7f24a4099c40 msgr2=0x7f24a40a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.196+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 shutdown_connections 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:53.197+0000 7f24a9ac5700 1 -- 172.21.15.125:0/3625590939 wait complete. 2023-10-03T10:12:53.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:54.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:54.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:54.179 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:54.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.298+0000 7f2a1fa93700 1 Processor -- start 2023-10-03T10:12:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.298+0000 7f2a1fa93700 1 -- start start 2023-10-03T10:12:54.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a180a1380 0x7f2a18133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1809e9d0 con 0x7f2a180a1380 2023-10-03T10:12:54.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1809dc00 con 0x7f2a18133f50 2023-10-03T10:12:54.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1fa93700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1809dec0 con 0x7f2a180a0a70 2023-10-03T10:12:54.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1d82f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1d02e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a180a1380 0x7f2a18133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1d02e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a180a1380 0x7f2a18133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46784/0 (socket says 172.21.15.125:46784) 2023-10-03T10:12:54.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1d82f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43390/0 (socket says 172.21.15.125:43390) 2023-10-03T10:12:54.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.299+0000 7f2a1d02e700 1 -- 172.21.15.125:0/1799053832 learned_addr learned my addr 172.21.15.125:0/1799053832 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1e030700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 -- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 msgr2=0x7f2a180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 -- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 msgr2=0x7f2a18134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 -- 172.21.15.125:0/1799053832 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1809e6a0 con 0x7f2a180a1380 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1d02e700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18133a10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2a080098f0 tx=0x7f2a08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf5409f54f91a98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1c82d700 1 -- 172.21.15.125:0/1799053832 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011830 con 0x7f2a180a1380 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1c82d700 1 -- 172.21.15.125:0/1799053832 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08011990 con 0x7f2a180a1380 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.300+0000 7f2a1c82d700 1 -- 172.21.15.125:0/1799053832 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011d20 con 0x7f2a180a1380 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 -- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 msgr2=0x7f2a18133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18133a10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2a080098f0 tx=0x7f2a08009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 -- 172.21.15.125:0/1799053832 shutdown_connections 2023-10-03T10:12:54.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/1799053832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18133a10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 -- 172.21.15.125:0/1799053832 >> 172.21.15.125:0/1799053832 conn(0x7f2a180a6610 msgr2=0x7f2a180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 -- 172.21.15.125:0/1799053832 shutdown_connections 2023-10-03T10:12:54.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.301+0000 7f2a1fa93700 1 -- 172.21.15.125:0/1799053832 wait complete. 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.302+0000 7f2a1fa93700 1 Processor -- start 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.302+0000 7f2a1fa93700 1 -- start start 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18124d20 con 0x7f2a180a1380 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18124520 con 0x7f2a18133f50 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1fa93700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180a50a0 con 0x7f2a180a0a70 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43394/0 (socket says 172.21.15.125:43394) 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 -- 172.21.15.125:0/183248923 learned_addr learned my addr 172.21.15.125:0/183248923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d02e700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1e030700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 -- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 msgr2=0x7f2a18122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 -- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 msgr2=0x7f2a18122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 -- 172.21.15.125:0/183248923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009550 con 0x7f2a180a0a70 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d02e700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1e030700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.303+0000 7f2a1d82f700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e870 tx=0x7f2a1400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.304+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400c640 con 0x7f2a180a0a70 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.304+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400c7a0 con 0x7f2a180a0a70 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.304+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400cb30 con 0x7f2a180a0a70 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.304+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a180a03e0 con 0x7f2a180a0a70 2023-10-03T10:12:54.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.304+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a18125c10 con 0x7f2a180a0a70 2023-10-03T10:12:54.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.305+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a1400cc90 con 0x7f2a180a0a70 2023-10-03T10:12:54.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.305+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a1403f820 con 0x7f2a180a0a70 2023-10-03T10:12:54.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.306+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1811f760 con 0x7f2a180a0a70 2023-10-03T10:12:54.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.314+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1401bba0 con 0x7f2a180a0a70 2023-10-03T10:12:54.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 Processor -- start 2023-10-03T10:12:54.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 -- start start 2023-10-03T10:12:54.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd72812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 0x7fd7281308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd728130e30 con 0x7fd7281304a0 2023-10-03T10:12:54.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280a1e70 con 0x7fd7280a0a30 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd7301e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809a720 con 0x7fd7280a1340 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd72e783700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 0x7fd7281308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd72e783700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 0x7fd7281308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46810/0 (socket says 172.21.15.125:46810) 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.326+0000 7fd72e783700 1 -- 172.21.15.125:0/1619862547 learned_addr learned my addr 172.21.15.125:0/1619862547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd72812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72df82700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 -- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 msgr2=0x7fd7280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 -- 172.21.15.125:0/1619862547 >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 msgr2=0x7fd7281308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 --2- 172.21.15.125:0/1619862547 >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 0x7fd7281308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 -- 172.21.15.125:0/1619862547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72809b300 con 0x7fd7280a1340 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72df82700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72d781700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd72812ff60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b8f0 tx=0x7fd71800bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ce4cae5edf7be5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72cf80700 1 -- 172.21.15.125:0/1619862547 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718009030 con 0x7fd7280a1340 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72cf80700 1 -- 172.21.15.125:0/1619862547 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800caf0 con 0x7fd7280a1340 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.327+0000 7fd72cf80700 1 -- 172.21.15.125:0/1619862547 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800cea0 con 0x7fd7280a1340 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 -- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 msgr2=0x7fd72812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd72812ff60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b8f0 tx=0x7fd71800bc00 comp rx=0 tx=0).stop 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 -- 172.21.15.125:0/1619862547 shutdown_connections 2023-10-03T10:12:54.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 --2- 172.21.15.125:0/1619862547 >> v2:172.21.15.125:3300/0 conn(0x7fd7281304a0 0x7fd7281308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 --2- 172.21.15.125:0/1619862547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd72812ff60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 -- 172.21.15.125:0/1619862547 >> 172.21.15.125:0/1619862547 conn(0x7fd7280a2980 msgr2=0x7fd7280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 -- 172.21.15.125:0/1619862547 shutdown_connections 2023-10-03T10:12:54.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.328+0000 7fd7301e6700 1 -- 172.21.15.125:0/1619862547 wait complete. 2023-10-03T10:12:54.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7fd7301e6700 1 Processor -- start 2023-10-03T10:12:54.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7fd7301e6700 1 -- start start 2023-10-03T10:12:54.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7f070e58a700 1 Processor -- start 2023-10-03T10:12:54.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7fd7301e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7281c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7fd7301e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd7301e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7281304a0 0x7fd72811ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd7301e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72812f750 con 0x7fd7281304a0 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd7301e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72811e320 con 0x7fd7280a0a30 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd7301e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd72811cb30 con 0x7fd7280a1340 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43418/0 (socket says 172.21.15.125:43418) 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 -- 172.21.15.125:0/4208156446 learned_addr learned my addr 172.21.15.125:0/4208156446 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72e783700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7281304a0 0x7fd72811ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72df82700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7281c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.329+0000 7f070e58a700 1 -- start start 2023-10-03T10:12:54.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070e58a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f070809d860 0x7f070809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070e58a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 0x7f0708138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 -- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 msgr2=0x7fd7281c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7281c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 -- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7281304a0 msgr2=0x7fd72811ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7281304a0 0x7fd72811ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7fd72d781700 1 -- 172.21.15.125:0/4208156446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72400d8d0 con 0x7fd7280a1340 2023-10-03T10:12:54.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd72d781700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd71800bc40 tx=0x7fd718004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718022070 con 0x7fd7280a1340 2023-10-03T10:12:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71800b550 con 0x7fd7280a1340 2023-10-03T10:12:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718016c60 con 0x7fd7280a1340 2023-10-03T10:12:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718009040 con 0x7fd7280a1340 2023-10-03T10:12:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72809f240 con 0x7fd7280a1340 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070e58a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070809aaa0 con 0x7f070809e170 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070e58a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070809f870 con 0x7f070809d860 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070e58a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070809b360 con 0x7f0708130eb0 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f07077fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f070809e170 0x7f07081307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47232/0 (socket says 172.21.15.125:47232) 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f07077fe700 1 -- 172.21.15.125:0/2644753080 learned_addr learned my addr 172.21.15.125:0/2644753080 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f0707fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f070809d860 0x7f070809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.330+0000 7f070cb27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 0x7f0708138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f070cb27700 1 -- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f070809d860 msgr2=0x7f070809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f070cb27700 1 --2- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f070809d860 0x7f070809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f0706ffd700 1 -- 172.21.15.125:0/2644753080 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126136115 0 0) 0x7f070809aaa0 con 0x7f070809e170 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f070cb27700 1 -- 172.21.15.125:0/2644753080 >> v1:172.21.15.125:6789/0 conn(0x7f070809e170 legacy=0x7f07081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.331+0000 7f070cb27700 1 -- 172.21.15.125:0/2644753080 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070809b620 con 0x7f0708130eb0 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.332+0000 7f070cb27700 1 --2- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 0x7f0708138a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0700009dc0 tx=0x7f070000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bee0e07c3ff3926 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.332+0000 7f0706ffd700 1 -- 172.21.15.125:0/2644753080 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000e070 con 0x7f0708130eb0 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.332+0000 7f0706ffd700 1 -- 172.21.15.125:0/2644753080 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070000bb20 con 0x7f0708130eb0 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.332+0000 7f0706ffd700 1 -- 172.21.15.125:0/2644753080 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700012430 con 0x7f0708130eb0 2023-10-03T10:12:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72812fd30 con 0x7fd7280a1340 2023-10-03T10:12:54.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 -- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 msgr2=0x7f0708138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 --2- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 0x7f0708138a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0700009dc0 tx=0x7f070000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:54.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 -- 172.21.15.125:0/2644753080 shutdown_connections 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 --2- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0708130eb0 0x7f0708138a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 --2- 172.21.15.125:0/2644753080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f070809d860 0x7f070809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.333+0000 7f070e58a700 1 -- 172.21.15.125:0/2644753080 >> 172.21.15.125:0/2644753080 conn(0x7f0708099c40 msgr2=0x7f07080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.335+0000 7f070e58a700 1 -- 172.21.15.125:0/2644753080 shutdown_connections 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.335+0000 7f070e58a700 1 -- 172.21.15.125:0/2644753080 wait complete. 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.336+0000 7f070e58a700 1 Processor -- start 2023-10-03T10:12:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.336+0000 7f070e58a700 1 -- start start 2023-10-03T10:12:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.335+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd71801c070 con 0x7fd7280a1340 2023-10-03T10:12:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.335+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd718040f80 con 0x7fd7280a1340 2023-10-03T10:12:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f070809e170 0x7f07081ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 0x7f07081ba910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07081bc660 con 0x7f070809e170 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07081bded0 con 0x7f0708130eb0 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070e58a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070809c8e0 con 0x7f070809d860 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f0707fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f0707fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43438/0 (socket says 172.21.15.125:43438) 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f0707fff700 1 -- 172.21.15.125:0/3449018849 learned_addr learned my addr 172.21.15.125:0/3449018849 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 0x7f07081ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 -- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 msgr2=0x7f07081bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 -- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f070809e170 msgr2=0x7f07081ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f070809e170 0x7f07081ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f070cb27700 1 -- 172.21.15.125:0/3449018849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009a70 con 0x7f0708130eb0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.337+0000 7f0707fff700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f070cb27700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 0x7f07081ba910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0700016000 tx=0x7f0700004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700012430 con 0x7f0708130eb0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700020070 con 0x7f0708130eb0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004280 con 0x7f0708130eb0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07081bd750 con 0x7f0708130eb0 2023-10-03T10:12:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.338+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07081bae50 con 0x7f0708130eb0 2023-10-03T10:12:54.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.339+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07000043e0 con 0x7f0708130eb0 2023-10-03T10:12:54.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.339+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd718030db0 con 0x7fd7280a1340 2023-10-03T10:12:54.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.339+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0700022070 con 0x7f0708130eb0 2023-10-03T10:12:54.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.339+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070804f2a0 con 0x7f0708130eb0 2023-10-03T10:12:54.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.348+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070002c080 con 0x7f0708130eb0 2023-10-03T10:12:54.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.390+0000 7fba13c6f700 1 Processor -- start 2023-10-03T10:12:54.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 -- start start 2023-10-03T10:12:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c09da80 con 0x7fba0c06a770 2023-10-03T10:12:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c09dce0 con 0x7fba0c137140 2023-10-03T10:12:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba13c6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c06b620 con 0x7fba0c06b250 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba1220c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba1120a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba1120a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43442/0 (socket says 172.21.15.125:43442) 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba1120a700 1 -- 172.21.15.125:0/3910593233 learned_addr learned my addr 172.21.15.125:0/3910593233 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.391+0000 7fba1220c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47026/0 (socket says 172.21.15.125:47026) 2023-10-03T10:12:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1220c700 1 -- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 msgr2=0x7fba0c136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1220c700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1220c700 1 -- 172.21.15.125:0/3910593233 >> v1:172.21.15.125:6789/0 conn(0x7fba0c06a770 legacy=0x7fba0c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba10a09700 1 -- 172.21.15.125:0/3910593233 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676281497 0 0) 0x7fba0c09da80 con 0x7fba0c06a770 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1220c700 1 -- 172.21.15.125:0/3910593233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c09eb20 con 0x7fba0c137140 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1120a700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba1220c700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba04009dc0 tx=0x7fba0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676b5ba5d4efe0aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba10a09700 1 -- 172.21.15.125:0/3910593233 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e070 con 0x7fba0c137140 2023-10-03T10:12:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba10a09700 1 -- 172.21.15.125:0/3910593233 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400bb20 con 0x7fba0c137140 2023-10-03T10:12:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.392+0000 7fba10a09700 1 -- 172.21.15.125:0/3910593233 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04012430 con 0x7fba0c137140 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 -- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 msgr2=0x7fba0c139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba04009dc0 tx=0x7fba0400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 -- 172.21.15.125:0/3910593233 shutdown_connections 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c137140 0x7fba0c139520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 --2- 172.21.15.125:0/3910593233 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06b250 0x7fba0c136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 -- 172.21.15.125:0/3910593233 >> 172.21.15.125:0/3910593233 conn(0x7fba0c099c40 msgr2=0x7fba0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 -- 172.21.15.125:0/3910593233 shutdown_connections 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.393+0000 7fba13c6f700 1 -- 172.21.15.125:0/3910593233 wait complete. 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 Processor -- start 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 -- start start 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 0x7fba0c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 0x7fba0c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c125c20 con 0x7fba0c137140 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c136620 con 0x7fba0c06b250 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.394+0000 7fba13c6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1262c0 con 0x7fba0c06a770 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba1220c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 0x7fba0c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43448/0 (socket says 172.21.15.125:43448) 2023-10-03T10:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 -- 172.21.15.125:0/1562117789 learned_addr learned my addr 172.21.15.125:0/1562117789 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba1120a700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 0x7fba0c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 -- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 msgr2=0x7fba0c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 0x7fba0c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 -- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 msgr2=0x7fba0c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 0x7fba0c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 -- 172.21.15.125:0/1562117789 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009550 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba1120a700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 0x7fba0c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba1220c700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 0x7fba0c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba11a0b700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c520 tx=0x7fba0800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080054e0 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08003680 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba04009a70 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.395+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080039f0 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.396+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c071e10 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.397+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c126a10 con 0x7fba0c06a770 2023-10-03T10:12:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.397+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba08003b50 con 0x7fba0c06a770 2023-10-03T10:12:54.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.397+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba0803eab0 con 0x7fba0c06a770 2023-10-03T10:12:54.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.402+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba0801b3b0 con 0x7fba0c06a770 2023-10-03T10:12:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.524+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a1804f2a0 con 0x7f2a180a0a70 2023-10-03T10:12:54.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.524+0000 7f2a0e7fc700 1 -- 172.21.15.125:0/183248923 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a1402a090 con 0x7f2a180a0a70 2023-10-03T10:12:54.525 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:54.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 msgr2=0x7f2a181224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e870 tx=0x7f2a1400ec30 comp rx=0 tx=0).stop 2023-10-03T10:12:54.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 shutdown_connections 2023-10-03T10:12:54.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a18133f50 0x7f2a18122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a180a0a70 0x7f2a181224e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 --2- 172.21.15.125:0/183248923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a180a1380 0x7f2a18122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 >> 172.21.15.125:0/183248923 conn(0x7f2a180a6610 msgr2=0x7f2a1811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 shutdown_connections 2023-10-03T10:12:54.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.526+0000 7f2a1fa93700 1 -- 172.21.15.125:0/183248923 wait complete. 2023-10-03T10:12:54.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.555+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd72804f2a0 con 0x7fd7280a1340 2023-10-03T10:12:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.556+0000 7fd71e7fc700 1 -- 172.21.15.125:0/4208156446 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd71801a020 con 0x7fd7280a1340 2023-10-03T10:12:54.557 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.557+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 msgr2=0x7fd7281c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.557+0000 7fd7301e6700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd71800bc40 tx=0x7fd718004750 comp rx=0 tx=0).stop 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 shutdown_connections 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7281304a0 0x7fd72811ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7280a0a30 0x7fd7281c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 --2- 172.21.15.125:0/4208156446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7280a1340 0x7fd7281c4980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 >> 172.21.15.125:0/4208156446 conn(0x7fd7280a2980 msgr2=0x7fd7281b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 shutdown_connections 2023-10-03T10:12:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.558+0000 7fd7301e6700 1 -- 172.21.15.125:0/4208156446 wait complete. 2023-10-03T10:12:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.560+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f070806c3b0 con 0x7f0708130eb0 2023-10-03T10:12:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.561+0000 7f0704ff9700 1 -- 172.21.15.125:0/3449018849 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0700036090 con 0x7f0708130eb0 2023-10-03T10:12:54.561 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:54.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 msgr2=0x7f07081ba910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 0x7f07081ba910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0700016000 tx=0x7f0700004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 shutdown_connections 2023-10-03T10:12:54.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0708130eb0 0x7f07081ba910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f070809d860 0x7f07081bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 --2- 172.21.15.125:0/3449018849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f070809e170 0x7f07081ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.563+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 >> 172.21.15.125:0/3449018849 conn(0x7f0708099c40 msgr2=0x7f07080a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.566+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 shutdown_connections 2023-10-03T10:12:54.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.566+0000 7f070e58a700 1 -- 172.21.15.125:0/3449018849 wait complete. 2023-10-03T10:12:54.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:54.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:54.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.615+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba0c04f2a0 con 0x7fba0c06a770 2023-10-03T10:12:54.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.615+0000 7fba027fc700 1 -- 172.21.15.125:0/1562117789 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba08017030 con 0x7fba0c06a770 2023-10-03T10:12:54.616 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 msgr2=0x7fba0c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c520 tx=0x7fba0800c830 comp rx=0 tx=0).stop 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 shutdown_connections 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba0c137140 0x7fba0c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba0c06a770 0x7fba0c09a490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 --2- 172.21.15.125:0/1562117789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba0c06b250 0x7fba0c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 >> 172.21.15.125:0/1562117789 conn(0x7fba0c099c40 msgr2=0x7fba0c06fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 shutdown_connections 2023-10-03T10:12:54.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:54.617+0000 7fba13c6f700 1 -- 172.21.15.125:0/1562117789 wait complete. 2023-10-03T10:12:54.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:55.541 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:55.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:55.581 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:55.630 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:55.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.682+0000 7fecea6a6700 1 Processor -- start 2023-10-03T10:12:55.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 -- start start 2023-10-03T10:12:55.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409d860 0x7fece409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 0x7fece41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece409aaa0 con 0x7fece4130ce0 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece409f870 con 0x7fece409e170 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fecea6a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece409b360 con 0x7fece409d860 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fece8c43700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fece4130ce0 0x7fece41379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49316/0 (socket says 172.21.15.125:49316) 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fece8c43700 1 -- 172.21.15.125:0/955610402 learned_addr learned my addr 172.21.15.125:0/955610402 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fece3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409d860 0x7fece409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.683+0000 7fece37fe700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 0x7fece41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece37fe700 1 -- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409d860 msgr2=0x7fece409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece37fe700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409d860 0x7fece409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece37fe700 1 -- 172.21.15.125:0/955610402 >> v1:172.21.15.125:6789/0 conn(0x7fece4130ce0 legacy=0x7fece41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece37fe700 1 -- 172.21.15.125:0/955610402 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece409b620 con 0x7fece409e170 2023-10-03T10:12:55.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece37fe700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 0x7fece41307a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009870 tx=0x7fecd8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=971c629734acfd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece2ffd700 1 -- 172.21.15.125:0/955610402 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8011830 con 0x7fece409e170 2023-10-03T10:12:55.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece2ffd700 1 -- 172.21.15.125:0/955610402 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8011990 con 0x7fece409e170 2023-10-03T10:12:55.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.684+0000 7fece2ffd700 1 -- 172.21.15.125:0/955610402 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8011d20 con 0x7fece409e170 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 -- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 msgr2=0x7fece41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 0x7fece41307a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009870 tx=0x7fecd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 -- 172.21.15.125:0/955610402 shutdown_connections 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409d860 0x7fece409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 --2- 172.21.15.125:0/955610402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece409e170 0x7fece41307a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 -- 172.21.15.125:0/955610402 >> 172.21.15.125:0/955610402 conn(0x7fece4099c40 msgr2=0x7fece40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 -- 172.21.15.125:0/955610402 shutdown_connections 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.685+0000 7fecea6a6700 1 -- 172.21.15.125:0/955610402 wait complete. 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.686+0000 7fecea6a6700 1 Processor -- start 2023-10-03T10:12:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 -- start start 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 0x7fece4138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 0x7fece41386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 0x7fece41c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4136a60 con 0x7fece409d860 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece409c8b0 con 0x7fece4130ce0 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fecea6a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece41357e0 con 0x7fece409e170 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fece3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 0x7fece4138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fece3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 0x7fece4138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47760/0 (socket says 172.21.15.125:47760) 2023-10-03T10:12:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.687+0000 7fece3fff700 1 -- 172.21.15.125:0/2725659305 learned_addr learned my addr 172.21.15.125:0/2725659305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 0x7fece41c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece37fe700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 0x7fece41386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 -- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 msgr2=0x7fece41386d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 0x7fece41386d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 -- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 msgr2=0x7fece4138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 0x7fece4138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 -- 172.21.15.125:0/2725659305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80094a0 con 0x7fece4130ce0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece37fe700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 0x7fece41386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece8c43700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 0x7fece41c8190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00caa0 tx=0x7fecdc00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00a9a0 con 0x7fece4130ce0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00ab00 con 0x7fece4130ce0 2023-10-03T10:12:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4138c10 con 0x7fece4130ce0 2023-10-03T10:12:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.688+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00ae70 con 0x7fece4130ce0 2023-10-03T10:12:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.689+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece413be00 con 0x7fece4130ce0 2023-10-03T10:12:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.689+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecdc01b3b0 con 0x7fece4130ce0 2023-10-03T10:12:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.690+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecdc03f170 con 0x7fece4130ce0 2023-10-03T10:12:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.690+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece413be00 con 0x7fece4130ce0 2023-10-03T10:12:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.695+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fece413be00 con 0x7fece4130ce0 2023-10-03T10:12:55.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.720+0000 7f08d5c8d700 1 Processor -- start 2023-10-03T10:12:55.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.720+0000 7f08d5c8d700 1 -- start start 2023-10-03T10:12:55.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08d5c8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 0x7f08d009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08d5c8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009e170 0x7f08d01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08d5c8d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d009aaa0 con 0x7f08d0130ce0 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08d5c8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009f870 con 0x7f08d009e170 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08d5c8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009b360 con 0x7f08d009d860 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08cffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f08d0130ce0 0x7f08d01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49318/0 (socket says 172.21.15.125:49318) 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08cffff700 1 -- 172.21.15.125:0/4277672592 learned_addr learned my addr 172.21.15.125:0/4277672592 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08ceffd700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009e170 0x7f08d01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.721+0000 7f08cf7fe700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 0x7f08d009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08cf7fe700 1 -- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009e170 msgr2=0x7f08d01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08cf7fe700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009e170 0x7f08d01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08cf7fe700 1 -- 172.21.15.125:0/4277672592 >> v1:172.21.15.125:6789/0 conn(0x7f08d0130ce0 legacy=0x7f08d01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08ce7fc700 1 -- 172.21.15.125:0/4277672592 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361291047 0 0) 0x7f08d009aaa0 con 0x7f08d0130ce0 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08cf7fe700 1 -- 172.21.15.125:0/4277672592 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d009b620 con 0x7f08d009d860 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08cf7fe700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 0x7f08d009dc30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa8818d1700d1d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08ce7fc700 1 -- 172.21.15.125:0/4277672592 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0011830 con 0x7f08d009d860 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08ce7fc700 1 -- 172.21.15.125:0/4277672592 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0011990 con 0x7f08d009d860 2023-10-03T10:12:55.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.722+0000 7f08ce7fc700 1 -- 172.21.15.125:0/4277672592 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0011d20 con 0x7f08d009d860 2023-10-03T10:12:55.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 -- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 msgr2=0x7f08d009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 0x7f08d009dc30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 -- 172.21.15.125:0/4277672592 shutdown_connections 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d009d860 0x7f08d009dc30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/4277672592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009e170 0x7f08d01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 -- 172.21.15.125:0/4277672592 >> 172.21.15.125:0/4277672592 conn(0x7f08d0099c40 msgr2=0x7f08d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 -- 172.21.15.125:0/4277672592 shutdown_connections 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.723+0000 7f08d5c8d700 1 -- 172.21.15.125:0/4277672592 wait complete. 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 Processor -- start 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 -- start start 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009d860 0x7f08d0135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08d009e170 0x7f08d0135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0139140 con 0x7f08d009e170 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00a0660 con 0x7f08d009d860 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.724+0000 7f08d5c8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0138b30 con 0x7f08d0130ce0 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46512/0 (socket says 172.21.15.125:46512) 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 -- 172.21.15.125:0/2563424674 learned_addr learned my addr 172.21.15.125:0/2563424674 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cf7fe700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009d860 0x7f08d0135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 -- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009d860 msgr2=0x7f08d0135600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009d860 0x7f08d0135600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 -- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08d009e170 msgr2=0x7f08d0135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08d009e170 0x7f08d0135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 -- 172.21.15.125:0/2563424674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00094a0 con 0x7f08d0130ce0 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08cffff700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08c8002230 tx=0x7f08c800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800abc0 con 0x7f08d0130ce0 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d0138df0 con 0x7f08d0130ce0 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800ad40 con 0x7f08d0130ce0 2023-10-03T10:12:55.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007310 con 0x7f08d0130ce0 2023-10-03T10:12:55.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.725+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d01379b0 con 0x7f08d0130ce0 2023-10-03T10:12:55.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.726+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08c8007470 con 0x7f08d0130ce0 2023-10-03T10:12:55.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.727+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08c8007720 con 0x7f08d0130ce0 2023-10-03T10:12:55.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.727+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d004f2a0 con 0x7f08d0130ce0 2023-10-03T10:12:55.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 Processor -- start 2023-10-03T10:12:55.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 -- start start 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 0x7ffb1c09c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 0x7ffb1c139b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c0a23a0 con 0x7ffb1c131a80 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c131440 con 0x7ffb1c131e50 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.732+0000 7ffb20c8e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06eaa0 con 0x7ffb1c137770 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 0x7ffb1c139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ffb1c131a80 0x7ffb1c09bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49334/0 (socket says 172.21.15.125:49334) 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1a59c700 1 -- 172.21.15.125:0/1630295235 learned_addr learned my addr 172.21.15.125:0/1630295235 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb19d9b700 1 --2- 172.21.15.125:0/1630295235 >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 0x7ffb1c09c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 -- 172.21.15.125:0/1630295235 >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 msgr2=0x7ffb1c09c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 --2- 172.21.15.125:0/1630295235 >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 0x7ffb1c09c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 -- 172.21.15.125:0/1630295235 >> v1:172.21.15.125:6789/0 conn(0x7ffb1c131a80 legacy=0x7ffb1c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 -- 172.21.15.125:0/1630295235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0a25d0 con 0x7ffb1c137770 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1959a700 1 -- 172.21.15.125:0/1630295235 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554037482 0 0) 0x7ffb1c0a23a0 con 0x7ffb1c131a80 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb19d9b700 1 --2- 172.21.15.125:0/1630295235 >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 0x7ffb1c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1ad9d700 1 --2- 172.21.15.125:0/1630295235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 0x7ffb1c139b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009dc0 tx=0x7ffb1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5942ea8f0b605c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1959a700 1 -- 172.21.15.125:0/1630295235 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400e070 con 0x7ffb1c137770 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1959a700 1 -- 172.21.15.125:0/1630295235 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400bae0 con 0x7ffb1c137770 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.733+0000 7ffb1959a700 1 -- 172.21.15.125:0/1630295235 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400be90 con 0x7ffb1c137770 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 -- 172.21.15.125:0/1630295235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 msgr2=0x7ffb1c139b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/1630295235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 0x7ffb1c139b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009dc0 tx=0x7ffb1400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 -- 172.21.15.125:0/1630295235 shutdown_connections 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/1630295235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c137770 0x7ffb1c139b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/1630295235 >> v2:172.21.15.125:3300/0 conn(0x7ffb1c131e50 0x7ffb1c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 -- 172.21.15.125:0/1630295235 >> 172.21.15.125:0/1630295235 conn(0x7ffb1c0a2980 msgr2=0x7ffb1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 -- 172.21.15.125:0/1630295235 shutdown_connections 2023-10-03T10:12:55.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.734+0000 7ffb20c8e700 1 -- 172.21.15.125:0/1630295235 wait complete. 2023-10-03T10:12:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.735+0000 7ffb20c8e700 1 Processor -- start 2023-10-03T10:12:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.735+0000 7ffb20c8e700 1 -- start start 2023-10-03T10:12:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb1c131e50 0x7ffb1c132530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb1c137770 0x7ffb1c132a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c134e30 con 0x7ffb1c131e50 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c09c690 con 0x7ffb1c131a80 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb20c8e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c13ad20 con 0x7ffb1c137770 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39208/0 (socket says 172.21.15.125:39208) 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 -- 172.21.15.125:0/3729594776 learned_addr learned my addr 172.21.15.125:0/3729594776 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb19d9b700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb1c131e50 0x7ffb1c132530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 -- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb1c137770 msgr2=0x7ffb1c132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb1c137770 0x7ffb1c132a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 -- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb1c131e50 msgr2=0x7ffb1c132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb1c131e50 0x7ffb1c132530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 -- 172.21.15.125:0/3729594776 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100094a0 con 0x7ffb1c131a80 2023-10-03T10:12:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb1a59c700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c4a0 tx=0x7ffb0c00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08c8041020 con 0x7f08d0130ce0 2023-10-03T10:12:55.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.736+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0074e0 con 0x7ffb1c131a80 2023-10-03T10:12:55.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.737+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c007640 con 0x7ffb1c131a80 2023-10-03T10:12:55.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.737+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb14009a70 con 0x7ffb1c131a80 2023-10-03T10:12:55.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.737+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c005a70 con 0x7ffb1c131a80 2023-10-03T10:12:55.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.737+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c135030 con 0x7ffb1c131a80 2023-10-03T10:12:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.738+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c136fe0 con 0x7ffb1c131a80 2023-10-03T10:12:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.738+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb0c005bd0 con 0x7ffb1c131a80 2023-10-03T10:12:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.738+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb0c03eb00 con 0x7ffb1c131a80 2023-10-03T10:12:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.742+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb0c018260 con 0x7ffb1c131a80 2023-10-03T10:12:55.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.781+0000 7fd3099c0700 1 Processor -- start 2023-10-03T10:12:55.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.781+0000 7fd3099c0700 1 -- start start 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3099c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3099c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd304134120 0x7fd30413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3099c0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30409dc00 con 0x7fd3040a1380 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3099c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30409ea60 con 0x7fd304134120 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3099c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30409dec0 con 0x7fd3040a0a70 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39222/0 (socket says 172.21.15.125:39222) 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd302ffd700 1 -- 172.21.15.125:0/1512452603 learned_addr learned my addr 172.21.15.125:0/1512452603 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.782+0000 7fd3037fe700 1 --2- 172.21.15.125:0/1512452603 >> v2:172.21.15.125:3300/0 conn(0x7fd304134120 0x7fd30413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd302ffd700 1 -- 172.21.15.125:0/1512452603 >> v2:172.21.15.125:3300/0 conn(0x7fd304134120 msgr2=0x7fd30413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd302ffd700 1 --2- 172.21.15.125:0/1512452603 >> v2:172.21.15.125:3300/0 conn(0x7fd304134120 0x7fd30413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd302ffd700 1 -- 172.21.15.125:0/1512452603 >> v1:172.21.15.125:6789/0 conn(0x7fd3040a1380 legacy=0x7fd304133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd302ffd700 1 -- 172.21.15.125:0/1512452603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30409e6a0 con 0x7fd3040a0a70 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd302ffd700 1 --2- 172.21.15.125:0/1512452603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098f0 tx=0x7fd2f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3acdc5324b9929b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd301ffb700 1 -- 172.21.15.125:0/1512452603 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4011830 con 0x7fd3040a0a70 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd301ffb700 1 -- 172.21.15.125:0/1512452603 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4011990 con 0x7fd3040a0a70 2023-10-03T10:12:55.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.783+0000 7fd301ffb700 1 -- 172.21.15.125:0/1512452603 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4011d20 con 0x7fd3040a0a70 2023-10-03T10:12:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 -- 172.21.15.125:0/1512452603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 msgr2=0x7fd3040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 --2- 172.21.15.125:0/1512452603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098f0 tx=0x7fd2f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 -- 172.21.15.125:0/1512452603 shutdown_connections 2023-10-03T10:12:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 --2- 172.21.15.125:0/1512452603 >> v2:172.21.15.125:3300/0 conn(0x7fd304134120 0x7fd30413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 --2- 172.21.15.125:0/1512452603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd3040a0e40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 -- 172.21.15.125:0/1512452603 >> 172.21.15.125:0/1512452603 conn(0x7fd3040a6610 msgr2=0x7fd3040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 -- 172.21.15.125:0/1512452603 shutdown_connections 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.784+0000 7fd3099c0700 1 -- 172.21.15.125:0/1512452603 wait complete. 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.785+0000 7fd3099c0700 1 Processor -- start 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 -- start start 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd304122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd304134120 0x7fd304123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd304133af0 con 0x7fd3040a1380 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd304125ef0 con 0x7fd3040a0a70 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.786+0000 7fd3099c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd304124dc0 con 0x7fd304134120 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3027fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3027fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47810/0 (socket says 172.21.15.125:47810) 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3027fc700 1 -- 172.21.15.125:0/2624760143 learned_addr learned my addr 172.21.15.125:0/2624760143 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd304122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3037fe700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd304134120 0x7fd304123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 -- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd304134120 msgr2=0x7fd304123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd304134120 0x7fd304123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 -- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 msgr2=0x7fd304122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 -- 172.21.15.125:0/2624760143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009550 con 0x7fd3040a0a70 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3027fc700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd302ffd700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd304122a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4016000 tx=0x7fd2f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40045d0 con 0x7fd3040a0a70 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f401f070 con 0x7fd3040a0a70 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd304124b30 con 0x7fd3040a0a70 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.787+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40038e0 con 0x7fd3040a0a70 2023-10-03T10:12:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.788+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd304126b90 con 0x7fd3040a0a70 2023-10-03T10:12:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.789+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2f4003a40 con 0x7fd3040a0a70 2023-10-03T10:12:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.789+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd2f4021070 con 0x7fd3040a0a70 2023-10-03T10:12:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.789+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304126080 con 0x7fd3040a0a70 2023-10-03T10:12:55.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.798+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd304126080 con 0x7fd3040a0a70 2023-10-03T10:12:55.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.906+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fece413be00 con 0x7fece4130ce0 2023-10-03T10:12:55.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.906+0000 7fece0ff9700 1 -- 172.21.15.125:0/2725659305 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fece413be00 con 0x7fece4130ce0 2023-10-03T10:12:55.907 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 msgr2=0x7fece41c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 0x7fece41c8190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00caa0 tx=0x7fecdc00cdb0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 shutdown_connections 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fece4130ce0 0x7fece41c8190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fece409d860 0x7fece4138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 --2- 172.21.15.125:0/2725659305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fece409e170 0x7fece41386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.908+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 >> 172.21.15.125:0/2725659305 conn(0x7fece4099c40 msgr2=0x7fece4139590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.909+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 shutdown_connections 2023-10-03T10:12:55.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.912+0000 7fecea6a6700 1 -- 172.21.15.125:0/2725659305 wait complete. 2023-10-03T10:12:55.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:55.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.950+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb1c04f2a0 con 0x7ffb1c131a80 2023-10-03T10:12:55.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.950+0000 7ffb0affd700 1 -- 172.21.15.125:0/3729594776 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb0c017030 con 0x7ffb1c131a80 2023-10-03T10:12:55.951 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 msgr2=0x7ffb1c12e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c4a0 tx=0x7ffb0c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 shutdown_connections 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb1c137770 0x7ffb1c132a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb1c131a80 0x7ffb1c12e590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 --2- 172.21.15.125:0/3729594776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb1c131e50 0x7ffb1c132530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 >> 172.21.15.125:0/3729594776 conn(0x7ffb1c0a2980 msgr2=0x7ffb1c06f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 shutdown_connections 2023-10-03T10:12:55.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.952+0000 7ffb20c8e700 1 -- 172.21.15.125:0/3729594776 wait complete. 2023-10-03T10:12:55.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:55.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.970+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08d006c3b0 con 0x7f08d0130ce0 2023-10-03T10:12:55.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.970+0000 7f08b7fff700 1 -- 172.21.15.125:0/2563424674 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08c8018020 con 0x7f08d0130ce0 2023-10-03T10:12:55.971 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 msgr2=0x7f08d0136080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08c8002230 tx=0x7f08c800a060 comp rx=0 tx=0).stop 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 shutdown_connections 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08d0130ce0 0x7f08d0136080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08d009d860 0x7f08d0135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 --2- 172.21.15.125:0/2563424674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08d009e170 0x7f08d0135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 >> 172.21.15.125:0/2563424674 conn(0x7f08d0099c40 msgr2=0x7f08d0139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 shutdown_connections 2023-10-03T10:12:55.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:55.972+0000 7f08d5c8d700 1 -- 172.21.15.125:0/2563424674 wait complete. 2023-10-03T10:12:55.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.008+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd304126030 con 0x7fd3040a0a70 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.009+0000 7fd2ebfff700 1 -- 172.21.15.125:0/2624760143 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2f402b020 con 0x7fd3040a0a70 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 msgr2=0x7fd304122a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd304122a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4016000 tx=0x7fd2f4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 shutdown_connections 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd304134120 0x7fd304123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3040a0a70 0x7fd304122a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 --2- 172.21.15.125:0/2624760143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3040a1380 0x7fd304122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 >> 172.21.15.125:0/2624760143 conn(0x7fd3040a6610 msgr2=0x7fd3040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 shutdown_connections 2023-10-03T10:12:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:56.011+0000 7fd3099c0700 1 -- 172.21.15.125:0/2624760143 wait complete. 2023-10-03T10:12:56.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:56.929 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:56.966 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:56.986 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:57.024 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:57.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.082+0000 7f00e1bbc700 1 Processor -- start 2023-10-03T10:12:57.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.082+0000 7f00e1bbc700 1 -- start start 2023-10-03T10:12:57.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00e1bbc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc12d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00e1bbc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00dc09a5a0 0x7f00dc138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00e1bbc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc09bb90 con 0x7f00dc099a60 2023-10-03T10:12:57.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00e1bbc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc09c210 con 0x7f00dc09a5a0 2023-10-03T10:12:57.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00e1bbc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09ced0 con 0x7f00dc12d380 2023-10-03T10:12:57.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00dc09a5a0 0x7f00dc138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00dc09a5a0 0x7f00dc138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47816/0 (socket says 172.21.15.125:47816) 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.083+0000 7f00dbfff700 1 -- 172.21.15.125:0/1621841187 learned_addr learned my addr 172.21.15.125:0/1621841187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00dbfff700 1 -- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 msgr2=0x7f00dc12d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00dbfff700 1 --2- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00dbfff700 1 -- 172.21.15.125:0/1621841187 >> v1:172.21.15.125:6789/0 conn(0x7f00dc099a60 legacy=0x7f00dc099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00dbfff700 1 -- 172.21.15.125:0/1621841187 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc09ac30 con 0x7f00dc09a5a0 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00da7fc700 1 -- 172.21.15.125:0/1621841187 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187706996 0 0) 0x7f00dc09bb90 con 0x7f00dc099a60 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00dbfff700 1 --2- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc09a5a0 0x7f00dc138620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e50 tx=0x7f00d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c339c0a8fc51ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00da7fc700 1 -- 172.21.15.125:0/1621841187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400e070 con 0x7f00dc09a5a0 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00da7fc700 1 -- 172.21.15.125:0/1621841187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400b9c0 con 0x7f00dc09a5a0 2023-10-03T10:12:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.084+0000 7f00da7fc700 1 -- 172.21.15.125:0/1621841187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400bd70 con 0x7f00dc09a5a0 2023-10-03T10:12:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 -- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc09a5a0 msgr2=0x7f00dc138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc09a5a0 0x7f00dc138620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e50 tx=0x7f00d400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 -- 172.21.15.125:0/1621841187 shutdown_connections 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc09a5a0 0x7f00dc138620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/1621841187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc12d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 -- 172.21.15.125:0/1621841187 >> 172.21.15.125:0/1621841187 conn(0x7f00dc0a2980 msgr2=0x7f00dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 -- 172.21.15.125:0/1621841187 shutdown_connections 2023-10-03T10:12:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.085+0000 7f00e1bbc700 1 -- 172.21.15.125:0/1621841187 wait complete. 2023-10-03T10:12:57.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 Processor -- start 2023-10-03T10:12:57.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 -- start start 2023-10-03T10:12:57.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00dc09a5a0 0x7f00dc1c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc1c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1348d0 con 0x7f00dc099a60 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1346e0 con 0x7f00dc12d380 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.087+0000 7f00e1bbc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc133f80 con 0x7f00dc09a5a0 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47824/0 (socket says 172.21.15.125:47824) 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00db7fe700 1 -- 172.21.15.125:0/3269887268 learned_addr learned my addr 172.21.15.125:0/3269887268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc1c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00daffd700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00dc09a5a0 0x7f00dc1c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 -- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00dc09a5a0 msgr2=0x7f00dc1c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00dc09a5a0 0x7f00dc1c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 -- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 msgr2=0x7f00dc1c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 -- 172.21.15.125:0/3269887268 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009b30 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00db7fe700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.088+0000 7f00dbfff700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc1c4ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00d4015000 tx=0x7f00d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.089+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40048c0 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.089+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc1c9090 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.089+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc135930 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.089+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40092e0 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.089+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d401c680 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.090+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc135ec0 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.090+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00d401c7e0 con 0x7f00dc12d380 2023-10-03T10:12:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.090+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00d4040f40 con 0x7f00dc12d380 2023-10-03T10:12:57.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.095+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00d40247c0 con 0x7f00dc12d380 2023-10-03T10:12:57.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.126+0000 7fa0a99a6700 1 Processor -- start 2023-10-03T10:12:57.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.126+0000 7fa0a99a6700 1 -- start start 2023-10-03T10:12:57.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.126+0000 7fa0a99a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a99a6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa0a413dd10 0x7fa0a41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a99a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a41379e0 con 0x7fa0a4138040 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a99a6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a40a2100 con 0x7fa0a413dd10 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a99a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a409b9b0 con 0x7fa0a4138410 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46542/0 (socket says 172.21.15.125:46542) 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 -- 172.21.15.125:0/2437973778 learned_addr learned my addr 172.21.15.125:0/2437973778 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a37fe700 1 --2- 172.21.15.125:0/2437973778 >> v2:172.21.15.125:3300/0 conn(0x7fa0a413dd10 0x7fa0a41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 -- 172.21.15.125:0/2437973778 >> v2:172.21.15.125:3300/0 conn(0x7fa0a413dd10 msgr2=0x7fa0a41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 --2- 172.21.15.125:0/2437973778 >> v2:172.21.15.125:3300/0 conn(0x7fa0a413dd10 0x7fa0a41400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 -- 172.21.15.125:0/2437973778 >> v1:172.21.15.125:6789/0 conn(0x7fa0a4138040 legacy=0x7fa0a40a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 -- 172.21.15.125:0/2437973778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4137c10 con 0x7fa0a4138410 2023-10-03T10:12:57.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.127+0000 7fa0a27fc700 1 --2- 172.21.15.125:0/2437973778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa098009920 tx=0x7fa098009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2267b3b282eeefb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a1ffb700 1 -- 172.21.15.125:0/2437973778 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011830 con 0x7fa0a4138410 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a1ffb700 1 -- 172.21.15.125:0/2437973778 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa098011990 con 0x7fa0a4138410 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a1ffb700 1 -- 172.21.15.125:0/2437973778 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011d20 con 0x7fa0a4138410 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 -- 172.21.15.125:0/2437973778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 msgr2=0x7fa0a40a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/2437973778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa098009920 tx=0x7fa098009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 -- 172.21.15.125:0/2437973778 shutdown_connections 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/2437973778 >> v2:172.21.15.125:3300/0 conn(0x7fa0a413dd10 0x7fa0a41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/2437973778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a4138410 0x7fa0a40a0ff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 -- 172.21.15.125:0/2437973778 >> 172.21.15.125:0/2437973778 conn(0x7fa0a40a2980 msgr2=0x7fa0a40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 -- 172.21.15.125:0/2437973778 shutdown_connections 2023-10-03T10:12:57.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.128+0000 7fa0a99a6700 1 -- 172.21.15.125:0/2437973778 wait complete. 2023-10-03T10:12:57.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.130+0000 7fa0a99a6700 1 Processor -- start 2023-10-03T10:12:57.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.130+0000 7fa0a99a6700 1 -- start start 2023-10-03T10:12:57.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0a4138040 0x7fa0a4136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a413dd10 0x7fa0a4135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a412fea0 con 0x7fa0a4138410 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a413c190 con 0x7fa0a4138040 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a99a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a413d260 con 0x7fa0a413dd10 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47842/0 (socket says 172.21.15.125:47842) 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 -- 172.21.15.125:0/1588053753 learned_addr learned my addr 172.21.15.125:0/1588053753 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a37fe700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a413dd10 0x7fa0a4135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a2ffd700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0a4138040 0x7fa0a4136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 -- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a413dd10 msgr2=0x7fa0a4135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a413dd10 0x7fa0a4135740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 -- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0a4138040 msgr2=0x7fa0a4136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0a4138040 0x7fa0a4136f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.131+0000 7fa0a27fc700 1 -- 172.21.15.125:0/1588053753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098009550 con 0x7fa0a4138410 2023-10-03T10:12:57.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa0a27fc700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa098009870 tx=0x7fa098004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098004300 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09801f070 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a409a240 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980036a0 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.132+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a409e9d0 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.133+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a413da40 con 0x7fa0a4138410 2023-10-03T10:12:57.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.134+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa098021030 con 0x7fa0a4138410 2023-10-03T10:12:57.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.134+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0980417f0 con 0x7fa0a4138410 2023-10-03T10:12:57.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.143+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0980239c0 con 0x7fa0a4138410 2023-10-03T10:12:57.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.165+0000 7ffb6424b700 1 Processor -- start 2023-10-03T10:12:57.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.165+0000 7ffb6424b700 1 -- start start 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 0x7ffb5c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c06b2d0 con 0x7ffb5c1309f0 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c133610 con 0x7ffb5c133ad0 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb6424b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c09a500 con 0x7ffb5c1300a0 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.166+0000 7ffb617e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb627e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 0x7ffb5c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb617e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46554/0 (socket says 172.21.15.125:46554) 2023-10-03T10:12:57.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb617e6700 1 -- 172.21.15.125:0/648283742 learned_addr learned my addr 172.21.15.125:0/648283742 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 -- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 msgr2=0x7ffb5c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 -- 172.21.15.125:0/648283742 >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 msgr2=0x7ffb5c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/648283742 >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 0x7ffb5c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 -- 172.21.15.125:0/648283742 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c1338b0 con 0x7ffb5c133ad0 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb617e6700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb627e8700 1 --2- 172.21.15.125:0/648283742 >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 0x7ffb5c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c133ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009840 tx=0x7ffb58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f55351b88d0cb04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb60fe5700 1 -- 172.21.15.125:0/648283742 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58011830 con 0x7ffb5c133ad0 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb60fe5700 1 -- 172.21.15.125:0/648283742 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58011990 con 0x7ffb5c133ad0 2023-10-03T10:12:57.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.167+0000 7ffb60fe5700 1 -- 172.21.15.125:0/648283742 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58011d20 con 0x7ffb5c133ad0 2023-10-03T10:12:57.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 -- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 msgr2=0x7ffb5c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c133ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009840 tx=0x7ffb58009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:57.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 -- 172.21.15.125:0/648283742 shutdown_connections 2023-10-03T10:12:57.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c133ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 --2- 172.21.15.125:0/648283742 >> v2:172.21.15.125:3300/0 conn(0x7ffb5c1309f0 0x7ffb5c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 --2- 172.21.15.125:0/648283742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1300a0 0x7ffb5c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 -- 172.21.15.125:0/648283742 >> 172.21.15.125:0/648283742 conn(0x7ffb5c099c40 msgr2=0x7ffb5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 -- 172.21.15.125:0/648283742 shutdown_connections 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.168+0000 7ffb6424b700 1 -- 172.21.15.125:0/648283742 wait complete. 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 Processor -- start 2023-10-03T10:12:57.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 -- start start 2023-10-03T10:12:57.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1309f0 0x7ffb5c1cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c1cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c11cef0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c11d4c0 con 0x7ffb5c133ad0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb6424b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c11d090 con 0x7ffb5c1309f0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb61fe7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.170+0000 7ffb61fe7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47858/0 (socket says 172.21.15.125:47858) 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 -- 172.21.15.125:0/3035751534 learned_addr learned my addr 172.21.15.125:0/3035751534 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb627e8700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c1cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb617e6700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1309f0 0x7ffb5c1cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 -- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1309f0 msgr2=0x7ffb5c1cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1309f0 0x7ffb5c1cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 -- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 msgr2=0x7ffb5c1cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c1cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 -- 172.21.15.125:0/3035751534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c009550 con 0x7ffb5c1300a0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb627e8700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c1cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb61fe7700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009b90 tx=0x7ffb58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58004450 con 0x7ffb5c1300a0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580045b0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54009a70 con 0x7ffb5c1300a0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580038c0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.171+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb580094a0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.173+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c04f2a0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.173+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb58003a20 con 0x7ffb5c1300a0 2023-10-03T10:12:57.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.174+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb58040900 con 0x7ffb5c1300a0 2023-10-03T10:12:57.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.178+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb5801a420 con 0x7ffb5c1300a0 2023-10-03T10:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.200+0000 7f7f0bc7f700 1 Processor -- start 2023-10-03T10:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.200+0000 7f7f0bc7f700 1 -- start start 2023-10-03T10:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0bc7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0bc7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0bc7f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040a1e70 con 0x7f7f040a1340 2023-10-03T10:12:57.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0bc7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409a720 con 0x7f7f040a0a30 2023-10-03T10:12:57.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0bc7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409b300 con 0x7f7f04130670 2023-10-03T10:12:57.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0921a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7f040a1340 0x7f7f0412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49384/0 (socket says 172.21.15.125:49384) 2023-10-03T10:12:57.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0921a700 1 -- 172.21.15.125:0/138744380 learned_addr learned my addr 172.21.15.125:0/138744380 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:57.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f09a1b700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f08a19700 1 -- 172.21.15.125:0/138744380 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102079834 0 0) 0x7f7f040a1e70 con 0x7f7f040a1340 2023-10-03T10:12:57.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f08a19700 1 -- 172.21.15.125:0/138744380 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef00079c0 con 0x7f7f040a1340 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0a21c700 1 -- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 msgr2=0x7f7f040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0a21c700 1 -- 172.21.15.125:0/138744380 >> v1:172.21.15.125:6789/0 conn(0x7f7f040a1340 legacy=0x7f7f0412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.201+0000 7f7f0a21c700 1 -- 172.21.15.125:0/138744380 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0409abc0 con 0x7f7f04130670 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041381c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009dc0 tx=0x7f7efc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58470bc7df9220f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f08a19700 1 -- 172.21.15.125:0/138744380 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00e070 con 0x7f7f04130670 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f08a19700 1 -- 172.21.15.125:0/138744380 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00bb20 con 0x7f7f04130670 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f08a19700 1 -- 172.21.15.125:0/138744380 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc012430 con 0x7f7f04130670 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 msgr2=0x7f7f041381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041381c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009dc0 tx=0x7f7efc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/138744380 shutdown_connections 2023-10-03T10:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041381c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/138744380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.202+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/138744380 >> 172.21.15.125:0/138744380 conn(0x7f7f040a2980 msgr2=0x7f7f040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.203+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/138744380 shutdown_connections 2023-10-03T10:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.203+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/138744380 wait complete. 2023-10-03T10:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.204+0000 7f7f0bc7f700 1 Processor -- start 2023-10-03T10:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.204+0000 7f7f0bc7f700 1 -- start start 2023-10-03T10:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f041c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0411d450 con 0x7f7f040a1340 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0411cd00 con 0x7f7f040a0a30 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0bc7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409faa0 con 0x7f7f04130670 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0921a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0921a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47864/0 (socket says 172.21.15.125:47864) 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0921a700 1 -- 172.21.15.125:0/3047318368 learned_addr learned my addr 172.21.15.125:0/3047318368 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f09a1b700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f041c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 -- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 msgr2=0x7f7f041c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f041c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 -- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 msgr2=0x7f7f041c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 -- 172.21.15.125:0/3047318368 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc009a70 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0921a700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.205+0000 7f7f0a21c700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041c46b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7efc016000 tx=0x7f7efc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.206+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc004800 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.206+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc020070 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.206+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0411e4f0 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.206+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0276c0 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.206+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0411f220 con 0x7f7f04130670 2023-10-03T10:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.207+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0409ae60 con 0x7f7f04130670 2023-10-03T10:12:57.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.207+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7efc012430 con 0x7f7f04130670 2023-10-03T10:12:57.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.207+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7efc022070 con 0x7f7f04130670 2023-10-03T10:12:57.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.211+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7efc012e40 con 0x7f7f04130670 2023-10-03T10:12:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.329+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f00dc04f2a0 con 0x7f00dc12d380 2023-10-03T10:12:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.329+0000 7f00c3fff700 1 -- 172.21.15.125:0/3269887268 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00d40243b0 con 0x7f00dc12d380 2023-10-03T10:12:57.330 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:57.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 msgr2=0x7f00dc1c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc1c4ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00d4015000 tx=0x7f00d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 shutdown_connections 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00dc12d380 0x7f00dc1c4ea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00dc099a60 0x7f00dc1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 --2- 172.21.15.125:0/3269887268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00dc09a5a0 0x7f00dc1c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.332+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 >> 172.21.15.125:0/3269887268 conn(0x7f00dc0a2980 msgr2=0x7f00dc130940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.333+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 shutdown_connections 2023-10-03T10:12:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.333+0000 7f00e1bbc700 1 -- 172.21.15.125:0/3269887268 wait complete. 2023-10-03T10:12:57.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.345+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa0a404f2a0 con 0x7fa0a4138410 2023-10-03T10:12:57.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.346+0000 7fa08bfff700 1 -- 172.21.15.125:0/1588053753 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa098015030 con 0x7fa0a4138410 2023-10-03T10:12:57.346 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.347+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 msgr2=0x7fa0a41374a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.347+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa098009870 tx=0x7fa098004750 comp rx=0 tx=0).stop 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 shutdown_connections 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0a413dd10 0x7fa0a4135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0a4138040 0x7fa0a4136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 --2- 172.21.15.125:0/1588053753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a4138410 0x7fa0a41374a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 >> 172.21.15.125:0/1588053753 conn(0x7fa0a40a2980 msgr2=0x7fa0a4140ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 shutdown_connections 2023-10-03T10:12:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.348+0000 7fa0a99a6700 1 -- 172.21.15.125:0/1588053753 wait complete. 2023-10-03T10:12:57.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:57.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:57.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.407+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f0404f2a0 con 0x7f7f04130670 2023-10-03T10:12:57.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.408+0000 7f7efa7fc700 1 -- 172.21.15.125:0/3047318368 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7efc02f3a0 con 0x7f7f04130670 2023-10-03T10:12:57.408 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:57.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.409+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb5c11afd0 con 0x7ffb5c1300a0 2023-10-03T10:12:57.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.409+0000 7ffb527fc700 1 -- 172.21.15.125:0/3035751534 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb58028070 con 0x7ffb5c1300a0 2023-10-03T10:12:57.410 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:57.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 msgr2=0x7f7f041c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041c46b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7efc016000 tx=0x7f7efc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 shutdown_connections 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f04130670 0x7f7f041c46b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a30 0x7f7f041c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 --2- 172.21.15.125:0/3047318368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a1340 0x7f7f041c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 >> 172.21.15.125:0/3047318368 conn(0x7f7f040a2980 msgr2=0x7f7f04070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 shutdown_connections 2023-10-03T10:12:57.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.410+0000 7f7f0bc7f700 1 -- 172.21.15.125:0/3047318368 wait complete. 2023-10-03T10:12:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 msgr2=0x7ffb5c1cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009b90 tx=0x7ffb58004750 comp rx=0 tx=0).stop 2023-10-03T10:12:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 shutdown_connections 2023-10-03T10:12:57.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb5c133ad0 0x7ffb5c1cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb5c1300a0 0x7ffb5c1cc790 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 --2- 172.21.15.125:0/3035751534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffb5c1309f0 0x7ffb5c1cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 >> 172.21.15.125:0/3035751534 conn(0x7ffb5c099c40 msgr2=0x7ffb5c12eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 shutdown_connections 2023-10-03T10:12:57.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:57.411+0000 7ffb6424b700 1 -- 172.21.15.125:0/3035751534 wait complete. 2023-10-03T10:12:57.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:57.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:58.351 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:58.361 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:58.424 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:58.425 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:58.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 Processor -- start 2023-10-03T10:12:58.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 -- start start 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b5409e170 0x7f4b541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5409aaa0 con 0x7f4b54130ce0 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5409f870 con 0x7f4b5409e170 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b59306700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5409b360 con 0x7f4b5409d860 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46578/0 (socket says 172.21.15.125:46578) 2023-10-03T10:12:58.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.488+0000 7f4b52ffd700 1 -- 172.21.15.125:0/691324661 learned_addr learned my addr 172.21.15.125:0/691324661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 --2- 172.21.15.125:0/691324661 >> v2:172.21.15.125:3300/0 conn(0x7f4b5409e170 0x7f4b541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 -- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 msgr2=0x7f4b5409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 --2- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 -- 172.21.15.125:0/691324661 >> v1:172.21.15.125:6789/0 conn(0x7f4b54130ce0 legacy=0x7f4b541379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 -- 172.21.15.125:0/691324661 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5409b620 con 0x7f4b5409e170 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b527fc700 1 --2- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b5409e170 0x7f4b541307a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009840 tx=0x7f4b48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37b84c9f6ab7bde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b51ffb700 1 -- 172.21.15.125:0/691324661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48004230 con 0x7f4b5409e170 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b51ffb700 1 -- 172.21.15.125:0/691324661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48004390 con 0x7f4b5409e170 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.489+0000 7f4b51ffb700 1 -- 172.21.15.125:0/691324661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480036a0 con 0x7f4b5409e170 2023-10-03T10:12:58.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 -- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b5409e170 msgr2=0x7f4b541307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 --2- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b5409e170 0x7f4b541307a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009840 tx=0x7f4b48009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 -- 172.21.15.125:0/691324661 shutdown_connections 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 --2- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 --2- 172.21.15.125:0/691324661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b5409e170 0x7f4b541307a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 -- 172.21.15.125:0/691324661 >> 172.21.15.125:0/691324661 conn(0x7f4b54099c40 msgr2=0x7f4b540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 -- 172.21.15.125:0/691324661 shutdown_connections 2023-10-03T10:12:58.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.490+0000 7f4b59306700 1 -- 172.21.15.125:0/691324661 wait complete. 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 Processor -- start 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 -- start start 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b5409e170 0x7f4b5411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 0x7f4b5411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541220b0 con 0x7f4b54130ce0 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541201a0 con 0x7f4b5409e170 2023-10-03T10:12:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.492+0000 7f4b59306700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54120750 con 0x7f4b5409d860 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46590/0 (socket says 172.21.15.125:46590) 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 -- 172.21.15.125:0/2992320757 learned_addr learned my addr 172.21.15.125:0/2992320757 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b537fe700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 0x7f4b5411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 -- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b5409e170 msgr2=0x7f4b5411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b5409e170 0x7f4b5411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 -- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 msgr2=0x7f4b5411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 0x7f4b5411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 -- 172.21.15.125:0/2992320757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480094a0 con 0x7f4b5409d860 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b537fe700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 0x7f4b5411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b52ffd700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b44012fc0 tx=0x7f4b440103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44010bb0 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44013040 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b540a20c0 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400de60 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.493+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5409c900 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.494+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b541228d0 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.495+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b44018480 con 0x7f4b5409d860 2023-10-03T10:12:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.495+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b44044b70 con 0x7f4b5409d860 2023-10-03T10:12:58.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.503+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b4402a750 con 0x7f4b5409d860 2023-10-03T10:12:58.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.528+0000 7f54e74da700 1 Processor -- start 2023-10-03T10:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 -- start start 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54e009d860 0x7f54e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e009aaa0 con 0x7f54e0130ce0 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e009f870 con 0x7f54e009d860 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e74da700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e009b360 con 0x7f54e009e170 2023-10-03T10:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e4a75700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.529+0000 7f54e4a75700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46602/0 (socket says 172.21.15.125:46602) 2023-10-03T10:12:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 -- 172.21.15.125:0/1407351773 learned_addr learned my addr 172.21.15.125:0/1407351773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e5276700 1 --2- 172.21.15.125:0/1407351773 >> v2:172.21.15.125:3300/0 conn(0x7f54e009d860 0x7f54e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 -- 172.21.15.125:0/1407351773 >> v2:172.21.15.125:3300/0 conn(0x7f54e009d860 msgr2=0x7f54e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 --2- 172.21.15.125:0/1407351773 >> v2:172.21.15.125:3300/0 conn(0x7f54e009d860 0x7f54e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 -- 172.21.15.125:0/1407351773 >> v1:172.21.15.125:6789/0 conn(0x7f54e0130ce0 legacy=0x7f54e01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 -- 172.21.15.125:0/1407351773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e009b620 con 0x7f54e009e170 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54e4a75700 1 --2- 172.21.15.125:0/1407351773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54d000bb90 tx=0x7f54d000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcff55ec4ac9aaeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54d7fff700 1 -- 172.21.15.125:0/1407351773 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000dd30 con 0x7f54e009e170 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54d7fff700 1 -- 172.21.15.125:0/1407351773 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d000de90 con 0x7f54e009e170 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.530+0000 7f54d7fff700 1 -- 172.21.15.125:0/1407351773 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0010690 con 0x7f54e009e170 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 -- 172.21.15.125:0/1407351773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 msgr2=0x7f54e01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 --2- 172.21.15.125:0/1407351773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54d000bb90 tx=0x7f54d000bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 -- 172.21.15.125:0/1407351773 shutdown_connections 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 --2- 172.21.15.125:0/1407351773 >> v2:172.21.15.125:3300/0 conn(0x7f54e009d860 0x7f54e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 --2- 172.21.15.125:0/1407351773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009e170 0x7f54e01307a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 -- 172.21.15.125:0/1407351773 >> 172.21.15.125:0/1407351773 conn(0x7f54e0099c40 msgr2=0x7f54e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 -- 172.21.15.125:0/1407351773 shutdown_connections 2023-10-03T10:12:58.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.531+0000 7f54e74da700 1 -- 172.21.15.125:0/1407351773 wait complete. 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 Processor -- start 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 -- start start 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 0x7f54e011e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0120890 con 0x7f54e009e170 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01203f0 con 0x7f54e0130ce0 2023-10-03T10:12:58.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.533+0000 7f54e74da700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0130630 con 0x7f54e009d860 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5276700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 0x7f54e011e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5a77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5276700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 0x7f54e011e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46616/0 (socket says 172.21.15.125:46616) 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5a77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39314/0 (socket says 172.21.15.125:39314) 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5276700 1 -- 172.21.15.125:0/520451692 learned_addr learned my addr 172.21.15.125:0/520451692 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47908/0 (socket says 172.21.15.125:47908) 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 -- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 msgr2=0x7f54e011e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 0x7f54e011e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 -- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 msgr2=0x7f54e011f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 -- 172.21.15.125:0/520451692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d000b7f0 con 0x7f54e009e170 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e5a77700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e4a75700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f54d0018000 tx=0x7f54d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d001f070 con 0x7f54e009e170 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e0121c50 con 0x7f54e009e170 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.534+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0003970 con 0x7f54e009e170 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.535+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0003d20 con 0x7f54e009e170 2023-10-03T10:12:58.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.535+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0120ad0 con 0x7f54e009e170 2023-10-03T10:12:58.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.536+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54d0024470 con 0x7f54e009e170 2023-10-03T10:12:58.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.536+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e004f2a0 con 0x7f54e009e170 2023-10-03T10:12:58.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.536+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54d00430a0 con 0x7f54e009e170 2023-10-03T10:12:58.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.545+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54d0074750 con 0x7f54e009e170 2023-10-03T10:12:58.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.583+0000 7f491099f700 1 Processor -- start 2023-10-03T10:12:58.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.583+0000 7f491099f700 1 -- start start 2023-10-03T10:12:58.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f491099f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f490c09e340 0x7f490c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f491099f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c135f20 0x7f490c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f491099f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c09aaa0 con 0x7f490c09d860 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f491099f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c09e730 con 0x7f490c09e340 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f491099f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f490c09f870 con 0x7f490c135f20 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f490c09e340 0x7f490c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f490a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f490c09d860 0x7f490c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49412/0 (socket says 172.21.15.125:49412) 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f490c09e340 0x7f490c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47916/0 (socket says 172.21.15.125:47916) 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f490a59c700 1 -- 172.21.15.125:0/1914944099 learned_addr learned my addr 172.21.15.125:0/1914944099 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:12:58.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f490ad9d700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c135f20 0x7f490c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 -- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c135f20 msgr2=0x7f490c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c135f20 0x7f490c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 -- 172.21.15.125:0/1914944099 >> v1:172.21.15.125:6789/0 conn(0x7f490c09d860 legacy=0x7f490c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.584+0000 7f4901d9b700 1 -- 172.21.15.125:0/1914944099 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c09b360 con 0x7f490c09e340 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f4901d9b700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c1359e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009840 tx=0x7f48f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94ac21270eeefd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f4909d9b700 1 -- 172.21.15.125:0/1914944099 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011830 con 0x7f490c09e340 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f4909d9b700 1 -- 172.21.15.125:0/1914944099 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4011990 con 0x7f490c09e340 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f4909d9b700 1 -- 172.21.15.125:0/1914944099 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011d20 con 0x7f490c09e340 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f491099f700 1 -- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 msgr2=0x7f490c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.585+0000 7f491099f700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c1359e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009840 tx=0x7f48f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 -- 172.21.15.125:0/1914944099 shutdown_connections 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c135f20 0x7f490c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 --2- 172.21.15.125:0/1914944099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c1359e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 -- 172.21.15.125:0/1914944099 >> 172.21.15.125:0/1914944099 conn(0x7f490c099c40 msgr2=0x7f490c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 -- 172.21.15.125:0/1914944099 shutdown_connections 2023-10-03T10:12:58.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f491099f700 1 -- 172.21.15.125:0/1914944099 wait complete. 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 Processor -- start 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 -- start start 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ee80a0ff0 0x7f8ee813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee809aa00 con 0x7f8ee8099a60 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.586+0000 7f8eee9e9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee809a080 con 0x7f8ee80a0ff0 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8eee9e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8133750 con 0x7f8ee8133b80 2023-10-03T10:12:58.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46638/0 (socket says 172.21.15.125:46638) 2023-10-03T10:12:58.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1462419327 learned_addr learned my addr 172.21.15.125:0/1462419327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f491099f700 1 Processor -- start 2023-10-03T10:12:58.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f491099f700 1 -- start start 2023-10-03T10:12:58.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1462419327 >> v2:172.21.15.125:3300/0 conn(0x7f8ee80a0ff0 msgr2=0x7f8ee813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 --2- 172.21.15.125:0/1462419327 >> v2:172.21.15.125:3300/0 conn(0x7f8ee80a0ff0 0x7f8ee813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1462419327 >> v1:172.21.15.125:6789/0 conn(0x7f8ee8099a60 legacy=0x7f8ee80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1462419327 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee809a760 con 0x7f8ee8133b80 2023-10-03T10:12:58.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee7fff700 1 --2- 172.21.15.125:0/1462419327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8006fd0 tx=0x7f8ed8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8685627d23f6c4a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee6ffd700 1 -- 172.21.15.125:0/1462419327 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8005e30 con 0x7f8ee8133b80 2023-10-03T10:12:58.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee6ffd700 1 -- 172.21.15.125:0/1462419327 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8006030 con 0x7f8ee8133b80 2023-10-03T10:12:58.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f8ee6ffd700 1 -- 172.21.15.125:0/1462419327 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80063c0 con 0x7f8ee8133b80 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f491099f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c09d860 0x7f490c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f491099f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.587+0000 7f491099f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f491099f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c12ff40 con 0x7f490c09e340 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f491099f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c11cd40 con 0x7f490c135f20 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f491099f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f490c11b220 con 0x7f490c09d860 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39322/0 (socket says 172.21.15.125:39322) 2023-10-03T10:12:58.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 -- 172.21.15.125:0/3529511012 learned_addr learned my addr 172.21.15.125:0/3529511012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 -- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c09d860 msgr2=0x7f490c119630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c09d860 0x7f490c119630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 -- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 msgr2=0x7f490c119b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c119b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 -- 172.21.15.125:0/3529511012 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40094a0 con 0x7f490c135f20 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f490ad9d700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f490400d2f0 tx=0x7f490400d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 -- 172.21.15.125:0/1462419327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 msgr2=0x7f8ee8133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/1462419327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8006fd0 tx=0x7f8ed8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904011680 con 0x7f490c135f20 2023-10-03T10:12:58.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49040117e0 con 0x7f490c135f20 2023-10-03T10:12:58.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 -- 172.21.15.125:0/1462419327 shutdown_connections 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/1462419327 >> v2:172.21.15.125:3300/0 conn(0x7f8ee80a0ff0 0x7f8ee813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/1462419327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee8133f50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 -- 172.21.15.125:0/1462419327 >> 172.21.15.125:0/1462419327 conn(0x7f8ee80a2980 msgr2=0x7f8ee80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 -- 172.21.15.125:0/1462419327 shutdown_connections 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f8eee9e9700 1 -- 172.21.15.125:0/1462419327 wait complete. 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c0a21f0 con 0x7f490c135f20 2023-10-03T10:12:58.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.588+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c11b8a0 con 0x7f490c135f20 2023-10-03T10:12:58.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.589+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c04f2a0 con 0x7f490c135f20 2023-10-03T10:12:58.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.589+0000 7f8eee9e9700 1 Processor -- start 2023-10-03T10:12:58.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.589+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904011b90 con 0x7f490c135f20 2023-10-03T10:12:58.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 -- start start 2023-10-03T10:12:58.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 0x7f8ee811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee811f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4904011cf0 con 0x7f490c135f20 2023-10-03T10:12:58.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4904040aa0 con 0x7f490c135f20 2023-10-03T10:12:58.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8122160 con 0x7f8ee8099a60 2023-10-03T10:12:58.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee812fff0 con 0x7f8ee80a0ff0 2023-10-03T10:12:58.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.590+0000 7f8eee9e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee812f770 con 0x7f8ee8133b80 2023-10-03T10:12:58.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47934/0 (socket says 172.21.15.125:47934) 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee7fff700 1 -- 172.21.15.125:0/2686218612 learned_addr learned my addr 172.21.15.125:0/2686218612 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee77fe700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 0x7f8ee811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee811f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 -- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 msgr2=0x7f8ee811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 0x7f8ee811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 -- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 msgr2=0x7f8ee811ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 -- 172.21.15.125:0/2686218612 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009500 con 0x7f8ee8133b80 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee7fff700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8ee77fe700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 0x7f8ee811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:58.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.591+0000 7f8eecf86700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee811f630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000be50 tx=0x7f8ee0009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.592+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000cc10 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.592+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000cd90 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.592+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee812fb30 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.592+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0014680 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.592+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee8122e20 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.593+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ee001d3b0 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.593+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ee0006e40 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.593+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee804f2a0 con 0x7f8ee8133b80 2023-10-03T10:12:58.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.597+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f490400f340 con 0x7f490c135f20 2023-10-03T10:12:58.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.602+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ee0019020 con 0x7f8ee8133b80 2023-10-03T10:12:58.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.709+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b5404f2a0 con 0x7f4b5409d860 2023-10-03T10:12:58.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.709+0000 7f4b3b7fe700 1 -- 172.21.15.125:0/2992320757 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b4402a390 con 0x7f4b5409d860 2023-10-03T10:12:58.710 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 msgr2=0x7f4b5411e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b44012fc0 tx=0x7f4b440103a0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 shutdown_connections 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b54130ce0 0x7f4b5411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b5409d860 0x7f4b5411e590 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 --2- 172.21.15.125:0/2992320757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b5409e170 0x7f4b5411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 >> 172.21.15.125:0/2992320757 conn(0x7f4b54099c40 msgr2=0x7f4b540a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 shutdown_connections 2023-10-03T10:12:58.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.711+0000 7f4b59306700 1 -- 172.21.15.125:0/2992320757 wait complete. 2023-10-03T10:12:58.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:12:58.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.788+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f490c06c3b0 con 0x7f490c135f20 2023-10-03T10:12:58.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.789+0000 7f49037fe700 1 -- 172.21.15.125:0/3529511012 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4904028070 con 0x7f490c135f20 2023-10-03T10:12:58.789 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:12:58.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 msgr2=0x7f490c11a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f490400d2f0 tx=0x7f490400d6b0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 shutdown_connections 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f490c135f20 0x7f490c11a0b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f490c09d860 0x7f490c119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 --2- 172.21.15.125:0/3529511012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f490c09e340 0x7f490c119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 >> 172.21.15.125:0/3529511012 conn(0x7f490c099c40 msgr2=0x7f490c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 shutdown_connections 2023-10-03T10:12:58.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.791+0000 7f491099f700 1 -- 172.21.15.125:0/3529511012 wait complete. 2023-10-03T10:12:58.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.802+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f54e006c3b0 con 0x7f54e009e170 2023-10-03T10:12:58.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.802+0000 7f54d5ffb700 1 -- 172.21.15.125:0/520451692 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54d0024720 con 0x7f54e009e170 2023-10-03T10:12:58.803 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:12:58.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.804+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 msgr2=0x7f54e011ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.804+0000 7f54e74da700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f54d0018000 tx=0x7f54d0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 shutdown_connections 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54e0130ce0 0x7f54e011f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54e009d860 0x7f54e011e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 --2- 172.21.15.125:0/520451692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54e009e170 0x7f54e011ec10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 >> 172.21.15.125:0/520451692 conn(0x7f54e0099c40 msgr2=0x7f54e00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 shutdown_connections 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.805+0000 7f54e74da700 1 -- 172.21.15.125:0/520451692 wait complete. 2023-10-03T10:12:58.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:12:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.835+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ee81225f0 con 0x7f8ee8133b80 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.835+0000 7f8ee4ff9700 1 -- 172.21.15.125:0/2686218612 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ee001c360 con 0x7f8ee8133b80 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:12:58.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 msgr2=0x7f8ee811f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee811f630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000be50 tx=0x7f8ee0009ed0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 shutdown_connections 2023-10-03T10:12:58.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ee8133b80 0x7f8ee811f630 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ee8099a60 0x7f8ee811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 --2- 172.21.15.125:0/2686218612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ee80a0ff0 0x7f8ee811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.837+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 >> 172.21.15.125:0/2686218612 conn(0x7f8ee80a2980 msgr2=0x7f8ee8132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.838+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 shutdown_connections 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:58.838+0000 7f8eee9e9700 1 -- 172.21.15.125:0/2686218612 wait complete. 2023-10-03T10:12:58.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:12:59.729 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:59.804 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:59.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:59.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.878+0000 7f73608e0700 1 Processor -- start 2023-10-03T10:12:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.879+0000 7f73608e0700 1 -- start start 2023-10-03T10:12:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.879+0000 7f73608e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.879+0000 7f73608e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c135f20 0x7f735c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f73608e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c09aaa0 con 0x7f735c09d860 2023-10-03T10:12:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f73608e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c09e730 con 0x7f735c135f20 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f73608e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735c09f870 con 0x7f735c09e340 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46656/0 (socket says 172.21.15.125:46656) 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 -- 172.21.15.125:0/4183124448 learned_addr learned my addr 172.21.15.125:0/4183124448 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f735ad9d700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c135f20 0x7f735c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 -- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c135f20 msgr2=0x7f735c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c135f20 0x7f735c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 -- 172.21.15.125:0/4183124448 >> v1:172.21.15.125:6789/0 conn(0x7f735c09d860 legacy=0x7f735c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 -- 172.21.15.125:0/4183124448 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c09b360 con 0x7f735c09e340 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f735959a700 1 -- 172.21.15.125:0/4183124448 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916731919 0 0) 0x7f735c09aaa0 con 0x7f735c09d860 2023-10-03T10:12:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f7359d9b700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7350009950 tx=0x7f7350009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2260e4b785a332 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.880+0000 7f735959a700 1 -- 172.21.15.125:0/4183124448 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350009ea0 con 0x7f735c09e340 2023-10-03T10:12:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.881+0000 7f735959a700 1 -- 172.21.15.125:0/4183124448 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735000ba20 con 0x7f735c09e340 2023-10-03T10:12:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.881+0000 7f735959a700 1 -- 172.21.15.125:0/4183124448 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000bdb0 con 0x7f735c09e340 2023-10-03T10:12:59.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.881+0000 7f73608e0700 1 -- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 msgr2=0x7f735c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.881+0000 7f73608e0700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7350009950 tx=0x7f7350009c60 comp rx=0 tx=0).stop 2023-10-03T10:12:59.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 -- 172.21.15.125:0/4183124448 shutdown_connections 2023-10-03T10:12:59.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c135f20 0x7f735c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 --2- 172.21.15.125:0/4183124448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1359e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 -- 172.21.15.125:0/4183124448 >> 172.21.15.125:0/4183124448 conn(0x7f735c099c40 msgr2=0x7f735c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 -- 172.21.15.125:0/4183124448 shutdown_connections 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.882+0000 7f73608e0700 1 -- 172.21.15.125:0/4183124448 wait complete. 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 Processor -- start 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 -- start start 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735c135f20 0x7f735c1c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c11c8c0 con 0x7f735c135f20 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c135d90 con 0x7f735c09d860 2023-10-03T10:12:59.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f73608e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0a26f0 con 0x7f735c09e340 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f735a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f735a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39354/0 (socket says 172.21.15.125:39354) 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.883+0000 7f735a59c700 1 -- 172.21.15.125:0/4249613915 learned_addr learned my addr 172.21.15.125:0/4249613915 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f7359d9b700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735ad9d700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735c135f20 0x7f735c1c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 -- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 msgr2=0x7f735c1c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 -- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735c135f20 msgr2=0x7f735c1c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735c135f20 0x7f735c1c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 -- 172.21.15.125:0/4249613915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350009550 con 0x7f735c09d860 2023-10-03T10:12:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f735a59c700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f734c001eb0 tx=0x7f734c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0054e0 con 0x7f735c09d860 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c003680 con 0x7f735c09d860 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0039f0 con 0x7f735c09d860 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c11d850 con 0x7f735c09d860 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.884+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c11d020 con 0x7f735c09d860 2023-10-03T10:12:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.885+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f734c003b50 con 0x7f735c09d860 2023-10-03T10:12:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.886+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c04f2a0 con 0x7f735c09d860 2023-10-03T10:12:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.886+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f734c03eb90 con 0x7f735c09d860 2023-10-03T10:12:59.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.890+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f734c003e00 con 0x7f735c09d860 2023-10-03T10:12:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.967+0000 7f63e78ee700 1 Processor -- start 2023-10-03T10:12:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.967+0000 7f63e78ee700 1 -- start start 2023-10-03T10:12:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e78ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e78ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63e0137000 0x7f63e01393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e78ee700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00a1640 con 0x7f63e0131980 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e78ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e006eb30 con 0x7f63e0137000 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e78ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a22d0 con 0x7f63e01346e0 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46670/0 (socket says 172.21.15.125:46670) 2023-10-03T10:12:59.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 -- 172.21.15.125:0/1771183420 learned_addr learned my addr 172.21.15.125:0/1771183420 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e5e8b700 1 --2- 172.21.15.125:0/1771183420 >> v2:172.21.15.125:3300/0 conn(0x7f63e0137000 0x7f63e01393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 -- 172.21.15.125:0/1771183420 >> v2:172.21.15.125:3300/0 conn(0x7f63e0137000 msgr2=0x7f63e01393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 --2- 172.21.15.125:0/1771183420 >> v2:172.21.15.125:3300/0 conn(0x7f63e0137000 0x7f63e01393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 -- 172.21.15.125:0/1771183420 >> v1:172.21.15.125:6789/0 conn(0x7f63e0131980 legacy=0x7f63e0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 -- 172.21.15.125:0/1771183420 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0131550 con 0x7f63e01346e0 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.968+0000 7f63e4e89700 1 --2- 172.21.15.125:0/1771183420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009920 tx=0x7f63d0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad077e84da1c196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63d7fff700 1 -- 172.21.15.125:0/1771183420 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011830 con 0x7f63e01346e0 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63d7fff700 1 -- 172.21.15.125:0/1771183420 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0011990 con 0x7f63e01346e0 2023-10-03T10:12:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63d7fff700 1 -- 172.21.15.125:0/1771183420 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011d20 con 0x7f63e01346e0 2023-10-03T10:12:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 -- 172.21.15.125:0/1771183420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 msgr2=0x7f63e0136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 --2- 172.21.15.125:0/1771183420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009920 tx=0x7f63d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:59.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 -- 172.21.15.125:0/1771183420 shutdown_connections 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 --2- 172.21.15.125:0/1771183420 >> v2:172.21.15.125:3300/0 conn(0x7f63e0137000 0x7f63e01393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 --2- 172.21.15.125:0/1771183420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e01346e0 0x7f63e0136ac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 -- 172.21.15.125:0/1771183420 >> 172.21.15.125:0/1771183420 conn(0x7f63e00a2980 msgr2=0x7f63e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 -- 172.21.15.125:0/1771183420 shutdown_connections 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.969+0000 7f63e78ee700 1 -- 172.21.15.125:0/1771183420 wait complete. 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.970+0000 7f63e78ee700 1 Processor -- start 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.970+0000 7f63e78ee700 1 -- start start 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 0x7f63e0119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63e0137000 0x7f63e01c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e011b5b0 con 0x7f63e01346e0 2023-10-03T10:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a00f0 con 0x7f63e0137000 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e78ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a1c40 con 0x7f63e0131980 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46676/0 (socket says 172.21.15.125:46676) 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 -- 172.21.15.125:0/2581208625 learned_addr learned my addr 172.21.15.125:0/2581208625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e5e8b700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63e0137000 0x7f63e01c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e4e89700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 0x7f63e0119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 -- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63e0137000 msgr2=0x7f63e01c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63e0137000 0x7f63e01c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 -- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 msgr2=0x7f63e0119990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 0x7f63e0119990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 -- 172.21.15.125:0/2581208625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009550 con 0x7f63e0131980 2023-10-03T10:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e4e89700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 0x7f63e0119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.971+0000 7f63e568a700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c4d0 tx=0x7f63dc00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0054e0 con 0x7f63e0131980 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc003680 con 0x7f63e0131980 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e0119ed0 con 0x7f63e0131980 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc003a30 con 0x7f63e0131980 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e011a840 con 0x7f63e0131980 2023-10-03T10:12:59.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.972+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63dc003b90 con 0x7f63e0131980 2023-10-03T10:12:59.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.973+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63dc03eb00 con 0x7f63e0131980 2023-10-03T10:12:59.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.973+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e004f2a0 con 0x7f63e0131980 2023-10-03T10:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.978+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63dc017080 con 0x7f63e0131980 2023-10-03T10:12:59.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.986+0000 7f11d37c8700 1 Processor -- start 2023-10-03T10:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.986+0000 7f11d37c8700 1 -- start start 2023-10-03T10:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d37c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11cc099a60 0x7f11cc1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d37c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc138e30 0x7f11cc13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d37c8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc09aa00 con 0x7f11cc133b80 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d37c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11cc09a080 con 0x7f11cc099a60 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d37c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc133750 con 0x7f11cc138e30 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11cc099a60 0x7f11cc1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11cc099a60 0x7f11cc1388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47952/0 (socket says 172.21.15.125:47952) 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 -- 172.21.15.125:0/3561639132 learned_addr learned my addr 172.21.15.125:0/3561639132 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d1d65700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc138e30 0x7f11cc13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 -- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc138e30 msgr2=0x7f11cc13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc138e30 0x7f11cc13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 -- 172.21.15.125:0/3561639132 >> v1:172.21.15.125:6789/0 conn(0x7f11cc133b80 legacy=0x7f11cc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 -- 172.21.15.125:0/3561639132 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc09a760 con 0x7f11cc099a60 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.987+0000 7f11d0d63700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc099a60 0x7f11cc1388f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0098f0 tx=0x7f11bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7133ac842a66070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11c3fff700 1 -- 172.21.15.125:0/3561639132 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011830 con 0x7f11cc099a60 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11c3fff700 1 -- 172.21.15.125:0/3561639132 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc011990 con 0x7f11cc099a60 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11c3fff700 1 -- 172.21.15.125:0/3561639132 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011d20 con 0x7f11cc099a60 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 -- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc099a60 msgr2=0x7f11cc1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc099a60 0x7f11cc1388f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0098f0 tx=0x7f11bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 -- 172.21.15.125:0/3561639132 shutdown_connections 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc138e30 0x7f11cc13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 --2- 172.21.15.125:0/3561639132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc099a60 0x7f11cc1388f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 -- 172.21.15.125:0/3561639132 >> 172.21.15.125:0/3561639132 conn(0x7f11cc0a2980 msgr2=0x7f11cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 -- 172.21.15.125:0/3561639132 shutdown_connections 2023-10-03T10:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.988+0000 7f11d37c8700 1 -- 172.21.15.125:0/3561639132 wait complete. 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.989+0000 7f11d37c8700 1 Processor -- start 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.989+0000 7f11d37c8700 1 -- start start 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 0x7f11cc118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11cc138e30 0x7f11cc119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc11b1f0 con 0x7f11cc133b80 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc11c020 con 0x7f11cc099a60 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d37c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc138aa0 con 0x7f11cc138e30 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47966/0 (socket says 172.21.15.125:47966) 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 -- 172.21.15.125:0/1214702518 learned_addr learned my addr 172.21.15.125:0/1214702518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d1564700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 0x7f11cc118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 -- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11cc138e30 msgr2=0x7f11cc119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11cc138e30 0x7f11cc119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 -- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 msgr2=0x7f11cc118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 0x7f11cc118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 -- 172.21.15.125:0/1214702518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009550 con 0x7f11cc133b80 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d1564700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 0x7f11cc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.990+0000 7f11d0d63700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11bc014040 tx=0x7f11bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.991+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0036a0 con 0x7f11cc133b80 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.991+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc01e070 con 0x7f11cc133b80 2023-10-03T10:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.991+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc09a2c0 con 0x7f11cc133b80 2023-10-03T10:12:59.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.991+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc003a60 con 0x7f11cc133b80 2023-10-03T10:12:59.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.991+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc11b3d0 con 0x7f11cc133b80 2023-10-03T10:12:59.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.992+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc11b020 con 0x7f11cc133b80 2023-10-03T10:12:59.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.992+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11bc003bc0 con 0x7f11cc133b80 2023-10-03T10:12:59.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:12:59.992+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11bc040790 con 0x7f11cc133b80 2023-10-03T10:13:00.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.001+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11bc01a420 con 0x7f11cc133b80 2023-10-03T10:13:00.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.018+0000 7f040f0ba700 1 Processor -- start 2023-10-03T10:13:00.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 -- start start 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f040809f350 0x7f0408136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 0x7f04081395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040809c970 con 0x7f040809e870 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080a0920 con 0x7f040809f350 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.019+0000 7f040f0ba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f040809f9c0 con 0x7f04081371c0 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f040d657700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 0x7f04081395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f040ce56700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f040809e870 0x7f040809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49472/0 (socket says 172.21.15.125:49472) 2023-10-03T10:13:00.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f040ce56700 1 -- 172.21.15.125:0/507994542 learned_addr learned my addr 172.21.15.125:0/507994542 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:00.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 --2- 172.21.15.125:0/507994542 >> v2:172.21.15.125:3300/0 conn(0x7f040809f350 0x7f0408136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 -- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 msgr2=0x7f04081395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 0x7f04081395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 -- 172.21.15.125:0/507994542 >> v1:172.21.15.125:6789/0 conn(0x7f040809e870 legacy=0x7f040809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 -- 172.21.15.125:0/507994542 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040809bab0 con 0x7f040809f350 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f040d657700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 0x7f04081395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f0407fff700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f0408136c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009840 tx=0x7f03f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6380ac359d903d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f04077fe700 1 -- 172.21.15.125:0/507994542 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011830 con 0x7f040809f350 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f04077fe700 1 -- 172.21.15.125:0/507994542 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4011990 con 0x7f040809f350 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.020+0000 7f04077fe700 1 -- 172.21.15.125:0/507994542 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011d20 con 0x7f040809f350 2023-10-03T10:13:00.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 -- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 msgr2=0x7f0408136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f0408136c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009840 tx=0x7f03f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 -- 172.21.15.125:0/507994542 shutdown_connections 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04081371c0 0x7f04081395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 --2- 172.21.15.125:0/507994542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f0408136c80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 -- 172.21.15.125:0/507994542 >> 172.21.15.125:0/507994542 conn(0x7f04080a4430 msgr2=0x7f04080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 -- 172.21.15.125:0/507994542 shutdown_connections 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.021+0000 7f040f0ba700 1 -- 172.21.15.125:0/507994542 wait complete. 2023-10-03T10:13:00.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.023+0000 7f040f0ba700 1 Processor -- start 2023-10-03T10:13:00.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.023+0000 7f040f0ba700 1 -- start start 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f04081206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04081371c0 0x7f04081c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408123090 con 0x7f040809f350 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0408123570 con 0x7f04081371c0 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040f0ba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f040811fd10 con 0x7f040809e870 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46716/0 (socket says 172.21.15.125:46716) 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 -- 172.21.15.125:0/675195429 learned_addr learned my addr 172.21.15.125:0/675195429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f0407fff700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f04081206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040d657700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04081371c0 0x7f04081c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 -- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04081371c0 msgr2=0x7f04081c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04081371c0 0x7f04081c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 -- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 msgr2=0x7f04081206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f04081206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 -- 172.21.15.125:0/675195429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009a70 con 0x7f040809e870 2023-10-03T10:13:00.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.024+0000 7f040ce56700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c550 tx=0x7f03fc00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.025+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc005d70 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.025+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0070d0 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.025+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40094a0 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.025+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc007440 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.025+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408120c30 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.026+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03fc0075a0 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.026+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03fc040c90 con 0x7f040809e870 2023-10-03T10:13:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.026+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04081231d0 con 0x7f040809e870 2023-10-03T10:13:00.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.031+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04081231d0 con 0x7f040809e870 2023-10-03T10:13:00.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.126+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f735c09b580 con 0x7f735c09d860 2023-10-03T10:13:00.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.126+0000 7f734affd700 1 -- 172.21.15.125:0/4249613915 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f734c017070 con 0x7f735c09d860 2023-10-03T10:13:00.127 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.128+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 msgr2=0x7f735c1c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.128+0000 7f73608e0700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f734c001eb0 tx=0x7f734c00c800 comp rx=0 tx=0).stop 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 shutdown_connections 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735c135f20 0x7f735c1c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735c09d860 0x7f735c1c6390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 --2- 172.21.15.125:0/4249613915 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735c09e340 0x7f735c1c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 >> 172.21.15.125:0/4249613915 conn(0x7f735c099c40 msgr2=0x7f735c0a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 shutdown_connections 2023-10-03T10:13:00.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.129+0000 7f73608e0700 1 -- 172.21.15.125:0/4249613915 wait complete. 2023-10-03T10:13:00.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:00.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.177+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63e0072400 con 0x7f63e0131980 2023-10-03T10:13:00.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.177+0000 7f63d5ffb700 1 -- 172.21.15.125:0/2581208625 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63dc003e40 con 0x7f63e0131980 2023-10-03T10:13:00.178 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:00.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.179+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 msgr2=0x7f63e0119450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.179+0000 7f63e78ee700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c4d0 tx=0x7f63dc00c7e0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.179+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 shutdown_connections 2023-10-03T10:13:00.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.179+0000 7f63e78ee700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63e0137000 0x7f63e01c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.180+0000 7f63e78ee700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63e0131980 0x7f63e0119450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.180+0000 7f63e78ee700 1 --2- 172.21.15.125:0/2581208625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63e01346e0 0x7f63e0119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.180+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 >> 172.21.15.125:0/2581208625 conn(0x7f63e00a2980 msgr2=0x7f63e012e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.180+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 shutdown_connections 2023-10-03T10:13:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.180+0000 7f63e78ee700 1 -- 172.21.15.125:0/2581208625 wait complete. 2023-10-03T10:13:00.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.231+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11cc11a1f0 con 0x7f11cc133b80 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.231+0000 7f11c1ffb700 1 -- 172.21.15.125:0/1214702518 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11bc015030 con 0x7f11cc133b80 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 msgr2=0x7f11cc119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11bc014040 tx=0x7f11bc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 shutdown_connections 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11cc138e30 0x7f11cc119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11cc099a60 0x7f11cc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 --2- 172.21.15.125:0/1214702518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11cc133b80 0x7f11cc119330 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 >> 172.21.15.125:0/1214702518 conn(0x7f11cc0a2980 msgr2=0x7f11cc1314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 shutdown_connections 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.233+0000 7f11d37c8700 1 -- 172.21.15.125:0/1214702518 wait complete. 2023-10-03T10:13:00.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:00.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.250+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04081231d0 con 0x7f040809e870 2023-10-03T10:13:00.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.251+0000 7f04057fa700 1 -- 172.21.15.125:0/675195429 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04081231d0 con 0x7f040809e870 2023-10-03T10:13:00.251 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:00.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 msgr2=0x7f04081201b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c550 tx=0x7f03fc00c860 comp rx=0 tx=0).stop 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 shutdown_connections 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04081371c0 0x7f04081c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f040809e870 0x7f04081201b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 --2- 172.21.15.125:0/675195429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f040809f350 0x7f04081206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 >> 172.21.15.125:0/675195429 conn(0x7f04080a4430 msgr2=0x7f04080a2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 shutdown_connections 2023-10-03T10:13:00.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:00.253+0000 7f040f0ba700 1 -- 172.21.15.125:0/675195429 wait complete. 2023-10-03T10:13:00.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:01.142 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:01.193 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:01.246 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:01.266 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:01.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.279+0000 7f9b1351c700 1 Processor -- start 2023-10-03T10:13:01.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.279+0000 7f9b1351c700 1 -- start start 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b0c06a770 0x7f9b0c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c131a00 0x7f9b0c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c06b5c0 con 0x7f9b0c06a770 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c06e900 con 0x7f9b0c131a00 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b1351c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c09d180 con 0x7f9b0c09dec0 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46720/0 (socket says 172.21.15.125:46720) 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 -- 172.21.15.125:0/1955122258 learned_addr learned my addr 172.21.15.125:0/1955122258 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b112b8700 1 --2- 172.21.15.125:0/1955122258 >> v2:172.21.15.125:3300/0 conn(0x7f9b0c06a770 0x7f9b0c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b11ab9700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c131a00 0x7f9b0c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 -- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c131a00 msgr2=0x7f9b0c131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c131a00 0x7f9b0c131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 -- 172.21.15.125:0/1955122258 >> v2:172.21.15.125:3300/0 conn(0x7f9b0c06a770 msgr2=0x7f9b0c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 --2- 172.21.15.125:0/1955122258 >> v2:172.21.15.125:3300/0 conn(0x7f9b0c06a770 0x7f9b0c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.280+0000 7f9b10ab7700 1 -- 172.21.15.125:0/1955122258 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c09e780 con 0x7f9b0c09dec0 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.281+0000 7f9b10ab7700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0098f0 tx=0x7f9afc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d1eddcd96aaa3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.281+0000 7f9b03fff700 1 -- 172.21.15.125:0/1955122258 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc010a90 con 0x7f9b0c09dec0 2023-10-03T10:13:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.281+0000 7f9b03fff700 1 -- 172.21.15.125:0/1955122258 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc010bf0 con 0x7f9b0c09dec0 2023-10-03T10:13:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.281+0000 7f9b03fff700 1 -- 172.21.15.125:0/1955122258 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc018440 con 0x7f9b0c09dec0 2023-10-03T10:13:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 -- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 msgr2=0x7f9b0c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0098f0 tx=0x7f9afc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 -- 172.21.15.125:0/1955122258 shutdown_connections 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c131a00 0x7f9b0c131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 --2- 172.21.15.125:0/1955122258 >> v2:172.21.15.125:3300/0 conn(0x7f9b0c06a770 0x7f9b0c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 --2- 172.21.15.125:0/1955122258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c09dec0 0x7f9b0c06b080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 -- 172.21.15.125:0/1955122258 >> 172.21.15.125:0/1955122258 conn(0x7f9b0c099c40 msgr2=0x7f9b0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 -- 172.21.15.125:0/1955122258 shutdown_connections 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.282+0000 7f9b1351c700 1 -- 172.21.15.125:0/1955122258 wait complete. 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 Processor -- start 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 -- start start 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b0c09dec0 0x7f9b0c1c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c130f90 con 0x7f9b0c09dec0 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c071ce0 con 0x7f9b0c06a770 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b1351c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c11d230 con 0x7f9b0c131a00 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b112b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.283+0000 7f9b11ab9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b112b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39388/0 (socket says 172.21.15.125:39388) 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46730/0 (socket says 172.21.15.125:46730) 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b112b8700 1 -- 172.21.15.125:0/2835562962 learned_addr learned my addr 172.21.15.125:0/2835562962 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 -- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 msgr2=0x7f9b0c1c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 -- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b0c09dec0 msgr2=0x7f9b0c1c49e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b0c09dec0 0x7f9b0c1c49e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 -- 172.21.15.125:0/2835562962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc009550 con 0x7f9b0c131a00 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b112b8700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b11ab9700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009d90 tx=0x7f9b0400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04009c00 con 0x7f9b0c131a00 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400f040 con 0x7f9b0c131a00 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c11d4f0 con 0x7f9b0c131a00 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.284+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04014480 con 0x7f9b0c131a00 2023-10-03T10:13:01.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.285+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c11b960 con 0x7f9b0c131a00 2023-10-03T10:13:01.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.285+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b040145e0 con 0x7f9b0c131a00 2023-10-03T10:13:01.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.286+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b04040360 con 0x7f9b0c131a00 2023-10-03T10:13:01.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.286+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c04f2a0 con 0x7f9b0c131a00 2023-10-03T10:13:01.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.291+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b04018030 con 0x7f9b0c131a00 2023-10-03T10:13:01.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.335+0000 7f0797d8d700 1 Processor -- start 2023-10-03T10:13:01.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.335+0000 7f0797d8d700 1 -- start start 2023-10-03T10:13:01.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 0x7f0790138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f079013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900a2100 con 0x7f0790138040 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0790138950 con 0x7f07900a08e0 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0797d8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07901379e0 con 0x7f07900a1230 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0795b29700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 0x7f0790138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0795328700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0795b29700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 0x7f0790138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48004/0 (socket says 172.21.15.125:48004) 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0795328700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39390/0 (socket says 172.21.15.125:39390) 2023-10-03T10:13:01.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.336+0000 7f0795b29700 1 -- 172.21.15.125:0/2086513010 learned_addr learned my addr 172.21.15.125:0/2086513010 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f079632a700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f079013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 -- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 msgr2=0x7f079013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f079013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 -- 172.21.15.125:0/2086513010 >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 msgr2=0x7f0790138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 --2- 172.21.15.125:0/2086513010 >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 0x7f0790138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 -- 172.21.15.125:0/2086513010 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079009b9b0 con 0x7f07900a08e0 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f079632a700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f079013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0795328700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0780009870 tx=0x7f0780009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb749c7ddbcd8a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0794b27700 1 -- 172.21.15.125:0/2086513010 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780011830 con 0x7f07900a08e0 2023-10-03T10:13:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0794b27700 1 -- 172.21.15.125:0/2086513010 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780011990 con 0x7f07900a08e0 2023-10-03T10:13:01.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.337+0000 7f0794b27700 1 -- 172.21.15.125:0/2086513010 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780011d20 con 0x7f07900a08e0 2023-10-03T10:13:01.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 -- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 msgr2=0x7f07900a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0780009870 tx=0x7f0780009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:01.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 -- 172.21.15.125:0/2086513010 shutdown_connections 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f079013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 --2- 172.21.15.125:0/2086513010 >> v2:172.21.15.125:3300/0 conn(0x7f0790138040 0x7f0790138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 --2- 172.21.15.125:0/2086513010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f07900a0cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 -- 172.21.15.125:0/2086513010 >> 172.21.15.125:0/2086513010 conn(0x7f07900a2980 msgr2=0x7f07900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 -- 172.21.15.125:0/2086513010 shutdown_connections 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.338+0000 7f0797d8d700 1 -- 172.21.15.125:0/2086513010 wait complete. 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.339+0000 7f0797d8d700 1 Processor -- start 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.339+0000 7f0797d8d700 1 -- start start 2023-10-03T10:13:01.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f0790126880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 0x7f0790126dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0790129c20 con 0x7f0790138040 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0790129880 con 0x7f07900a08e0 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0797d8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0790129e20 con 0x7f07900a1230 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795b29700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795b29700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39402/0 (socket says 172.21.15.125:39402) 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795b29700 1 -- 172.21.15.125:0/1924019371 learned_addr learned my addr 172.21.15.125:0/1924019371 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 0x7f0790126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795328700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f0790126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 -- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 msgr2=0x7f0790126880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f0790126880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 -- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 msgr2=0x7f0790126340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 -- 172.21.15.125:0/1924019371 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800094a0 con 0x7f0790138040 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795b29700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f0795328700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f0790126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.340+0000 7f079632a700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 0x7f0790126dc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f079006d6b0 tx=0x7f078800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.341+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800ad10 con 0x7f0790138040 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.341+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0790137700 con 0x7f0790138040 2023-10-03T10:13:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.341+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800ae70 con 0x7f0790138040 2023-10-03T10:13:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.341+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800f6a0 con 0x7f0790138040 2023-10-03T10:13:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.341+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0790136e20 con 0x7f0790138040 2023-10-03T10:13:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.342+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0790129a80 con 0x7f0790138040 2023-10-03T10:13:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.342+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f078800b040 con 0x7f0790138040 2023-10-03T10:13:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.343+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f078803fae0 con 0x7f0790138040 2023-10-03T10:13:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.347+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0788016710 con 0x7f0790138040 2023-10-03T10:13:01.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.382+0000 7f81131f9700 1 Processor -- start 2023-10-03T10:13:01.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.382+0000 7f81131f9700 1 -- start start 2023-10-03T10:13:01.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f81131f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 0x7f810c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f81131f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f810c09edb0 0x7f810c09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f81131f9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c072b30 con 0x7f810c13c410 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f81131f9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c09a500 con 0x7f810c09edb0 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f81131f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c09f720 con 0x7f810c09a130 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8110f95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 0x7f810c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8111796700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f810c13c410 0x7f810c13e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49486/0 (socket says 172.21.15.125:49486) 2023-10-03T10:13:01.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8111796700 1 -- 172.21.15.125:0/2858170402 learned_addr learned my addr 172.21.15.125:0/2858170402 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8110f95700 1 -- 172.21.15.125:0/2858170402 >> v2:172.21.15.125:3300/0 conn(0x7f810c09edb0 msgr2=0x7f810c09f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8110f95700 1 --2- 172.21.15.125:0/2858170402 >> v2:172.21.15.125:3300/0 conn(0x7f810c09edb0 0x7f810c09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f8110f95700 1 -- 172.21.15.125:0/2858170402 >> v1:172.21.15.125:6789/0 conn(0x7f810c13c410 legacy=0x7f810c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.383+0000 7f810b7fe700 1 -- 172.21.15.125:0/2858170402 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942244663 0 0) 0x7f810c072b30 con 0x7f810c13c410 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f8110f95700 1 -- 172.21.15.125:0/2858170402 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c09fe00 con 0x7f810c09a130 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f8110f95700 1 --2- 172.21.15.125:0/2858170402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 0x7f810c09e870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f8100009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0169602754e6ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f810b7fe700 1 -- 172.21.15.125:0/2858170402 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100011830 con 0x7f810c09a130 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f810b7fe700 1 -- 172.21.15.125:0/2858170402 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100011990 con 0x7f810c09a130 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f810b7fe700 1 -- 172.21.15.125:0/2858170402 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100011d20 con 0x7f810c09a130 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f81131f9700 1 -- 172.21.15.125:0/2858170402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 msgr2=0x7f810c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.384+0000 7f81131f9700 1 --2- 172.21.15.125:0/2858170402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 0x7f810c09e870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f8100009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 -- 172.21.15.125:0/2858170402 shutdown_connections 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 --2- 172.21.15.125:0/2858170402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c09a130 0x7f810c09e870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 --2- 172.21.15.125:0/2858170402 >> v2:172.21.15.125:3300/0 conn(0x7f810c09edb0 0x7f810c09f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 -- 172.21.15.125:0/2858170402 >> 172.21.15.125:0/2858170402 conn(0x7f810c0a4430 msgr2=0x7f810c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 -- 172.21.15.125:0/2858170402 shutdown_connections 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 -- 172.21.15.125:0/2858170402 wait complete. 2023-10-03T10:13:01.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.385+0000 7f81131f9700 1 Processor -- start 2023-10-03T10:13:01.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 -- start start 2023-10-03T10:13:01.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f810c09a130 0x7f810c13bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 0x7f810c13a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 0x7f810c13abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c11ba90 con 0x7f810c09a130 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c11dde0 con 0x7f810c13c410 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f81131f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f810c11e250 con 0x7f810c09edb0 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f810bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 0x7f810c13a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f8111796700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 0x7f810c13abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f810bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 0x7f810c13a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46754/0 (socket says 172.21.15.125:46754) 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.386+0000 7f810bfff700 1 -- 172.21.15.125:0/338095122 learned_addr learned my addr 172.21.15.125:0/338095122 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8110f95700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f810c09a130 0x7f810c13bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 -- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 msgr2=0x7f810c13a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 0x7f810c13a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 -- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f810c09a130 msgr2=0x7f810c13bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f810c09a130 0x7f810c13bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 -- 172.21.15.125:0/338095122 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000094a0 con 0x7f810c13c410 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f8111796700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 0x7f810c13abd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f810c06d3a0 tx=0x7f810400cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400a9d0 con 0x7f810c13c410 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400ab50 con 0x7f810c13c410 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c11bdd0 con 0x7f810c13c410 2023-10-03T10:13:01.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040070d0 con 0x7f810c13c410 2023-10-03T10:13:01.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.387+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c136f70 con 0x7f810c13c410 2023-10-03T10:13:01.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.388+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8104007230 con 0x7f810c13c410 2023-10-03T10:13:01.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.388+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f810403f1a0 con 0x7f810c13c410 2023-10-03T10:13:01.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.388+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c136f10 con 0x7f810c13c410 2023-10-03T10:13:01.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.398+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8104018070 con 0x7f810c13c410 2023-10-03T10:13:01.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.417+0000 7f3c0e004700 1 Processor -- start 2023-10-03T10:13:01.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.417+0000 7f3c0e004700 1 -- start start 2023-10-03T10:13:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 0x7f3c0809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c08131dd0 0x7f3c08132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0809b6d0 con 0x7f3c0809e950 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0809afb0 con 0x7f3c0809f260 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c0e004700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080a0970 con 0x7f3c08131dd0 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c077fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 0x7f3c0809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39426/0 (socket says 172.21.15.125:39426) 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 -- 172.21.15.125:0/1583530405 learned_addr learned my addr 172.21.15.125:0/1583530405 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c07fff700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c08131dd0 0x7f3c08132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 -- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c08131dd0 msgr2=0x7f3c08132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c08131dd0 0x7f3c08132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 -- 172.21.15.125:0/1583530405 >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 msgr2=0x7f3c0809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 --2- 172.21.15.125:0/1583530405 >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 0x7f3c0809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c06ffd700 1 -- 172.21.15.125:0/1583530405 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080a0320 con 0x7f3c0809f260 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.418+0000 7f3c077fe700 1 --2- 172.21.15.125:0/1583530405 >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 0x7f3c0809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c06ffd700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0098f0 tx=0x7f3bfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f6a0544f590f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c067fc700 1 -- 172.21.15.125:0/1583530405 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011830 con 0x7f3c0809f260 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c067fc700 1 -- 172.21.15.125:0/1583530405 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc011990 con 0x7f3c0809f260 2023-10-03T10:13:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c067fc700 1 -- 172.21.15.125:0/1583530405 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011d20 con 0x7f3c0809f260 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c0e004700 1 -- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 msgr2=0x7f3c08131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.419+0000 7f3c0e004700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0098f0 tx=0x7f3bfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 -- 172.21.15.125:0/1583530405 shutdown_connections 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c08131dd0 0x7f3c08132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 --2- 172.21.15.125:0/1583530405 >> v2:172.21.15.125:3300/0 conn(0x7f3c0809e950 0x7f3c0809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 --2- 172.21.15.125:0/1583530405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c0809f260 0x7f3c08131890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 -- 172.21.15.125:0/1583530405 >> 172.21.15.125:0/1583530405 conn(0x7f3c080a0f70 msgr2=0x7f3c080a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 -- 172.21.15.125:0/1583530405 shutdown_connections 2023-10-03T10:13:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.420+0000 7f3c0e004700 1 -- 172.21.15.125:0/1583530405 wait complete. 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.421+0000 7f3c0e004700 1 Processor -- start 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.421+0000 7f3c0e004700 1 -- start start 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c0809e950 0x7f3c08127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 0x7f3c08127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08129bd0 con 0x7f3c0809f260 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0811dd10 con 0x7f3c08131dd0 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c0e004700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0811e210 con 0x7f3c0809e950 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c06ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 0x7f3c08127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39428/0 (socket says 172.21.15.125:39428) 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 -- 172.21.15.125:0/638193372 learned_addr learned my addr 172.21.15.125:0/638193372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c077fe700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c0809e950 0x7f3c08127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 -- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c0809e950 msgr2=0x7f3c08127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c0809e950 0x7f3c08127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 -- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 msgr2=0x7f3c08127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 0x7f3c08127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c07fff700 1 -- 172.21.15.125:0/638193372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009430 con 0x7f3c08131dd0 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.422+0000 7f3c06ffd700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 0x7f3c08127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3c07fff700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000efc0 tx=0x7f3c0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00009ea0 con 0x7f3c08131dd0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000f040 con 0x7f3c08131dd0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00014480 con 0x7f3c08131dd0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc009550 con 0x7f3c08131dd0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.423+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0812a560 con 0x7f3c08131dd0 2023-10-03T10:13:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.424+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c000145e0 con 0x7f3c08131dd0 2023-10-03T10:13:01.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.424+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3c0003ff30 con 0x7f3c08131dd0 2023-10-03T10:13:01.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.424+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0804f2a0 con 0x7f3c08131dd0 2023-10-03T10:13:01.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.433+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c00018070 con 0x7f3c08131dd0 2023-10-03T10:13:01.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.498+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b0c09e3a0 con 0x7f9b0c131a00 2023-10-03T10:13:01.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.498+0000 7f9b01ffb700 1 -- 172.21.15.125:0/2835562962 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b04007900 con 0x7f9b0c131a00 2023-10-03T10:13:01.498 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 msgr2=0x7f9b0c1c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009d90 tx=0x7f9b0400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 shutdown_connections 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b0c131a00 0x7f9b0c1c0980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b0c06a770 0x7f9b0c1c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 --2- 172.21.15.125:0/2835562962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b0c09dec0 0x7f9b0c1c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 >> 172.21.15.125:0/2835562962 conn(0x7f9b0c099c40 msgr2=0x7f9b0c12ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 shutdown_connections 2023-10-03T10:13:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.500+0000 7f9b1351c700 1 -- 172.21.15.125:0/2835562962 wait complete. 2023-10-03T10:13:01.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:01.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.556+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0790129a80 con 0x7f0790138040 2023-10-03T10:13:01.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.557+0000 7f07867fc700 1 -- 172.21.15.125:0/1924019371 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0790129a80 con 0x7f0790138040 2023-10-03T10:13:01.557 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 msgr2=0x7f0790126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 0x7f0790126dc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f079006d6b0 tx=0x7f078800cf10 comp rx=0 tx=0).stop 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 shutdown_connections 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0790138040 0x7f0790126dc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07900a08e0 0x7f0790126340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 --2- 172.21.15.125:0/1924019371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a1230 0x7f0790126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 >> 172.21.15.125:0/1924019371 conn(0x7f07900a2980 msgr2=0x7f079009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 shutdown_connections 2023-10-03T10:13:01.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.559+0000 7f0797d8d700 1 -- 172.21.15.125:0/1924019371 wait complete. 2023-10-03T10:13:01.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:01.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.636+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f810c04f2a0 con 0x7f810c13c410 2023-10-03T10:13:01.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.636+0000 7f81097fa700 1 -- 172.21.15.125:0/338095122 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f810401c3b0 con 0x7f810c13c410 2023-10-03T10:13:01.636 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:01.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 msgr2=0x7f810c13abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 0x7f810c13abd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f810c06d3a0 tx=0x7f810400cec0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 shutdown_connections 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f810c13c410 0x7f810c13abd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f810c09a130 0x7f810c13bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 --2- 172.21.15.125:0/338095122 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f810c09edb0 0x7f810c13a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 >> 172.21.15.125:0/338095122 conn(0x7f810c0a4430 msgr2=0x7f810c09b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 shutdown_connections 2023-10-03T10:13:01.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.638+0000 7f81131f9700 1 -- 172.21.15.125:0/338095122 wait complete. 2023-10-03T10:13:01.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.662+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c0809b8b0 con 0x7f3c08131dd0 2023-10-03T10:13:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.662+0000 7f3beffff700 1 -- 172.21.15.125:0/638193372 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c00018030 con 0x7f3c08131dd0 2023-10-03T10:13:01.663 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 msgr2=0x7f3c08127dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000efc0 tx=0x7f3c0000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 shutdown_connections 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c08131dd0 0x7f3c08127dc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c0809e950 0x7f3c08127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 --2- 172.21.15.125:0/638193372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c0809f260 0x7f3c08127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 >> 172.21.15.125:0/638193372 conn(0x7f3c080a0f70 msgr2=0x7f3c080a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 shutdown_connections 2023-10-03T10:13:01.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:01.664+0000 7f3c0e004700 1 -- 172.21.15.125:0/638193372 wait complete. 2023-10-03T10:13:01.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:02.514 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:02.595 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:02.651 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:02.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.723+0000 7fe5503f8700 1 Processor -- start 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.723+0000 7fe5503f8700 1 -- start start 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.723+0000 7f59753ad700 1 Processor -- start 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.723+0000 7f59753ad700 1 -- start start 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5970133ad0 0x7f5970133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59701309f0 0x7f597013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe5481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5481309f0 0x7fe54813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54806b2d0 con 0x7fe5481309f0 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe548133610 con 0x7fe548133ad0 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe5503f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54809a500 con 0x7fe5481300a0 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597006b2d0 con 0x7f59701309f0 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970133610 con 0x7f5970133ad0 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f59753ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f597009a500 con 0x7f59701300a0 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46798/0 (socket says 172.21.15.125:46798) 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 -- 172.21.15.125:0/3857153745 learned_addr learned my addr 172.21.15.125:0/3857153745 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596effd700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5970133ad0 0x7f5970133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596f7fe700 1 --2- 172.21.15.125:0/3857153745 >> v2:172.21.15.125:3300/0 conn(0x7f59701309f0 0x7f597013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39452/0 (socket says 172.21.15.125:39452) 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 -- 172.21.15.125:0/1744234664 learned_addr learned my addr 172.21.15.125:0/1744234664 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54d993700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe5481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e995700 1 --2- 172.21.15.125:0/1744234664 >> v2:172.21.15.125:3300/0 conn(0x7fe5481309f0 0x7fe54813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 -- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 msgr2=0x7fe5481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe5481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 -- 172.21.15.125:0/1744234664 >> v2:172.21.15.125:3300/0 conn(0x7fe5481309f0 msgr2=0x7fe54813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 --2- 172.21.15.125:0/1744234664 >> v2:172.21.15.125:3300/0 conn(0x7fe5481309f0 0x7fe54813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7fe54e194700 1 -- 172.21.15.125:0/1744234664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5481338b0 con 0x7fe548133ad0 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 -- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5970133ad0 msgr2=0x7f5970133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5970133ad0 0x7f5970133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 -- 172.21.15.125:0/3857153745 >> v2:172.21.15.125:3300/0 conn(0x7f59701309f0 msgr2=0x7f597013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 --2- 172.21.15.125:0/3857153745 >> v2:172.21.15.125:3300/0 conn(0x7f59701309f0 0x7f597013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.724+0000 7f596e7fc700 1 -- 172.21.15.125:0/3857153745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59701338b0 con 0x7f59701300a0 2023-10-03T10:13:03.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe54e194700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5440098f0 tx=0x7fe544009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923f27e317ad122c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7f596e7fc700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59640098f0 tx=0x7f5964009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2f88346473acf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe54d192700 1 -- 172.21.15.125:0/1744234664 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011830 con 0x7fe548133ad0 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe54d192700 1 -- 172.21.15.125:0/1744234664 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544011990 con 0x7fe548133ad0 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe54d192700 1 -- 172.21.15.125:0/1744234664 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011d20 con 0x7fe548133ad0 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7f596dffb700 1 -- 172.21.15.125:0/3857153745 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964011830 con 0x7f59701300a0 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7f596dffb700 1 -- 172.21.15.125:0/3857153745 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964011990 con 0x7f59701300a0 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7f596dffb700 1 -- 172.21.15.125:0/3857153745 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964011d20 con 0x7f59701300a0 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe5503f8700 1 -- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 msgr2=0x7fe548133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.725+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5440098f0 tx=0x7fe544009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 -- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 msgr2=0x7f59701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59640098f0 tx=0x7f5964009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 -- 172.21.15.125:0/1744234664 shutdown_connections 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe548133ea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1744234664 >> v2:172.21.15.125:3300/0 conn(0x7fe5481309f0 0x7fe54813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1744234664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe5481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 -- 172.21.15.125:0/1744234664 >> 172.21.15.125:0/1744234664 conn(0x7fe548099c40 msgr2=0x7fe5480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 -- 172.21.15.125:0/3857153745 shutdown_connections 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5970133ad0 0x7f5970133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 --2- 172.21.15.125:0/3857153745 >> v2:172.21.15.125:3300/0 conn(0x7f59701309f0 0x7f597013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 --2- 172.21.15.125:0/3857153745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59701300a0 0x7f59701304b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 -- 172.21.15.125:0/3857153745 >> 172.21.15.125:0/3857153745 conn(0x7f5970099c40 msgr2=0x7f59700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 -- 172.21.15.125:0/1744234664 shutdown_connections 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 -- 172.21.15.125:0/3857153745 shutdown_connections 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7f59753ad700 1 -- 172.21.15.125:0/3857153745 wait complete. 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.726+0000 7fe5503f8700 1 -- 172.21.15.125:0/1744234664 wait complete. 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 Processor -- start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 -- start start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 Processor -- start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 -- start start 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe54811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 0x7fe54811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe54811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54811fb90 con 0x7fe5481309f0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54812da50 con 0x7fe548133ad0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe5503f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe548072180 con 0x7fe5481300a0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe54e194700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe54811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe54e194700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe54811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46824/0 (socket says 172.21.15.125:46824) 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe54e194700 1 -- 172.21.15.125:0/1496776804 learned_addr learned my addr 172.21.15.125:0/1496776804 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe54e995700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe54811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59701309f0 0x7f597011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5970133ad0 0x7f597011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597011fe50 con 0x7f59701309f0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970120130 con 0x7f59701300a0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f59753ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59700a2ea0 con 0x7f5970133ad0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f596effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59701309f0 0x7f597011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f596effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39470/0 (socket says 172.21.15.125:39470) 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7f596effd700 1 -- 172.21.15.125:0/4251347763 learned_addr learned my addr 172.21.15.125:0/4251347763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.727+0000 7fe54d993700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 0x7fe54811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 -- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 msgr2=0x7fe54811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe54811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 -- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 msgr2=0x7fe54811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe54811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 -- 172.21.15.125:0/1496776804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544009550 con 0x7fe5481309f0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54e995700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe54811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596f7fe700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5970133ad0 0x7f597011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 -- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5970133ad0 msgr2=0x7f597011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5970133ad0 0x7f597011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 -- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59701309f0 msgr2=0x7f597011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59701309f0 0x7f597011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 -- 172.21.15.125:0/4251347763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964009550 con 0x7f59701300a0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f596effd700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f596000e9b0 tx=0x7f596000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe54d993700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 0x7fe54811df80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e840 tx=0x7fe53800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960009710 con 0x7f59701300a0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538013680 con 0x7fe5481309f0 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000ee50 con 0x7f59701300a0 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597012dd00 con 0x7f59701300a0 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380137e0 con 0x7fe5481309f0 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54811fe50 con 0x7fe5481309f0 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000ca50 con 0x7f59701300a0 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597011f8c0 con 0x7f59701300a0 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538013b50 con 0x7fe5481309f0 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.728+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480a2ef0 con 0x7fe5481309f0 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.729+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f596000cbb0 con 0x7f59701300a0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.729+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f596003fb00 con 0x7f59701300a0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.729+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597009cb20 con 0x7f59701300a0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.730+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe538013cb0 con 0x7fe5481309f0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.730+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5300052e0 con 0x7fe5481309f0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.730+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe538047350 con 0x7fe5481309f0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.738+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f596001b3b0 con 0x7f59701300a0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.738+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe538044060 con 0x7fe5481309f0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.930+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f597011fcb0 con 0x7f59701300a0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.930+0000 7f59577fe700 1 -- 172.21.15.125:0/4251347763 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f597011fcb0 con 0x7f59701300a0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 msgr2=0x7f597011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f596000e9b0 tx=0x7f596000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 shutdown_connections 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5970133ad0 0x7f597011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59701300a0 0x7f597011da40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 --2- 172.21.15.125:0/4251347763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59701309f0 0x7f597011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 >> 172.21.15.125:0/4251347763 conn(0x7f5970099c40 msgr2=0x7f597012f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 shutdown_connections 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.932+0000 7f59753ad700 1 -- 172.21.15.125:0/4251347763 wait complete. 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.933+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe530005590 con 0x7fe5481309f0 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.933+0000 7fe53effd700 1 -- 172.21.15.125:0/1496776804 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe538017020 con 0x7fe5481309f0 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.936+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 msgr2=0x7fe54811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 0x7fe54811df80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e840 tx=0x7fe53800eb50 comp rx=0 tx=0).stop 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 shutdown_connections 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe548133ad0 0x7fe54811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5481300a0 0x7fe54811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 --2- 172.21.15.125:0/1496776804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5481309f0 0x7fe54811df80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 >> 172.21.15.125:0/1496776804 conn(0x7fe548099c40 msgr2=0x7fe5481321b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 shutdown_connections 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:02.937+0000 7fe5503f8700 1 -- 172.21.15.125:0/1496776804 wait complete. 2023-10-03T10:13:03.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:03.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:03.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 Processor -- start 2023-10-03T10:13:03.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 -- start start 2023-10-03T10:13:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f4d5625d700 1 Processor -- start 2023-10-03T10:13:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f4d5625d700 1 -- start start 2023-10-03T10:13:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 0x7f6f840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f4d5625d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d500a0a70 0x7f4d500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f84134120 0x7f6f8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8409dc00 con 0x7f6f840a1380 2023-10-03T10:13:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8409ea60 con 0x7f6f84134120 2023-10-03T10:13:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f6f8c35b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8409dec0 con 0x7f6f840a0a70 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f4d5625d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 0x7f4d5013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.217+0000 7f4d5625d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5009dc00 con 0x7f4d500a1380 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d5625d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5009ea90 con 0x7f4d500a0a70 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d5625d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5009dec0 con 0x7f4d50134120 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4d500a1380 0x7f4d50133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49498/0 (socket says 172.21.15.125:49498) 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4effd700 1 -- 172.21.15.125:0/4130128323 learned_addr learned my addr 172.21.15.125:0/4130128323 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a0f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 0x7f6f840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f84134120 0x7f6f8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a0f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 0x7f6f840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46854/0 (socket says 172.21.15.125:46854) 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a0f7700 1 -- 172.21.15.125:0/3867147770 learned_addr learned my addr 172.21.15.125:0/3867147770 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4f7fe700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d500a0a70 0x7f4d500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 0x7f4d5013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4e7fc700 1 -- 172.21.15.125:0/4130128323 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519976993 0 0) 0x7f4d5009dc00 con 0x7f4d500a1380 2023-10-03T10:13:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4e7fc700 1 -- 172.21.15.125:0/4130128323 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d380035b0 con 0x7f4d500a1380 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 -- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 msgr2=0x7f6f840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 --2- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 0x7f6f840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 -- 172.21.15.125:0/3867147770 >> v1:172.21.15.125:6789/0 conn(0x7f6f840a1380 legacy=0x7f6f84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 -- 172.21.15.125:0/3867147770 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8409e6a0 con 0x7f6f84134120 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 -- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d500a0a70 msgr2=0x7f4d500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d500a0a70 0x7f4d500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 -- 172.21.15.125:0/4130128323 >> v1:172.21.15.125:6789/0 conn(0x7f4d500a1380 legacy=0x7f4d50133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 -- 172.21.15.125:0/4130128323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5009e6a0 con 0x7f4d50134120 2023-10-03T10:13:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f8a8f8700 1 --2- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f84134120 0x7f6f8413bce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009d90 tx=0x7f6f7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815cef20733ccf7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f4d4ffff700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 0x7f4d5013bce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6755df0acff68ac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.218+0000 7f6f890f5700 1 -- 172.21.15.125:0/3867147770 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00e070 con 0x7f6f84134120 2023-10-03T10:13:03.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d4e7fc700 1 -- 172.21.15.125:0/4130128323 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800e070 con 0x7f4d50134120 2023-10-03T10:13:03.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f890f5700 1 -- 172.21.15.125:0/3867147770 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00bb20 con 0x7f6f84134120 2023-10-03T10:13:03.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f890f5700 1 -- 172.21.15.125:0/3867147770 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c012430 con 0x7f6f84134120 2023-10-03T10:13:03.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d4e7fc700 1 -- 172.21.15.125:0/4130128323 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800bb20 con 0x7f4d50134120 2023-10-03T10:13:03.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d4e7fc700 1 -- 172.21.15.125:0/4130128323 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48012430 con 0x7f4d50134120 2023-10-03T10:13:03.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 -- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 msgr2=0x7f4d5013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 -- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f84134120 msgr2=0x7f6f8413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f84134120 0x7f6f8413bce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009d90 tx=0x7f6f7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 0x7f4d5013bce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 -- 172.21.15.125:0/3867147770 shutdown_connections 2023-10-03T10:13:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f84134120 0x7f6f8413bce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/3867147770 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f840a0a70 0x7f6f840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 -- 172.21.15.125:0/3867147770 >> 172.21.15.125:0/3867147770 conn(0x7f6f840a6610 msgr2=0x7f6f840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 -- 172.21.15.125:0/4130128323 shutdown_connections 2023-10-03T10:13:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d50134120 0x7f4d5013bce0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 --2- 172.21.15.125:0/4130128323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d500a0a70 0x7f4d500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 -- 172.21.15.125:0/4130128323 >> 172.21.15.125:0/4130128323 conn(0x7f4d500a6610 msgr2=0x7f4d500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 -- 172.21.15.125:0/3867147770 shutdown_connections 2023-10-03T10:13:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f6f8c35b700 1 -- 172.21.15.125:0/3867147770 wait complete. 2023-10-03T10:13:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 -- 172.21.15.125:0/4130128323 shutdown_connections 2023-10-03T10:13:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.219+0000 7f4d5625d700 1 -- 172.21.15.125:0/4130128323 wait complete. 2023-10-03T10:13:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.220+0000 7f6f8c35b700 1 Processor -- start 2023-10-03T10:13:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.220+0000 7f4d5625d700 1 Processor -- start 2023-10-03T10:13:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.220+0000 7f6f8c35b700 1 -- start start 2023-10-03T10:13:03.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.220+0000 7f4d5625d700 1 -- start start 2023-10-03T10:13:03.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 0x7f6f841c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f84134120 0x7f6f841c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f841247e0 con 0x7f6f840a1380 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84122ef0 con 0x7f6f840a0a70 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8c35b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84133aa0 con 0x7f6f84134120 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f898f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 0x7f6f841c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39476/0 (socket says 172.21.15.125:39476) 2023-10-03T10:13:03.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 -- 172.21.15.125:0/2916626630 learned_addr learned my addr 172.21.15.125:0/2916626630 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:03.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d500a1380 0x7f4d50122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d50134120 0x7f4d501231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50125a70 con 0x7f4d500a0a70 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50133260 con 0x7f4d50134120 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d5625d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50125c50 con 0x7f4d500a1380 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48124/0 (socket says 172.21.15.125:48124) 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 -- 172.21.15.125:0/300612062 learned_addr learned my addr 172.21.15.125:0/300612062 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:03.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4ffff700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d50134120 0x7f4d501231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 -- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f84134120 msgr2=0x7f6f841c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f84134120 0x7f6f841c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 -- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 msgr2=0x7f6f841c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 0x7f6f841c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 -- 172.21.15.125:0/2916626630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c009a70 con 0x7f6f840a0a70 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f898f6700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 0x7f6f841c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f8a0f7700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e910 tx=0x7f6f8000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 -- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d500a1380 msgr2=0x7f4d50122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d500a1380 0x7f4d50122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 -- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d50134120 msgr2=0x7f4d501231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f4d4f7fe700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d50134120 0x7f4d501231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f4d4f7fe700 1 -- 172.21.15.125:0/300612062 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48009a70 con 0x7f4d500a0a70 2023-10-03T10:13:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.221+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800096a0 con 0x7f6f840a0a70 2023-10-03T10:13:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000ee60 con 0x7f6f840a0a70 2023-10-03T10:13:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840a03e0 con 0x7f6f840a0a70 2023-10-03T10:13:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f841252d0 con 0x7f6f840a0a70 2023-10-03T10:13:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000ca90 con 0x7f6f840a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f4d4f7fe700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e9b0 tx=0x7f4d4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40009710 con 0x7f4d500a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d500a55f0 con 0x7f4d500a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d50125f10 con 0x7f4d500a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.222+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f8000cbf0 con 0x7f6f840a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000c850 con 0x7f4d500a0a70 2023-10-03T10:13:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000cbc0 con 0x7f4d500a0a70 2023-10-03T10:13:03.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f8003fb70 con 0x7f6f840a0a70 2023-10-03T10:13:03.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0052e0 con 0x7f6f840a0a70 2023-10-03T10:13:03.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d4000cd20 con 0x7f4d500a0a70 2023-10-03T10:13:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300052e0 con 0x7f4d500a0a70 2023-10-03T10:13:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.223+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d4003f810 con 0x7f4d500a0a70 2023-10-03T10:13:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.227+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f80021080 con 0x7f6f840a0a70 2023-10-03T10:13:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.228+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d4001be10 con 0x7f4d500a0a70 2023-10-03T10:13:03.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.419+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f6c005590 con 0x7f6f840a0a70 2023-10-03T10:13:03.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.419+0000 7f6f7affd700 1 -- 172.21.15.125:0/2916626630 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f8001b3b0 con 0x7f6f840a0a70 2023-10-03T10:13:03.495 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:03.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.421+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d30005590 con 0x7f4d500a0a70 2023-10-03T10:13:03.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.421+0000 7f4d37fff700 1 -- 172.21.15.125:0/300612062 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d40021030 con 0x7f4d500a0a70 2023-10-03T10:13:03.496 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 msgr2=0x7f6f841c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e910 tx=0x7f6f8000ec20 comp rx=0 tx=0).stop 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 shutdown_connections 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f84134120 0x7f6f841c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f840a0a70 0x7f6f841c8400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 --2- 172.21.15.125:0/2916626630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f840a1380 0x7f6f841c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 >> 172.21.15.125:0/2916626630 conn(0x7f6f840a6610 msgr2=0x7f6f840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 shutdown_connections 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.422+0000 7f6f8c35b700 1 -- 172.21.15.125:0/2916626630 wait complete. 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 msgr2=0x7f4d50122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e9b0 tx=0x7f4d4000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 shutdown_connections 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d50134120 0x7f4d501231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d500a0a70 0x7f4d50122720 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 --2- 172.21.15.125:0/300612062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d500a1380 0x7f4d50122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 >> 172.21.15.125:0/300612062 conn(0x7f4d500a6610 msgr2=0x7f4d500a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 shutdown_connections 2023-10-03T10:13:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:03.423+0000 7f4d5625d700 1 -- 172.21.15.125:0/300612062 wait complete. 2023-10-03T10:13:03.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:03.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:04.098 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:04.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:04.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.236+0000 7f6a67f57700 1 Processor -- start 2023-10-03T10:13:04.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.236+0000 7fadf6acc700 1 Processor -- start 2023-10-03T10:13:04.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.236+0000 7f6a67f57700 1 -- start start 2023-10-03T10:13:04.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.236+0000 7fadf6acc700 1 -- start start 2023-10-03T10:13:04.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf6acc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadf0133ad0 0x7fadf0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a67f57700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a60133ad0 0x7f6a60133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf6acc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a67f57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 0x7f6a601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a67f57700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6006b2d0 con 0x7f6a601309f0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a67f57700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a60133610 con 0x7f6a60133ad0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a67f57700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6009a500 con 0x7f6a601300a0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf6acc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf006b2d0 con 0x7fadf01309f0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf6acc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf0133610 con 0x7fadf0133ad0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf6acc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf009a500 con 0x7fadf01300a0 2023-10-03T10:13:04.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a664f4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6a601309f0 0x7f6a6013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49508/0 (socket says 172.21.15.125:49508) 2023-10-03T10:13:04.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a664f4700 1 -- 172.21.15.125:0/638419443 learned_addr learned my addr 172.21.15.125:0/638419443 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:04.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadf4868700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadf0133ad0 0x7fadf0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39496/0 (socket says 172.21.15.125:39496) 2023-10-03T10:13:04.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 -- 172.21.15.125:0/2236349656 learned_addr learned my addr 172.21.15.125:0/2236349656 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a65cf3700 1 --2- 172.21.15.125:0/638419443 >> v2:172.21.15.125:3300/0 conn(0x7f6a60133ad0 0x7f6a60133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a654f2700 1 --2- 172.21.15.125:0/638419443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 0x7f6a601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a654f2700 1 -- 172.21.15.125:0/638419443 >> v2:172.21.15.125:3300/0 conn(0x7f6a60133ad0 msgr2=0x7f6a60133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a654f2700 1 --2- 172.21.15.125:0/638419443 >> v2:172.21.15.125:3300/0 conn(0x7f6a60133ad0 0x7f6a60133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a654f2700 1 -- 172.21.15.125:0/638419443 >> v1:172.21.15.125:6789/0 conn(0x7f6a601309f0 legacy=0x7f6a6013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7f6a654f2700 1 -- 172.21.15.125:0/638419443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a601338b0 con 0x7f6a601300a0 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 -- 172.21.15.125:0/2236349656 >> v2:172.21.15.125:3300/0 conn(0x7fadf0133ad0 msgr2=0x7fadf0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 --2- 172.21.15.125:0/2236349656 >> v2:172.21.15.125:3300/0 conn(0x7fadf0133ad0 0x7fadf0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 -- 172.21.15.125:0/2236349656 >> v1:172.21.15.125:6789/0 conn(0x7fadf01309f0 legacy=0x7fadf013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.237+0000 7fadeffff700 1 -- 172.21.15.125:0/2236349656 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf01338b0 con 0x7fadf01300a0 2023-10-03T10:13:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a654f2700 1 --2- 172.21.15.125:0/638419443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 0x7f6a601304b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009840 tx=0x7f6a50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b60974557824dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadeffff700 1 --2- 172.21.15.125:0/2236349656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098f0 tx=0x7faddc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8c807a305c9558 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a64cf1700 1 -- 172.21.15.125:0/638419443 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50011830 con 0x7f6a601300a0 2023-10-03T10:13:04.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadef7fe700 1 -- 172.21.15.125:0/2236349656 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011830 con 0x7fadf01300a0 2023-10-03T10:13:04.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadef7fe700 1 -- 172.21.15.125:0/2236349656 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc011990 con 0x7fadf01300a0 2023-10-03T10:13:04.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a64cf1700 1 -- 172.21.15.125:0/638419443 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a50011990 con 0x7f6a601300a0 2023-10-03T10:13:04.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a64cf1700 1 -- 172.21.15.125:0/638419443 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50011d20 con 0x7f6a601300a0 2023-10-03T10:13:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadef7fe700 1 -- 172.21.15.125:0/2236349656 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011d20 con 0x7fadf01300a0 2023-10-03T10:13:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a67f57700 1 -- 172.21.15.125:0/638419443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 msgr2=0x7f6a601304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7f6a67f57700 1 --2- 172.21.15.125:0/638419443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 0x7f6a601304b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009840 tx=0x7f6a50009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadf6acc700 1 -- 172.21.15.125:0/2236349656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 msgr2=0x7fadf01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadf6acc700 1 --2- 172.21.15.125:0/2236349656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098f0 tx=0x7faddc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 -- 172.21.15.125:0/638419443 shutdown_connections 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.238+0000 7fadf6acc700 1 -- 172.21.15.125:0/2236349656 shutdown_connections 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7fadf6acc700 1 --2- 172.21.15.125:0/2236349656 >> v2:172.21.15.125:3300/0 conn(0x7fadf0133ad0 0x7fadf0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7fadf6acc700 1 --2- 172.21.15.125:0/2236349656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01300a0 0x7fadf01304b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7fadf6acc700 1 -- 172.21.15.125:0/2236349656 >> 172.21.15.125:0/2236349656 conn(0x7fadf0099c40 msgr2=0x7fadf00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 --2- 172.21.15.125:0/638419443 >> v2:172.21.15.125:3300/0 conn(0x7f6a60133ad0 0x7f6a60133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 --2- 172.21.15.125:0/638419443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a601300a0 0x7f6a601304b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 -- 172.21.15.125:0/638419443 >> 172.21.15.125:0/638419443 conn(0x7f6a60099c40 msgr2=0x7f6a600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7fadf6acc700 1 -- 172.21.15.125:0/2236349656 shutdown_connections 2023-10-03T10:13:04.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7fadf6acc700 1 -- 172.21.15.125:0/2236349656 wait complete. 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 -- 172.21.15.125:0/638419443 shutdown_connections 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.239+0000 7f6a67f57700 1 -- 172.21.15.125:0/638419443 wait complete. 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 Processor -- start 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 -- start start 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7fadf6acc700 1 Processor -- start 2023-10-03T10:13:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7fadf6acc700 1 -- start start 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a601300a0 0x7f6a6011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 0x7f6a6011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6011f5b0 con 0x7f6a601309f0 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6012fcc0 con 0x7f6a601300a0 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a67f57700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6012dd00 con 0x7f6a60133ad0 2023-10-03T10:13:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a654f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a654f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48142/0 (socket says 172.21.15.125:48142) 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a654f2700 1 -- 172.21.15.125:0/2508225107 learned_addr learned my addr 172.21.15.125:0/2508225107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 0x7f6a6011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a65cf3700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a601300a0 0x7f6a6011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 -- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a601300a0 msgr2=0x7f6a6011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a601300a0 0x7f6a6011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 -- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 msgr2=0x7f6a6011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a664f4700 1 -- 172.21.15.125:0/2508225107 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500094a0 con 0x7f6a60133ad0 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.240+0000 7f6a654f2700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a664f4700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 0x7f6a6011e4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800cad0 tx=0x7f6a5800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800a9a0 con 0x7f6a60133ad0 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800ab00 con 0x7f6a60133ad0 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6011fbf0 con 0x7f6a60133ad0 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800ae70 con 0x7f6a60133ad0 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 0x7fadf011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 0x7fadf011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadf0133ad0 0x7fadf011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0072210 con 0x7fadf01300a0 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf011fc10 con 0x7fadf01309f0 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf6acc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadf012d220 con 0x7fadf0133ad0 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadeffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 0x7fadf011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6011feb0 con 0x7f6a60133ad0 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 0x7fadf011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadeffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 0x7fadf011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39522/0 (socket says 172.21.15.125:39522) 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadeffff700 1 -- 172.21.15.125:0/827649452 learned_addr learned my addr 172.21.15.125:0/827649452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf5069700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadf0133ad0 0x7fadf011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 -- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadf0133ad0 msgr2=0x7fadf011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadf0133ad0 0x7fadf011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 -- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 msgr2=0x7fadf011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 0x7fadf011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.241+0000 7fadf4868700 1 -- 172.21.15.125:0/827649452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009550 con 0x7fadf01300a0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7fadf4868700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 0x7fadf011da40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fade400e900 tx=0x7fade400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade400ee50 con 0x7fadf01300a0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade400c850 con 0x7fadf01300a0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf011fed0 con 0x7fadf01300a0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade400cbc0 con 0x7fadf01300a0 2023-10-03T10:13:04.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0072810 con 0x7fadf01300a0 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60072720 con 0x7f6a60133ad0 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a58012400 con 0x7f6a60133ad0 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.242+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a5803f100 con 0x7f6a60133ad0 2023-10-03T10:13:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.243+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fade400cd20 con 0x7fadf01300a0 2023-10-03T10:13:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.243+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fade403f6b0 con 0x7fadf01300a0 2023-10-03T10:13:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.243+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf004f2a0 con 0x7fadf01300a0 2023-10-03T10:13:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.247+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a58010300 con 0x7f6a60133ad0 2023-10-03T10:13:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.248+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fade401bdc0 con 0x7fadf01300a0 2023-10-03T10:13:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.439+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a6004f2a0 con 0x7f6a60133ad0 2023-10-03T10:13:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.439+0000 7f6a567fc700 1 -- 172.21.15.125:0/2508225107 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a58007b60 con 0x7f6a60133ad0 2023-10-03T10:13:04.440 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 msgr2=0x7f6a6011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 0x7f6a6011e4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800cad0 tx=0x7f6a5800cde0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 shutdown_connections 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a60133ad0 0x7f6a6011e4c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a601300a0 0x7f6a6011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 --2- 172.21.15.125:0/2508225107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a601309f0 0x7f6a6011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 >> 172.21.15.125:0/2508225107 conn(0x7f6a60099c40 msgr2=0x7f6a600a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 shutdown_connections 2023-10-03T10:13:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7f6a67f57700 1 -- 172.21.15.125:0/2508225107 wait complete. 2023-10-03T10:13:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.441+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadf006c3b0 con 0x7fadf01300a0 2023-10-03T10:13:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.442+0000 7faded7fa700 1 -- 172.21.15.125:0/827649452 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fade4021030 con 0x7fadf01300a0 2023-10-03T10:13:04.443 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 msgr2=0x7fadf011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 0x7fadf011da40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fade400e900 tx=0x7fade400ec10 comp rx=0 tx=0).stop 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 shutdown_connections 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadf0133ad0 0x7fadf011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadf01300a0 0x7fadf011da40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 --2- 172.21.15.125:0/827649452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadf01309f0 0x7fadf011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 >> 172.21.15.125:0/827649452 conn(0x7fadf0099c40 msgr2=0x7fadf0131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 shutdown_connections 2023-10-03T10:13:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.444+0000 7fadf6acc700 1 -- 172.21.15.125:0/827649452 wait complete. 2023-10-03T10:13:04.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:04.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:04.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:04.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 Processor -- start 2023-10-03T10:13:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 -- start start 2023-10-03T10:13:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 Processor -- start 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 -- start start 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cd8131980 0x7f8cd8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80a1640 con 0x7f8cd809c5c0 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd806eb30 con 0x7f8cd8131980 2023-10-03T10:13:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cdd911700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80a22d0 con 0x7f8cd809bc70 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 0x7fbaf0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 0x7fbaf01321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00a0920 con 0x7fbaf009e870 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf009c970 con 0x7fbaf009f180 2023-10-03T10:13:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaf5f02700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf009bab0 con 0x7fbaf0131d70 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48176/0 (socket says 172.21.15.125:48176) 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaef7fe700 1 -- 172.21.15.125:0/1955413318 learned_addr learned my addr 172.21.15.125:0/1955413318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaeeffd700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 0x7fbaf0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7fbaeffff700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 0x7fbaf01321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cd6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cd8131980 0x7f8cd8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cd6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cd8131980 0x7f8cd8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48160/0 (socket says 172.21.15.125:48160) 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cd6ffd700 1 -- 172.21.15.125:0/3504366653 learned_addr learned my addr 172.21.15.125:0/3504366653 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.626+0000 7f8cd67fc700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 -- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 msgr2=0x7fbaf01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd6ffd700 1 -- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 msgr2=0x7f8cd809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd6ffd700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd6ffd700 1 -- 172.21.15.125:0/3504366653 >> v1:172.21.15.125:6789/0 conn(0x7f8cd809c5c0 legacy=0x7f8cd8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd6ffd700 1 -- 172.21.15.125:0/3504366653 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8131550 con 0x7f8cd8131980 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 0x7fbaf01321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 -- 172.21.15.125:0/1955413318 >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 msgr2=0x7fbaf009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 --2- 172.21.15.125:0/1955413318 >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 -- 172.21.15.125:0/1955413318 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf009f9c0 con 0x7fbaf009f180 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaef7fe700 1 --2- 172.21.15.125:0/1955413318 >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeffff700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 0x7fbaf01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd6ffd700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd8131980 0x7f8cd8131d50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006fd0 tx=0x7f8cc800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd10c7e0fd255d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaeeffd700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 0x7fbaf0131830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009870 tx=0x7fbae4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6407c578e48761c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd5ffb700 1 -- 172.21.15.125:0/3504366653 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800f460 con 0x7f8cd8131980 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd5ffb700 1 -- 172.21.15.125:0/3504366653 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8005a20 con 0x7f8cd8131980 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaee7fc700 1 -- 172.21.15.125:0/1955413318 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011830 con 0x7fbaf009f180 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7f8cd5ffb700 1 -- 172.21.15.125:0/3504366653 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8005db0 con 0x7f8cd8131980 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaee7fc700 1 -- 172.21.15.125:0/1955413318 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4011990 con 0x7fbaf009f180 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.627+0000 7fbaee7fc700 1 -- 172.21.15.125:0/1955413318 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011d20 con 0x7fbaf009f180 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 -- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd8131980 msgr2=0x7f8cd8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd8131980 0x7f8cd8131d50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006fd0 tx=0x7f8cc800fcc0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 -- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 msgr2=0x7fbaf0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 0x7fbaf0131830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009870 tx=0x7fbae4009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 -- 172.21.15.125:0/3504366653 shutdown_connections 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd8131980 0x7f8cd8131d50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 --2- 172.21.15.125:0/3504366653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 -- 172.21.15.125:0/3504366653 >> 172.21.15.125:0/3504366653 conn(0x7f8cd80a2980 msgr2=0x7f8cd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 -- 172.21.15.125:0/1955413318 shutdown_connections 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf0131d70 0x7fbaf01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/1955413318 >> v2:172.21.15.125:3300/0 conn(0x7fbaf009e870 0x7fbaf009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/1955413318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf009f180 0x7fbaf0131830 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 -- 172.21.15.125:0/1955413318 >> 172.21.15.125:0/1955413318 conn(0x7fbaf00a4430 msgr2=0x7fbaf00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 -- 172.21.15.125:0/3504366653 shutdown_connections 2023-10-03T10:13:04.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 -- 172.21.15.125:0/1955413318 shutdown_connections 2023-10-03T10:13:04.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7fbaf5f02700 1 -- 172.21.15.125:0/1955413318 wait complete. 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.628+0000 7f8cdd911700 1 -- 172.21.15.125:0/3504366653 wait complete. 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7f8cdd911700 1 Processor -- start 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7f8cdd911700 1 -- start start 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7fbaf5f02700 1 Processor -- start 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7fbaf5f02700 1 -- start start 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7f8cdd911700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd8119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7f8cdd911700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.629+0000 7f8cdd911700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cd8131980 0x7f8cd8119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cdd911700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd811d070 con 0x7f8cd809c5c0 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cdd911700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd811b780 con 0x7f8cd8131980 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cdd911700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd811c440 con 0x7f8cd809bc70 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd8119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48180/0 (socket says 172.21.15.125:48180) 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 -- 172.21.15.125:0/2147136016 learned_addr learned my addr 172.21.15.125:0/2147136016 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd77fe700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cd8131980 0x7f8cd8119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 -- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 msgr2=0x7f8cd8119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd8119550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 -- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cd8131980 msgr2=0x7f8cd8119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cd8131980 0x7f8cd8119fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 -- 172.21.15.125:0/2147136016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc800f5f0 con 0x7f8cd809c5c0 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd6ffd700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd8119550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 0x7fbaf0135860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 0x7fbaf0135da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 0x7fbaf01c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf012bd30 con 0x7fbaf009e870 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00a2ab0 con 0x7fbaf0131d70 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaf5f02700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf0137340 con 0x7fbaf009f180 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaeeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 0x7fbaf0135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaeeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 0x7fbaf0135da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46950/0 (socket says 172.21.15.125:46950) 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaeeffd700 1 -- 172.21.15.125:0/2085383205 learned_addr learned my addr 172.21.15.125:0/2085383205 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaef7fe700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 0x7fbaf0135860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7fbaeffff700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 0x7fbaf01c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cd67fc700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e9e0 tx=0x7f8ccc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 -- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 msgr2=0x7fbaf0135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 0x7fbaf0135da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 -- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 msgr2=0x7fbaf01c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 0x7fbaf01c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 -- 172.21.15.125:0/2085383205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009550 con 0x7fbaf009e870 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaeffff700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 0x7fbaf01c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.630+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc009710 con 0x7f8cd809c5c0 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00ee80 con 0x7f8cd809c5c0 2023-10-03T10:13:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaef7fe700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 0x7fbaf0135860 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9b0 tx=0x7fbae000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000eea0 con 0x7fbaf009e870 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000c850 con 0x7fbaf009e870 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000cbe0 con 0x7fbaf009e870 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00ca50 con 0x7f8cd809c5c0 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd811a9b0 con 0x7f8cd809c5c0 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8130b60 con 0x7f8cd809c5c0 2023-10-03T10:13:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ccc00cbb0 con 0x7f8cd809c5c0 2023-10-03T10:13:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae8009a70 con 0x7fbaf009e870 2023-10-03T10:13:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.632+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ccc03fa90 con 0x7f8cd809c5c0 2023-10-03T10:13:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.631+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae40094a0 con 0x7fbaf009e870 2023-10-03T10:13:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.632+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd811cbf0 con 0x7f8cd809c5c0 2023-10-03T10:13:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.632+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbae000cd40 con 0x7fbaf009e870 2023-10-03T10:13:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.632+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf01385c0 con 0x7fbaf009e870 2023-10-03T10:13:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.632+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbae003f7f0 con 0x7fbaf009e870 2023-10-03T10:13:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.636+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ccc021080 con 0x7f8cd809c5c0 2023-10-03T10:13:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.641+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbae001bdf0 con 0x7fbaf009e870 2023-10-03T10:13:04.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.829+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8cd804f2a0 con 0x7f8cd809c5c0 2023-10-03T10:13:04.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.830+0000 7f8cbffff700 1 -- 172.21.15.125:0/2147136016 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ccc017020 con 0x7f8cd809c5c0 2023-10-03T10:13:04.830 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:04.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbaf004f2a0 con 0x7fbaf009e870 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 msgr2=0x7f8cd8119a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e9e0 tx=0x7f8ccc00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 shutdown_connections 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cd8131980 0x7f8cd8119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cd809bc70 0x7f8cd8119550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 --2- 172.21.15.125:0/2147136016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cd809c5c0 0x7f8cd8119a90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 >> 172.21.15.125:0/2147136016 conn(0x7f8cd80a2980 msgr2=0x7f8cd812e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7fbad7fff700 1 -- 172.21.15.125:0/2085383205 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbae0021070 con 0x7fbaf009e870 2023-10-03T10:13:04.834 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:04.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 shutdown_connections 2023-10-03T10:13:04.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.832+0000 7f8cdd911700 1 -- 172.21.15.125:0/2147136016 wait complete. 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 msgr2=0x7fbaf0135860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 0x7fbaf0135860 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9b0 tx=0x7fbae000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 shutdown_connections 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbaf0131d70 0x7fbaf01c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaf009e870 0x7fbaf0135860 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 --2- 172.21.15.125:0/2085383205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbaf009f180 0x7fbaf0135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 >> 172.21.15.125:0/2085383205 conn(0x7fbaf00a4430 msgr2=0x7fbaf006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 shutdown_connections 2023-10-03T10:13:04.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:04.834+0000 7fbaf5f02700 1 -- 172.21.15.125:0/2085383205 wait complete. 2023-10-03T10:13:04.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:04.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:05.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:05.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:05.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 Processor -- start 2023-10-03T10:13:05.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 -- start start 2023-10-03T10:13:05.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f7c81942700 1 Processor -- start 2023-10-03T10:13:05.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f7c81942700 1 -- start start 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a0a70 0x7f81bc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81bc0a1380 0x7f81bc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81bc09dc00 con 0x7f81bc133f50 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc09ea60 con 0x7f81bc0a1380 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.584+0000 7f81c11d5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc09dec0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81bc0a1380 0x7f81bc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81bc0a1380 0x7f81bc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55614/0 (socket says 172.21.15.125:55614) 2023-10-03T10:13:05.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 -- 172.21.15.125:0/2673088599 learned_addr learned my addr 172.21.15.125:0/2673088599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81bad9d700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a0a70 0x7f81bc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c131670 con 0x7f7c7c09d860 2023-10-03T10:13:05.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09aaa0 con 0x7f7c7c130ce0 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c81942700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09f870 con 0x7f7c7c09e170 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55626/0 (socket says 172.21.15.125:55626) 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 -- 172.21.15.125:0/1272482482 learned_addr learned my addr 172.21.15.125:0/1272482482 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 -- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a0a70 msgr2=0x7f81bc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a0a70 0x7f81bc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 -- 172.21.15.125:0/2673088599 >> v1:172.21.15.125:6789/0 conn(0x7f81bc133f50 legacy=0x7f81bc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 -- 172.21.15.125:0/2673088599 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc09e6a0 con 0x7f81bc0a1380 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81b9d9b700 1 -- 172.21.15.125:0/2673088599 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54396084 0 0) 0x7f81bc09dc00 con 0x7f81bc133f50 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7b7fe700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 -- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c09e170 msgr2=0x7f7c7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 -- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 msgr2=0x7f7c7c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7affd700 1 -- 172.21.15.125:0/1272482482 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09b360 con 0x7f7c7c09d860 2023-10-03T10:13:05.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f81ba59c700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a1380 0x7f81bc133a10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f81b00098f0 tx=0x7f81b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6c802548f2b5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.585+0000 7f7c7b7fe700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:05.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81b9d9b700 1 -- 172.21.15.125:0/2673088599 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0011830 con 0x7f81bc0a1380 2023-10-03T10:13:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c7affd700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009920 tx=0x7f7c6c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78a8f4c55650f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81b9d9b700 1 -- 172.21.15.125:0/2673088599 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b0011990 con 0x7f81bc0a1380 2023-10-03T10:13:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81b9d9b700 1 -- 172.21.15.125:0/2673088599 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0011d20 con 0x7f81bc0a1380 2023-10-03T10:13:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c79ffb700 1 -- 172.21.15.125:0/1272482482 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c011830 con 0x7f7c7c09d860 2023-10-03T10:13:05.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c79ffb700 1 -- 172.21.15.125:0/1272482482 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c011990 con 0x7f7c7c09d860 2023-10-03T10:13:05.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c79ffb700 1 -- 172.21.15.125:0/1272482482 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c011d20 con 0x7f7c7c09d860 2023-10-03T10:13:05.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 -- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a1380 msgr2=0x7f81bc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a1380 0x7f81bc133a10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f81b00098f0 tx=0x7f81b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:05.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 -- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09d860 msgr2=0x7f7c7c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009920 tx=0x7f7c6c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:05.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 -- 172.21.15.125:0/2673088599 shutdown_connections 2023-10-03T10:13:05.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a0a70 0x7f81bc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 --2- 172.21.15.125:0/2673088599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a1380 0x7f81bc133a10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 -- 172.21.15.125:0/2673088599 >> 172.21.15.125:0/2673088599 conn(0x7f81bc0a6610 msgr2=0x7f81bc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 -- 172.21.15.125:0/1272482482 shutdown_connections 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 --2- 172.21.15.125:0/1272482482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 -- 172.21.15.125:0/2673088599 shutdown_connections 2023-10-03T10:13:05.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f7c81942700 1 -- 172.21.15.125:0/1272482482 >> 172.21.15.125:0/1272482482 conn(0x7f7c7c099c40 msgr2=0x7f7c7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.586+0000 7f81c11d5700 1 -- 172.21.15.125:0/2673088599 wait complete. 2023-10-03T10:13:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.587+0000 7f7c81942700 1 -- 172.21.15.125:0/1272482482 shutdown_connections 2023-10-03T10:13:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.587+0000 7f7c81942700 1 -- 172.21.15.125:0/1272482482 wait complete. 2023-10-03T10:13:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.587+0000 7f7c81942700 1 Processor -- start 2023-10-03T10:13:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 Processor -- start 2023-10-03T10:13:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 -- start start 2023-10-03T10:13:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 -- start start 2023-10-03T10:13:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c09d860 0x7f7c7c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a1380 0x7f81bc122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c130ce0 0x7f7c7c11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11ac50 con 0x7f7c7c09e170 2023-10-03T10:13:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81bc133f50 0x7f81bc123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11aa60 con 0x7f7c7c09d860 2023-10-03T10:13:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c81942700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c12e780 con 0x7f7c7c130ce0 2023-10-03T10:13:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc124d90 con 0x7f81bc0a0a70 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc133aa0 con 0x7f81bc0a1380 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81c11d5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc124680 con 0x7f81bc133f50 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81bad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81bad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55658/0 (socket says 172.21.15.125:55658) 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81bad9d700 1 -- 172.21.15.125:0/3322611942 learned_addr learned my addr 172.21.15.125:0/3322611942 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81bb59e700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81bc133f50 0x7f81bc123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f81ba59c700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a1380 0x7f81bc122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c7a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c7a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55642/0 (socket says 172.21.15.125:55642) 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c7a7fc700 1 -- 172.21.15.125:0/2765819203 learned_addr learned my addr 172.21.15.125:0/2765819203 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c7b7fe700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c130ce0 0x7f7c7c11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.588+0000 7f7c7affd700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c09d860 0x7f7c7c119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 -- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c130ce0 msgr2=0x7f7c7c11a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c130ce0 0x7f7c7c11a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 -- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c09d860 msgr2=0x7f7c7c119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c09d860 0x7f7c7c119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 -- 172.21.15.125:0/2765819203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009550 con 0x7f7c7c09e170 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 -- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81bc133f50 msgr2=0x7f81bc123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81bc133f50 0x7f81bc123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 -- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a1380 msgr2=0x7f81bc122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a1380 0x7f81bc122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 -- 172.21.15.125:0/3322611942 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009550 con 0x7f81bc0a0a70 2023-10-03T10:13:05.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c7a7fc700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7c70012ed0 tx=0x7f7c7000f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81bad9d700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9b0 tx=0x7f81ac00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014070 con 0x7f7c7c09e170 2023-10-03T10:13:05.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009710 con 0x7f81bc0a0a70 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000de20 con 0x7f7c7c09e170 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70005e30 con 0x7f7c7c09e170 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c09c8b0 con 0x7f7c7c09e170 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00ee50 con 0x7f81bc0a0a70 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc133410 con 0x7f81bc0a0a70 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00ca50 con 0x7f81bc0a0a70 2023-10-03T10:13:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.589+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc126ba0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.590+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c11c9e0 con 0x7f7c7c09e170 2023-10-03T10:13:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.590+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81ac00cbb0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.590+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81bc04f2a0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.590+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81ac03fba0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.591+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c7000f940 con 0x7f7c7c09e170 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.591+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c7003f180 con 0x7f7c7c09e170 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.591+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c11c790 con 0x7f7c7c09e170 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.595+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81ac01b3b0 con 0x7f81bc0a0a70 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.599+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c70017d60 con 0x7f7c7c09e170 2023-10-03T10:13:05.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.787+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81bc072980 con 0x7f81bc0a0a70 2023-10-03T10:13:05.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.787+0000 7f81a37fe700 1 -- 172.21.15.125:0/3322611942 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81ac017020 con 0x7f81bc0a0a70 2023-10-03T10:13:05.788 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:05.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 msgr2=0x7f81bc122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9b0 tx=0x7f81ac00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 shutdown_connections 2023-10-03T10:13:05.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81bc133f50 0x7f81bc123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81bc0a0a70 0x7f81bc122980 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 --2- 172.21.15.125:0/3322611942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81bc0a1380 0x7f81bc122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 >> 172.21.15.125:0/3322611942 conn(0x7f81bc0a6610 msgr2=0x7f81bc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 shutdown_connections 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.789+0000 7f81c11d5700 1 -- 172.21.15.125:0/3322611942 wait complete. 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.790+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c7c04f2a0 con 0x7f7c7c09e170 2023-10-03T10:13:05.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.790+0000 7f7c63fff700 1 -- 172.21.15.125:0/2765819203 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c70017320 con 0x7f7c7c09e170 2023-10-03T10:13:05.792 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 msgr2=0x7f7c7c119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7c70012ed0 tx=0x7f7c7000f390 comp rx=0 tx=0).stop 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 shutdown_connections 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c7c130ce0 0x7f7c7c11a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c7c09d860 0x7f7c7c119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 --2- 172.21.15.125:0/2765819203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c7c09e170 0x7f7c7c119b70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 >> 172.21.15.125:0/2765819203 conn(0x7f7c7c099c40 msgr2=0x7f7c7c12dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 shutdown_connections 2023-10-03T10:13:05.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.793+0000 7f7c81942700 1 -- 172.21.15.125:0/2765819203 wait complete. 2023-10-03T10:13:05.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:05.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:05.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:05.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 Processor -- start 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 -- start start 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 Processor -- start 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 -- start start 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 0x7f851c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 0x7f851c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2684136960 0x7f2684138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 0x7f268413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c09e9d0 con 0x7f851c0a0a70 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c09dc00 con 0x7f851c0a1380 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f8520ce4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851c09dec0 con 0x7f851c133f50 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268406b2d0 con 0x7f2684133ad0 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26841345b0 con 0x7f2684136960 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.975+0000 7f268a299700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2684133610 con 0x7f2684139280 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 0x7f851c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 0x7f851c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55668/0 (socket says 172.21.15.125:55668) 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851a59c700 1 -- 172.21.15.125:0/1606426177 learned_addr learned my addr 172.21.15.125:0/1606426177 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f26837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2684136960 0x7f2684138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 0x7f268413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2683fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2684133ad0 0x7f2684133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48436/0 (socket says 172.21.15.125:48436) 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2683fff700 1 -- 172.21.15.125:0/1618759610 learned_addr learned my addr 172.21.15.125:0/1618759610 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f8519d9b700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 0x7f851c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 -- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 msgr2=0x7f851c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 0x7f851c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 -- 172.21.15.125:0/1606426177 >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 msgr2=0x7f851c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 --2- 172.21.15.125:0/1606426177 >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 0x7f851c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 -- 172.21.15.125:0/1606426177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c09e6a0 con 0x7f851c133f50 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f8519d9b700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 0x7f851c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 -- 172.21.15.125:0/1618759610 >> v2:172.21.15.125:3300/0 conn(0x7f2684136960 msgr2=0x7f2684138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 --2- 172.21.15.125:0/1618759610 >> v2:172.21.15.125:3300/0 conn(0x7f2684136960 0x7f2684138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 -- 172.21.15.125:0/1618759610 >> v1:172.21.15.125:6789/0 conn(0x7f2684133ad0 legacy=0x7f2684133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 -- 172.21.15.125:0/1618759610 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268409a500 con 0x7f2684139280 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851ad9d700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c1343b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8514009d90 tx=0x7f851400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a6bdb7c14ac4a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2688836700 1 --2- 172.21.15.125:0/1618759610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 0x7f268413b660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f267c009d90 tx=0x7f267c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4c81da6a93b9af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851959a700 1 -- 172.21.15.125:0/1606426177 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400e070 con 0x7f851c133f50 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851959a700 1 -- 172.21.15.125:0/1606426177 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400bb20 con 0x7f851c133f50 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f851959a700 1 -- 172.21.15.125:0/1606426177 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514012430 con 0x7f851c133f50 2023-10-03T10:13:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.976+0000 7f2682ffd700 1 -- 172.21.15.125:0/1618759610 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c00e070 con 0x7f2684139280 2023-10-03T10:13:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f2682ffd700 1 -- 172.21.15.125:0/1618759610 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c003a20 con 0x7f2684139280 2023-10-03T10:13:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f2682ffd700 1 -- 172.21.15.125:0/1618759610 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c003dd0 con 0x7f2684139280 2023-10-03T10:13:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 -- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 msgr2=0x7f851c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c1343b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8514009d90 tx=0x7f851400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 -- 172.21.15.125:0/1618759610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 msgr2=0x7f268413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 --2- 172.21.15.125:0/1618759610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 0x7f268413b660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f267c009d90 tx=0x7f267c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 -- 172.21.15.125:0/1618759610 shutdown_connections 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 -- 172.21.15.125:0/1606426177 shutdown_connections 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c1343b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1606426177 >> v2:172.21.15.125:3300/0 conn(0x7f851c0a0a70 0x7f851c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 --2- 172.21.15.125:0/1618759610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684139280 0x7f268413b660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 --2- 172.21.15.125:0/1618759610 >> v2:172.21.15.125:3300/0 conn(0x7f2684136960 0x7f2684138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 -- 172.21.15.125:0/1618759610 >> 172.21.15.125:0/1618759610 conn(0x7f2684099c40 msgr2=0x7f26840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1606426177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a1380 0x7f851c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 -- 172.21.15.125:0/1606426177 >> 172.21.15.125:0/1606426177 conn(0x7f851c0a6610 msgr2=0x7f851c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 -- 172.21.15.125:0/1606426177 shutdown_connections 2023-10-03T10:13:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 -- 172.21.15.125:0/1618759610 shutdown_connections 2023-10-03T10:13:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f268a299700 1 -- 172.21.15.125:0/1618759610 wait complete. 2023-10-03T10:13:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.977+0000 7f8520ce4700 1 -- 172.21.15.125:0/1606426177 wait complete. 2023-10-03T10:13:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.978+0000 7f268a299700 1 Processor -- start 2023-10-03T10:13:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.978+0000 7f8520ce4700 1 Processor -- start 2023-10-03T10:13:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.978+0000 7f268a299700 1 -- start start 2023-10-03T10:13:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.978+0000 7f8520ce4700 1 -- start start 2023-10-03T10:13:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684133ad0 0x7f268412cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a0a70 0x7f851c121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2684136960 0x7f268412d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268412eff0 con 0x7f2684139280 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26841316a0 con 0x7f2684136960 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f268a299700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f268409f390 con 0x7f2684133ad0 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c124cd0 con 0x7f851c0a1380 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c124eb0 con 0x7f851c0a0a70 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8520ce4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851c122930 con 0x7f851c133f50 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55684/0 (socket says 172.21.15.125:55684) 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 -- 172.21.15.125:0/2418985889 learned_addr learned my addr 172.21.15.125:0/2418985889 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55676/0 (socket says 172.21.15.125:55676) 2023-10-03T10:13:05.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 -- 172.21.15.125:0/1595498609 learned_addr learned my addr 172.21.15.125:0/1595498609 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:05.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f851a59c700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a0a70 0x7f851c121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f851ad9d700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f26837fe700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2684136960 0x7f268412d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2683fff700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684133ad0 0x7f268412cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 -- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684133ad0 msgr2=0x7f268412cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684133ad0 0x7f268412cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 -- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2684136960 msgr2=0x7f268412d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2684136960 0x7f268412d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f2688836700 1 -- 172.21.15.125:0/2418985889 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c009a70 con 0x7f2684139280 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 -- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 msgr2=0x7f851c121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 -- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a0a70 msgr2=0x7f851c121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a0a70 0x7f851c121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.979+0000 7f8519d9b700 1 -- 172.21.15.125:0/1595498609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100094a0 con 0x7f851c0a1380 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f8519d9b700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f851000ec10 tx=0x7f851000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f2688836700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f267c004000 tx=0x7f267c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c009410 con 0x7f2684139280 2023-10-03T10:13:05.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c004740 con 0x7f2684139280 2023-10-03T10:13:05.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000c850 con 0x7f851c0a1380 2023-10-03T10:13:05.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268412f290 con 0x7f2684139280 2023-10-03T10:13:05.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c012430 con 0x7f2684139280 2023-10-03T10:13:05.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000c9b0 con 0x7f851c0a1380 2023-10-03T10:13:05.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000cd20 con 0x7f851c0a1380 2023-10-03T10:13:05.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514009a70 con 0x7f851c0a1380 2023-10-03T10:13:05.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0a03e0 con 0x7f851c0a1380 2023-10-03T10:13:05.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.980+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268406ede0 con 0x7f2684139280 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f267c012590 con 0x7f2684139280 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f267c041450 con 0x7f2684139280 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8510013470 con 0x7f851c0a1380 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c124b10 con 0x7f851c0a1380 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f851003fb30 con 0x7f851c0a1380 2023-10-03T10:13:05.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.981+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2684070160 con 0x7f2684139280 2023-10-03T10:13:05.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.986+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f851c124b10 con 0x7f851c0a1380 2023-10-03T10:13:05.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:05.990+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2684070160 con 0x7f2684139280 2023-10-03T10:13:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.179+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f851c124b10 con 0x7f851c0a1380 2023-10-03T10:13:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.179+0000 7f850affd700 1 -- 172.21.15.125:0/1595498609 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f851c124b10 con 0x7f851c0a1380 2023-10-03T10:13:06.180 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 msgr2=0x7f851c121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f851000ec10 tx=0x7f851000ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 shutdown_connections 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f851c133f50 0x7f851c121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f851c0a0a70 0x7f851c121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 --2- 172.21.15.125:0/1595498609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f851c0a1380 0x7f851c121aa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 >> 172.21.15.125:0/1595498609 conn(0x7f851c0a6610 msgr2=0x7f851c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 shutdown_connections 2023-10-03T10:13:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.181+0000 7f8520ce4700 1 -- 172.21.15.125:0/1595498609 wait complete. 2023-10-03T10:13:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.184+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2684070160 con 0x7f2684139280 2023-10-03T10:13:06.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.184+0000 7f2680ff9700 1 -- 172.21.15.125:0/2418985889 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2684070160 con 0x7f2684139280 2023-10-03T10:13:06.185 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 msgr2=0x7f26840710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f267c004000 tx=0x7f267c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 shutdown_connections 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684139280 0x7f26840710e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2684133ad0 0x7f268412cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 --2- 172.21.15.125:0/2418985889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2684136960 0x7f268412d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 >> 172.21.15.125:0/2418985889 conn(0x7f2684099c40 msgr2=0x7f2684134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 shutdown_connections 2023-10-03T10:13:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.187+0000 7f268a299700 1 -- 172.21.15.125:0/2418985889 wait complete. 2023-10-03T10:13:06.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:06.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:06.808 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:06.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.948+0000 7f49e3a50700 1 Processor -- start 2023-10-03T10:13:06.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.948+0000 7f357fecb700 1 Processor -- start 2023-10-03T10:13:06.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.948+0000 7f49e3a50700 1 -- start start 2023-10-03T10:13:06.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.948+0000 7f357fecb700 1 -- start start 2023-10-03T10:13:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357809a730 0x7f3578130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49dc0a0a70 0x7f49dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3578130890 0x7f3578130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357809bf50 con 0x7f3578130890 2023-10-03T10:13:06.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 0x7f49dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578099a60 con 0x7f357809a730 2023-10-03T10:13:06.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357fecb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357809b230 con 0x7f3578099e20 2023-10-03T10:13:06.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc09e9d0 con 0x7f49dc0a0a70 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc09dc00 con 0x7f49dc133f50 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e3a50700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc09dec0 con 0x7f49dc0a1380 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357dc67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e0feb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 0x7f49dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45310/0 (socket says 172.21.15.125:45310) 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e0feb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 0x7f49dc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41294/0 (socket says 172.21.15.125:41294) 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 -- 172.21.15.125:0/3280599343 learned_addr learned my addr 172.21.15.125:0/3280599343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357dc67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41292/0 (socket says 172.21.15.125:41292) 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357dc67700 1 -- 172.21.15.125:0/1056866564 learned_addr learned my addr 172.21.15.125:0/1056866564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 --2- 172.21.15.125:0/1056866564 >> v2:172.21.15.125:3300/0 conn(0x7f3578130890 0x7f3578130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357d466700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357809a730 0x7f3578130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e17ec700 1 --2- 172.21.15.125:0/3280599343 >> v2:172.21.15.125:3300/0 conn(0x7f49dc0a0a70 0x7f49dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 -- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 msgr2=0x7f49dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 --2- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 0x7f49dc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 -- 172.21.15.125:0/3280599343 >> v2:172.21.15.125:3300/0 conn(0x7f49dc0a0a70 msgr2=0x7f49dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 --2- 172.21.15.125:0/3280599343 >> v2:172.21.15.125:3300/0 conn(0x7f49dc0a0a70 0x7f49dc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 -- 172.21.15.125:0/3280599343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc09e6a0 con 0x7f49dc133f50 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 -- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 msgr2=0x7f357809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 -- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357809a730 msgr2=0x7f3578130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357809a730 0x7f3578130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 -- 172.21.15.125:0/1056866564 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357809bb90 con 0x7f3578130890 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357dc67700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f49e1fed700 1 --2- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009e50 tx=0x7f49d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26796f12c2f13d9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.949+0000 7f357e468700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578130890 0x7f3578130d00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3570009d90 tx=0x7f357000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2186c955a9fd98e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49d3fff700 1 -- 172.21.15.125:0/3280599343 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400e070 con 0x7f49dc133f50 2023-10-03T10:13:06.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357cc65700 1 -- 172.21.15.125:0/1056866564 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357000e070 con 0x7f3578130890 2023-10-03T10:13:06.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49d3fff700 1 -- 172.21.15.125:0/3280599343 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400b910 con 0x7f49dc133f50 2023-10-03T10:13:06.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49d3fff700 1 -- 172.21.15.125:0/3280599343 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400bcc0 con 0x7f49dc133f50 2023-10-03T10:13:06.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357cc65700 1 -- 172.21.15.125:0/1056866564 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357000bb20 con 0x7f3578130890 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357cc65700 1 -- 172.21.15.125:0/1056866564 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570012430 con 0x7f3578130890 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 -- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 msgr2=0x7f49dc1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 --2- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009e50 tx=0x7f49d400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 -- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578130890 msgr2=0x7f3578130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578130890 0x7f3578130d00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3570009d90 tx=0x7f357000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 -- 172.21.15.125:0/1056866564 shutdown_connections 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578130890 0x7f3578130d00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3578099e20 0x7f357809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 -- 172.21.15.125:0/3280599343 shutdown_connections 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 --2- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc133f50 0x7f49dc1343b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 --2- 172.21.15.125:0/3280599343 >> v2:172.21.15.125:3300/0 conn(0x7f49dc0a0a70 0x7f49dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 --2- 172.21.15.125:0/3280599343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc0a1380 0x7f49dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f49e3a50700 1 -- 172.21.15.125:0/3280599343 >> 172.21.15.125:0/3280599343 conn(0x7f49dc0a6610 msgr2=0x7f49dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 --2- 172.21.15.125:0/1056866564 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357809a730 0x7f3578130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.950+0000 7f357fecb700 1 -- 172.21.15.125:0/1056866564 >> 172.21.15.125:0/1056866564 conn(0x7f35780a2980 msgr2=0x7f35780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f49e3a50700 1 -- 172.21.15.125:0/3280599343 shutdown_connections 2023-10-03T10:13:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f357fecb700 1 -- 172.21.15.125:0/1056866564 shutdown_connections 2023-10-03T10:13:06.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f49e3a50700 1 -- 172.21.15.125:0/3280599343 wait complete. 2023-10-03T10:13:06.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f357fecb700 1 -- 172.21.15.125:0/1056866564 wait complete. 2023-10-03T10:13:06.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f357fecb700 1 Processor -- start 2023-10-03T10:13:06.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f49e3a50700 1 Processor -- start 2023-10-03T10:13:06.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f357fecb700 1 -- start start 2023-10-03T10:13:06.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.951+0000 7f49e3a50700 1 -- start start 2023-10-03T10:13:06.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49dc0a1380 0x7f49dc121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 0x7f357809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357809a730 0x7f357809d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc133f50 0x7f49dc121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc124cd0 con 0x7f49dc0a1380 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc124eb0 con 0x7f49dc0a0a70 2023-10-03T10:13:06.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 0x7f357809dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357811eca0 con 0x7f3578099e20 2023-10-03T10:13:06.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e3a50700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc122930 con 0x7f49dc133f50 2023-10-03T10:13:06.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357809b470 con 0x7f3578130890 2023-10-03T10:13:06.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357fecb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357809e5a0 con 0x7f357809a730 2023-10-03T10:13:06.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357dc67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 0x7f357809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357dc67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 0x7f357809d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55708/0 (socket says 172.21.15.125:55708) 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45314/0 (socket says 172.21.15.125:45314) 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 -- 172.21.15.125:0/2108517164 learned_addr learned my addr 172.21.15.125:0/2108517164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357dc67700 1 -- 172.21.15.125:0/2259849632 learned_addr learned my addr 172.21.15.125:0/2259849632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:06.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 0x7f357809dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e1fed700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc133f50 0x7f49dc121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357d466700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357809a730 0x7f357809d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 -- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc133f50 msgr2=0x7f49dc121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc133f50 0x7f49dc121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 -- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49dc0a1380 msgr2=0x7f49dc121aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:06.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49dc0a1380 0x7f49dc121aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f49e17ec700 1 -- 172.21.15.125:0/2108517164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4009b30 con 0x7f49dc0a0a70 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 -- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357809a730 msgr2=0x7f357809d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357809a730 0x7f357809d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 -- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 msgr2=0x7f357809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 0x7f357809d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.952+0000 7f357e468700 1 -- 172.21.15.125:0/2259849632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009500 con 0x7f3578130890 2023-10-03T10:13:06.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49e17ec700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e810 tx=0x7f49d800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f357e468700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 0x7f357809dc40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35780721d0 tx=0x7f3570004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8013610 con 0x7f49dc0a0a70 2023-10-03T10:13:06.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8013790 con 0x7f49dc0a0a70 2023-10-03T10:13:06.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8013b40 con 0x7f49dc0a0a70 2023-10-03T10:13:06.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570012430 con 0x7f3578130890 2023-10-03T10:13:06.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc133a10 con 0x7f49dc0a0a70 2023-10-03T10:13:06.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570020070 con 0x7f3578130890 2023-10-03T10:13:06.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570009a70 con 0x7f3578130890 2023-10-03T10:13:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570004040 con 0x7f3578130890 2023-10-03T10:13:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357809fca0 con 0x7f3578130890 2023-10-03T10:13:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.953+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc1234b0 con 0x7f49dc0a0a70 2023-10-03T10:13:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.954+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49d8013ca0 con 0x7f49dc0a0a70 2023-10-03T10:13:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.954+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357804f2a0 con 0x7f3578130890 2023-10-03T10:13:06.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.954+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49d803f3c0 con 0x7f49dc0a0a70 2023-10-03T10:13:06.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.955+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35700041a0 con 0x7f3578130890 2023-10-03T10:13:06.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.955+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc124b10 con 0x7f49dc0a0a70 2023-10-03T10:13:06.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.955+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3570022070 con 0x7f3578130890 2023-10-03T10:13:06.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.960+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3570004450 con 0x7f3578130890 2023-10-03T10:13:06.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:06.963+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49dc124b10 con 0x7f49dc0a0a70 2023-10-03T10:13:07.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.146+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f357811d200 con 0x7f3578130890 2023-10-03T10:13:07.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.146+0000 7f356e7fc700 1 -- 172.21.15.125:0/2259849632 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3570035090 con 0x7f3578130890 2023-10-03T10:13:07.147 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:07.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 msgr2=0x7f357809dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 0x7f357809dc40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35780721d0 tx=0x7f3570004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 shutdown_connections 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3578130890 0x7f357809dc40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3578099e20 0x7f357809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 --2- 172.21.15.125:0/2259849632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357809a730 0x7f357809d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 >> 172.21.15.125:0/2259849632 conn(0x7f35780a2980 msgr2=0x7f357812d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 shutdown_connections 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f357fecb700 1 -- 172.21.15.125:0/2259849632 wait complete. 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.149+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49dc124b10 con 0x7f49dc0a0a70 2023-10-03T10:13:07.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.150+0000 7f49d1ffb700 1 -- 172.21.15.125:0/2108517164 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49dc124b10 con 0x7f49dc0a0a70 2023-10-03T10:13:07.151 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:07.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 msgr2=0x7f49dc121560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e810 tx=0x7f49d800eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:07.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 shutdown_connections 2023-10-03T10:13:07.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49dc133f50 0x7f49dc121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49dc0a0a70 0x7f49dc121560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 --2- 172.21.15.125:0/2108517164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49dc0a1380 0x7f49dc121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 >> 172.21.15.125:0/2108517164 conn(0x7f49dc0a6610 msgr2=0x7f49dc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 shutdown_connections 2023-10-03T10:13:07.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.152+0000 7f49e3a50700 1 -- 172.21.15.125:0/2108517164 wait complete. 2023-10-03T10:13:07.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:07.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:07.195 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:07.201 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:07.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 Processor -- start 2023-10-03T10:13:07.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 Processor -- start 2023-10-03T10:13:07.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 -- start start 2023-10-03T10:13:07.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 -- start start 2023-10-03T10:13:07.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb24c09f180 0x7fb24c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 0x7fea800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0a0370 con 0x7fb24c09f180 2023-10-03T10:13:07.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c09fa00 con 0x7fb24c09e870 2023-10-03T10:13:07.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fb253b5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c09ada0 con 0x7fb24c134160 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea800a1e70 con 0x7fea800a1340 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8009a720 con 0x7fea800a0a30 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.331+0000 7fea85a4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea8009b300 con 0x7fea80130670 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fea800a1340 0x7fea8012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48444/0 (socket says 172.21.15.125:48444) 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7e7fc700 1 -- 172.21.15.125:0/4069675327 learned_addr learned my addr 172.21.15.125:0/4069675327 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7f7fe700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 0x7fea800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2520f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb24c09f180 0x7fb24c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb24c09f180 0x7fb24c133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55714/0 (socket says 172.21.15.125:55714) 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2520f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41342/0 (socket says 172.21.15.125:41342) 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 -- 172.21.15.125:0/2850716596 learned_addr learned my addr 172.21.15.125:0/2850716596 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2518f7700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865089804 0 0) 0x7fea800a1e70 con 0x7fea800a1340 2023-10-03T10:13:07.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea680057c0 con 0x7fea800a1340 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 -- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 msgr2=0x7fb24c134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 -- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 msgr2=0x7fb24c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 -- 172.21.15.125:0/2850716596 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c06bec0 con 0x7fb24c09f180 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 -- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 msgr2=0x7fea801381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 -- 172.21.15.125:0/4069675327 >> v1:172.21.15.125:6789/0 conn(0x7fea800a1340 legacy=0x7fea8012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806874886 0 0) 0x7fea680057c0 con 0x7fea800a1340 2023-10-03T10:13:07.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 -- 172.21.15.125:0/4069675327 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8009abc0 con 0x7fea800a0a30 2023-10-03T10:13:07.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fb2510f6700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c133c20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009920 tx=0x7fb23c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d7806f6b05f1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.332+0000 7fea7effd700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 0x7fea800a0e00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea70009850 tx=0x7fea70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c72c930f62299ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb2508f5700 1 -- 172.21.15.125:0/2850716596 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011830 con 0x7fb24c09f180 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb2508f5700 1 -- 172.21.15.125:0/2850716596 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c011990 con 0x7fb24c09f180 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb2508f5700 1 -- 172.21.15.125:0/2850716596 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011d20 con 0x7fb24c09f180 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74001670 con 0x7fea800a0a30 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea70005c30 con 0x7fea800a0a30 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea7dffb700 1 -- 172.21.15.125:0/4069675327 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70004030 con 0x7fea800a0a30 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 -- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 msgr2=0x7fea800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 0x7fea800a0e00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea70009850 tx=0x7fea70009b60 comp rx=0 tx=0).stop 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 -- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 msgr2=0x7fb24c133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c133c20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009920 tx=0x7fb23c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 -- 172.21.15.125:0/4069675327 shutdown_connections 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 --2- 172.21.15.125:0/4069675327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a0a30 0x7fea800a0e00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 -- 172.21.15.125:0/4069675327 >> 172.21.15.125:0/4069675327 conn(0x7fea800a2980 msgr2=0x7fea800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 -- 172.21.15.125:0/2850716596 shutdown_connections 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 --2- 172.21.15.125:0/2850716596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c133c20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fb253b5b700 1 -- 172.21.15.125:0/2850716596 >> 172.21.15.125:0/2850716596 conn(0x7fb24c0a4430 msgr2=0x7fb24c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.333+0000 7fea85a4e700 1 -- 172.21.15.125:0/4069675327 shutdown_connections 2023-10-03T10:13:07.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fea85a4e700 1 -- 172.21.15.125:0/4069675327 wait complete. 2023-10-03T10:13:07.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fb253b5b700 1 -- 172.21.15.125:0/2850716596 shutdown_connections 2023-10-03T10:13:07.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fb253b5b700 1 -- 172.21.15.125:0/2850716596 wait complete. 2023-10-03T10:13:07.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fea85a4e700 1 Processor -- start 2023-10-03T10:13:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fb253b5b700 1 Processor -- start 2023-10-03T10:13:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.334+0000 7fb253b5b700 1 -- start start 2023-10-03T10:13:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 -- start start 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c125dc0 con 0x7fb24c09f180 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1338b0 con 0x7fb24c09e870 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb253b5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c125a60 con 0x7fb24c134160 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2520f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45344/0 (socket says 172.21.15.125:45344) 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 -- 172.21.15.125:0/4262512550 learned_addr learned my addr 172.21.15.125:0/4262512550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 0x7fea801c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 0x7fea801c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8011bd20 con 0x7fea800a0a30 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8011c370 con 0x7fea800a1340 2023-10-03T10:13:07.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea85a4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea8011dc30 con 0x7fea80130670 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2510f6700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 -- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 msgr2=0x7fb24c122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 -- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 msgr2=0x7fb24c122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2518f7700 1 -- 172.21.15.125:0/4262512550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009550 con 0x7fb24c09e870 2023-10-03T10:13:07.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea7f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fb2520f8700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.335+0000 7fea7f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41362/0 (socket says 172.21.15.125:41362) 2023-10-03T10:13:07.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 -- 172.21.15.125:0/2953549502 learned_addr learned my addr 172.21.15.125:0/2953549502 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:07.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb2510f6700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:07.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb2518f7700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d800 tx=0x7fb24800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 -- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 msgr2=0x7fea801c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7effd700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 0x7fea801c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7e7fc700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 0x7fea801c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 0x7fea801c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 -- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 msgr2=0x7fea801c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 0x7fea801c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 -- 172.21.15.125:0/2953549502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70009430 con 0x7fea80130670 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7effd700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 0x7fea801c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480125f0 con 0x7fb24c09e870 2023-10-03T10:13:07.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7e7fc700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 0x7fea801c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:07.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c124f80 con 0x7fb24c09e870 2023-10-03T10:13:07.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c125790 con 0x7fb24c09e870 2023-10-03T10:13:07.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea7f7fe700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea780072c0 tx=0x7fea78007680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248012750 con 0x7fb24c09e870 2023-10-03T10:13:07.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248012ac0 con 0x7fb24c09e870 2023-10-03T10:13:07.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780143f0 con 0x7fea80130670 2023-10-03T10:13:07.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78010040 con 0x7fea80130670 2023-10-03T10:13:07.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.336+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780147d0 con 0x7fea80130670 2023-10-03T10:13:07.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.337+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb248012c20 con 0x7fb24c09e870 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.337+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb24803f900 con 0x7fb24c09e870 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.337+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2340052e0 con 0x7fb24c09e870 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.337+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8009fd40 con 0x7fea80130670 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.337+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8009ae60 con 0x7fea80130670 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.338+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea78014930 con 0x7fea80130670 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.338+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8011d5f0 con 0x7fea80130670 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.338+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea7803fe80 con 0x7fea80130670 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.342+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb248014430 con 0x7fb24c09e870 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.343+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea8011d5f0 con 0x7fea80130670 2023-10-03T10:13:07.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.535+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea8011d5d0 con 0x7fea80130670 2023-10-03T10:13:07.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.535+0000 7fea67fff700 1 -- 172.21.15.125:0/2953549502 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea7801b960 con 0x7fea80130670 2023-10-03T10:13:07.535 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:07.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.536+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb234005590 con 0x7fb24c09e870 2023-10-03T10:13:07.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fb2427fc700 1 -- 172.21.15.125:0/4262512550 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb24801c360 con 0x7fb24c09e870 2023-10-03T10:13:07.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 msgr2=0x7fea801c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea780072c0 tx=0x7fea78007680 comp rx=0 tx=0).stop 2023-10-03T10:13:07.538 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:07.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 shutdown_connections 2023-10-03T10:13:07.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea80130670 0x7fea801c4880 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea800a0a30 0x7fea801c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 --2- 172.21.15.125:0/2953549502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a1340 0x7fea801c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 >> 172.21.15.125:0/2953549502 conn(0x7fea800a2980 msgr2=0x7fea8009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 shutdown_connections 2023-10-03T10:13:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.537+0000 7fea85a4e700 1 -- 172.21.15.125:0/2953549502 wait complete. 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 msgr2=0x7fb24c1224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d800 tx=0x7fb24800db10 comp rx=0 tx=0).stop 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 shutdown_connections 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb24c134160 0x7fb24c122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb24c09e870 0x7fb24c1224e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 --2- 172.21.15.125:0/4262512550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c09f180 0x7fb24c122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 >> 172.21.15.125:0/4262512550 conn(0x7fb24c0a4430 msgr2=0x7fb24c070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 shutdown_connections 2023-10-03T10:13:07.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:07.539+0000 7fb253b5b700 1 -- 172.21.15.125:0/4262512550 wait complete. 2023-10-03T10:13:07.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:07.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:08.164 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:08.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.298+0000 7f3a88380700 1 Processor -- start 2023-10-03T10:13:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.298+0000 7f3a88380700 1 -- start start 2023-10-03T10:13:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f75a0035700 1 Processor -- start 2023-10-03T10:13:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f75a0035700 1 -- start start 2023-10-03T10:13:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a88380700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 0x7f3a80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a88380700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 0x7f3a8013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a88380700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8006b2d0 con 0x7f3a801300a0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a88380700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80133610 con 0x7f3a80130bc0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a88380700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8009a500 con 0x7f3a80133ad0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8691d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 0x7f3a8013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8591b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3a801300a0 0x7f3a801304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48450/0 (socket says 172.21.15.125:48450) 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8611c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 0x7f3a80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8591b700 1 -- 172.21.15.125:0/3912564974 learned_addr learned my addr 172.21.15.125:0/3912564974 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8691d700 1 -- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 msgr2=0x7f3a80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8691d700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 0x7f3a80133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8691d700 1 -- 172.21.15.125:0/3912564974 >> v1:172.21.15.125:6789/0 conn(0x7f3a801300a0 legacy=0x7f3a801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8691d700 1 -- 172.21.15.125:0/3912564974 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a801338b0 con 0x7f3a80130bc0 2023-10-03T10:13:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.299+0000 7f3a8611c700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 0x7f3a80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f3a8691d700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 0x7f3a8013b990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009dc0 tx=0x7f3a7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e531aa612a8ea045 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f75a0035700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a1510 0x7f75981351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f75a0035700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75981356e0 0x7f7598137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f75a0035700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980a1e70 con 0x7f75980a0a30 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f75a0035700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759809a720 con 0x7f75981356e0 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f75a0035700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759809b300 con 0x7f75980a1510 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75981356e0 0x7f7598137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75981356e0 0x7f7598137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55750/0 (socket says 172.21.15.125:55750) 2023-10-03T10:13:08.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 -- 172.21.15.125:0/769619218 learned_addr learned my addr 172.21.15.125:0/769619218 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759d5d0700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a1510 0x7f75981351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f3a8511a700 1 -- 172.21.15.125:0/3912564974 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800e070 con 0x7f3a80130bc0 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759cdcf700 1 -- 172.21.15.125:0/769619218 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822298809 0 0) 0x7f75980a1e70 con 0x7f75980a0a30 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759cdcf700 1 -- 172.21.15.125:0/769619218 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75840057c0 con 0x7f75980a0a30 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 -- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a1510 msgr2=0x7f75981351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a1510 0x7f75981351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 -- 172.21.15.125:0/769619218 >> v1:172.21.15.125:6789/0 conn(0x7f75980a0a30 legacy=0x7f75980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 -- 172.21.15.125:0/769619218 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759809abc0 con 0x7f75981356e0 2023-10-03T10:13:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f3a8511a700 1 -- 172.21.15.125:0/3912564974 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7800bb20 con 0x7f3a80130bc0 2023-10-03T10:13:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f3a8511a700 1 -- 172.21.15.125:0/3912564974 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78012430 con 0x7f3a80130bc0 2023-10-03T10:13:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759e5d2700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75981356e0 0x7f7598137ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7590009d40 tx=0x7f759000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381062d2174ec382 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759cdcf700 1 -- 172.21.15.125:0/769619218 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000bb10 con 0x7f75981356e0 2023-10-03T10:13:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759cdcf700 1 -- 172.21.15.125:0/769619218 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590009e90 con 0x7f75981356e0 2023-10-03T10:13:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.300+0000 7f759cdcf700 1 -- 172.21.15.125:0/769619218 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900115e0 con 0x7f75981356e0 2023-10-03T10:13:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 -- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 msgr2=0x7f3a8013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 0x7f3a8013b990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009dc0 tx=0x7f3a7800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 -- 172.21.15.125:0/3912564974 shutdown_connections 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a80130bc0 0x7f3a8013b990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 --2- 172.21.15.125:0/3912564974 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80133ad0 0x7f3a80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 -- 172.21.15.125:0/3912564974 >> 172.21.15.125:0/3912564974 conn(0x7f3a80099c40 msgr2=0x7f3a800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 -- 172.21.15.125:0/3912564974 shutdown_connections 2023-10-03T10:13:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f3a88380700 1 -- 172.21.15.125:0/3912564974 wait complete. 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 -- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75981356e0 msgr2=0x7f7598137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75981356e0 0x7f7598137ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7590009d40 tx=0x7f759000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 -- 172.21.15.125:0/769619218 shutdown_connections 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75981356e0 0x7f7598137ac0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 --2- 172.21.15.125:0/769619218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a1510 0x7f75981351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 -- 172.21.15.125:0/769619218 >> 172.21.15.125:0/769619218 conn(0x7f75980a2980 msgr2=0x7f75980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 -- 172.21.15.125:0/769619218 shutdown_connections 2023-10-03T10:13:08.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.301+0000 7f75a0035700 1 -- 172.21.15.125:0/769619218 wait complete. 2023-10-03T10:13:08.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 Processor -- start 2023-10-03T10:13:08.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 -- start start 2023-10-03T10:13:08.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f75a0035700 1 Processor -- start 2023-10-03T10:13:08.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f75a0035700 1 -- start start 2023-10-03T10:13:08.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 0x7f3a8011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 0x7f3a8011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a80133ad0 0x7f3a8011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80120210 con 0x7f3a80133ad0 2023-10-03T10:13:08.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8012dd00 con 0x7f3a801300a0 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a88380700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800a2ea0 con 0x7f3a80130bc0 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a8611c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 0x7f3a8011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a8611c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 0x7f3a8011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45364/0 (socket says 172.21.15.125:45364) 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a8611c700 1 -- 172.21.15.125:0/1144943970 learned_addr learned my addr 172.21.15.125:0/1144943970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a8591b700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 0x7f3a8011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.302+0000 7f3a8691d700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a80133ad0 0x7f3a8011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75980a1510 0x7f7598071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75981356e0 0x7f75981c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7598119b90 con 0x7f75980a1510 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759811afb0 con 0x7f75981356e0 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f75a0035700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759811ac30 con 0x7f75980a0a30 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41390/0 (socket says 172.21.15.125:41390) 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 -- 172.21.15.125:0/872636220 learned_addr learned my addr 172.21.15.125:0/872636220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759e5d2700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75981356e0 0x7f75981c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 -- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 msgr2=0x7f3a8011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 0x7f3a8011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 -- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a80133ad0 msgr2=0x7f3a8011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a80133ad0 0x7f3a8011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 -- 172.21.15.125:0/1144943970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0094a0 con 0x7f3a80130bc0 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759d5d0700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75980a1510 0x7f7598071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 -- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75981356e0 msgr2=0x7f75981c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75981356e0 0x7f75981c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 -- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75980a1510 msgr2=0x7f7598071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75980a1510 0x7f7598071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a8591b700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 0x7f3a8011df80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c390 tx=0x7f3a7000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 -- 172.21.15.125:0/872636220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759000d040 con 0x7f75980a0a30 2023-10-03T10:13:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70005b40 con 0x7f3a80130bc0 2023-10-03T10:13:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70005ca0 con 0x7f3a80130bc0 2023-10-03T10:13:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a78009a70 con 0x7f3a80130bc0 2023-10-03T10:13:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f759ddd1700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f759400c730 tx=0x7f759400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940052d0 con 0x7f75980a0a30 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594005430 con 0x7f75980a0a30 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7598118f20 con 0x7f75980a0a30 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598071770 con 0x7f75980a0a30 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940038a0 con 0x7f75980a0a30 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700072f0 con 0x7f3a80130bc0 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.303+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8011fe90 con 0x7f3a80130bc0 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a70007450 con 0x7f3a80130bc0 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.304+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a7003e930 con 0x7f3a80130bc0 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.305+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8004f2a0 con 0x7f3a80130bc0 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.305+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7594003a00 con 0x7f75980a0a30 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.305+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f759403ec10 con 0x7f75980a0a30 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.305+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75800052e0 con 0x7f75980a0a30 2023-10-03T10:13:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.309+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a70017080 con 0x7f3a80130bc0 2023-10-03T10:13:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.313+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7594017080 con 0x7f75980a0a30 2023-10-03T10:13:08.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.502+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a800008d0 con 0x7f3a80130bc0 2023-10-03T10:13:08.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.503+0000 7f3a76ffd700 1 -- 172.21.15.125:0/1144943970 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a700194a0 con 0x7f3a80130bc0 2023-10-03T10:13:08.503 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:08.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 msgr2=0x7f3a8011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 0x7f3a8011df80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c390 tx=0x7f3a7000c6a0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 shutdown_connections 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a80133ad0 0x7f3a8011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a801300a0 0x7f3a8011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 --2- 172.21.15.125:0/1144943970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a80130bc0 0x7f3a8011df80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 >> 172.21.15.125:0/1144943970 conn(0x7f3a80099c40 msgr2=0x7f3a801320a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 shutdown_connections 2023-10-03T10:13:08.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.505+0000 7f3a88380700 1 -- 172.21.15.125:0/1144943970 wait complete. 2023-10-03T10:13:08.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.508+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7580005590 con 0x7f75980a0a30 2023-10-03T10:13:08.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.508+0000 7f758e7fc700 1 -- 172.21.15.125:0/872636220 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7594018260 con 0x7f75980a0a30 2023-10-03T10:13:08.508 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:08.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 msgr2=0x7f7598070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f759400c730 tx=0x7f759400ca40 comp rx=0 tx=0).stop 2023-10-03T10:13:08.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 shutdown_connections 2023-10-03T10:13:08.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75981356e0 0x7f75981c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75980a0a30 0x7f7598070cf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 --2- 172.21.15.125:0/872636220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75980a1510 0x7f7598071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 >> 172.21.15.125:0/872636220 conn(0x7f75980a2980 msgr2=0x7f7598130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 shutdown_connections 2023-10-03T10:13:08.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.511+0000 7f75a0035700 1 -- 172.21.15.125:0/872636220 wait complete. 2023-10-03T10:13:08.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:08.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:08.551 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:08.553 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:08.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.687+0000 7f0a9b3d3700 1 Processor -- start 2023-10-03T10:13:08.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.687+0000 7f552ee6a700 1 Processor -- start 2023-10-03T10:13:08.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.687+0000 7f0a9b3d3700 1 -- start start 2023-10-03T10:13:08.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.687+0000 7f552ee6a700 1 -- start start 2023-10-03T10:13:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9b3d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a940a0a70 0x7f0a940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9b3d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a940a1380 0x7f0a94133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9b3d3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9409dc00 con 0x7f0a94133f50 2023-10-03T10:13:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9b3d3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9409ea60 con 0x7f0a940a0a70 2023-10-03T10:13:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9b3d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9409dec0 con 0x7f0a940a1380 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 0x7f5528133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552806b2d0 con 0x7f5528133ad0 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5528133610 con 0x7f55281309f0 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552ee6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552809a500 con 0x7f55281300a0 2023-10-03T10:13:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9916f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a940a0a70 0x7f0a940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a99970700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0a94133f50 0x7f0a9413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48472/0 (socket says 172.21.15.125:48472) 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a99970700 1 -- 172.21.15.125:0/2260995772 learned_addr learned my addr 172.21.15.125:0/2260995772 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9896e700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a940a1380 0x7f0a94133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552d407700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f5527fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552d407700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45398/0 (socket says 172.21.15.125:45398) 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552d407700 1 -- 172.21.15.125:0/2116821922 learned_addr learned my addr 172.21.15.125:0/2116821922 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f5527fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41400/0 (socket says 172.21.15.125:41400) 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f552cc06700 1 --2- 172.21.15.125:0/2116821922 >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 0x7f5528133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9916f700 1 -- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a940a1380 msgr2=0x7f0a94133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9916f700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a940a1380 0x7f0a94133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9916f700 1 -- 172.21.15.125:0/2260995772 >> v1:172.21.15.125:6789/0 conn(0x7f0a94133f50 legacy=0x7f0a9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.688+0000 7f0a9916f700 1 -- 172.21.15.125:0/2260995772 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9409e6a0 con 0x7f0a940a0a70 2023-10-03T10:13:08.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 -- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 msgr2=0x7f552813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 --2- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 -- 172.21.15.125:0/2116821922 >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 msgr2=0x7f5528133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 --2- 172.21.15.125:0/2116821922 >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 0x7f5528133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 -- 172.21.15.125:0/2116821922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55281338b0 con 0x7f55281300a0 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f552cc06700 1 --2- 172.21.15.125:0/2116821922 >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 0x7f5528133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a9916f700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a940a0e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009840 tx=0x7f0a90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dacf055f2fbd7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f5527fff700 1 --2- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5514009840 tx=0x7f5514009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cbf1f61dc51cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a8bfff700 1 -- 172.21.15.125:0/2260995772 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90011830 con 0x7f0a940a0a70 2023-10-03T10:13:08.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a8bfff700 1 -- 172.21.15.125:0/2260995772 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90011990 con 0x7f0a940a0a70 2023-10-03T10:13:08.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a8bfff700 1 -- 172.21.15.125:0/2260995772 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90011d20 con 0x7f0a940a0a70 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f55277fe700 1 -- 172.21.15.125:0/2116821922 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011830 con 0x7f55281300a0 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f55277fe700 1 -- 172.21.15.125:0/2116821922 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5514011990 con 0x7f55281300a0 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f55277fe700 1 -- 172.21.15.125:0/2116821922 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011d20 con 0x7f55281300a0 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 msgr2=0x7f0a940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.689+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a940a0e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009840 tx=0x7f0a90009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:08.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/2260995772 shutdown_connections 2023-10-03T10:13:08.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 -- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 msgr2=0x7f55281304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 --2- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5514009840 tx=0x7f5514009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:08.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a940a0e40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/2260995772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a940a1380 0x7f0a94133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/2260995772 >> 172.21.15.125:0/2260995772 conn(0x7f0a940a6610 msgr2=0x7f0a940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 -- 172.21.15.125:0/2116821922 shutdown_connections 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 --2- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 --2- 172.21.15.125:0/2116821922 >> v2:172.21.15.125:3300/0 conn(0x7f5528133ad0 0x7f5528133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 --2- 172.21.15.125:0/2116821922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f55281304b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 -- 172.21.15.125:0/2116821922 >> 172.21.15.125:0/2116821922 conn(0x7f5528099c40 msgr2=0x7f55280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 -- 172.21.15.125:0/2116821922 shutdown_connections 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/2260995772 shutdown_connections 2023-10-03T10:13:08.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f552ee6a700 1 -- 172.21.15.125:0/2116821922 wait complete. 2023-10-03T10:13:08.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.690+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/2260995772 wait complete. 2023-10-03T10:13:08.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 Processor -- start 2023-10-03T10:13:08.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 -- start start 2023-10-03T10:13:08.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 Processor -- start 2023-10-03T10:13:08.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 -- start start 2023-10-03T10:13:08.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a9411e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a940a1380 0x7f0a9411ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 0x7f0a9411f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94133b60 con 0x7f0a940a0a70 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94133840 con 0x7f0a94133f50 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9b3d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94120560 con 0x7f0a940a1380 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9916f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a9411e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9916f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a9411e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55792/0 (socket says 172.21.15.125:55792) 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a9916f700 1 -- 172.21.15.125:0/3209265345 learned_addr learned my addr 172.21.15.125:0/3209265345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f0a99970700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 0x7f0a9411f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f552811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552811fcc0 con 0x7f5528133ad0 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5528072020 con 0x7f55281309f0 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552ee6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55280a3370 con 0x7f55281300a0 2023-10-03T10:13:08.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552d407700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552d407700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55794/0 (socket says 172.21.15.125:55794) 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.691+0000 7f552d407700 1 -- 172.21.15.125:0/3191052898 learned_addr learned my addr 172.21.15.125:0/3191052898 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f5527fff700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552cc06700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f552811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 -- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 msgr2=0x7f552811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f552811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 -- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 msgr2=0x7f552811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 -- 172.21.15.125:0/3191052898 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0094a0 con 0x7f5528133ad0 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f5527fff700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:08.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552d407700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f552000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a9896e700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a940a1380 0x7f0a9411ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520003c20 con 0x7f5528133ad0 2023-10-03T10:13:08.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f5528133ad0 2023-10-03T10:13:08.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55140094a0 con 0x7f5528133ad0 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 -- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a940a1380 msgr2=0x7f0a9411ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a940a1380 0x7f0a9411ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 -- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 msgr2=0x7f0a9411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a9411e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 -- 172.21.15.125:0/3209265345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900094a0 con 0x7f0a94133f50 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a99970700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 0x7f0a9411f3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cad0 tx=0x7f0a8c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00a960 con 0x7f0a94133f50 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00aac0 con 0x7f0a94133f50 2023-10-03T10:13:08.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a941220f0 con 0x7f0a94133f50 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00ae30 con 0x7f0a94133f50 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a941223d0 con 0x7f0a94133f50 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552811ffa0 con 0x7f5528133ad0 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.692+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520009e60 con 0x7f5528133ad0 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.693+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9404f2a0 con 0x7f0a94133f50 2023-10-03T10:13:08.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.693+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f552000c930 con 0x7f5528133ad0 2023-10-03T10:13:08.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.693+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080052e0 con 0x7f5528133ad0 2023-10-03T10:13:08.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.694+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f552003f980 con 0x7f5528133ad0 2023-10-03T10:13:08.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.694+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a8c01b3b0 con 0x7f0a94133f50 2023-10-03T10:13:08.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.694+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a8c03f180 con 0x7f0a94133f50 2023-10-03T10:13:08.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.698+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5520013bd0 con 0x7f5528133ad0 2023-10-03T10:13:08.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.698+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a8c0192c0 con 0x7f0a94133f50 2023-10-03T10:13:08.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.888+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a94121d40 con 0x7f0a94133f50 2023-10-03T10:13:08.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.889+0000 7f0a89ffb700 1 -- 172.21.15.125:0/3209265345 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a8c017030 con 0x7f0a94133f50 2023-10-03T10:13:08.888 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:08.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.890+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5508005150 con 0x7f5528133ad0 2023-10-03T10:13:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.890+0000 7f55257fa700 1 -- 172.21.15.125:0/3191052898 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5520014e00 con 0x7f5528133ad0 2023-10-03T10:13:08.890 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 msgr2=0x7f0a9411f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 0x7f0a9411f3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cad0 tx=0x7f0a8c00cde0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 shutdown_connections 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a94133f50 0x7f0a9411f3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a940a0a70 0x7f0a9411e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 --2- 172.21.15.125:0/3209265345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a940a1380 0x7f0a9411ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 >> 172.21.15.125:0/3209265345 conn(0x7f0a940a6610 msgr2=0x7f0a940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 shutdown_connections 2023-10-03T10:13:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.891+0000 7f0a9b3d3700 1 -- 172.21.15.125:0/3209265345 wait complete. 2023-10-03T10:13:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.892+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 msgr2=0x7f552811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.892+0000 7f552ee6a700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f552000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 shutdown_connections 2023-10-03T10:13:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5528133ad0 0x7f552811e4c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55281300a0 0x7f552811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 --2- 172.21.15.125:0/3191052898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55281309f0 0x7f552811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 >> 172.21.15.125:0/3191052898 conn(0x7f5528099c40 msgr2=0x7f5528132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 shutdown_connections 2023-10-03T10:13:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:08.893+0000 7f552ee6a700 1 -- 172.21.15.125:0/3191052898 wait complete. 2023-10-03T10:13:08.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:08.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:09.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:09.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:09.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 Processor -- start 2023-10-03T10:13:09.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 -- start start 2023-10-03T10:13:09.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25d80a1380 0x7f25d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 0x7f25d8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d809e9d0 con 0x7f25d80a1380 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d809dc00 con 0x7f25d8133f50 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.649+0000 7f25df129700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d809dec0 con 0x7f25d80a0a70 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dcec5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25d80a1380 0x7f25d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dcec5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41414/0 (socket says 172.21.15.125:41414) 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dcec5700 1 -- 172.21.15.125:0/1952452567 learned_addr learned my addr 172.21.15.125:0/1952452567 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dd6c6700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 0x7f25d8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 -- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 msgr2=0x7f25d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 -- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 msgr2=0x7f25d8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 0x7f25d8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 -- 172.21.15.125:0/1952452567 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d809e6a0 con 0x7f25d80a1380 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dcec5700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25dd6c6700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 0x7f25d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d7fff700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d80a1380 0x7f25d8133a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009840 tx=0x7f25c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c302dfba57543249 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d77fe700 1 -- 172.21.15.125:0/1952452567 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011830 con 0x7f25d80a1380 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d77fe700 1 -- 172.21.15.125:0/1952452567 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4011990 con 0x7f25d80a1380 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.650+0000 7f25d77fe700 1 -- 172.21.15.125:0/1952452567 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011d20 con 0x7f25d80a1380 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 -- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d80a1380 msgr2=0x7f25d8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d80a1380 0x7f25d8133a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009840 tx=0x7f25c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:09.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 -- 172.21.15.125:0/1952452567 shutdown_connections 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d8133f50 0x7f25d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 --2- 172.21.15.125:0/1952452567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d80a1380 0x7f25d8133a10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 -- 172.21.15.125:0/1952452567 >> 172.21.15.125:0/1952452567 conn(0x7f25d80a6610 msgr2=0x7f25d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 -- 172.21.15.125:0/1952452567 shutdown_connections 2023-10-03T10:13:09.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.651+0000 7f25df129700 1 -- 172.21.15.125:0/1952452567 wait complete. 2023-10-03T10:13:09.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 Processor -- start 2023-10-03T10:13:09.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 -- start start 2023-10-03T10:13:09.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d8122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 0x7f25d8122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8133760 con 0x7f25d8133f50 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81237f0 con 0x7f25d80a1380 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.652+0000 7f25df129700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8124e30 con 0x7f25d80a0a70 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45444/0 (socket says 172.21.15.125:45444) 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25dd6c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 0x7f25d8122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 -- 172.21.15.125:0/2367138609 learned_addr learned my addr 172.21.15.125:0/2367138609 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25dcec5700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d8122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 -- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 msgr2=0x7f25d8122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d8122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 -- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 msgr2=0x7f25d8122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 0x7f25d8122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 -- 172.21.15.125:0/2367138609 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc009550 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25dd6c6700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 0x7f25d8122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d7fff700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25c4013000 tx=0x7f25c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40044d0 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c401f070 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0009a70 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40038e0 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.653+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40094a0 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.654+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25c4003a40 con 0x7f25d80a1380 2023-10-03T10:13:09.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.654+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25c4021070 con 0x7f25d80a1380 2023-10-03T10:13:09.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.654+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d811f760 con 0x7f25d80a1380 2023-10-03T10:13:09.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.659+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c4015020 con 0x7f25d80a1380 2023-10-03T10:13:09.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.690+0000 7ffa7592f700 1 Processor -- start 2023-10-03T10:13:09.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.690+0000 7ffa7592f700 1 -- start start 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7006b2d0 con 0x7ffa70133ad0 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70133610 con 0x7ffa701300a0 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa7592f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7009a500 con 0x7ffa701309f0 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55820/0 (socket says 172.21.15.125:55820) 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41436/0 (socket says 172.21.15.125:41436) 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6effd700 1 -- 172.21.15.125:0/2905310681 learned_addr learned my addr 172.21.15.125:0/2905310681 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 -- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 msgr2=0x7ffa7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 -- 172.21.15.125:0/2905310681 >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 msgr2=0x7ffa70133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 --2- 172.21.15.125:0/2905310681 >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 -- 172.21.15.125:0/2905310681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa701338b0 con 0x7ffa701300a0 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6effd700 1 --2- 172.21.15.125:0/2905310681 >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6f7fe700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.691+0000 7ffa6e7fc700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa701304b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009840 tx=0x7ffa60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10f5505d6f096693 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa6dffb700 1 -- 172.21.15.125:0/2905310681 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011830 con 0x7ffa701300a0 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa6dffb700 1 -- 172.21.15.125:0/2905310681 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60011990 con 0x7ffa701300a0 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa6dffb700 1 -- 172.21.15.125:0/2905310681 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011d20 con 0x7ffa701300a0 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 -- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 msgr2=0x7ffa701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa701304b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009840 tx=0x7ffa60009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 -- 172.21.15.125:0/2905310681 shutdown_connections 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 --2- 172.21.15.125:0/2905310681 >> v2:172.21.15.125:3300/0 conn(0x7ffa70133ad0 0x7ffa70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 --2- 172.21.15.125:0/2905310681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa701304b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 -- 172.21.15.125:0/2905310681 >> 172.21.15.125:0/2905310681 conn(0x7ffa70099c40 msgr2=0x7ffa700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 -- 172.21.15.125:0/2905310681 shutdown_connections 2023-10-03T10:13:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.692+0000 7ffa7592f700 1 -- 172.21.15.125:0/2905310681 wait complete. 2023-10-03T10:13:09.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.693+0000 7ffa7592f700 1 Processor -- start 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.693+0000 7ffa7592f700 1 -- start start 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700720e0 con 0x7ffa70133ad0 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7011fa40 con 0x7ffa701300a0 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa7592f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7012dd00 con 0x7ffa701309f0 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55830/0 (socket says 172.21.15.125:55830) 2023-10-03T10:13:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6f7fe700 1 -- 172.21.15.125:0/1990417639 learned_addr learned my addr 172.21.15.125:0/1990417639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45474/0 (socket says 172.21.15.125:45474) 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6e7fc700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 -- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 msgr2=0x7ffa7011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 -- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 msgr2=0x7ffa7011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 -- 172.21.15.125:0/1990417639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009a70 con 0x7ffa701300a0 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6f7fe700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa6effd700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e9a0 tx=0x7ffa6400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.694+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004030 con 0x7ffa701300a0 2023-10-03T10:13:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64004190 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa64009550 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004520 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600094a0 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa640036a0 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa6403f860 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.695+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7004f2a0 con 0x7ffa701300a0 2023-10-03T10:13:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.700+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa64011bd0 con 0x7ffa701300a0 2023-10-03T10:13:09.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.854+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25d80a5180 con 0x7f25d80a1380 2023-10-03T10:13:09.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.854+0000 7f25d57fa700 1 -- 172.21.15.125:0/2367138609 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c4033070 con 0x7f25d80a1380 2023-10-03T10:13:09.854 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 msgr2=0x7f25d81228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25c4013000 tx=0x7f25c4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 shutdown_connections 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d8133f50 0x7f25d8122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25d80a0a70 0x7f25d8122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 --2- 172.21.15.125:0/2367138609 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25d80a1380 0x7f25d81228d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 >> 172.21.15.125:0/2367138609 conn(0x7f25d80a6610 msgr2=0x7f25d811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 shutdown_connections 2023-10-03T10:13:09.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.856+0000 7f25df129700 1 -- 172.21.15.125:0/2367138609 wait complete. 2023-10-03T10:13:09.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:09.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.893+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa7006c3b0 con 0x7ffa701300a0 2023-10-03T10:13:09.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.893+0000 7ffa57fff700 1 -- 172.21.15.125:0/1990417639 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa6402a090 con 0x7ffa701300a0 2023-10-03T10:13:09.893 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 msgr2=0x7ffa7011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e9a0 tx=0x7ffa6400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 shutdown_connections 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa70133ad0 0x7ffa7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa701300a0 0x7ffa7011da40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 --2- 172.21.15.125:0/1990417639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa701309f0 0x7ffa7011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 >> 172.21.15.125:0/1990417639 conn(0x7ffa70099c40 msgr2=0x7ffa7012e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 shutdown_connections 2023-10-03T10:13:09.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:09.895+0000 7ffa7592f700 1 -- 172.21.15.125:0/1990417639 wait complete. 2023-10-03T10:13:09.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:09.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:09.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:10.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 Processor -- start 2023-10-03T10:13:10.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 -- start start 2023-10-03T10:13:10.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 Processor -- start 2023-10-03T10:13:10.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 -- start start 2023-10-03T10:13:10.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc099e20 0x7fe9cc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc099a60 con 0x7fe9cc09a730 2023-10-03T10:13:10.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09bf50 con 0x7fe9cc130a60 2023-10-03T10:13:10.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9d112b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09b230 con 0x7fe9cc099e20 2023-10-03T10:13:10.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9cb59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6de8133ad0 0x7f6de8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de81300a0 0x7f6de81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9cb59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45486/0 (socket says 172.21.15.125:45486) 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9cb59e700 1 -- 172.21.15.125:0/1214537356 learned_addr learned my addr 172.21.15.125:0/1214537356 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de806b2d0 con 0x7f6de8133ad0 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8133610 con 0x7f6de81309f0 2023-10-03T10:13:10.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6dee498700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de809a500 con 0x7f6de81300a0 2023-10-03T10:13:10.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7fe9cad9d700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc099e20 0x7fe9cc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6deca35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6deca35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45494/0 (socket says 172.21.15.125:45494) 2023-10-03T10:13:10.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.032+0000 7f6deca35700 1 -- 172.21.15.125:0/409149398 learned_addr learned my addr 172.21.15.125:0/409149398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:10.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6de77fe700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de81300a0 0x7f6de81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9cb59e700 1 -- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc099e20 msgr2=0x7fe9cc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9cb59e700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc099e20 0x7fe9cc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9cb59e700 1 -- 172.21.15.125:0/1214537356 >> v1:172.21.15.125:6789/0 conn(0x7fe9cc09a730 legacy=0x7fe9cc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9cb59e700 1 -- 172.21.15.125:0/1214537356 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc09bb90 con 0x7fe9cc130a60 2023-10-03T10:13:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 -- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de81300a0 msgr2=0x7f6de81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de81300a0 0x7f6de81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 -- 172.21.15.125:0/409149398 >> v2:172.21.15.125:3300/0 conn(0x7f6de8133ad0 msgr2=0x7f6de8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 --2- 172.21.15.125:0/409149398 >> v2:172.21.15.125:3300/0 conn(0x7f6de8133ad0 0x7f6de8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 -- 172.21.15.125:0/409149398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de81338b0 con 0x7f6de81309f0 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9cb59e700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d180 tx=0x7fe9c400d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfddd026b7a59665 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6deca35700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fc75f92159d256 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9c9d9b700 1 -- 172.21.15.125:0/1214537356 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4010070 con 0x7fe9cc130a60 2023-10-03T10:13:10.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9c9d9b700 1 -- 172.21.15.125:0/1214537356 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400b2e0 con 0x7fe9cc130a60 2023-10-03T10:13:10.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7fe9c9d9b700 1 -- 172.21.15.125:0/1214537356 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4003c60 con 0x7fe9cc130a60 2023-10-03T10:13:10.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6de6ffd700 1 -- 172.21.15.125:0/409149398 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000e070 con 0x7f6de81309f0 2023-10-03T10:13:10.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6de6ffd700 1 -- 172.21.15.125:0/409149398 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000b910 con 0x7f6de81309f0 2023-10-03T10:13:10.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.033+0000 7f6de6ffd700 1 -- 172.21.15.125:0/409149398 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000bcc0 con 0x7f6de81309f0 2023-10-03T10:13:10.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 -- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 msgr2=0x7fe9cc138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d180 tx=0x7fe9c400d490 comp rx=0 tx=0).stop 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 -- 172.21.15.125:0/1214537356 shutdown_connections 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc130a60 0x7fe9cc138690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1214537356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc099e20 0x7fe9cc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 -- 172.21.15.125:0/1214537356 >> 172.21.15.125:0/1214537356 conn(0x7fe9cc0a2980 msgr2=0x7fe9cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 -- 172.21.15.125:0/1214537356 shutdown_connections 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 -- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 msgr2=0x7f6de813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7fe9d112b700 1 -- 172.21.15.125:0/1214537356 wait complete. 2023-10-03T10:13:10.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 -- 172.21.15.125:0/409149398 shutdown_connections 2023-10-03T10:13:10.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de813a980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 --2- 172.21.15.125:0/409149398 >> v2:172.21.15.125:3300/0 conn(0x7f6de8133ad0 0x7f6de8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 --2- 172.21.15.125:0/409149398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de81300a0 0x7f6de81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 -- 172.21.15.125:0/409149398 >> 172.21.15.125:0/409149398 conn(0x7f6de8099c40 msgr2=0x7f6de80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 -- 172.21.15.125:0/409149398 shutdown_connections 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.034+0000 7f6dee498700 1 -- 172.21.15.125:0/409149398 wait complete. 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.035+0000 7f6dee498700 1 Processor -- start 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.035+0000 7fe9d112b700 1 Processor -- start 2023-10-03T10:13:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.035+0000 7f6dee498700 1 -- start start 2023-10-03T10:13:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.035+0000 7fe9d112b700 1 -- start start 2023-10-03T10:13:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 0x7fe9cc1202e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 0x7f6de811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 0x7fe9cc120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc121270 con 0x7fe9cc130a60 2023-10-03T10:13:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc123280 con 0x7fe9cc099e20 2023-10-03T10:13:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de811fe10 con 0x7f6de81300a0 2023-10-03T10:13:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8120010 con 0x7f6de81309f0 2023-10-03T10:13:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6dee498700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de811eaf0 con 0x7f6de8133ad0 2023-10-03T10:13:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9d112b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc123620 con 0x7fe9cc09a730 2023-10-03T10:13:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55846/0 (socket says 172.21.15.125:55846) 2023-10-03T10:13:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6de7fff700 1 -- 172.21.15.125:0/264611602 learned_addr learned my addr 172.21.15.125:0/264611602 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6de77fe700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 0x7f6de811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 0x7fe9cc1202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45510/0 (socket says 172.21.15.125:45510) 2023-10-03T10:13:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cad9d700 1 -- 172.21.15.125:0/1427328969 learned_addr learned my addr 172.21.15.125:0/1427328969 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cb59e700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 0x7fe9cc120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 -- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 msgr2=0x7f6de811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 -- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 msgr2=0x7f6de811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 -- 172.21.15.125:0/264611602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009b30 con 0x7f6de8133ad0 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6de7fff700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7f6deca35700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 0x7f6de811e4c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6de0015000 tx=0x7f6de0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 -- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 msgr2=0x7fe9cc11fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 -- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 msgr2=0x7fe9cc120820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 0x7fe9cc120820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9ca59c700 1 -- 172.21.15.125:0/1427328969 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c400bd40 con 0x7fe9cc09a730 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cad9d700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.036+0000 7fe9cb59e700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 0x7fe9cc120820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9ca59c700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 0x7fe9cc1202e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c750 tx=0x7fe9c000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00092e0 con 0x7f6de8133ad0 2023-10-03T10:13:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0004250 con 0x7f6de8133ad0 2023-10-03T10:13:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de812dd00 con 0x7f6de8133ad0 2023-10-03T10:13:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0004600 con 0x7f6de8133ad0 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00054e0 con 0x7fe9cc09a730 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0003680 con 0x7fe9cc09a730 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00039f0 con 0x7fe9cc09a730 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc123820 con 0x7fe9cc09a730 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de811edd0 con 0x7f6de8133ad0 2023-10-03T10:13:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.037+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc0a15d0 con 0x7fe9cc09a730 2023-10-03T10:13:10.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6de0004760 con 0x7f6de8133ad0 2023-10-03T10:13:10.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de811fc50 con 0x7f6de8133ad0 2023-10-03T10:13:10.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc072480 con 0x7fe9cc09a730 2023-10-03T10:13:10.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6de0040c50 con 0x7f6de8133ad0 2023-10-03T10:13:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9c0003b50 con 0x7fe9cc09a730 2023-10-03T10:13:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.038+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9c003ee90 con 0x7fe9cc09a730 2023-10-03T10:13:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.042+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6de0019350 con 0x7f6de8133ad0 2023-10-03T10:13:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.047+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9c0003e00 con 0x7fe9cc09a730 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.238+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6de8120950 con 0x7f6de8133ad0 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.238+0000 7f6de4ff9700 1 -- 172.21.15.125:0/264611602 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6de0020070 con 0x7f6de8133ad0 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 msgr2=0x7f6de811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 0x7f6de811e4c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6de0015000 tx=0x7f6de0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 shutdown_connections 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6de8133ad0 0x7f6de811e4c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de81300a0 0x7f6de811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 --2- 172.21.15.125:0/264611602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de81309f0 0x7f6de811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 >> 172.21.15.125:0/264611602 conn(0x7f6de8099c40 msgr2=0x7f6de812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 shutdown_connections 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.240+0000 7f6dee498700 1 -- 172.21.15.125:0/264611602 wait complete. 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.241+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9cc123480 con 0x7fe9cc09a730 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.242+0000 7fe9b37fe700 1 -- 172.21.15.125:0/1427328969 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9cc123480 con 0x7fe9cc09a730 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 msgr2=0x7fe9cc1202e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 0x7fe9cc1202e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c750 tx=0x7fe9c000ca60 comp rx=0 tx=0).stop 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 shutdown_connections 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9cc130a60 0x7fe9cc120820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9cc099e20 0x7fe9cc11fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 --2- 172.21.15.125:0/1427328969 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9cc09a730 0x7fe9cc1202e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 >> 172.21.15.125:0/1427328969 conn(0x7fe9cc0a2980 msgr2=0x7fe9cc12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 shutdown_connections 2023-10-03T10:13:10.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.244+0000 7fe9d112b700 1 -- 172.21.15.125:0/1427328969 wait complete. 2023-10-03T10:13:10.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:10.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:10.869 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:10.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:10.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:10.999+0000 7fba9f2c5700 1 Processor -- start 2023-10-03T10:13:10.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 -- start start 2023-10-03T10:13:11.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 0x7fba98133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9809fa00 con 0x7fba98134160 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980a0370 con 0x7fba9809f180 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9f2c5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba9806bec0 con 0x7fba9809e870 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9c860700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 0x7fba98133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9d061700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9d862700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fba98134160 0x7fba9813ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48498/0 (socket says 172.21.15.125:48498) 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9d862700 1 -- 172.21.15.125:0/3685791779 learned_addr learned my addr 172.21.15.125:0/3685791779 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9d061700 1 -- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 msgr2=0x7fba98133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.000+0000 7fba9d061700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 0x7fba98133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9d061700 1 -- 172.21.15.125:0/3685791779 >> v1:172.21.15.125:6789/0 conn(0x7fba98134160 legacy=0x7fba9813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9d061700 1 -- 172.21.15.125:0/3685791779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9809ada0 con 0x7fba9809e870 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba8ffff700 1 -- 172.21.15.125:0/3685791779 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964081824 0 0) 0x7fba9809fa00 con 0x7fba98134160 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9c860700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 0x7fba98133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9d061700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba9809ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba940098a0 tx=0x7fba94009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e956ab44ccda3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba8ffff700 1 -- 172.21.15.125:0/3685791779 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011830 con 0x7fba9809e870 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba8ffff700 1 -- 172.21.15.125:0/3685791779 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94011990 con 0x7fba9809e870 2023-10-03T10:13:11.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba8ffff700 1 -- 172.21.15.125:0/3685791779 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011d20 con 0x7fba9809e870 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9f2c5700 1 -- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 msgr2=0x7fba9809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.001+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba9809ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba940098a0 tx=0x7fba94009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 -- 172.21.15.125:0/3685791779 shutdown_connections 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba9809ec40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/3685791779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba9809f180 0x7fba98133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 -- 172.21.15.125:0/3685791779 >> 172.21.15.125:0/3685791779 conn(0x7fba980a4430 msgr2=0x7fba980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 -- 172.21.15.125:0/3685791779 shutdown_connections 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.002+0000 7fba9f2c5700 1 -- 172.21.15.125:0/3685791779 wait complete. 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 Processor -- start 2023-10-03T10:13:11.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 -- start start 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba981229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 0x7fba98123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba981264a0 con 0x7fba9809f180 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba98125c10 con 0x7fba98134160 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9f2c5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba980a1650 con 0x7fba9809e870 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9c860700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba981229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9c860700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55870/0 (socket says 172.21.15.125:55870) 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9c860700 1 -- 172.21.15.125:0/914532657 learned_addr learned my addr 172.21.15.125:0/914532657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d862700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 0x7fba98123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 -- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 msgr2=0x7fba98123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 0x7fba98123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 -- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 msgr2=0x7fba98122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d061700 1 -- 172.21.15.125:0/914532657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880094a0 con 0x7fba9809e870 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9c860700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.003+0000 7fba9d862700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 0x7fba98123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba9d061700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba981229d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba94016000 tx=0x7fba94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94004450 con 0x7fba9809e870 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9401f070 con 0x7fba9809e870 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba940094a0 con 0x7fba9809e870 2023-10-03T10:13:11.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940038e0 con 0x7fba9809e870 2023-10-03T10:13:11.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.004+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba98125f00 con 0x7fba9809e870 2023-10-03T10:13:11.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.005+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba94003a40 con 0x7fba9809e870 2023-10-03T10:13:11.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.005+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba981260f0 con 0x7fba9809e870 2023-10-03T10:13:11.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.005+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba94021070 con 0x7fba9809e870 2023-10-03T10:13:11.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.014+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba940045b0 con 0x7fba9809e870 2023-10-03T10:13:11.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.042+0000 7f0a21c37700 1 Processor -- start 2023-10-03T10:13:11.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.042+0000 7f0a21c37700 1 -- start start 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a21c37700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a21c37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a21c37700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c09af80 con 0x7f0a1c09edb0 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a21c37700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c09a520 con 0x7f0a1c09a150 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a21c37700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c09fe00 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0a1c09edb0 0x7f0a1c133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48504/0 (socket says 172.21.15.125:48504) 2023-10-03T10:13:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55872/0 (socket says 172.21.15.125:55872) 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1affd700 1 -- 172.21.15.125:0/3822693684 learned_addr learned my addr 172.21.15.125:0/3822693684 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45538/0 (socket says 172.21.15.125:45538) 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3822693684 >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 msgr2=0x7f0a1c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 --2- 172.21.15.125:0/3822693684 >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3822693684 >> v1:172.21.15.125:6789/0 conn(0x7f0a1c09edb0 legacy=0x7f0a1c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3822693684 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c06bc20 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1b7fe700 1 --2- 172.21.15.125:0/3822693684 >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.043+0000 7f0a1bfff700 1 --2- 172.21.15.125:0/3822693684 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009dc0 tx=0x7f0a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a62ac1bbe988139 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a1a7fc700 1 -- 172.21.15.125:0/3822693684 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00e070 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a1a7fc700 1 -- 172.21.15.125:0/3822693684 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00bae0 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a1a7fc700 1 -- 172.21.15.125:0/3822693684 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00be90 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 -- 172.21.15.125:0/3822693684 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 msgr2=0x7f0a1c134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3822693684 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009dc0 tx=0x7f0a0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 -- 172.21.15.125:0/3822693684 shutdown_connections 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3822693684 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09f1a0 0x7f0a1c134330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3822693684 >> v2:172.21.15.125:3300/0 conn(0x7f0a1c09a150 0x7f0a1c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 -- 172.21.15.125:0/3822693684 >> 172.21.15.125:0/3822693684 conn(0x7f0a1c0a4430 msgr2=0x7f0a1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 -- 172.21.15.125:0/3822693684 shutdown_connections 2023-10-03T10:13:11.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.044+0000 7f0a21c37700 1 -- 172.21.15.125:0/3822693684 wait complete. 2023-10-03T10:13:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.045+0000 7f0a21c37700 1 Processor -- start 2023-10-03T10:13:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.045+0000 7f0a21c37700 1 -- start start 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a1c09edb0 0x7f0a1c1c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 0x7f0a1c1c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1aada0 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c09be00 con 0x7f0a1c09a150 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a0440 con 0x7f0a1c09edb0 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 0x7f0a1c1c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45540/0 (socket says 172.21.15.125:45540) 2023-10-03T10:13:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1b7fe700 1 -- 172.21.15.125:0/3665531160 learned_addr learned my addr 172.21.15.125:0/3665531160 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1affd700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a1c09edb0 0x7f0a1c1c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a1c09edb0 msgr2=0x7f0a1c1c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a1c09edb0 0x7f0a1c1c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 msgr2=0x7f0a1c1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 -- 172.21.15.125:0/3665531160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140094a0 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1b7fe700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a1bfff700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 0x7f0a1c1c4d60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c016000 tx=0x7f0a0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004800 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c020070 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0276c0 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.046+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c009a70 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.047+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c1aa160 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.047+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a0c012430 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.047+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c09fa30 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.047+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a0c022070 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.052+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a0c072750 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.209+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba98123e80 con 0x7fba9809e870 2023-10-03T10:13:11.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.209+0000 7fba8dffb700 1 -- 172.21.15.125:0/914532657 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba9402b070 con 0x7fba9809e870 2023-10-03T10:13:11.209 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:11.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 msgr2=0x7fba981229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba981229d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba94016000 tx=0x7fba94004750 comp rx=0 tx=0).stop 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 shutdown_connections 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fba98134160 0x7fba98123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fba9809e870 0x7fba981229d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 --2- 172.21.15.125:0/914532657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba9809f180 0x7fba98122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 >> 172.21.15.125:0/914532657 conn(0x7fba980a4430 msgr2=0x7fba98070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 shutdown_connections 2023-10-03T10:13:11.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.212+0000 7fba9f2c5700 1 -- 172.21.15.125:0/914532657 wait complete. 2023-10-03T10:13:11.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:11.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.246+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a1c1aa160 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.247+0000 7f0a13fff700 1 -- 172.21.15.125:0/3665531160 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a1c1aa160 con 0x7f0a1c09f1a0 2023-10-03T10:13:11.246 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:11.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 msgr2=0x7f0a1c1c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 0x7f0a1c1c4d60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c016000 tx=0x7f0a0c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 shutdown_connections 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c09f1a0 0x7f0a1c1c4d60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a1c09a150 0x7f0a1c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 --2- 172.21.15.125:0/3665531160 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a1c09edb0 0x7f0a1c1c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 >> 172.21.15.125:0/3665531160 conn(0x7f0a1c0a4430 msgr2=0x7f0a1c0a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 shutdown_connections 2023-10-03T10:13:11.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.249+0000 7f0a21c37700 1 -- 172.21.15.125:0/3665531160 wait complete. 2023-10-03T10:13:11.254 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:11.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:11.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.381+0000 7fa8b213c700 1 Processor -- start 2023-10-03T10:13:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 -- start start 2023-10-03T10:13:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 0x7fa8ac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac09aaa0 con 0x7fa8ac130ce0 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac09f870 con 0x7fa8ac09d860 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8b213c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac09b360 con 0x7fa8ac09e170 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 0x7fa8ac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41516/0 (socket says 172.21.15.125:41516) 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8a2ffd700 1 -- 172.21.15.125:0/1214338534 learned_addr learned my addr 172.21.15.125:0/1214338534 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8abfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa8ac130ce0 0x7fa8ac1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48506/0 (socket says 172.21.15.125:48506) 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8a2ffd700 1 -- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 msgr2=0x7fa8ac09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8a2ffd700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 0x7fa8ac09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.382+0000 7fa8aaffd700 1 -- 172.21.15.125:0/1214338534 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056429085 0 0) 0x7fa8ac09aaa0 con 0x7fa8ac130ce0 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8a2ffd700 1 -- 172.21.15.125:0/1214338534 >> v1:172.21.15.125:6789/0 conn(0x7fa8ac130ce0 legacy=0x7fa8ac1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8a2ffd700 1 -- 172.21.15.125:0/1214338534 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac09b620 con 0x7fa8ac09e170 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8ab7fe700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 0x7fa8ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8a2ffd700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa894009920 tx=0x7fa894009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867f6d5615caf25d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8aaffd700 1 -- 172.21.15.125:0/1214338534 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011830 con 0x7fa8ac09e170 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8aaffd700 1 -- 172.21.15.125:0/1214338534 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011990 con 0x7fa8ac09e170 2023-10-03T10:13:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.383+0000 7fa8aaffd700 1 -- 172.21.15.125:0/1214338534 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011d20 con 0x7fa8ac09e170 2023-10-03T10:13:11.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 -- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 msgr2=0x7fa8ac1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa894009920 tx=0x7fa894009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:11.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 -- 172.21.15.125:0/1214338534 shutdown_connections 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09d860 0x7fa8ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1214338534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac09e170 0x7fa8ac1307a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 -- 172.21.15.125:0/1214338534 >> 172.21.15.125:0/1214338534 conn(0x7fa8ac099c40 msgr2=0x7fa8ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 -- 172.21.15.125:0/1214338534 shutdown_connections 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.384+0000 7fa8b213c700 1 -- 172.21.15.125:0/1214338534 wait complete. 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 Processor -- start 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 -- start start 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 0x7fa8ac1c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac130ce0 0x7fa8ac1c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1214f0 con 0x7fa8ac09d860 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0a3390 con 0x7fa8ac09e170 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8b213c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac121bd0 con 0x7fa8ac130ce0 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55888/0 (socket says 172.21.15.125:55888) 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8ab7fe700 1 -- 172.21.15.125:0/1986971631 learned_addr learned my addr 172.21.15.125:0/1986971631 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.385+0000 7fa8a2ffd700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 0x7fa8ac1c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8abfff700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac130ce0 0x7fa8ac1c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 -- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac130ce0 msgr2=0x7fa8ac1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac130ce0 0x7fa8ac1c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 -- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 msgr2=0x7fa8ac1c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 0x7fa8ac1c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 -- 172.21.15.125:0/1986971631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0094a0 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8a2ffd700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 0x7fa8ac1c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8ab7fe700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec10 tx=0x7fa89c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00c910 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00ca70 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894009550 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00cde0 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.386+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac1218e0 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.387+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa89c013470 con 0x7fa8ac09d860 2023-10-03T10:13:11.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.387+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac04f2a0 con 0x7fa8ac09d860 2023-10-03T10:13:11.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.387+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa89c03fbe0 con 0x7fa8ac09d860 2023-10-03T10:13:11.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.392+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa89c01b3b0 con 0x7fa8ac09d860 2023-10-03T10:13:11.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.427+0000 7f86ff1ca700 1 Processor -- start 2023-10-03T10:13:11.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.427+0000 7f86ff1ca700 1 -- start start 2023-10-03T10:13:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86ff1ca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86ff1ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86f8130eb0 0x7f86f8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86ff1ca700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f809aaa0 con 0x7f86f809e170 2023-10-03T10:13:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86ff1ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f809f870 con 0x7f86f8130eb0 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86ff1ca700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f809b360 con 0x7f86f809d860 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41538/0 (socket says 172.21.15.125:41538) 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 -- 172.21.15.125:0/2355810074 learned_addr learned my addr 172.21.15.125:0/2355810074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fd767700 1 --2- 172.21.15.125:0/2355810074 >> v2:172.21.15.125:3300/0 conn(0x7f86f8130eb0 0x7f86f8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 -- 172.21.15.125:0/2355810074 >> v2:172.21.15.125:3300/0 conn(0x7f86f8130eb0 msgr2=0x7f86f8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 --2- 172.21.15.125:0/2355810074 >> v2:172.21.15.125:3300/0 conn(0x7f86f8130eb0 0x7f86f8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 -- 172.21.15.125:0/2355810074 >> v1:172.21.15.125:6789/0 conn(0x7f86f809e170 legacy=0x7f86f81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86f77fe700 1 -- 172.21.15.125:0/2355810074 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824513845 0 0) 0x7f86f809aaa0 con 0x7f86f809e170 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 -- 172.21.15.125:0/2355810074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f809b620 con 0x7f86f809d860 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.428+0000 7f86fcf66700 1 --2- 172.21.15.125:0/2355810074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891822c47ac6f278 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86f77fe700 1 -- 172.21.15.125:0/2355810074 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00f8a0 con 0x7f86f809d860 2023-10-03T10:13:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86f77fe700 1 -- 172.21.15.125:0/2355810074 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00fa00 con 0x7f86f809d860 2023-10-03T10:13:11.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86f77fe700 1 -- 172.21.15.125:0/2355810074 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00fd90 con 0x7f86f809d860 2023-10-03T10:13:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 -- 172.21.15.125:0/2355810074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 msgr2=0x7f86f809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/2355810074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098f0 tx=0x7f86ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 -- 172.21.15.125:0/2355810074 shutdown_connections 2023-10-03T10:13:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/2355810074 >> v2:172.21.15.125:3300/0 conn(0x7f86f8130eb0 0x7f86f8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/2355810074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f809dc30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.429+0000 7f86ff1ca700 1 -- 172.21.15.125:0/2355810074 >> 172.21.15.125:0/2355810074 conn(0x7f86f8099c40 msgr2=0x7f86f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.430+0000 7f86ff1ca700 1 -- 172.21.15.125:0/2355810074 shutdown_connections 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.430+0000 7f86ff1ca700 1 -- 172.21.15.125:0/2355810074 wait complete. 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.431+0000 7f86ff1ca700 1 Processor -- start 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.431+0000 7f86ff1ca700 1 -- start start 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f811e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f809e170 0x7f86f811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8120500 con 0x7f86f8130eb0 2023-10-03T10:13:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80720e0 con 0x7f86f809e170 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86ff1ca700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f809c8b0 con 0x7f86f809d860 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fd767700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f811e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fd767700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55906/0 (socket says 172.21.15.125:55906) 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fd767700 1 -- 172.21.15.125:0/3186574595 learned_addr learned my addr 172.21.15.125:0/3186574595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86f7fff700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f809e170 0x7f86f811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 -- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f809e170 msgr2=0x7f86f811e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f809e170 0x7f86f811e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 -- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 msgr2=0x7f86f811edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 -- 172.21.15.125:0/3186574595 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009550 con 0x7f86f809d860 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fd767700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86fcf66700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f811e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86ec018000 tx=0x7f86ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.432+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec01e070 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0036a0 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f81215f0 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003a10 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f81225f0 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86ec003b70 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.433+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86ec042310 con 0x7f86f809d860 2023-10-03T10:13:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.434+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f81217e0 con 0x7f86f809d860 2023-10-03T10:13:11.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.438+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86ec02a300 con 0x7f86f809d860 2023-10-03T10:13:11.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.616+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8ac072790 con 0x7fa8ac09d860 2023-10-03T10:13:11.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.616+0000 7fa8a8ff9700 1 -- 172.21.15.125:0/1986971631 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa89c021020 con 0x7fa8ac09d860 2023-10-03T10:13:11.616 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 msgr2=0x7fa8ac1c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec10 tx=0x7fa89c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 shutdown_connections 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8ac130ce0 0x7fa8ac1c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8ac09d860 0x7fa8ac1c4fc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 --2- 172.21.15.125:0/1986971631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8ac09e170 0x7fa8ac1c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.618+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 >> 172.21.15.125:0/1986971631 conn(0x7fa8ac099c40 msgr2=0x7fa8ac06edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.619+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 shutdown_connections 2023-10-03T10:13:11.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.619+0000 7fa8b213c700 1 -- 172.21.15.125:0/1986971631 wait complete. 2023-10-03T10:13:11.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:11.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.661+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f86f804f2a0 con 0x7f86f809d860 2023-10-03T10:13:11.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.661+0000 7f86f57fa700 1 -- 172.21.15.125:0/3186574595 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86ec028030 con 0x7f86f809d860 2023-10-03T10:13:11.661 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 msgr2=0x7f86f811e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f811e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86ec018000 tx=0x7f86ec004750 comp rx=0 tx=0).stop 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 shutdown_connections 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f8130eb0 0x7f86f811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86f809d860 0x7f86f811e340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 --2- 172.21.15.125:0/3186574595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f809e170 0x7f86f811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 >> 172.21.15.125:0/3186574595 conn(0x7f86f8099c40 msgr2=0x7f86f8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 shutdown_connections 2023-10-03T10:13:11.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:11.663+0000 7f86ff1ca700 1 -- 172.21.15.125:0/3186574595 wait complete. 2023-10-03T10:13:11.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:12.224 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:12.262 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:12.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.354+0000 7fdaee760700 1 Processor -- start 2023-10-03T10:13:12.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.354+0000 7fdaee760700 1 -- start start 2023-10-03T10:13:12.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.354+0000 7fdaee760700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.354+0000 7fdaee760700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdae8134570 0x7fdae813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaee760700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae809b110 con 0x7fdae809ad40 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaee760700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80a3b60 con 0x7fdae8134570 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaee760700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80a1a80 con 0x7fdae8134140 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdae8134570 0x7fdae813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45570/0 (socket says 172.21.15.125:45570) 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae77fe700 1 -- 172.21.15.125:0/4037655883 learned_addr learned my addr 172.21.15.125:0/4037655883 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 msgr2=0x7fdae8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4037655883 >> v1:172.21.15.125:6789/0 conn(0x7fdae809ad40 legacy=0x7fdae8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4037655883 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80a2fa0 con 0x7fdae8134570 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae77fe700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdaeccfd700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae813b3d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009d90 tx=0x7fdae000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332943bae7b0a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae6ffd700 1 -- 172.21.15.125:0/4037655883 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000e070 con 0x7fdae8134570 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae6ffd700 1 -- 172.21.15.125:0/4037655883 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000bb20 con 0x7fdae8134570 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.355+0000 7fdae6ffd700 1 -- 172.21.15.125:0/4037655883 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0012430 con 0x7fdae8134570 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 -- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 msgr2=0x7fdae813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae813b3d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009d90 tx=0x7fdae000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 -- 172.21.15.125:0/4037655883 shutdown_connections 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae813b3d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 --2- 172.21.15.125:0/4037655883 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 -- 172.21.15.125:0/4037655883 >> 172.21.15.125:0/4037655883 conn(0x7fdae8099c40 msgr2=0x7fdae806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 -- 172.21.15.125:0/4037655883 shutdown_connections 2023-10-03T10:13:12.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.356+0000 7fdaee760700 1 -- 172.21.15.125:0/4037655883 wait complete. 2023-10-03T10:13:12.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.357+0000 7fdaee760700 1 Processor -- start 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 -- start start 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae809ad40 0x7fdae811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 0x7fdae811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae811ebb0 con 0x7fdae8134570 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae809c7e0 con 0x7fdae809ad40 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaee760700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae811d9e0 con 0x7fdae8134140 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaeccfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 0x7fdae811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaeccfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55916/0 (socket says 172.21.15.125:55916) 2023-10-03T10:13:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 0x7fdae811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41562/0 (socket says 172.21.15.125:41562) 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4042910605 learned_addr learned my addr 172.21.15.125:0/4042910605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.358+0000 7fdae7fff700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae809ad40 0x7fdae811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 msgr2=0x7fdae811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 0x7fdae811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae809ad40 msgr2=0x7fdae811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae809ad40 0x7fdae811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 -- 172.21.15.125:0/4042910605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc009550 con 0x7fdae8134570 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaeccfd700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdae809a5d0 tx=0x7fdae0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0012430 con 0x7fdae8134570 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0020070 con 0x7fdae8134570 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae0009a70 con 0x7fdae8134570 2023-10-03T10:13:12.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0003ea0 con 0x7fdae8134570 2023-10-03T10:13:12.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.359+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae811e260 con 0x7fdae8134570 2023-10-03T10:13:12.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.360+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdae0004280 con 0x7fdae8134570 2023-10-03T10:13:12.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.360+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdae0022070 con 0x7fdae8134570 2023-10-03T10:13:12.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.360+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae8139880 con 0x7fdae8134570 2023-10-03T10:13:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.365+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdae001c400 con 0x7fdae8134570 2023-10-03T10:13:12.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.401+0000 7f6227d17700 1 Processor -- start 2023-10-03T10:13:12.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.401+0000 7f6227d17700 1 -- start start 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6227d17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6227d17700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 0x7f6220139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6227d17700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622009c970 con 0x7f622009f180 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6227d17700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200a0920 con 0x7f6220131f40 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6227d17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622009f9c0 con 0x7f622009e870 2023-10-03T10:13:12.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f62262b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 0x7f6220139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45582/0 (socket says 172.21.15.125:45582) 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 -- 172.21.15.125:0/3446110116 learned_addr learned my addr 172.21.15.125:0/3446110116 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 -- 172.21.15.125:0/3446110116 >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 msgr2=0x7f6220139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 --2- 172.21.15.125:0/3446110116 >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 0x7f6220139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 -- 172.21.15.125:0/3446110116 >> v1:172.21.15.125:6789/0 conn(0x7f622009f180 legacy=0x7f6220131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 -- 172.21.15.125:0/3446110116 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622009bab0 con 0x7f622009e870 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f62262b4700 1 --2- 172.21.15.125:0/3446110116 >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 0x7f6220139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.402+0000 7f6225ab3700 1 --2- 172.21.15.125:0/3446110116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f621c0098f0 tx=0x7f621c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de0ae611c2fb394 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6224ab1700 1 -- 172.21.15.125:0/3446110116 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011830 con 0x7f622009e870 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6224ab1700 1 -- 172.21.15.125:0/3446110116 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c011990 con 0x7f622009e870 2023-10-03T10:13:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6224ab1700 1 -- 172.21.15.125:0/3446110116 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011d20 con 0x7f622009e870 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 -- 172.21.15.125:0/3446110116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 msgr2=0x7f622009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 --2- 172.21.15.125:0/3446110116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f621c0098f0 tx=0x7f621c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 -- 172.21.15.125:0/3446110116 shutdown_connections 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 --2- 172.21.15.125:0/3446110116 >> v2:172.21.15.125:3300/0 conn(0x7f6220131f40 0x7f6220139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 --2- 172.21.15.125:0/3446110116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f622009ec40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 -- 172.21.15.125:0/3446110116 >> 172.21.15.125:0/3446110116 conn(0x7f62200a4430 msgr2=0x7f62200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 -- 172.21.15.125:0/3446110116 shutdown_connections 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.403+0000 7f6227d17700 1 -- 172.21.15.125:0/3446110116 wait complete. 2023-10-03T10:13:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.404+0000 7f6227d17700 1 Processor -- start 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.404+0000 7f6227d17700 1 -- start start 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622009f180 0x7f6220120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6220131f40 0x7f6220120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201315d0 con 0x7f622009f180 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6220122ca0 con 0x7f622009e870 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6227d17700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6220123780 con 0x7f6220131f40 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45590/0 (socket says 172.21.15.125:45590) 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 -- 172.21.15.125:0/543157376 learned_addr learned my addr 172.21.15.125:0/543157376 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f62262b4700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6220131f40 0x7f6220120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f62252b2700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622009f180 0x7f6220120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 -- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6220131f40 msgr2=0x7f6220120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6220131f40 0x7f6220120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 -- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622009f180 msgr2=0x7f6220120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622009f180 0x7f6220120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.405+0000 7f6225ab3700 1 -- 172.21.15.125:0/543157376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009a70 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f6225ab3700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f621c014040 tx=0x7f621c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0044d0 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c01e070 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c009550 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0038e0 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.406+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6220123aa0 con 0x7f622009e870 2023-10-03T10:13:12.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.407+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f621c003a40 con 0x7f622009e870 2023-10-03T10:13:12.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.407+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f621c0405d0 con 0x7f622009e870 2023-10-03T10:13:12.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.407+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622011d580 con 0x7f622009e870 2023-10-03T10:13:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.416+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f621c015020 con 0x7f622009e870 2023-10-03T10:13:12.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.568+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdae804f2a0 con 0x7fdae8134570 2023-10-03T10:13:12.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.568+0000 7fdae4ff9700 1 -- 172.21.15.125:0/4042910605 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdae0011390 con 0x7fdae8134570 2023-10-03T10:13:12.568 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 msgr2=0x7fdae811d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdae809a5d0 tx=0x7fdae0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 shutdown_connections 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae8134570 0x7fdae811d340 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae809ad40 0x7fdae811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 --2- 172.21.15.125:0/4042910605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdae8134140 0x7fdae811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 >> 172.21.15.125:0/4042910605 conn(0x7fdae8099c40 msgr2=0x7fdae80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.570+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 shutdown_connections 2023-10-03T10:13:12.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.571+0000 7fdaee760700 1 -- 172.21.15.125:0/4042910605 wait complete. 2023-10-03T10:13:12.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:12.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.604+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62201238c0 con 0x7f622009e870 2023-10-03T10:13:12.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.604+0000 7f62167fc700 1 -- 172.21.15.125:0/543157376 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f621c003cf0 con 0x7f622009e870 2023-10-03T10:13:12.604 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 msgr2=0x7f6220120200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f621c014040 tx=0x7f621c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 shutdown_connections 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6220131f40 0x7f6220120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622009e870 0x7f6220120200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 --2- 172.21.15.125:0/543157376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622009f180 0x7f6220120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 >> 172.21.15.125:0/543157376 conn(0x7f62200a4430 msgr2=0x7f622011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 shutdown_connections 2023-10-03T10:13:12.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.606+0000 7f6227d17700 1 -- 172.21.15.125:0/543157376 wait complete. 2023-10-03T10:13:12.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:12.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:12.676 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:12.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.784+0000 7f86dd1e6700 1 Processor -- start 2023-10-03T10:13:12.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.784+0000 7f86dd1e6700 1 -- start start 2023-10-03T10:13:12.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86dd1e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86dd1e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86dd1e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d809c970 con 0x7f86d809f180 2023-10-03T10:13:12.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86dd1e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80a0920 con 0x7f86d8131f40 2023-10-03T10:13:12.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86dd1e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86d809f9c0 con 0x7f86d809e870 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41584/0 (socket says 172.21.15.125:41584) 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55940/0 (socket says 172.21.15.125:55940) 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 -- 172.21.15.125:0/3893922388 learned_addr learned my addr 172.21.15.125:0/3893922388 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d659c700 1 --1- 172.21.15.125:0/3893922388 >> v1:172.21.15.125:6789/0 conn(0x7f86d809f180 0x7f86d8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48558/0 (socket says 172.21.15.125:48558) 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 -- 172.21.15.125:0/3893922388 >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 msgr2=0x7f86d8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 --2- 172.21.15.125:0/3893922388 >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 -- 172.21.15.125:0/3893922388 >> v1:172.21.15.125:6789/0 conn(0x7f86d809f180 legacy=0x7f86d8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 -- 172.21.15.125:0/3893922388 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d809bab0 con 0x7f86d809e870 2023-10-03T10:13:12.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d759e700 1 --2- 172.21.15.125:0/3893922388 >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.785+0000 7f86d6d9d700 1 --2- 172.21.15.125:0/3893922388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098f0 tx=0x7f86c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ef3a118bde16bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86d5d9b700 1 -- 172.21.15.125:0/3893922388 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011830 con 0x7f86d809e870 2023-10-03T10:13:12.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86d5d9b700 1 -- 172.21.15.125:0/3893922388 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8011990 con 0x7f86d809e870 2023-10-03T10:13:12.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86d5d9b700 1 -- 172.21.15.125:0/3893922388 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011d20 con 0x7f86d809e870 2023-10-03T10:13:12.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 -- 172.21.15.125:0/3893922388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 msgr2=0x7f86d809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/3893922388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098f0 tx=0x7f86c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 -- 172.21.15.125:0/3893922388 shutdown_connections 2023-10-03T10:13:12.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/3893922388 >> v2:172.21.15.125:3300/0 conn(0x7f86d8131f40 0x7f86d8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/3893922388 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d809ec40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 -- 172.21.15.125:0/3893922388 >> 172.21.15.125:0/3893922388 conn(0x7f86d80a4430 msgr2=0x7f86d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 -- 172.21.15.125:0/3893922388 shutdown_connections 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.786+0000 7f86dd1e6700 1 -- 172.21.15.125:0/3893922388 wait complete. 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.788+0000 7f86dd1e6700 1 Processor -- start 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.788+0000 7f86dd1e6700 1 -- start start 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 0x7f86d8120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 0x7f86d8120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8123e10 con 0x7f86d8131f40 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80a2f60 con 0x7f86d809f180 2023-10-03T10:13:12.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86d809dba0 con 0x7f86d809e870 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 0x7f86d8120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41598/0 (socket says 172.21.15.125:41598) 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d6d9d700 1 -- 172.21.15.125:0/2691040443 learned_addr learned my addr 172.21.15.125:0/2691040443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d759e700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 0x7f86d8120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 -- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 msgr2=0x7f86d81202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 -- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 msgr2=0x7f86d8120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 0x7f86d8120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 -- 172.21.15.125:0/2691040443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009a70 con 0x7f86d809f180 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d759e700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 0x7f86d8120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d6d9d700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86d659c700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 0x7f86d8120830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c420 tx=0x7f86cc00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005cb0 con 0x7f86d809f180 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc005e10 con 0x7f86d809f180 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c8009550 con 0x7f86d809f180 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.789+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0072d0 con 0x7f86d809f180 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.790+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8122d20 con 0x7f86d809f180 2023-10-03T10:13:12.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.790+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86cc007430 con 0x7f86d809f180 2023-10-03T10:13:12.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.791+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86cc03e8e0 con 0x7f86d809f180 2023-10-03T10:13:12.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.791+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d811d580 con 0x7f86d809f180 2023-10-03T10:13:12.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.795+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86cc017080 con 0x7f86d809f180 2023-10-03T10:13:12.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.834+0000 7f7ac8a85700 1 Processor -- start 2023-10-03T10:13:12.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.834+0000 7f7ac8a85700 1 -- start start 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ac40a1380 0x7f7ac4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 0x7f7ac4134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac409e9d0 con 0x7f7ac40a1380 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac409dc00 con 0x7f7ac40a0a70 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac8a85700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac409dec0 con 0x7f7ac4133f50 2023-10-03T10:13:12.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ac40a1380 0x7f7ac4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 0x7f7ac4134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ac40a1380 0x7f7ac4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55954/0 (socket says 172.21.15.125:55954) 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/976560387 learned_addr learned my addr 172.21.15.125:0/976560387 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45604/0 (socket says 172.21.15.125:45604) 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 msgr2=0x7f7ac4134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 0x7f7ac4134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 msgr2=0x7f7ac40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/976560387 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac409e6a0 con 0x7f7ac40a1380 2023-10-03T10:13:12.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac259c700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac2d9d700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 0x7f7ac4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac40a1380 0x7f7ac4133a10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098f0 tx=0x7f7ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9045c1b5664bbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac159a700 1 -- 172.21.15.125:0/976560387 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011830 con 0x7f7ac40a1380 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac159a700 1 -- 172.21.15.125:0/976560387 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8011990 con 0x7f7ac40a1380 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.835+0000 7f7ac159a700 1 -- 172.21.15.125:0/976560387 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011d20 con 0x7f7ac40a1380 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 -- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac40a1380 msgr2=0x7f7ac4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac40a1380 0x7f7ac4133a10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098f0 tx=0x7f7ab8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 -- 172.21.15.125:0/976560387 shutdown_connections 2023-10-03T10:13:12.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a0a70 0x7f7ac40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac4133f50 0x7f7ac4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/976560387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac40a1380 0x7f7ac4133a10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 -- 172.21.15.125:0/976560387 >> 172.21.15.125:0/976560387 conn(0x7f7ac40a6610 msgr2=0x7f7ac40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 -- 172.21.15.125:0/976560387 shutdown_connections 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.836+0000 7f7ac8a85700 1 -- 172.21.15.125:0/976560387 wait complete. 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.837+0000 7f7ac8a85700 1 Processor -- start 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.837+0000 7f7ac8a85700 1 -- start start 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 0x7f7ac4123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41239f0 con 0x7f7ac4133f50 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40a03e0 con 0x7f7ac40a1380 2023-10-03T10:13:12.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40a5180 con 0x7f7ac40a0a70 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 0x7f7ac4123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45610/0 (socket says 172.21.15.125:45610) 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41618/0 (socket says 172.21.15.125:41618) 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac259c700 1 -- 172.21.15.125:0/3377571055 learned_addr learned my addr 172.21.15.125:0/3377571055 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 msgr2=0x7f7ac4122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 msgr2=0x7f7ac4123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 0x7f7ac4123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 -- 172.21.15.125:0/3377571055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40094a0 con 0x7f7ac40a1380 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac259c700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac2d9d700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 0x7f7ac4123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac1d9b700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8016000 tx=0x7f7ab8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004240 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab801f070 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc009a70 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.838+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80036a0 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.839+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab8009550 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.839+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ab8021030 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.839+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ab80407b0 con 0x7f7ac40a1380 2023-10-03T10:13:12.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.840+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac404f2a0 con 0x7f7ac40a1380 2023-10-03T10:13:12.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:12.844+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ab8003800 con 0x7f7ac40a1380 2023-10-03T10:13:13.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.023+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86d804f2a0 con 0x7f86d809f180 2023-10-03T10:13:13.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.024+0000 7f86bf7fe700 1 -- 172.21.15.125:0/2691040443 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86cc0076e0 con 0x7f86d809f180 2023-10-03T10:13:13.023 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 msgr2=0x7f86d8120830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 0x7f86d8120830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c420 tx=0x7f86cc00c730 comp rx=0 tx=0).stop 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 shutdown_connections 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d8131f40 0x7f86d8120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86d809e870 0x7f86d81202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 --2- 172.21.15.125:0/2691040443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86d809f180 0x7f86d8120830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 >> 172.21.15.125:0/2691040443 conn(0x7f86d80a4430 msgr2=0x7f86d811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 shutdown_connections 2023-10-03T10:13:13.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.026+0000 7f86dd1e6700 1 -- 172.21.15.125:0/2691040443 wait complete. 2023-10-03T10:13:13.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:13.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.069+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ac4125c30 con 0x7f7ac40a1380 2023-10-03T10:13:13.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.074+0000 7f7ab2ffd700 1 -- 172.21.15.125:0/3377571055 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ab8015020 con 0x7f7ac40a1380 2023-10-03T10:13:13.073 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:13.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 msgr2=0x7f7ac4122ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8016000 tx=0x7f7ab8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 shutdown_connections 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac4133f50 0x7f7ac4123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ac40a0a70 0x7f7ac4122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 --2- 172.21.15.125:0/3377571055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ac40a1380 0x7f7ac4122ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 >> 172.21.15.125:0/3377571055 conn(0x7f7ac40a6610 msgr2=0x7f7ac409c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 shutdown_connections 2023-10-03T10:13:13.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.076+0000 7f7ac8a85700 1 -- 172.21.15.125:0/3377571055 wait complete. 2023-10-03T10:13:13.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:13.583 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:13.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:13.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.716+0000 7f711f308700 1 Processor -- start 2023-10-03T10:13:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 -- start start 2023-10-03T10:13:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 0x7f7118136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 0x7f71181395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711809c970 con 0x7f711809e870 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180a0920 con 0x7f711809f350 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711f308700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711809f9c0 con 0x7f71181371c0 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d0a4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f711809e870 0x7f711809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48564/0 (socket says 172.21.15.125:48564) 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d0a4700 1 -- 172.21.15.125:0/4043863146 learned_addr learned my addr 172.21.15.125:0/4043863146 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711c8a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 0x7f7118136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d8a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 0x7f71181395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f710ffff700 1 -- 172.21.15.125:0/4043863146 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106947243 0 0) 0x7f711809c970 con 0x7f711809e870 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d8a5700 1 -- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 msgr2=0x7f7118136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d8a5700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 0x7f7118136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d8a5700 1 -- 172.21.15.125:0/4043863146 >> v1:172.21.15.125:6789/0 conn(0x7f711809e870 legacy=0x7f711809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.717+0000 7f711d8a5700 1 -- 172.21.15.125:0/4043863146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711809bab0 con 0x7f71181371c0 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711c8a3700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 0x7f7118136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711d8a5700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 0x7f71181395a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7110009dc0 tx=0x7f711000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348f904c2857532e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f710ffff700 1 -- 172.21.15.125:0/4043863146 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000e070 con 0x7f71181371c0 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f710ffff700 1 -- 172.21.15.125:0/4043863146 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000bb20 con 0x7f71181371c0 2023-10-03T10:13:13.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f710ffff700 1 -- 172.21.15.125:0/4043863146 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110012430 con 0x7f71181371c0 2023-10-03T10:13:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 -- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 msgr2=0x7f71181395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 0x7f71181395a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7110009dc0 tx=0x7f711000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 -- 172.21.15.125:0/4043863146 shutdown_connections 2023-10-03T10:13:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71181371c0 0x7f71181395a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 --2- 172.21.15.125:0/4043863146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809f350 0x7f7118136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.718+0000 7f711f308700 1 -- 172.21.15.125:0/4043863146 >> 172.21.15.125:0/4043863146 conn(0x7f71180a4430 msgr2=0x7f71180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.719+0000 7f711f308700 1 -- 172.21.15.125:0/4043863146 shutdown_connections 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.719+0000 7f711f308700 1 -- 172.21.15.125:0/4043863146 wait complete. 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.719+0000 7f711f308700 1 Processor -- start 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.719+0000 7f711f308700 1 -- start start 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 0x7f711806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 0x7f711806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711806cd80 con 0x7f71181371c0 2023-10-03T10:13:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118126380 con 0x7f711809e870 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711f308700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711806d4c0 con 0x7f711809f350 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711d0a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 0x7f711806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711d8a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 0x7f711806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41646/0 (socket says 172.21.15.125:41646) 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711d0a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 0x7f711806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45618/0 (socket says 172.21.15.125:45618) 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 -- 172.21.15.125:0/81460205 learned_addr learned my addr 172.21.15.125:0/81460205 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 -- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 msgr2=0x7f711806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 0x7f711806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 -- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 msgr2=0x7f711806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 0x7f711806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 -- 172.21.15.125:0/81460205 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080094a0 con 0x7f711809f350 2023-10-03T10:13:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711d8a5700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 0x7f711806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.720+0000 7f711c8a3700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f710800ec10 tx=0x7f710800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.721+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800c850 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.721+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800c9b0 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.721+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7110009a70 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.721+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800cd20 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.721+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118125de0 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.722+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7108013470 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.722+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f710803fb30 con 0x7f711809f350 2023-10-03T10:13:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.722+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711804f2a0 con 0x7f711809f350 2023-10-03T10:13:13.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.726+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7108021080 con 0x7f711809f350 2023-10-03T10:13:13.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 Processor -- start 2023-10-03T10:13:13.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 -- start start 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 0x7fdc1806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 0x7fdc181317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 0x7fdc18132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1809f770 con 0x7fdc18131cf0 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809dce0 con 0x7fdc1806a770 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.755+0000 7fdc1e5c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809da80 con 0x7fdc1806b080 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 0x7fdc181317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 0x7fdc1806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 0x7fdc181317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41654/0 (socket says 172.21.15.125:41654) 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc177fe700 1 -- 172.21.15.125:0/1485367307 learned_addr learned my addr 172.21.15.125:0/1485367307 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc1cb64700 1 --2- 172.21.15.125:0/1485367307 >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 0x7fdc18132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 -- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 msgr2=0x7fdc181317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 --2- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 0x7fdc181317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 -- 172.21.15.125:0/1485367307 >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 msgr2=0x7fdc18132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 --2- 172.21.15.125:0/1485367307 >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 0x7fdc18132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 -- 172.21.15.125:0/1485367307 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1809eb20 con 0x7fdc1806a770 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc1cb64700 1 --2- 172.21.15.125:0/1485367307 >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 0x7fdc18132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc17fff700 1 --2- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 0x7fdc1806ab40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc08009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72138781f7fe6ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc16ffd700 1 -- 172.21.15.125:0/1485367307 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08011830 con 0x7fdc1806a770 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc16ffd700 1 -- 172.21.15.125:0/1485367307 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08011990 con 0x7fdc1806a770 2023-10-03T10:13:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.756+0000 7fdc16ffd700 1 -- 172.21.15.125:0/1485367307 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08011d20 con 0x7fdc1806a770 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 msgr2=0x7fdc1806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 0x7fdc1806ab40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc08009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/1485367307 shutdown_connections 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806a770 0x7fdc1806ab40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/1485367307 >> v2:172.21.15.125:3300/0 conn(0x7fdc18131cf0 0x7fdc18132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/1485367307 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc1806b080 0x7fdc181317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/1485367307 >> 172.21.15.125:0/1485367307 conn(0x7fdc18099c40 msgr2=0x7fdc180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/1485367307 shutdown_connections 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.757+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/1485367307 wait complete. 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 Processor -- start 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 -- start start 2023-10-03T10:13:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc1806a770 0x7fdc1809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 0x7fdc181c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809aa40 con 0x7fdc1806a770 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc18121190 con 0x7fdc1806b080 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1e5c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809b8a0 con 0x7fdc18131cf0 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.758+0000 7fdc1cb64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 0x7fdc181c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45646/0 (socket says 172.21.15.125:45646) 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc1cb64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 0x7fdc181c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41656/0 (socket says 172.21.15.125:41656) 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 -- 172.21.15.125:0/2683547121 learned_addr learned my addr 172.21.15.125:0/2683547121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc17fff700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc1806a770 0x7fdc1809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 -- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 msgr2=0x7fdc181c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 0x7fdc181c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 -- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc1806a770 msgr2=0x7fdc1809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc1806a770 0x7fdc1809ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 -- 172.21.15.125:0/2683547121 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10009a70 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc177fe700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e8e0 tx=0x7fdc0c00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c013680 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c0137e0 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc080094a0 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c013b50 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.759+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc18120490 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.760+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180a3db0 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.760+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc0c013cb0 con 0x7fdc1806b080 2023-10-03T10:13:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.760+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc0c03f980 con 0x7fdc1806b080 2023-10-03T10:13:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.765+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc0c01ab90 con 0x7fdc1806b080 2023-10-03T10:13:13.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.921+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7118124c60 con 0x7f711809f350 2023-10-03T10:13:13.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.921+0000 7f710dffb700 1 -- 172.21.15.125:0/81460205 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7108013720 con 0x7f711809f350 2023-10-03T10:13:13.921 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 msgr2=0x7f711806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f710800ec10 tx=0x7f710800ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 shutdown_connections 2023-10-03T10:13:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71181371c0 0x7f711806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711809e870 0x7f711806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 --2- 172.21.15.125:0/81460205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f711809f350 0x7f711806bdf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.923+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 >> 172.21.15.125:0/81460205 conn(0x7f71180a4430 msgr2=0x7f71180a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.924+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 shutdown_connections 2023-10-03T10:13:13.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.924+0000 7f711f308700 1 -- 172.21.15.125:0/81460205 wait complete. 2023-10-03T10:13:13.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:13.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.959+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc180a2e60 con 0x7fdc1806b080 2023-10-03T10:13:13.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.959+0000 7fdc14ff9700 1 -- 172.21.15.125:0/2683547121 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc0c017070 con 0x7fdc1806b080 2023-10-03T10:13:13.958 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:13.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 msgr2=0x7fdc1809b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e8e0 tx=0x7fdc0c00ebf0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 shutdown_connections 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc18131cf0 0x7fdc181c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc1806a770 0x7fdc1809ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 --2- 172.21.15.125:0/2683547121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc1806b080 0x7fdc1809b360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 >> 172.21.15.125:0/2683547121 conn(0x7fdc18099c40 msgr2=0x7fdc180a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 shutdown_connections 2023-10-03T10:13:13.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:13.961+0000 7fdc1e5c7700 1 -- 172.21.15.125:0/2683547121 wait complete. 2023-10-03T10:13:13.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:14.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:14.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:14.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 Processor -- start 2023-10-03T10:13:14.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 -- start start 2023-10-03T10:13:14.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f409e9d0 con 0x7fa7f40a0a70 2023-10-03T10:13:14.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f409dc00 con 0x7fa7f4139200 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f9baf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f409dec0 con 0x7fa7f40a1550 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55994/0 (socket says 172.21.15.125:55994) 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45660/0 (socket says 172.21.15.125:45660) 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa7f40a0a70 0x7fa7f40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48570/0 (socket says 172.21.15.125:48570) 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.170+0000 7fa7f3fff700 1 -- 172.21.15.125:0/3075163096 learned_addr learned my addr 172.21.15.125:0/3075163096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f2ffd700 1 -- 172.21.15.125:0/3075163096 >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 msgr2=0x7fa7f413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f2ffd700 1 --2- 172.21.15.125:0/3075163096 >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f2ffd700 1 -- 172.21.15.125:0/3075163096 >> v1:172.21.15.125:6789/0 conn(0x7fa7f40a0a70 legacy=0x7fa7f40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f27fc700 1 -- 172.21.15.125:0/3075163096 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925992590 0 0) 0x7fa7f409e9d0 con 0x7fa7f40a0a70 2023-10-03T10:13:14.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f2ffd700 1 -- 172.21.15.125:0/3075163096 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f409e6a0 con 0x7fa7f40a1550 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f3fff700 1 --2- 172.21.15.125:0/3075163096 >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f2ffd700 1 --2- 172.21.15.125:0/3075163096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009840 tx=0x7fa7e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a154c82f0519076 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f27fc700 1 -- 172.21.15.125:0/3075163096 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8011830 con 0x7fa7f40a1550 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f27fc700 1 -- 172.21.15.125:0/3075163096 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8011990 con 0x7fa7f40a1550 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.171+0000 7fa7f27fc700 1 -- 172.21.15.125:0/3075163096 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8011d20 con 0x7fa7f40a1550 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 -- 172.21.15.125:0/3075163096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 msgr2=0x7fa7f4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/3075163096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009840 tx=0x7fa7e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 -- 172.21.15.125:0/3075163096 shutdown_connections 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/3075163096 >> v2:172.21.15.125:3300/0 conn(0x7fa7f4139200 0x7fa7f413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/3075163096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4138cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 -- 172.21.15.125:0/3075163096 >> 172.21.15.125:0/3075163096 conn(0x7fa7f40a6610 msgr2=0x7fa7f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 -- 172.21.15.125:0/3075163096 shutdown_connections 2023-10-03T10:13:14.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.172+0000 7fa7f9baf700 1 -- 172.21.15.125:0/3075163096 wait complete. 2023-10-03T10:13:14.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 Processor -- start 2023-10-03T10:13:14.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 -- start start 2023-10-03T10:13:14.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7f4139200 0x7fa7f4121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40a03e0 con 0x7fa7f40a0a70 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f41239b0 con 0x7fa7f40a1550 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f9baf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4123ed0 con 0x7fa7f4139200 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56006/0 (socket says 172.21.15.125:56006) 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f37fe700 1 -- 172.21.15.125:0/1113261264 learned_addr learned my addr 172.21.15.125:0/1113261264 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.173+0000 7fa7f3fff700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7f4139200 0x7fa7f4121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 -- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7f4139200 msgr2=0x7fa7f4121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7f4139200 0x7fa7f4121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 -- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 msgr2=0x7fa7f4120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 -- 172.21.15.125:0/1113261264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009b30 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f2ffd700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f37fe700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c520 tx=0x7fa7e400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4004c80 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4004e00 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80094a0 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4007310 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.174+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f4124940 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.175+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7e4007470 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.175+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7e403f410 con 0x7fa7f40a0a70 2023-10-03T10:13:14.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.175+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f4123d10 con 0x7fa7f40a0a70 2023-10-03T10:13:14.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.180+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7e40123b0 con 0x7fa7f40a0a70 2023-10-03T10:13:14.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.214+0000 7f5b33454700 1 Processor -- start 2023-10-03T10:13:14.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 -- start start 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b2c133f50 0x7f5b2c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c09e9d0 con 0x7f5b2c133f50 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c09dc00 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b33454700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c09dec0 con 0x7f5b2c0a1380 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b309ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b311f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b319f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b2c133f50 0x7f5b2c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b311f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45690/0 (socket says 172.21.15.125:45690) 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b309ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:41666/0 (socket says 172.21.15.125:41666) 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.215+0000 7f5b319f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b2c133f50 0x7f5b2c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56008/0 (socket says 172.21.15.125:56008) 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b311f0700 1 -- 172.21.15.125:0/967484925 learned_addr learned my addr 172.21.15.125:0/967484925 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 -- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 msgr2=0x7f5b2c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 -- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 msgr2=0x7f5b2c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 -- 172.21.15.125:0/967484925 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c09e6a0 con 0x7f5b2c133f50 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b311f0700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b319f1700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c133f50 0x7f5b2c1343f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009d90 tx=0x7f5b2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65ce4d59ff61e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b23fff700 1 -- 172.21.15.125:0/967484925 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400e070 con 0x7f5b2c133f50 2023-10-03T10:13:14.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b23fff700 1 -- 172.21.15.125:0/967484925 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400bb20 con 0x7f5b2c133f50 2023-10-03T10:13:14.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.216+0000 7f5b23fff700 1 -- 172.21.15.125:0/967484925 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24012430 con 0x7f5b2c133f50 2023-10-03T10:13:14.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 -- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c133f50 msgr2=0x7f5b2c1343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c133f50 0x7f5b2c1343f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009d90 tx=0x7f5b2400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 -- 172.21.15.125:0/967484925 shutdown_connections 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c0a0a70 0x7f5b2c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c133f50 0x7f5b2c1343f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 --2- 172.21.15.125:0/967484925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 -- 172.21.15.125:0/967484925 >> 172.21.15.125:0/967484925 conn(0x7f5b2c0a6610 msgr2=0x7f5b2c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 -- 172.21.15.125:0/967484925 shutdown_connections 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.217+0000 7f5b33454700 1 -- 172.21.15.125:0/967484925 wait complete. 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 Processor -- start 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 -- start start 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 0x7f5b2c11f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c11f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c1206f0 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c122a80 con 0x7f5b2c133f50 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b33454700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c133a10 con 0x7f5b2c0a1380 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b319f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b311f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 0x7f5b2c11f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b319f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45698/0 (socket says 172.21.15.125:45698) 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b319f1700 1 -- 172.21.15.125:0/812491610 learned_addr learned my addr 172.21.15.125:0/812491610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.218+0000 7f5b309ef700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c11f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 -- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 msgr2=0x7f5b2c11f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c11f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 -- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 msgr2=0x7f5b2c11fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 -- 172.21.15.125:0/812491610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009550 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b319f1700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b309ef700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c11f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b311f0700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 0x7f5b2c11f240 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800e9b0 tx=0x7f5b2800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800c640 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2800c7a0 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b24009a70 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800cb30 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.219+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c122d60 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.220+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b2800cc90 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.220+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c04f2a0 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.220+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b2803fa10 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.225+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b28011d70 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.372+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7f4123b20 con 0x7fa7f40a0a70 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.372+0000 7fa7dbfff700 1 -- 172.21.15.125:0/1113261264 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7e4011360 con 0x7fa7f40a0a70 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.374+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 msgr2=0x7fa7f4120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.374+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c520 tx=0x7fa7e400c830 comp rx=0 tx=0).stop 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 shutdown_connections 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7f4139200 0x7fa7f4121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7f40a0a70 0x7fa7f4120690 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 --2- 172.21.15.125:0/1113261264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7f40a1550 0x7fa7f4120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 >> 172.21.15.125:0/1113261264 conn(0x7fa7f40a6610 msgr2=0x7fa7f40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 shutdown_connections 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.375+0000 7fa7f9baf700 1 -- 172.21.15.125:0/1113261264 wait complete. 2023-10-03T10:13:14.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:14.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.418+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b2c122bc0 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.418+0000 7f5b21ffb700 1 -- 172.21.15.125:0/812491610 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b2c122bc0 con 0x7f5b2c0a0a70 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 msgr2=0x7f5b2c11f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 0x7f5b2c11f240 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800e9b0 tx=0x7f5b2800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 shutdown_connections 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b2c133f50 0x7f5b2c11fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b2c0a0a70 0x7f5b2c11f240 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 --2- 172.21.15.125:0/812491610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b2c0a1380 0x7f5b2c11f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 >> 172.21.15.125:0/812491610 conn(0x7f5b2c0a6610 msgr2=0x7f5b2c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 shutdown_connections 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:14.421+0000 7f5b33454700 1 -- 172.21.15.125:0/812491610 wait complete. 2023-10-03T10:13:14.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:14.935 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:14.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:15.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.067+0000 7f5e9f0c2700 1 Processor -- start 2023-10-03T10:13:15.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.067+0000 7f5e9f0c2700 1 -- start start 2023-10-03T10:13:15.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9f0c2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9f0c2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9f0c2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9809e9d0 con 0x7f5e980a0a70 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9f0c2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9809dc00 con 0x7f5e980a1550 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9f0c2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9809dec0 con 0x7f5e98139200 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e97fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45710/0 (socket says 172.21.15.125:45710) 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e97fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56036/0 (socket says 172.21.15.125:56036) 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 -- 172.21.15.125:0/662358402 learned_addr learned my addr 172.21.15.125:0/662358402 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9ce5e700 1 --1- 172.21.15.125:0/662358402 >> v1:172.21.15.125:6789/0 conn(0x7f5e980a0a70 0x7f5e980a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48580/0 (socket says 172.21.15.125:48580) 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 -- 172.21.15.125:0/662358402 >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 msgr2=0x7f5e98138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 --2- 172.21.15.125:0/662358402 >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 -- 172.21.15.125:0/662358402 >> v1:172.21.15.125:6789/0 conn(0x7f5e980a0a70 legacy=0x7f5e980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 -- 172.21.15.125:0/662358402 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9809e6a0 con 0x7f5e98139200 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e977fe700 1 -- 172.21.15.125:0/662358402 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607281584 0 0) 0x7f5e9809e9d0 con 0x7f5e980a0a70 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e97fff700 1 --2- 172.21.15.125:0/662358402 >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e9d65f700 1 --2- 172.21.15.125:0/662358402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009e50 tx=0x7f5e9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dde5cbc93bb878d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e977fe700 1 -- 172.21.15.125:0/662358402 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000e070 con 0x7f5e98139200 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e977fe700 1 -- 172.21.15.125:0/662358402 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000b910 con 0x7f5e98139200 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.068+0000 7f5e977fe700 1 -- 172.21.15.125:0/662358402 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000bcc0 con 0x7f5e98139200 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/662358402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 msgr2=0x7f5e9813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/662358402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009e50 tx=0x7f5e9000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/662358402 shutdown_connections 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/662358402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e98139200 0x7f5e9813b5e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/662358402 >> v2:172.21.15.125:3300/0 conn(0x7f5e980a1550 0x7f5e98138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/662358402 >> 172.21.15.125:0/662358402 conn(0x7f5e980a6610 msgr2=0x7f5e980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/662358402 shutdown_connections 2023-10-03T10:13:15.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.069+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/662358402 wait complete. 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.070+0000 7f5e9f0c2700 1 Processor -- start 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.070+0000 7f5e9f0c2700 1 -- start start 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 0x7f5e9811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 0x7f5e9811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980a03e0 con 0x7f5e980a1550 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98121990 con 0x7f5e980a0a70 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9f0c2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98121eb0 con 0x7f5e98139200 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9ce5e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 0x7f5e9811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56052/0 (socket says 172.21.15.125:56052) 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 -- 172.21.15.125:0/468506650 learned_addr learned my addr 172.21.15.125:0/468506650 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9d65f700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 0x7f5e9811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 -- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 msgr2=0x7f5e9811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 0x7f5e9811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 -- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 msgr2=0x7f5e9811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 0x7f5e9811e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 -- 172.21.15.125:0/468506650 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840094a0 con 0x7f5e980a1550 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9d65f700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 0x7f5e9811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e9ce5e700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 0x7f5e9811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e97fff700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400ebe0 tx=0x7f5e8400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.071+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400c850 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.072+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400c9b0 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.072+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e90009b30 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.072+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400cd40 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.072+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98122920 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.073+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9804f2a0 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.074+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e84013470 con 0x7f5e980a1550 2023-10-03T10:13:15.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.074+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e8403ffc0 con 0x7f5e980a1550 2023-10-03T10:13:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.078+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e84013720 con 0x7f5e980a1550 2023-10-03T10:13:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 Processor -- start 2023-10-03T10:13:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 -- start start 2023-10-03T10:13:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 0x7f54140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 0x7f5414133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541409e9d0 con 0x7f54140a0a70 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541409dc00 con 0x7f5414133f50 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541ae81700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541409dec0 con 0x7f54140a1380 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541941e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541941e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45726/0 (socket says 172.21.15.125:45726) 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f5413fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 0x7f5414133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.108+0000 7f541941e700 1 -- 172.21.15.125:0/1269602220 learned_addr learned my addr 172.21.15.125:0/1269602220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5418c1d700 1 --2- 172.21.15.125:0/1269602220 >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 0x7f54140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 -- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 msgr2=0x7f54141343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 -- 172.21.15.125:0/1269602220 >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 msgr2=0x7f54140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 --2- 172.21.15.125:0/1269602220 >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 0x7f54140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 -- 172.21.15.125:0/1269602220 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541409e6a0 con 0x7f54140a1380 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f541941e700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5418c1d700 1 --2- 172.21.15.125:0/1269602220 >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 0x7f54140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f5413fff700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 0x7f5414133a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa918b756873439f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f54137fe700 1 -- 172.21.15.125:0/1269602220 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011830 con 0x7f54140a1380 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f54137fe700 1 -- 172.21.15.125:0/1269602220 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400011990 con 0x7f54140a1380 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.109+0000 7f54137fe700 1 -- 172.21.15.125:0/1269602220 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011d20 con 0x7f54140a1380 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 -- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 msgr2=0x7f5414133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 0x7f5414133a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 -- 172.21.15.125:0/1269602220 shutdown_connections 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5414133f50 0x7f54141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 --2- 172.21.15.125:0/1269602220 >> v2:172.21.15.125:3300/0 conn(0x7f54140a0a70 0x7f54140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 --2- 172.21.15.125:0/1269602220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54140a1380 0x7f5414133a10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 -- 172.21.15.125:0/1269602220 >> 172.21.15.125:0/1269602220 conn(0x7f54140a6610 msgr2=0x7f54140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 -- 172.21.15.125:0/1269602220 shutdown_connections 2023-10-03T10:13:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 -- 172.21.15.125:0/1269602220 wait complete. 2023-10-03T10:13:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.110+0000 7f541ae81700 1 Processor -- start 2023-10-03T10:13:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 -- start start 2023-10-03T10:13:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54140a1380 0x7f54141229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5414133f50 0x7f5414122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141241a0 con 0x7f54140a1380 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5414124eb0 con 0x7f54140a0a70 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541ae81700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5414125270 con 0x7f5414133f50 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f5418c1d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f5413fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54140a1380 0x7f54141229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f5418c1d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45730/0 (socket says 172.21.15.125:45730) 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f5418c1d700 1 -- 172.21.15.125:0/1507923420 learned_addr learned my addr 172.21.15.125:0/1507923420 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.111+0000 7f541941e700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5414133f50 0x7f5414122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 -- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5414133f50 msgr2=0x7f5414122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5414133f50 0x7f5414122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 -- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54140a1380 msgr2=0x7f54141229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54140a1380 0x7f54141229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 -- 172.21.15.125:0/1507923420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009b30 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f5418c1d700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f540800d800 tx=0x7f540800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408004030 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408004190 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54000094a0 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408004520 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.112+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5414125990 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.113+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541404f2a0 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.113+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54080036a0 con 0x7f54140a0a70 2023-10-03T10:13:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.113+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f540803f870 con 0x7f54140a0a70 2023-10-03T10:13:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.118+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54080125f0 con 0x7f54140a0a70 2023-10-03T10:13:15.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.267+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e98121b50 con 0x7f5e980a1550 2023-10-03T10:13:15.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.268+0000 7f5e957fa700 1 -- 172.21.15.125:0/468506650 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e8402a090 con 0x7f5e980a1550 2023-10-03T10:13:15.267 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:15.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.269+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 msgr2=0x7f5e9811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.269+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400ebe0 tx=0x7f5e8400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 shutdown_connections 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e98139200 0x7f5e9811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e980a0a70 0x7f5e9811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 --2- 172.21.15.125:0/468506650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e980a1550 0x7f5e9811ebb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 >> 172.21.15.125:0/468506650 conn(0x7f5e980a6610 msgr2=0x7f5e98136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 shutdown_connections 2023-10-03T10:13:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.270+0000 7f5e9f0c2700 1 -- 172.21.15.125:0/468506650 wait complete. 2023-10-03T10:13:15.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:15.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.306+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5414072980 con 0x7f54140a0a70 2023-10-03T10:13:15.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.306+0000 7f54117fa700 1 -- 172.21.15.125:0/1507923420 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5408019020 con 0x7f54140a0a70 2023-10-03T10:13:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:15.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 msgr2=0x7f54141224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f540800d800 tx=0x7f540800db10 comp rx=0 tx=0).stop 2023-10-03T10:13:15.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 shutdown_connections 2023-10-03T10:13:15.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5414133f50 0x7f5414122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54140a0a70 0x7f54141224b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 --2- 172.21.15.125:0/1507923420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54140a1380 0x7f54141229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 >> 172.21.15.125:0/1507923420 conn(0x7f54140a6610 msgr2=0x7f541409b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 shutdown_connections 2023-10-03T10:13:15.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.308+0000 7f541ae81700 1 -- 172.21.15.125:0/1507923420 wait complete. 2023-10-03T10:13:15.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:15.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:15.433 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:15.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.513+0000 7f9d45486700 1 Processor -- start 2023-10-03T10:13:15.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.513+0000 7f9d45486700 1 -- start start 2023-10-03T10:13:15.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d45486700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d400a0a70 0x7f9d400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d45486700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d45486700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4009dc00 con 0x7f9d40133f50 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d45486700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4009ea60 con 0x7f9d400a0a70 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d45486700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4009dec0 con 0x7f9d400a1380 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d400a0a70 0x7f9d400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d40133f50 0x7f9d4013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42356/0 (socket says 172.21.15.125:42356) 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d400a0a70 0x7f9d400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33512/0 (socket says 172.21.15.125:33512) 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48036/0 (socket says 172.21.15.125:48036) 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 -- 172.21.15.125:0/1963551960 learned_addr learned my addr 172.21.15.125:0/1963551960 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 -- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 msgr2=0x7f9d40133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 -- 172.21.15.125:0/1963551960 >> v1:172.21.15.125:6789/0 conn(0x7f9d40133f50 legacy=0x7f9d4013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3effd700 1 -- 172.21.15.125:0/1963551960 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4009e6a0 con 0x7f9d400a0a70 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3dffb700 1 -- 172.21.15.125:0/1963551960 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566579166 0 0) 0x7f9d4009dc00 con 0x7f9d40133f50 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.514+0000 7f9d3e7fc700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d3effd700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d400a0e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d300098f0 tx=0x7f9d30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f8c847e89d51b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d3dffb700 1 -- 172.21.15.125:0/1963551960 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011830 con 0x7f9d400a0a70 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d3dffb700 1 -- 172.21.15.125:0/1963551960 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30011990 con 0x7f9d400a0a70 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d3dffb700 1 -- 172.21.15.125:0/1963551960 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011d20 con 0x7f9d400a0a70 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 -- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 msgr2=0x7f9d400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d400a0e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d300098f0 tx=0x7f9d30009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:15.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 -- 172.21.15.125:0/1963551960 shutdown_connections 2023-10-03T10:13:15.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d400a0a70 0x7f9d400a0e40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 --2- 172.21.15.125:0/1963551960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 -- 172.21.15.125:0/1963551960 >> 172.21.15.125:0/1963551960 conn(0x7f9d400a6610 msgr2=0x7f9d400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 -- 172.21.15.125:0/1963551960 shutdown_connections 2023-10-03T10:13:15.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.515+0000 7f9d45486700 1 -- 172.21.15.125:0/1963551960 wait complete. 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.516+0000 7f9d45486700 1 Processor -- start 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.516+0000 7f9d45486700 1 -- start start 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a0a70 0x7f9d40122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 0x7f9d401232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40133ad0 con 0x7f9d40133f50 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40125de0 con 0x7f9d400a0a70 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d45486700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40124510 con 0x7f9d400a1380 2023-10-03T10:13:15.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 0x7f9d401232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48046/0 (socket says 172.21.15.125:48046) 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3e7fc700 1 -- 172.21.15.125:0/1871056018 learned_addr learned my addr 172.21.15.125:0/1871056018 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3effd700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a0a70 0x7f9d40122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 -- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 msgr2=0x7f9d40122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 -- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a0a70 msgr2=0x7f9d40122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a0a70 0x7f9d40122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 -- 172.21.15.125:0/1871056018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340094a0 con 0x7f9d40133f50 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.517+0000 7f9d3f7fe700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 0x7f9d401232e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cbe0 tx=0x7f9d3800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.518+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800aa40 con 0x7f9d40133f50 2023-10-03T10:13:15.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.518+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800abc0 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.518+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380070d0 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.518+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30009550 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.518+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d400a0430 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.519+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4004f2a0 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.519+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d38007230 con 0x7f9d40133f50 2023-10-03T10:13:15.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.519+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d3803f380 con 0x7f9d40133f50 2023-10-03T10:13:15.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.523+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d380074e0 con 0x7f9d40133f50 2023-10-03T10:13:15.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.558+0000 7f1026fc6700 1 Processor -- start 2023-10-03T10:13:15.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.558+0000 7f1026fc6700 1 -- start start 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1026fc6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10200a0a70 0x7f10200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1026fc6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1020134120 0x7f102013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1026fc6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102009dc00 con 0x7f10200a1380 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1026fc6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102009ea60 con 0x7f1020134120 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1026fc6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102009dec0 con 0x7f10200a0a70 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1025563700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1020134120 0x7f102013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f101ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f10200a1380 0x7f1020133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42360/0 (socket says 172.21.15.125:42360) 2023-10-03T10:13:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1024d62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10200a0a70 0x7f10200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f101ffff700 1 -- 172.21.15.125:0/176710805 learned_addr learned my addr 172.21.15.125:0/176710805 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1025563700 1 -- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10200a0a70 msgr2=0x7f10200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1025563700 1 --2- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10200a0a70 0x7f10200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1025563700 1 -- 172.21.15.125:0/176710805 >> v1:172.21.15.125:6789/0 conn(0x7f10200a1380 legacy=0x7f1020133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f1025563700 1 -- 172.21.15.125:0/176710805 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102009e6a0 con 0x7f1020134120 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.559+0000 7f101f7fe700 1 -- 172.21.15.125:0/176710805 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019075009 0 0) 0x7f102009dc00 con 0x7f10200a1380 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1025563700 1 --2- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1020134120 0x7f102013bce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1018009d90 tx=0x7f101800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e528b9e617b668 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f101f7fe700 1 -- 172.21.15.125:0/176710805 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101800e070 con 0x7f1020134120 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f101f7fe700 1 -- 172.21.15.125:0/176710805 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101800bb20 con 0x7f1020134120 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f101f7fe700 1 -- 172.21.15.125:0/176710805 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012430 con 0x7f1020134120 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 -- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1020134120 msgr2=0x7f102013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 --2- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1020134120 0x7f102013bce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1018009d90 tx=0x7f101800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 -- 172.21.15.125:0/176710805 shutdown_connections 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 --2- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1020134120 0x7f102013bce0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 --2- 172.21.15.125:0/176710805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10200a0a70 0x7f10200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 -- 172.21.15.125:0/176710805 >> 172.21.15.125:0/176710805 conn(0x7f10200a6610 msgr2=0x7f10200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 -- 172.21.15.125:0/176710805 shutdown_connections 2023-10-03T10:13:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.560+0000 7f1026fc6700 1 -- 172.21.15.125:0/176710805 wait complete. 2023-10-03T10:13:15.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.561+0000 7f1026fc6700 1 Processor -- start 2023-10-03T10:13:15.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.561+0000 7f1026fc6700 1 -- start start 2023-10-03T10:13:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 0x7f1020122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020125ab0 con 0x7f10200a0a70 2023-10-03T10:13:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10201332b0 con 0x7f1020134120 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1026fc6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1020123b70 con 0x7f10200a1380 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f101ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f101ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48048/0 (socket says 172.21.15.125:48048) 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50126/0 (socket says 172.21.15.125:50126) 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f101ffff700 1 -- 172.21.15.125:0/4277279262 learned_addr learned my addr 172.21.15.125:0/4277279262 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1024d62700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 0x7f1020122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 -- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 msgr2=0x7f1020122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 -- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 msgr2=0x7f1020122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 0x7f1020122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 -- 172.21.15.125:0/4277279262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018009a70 con 0x7f1020134120 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f101ffff700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1024d62700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 0x7f1020122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.562+0000 7f1025563700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1018016000 tx=0x7f1018004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012430 con 0x7f1020134120 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018020070 con 0x7f1020134120 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10201336c0 con 0x7f1020134120 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018004280 con 0x7f1020134120 2023-10-03T10:13:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10201339a0 con 0x7f1020134120 2023-10-03T10:13:15.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.563+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020125e70 con 0x7f1020134120 2023-10-03T10:13:15.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.564+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10180043e0 con 0x7f1020134120 2023-10-03T10:13:15.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.564+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1018022070 con 0x7f1020134120 2023-10-03T10:13:15.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.568+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10180269d0 con 0x7f1020134120 2023-10-03T10:13:15.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.716+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d401337b0 con 0x7f9d40133f50 2023-10-03T10:13:15.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.717+0000 7f9d277fe700 1 -- 172.21.15.125:0/1871056018 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d38019270 con 0x7f9d40133f50 2023-10-03T10:13:15.716 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 msgr2=0x7f9d401232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 0x7f9d401232e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cbe0 tx=0x7f9d3800cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 shutdown_connections 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d40133f50 0x7f9d401232e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a0a70 0x7f9d40122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 --2- 172.21.15.125:0/1871056018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d400a1380 0x7f9d40122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 >> 172.21.15.125:0/1871056018 conn(0x7f9d400a6610 msgr2=0x7f9d4009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 shutdown_connections 2023-10-03T10:13:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.719+0000 7f9d45486700 1 -- 172.21.15.125:0/1871056018 wait complete. 2023-10-03T10:13:15.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:15.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.761+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f10201336c0 con 0x7f1020134120 2023-10-03T10:13:15.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.761+0000 7f101d7fa700 1 -- 172.21.15.125:0/4277279262 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10201336c0 con 0x7f1020134120 2023-10-03T10:13:15.761 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 msgr2=0x7f1020123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1018016000 tx=0x7f1018004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 shutdown_connections 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1020134120 0x7f1020123190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10200a0a70 0x7f1020122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 --2- 172.21.15.125:0/4277279262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10200a1380 0x7f1020122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 >> 172.21.15.125:0/4277279262 conn(0x7f10200a6610 msgr2=0x7f10200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 shutdown_connections 2023-10-03T10:13:15.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:15.763+0000 7f1026fc6700 1 -- 172.21.15.125:0/4277279262 wait complete. 2023-10-03T10:13:15.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:16.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:16.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 Processor -- start 2023-10-03T10:13:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 -- start start 2023-10-03T10:13:16.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30b4131f40 0x7f30b4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b409c970 con 0x7f30b409f180 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40a0920 con 0x7f30b4131f40 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b9257700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b409f9c0 con 0x7f30b409e870 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30b4131f40 0x7f30b4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50134/0 (socket says 172.21.15.125:50134) 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30b4131f40 0x7f30b4139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33548/0 (socket says 172.21.15.125:33548) 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f30b409f180 0x7f30b4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42364/0 (socket says 172.21.15.125:42364) 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.410+0000 7f30b2d9d700 1 -- 172.21.15.125:0/3779191398 learned_addr learned my addr 172.21.15.125:0/3779191398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b1d9b700 1 -- 172.21.15.125:0/3779191398 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872545754 0 0) 0x7f30b409c970 con 0x7f30b409f180 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b1d9b700 1 -- 172.21.15.125:0/3779191398 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f309c0035b0 con 0x7f30b409f180 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b359e700 1 -- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 msgr2=0x7f30b409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b359e700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b359e700 1 -- 172.21.15.125:0/3779191398 >> v1:172.21.15.125:6789/0 conn(0x7f30b409f180 legacy=0x7f30b4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b359e700 1 -- 172.21.15.125:0/3779191398 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b409bab0 con 0x7f30b4131f40 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b2d9d700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b359e700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4139ca0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009d90 tx=0x7f30ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb9e28ae0d81d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b1d9b700 1 -- 172.21.15.125:0/3779191398 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00e070 con 0x7f30b4131f40 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b1d9b700 1 -- 172.21.15.125:0/3779191398 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00bae0 con 0x7f30b4131f40 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.411+0000 7f30b1d9b700 1 -- 172.21.15.125:0/3779191398 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00be90 con 0x7f30b4131f40 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 -- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 msgr2=0x7f30b4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4139ca0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009d90 tx=0x7f30ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 -- 172.21.15.125:0/3779191398 shutdown_connections 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4139ca0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 --2- 172.21.15.125:0/3779191398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 -- 172.21.15.125:0/3779191398 >> 172.21.15.125:0/3779191398 conn(0x7f30b40a4430 msgr2=0x7f30b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 -- 172.21.15.125:0/3779191398 shutdown_connections 2023-10-03T10:13:16.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.412+0000 7f30b9257700 1 -- 172.21.15.125:0/3779191398 wait complete. 2023-10-03T10:13:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 Processor -- start 2023-10-03T10:13:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 -- start start 2023-10-03T10:13:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b411ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 0x7f30b4120520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4121bf0 con 0x7f30b4131f40 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4122a80 con 0x7f30b409e870 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b9257700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4123560 con 0x7f30b409f180 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.413+0000 7f30b359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 0x7f30b4120520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33550/0 (socket says 172.21.15.125:33550) 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 -- 172.21.15.125:0/1932878663 learned_addr learned my addr 172.21.15.125:0/1932878663 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b2d9d700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b411ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 -- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 msgr2=0x7f30b4120520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 0x7f30b4120520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 -- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 msgr2=0x7f30b411ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b411ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 -- 172.21.15.125:0/1932878663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4009550 con 0x7f30b4131f40 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b259c700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 0x7f30b4120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b359e700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b680 tx=0x7f30ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0044c0 con 0x7f30b4131f40 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac004620 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac009a70 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac012430 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.414+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b40a2cf0 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.415+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b411ce70 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.415+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30ac012590 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.415+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30ac0412b0 con 0x7f30b4131f40 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.420+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30ac02d940 con 0x7f30b4131f40 2023-10-03T10:13:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 Processor -- start 2023-10-03T10:13:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 -- start start 2023-10-03T10:13:16.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 0x7f8a840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a840a1380 0x7f8a84133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8409dc00 con 0x7f8a84133f50 2023-10-03T10:13:16.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8409ea60 con 0x7f8a840a1380 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a8aa96700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8409dec0 con 0x7f8a840a0a70 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a88832700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 0x7f8a840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a83fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a840a1380 0x7f8a84133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a89033700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8a84133f50 0x7f8a8413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42372/0 (socket says 172.21.15.125:42372) 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.452+0000 7f8a89033700 1 -- 172.21.15.125:0/2704156707 learned_addr learned my addr 172.21.15.125:0/2704156707 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a837fe700 1 -- 172.21.15.125:0/2704156707 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476630669 0 0) 0x7f8a8409dc00 con 0x7f8a84133f50 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a837fe700 1 -- 172.21.15.125:0/2704156707 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a740035b0 con 0x7f8a84133f50 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a83fff700 1 -- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 msgr2=0x7f8a840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a83fff700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 0x7f8a840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a83fff700 1 -- 172.21.15.125:0/2704156707 >> v1:172.21.15.125:6789/0 conn(0x7f8a84133f50 legacy=0x7f8a8413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a83fff700 1 -- 172.21.15.125:0/2704156707 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8409e6a0 con 0x7f8a840a1380 2023-10-03T10:13:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a88832700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 0x7f8a840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a83fff700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a84133a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009840 tx=0x7f8a70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed6a70c41881066 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a837fe700 1 -- 172.21.15.125:0/2704156707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70011830 con 0x7f8a840a1380 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a837fe700 1 -- 172.21.15.125:0/2704156707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70011990 con 0x7f8a840a1380 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.453+0000 7f8a837fe700 1 -- 172.21.15.125:0/2704156707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70011d20 con 0x7f8a840a1380 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 -- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 msgr2=0x7f8a84133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a84133a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009840 tx=0x7f8a70009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 -- 172.21.15.125:0/2704156707 shutdown_connections 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a840a0a70 0x7f8a840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/2704156707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a84133a10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 -- 172.21.15.125:0/2704156707 >> 172.21.15.125:0/2704156707 conn(0x7f8a840a6610 msgr2=0x7f8a840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 -- 172.21.15.125:0/2704156707 shutdown_connections 2023-10-03T10:13:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 -- 172.21.15.125:0/2704156707 wait complete. 2023-10-03T10:13:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.454+0000 7f8a8aa96700 1 Processor -- start 2023-10-03T10:13:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 -- start start 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 0x7f8a8411e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84120350 con 0x7f8a840a1380 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a841336d0 con 0x7f8a84133f50 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a8aa96700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84122260 con 0x7f8a840a0a70 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a88832700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 0x7f8a8411e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a89033700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a83fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a88832700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 0x7f8a8411e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48064/0 (socket says 172.21.15.125:48064) 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a89033700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50146/0 (socket says 172.21.15.125:50146) 2023-10-03T10:13:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a83fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33566/0 (socket says 172.21.15.125:33566) 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.455+0000 7f8a88832700 1 -- 172.21.15.125:0/1222686596 learned_addr learned my addr 172.21.15.125:0/1222686596 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 -- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 msgr2=0x7f8a8411e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 0x7f8a8411e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 -- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 msgr2=0x7f8a8411f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 -- 172.21.15.125:0/1222686596 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a780094a0 con 0x7f8a840a1380 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a89033700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a83fff700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a840a0370 tx=0x7f8a70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70004590 con 0x7f8a840a1380 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7001f070 con 0x7f8a840a1380 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a700094a0 con 0x7f8a840a1380 2023-10-03T10:13:16.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700038e0 con 0x7f8a840a1380 2023-10-03T10:13:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.456+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a840a5600 con 0x7f8a840a1380 2023-10-03T10:13:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.457+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a70003a40 con 0x7f8a840a1380 2023-10-03T10:13:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.457+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a70021070 con 0x7f8a840a1380 2023-10-03T10:13:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.457+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a841220a0 con 0x7f8a840a1380 2023-10-03T10:13:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.461+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a7002b020 con 0x7f8a840a1380 2023-10-03T10:13:16.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.624+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30b41236a0 con 0x7f30b4131f40 2023-10-03T10:13:16.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.624+0000 7f309b7fe700 1 -- 172.21.15.125:0/1932878663 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30ac01b3d0 con 0x7f30b4131f40 2023-10-03T10:13:16.624 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 msgr2=0x7f30b4120a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b680 tx=0x7f30ac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 shutdown_connections 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30b4131f40 0x7f30b4120a60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30b409e870 0x7f30b411ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 --2- 172.21.15.125:0/1932878663 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30b409f180 0x7f30b4120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.626+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 >> 172.21.15.125:0/1932878663 conn(0x7f30b40a4430 msgr2=0x7f30b40720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.627+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 shutdown_connections 2023-10-03T10:13:16.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.627+0000 7f30b9257700 1 -- 172.21.15.125:0/1932878663 wait complete. 2023-10-03T10:13:16.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:16.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.663+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a8404f2a0 con 0x7f8a840a1380 2023-10-03T10:13:16.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.663+0000 7f8a817fa700 1 -- 172.21.15.125:0/1222686596 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a70015070 con 0x7f8a840a1380 2023-10-03T10:13:16.663 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 msgr2=0x7f8a8411ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a840a0370 tx=0x7f8a70004750 comp rx=0 tx=0).stop 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 shutdown_connections 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a84133f50 0x7f8a8411f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a840a0a70 0x7f8a8411e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 --2- 172.21.15.125:0/1222686596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a840a1380 0x7f8a8411ed60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 >> 172.21.15.125:0/1222686596 conn(0x7f8a840a6610 msgr2=0x7f8a840a58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.665+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 shutdown_connections 2023-10-03T10:13:16.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.666+0000 7f8a8aa96700 1 -- 172.21.15.125:0/1222686596 wait complete. 2023-10-03T10:13:16.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:16.731 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:16.776 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.858+0000 7f4f01489700 1 Processor -- start 2023-10-03T10:13:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.858+0000 7f4f01489700 1 -- start start 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4f01489700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 0x7f4efc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4f01489700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 0x7f4efc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4f01489700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc09fa00 con 0x7f4efc134160 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4f01489700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0a0370 con 0x7f4efc09e870 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4f01489700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc06bec0 con 0x7f4efc09f180 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 0x7f4efc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4efc134160 0x7f4efc13ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42388/0 (socket says 172.21.15.125:42388) 2023-10-03T10:13:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efb7fe700 1 -- 172.21.15.125:0/3415009493 learned_addr learned my addr 172.21.15.125:0/3415009493 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efaffd700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 0x7f4efc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 -- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 msgr2=0x7f4efc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 0x7f4efc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 -- 172.21.15.125:0/3415009493 >> v1:172.21.15.125:6789/0 conn(0x7f4efc134160 legacy=0x7f4efc13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4ef9ffb700 1 -- 172.21.15.125:0/3415009493 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023139956 0 0) 0x7f4efc09fa00 con 0x7f4efc134160 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 -- 172.21.15.125:0/3415009493 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc09ada0 con 0x7f4efc09f180 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efaffd700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 0x7f4efc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.859+0000 7f4efa7fc700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 0x7f4efc133c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00098a0 tx=0x7f4ef0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6a01946b774673 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4ef9ffb700 1 -- 172.21.15.125:0/3415009493 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011830 con 0x7f4efc09f180 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4ef9ffb700 1 -- 172.21.15.125:0/3415009493 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0011990 con 0x7f4efc09f180 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4ef9ffb700 1 -- 172.21.15.125:0/3415009493 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011d20 con 0x7f4efc09f180 2023-10-03T10:13:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 -- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 msgr2=0x7f4efc133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 0x7f4efc133c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00098a0 tx=0x7f4ef0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 -- 172.21.15.125:0/3415009493 shutdown_connections 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc09e870 0x7f4efc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 --2- 172.21.15.125:0/3415009493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09f180 0x7f4efc133c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 -- 172.21.15.125:0/3415009493 >> 172.21.15.125:0/3415009493 conn(0x7f4efc0a4430 msgr2=0x7f4efc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 -- 172.21.15.125:0/3415009493 shutdown_connections 2023-10-03T10:13:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.860+0000 7f4f01489700 1 -- 172.21.15.125:0/3415009493 wait complete. 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.861+0000 7f4f01489700 1 Processor -- start 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.861+0000 7f4f01489700 1 -- start start 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 0x7f4efc1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc134160 0x7f4efc123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc125be0 con 0x7f4efc09f180 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc124580 con 0x7f4efc134160 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4f01489700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc123e20 con 0x7f4efc09e870 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 0x7f4efc1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33578/0 (socket says 172.21.15.125:33578) 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 -- 172.21.15.125:0/4226515859 learned_addr learned my addr 172.21.15.125:0/4226515859 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efb7fe700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc134160 0x7f4efc123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 -- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 msgr2=0x7f4efc1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 0x7f4efc1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 -- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc134160 msgr2=0x7f4efc123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc134160 0x7f4efc123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 -- 172.21.15.125:0/4226515859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0094a0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efaffd700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 0x7f4efc1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.862+0000 7f4efa7fc700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097c0 tx=0x7f4ef0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001a9f0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00094a0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc0a15f0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef001ab50 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00243f0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.863+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ef0024550 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.864+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ef0040cc0 con 0x7f4efc09f180 2023-10-03T10:13:16.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.864+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0052e0 con 0x7f4efc09f180 2023-10-03T10:13:16.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.868+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ef0015030 con 0x7f4efc09f180 2023-10-03T10:13:16.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 Processor -- start 2023-10-03T10:13:16.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 -- start start 2023-10-03T10:13:16.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e101300a0 0x7f8e101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1006b2d0 con 0x7f8e101309f0 2023-10-03T10:13:16.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e10133610 con 0x7f8e101300a0 2023-10-03T10:13:16.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e15cf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1009a500 con 0x7f8e10133ad0 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e101300a0 0x7f8e101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50174/0 (socket says 172.21.15.125:50174) 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e101300a0 0x7f8e101304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33584/0 (socket says 172.21.15.125:33584) 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0f7fe700 1 -- 172.21.15.125:0/824341846 learned_addr learned my addr 172.21.15.125:0/824341846 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.903+0000 7f8e0ffff700 1 --1- 172.21.15.125:0/824341846 >> v1:172.21.15.125:6789/0 conn(0x7f8e101309f0 0x7f8e1013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42402/0 (socket says 172.21.15.125:42402) 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0effd700 1 -- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 msgr2=0x7f8e10133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0effd700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0effd700 1 -- 172.21.15.125:0/824341846 >> v1:172.21.15.125:6789/0 conn(0x7f8e101309f0 legacy=0x7f8e1013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0e7fc700 1 -- 172.21.15.125:0/824341846 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756620397 0 0) 0x7f8e1006b2d0 con 0x7f8e101309f0 2023-10-03T10:13:16.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0effd700 1 -- 172.21.15.125:0/824341846 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e101338b0 con 0x7f8e101300a0 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0f7fe700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0effd700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101300a0 0x7f8e101304b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009840 tx=0x7f8e04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19148f6c4556563e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0e7fc700 1 -- 172.21.15.125:0/824341846 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04011830 con 0x7f8e101300a0 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0e7fc700 1 -- 172.21.15.125:0/824341846 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04011990 con 0x7f8e101300a0 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.904+0000 7f8e0e7fc700 1 -- 172.21.15.125:0/824341846 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04011d20 con 0x7f8e101300a0 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 -- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101300a0 msgr2=0x7f8e101304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101300a0 0x7f8e101304b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009840 tx=0x7f8e04009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 -- 172.21.15.125:0/824341846 shutdown_connections 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/824341846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101300a0 0x7f8e101304b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 -- 172.21.15.125:0/824341846 >> 172.21.15.125:0/824341846 conn(0x7f8e10099c40 msgr2=0x7f8e100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 -- 172.21.15.125:0/824341846 shutdown_connections 2023-10-03T10:13:16.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.905+0000 7f8e15cf6700 1 -- 172.21.15.125:0/824341846 wait complete. 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 Processor -- start 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 -- start start 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 0x7f8e100712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101309f0 0x7f8e100717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100a3470 con 0x7f8e101309f0 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1011e100 con 0x7f8e10133ad0 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e15cf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1011f1b0 con 0x7f8e101300a0 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e0ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 0x7f8e100712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e0ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50184/0 (socket says 172.21.15.125:50184) 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e0ffff700 1 -- 172.21.15.125:0/2888860646 learned_addr learned my addr 172.21.15.125:0/2888860646 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.906+0000 7f8e0effd700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101309f0 0x7f8e100717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 -- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 msgr2=0x7f8e10071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 -- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101309f0 msgr2=0x7f8e100717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101309f0 0x7f8e100717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 -- 172.21.15.125:0/2888860646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009550 con 0x7f8e101300a0 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0ffff700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e0f7fe700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 0x7f8e100712a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e9d0 tx=0x7f8e0000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000ee70 con 0x7f8e101300a0 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00004030 con 0x7f8e101300a0 2023-10-03T10:13:16.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e040094a0 con 0x7f8e101300a0 2023-10-03T10:13:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e000043c0 con 0x7f8e101300a0 2023-10-03T10:13:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.907+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1011f8f0 con 0x7f8e101300a0 2023-10-03T10:13:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.908+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e0000c850 con 0x7f8e101300a0 2023-10-03T10:13:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.908+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100a2620 con 0x7f8e101300a0 2023-10-03T10:13:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.908+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e0003f530 con 0x7f8e101300a0 2023-10-03T10:13:16.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:16.913+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e00019d40 con 0x7f8e101300a0 2023-10-03T10:13:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.061+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4edc005590 con 0x7f4efc09f180 2023-10-03T10:13:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.061+0000 7f4ee37fe700 1 -- 172.21.15.125:0/4226515859 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ef0010970 con 0x7f4efc09f180 2023-10-03T10:13:17.061 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:17.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.063+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 msgr2=0x7f4efc122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.063+0000 7f4f01489700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097c0 tx=0x7f4ef0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:17.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 shutdown_connections 2023-10-03T10:13:17.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4efc134160 0x7f4efc123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4efc09e870 0x7f4efc1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 --2- 172.21.15.125:0/4226515859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4efc09f180 0x7f4efc122f00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 >> 172.21.15.125:0/4226515859 conn(0x7f4efc0a4430 msgr2=0x7f4efc070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 shutdown_connections 2023-10-03T10:13:17.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.064+0000 7f4f01489700 1 -- 172.21.15.125:0/4226515859 wait complete. 2023-10-03T10:13:17.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:17.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.108+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e1004f2a0 con 0x7f8e101300a0 2023-10-03T10:13:17.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.108+0000 7f8df7fff700 1 -- 172.21.15.125:0/2888860646 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e00019300 con 0x7f8e101300a0 2023-10-03T10:13:17.107 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 msgr2=0x7f8e100712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 0x7f8e100712a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e9d0 tx=0x7f8e0000ece0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 shutdown_connections 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10133ad0 0x7f8e10071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e101300a0 0x7f8e100712a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 --2- 172.21.15.125:0/2888860646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e101309f0 0x7f8e100717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 >> 172.21.15.125:0/2888860646 conn(0x7f8e10099c40 msgr2=0x7f8e101329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 shutdown_connections 2023-10-03T10:13:17.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.110+0000 7f8e15cf6700 1 -- 172.21.15.125:0/2888860646 wait complete. 2023-10-03T10:13:17.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:17.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:17.677 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 Processor -- start 2023-10-03T10:13:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 -- start start 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f041809d860 0x7f041809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f041809e170 0x7f04181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041809aaa0 con 0x7f0418130ce0 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041809f870 con 0x7f041809e170 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.766+0000 7f0420075700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f041809b360 con 0x7f041809d860 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f041809e170 0x7f04181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041de11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f041809d860 0x7f041809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f041809e170 0x7f04181307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33604/0 (socket says 172.21.15.125:33604) 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041e612700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0418130ce0 0x7f04181379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42418/0 (socket says 172.21.15.125:42418) 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 -- 172.21.15.125:0/3527428198 learned_addr learned my addr 172.21.15.125:0/3527428198 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 -- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f041809d860 msgr2=0x7f041809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 --2- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f041809d860 0x7f041809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 -- 172.21.15.125:0/3527428198 >> v1:172.21.15.125:6789/0 conn(0x7f0418130ce0 legacy=0x7f04181379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 -- 172.21.15.125:0/3527428198 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041809b620 con 0x7f041809e170 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041ce0f700 1 -- 172.21.15.125:0/3527428198 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768579726 0 0) 0x7f041809aaa0 con 0x7f0418130ce0 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041d610700 1 --2- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f04181307a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f040800b9a0 tx=0x7f040800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02fb260f6144704 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041ce0f700 1 -- 172.21.15.125:0/3527428198 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800caa0 con 0x7f041809e170 2023-10-03T10:13:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041ce0f700 1 -- 172.21.15.125:0/3527428198 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040800cc00 con 0x7f041809e170 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.767+0000 7f041ce0f700 1 -- 172.21.15.125:0/3527428198 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800f460 con 0x7f041809e170 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 -- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 msgr2=0x7f04181307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 --2- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f04181307a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f040800b9a0 tx=0x7f040800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 -- 172.21.15.125:0/3527428198 shutdown_connections 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 --2- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f041809d860 0x7f041809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 --2- 172.21.15.125:0/3527428198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f04181307a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 -- 172.21.15.125:0/3527428198 >> 172.21.15.125:0/3527428198 conn(0x7f0418099c40 msgr2=0x7f04180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 -- 172.21.15.125:0/3527428198 shutdown_connections 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.768+0000 7f0420075700 1 -- 172.21.15.125:0/3527428198 wait complete. 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 Processor -- start 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 -- start start 2023-10-03T10:13:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f041809d860 0x7f041811e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 0x7f041811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041811f8f0 con 0x7f041809e170 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0418120650 con 0x7f041809d860 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f0420075700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0418130380 con 0x7f0418130ce0 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f041d610700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f041d610700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33618/0 (socket says 172.21.15.125:33618) 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f041d610700 1 -- 172.21.15.125:0/1675892392 learned_addr learned my addr 172.21.15.125:0/1675892392 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f041e612700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 0x7f041811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.769+0000 7f041de11700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f041809d860 0x7f041811e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 -- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f041809d860 msgr2=0x7f041811e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f041809d860 0x7f041811e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 -- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 msgr2=0x7f041811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 -- 172.21.15.125:0/1675892392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040800b600 con 0x7f0418130ce0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041d610700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f041e612700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 0x7f041811eea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f041000cc10 tx=0x7f041000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000aa00 con 0x7f0418130ce0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000ab80 con 0x7f0418130ce0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100070d0 con 0x7f0418130ce0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0418121f40 con 0x7f0418130ce0 2023-10-03T10:13:17.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.770+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04180a26a0 con 0x7f0418130ce0 2023-10-03T10:13:17.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.771+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0410007230 con 0x7f0418130ce0 2023-10-03T10:13:17.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.771+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f041003f050 con 0x7f0418130ce0 2023-10-03T10:13:17.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.771+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041804f2a0 con 0x7f0418130ce0 2023-10-03T10:13:17.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.776+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0410018020 con 0x7f0418130ce0 2023-10-03T10:13:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.807+0000 7ff65ad53700 1 Processor -- start 2023-10-03T10:13:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.807+0000 7ff65ad53700 1 -- start start 2023-10-03T10:13:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff65ad53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff65ad53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6540a1380 0x7ff654133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff65ad53700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65409dc00 con 0x7ff654133f50 2023-10-03T10:13:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff65ad53700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65409ea60 con 0x7ff6540a1380 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff65ad53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65409dec0 con 0x7ff6540a0a70 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6540a1380 0x7ff654133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff658aef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6540a1380 0x7ff654133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33624/0 (socket says 172.21.15.125:33624) 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff658aef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50210/0 (socket says 172.21.15.125:50210) 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 -- 172.21.15.125:0/50204173 learned_addr learned my addr 172.21.15.125:0/50204173 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 -- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 msgr2=0x7ff6540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 -- 172.21.15.125:0/50204173 >> v1:172.21.15.125:6789/0 conn(0x7ff654133f50 legacy=0x7ff65413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff653fff700 1 -- 172.21.15.125:0/50204173 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65409e6a0 con 0x7ff6540a1380 2023-10-03T10:13:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff6537fe700 1 -- 172.21.15.125:0/50204173 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685252621 0 0) 0x7ff65409dc00 con 0x7ff654133f50 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.808+0000 7ff658aef700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff653fff700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6540a1380 0x7ff654133a10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff6400098f0 tx=0x7ff640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556094d91a176fe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff6537fe700 1 -- 172.21.15.125:0/50204173 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640011830 con 0x7ff6540a1380 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff6537fe700 1 -- 172.21.15.125:0/50204173 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640011990 con 0x7ff6540a1380 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff6537fe700 1 -- 172.21.15.125:0/50204173 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640011d20 con 0x7ff6540a1380 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 -- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6540a1380 msgr2=0x7ff654133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6540a1380 0x7ff654133a10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff6400098f0 tx=0x7ff640009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 -- 172.21.15.125:0/50204173 shutdown_connections 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a0a70 0x7ff6540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 --2- 172.21.15.125:0/50204173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6540a1380 0x7ff654133a10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 -- 172.21.15.125:0/50204173 >> 172.21.15.125:0/50204173 conn(0x7ff6540a6610 msgr2=0x7ff6540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 -- 172.21.15.125:0/50204173 shutdown_connections 2023-10-03T10:13:17.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.809+0000 7ff65ad53700 1 -- 172.21.15.125:0/50204173 wait complete. 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.810+0000 7ff65ad53700 1 Processor -- start 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.810+0000 7ff65ad53700 1 -- start start 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6540a0a70 0x7ff654122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff654133f50 0x7ff654123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654126220 con 0x7ff654133f50 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff654133960 con 0x7ff6540a1380 2023-10-03T10:13:17.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff65ad53700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff654133420 con 0x7ff6540a0a70 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff6592f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff654133f50 0x7ff654123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50218/0 (socket says 172.21.15.125:50218) 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 -- 172.21.15.125:0/3874038048 learned_addr learned my addr 172.21.15.125:0/3874038048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff658aef700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6540a0a70 0x7ff654122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 -- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6540a0a70 msgr2=0x7ff654122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6540a0a70 0x7ff654122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 -- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff654133f50 msgr2=0x7ff654123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff654133f50 0x7ff654123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.811+0000 7ff653fff700 1 -- 172.21.15.125:0/3874038048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480094a0 con 0x7ff6540a1380 2023-10-03T10:13:17.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff653fff700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff640013000 tx=0x7ff640004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640004300 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64001f070 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff640009550 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400036a0 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff654126bb0 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.812+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff640021030 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.813+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff640040a70 con 0x7ff6540a1380 2023-10-03T10:13:17.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.813+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65404f2a0 con 0x7ff6540a1380 2023-10-03T10:13:17.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.817+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff640015020 con 0x7ff6540a1380 2023-10-03T10:13:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.969+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f041806c3b0 con 0x7f0418130ce0 2023-10-03T10:13:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.970+0000 7f040e7fc700 1 -- 172.21.15.125:0/1675892392 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04100074e0 con 0x7f0418130ce0 2023-10-03T10:13:17.969 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 msgr2=0x7f041811eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 0x7f041811eea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f041000cc10 tx=0x7f041000cf20 comp rx=0 tx=0).stop 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 shutdown_connections 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0418130ce0 0x7f041811eea0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f041809d860 0x7f041811e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 --2- 172.21.15.125:0/1675892392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f041809e170 0x7f041811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 >> 172.21.15.125:0/1675892392 conn(0x7f0418099c40 msgr2=0x7f04180a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 shutdown_connections 2023-10-03T10:13:17.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:17.972+0000 7f0420075700 1 -- 172.21.15.125:0/1675892392 wait complete. 2023-10-03T10:13:17.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:18.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.011+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff654072980 con 0x7ff6540a1380 2023-10-03T10:13:18.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.012+0000 7ff6517fa700 1 -- 172.21.15.125:0/3874038048 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6400199a0 con 0x7ff6540a1380 2023-10-03T10:13:18.011 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:18.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 msgr2=0x7ff654122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff640013000 tx=0x7ff640004750 comp rx=0 tx=0).stop 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 shutdown_connections 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff654133f50 0x7ff654123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6540a0a70 0x7ff654122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 --2- 172.21.15.125:0/3874038048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6540a1380 0x7ff654122e40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 >> 172.21.15.125:0/3874038048 conn(0x7ff6540a6610 msgr2=0x7ff6540a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 shutdown_connections 2023-10-03T10:13:18.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.014+0000 7ff65ad53700 1 -- 172.21.15.125:0/3874038048 wait complete. 2023-10-03T10:13:18.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:18.077 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:18.122 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:18.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.203+0000 7f17f5fd9700 1 Processor -- start 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.203+0000 7f17f5fd9700 1 -- start start 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17f0131d70 0x7f17f0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00a0920 con 0x7f17f0131d70 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f009c970 con 0x7f17f009f180 2023-10-03T10:13:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17f5fd9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f009bab0 con 0x7f17f009e870 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17ef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17f0131d70 0x7f17f0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17ef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48122/0 (socket says 172.21.15.125:48122) 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50234/0 (socket says 172.21.15.125:50234) 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17ef7fe700 1 -- 172.21.15.125:0/3289374179 learned_addr learned my addr 172.21.15.125:0/3289374179 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:18.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 -- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 msgr2=0x7f17f009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 -- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 msgr2=0x7f17f0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17effff700 1 -- 172.21.15.125:0/3289374179 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f009f9c0 con 0x7f17f0131d70 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17ef7fe700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.204+0000 7f17eeffd700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17effff700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0131d70 0x7f17f0132210 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009840 tx=0x7f17e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08db2218b1f6479 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17ee7fc700 1 -- 172.21.15.125:0/3289374179 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8011830 con 0x7f17f0131d70 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17ee7fc700 1 -- 172.21.15.125:0/3289374179 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8011990 con 0x7f17f0131d70 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17ee7fc700 1 -- 172.21.15.125:0/3289374179 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8011d20 con 0x7f17f0131d70 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 -- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0131d70 msgr2=0x7f17f0132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0131d70 0x7f17f0132210 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009840 tx=0x7f17e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 -- 172.21.15.125:0/3289374179 shutdown_connections 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0131d70 0x7f17f0132210 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/3289374179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f009f180 0x7f17f0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 -- 172.21.15.125:0/3289374179 >> 172.21.15.125:0/3289374179 conn(0x7f17f00a4430 msgr2=0x7f17f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 -- 172.21.15.125:0/3289374179 shutdown_connections 2023-10-03T10:13:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.205+0000 7f17f5fd9700 1 -- 172.21.15.125:0/3289374179 wait complete. 2023-10-03T10:13:18.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.207+0000 7f17f5fd9700 1 Processor -- start 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.207+0000 7f17f5fd9700 1 -- start start 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f009f180 0x7f17f01c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0131d70 0x7f17f01c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f011c2c0 con 0x7f17f009f180 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f011e8e0 con 0x7f17f0131d70 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01c1ad0 con 0x7f17f009e870 2023-10-03T10:13:18.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f009f180 0x7f17f01c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48138/0 (socket says 172.21.15.125:48138) 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 -- 172.21.15.125:0/2311770303 learned_addr learned my addr 172.21.15.125:0/2311770303 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17effff700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0131d70 0x7f17f01c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 -- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0131d70 msgr2=0x7f17f01c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0131d70 0x7f17f01c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 -- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f009f180 msgr2=0x7f17f01c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f009f180 0x7f17f01c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 -- 172.21.15.125:0/2311770303 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e0009b30 con 0x7f17f009e870 2023-10-03T10:13:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17ef7fe700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17e000eed0 tx=0x7f17e000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0010040 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e000baf0 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d800d940 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000be80 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.208+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e80094a0 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.209+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17e001d410 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.209+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f004f2a0 con 0x7f17f009e870 2023-10-03T10:13:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.209+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17e003f790 con 0x7f17f009e870 2023-10-03T10:13:18.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.218+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17e001d6c0 con 0x7f17f009e870 2023-10-03T10:13:18.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.251+0000 7f13a8034700 1 Processor -- start 2023-10-03T10:13:18.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 -- start start 2023-10-03T10:13:18.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a009da80 con 0x7f13a006a770 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a009dce0 con 0x7f13a0137140 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a8034700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a006b620 con 0x7f13a006b250 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a65d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a55cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a65d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33676/0 (socket says 172.21.15.125:33676) 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a5dd0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13a006a770 0x7f13a006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42442/0 (socket says 172.21.15.125:42442) 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a55cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50254/0 (socket says 172.21.15.125:50254) 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a65d1700 1 -- 172.21.15.125:0/2549757893 learned_addr learned my addr 172.21.15.125:0/2549757893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:18.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.252+0000 7f13a55cf700 1 -- 172.21.15.125:0/2549757893 >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 msgr2=0x7f13a0139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a55cf700 1 --2- 172.21.15.125:0/2549757893 >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a55cf700 1 -- 172.21.15.125:0/2549757893 >> v1:172.21.15.125:6789/0 conn(0x7f13a006a770 legacy=0x7f13a006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a55cf700 1 -- 172.21.15.125:0/2549757893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a009eb20 con 0x7f13a006b250 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a65d1700 1 --2- 172.21.15.125:0/2549757893 >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a4dce700 1 -- 172.21.15.125:0/2549757893 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076662855 0 0) 0x7f13a009da80 con 0x7f13a006a770 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a55cf700 1 --2- 172.21.15.125:0/2549757893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1390009840 tx=0x7f1390009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9750e8622451016 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a4dce700 1 -- 172.21.15.125:0/2549757893 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390011830 con 0x7f13a006b250 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a4dce700 1 -- 172.21.15.125:0/2549757893 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390011990 con 0x7f13a006b250 2023-10-03T10:13:18.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a4dce700 1 -- 172.21.15.125:0/2549757893 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390011d20 con 0x7f13a006b250 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 -- 172.21.15.125:0/2549757893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 msgr2=0x7f13a0136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 --2- 172.21.15.125:0/2549757893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1390009840 tx=0x7f1390009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 -- 172.21.15.125:0/2549757893 shutdown_connections 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 --2- 172.21.15.125:0/2549757893 >> v2:172.21.15.125:3300/0 conn(0x7f13a0137140 0x7f13a0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 --2- 172.21.15.125:0/2549757893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006b250 0x7f13a0136c00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.253+0000 7f13a8034700 1 -- 172.21.15.125:0/2549757893 >> 172.21.15.125:0/2549757893 conn(0x7f13a0099c40 msgr2=0x7f13a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.254+0000 7f13a8034700 1 -- 172.21.15.125:0/2549757893 shutdown_connections 2023-10-03T10:13:18.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.254+0000 7f13a8034700 1 -- 172.21.15.125:0/2549757893 wait complete. 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.254+0000 7f13a8034700 1 Processor -- start 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.254+0000 7f13a8034700 1 -- start start 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a006b250 0x7f13a011e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0121e80 con 0x7f13a0137140 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0121610 con 0x7f13a006a770 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a8034700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0071e10 con 0x7f13a006b250 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a5dd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33688/0 (socket says 172.21.15.125:33688) 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a5dd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50264/0 (socket says 172.21.15.125:50264) 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 -- 172.21.15.125:0/4183159673 learned_addr learned my addr 172.21.15.125:0/4183159673 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 -- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a006b250 msgr2=0x7f13a011e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a006b250 0x7f13a011e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 -- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 msgr2=0x7f13a011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a65d1700 1 -- 172.21.15.125:0/4183159673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139800f050 con 0x7f13a0137140 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.255+0000 7f13a5dd0700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13a65d1700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f139800f500 tx=0x7f139800f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398012050 con 0x7f13a0137140 2023-10-03T10:13:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398013040 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398003e20 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13900094a0 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.256+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a00a0630 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.257+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1398004030 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.257+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1398044140 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.257+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a004f2a0 con 0x7f13a0137140 2023-10-03T10:13:18.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.261+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13980044c0 con 0x7f13a0137140 2023-10-03T10:13:18.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.409+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17f011e540 con 0x7f17f009e870 2023-10-03T10:13:18.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.409+0000 7f17e7fff700 1 -- 172.21.15.125:0/2311770303 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17f011e540 con 0x7f17f009e870 2023-10-03T10:13:18.409 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:18.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.411+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 msgr2=0x7f17f01c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.411+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17e000eed0 tx=0x7f17e000b390 comp rx=0 tx=0).stop 2023-10-03T10:13:18.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 shutdown_connections 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0131d70 0x7f17f01c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17f009e870 0x7f17f01c1050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 --2- 172.21.15.125:0/2311770303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f009f180 0x7f17f01c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 >> 172.21.15.125:0/2311770303 conn(0x7f17f00a4430 msgr2=0x7f17f012fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 shutdown_connections 2023-10-03T10:13:18.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.412+0000 7f17f5fd9700 1 -- 172.21.15.125:0/2311770303 wait complete. 2023-10-03T10:13:18.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:18.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.454+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f13a01211c0 con 0x7f13a0137140 2023-10-03T10:13:18.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.455+0000 7f13967fc700 1 -- 172.21.15.125:0/4183159673 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13980173c0 con 0x7f13a0137140 2023-10-03T10:13:18.454 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:18.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 msgr2=0x7f13a011ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f139800f500 tx=0x7f139800f810 comp rx=0 tx=0).stop 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 shutdown_connections 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a0137140 0x7f13a011ee30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a006a770 0x7f13a011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 --2- 172.21.15.125:0/4183159673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a006b250 0x7f13a011e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 >> 172.21.15.125:0/4183159673 conn(0x7f13a0099c40 msgr2=0x7f13a00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 shutdown_connections 2023-10-03T10:13:18.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:18.457+0000 7f13a8034700 1 -- 172.21.15.125:0/4183159673 wait complete. 2023-10-03T10:13:18.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:18.984 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:19.026 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:19.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.117+0000 7fc5e33b2700 1 Processor -- start 2023-10-03T10:13:19.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.117+0000 7fc5e33b2700 1 -- start start 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 0x7fc5dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 0x7fc5dc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc09e9d0 con 0x7fc5dc133f50 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc09dc00 con 0x7fc5dc0a1380 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e33b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc09dec0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48158/0 (socket says 172.21.15.125:48158) 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 -- 172.21.15.125:0/4272404751 learned_addr learned my addr 172.21.15.125:0/4272404751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e094d700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 0x7fc5dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e194f700 1 --2- 172.21.15.125:0/4272404751 >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 0x7fc5dc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 -- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 msgr2=0x7fc5dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 0x7fc5dc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 -- 172.21.15.125:0/4272404751 >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 msgr2=0x7fc5dc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 --2- 172.21.15.125:0/4272404751 >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 0x7fc5dc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 -- 172.21.15.125:0/4272404751 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc09e6a0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e194f700 1 --2- 172.21.15.125:0/4272404751 >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 0x7fc5dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e094d700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 0x7fc5dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.118+0000 7fc5e114e700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80098f0 tx=0x7fc5d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc28356e3735294 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5d3fff700 1 -- 172.21.15.125:0/4272404751 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011830 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5d3fff700 1 -- 172.21.15.125:0/4272404751 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8011990 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5d3fff700 1 -- 172.21.15.125:0/4272404751 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011d20 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 -- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 msgr2=0x7fc5dc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80098f0 tx=0x7fc5d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:19.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 -- 172.21.15.125:0/4272404751 shutdown_connections 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/4272404751 >> v2:172.21.15.125:3300/0 conn(0x7fc5dc133f50 0x7fc5dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc0a0a70 0x7fc5dc0a0e40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/4272404751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a1380 0x7fc5dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 -- 172.21.15.125:0/4272404751 >> 172.21.15.125:0/4272404751 conn(0x7fc5dc0a6610 msgr2=0x7fc5dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 -- 172.21.15.125:0/4272404751 shutdown_connections 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.119+0000 7fc5e33b2700 1 -- 172.21.15.125:0/4272404751 wait complete. 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 Processor -- start 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 -- start start 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 0x7fc5dc122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 0x7fc5dc122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc133700 con 0x7fc5dc0a1380 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc123830 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e33b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc124dd0 con 0x7fc5dc133f50 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e114e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e114e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50276/0 (socket says 172.21.15.125:50276) 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e114e700 1 -- 172.21.15.125:0/2346911603 learned_addr learned my addr 172.21.15.125:0/2346911603 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e194f700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 0x7fc5dc122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.121+0000 7fc5e094d700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 0x7fc5dc122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 -- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 msgr2=0x7fc5dc122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 0x7fc5dc122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 -- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 msgr2=0x7fc5dc122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 0x7fc5dc122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 -- 172.21.15.125:0/2346911603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0094a0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e194f700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 0x7fc5dc122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e094d700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 0x7fc5dc122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e114e700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc09e000 tx=0x7fc5d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8004240 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d801f070 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4009a70 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80045c0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.122+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d8009550 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.123+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5d8021030 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.123+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc11f760 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.123+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5d80407b0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.128+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5d802d440 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.162+0000 7f7cdcb1e700 1 Processor -- start 2023-10-03T10:13:19.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.162+0000 7f7cdcb1e700 1 -- start start 2023-10-03T10:13:19.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cdcb1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7cd80a1550 0x7f7cd8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cdcb1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 0x7f7cd813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cdcb1e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd809e9d0 con 0x7f7cd80a0a70 2023-10-03T10:13:19.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cdcb1e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd809dc00 con 0x7f7cd80a1550 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cdcb1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd809dec0 con 0x7f7cd8139200 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7cd80a1550 0x7f7cd8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 0x7f7cd813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7cd80a0a70 0x7f7cd80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42450/0 (socket says 172.21.15.125:42450) 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd659c700 1 -- 172.21.15.125:0/2707476624 learned_addr learned my addr 172.21.15.125:0/2707476624 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 msgr2=0x7f7cd813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 0x7f7cd813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2707476624 >> v1:172.21.15.125:6789/0 conn(0x7f7cd80a0a70 legacy=0x7f7cd80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd559a700 1 -- 172.21.15.125:0/2707476624 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647537864 0 0) 0x7f7cd809e9d0 con 0x7f7cd80a0a70 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2707476624 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd809e6a0 con 0x7f7cd80a1550 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd6d9d700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 0x7f7cd813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.163+0000 7f7cd5d9b700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd80a1550 0x7f7cd8138cc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009840 tx=0x7f7ccc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccfa5ec15f16eda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cd559a700 1 -- 172.21.15.125:0/2707476624 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc011830 con 0x7f7cd80a1550 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cd559a700 1 -- 172.21.15.125:0/2707476624 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc011990 con 0x7f7cd80a1550 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cd559a700 1 -- 172.21.15.125:0/2707476624 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc011d20 con 0x7f7cd80a1550 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd80a1550 msgr2=0x7f7cd8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd80a1550 0x7f7cd8138cc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009840 tx=0x7f7ccc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2707476624 shutdown_connections 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd8139200 0x7f7cd813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2707476624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd80a1550 0x7f7cd8138cc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2707476624 >> 172.21.15.125:0/2707476624 conn(0x7f7cd80a6610 msgr2=0x7f7cd80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2707476624 shutdown_connections 2023-10-03T10:13:19.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.164+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2707476624 wait complete. 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.165+0000 7f7cdcb1e700 1 Processor -- start 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.165+0000 7f7cdcb1e700 1 -- start start 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 0x7f7cd81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 0x7f7cd8121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8124420 con 0x7f7cd8139200 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80a5100 con 0x7f7cd80a0a70 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cdcb1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8123ac0 con 0x7f7cd80a1550 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 0x7f7cd81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48192/0 (socket says 172.21.15.125:48192) 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2699360346 learned_addr learned my addr 172.21.15.125:0/2699360346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd6d9d700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 0x7f7cd8121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 msgr2=0x7f7cd81207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 0x7f7cd81207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 msgr2=0x7f7cd8121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 0x7f7cd8121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 -- 172.21.15.125:0/2699360346 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0009a70 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd659c700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 0x7f7cd81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd6d9d700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 0x7f7cd8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.166+0000 7f7cd5d9b700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009fd0 tx=0x7f7ccc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0045d0 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc01f070 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc0094a0 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0038a0 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd8124030 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.167+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ccc003a00 con 0x7f7cd80a1550 2023-10-03T10:13:19.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.168+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd804f2a0 con 0x7f7cd80a1550 2023-10-03T10:13:19.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.168+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ccc021070 con 0x7f7cd80a1550 2023-10-03T10:13:19.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.172+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ccc010be0 con 0x7f7cd80a1550 2023-10-03T10:13:19.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.329+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5dc0a03e0 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.329+0000 7fc5d1ffb700 1 -- 172.21.15.125:0/2346911603 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5d8015020 con 0x7fc5dc0a0a70 2023-10-03T10:13:19.329 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 msgr2=0x7fc5dc1223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc09e000 tx=0x7fc5d8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 shutdown_connections 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5dc133f50 0x7fc5dc122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5dc0a0a70 0x7fc5dc1223d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 --2- 172.21.15.125:0/2346911603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5dc0a1380 0x7fc5dc122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 >> 172.21.15.125:0/2346911603 conn(0x7fc5dc0a6610 msgr2=0x7fc5dc11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 shutdown_connections 2023-10-03T10:13:19.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.331+0000 7fc5e33b2700 1 -- 172.21.15.125:0/2346911603 wait complete. 2023-10-03T10:13:19.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.364+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7cd8122bf0 con 0x7f7cd80a1550 2023-10-03T10:13:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.364+0000 7f7cc6ffd700 1 -- 172.21.15.125:0/2699360346 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ccc02b020 con 0x7f7cd80a1550 2023-10-03T10:13:19.363 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 msgr2=0x7f7cd8120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009fd0 tx=0x7f7ccc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 shutdown_connections 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cd8139200 0x7f7cd8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cd80a0a70 0x7f7cd81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 --2- 172.21.15.125:0/2699360346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7cd80a1550 0x7f7cd8120d30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 >> 172.21.15.125:0/2699360346 conn(0x7f7cd80a6610 msgr2=0x7f7cd80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 shutdown_connections 2023-10-03T10:13:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.366+0000 7f7cdcb1e700 1 -- 172.21.15.125:0/2699360346 wait complete. 2023-10-03T10:13:19.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:19.425 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:19.469 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 Processor -- start 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 -- start start 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 0x7f94001343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 0x7f94000a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94000a3b60 con 0x7f940009ad40 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94001348e0 con 0x7f9400133f70 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f9405252700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940009b110 con 0x7f94000a0a70 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f93fed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f93ff59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 0x7f94000a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f93fed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33740/0 (socket says 172.21.15.125:33740) 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f93fed9d700 1 -- 172.21.15.125:0/3340247173 learned_addr learned my addr 172.21.15.125:0/3340247173 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.553+0000 7f93fe59c700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 0x7f94001343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 -- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 msgr2=0x7f94001343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 0x7f94001343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 -- 172.21.15.125:0/3340247173 >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 msgr2=0x7f9400133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 --2- 172.21.15.125:0/3340247173 >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 -- 172.21.15.125:0/3340247173 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000a2fa0 con 0x7f94000a0a70 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93fed9d700 1 --2- 172.21.15.125:0/3340247173 >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93fe59c700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 0x7f94001343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93ff59e700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 0x7f94000a0f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009dc0 tx=0x7f93f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30837b334e45d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93fdd9b700 1 -- 172.21.15.125:0/3340247173 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800e070 con 0x7f94000a0a70 2023-10-03T10:13:19.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93fdd9b700 1 -- 172.21.15.125:0/3340247173 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800bae0 con 0x7f94000a0a70 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.554+0000 7f93fdd9b700 1 -- 172.21.15.125:0/3340247173 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800be90 con 0x7f94000a0a70 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 -- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 msgr2=0x7f94000a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 0x7f94000a0f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009dc0 tx=0x7f93f800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 -- 172.21.15.125:0/3340247173 shutdown_connections 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f94000a0a70 0x7f94000a0f10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 --2- 172.21.15.125:0/3340247173 >> v2:172.21.15.125:3300/0 conn(0x7f940009ad40 0x7f9400133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 --2- 172.21.15.125:0/3340247173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9400133f70 0x7f94001343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 -- 172.21.15.125:0/3340247173 >> 172.21.15.125:0/3340247173 conn(0x7f9400099c40 msgr2=0x7f940006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 -- 172.21.15.125:0/3340247173 shutdown_connections 2023-10-03T10:13:19.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.555+0000 7f9405252700 1 -- 172.21.15.125:0/3340247173 wait complete. 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 Processor -- start 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 -- start start 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 0x7f94001226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 0x7f9400122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400123f30 con 0x7f940009ad40 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400124c40 con 0x7f94000a0a70 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f9405252700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9400125000 con 0x7f9400133f70 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.556+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93ff59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 0x7f9400122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33744/0 (socket says 172.21.15.125:33744) 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 -- 172.21.15.125:0/212381679 learned_addr learned my addr 172.21.15.125:0/212381679 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fe59c700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 0x7f94001226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 -- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 msgr2=0x7f9400122c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 0x7f9400122c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 -- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 msgr2=0x7f94001226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 0x7f94001226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 -- 172.21.15.125:0/212381679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0009550 con 0x7f940009ad40 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93ff59e700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 0x7f9400122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fe59c700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 0x7f94001226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93fed9d700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e960 tx=0x7f93f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0004030 con 0x7f940009ad40 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f0004190 con 0x7f940009ad40 2023-10-03T10:13:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f40094a0 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0004520 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.557+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8009a70 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.558+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93f00036a0 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.558+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93f003f570 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.558+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940004f2a0 con 0x7f940009ad40 2023-10-03T10:13:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.563+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93f0003950 con 0x7f940009ad40 2023-10-03T10:13:19.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.597+0000 7f2d244e8700 1 Processor -- start 2023-10-03T10:13:19.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.597+0000 7f2d244e8700 1 -- start start 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d244e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d244e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d244e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c09aaa0 con 0x7f2d1c09d860 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d244e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c09e730 con 0x7f2d1c09e340 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d244e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c09f870 con 0x7f2d1c135f20 2023-10-03T10:13:19.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22a85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22284700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2d1c09d860 0x7f2d1c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42452/0 (socket says 172.21.15.125:42452) 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22284700 1 -- 172.21.15.125:0/1452463808 learned_addr learned my addr 172.21.15.125:0/1452463808 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d21a83700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22a85700 1 -- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 msgr2=0x7f2d1c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22a85700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22a85700 1 -- 172.21.15.125:0/1452463808 >> v1:172.21.15.125:6789/0 conn(0x7f2d1c09d860 legacy=0x7f2d1c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d22a85700 1 -- 172.21.15.125:0/1452463808 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c09b360 con 0x7f2d1c135f20 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.598+0000 7f2d21282700 1 -- 172.21.15.125:0/1452463808 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146931944 0 0) 0x7f2d1c09aaa0 con 0x7f2d1c09d860 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d21a83700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d22a85700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c138300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400be90 tx=0x7f2d140092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178fd40de916cfde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d21282700 1 -- 172.21.15.125:0/1452463808 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400c850 con 0x7f2d1c135f20 2023-10-03T10:13:19.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d21282700 1 -- 172.21.15.125:0/1452463808 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400c9b0 con 0x7f2d1c135f20 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d21282700 1 -- 172.21.15.125:0/1452463808 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400cd40 con 0x7f2d1c135f20 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 -- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 msgr2=0x7f2d1c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c138300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400be90 tx=0x7f2d140092f0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 -- 172.21.15.125:0/1452463808 shutdown_connections 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c138300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 --2- 172.21.15.125:0/1452463808 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 -- 172.21.15.125:0/1452463808 >> 172.21.15.125:0/1452463808 conn(0x7f2d1c099c40 msgr2=0x7f2d1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.599+0000 7f2d244e8700 1 -- 172.21.15.125:0/1452463808 shutdown_connections 2023-10-03T10:13:19.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.600+0000 7f2d244e8700 1 -- 172.21.15.125:0/1452463808 wait complete. 2023-10-03T10:13:19.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.600+0000 7f2d244e8700 1 Processor -- start 2023-10-03T10:13:19.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.600+0000 7f2d244e8700 1 -- start start 2023-10-03T10:13:19.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1c09d860 0x7f2d1c11b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c11bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c11eea0 con 0x7f2d1c09d860 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0a0700 con 0x7f2d1c09e340 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d244e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c09c8b0 con 0x7f2d1c135f20 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50318/0 (socket says 172.21.15.125:50318) 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 -- 172.21.15.125:0/2810640218 learned_addr learned my addr 172.21.15.125:0/2810640218 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d22284700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1c09d860 0x7f2d1c11b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d22a85700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c11bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 -- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 msgr2=0x7f2d1c11bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c11bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 -- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1c09d860 msgr2=0x7f2d1c11b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1c09d860 0x7f2d1c11b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 -- 172.21.15.125:0/2810640218 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1800d940 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.601+0000 7f2d21a83700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d18012fc0 tx=0x7f2d180103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.602+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18010b00 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.602+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18013040 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.602+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1400ba90 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.602+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18010e60 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.602+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c11c720 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.603+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d18018480 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.603+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c11e1b0 con 0x7f2d1c09e340 2023-10-03T10:13:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.603+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d180436e0 con 0x7f2d1c09e340 2023-10-03T10:13:19.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.607+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d18018730 con 0x7f2d1c09e340 2023-10-03T10:13:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.757+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94000729d0 con 0x7f940009ad40 2023-10-03T10:13:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.757+0000 7f93e77fe700 1 -- 172.21.15.125:0/212381679 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93f0019300 con 0x7f940009ad40 2023-10-03T10:13:19.757 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 msgr2=0x7f94001221a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e960 tx=0x7f93f000ec70 comp rx=0 tx=0).stop 2023-10-03T10:13:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 shutdown_connections 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9400133f70 0x7f9400122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f940009ad40 0x7f94001221a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 --2- 172.21.15.125:0/212381679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f94000a0a70 0x7f94001226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 >> 172.21.15.125:0/212381679 conn(0x7f9400099c40 msgr2=0x7f94000a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 shutdown_connections 2023-10-03T10:13:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.760+0000 7f9405252700 1 -- 172.21.15.125:0/212381679 wait complete. 2023-10-03T10:13:19.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.799+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d1c04f2a0 con 0x7f2d1c09e340 2023-10-03T10:13:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.799+0000 7f2d12ffd700 1 -- 172.21.15.125:0/2810640218 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d1800dca0 con 0x7f2d1c09e340 2023-10-03T10:13:19.799 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 msgr2=0x7f2d1c11b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d18012fc0 tx=0x7f2d180103a0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 shutdown_connections 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d1c135f20 0x7f2d1c11bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1c09d860 0x7f2d1c11b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 --2- 172.21.15.125:0/2810640218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d1c09e340 0x7f2d1c11b890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 >> 172.21.15.125:0/2810640218 conn(0x7f2d1c099c40 msgr2=0x7f2d1c1328a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 shutdown_connections 2023-10-03T10:13:19.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:19.801+0000 7f2d244e8700 1 -- 172.21.15.125:0/2810640218 wait complete. 2023-10-03T10:13:19.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:20.343 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:20.378 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 Processor -- start 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 -- start start 2023-10-03T10:13:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19809c970 con 0x7fa19809f180 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980a0920 con 0x7fa19809e870 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.472+0000 7fa19d1a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa19809f9c0 con 0x7fa198131f40 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa19759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa19659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa19809f180 0x7fa198131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42456/0 (socket says 172.21.15.125:42456) 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50324/0 (socket says 172.21.15.125:50324) 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa19659c700 1 -- 172.21.15.125:0/2452492817 learned_addr learned my addr 172.21.15.125:0/2452492817 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa19759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48238/0 (socket says 172.21.15.125:48238) 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa195d9b700 1 -- 172.21.15.125:0/2452492817 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489363141 0 0) 0x7fa19809c970 con 0x7fa19809f180 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa195d9b700 1 -- 172.21.15.125:0/2452492817 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1840035b0 con 0x7fa19809f180 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 -- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 msgr2=0x7fa198139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 -- 172.21.15.125:0/2452492817 >> v1:172.21.15.125:6789/0 conn(0x7fa19809f180 legacy=0x7fa198131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 -- 172.21.15.125:0/2452492817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19809bab0 con 0x7fa19809e870 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa19759e700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa196d9d700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa190009870 tx=0x7fa190009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fab55f1148230eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa195d9b700 1 -- 172.21.15.125:0/2452492817 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190011830 con 0x7fa19809e870 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa195d9b700 1 -- 172.21.15.125:0/2452492817 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa190011990 con 0x7fa19809e870 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.473+0000 7fa195d9b700 1 -- 172.21.15.125:0/2452492817 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190011d20 con 0x7fa19809e870 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 -- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 msgr2=0x7fa19809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa190009870 tx=0x7fa190009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 -- 172.21.15.125:0/2452492817 shutdown_connections 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa198139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/2452492817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19809ec40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 -- 172.21.15.125:0/2452492817 >> 172.21.15.125:0/2452492817 conn(0x7fa1980a4430 msgr2=0x7fa1980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 -- 172.21.15.125:0/2452492817 shutdown_connections 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.474+0000 7fa19d1a5700 1 -- 172.21.15.125:0/2452492817 wait complete. 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 Processor -- start 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 -- start start 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 0x7fa19806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa198124e00 con 0x7fa19809f180 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa198123790 con 0x7fa19809e870 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19d1a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1981248f0 con 0x7fa198131f40 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa196d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 0x7fa19806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa196d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50336/0 (socket says 172.21.15.125:50336) 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa196d9d700 1 -- 172.21.15.125:0/1843896297 learned_addr learned my addr 172.21.15.125:0/1843896297 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48244/0 (socket says 172.21.15.125:48244) 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19659c700 1 -- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 msgr2=0x7fa19806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19659c700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19659c700 1 -- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 msgr2=0x7fa19806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.476+0000 7fa19659c700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa19659c700 1 -- 172.21.15.125:0/1843896297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009a70 con 0x7fa19809f180 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa196d9d700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa19759e700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa19659c700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 0x7fa19806bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa18000c490 tx=0x7fa18000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180005d70 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1800070d0 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900094a0 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180007440 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.477+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1981245f0 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.478+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1800075a0 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.478+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa18003e4f0 con 0x7fa19809f180 2023-10-03T10:13:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.478+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19811be60 con 0x7fa19809f180 2023-10-03T10:13:20.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.483+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa180017020 con 0x7fa19809f180 2023-10-03T10:13:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.511+0000 7f301b91e700 1 Processor -- start 2023-10-03T10:13:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 -- start start 2023-10-03T10:13:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f3014133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3014133f70 0x7f30141343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30140a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140a3b60 con 0x7f3014133f70 2023-10-03T10:13:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30141348e0 con 0x7f301409ad40 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f301b91e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f301409b110 con 0x7f30140a0a70 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f30196ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f3014133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3019ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30140a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f30196ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f3014133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50348/0 (socket says 172.21.15.125:50348) 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3019ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30140a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48248/0 (socket says 172.21.15.125:48248) 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f30196ba700 1 -- 172.21.15.125:0/1200511116 learned_addr learned my addr 172.21.15.125:0/1200511116 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3018eb9700 1 --2- 172.21.15.125:0/1200511116 >> v2:172.21.15.125:3300/0 conn(0x7f3014133f70 0x7f30141343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3018eb9700 1 -- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 msgr2=0x7f30140a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3018eb9700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30140a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.512+0000 7f3018eb9700 1 -- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 msgr2=0x7f3014133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f3018eb9700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f3014133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f3018eb9700 1 -- 172.21.15.125:0/1200511116 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140a2fa0 con 0x7f3014133f70 2023-10-03T10:13:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f3018eb9700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141343a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3004009870 tx=0x7f3004009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11ed9e05c6c53cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f300bfff700 1 -- 172.21.15.125:0/1200511116 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004011830 con 0x7f3014133f70 2023-10-03T10:13:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f300bfff700 1 -- 172.21.15.125:0/1200511116 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004011990 con 0x7f3014133f70 2023-10-03T10:13:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f300bfff700 1 -- 172.21.15.125:0/1200511116 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004011d20 con 0x7f3014133f70 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 -- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 msgr2=0x7f30141343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141343a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3004009870 tx=0x7f3004009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 -- 172.21.15.125:0/1200511116 shutdown_connections 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f3014133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30140a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 --2- 172.21.15.125:0/1200511116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141343a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.513+0000 7f301b91e700 1 -- 172.21.15.125:0/1200511116 >> 172.21.15.125:0/1200511116 conn(0x7f3014099c40 msgr2=0x7f301406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.514+0000 7f301b91e700 1 -- 172.21.15.125:0/1200511116 shutdown_connections 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.514+0000 7f301b91e700 1 -- 172.21.15.125:0/1200511116 wait complete. 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 Processor -- start 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 -- start start 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f30141c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30141c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141208e0 con 0x7f3014133f70 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30141206f0 con 0x7f301409ad40 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.515+0000 7f301b91e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f301409c7e0 con 0x7f30140a0a70 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3019ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f30141c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3019ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33778/0 (socket says 172.21.15.125:33778) 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3019ebb700 1 -- 172.21.15.125:0/2202082134 learned_addr learned my addr 172.21.15.125:0/2202082134 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3018eb9700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30141c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 -- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 msgr2=0x7f30141c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30141c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 -- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 msgr2=0x7f30141c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 -- 172.21.15.125:0/2202082134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040094a0 con 0x7f301409ad40 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3018eb9700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30141c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f30196ba700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f30141c8300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f301000e840 tx=0x7f301000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010013680 con 0x7f301409ad40 2023-10-03T10:13:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3014122600 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30100137e0 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010013b90 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.516+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301409bf30 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.517+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3014120f40 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.518+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3010013cf0 con 0x7f301409ad40 2023-10-03T10:13:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.518+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f301003fca0 con 0x7f301409ad40 2023-10-03T10:13:20.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.526+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f301001ada0 con 0x7f301409ad40 2023-10-03T10:13:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.682+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa198124590 con 0x7fa19809f180 2023-10-03T10:13:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.682+0000 7fa18f7fe700 1 -- 172.21.15.125:0/1843896297 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa18001a360 con 0x7fa19809f180 2023-10-03T10:13:20.683 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 msgr2=0x7fa19806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 0x7fa19806bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa18000c490 tx=0x7fa18000c7a0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 shutdown_connections 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa198131f40 0x7fa19806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa19809e870 0x7fa19806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 --2- 172.21.15.125:0/1843896297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19809f180 0x7fa19806bdf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 >> 172.21.15.125:0/1843896297 conn(0x7fa1980a4430 msgr2=0x7fa19809d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 shutdown_connections 2023-10-03T10:13:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.684+0000 7fa19d1a5700 1 -- 172.21.15.125:0/1843896297 wait complete. 2023-10-03T10:13:20.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:20.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.720+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f301404f2a0 con 0x7f301409ad40 2023-10-03T10:13:20.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.720+0000 7f3009ffb700 1 -- 172.21.15.125:0/2202082134 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3010017070 con 0x7f301409ad40 2023-10-03T10:13:20.721 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 msgr2=0x7f30141c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f30141c8300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f301000e840 tx=0x7f301000eb50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 shutdown_connections 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3014133f70 0x7f30141c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f301409ad40 0x7f30141c8300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 --2- 172.21.15.125:0/2202082134 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f30140a0a70 0x7f30141c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 >> 172.21.15.125:0/2202082134 conn(0x7f3014099c40 msgr2=0x7f301409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 shutdown_connections 2023-10-03T10:13:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.722+0000 7f301b91e700 1 -- 172.21.15.125:0/2202082134 wait complete. 2023-10-03T10:13:20.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:20.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:20.814 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.900+0000 7f9ed6498700 1 Processor -- start 2023-10-03T10:13:20.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.900+0000 7f9ed6498700 1 -- start start 2023-10-03T10:13:20.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed6498700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed6498700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 0x7f9ed013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed6498700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed009dc00 con 0x7f9ed00a1380 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed6498700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed009ea90 con 0x7f9ed00a0a70 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed6498700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed009dec0 con 0x7f9ed0134120 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50374/0 (socket says 172.21.15.125:50374) 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ecffff700 1 -- 172.21.15.125:0/2554924524 learned_addr learned my addr 172.21.15.125:0/2554924524 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 0x7f9ed013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9eceffd700 1 -- 172.21.15.125:0/2554924524 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346478632 0 0) 0x7f9ed009dc00 con 0x7f9ed00a1380 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 -- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 msgr2=0x7f9ed00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 -- 172.21.15.125:0/2554924524 >> v1:172.21.15.125:6789/0 conn(0x7f9ed00a1380 legacy=0x7f9ed0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 -- 172.21.15.125:0/2554924524 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed009e6a0 con 0x7f9ed0134120 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ecffff700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9ed4a35700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 0x7f9ed013bce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009dc0 tx=0x7f9ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba624207a833fab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9eceffd700 1 -- 172.21.15.125:0/2554924524 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800e070 con 0x7f9ed0134120 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9eceffd700 1 -- 172.21.15.125:0/2554924524 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800bb20 con 0x7f9ed0134120 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.901+0000 7f9eceffd700 1 -- 172.21.15.125:0/2554924524 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8012430 con 0x7f9ed0134120 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 -- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 msgr2=0x7f9ed013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 0x7f9ed013bce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009dc0 tx=0x7f9ec800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 -- 172.21.15.125:0/2554924524 shutdown_connections 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed0134120 0x7f9ed013bce0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 --2- 172.21.15.125:0/2554924524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed00a0a70 0x7f9ed00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 -- 172.21.15.125:0/2554924524 >> 172.21.15.125:0/2554924524 conn(0x7f9ed00a6610 msgr2=0x7f9ed00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 -- 172.21.15.125:0/2554924524 shutdown_connections 2023-10-03T10:13:20.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.902+0000 7f9ed6498700 1 -- 172.21.15.125:0/2554924524 wait complete. 2023-10-03T10:13:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.903+0000 7f9ed6498700 1 Processor -- start 2023-10-03T10:13:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.903+0000 7f9ed6498700 1 -- start start 2023-10-03T10:13:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed0134120 0x7f9ed0123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01258f0 con 0x7f9ed00a1380 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0133640 con 0x7f9ed0134120 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01262f0 con 0x7f9ed00a0a70 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed4a35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed0134120 0x7f9ed0123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48280/0 (socket says 172.21.15.125:48280) 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33782/0 (socket says 172.21.15.125:33782) 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 -- 172.21.15.125:0/3976655778 learned_addr learned my addr 172.21.15.125:0/3976655778 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 -- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed0134120 msgr2=0x7f9ed0123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed0134120 0x7f9ed0123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 -- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 msgr2=0x7f9ed0122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 -- 172.21.15.125:0/3976655778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009550 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecf7fe700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ecffff700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ebe0 tx=0x7f9ec000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000c850 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000c9b0 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec8009a70 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.904+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000cd40 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.905+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed00a0430 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.905+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ec0013470 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.905+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ec003f860 con 0x7f9ed00a0a70 2023-10-03T10:13:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.905+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0126a60 con 0x7f9ed00a0a70 2023-10-03T10:13:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.910+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ec0017080 con 0x7f9ed00a0a70 2023-10-03T10:13:20.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.943+0000 7f01b337d700 1 Processor -- start 2023-10-03T10:13:20.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.943+0000 7f01b337d700 1 -- start start 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.943+0000 7f01b337d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b337d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b337d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b337d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0a3b60 con 0x7f01ac09ad40 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b337d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1348e0 con 0x7f01ac133f70 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b337d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac09b110 con 0x7f01ac0a0a70 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b1119700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b191a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b191a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48284/0 (socket says 172.21.15.125:48284) 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b1119700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33796/0 (socket says 172.21.15.125:33796) 2023-10-03T10:13:20.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b191a700 1 -- 172.21.15.125:0/1048718448 learned_addr learned my addr 172.21.15.125:0/1048718448 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 -- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 msgr2=0x7f01ac0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 -- 172.21.15.125:0/1048718448 >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 msgr2=0x7f01ac133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 --2- 172.21.15.125:0/1048718448 >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 -- 172.21.15.125:0/1048718448 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0a2fa0 con 0x7f01ac133f70 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b191a700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b1119700 1 --2- 172.21.15.125:0/1048718448 >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01b0918700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac1343a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f019c009840 tx=0x7f019c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3027b3fc3c94af89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01a3fff700 1 -- 172.21.15.125:0/1048718448 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c011830 con 0x7f01ac133f70 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01a3fff700 1 -- 172.21.15.125:0/1048718448 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c011990 con 0x7f01ac133f70 2023-10-03T10:13:20.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.944+0000 7f01a3fff700 1 -- 172.21.15.125:0/1048718448 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c011d20 con 0x7f01ac133f70 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 -- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 msgr2=0x7f01ac1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac1343a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f019c009840 tx=0x7f019c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 -- 172.21.15.125:0/1048718448 shutdown_connections 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 --2- 172.21.15.125:0/1048718448 >> v2:172.21.15.125:3300/0 conn(0x7f01ac09ad40 0x7f01ac133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 --2- 172.21.15.125:0/1048718448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac1343a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 -- 172.21.15.125:0/1048718448 >> 172.21.15.125:0/1048718448 conn(0x7f01ac099c40 msgr2=0x7f01ac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 -- 172.21.15.125:0/1048718448 shutdown_connections 2023-10-03T10:13:20.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.945+0000 7f01b337d700 1 -- 172.21.15.125:0/1048718448 wait complete. 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.946+0000 7f01b337d700 1 Processor -- start 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.946+0000 7f01b337d700 1 -- start start 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 0x7f01ac121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1226d0 con 0x7f01ac09ad40 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac124a70 con 0x7f01ac133f70 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b337d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac133a30 con 0x7f01ac0a0a70 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b1119700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 0x7f01ac121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48296/0 (socket says 172.21.15.125:48296) 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 -- 172.21.15.125:0/460507873 learned_addr learned my addr 172.21.15.125:0/460507873 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:20.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b191a700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 -- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 msgr2=0x7f01ac121cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac121cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 -- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 msgr2=0x7f01ac121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 0x7f01ac121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b0918700 1 -- 172.21.15.125:0/460507873 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80094a0 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.947+0000 7f01b1119700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 0x7f01ac121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01b0918700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f019c0090b0 tx=0x7f019c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c004450 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c0045b0 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a4009b30 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0038a0 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.948+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c0094a0 con 0x7f01ac0a0a70 2023-10-03T10:13:20.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.949+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f019c003a00 con 0x7f01ac0a0a70 2023-10-03T10:13:20.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.949+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f019c040450 con 0x7f01ac0a0a70 2023-10-03T10:13:20.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.949+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac11e060 con 0x7f01ac0a0a70 2023-10-03T10:13:20.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:20.954+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f019c015080 con 0x7f01ac0a0a70 2023-10-03T10:13:21.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.107+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ed004f2a0 con 0x7f9ed00a0a70 2023-10-03T10:13:21.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.108+0000 7f9eccff9700 1 -- 172.21.15.125:0/3976655778 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ec0021020 con 0x7f9ed00a0a70 2023-10-03T10:13:21.108 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 msgr2=0x7f9ed0122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ebe0 tx=0x7f9ec000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 shutdown_connections 2023-10-03T10:13:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ed0134120 0x7f9ed0123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ed00a0a70 0x7f9ed0122890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 --2- 172.21.15.125:0/3976655778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ed00a1380 0x7f9ed0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 >> 172.21.15.125:0/3976655778 conn(0x7f9ed00a6610 msgr2=0x7f9ed009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 shutdown_connections 2023-10-03T10:13:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.110+0000 7f9ed6498700 1 -- 172.21.15.125:0/3976655778 wait complete. 2023-10-03T10:13:21.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.149+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01ac04f2a0 con 0x7f01ac0a0a70 2023-10-03T10:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.149+0000 7f01a1ffb700 1 -- 172.21.15.125:0/460507873 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f019c003cb0 con 0x7f01ac0a0a70 2023-10-03T10:13:21.150 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 msgr2=0x7f01ac1217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f019c0090b0 tx=0x7f019c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 shutdown_connections 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01ac133f70 0x7f01ac121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01ac09ad40 0x7f01ac121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 --2- 172.21.15.125:0/460507873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01ac0a0a70 0x7f01ac1217b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 >> 172.21.15.125:0/460507873 conn(0x7f01ac099c40 msgr2=0x7f01ac133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 shutdown_connections 2023-10-03T10:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.152+0000 7f01b337d700 1 -- 172.21.15.125:0/460507873 wait complete. 2023-10-03T10:13:21.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:21.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:21.735 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.826+0000 7f5f0907e700 1 Processor -- start 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.826+0000 7f5f0907e700 1 -- start start 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0907e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f040a1550 0x7f5f04138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0907e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f04139200 0x7f5f0413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0907e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0409e9d0 con 0x7f5f040a0a70 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0907e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0409dc00 con 0x7f5f04139200 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0907e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0409dec0 con 0x7f5f040a1550 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f04139200 0x7f5f0413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f02d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f040a0a70 0x7f5f040a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42468/0 (socket says 172.21.15.125:42468) 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f040a1550 0x7f5f04138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f02d9d700 1 -- 172.21.15.125:0/181445456 learned_addr learned my addr 172.21.15.125:0/181445456 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 -- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f040a1550 msgr2=0x7f5f04138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 --2- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f040a1550 0x7f5f04138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 -- 172.21.15.125:0/181445456 >> v1:172.21.15.125:6789/0 conn(0x7f5f040a0a70 legacy=0x7f5f040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 -- 172.21.15.125:0/181445456 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0409e6a0 con 0x7f5f04139200 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f01d9b700 1 -- 172.21.15.125:0/181445456 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609646036 0 0) 0x7f5f0409e9d0 con 0x7f5f040a0a70 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f0359e700 1 --2- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f04139200 0x7f5f0413b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009d90 tx=0x7f5efc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6ff3232bc98dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f01d9b700 1 -- 172.21.15.125:0/181445456 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc00e070 con 0x7f5f04139200 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f01d9b700 1 -- 172.21.15.125:0/181445456 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc00bb20 con 0x7f5f04139200 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.827+0000 7f5f01d9b700 1 -- 172.21.15.125:0/181445456 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc012430 con 0x7f5f04139200 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 -- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f04139200 msgr2=0x7f5f0413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 --2- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f04139200 0x7f5f0413b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009d90 tx=0x7f5efc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 -- 172.21.15.125:0/181445456 shutdown_connections 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 --2- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f04139200 0x7f5f0413b5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 --2- 172.21.15.125:0/181445456 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f040a1550 0x7f5f04138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 -- 172.21.15.125:0/181445456 >> 172.21.15.125:0/181445456 conn(0x7f5f040a6610 msgr2=0x7f5f040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 -- 172.21.15.125:0/181445456 shutdown_connections 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.828+0000 7f5f0907e700 1 -- 172.21.15.125:0/181445456 wait complete. 2023-10-03T10:13:21.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 Processor -- start 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 -- start start 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 0x7f5f041207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f041239a0 con 0x7f5f040a1550 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04122c70 con 0x7f5f040a0a70 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0907e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f041223a0 con 0x7f5f04139200 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33830/0 (socket says 172.21.15.125:33830) 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48314/0 (socket says 172.21.15.125:48314) 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f02d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 0x7f5f041207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.830+0000 7f5f0259c700 1 -- 172.21.15.125:0/1424276041 learned_addr learned my addr 172.21.15.125:0/1424276041 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 -- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 msgr2=0x7f5f04121250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 -- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 msgr2=0x7f5f041207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 0x7f5f041207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 -- 172.21.15.125:0/1424276041 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc009a70 con 0x7f5f040a1550 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f02d9d700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 0x7f5f041207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0359e700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0259c700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800e9e0 tx=0x7f5ef800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8009710 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800ee80 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800ca50 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f040a03e0 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.831+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04123fd0 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.832+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ef800cbb0 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.832+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ef803f680 con 0x7f5f040a1550 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.832+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f04123bf0 con 0x7f5f040a1550 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.837+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef80232f0 con 0x7f5f040a1550 2023-10-03T10:13:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 Processor -- start 2023-10-03T10:13:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 -- start start 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 0x7f7b58138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 0x7f7b5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5809e9d0 con 0x7f7b580a0a70 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5809dc00 con 0x7f7b580a1550 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.867+0000 7f7b5f133700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5809dec0 con 0x7f7b58139200 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b57fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 0x7f7b58138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 0x7f7b5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5cecf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7b580a0a70 0x7f7b580a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42484/0 (socket says 172.21.15.125:42484) 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5cecf700 1 -- 172.21.15.125:0/4134545486 learned_addr learned my addr 172.21.15.125:0/4134545486 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b577fe700 1 -- 172.21.15.125:0/4134545486 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139836639 0 0) 0x7f7b5809e9d0 con 0x7f7b580a0a70 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b577fe700 1 -- 172.21.15.125:0/4134545486 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b480035b0 con 0x7f7b580a0a70 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/4134545486 >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 msgr2=0x7f7b58138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 --2- 172.21.15.125:0/4134545486 >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 0x7f7b58138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/4134545486 >> v1:172.21.15.125:6789/0 conn(0x7f7b580a0a70 legacy=0x7f7b580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/4134545486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5809e6a0 con 0x7f7b58139200 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b57fff700 1 --2- 172.21.15.125:0/4134545486 >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 0x7f7b58138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b5d6d0700 1 --2- 172.21.15.125:0/4134545486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 0x7f7b5813b5e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009d90 tx=0x7f7b5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15653a507c1a645e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b577fe700 1 -- 172.21.15.125:0/4134545486 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000e070 con 0x7f7b58139200 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b577fe700 1 -- 172.21.15.125:0/4134545486 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000bb20 con 0x7f7b58139200 2023-10-03T10:13:21.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.868+0000 7f7b577fe700 1 -- 172.21.15.125:0/4134545486 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50012430 con 0x7f7b58139200 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 -- 172.21.15.125:0/4134545486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 msgr2=0x7f7b5813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 --2- 172.21.15.125:0/4134545486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 0x7f7b5813b5e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009d90 tx=0x7f7b5000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 -- 172.21.15.125:0/4134545486 shutdown_connections 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 --2- 172.21.15.125:0/4134545486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b58139200 0x7f7b5813b5e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 --2- 172.21.15.125:0/4134545486 >> v2:172.21.15.125:3300/0 conn(0x7f7b580a1550 0x7f7b58138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 -- 172.21.15.125:0/4134545486 >> 172.21.15.125:0/4134545486 conn(0x7f7b580a6610 msgr2=0x7f7b580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 -- 172.21.15.125:0/4134545486 shutdown_connections 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.869+0000 7f7b5f133700 1 -- 172.21.15.125:0/4134545486 wait complete. 2023-10-03T10:13:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 Processor -- start 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 -- start start 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 0x7f7b58121740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b580a1550 0x7f7b58121c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58123540 con 0x7f7b58139200 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58123350 con 0x7f7b580a1550 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5f133700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b581376c0 con 0x7f7b580a0a70 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5d6d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b5cecf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 0x7f7b58121740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33860/0 (socket says 172.21.15.125:33860) 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/2003329219 learned_addr learned my addr 172.21.15.125:0/2003329219 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:21.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.870+0000 7f7b57fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b580a1550 0x7f7b58121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 msgr2=0x7f7b58121740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 0x7f7b58121740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b580a1550 msgr2=0x7f7b58121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b580a1550 0x7f7b58121c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 -- 172.21.15.125:0/2003329219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440094a0 con 0x7f7b58139200 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5cecf700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 0x7f7b58121740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5d6d0700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7b50013000 tx=0x7f7b50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500129f0 con 0x7f7b58139200 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50020070 con 0x7f7b58139200 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b50009a70 con 0x7f7b58139200 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50012db0 con 0x7f7b58139200 2023-10-03T10:13:21.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.871+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b58124f80 con 0x7f7b58139200 2023-10-03T10:13:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.872+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58124c20 con 0x7f7b58139200 2023-10-03T10:13:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.872+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b50004040 con 0x7f7b58139200 2023-10-03T10:13:21.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.872+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b50022070 con 0x7f7b58139200 2023-10-03T10:13:21.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:21.877+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b58124c20 con 0x7f7b58139200 2023-10-03T10:13:22.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.029+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f04123e30 con 0x7f5f040a1550 2023-10-03T10:13:22.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.029+0000 7f5eeb7fe700 1 -- 172.21.15.125:0/1424276041 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f04123e30 con 0x7f5f040a1550 2023-10-03T10:13:22.030 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:22.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.031+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 msgr2=0x7f5f04120d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800e9e0 tx=0x7f5ef800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 shutdown_connections 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f04139200 0x7f5f04121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f040a0a70 0x7f5f041207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 --2- 172.21.15.125:0/1424276041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f040a1550 0x7f5f04120d10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 >> 172.21.15.125:0/1424276041 conn(0x7f5f040a6610 msgr2=0x7f5f040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 shutdown_connections 2023-10-03T10:13:22.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.032+0000 7f5f0907e700 1 -- 172.21.15.125:0/1424276041 wait complete. 2023-10-03T10:13:22.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.070+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b58124c20 con 0x7f7b58139200 2023-10-03T10:13:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.070+0000 7f7b557fa700 1 -- 172.21.15.125:0/2003329219 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b58124c20 con 0x7f7b58139200 2023-10-03T10:13:22.071 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 msgr2=0x7f7b581221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7b50013000 tx=0x7f7b50004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 shutdown_connections 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b58139200 0x7f7b581221c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b580a0a70 0x7f7b58121740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 --2- 172.21.15.125:0/2003329219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b580a1550 0x7f7b58121c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 >> 172.21.15.125:0/2003329219 conn(0x7f7b580a6610 msgr2=0x7f7b58137d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 shutdown_connections 2023-10-03T10:13:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.072+0000 7f7b5f133700 1 -- 172.21.15.125:0/2003329219 wait complete. 2023-10-03T10:13:22.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:22.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:22.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.251+0000 7f86a748b700 1 Processor -- start 2023-10-03T10:13:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 -- start start 2023-10-03T10:13:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86a00a1380 0x7f86a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a009dc00 con 0x7f86a0133f50 2023-10-03T10:13:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a009ea60 con 0x7f86a00a1380 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.252+0000 7f86a748b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a009dec0 con 0x7f86a00a0a70 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86a00a1380 0x7f86a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a5227700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86a00a1380 0x7f86a0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33866/0 (socket says 172.21.15.125:33866) 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a5227700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48324/0 (socket says 172.21.15.125:48324) 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 -- 172.21.15.125:0/2813180649 learned_addr learned my addr 172.21.15.125:0/2813180649 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a5a28700 1 --1- 172.21.15.125:0/2813180649 >> v1:172.21.15.125:6789/0 conn(0x7f86a0133f50 0x7f86a013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42486/0 (socket says 172.21.15.125:42486) 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 -- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 msgr2=0x7f86a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 -- 172.21.15.125:0/2813180649 >> v1:172.21.15.125:6789/0 conn(0x7f86a0133f50 legacy=0x7f86a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 -- 172.21.15.125:0/2813180649 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a009e6a0 con 0x7f86a00a1380 2023-10-03T10:13:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f8697fff700 1 -- 172.21.15.125:0/2813180649 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483890990 0 0) 0x7f86a009dc00 con 0x7f86a0133f50 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a5227700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f86a4a26700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a1380 0x7f86a0133a10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86900098f0 tx=0x7f8690009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3350d475321600c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f8697fff700 1 -- 172.21.15.125:0/2813180649 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690011830 con 0x7f86a00a1380 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f8697fff700 1 -- 172.21.15.125:0/2813180649 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690011990 con 0x7f86a00a1380 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.253+0000 7f8697fff700 1 -- 172.21.15.125:0/2813180649 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690011d20 con 0x7f86a00a1380 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 -- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a1380 msgr2=0x7f86a0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a1380 0x7f86a0133a10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86900098f0 tx=0x7f8690009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 -- 172.21.15.125:0/2813180649 shutdown_connections 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a00a0a70 0x7f86a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 --2- 172.21.15.125:0/2813180649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a1380 0x7f86a0133a10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 -- 172.21.15.125:0/2813180649 >> 172.21.15.125:0/2813180649 conn(0x7f86a00a6610 msgr2=0x7f86a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 -- 172.21.15.125:0/2813180649 shutdown_connections 2023-10-03T10:13:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.254+0000 7f86a748b700 1 -- 172.21.15.125:0/2813180649 wait complete. 2023-10-03T10:13:22.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.255+0000 7f86a748b700 1 Processor -- start 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.255+0000 7f86a748b700 1 -- start start 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 0x7f86a0122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86a00a1380 0x7f86a0122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0126220 con 0x7f86a00a0a70 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0133960 con 0x7f86a00a1380 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a748b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0133420 con 0x7f86a0133f50 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5227700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 0x7f86a0122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5227700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 0x7f86a0122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33870/0 (socket says 172.21.15.125:33870) 2023-10-03T10:13:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5227700 1 -- 172.21.15.125:0/1541022953 learned_addr learned my addr 172.21.15.125:0/1541022953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48340/0 (socket says 172.21.15.125:48340) 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a4a26700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86a00a1380 0x7f86a0122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 -- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86a00a1380 msgr2=0x7f86a0122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86a00a1380 0x7f86a0122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 -- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 msgr2=0x7f86a0122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 0x7f86a0122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 -- 172.21.15.125:0/1541022953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0094a0 con 0x7f86a0133f50 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.256+0000 7f86a5a28700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f869800cc10 tx=0x7f869800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800aa00 con 0x7f86a0133f50 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800ab80 con 0x7f86a0133f50 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8690009550 con 0x7f86a0133f50 2023-10-03T10:13:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980070d0 con 0x7f86a0133f50 2023-10-03T10:13:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a0126bb0 con 0x7f86a0133f50 2023-10-03T10:13:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.257+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8698007230 con 0x7f86a0133f50 2023-10-03T10:13:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.258+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f869803f400 con 0x7f86a0133f50 2023-10-03T10:13:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.258+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a004f2a0 con 0x7f86a0133f50 2023-10-03T10:13:22.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.262+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8698018080 con 0x7f86a0133f50 2023-10-03T10:13:22.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.293+0000 7f761ef50700 1 Processor -- start 2023-10-03T10:13:22.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 -- start start 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761809dc00 con 0x7f7618133f50 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761809ea60 con 0x7f76180a1380 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ef50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761809dec0 con 0x7f76180a0a70 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f7617fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f7617fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33872/0 (socket says 172.21.15.125:33872) 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50468/0 (socket says 172.21.15.125:50468) 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f7617fff700 1 -- 172.21.15.125:0/4112330617 learned_addr learned my addr 172.21.15.125:0/4112330617 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 -- 172.21.15.125:0/4112330617 >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 msgr2=0x7f7618133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 --2- 172.21.15.125:0/4112330617 >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 -- 172.21.15.125:0/4112330617 >> v1:172.21.15.125:6789/0 conn(0x7f7618133f50 legacy=0x7f761813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f761ccec700 1 -- 172.21.15.125:0/4112330617 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761809e6a0 con 0x7f76180a0a70 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f76177fe700 1 -- 172.21.15.125:0/4112330617 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372574579 0 0) 0x7f761809dc00 con 0x7f7618133f50 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.294+0000 7f7617fff700 1 --2- 172.21.15.125:0/4112330617 >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ccec700 1 --2- 172.21.15.125:0/4112330617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f760c009840 tx=0x7f760c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c7e1860a2f7c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f76177fe700 1 -- 172.21.15.125:0/4112330617 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011830 con 0x7f76180a0a70 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f76177fe700 1 -- 172.21.15.125:0/4112330617 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c011990 con 0x7f76180a0a70 2023-10-03T10:13:22.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f76177fe700 1 -- 172.21.15.125:0/4112330617 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011d20 con 0x7f76180a0a70 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 -- 172.21.15.125:0/4112330617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 msgr2=0x7f76180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 --2- 172.21.15.125:0/4112330617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f760c009840 tx=0x7f760c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 -- 172.21.15.125:0/4112330617 shutdown_connections 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 --2- 172.21.15.125:0/4112330617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76180a0a70 0x7f76180a0e40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 --2- 172.21.15.125:0/4112330617 >> v2:172.21.15.125:3300/0 conn(0x7f76180a1380 0x7f7618133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 -- 172.21.15.125:0/4112330617 >> 172.21.15.125:0/4112330617 conn(0x7f76180a6610 msgr2=0x7f76180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 -- 172.21.15.125:0/4112330617 shutdown_connections 2023-10-03T10:13:22.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.295+0000 7f761ef50700 1 -- 172.21.15.125:0/4112330617 wait complete. 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.296+0000 7f761ef50700 1 Processor -- start 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.296+0000 7f761ef50700 1 -- start start 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76180a0a70 0x7f7618122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 0x7f76181232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618126140 con 0x7f76180a1380 2023-10-03T10:13:22.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76181244d0 con 0x7f7618133f50 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ef50700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7618126340 con 0x7f76180a0a70 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33884/0 (socket says 172.21.15.125:33884) 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 -- 172.21.15.125:0/3310448116 learned_addr learned my addr 172.21.15.125:0/3310448116 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761ccec700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76180a0a70 0x7f7618122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761d4ed700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 0x7f76181232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 -- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76180a0a70 msgr2=0x7f7618122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76180a0a70 0x7f7618122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 -- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 msgr2=0x7f76181232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 0x7f76181232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f7617fff700 1 -- 172.21.15.125:0/3310448116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604009550 con 0x7f76180a1380 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.297+0000 7f761d4ed700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 0x7f76181232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f7617fff700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f760400ec10 tx=0x7f760400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400c850 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400c9b0 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0094a0 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400cd60 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7618125da0 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.298+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7604013470 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.299+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f760403f7b0 con 0x7f76180a1380 2023-10-03T10:13:22.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.299+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761804f2a0 con 0x7f76180a1380 2023-10-03T10:13:22.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.303+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76040232f0 con 0x7f76180a1380 2023-10-03T10:13:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.460+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86a0072980 con 0x7f86a0133f50 2023-10-03T10:13:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.460+0000 7f8695ffb700 1 -- 172.21.15.125:0/1541022953 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86980074e0 con 0x7f86a0133f50 2023-10-03T10:13:22.461 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 msgr2=0x7f86a0123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f869800cc10 tx=0x7f869800cf20 comp rx=0 tx=0).stop 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 shutdown_connections 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f86a0133f50 0x7f86a0123380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86a00a0a70 0x7f86a0122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 --2- 172.21.15.125:0/1541022953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86a00a1380 0x7f86a0122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 >> 172.21.15.125:0/1541022953 conn(0x7f86a00a6610 msgr2=0x7f86a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 shutdown_connections 2023-10-03T10:13:22.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.462+0000 7f86a748b700 1 -- 172.21.15.125:0/1541022953 wait complete. 2023-10-03T10:13:22.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:22.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.496+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f76181339b0 con 0x7f76180a1380 2023-10-03T10:13:22.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.496+0000 7f76157fa700 1 -- 172.21.15.125:0/3310448116 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7604021020 con 0x7f76180a1380 2023-10-03T10:13:22.497 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.498+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 msgr2=0x7f7618122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.498+0000 7f761ef50700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f760400ec10 tx=0x7f760400ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 shutdown_connections 2023-10-03T10:13:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7618133f50 0x7f76181232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76180a0a70 0x7f7618122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 --2- 172.21.15.125:0/3310448116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76180a1380 0x7f7618122d60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 >> 172.21.15.125:0/3310448116 conn(0x7f76180a6610 msgr2=0x7f76180a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 shutdown_connections 2023-10-03T10:13:22.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:22.499+0000 7f761ef50700 1 -- 172.21.15.125:0/3310448116 wait complete. 2023-10-03T10:13:22.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:23.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:23.086 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:23.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.181+0000 7f5ac2c0c700 1 Processor -- start 2023-10-03T10:13:23.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.181+0000 7f5ac2c0c700 1 -- start start 2023-10-03T10:13:23.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac2c0c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5abc132e70 0x7f5abc135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac2c0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac2c0c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc09a540 con 0x7f5abc12feb0 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac2c0c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc09ad40 con 0x7f5abc132e70 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac2c0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc09e640 con 0x7f5abc135790 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5abc132e70 0x7f5abc135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac11a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5abc132e70 0x7f5abc135250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33890/0 (socket says 172.21.15.125:33890) 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac11a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48352/0 (socket says 172.21.15.125:48352) 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 -- 172.21.15.125:0/2531830208 learned_addr learned my addr 172.21.15.125:0/2531830208 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac09a8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5abc12feb0 0x7f5abc130280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42508/0 (socket says 172.21.15.125:42508) 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 -- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 msgr2=0x7f5abc137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 -- 172.21.15.125:0/2531830208 >> v1:172.21.15.125:6789/0 conn(0x7f5abc12feb0 legacy=0x7f5abc130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abbfff700 1 -- 172.21.15.125:0/2531830208 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc09e3c0 con 0x7f5abc132e70 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5abb7fe700 1 -- 172.21.15.125:0/2531830208 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869732355 0 0) 0x7f5abc09a540 con 0x7f5abc12feb0 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.182+0000 7f5ac11a9700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5abbfff700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc132e70 0x7f5abc135250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098f0 tx=0x7f5aa8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a9e734486e1332 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5abb7fe700 1 -- 172.21.15.125:0/2531830208 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011830 con 0x7f5abc132e70 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5abb7fe700 1 -- 172.21.15.125:0/2531830208 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8011990 con 0x7f5abc132e70 2023-10-03T10:13:23.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5abb7fe700 1 -- 172.21.15.125:0/2531830208 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011d20 con 0x7f5abc132e70 2023-10-03T10:13:23.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc132e70 msgr2=0x7f5abc135250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc132e70 0x7f5abc135250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098f0 tx=0x7f5aa8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/2531830208 shutdown_connections 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc135790 0x7f5abc137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/2531830208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc132e70 0x7f5abc135250 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/2531830208 >> 172.21.15.125:0/2531830208 conn(0x7f5abc0a2b30 msgr2=0x7f5abc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/2531830208 shutdown_connections 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.183+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/2531830208 wait complete. 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.184+0000 7f5ac2c0c700 1 Processor -- start 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.184+0000 7f5ac2c0c700 1 -- start start 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 0x7f5abc1c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 0x7f5abc12b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1352d0 con 0x7f5abc135790 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc128340 con 0x7f5abc12feb0 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac2c0c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1c81f0 con 0x7f5abc132e70 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48360/0 (socket says 172.21.15.125:48360) 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac11a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 0x7f5abc12b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 -- 172.21.15.125:0/1401014403 learned_addr learned my addr 172.21.15.125:0/1401014403 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac09a8700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 0x7f5abc1c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 -- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 msgr2=0x7f5abc1c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 0x7f5abc1c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 -- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 msgr2=0x7f5abc12b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 0x7f5abc12b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5abbfff700 1 -- 172.21.15.125:0/1401014403 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4009a70 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac09a8700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 0x7f5abc1c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.185+0000 7f5ac11a9700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 0x7f5abc12b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5abbfff700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009c40 tx=0x7f5aa8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8004510 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa80036a0 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8003a50 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa8009550 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc1c9030 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.186+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aa8021070 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.187+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5aa8040a30 con 0x7f5abc132e70 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.187+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc130950 con 0x7f5abc132e70 2023-10-03T10:13:23.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.191+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aa8029080 con 0x7f5abc132e70 2023-10-03T10:13:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.218+0000 7fde8ddc5700 1 Processor -- start 2023-10-03T10:13:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.218+0000 7fde8ddc5700 1 -- start start 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde8ddc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde8ddc5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde880a1380 0x7fde88133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde8ddc5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8809dc00 con 0x7fde88133f50 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde8ddc5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8809ea60 con 0x7fde880a1380 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde8ddc5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8809dec0 con 0x7fde880a0a70 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde880a1380 0x7fde88133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde880a1380 0x7fde88133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33916/0 (socket says 172.21.15.125:33916) 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde87fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde88133f50 0x7fde8813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42514/0 (socket says 172.21.15.125:42514) 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 -- 172.21.15.125:0/444375301 learned_addr learned my addr 172.21.15.125:0/444375301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 -- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 msgr2=0x7fde880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 --2- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 -- 172.21.15.125:0/444375301 >> v1:172.21.15.125:6789/0 conn(0x7fde88133f50 legacy=0x7fde8813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 -- 172.21.15.125:0/444375301 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8809e6a0 con 0x7fde880a1380 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde86ffd700 1 -- 172.21.15.125:0/444375301 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164581340 0 0) 0x7fde8809dc00 con 0x7fde88133f50 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.219+0000 7fde7ffff700 1 --2- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde88133a10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde700098f0 tx=0x7fde70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6346a56bd91381a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde86ffd700 1 -- 172.21.15.125:0/444375301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000b8a0 con 0x7fde880a1380 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde86ffd700 1 -- 172.21.15.125:0/444375301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000ba00 con 0x7fde880a1380 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde86ffd700 1 -- 172.21.15.125:0/444375301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000bd90 con 0x7fde880a1380 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 -- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 msgr2=0x7fde88133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde88133a10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde700098f0 tx=0x7fde70009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 -- 172.21.15.125:0/444375301 shutdown_connections 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/444375301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde88133a10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 -- 172.21.15.125:0/444375301 >> 172.21.15.125:0/444375301 conn(0x7fde880a6610 msgr2=0x7fde880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 -- 172.21.15.125:0/444375301 shutdown_connections 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.220+0000 7fde8ddc5700 1 -- 172.21.15.125:0/444375301 wait complete. 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.221+0000 7fde8ddc5700 1 Processor -- start 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.221+0000 7fde8ddc5700 1 -- start start 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde881c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde881c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 0x7fde881c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881245d0 con 0x7fde880a1380 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde88125f40 con 0x7fde88133f50 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde881265e0 con 0x7fde880a0a70 2023-10-03T10:13:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde881c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde7ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde881c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde7ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde881c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33930/0 (socket says 172.21.15.125:33930) 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde881c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48378/0 (socket says 172.21.15.125:48378) 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde7ffff700 1 -- 172.21.15.125:0/4196157147 learned_addr learned my addr 172.21.15.125:0/4196157147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 0x7fde881c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 -- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 msgr2=0x7fde881c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde881c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 -- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 msgr2=0x7fde881c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde881c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 -- 172.21.15.125:0/4196157147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009550 con 0x7fde88133f50 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde87fff700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 0x7fde881c8c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde8000cbe0 tx=0x7fde8000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000aa40 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000aba0 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde880a03e0 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800070d0 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.222+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde88126c70 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.223+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde80007230 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.223+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8804f2a0 con 0x7fde88133f50 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.223+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde8003f170 con 0x7fde88133f50 2023-10-03T10:13:23.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.228+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde800074e0 con 0x7fde88133f50 2023-10-03T10:13:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.384+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5abc12a220 con 0x7f5abc132e70 2023-10-03T10:13:23.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.385+0000 7f5ab97fa700 1 -- 172.21.15.125:0/1401014403 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aa8015020 con 0x7f5abc132e70 2023-10-03T10:13:23.385 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 msgr2=0x7f5abc1c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009c40 tx=0x7f5aa8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 shutdown_connections 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5abc135790 0x7f5abc12b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5abc12feb0 0x7f5abc1c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 --2- 172.21.15.125:0/1401014403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5abc132e70 0x7f5abc1c8af0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 >> 172.21.15.125:0/1401014403 conn(0x7f5abc0a2b30 msgr2=0x7f5abc09c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 shutdown_connections 2023-10-03T10:13:23.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.387+0000 7f5ac2c0c700 1 -- 172.21.15.125:0/1401014403 wait complete. 2023-10-03T10:13:23.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.421+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde88072980 con 0x7fde88133f50 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.421+0000 7fde84ff9700 1 -- 172.21.15.125:0/4196157147 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde80018020 con 0x7fde88133f50 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:23.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 msgr2=0x7fde881c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 0x7fde881c8c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde8000cbe0 tx=0x7fde8000cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 shutdown_connections 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde88133f50 0x7fde881c8c80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde880a0a70 0x7fde881c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 --2- 172.21.15.125:0/4196157147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde880a1380 0x7fde881c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 >> 172.21.15.125:0/4196157147 conn(0x7fde880a6610 msgr2=0x7fde880a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 shutdown_connections 2023-10-03T10:13:23.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.424+0000 7fde8ddc5700 1 -- 172.21.15.125:0/4196157147 wait complete. 2023-10-03T10:13:23.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:23.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:23.512 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:23.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.601+0000 7f840682d700 1 Processor -- start 2023-10-03T10:13:23.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.601+0000 7f840682d700 1 -- start start 2023-10-03T10:13:23.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f840682d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 0x7f8400138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f840682d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f840682d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840009b110 con 0x7f840009ad40 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f840682d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000a3b60 con 0x7f8400134570 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f840682d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84000a1a80 con 0x7f8400134140 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 0x7f8400138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50492/0 (socket says 172.21.15.125:50492) 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 -- 172.21.15.125:0/3924499939 learned_addr learned my addr 172.21.15.125:0/3924499939 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83fffff700 1 --1- 172.21.15.125:0/3924499939 >> v1:172.21.15.125:6789/0 conn(0x7f840009ad40 0x7f8400133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42520/0 (socket says 172.21.15.125:42520) 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83feffd700 1 -- 172.21.15.125:0/3924499939 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786067189 0 0) 0x7f840009b110 con 0x7f840009ad40 2023-10-03T10:13:23.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 -- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 msgr2=0x7f8400138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 0x7f8400138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 -- 172.21.15.125:0/3924499939 >> v1:172.21.15.125:6789/0 conn(0x7f840009ad40 legacy=0x7f8400133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 -- 172.21.15.125:0/3924499939 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000a2fa0 con 0x7f8400134570 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83ff7fe700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 0x7f8400138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f8404dca700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009eb0 tx=0x7f83f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e5d9a63cd27d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83feffd700 1 -- 172.21.15.125:0/3924499939 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800e070 con 0x7f8400134570 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83feffd700 1 -- 172.21.15.125:0/3924499939 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800b8d0 con 0x7f8400134570 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.602+0000 7f83feffd700 1 -- 172.21.15.125:0/3924499939 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800bc80 con 0x7f8400134570 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 -- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 msgr2=0x7f840013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009eb0 tx=0x7f83f800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 -- 172.21.15.125:0/3924499939 shutdown_connections 2023-10-03T10:13:23.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134570 0x7f840013b3d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 --2- 172.21.15.125:0/3924499939 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8400134140 0x7f8400138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 -- 172.21.15.125:0/3924499939 >> 172.21.15.125:0/3924499939 conn(0x7f8400099c40 msgr2=0x7f840006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 -- 172.21.15.125:0/3924499939 shutdown_connections 2023-10-03T10:13:23.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.603+0000 7f840682d700 1 -- 172.21.15.125:0/3924499939 wait complete. 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.604+0000 7f840682d700 1 Processor -- start 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 -- start start 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f840009ad40 0x7f8400139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8400134570 0x7f8400139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840009c7e0 con 0x7f8400134570 2023-10-03T10:13:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840009e490 con 0x7f8400134140 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f840682d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f840011d700 con 0x7f840009ad40 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f83ff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f83ff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50508/0 (socket says 172.21.15.125:50508) 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f8404dca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8400134570 0x7f8400139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f83ff7fe700 1 -- 172.21.15.125:0/3903353628 learned_addr learned my addr 172.21.15.125:0/3903353628 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.605+0000 7f83fffff700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f840009ad40 0x7f8400139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 -- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f840009ad40 msgr2=0x7f8400139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f840009ad40 0x7f8400139470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 -- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8400134570 msgr2=0x7f8400139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8400134570 0x7f8400139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 -- 172.21.15.125:0/3903353628 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40094a0 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83ff7fe700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83f400ec10 tx=0x7f83f400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4009760 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f400c850 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f8009b30 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400cbe0 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.606+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84001336d0 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.607+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83f400cd40 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.607+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83f403fa70 con 0x7f8400134140 2023-10-03T10:13:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.607+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84001361e0 con 0x7f8400134140 2023-10-03T10:13:23.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.612+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83f401b3b0 con 0x7f8400134140 2023-10-03T10:13:23.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 Processor -- start 2023-10-03T10:13:23.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 -- start start 2023-10-03T10:13:23.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e7013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7009dc00 con 0x7f3e700a1380 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7009ea90 con 0x7f3e700a0a70 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.645+0000 7f3e76c84700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7009dec0 con 0x7f3e70134120 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e75221700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e7013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3e700a1380 0x7f3e70133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42536/0 (socket says 172.21.15.125:42536) 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6ffff700 1 -- 172.21.15.125:0/944898474 learned_addr learned my addr 172.21.15.125:0/944898474 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50518/0 (socket says 172.21.15.125:50518) 2023-10-03T10:13:23.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6f7fe700 1 -- 172.21.15.125:0/944898474 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397048517 0 0) 0x7f3e7009dc00 con 0x7f3e700a1380 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6f7fe700 1 -- 172.21.15.125:0/944898474 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e600035b0 con 0x7f3e700a1380 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 -- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 msgr2=0x7f3e7013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e7013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 -- 172.21.15.125:0/944898474 >> v1:172.21.15.125:6789/0 conn(0x7f3e700a1380 legacy=0x7f3e70133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 -- 172.21.15.125:0/944898474 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7009e6a0 con 0x7f3e700a0a70 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e75221700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e7013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e74a20700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35bf09544b3856b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6f7fe700 1 -- 172.21.15.125:0/944898474 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64004230 con 0x7f3e700a0a70 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6f7fe700 1 -- 172.21.15.125:0/944898474 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64004390 con 0x7f3e700a0a70 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.646+0000 7f3e6f7fe700 1 -- 172.21.15.125:0/944898474 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640036a0 con 0x7f3e700a0a70 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 -- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 msgr2=0x7f3e700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e64009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 -- 172.21.15.125:0/944898474 shutdown_connections 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e7013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 --2- 172.21.15.125:0/944898474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e700a0e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 -- 172.21.15.125:0/944898474 >> 172.21.15.125:0/944898474 conn(0x7f3e700a6610 msgr2=0x7f3e700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 -- 172.21.15.125:0/944898474 shutdown_connections 2023-10-03T10:13:23.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.647+0000 7f3e76c84700 1 -- 172.21.15.125:0/944898474 wait complete. 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.648+0000 7f3e76c84700 1 Processor -- start 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.648+0000 7f3e76c84700 1 -- start start 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e70122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 0x7f3e70122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e701233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70124bc0 con 0x7f3e700a1380 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70125ec0 con 0x7f3e700a0a70 2023-10-03T10:13:23.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e76c84700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70126540 con 0x7f3e70134120 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 0x7f3e70122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e701233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 0x7f3e70122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33944/0 (socket says 172.21.15.125:33944) 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e6ffff700 1 -- 172.21.15.125:0/2288135333 learned_addr learned my addr 172.21.15.125:0/2288135333 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e74a20700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e70122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 -- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 msgr2=0x7f3e70122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e70122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 -- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 msgr2=0x7f3e70122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 0x7f3e70122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.649+0000 7f3e75221700 1 -- 172.21.15.125:0/2288135333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009a70 con 0x7f3e70134120 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e75221700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e701233c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800efc0 tx=0x7f3e6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800ca90 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800f040 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e640094a0 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800ce30 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e700a0430 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.650+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e68014480 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.651+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e6803fc60 con 0x7f3e70134120 2023-10-03T10:13:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.651+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7006d630 con 0x7f3e70134120 2023-10-03T10:13:23.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.659+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e68012930 con 0x7f3e70134120 2023-10-03T10:13:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.812+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f840011e950 con 0x7f8400134140 2023-10-03T10:13:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.813+0000 7f83fcff9700 1 -- 172.21.15.125:0/3903353628 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83f402b090 con 0x7f8400134140 2023-10-03T10:13:23.813 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 msgr2=0x7f84001399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83f400ec10 tx=0x7f83f400ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 shutdown_connections 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8400134570 0x7f8400139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f840009ad40 0x7f8400139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 --2- 172.21.15.125:0/3903353628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8400134140 0x7f84001399b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 >> 172.21.15.125:0/3903353628 conn(0x7f8400099c40 msgr2=0x7f840013b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 shutdown_connections 2023-10-03T10:13:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.815+0000 7f840682d700 1 -- 172.21.15.125:0/3903353628 wait complete. 2023-10-03T10:13:23.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:23.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.852+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e7004f2a0 con 0x7f3e70134120 2023-10-03T10:13:23.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.853+0000 7f3e6d7fa700 1 -- 172.21.15.125:0/2288135333 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e68012340 con 0x7f3e70134120 2023-10-03T10:13:23.853 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:23.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 msgr2=0x7f3e701233c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e701233c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800efc0 tx=0x7f3e6800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 shutdown_connections 2023-10-03T10:13:23.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e70134120 0x7f3e701233c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e700a0a70 0x7f3e70122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 --2- 172.21.15.125:0/2288135333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e700a1380 0x7f3e70122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 >> 172.21.15.125:0/2288135333 conn(0x7f3e700a6610 msgr2=0x7f3e7009a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 shutdown_connections 2023-10-03T10:13:23.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:23.855+0000 7f3e76c84700 1 -- 172.21.15.125:0/2288135333 wait complete. 2023-10-03T10:13:23.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:24.400 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:24.437 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.529+0000 7efcd5378700 1 Processor -- start 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.529+0000 7efcd5378700 1 -- start start 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcd5378700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcd5378700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 0x7efcd0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcd5378700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd009dc00 con 0x7efcd0133f50 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcd5378700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd009ea60 con 0x7efcd00a1380 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcd5378700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcd009dec0 con 0x7efcd00a0a70 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcce7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 0x7efcd0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48426/0 (socket says 172.21.15.125:48426) 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 -- 172.21.15.125:0/1450737515 learned_addr learned my addr 172.21.15.125:0/1450737515 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efccf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efcd0133f50 0x7efcd013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42538/0 (socket says 172.21.15.125:42538) 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 -- 172.21.15.125:0/1450737515 >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 msgr2=0x7efcd0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 --2- 172.21.15.125:0/1450737515 >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 0x7efcd0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 -- 172.21.15.125:0/1450737515 >> v1:172.21.15.125:6789/0 conn(0x7efcd0133f50 legacy=0x7efcd013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 -- 172.21.15.125:0/1450737515 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd009e6a0 con 0x7efcd00a0a70 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcce7fc700 1 --2- 172.21.15.125:0/1450737515 >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 0x7efcd0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efcceffd700 1 --2- 172.21.15.125:0/1450737515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098f0 tx=0x7efcc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42180da56a226af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efccdffb700 1 -- 172.21.15.125:0/1450737515 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011830 con 0x7efcd00a0a70 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efccdffb700 1 -- 172.21.15.125:0/1450737515 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0011990 con 0x7efcd00a0a70 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.530+0000 7efccdffb700 1 -- 172.21.15.125:0/1450737515 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011d20 con 0x7efcd00a0a70 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 -- 172.21.15.125:0/1450737515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 msgr2=0x7efcd00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 --2- 172.21.15.125:0/1450737515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098f0 tx=0x7efcc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 -- 172.21.15.125:0/1450737515 shutdown_connections 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 --2- 172.21.15.125:0/1450737515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a0a70 0x7efcd00a0e40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 --2- 172.21.15.125:0/1450737515 >> v2:172.21.15.125:3300/0 conn(0x7efcd00a1380 0x7efcd0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 -- 172.21.15.125:0/1450737515 >> 172.21.15.125:0/1450737515 conn(0x7efcd00a6610 msgr2=0x7efcd00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 -- 172.21.15.125:0/1450737515 shutdown_connections 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.531+0000 7efcd5378700 1 -- 172.21.15.125:0/1450737515 wait complete. 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.532+0000 7efcd5378700 1 Processor -- start 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.532+0000 7efcd5378700 1 -- start start 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 0x7efcd01c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 0x7efcd01c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01247f0 con 0x7efcd0133f50 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0124600 con 0x7efcd00a0a70 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01252e0 con 0x7efcd00a1380 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 0x7efcd01c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48436/0 (socket says 172.21.15.125:48436) 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 -- 172.21.15.125:0/328048735 learned_addr learned my addr 172.21.15.125:0/328048735 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcceffd700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 0x7efcd01c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 -- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 msgr2=0x7efcd01c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 0x7efcd01c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 -- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 msgr2=0x7efcd01c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 0x7efcd01c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 -- 172.21.15.125:0/328048735 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40094a0 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efccf7fe700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 0x7efcd01c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcceffd700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 0x7efcd01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcce7fc700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcc400ebe0 tx=0x7efcc400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400c850 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400c9b0 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc0009550 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.533+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400cd40 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.534+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd0126230 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.534+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcc4013470 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.535+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd004f2a0 con 0x7efcd00a1380 2023-10-03T10:13:24.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.535+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efcc403fb70 con 0x7efcd00a1380 2023-10-03T10:13:24.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.543+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcc400cea0 con 0x7efcd00a1380 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.572+0000 7f9cee3de700 1 Processor -- start 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.572+0000 7f9cee3de700 1 -- start start 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cee3de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 0x7f9ce8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cee3de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 0x7f9ce813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cee3de700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce809e9d0 con 0x7f9ce80a0a70 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cee3de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce809dc00 con 0x7f9ce8139200 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cee3de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce809dec0 con 0x7f9ce80a1550 2023-10-03T10:13:24.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 0x7f9ce8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cec97b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 0x7f9ce813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9ce80a0a70 0x7f9ce80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42544/0 (socket says 172.21.15.125:42544) 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce7fff700 1 -- 172.21.15.125:0/4006671676 learned_addr learned my addr 172.21.15.125:0/4006671676 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 -- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 msgr2=0x7f9ce813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 0x7f9ce813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 -- 172.21.15.125:0/4006671676 >> v1:172.21.15.125:6789/0 conn(0x7f9ce80a0a70 legacy=0x7f9ce80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce6ffd700 1 -- 172.21.15.125:0/4006671676 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816616072 0 0) 0x7f9ce809e9d0 con 0x7f9ce80a0a70 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 -- 172.21.15.125:0/4006671676 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce809e6a0 con 0x7f9ce80a1550 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9cec97b700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 0x7f9ce813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.573+0000 7f9ce77fe700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 0x7f9ce8138cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009870 tx=0x7f9cdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d5d5899016d969 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9ce6ffd700 1 -- 172.21.15.125:0/4006671676 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011830 con 0x7f9ce80a1550 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9ce6ffd700 1 -- 172.21.15.125:0/4006671676 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc011990 con 0x7f9ce80a1550 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9ce6ffd700 1 -- 172.21.15.125:0/4006671676 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011d20 con 0x7f9ce80a1550 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 -- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 msgr2=0x7f9ce8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 0x7f9ce8138cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009870 tx=0x7f9cdc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 -- 172.21.15.125:0/4006671676 shutdown_connections 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce8139200 0x7f9ce813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 --2- 172.21.15.125:0/4006671676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a1550 0x7f9ce8138cc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 -- 172.21.15.125:0/4006671676 >> 172.21.15.125:0/4006671676 conn(0x7f9ce80a6610 msgr2=0x7f9ce80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 -- 172.21.15.125:0/4006671676 shutdown_connections 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.574+0000 7f9cee3de700 1 -- 172.21.15.125:0/4006671676 wait complete. 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.575+0000 7f9cee3de700 1 Processor -- start 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.575+0000 7f9cee3de700 1 -- start start 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 0x7f9ce811e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce8139200 0x7f9ce811f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8133fd0 con 0x7f9ce8139200 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81345b0 con 0x7f9ce80a1550 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a5100 con 0x7f9ce80a0a70 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 0x7f9ce811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50554/0 (socket says 172.21.15.125:50554) 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 0x7f9ce811e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48452/0 (socket says 172.21.15.125:48452) 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 -- 172.21.15.125:0/2533314181 learned_addr learned my addr 172.21.15.125:0/2533314181 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cec97b700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce8139200 0x7f9ce811f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 -- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 msgr2=0x7f9ce811e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 0x7f9ce811e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 -- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce8139200 msgr2=0x7f9ce811f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce8139200 0x7f9ce811f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 -- 172.21.15.125:0/2533314181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009a70 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce77fe700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009840 tx=0x7f9cdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0044d0 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc01f070 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0038e0 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc0094a0 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.576+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce8120b30 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.577+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cdc003a40 con 0x7f9ce80a1550 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.577+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cdc021070 con 0x7f9ce80a1550 2023-10-03T10:13:24.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.578+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce804f2a0 con 0x7f9ce80a1550 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.582+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cdc02b080 con 0x7f9ce80a1550 2023-10-03T10:13:24.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.734+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efcd00a2710 con 0x7efcd00a1380 2023-10-03T10:13:24.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.734+0000 7efcb77fe700 1 -- 172.21.15.125:0/328048735 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcc4021020 con 0x7efcd00a1380 2023-10-03T10:13:24.735 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 msgr2=0x7efcd01c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcc400ebe0 tx=0x7efcc400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 shutdown_connections 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcd0133f50 0x7efcd01c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcd00a0a70 0x7efcd01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 --2- 172.21.15.125:0/328048735 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcd00a1380 0x7efcd01c8740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 >> 172.21.15.125:0/328048735 conn(0x7efcd00a6610 msgr2=0x7efcd00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.736+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 shutdown_connections 2023-10-03T10:13:24.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.737+0000 7efcd5378700 1 -- 172.21.15.125:0/328048735 wait complete. 2023-10-03T10:13:24.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.768+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ce8072980 con 0x7f9ce80a1550 2023-10-03T10:13:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.769+0000 7f9ce4ff9700 1 -- 172.21.15.125:0/2533314181 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cdc015020 con 0x7f9ce80a1550 2023-10-03T10:13:24.769 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 msgr2=0x7f9ce811ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009840 tx=0x7f9cdc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 shutdown_connections 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce8139200 0x7f9ce811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ce80a0a70 0x7f9ce811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 --2- 172.21.15.125:0/2533314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce80a1550 0x7f9ce811ec00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 >> 172.21.15.125:0/2533314181 conn(0x7f9ce80a6610 msgr2=0x7f9ce80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 shutdown_connections 2023-10-03T10:13:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.771+0000 7f9cee3de700 1 -- 172.21.15.125:0/2533314181 wait complete. 2023-10-03T10:13:24.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:24.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:24.868 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 Processor -- start 2023-10-03T10:13:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 -- start start 2023-10-03T10:13:24.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe50c0a1380 0x7fe50c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c133f50 0x7fe50c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c09e9d0 con 0x7fe50c0a1380 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c09dc00 con 0x7fe50c133f50 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.954+0000 7fe511682700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c09dec0 con 0x7fe50c0a0a70 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe50c0a1380 0x7fe50c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c133f50 0x7fe50c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48464/0 (socket says 172.21.15.125:48464) 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe50c0a1380 0x7fe50c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33986/0 (socket says 172.21.15.125:33986) 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50affd700 1 -- 172.21.15.125:0/2144451724 learned_addr learned my addr 172.21.15.125:0/2144451724 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 -- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 msgr2=0x7fe50c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 -- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c133f50 msgr2=0x7fe50c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c133f50 0x7fe50c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 -- 172.21.15.125:0/2144451724 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c09e6a0 con 0x7fe50c0a1380 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50affd700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe50a7fc700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a1380 0x7fe50c133a10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe500009840 tx=0x7fe500009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72162632cff4e103 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe509ffb700 1 -- 172.21.15.125:0/2144451724 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500011830 con 0x7fe50c0a1380 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe509ffb700 1 -- 172.21.15.125:0/2144451724 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe500011990 con 0x7fe50c0a1380 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.955+0000 7fe509ffb700 1 -- 172.21.15.125:0/2144451724 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500011d20 con 0x7fe50c0a1380 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 -- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a1380 msgr2=0x7fe50c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a1380 0x7fe50c133a10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe500009840 tx=0x7fe500009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 -- 172.21.15.125:0/2144451724 shutdown_connections 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c133f50 0x7fe50c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c0a0a70 0x7fe50c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 --2- 172.21.15.125:0/2144451724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a1380 0x7fe50c133a10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 -- 172.21.15.125:0/2144451724 >> 172.21.15.125:0/2144451724 conn(0x7fe50c0a6610 msgr2=0x7fe50c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 -- 172.21.15.125:0/2144451724 shutdown_connections 2023-10-03T10:13:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.956+0000 7fe511682700 1 -- 172.21.15.125:0/2144451724 wait complete. 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 Processor -- start 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 -- start start 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 0x7fe50c11fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 0x7fe50c120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c121a80 con 0x7fe50c0a0a70 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0a0470 con 0x7fe50c0a1380 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.957+0000 7fe511682700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c133a10 con 0x7fe50c133f50 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33998/0 (socket says 172.21.15.125:33998) 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 -- 172.21.15.125:0/3244063179 learned_addr learned my addr 172.21.15.125:0/3244063179 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50b7fe700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 0x7fe50c120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50a7fc700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 0x7fe50c11fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 -- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 msgr2=0x7fe50c120070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 0x7fe50c120070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 -- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 msgr2=0x7fe50c11fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 0x7fe50c11fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 -- 172.21.15.125:0/3244063179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009550 con 0x7fe50c0a0a70 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50b7fe700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 0x7fe50c120070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50a7fc700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 0x7fe50c11fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe50affd700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e930 tx=0x7fe4fc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc004030 con 0x7fe50c0a0a70 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc004190 con 0x7fe50c0a0a70 2023-10-03T10:13:24.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5000094a0 con 0x7fe50c0a0a70 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc004520 con 0x7fe50c0a0a70 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.958+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c1300c0 con 0x7fe50c0a0a70 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.959+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4fc0036a0 con 0x7fe50c0a0a70 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.959+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4fc03f820 con 0x7fe50c0a0a70 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.959+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c04f2a0 con 0x7fe50c0a0a70 2023-10-03T10:13:24.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.964+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4fc020080 con 0x7fe50c0a0a70 2023-10-03T10:13:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.996+0000 7f33aae7e700 1 Processor -- start 2023-10-03T10:13:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.996+0000 7f33aae7e700 1 -- start start 2023-10-03T10:13:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33aae7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a412ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33aae7e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 0x7f33a4133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33aae7e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a406b0a0 con 0x7f33a41305d0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33aae7e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a406ab40 con 0x7f33a406a770 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33aae7e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a409b000 con 0x7f33a4130a20 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a8c1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a412ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f33a41305d0 0x7f33a41334b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42550/0 (socket says 172.21.15.125:42550) 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a3fff700 1 -- 172.21.15.125:0/3241604005 learned_addr learned my addr 172.21.15.125:0/3241604005 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 0x7f33a4133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a37fe700 1 -- 172.21.15.125:0/3241604005 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637628910 0 0) 0x7f33a406b0a0 con 0x7f33a41305d0 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 -- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 msgr2=0x7f33a412ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a412ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 -- 172.21.15.125:0/3241604005 >> v1:172.21.15.125:6789/0 conn(0x7f33a41305d0 legacy=0x7f33a41334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 -- 172.21.15.125:0/3241604005 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a409f670 con 0x7f33a4130a20 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a8c1a700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.997+0000 7f33a941b700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 0x7f33a4133bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f339c009dc0 tx=0x7f339c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf757c087672d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33a37fe700 1 -- 172.21.15.125:0/3241604005 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c00e070 con 0x7f33a4130a20 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33a37fe700 1 -- 172.21.15.125:0/3241604005 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c00bac0 con 0x7f33a4130a20 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33a37fe700 1 -- 172.21.15.125:0/3241604005 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c00be70 con 0x7f33a4130a20 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 -- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 msgr2=0x7f33a4133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 0x7f33a4133bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f339c009dc0 tx=0x7f339c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 -- 172.21.15.125:0/3241604005 shutdown_connections 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a4130a20 0x7f33a4133bc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 --2- 172.21.15.125:0/3241604005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 -- 172.21.15.125:0/3241604005 >> 172.21.15.125:0/3241604005 conn(0x7f33a40a2ef0 msgr2=0x7f33a40a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 -- 172.21.15.125:0/3241604005 shutdown_connections 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:24.998+0000 7f33aae7e700 1 -- 172.21.15.125:0/3241604005 wait complete. 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.000+0000 7f33aae7e700 1 Processor -- start 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.000+0000 7f33aae7e700 1 -- start start 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.000+0000 7f33aae7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a41305d0 0x7f33a4134ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 0x7f33a4135020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a413b640 con 0x7f33a4130a20 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41356d0 con 0x7f33a406a770 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4136b10 con 0x7f33a41305d0 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a941b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 0x7f33a4135020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a941b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 0x7f33a4135020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34002/0 (socket says 172.21.15.125:34002) 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50610/0 (socket says 172.21.15.125:50610) 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a941b700 1 -- 172.21.15.125:0/2872254752 learned_addr learned my addr 172.21.15.125:0/2872254752 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a3fff700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a41305d0 0x7f33a4134ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 -- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a41305d0 msgr2=0x7f33a4134ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a41305d0 0x7f33a4134ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 -- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 msgr2=0x7f33a4135020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 0x7f33a4135020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 -- 172.21.15.125:0/2872254752 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940094a0 con 0x7f33a406a770 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a8c1a700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f339400e900 tx=0x7f339400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394013680 con 0x7f33a406a770 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940137e0 con 0x7f33a406a770 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394013b70 con 0x7f33a406a770 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c009a70 con 0x7f33a406a770 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.001+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a412db30 con 0x7f33a406a770 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.002+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3394013cd0 con 0x7f33a406a770 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.002+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f339403f9b0 con 0x7f33a406a770 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.002+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a404f2a0 con 0x7f33a406a770 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.007+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3394017020 con 0x7f33a406a770 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.162+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe50c09be30 con 0x7fe50c0a0a70 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.162+0000 7fe4f37fe700 1 -- 172.21.15.125:0/3244063179 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4fc011bd0 con 0x7fe50c0a0a70 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.164+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 msgr2=0x7fe50c11f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.164+0000 7fe511682700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e930 tx=0x7fe4fc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 shutdown_connections 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c133f50 0x7fe50c120070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c0a0a70 0x7fe50c11f5f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 --2- 172.21.15.125:0/3244063179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c0a1380 0x7fe50c11fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 >> 172.21.15.125:0/3244063179 conn(0x7fe50c0a6610 msgr2=0x7fe50c0a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 shutdown_connections 2023-10-03T10:13:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.165+0000 7fe511682700 1 -- 172.21.15.125:0/3244063179 wait complete. 2023-10-03T10:13:25.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.200+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33a41367b0 con 0x7f33a406a770 2023-10-03T10:13:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.200+0000 7f33a17fa700 1 -- 172.21.15.125:0/2872254752 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33a41367b0 con 0x7f33a406a770 2023-10-03T10:13:25.200 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 msgr2=0x7f33a41345a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f339400e900 tx=0x7f339400ec10 comp rx=0 tx=0).stop 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 shutdown_connections 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a4130a20 0x7f33a4135020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a406a770 0x7f33a41345a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 --2- 172.21.15.125:0/2872254752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a41305d0 0x7f33a4134ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 >> 172.21.15.125:0/2872254752 conn(0x7f33a40a2ef0 msgr2=0x7f33a409b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 shutdown_connections 2023-10-03T10:13:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.202+0000 7f33aae7e700 1 -- 172.21.15.125:0/2872254752 wait complete. 2023-10-03T10:13:25.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:25.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:25.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.879+0000 7f64f10dc700 1 Processor -- start 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.879+0000 7f64f10dc700 1 -- start start 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 0x7f64ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 0x7f64ec1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec09e9d0 con 0x7f64ec133f50 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec09dc00 con 0x7f64ec0a1380 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64f10dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec09dec0 con 0x7f64ec0a0a70 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ead9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 0x7f64ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ead9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34324/0 (socket says 172.21.15.125:34324) 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ead9d700 1 -- 172.21.15.125:0/29145849 learned_addr learned my addr 172.21.15.125:0/29145849 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64eb59e700 1 --2- 172.21.15.125:0/29145849 >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 0x7f64ec1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 -- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 msgr2=0x7f64ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 -- 172.21.15.125:0/29145849 >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 msgr2=0x7f64ec1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 --2- 172.21.15.125:0/29145849 >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 0x7f64ec1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 -- 172.21.15.125:0/29145849 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec09e6a0 con 0x7f64ec0a1380 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ead9d700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64eb59e700 1 --2- 172.21.15.125:0/29145849 >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 0x7f64ec1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64ea59c700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 0x7f64ec133a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d537b7d0a52e3ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64e9d9b700 1 -- 172.21.15.125:0/29145849 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011830 con 0x7f64ec0a1380 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64e9d9b700 1 -- 172.21.15.125:0/29145849 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011990 con 0x7f64ec0a1380 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.880+0000 7f64e9d9b700 1 -- 172.21.15.125:0/29145849 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011d20 con 0x7f64ec0a1380 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 -- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 msgr2=0x7f64ec133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 0x7f64ec133a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 -- 172.21.15.125:0/29145849 shutdown_connections 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 --2- 172.21.15.125:0/29145849 >> v2:172.21.15.125:3300/0 conn(0x7f64ec133f50 0x7f64ec1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec0a0a70 0x7f64ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 --2- 172.21.15.125:0/29145849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a1380 0x7f64ec133a10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 -- 172.21.15.125:0/29145849 >> 172.21.15.125:0/29145849 conn(0x7f64ec0a6610 msgr2=0x7f64ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 -- 172.21.15.125:0/29145849 shutdown_connections 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.881+0000 7f64f10dc700 1 -- 172.21.15.125:0/29145849 wait complete. 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.882+0000 7f64f10dc700 1 Processor -- start 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.882+0000 7f64f10dc700 1 -- start start 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 0x7f64ec1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec124aa0 con 0x7f64ec0a1380 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec133a10 con 0x7f64ec0a0a70 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64f10dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0a03e0 con 0x7f64ec133f50 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ead9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57618/0 (socket says 172.21.15.125:57618) 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ead9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56404/0 (socket says 172.21.15.125:56404) 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 -- 172.21.15.125:0/4125305350 learned_addr learned my addr 172.21.15.125:0/4125305350 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64eb59e700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 0x7f64ec1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 -- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 msgr2=0x7f64ec1222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 0x7f64ec1222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 -- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 msgr2=0x7f64ec121850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 -- 172.21.15.125:0/4125305350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc009550 con 0x7f64ec0a1380 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64eb59e700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 0x7f64ec1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ead9d700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.883+0000 7f64ea59c700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f64e00090b0 tx=0x7f64e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.884+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00044d0 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.884+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e001f070 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.884+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e4009a70 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.884+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00038e0 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.884+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e00094a0 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.885+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64e0003a40 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.885+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec09d100 con 0x7f64ec0a1380 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.885+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64e0021070 con 0x7f64ec0a1380 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.889+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64e0010380 con 0x7f64ec0a1380 2023-10-03T10:13:25.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 Processor -- start 2023-10-03T10:13:25.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 -- start start 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 0x7f0c54133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 0x7f0c54134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5409e9d0 con 0x7f0c540a1380 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5409dc00 con 0x7f0c540a0a70 2023-10-03T10:13:25.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c5b5b7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5409dec0 con 0x7f0c54133f50 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c59353700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c58b52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 0x7f0c54133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c59b54700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 0x7f0c54134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c59353700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56406/0 (socket says 172.21.15.125:56406) 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.921+0000 7f0c59353700 1 -- 172.21.15.125:0/2055258669 learned_addr learned my addr 172.21.15.125:0/2055258669 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 -- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 msgr2=0x7f0c54134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 0x7f0c54134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 -- 172.21.15.125:0/2055258669 >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 msgr2=0x7f0c54133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 --2- 172.21.15.125:0/2055258669 >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 0x7f0c54133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 -- 172.21.15.125:0/2055258669 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5409e6a0 con 0x7f0c540a0a70 2023-10-03T10:13:25.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59b54700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 0x7f0c54134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c58b52700 1 --2- 172.21.15.125:0/2055258669 >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 0x7f0c54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c59353700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098f0 tx=0x7f0c50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19cb1eae65a26d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c4bfff700 1 -- 172.21.15.125:0/2055258669 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011830 con 0x7f0c540a0a70 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c4bfff700 1 -- 172.21.15.125:0/2055258669 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50011990 con 0x7f0c540a0a70 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c4bfff700 1 -- 172.21.15.125:0/2055258669 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011d20 con 0x7f0c540a0a70 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 msgr2=0x7f0c540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.922+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098f0 tx=0x7f0c50009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/2055258669 shutdown_connections 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540a0a70 0x7f0c540a0e40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/2055258669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c54133f50 0x7f0c54134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/2055258669 >> v2:172.21.15.125:3300/0 conn(0x7f0c540a1380 0x7f0c54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/2055258669 >> 172.21.15.125:0/2055258669 conn(0x7f0c540a6610 msgr2=0x7f0c540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/2055258669 shutdown_connections 2023-10-03T10:13:25.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.923+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/2055258669 wait complete. 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.924+0000 7f0c5b5b7700 1 Processor -- start 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.924+0000 7f0c5b5b7700 1 -- start start 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 0x7f0c5411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 0x7f0c5411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54120b50 con 0x7f0c540a0a70 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54121990 con 0x7f0c54133f50 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540a03e0 con 0x7f0c540a1380 2023-10-03T10:13:25.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59353700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c58b52700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 0x7f0c5411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c58b52700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 0x7f0c5411ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34342/0 (socket says 172.21.15.125:34342) 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c58b52700 1 -- 172.21.15.125:0/3257870533 learned_addr learned my addr 172.21.15.125:0/3257870533 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59353700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57626/0 (socket says 172.21.15.125:57626) 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 0x7f0c5411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 -- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 msgr2=0x7f0c5411ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 0x7f0c5411ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 -- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 msgr2=0x7f0c5411e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 -- 172.21.15.125:0/3257870533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440094a0 con 0x7f0c54133f50 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59353700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c59b54700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 0x7f0c5411f1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c011620 tx=0x7f0c4c011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c019040 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c003c20 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c014660 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.925+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004030 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.926+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c50009550 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.926+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c4c004190 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.927+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c54120350 con 0x7f0c54133f50 2023-10-03T10:13:25.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.927+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c4c0486a0 con 0x7f0c54133f50 2023-10-03T10:13:25.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:25.931+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c4c01c340 con 0x7f0c54133f50 2023-10-03T10:13:26.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.083+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f64ec06d3f0 con 0x7f64ec0a1380 2023-10-03T10:13:26.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.083+0000 7f64d37fe700 1 -- 172.21.15.125:0/4125305350 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64e002b030 con 0x7f64ec0a1380 2023-10-03T10:13:26.084 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:26.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 msgr2=0x7f64ec121d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f64e00090b0 tx=0x7f64e0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:26.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 shutdown_connections 2023-10-03T10:13:26.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64ec133f50 0x7f64ec1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ec0a0a70 0x7f64ec121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 --2- 172.21.15.125:0/4125305350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ec0a1380 0x7f64ec121d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 >> 172.21.15.125:0/4125305350 conn(0x7f64ec0a6610 msgr2=0x7f64ec133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 shutdown_connections 2023-10-03T10:13:26.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.086+0000 7f64f10dc700 1 -- 172.21.15.125:0/4125305350 wait complete. 2023-10-03T10:13:26.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:26.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.128+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c540a48c0 con 0x7f0c54133f50 2023-10-03T10:13:26.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.128+0000 7f0c49ffb700 1 -- 172.21.15.125:0/3257870533 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c4c027b50 con 0x7f0c54133f50 2023-10-03T10:13:26.129 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 msgr2=0x7f0c5411f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 0x7f0c5411f1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c011620 tx=0x7f0c4c011930 comp rx=0 tx=0).stop 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 shutdown_connections 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54133f50 0x7f0c5411f1f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540a0a70 0x7f0c5411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 --2- 172.21.15.125:0/3257870533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c540a1380 0x7f0c5411ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 >> 172.21.15.125:0/3257870533 conn(0x7f0c540a6610 msgr2=0x7f0c540a5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 shutdown_connections 2023-10-03T10:13:26.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.130+0000 7f0c5b5b7700 1 -- 172.21.15.125:0/3257870533 wait complete. 2023-10-03T10:13:26.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:26.178 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:26.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:26.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.309+0000 7fe281588700 1 Processor -- start 2023-10-03T10:13:26.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.309+0000 7fe281588700 1 -- start start 2023-10-03T10:13:26.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.309+0000 7fe281588700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe27c09f350 0x7fe27c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.309+0000 7fe281588700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 0x7fe27c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe281588700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c09c970 con 0x7fe27c09e870 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe281588700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0a0920 con 0x7fe27c09f350 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe281588700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c09f9c0 con 0x7fe27c1371c0 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe27c09f350 0x7fe27c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 0x7fe27c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe27c09f350 0x7fe27c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57628/0 (socket says 172.21.15.125:57628) 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe27c09e870 0x7fe27c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56734/0 (socket says 172.21.15.125:56734) 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 -- 172.21.15.125:0/2467451919 learned_addr learned my addr 172.21.15.125:0/2467451919 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 -- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 msgr2=0x7fe27c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 0x7fe27c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 -- 172.21.15.125:0/2467451919 >> v1:172.21.15.125:6789/0 conn(0x7fe27c09e870 legacy=0x7fe27c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 -- 172.21.15.125:0/2467451919 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c09bab0 con 0x7fe27c09f350 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe279ffb700 1 -- 172.21.15.125:0/2467451919 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610298093 0 0) 0x7fe27c09c970 con 0x7fe27c09e870 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27b7fe700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 0x7fe27c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe27a7fc700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09f350 0x7fe27c136c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe2700098f0 tx=0x7fe270009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be8e0e43c685b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe279ffb700 1 -- 172.21.15.125:0/2467451919 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011830 con 0x7fe27c09f350 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe279ffb700 1 -- 172.21.15.125:0/2467451919 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270011990 con 0x7fe27c09f350 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.310+0000 7fe279ffb700 1 -- 172.21.15.125:0/2467451919 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011d20 con 0x7fe27c09f350 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 -- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09f350 msgr2=0x7fe27c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09f350 0x7fe27c136c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe2700098f0 tx=0x7fe270009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 -- 172.21.15.125:0/2467451919 shutdown_connections 2023-10-03T10:13:26.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c1371c0 0x7fe27c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 --2- 172.21.15.125:0/2467451919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09f350 0x7fe27c136c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 -- 172.21.15.125:0/2467451919 >> 172.21.15.125:0/2467451919 conn(0x7fe27c0a4430 msgr2=0x7fe27c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 -- 172.21.15.125:0/2467451919 shutdown_connections 2023-10-03T10:13:26.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.311+0000 7fe281588700 1 -- 172.21.15.125:0/2467451919 wait complete. 2023-10-03T10:13:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 Processor -- start 2023-10-03T10:13:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 -- start start 2023-10-03T10:13:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 0x7fe27c11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c120450 con 0x7fe27c09e870 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c120b30 con 0x7fe27c1371c0 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.312+0000 7fe281588700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c120880 con 0x7fe27c09f350 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34360/0 (socket says 172.21.15.125:34360) 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57644/0 (socket says 172.21.15.125:57644) 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27a7fc700 1 -- 172.21.15.125:0/4225197214 learned_addr learned my addr 172.21.15.125:0/4225197214 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27b7fe700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 0x7fe27c11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 -- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 msgr2=0x7fe27c11ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 -- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 msgr2=0x7fe27c11f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 0x7fe27c11f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 -- 172.21.15.125:0/4225197214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274009a70 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27b7fe700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 0x7fe27c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27a7fc700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe27affd700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00c4a0 tx=0x7fe26c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c004c80 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c004de0 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270009550 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c007310 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.313+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c0a2e60 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.314+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe26c007470 con 0x7fe27c09e870 2023-10-03T10:13:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.314+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe26c03f1d0 con 0x7fe27c09e870 2023-10-03T10:13:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.314+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c132700 con 0x7fe27c09e870 2023-10-03T10:13:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.319+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe26c00ce60 con 0x7fe27c09e870 2023-10-03T10:13:26.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.351+0000 7fc6db7b8700 1 Processor -- start 2023-10-03T10:13:26.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.351+0000 7fc6db7b8700 1 -- start start 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.351+0000 7fc6db7b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d40a0a70 0x7fc6d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6db7b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 0x7fc6d413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6db7b8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d409dc00 con 0x7fc6d40a1380 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6db7b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d409ea90 con 0x7fc6d40a0a70 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6db7b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d409dec0 con 0x7fc6d4134120 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9d55700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 0x7fc6d413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d40a0a70 0x7fc6d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d8d53700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc6d40a1380 0x7fc6d4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56746/0 (socket says 172.21.15.125:56746) 2023-10-03T10:13:26.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d8d53700 1 -- 172.21.15.125:0/22217448 learned_addr learned my addr 172.21.15.125:0/22217448 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6d40a0a70 0x7fc6d40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57646/0 (socket says 172.21.15.125:57646) 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 -- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 msgr2=0x7fc6d413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 0x7fc6d413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 -- 172.21.15.125:0/22217448 >> v1:172.21.15.125:6789/0 conn(0x7fc6d40a1380 legacy=0x7fc6d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 -- 172.21.15.125:0/22217448 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d409e6a0 con 0x7fc6d40a0a70 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6cbfff700 1 -- 172.21.15.125:0/22217448 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257585541 0 0) 0x7fc6d409dc00 con 0x7fc6d40a1380 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9d55700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 0x7fc6d413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6d9554700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d40a0a70 0x7fc6d40a0e40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009840 tx=0x7fc6d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cbc5d4552458dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6cbfff700 1 -- 172.21.15.125:0/22217448 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0011830 con 0x7fc6d40a0a70 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6cbfff700 1 -- 172.21.15.125:0/22217448 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0011990 con 0x7fc6d40a0a70 2023-10-03T10:13:26.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.352+0000 7fc6cbfff700 1 -- 172.21.15.125:0/22217448 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0011d20 con 0x7fc6d40a0a70 2023-10-03T10:13:26.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 -- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d40a0a70 msgr2=0x7fc6d40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d40a0a70 0x7fc6d40a0e40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009840 tx=0x7fc6d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 -- 172.21.15.125:0/22217448 shutdown_connections 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d4134120 0x7fc6d413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/22217448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d40a0a70 0x7fc6d40a0e40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 -- 172.21.15.125:0/22217448 >> 172.21.15.125:0/22217448 conn(0x7fc6d40a6610 msgr2=0x7fc6d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 -- 172.21.15.125:0/22217448 shutdown_connections 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.353+0000 7fc6db7b8700 1 -- 172.21.15.125:0/22217448 wait complete. 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 Processor -- start 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 -- start start 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 0x7fc6d4122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d40a1380 0x7fc6d4122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 0x7fc6d4123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4133300 con 0x7fc6d4134120 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4125920 con 0x7fc6d40a1380 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6db7b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4124310 con 0x7fc6d40a0a70 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6d9d55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 0x7fc6d4123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6d9554700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 0x7fc6d4122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6d9d55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 0x7fc6d4123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57654/0 (socket says 172.21.15.125:57654) 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6d9d55700 1 -- 172.21.15.125:0/2478074805 learned_addr learned my addr 172.21.15.125:0/2478074805 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.354+0000 7fc6d8d53700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d40a1380 0x7fc6d4122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 -- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d40a1380 msgr2=0x7fc6d4122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d40a1380 0x7fc6d4122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 -- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 msgr2=0x7fc6d4123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 0x7fc6d4123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 -- 172.21.15.125:0/2478074805 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc009a70 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6d9554700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 0x7fc6d4122700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0016000 tx=0x7fc6d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00036a0 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d001f070 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003a00 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d00094a0 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.355+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d4125c80 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.356+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6d0003b60 con 0x7fc6d40a0a70 2023-10-03T10:13:26.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.356+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6d0021070 con 0x7fc6d40a0a70 2023-10-03T10:13:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.356+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d404f2a0 con 0x7fc6d40a0a70 2023-10-03T10:13:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.361+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6d0026480 con 0x7fc6d40a0a70 2023-10-03T10:13:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.515+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe27c04f2a0 con 0x7fe27c09e870 2023-10-03T10:13:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.516+0000 7fe2637fe700 1 -- 172.21.15.125:0/4225197214 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe26c01b760 con 0x7fe27c09e870 2023-10-03T10:13:26.516 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 msgr2=0x7fe27c11e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00c4a0 tx=0x7fe26c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 shutdown_connections 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe27c1371c0 0x7fe27c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe27c09e870 0x7fe27c11e6c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 --2- 172.21.15.125:0/4225197214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe27c09f350 0x7fe27c11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 >> 172.21.15.125:0/4225197214 conn(0x7fe27c0a4430 msgr2=0x7fe27c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 shutdown_connections 2023-10-03T10:13:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.518+0000 7fe281588700 1 -- 172.21.15.125:0/4225197214 wait complete. 2023-10-03T10:13:26.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:26.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.557+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6d4072980 con 0x7fc6d40a0a70 2023-10-03T10:13:26.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.558+0000 7fc6c9ffb700 1 -- 172.21.15.125:0/2478074805 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6d0019ba0 con 0x7fc6d40a0a70 2023-10-03T10:13:26.558 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:26.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 msgr2=0x7fc6d4122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 0x7fc6d4122700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0016000 tx=0x7fc6d0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 shutdown_connections 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6d4134120 0x7fc6d4123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6d40a0a70 0x7fc6d4122700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 --2- 172.21.15.125:0/2478074805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6d40a1380 0x7fc6d4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 >> 172.21.15.125:0/2478074805 conn(0x7fc6d40a6610 msgr2=0x7fc6d40a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 shutdown_connections 2023-10-03T10:13:26.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:26.560+0000 7fc6db7b8700 1 -- 172.21.15.125:0/2478074805 wait complete. 2023-10-03T10:13:26.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:27.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:27.143 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:27.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 Processor -- start 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 -- start start 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6409a520 con 0x7faf6409edb0 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6409fe00 con 0x7faf64133c20 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf696c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf6406bec0 con 0x7faf6409a150 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf62ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf637fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.230+0000 7faf627fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56450/0 (socket says 172.21.15.125:56450) 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf627fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57660/0 (socket says 172.21.15.125:57660) 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 -- 172.21.15.125:0/754850178 learned_addr learned my addr 172.21.15.125:0/754850178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf62ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34364/0 (socket says 172.21.15.125:34364) 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 -- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 msgr2=0x7faf6409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 -- 172.21.15.125:0/754850178 >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 msgr2=0x7faf6409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 --2- 172.21.15.125:0/754850178 >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 -- 172.21.15.125:0/754850178 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6409af80 con 0x7faf64133c20 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf62ffd700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf627fc700 1 --2- 172.21.15.125:0/754850178 >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf637fe700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009eb0 tx=0x7faf5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68eb9d2ee58c3074 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf61ffb700 1 -- 172.21.15.125:0/754850178 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e070 con 0x7faf64133c20 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf61ffb700 1 -- 172.21.15.125:0/754850178 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00b890 con 0x7faf64133c20 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.231+0000 7faf61ffb700 1 -- 172.21.15.125:0/754850178 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00bc40 con 0x7faf64133c20 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 -- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 msgr2=0x7faf641340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009eb0 tx=0x7faf5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 -- 172.21.15.125:0/754850178 shutdown_connections 2023-10-03T10:13:27.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641340a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 --2- 172.21.15.125:0/754850178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf6409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 --2- 172.21.15.125:0/754850178 >> v2:172.21.15.125:3300/0 conn(0x7faf6409edb0 0x7faf6409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 -- 172.21.15.125:0/754850178 >> 172.21.15.125:0/754850178 conn(0x7faf640a4430 msgr2=0x7faf640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 -- 172.21.15.125:0/754850178 shutdown_connections 2023-10-03T10:13:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.232+0000 7faf696c8700 1 -- 172.21.15.125:0/754850178 wait complete. 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 Processor -- start 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 -- start start 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf64122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64126360 con 0x7faf6409edb0 2023-10-03T10:13:27.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64124840 con 0x7faf64133c20 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf696c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf64124ce0 con 0x7faf6409a150 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf627fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf637fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf627fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57662/0 (socket says 172.21.15.125:57662) 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf627fc700 1 -- 172.21.15.125:0/1336998301 learned_addr learned my addr 172.21.15.125:0/1336998301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf637fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56464/0 (socket says 172.21.15.125:56464) 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.233+0000 7faf62ffd700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf64122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 -- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 msgr2=0x7faf64122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf64122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 -- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 msgr2=0x7faf641235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 -- 172.21.15.125:0/1336998301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540094a0 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf637fe700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf62ffd700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf64122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf627fc700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5800ebb0 tx=0x7faf5800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800c850 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5800c9b0 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf580094a0 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800cd40 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.234+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c009b30 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.235+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf58013470 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.235+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf5803fac0 con 0x7faf6409edb0 2023-10-03T10:13:27.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.235+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6409fa30 con 0x7faf6409edb0 2023-10-03T10:13:27.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.240+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf58021080 con 0x7faf6409edb0 2023-10-03T10:13:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 Processor -- start 2023-10-03T10:13:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 -- start start 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c133f50 0x7fbd7c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c09e9d0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c09dc00 con 0x7fbd7c133f50 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd81893700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c09dec0 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd7a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34378/0 (socket says 172.21.15.125:34378) 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57670/0 (socket says 172.21.15.125:57670) 2023-10-03T10:13:27.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.270+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c133f50 0x7fbd7c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 -- 172.21.15.125:0/1552101928 learned_addr learned my addr 172.21.15.125:0/1552101928 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 -- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c133f50 msgr2=0x7fbd7c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 --2- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c133f50 0x7fbd7c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 -- 172.21.15.125:0/1552101928 >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 msgr2=0x7fbd7c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 --2- 172.21.15.125:0/1552101928 >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 -- 172.21.15.125:0/1552101928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c09e6a0 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7a7fc700 1 --2- 172.21.15.125:0/1552101928 >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd7affd700 1 --2- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098f0 tx=0x7fbd6c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c912d612c4b1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd79ffb700 1 -- 172.21.15.125:0/1552101928 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c011830 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd79ffb700 1 -- 172.21.15.125:0/1552101928 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c011990 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.271+0000 7fbd79ffb700 1 -- 172.21.15.125:0/1552101928 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c011d20 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 -- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 msgr2=0x7fbd7c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 --2- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098f0 tx=0x7fbd6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 -- 172.21.15.125:0/1552101928 shutdown_connections 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 --2- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c133f50 0x7fbd7c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 --2- 172.21.15.125:0/1552101928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a0a70 0x7fbd7c0a0e40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 --2- 172.21.15.125:0/1552101928 >> v2:172.21.15.125:3300/0 conn(0x7fbd7c0a1380 0x7fbd7c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 -- 172.21.15.125:0/1552101928 >> 172.21.15.125:0/1552101928 conn(0x7fbd7c0a6610 msgr2=0x7fbd7c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 -- 172.21.15.125:0/1552101928 shutdown_connections 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.272+0000 7fbd81893700 1 -- 172.21.15.125:0/1552101928 wait complete. 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.273+0000 7fbd81893700 1 Processor -- start 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.273+0000 7fbd81893700 1 -- start start 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 0x7fbd7c11f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 0x7fbd7c11fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c122bd0 con 0x7fbd7c133f50 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c1207f0 con 0x7fbd7c0a0a70 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd81893700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0a03e0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 0x7fbd7c11fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34386/0 (socket says 172.21.15.125:34386) 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 -- 172.21.15.125:0/3366731322 learned_addr learned my addr 172.21.15.125:0/3366731322 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 0x7fbd7c11fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57678/0 (socket says 172.21.15.125:57678) 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7affd700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 0x7fbd7c11f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 -- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 msgr2=0x7fbd7c11f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 0x7fbd7c11f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 -- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 msgr2=0x7fbd7c11fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.274+0000 7fbd7a7fc700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 0x7fbd7c11fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd7a7fc700 1 -- 172.21.15.125:0/3366731322 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700094a0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd7affd700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 0x7fbd7c11f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd7a7fc700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000ebb0 tx=0x7fbd7000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000c850 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000c9b0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c009550 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000cd40 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.275+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c133a60 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.276+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd70013470 con 0x7fbd7c0a1380 2023-10-03T10:13:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.276+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd7003f6b0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.276+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c123700 con 0x7fbd7c0a1380 2023-10-03T10:13:27.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.280+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd700232f0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.435+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf640a1420 con 0x7faf6409edb0 2023-10-03T10:13:27.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.435+0000 7faf4b7fe700 1 -- 172.21.15.125:0/1336998301 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf5801b3b0 con 0x7faf6409edb0 2023-10-03T10:13:27.435 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:27.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 msgr2=0x7faf64123060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5800ebb0 tx=0x7faf5800eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 shutdown_connections 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf64133c20 0x7faf641235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6409a150 0x7faf64122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 --2- 172.21.15.125:0/1336998301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf6409edb0 0x7faf64123060 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 >> 172.21.15.125:0/1336998301 conn(0x7faf640a4430 msgr2=0x7faf6409c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 shutdown_connections 2023-10-03T10:13:27.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.437+0000 7faf696c8700 1 -- 172.21.15.125:0/1336998301 wait complete. 2023-10-03T10:13:27.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.473+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd7c04f2a0 con 0x7fbd7c0a1380 2023-10-03T10:13:27.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.474+0000 7fbd63fff700 1 -- 172.21.15.125:0/3366731322 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd70021020 con 0x7fbd7c0a1380 2023-10-03T10:13:27.474 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:27.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 msgr2=0x7fbd7c11f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000ebb0 tx=0x7fbd7000eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 shutdown_connections 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd7c133f50 0x7fbd7c11fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd7c0a0a70 0x7fbd7c11f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 --2- 172.21.15.125:0/3366731322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd7c0a1380 0x7fbd7c11f8d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 >> 172.21.15.125:0/3366731322 conn(0x7fbd7c0a6610 msgr2=0x7fbd7c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 shutdown_connections 2023-10-03T10:13:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.476+0000 7fbd81893700 1 -- 172.21.15.125:0/3366731322 wait complete. 2023-10-03T10:13:27.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:27.532 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:27.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:27.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 Processor -- start 2023-10-03T10:13:27.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 -- start start 2023-10-03T10:13:27.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7c40a0a70 0x7ff7c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c409dc00 con 0x7ff7c4133f50 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c409ea60 con 0x7ff7c40a0a70 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7cbe5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c409dec0 con 0x7ff7c40a1380 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7c93f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7c9bf8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7c40a0a70 0x7ff7c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7ca3f9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff7c4133f50 0x7ff7c413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56754/0 (socket says 172.21.15.125:56754) 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7c93f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34400/0 (socket says 172.21.15.125:34400) 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.658+0000 7ff7ca3f9700 1 -- 172.21.15.125:0/4230680672 learned_addr learned my addr 172.21.15.125:0/4230680672 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c9bf8700 1 -- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 msgr2=0x7ff7c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c9bf8700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c9bf8700 1 -- 172.21.15.125:0/4230680672 >> v1:172.21.15.125:6789/0 conn(0x7ff7c4133f50 legacy=0x7ff7c413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c9bf8700 1 -- 172.21.15.125:0/4230680672 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c409e6a0 con 0x7ff7c40a0a70 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c8bf6700 1 -- 172.21.15.125:0/4230680672 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819024422 0 0) 0x7ff7c409dc00 con 0x7ff7c4133f50 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c93f7700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c9bf8700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a0a70 0x7ff7c40a0e40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009840 tx=0x7ff7c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172fd1942c11ebdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c8bf6700 1 -- 172.21.15.125:0/4230680672 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011830 con 0x7ff7c40a0a70 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c8bf6700 1 -- 172.21.15.125:0/4230680672 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0011990 con 0x7ff7c40a0a70 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.659+0000 7ff7c8bf6700 1 -- 172.21.15.125:0/4230680672 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011d20 con 0x7ff7c40a0a70 2023-10-03T10:13:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a0a70 msgr2=0x7ff7c40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a0a70 0x7ff7c40a0e40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009840 tx=0x7ff7c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/4230680672 shutdown_connections 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a0a70 0x7ff7c40a0e40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/4230680672 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c40a1380 0x7ff7c4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/4230680672 >> 172.21.15.125:0/4230680672 conn(0x7ff7c40a6610 msgr2=0x7ff7c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/4230680672 shutdown_connections 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.660+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/4230680672 wait complete. 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 Processor -- start 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 -- start start 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c40a0a70 0x7ff7c4122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c4133f50 0x7ff7c41232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4133ad0 con 0x7ff7c40a1380 2023-10-03T10:13:27.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4125de0 con 0x7ff7c40a0a70 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7cbe5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4124510 con 0x7ff7c4133f50 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57700/0 (socket says 172.21.15.125:57700) 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 -- 172.21.15.125:0/6423262 learned_addr learned my addr 172.21.15.125:0/6423262 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7ca3f9700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c4133f50 0x7ff7c41232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c9bf8700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c40a0a70 0x7ff7c4122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 -- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c4133f50 msgr2=0x7ff7c41232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c4133f50 0x7ff7c41232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 -- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c40a0a70 msgr2=0x7ff7c4122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c40a0a70 0x7ff7c4122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.661+0000 7ff7c93f7700 1 -- 172.21.15.125:0/6423262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40094a0 con 0x7ff7c40a1380 2023-10-03T10:13:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7c93f7700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ebe0 tx=0x7ff7b400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400c850 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400c9b0 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400cd40 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c00094a0 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.662+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c4133380 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.663+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7b4013470 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.663+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7b403f780 con 0x7ff7c40a1380 2023-10-03T10:13:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.663+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404f2a0 con 0x7ff7c40a1380 2023-10-03T10:13:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.668+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7b4013720 con 0x7ff7c40a1380 2023-10-03T10:13:27.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 Processor -- start 2023-10-03T10:13:27.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 -- start start 2023-10-03T10:13:27.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f865c09ad40 0x7f865c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c09b110 con 0x7f865c0a0a70 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c0a3b60 con 0x7f865c09ad40 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8660c92700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1348e0 con 0x7f865c133f70 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f865a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f865c09ad40 0x7f865c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8659d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f865a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f865c09ad40 0x7f865c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57710/0 (socket says 172.21.15.125:57710) 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f865ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f865c0a0a70 0x7f865c0a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56756/0 (socket says 172.21.15.125:56756) 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f8659d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56492/0 (socket says 172.21.15.125:56492) 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.700+0000 7f865a59c700 1 -- 172.21.15.125:0/1774368322 learned_addr learned my addr 172.21.15.125:0/1774368322 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865a59c700 1 -- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 msgr2=0x7f865c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865a59c700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865a59c700 1 -- 172.21.15.125:0/1774368322 >> v1:172.21.15.125:6789/0 conn(0x7f865c0a0a70 legacy=0x7f865c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865959a700 1 -- 172.21.15.125:0/1774368322 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203527887 0 0) 0x7f865c09b110 con 0x7f865c0a0a70 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865a59c700 1 -- 172.21.15.125:0/1774368322 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0a2fa0 con 0x7f865c09ad40 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f8659d9b700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865a59c700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c133a30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098f0 tx=0x7f864c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d5259aaddc3a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865959a700 1 -- 172.21.15.125:0/1774368322 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011830 con 0x7f865c09ad40 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865959a700 1 -- 172.21.15.125:0/1774368322 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c011990 con 0x7f865c09ad40 2023-10-03T10:13:27.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.701+0000 7f865959a700 1 -- 172.21.15.125:0/1774368322 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011d20 con 0x7f865c09ad40 2023-10-03T10:13:27.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 -- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 msgr2=0x7f865c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c133a30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098f0 tx=0x7f864c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:27.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 -- 172.21.15.125:0/1774368322 shutdown_connections 2023-10-03T10:13:27.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c133a30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 --2- 172.21.15.125:0/1774368322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 -- 172.21.15.125:0/1774368322 >> 172.21.15.125:0/1774368322 conn(0x7f865c099c40 msgr2=0x7f865c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 -- 172.21.15.125:0/1774368322 shutdown_connections 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.702+0000 7f8660c92700 1 -- 172.21.15.125:0/1774368322 wait complete. 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 Processor -- start 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 -- start start 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f865c0a0a70 0x7f865c11fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c122440 con 0x7f865c09ad40 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c121000 con 0x7f865c133f70 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f8660c92700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f865c122620 con 0x7f865c0a0a70 2023-10-03T10:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f865a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f865ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f865a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57716/0 (socket says 172.21.15.125:57716) 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.703+0000 7f865a59c700 1 -- 172.21.15.125:0/1268084571 learned_addr learned my addr 172.21.15.125:0/1268084571 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f8659d9b700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f865c0a0a70 0x7f865c11fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 -- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f865c0a0a70 msgr2=0x7f865c11fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f865c0a0a70 0x7f865c11fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 -- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 msgr2=0x7f865c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 -- 172.21.15.125:0/1268084571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500094a0 con 0x7f865c09ad40 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f865a59c700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f864c009130 tx=0x7f864c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c004510 con 0x7f865c09ad40 2023-10-03T10:13:27.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c01e070 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c009550 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0038c0 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.704+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c11efd0 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.705+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f864c003a20 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.705+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f864c0405a0 con 0x7f865c09ad40 2023-10-03T10:13:27.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.705+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c09c840 con 0x7f865c09ad40 2023-10-03T10:13:27.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.710+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f864c015070 con 0x7f865c09ad40 2023-10-03T10:13:27.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.856+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7c41263e0 con 0x7ff7c40a1380 2023-10-03T10:13:27.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.856+0000 7ff7ba7fc700 1 -- 172.21.15.125:0/6423262 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7b4021030 con 0x7ff7c40a1380 2023-10-03T10:13:27.857 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 msgr2=0x7ff7c4122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ebe0 tx=0x7ff7b400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 shutdown_connections 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c4133f50 0x7ff7c41232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c40a0a70 0x7ff7c4122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 --2- 172.21.15.125:0/6423262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c40a1380 0x7ff7c4122da0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 >> 172.21.15.125:0/6423262 conn(0x7ff7c40a6610 msgr2=0x7ff7c409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 shutdown_connections 2023-10-03T10:13:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.858+0000 7ff7cbe5c700 1 -- 172.21.15.125:0/6423262 wait complete. 2023-10-03T10:13:27.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.896+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f865c04f2a0 con 0x7f865c09ad40 2023-10-03T10:13:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.897+0000 7f864affd700 1 -- 172.21.15.125:0/1268084571 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f864c003cd0 con 0x7f865c09ad40 2023-10-03T10:13:27.897 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 msgr2=0x7f865c11f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f864c009130 tx=0x7f864c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 shutdown_connections 2023-10-03T10:13:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f865c133f70 0x7f865c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f865c09ad40 0x7f865c11f5f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 --2- 172.21.15.125:0/1268084571 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f865c0a0a70 0x7f865c11fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 >> 172.21.15.125:0/1268084571 conn(0x7f865c099c40 msgr2=0x7f865c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 shutdown_connections 2023-10-03T10:13:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:27.899+0000 7f8660c92700 1 -- 172.21.15.125:0/1268084571 wait complete. 2023-10-03T10:13:27.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:28.451 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:28.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.576+0000 7fd5cf68d700 1 Processor -- start 2023-10-03T10:13:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 -- start start 2023-10-03T10:13:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c8133f50 0x7fd5c81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c809e9d0 con 0x7fd5c8133f50 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c809dc00 con 0x7fd5c80a1380 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cf68d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c809dec0 con 0x7fd5c80a0a70 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5ccc28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cdc2a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c8133f50 0x7fd5c81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cd429700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cdc2a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c8133f50 0x7fd5c81343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57718/0 (socket says 172.21.15.125:57718) 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5ccc28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56504/0 (socket says 172.21.15.125:56504) 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.577+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/4291877932 learned_addr learned my addr 172.21.15.125:0/4291877932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 msgr2=0x7fd5c80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 msgr2=0x7fd5c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/4291877932 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c809e6a0 con 0x7fd5c8133f50 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5ccc28700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cd429700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c8133f50 0x7fd5c81343f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e50 tx=0x7fd5c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208147898cfaaee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5bffff700 1 -- 172.21.15.125:0/4291877932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000e070 con 0x7fd5c8133f50 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5bffff700 1 -- 172.21.15.125:0/4291877932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000b910 con 0x7fd5c8133f50 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5bffff700 1 -- 172.21.15.125:0/4291877932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000bcc0 con 0x7fd5c8133f50 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.578+0000 7fd5cf68d700 1 -- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c8133f50 msgr2=0x7fd5c81343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c8133f50 0x7fd5c81343f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e50 tx=0x7fd5c000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 -- 172.21.15.125:0/4291877932 shutdown_connections 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c8133f50 0x7fd5c81343f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/4291877932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c80a1380 0x7fd5c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 -- 172.21.15.125:0/4291877932 >> 172.21.15.125:0/4291877932 conn(0x7fd5c80a6610 msgr2=0x7fd5c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 -- 172.21.15.125:0/4291877932 shutdown_connections 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.579+0000 7fd5cf68d700 1 -- 172.21.15.125:0/4291877932 wait complete. 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.580+0000 7fd5cf68d700 1 Processor -- start 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.580+0000 7fd5cf68d700 1 -- start start 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c8121400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 0x7fd5c8121940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8124b40 con 0x7fd5c80a1380 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81227f0 con 0x7fd5c8133f50 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80a50b0 con 0x7fd5c80a0a70 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cd429700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c8121400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5ccc28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 0x7fd5c8121940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56514/0 (socket says 172.21.15.125:56514) 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/1257932216 learned_addr learned my addr 172.21.15.125:0/1257932216 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 msgr2=0x7fd5c8121400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c8121400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 msgr2=0x7fd5c8121940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 0x7fd5c8121940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 -- 172.21.15.125:0/1257932216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40094a0 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5ccc28700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 0x7fd5c8121940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cd429700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c8121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cdc2a700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5c809eb10 tx=0x7fd5c0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0004450 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00045f0 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b80094a0 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.581+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00099b0 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.582+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c0009b30 con 0x7fd5c8133f50 2023-10-03T10:13:28.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.582+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5c001c410 con 0x7fd5c8133f50 2023-10-03T10:13:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.583+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5c0041020 con 0x7fd5c8133f50 2023-10-03T10:13:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.583+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c80a0440 con 0x7fd5c8133f50 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.588+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5c000ce80 con 0x7fd5c8133f50 2023-10-03T10:13:28.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.625+0000 7f76a1110700 1 Processor -- start 2023-10-03T10:13:28.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.625+0000 7f76a1110700 1 -- start start 2023-10-03T10:13:28.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f76a1110700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f76a1110700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f76a1110700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c09dc00 con 0x7f769c133f50 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f76a1110700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09ea60 con 0x7f769c0a1380 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f76a1110700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09dec0 con 0x7f769c0a0a70 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56520/0 (socket says 172.21.15.125:56520) 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 -- 172.21.15.125:0/3856929026 learned_addr learned my addr 172.21.15.125:0/3856929026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34440/0 (socket says 172.21.15.125:34440) 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f7699d9b700 1 -- 172.21.15.125:0/3856929026 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498901539 0 0) 0x7f769c09dc00 con 0x7f769c133f50 2023-10-03T10:13:28.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 -- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 msgr2=0x7f769c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 -- 172.21.15.125:0/3856929026 >> v1:172.21.15.125:6789/0 conn(0x7f769c133f50 legacy=0x7f769c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 -- 172.21.15.125:0/3856929026 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c09e6a0 con 0x7f769c0a1380 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769ad9d700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f769a59c700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7690009920 tx=0x7f7690009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830c405ca67c4234 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.626+0000 7f7699d9b700 1 -- 172.21.15.125:0/3856929026 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690011830 con 0x7f769c0a1380 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f7699d9b700 1 -- 172.21.15.125:0/3856929026 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690011990 con 0x7f769c0a1380 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f7699d9b700 1 -- 172.21.15.125:0/3856929026 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690011d20 con 0x7f769c0a1380 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 -- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 msgr2=0x7f769c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7690009920 tx=0x7f7690009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 -- 172.21.15.125:0/3856929026 shutdown_connections 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a0a70 0x7f769c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 --2- 172.21.15.125:0/3856929026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a1380 0x7f769c133a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 -- 172.21.15.125:0/3856929026 >> 172.21.15.125:0/3856929026 conn(0x7f769c0a6610 msgr2=0x7f769c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 -- 172.21.15.125:0/3856929026 shutdown_connections 2023-10-03T10:13:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.627+0000 7f76a1110700 1 -- 172.21.15.125:0/3856929026 wait complete. 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.628+0000 7f76a1110700 1 Processor -- start 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.628+0000 7f76a1110700 1 -- start start 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 0x7f769c123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c122fd0 con 0x7f769c133f50 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c125340 con 0x7f769c0a0a70 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76a1110700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c126040 con 0x7f769c0a1380 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56536/0 (socket says 172.21.15.125:56536) 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57734/0 (socket says 172.21.15.125:57734) 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 -- 172.21.15.125:0/3112582153 learned_addr learned my addr 172.21.15.125:0/3112582153 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769a59c700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 0x7f769c123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 -- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 msgr2=0x7f769c123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 0x7f769c123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 -- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 msgr2=0x7f769c1c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 -- 172.21.15.125:0/3112582153 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0094a0 con 0x7f769c0a0a70 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769b59e700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769a59c700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 0x7f769c123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f769ad9d700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f768c00ec10 tx=0x7f768c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.629+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00c850 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.630+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c00c9b0 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.630+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7690009550 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.630+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00cd20 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.630+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c1246d0 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.630+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f768c013470 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.631+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f768c03f780 con 0x7f769c0a0a70 2023-10-03T10:13:28.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.631+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c04f2a0 con 0x7f769c0a0a70 2023-10-03T10:13:28.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.635+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f768c013720 con 0x7f769c0a0a70 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.789+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5c804f2a0 con 0x7fd5c8133f50 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.789+0000 7fd5bdffb700 1 -- 172.21.15.125:0/1257932216 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5c0011ce0 con 0x7fd5c8133f50 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 msgr2=0x7fd5c8121e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5c809eb10 tx=0x7fd5c0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 shutdown_connections 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5c8133f50 0x7fd5c8121e80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5c80a0a70 0x7fd5c8121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 --2- 172.21.15.125:0/1257932216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80a1380 0x7fd5c8121940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 >> 172.21.15.125:0/1257932216 conn(0x7fd5c80a6610 msgr2=0x7fd5c809bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 shutdown_connections 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.792+0000 7fd5cf68d700 1 -- 172.21.15.125:0/1257932216 wait complete. 2023-10-03T10:13:28.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.826+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f769c126260 con 0x7f769c0a0a70 2023-10-03T10:13:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.826+0000 7f76837fe700 1 -- 172.21.15.125:0/3112582153 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f768c021020 con 0x7f769c0a0a70 2023-10-03T10:13:28.827 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 msgr2=0x7f769c123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f768c00ec10 tx=0x7f768c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 shutdown_connections 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769c133f50 0x7f769c1c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f769c0a0a70 0x7f769c123350 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 --2- 172.21.15.125:0/3112582153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f769c0a1380 0x7f769c123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 >> 172.21.15.125:0/3112582153 conn(0x7f769c0a6610 msgr2=0x7f769c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 shutdown_connections 2023-10-03T10:13:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:28.829+0000 7f76a1110700 1 -- 172.21.15.125:0/3112582153 wait complete. 2023-10-03T10:13:28.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:28.872 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:28.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:29.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.006+0000 7f3f46bd0700 1 Processor -- start 2023-10-03T10:13:29.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.006+0000 7f3f46bd0700 1 -- start start 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f46bd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f46bd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f46bd0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4009b110 con 0x7f3f400a0a70 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f46bd0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400a3b60 con 0x7f3f4009ad40 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f46bd0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401348e0 con 0x7f3f40133f70 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34460/0 (socket says 172.21.15.125:34460) 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f3ffff700 1 -- 172.21.15.125:0/3248941538 learned_addr learned my addr 172.21.15.125:0/3248941538 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56540/0 (socket says 172.21.15.125:56540) 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4516d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3f400a0a70 0x7f3f400a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56788/0 (socket says 172.21.15.125:56788) 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f3f7fe700 1 -- 172.21.15.125:0/3248941538 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277309409 0 0) 0x7f3f4009b110 con 0x7f3f400a0a70 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 -- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 msgr2=0x7f3f401343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 --2- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 -- 172.21.15.125:0/3248941538 >> v1:172.21.15.125:6789/0 conn(0x7f3f400a0a70 legacy=0x7f3f400a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 -- 172.21.15.125:0/3248941538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400a2fa0 con 0x7f3f4009ad40 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.007+0000 7f3f4496c700 1 --2- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d5844ffa6ef457 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f3f7fe700 1 -- 172.21.15.125:0/3248941538 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011830 con 0x7f3f4009ad40 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f3f7fe700 1 -- 172.21.15.125:0/3248941538 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34011990 con 0x7f3f4009ad40 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f3f7fe700 1 -- 172.21.15.125:0/3248941538 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011d20 con 0x7f3f4009ad40 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 -- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 msgr2=0x7f3f40133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f34009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 -- 172.21.15.125:0/3248941538 shutdown_connections 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f4009ad40 0x7f3f40133a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/3248941538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 -- 172.21.15.125:0/3248941538 >> 172.21.15.125:0/3248941538 conn(0x7f3f40099c40 msgr2=0x7f3f4006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 -- 172.21.15.125:0/3248941538 shutdown_connections 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.008+0000 7f3f46bd0700 1 -- 172.21.15.125:0/3248941538 wait complete. 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.009+0000 7f3f46bd0700 1 Processor -- start 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.009+0000 7f3f46bd0700 1 -- start start 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40122580 con 0x7f3f4009ad40 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40122760 con 0x7f3f400a0a70 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f46bd0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401335d0 con 0x7f3f40133f70 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4496c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4496c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57736/0 (socket says 172.21.15.125:57736) 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56554/0 (socket says 172.21.15.125:56554) 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4496c700 1 -- 172.21.15.125:0/248254481 learned_addr learned my addr 172.21.15.125:0/248254481 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 -- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 msgr2=0x7f3f4011fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 -- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 msgr2=0x7f3f4011f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 -- 172.21.15.125:0/248254481 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340094a0 con 0x7f3f40133f70 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f3ffff700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4496c700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.010+0000 7f3f4516d700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401c82a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800cc10 tx=0x7f3f3800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800aa00 con 0x7f3f40133f70 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800ab80 con 0x7f3f40133f70 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4011f100 con 0x7f3f40133f70 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380070d0 con 0x7f3f40133f70 2023-10-03T10:13:29.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40121040 con 0x7f3f40133f70 2023-10-03T10:13:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.011+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f38007230 con 0x7f3f40133f70 2023-10-03T10:13:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.012+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f3803f3c0 con 0x7f3f40133f70 2023-10-03T10:13:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.012+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4004f2a0 con 0x7f3f40133f70 2023-10-03T10:13:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.016+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f38018020 con 0x7f3f40133f70 2023-10-03T10:13:29.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.049+0000 7f314ec9c700 1 Processor -- start 2023-10-03T10:13:29.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.049+0000 7f314ec9c700 1 -- start start 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ec9c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 0x7f31480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ec9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 0x7f314813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ec9c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314809dc00 con 0x7f31480a1380 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ec9c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314809ea90 con 0x7f31480a0a70 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ec9c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314809dec0 con 0x7f3148134120 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ca38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 0x7f31480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 0x7f314813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f3147fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f31480a1380 0x7f3148133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56796/0 (socket says 172.21.15.125:56796) 2023-10-03T10:13:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314ca38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 0x7f31480a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57748/0 (socket says 172.21.15.125:57748) 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f3147fff700 1 -- 172.21.15.125:0/4043721273 learned_addr learned my addr 172.21.15.125:0/4043721273 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 -- 172.21.15.125:0/4043721273 >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 msgr2=0x7f31480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 --2- 172.21.15.125:0/4043721273 >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 0x7f31480a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 -- 172.21.15.125:0/4043721273 >> v1:172.21.15.125:6789/0 conn(0x7f31480a1380 legacy=0x7f3148133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 -- 172.21.15.125:0/4043721273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314809e6a0 con 0x7f3148134120 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.050+0000 7f314d239700 1 --2- 172.21.15.125:0/4043721273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 0x7f314813bce0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3140009d90 tx=0x7f314000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711fceb379f956ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f31477fe700 1 -- 172.21.15.125:0/4043721273 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000e070 con 0x7f3148134120 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f31477fe700 1 -- 172.21.15.125:0/4043721273 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000bb20 con 0x7f3148134120 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f31477fe700 1 -- 172.21.15.125:0/4043721273 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140012430 con 0x7f3148134120 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 -- 172.21.15.125:0/4043721273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 msgr2=0x7f314813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 --2- 172.21.15.125:0/4043721273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 0x7f314813bce0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3140009d90 tx=0x7f314000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 -- 172.21.15.125:0/4043721273 shutdown_connections 2023-10-03T10:13:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 --2- 172.21.15.125:0/4043721273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3148134120 0x7f314813bce0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 --2- 172.21.15.125:0/4043721273 >> v2:172.21.15.125:3300/0 conn(0x7f31480a0a70 0x7f31480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 -- 172.21.15.125:0/4043721273 >> 172.21.15.125:0/4043721273 conn(0x7f31480a6610 msgr2=0x7f31480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 -- 172.21.15.125:0/4043721273 shutdown_connections 2023-10-03T10:13:29.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.051+0000 7f314ec9c700 1 -- 172.21.15.125:0/4043721273 wait complete. 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.052+0000 7f314ec9c700 1 Processor -- start 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.052+0000 7f314ec9c700 1 -- start start 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31480a1380 0x7f3148122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148126160 con 0x7f3148134120 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3148126340 con 0x7f31480a0a70 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ec9c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3148125da0 con 0x7f31480a1380 2023-10-03T10:13:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ca38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ca38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56562/0 (socket says 172.21.15.125:56562) 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57760/0 (socket says 172.21.15.125:57760) 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ca38700 1 -- 172.21.15.125:0/2282426502 learned_addr learned my addr 172.21.15.125:0/2282426502 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f3147fff700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31480a1380 0x7f3148122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 -- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31480a1380 msgr2=0x7f3148122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31480a1380 0x7f3148122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 -- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 msgr2=0x7f3148122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 -- 172.21.15.125:0/2282426502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140009a70 con 0x7f3148134120 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314ca38700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f314d239700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f314809ff60 tx=0x7f3140004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.053+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140012430 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.054+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140020070 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.054+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31480a03e0 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.054+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31400098f0 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.054+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31481339b0 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.054+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3140004040 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.055+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3140022070 con 0x7f3148134120 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.055+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314804f2a0 con 0x7f3148134120 2023-10-03T10:13:29.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.059+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f314001a970 con 0x7f3148134120 2023-10-03T10:13:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.209+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f40120090 con 0x7f3f40133f70 2023-10-03T10:13:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.209+0000 7f3f3d7fa700 1 -- 172.21.15.125:0/248254481 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f380074e0 con 0x7f3f40133f70 2023-10-03T10:13:29.210 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 msgr2=0x7f3f401c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401c82a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800cc10 tx=0x7f3f3800cf20 comp rx=0 tx=0).stop 2023-10-03T10:13:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 shutdown_connections 2023-10-03T10:13:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f40133f70 0x7f3f401c82a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f4009ad40 0x7f3f4011f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 --2- 172.21.15.125:0/248254481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f400a0a70 0x7f3f4011fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.211+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 >> 172.21.15.125:0/248254481 conn(0x7f3f40099c40 msgr2=0x7f3f401bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.212+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 shutdown_connections 2023-10-03T10:13:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.212+0000 7f3f46bd0700 1 -- 172.21.15.125:0/248254481 wait complete. 2023-10-03T10:13:29.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.251+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3148072980 con 0x7f3148134120 2023-10-03T10:13:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.252+0000 7f31457fa700 1 -- 172.21.15.125:0/2282426502 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3140041080 con 0x7f3148134120 2023-10-03T10:13:29.252 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 msgr2=0x7f31481232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f314809ff60 tx=0x7f3140004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 shutdown_connections 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3148134120 0x7f31481232a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31480a0a70 0x7f3148122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 --2- 172.21.15.125:0/2282426502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f31480a1380 0x7f3148122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 >> 172.21.15.125:0/2282426502 conn(0x7f31480a6610 msgr2=0x7f31480a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 shutdown_connections 2023-10-03T10:13:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.254+0000 7f314ec9c700 1 -- 172.21.15.125:0/2282426502 wait complete. 2023-10-03T10:13:29.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:29.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:29.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:29.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.931+0000 7f400b422700 1 Processor -- start 2023-10-03T10:13:29.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.931+0000 7f400b422700 1 -- start start 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f400b422700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 0x7f40040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f400b422700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f400b422700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400409dc00 con 0x7f40040a1380 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f400b422700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400409ea60 con 0x7f4004134120 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f400b422700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400409dec0 con 0x7f40040a0a70 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40099bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40091be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 0x7f40040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40089bd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f40040a1380 0x7f4004133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56804/0 (socket says 172.21.15.125:56804) 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40089bd700 1 -- 172.21.15.125:0/1647181654 learned_addr learned my addr 172.21.15.125:0/1647181654 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40099bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57772/0 (socket says 172.21.15.125:57772) 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40091be700 1 -- 172.21.15.125:0/1647181654 >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 msgr2=0x7f400413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40091be700 1 --2- 172.21.15.125:0/1647181654 >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40091be700 1 -- 172.21.15.125:0/1647181654 >> v1:172.21.15.125:6789/0 conn(0x7f40040a1380 legacy=0x7f4004133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40091be700 1 -- 172.21.15.125:0/1647181654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400409e6a0 con 0x7f40040a0a70 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f3ffbfff700 1 -- 172.21.15.125:0/1647181654 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655606061 0 0) 0x7f400409dc00 con 0x7f40040a1380 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.932+0000 7f40099bf700 1 --2- 172.21.15.125:0/1647181654 >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f40091be700 1 --2- 172.21.15.125:0/1647181654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 0x7f40040a0e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4000009840 tx=0x7f4000009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b268159cd543895 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f3ffbfff700 1 -- 172.21.15.125:0/1647181654 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011830 con 0x7f40040a0a70 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f3ffbfff700 1 -- 172.21.15.125:0/1647181654 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4000011990 con 0x7f40040a0a70 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f3ffbfff700 1 -- 172.21.15.125:0/1647181654 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011d20 con 0x7f40040a0a70 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 -- 172.21.15.125:0/1647181654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 msgr2=0x7f40040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 --2- 172.21.15.125:0/1647181654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 0x7f40040a0e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4000009840 tx=0x7f4000009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 -- 172.21.15.125:0/1647181654 shutdown_connections 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 --2- 172.21.15.125:0/1647181654 >> v2:172.21.15.125:3300/0 conn(0x7f4004134120 0x7f400413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 --2- 172.21.15.125:0/1647181654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a0a70 0x7f40040a0e40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.933+0000 7f400b422700 1 -- 172.21.15.125:0/1647181654 >> 172.21.15.125:0/1647181654 conn(0x7f40040a6610 msgr2=0x7f40040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.934+0000 7f400b422700 1 -- 172.21.15.125:0/1647181654 shutdown_connections 2023-10-03T10:13:29.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.934+0000 7f400b422700 1 -- 172.21.15.125:0/1647181654 wait complete. 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.934+0000 7f400b422700 1 Processor -- start 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.934+0000 7f400b422700 1 -- start start 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 0x7f4004122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4004134120 0x7f4004123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4004133300 con 0x7f4004134120 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4004125aa0 con 0x7f40040a1380 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f400b422700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4004133650 con 0x7f40040a0a70 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40091be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 0x7f4004122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40091be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34496/0 (socket says 172.21.15.125:34496) 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40091be700 1 -- 172.21.15.125:0/4022681612 learned_addr learned my addr 172.21.15.125:0/4022681612 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40099bf700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4004134120 0x7f4004123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 -- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 msgr2=0x7f4004122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 -- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4004134120 msgr2=0x7f4004123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4004134120 0x7f4004123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 -- 172.21.15.125:0/4022681612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009a70 con 0x7f40040a1380 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40091be700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.935+0000 7f40089bd700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 0x7f4004122cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40040a2b70 tx=0x7f3ff400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.936+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4004c80 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.936+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4004de0 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.936+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000094a0 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.936+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4007310 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.936+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40041269b0 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.937+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ff4007470 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.937+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ff403f1c0 con 0x7f40040a1380 2023-10-03T10:13:29.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.937+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400404f2a0 con 0x7f40040a1380 2023-10-03T10:13:29.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.942+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ff4007720 con 0x7f40040a1380 2023-10-03T10:13:29.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.972+0000 7f4f9b984700 1 Processor -- start 2023-10-03T10:13:29.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 -- start start 2023-10-03T10:13:29.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 0x7f4f9413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9406b2d0 con 0x7f4f941300a0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94133610 con 0x7f4f94133ad0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f9b984700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9409a500 con 0x7f4f94130bc0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99720700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99f21700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 0x7f4f9413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99720700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56590/0 (socket says 172.21.15.125:56590) 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f98f1f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f941300a0 0x7f4f941304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56814/0 (socket says 172.21.15.125:56814) 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99720700 1 -- 172.21.15.125:0/3787247635 learned_addr learned my addr 172.21.15.125:0/3787247635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f8bfff700 1 -- 172.21.15.125:0/3787247635 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491217424 0 0) 0x7f4f9406b2d0 con 0x7f4f941300a0 2023-10-03T10:13:29.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99720700 1 -- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 msgr2=0x7f4f9413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.973+0000 7f4f99720700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 0x7f4f9413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f99720700 1 -- 172.21.15.125:0/3787247635 >> v1:172.21.15.125:6789/0 conn(0x7f4f941300a0 legacy=0x7f4f941304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f99720700 1 -- 172.21.15.125:0/3787247635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f941338b0 con 0x7f4f94133ad0 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f99f21700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 0x7f4f9413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f99720700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009920 tx=0x7f4f90009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fddceefcf02c62ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f8bfff700 1 -- 172.21.15.125:0/3787247635 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011830 con 0x7f4f94133ad0 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f8bfff700 1 -- 172.21.15.125:0/3787247635 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90011990 con 0x7f4f94133ad0 2023-10-03T10:13:29.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f8bfff700 1 -- 172.21.15.125:0/3787247635 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011d20 con 0x7f4f94133ad0 2023-10-03T10:13:29.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 -- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 msgr2=0x7f4f94133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009920 tx=0x7f4f90009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 -- 172.21.15.125:0/3787247635 shutdown_connections 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94130bc0 0x7f4f9413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 --2- 172.21.15.125:0/3787247635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94133ad0 0x7f4f94133ea0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 -- 172.21.15.125:0/3787247635 >> 172.21.15.125:0/3787247635 conn(0x7f4f94099c40 msgr2=0x7f4f940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.974+0000 7f4f9b984700 1 -- 172.21.15.125:0/3787247635 shutdown_connections 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.975+0000 7f4f9b984700 1 -- 172.21.15.125:0/3787247635 wait complete. 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.975+0000 7f4f9b984700 1 Processor -- start 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.975+0000 7f4f9b984700 1 -- start start 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f941300a0 0x7f4f9411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 0x7f4f9411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9411f080 con 0x7f4f941300a0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941200c0 con 0x7f4f94130bc0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f9b984700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9411fb20 con 0x7f4f94133ad0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f98f1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 0x7f4f9411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f98f1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56594/0 (socket says 172.21.15.125:56594) 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f98f1f700 1 -- 172.21.15.125:0/830791514 learned_addr learned my addr 172.21.15.125:0/830791514 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99720700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f941300a0 0x7f4f9411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 -- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 msgr2=0x7f4f9411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 -- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f941300a0 msgr2=0x7f4f9411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f941300a0 0x7f4f9411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 -- 172.21.15.125:0/830791514 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009a70 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f98f1f700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f99f21700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 0x7f4f9411e4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00efc0 tx=0x7f4f8c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00ca90 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.976+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00f040 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.977+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f90009550 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.977+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00ce30 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.977+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9411f8a0 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.977+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f8c014480 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.978+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f8c03fbd0 con 0x7f4f94133ad0 2023-10-03T10:13:29.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.978+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9404f2a0 con 0x7f4f94133ad0 2023-10-03T10:13:29.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:29.982+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f8c012930 con 0x7f4f94133ad0 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.137+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4004072980 con 0x7f40040a1380 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.138+0000 7f3ff9ffb700 1 -- 172.21.15.125:0/4022681612 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ff401b7b0 con 0x7f40040a1380 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 msgr2=0x7f4004122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 0x7f4004122cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40040a2b70 tx=0x7f3ff400c750 comp rx=0 tx=0).stop 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 shutdown_connections 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4004134120 0x7f4004123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40040a0a70 0x7f4004122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 --2- 172.21.15.125:0/4022681612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40040a1380 0x7f4004122cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 >> 172.21.15.125:0/4022681612 conn(0x7f40040a6610 msgr2=0x7f40040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 shutdown_connections 2023-10-03T10:13:30.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.140+0000 7f400b422700 1 -- 172.21.15.125:0/4022681612 wait complete. 2023-10-03T10:13:30.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.178+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f9412d970 con 0x7f4f94133ad0 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.178+0000 7f4f89ffb700 1 -- 172.21.15.125:0/830791514 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f8c012340 con 0x7f4f94133ad0 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.180+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 msgr2=0x7f4f9411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.180+0000 7f4f9b984700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 0x7f4f9411e4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00efc0 tx=0x7f4f8c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.180+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 shutdown_connections 2023-10-03T10:13:30.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f94133ad0 0x7f4f9411e4c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f941300a0 0x7f4f9411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 --2- 172.21.15.125:0/830791514 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f94130bc0 0x7f4f9411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 >> 172.21.15.125:0/830791514 conn(0x7f4f94099c40 msgr2=0x7f4f94132070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 shutdown_connections 2023-10-03T10:13:30.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.181+0000 7f4f9b984700 1 -- 172.21.15.125:0/830791514 wait complete. 2023-10-03T10:13:30.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:30.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:30.266 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.358+0000 7f1f10568700 1 Processor -- start 2023-10-03T10:13:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.358+0000 7f1f10568700 1 -- start start 2023-10-03T10:13:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f10568700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f080a0a70 0x7f1f080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f10568700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f0813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f10568700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0809dc00 con 0x7f1f080a1380 2023-10-03T10:13:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f10568700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0809ea90 con 0x7f1f080a0a70 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f10568700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0809dec0 con 0x7f1f08134120 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f080a0a70 0x7f1f080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0eb05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f0813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f080a0a70 0x7f1f080a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57792/0 (socket says 172.21.15.125:57792) 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 -- 172.21.15.125:0/2980214704 learned_addr learned my addr 172.21.15.125:0/2980214704 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 -- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 msgr2=0x7f1f0813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f0813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 -- 172.21.15.125:0/2980214704 >> v1:172.21.15.125:6789/0 conn(0x7f1f080a1380 legacy=0x7f1f08133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0e304700 1 -- 172.21.15.125:0/2980214704 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0809e6a0 con 0x7f1f080a0a70 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0d302700 1 -- 172.21.15.125:0/2980214704 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697029304 0 0) 0x7f1f0809dc00 con 0x7f1f080a1380 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.359+0000 7f1f0eb05700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f0813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f0e304700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a0a70 0x7f1f080a0e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098f0 tx=0x7f1f04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2374b91e7a78c5fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f0d302700 1 -- 172.21.15.125:0/2980214704 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04011830 con 0x7f1f080a0a70 2023-10-03T10:13:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f0d302700 1 -- 172.21.15.125:0/2980214704 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f04011990 con 0x7f1f080a0a70 2023-10-03T10:13:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f0d302700 1 -- 172.21.15.125:0/2980214704 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04011d20 con 0x7f1f080a0a70 2023-10-03T10:13:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 -- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a0a70 msgr2=0x7f1f080a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a0a70 0x7f1f080a0e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098f0 tx=0x7f1f04009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 -- 172.21.15.125:0/2980214704 shutdown_connections 2023-10-03T10:13:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f0813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 --2- 172.21.15.125:0/2980214704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a0a70 0x7f1f080a0e40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.360+0000 7f1f10568700 1 -- 172.21.15.125:0/2980214704 >> 172.21.15.125:0/2980214704 conn(0x7f1f080a6610 msgr2=0x7f1f080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.361+0000 7f1f10568700 1 -- 172.21.15.125:0/2980214704 shutdown_connections 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.361+0000 7f1f10568700 1 -- 172.21.15.125:0/2980214704 wait complete. 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.361+0000 7f1f10568700 1 Processor -- start 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.361+0000 7f1f10568700 1 -- start start 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 0x7f1f08122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f08123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08133300 con 0x7f1f080a1380 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08125920 con 0x7f1f08134120 2023-10-03T10:13:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f10568700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08124310 con 0x7f1f080a0a70 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0eb05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f08123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 0x7f1f08122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0e304700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0eb05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f08123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56612/0 (socket says 172.21.15.125:56612) 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0e304700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34522/0 (socket says 172.21.15.125:34522) 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0eb05700 1 -- 172.21.15.125:0/2346477318 learned_addr learned my addr 172.21.15.125:0/2346477318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 -- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 msgr2=0x7f1f08122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 -- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 msgr2=0x7f1f08123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f08123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 -- 172.21.15.125:0/2346477318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f00009a70 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0e304700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.362+0000 7f1f0db03700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 0x7f1f08122c40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c430 tx=0x7f1ef800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef80054e0 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800ce40 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f04009550 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef80038c0 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08125c80 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ef8003a20 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.363+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ef803e9f0 con 0x7f1f080a1380 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.364+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0804f2a0 con 0x7f1f080a1380 2023-10-03T10:13:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.368+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ef8017080 con 0x7f1f080a1380 2023-10-03T10:13:30.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.400+0000 7f9763ac8700 1 Processor -- start 2023-10-03T10:13:30.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 -- start start 2023-10-03T10:13:30.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 0x7f975c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0a0920 con 0x7f975c09e870 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c09c970 con 0x7f975c131d70 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9763ac8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f975c09bab0 con 0x7f975c09f180 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9761864700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9761063700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9762065700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 0x7f975c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9761864700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57814/0 (socket says 172.21.15.125:57814) 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9761063700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34526/0 (socket says 172.21.15.125:34526) 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.401+0000 7f9761864700 1 -- 172.21.15.125:0/2604946270 learned_addr learned my addr 172.21.15.125:0/2604946270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 -- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 msgr2=0x7f975c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 -- 172.21.15.125:0/2604946270 >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 msgr2=0x7f975c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 --2- 172.21.15.125:0/2604946270 >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 -- 172.21.15.125:0/2604946270 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c09f9c0 con 0x7f975c131d70 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9761864700 1 --2- 172.21.15.125:0/2604946270 >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9761063700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9762065700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 0x7f975c1321f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9754009dc0 tx=0x7f975400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=425d3ecde6189a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9760862700 1 -- 172.21.15.125:0/2604946270 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400e070 con 0x7f975c131d70 2023-10-03T10:13:30.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9760862700 1 -- 172.21.15.125:0/2604946270 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400bae0 con 0x7f975c131d70 2023-10-03T10:13:30.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.402+0000 7f9760862700 1 -- 172.21.15.125:0/2604946270 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400be90 con 0x7f975c131d70 2023-10-03T10:13:30.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 -- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 msgr2=0x7f975c1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 0x7f975c1321f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9754009dc0 tx=0x7f975400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 -- 172.21.15.125:0/2604946270 shutdown_connections 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c131d70 0x7f975c1321f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2604946270 >> v2:172.21.15.125:3300/0 conn(0x7f975c09e870 0x7f975c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2604946270 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 -- 172.21.15.125:0/2604946270 >> 172.21.15.125:0/2604946270 conn(0x7f975c0a4430 msgr2=0x7f975c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 -- 172.21.15.125:0/2604946270 shutdown_connections 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.403+0000 7f9763ac8700 1 -- 172.21.15.125:0/2604946270 wait complete. 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 Processor -- start 2023-10-03T10:13:30.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 -- start start 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c1206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f975c131d70 0x7f975c120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c123cd0 con 0x7f975c131d70 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1237c0 con 0x7f975c09e870 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9763ac8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f975c122c50 con 0x7f975c09f180 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56634/0 (socket says 172.21.15.125:56634) 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 -- 172.21.15.125:0/2813246930 learned_addr learned my addr 172.21.15.125:0/2813246930 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:30.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9762065700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f975c131d70 0x7f975c120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761063700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c1206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 -- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 msgr2=0x7f975c1206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c1206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 -- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f975c131d70 msgr2=0x7f975c120c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f975c131d70 0x7f975c120c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.404+0000 7f9761864700 1 -- 172.21.15.125:0/2813246930 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758009550 con 0x7f975c09e870 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f9761864700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f975800ebe0 tx=0x7f975800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758004030 con 0x7f975c09e870 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758004190 con 0x7f975c09e870 2023-10-03T10:13:30.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c0094a0 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758004520 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9754009a70 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.405+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f975800c850 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.406+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c04f2a0 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.406+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f975803f9b0 con 0x7f975c09e870 2023-10-03T10:13:30.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.410+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97580036a0 con 0x7f975c09e870 2023-10-03T10:13:30.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.566+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f08072980 con 0x7f1f080a1380 2023-10-03T10:13:30.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.566+0000 7f1efeffd700 1 -- 172.21.15.125:0/2346477318 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ef8019b20 con 0x7f1f080a1380 2023-10-03T10:13:30.567 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 msgr2=0x7f1f08122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 0x7f1f08122c40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c430 tx=0x7f1ef800c740 comp rx=0 tx=0).stop 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 shutdown_connections 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f08134120 0x7f1f08123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f080a0a70 0x7f1f08122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 --2- 172.21.15.125:0/2346477318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f080a1380 0x7f1f08122c40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 >> 172.21.15.125:0/2346477318 conn(0x7f1f080a6610 msgr2=0x7f1f080a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 shutdown_connections 2023-10-03T10:13:30.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.568+0000 7f1f10568700 1 -- 172.21.15.125:0/2346477318 wait complete. 2023-10-03T10:13:30.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:30.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.602+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f975c131b50 con 0x7f975c09e870 2023-10-03T10:13:30.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.603+0000 7f97527fc700 1 -- 172.21.15.125:0/2813246930 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9758013e60 con 0x7f975c09e870 2023-10-03T10:13:30.603 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:30.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 msgr2=0x7f975c1201b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f975800ebe0 tx=0x7f975800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 shutdown_connections 2023-10-03T10:13:30.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f975c131d70 0x7f975c120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975c09e870 0x7f975c1201b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 --2- 172.21.15.125:0/2813246930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f975c09f180 0x7f975c1206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 >> 172.21.15.125:0/2813246930 conn(0x7f975c0a4430 msgr2=0x7f975c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 shutdown_connections 2023-10-03T10:13:30.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:30.605+0000 7f9763ac8700 1 -- 172.21.15.125:0/2813246930 wait complete. 2023-10-03T10:13:30.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:31.153 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:31.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:31.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.294+0000 7f5f16fc4700 1 Processor -- start 2023-10-03T10:13:31.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.294+0000 7f5f16fc4700 1 -- start start 2023-10-03T10:13:31.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f16fc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 0x7f5f100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f16fc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 0x7f5f101381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f16fc4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100a1e70 con 0x7f5f100a1340 2023-10-03T10:13:31.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f16fc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1009a720 con 0x7f5f100a0a30 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f16fc4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1009b300 con 0x7f5f10130670 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f14d60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 0x7f5f100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f0ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f100a1340 0x7f5f1012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56826/0 (socket says 172.21.15.125:56826) 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f0ffff700 1 -- 172.21.15.125:0/2400277638 learned_addr learned my addr 172.21.15.125:0/2400277638 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f15561700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 0x7f5f101381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f15561700 1 -- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 msgr2=0x7f5f100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f0f7fe700 1 -- 172.21.15.125:0/2400277638 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833124225 0 0) 0x7f5f100a1e70 con 0x7f5f100a1340 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f15561700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 0x7f5f100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f15561700 1 -- 172.21.15.125:0/2400277638 >> v1:172.21.15.125:6789/0 conn(0x7f5f100a1340 legacy=0x7f5f1012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f15561700 1 -- 172.21.15.125:0/2400277638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1009abc0 con 0x7f5f10130670 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.295+0000 7f5f14d60700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 0x7f5f100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f15561700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 0x7f5f101381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009dc0 tx=0x7f5f0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfa8cf28c90aa33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f0f7fe700 1 -- 172.21.15.125:0/2400277638 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800e070 con 0x7f5f10130670 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f0f7fe700 1 -- 172.21.15.125:0/2400277638 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800bb20 con 0x7f5f10130670 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f0f7fe700 1 -- 172.21.15.125:0/2400277638 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08012430 con 0x7f5f10130670 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 -- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 msgr2=0x7f5f101381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 0x7f5f101381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009dc0 tx=0x7f5f0800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 -- 172.21.15.125:0/2400277638 shutdown_connections 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f10130670 0x7f5f101381c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/2400277638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f100a0a30 0x7f5f100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 -- 172.21.15.125:0/2400277638 >> 172.21.15.125:0/2400277638 conn(0x7f5f100a2980 msgr2=0x7f5f100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 -- 172.21.15.125:0/2400277638 shutdown_connections 2023-10-03T10:13:31.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.296+0000 7f5f16fc4700 1 -- 172.21.15.125:0/2400277638 wait complete. 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.297+0000 7f5f16fc4700 1 Processor -- start 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.297+0000 7f5f16fc4700 1 -- start start 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 0x7f5f101c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f10130670 0x7f5f101c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10120a00 con 0x7f5f100a0a30 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1012fe30 con 0x7f5f10130670 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f16fc4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101230c0 con 0x7f5f100a1340 2023-10-03T10:13:31.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 0x7f5f101c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34546/0 (socket says 172.21.15.125:34546) 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f0ffff700 1 -- 172.21.15.125:0/944997653 learned_addr learned my addr 172.21.15.125:0/944997653 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f15561700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f10130670 0x7f5f101c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 -- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 msgr2=0x7f5f101c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 -- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f10130670 msgr2=0x7f5f101c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f10130670 0x7f5f101c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f14d60700 1 -- 172.21.15.125:0/944997653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0400b6d0 con 0x7f5f100a0a30 2023-10-03T10:13:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.298+0000 7f5f0ffff700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f14d60700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 0x7f5f101c8720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400dd20 tx=0x7f5f04009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400de10 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04009b70 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f08009a70 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04005a20 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.299+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f10122300 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.300+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f04005b80 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.300+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1004f2a0 con 0x7f5f100a0a30 2023-10-03T10:13:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.300+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f0400b050 con 0x7f5f100a0a30 2023-10-03T10:13:31.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.305+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f04015310 con 0x7f5f100a0a30 2023-10-03T10:13:31.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.346+0000 7f0cb359e700 1 Processor -- start 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.346+0000 7f0cb359e700 1 -- start start 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0cb406b0a0 0x7f0cb4138590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb409d220 con 0x7f0cb406b0a0 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4071740 con 0x7f0cb4070e30 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb359e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb409ce30 con 0x7f0cb406a770 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0cb406b0a0 0x7f0cb4138590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34560/0 (socket says 172.21.15.125:34560) 2023-10-03T10:13:31.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56676/0 (socket says 172.21.15.125:56676) 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb1d9b700 1 -- 172.21.15.125:0/3294591392 learned_addr learned my addr 172.21.15.125:0/3294591392 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 -- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 msgr2=0x7f0cb406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 -- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 msgr2=0x7f0cb4071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 -- 172.21.15.125:0/3294591392 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb406e730 con 0x7f0cb406b0a0 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb259c700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb1d9b700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.347+0000 7f0cb2d9d700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406b0a0 0x7f0cb4138590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009d90 tx=0x7f0cac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22043b577f9793fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb159a700 1 -- 172.21.15.125:0/3294591392 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00e070 con 0x7f0cb406b0a0 2023-10-03T10:13:31.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb159a700 1 -- 172.21.15.125:0/3294591392 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00bb20 con 0x7f0cb406b0a0 2023-10-03T10:13:31.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb159a700 1 -- 172.21.15.125:0/3294591392 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac012430 con 0x7f0cb406b0a0 2023-10-03T10:13:31.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 -- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406b0a0 msgr2=0x7f0cb4138590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406b0a0 0x7f0cb4138590 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009d90 tx=0x7f0cac00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 -- 172.21.15.125:0/3294591392 shutdown_connections 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406b0a0 0x7f0cb4138590 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 --2- 172.21.15.125:0/3294591392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406a770 0x7f0cb406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 -- 172.21.15.125:0/3294591392 >> 172.21.15.125:0/3294591392 conn(0x7f0cb40a2d80 msgr2=0x7f0cb40a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 -- 172.21.15.125:0/3294591392 shutdown_connections 2023-10-03T10:13:31.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.348+0000 7f0cb359e700 1 -- 172.21.15.125:0/3294591392 wait complete. 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.349+0000 7f0cb359e700 1 Processor -- start 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.349+0000 7f0cb359e700 1 -- start start 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 0x7f0cb41b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 0x7f0cb41b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb41c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41a6070 con 0x7f0cb406a770 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41b7120 con 0x7f0cb4070e30 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb359e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41a43b0 con 0x7f0cb406b0a0 2023-10-03T10:13:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 0x7f0cb41b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 0x7f0cb41b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 0x7f0cb41b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34568/0 (socket says 172.21.15.125:34568) 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb1d9b700 1 -- 172.21.15.125:0/700604761 learned_addr learned my addr 172.21.15.125:0/700604761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb2d9d700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb41c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 -- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 msgr2=0x7f0cb41b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 0x7f0cb41b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 -- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 msgr2=0x7f0cb41c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb41c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 -- 172.21.15.125:0/700604761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4009550 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0cb259c700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 0x7f0cb41b66a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e9b0 tx=0x7f0ca800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800ee50 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.350+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800c850 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800cc00 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80094a0 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac009a70 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca8013470 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb4071950 con 0x7f0cb406a770 2023-10-03T10:13:31.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.351+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ca803f720 con 0x7f0cb406a770 2023-10-03T10:13:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.356+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ca801be10 con 0x7f0cb406a770 2023-10-03T10:13:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.513+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f10071c30 con 0x7f5f100a0a30 2023-10-03T10:13:31.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.513+0000 7f5f0d7fa700 1 -- 172.21.15.125:0/944997653 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f0401eb00 con 0x7f5f100a0a30 2023-10-03T10:13:31.514 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 msgr2=0x7f5f101c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 0x7f5f101c8720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400dd20 tx=0x7f5f04009400 comp rx=0 tx=0).stop 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 shutdown_connections 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f10130670 0x7f5f101c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f100a0a30 0x7f5f101c8720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 --2- 172.21.15.125:0/944997653 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f100a1340 0x7f5f101c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.515+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 >> 172.21.15.125:0/944997653 conn(0x7f5f100a2980 msgr2=0x7f5f101b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.516+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 shutdown_connections 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.516+0000 7f5f16fc4700 1 -- 172.21.15.125:0/944997653 wait complete. 2023-10-03T10:13:31.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.550+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cb404f2a0 con 0x7f0cb406a770 2023-10-03T10:13:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.551+0000 7f0ca2ffd700 1 -- 172.21.15.125:0/700604761 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ca8021070 con 0x7f0cb406a770 2023-10-03T10:13:31.551 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:31.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.552+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 msgr2=0x7f0cb41b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.552+0000 7f0cb359e700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 0x7f0cb41b66a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e9b0 tx=0x7f0ca800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 shutdown_connections 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cb4070e30 0x7f0cb41c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a770 0x7f0cb41b66a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 --2- 172.21.15.125:0/700604761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0cb406b0a0 0x7f0cb41b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 >> 172.21.15.125:0/700604761 conn(0x7f0cb40a2d80 msgr2=0x7f0cb406f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 shutdown_connections 2023-10-03T10:13:31.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.553+0000 7f0cb359e700 1 -- 172.21.15.125:0/700604761 wait complete. 2023-10-03T10:13:31.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:31.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:31.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:31.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.734+0000 7fd6f46ee700 1 Processor -- start 2023-10-03T10:13:31.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.734+0000 7fd6f46ee700 1 -- start start 2023-10-03T10:13:31.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f46ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f46ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 0x7fd6ec13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f46ee700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec06bec0 con 0x7fd6ec09e870 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f46ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec09fdd0 con 0x7fd6ec139410 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f46ee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec06b990 con 0x7fd6ec09f350 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f2c8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 0x7fd6ec13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56694/0 (socket says 172.21.15.125:56694) 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 -- 172.21.15.125:0/479413212 learned_addr learned my addr 172.21.15.125:0/479413212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 -- 172.21.15.125:0/479413212 >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 msgr2=0x7fd6ec13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 --2- 172.21.15.125:0/479413212 >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 0x7fd6ec13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 -- 172.21.15.125:0/479413212 >> v1:172.21.15.125:6789/0 conn(0x7fd6ec09e870 legacy=0x7fd6ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f1c89700 1 -- 172.21.15.125:0/479413212 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0a0870 con 0x7fd6ec09f350 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.735+0000 7fd6f2c8b700 1 --2- 172.21.15.125:0/479413212 >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 0x7fd6ec13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f1c89700 1 --2- 172.21.15.125:0/479413212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009920 tx=0x7fd6dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31541dd4cd955478 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f1488700 1 -- 172.21.15.125:0/479413212 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc011830 con 0x7fd6ec09f350 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f1488700 1 -- 172.21.15.125:0/479413212 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc011990 con 0x7fd6ec09f350 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f1488700 1 -- 172.21.15.125:0/479413212 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc011d20 con 0x7fd6ec09f350 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 -- 172.21.15.125:0/479413212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 msgr2=0x7fd6ec138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/479413212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009920 tx=0x7fd6dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 -- 172.21.15.125:0/479413212 shutdown_connections 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/479413212 >> v2:172.21.15.125:3300/0 conn(0x7fd6ec139410 0x7fd6ec13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/479413212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec09f350 0x7fd6ec138ed0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 -- 172.21.15.125:0/479413212 >> 172.21.15.125:0/479413212 conn(0x7fd6ec0a4430 msgr2=0x7fd6ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 -- 172.21.15.125:0/479413212 shutdown_connections 2023-10-03T10:13:31.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.736+0000 7fd6f46ee700 1 -- 172.21.15.125:0/479413212 wait complete. 2023-10-03T10:13:31.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.737+0000 7fd6f46ee700 1 Processor -- start 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.737+0000 7fd6f46ee700 1 -- start start 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 0x7fd6ec11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 0x7fd6ec11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec133a50 con 0x7fd6ec09e870 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec09e2b0 con 0x7fd6ec139410 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f46ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec121050 con 0x7fd6ec09f350 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56700/0 (socket says 172.21.15.125:56700) 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 -- 172.21.15.125:0/2065369346 learned_addr learned my addr 172.21.15.125:0/2065369346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f1c89700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 0x7fd6ec11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f248a700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 0x7fd6ec11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 -- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 msgr2=0x7fd6ec11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 0x7fd6ec11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 -- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 msgr2=0x7fd6ec11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 0x7fd6ec11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 -- 172.21.15.125:0/2065369346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4009a70 con 0x7fd6ec139410 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f1c89700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 0x7fd6ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f248a700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 0x7fd6ec11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.738+0000 7fd6f2c8b700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400efb0 tx=0x7fd6e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400cc90 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e400f040 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc009550 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4014480 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec121310 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6e40145e0 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.739+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec0a0440 con 0x7fd6ec139410 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.740+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6e4040390 con 0x7fd6ec139410 2023-10-03T10:13:31.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.744+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6e401d400 con 0x7fd6ec139410 2023-10-03T10:13:31.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.777+0000 7fae14f69700 1 Processor -- start 2023-10-03T10:13:31.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.777+0000 7fae14f69700 1 -- start start 2023-10-03T10:13:31.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1009e9d0 con 0x7fae10133f50 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1009dc00 con 0x7fae100a1380 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae14f69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1009dec0 con 0x7fae100a0a70 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34596/0 (socket says 172.21.15.125:34596) 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56714/0 (socket says 172.21.15.125:56714) 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57876/0 (socket says 172.21.15.125:57876) 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 -- 172.21.15.125:0/2399861927 learned_addr learned my addr 172.21.15.125:0/2399861927 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 -- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 msgr2=0x7fae10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 -- 172.21.15.125:0/2399861927 >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 msgr2=0x7fae101343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2399861927 >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 -- 172.21.15.125:0/2399861927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1009e6a0 con 0x7fae100a0a70 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0dd9b700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0ed9d700 1 --2- 172.21.15.125:0/2399861927 >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae000098f0 tx=0x7fae00009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=250ce4ebcedf57e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0d59a700 1 -- 172.21.15.125:0/2399861927 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011830 con 0x7fae100a0a70 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0d59a700 1 -- 172.21.15.125:0/2399861927 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00011990 con 0x7fae100a0a70 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.778+0000 7fae0d59a700 1 -- 172.21.15.125:0/2399861927 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011d20 con 0x7fae100a0a70 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 -- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 msgr2=0x7fae100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae000098f0 tx=0x7fae00009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 -- 172.21.15.125:0/2399861927 shutdown_connections 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 --2- 172.21.15.125:0/2399861927 >> v2:172.21.15.125:3300/0 conn(0x7fae10133f50 0x7fae101343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a0a70 0x7fae100a0e40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 --2- 172.21.15.125:0/2399861927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a1380 0x7fae10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 -- 172.21.15.125:0/2399861927 >> 172.21.15.125:0/2399861927 conn(0x7fae100a6610 msgr2=0x7fae100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 -- 172.21.15.125:0/2399861927 shutdown_connections 2023-10-03T10:13:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.779+0000 7fae14f69700 1 -- 172.21.15.125:0/2399861927 wait complete. 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.780+0000 7fae14f69700 1 Processor -- start 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 -- start start 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a1380 0x7fae10122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 0x7fae10122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10133a90 con 0x7fae10133f50 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae101253a0 con 0x7fae100a0a70 2023-10-03T10:13:31.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae14f69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae10124fe0 con 0x7fae100a1380 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae0e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae0e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56718/0 (socket says 172.21.15.125:56718) 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae0ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 0x7fae10122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae0e59c700 1 -- 172.21.15.125:0/2283242562 learned_addr learned my addr 172.21.15.125:0/2283242562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.781+0000 7fae0dd9b700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a1380 0x7fae10122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 -- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a1380 msgr2=0x7fae10122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a1380 0x7fae10122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 -- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 msgr2=0x7fae10122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 0x7fae10122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 -- 172.21.15.125:0/2283242562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040094a0 con 0x7fae100a0a70 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0ed9d700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 0x7fae10122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae0e59c700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae00000c00 tx=0x7fae00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00004240 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0001f070 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08009a70 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000045c0 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.782+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae00009550 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.783+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae00021030 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.783+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae00040820 con 0x7fae100a0a70 2023-10-03T10:13:31.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.783+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1004f2a0 con 0x7fae100a0a70 2023-10-03T10:13:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.788+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae0001a450 con 0x7fae100a0a70 2023-10-03T10:13:31.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.937+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6ec04f2a0 con 0x7fd6ec139410 2023-10-03T10:13:31.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.938+0000 7fd6e2ffd700 1 -- 172.21.15.125:0/2065369346 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6e401c3b0 con 0x7fd6ec139410 2023-10-03T10:13:31.938 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:31.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 msgr2=0x7fd6ec11f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400efb0 tx=0x7fd6e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 shutdown_connections 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6ec139410 0x7fd6ec11f550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6ec09e870 0x7fd6ec11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 --2- 172.21.15.125:0/2065369346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6ec09f350 0x7fd6ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 >> 172.21.15.125:0/2065369346 conn(0x7fd6ec0a4430 msgr2=0x7fd6ec138550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 shutdown_connections 2023-10-03T10:13:31.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.940+0000 7fd6f46ee700 1 -- 172.21.15.125:0/2065369346 wait complete. 2023-10-03T10:13:31.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:31.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.980+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae100a4830 con 0x7fae100a0a70 2023-10-03T10:13:31.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.980+0000 7fadfeffd700 1 -- 172.21.15.125:0/2283242562 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae000233d0 con 0x7fae100a0a70 2023-10-03T10:13:31.980 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:31.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 msgr2=0x7fae10122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae00000c00 tx=0x7fae00004750 comp rx=0 tx=0).stop 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 shutdown_connections 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae10133f50 0x7fae10122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae100a0a70 0x7fae10122540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 --2- 172.21.15.125:0/2283242562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae100a1380 0x7fae10122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 >> 172.21.15.125:0/2283242562 conn(0x7fae100a6610 msgr2=0x7fae1009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 shutdown_connections 2023-10-03T10:13:31.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:31.982+0000 7fae14f69700 1 -- 172.21.15.125:0/2283242562 wait complete. 2023-10-03T10:13:31.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:32.530 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:32.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 Processor -- start 2023-10-03T10:13:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 -- start start 2023-10-03T10:13:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 0x7f7f28130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2809a540 con 0x7f7f28099920 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2809ad40 con 0x7f7f2812feb0 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.658+0000 7f7f2fc97700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2809e640 con 0x7f7f281307c0 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2d232700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2e234700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 0x7f7f28130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2d232700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34618/0 (socket says 172.21.15.125:34618) 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2e234700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57894/0 (socket says 172.21.15.125:57894) 2023-10-03T10:13:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2d232700 1 -- 172.21.15.125:0/2379517716 learned_addr learned my addr 172.21.15.125:0/2379517716 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 -- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 msgr2=0x7f7f280993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 -- 172.21.15.125:0/2379517716 >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 msgr2=0x7f7f28099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 --2- 172.21.15.125:0/2379517716 >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 -- 172.21.15.125:0/2379517716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2809e3c0 con 0x7f7f2812feb0 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2e234700 1 --2- 172.21.15.125:0/2379517716 >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2d232700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2da33700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 0x7f7f28130280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400dc50 tx=0x7f7f2400df60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80348544ef62e259 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2ca31700 1 -- 172.21.15.125:0/2379517716 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24012070 con 0x7f7f2812feb0 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2ca31700 1 -- 172.21.15.125:0/2379517716 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24006b10 con 0x7f7f2812feb0 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.659+0000 7f7f2ca31700 1 -- 172.21.15.125:0/2379517716 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2400f6b0 con 0x7f7f2812feb0 2023-10-03T10:13:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 msgr2=0x7f7f28130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 0x7f7f28130280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400dc50 tx=0x7f7f2400df60 comp rx=0 tx=0).stop 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2379517716 shutdown_connections 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2812feb0 0x7f7f28130280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2379517716 >> v2:172.21.15.125:3300/0 conn(0x7f7f28099920 0x7f7f28099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2379517716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f281307c0 0x7f7f280993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2379517716 >> 172.21.15.125:0/2379517716 conn(0x7f7f280a2b30 msgr2=0x7f7f2809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2379517716 shutdown_connections 2023-10-03T10:13:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.660+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2379517716 wait complete. 2023-10-03T10:13:32.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.661+0000 7f7f2fc97700 1 Processor -- start 2023-10-03T10:13:32.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.661+0000 7f7f2fc97700 1 -- start start 2023-10-03T10:13:32.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2812feb0 0x7f7f28128aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 0x7f7f28128fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2806f190 con 0x7f7f2812feb0 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2806f390 con 0x7f7f281307c0 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2fc97700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28129f80 con 0x7f7f28099920 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2da33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 0x7f7f28128fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2da33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34634/0 (socket says 172.21.15.125:34634) 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2da33700 1 -- 172.21.15.125:0/2052476676 learned_addr learned my addr 172.21.15.125:0/2052476676 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2d232700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2812feb0 0x7f7f28128aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 -- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 msgr2=0x7f7f28128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 -- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2812feb0 msgr2=0x7f7f28128aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2812feb0 0x7f7f28128aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2e234700 1 -- 172.21.15.125:0/2052476676 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009a70 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.662+0000 7f7f2da33700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f2e234700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 0x7f7f28128fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000efc0 tx=0x7f7f2000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000ca90 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000f040 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f18009550 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000ce30 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2400d8e0 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.663+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f20014480 con 0x7f7f281307c0 2023-10-03T10:13:32.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.664+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f2003fc20 con 0x7f7f281307c0 2023-10-03T10:13:32.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.664+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2809aa40 con 0x7f7f281307c0 2023-10-03T10:13:32.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.668+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f20012930 con 0x7f7f281307c0 2023-10-03T10:13:32.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 Processor -- start 2023-10-03T10:13:32.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 -- start start 2023-10-03T10:13:32.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 0x7f3a0013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0006b2d0 con 0x7f3a00133ad0 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a001345b0 con 0x7f3a00139280 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f3a05e41700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a00133610 con 0x7f3a00136960 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f39feffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f39fffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 0x7f3a0013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f39feffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34636/0 (socket says 172.21.15.125:34636) 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f39feffd700 1 -- 172.21.15.125:0/1988514354 learned_addr learned my addr 172.21.15.125:0/1988514354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.701+0000 7f39ff7fe700 1 --1- 172.21.15.125:0/1988514354 >> v1:172.21.15.125:6789/0 conn(0x7f3a00133ad0 0x7f3a00133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56832/0 (socket says 172.21.15.125:56832) 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39feffd700 1 -- 172.21.15.125:0/1988514354 >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 msgr2=0x7f3a0013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39feffd700 1 --2- 172.21.15.125:0/1988514354 >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 0x7f3a0013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39feffd700 1 -- 172.21.15.125:0/1988514354 >> v1:172.21.15.125:6789/0 conn(0x7f3a00133ad0 legacy=0x7f3a00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39feffd700 1 -- 172.21.15.125:0/1988514354 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0009a500 con 0x7f3a00136960 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39fffff700 1 --2- 172.21.15.125:0/1988514354 >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 0x7f3a0013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39feffd700 1 --2- 172.21.15.125:0/1988514354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009920 tx=0x7f39f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594d8efd00982e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39fe7fc700 1 -- 172.21.15.125:0/1988514354 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0011830 con 0x7f3a00136960 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39fe7fc700 1 -- 172.21.15.125:0/1988514354 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0011990 con 0x7f3a00136960 2023-10-03T10:13:32.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.702+0000 7f39fe7fc700 1 -- 172.21.15.125:0/1988514354 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0011d20 con 0x7f3a00136960 2023-10-03T10:13:32.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 -- 172.21.15.125:0/1988514354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 msgr2=0x7f3a00138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 --2- 172.21.15.125:0/1988514354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009920 tx=0x7f39f0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 -- 172.21.15.125:0/1988514354 shutdown_connections 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 --2- 172.21.15.125:0/1988514354 >> v2:172.21.15.125:3300/0 conn(0x7f3a00139280 0x7f3a0013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 --2- 172.21.15.125:0/1988514354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00136960 0x7f3a00138d40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 -- 172.21.15.125:0/1988514354 >> 172.21.15.125:0/1988514354 conn(0x7f3a00099c40 msgr2=0x7f3a000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 -- 172.21.15.125:0/1988514354 shutdown_connections 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.703+0000 7f3a05e41700 1 -- 172.21.15.125:0/1988514354 wait complete. 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 Processor -- start 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 -- start start 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00133ad0 0x7f3a0012fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 0x7f3a001c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a00070430 con 0x7f3a00136960 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0009f390 con 0x7f3a00139280 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f3a05e41700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0006e970 con 0x7f3a00133ad0 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f39feffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f39feffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57912/0 (socket says 172.21.15.125:57912) 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f39feffd700 1 -- 172.21.15.125:0/3409270176 learned_addr learned my addr 172.21.15.125:0/3409270176 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f39fffff700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 0x7f3a001c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.704+0000 7f39ff7fe700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00133ad0 0x7f3a0012fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 -- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00133ad0 msgr2=0x7f3a0012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00133ad0 0x7f3a0012fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 -- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 msgr2=0x7f3a00130080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 -- 172.21.15.125:0/3409270176 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8009a70 con 0x7f3a00139280 2023-10-03T10:13:32.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39feffd700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39fffff700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 0x7f3a001c84e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f39f800ef90 tx=0x7f39f800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f800ca90 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f800f040 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f800ce30 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0009550 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.705+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a00070ea0 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.706+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39f8014480 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.706+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39f803fba0 con 0x7f3a00139280 2023-10-03T10:13:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.706+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0004f2a0 con 0x7f3a00139280 2023-10-03T10:13:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.710+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39f8012930 con 0x7f3a00139280 2023-10-03T10:13:32.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.865+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f2812b400 con 0x7f7f281307c0 2023-10-03T10:13:32.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.866+0000 7f7f1e7fc700 1 -- 172.21.15.125:0/2052476676 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f20012340 con 0x7f7f281307c0 2023-10-03T10:13:32.867 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:32.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 msgr2=0x7f7f28128fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 0x7f7f28128fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000efc0 tx=0x7f7f2000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 shutdown_connections 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f281307c0 0x7f7f28128fe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f28099920 0x7f7f28128560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 --2- 172.21.15.125:0/2052476676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2812feb0 0x7f7f28128aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 >> 172.21.15.125:0/2052476676 conn(0x7f7f280a2b30 msgr2=0x7f7f2809fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 shutdown_connections 2023-10-03T10:13:32.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.868+0000 7f7f2fc97700 1 -- 172.21.15.125:0/2052476676 wait complete. 2023-10-03T10:13:32.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:32.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.906+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a0009f0f0 con 0x7f3a00139280 2023-10-03T10:13:32.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.906+0000 7f39f7fff700 1 -- 172.21.15.125:0/3409270176 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39f8012340 con 0x7f3a00139280 2023-10-03T10:13:32.907 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 msgr2=0x7f3a001c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 0x7f3a001c84e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f39f800ef90 tx=0x7f39f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 shutdown_connections 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a00139280 0x7f3a001c84e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3a00133ad0 0x7f3a0012fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 --2- 172.21.15.125:0/3409270176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a00136960 0x7f3a00130080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 >> 172.21.15.125:0/3409270176 conn(0x7f3a00099c40 msgr2=0x7f3a001371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 shutdown_connections 2023-10-03T10:13:32.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:32.908+0000 7f3a05e41700 1 -- 172.21.15.125:0/3409270176 wait complete. 2023-10-03T10:13:32.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:32.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:32.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:33.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.084+0000 7f4abc145700 1 Processor -- start 2023-10-03T10:13:33.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 -- start start 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab409dc00 con 0x7f4ab40a1380 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab409ea90 con 0x7f4ab40a0a70 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4abc145700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab409dec0 con 0x7f4ab4134120 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4ab9ee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4aba6e2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4ab96e0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4ab40a1380 0x7f4ab4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56836/0 (socket says 172.21.15.125:56836) 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4ab96e0700 1 -- 172.21.15.125:0/3127052326 learned_addr learned my addr 172.21.15.125:0/3127052326 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4aba6e2700 1 -- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 msgr2=0x7f4ab40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4aba6e2700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4aba6e2700 1 -- 172.21.15.125:0/3127052326 >> v1:172.21.15.125:6789/0 conn(0x7f4ab40a1380 legacy=0x7f4ab4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4aba6e2700 1 -- 172.21.15.125:0/3127052326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab409e6a0 con 0x7f4ab4134120 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4ab8edf700 1 -- 172.21.15.125:0/3127052326 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959798180 0 0) 0x7f4ab409dc00 con 0x7f4ab40a1380 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.085+0000 7f4ab9ee1700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4aba6e2700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab413bce0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009dc0 tx=0x7f4aac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17564b61e78549eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4ab8edf700 1 -- 172.21.15.125:0/3127052326 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00e070 con 0x7f4ab4134120 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4ab8edf700 1 -- 172.21.15.125:0/3127052326 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00bb20 con 0x7f4ab4134120 2023-10-03T10:13:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4ab8edf700 1 -- 172.21.15.125:0/3127052326 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac012430 con 0x7f4ab4134120 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 -- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 msgr2=0x7f4ab413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab413bce0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009dc0 tx=0x7f4aac00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 -- 172.21.15.125:0/3127052326 shutdown_connections 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab413bce0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 --2- 172.21.15.125:0/3127052326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 -- 172.21.15.125:0/3127052326 >> 172.21.15.125:0/3127052326 conn(0x7f4ab40a6610 msgr2=0x7f4ab40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 -- 172.21.15.125:0/3127052326 shutdown_connections 2023-10-03T10:13:33.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.086+0000 7f4abc145700 1 -- 172.21.15.125:0/3127052326 wait complete. 2023-10-03T10:13:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.087+0000 7f4abc145700 1 Processor -- start 2023-10-03T10:13:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.087+0000 7f4abc145700 1 -- start start 2023-10-03T10:13:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 0x7f4ab4122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab4123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41258f0 con 0x7f4ab40a1380 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4133640 con 0x7f4ab40a0a70 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41262f0 con 0x7f4ab4134120 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab96e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 0x7f4ab4122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56754/0 (socket says 172.21.15.125:56754) 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 -- 172.21.15.125:0/565036246 learned_addr learned my addr 172.21.15.125:0/565036246 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4aba6e2700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab4123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 -- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 msgr2=0x7f4ab4123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab4123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 -- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 msgr2=0x7f4ab4122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 0x7f4ab4122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 -- 172.21.15.125:0/565036246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00094a0 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab96e0700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 0x7f4ab4122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4ab9ee1700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000ebe0 tx=0x7f4ab000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000c850 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000c9b0 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.088+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac009a70 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.089+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000cd40 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.089+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab40a0430 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.089+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ab0013470 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.090+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ab003f770 con 0x7f4ab40a0a70 2023-10-03T10:13:33.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.090+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab4126a60 con 0x7f4ab40a0a70 2023-10-03T10:13:33.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.095+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ab0013720 con 0x7f4ab40a0a70 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 Processor -- start 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 -- start start 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 0x7f06fc0993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc09a540 con 0x7f06fc099920 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc09ad40 con 0x7f06fc12feb0 2023-10-03T10:13:33.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.128+0000 7f0701ebb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc09e640 con 0x7f06fc1307c0 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06faffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 0x7f06fc0993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f06fc099920 0x7f06fc136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56838/0 (socket says 172.21.15.125:56838) 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56760/0 (socket says 172.21.15.125:56760) 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fbfff700 1 -- 172.21.15.125:0/1482314675 learned_addr learned my addr 172.21.15.125:0/1482314675 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fa7fc700 1 -- 172.21.15.125:0/1482314675 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85324387 0 0) 0x7f06fc09a540 con 0x7f06fc099920 2023-10-03T10:13:33.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 -- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 msgr2=0x7f06fc0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 0x7f06fc0993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 -- 172.21.15.125:0/1482314675 >> v1:172.21.15.125:6789/0 conn(0x7f06fc099920 legacy=0x7f06fc136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 -- 172.21.15.125:0/1482314675 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc09e3c0 con 0x7f06fc12feb0 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06faffd700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 0x7f06fc0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fb7fe700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f06f400baf0 tx=0x7f06f400be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888aac286e30d4cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fa7fc700 1 -- 172.21.15.125:0/1482314675 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4005e30 con 0x7f06fc12feb0 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fa7fc700 1 -- 172.21.15.125:0/1482314675 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400d860 con 0x7f06fc12feb0 2023-10-03T10:13:33.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.129+0000 7f06fa7fc700 1 -- 172.21.15.125:0/1482314675 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400dbf0 con 0x7f06fc12feb0 2023-10-03T10:13:33.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 -- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 msgr2=0x7f06fc130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f06f400baf0 tx=0x7f06f400be00 comp rx=0 tx=0).stop 2023-10-03T10:13:33.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 -- 172.21.15.125:0/1482314675 shutdown_connections 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc12feb0 0x7f06fc130280 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 --2- 172.21.15.125:0/1482314675 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc1307c0 0x7f06fc0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 -- 172.21.15.125:0/1482314675 >> 172.21.15.125:0/1482314675 conn(0x7f06fc0a2b30 msgr2=0x7f06fc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 -- 172.21.15.125:0/1482314675 shutdown_connections 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.130+0000 7f0701ebb700 1 -- 172.21.15.125:0/1482314675 wait complete. 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 Processor -- start 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 -- start start 2023-10-03T10:13:33.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc099920 0x7f06fc128260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc06ef00 con 0x7f06fc12feb0 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc06d880 con 0x7f06fc1307c0 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f0701ebb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc09fde0 con 0x7f06fc099920 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06faffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06fbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06faffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57930/0 (socket says 172.21.15.125:57930) 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06faffd700 1 -- 172.21.15.125:0/2858268521 learned_addr learned my addr 172.21.15.125:0/2858268521 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06fbfff700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56776/0 (socket says 172.21.15.125:56776) 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.131+0000 7f06fb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc099920 0x7f06fc128260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 -- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc099920 msgr2=0x7f06fc128260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc099920 0x7f06fc128260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 -- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 msgr2=0x7f06fc1287a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 -- 172.21.15.125:0/2858268521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094a0 con 0x7f06fc1307c0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06faffd700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06fbfff700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00cbe0 tx=0x7f06ec00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00aa40 con 0x7f06fc1307c0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00abc0 con 0x7f06fc1307c0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f400b6d0 con 0x7f06fc1307c0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0070d0 con 0x7f06fc1307c0 2023-10-03T10:13:33.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.132+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc06f1e0 con 0x7f06fc1307c0 2023-10-03T10:13:33.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.133+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06ec007230 con 0x7f06fc1307c0 2023-10-03T10:13:33.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.133+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06ec03f3d0 con 0x7f06fc1307c0 2023-10-03T10:13:33.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.133+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc04f2a0 con 0x7f06fc1307c0 2023-10-03T10:13:33.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.138+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06ec018080 con 0x7f06fc1307c0 2023-10-03T10:13:33.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.307+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ab404f2a0 con 0x7f4ab40a0a70 2023-10-03T10:13:33.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.308+0000 7f4aaa7fc700 1 -- 172.21.15.125:0/565036246 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ab0021030 con 0x7f4ab40a0a70 2023-10-03T10:13:33.308 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:33.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 msgr2=0x7f4ab4122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000ebe0 tx=0x7f4ab000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 shutdown_connections 2023-10-03T10:13:33.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab4134120 0x7f4ab4123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab40a0a70 0x7f4ab4122890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 --2- 172.21.15.125:0/565036246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40a1380 0x7f4ab4122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 >> 172.21.15.125:0/565036246 conn(0x7f4ab40a6610 msgr2=0x7f4ab409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 shutdown_connections 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.310+0000 7f4abc145700 1 -- 172.21.15.125:0/565036246 wait complete. 2023-10-03T10:13:33.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:33.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.352+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06fc09aa50 con 0x7f06fc1307c0 2023-10-03T10:13:33.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.352+0000 7f06f3fff700 1 -- 172.21.15.125:0/2858268521 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06ec0074e0 con 0x7f06fc1307c0 2023-10-03T10:13:33.353 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 msgr2=0x7f06fc128ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00cbe0 tx=0x7f06ec00cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 shutdown_connections 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06fc1307c0 0x7f06fc128ce0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06fc099920 0x7f06fc128260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 --2- 172.21.15.125:0/2858268521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06fc12feb0 0x7f06fc1287a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 >> 172.21.15.125:0/2858268521 conn(0x7f06fc0a2b30 msgr2=0x7f06fc09c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 shutdown_connections 2023-10-03T10:13:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:33.354+0000 7f0701ebb700 1 -- 172.21.15.125:0/2858268521 wait complete. 2023-10-03T10:13:33.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:33.882 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:33.921 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:34.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 Processor -- start 2023-10-03T10:13:34.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 -- start start 2023-10-03T10:13:34.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 0x7f58e01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e009aaa0 con 0x7f58e009d860 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e009e730 con 0x7f58e0135f20 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e851a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58e009f870 con 0x7f58e009e340 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e62b6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f58e009d860 0x7f58e009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56842/0 (socket says 172.21.15.125:56842) 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e62b6700 1 -- 172.21.15.125:0/592243357 learned_addr learned my addr 172.21.15.125:0/592243357 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e5ab5700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 0x7f58e01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.012+0000 7f58e6ab7700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e6ab7700 1 -- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 msgr2=0x7f58e01359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e6ab7700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 0x7f58e01359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e52b4700 1 -- 172.21.15.125:0/592243357 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238757809 0 0) 0x7f58e009aaa0 con 0x7f58e009d860 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e6ab7700 1 -- 172.21.15.125:0/592243357 >> v1:172.21.15.125:6789/0 conn(0x7f58e009d860 legacy=0x7f58e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e6ab7700 1 -- 172.21.15.125:0/592243357 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e009b360 con 0x7f58e0135f20 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e5ab5700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 0x7f58e01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e6ab7700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e0138300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e14a01bbffd9ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e52b4700 1 -- 172.21.15.125:0/592243357 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc011830 con 0x7f58e0135f20 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e52b4700 1 -- 172.21.15.125:0/592243357 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc011990 con 0x7f58e0135f20 2023-10-03T10:13:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.013+0000 7f58e52b4700 1 -- 172.21.15.125:0/592243357 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc011d20 con 0x7f58e0135f20 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 -- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 msgr2=0x7f58e0138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e0138300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 -- 172.21.15.125:0/592243357 shutdown_connections 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e0138300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 --2- 172.21.15.125:0/592243357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009e340 0x7f58e01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 -- 172.21.15.125:0/592243357 >> 172.21.15.125:0/592243357 conn(0x7f58e0099c40 msgr2=0x7f58e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 -- 172.21.15.125:0/592243357 shutdown_connections 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.014+0000 7f58e851a700 1 -- 172.21.15.125:0/592243357 wait complete. 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 Processor -- start 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 -- start start 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 0x7f58e011e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 0x7f58e011e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0122130 con 0x7f58e009e340 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e01200a0 con 0x7f58e0135f20 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e851a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58e01206c0 con 0x7f58e009d860 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e6ab7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e5ab5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 0x7f58e011e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e6ab7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56784/0 (socket says 172.21.15.125:56784) 2023-10-03T10:13:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e6ab7700 1 -- 172.21.15.125:0/1778648545 learned_addr learned my addr 172.21.15.125:0/1778648545 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.015+0000 7f58e62b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 0x7f58e011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 -- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 msgr2=0x7f58e011ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 -- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 msgr2=0x7f58e011e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 0x7f58e011e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 -- 172.21.15.125:0/1778648545 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00094a0 con 0x7f58e009d860 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e6ab7700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e5ab5700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 0x7f58e011e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e62b6700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 0x7f58e011e490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58d800cad0 tx=0x7f58d800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800e040 con 0x7f58e009d860 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d800a9a0 con 0x7f58e009d860 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc0094a0 con 0x7f58e009d860 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800ad50 con 0x7f58e009d860 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.016+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e0121a10 con 0x7f58e009d860 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.017+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58d80060d0 con 0x7f58e009d860 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.017+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e004f2a0 con 0x7f58e009d860 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.017+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58d803f690 con 0x7f58e009d860 2023-10-03T10:13:34.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.022+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58d8011750 con 0x7f58e009d860 2023-10-03T10:13:34.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 Processor -- start 2023-10-03T10:13:34.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 -- start start 2023-10-03T10:13:34.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 0x7f70680a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f706813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706809dc00 con 0x7f70680a1380 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706809ea90 con 0x7f70680a0a70 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706f483700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706809dec0 con 0x7f7068134120 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706d21f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 0x7f70680a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706da20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f706813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706ca1e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f70680a1380 0x7f7068133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56854/0 (socket says 172.21.15.125:56854) 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.053+0000 7f706d21f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 0x7f70680a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57944/0 (socket says 172.21.15.125:57944) 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706ca1e700 1 -- 172.21.15.125:0/1606320310 learned_addr learned my addr 172.21.15.125:0/1606320310 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f705ffff700 1 -- 172.21.15.125:0/1606320310 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790760779 0 0) 0x7f706809dc00 con 0x7f70680a1380 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f705ffff700 1 -- 172.21.15.125:0/1606320310 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70540035b0 con 0x7f70680a1380 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706da20700 1 -- 172.21.15.125:0/1606320310 >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 msgr2=0x7f70680a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706da20700 1 --2- 172.21.15.125:0/1606320310 >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 0x7f70680a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706da20700 1 -- 172.21.15.125:0/1606320310 >> v1:172.21.15.125:6789/0 conn(0x7f70680a1380 legacy=0x7f7068133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706da20700 1 -- 172.21.15.125:0/1606320310 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706809e6a0 con 0x7f7068134120 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f706da20700 1 --2- 172.21.15.125:0/1606320310 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f706813bce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7060009d90 tx=0x7f706000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40402c3de9318ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f705ffff700 1 -- 172.21.15.125:0/1606320310 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706000e070 con 0x7f7068134120 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f705ffff700 1 -- 172.21.15.125:0/1606320310 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706000bb20 con 0x7f7068134120 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.054+0000 7f705ffff700 1 -- 172.21.15.125:0/1606320310 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060012430 con 0x7f7068134120 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 -- 172.21.15.125:0/1606320310 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 msgr2=0x7f706813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 --2- 172.21.15.125:0/1606320310 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f706813bce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7060009d90 tx=0x7f706000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 -- 172.21.15.125:0/1606320310 shutdown_connections 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 --2- 172.21.15.125:0/1606320310 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f706813bce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 --2- 172.21.15.125:0/1606320310 >> v2:172.21.15.125:3300/0 conn(0x7f70680a0a70 0x7f70680a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 -- 172.21.15.125:0/1606320310 >> 172.21.15.125:0/1606320310 conn(0x7f70680a6610 msgr2=0x7f70680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 -- 172.21.15.125:0/1606320310 shutdown_connections 2023-10-03T10:13:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.055+0000 7f706f483700 1 -- 172.21.15.125:0/1606320310 wait complete. 2023-10-03T10:13:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 Processor -- start 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 -- start start 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 0x7f7068122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70680a1380 0x7f7068122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068124b30 con 0x7f70680a0a70 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7068125e90 con 0x7f7068134120 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706f483700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7068124370 con 0x7f70680a1380 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706da20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706d21f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 0x7f7068122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706da20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56802/0 (socket says 172.21.15.125:56802) 2023-10-03T10:13:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706da20700 1 -- 172.21.15.125:0/1734095515 learned_addr learned my addr 172.21.15.125:0/1734095515 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.056+0000 7f706ca1e700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70680a1380 0x7f7068122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 -- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70680a1380 msgr2=0x7f7068122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70680a1380 0x7f7068122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 -- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 msgr2=0x7f70681230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 -- 172.21.15.125:0/1734095515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009a70 con 0x7f70680a0a70 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706da20700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706d21f700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 0x7f7068122650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f706400e930 tx=0x7f706400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064013680 con 0x7f70680a0a70 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70640137e0 con 0x7f70680a0a70 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70680a5610 con 0x7f70680a0a70 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064013b50 con 0x7f70680a0a70 2023-10-03T10:13:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.057+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7068126900 con 0x7f70680a0a70 2023-10-03T10:13:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.058+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7064013cb0 con 0x7f70680a0a70 2023-10-03T10:13:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.058+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f706403f660 con 0x7f70680a0a70 2023-10-03T10:13:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.058+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706804f2a0 con 0x7f70680a0a70 2023-10-03T10:13:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.063+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706401bc30 con 0x7f70680a0a70 2023-10-03T10:13:34.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.219+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58e0120890 con 0x7f58e009d860 2023-10-03T10:13:34.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.220+0000 7f58d6ffd700 1 -- 172.21.15.125:0/1778648545 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58d80123e0 con 0x7f58e009d860 2023-10-03T10:13:34.220 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:34.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 msgr2=0x7f58e011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 0x7f58e011e490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58d800cad0 tx=0x7f58d800cde0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 shutdown_connections 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58e0135f20 0x7f58e011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58e009d860 0x7f58e011e490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 --2- 172.21.15.125:0/1778648545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58e009e340 0x7f58e011e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 >> 172.21.15.125:0/1778648545 conn(0x7f58e0099c40 msgr2=0x7f58e00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 shutdown_connections 2023-10-03T10:13:34.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.222+0000 7f58e851a700 1 -- 172.21.15.125:0/1778648545 wait complete. 2023-10-03T10:13:34.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:34.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.257+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7068072980 con 0x7f70680a0a70 2023-10-03T10:13:34.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.257+0000 7f705dffb700 1 -- 172.21.15.125:0/1734095515 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7064017020 con 0x7f70680a0a70 2023-10-03T10:13:34.257 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:34.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 msgr2=0x7f7068122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 0x7f7068122650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f706400e930 tx=0x7f706400ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 shutdown_connections 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7068134120 0x7f70681230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70680a0a70 0x7f7068122650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 --2- 172.21.15.125:0/1734095515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70680a1380 0x7f7068122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 >> 172.21.15.125:0/1734095515 conn(0x7f70680a6610 msgr2=0x7f70680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 shutdown_connections 2023-10-03T10:13:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.259+0000 7f706f483700 1 -- 172.21.15.125:0/1734095515 wait complete. 2023-10-03T10:13:34.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:34.323 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:34.367 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.448+0000 7f78ee396700 1 Processor -- start 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.448+0000 7f78ee396700 1 -- start start 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ee396700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ee396700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ee396700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e809aaa0 con 0x7f78e809d860 2023-10-03T10:13:34.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ee396700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e809e730 con 0x7f78e8135f20 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ee396700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809f870 con 0x7f78e809e340 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ec933700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ec933700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57962/0 (socket says 172.21.15.125:57962) 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34714/0 (socket says 172.21.15.125:34714) 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ec933700 1 -- 172.21.15.125:0/1733555975 learned_addr learned my addr 172.21.15.125:0/1733555975 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e7fff700 1 --1- 172.21.15.125:0/1733555975 >> v1:172.21.15.125:6789/0 conn(0x7f78e809d860 0x7f78e809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56866/0 (socket says 172.21.15.125:56866) 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 -- 172.21.15.125:0/1733555975 >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 msgr2=0x7f78e8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 --2- 172.21.15.125:0/1733555975 >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 -- 172.21.15.125:0/1733555975 >> v1:172.21.15.125:6789/0 conn(0x7f78e809d860 legacy=0x7f78e809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 -- 172.21.15.125:0/1733555975 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e809b360 con 0x7f78e809e340 2023-10-03T10:13:34.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e6ffd700 1 -- 172.21.15.125:0/1733555975 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872963671 0 0) 0x7f78e809aaa0 con 0x7f78e809d860 2023-10-03T10:13:34.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78ec933700 1 --2- 172.21.15.125:0/1733555975 >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e77fe700 1 --2- 172.21.15.125:0/1733555975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009840 tx=0x7f78dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7900a40ece24ddb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e6ffd700 1 -- 172.21.15.125:0/1733555975 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011830 con 0x7f78e809e340 2023-10-03T10:13:34.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.449+0000 7f78e6ffd700 1 -- 172.21.15.125:0/1733555975 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc011990 con 0x7f78e809e340 2023-10-03T10:13:34.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78e6ffd700 1 -- 172.21.15.125:0/1733555975 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011d20 con 0x7f78e809e340 2023-10-03T10:13:34.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 -- 172.21.15.125:0/1733555975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 msgr2=0x7f78e81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 --2- 172.21.15.125:0/1733555975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009840 tx=0x7f78dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:34.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 -- 172.21.15.125:0/1733555975 shutdown_connections 2023-10-03T10:13:34.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 --2- 172.21.15.125:0/1733555975 >> v2:172.21.15.125:3300/0 conn(0x7f78e8135f20 0x7f78e8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 --2- 172.21.15.125:0/1733555975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e81359e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 -- 172.21.15.125:0/1733555975 >> 172.21.15.125:0/1733555975 conn(0x7f78e8099c40 msgr2=0x7f78e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 -- 172.21.15.125:0/1733555975 shutdown_connections 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.450+0000 7f78ee396700 1 -- 172.21.15.125:0/1733555975 wait complete. 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.451+0000 7f78ee396700 1 Processor -- start 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.451+0000 7f78ee396700 1 -- start start 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e809d860 0x7f78e811c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 0x7f78e811cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e811f8e0 con 0x7f78e8135f20 2023-10-03T10:13:34.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e811e430 con 0x7f78e809d860 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809c8b0 con 0x7f78e809e340 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34728/0 (socket says 172.21.15.125:34728) 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 -- 172.21.15.125:0/547551121 learned_addr learned my addr 172.21.15.125:0/547551121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ec933700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 0x7f78e811cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e7fff700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e809d860 0x7f78e811c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 -- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e809d860 msgr2=0x7f78e811c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e809d860 0x7f78e811c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 -- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 msgr2=0x7f78e811cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 0x7f78e811cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 -- 172.21.15.125:0/547551121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0009b30 con 0x7f78e809e340 2023-10-03T10:13:34.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ec933700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 0x7f78e811cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e77fe700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009fd0 tx=0x7f78dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0036a0 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc01f070 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc003a60 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc0094a0 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.452+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e80a1f50 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.453+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78dc003bc0 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.453+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78dc021070 con 0x7f78e809e340 2023-10-03T10:13:34.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.453+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e811f710 con 0x7f78e809e340 2023-10-03T10:13:34.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.458+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78dc015080 con 0x7f78e809e340 2023-10-03T10:13:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.495+0000 7fdaa9a68700 1 Processor -- start 2023-10-03T10:13:34.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.495+0000 7fdaa9a68700 1 -- start start 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa9a68700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdaa409e870 0x7fdaa409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa9a68700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 0x7fdaa413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa9a68700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa409fa00 con 0x7fdaa409f180 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa9a68700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa40a0370 con 0x7fdaa409e870 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa9a68700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa406bec0 con 0x7fdaa4134330 2023-10-03T10:13:34.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdaa409e870 0x7fdaa409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdaa409e870 0x7fdaa409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57978/0 (socket says 172.21.15.125:57978) 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 -- 172.21.15.125:0/287034687 learned_addr learned my addr 172.21.15.125:0/287034687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa2ffd700 1 --1- 172.21.15.125:0/287034687 >> v1:172.21.15.125:6789/0 conn(0x7fdaa409f180 0x7fdaa4133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56882/0 (socket says 172.21.15.125:56882) 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa3fff700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 0x7fdaa413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 -- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 msgr2=0x7fdaa413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 0x7fdaa413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 -- 172.21.15.125:0/287034687 >> v1:172.21.15.125:6789/0 conn(0x7fdaa409f180 legacy=0x7fdaa4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa37fe700 1 -- 172.21.15.125:0/287034687 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa409ada0 con 0x7fdaa409e870 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa27fc700 1 -- 172.21.15.125:0/287034687 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635160344 0 0) 0x7fdaa409fa00 con 0x7fdaa409f180 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.496+0000 7fdaa3fff700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 0x7fdaa413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa37fe700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa409ec40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fda94009e50 tx=0x7fda9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d11a066cc49d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa27fc700 1 -- 172.21.15.125:0/287034687 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400e070 con 0x7fdaa409e870 2023-10-03T10:13:34.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa27fc700 1 -- 172.21.15.125:0/287034687 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400b910 con 0x7fdaa409e870 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa27fc700 1 -- 172.21.15.125:0/287034687 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400bcc0 con 0x7fdaa409e870 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 -- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 msgr2=0x7fdaa409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa409ec40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fda94009e50 tx=0x7fda9400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 -- 172.21.15.125:0/287034687 shutdown_connections 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa4134330 0x7fdaa413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/287034687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa409ec40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 -- 172.21.15.125:0/287034687 >> 172.21.15.125:0/287034687 conn(0x7fdaa40a4430 msgr2=0x7fdaa40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 -- 172.21.15.125:0/287034687 shutdown_connections 2023-10-03T10:13:34.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.497+0000 7fdaa9a68700 1 -- 172.21.15.125:0/287034687 wait complete. 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.498+0000 7fdaa9a68700 1 Processor -- start 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.498+0000 7fdaa9a68700 1 -- start start 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdaa4134330 0x7fdaa4123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4126190 con 0x7fdaa409e870 2023-10-03T10:13:34.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4124480 con 0x7fdaa4134330 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa9a68700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa406cfa0 con 0x7fdaa409f180 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57990/0 (socket says 172.21.15.125:57990) 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34750/0 (socket says 172.21.15.125:34750) 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa37fe700 1 -- 172.21.15.125:0/1327474718 learned_addr learned my addr 172.21.15.125:0/1327474718 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 -- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdaa4134330 msgr2=0x7fdaa4123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdaa4134330 0x7fdaa4123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 -- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 msgr2=0x7fdaa41228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 -- 172.21.15.125:0/1327474718 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0094a0 con 0x7fdaa409f180 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa37fe700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fdaa2ffd700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c470 tx=0x7fda8c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.499+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c004c80 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.500+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c004de0 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.500+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c007310 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.500+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94009b30 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.500+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa4126b20 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.500+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda8c007470 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.501+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda8c03f2f0 con 0x7fdaa409f180 2023-10-03T10:13:34.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.501+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa4133420 con 0x7fdaa409f180 2023-10-03T10:13:34.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.505+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda8c007720 con 0x7fdaa409f180 2023-10-03T10:13:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.651+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78e804f2a0 con 0x7f78e809e340 2023-10-03T10:13:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.651+0000 7f78e4ff9700 1 -- 172.21.15.125:0/547551121 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78dc0253e0 con 0x7f78e809e340 2023-10-03T10:13:34.652 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 msgr2=0x7f78e811c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009fd0 tx=0x7f78dc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 shutdown_connections 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e8135f20 0x7f78e811cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e809d860 0x7f78e811c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 --2- 172.21.15.125:0/547551121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78e809e340 0x7f78e811c7c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 >> 172.21.15.125:0/547551121 conn(0x7f78e8099c40 msgr2=0x7f78e806ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 shutdown_connections 2023-10-03T10:13:34.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.653+0000 7f78ee396700 1 -- 172.21.15.125:0/547551121 wait complete. 2023-10-03T10:13:34.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:34.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.694+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdaa4125fd0 con 0x7fdaa409f180 2023-10-03T10:13:34.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.694+0000 7fda9bfff700 1 -- 172.21.15.125:0/1327474718 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda8c011360 con 0x7fdaa409f180 2023-10-03T10:13:34.695 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 msgr2=0x7fdaa4122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c470 tx=0x7fda8c00c780 comp rx=0 tx=0).stop 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 shutdown_connections 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdaa4134330 0x7fdaa4123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdaa409e870 0x7fdaa41228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 --2- 172.21.15.125:0/1327474718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdaa409f180 0x7fdaa4122e00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 >> 172.21.15.125:0/1327474718 conn(0x7fdaa40a4430 msgr2=0x7fdaa4070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 shutdown_connections 2023-10-03T10:13:34.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:34.696+0000 7fdaa9a68700 1 -- 172.21.15.125:0/1327474718 wait complete. 2023-10-03T10:13:34.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:35.235 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:35.272 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.361+0000 7f50f0afd700 1 Processor -- start 2023-10-03T10:13:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.361+0000 7f50f0afd700 1 -- start start 2023-10-03T10:13:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50f0afd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50f0afd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50f0afd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec09b110 con 0x7f50ec133f70 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50f0afd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec0a3b60 con 0x7f50ec09ad40 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50f0afd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec134850 con 0x7f50ec1343d0 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ea59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39522/0 (socket says 172.21.15.125:39522) 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ea59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59816/0 (socket says 172.21.15.125:59816) 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 -- 172.21.15.125:0/2504933073 learned_addr learned my addr 172.21.15.125:0/2504933073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 -- 172.21.15.125:0/2504933073 >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 msgr2=0x7f50ec133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 --2- 172.21.15.125:0/2504933073 >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 -- 172.21.15.125:0/2504933073 >> v1:172.21.15.125:6789/0 conn(0x7f50ec133f70 legacy=0x7f50ec0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 -- 172.21.15.125:0/2504933073 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0a2fa0 con 0x7f50ec1343d0 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50e959a700 1 -- 172.21.15.125:0/2504933073 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285311675 0 0) 0x7f50ec09b110 con 0x7f50ec133f70 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ea59c700 1 --2- 172.21.15.125:0/2504933073 >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50ead9d700 1 --2- 172.21.15.125:0/2504933073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009e50 tx=0x7f50e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd3ea61bc35bac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50e959a700 1 -- 172.21.15.125:0/2504933073 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400e070 con 0x7f50ec1343d0 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50e959a700 1 -- 172.21.15.125:0/2504933073 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400b910 con 0x7f50ec1343d0 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.362+0000 7f50e959a700 1 -- 172.21.15.125:0/2504933073 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400bcc0 con 0x7f50ec1343d0 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 -- 172.21.15.125:0/2504933073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 msgr2=0x7f50ec0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 --2- 172.21.15.125:0/2504933073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009e50 tx=0x7f50e400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 -- 172.21.15.125:0/2504933073 shutdown_connections 2023-10-03T10:13:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 --2- 172.21.15.125:0/2504933073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec1343d0 0x7f50ec0a1180 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 --2- 172.21.15.125:0/2504933073 >> v2:172.21.15.125:3300/0 conn(0x7f50ec09ad40 0x7f50ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 -- 172.21.15.125:0/2504933073 >> 172.21.15.125:0/2504933073 conn(0x7f50ec099c40 msgr2=0x7f50ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 -- 172.21.15.125:0/2504933073 shutdown_connections 2023-10-03T10:13:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.363+0000 7f50f0afd700 1 -- 172.21.15.125:0/2504933073 wait complete. 2023-10-03T10:13:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.364+0000 7f50f0afd700 1 Processor -- start 2023-10-03T10:13:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.364+0000 7f50f0afd700 1 -- start start 2023-10-03T10:13:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 0x7f50ec11f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 0x7f50ec1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0a4230 con 0x7f50ec1343d0 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec1223c0 con 0x7f50ec09ad40 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec133510 con 0x7f50ec133f70 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50e9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50e9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39534/0 (socket says 172.21.15.125:39534) 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 0x7f50ec11f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50e9d9b700 1 -- 172.21.15.125:0/884596700 learned_addr learned my addr 172.21.15.125:0/884596700 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ead9d700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 0x7f50ec1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 -- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 msgr2=0x7f50ec11f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 -- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 msgr2=0x7f50ec1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 0x7f50ec1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 -- 172.21.15.125:0/884596700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0094a0 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50e9d9b700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ead9d700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 0x7f50ec1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50ea59c700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 0x7f50ec11f450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00e930 tx=0x7f50dc00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc013680 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0137e0 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4009b30 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc013b90 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.365+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec120f80 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.366+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50dc013cf0 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.366+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f50dc03f9b0 con 0x7f50ec09ad40 2023-10-03T10:13:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.366+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec122500 con 0x7f50ec09ad40 2023-10-03T10:13:35.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.371+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50ec122500 con 0x7f50ec09ad40 2023-10-03T10:13:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.403+0000 7fc1fff16700 1 Processor -- start 2023-10-03T10:13:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 -- start start 2023-10-03T10:13:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f80a0a70 0x7fc1f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 0x7fc1f8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f809dc00 con 0x7fc1f8133f50 2023-10-03T10:13:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f809ea60 con 0x7fc1f80a0a70 2023-10-03T10:13:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fff16700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f809dec0 con 0x7fc1f80a1380 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f80a0a70 0x7fc1f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fd4b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 0x7fc1f8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1f80a0a70 0x7fc1f80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59832/0 (socket says 172.21.15.125:59832) 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fd4b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 0x7fc1f8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39542/0 (socket says 172.21.15.125:39542) 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fe4b3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc1f8133f50 0x7fc1f813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33692/0 (socket says 172.21.15.125:33692) 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 -- 172.21.15.125:0/2050917007 learned_addr learned my addr 172.21.15.125:0/2050917007 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 -- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 msgr2=0x7fc1f8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 --2- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 0x7fc1f8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 -- 172.21.15.125:0/2050917007 >> v1:172.21.15.125:6789/0 conn(0x7fc1f8133f50 legacy=0x7fc1f813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fccb0700 1 -- 172.21.15.125:0/2050917007 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282989283 0 0) 0x7fc1f809dc00 con 0x7fc1f8133f50 2023-10-03T10:13:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.404+0000 7fc1fdcb2700 1 -- 172.21.15.125:0/2050917007 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f809e6a0 con 0x7fc1f80a0a70 2023-10-03T10:13:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fdcb2700 1 --2- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f80a0a70 0x7fc1f80a0e40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098f0 tx=0x7fc1ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d41c0203a87b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fccb0700 1 -- 172.21.15.125:0/2050917007 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec011830 con 0x7fc1f80a0a70 2023-10-03T10:13:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fccb0700 1 -- 172.21.15.125:0/2050917007 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec011990 con 0x7fc1f80a0a70 2023-10-03T10:13:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fccb0700 1 -- 172.21.15.125:0/2050917007 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec011d20 con 0x7fc1f80a0a70 2023-10-03T10:13:35.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 -- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f80a0a70 msgr2=0x7fc1f80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f80a0a70 0x7fc1f80a0e40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098f0 tx=0x7fc1ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:35.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 -- 172.21.15.125:0/2050917007 shutdown_connections 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f80a0a70 0x7fc1f80a0e40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2050917007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a1380 0x7fc1f8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 -- 172.21.15.125:0/2050917007 >> 172.21.15.125:0/2050917007 conn(0x7fc1f80a6610 msgr2=0x7fc1f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 -- 172.21.15.125:0/2050917007 shutdown_connections 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.405+0000 7fc1fff16700 1 -- 172.21.15.125:0/2050917007 wait complete. 2023-10-03T10:13:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.406+0000 7fc1fff16700 1 Processor -- start 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.406+0000 7fc1fff16700 1 -- start start 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 0x7fc1f81c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81209e0 con 0x7fc1f8133f50 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81207f0 con 0x7fc1f80a1380 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fff16700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8122700 con 0x7fc1f80a0a70 2023-10-03T10:13:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fd4b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fd4b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45346/0 (socket says 172.21.15.125:45346) 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fd4b1700 1 -- 172.21.15.125:0/2868772483 learned_addr learned my addr 172.21.15.125:0/2868772483 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59840/0 (socket says 172.21.15.125:59840) 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fdcb2700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 0x7fc1f81c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 -- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 msgr2=0x7fc1f81c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 0x7fc1f81c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 -- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 msgr2=0x7fc1f81c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 -- 172.21.15.125:0/2868772483 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009550 con 0x7fc1f8133f50 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fd4b1700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fdcb2700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 0x7fc1f81c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.407+0000 7fc1fe4b3700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000cbe0 tx=0x7fc1f000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000aa40 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f000abc0 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f80a17b0 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00070d0 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f8120fe0 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.408+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1f0007230 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.409+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1f003f390 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.409+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f80a4fd0 con 0x7fc1f8133f50 2023-10-03T10:13:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.413+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1f0018080 con 0x7fc1f8133f50 2023-10-03T10:13:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.565+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50ec122500 con 0x7f50ec09ad40 2023-10-03T10:13:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.565+0000 7f50daffd700 1 -- 172.21.15.125:0/884596700 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50ec122500 con 0x7f50ec09ad40 2023-10-03T10:13:35.566 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 msgr2=0x7f50ec11f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 0x7f50ec11f450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00e930 tx=0x7f50dc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 shutdown_connections 2023-10-03T10:13:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50ec1343d0 0x7f50ec1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50ec09ad40 0x7f50ec11f450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 --2- 172.21.15.125:0/884596700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f50ec133f70 0x7f50ec11f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 >> 172.21.15.125:0/884596700 conn(0x7f50ec099c40 msgr2=0x7f50ec1bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 shutdown_connections 2023-10-03T10:13:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.567+0000 7f50f0afd700 1 -- 172.21.15.125:0/884596700 wait complete. 2023-10-03T10:13:35.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:35.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.605+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1f804f2a0 con 0x7fc1f8133f50 2023-10-03T10:13:35.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.606+0000 7fc1ea7fc700 1 -- 172.21.15.125:0/2868772483 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1f00074e0 con 0x7fc1f8133f50 2023-10-03T10:13:35.606 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 msgr2=0x7fc1f81c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000cbe0 tx=0x7fc1f000cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 shutdown_connections 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f8133f50 0x7fc1f81c90f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1f80a0a70 0x7fc1f81c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 --2- 172.21.15.125:0/2868772483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f80a1380 0x7fc1f81c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 >> 172.21.15.125:0/2868772483 conn(0x7fc1f80a6610 msgr2=0x7fc1f80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 shutdown_connections 2023-10-03T10:13:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.608+0000 7fc1fff16700 1 -- 172.21.15.125:0/2868772483 wait complete. 2023-10-03T10:13:35.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:35.666 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:35.709 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:35.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 Processor -- start 2023-10-03T10:13:35.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 -- start start 2023-10-03T10:13:35.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1e40a1550 0x7fb1e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e409e9d0 con 0x7fb1e40a0a70 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e409dc00 con 0x7fb1e40a1550 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e97a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e409dec0 con 0x7fb1e4139200 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1e40a1550 0x7fb1e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1e40a0a70 0x7fb1e40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33698/0 (socket says 172.21.15.125:33698) 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45356/0 (socket says 172.21.15.125:45356) 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.792+0000 7fb1e2ffd700 1 -- 172.21.15.125:0/1745604380 learned_addr learned my addr 172.21.15.125:0/1745604380 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e27fc700 1 -- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 msgr2=0x7fb1e413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e27fc700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e27fc700 1 -- 172.21.15.125:0/1745604380 >> v1:172.21.15.125:6789/0 conn(0x7fb1e40a0a70 legacy=0x7fb1e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e1ffb700 1 -- 172.21.15.125:0/1745604380 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267401094 0 0) 0x7fb1e409e9d0 con 0x7fb1e40a0a70 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e27fc700 1 -- 172.21.15.125:0/1745604380 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e409e6a0 con 0x7fb1e40a1550 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e37fe700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e27fc700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e40a1550 0x7fb1e4138cc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009840 tx=0x7fb1d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906e515a3386f1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e1ffb700 1 -- 172.21.15.125:0/1745604380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011830 con 0x7fb1e40a1550 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e1ffb700 1 -- 172.21.15.125:0/1745604380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8011990 con 0x7fb1e40a1550 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.793+0000 7fb1e1ffb700 1 -- 172.21.15.125:0/1745604380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011d20 con 0x7fb1e40a1550 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 -- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e40a1550 msgr2=0x7fb1e4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e40a1550 0x7fb1e4138cc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009840 tx=0x7fb1d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:35.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 -- 172.21.15.125:0/1745604380 shutdown_connections 2023-10-03T10:13:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e4139200 0x7fb1e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/1745604380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e40a1550 0x7fb1e4138cc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 -- 172.21.15.125:0/1745604380 >> 172.21.15.125:0/1745604380 conn(0x7fb1e40a6610 msgr2=0x7fb1e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 -- 172.21.15.125:0/1745604380 shutdown_connections 2023-10-03T10:13:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.794+0000 7fb1e97a4700 1 -- 172.21.15.125:0/1745604380 wait complete. 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 Processor -- start 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 -- start start 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 0x7fb1e411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 0x7fb1e411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41219d0 con 0x7fb1e4139200 2023-10-03T10:13:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a5100 con 0x7fb1e40a1550 2023-10-03T10:13:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e97a4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a03e0 con 0x7fb1e40a0a70 2023-10-03T10:13:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 0x7fb1e411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 0x7fb1e411e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39558/0 (socket says 172.21.15.125:39558) 2023-10-03T10:13:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45366/0 (socket says 172.21.15.125:45366) 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e2ffd700 1 -- 172.21.15.125:0/3143380422 learned_addr learned my addr 172.21.15.125:0/3143380422 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.795+0000 7fb1e37fe700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 0x7fb1e411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 -- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 msgr2=0x7fb1e411e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 0x7fb1e411e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 -- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 msgr2=0x7fb1e411ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 -- 172.21.15.125:0/3143380422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc009a70 con 0x7fb1e4139200 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e27fc700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e37fe700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 0x7fb1e411f1f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ef90 tx=0x7fb1dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00ca90 con 0x7fb1e4139200 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00f040 con 0x7fb1e4139200 2023-10-03T10:13:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80094a0 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00ce30 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.796+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e4120ae0 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.797+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1dc014480 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.797+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1dc03fbd0 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.797+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e404f2a0 con 0x7fb1e4139200 2023-10-03T10:13:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.802+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1dc012930 con 0x7fb1e4139200 2023-10-03T10:13:35.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.835+0000 7f6827d5d700 1 Processor -- start 2023-10-03T10:13:35.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.835+0000 7f6827d5d700 1 -- start start 2023-10-03T10:13:35.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6827d5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 0x7f6820138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6827d5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 0x7f682013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6827d5d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682009b110 con 0x7f682009ad40 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6827d5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200a3b60 con 0x7f6820134570 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6827d5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68200a1a80 con 0x7f6820134140 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6825af9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f682009ad40 0x7f6820133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33702/0 (socket says 172.21.15.125:33702) 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6825af9700 1 -- 172.21.15.125:0/903670734 learned_addr learned my addr 172.21.15.125:0/903670734 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68262fa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 0x7f682013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68252f8700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 0x7f6820138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68262fa700 1 -- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 msgr2=0x7f6820138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68262fa700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 0x7f6820138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68262fa700 1 -- 172.21.15.125:0/903670734 >> v1:172.21.15.125:6789/0 conn(0x7f682009ad40 legacy=0x7f6820133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f6824af7700 1 -- 172.21.15.125:0/903670734 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122018363 0 0) 0x7f682009b110 con 0x7f682009ad40 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68262fa700 1 -- 172.21.15.125:0/903670734 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200a2fa0 con 0x7f6820134570 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.836+0000 7f68252f8700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 0x7f6820138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f68262fa700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 0x7f682013b3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6818009df0 tx=0x7f681800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e338185762c9b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6824af7700 1 -- 172.21.15.125:0/903670734 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800e070 con 0x7f6820134570 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6824af7700 1 -- 172.21.15.125:0/903670734 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800bae0 con 0x7f6820134570 2023-10-03T10:13:35.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6824af7700 1 -- 172.21.15.125:0/903670734 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800be90 con 0x7f6820134570 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 -- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 msgr2=0x7f682013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 0x7f682013b3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6818009df0 tx=0x7f681800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 -- 172.21.15.125:0/903670734 shutdown_connections 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6820134570 0x7f682013b3d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 --2- 172.21.15.125:0/903670734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134140 0x7f6820138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 -- 172.21.15.125:0/903670734 >> 172.21.15.125:0/903670734 conn(0x7f6820099c40 msgr2=0x7f682006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.837+0000 7f6827d5d700 1 -- 172.21.15.125:0/903670734 shutdown_connections 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.838+0000 7f6827d5d700 1 -- 172.21.15.125:0/903670734 wait complete. 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.838+0000 7f6827d5d700 1 Processor -- start 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.838+0000 7f6827d5d700 1 -- start start 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f682009ad40 0x7f6820139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 0x7f6820139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682011cf70 con 0x7f6820134140 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682011ea90 con 0x7f682009ad40 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6827d5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f682009e490 con 0x7f6820134570 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59880/0 (socket says 172.21.15.125:59880) 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 -- 172.21.15.125:0/2790489605 learned_addr learned my addr 172.21.15.125:0/2790489605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f6825af9700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f682009ad40 0x7f6820139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68262fa700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 0x7f6820139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 -- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 msgr2=0x7f6820139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 0x7f6820139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 -- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f682009ad40 msgr2=0x7f6820139420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f682009ad40 0x7f6820139420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 -- 172.21.15.125:0/2790489605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100094a0 con 0x7f6820134140 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68262fa700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 0x7f6820139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.839+0000 7f68252f8700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f681000ebe0 tx=0x7f681000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000c850 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681000c9b0 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6818009a70 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000cd40 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682011d650 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6810013470 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.840+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f681003f7e0 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.841+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68201361e0 con 0x7f6820134140 2023-10-03T10:13:35.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.845+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6810013720 con 0x7f6820134140 2023-10-03T10:13:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.998+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1e4072980 con 0x7fb1e4139200 2023-10-03T10:13:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:35.998+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/3143380422 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1dc012340 con 0x7fb1e4139200 2023-10-03T10:13:35.999 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:36.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 msgr2=0x7fb1e411f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 0x7fb1e411f1f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ef90 tx=0x7fb1dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 shutdown_connections 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e4139200 0x7fb1e411f1f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e40a0a70 0x7fb1e411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 --2- 172.21.15.125:0/3143380422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e40a1550 0x7fb1e411ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 >> 172.21.15.125:0/3143380422 conn(0x7fb1e40a6610 msgr2=0x7fb1e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 shutdown_connections 2023-10-03T10:13:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.000+0000 7fb1e97a4700 1 -- 172.21.15.125:0/3143380422 wait complete. 2023-10-03T10:13:36.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:36.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.038+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f682004f2a0 con 0x7f6820134140 2023-10-03T10:13:36.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.038+0000 7f68167fc700 1 -- 172.21.15.125:0/2790489605 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f681001b9c0 con 0x7f6820134140 2023-10-03T10:13:36.038 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 msgr2=0x7f6820139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f681000ebe0 tx=0x7f681000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 shutdown_connections 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6820134570 0x7f6820139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f682009ad40 0x7f6820139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 --2- 172.21.15.125:0/2790489605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6820134140 0x7f6820139960 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 >> 172.21.15.125:0/2790489605 conn(0x7f6820099c40 msgr2=0x7f682013b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 shutdown_connections 2023-10-03T10:13:36.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.040+0000 7f6827d5d700 1 -- 172.21.15.125:0/2790489605 wait complete. 2023-10-03T10:13:36.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:36.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:36.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.717+0000 7f3530d70700 1 Processor -- start 2023-10-03T10:13:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.717+0000 7f3530d70700 1 -- start start 2023-10-03T10:13:36.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 0x7f352c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c09e9d0 con 0x7f352c133f50 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c09dc00 con 0x7f352c0a1380 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3530d70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f352c09dec0 con 0x7f352c0a0a70 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3529d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 0x7f352c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59886/0 (socket says 172.21.15.125:59886) 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39598/0 (socket says 172.21.15.125:39598) 2023-10-03T10:13:36.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f3529d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 0x7f352c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45396/0 (socket says 172.21.15.125:45396) 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352ad9d700 1 -- 172.21.15.125:0/2144021774 learned_addr learned my addr 172.21.15.125:0/2144021774 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352a59c700 1 -- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 msgr2=0x7f352c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.718+0000 7f352a59c700 1 --2- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 0x7f352c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352a59c700 1 -- 172.21.15.125:0/2144021774 >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 msgr2=0x7f352c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352a59c700 1 --2- 172.21.15.125:0/2144021774 >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352a59c700 1 -- 172.21.15.125:0/2144021774 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c09e6a0 con 0x7f352c0a0a70 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352ad9d700 1 --2- 172.21.15.125:0/2144021774 >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352a59c700 1 --2- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f351c009840 tx=0x7f351c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25987f8167548826 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352959a700 1 -- 172.21.15.125:0/2144021774 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c011830 con 0x7f352c0a0a70 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352959a700 1 -- 172.21.15.125:0/2144021774 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c011990 con 0x7f352c0a0a70 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f352959a700 1 -- 172.21.15.125:0/2144021774 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c011d20 con 0x7f352c0a0a70 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f3530d70700 1 -- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 msgr2=0x7f352c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.719+0000 7f3530d70700 1 --2- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f351c009840 tx=0x7f351c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 -- 172.21.15.125:0/2144021774 shutdown_connections 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 --2- 172.21.15.125:0/2144021774 >> v2:172.21.15.125:3300/0 conn(0x7f352c133f50 0x7f352c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 --2- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a0a70 0x7f352c0a0e40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 --2- 172.21.15.125:0/2144021774 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c0a1380 0x7f352c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 -- 172.21.15.125:0/2144021774 >> 172.21.15.125:0/2144021774 conn(0x7f352c0a6610 msgr2=0x7f352c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 -- 172.21.15.125:0/2144021774 shutdown_connections 2023-10-03T10:13:36.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.720+0000 7f3530d70700 1 -- 172.21.15.125:0/2144021774 wait complete. 2023-10-03T10:13:36.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 Processor -- start 2023-10-03T10:13:36.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 -- start start 2023-10-03T10:13:36.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 0x7f352c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 0x7f352c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c133a90 con 0x7f352c0a0a70 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c1253a0 con 0x7f352c133f50 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3530d70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f352c124fe0 con 0x7f352c0a1380 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f352a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f352ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 0x7f352c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f352a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59898/0 (socket says 172.21.15.125:59898) 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f3529d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 0x7f352c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.721+0000 7f352a59c700 1 -- 172.21.15.125:0/3775195085 learned_addr learned my addr 172.21.15.125:0/3775195085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 -- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 msgr2=0x7f352c122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 0x7f352c122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 -- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 msgr2=0x7f352c122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 -- 172.21.15.125:0/3775195085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009b30 con 0x7f352c133f50 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352a59c700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f3529d9b700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 0x7f352c122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f352ad9d700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 0x7f352c122fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f352400efc0 tx=0x7f352400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524018070 con 0x7f352c133f50 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400f040 con 0x7f352c133f50 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524003c60 con 0x7f352c133f50 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c0094a0 con 0x7f352c133f50 2023-10-03T10:13:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.722+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c125ac0 con 0x7f352c133f50 2023-10-03T10:13:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.723+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f352400c880 con 0x7f352c133f50 2023-10-03T10:13:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.723+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c04f2a0 con 0x7f352c133f50 2023-10-03T10:13:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.723+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f352403f730 con 0x7f352c133f50 2023-10-03T10:13:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.727+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f352401cd90 con 0x7f352c133f50 2023-10-03T10:13:36.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.756+0000 7f143ec56700 1 Processor -- start 2023-10-03T10:13:36.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.756+0000 7f143ec56700 1 -- start start 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.756+0000 7f143ec56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143ec56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 0x7f14380a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143ec56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143809b110 con 0x7f1438133f70 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143ec56700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380a3b60 con 0x7f14381343a0 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143ec56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a2fa0 con 0x7f143809ad40 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143d1f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 0x7f14380a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39608/0 (socket says 172.21.15.125:39608) 2023-10-03T10:13:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143d1f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 0x7f14380a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59910/0 (socket says 172.21.15.125:59910) 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 -- 172.21.15.125:0/1356877001 learned_addr learned my addr 172.21.15.125:0/1356877001 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 -- 172.21.15.125:0/1356877001 >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 msgr2=0x7f14380a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 --2- 172.21.15.125:0/1356877001 >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 0x7f14380a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 -- 172.21.15.125:0/1356877001 >> v1:172.21.15.125:6789/0 conn(0x7f1438133f70 legacy=0x7f14380a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f14377fe700 1 -- 172.21.15.125:0/1356877001 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080672142 0 0) 0x7f143809b110 con 0x7f1438133f70 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 -- 172.21.15.125:0/1356877001 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143809a280 con 0x7f143809ad40 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f143c9f2700 1 --2- 172.21.15.125:0/1356877001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f142c009920 tx=0x7f142c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed657dbe0eb25891 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f14377fe700 1 -- 172.21.15.125:0/1356877001 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c011830 con 0x7f143809ad40 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f14377fe700 1 -- 172.21.15.125:0/1356877001 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c011990 con 0x7f143809ad40 2023-10-03T10:13:36.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.757+0000 7f14377fe700 1 -- 172.21.15.125:0/1356877001 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c011d20 con 0x7f143809ad40 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 -- 172.21.15.125:0/1356877001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 msgr2=0x7f1438133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 --2- 172.21.15.125:0/1356877001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f142c009920 tx=0x7f142c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 -- 172.21.15.125:0/1356877001 shutdown_connections 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 --2- 172.21.15.125:0/1356877001 >> v2:172.21.15.125:3300/0 conn(0x7f14381343a0 0x7f14380a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 --2- 172.21.15.125:0/1356877001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f143809ad40 0x7f1438133a30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 -- 172.21.15.125:0/1356877001 >> 172.21.15.125:0/1356877001 conn(0x7f1438099c40 msgr2=0x7f143806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 -- 172.21.15.125:0/1356877001 shutdown_connections 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.758+0000 7f143ec56700 1 -- 172.21.15.125:0/1356877001 wait complete. 2023-10-03T10:13:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 Processor -- start 2023-10-03T10:13:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 -- start start 2023-10-03T10:13:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f143809ad40 0x7f143811f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1438133f70 0x7f143811f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1438122620 con 0x7f14381343a0 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143809c7e0 con 0x7f143809ad40 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.759+0000 7f143ec56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1438120f40 con 0x7f1438133f70 2023-10-03T10:13:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59926/0 (socket says 172.21.15.125:59926) 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143c9f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f143809ad40 0x7f143811f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 -- 172.21.15.125:0/398477604 learned_addr learned my addr 172.21.15.125:0/398477604 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f1437fff700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1438133f70 0x7f143811f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 -- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1438133f70 msgr2=0x7f143811f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1438133f70 0x7f143811f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 -- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f143809ad40 msgr2=0x7f143811f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f143809ad40 0x7f143811f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 -- 172.21.15.125:0/398477604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009550 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143d1f3700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f143000efc0 tx=0x7f143000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430009ea0 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000f040 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430014480 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1438122ad0 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.760+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14380a4200 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.761+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14300145e0 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.761+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f143003fe90 con 0x7f14381343a0 2023-10-03T10:13:36.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.761+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14380a0430 con 0x7f14381343a0 2023-10-03T10:13:36.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.766+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f143006b750 con 0x7f14381343a0 2023-10-03T10:13:36.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.918+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f352c0a4830 con 0x7f352c133f50 2023-10-03T10:13:36.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.918+0000 7f351affd700 1 -- 172.21.15.125:0/3775195085 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f352401cbb0 con 0x7f352c133f50 2023-10-03T10:13:36.920 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 msgr2=0x7f352c122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 0x7f352c122fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f352400efc0 tx=0x7f352400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 shutdown_connections 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f352c133f50 0x7f352c122fc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f352c0a0a70 0x7f352c122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 --2- 172.21.15.125:0/3775195085 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f352c0a1380 0x7f352c122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 >> 172.21.15.125:0/3775195085 conn(0x7f352c0a6610 msgr2=0x7f352c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.920+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 shutdown_connections 2023-10-03T10:13:36.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.921+0000 7f3530d70700 1 -- 172.21.15.125:0/3775195085 wait complete. 2023-10-03T10:13:36.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.958+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f143804f2a0 con 0x7f14381343a0 2023-10-03T10:13:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.959+0000 7f14357fa700 1 -- 172.21.15.125:0/398477604 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1430018020 con 0x7f14381343a0 2023-10-03T10:13:36.959 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 msgr2=0x7f143811fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f143000efc0 tx=0x7f143000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 shutdown_connections 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14381343a0 0x7f143811fe60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f143809ad40 0x7f143811f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 --2- 172.21.15.125:0/398477604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1438133f70 0x7f143811f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 >> 172.21.15.125:0/398477604 conn(0x7f1438099c40 msgr2=0x7f143809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 shutdown_connections 2023-10-03T10:13:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:36.961+0000 7f143ec56700 1 -- 172.21.15.125:0/398477604 wait complete. 2023-10-03T10:13:36.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:37.014 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:37.053 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.139+0000 7fe995921700 1 Processor -- start 2023-10-03T10:13:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.139+0000 7fe995921700 1 -- start start 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe995921700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 0x7fe990133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe995921700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe995921700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99009b110 con 0x7fe990133f70 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe995921700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9900a3b60 con 0x7fe99009ad40 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe995921700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe990134850 con 0x7fe9901343d0 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 0x7fe990133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45422/0 (socket says 172.21.15.125:45422) 2023-10-03T10:13:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2569203786 learned_addr learned my addr 172.21.15.125:0/2569203786 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2569203786 >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 msgr2=0x7fe990133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 --2- 172.21.15.125:0/2569203786 >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 0x7fe990133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2569203786 >> v1:172.21.15.125:6789/0 conn(0x7fe990133f70 legacy=0x7fe9900a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2569203786 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900a2fa0 con 0x7fe9901343d0 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98dffb700 1 -- 172.21.15.125:0/2569203786 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273246125 0 0) 0x7fe99009b110 con 0x7fe990133f70 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98effd700 1 --2- 172.21.15.125:0/2569203786 >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 0x7fe990133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.140+0000 7fe98f7fe700 1 --2- 172.21.15.125:0/2569203786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe988009e50 tx=0x7fe98800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=112e0847058b0ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe98dffb700 1 -- 172.21.15.125:0/2569203786 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800e070 con 0x7fe9901343d0 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe98dffb700 1 -- 172.21.15.125:0/2569203786 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98800b910 con 0x7fe9901343d0 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe98dffb700 1 -- 172.21.15.125:0/2569203786 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800bcc0 con 0x7fe9901343d0 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 -- 172.21.15.125:0/2569203786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 msgr2=0x7fe9900a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 --2- 172.21.15.125:0/2569203786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe988009e50 tx=0x7fe98800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 -- 172.21.15.125:0/2569203786 shutdown_connections 2023-10-03T10:13:37.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 --2- 172.21.15.125:0/2569203786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9900a1180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 --2- 172.21.15.125:0/2569203786 >> v2:172.21.15.125:3300/0 conn(0x7fe99009ad40 0x7fe990133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 -- 172.21.15.125:0/2569203786 >> 172.21.15.125:0/2569203786 conn(0x7fe990099c40 msgr2=0x7fe99006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 -- 172.21.15.125:0/2569203786 shutdown_connections 2023-10-03T10:13:37.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.141+0000 7fe995921700 1 -- 172.21.15.125:0/2569203786 wait complete. 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.142+0000 7fe995921700 1 Processor -- start 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.142+0000 7fe995921700 1 -- start start 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe99009ad40 0x7fe99011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9901c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900a4230 con 0x7fe99009ad40 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9901223c0 con 0x7fe9901343d0 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe995921700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe990133510 con 0x7fe990133f70 2023-10-03T10:13:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9901c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39638/0 (socket says 172.21.15.125:39638) 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98e7fc700 1 -- 172.21.15.125:0/2611322821 learned_addr learned my addr 172.21.15.125:0/2611322821 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98effd700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe99009ad40 0x7fe99011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 msgr2=0x7fe99011f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe99009ad40 msgr2=0x7fe99011f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe99009ad40 0x7fe99011f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 -- 172.21.15.125:0/2611322821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800094a0 con 0x7fe9901343d0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98e7fc700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe98f7fe700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9901c8120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9900a31c0 tx=0x7fe988004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.143+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988004840 con 0x7fe9901343d0 2023-10-03T10:13:37.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.144+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9880092e0 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.144+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98801c660 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.144+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988009b30 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.144+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe990120f80 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.144+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe98801c7c0 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.145+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe988040e10 con 0x7fe9901343d0 2023-10-03T10:13:37.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.145+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99004f2a0 con 0x7fe9901343d0 2023-10-03T10:13:37.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.149+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9880123f0 con 0x7fe9901343d0 2023-10-03T10:13:37.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.183+0000 7ff2cc407700 1 Processor -- start 2023-10-03T10:13:37.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.183+0000 7ff2cc407700 1 -- start start 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2cc407700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 0x7ff2c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2cc407700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2c4134120 0x7ff2c413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2cc407700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c409dc00 con 0x7ff2c40a1380 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2cc407700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c409ea60 con 0x7ff2c4134120 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2cc407700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c409dec0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2ca1a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 0x7ff2c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2ca9a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2c4134120 0x7ff2c413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2c99a2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff2c40a1380 0x7ff2c4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33716/0 (socket says 172.21.15.125:33716) 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2c99a2700 1 -- 172.21.15.125:0/4007227886 learned_addr learned my addr 172.21.15.125:0/4007227886 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2ca9a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2c4134120 0x7ff2c413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59958/0 (socket says 172.21.15.125:59958) 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2c91a1700 1 -- 172.21.15.125:0/4007227886 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148308632 0 0) 0x7ff2c409dc00 con 0x7ff2c40a1380 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.184+0000 7ff2c91a1700 1 -- 172.21.15.125:0/4007227886 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b00035b0 con 0x7ff2c40a1380 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca9a4700 1 -- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 msgr2=0x7ff2c40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca9a4700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 0x7ff2c40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca9a4700 1 -- 172.21.15.125:0/4007227886 >> v1:172.21.15.125:6789/0 conn(0x7ff2c40a1380 legacy=0x7ff2c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca9a4700 1 -- 172.21.15.125:0/4007227886 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c409e6a0 con 0x7ff2c4134120 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca1a3700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 0x7ff2c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2ca9a4700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c413bce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009d90 tx=0x7ff2bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481742f53dfe0a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2c91a1700 1 -- 172.21.15.125:0/4007227886 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00e070 con 0x7ff2c4134120 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2c91a1700 1 -- 172.21.15.125:0/4007227886 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00bb20 con 0x7ff2c4134120 2023-10-03T10:13:37.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2c91a1700 1 -- 172.21.15.125:0/4007227886 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc012430 con 0x7ff2c4134120 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2cc407700 1 -- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 msgr2=0x7ff2c413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.185+0000 7ff2cc407700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c413bce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009d90 tx=0x7ff2bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 -- 172.21.15.125:0/4007227886 shutdown_connections 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c413bce0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 --2- 172.21.15.125:0/4007227886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a0a70 0x7ff2c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 -- 172.21.15.125:0/4007227886 >> 172.21.15.125:0/4007227886 conn(0x7ff2c40a6610 msgr2=0x7ff2c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 -- 172.21.15.125:0/4007227886 shutdown_connections 2023-10-03T10:13:37.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 -- 172.21.15.125:0/4007227886 wait complete. 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 Processor -- start 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.186+0000 7ff2cc407700 1 -- start start 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 0x7ff2c4122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a1380 0x7ff2c4122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4124e10 con 0x7ff2c4134120 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4133880 con 0x7ff2c40a1380 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2cc407700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4126170 con 0x7ff2c40a0a70 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2c99a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a1380 0x7ff2c4122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca9a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca9a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59964/0 (socket says 172.21.15.125:59964) 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 0x7ff2c4122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca9a4700 1 -- 172.21.15.125:0/3480458157 learned_addr learned my addr 172.21.15.125:0/3480458157 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 -- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a1380 msgr2=0x7ff2c4122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a1380 0x7ff2c4122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 -- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 msgr2=0x7ff2c41233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca1a3700 1 -- 172.21.15.125:0/3480458157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00094a0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.187+0000 7ff2ca9a4700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2ca1a3700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 0x7ff2c4122930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e9e0 tx=0x7ff2c000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000ee80 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000c850 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc009a70 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000cc00 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4126be0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.188+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2c000cd60 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.189+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2c003f710 con 0x7ff2c40a0a70 2023-10-03T10:13:37.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.189+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c41263b0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.193+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2c001be10 con 0x7ff2c40a0a70 2023-10-03T10:13:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.339+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe990120790 con 0x7fe9901343d0 2023-10-03T10:13:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.339+0000 7fe977fff700 1 -- 172.21.15.125:0/2611322821 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe988034090 con 0x7fe9901343d0 2023-10-03T10:13:37.340 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 msgr2=0x7fe9901c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9901c8120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9900a31c0 tx=0x7fe988004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 shutdown_connections 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9901343d0 0x7fe9901c8120 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe99009ad40 0x7fe99011f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 --2- 172.21.15.125:0/2611322821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe990133f70 0x7fe99011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 >> 172.21.15.125:0/2611322821 conn(0x7fe990099c40 msgr2=0x7fe9901bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 shutdown_connections 2023-10-03T10:13:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.342+0000 7fe995921700 1 -- 172.21.15.125:0/2611322821 wait complete. 2023-10-03T10:13:37.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.382+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2c404f2a0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.382+0000 7ff2baffd700 1 -- 172.21.15.125:0/3480458157 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2c001b3b0 con 0x7ff2c40a0a70 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 msgr2=0x7ff2c4122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 0x7ff2c4122930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e9e0 tx=0x7ff2c000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 shutdown_connections 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2c4134120 0x7ff2c41233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2c40a0a70 0x7ff2c4122930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 --2- 172.21.15.125:0/3480458157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2c40a1380 0x7ff2c4122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 >> 172.21.15.125:0/3480458157 conn(0x7ff2c40a6610 msgr2=0x7ff2c40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 shutdown_connections 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:37.384+0000 7ff2cc407700 1 -- 172.21.15.125:0/3480458157 wait complete. 2023-10-03T10:13:37.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:37.934 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:37.974 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 Processor -- start 2023-10-03T10:13:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 -- start start 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144c09dc00 con 0x7f144c0a1380 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c09ea90 con 0x7f144c0a0a70 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.064+0000 7f1451b27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f144c09dec0 con 0x7f144c134120 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f144c0a1380 0x7f144c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33724/0 (socket says 172.21.15.125:33724) 2023-10-03T10:13:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144affd700 1 -- 172.21.15.125:0/3690616745 learned_addr learned my addr 172.21.15.125:0/3690616745 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45442/0 (socket says 172.21.15.125:45442) 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 -- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 msgr2=0x7f144c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 -- 172.21.15.125:0/3690616745 >> v1:172.21.15.125:6789/0 conn(0x7f144c0a1380 legacy=0x7f144c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144a7fc700 1 -- 172.21.15.125:0/3690616745 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712436035 0 0) 0x7f144c09dc00 con 0x7f144c0a1380 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 -- 172.21.15.125:0/3690616745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c09e6a0 con 0x7f144c134120 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144b7fe700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144bfff700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c13bce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f143c009dc0 tx=0x7f143c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=554f61dd480800a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144a7fc700 1 -- 172.21.15.125:0/3690616745 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00e070 con 0x7f144c134120 2023-10-03T10:13:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144a7fc700 1 -- 172.21.15.125:0/3690616745 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c00bb20 con 0x7f144c134120 2023-10-03T10:13:38.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.065+0000 7f144a7fc700 1 -- 172.21.15.125:0/3690616745 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c012430 con 0x7f144c134120 2023-10-03T10:13:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 -- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 msgr2=0x7f144c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c13bce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f143c009dc0 tx=0x7f143c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 -- 172.21.15.125:0/3690616745 shutdown_connections 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c13bce0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 --2- 172.21.15.125:0/3690616745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 -- 172.21.15.125:0/3690616745 >> 172.21.15.125:0/3690616745 conn(0x7f144c0a6610 msgr2=0x7f144c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 -- 172.21.15.125:0/3690616745 shutdown_connections 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.066+0000 7f1451b27700 1 -- 172.21.15.125:0/3690616745 wait complete. 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.067+0000 7f1451b27700 1 Processor -- start 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 -- start start 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 0x7f144c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1258f0 con 0x7f144c0a1380 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c133640 con 0x7f144c0a0a70 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f1451b27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1262f0 con 0x7f144c134120 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f144bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f144b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f144affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 0x7f144c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f144bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39656/0 (socket says 172.21.15.125:39656) 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.068+0000 7f144bfff700 1 -- 172.21.15.125:0/3563249195 learned_addr learned my addr 172.21.15.125:0/3563249195 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 -- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 msgr2=0x7f144c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 -- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 msgr2=0x7f144c122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 0x7f144c122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 -- 172.21.15.125:0/3563249195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440094a0 con 0x7f144c0a0a70 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144bfff700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144affd700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 0x7f144c122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f144b7fe700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c122890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f144400e9b0 tx=0x7f144400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400ee50 con 0x7f144c0a0a70 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144400c850 con 0x7f144c0a0a70 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c009a70 con 0x7f144c0a0a70 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400cc00 con 0x7f144c0a0a70 2023-10-03T10:13:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.069+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c0a0430 con 0x7f144c0a0a70 2023-10-03T10:13:38.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.070+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1444013470 con 0x7f144c0a0a70 2023-10-03T10:13:38.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.070+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f144403f740 con 0x7f144c0a0a70 2023-10-03T10:13:38.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.070+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144c125ae0 con 0x7f144c0a0a70 2023-10-03T10:13:38.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.075+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1444013720 con 0x7f144c0a0a70 2023-10-03T10:13:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 Processor -- start 2023-10-03T10:13:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 -- start start 2023-10-03T10:13:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09e870 0x7f55bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55bc09f180 0x7f55bc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc09c970 con 0x7f55bc131d70 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0a0920 con 0x7f55bc09f180 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.118+0000 7f55c3a81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc09f9c0 con 0x7f55bc09e870 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55bc09f180 0x7f55bc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c181d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09e870 0x7f55bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55bc09f180 0x7f55bc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59984/0 (socket says 172.21.15.125:59984) 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 -- 172.21.15.125:0/482886084 learned_addr learned my addr 172.21.15.125:0/482886084 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 -- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09e870 msgr2=0x7f55bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 --2- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09e870 0x7f55bc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 -- 172.21.15.125:0/482886084 >> v1:172.21.15.125:6789/0 conn(0x7f55bc131d70 legacy=0x7f55bc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c081b700 1 -- 172.21.15.125:0/482886084 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254476492 0 0) 0x7f55bc09c970 con 0x7f55bc131d70 2023-10-03T10:13:38.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 -- 172.21.15.125:0/482886084 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc09bab0 con 0x7f55bc09f180 2023-10-03T10:13:38.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c101c700 1 --2- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09f180 0x7f55bc131830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098f0 tx=0x7f55ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1069e4c1eeabb891 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c081b700 1 -- 172.21.15.125:0/482886084 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011830 con 0x7f55bc09f180 2023-10-03T10:13:38.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c081b700 1 -- 172.21.15.125:0/482886084 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac011990 con 0x7f55bc09f180 2023-10-03T10:13:38.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.119+0000 7f55c081b700 1 -- 172.21.15.125:0/482886084 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011d20 con 0x7f55bc09f180 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 -- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09f180 msgr2=0x7f55bc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 --2- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09f180 0x7f55bc131830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098f0 tx=0x7f55ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 -- 172.21.15.125:0/482886084 shutdown_connections 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 --2- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09e870 0x7f55bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 --2- 172.21.15.125:0/482886084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09f180 0x7f55bc131830 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 -- 172.21.15.125:0/482886084 >> 172.21.15.125:0/482886084 conn(0x7f55bc0a4430 msgr2=0x7f55bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 -- 172.21.15.125:0/482886084 shutdown_connections 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.120+0000 7f55c3a81700 1 -- 172.21.15.125:0/482886084 wait complete. 2023-10-03T10:13:38.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.121+0000 7f55c3a81700 1 Processor -- start 2023-10-03T10:13:38.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.121+0000 7f55c3a81700 1 -- start start 2023-10-03T10:13:38.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 0x7f55bc11ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55bc131d70 0x7f55bc11b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc11f2e0 con 0x7f55bc09e870 2023-10-03T10:13:38.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc11ca10 con 0x7f55bc09f180 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c3a81700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc11d030 con 0x7f55bc131d70 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c181d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 0x7f55bc11ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45480/0 (socket says 172.21.15.125:45480) 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 -- 172.21.15.125:0/3218475330 learned_addr learned my addr 172.21.15.125:0/3218475330 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c201e700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55bc131d70 0x7f55bc11b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 -- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55bc131d70 msgr2=0x7f55bc11b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55bc131d70 0x7f55bc11b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 -- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 msgr2=0x7f55bc11ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 0x7f55bc11ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c101c700 1 -- 172.21.15.125:0/3218475330 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac009550 con 0x7f55bc09f180 2023-10-03T10:13:38.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.122+0000 7f55c181d700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 0x7f55bc11ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55c101c700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f55ac013000 tx=0x7f55ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac004300 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac01f070 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc11dc60 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0036a0 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc0a29d0 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.123+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55ac021030 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.124+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc09dba0 con 0x7f55bc09f180 2023-10-03T10:13:38.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.124+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55ac040a00 con 0x7f55bc09f180 2023-10-03T10:13:38.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.128+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55ac0199a0 con 0x7f55bc09f180 2023-10-03T10:13:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.305+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f144c126a60 con 0x7f144c0a0a70 2023-10-03T10:13:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.305+0000 7f1443fff700 1 -- 172.21.15.125:0/3563249195 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1444021030 con 0x7f144c0a0a70 2023-10-03T10:13:38.306 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 msgr2=0x7f144c122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c122890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f144400e9b0 tx=0x7f144400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 shutdown_connections 2023-10-03T10:13:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f144c134120 0x7f144c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144c0a0a70 0x7f144c122890 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 --2- 172.21.15.125:0/3563249195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144c0a1380 0x7f144c122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 >> 172.21.15.125:0/3563249195 conn(0x7f144c0a6610 msgr2=0x7f144c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 shutdown_connections 2023-10-03T10:13:38.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.307+0000 7f1451b27700 1 -- 172.21.15.125:0/3563249195 wait complete. 2023-10-03T10:13:38.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:38.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.335+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55bc04f2a0 con 0x7f55bc09f180 2023-10-03T10:13:38.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.335+0000 7f55b27fc700 1 -- 172.21.15.125:0/3218475330 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55ac0193b0 con 0x7f55bc09f180 2023-10-03T10:13:38.336 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 msgr2=0x7f55bc11b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f55ac013000 tx=0x7f55ac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 shutdown_connections 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55bc131d70 0x7f55bc11b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55bc09e870 0x7f55bc11ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 --2- 172.21.15.125:0/3218475330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55bc09f180 0x7f55bc11b340 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 >> 172.21.15.125:0/3218475330 conn(0x7f55bc0a4430 msgr2=0x7f55bc12fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 shutdown_connections 2023-10-03T10:13:38.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.337+0000 7f55c3a81700 1 -- 172.21.15.125:0/3218475330 wait complete. 2023-10-03T10:13:38.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:38.355 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:38.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:38.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 Processor -- start 2023-10-03T10:13:38.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 -- start start 2023-10-03T10:13:38.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4480a0a70 0x7ff4480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 0x7ff4481343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44809e9d0 con 0x7ff4480a0a70 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44809dc00 con 0x7ff448133f50 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.515+0000 7ff450132700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44809dec0 con 0x7ff4480a1380 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4480a0a70 0x7ff4480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44d6cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44e6cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 0x7ff4481343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4480a0a70 0x7ff4480a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60004/0 (socket says 172.21.15.125:60004) 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44d6cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39664/0 (socket says 172.21.15.125:39664) 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 -- 172.21.15.125:0/3326724102 learned_addr learned my addr 172.21.15.125:0/3326724102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 -- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 msgr2=0x7ff448133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 -- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 msgr2=0x7ff4481343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 0x7ff4481343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 -- 172.21.15.125:0/3326724102 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44809e6a0 con 0x7ff4480a0a70 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44e6cf700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 0x7ff4481343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44d6cd700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44dece700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4480a0a70 0x7ff4480a0e40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098f0 tx=0x7ff444009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d1621d5bbe40d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44cecc700 1 -- 172.21.15.125:0/3326724102 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011830 con 0x7ff4480a0a70 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44cecc700 1 -- 172.21.15.125:0/3326724102 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444011990 con 0x7ff4480a0a70 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.516+0000 7ff44cecc700 1 -- 172.21.15.125:0/3326724102 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011d20 con 0x7ff4480a0a70 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 -- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4480a0a70 msgr2=0x7ff4480a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4480a0a70 0x7ff4480a0e40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098f0 tx=0x7ff444009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 -- 172.21.15.125:0/3326724102 shutdown_connections 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff448133f50 0x7ff4481343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4480a0a70 0x7ff4480a0e40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 --2- 172.21.15.125:0/3326724102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff448133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 -- 172.21.15.125:0/3326724102 >> 172.21.15.125:0/3326724102 conn(0x7ff4480a6610 msgr2=0x7ff4480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 -- 172.21.15.125:0/3326724102 shutdown_connections 2023-10-03T10:13:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.517+0000 7ff450132700 1 -- 172.21.15.125:0/3326724102 wait complete. 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 Processor -- start 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 -- start start 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4480a0a70 0x7ff448121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 0x7ff448121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448132830 con 0x7ff448133f50 2023-10-03T10:13:38.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481228c0 con 0x7ff4480a0a70 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff450132700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff448123f00 con 0x7ff4480a1380 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff44d6cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff44e6cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 0x7ff448121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff44d6cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39670/0 (socket says 172.21.15.125:39670) 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff44d6cd700 1 -- 172.21.15.125:0/933042864 learned_addr learned my addr 172.21.15.125:0/933042864 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.518+0000 7ff44dece700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4480a0a70 0x7ff448121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 -- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4480a0a70 msgr2=0x7ff448121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4480a0a70 0x7ff448121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 -- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 msgr2=0x7ff448121ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 0x7ff448121ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 -- 172.21.15.125:0/933042864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380094a0 con 0x7ff4480a1380 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44e6cf700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 0x7ff448121ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff44d6cd700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ec10 tx=0x7ff43800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438009780 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800c850 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440009a70 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800cbe0 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.519+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff444009550 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.520+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44811e040 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.520+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff43800cd40 con 0x7ff4480a1380 2023-10-03T10:13:38.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.520+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff43803ff80 con 0x7ff4480a1380 2023-10-03T10:13:38.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.528+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff438011350 con 0x7ff4480a1380 2023-10-03T10:13:38.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.561+0000 7f6bd932e700 1 Processor -- start 2023-10-03T10:13:38.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.561+0000 7f6bd932e700 1 -- start start 2023-10-03T10:13:38.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.561+0000 7f6bd932e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.561+0000 7f6bd932e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bd40a1380 0x7f6bd4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd932e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd409dc00 con 0x7f6bd4133f50 2023-10-03T10:13:38.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd932e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd409ea60 con 0x7f6bd40a1380 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd932e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd409dec0 con 0x7f6bd40a0a70 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bd40a1380 0x7f6bd4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39686/0 (socket says 172.21.15.125:39686) 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6bd4133f50 0x7f6bd413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33750/0 (socket says 172.21.15.125:33750) 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 -- 172.21.15.125:0/2512195102 learned_addr learned my addr 172.21.15.125:0/2512195102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 -- 172.21.15.125:0/2512195102 >> v2:172.21.15.125:3300/0 conn(0x7f6bd40a1380 msgr2=0x7f6bd4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd1ffb700 1 -- 172.21.15.125:0/2512195102 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649616288 0 0) 0x7f6bd409dc00 con 0x7f6bd4133f50 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 --2- 172.21.15.125:0/2512195102 >> v2:172.21.15.125:3300/0 conn(0x7f6bd40a1380 0x7f6bd4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 -- 172.21.15.125:0/2512195102 >> v1:172.21.15.125:6789/0 conn(0x7f6bd4133f50 legacy=0x7f6bd413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 -- 172.21.15.125:0/2512195102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd409e6a0 con 0x7f6bd40a0a70 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd2ffd700 1 --2- 172.21.15.125:0/2512195102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098f0 tx=0x7f6bc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c26a8070b3d9d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd1ffb700 1 -- 172.21.15.125:0/2512195102 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011830 con 0x7f6bd40a0a70 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd1ffb700 1 -- 172.21.15.125:0/2512195102 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4011990 con 0x7f6bd40a0a70 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.562+0000 7f6bd1ffb700 1 -- 172.21.15.125:0/2512195102 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011d20 con 0x7f6bd40a0a70 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 -- 172.21.15.125:0/2512195102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 msgr2=0x7f6bd40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 --2- 172.21.15.125:0/2512195102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098f0 tx=0x7f6bc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 -- 172.21.15.125:0/2512195102 shutdown_connections 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 --2- 172.21.15.125:0/2512195102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a0a70 0x7f6bd40a0e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 --2- 172.21.15.125:0/2512195102 >> v2:172.21.15.125:3300/0 conn(0x7f6bd40a1380 0x7f6bd4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 -- 172.21.15.125:0/2512195102 >> 172.21.15.125:0/2512195102 conn(0x7f6bd40a6610 msgr2=0x7f6bd40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 -- 172.21.15.125:0/2512195102 shutdown_connections 2023-10-03T10:13:38.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.563+0000 7f6bd932e700 1 -- 172.21.15.125:0/2512195102 wait complete. 2023-10-03T10:13:38.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 Processor -- start 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 -- start start 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 0x7f6bd41228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 0x7f6bd4123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4126060 con 0x7f6bd40a0a70 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4124540 con 0x7f6bd4133f50 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd932e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4133aa0 con 0x7f6bd40a1380 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd27fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39692/0 (socket says 172.21.15.125:39692) 2023-10-03T10:13:38.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd27fc700 1 -- 172.21.15.125:0/1554418639 learned_addr learned my addr 172.21.15.125:0/1554418639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd37fe700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 0x7f6bd4123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.564+0000 7f6bd2ffd700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 0x7f6bd41228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 -- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 msgr2=0x7f6bd4123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 0x7f6bd4123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 -- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 msgr2=0x7f6bd41228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 0x7f6bd41228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 -- 172.21.15.125:0/1554418639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009550 con 0x7f6bd40a1380 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd37fe700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 0x7f6bd4123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd2ffd700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 0x7f6bd41228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd27fc700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800e980 tx=0x7f6bc800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8009710 con 0x7f6bd40a1380 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc800c690 con 0x7f6bd40a1380 2023-10-03T10:13:38.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd40a03e0 con 0x7f6bd40a1380 2023-10-03T10:13:38.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800ca20 con 0x7f6bd40a1380 2023-10-03T10:13:38.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.565+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd4126ad0 con 0x7f6bd40a1380 2023-10-03T10:13:38.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.566+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bc800cb80 con 0x7f6bd40a1380 2023-10-03T10:13:38.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.566+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd404f2a0 con 0x7f6bd40a1380 2023-10-03T10:13:38.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.566+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bc803fa60 con 0x7f6bd40a1380 2023-10-03T10:13:38.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.571+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bc801b3b0 con 0x7f6bd40a1380 2023-10-03T10:13:38.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.715+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff448124ac0 con 0x7ff4480a1380 2023-10-03T10:13:38.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.715+0000 7ff43e7fc700 1 -- 172.21.15.125:0/933042864 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff438021070 con 0x7ff4480a1380 2023-10-03T10:13:38.716 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:38.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 msgr2=0x7ff4481219a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ec10 tx=0x7ff43800ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:38.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 shutdown_connections 2023-10-03T10:13:38.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff448133f50 0x7ff448121ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4480a0a70 0x7ff448121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 --2- 172.21.15.125:0/933042864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4480a1380 0x7ff4481219a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.717+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 >> 172.21.15.125:0/933042864 conn(0x7ff4480a6610 msgr2=0x7ff44809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.718+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 shutdown_connections 2023-10-03T10:13:38.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.718+0000 7ff450132700 1 -- 172.21.15.125:0/933042864 wait complete. 2023-10-03T10:13:38.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:38.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.759+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bd4072980 con 0x7f6bd40a1380 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.760+0000 7f6bbb7fe700 1 -- 172.21.15.125:0/1554418639 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bc8017070 con 0x7f6bd40a1380 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 msgr2=0x7f6bd4122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800e980 tx=0x7f6bc800ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 shutdown_connections 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd4133f50 0x7f6bd4123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd40a0a70 0x7f6bd41228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 --2- 172.21.15.125:0/1554418639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bd40a1380 0x7f6bd4122df0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.761+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 >> 172.21.15.125:0/1554418639 conn(0x7f6bd40a6610 msgr2=0x7f6bd409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.762+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 shutdown_connections 2023-10-03T10:13:38.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:38.762+0000 7f6bd932e700 1 -- 172.21.15.125:0/1554418639 wait complete. 2023-10-03T10:13:38.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:39.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:39.350 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.446+0000 7f79336e5700 1 Processor -- start 2023-10-03T10:13:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 -- start start 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c09f180 0x7f792c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c06ce60 con 0x7f792c1341d0 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c06bec0 con 0x7f792c09f180 2023-10-03T10:13:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f79336e5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f792c09fa00 con 0x7f792c09e870 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931c82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7930c80700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c09f180 0x7f792c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39708/0 (socket says 172.21.15.125:39708) 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931c82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60032/0 (socket says 172.21.15.125:60032) 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 -- 172.21.15.125:0/2045032752 learned_addr learned my addr 172.21.15.125:0/2045032752 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 -- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c09f180 msgr2=0x7f792c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 --2- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c09f180 0x7f792c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 -- 172.21.15.125:0/2045032752 >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 msgr2=0x7f792c134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 --2- 172.21.15.125:0/2045032752 >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931481700 1 -- 172.21.15.125:0/2045032752 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c09ad80 con 0x7f792c09e870 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.447+0000 7f7931c82700 1 --2- 172.21.15.125:0/2045032752 >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f7931481700 1 --2- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7928009920 tx=0x7f7928009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2563ea516fca19b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f7923fff700 1 -- 172.21.15.125:0/2045032752 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928011830 con 0x7f792c09e870 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f7923fff700 1 -- 172.21.15.125:0/2045032752 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928011990 con 0x7f792c09e870 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f7923fff700 1 -- 172.21.15.125:0/2045032752 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928011d20 con 0x7f792c09e870 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 -- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 msgr2=0x7f792c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 --2- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7928009920 tx=0x7f7928009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 -- 172.21.15.125:0/2045032752 shutdown_connections 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 --2- 172.21.15.125:0/2045032752 >> v2:172.21.15.125:3300/0 conn(0x7f792c1341d0 0x7f792c134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 --2- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c09ec40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 --2- 172.21.15.125:0/2045032752 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c09f180 0x7f792c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.448+0000 7f79336e5700 1 -- 172.21.15.125:0/2045032752 >> 172.21.15.125:0/2045032752 conn(0x7f792c0a4430 msgr2=0x7f792c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.449+0000 7f79336e5700 1 -- 172.21.15.125:0/2045032752 shutdown_connections 2023-10-03T10:13:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.449+0000 7f79336e5700 1 -- 172.21.15.125:0/2045032752 wait complete. 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 Processor -- start 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 -- start start 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c1227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c1341d0 0x7f792c123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c124930 con 0x7f792c09f180 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c125590 con 0x7f792c1341d0 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f79336e5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f792c06cfd0 con 0x7f792c09e870 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.450+0000 7f7930c80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c1227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7930c80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60038/0 (socket says 172.21.15.125:60038) 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7930c80700 1 -- 172.21.15.125:0/301239671 learned_addr learned my addr 172.21.15.125:0/301239671 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931c82700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c1341d0 0x7f792c123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 -- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c1341d0 msgr2=0x7f792c123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c1341d0 0x7f792c123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 -- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 msgr2=0x7f792c122d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 -- 172.21.15.125:0/301239671 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009a70 con 0x7f792c09e870 2023-10-03T10:13:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7930c80700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7931481700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c1227d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7928016000 tx=0x7f7928004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928004240 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792801f070 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7928009550 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79280045e0 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.451+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c126280 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.452+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c09d490 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.453+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7928021030 con 0x7f792c09e870 2023-10-03T10:13:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.453+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7928040b40 con 0x7f792c09e870 2023-10-03T10:13:39.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.457+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7928023810 con 0x7f792c09e870 2023-10-03T10:13:39.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 Processor -- start 2023-10-03T10:13:39.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 -- start start 2023-10-03T10:13:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c09e9d0 con 0x7fcd1c0a0a70 2023-10-03T10:13:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c09dc00 con 0x7fcd1c0a1380 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd246ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c09dec0 con 0x7fcd1c133f50 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd22c8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd21c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd2248b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd22c8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39718/0 (socket says 172.21.15.125:39718) 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd2248b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60046/0 (socket says 172.21.15.125:60046) 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd21c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45514/0 (socket says 172.21.15.125:45514) 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.490+0000 7fcd22c8c700 1 -- 172.21.15.125:0/1025408913 learned_addr learned my addr 172.21.15.125:0/1025408913 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 -- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 msgr2=0x7fcd1c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 -- 172.21.15.125:0/1025408913 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 msgr2=0x7fcd1c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 --2- 172.21.15.125:0/1025408913 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 -- 172.21.15.125:0/1025408913 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c09e6a0 con 0x7fcd1c133f50 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd21c8a700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd2248b700 1 --2- 172.21.15.125:0/1025408913 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd22c8c700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009e50 tx=0x7fcd1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf91cef17d0e3800 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd21489700 1 -- 172.21.15.125:0/1025408913 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400e070 con 0x7fcd1c133f50 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd21489700 1 -- 172.21.15.125:0/1025408913 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1400b910 con 0x7fcd1c133f50 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.491+0000 7fcd21489700 1 -- 172.21.15.125:0/1025408913 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400bcc0 con 0x7fcd1c133f50 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 -- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 msgr2=0x7fcd1c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009e50 tx=0x7fcd1400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 -- 172.21.15.125:0/1025408913 shutdown_connections 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c1343b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 --2- 172.21.15.125:0/1025408913 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0a0a70 0x7fcd1c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 --2- 172.21.15.125:0/1025408913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 -- 172.21.15.125:0/1025408913 >> 172.21.15.125:0/1025408913 conn(0x7fcd1c0a6610 msgr2=0x7fcd1c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 -- 172.21.15.125:0/1025408913 shutdown_connections 2023-10-03T10:13:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.492+0000 7fcd246ef700 1 -- 172.21.15.125:0/1025408913 wait complete. 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.493+0000 7fcd246ef700 1 Processor -- start 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.493+0000 7fcd246ef700 1 -- start start 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0a0a70 0x7fcd1c11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c11fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c122ae0 con 0x7fcd1c0a0a70 2023-10-03T10:13:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0a03e0 con 0x7fcd1c0a1380 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c120fc0 con 0x7fcd1c133f50 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd22c8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c11fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45528/0 (socket says 172.21.15.125:45528) 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 -- 172.21.15.125:0/2151607338 learned_addr learned my addr 172.21.15.125:0/2151607338 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd2248b700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0a0a70 0x7fcd1c11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 -- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 msgr2=0x7fcd1c11fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c11fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 -- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0a0a70 msgr2=0x7fcd1c11f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0a0a70 0x7fcd1c11f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 -- 172.21.15.125:0/2151607338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180094a0 con 0x7fcd1c0a1380 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd22c8c700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c11fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd21c8a700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00ec10 tx=0x7fcd0c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00c850 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00c9b0 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0094a0 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00cd20 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.494+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd14009b30 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.495+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd0c013470 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.495+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c04f2a0 con 0x7fcd1c0a1380 2023-10-03T10:13:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.495+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd0c03fb10 con 0x7fcd1c0a1380 2023-10-03T10:13:39.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.500+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd0c013720 con 0x7fcd1c0a1380 2023-10-03T10:13:39.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.649+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f792c04f2a0 con 0x7f792c09e870 2023-10-03T10:13:39.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.649+0000 7f7921ffb700 1 -- 172.21.15.125:0/301239671 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7928015020 con 0x7f792c09e870 2023-10-03T10:13:39.650 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 msgr2=0x7f792c1227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c1227d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7928016000 tx=0x7f7928004750 comp rx=0 tx=0).stop 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 shutdown_connections 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f792c1341d0 0x7f792c123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f792c09e870 0x7f792c1227d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 --2- 172.21.15.125:0/301239671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f792c09f180 0x7f792c122d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 >> 172.21.15.125:0/301239671 conn(0x7f792c0a4430 msgr2=0x7f792c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 shutdown_connections 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.651+0000 7f79336e5700 1 -- 172.21.15.125:0/301239671 wait complete. 2023-10-03T10:13:39.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:39.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.691+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd1c072980 con 0x7fcd1c0a1380 2023-10-03T10:13:39.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.691+0000 7fcd12ffd700 1 -- 172.21.15.125:0/2151607338 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd0c02a090 con 0x7fcd1c0a1380 2023-10-03T10:13:39.691 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:39.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 msgr2=0x7fcd1c11f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00ec10 tx=0x7fcd0c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 shutdown_connections 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd1c133f50 0x7fcd1c11fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0a0a70 0x7fcd1c11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 --2- 172.21.15.125:0/2151607338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0a1380 0x7fcd1c11f880 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 >> 172.21.15.125:0/2151607338 conn(0x7fcd1c0a6610 msgr2=0x7fcd1c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 shutdown_connections 2023-10-03T10:13:39.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.693+0000 7fcd246ef700 1 -- 172.21.15.125:0/2151607338 wait complete. 2023-10-03T10:13:39.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:39.731 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:39.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:39.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 Processor -- start 2023-10-03T10:13:39.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 -- start start 2023-10-03T10:13:39.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 0x7f62100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 0x7f621013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621009dc00 con 0x7f62100a1380 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621009ea90 con 0x7f62100a0a70 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f6215883700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621009dec0 con 0x7f6210134120 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f620effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 0x7f62100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 0x7f621013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f620e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f62100a1380 0x7f6210133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33762/0 (socket says 172.21.15.125:33762) 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.872+0000 7f620e7fc700 1 -- 172.21.15.125:0/2826275331 learned_addr learned my addr 172.21.15.125:0/2826275331 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620f7fe700 1 -- 172.21.15.125:0/2826275331 >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 msgr2=0x7f62100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620f7fe700 1 --2- 172.21.15.125:0/2826275331 >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 0x7f62100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620f7fe700 1 -- 172.21.15.125:0/2826275331 >> v1:172.21.15.125:6789/0 conn(0x7f62100a1380 legacy=0x7f6210133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620f7fe700 1 -- 172.21.15.125:0/2826275331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621009e6a0 con 0x7f6210134120 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620effd700 1 --2- 172.21.15.125:0/2826275331 >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 0x7f62100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620f7fe700 1 --2- 172.21.15.125:0/2826275331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 0x7f621013bce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afad5c3b7e51dd17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620dffb700 1 -- 172.21.15.125:0/2826275331 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800e070 con 0x7f6210134120 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620dffb700 1 -- 172.21.15.125:0/2826275331 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800bb20 con 0x7f6210134120 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f620dffb700 1 -- 172.21.15.125:0/2826275331 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208012430 con 0x7f6210134120 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 -- 172.21.15.125:0/2826275331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 msgr2=0x7f621013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 --2- 172.21.15.125:0/2826275331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 0x7f621013bce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 -- 172.21.15.125:0/2826275331 shutdown_connections 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 --2- 172.21.15.125:0/2826275331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6210134120 0x7f621013bce0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 --2- 172.21.15.125:0/2826275331 >> v2:172.21.15.125:3300/0 conn(0x7f62100a0a70 0x7f62100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.873+0000 7f6215883700 1 -- 172.21.15.125:0/2826275331 >> 172.21.15.125:0/2826275331 conn(0x7f62100a6610 msgr2=0x7f62100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.874+0000 7f6215883700 1 -- 172.21.15.125:0/2826275331 shutdown_connections 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.874+0000 7f6215883700 1 -- 172.21.15.125:0/2826275331 wait complete. 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.875+0000 7f6215883700 1 Processor -- start 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.875+0000 7f6215883700 1 -- start start 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.875+0000 7f6215883700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 0x7f6210122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 0x7f6210123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210133850 con 0x7f62100a1380 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6210133a80 con 0x7f6210134120 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62101260d0 con 0x7f62100a0a70 2023-10-03T10:13:39.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39742/0 (socket says 172.21.15.125:39742) 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 -- 172.21.15.125:0/3919830281 learned_addr learned my addr 172.21.15.125:0/3919830281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620f7fe700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 0x7f6210123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620e7fc700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 0x7f6210122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 -- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 msgr2=0x7f6210123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 0x7f6210123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 -- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 msgr2=0x7f6210122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 0x7f6210122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 -- 172.21.15.125:0/3919830281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000094a0 con 0x7f62100a0a70 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620f7fe700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 0x7f6210123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620e7fc700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 0x7f6210122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f620effd700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f620000ebe0 tx=0x7f620000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000c7f0 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620000c950 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000cce0 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6208009a70 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.876+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6210125e10 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.877+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6200013470 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.877+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621004f2a0 con 0x7f62100a0a70 2023-10-03T10:13:39.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.877+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f620003fb40 con 0x7f62100a0a70 2023-10-03T10:13:39.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.882+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6200013720 con 0x7f62100a0a70 2023-10-03T10:13:39.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.915+0000 7ff2eafe6700 1 Processor -- start 2023-10-03T10:13:39.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.915+0000 7ff2eafe6700 1 -- start start 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2eafe6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 0x7ff2e41359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2eafe6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 0x7ff2e41382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2eafe6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e409bb90 con 0x7ff2e412d380 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2eafe6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e409c210 con 0x7ff2e4135f10 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2eafe6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e409ced0 con 0x7ff2e41335f0 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 0x7ff2e41359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e8d82700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff2e412d380 0x7ff2e412d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33764/0 (socket says 172.21.15.125:33764) 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e8d82700 1 -- 172.21.15.125:0/1627696562 learned_addr learned my addr 172.21.15.125:0/1627696562 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 0x7ff2e41382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1627696562 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246802296 0 0) 0x7ff2e409bb90 con 0x7ff2e412d380 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1627696562 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d40035b0 con 0x7ff2e412d380 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 -- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 msgr2=0x7ff2e41359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 0x7ff2e41359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 -- 172.21.15.125:0/1627696562 >> v1:172.21.15.125:6789/0 conn(0x7ff2e412d380 legacy=0x7ff2e412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 -- 172.21.15.125:0/1627696562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e409ac30 con 0x7ff2e4135f10 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 0x7ff2e41359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e9583700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 0x7ff2e41382f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009dc0 tx=0x7ff2dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9faf233ec7e0f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.916+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1627696562 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e070 con 0x7ff2e4135f10 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1627696562 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00bae0 con 0x7ff2e4135f10 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1627696562 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00be90 con 0x7ff2e4135f10 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 msgr2=0x7ff2e41382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 0x7ff2e41382f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009dc0 tx=0x7ff2dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1627696562 shutdown_connections 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4135f10 0x7ff2e41382f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1627696562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e41335f0 0x7ff2e41359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1627696562 >> 172.21.15.125:0/1627696562 conn(0x7ff2e40a2980 msgr2=0x7ff2e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1627696562 shutdown_connections 2023-10-03T10:13:39.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.917+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1627696562 wait complete. 2023-10-03T10:13:39.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.918+0000 7ff2eafe6700 1 Processor -- start 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.918+0000 7ff2eafe6700 1 -- start start 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 0x7ff2e406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e411dc90 con 0x7ff2e41335f0 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40714b0 con 0x7ff2e412d380 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e411d4a0 con 0x7ff2e4135f10 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e9583700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60086/0 (socket says 172.21.15.125:60086) 2023-10-03T10:13:39.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e9583700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39754/0 (socket says 172.21.15.125:39754) 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1482874095 learned_addr learned my addr 172.21.15.125:0/1482874095 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 0x7ff2e406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 -- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 msgr2=0x7ff2e41c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 -- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 msgr2=0x7ff2e40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 -- 172.21.15.125:0/1482874095 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d000b740 con 0x7ff2e412d380 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e9583700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e8d82700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 0x7ff2e406fda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c460 tx=0x7ff2d800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80072d0 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8007450 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc009a70 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8005830 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.919+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e406f750 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.920+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2d8005990 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.920+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2d803e9c0 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.920+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e411da80 con 0x7ff2e412d380 2023-10-03T10:13:39.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:39.925+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2d8017070 con 0x7ff2e412d380 2023-10-03T10:13:40.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.075+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6210072980 con 0x7f62100a0a70 2023-10-03T10:13:40.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.075+0000 7f61f7fff700 1 -- 172.21.15.125:0/3919830281 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6200021070 con 0x7f62100a0a70 2023-10-03T10:13:40.076 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 msgr2=0x7f6210122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f620000ebe0 tx=0x7f620000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 shutdown_connections 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210134120 0x7f6210123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62100a0a70 0x7f6210122910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 --2- 172.21.15.125:0/3919830281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62100a1380 0x7f6210122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 >> 172.21.15.125:0/3919830281 conn(0x7f62100a6610 msgr2=0x7f621009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 shutdown_connections 2023-10-03T10:13:40.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.077+0000 7f6215883700 1 -- 172.21.15.125:0/3919830281 wait complete. 2023-10-03T10:13:40.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:40.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.119+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2e4070e60 con 0x7ff2e412d380 2023-10-03T10:13:40.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.119+0000 7ff2e17fa700 1 -- 172.21.15.125:0/1482874095 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2d8019cd0 con 0x7ff2e412d380 2023-10-03T10:13:40.120 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:40.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 msgr2=0x7ff2e406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 0x7ff2e406fda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c460 tx=0x7ff2d800c770 comp rx=0 tx=0).stop 2023-10-03T10:13:40.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 shutdown_connections 2023-10-03T10:13:40.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4135f10 0x7ff2e41c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e412d380 0x7ff2e406fda0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 --2- 172.21.15.125:0/1482874095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e41335f0 0x7ff2e40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 >> 172.21.15.125:0/1482874095 conn(0x7ff2e40a2980 msgr2=0x7ff2e4134160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 shutdown_connections 2023-10-03T10:13:40.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.121+0000 7ff2eafe6700 1 -- 172.21.15.125:0/1482874095 wait complete. 2023-10-03T10:13:40.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:40.664 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:40.706 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.798+0000 7fd293886700 1 Processor -- start 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 -- start start 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c09b110 con 0x7fd28c0a0a70 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c0a3b60 con 0x7fd28c09ad40 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd293886700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c1348e0 con 0x7fd28c133f70 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd291622700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd291622700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60100/0 (socket says 172.21.15.125:60100) 2023-10-03T10:13:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45560/0 (socket says 172.21.15.125:45560) 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd291622700 1 -- 172.21.15.125:0/1326776366 learned_addr learned my addr 172.21.15.125:0/1326776366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd291e23700 1 --1- 172.21.15.125:0/1326776366 >> v1:172.21.15.125:6789/0 conn(0x7fd28c0a0a70 0x7fd28c0a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33772/0 (socket says 172.21.15.125:33772) 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 -- 172.21.15.125:0/1326776366 >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 msgr2=0x7fd28c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 --2- 172.21.15.125:0/1326776366 >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 -- 172.21.15.125:0/1326776366 >> v1:172.21.15.125:6789/0 conn(0x7fd28c0a0a70 legacy=0x7fd28c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd290e21700 1 -- 172.21.15.125:0/1326776366 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0a2fa0 con 0x7fd28c133f70 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.799+0000 7fd283fff700 1 -- 172.21.15.125:0/1326776366 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169038438 0 0) 0x7fd28c09b110 con 0x7fd28c0a0a70 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.800+0000 7fd291622700 1 --2- 172.21.15.125:0/1326776366 >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.800+0000 7fd290e21700 1 --2- 172.21.15.125:0/1326776366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009840 tx=0x7fd27c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95b50f6aed74c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.800+0000 7fd283fff700 1 -- 172.21.15.125:0/1326776366 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c011830 con 0x7fd28c133f70 2023-10-03T10:13:40.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.800+0000 7fd283fff700 1 -- 172.21.15.125:0/1326776366 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c011990 con 0x7fd28c133f70 2023-10-03T10:13:40.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.800+0000 7fd283fff700 1 -- 172.21.15.125:0/1326776366 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c011d20 con 0x7fd28c133f70 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 -- 172.21.15.125:0/1326776366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 msgr2=0x7fd28c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 --2- 172.21.15.125:0/1326776366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009840 tx=0x7fd27c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 -- 172.21.15.125:0/1326776366 shutdown_connections 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 --2- 172.21.15.125:0/1326776366 >> v2:172.21.15.125:3300/0 conn(0x7fd28c09ad40 0x7fd28c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 --2- 172.21.15.125:0/1326776366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c133f70 0x7fd28c1343a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 -- 172.21.15.125:0/1326776366 >> 172.21.15.125:0/1326776366 conn(0x7fd28c099c40 msgr2=0x7fd28c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 -- 172.21.15.125:0/1326776366 shutdown_connections 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.801+0000 7fd293886700 1 -- 172.21.15.125:0/1326776366 wait complete. 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.802+0000 7fd293886700 1 Processor -- start 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.802+0000 7fd293886700 1 -- start start 2023-10-03T10:13:40.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 0x7fd28c121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c122eb0 con 0x7fd28c133f70 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c123d40 con 0x7fd28c09ad40 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd293886700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c124820 con 0x7fd28c0a0a70 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd290e21700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45568/0 (socket says 172.21.15.125:45568) 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd290e21700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39756/0 (socket says 172.21.15.125:39756) 2023-10-03T10:13:40.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 -- 172.21.15.125:0/2149576780 learned_addr learned my addr 172.21.15.125:0/2149576780 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291e23700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 0x7fd28c121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 -- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 msgr2=0x7fd28c121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 -- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 msgr2=0x7fd28c121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 0x7fd28c121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 -- 172.21.15.125:0/2149576780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009550 con 0x7fd28c09ad40 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd290e21700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291e23700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 0x7fd28c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.803+0000 7fd291622700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9e0 tx=0x7fd28800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.804+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800ee80 con 0x7fd28c09ad40 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.804+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800c850 con 0x7fd28c09ad40 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.804+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c0094a0 con 0x7fd28c09ad40 2023-10-03T10:13:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.804+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800cbc0 con 0x7fd28c09ad40 2023-10-03T10:13:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.804+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c09c7e0 con 0x7fd28c09ad40 2023-10-03T10:13:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.805+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd28800cd20 con 0x7fd28c09ad40 2023-10-03T10:13:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.805+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd28803fa60 con 0x7fd28c09ad40 2023-10-03T10:13:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.805+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c11e060 con 0x7fd28c09ad40 2023-10-03T10:13:40.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.810+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd28801b3b0 con 0x7fd28c09ad40 2023-10-03T10:13:40.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.837+0000 7feb1753e700 1 Processor -- start 2023-10-03T10:13:40.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.837+0000 7feb1753e700 1 -- start start 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.837+0000 7feb1753e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb100a0a70 0x7feb100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.837+0000 7feb1753e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.837+0000 7feb1753e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1009dc00 con 0x7feb100a1380 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb1753e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1009ea90 con 0x7feb100a0a70 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb1753e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1009dec0 con 0x7feb10134120 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb100a0a70 0x7feb100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb15adb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb100a0a70 0x7feb100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60128/0 (socket says 172.21.15.125:60128) 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb15adb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45584/0 (socket says 172.21.15.125:45584) 2023-10-03T10:13:40.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb14ad9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feb100a1380 0x7feb10133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33782/0 (socket says 172.21.15.125:33782) 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 -- 172.21.15.125:0/2884929919 learned_addr learned my addr 172.21.15.125:0/2884929919 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 -- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 msgr2=0x7feb1013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 -- 172.21.15.125:0/2884929919 >> v1:172.21.15.125:6789/0 conn(0x7feb100a1380 legacy=0x7feb10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 -- 172.21.15.125:0/2884929919 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1009e6a0 con 0x7feb100a0a70 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb15adb700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb07fff700 1 -- 172.21.15.125:0/2884929919 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277954085 0 0) 0x7feb1009dc00 con 0x7feb100a1380 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb152da700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a0a70 0x7feb100a0e40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0098f0 tx=0x7feb0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9535f569bf8c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb07fff700 1 -- 172.21.15.125:0/2884929919 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011830 con 0x7feb100a0a70 2023-10-03T10:13:40.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb07fff700 1 -- 172.21.15.125:0/2884929919 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c011990 con 0x7feb100a0a70 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.838+0000 7feb07fff700 1 -- 172.21.15.125:0/2884929919 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011d20 con 0x7feb100a0a70 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 -- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a0a70 msgr2=0x7feb100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a0a70 0x7feb100a0e40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0098f0 tx=0x7feb0c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 -- 172.21.15.125:0/2884929919 shutdown_connections 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb10134120 0x7feb1013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 --2- 172.21.15.125:0/2884929919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a0a70 0x7feb100a0e40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 -- 172.21.15.125:0/2884929919 >> 172.21.15.125:0/2884929919 conn(0x7feb100a6610 msgr2=0x7feb100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 -- 172.21.15.125:0/2884929919 shutdown_connections 2023-10-03T10:13:40.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.839+0000 7feb1753e700 1 -- 172.21.15.125:0/2884929919 wait complete. 2023-10-03T10:13:40.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 Processor -- start 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 -- start start 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 0x7feb10122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 0x7feb101233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb10133aa0 con 0x7feb100a1380 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb100a03e0 con 0x7feb100a0a70 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb1753e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb10125d30 con 0x7feb10134120 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb152da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb152da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45592/0 (socket says 172.21.15.125:45592) 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb152da700 1 -- 172.21.15.125:0/1432047014 learned_addr learned my addr 172.21.15.125:0/1432047014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:40.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.840+0000 7feb15adb700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 0x7feb101233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb14ad9700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 0x7feb10122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 -- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 msgr2=0x7feb101233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 0x7feb101233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 -- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 msgr2=0x7feb10122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 0x7feb10122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 -- 172.21.15.125:0/1432047014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009a70 con 0x7feb100a0a70 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb15adb700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 0x7feb101233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb14ad9700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 0x7feb10122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb152da700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009c40 tx=0x7feb0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0045d0 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c0036a0 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c009550 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c003a30 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.841+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb10126a60 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.842+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb0c021070 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.842+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb0c040ae0 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.842+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb10125ea0 con 0x7feb100a0a70 2023-10-03T10:13:40.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:40.847+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb0c029070 con 0x7feb100a0a70 2023-10-03T10:13:41.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.004+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd28c124960 con 0x7fd28c09ad40 2023-10-03T10:13:41.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.004+0000 7fd281ffb700 1 -- 172.21.15.125:0/2149576780 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd288021030 con 0x7fd28c09ad40 2023-10-03T10:13:41.032 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 msgr2=0x7fd28c1212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9e0 tx=0x7fd28800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 shutdown_connections 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c133f70 0x7fd28c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd28c09ad40 0x7fd28c1212f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 --2- 172.21.15.125:0/2149576780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd28c0a0a70 0x7fd28c121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 >> 172.21.15.125:0/2149576780 conn(0x7fd28c099c40 msgr2=0x7fd28c1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 shutdown_connections 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.006+0000 7fd293886700 1 -- 172.21.15.125:0/2149576780 wait complete. 2023-10-03T10:13:41.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:41.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.040+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb1004f2a0 con 0x7feb100a0a70 2023-10-03T10:13:41.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.040+0000 7feb05ffb700 1 -- 172.21.15.125:0/1432047014 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb0c015030 con 0x7feb100a0a70 2023-10-03T10:13:41.040 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 msgr2=0x7feb10122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009c40 tx=0x7feb0c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 shutdown_connections 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb10134120 0x7feb101233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb100a0a70 0x7feb10122940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 --2- 172.21.15.125:0/1432047014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb100a1380 0x7feb10122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 >> 172.21.15.125:0/1432047014 conn(0x7feb100a6610 msgr2=0x7feb1009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 shutdown_connections 2023-10-03T10:13:41.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.042+0000 7feb1753e700 1 -- 172.21.15.125:0/1432047014 wait complete. 2023-10-03T10:13:41.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:41.091 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:41.134 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:41.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 Processor -- start 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 -- start start 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5881371c0 0x7ff5881395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58809c970 con 0x7ff58809e870 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5880a0920 con 0x7ff5881371c0 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff58d848700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58809f9c0 con 0x7ff58809f350 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff5867fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff5867fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45604/0 (socket says 172.21.15.125:45604) 2023-10-03T10:13:41.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff5877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5881371c0 0x7ff5881395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.220+0000 7ff5867fc700 1 -- 172.21.15.125:0/4218148249 learned_addr learned my addr 172.21.15.125:0/4218148249 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5877fe700 1 -- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 msgr2=0x7ff588136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5877fe700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5877fe700 1 -- 172.21.15.125:0/4218148249 >> v1:172.21.15.125:6789/0 conn(0x7ff58809e870 legacy=0x7ff58809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff585ffb700 1 -- 172.21.15.125:0/4218148249 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987033780 0 0) 0x7ff58809c970 con 0x7ff58809e870 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5877fe700 1 -- 172.21.15.125:0/4218148249 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58809bab0 con 0x7ff5881371c0 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5867fc700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff5877fe700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5881371c0 0x7ff5881395a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff580009d90 tx=0x7ff58000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41088fbe2e3426 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff585ffb700 1 -- 172.21.15.125:0/4218148249 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58000e070 con 0x7ff5881371c0 2023-10-03T10:13:41.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff585ffb700 1 -- 172.21.15.125:0/4218148249 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58000bb20 con 0x7ff5881371c0 2023-10-03T10:13:41.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff585ffb700 1 -- 172.21.15.125:0/4218148249 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580012430 con 0x7ff5881371c0 2023-10-03T10:13:41.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff58d848700 1 -- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5881371c0 msgr2=0x7ff5881395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.221+0000 7ff58d848700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5881371c0 0x7ff5881395a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff580009d90 tx=0x7ff58000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 -- 172.21.15.125:0/4218148249 shutdown_connections 2023-10-03T10:13:41.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5881371c0 0x7ff5881395a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 --2- 172.21.15.125:0/4218148249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff58809f350 0x7ff588136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 -- 172.21.15.125:0/4218148249 >> 172.21.15.125:0/4218148249 conn(0x7ff5880a4430 msgr2=0x7ff5880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 -- 172.21.15.125:0/4218148249 shutdown_connections 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 -- 172.21.15.125:0/4218148249 wait complete. 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.222+0000 7ff58d848700 1 Processor -- start 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 -- start start 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff58809e870 0x7ff58811e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5881371c0 0x7ff58811ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff588120960 con 0x7ff58809f350 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58806d0e0 con 0x7ff5881371c0 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff58d848700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5881368f0 con 0x7ff58809e870 2023-10-03T10:13:41.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff586ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff58809e870 0x7ff58811e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60154/0 (socket says 172.21.15.125:60154) 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 -- 172.21.15.125:0/1470589024 learned_addr learned my addr 172.21.15.125:0/1470589024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5877fe700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5881371c0 0x7ff58811ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 -- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff58809e870 msgr2=0x7ff58811e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff58809e870 0x7ff58811e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 -- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5881371c0 msgr2=0x7ff58811ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5881371c0 0x7ff58811ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.223+0000 7ff5867fc700 1 -- 172.21.15.125:0/1470589024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c00d9f0 con 0x7ff58809f350 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff5867fc700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff57c012fc0 tx=0x7ff57c0103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c010b00 con 0x7ff58809f350 2023-10-03T10:13:41.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c013040 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff580009a70 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c010e80 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.224+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff588121760 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.225+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff57c018480 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.225+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58804f2a0 con 0x7ff58809f350 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.225+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff57c043620 con 0x7ff58809f350 2023-10-03T10:13:41.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.230+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff57c00b450 con 0x7ff58809f350 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.263+0000 7f4d7f6e0700 1 Processor -- start 2023-10-03T10:13:41.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.263+0000 7f4d7f6e0700 1 -- start start 2023-10-03T10:13:41.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7f6e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 0x7f4d780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7f6e0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d78134120 0x7f4d7813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7f6e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7809dc00 con 0x7f4d780a1380 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7f6e0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7809ea60 con 0x7f4d78134120 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7f6e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7809dec0 con 0x7f4d780a0a70 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7d47c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 0x7f4d780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d78134120 0x7f4d7813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7d47c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 0x7f4d780a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39778/0 (socket says 172.21.15.125:39778) 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7cc7b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4d780a1380 0x7f4d78133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33798/0 (socket says 172.21.15.125:33798) 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7d47c700 1 -- 172.21.15.125:0/2369020184 learned_addr learned my addr 172.21.15.125:0/2369020184 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:41.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 --2- 172.21.15.125:0/2369020184 >> v2:172.21.15.125:3300/0 conn(0x7f4d78134120 0x7f4d7813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60170/0 (socket says 172.21.15.125:60170) 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 -- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 msgr2=0x7f4d780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 --2- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 0x7f4d780a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d6ffff700 1 -- 172.21.15.125:0/2369020184 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868245681 0 0) 0x7f4d7809dc00 con 0x7f4d780a1380 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 -- 172.21.15.125:0/2369020184 >> v1:172.21.15.125:6789/0 conn(0x7f4d780a1380 legacy=0x7f4d78133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 -- 172.21.15.125:0/2369020184 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7809e6a0 con 0x7f4d78134120 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d7dc7d700 1 --2- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d7813bce0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009d90 tx=0x7f4d7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ef296a8355dea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d6ffff700 1 -- 172.21.15.125:0/2369020184 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000e070 con 0x7f4d78134120 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d6ffff700 1 -- 172.21.15.125:0/2369020184 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000bb20 con 0x7f4d78134120 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.264+0000 7f4d6ffff700 1 -- 172.21.15.125:0/2369020184 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70012430 con 0x7f4d78134120 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 msgr2=0x7f4d7813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d7813bce0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009d90 tx=0x7f4d7000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/2369020184 shutdown_connections 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d7813bce0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/2369020184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a0a70 0x7f4d780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/2369020184 >> 172.21.15.125:0/2369020184 conn(0x7f4d780a6610 msgr2=0x7f4d780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/2369020184 shutdown_connections 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.265+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/2369020184 wait complete. 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 Processor -- start 2023-10-03T10:13:41.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 -- start start 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 0x7f4d781227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d78123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d781262e0 con 0x7f4d78134120 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d781243d0 con 0x7f4d780a0a70 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.266+0000 7f4d7f6e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780a5640 con 0x7f4d780a1380 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7d47c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 0x7f4d781227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39784/0 (socket says 172.21.15.125:39784) 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7d47c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 0x7f4d781227c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45614/0 (socket says 172.21.15.125:45614) 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 -- 172.21.15.125:0/4046342311 learned_addr learned my addr 172.21.15.125:0/4046342311 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7dc7d700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d78123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 -- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 msgr2=0x7f4d781227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 0x7f4d781227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 -- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 msgr2=0x7f4d78123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d78123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 -- 172.21.15.125:0/4046342311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009a70 con 0x7f4d780a1380 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7cc7b700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4d68001eb0 tx=0x7f4d6800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68004c80 con 0x7f4d780a1380 2023-10-03T10:13:41.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68004de0 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d780a03e0 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68007310 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.267+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d78123b90 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.268+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d68007470 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.268+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d6803f3d0 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.268+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7804f2a0 con 0x7f4d780a1380 2023-10-03T10:13:41.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.273+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d680123b0 con 0x7f4d780a1380 2023-10-03T10:13:41.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.423+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff58806b2a0 con 0x7ff58809f350 2023-10-03T10:13:41.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.424+0000 7ff56ffff700 1 -- 172.21.15.125:0/1470589024 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff57c016340 con 0x7ff58809f350 2023-10-03T10:13:41.424 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 msgr2=0x7ff58811e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff57c012fc0 tx=0x7ff57c0103a0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 shutdown_connections 2023-10-03T10:13:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5881371c0 0x7ff58811ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff58809e870 0x7ff58811e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 --2- 172.21.15.125:0/1470589024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58809f350 0x7ff58811e9f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 >> 172.21.15.125:0/1470589024 conn(0x7ff5880a4430 msgr2=0x7ff588071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 shutdown_connections 2023-10-03T10:13:41.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.426+0000 7ff58d848700 1 -- 172.21.15.125:0/1470589024 wait complete. 2023-10-03T10:13:41.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:41.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.465+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d78072980 con 0x7f4d780a1380 2023-10-03T10:13:41.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.466+0000 7f4d6dffb700 1 -- 172.21.15.125:0/4046342311 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d68011360 con 0x7f4d780a1380 2023-10-03T10:13:41.466 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 msgr2=0x7f4d78122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4d68001eb0 tx=0x7f4d6800c800 comp rx=0 tx=0).stop 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 shutdown_connections 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d78134120 0x7f4d78123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d780a0a70 0x7f4d781227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 --2- 172.21.15.125:0/4046342311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d780a1380 0x7f4d78122d00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 >> 172.21.15.125:0/4046342311 conn(0x7f4d780a6610 msgr2=0x7f4d7811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 shutdown_connections 2023-10-03T10:13:41.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:41.468+0000 7f4d7f6e0700 1 -- 172.21.15.125:0/4046342311 wait complete. 2023-10-03T10:13:41.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:42.035 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:42.056 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:42.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.166+0000 7f734b4ff700 1 Processor -- start 2023-10-03T10:13:42.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.166+0000 7f734b4ff700 1 -- start start 2023-10-03T10:13:42.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f734409ad40 0x7f7344133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7344133f70 0x7f73441343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 0x7f73440a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440a3b60 con 0x7f7344133f70 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73441348e0 con 0x7f73440a0a70 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734b4ff700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f734409b110 con 0x7f734409ad40 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f7348a9a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7344133f70 0x7f73441343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f7348a9a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7344133f70 0x7f73441343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60190/0 (socket says 172.21.15.125:60190) 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f7349a9c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 0x7f73440a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f7348a9a700 1 -- 172.21.15.125:0/210349748 learned_addr learned my addr 172.21.15.125:0/210349748 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.167+0000 7f734929b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f734409ad40 0x7f7344133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 -- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f734409ad40 msgr2=0x7f7344133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f734409ad40 0x7f7344133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 -- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 msgr2=0x7f73440a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 0x7f73440a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 -- 172.21.15.125:0/210349748 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440a2fa0 con 0x7f7344133f70 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7349a9c700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 0x7f73440a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f7348a9a700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7344133f70 0x7f73441343a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7334009920 tx=0x7f7334009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a235c8ec6cc357 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f733bfff700 1 -- 172.21.15.125:0/210349748 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334011830 con 0x7f7344133f70 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f733bfff700 1 -- 172.21.15.125:0/210349748 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334011990 con 0x7f7344133f70 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f733bfff700 1 -- 172.21.15.125:0/210349748 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334011d20 con 0x7f7344133f70 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f734b4ff700 1 -- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7344133f70 msgr2=0x7f73441343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.168+0000 7f734b4ff700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7344133f70 0x7f73441343a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7334009920 tx=0x7f7334009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 -- 172.21.15.125:0/210349748 shutdown_connections 2023-10-03T10:13:42.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73440a0a70 0x7f73440a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f734409ad40 0x7f7344133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 --2- 172.21.15.125:0/210349748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7344133f70 0x7f73441343a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 -- 172.21.15.125:0/210349748 >> 172.21.15.125:0/210349748 conn(0x7f7344099c40 msgr2=0x7f734406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 -- 172.21.15.125:0/210349748 shutdown_connections 2023-10-03T10:13:42.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.169+0000 7f734b4ff700 1 -- 172.21.15.125:0/210349748 wait complete. 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 Processor -- start 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 -- start start 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 0x7f73441218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 0x7f7344121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7344124c50 con 0x7f73440a0a70 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7344122f80 con 0x7f734409ad40 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734b4ff700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7344123e10 con 0x7f7344133f70 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734929b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 0x7f7344121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734929b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45634/0 (socket says 172.21.15.125:45634) 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734929b700 1 -- 172.21.15.125:0/2911083148 learned_addr learned my addr 172.21.15.125:0/2911083148 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7348a9a700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 0x7f73441218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 -- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 msgr2=0x7f7344121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 -- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 msgr2=0x7f73441218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 0x7f73441218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7349a9c700 1 -- 172.21.15.125:0/2911083148 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c009a70 con 0x7f7344133f70 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f7348a9a700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 0x7f73441218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.170+0000 7f734929b700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f7349a9c700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 0x7f7344121df0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f733c009e50 tx=0x7f733c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00ca90 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00f040 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334009550 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00ce50 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.171+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734409c7e0 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.172+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f733c014480 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.172+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734411e060 con 0x7f7344133f70 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.172+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f733c03fc30 con 0x7f7344133f70 2023-10-03T10:13:42.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.177+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f733c046080 con 0x7f7344133f70 2023-10-03T10:13:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.205+0000 7ff7d018a700 1 Processor -- start 2023-10-03T10:13:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.205+0000 7ff7d018a700 1 -- start start 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7d018a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7c809d860 0x7ff7c809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7d018a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 0x7ff7c8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7d018a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c809aaa0 con 0x7ff7c809e170 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7d018a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c809f870 con 0x7ff7c809d860 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7d018a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c809b360 con 0x7ff7c8130eb0 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7c809d860 0x7ff7c809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ce727700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 0x7ff7c8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cd725700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff7c809e170 0x7ff7c81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33808/0 (socket says 172.21.15.125:33808) 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cd725700 1 -- 172.21.15.125:0/128298594 learned_addr learned my addr 172.21.15.125:0/128298594 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 -- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 msgr2=0x7ff7c8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 0x7ff7c8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 -- 172.21.15.125:0/128298594 >> v1:172.21.15.125:6789/0 conn(0x7ff7c809e170 legacy=0x7ff7c81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 -- 172.21.15.125:0/128298594 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c809b620 con 0x7ff7c809d860 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ccf24700 1 -- 172.21.15.125:0/128298594 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491691091 0 0) 0x7ff7c809aaa0 con 0x7ff7c809e170 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ce727700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 0x7ff7c8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7cdf26700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c809d860 0x7ff7c809dc30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009d90 tx=0x7ff7c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38199008cc18fa72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ccf24700 1 -- 172.21.15.125:0/128298594 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000e070 con 0x7ff7c809d860 2023-10-03T10:13:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ccf24700 1 -- 172.21.15.125:0/128298594 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000bb20 con 0x7ff7c809d860 2023-10-03T10:13:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.206+0000 7ff7ccf24700 1 -- 172.21.15.125:0/128298594 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0012430 con 0x7ff7c809d860 2023-10-03T10:13:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 -- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c809d860 msgr2=0x7ff7c809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c809d860 0x7ff7c809dc30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009d90 tx=0x7ff7c000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 -- 172.21.15.125:0/128298594 shutdown_connections 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c8130eb0 0x7ff7c8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 --2- 172.21.15.125:0/128298594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c809d860 0x7ff7c809dc30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 -- 172.21.15.125:0/128298594 >> 172.21.15.125:0/128298594 conn(0x7ff7c8099c40 msgr2=0x7ff7c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 -- 172.21.15.125:0/128298594 shutdown_connections 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.207+0000 7ff7d018a700 1 -- 172.21.15.125:0/128298594 wait complete. 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 Processor -- start 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 -- start start 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c809d860 0x7ff7c81c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c809e170 0x7ff7c81c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8120610 con 0x7ff7c8130eb0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8125ff0 con 0x7ff7c809e170 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.208+0000 7ff7d018a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8121300 con 0x7ff7c809d860 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7cd725700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c809e170 0x7ff7c81c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60230/0 (socket says 172.21.15.125:60230) 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 -- 172.21.15.125:0/1885630760 learned_addr learned my addr 172.21.15.125:0/1885630760 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7cdf26700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c809d860 0x7ff7c81c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 -- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c809d860 msgr2=0x7ff7c81c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c809d860 0x7ff7c81c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 -- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c809e170 msgr2=0x7ff7c81c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c809e170 0x7ff7c81c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 -- 172.21.15.125:0/1885630760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80094a0 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7ce727700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800eb90 tx=0x7ff7b800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80097a0 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8004020 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80043b0 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0009a70 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.209+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c8125b30 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.210+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7b800c850 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.210+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c804f2a0 con 0x7ff7c8130eb0 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.210+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7b803f830 con 0x7ff7c8130eb0 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.219+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7b8011d90 con 0x7ff7c8130eb0 2023-10-03T10:13:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.374+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f734404f2a0 con 0x7f7344133f70 2023-10-03T10:13:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.374+0000 7f7339ffb700 1 -- 172.21.15.125:0/2911083148 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f733c012520 con 0x7f7344133f70 2023-10-03T10:13:42.375 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 msgr2=0x7f7344121df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 0x7f7344121df0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f733c009e50 tx=0x7f733c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 shutdown_connections 2023-10-03T10:13:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7344133f70 0x7f7344121df0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f734409ad40 0x7f7344121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 --2- 172.21.15.125:0/2911083148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73440a0a70 0x7f73441218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 >> 172.21.15.125:0/2911083148 conn(0x7f7344099c40 msgr2=0x7f7344133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 shutdown_connections 2023-10-03T10:13:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.376+0000 7f734b4ff700 1 -- 172.21.15.125:0/2911083148 wait complete. 2023-10-03T10:13:42.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:42.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.411+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7c806c3b0 con 0x7ff7c8130eb0 2023-10-03T10:13:42.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.412+0000 7ff7c67fc700 1 -- 172.21.15.125:0/1885630760 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7b8011350 con 0x7ff7c8130eb0 2023-10-03T10:13:42.412 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:42.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 msgr2=0x7ff7c81c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800eb90 tx=0x7ff7b800eea0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 shutdown_connections 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c8130eb0 0x7ff7c81c8c70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7c809d860 0x7ff7c81c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 --2- 172.21.15.125:0/1885630760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c809e170 0x7ff7c81c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 >> 172.21.15.125:0/1885630760 conn(0x7ff7c8099c40 msgr2=0x7ff7c8119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 shutdown_connections 2023-10-03T10:13:42.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.414+0000 7ff7d018a700 1 -- 172.21.15.125:0/1885630760 wait complete. 2023-10-03T10:13:42.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:42.439 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:42.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.591+0000 7f289fcc5700 1 Processor -- start 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.591+0000 7f289fcc5700 1 -- start start 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289fcc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 0x7f28980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289fcc5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2898134120 0x7f289813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289fcc5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289809dc00 con 0x7f28980a1380 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289fcc5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289809ea60 con 0x7f2898134120 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289fcc5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289809dec0 con 0x7f28980a0a70 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2898134120 0x7f289813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289da61700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 0x7f28980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2898134120 0x7f289813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60242/0 (socket says 172.21.15.125:60242) 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289d260700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f28980a1380 0x7f2898133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33820/0 (socket says 172.21.15.125:33820) 2023-10-03T10:13:42.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289da61700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 0x7f28980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39830/0 (socket says 172.21.15.125:39830) 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 -- 172.21.15.125:0/3445057109 learned_addr learned my addr 172.21.15.125:0/3445057109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 -- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 msgr2=0x7f28980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 --2- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 0x7f28980a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 -- 172.21.15.125:0/3445057109 >> v1:172.21.15.125:6789/0 conn(0x7f28980a1380 legacy=0x7f2898133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 -- 172.21.15.125:0/3445057109 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289809e6a0 con 0x7f2898134120 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289ca5f700 1 -- 172.21.15.125:0/3445057109 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032677655 0 0) 0x7f289809dc00 con 0x7f28980a1380 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289e262700 1 --2- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2898134120 0x7f289813bce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2890009e50 tx=0x7f289000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97df30451c6fc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289ca5f700 1 -- 172.21.15.125:0/3445057109 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000e070 con 0x7f2898134120 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289ca5f700 1 -- 172.21.15.125:0/3445057109 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289000b9c0 con 0x7f2898134120 2023-10-03T10:13:42.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.592+0000 7f289ca5f700 1 -- 172.21.15.125:0/3445057109 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000bd70 con 0x7f2898134120 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 -- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2898134120 msgr2=0x7f289813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2898134120 0x7f289813bce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2890009e50 tx=0x7f289000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 -- 172.21.15.125:0/3445057109 shutdown_connections 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2898134120 0x7f289813bce0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3445057109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a0a70 0x7f28980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 -- 172.21.15.125:0/3445057109 >> 172.21.15.125:0/3445057109 conn(0x7f28980a6610 msgr2=0x7f28980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 -- 172.21.15.125:0/3445057109 shutdown_connections 2023-10-03T10:13:42.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.593+0000 7f289fcc5700 1 -- 172.21.15.125:0/3445057109 wait complete. 2023-10-03T10:13:42.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.594+0000 7f289fcc5700 1 Processor -- start 2023-10-03T10:13:42.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.594+0000 7f289fcc5700 1 -- start start 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 0x7f2898122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 0x7f2898122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28981332b0 con 0x7f28980a0a70 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28981258b0 con 0x7f2898134120 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289fcc5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28981242c0 con 0x7f28980a1380 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289d260700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 0x7f2898122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289e262700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289e262700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45656/0 (socket says 172.21.15.125:45656) 2023-10-03T10:13:42.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289d260700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 0x7f2898122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39834/0 (socket says 172.21.15.125:39834) 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 0x7f2898122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289e262700 1 -- 172.21.15.125:0/3645516221 learned_addr learned my addr 172.21.15.125:0/3645516221 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 -- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 msgr2=0x7f2898122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 0x7f2898122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 -- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 msgr2=0x7f28981231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.595+0000 7f289da61700 1 -- 172.21.15.125:0/3645516221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890009b30 con 0x7f28980a0a70 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f289e262700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f289da61700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 0x7f2898122750 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f289400e810 tx=0x7f289400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400c070 con 0x7f28980a0a70 2023-10-03T10:13:42.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894013610 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940139a0 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28981261d0 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.596+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28980a0430 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.597+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2894013b00 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.597+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289804f2a0 con 0x7f28980a0a70 2023-10-03T10:13:42.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.597+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f289403f2c0 con 0x7f28980a0a70 2023-10-03T10:13:42.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.601+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2894010900 con 0x7f28980a0a70 2023-10-03T10:13:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 Processor -- start 2023-10-03T10:13:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 -- start start 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 0x7f8600133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 0x7f86001343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86000a0a70 0x7f86000a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000a3b60 con 0x7f86000a0a70 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86001348e0 con 0x7f8600133f70 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8606fea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f860009b110 con 0x7f860009ad40 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8605587700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86000a0a70 0x7f86000a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f85fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 0x7f86001343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8605587700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86000a0a70 0x7f86000a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60264/0 (socket says 172.21.15.125:60264) 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f85fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 0x7f86001343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45662/0 (socket says 172.21.15.125:45662) 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8604d86700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 0x7f8600133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.634+0000 7f8605587700 1 -- 172.21.15.125:0/4038689830 learned_addr learned my addr 172.21.15.125:0/4038689830 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 -- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 msgr2=0x7f8600133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 0x7f8600133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 -- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 msgr2=0x7f86001343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 0x7f86001343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 -- 172.21.15.125:0/4038689830 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000a2fa0 con 0x7f86000a0a70 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8604d86700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 0x7f8600133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8605587700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86000a0a70 0x7f86000a0ef0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009e80 tx=0x7f85f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfab0a416db34d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f85ff7fe700 1 -- 172.21.15.125:0/4038689830 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800e070 con 0x7f86000a0a70 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f85ff7fe700 1 -- 172.21.15.125:0/4038689830 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800b8d0 con 0x7f86000a0a70 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f85ff7fe700 1 -- 172.21.15.125:0/4038689830 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800bc80 con 0x7f86000a0a70 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8606fea700 1 -- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86000a0a70 msgr2=0x7f86000a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8606fea700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86000a0a70 0x7f86000a0ef0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009e80 tx=0x7f85f800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8606fea700 1 -- 172.21.15.125:0/4038689830 shutdown_connections 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.635+0000 7f8606fea700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86000a0a70 0x7f86000a0ef0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f860009ad40 0x7f8600133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 --2- 172.21.15.125:0/4038689830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8600133f70 0x7f86001343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 -- 172.21.15.125:0/4038689830 >> 172.21.15.125:0/4038689830 conn(0x7f8600099c40 msgr2=0x7f860006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 -- 172.21.15.125:0/4038689830 shutdown_connections 2023-10-03T10:13:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 -- 172.21.15.125:0/4038689830 wait complete. 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 Processor -- start 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.636+0000 7f8606fea700 1 -- start start 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f860009ad40 0x7f86001c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 0x7f86001c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600120330 con 0x7f860009ad40 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86001c5cf0 con 0x7f86000a0a70 2023-10-03T10:13:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8606fea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f860009c7e0 con 0x7f8600133f70 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45674/0 (socket says 172.21.15.125:45674) 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 -- 172.21.15.125:0/2048091058 learned_addr learned my addr 172.21.15.125:0/2048091058 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8605587700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 0x7f86001c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8604d86700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f860009ad40 0x7f86001c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 -- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 msgr2=0x7f86001c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 0x7f86001c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 -- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f860009ad40 msgr2=0x7f86001c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f860009ad40 0x7f86001c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f85fffff700 1 -- 172.21.15.125:0/2048091058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40094a0 con 0x7f86000a0a70 2023-10-03T10:13:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.637+0000 7f8605587700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 0x7f86001c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f85fffff700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00e980 tx=0x7f85ec00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec009710 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec00c690 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00ca20 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8009b30 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8600132a20 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.638+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85ec00cb80 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.639+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f85ec03f700 con 0x7f86000a0a70 2023-10-03T10:13:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.639+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860004f2a0 con 0x7f86000a0a70 2023-10-03T10:13:42.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.644+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85ec0232f0 con 0x7f86000a0a70 2023-10-03T10:13:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.793+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2898125fb0 con 0x7f28980a0a70 2023-10-03T10:13:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.794+0000 7f288e7fc700 1 -- 172.21.15.125:0/3645516221 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2894010310 con 0x7f28980a0a70 2023-10-03T10:13:42.794 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 msgr2=0x7f2898122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 0x7f2898122750 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f289400e810 tx=0x7f289400eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 shutdown_connections 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2898134120 0x7f28981231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28980a0a70 0x7f2898122750 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 --2- 172.21.15.125:0/3645516221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28980a1380 0x7f2898122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 >> 172.21.15.125:0/3645516221 conn(0x7f28980a6610 msgr2=0x7f289811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 shutdown_connections 2023-10-03T10:13:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.796+0000 7f289fcc5700 1 -- 172.21.15.125:0/3645516221 wait complete. 2023-10-03T10:13:42.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:42.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.835+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f86000729d0 con 0x7f86000a0a70 2023-10-03T10:13:42.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.836+0000 7f85fd7fa700 1 -- 172.21.15.125:0/2048091058 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85ec01bd00 con 0x7f86000a0a70 2023-10-03T10:13:42.836 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:42.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 msgr2=0x7f86001c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00e980 tx=0x7f85ec00ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 shutdown_connections 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8600133f70 0x7f86001c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f860009ad40 0x7f86001c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 --2- 172.21.15.125:0/2048091058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86000a0a70 0x7f86001c57b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 >> 172.21.15.125:0/2048091058 conn(0x7f8600099c40 msgr2=0x7f8600132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 shutdown_connections 2023-10-03T10:13:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:42.838+0000 7f8606fea700 1 -- 172.21.15.125:0/2048091058 wait complete. 2023-10-03T10:13:42.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:43.389 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:43.427 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:43.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.517+0000 7f8b27f49700 1 Processor -- start 2023-10-03T10:13:43.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.517+0000 7f8b27f49700 1 -- start start 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b27f49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b27f49700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b20134120 0x7f8b2013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b27f49700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2009dc00 con 0x7f8b200a1380 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b27f49700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2009ea60 con 0x7f8b20134120 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b27f49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2009dec0 con 0x7f8b200a0a70 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b20134120 0x7f8b2013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b25ce5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b254e4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8b200a1380 0x7f8b20133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33834/0 (socket says 172.21.15.125:33834) 2023-10-03T10:13:43.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b25ce5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45688/0 (socket says 172.21.15.125:45688) 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b20134120 0x7f8b2013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60282/0 (socket says 172.21.15.125:60282) 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b254e4700 1 -- 172.21.15.125:0/726627525 learned_addr learned my addr 172.21.15.125:0/726627525 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b24ce3700 1 -- 172.21.15.125:0/726627525 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206944442 0 0) 0x7f8b2009dc00 con 0x7f8b200a1380 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 -- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 msgr2=0x7f8b200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 -- 172.21.15.125:0/726627525 >> v1:172.21.15.125:6789/0 conn(0x7f8b200a1380 legacy=0x7f8b20133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 -- 172.21.15.125:0/726627525 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2009e6a0 con 0x7f8b20134120 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b25ce5700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.518+0000 7f8b264e6700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b20134120 0x7f8b2013bce0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009d90 tx=0x7f8b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598203d5e78d0045 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b24ce3700 1 -- 172.21.15.125:0/726627525 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800e070 con 0x7f8b20134120 2023-10-03T10:13:43.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b24ce3700 1 -- 172.21.15.125:0/726627525 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800bb20 con 0x7f8b20134120 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b24ce3700 1 -- 172.21.15.125:0/726627525 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18012430 con 0x7f8b20134120 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 -- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b20134120 msgr2=0x7f8b2013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b20134120 0x7f8b2013bce0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009d90 tx=0x7f8b1800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 -- 172.21.15.125:0/726627525 shutdown_connections 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b20134120 0x7f8b2013bce0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 --2- 172.21.15.125:0/726627525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a0a70 0x7f8b200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 -- 172.21.15.125:0/726627525 >> 172.21.15.125:0/726627525 conn(0x7f8b200a6610 msgr2=0x7f8b200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 -- 172.21.15.125:0/726627525 shutdown_connections 2023-10-03T10:13:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.519+0000 7f8b27f49700 1 -- 172.21.15.125:0/726627525 wait complete. 2023-10-03T10:13:43.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.520+0000 7f8b27f49700 1 Processor -- start 2023-10-03T10:13:43.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.520+0000 7f8b27f49700 1 -- start start 2023-10-03T10:13:43.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 0x7f8b20122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b20134120 0x7f8b20123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201259a0 con 0x7f8b200a0a70 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20124390 con 0x7f8b200a1380 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20133350 con 0x7f8b20134120 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b25ce5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 0x7f8b20122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b25ce5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60292/0 (socket says 172.21.15.125:60292) 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b25ce5700 1 -- 172.21.15.125:0/2883977484 learned_addr learned my addr 172.21.15.125:0/2883977484 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b264e6700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b20134120 0x7f8b20123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 -- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b20134120 msgr2=0x7f8b20123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b20134120 0x7f8b20123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 -- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 msgr2=0x7f8b20122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 -- 172.21.15.125:0/2883977484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0094a0 con 0x7f8b200a1380 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b25ce5700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b254e4700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 0x7f8b20122cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b200a2b70 tx=0x7f8b1000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10004c80 con 0x7f8b200a1380 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10004de0 con 0x7f8b200a1380 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10007310 con 0x7f8b200a1380 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.521+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b18009a70 con 0x7f8b200a1380 2023-10-03T10:13:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.522+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b200a03e0 con 0x7f8b200a1380 2023-10-03T10:13:43.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.522+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b10007470 con 0x7f8b200a1380 2023-10-03T10:13:43.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.522+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b1003f150 con 0x7f8b200a1380 2023-10-03T10:13:43.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.522+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2004f2a0 con 0x7f8b200a1380 2023-10-03T10:13:43.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.527+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b10007720 con 0x7f8b200a1380 2023-10-03T10:13:43.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.557+0000 7f8e075c9700 1 Processor -- start 2023-10-03T10:13:43.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 -- start start 2023-10-03T10:13:43.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 0x7f8e00131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000a0920 con 0x7f8e0009e870 2023-10-03T10:13:43.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0009c970 con 0x7f8e00131d70 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e075c9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0009bab0 con 0x7f8e0009f180 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e04b64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 0x7f8e00131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e05365700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e05b66700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e05365700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60294/0 (socket says 172.21.15.125:60294) 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e04b64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 0x7f8e00131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39852/0 (socket says 172.21.15.125:39852) 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e05b66700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45706/0 (socket says 172.21.15.125:45706) 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.558+0000 7f8e05365700 1 -- 172.21.15.125:0/2209011107 learned_addr learned my addr 172.21.15.125:0/2209011107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 -- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 msgr2=0x7f8e00131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 --2- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 0x7f8e00131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 -- 172.21.15.125:0/2209011107 >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 msgr2=0x7f8e0009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 --2- 172.21.15.125:0/2209011107 >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 -- 172.21.15.125:0/2209011107 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0009f9c0 con 0x7f8e00131d70 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05365700 1 --2- 172.21.15.125:0/2209011107 >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e05b66700 1 --2- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009dc0 tx=0x7f8df800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7997f202e6c542d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8dfffff700 1 -- 172.21.15.125:0/2209011107 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800e070 con 0x7f8e00131d70 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8dfffff700 1 -- 172.21.15.125:0/2209011107 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800bae0 con 0x7f8e00131d70 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8dfffff700 1 -- 172.21.15.125:0/2209011107 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800be90 con 0x7f8e00131d70 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 msgr2=0x7f8e001321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.559+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009dc0 tx=0x7f8df800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:43.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209011107 shutdown_connections 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e001321f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209011107 >> v2:172.21.15.125:3300/0 conn(0x7f8e0009e870 0x7f8e0009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209011107 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009f180 0x7f8e00131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209011107 >> 172.21.15.125:0/2209011107 conn(0x7f8e000a4430 msgr2=0x7f8e000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209011107 shutdown_connections 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.560+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209011107 wait complete. 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.561+0000 7f8e075c9700 1 Processor -- start 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.561+0000 7f8e075c9700 1 -- start start 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.561+0000 7f8e075c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009e870 0x7f8e00120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.561+0000 7f8e075c9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e075c9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e00120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e075c9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001214e0 con 0x7f8e0009f180 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e075c9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00123ab0 con 0x7f8e00131d70 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e075c9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001235a0 con 0x7f8e0009e870 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60302/0 (socket says 172.21.15.125:60302) 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 -- 172.21.15.125:0/2209219809 learned_addr learned my addr 172.21.15.125:0/2209219809 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e05365700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009e870 0x7f8e00120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e05b66700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e00120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 -- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009e870 msgr2=0x7f8e00120030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009e870 0x7f8e00120030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 -- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 msgr2=0x7f8e00120ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e00120ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 -- 172.21.15.125:0/2209219809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0009550 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e04b64700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9e0 tx=0x7f8df400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4009710 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400ee70 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df8009a70 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.562+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400ca50 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.563+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e000a2a90 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.563+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8df400cbb0 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.563+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8df403f700 con 0x7f8e0009f180 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.563+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0011d580 con 0x7f8e0009f180 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.572+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8df40232f0 con 0x7f8e0009f180 2023-10-03T10:13:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.724+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b20072980 con 0x7f8b200a1380 2023-10-03T10:13:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.724+0000 7f8b167fc700 1 -- 172.21.15.125:0/2883977484 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b1001b760 con 0x7f8b200a1380 2023-10-03T10:13:43.725 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 msgr2=0x7f8b20122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 0x7f8b20122cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b200a2b70 tx=0x7f8b1000c750 comp rx=0 tx=0).stop 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 shutdown_connections 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b20134120 0x7f8b20123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b200a0a70 0x7f8b20122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 --2- 172.21.15.125:0/2883977484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b200a1380 0x7f8b20122cc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 >> 172.21.15.125:0/2883977484 conn(0x7f8b200a6610 msgr2=0x7f8b2009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 shutdown_connections 2023-10-03T10:13:43.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.726+0000 7f8b27f49700 1 -- 172.21.15.125:0/2883977484 wait complete. 2023-10-03T10:13:43.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.767+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e0004f2a0 con 0x7f8e0009f180 2023-10-03T10:13:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.767+0000 7f8dfdffb700 1 -- 172.21.15.125:0/2209219809 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8df401ae80 con 0x7f8e0009f180 2023-10-03T10:13:43.768 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 msgr2=0x7f8e00120570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9e0 tx=0x7f8df400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 shutdown_connections 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e00131d70 0x7f8e00120ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8e0009e870 0x7f8e00120030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 --2- 172.21.15.125:0/2209219809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e0009f180 0x7f8e00120570 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.769+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 >> 172.21.15.125:0/2209219809 conn(0x7f8e000a4430 msgr2=0x7f8e0011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.770+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 shutdown_connections 2023-10-03T10:13:43.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.770+0000 7f8e075c9700 1 -- 172.21.15.125:0/2209219809 wait complete. 2023-10-03T10:13:43.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:43.809 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:43.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:43.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 Processor -- start 2023-10-03T10:13:43.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 -- start start 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2284133f70 0x7f22841343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228409b110 con 0x7f22840a0a70 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840a3b60 con 0x7f2284133f70 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.947+0000 7f2288c06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22841348e0 con 0x7f228409ad40 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39856/0 (socket says 172.21.15.125:39856) 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 -- 172.21.15.125:0/1693949362 learned_addr learned my addr 172.21.15.125:0/1693949362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f2282d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f22840a0a70 0x7f22840a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33848/0 (socket says 172.21.15.125:33848) 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228159a700 1 -- 172.21.15.125:0/1693949362 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179648564 0 0) 0x7f228409b110 con 0x7f22840a0a70 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 -- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2284133f70 msgr2=0x7f22841343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 --2- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2284133f70 0x7f22841343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 -- 172.21.15.125:0/1693949362 >> v1:172.21.15.125:6789/0 conn(0x7f22840a0a70 legacy=0x7f22840a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 -- 172.21.15.125:0/1693949362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840a2fa0 con 0x7f228409ad40 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228259c700 1 --2- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2274009920 tx=0x7f2274009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f09a02045ef163 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228159a700 1 -- 172.21.15.125:0/1693949362 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400ba60 con 0x7f228409ad40 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228159a700 1 -- 172.21.15.125:0/1693949362 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400bbc0 con 0x7f228409ad40 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.948+0000 7f228159a700 1 -- 172.21.15.125:0/1693949362 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274009e70 con 0x7f228409ad40 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 -- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 msgr2=0x7f2284133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 --2- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2274009920 tx=0x7f2274009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 -- 172.21.15.125:0/1693949362 shutdown_connections 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 --2- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f228409ad40 0x7f2284133a30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 --2- 172.21.15.125:0/1693949362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2284133f70 0x7f22841343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 -- 172.21.15.125:0/1693949362 >> 172.21.15.125:0/1693949362 conn(0x7f2284099c40 msgr2=0x7f228406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 -- 172.21.15.125:0/1693949362 shutdown_connections 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.949+0000 7f2288c06700 1 -- 172.21.15.125:0/1693949362 wait complete. 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 Processor -- start 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 -- start start 2023-10-03T10:13:43.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 0x7f2284121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284122e90 con 0x7f2284133f70 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2284123d20 con 0x7f228409ad40 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.950+0000 7f2288c06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2284124800 con 0x7f22840a0a70 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2281d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2282d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 0x7f2284121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45732/0 (socket says 172.21.15.125:45732) 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 -- 172.21.15.125:0/1980944235 learned_addr learned my addr 172.21.15.125:0/1980944235 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2281d9b700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39868/0 (socket says 172.21.15.125:39868) 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 -- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 msgr2=0x7f2284121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 -- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 msgr2=0x7f2284121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 0x7f2284121d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 -- 172.21.15.125:0/1980944235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009550 con 0x7f228409ad40 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2281d9b700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2282d9d700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 0x7f2284121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f228259c700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2274000c00 tx=0x7f2274004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740036a0 con 0x7f228409ad40 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227401e070 con 0x7f228409ad40 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2284124ac0 con 0x7f228409ad40 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274003a60 con 0x7f228409ad40 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.951+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284124580 con 0x7f228409ad40 2023-10-03T10:13:43.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.952+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2274003bc0 con 0x7f228409ad40 2023-10-03T10:13:43.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.952+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22841240e0 con 0x7f228409ad40 2023-10-03T10:13:43.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.952+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2274020070 con 0x7f228409ad40 2023-10-03T10:13:43.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.957+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22740247f0 con 0x7f228409ad40 2023-10-03T10:13:43.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 Processor -- start 2023-10-03T10:13:43.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 -- start start 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0a0920 con 0x7ff22c09e870 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c09c970 con 0x7ff22c131d70 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff232f53700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c09bab0 con 0x7ff22c09f180 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff22bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff230cef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff2314f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff2314f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45740/0 (socket says 172.21.15.125:45740) 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff2314f0700 1 -- 172.21.15.125:0/804778519 learned_addr learned my addr 172.21.15.125:0/804778519 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff22bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39876/0 (socket says 172.21.15.125:39876) 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.989+0000 7ff230cef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60312/0 (socket says 172.21.15.125:60312) 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 -- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 msgr2=0x7ff22c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 -- 172.21.15.125:0/804778519 >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 msgr2=0x7ff22c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 --2- 172.21.15.125:0/804778519 >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 -- 172.21.15.125:0/804778519 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c09f9c0 con 0x7ff22c09f180 2023-10-03T10:13:43.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff230cef700 1 --2- 172.21.15.125:0/804778519 >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff2314f0700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22bfff700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff218009840 tx=0x7ff218009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc1dc917be868927 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22b7fe700 1 -- 172.21.15.125:0/804778519 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218011830 con 0x7ff22c09f180 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22b7fe700 1 -- 172.21.15.125:0/804778519 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff218011990 con 0x7ff22c09f180 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff22b7fe700 1 -- 172.21.15.125:0/804778519 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218011d20 con 0x7ff22c09f180 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff232f53700 1 -- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 msgr2=0x7ff22c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.990+0000 7ff232f53700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff218009840 tx=0x7ff218009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 -- 172.21.15.125:0/804778519 shutdown_connections 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c131d70 0x7ff22c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 --2- 172.21.15.125:0/804778519 >> v2:172.21.15.125:3300/0 conn(0x7ff22c09e870 0x7ff22c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 --2- 172.21.15.125:0/804778519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c131830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 -- 172.21.15.125:0/804778519 >> 172.21.15.125:0/804778519 conn(0x7ff22c0a4430 msgr2=0x7ff22c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 -- 172.21.15.125:0/804778519 shutdown_connections 2023-10-03T10:13:43.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 -- 172.21.15.125:0/804778519 wait complete. 2023-10-03T10:13:43.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.991+0000 7ff232f53700 1 Processor -- start 2023-10-03T10:13:43.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 -- start start 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c09e870 0x7ff22c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c1224f0 con 0x7ff22c131d70 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c06bd60 con 0x7ff22c09e870 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff232f53700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c131540 con 0x7ff22c09f180 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff2314f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff22bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff2314f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60314/0 (socket says 172.21.15.125:60314) 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff2314f0700 1 -- 172.21.15.125:0/739139769 learned_addr learned my addr 172.21.15.125:0/739139769 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.992+0000 7ff230cef700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c09e870 0x7ff22c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 -- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c09e870 msgr2=0x7ff22c06c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c09e870 0x7ff22c06c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 -- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 msgr2=0x7ff22c1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 -- 172.21.15.125:0/739139769 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200094a0 con 0x7ff22c09f180 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff2314f0700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff22bfff700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c06c880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff218009840 tx=0x7ff218004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218004450 con 0x7ff22c09f180 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21801f070 con 0x7ff22c09f180 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224009b30 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180038e0 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.993+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2180094a0 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.994+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff218003a40 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.994+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff218021070 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.994+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c0a2ca0 con 0x7ff22c09f180 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:43.998+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff21801a430 con 0x7ff22c09f180 2023-10-03T10:13:44.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.152+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f228411e060 con 0x7f228409ad40 2023-10-03T10:13:44.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.152+0000 7f2272ffd700 1 -- 172.21.15.125:0/1980944235 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22740193b0 con 0x7f228409ad40 2023-10-03T10:13:44.153 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 msgr2=0x7f22841212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2274000c00 tx=0x7f2274004750 comp rx=0 tx=0).stop 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 shutdown_connections 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2284133f70 0x7f2284121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f228409ad40 0x7f22841212d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 --2- 172.21.15.125:0/1980944235 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22840a0a70 0x7f2284121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 >> 172.21.15.125:0/1980944235 conn(0x7f2284099c40 msgr2=0x7f22841332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 shutdown_connections 2023-10-03T10:13:44.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.154+0000 7f2288c06700 1 -- 172.21.15.125:0/1980944235 wait complete. 2023-10-03T10:13:44.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:44.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.192+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff22c09dba0 con 0x7ff22c09f180 2023-10-03T10:13:44.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.193+0000 7ff2297fa700 1 -- 172.21.15.125:0/739139769 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff218015030 con 0x7ff22c09f180 2023-10-03T10:13:44.193 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:44.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 msgr2=0x7ff22c06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c06c880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff218009840 tx=0x7ff218004750 comp rx=0 tx=0).stop 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 shutdown_connections 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff22c131d70 0x7ff22c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff22c09e870 0x7ff22c06c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 --2- 172.21.15.125:0/739139769 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff22c09f180 0x7ff22c06c880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 >> 172.21.15.125:0/739139769 conn(0x7ff22c0a4430 msgr2=0x7ff22c1b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 shutdown_connections 2023-10-03T10:13:44.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.195+0000 7ff232f53700 1 -- 172.21.15.125:0/739139769 wait complete. 2023-10-03T10:13:44.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:44.740 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:44.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:44.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.868+0000 7faa46f83700 1 Processor -- start 2023-10-03T10:13:44.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.868+0000 7faa46f83700 1 -- start start 2023-10-03T10:13:44.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa46f83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 0x7faa40138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa46f83700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 0x7faa4013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa46f83700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4009e9d0 con 0x7faa400a0a70 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa46f83700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009dc00 con 0x7faa400a1550 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa46f83700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009dec0 con 0x7faa40139200 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa45520700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 0x7faa4013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa44d1f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faa400a0a70 0x7faa400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:33850/0 (socket says 172.21.15.125:33850) 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa44d1f700 1 -- 172.21.15.125:0/1563055012 learned_addr learned my addr 172.21.15.125:0/1563055012 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa3ffff700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 0x7faa40138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa3f7fe700 1 -- 172.21.15.125:0/1563055012 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172681575 0 0) 0x7faa4009e9d0 con 0x7faa400a0a70 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa3f7fe700 1 -- 172.21.15.125:0/1563055012 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa300035b0 con 0x7faa400a0a70 2023-10-03T10:13:44.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa45520700 1 -- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 msgr2=0x7faa40138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa45520700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 0x7faa40138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa45520700 1 -- 172.21.15.125:0/1563055012 >> v1:172.21.15.125:6789/0 conn(0x7faa400a0a70 legacy=0x7faa400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa45520700 1 -- 172.21.15.125:0/1563055012 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4009e6a0 con 0x7faa40139200 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.869+0000 7faa3ffff700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 0x7faa40138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa45520700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 0x7faa4013b5e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa38009dc0 tx=0x7faa3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1774d2478f5fb8e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa3f7fe700 1 -- 172.21.15.125:0/1563055012 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800e070 con 0x7faa40139200 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa3f7fe700 1 -- 172.21.15.125:0/1563055012 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800bb20 con 0x7faa40139200 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa3f7fe700 1 -- 172.21.15.125:0/1563055012 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38012430 con 0x7faa40139200 2023-10-03T10:13:44.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 -- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 msgr2=0x7faa4013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 0x7faa4013b5e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa38009dc0 tx=0x7faa3800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 -- 172.21.15.125:0/1563055012 shutdown_connections 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa40139200 0x7faa4013b5e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 --2- 172.21.15.125:0/1563055012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa400a1550 0x7faa40138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 -- 172.21.15.125:0/1563055012 >> 172.21.15.125:0/1563055012 conn(0x7faa400a6610 msgr2=0x7faa400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.870+0000 7faa46f83700 1 -- 172.21.15.125:0/1563055012 shutdown_connections 2023-10-03T10:13:44.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.871+0000 7faa46f83700 1 -- 172.21.15.125:0/1563055012 wait complete. 2023-10-03T10:13:44.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.872+0000 7faa46f83700 1 Processor -- start 2023-10-03T10:13:44.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.872+0000 7faa46f83700 1 -- start start 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.872+0000 7faa46f83700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 0x7faa4011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40122120 con 0x7faa400a1550 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40120600 con 0x7faa40139200 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009d340 con 0x7faa400a0a70 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa45520700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60316/0 (socket says 172.21.15.125:60316) 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa45520700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45766/0 (socket says 172.21.15.125:45766) 2023-10-03T10:13:44.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 -- 172.21.15.125:0/3043391493 learned_addr learned my addr 172.21.15.125:0/3043391493 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa44d1f700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 0x7faa4011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 -- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 msgr2=0x7faa4011e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 0x7faa4011e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 -- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 msgr2=0x7faa4011f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 -- 172.21.15.125:0/3043391493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0094a0 con 0x7faa400a1550 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa44d1f700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 0x7faa4011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa45520700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3ffff700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00ebe0 tx=0x7faa2c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00c850 con 0x7faa400a1550 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c00c9b0 con 0x7faa400a1550 2023-10-03T10:13:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa38009a70 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00cd40 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.873+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40122b90 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.874+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa2c013470 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.874+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa2c03fb30 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.875+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4004f2a0 con 0x7faa400a1550 2023-10-03T10:13:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.879+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa2c013720 con 0x7faa400a1550 2023-10-03T10:13:44.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 Processor -- start 2023-10-03T10:13:44.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 -- start start 2023-10-03T10:13:44.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32201309f0 0x7f3220130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f322009d8f0 0x7f322009dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009e280 0x7f3220137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.920+0000 7f3227fd5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322009c1f0 con 0x7f32201309f0 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3227fd5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322009b1f0 con 0x7f322009d8f0 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3227fd5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3220131300 con 0x7f322009e280 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32201309f0 0x7f3220130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225570700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f322009d8f0 0x7f322009dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32201309f0 0x7f3220130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60330/0 (socket says 172.21.15.125:60330) 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 -- 172.21.15.125:0/1166016150 learned_addr learned my addr 172.21.15.125:0/1166016150 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3226572700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009e280 0x7f3220137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 -- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009e280 msgr2=0x7f3220137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009e280 0x7f3220137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 -- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f322009d8f0 msgr2=0x7f322009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f322009d8f0 0x7f322009dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 -- 172.21.15.125:0/1166016150 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32201305a0 con 0x7f32201309f0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3225d71700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32201309f0 0x7f3220130dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f321c006fd0 tx=0x7f321c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2785121e84f4235 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3224d6f700 1 -- 172.21.15.125:0/1166016150 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c005e30 con 0x7f32201309f0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3224d6f700 1 -- 172.21.15.125:0/1166016150 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c004030 con 0x7f32201309f0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.921+0000 7f3224d6f700 1 -- 172.21.15.125:0/1166016150 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0043e0 con 0x7f32201309f0 2023-10-03T10:13:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 -- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32201309f0 msgr2=0x7f3220130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32201309f0 0x7f3220130dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f321c006fd0 tx=0x7f321c00bc80 comp rx=0 tx=0).stop 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 -- 172.21.15.125:0/1166016150 shutdown_connections 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009e280 0x7f3220137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32201309f0 0x7f3220130dc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 --2- 172.21.15.125:0/1166016150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f322009d8f0 0x7f322009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 -- 172.21.15.125:0/1166016150 >> 172.21.15.125:0/1166016150 conn(0x7f32200a2b30 msgr2=0x7f322009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 -- 172.21.15.125:0/1166016150 shutdown_connections 2023-10-03T10:13:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.922+0000 7f3227fd5700 1 -- 172.21.15.125:0/1166016150 wait complete. 2023-10-03T10:13:44.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 Processor -- start 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 -- start start 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 0x7f32201294a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322012c410 con 0x7f322009e280 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322012ab20 con 0x7f32201309f0 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3227fd5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f322012b750 con 0x7f322009d8f0 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3225d71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3225570700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3225570700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60334/0 (socket says 172.21.15.125:60334) 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3225d71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39920/0 (socket says 172.21.15.125:39920) 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3225570700 1 -- 172.21.15.125:0/2468122222 learned_addr learned my addr 172.21.15.125:0/2468122222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.923+0000 7f3226572700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 0x7f32201294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 -- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 msgr2=0x7f3220128a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 -- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 msgr2=0x7f32201294a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 0x7f32201294a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 -- 172.21.15.125:0/2468122222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c00b5b0 con 0x7f322009e280 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225d71700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3226572700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 0x7f32201294a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3225570700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3210012a90 tx=0x7f3210012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210014040 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321000f7a0 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32200a0610 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000da30 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.924+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322012bba0 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.925+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f321000fb10 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.925+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3210042f80 con 0x7f322009e280 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.925+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322004f2a0 con 0x7f322009e280 2023-10-03T10:13:44.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:44.930+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f321000fdc0 con 0x7f322009e280 2023-10-03T10:13:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.088+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa4009cba0 con 0x7faa400a1550 2023-10-03T10:13:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.088+0000 7faa3d7fa700 1 -- 172.21.15.125:0/3043391493 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa2c021030 con 0x7faa400a1550 2023-10-03T10:13:45.088 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 msgr2=0x7faa4011ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00ebe0 tx=0x7faa2c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 shutdown_connections 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa40139200 0x7faa4011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa400a0a70 0x7faa4011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 --2- 172.21.15.125:0/3043391493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa400a1550 0x7faa4011ee20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 >> 172.21.15.125:0/3043391493 conn(0x7faa400a6610 msgr2=0x7faa40138240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 shutdown_connections 2023-10-03T10:13:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.090+0000 7faa46f83700 1 -- 172.21.15.125:0/3043391493 wait complete. 2023-10-03T10:13:45.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:45.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.123+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f322006b2a0 con 0x7f322009e280 2023-10-03T10:13:45.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.123+0000 7f32167fc700 1 -- 172.21.15.125:0/2468122222 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3210020370 con 0x7f322009e280 2023-10-03T10:13:45.123 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 msgr2=0x7f3220128f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3210012a90 tx=0x7f3210012da0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 shutdown_connections 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32201309f0 0x7f32201294a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f322009d8f0 0x7f3220128a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 --2- 172.21.15.125:0/2468122222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322009e280 0x7f3220128f60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 >> 172.21.15.125:0/2468122222 conn(0x7f32200a2b30 msgr2=0x7f322012fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 shutdown_connections 2023-10-03T10:13:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.125+0000 7f3227fd5700 1 -- 172.21.15.125:0/2468122222 wait complete. 2023-10-03T10:13:45.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:45.168 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:45.208 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.303+0000 7fcf05048700 1 Processor -- start 2023-10-03T10:13:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.303+0000 7fcf05048700 1 -- start start 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcf05048700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 0x7fcf00133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcf05048700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcf001300a0 0x7fcf001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcf05048700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0006b2d0 con 0x7fcf001309f0 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcf05048700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf00133610 con 0x7fcf001300a0 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcf05048700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0009a500 con 0x7fcf00133ad0 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcf001300a0 0x7fcf001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcf001300a0 0x7fcf001304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51540/0 (socket says 172.21.15.125:51540) 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fceff59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcf001309f0 0x7fcf0013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53440/0 (socket says 172.21.15.125:53440) 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 -- 172.21.15.125:0/1087183347 learned_addr learned my addr 172.21.15.125:0/1087183347 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefed9d700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 0x7fcf00133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 -- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 msgr2=0x7fcf00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 0x7fcf00133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 -- 172.21.15.125:0/1087183347 >> v1:172.21.15.125:6789/0 conn(0x7fcf001309f0 legacy=0x7fcf0013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 -- 172.21.15.125:0/1087183347 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf001338b0 con 0x7fcf001300a0 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefdd9b700 1 -- 172.21.15.125:0/1087183347 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068906073 0 0) 0x7fcf0006b2d0 con 0x7fcf001309f0 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefed9d700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 0x7fcf00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.304+0000 7fcefe59c700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001300a0 0x7fcf001304b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcef40098f0 tx=0x7fcef4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b9d1cb3c15361f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcefdd9b700 1 -- 172.21.15.125:0/1087183347 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4011830 con 0x7fcf001300a0 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcefdd9b700 1 -- 172.21.15.125:0/1087183347 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4011990 con 0x7fcf001300a0 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcefdd9b700 1 -- 172.21.15.125:0/1087183347 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4011d20 con 0x7fcf001300a0 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 -- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001300a0 msgr2=0x7fcf001304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001300a0 0x7fcf001304b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcef40098f0 tx=0x7fcef4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 -- 172.21.15.125:0/1087183347 shutdown_connections 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf00133ad0 0x7fcf00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 --2- 172.21.15.125:0/1087183347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001300a0 0x7fcf001304b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 -- 172.21.15.125:0/1087183347 >> 172.21.15.125:0/1087183347 conn(0x7fcf00099c40 msgr2=0x7fcf000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 -- 172.21.15.125:0/1087183347 shutdown_connections 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.305+0000 7fcf05048700 1 -- 172.21.15.125:0/1087183347 wait complete. 2023-10-03T10:13:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.306+0000 7fcf05048700 1 Processor -- start 2023-10-03T10:13:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 -- start start 2023-10-03T10:13:45.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 0x7fcf000717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcf00133ad0 0x7fcf00071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000a3470 con 0x7fcf001309f0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0011e100 con 0x7fcf001300a0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcf05048700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0011f1b0 con 0x7fcf00133ad0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 0x7fcf000717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56236/0 (socket says 172.21.15.125:56236) 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefed9d700 1 -- 172.21.15.125:0/3615930751 learned_addr learned my addr 172.21.15.125:0/3615930751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fceff59e700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcf00133ad0 0x7fcf00071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 -- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcf00133ad0 msgr2=0x7fcf00071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcf00133ad0 0x7fcf00071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 -- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 msgr2=0x7fcf000712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefe59c700 1 -- 172.21.15.125:0/3615930751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00094a0 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.307+0000 7fcefed9d700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcefe59c700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 0x7fcf000717e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcf0006c6f0 tx=0x7fcef4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4004510 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40036a0 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef4009550 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4003a10 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0011f8f0 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.308+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcef4003b70 con 0x7fcf001309f0 2023-10-03T10:13:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.309+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcef4021030 con 0x7fcf001309f0 2023-10-03T10:13:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.309+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000a2620 con 0x7fcf001309f0 2023-10-03T10:13:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.313+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcef4015080 con 0x7fcf001309f0 2023-10-03T10:13:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.345+0000 7f2875b4a700 1 Processor -- start 2023-10-03T10:13:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.345+0000 7f2875b4a700 1 -- start start 2023-10-03T10:13:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f2875b4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f2875b4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 0x7f287013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f2875b4a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287009dc00 con 0x7f28700a1380 2023-10-03T10:13:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f2875b4a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287009ea90 con 0x7f28700a0a70 2023-10-03T10:13:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f2875b4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287009dec0 con 0x7f2870134120 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 0x7f287013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f28700a1380 0x7f2870133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53444/0 (socket says 172.21.15.125:53444) 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286effd700 1 -- 172.21.15.125:0/1086760950 learned_addr learned my addr 172.21.15.125:0/1086760950 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286e7fc700 1 -- 172.21.15.125:0/1086760950 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609442523 0 0) 0x7f287009dc00 con 0x7f28700a1380 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286e7fc700 1 -- 172.21.15.125:0/1086760950 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28580035b0 con 0x7f28700a1380 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 -- 172.21.15.125:0/1086760950 >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 msgr2=0x7f28700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 --2- 172.21.15.125:0/1086760950 >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 -- 172.21.15.125:0/1086760950 >> v1:172.21.15.125:6789/0 conn(0x7f28700a1380 legacy=0x7f2870133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 -- 172.21.15.125:0/1086760950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287009e6a0 con 0x7f2870134120 2023-10-03T10:13:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286f7fe700 1 --2- 172.21.15.125:0/1086760950 >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286ffff700 1 --2- 172.21.15.125:0/1086760950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 0x7f287013bce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4519e172b7da1013 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286e7fc700 1 -- 172.21.15.125:0/1086760950 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800e070 con 0x7f2870134120 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286e7fc700 1 -- 172.21.15.125:0/1086760950 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800bb20 con 0x7f2870134120 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.346+0000 7f286e7fc700 1 -- 172.21.15.125:0/1086760950 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868012430 con 0x7f2870134120 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 -- 172.21.15.125:0/1086760950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 msgr2=0x7f287013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 --2- 172.21.15.125:0/1086760950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 0x7f287013bce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 -- 172.21.15.125:0/1086760950 shutdown_connections 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 --2- 172.21.15.125:0/1086760950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870134120 0x7f287013bce0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 --2- 172.21.15.125:0/1086760950 >> v2:172.21.15.125:3300/0 conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 -- 172.21.15.125:0/1086760950 >> 172.21.15.125:0/1086760950 conn(0x7f28700a6610 msgr2=0x7f28700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 -- 172.21.15.125:0/1086760950 shutdown_connections 2023-10-03T10:13:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.347+0000 7f2875b4a700 1 -- 172.21.15.125:0/1086760950 wait complete. 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.348+0000 7f2875b4a700 1 Processor -- start 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 -- start start 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28700a1380 0x7f2870122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2870134120 0x7f28701230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870124b30 con 0x7f28700a0a70 2023-10-03T10:13:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870125e90 con 0x7f28700a1380 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f2875b4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2870124370 con 0x7f2870134120 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51566/0 (socket says 172.21.15.125:51566) 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f286f7fe700 1 -- 172.21.15.125:0/3091626054 learned_addr learned my addr 172.21.15.125:0/3091626054 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f286effd700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28700a1380 0x7f2870122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.349+0000 7f286ffff700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2870134120 0x7f28701230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 -- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2870134120 msgr2=0x7f28701230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2870134120 0x7f28701230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 -- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28700a1380 msgr2=0x7f2870122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28700a1380 0x7f2870122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 -- 172.21.15.125:0/3091626054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600094a0 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f286f7fe700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f286000ec10 tx=0x7f286000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000c850 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000c9b0 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000cd20 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868009a70 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.350+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870133170 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.351+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287004f2a0 con 0x7f28700a0a70 2023-10-03T10:13:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.351+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2860013470 con 0x7f28700a0a70 2023-10-03T10:13:45.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.352+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f286003ffa0 con 0x7f28700a0a70 2023-10-03T10:13:45.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.356+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2860013720 con 0x7f28700a0a70 2023-10-03T10:13:45.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.506+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf0004f2a0 con 0x7fcf001309f0 2023-10-03T10:13:45.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.506+0000 7fcee77fe700 1 -- 172.21.15.125:0/3615930751 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcef402b020 con 0x7fcf001309f0 2023-10-03T10:13:45.507 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 msgr2=0x7fcf000717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 0x7fcf000717e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcf0006c6f0 tx=0x7fcef4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 shutdown_connections 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcf00133ad0 0x7fcf00071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf001300a0 0x7fcf000712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 --2- 172.21.15.125:0/3615930751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf001309f0 0x7fcf000717e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 >> 172.21.15.125:0/3615930751 conn(0x7fcf00099c40 msgr2=0x7fcf001329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 shutdown_connections 2023-10-03T10:13:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.509+0000 7fcf05048700 1 -- 172.21.15.125:0/3615930751 wait complete. 2023-10-03T10:13:45.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:45.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.557+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2870126960 con 0x7f28700a0a70 2023-10-03T10:13:45.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.557+0000 7f2857fff700 1 -- 172.21.15.125:0/3091626054 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2860017020 con 0x7f28700a0a70 2023-10-03T10:13:45.557 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 msgr2=0x7f2870122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f286000ec10 tx=0x7f286000ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 shutdown_connections 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2870134120 0x7f28701230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a0a70 0x7f2870122650 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 --2- 172.21.15.125:0/3091626054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28700a1380 0x7f2870122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 >> 172.21.15.125:0/3091626054 conn(0x7f28700a6610 msgr2=0x7f28700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 shutdown_connections 2023-10-03T10:13:45.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:45.559+0000 7f2875b4a700 1 -- 172.21.15.125:0/3091626054 wait complete. 2023-10-03T10:13:45.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:46.104 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:46.138 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:46.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.233+0000 7faf8ad05700 1 Processor -- start 2023-10-03T10:13:46.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.233+0000 7faf8ad05700 1 -- start start 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf8ad05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 0x7faf840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf8ad05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 0x7faf8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf8ad05700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8409dc00 con 0x7faf840a1380 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf8ad05700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8409ea90 con 0x7faf84134120 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf8ad05700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8409dec0 con 0x7faf840a0a70 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf88aa1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 0x7faf840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf83fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faf840a1380 0x7faf84133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53454/0 (socket says 172.21.15.125:53454) 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf83fff700 1 -- 172.21.15.125:0/522153508 learned_addr learned my addr 172.21.15.125:0/522153508 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf892a2700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 0x7faf8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf837fe700 1 -- 172.21.15.125:0/522153508 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633504799 0 0) 0x7faf8409dc00 con 0x7faf840a1380 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf892a2700 1 -- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 msgr2=0x7faf840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf892a2700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 0x7faf840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf892a2700 1 -- 172.21.15.125:0/522153508 >> v1:172.21.15.125:6789/0 conn(0x7faf840a1380 legacy=0x7faf84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf892a2700 1 -- 172.21.15.125:0/522153508 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8409e6a0 con 0x7faf84134120 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.234+0000 7faf88aa1700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 0x7faf840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.235+0000 7faf892a2700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 0x7faf8413bce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009dc0 tx=0x7faf7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d139559cd168915 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.235+0000 7faf837fe700 1 -- 172.21.15.125:0/522153508 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00e070 con 0x7faf84134120 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.235+0000 7faf837fe700 1 -- 172.21.15.125:0/522153508 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00bb20 con 0x7faf84134120 2023-10-03T10:13:46.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.235+0000 7faf837fe700 1 -- 172.21.15.125:0/522153508 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c012430 con 0x7faf84134120 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 -- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 msgr2=0x7faf8413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 0x7faf8413bce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009dc0 tx=0x7faf7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 -- 172.21.15.125:0/522153508 shutdown_connections 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf84134120 0x7faf8413bce0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 --2- 172.21.15.125:0/522153508 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf840a0a70 0x7faf840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 -- 172.21.15.125:0/522153508 >> 172.21.15.125:0/522153508 conn(0x7faf840a6610 msgr2=0x7faf840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 -- 172.21.15.125:0/522153508 shutdown_connections 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.236+0000 7faf8ad05700 1 -- 172.21.15.125:0/522153508 wait complete. 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.237+0000 7faf8ad05700 1 Processor -- start 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.237+0000 7faf8ad05700 1 -- start start 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 0x7faf84123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84125930 con 0x7faf840a1380 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf84124320 con 0x7faf840a0a70 2023-10-03T10:13:46.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf8ad05700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf840a5600 con 0x7faf84134120 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf88aa1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf83fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf88aa1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56268/0 (socket says 172.21.15.125:56268) 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf83fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51568/0 (socket says 172.21.15.125:51568) 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf88aa1700 1 -- 172.21.15.125:0/4073129074 learned_addr learned my addr 172.21.15.125:0/4073129074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 0x7faf84123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 -- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 msgr2=0x7faf84122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 -- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 msgr2=0x7faf84122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf892a2700 1 -- 172.21.15.125:0/4073129074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780094a0 con 0x7faf84134120 2023-10-03T10:13:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf88aa1700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.238+0000 7faf83fff700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf892a2700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 0x7faf84123190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faf7c016000 tx=0x7faf7c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004880 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c020070 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0276c0 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c009a70 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.239+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84125c90 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.240+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf7c012430 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.240+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf7c022070 con 0x7faf84134120 2023-10-03T10:13:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.240+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8404f2a0 con 0x7faf84134120 2023-10-03T10:13:46.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.244+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf7c01b400 con 0x7faf84134120 2023-10-03T10:13:46.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.274+0000 7fb7e037a700 1 Processor -- start 2023-10-03T10:13:46.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.274+0000 7fb7e037a700 1 -- start start 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 0x7fb7d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 0x7fb7d81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d809e9d0 con 0x7fb7d80a0a70 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d809dc00 con 0x7fb7d8133f50 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7e037a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d809dec0 con 0x7fb7d80a1380 2023-10-03T10:13:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7de917700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 0x7fb7d81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7de116700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 0x7fb7d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7de917700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 0x7fb7d81343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56282/0 (socket says 172.21.15.125:56282) 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7de917700 1 -- 172.21.15.125:0/1051054619 learned_addr learned my addr 172.21.15.125:0/1051054619 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 -- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 msgr2=0x7fb7d81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 --2- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 0x7fb7d81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 -- 172.21.15.125:0/1051054619 >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 msgr2=0x7fb7d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 --2- 172.21.15.125:0/1051054619 >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 0x7fb7d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 -- 172.21.15.125:0/1051054619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d809e6a0 con 0x7fb7d80a1380 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7de116700 1 --2- 172.21.15.125:0/1051054619 >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 0x7fb7d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd915700 1 --2- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d8133a10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009840 tx=0x7fb7c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b947ba8b45822c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd114700 1 -- 172.21.15.125:0/1051054619 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8011830 con 0x7fb7d80a1380 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd114700 1 -- 172.21.15.125:0/1051054619 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c8011990 con 0x7fb7d80a1380 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.275+0000 7fb7dd114700 1 -- 172.21.15.125:0/1051054619 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8011d20 con 0x7fb7d80a1380 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 -- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 msgr2=0x7fb7d8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 --2- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d8133a10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009840 tx=0x7fb7c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 -- 172.21.15.125:0/1051054619 shutdown_connections 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 --2- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d8133f50 0x7fb7d81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 --2- 172.21.15.125:0/1051054619 >> v2:172.21.15.125:3300/0 conn(0x7fb7d80a0a70 0x7fb7d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 --2- 172.21.15.125:0/1051054619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d8133a10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 -- 172.21.15.125:0/1051054619 >> 172.21.15.125:0/1051054619 conn(0x7fb7d80a6610 msgr2=0x7fb7d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 -- 172.21.15.125:0/1051054619 shutdown_connections 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.276+0000 7fb7e037a700 1 -- 172.21.15.125:0/1051054619 wait complete. 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 Processor -- start 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 -- start start 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d80a0a70 0x7fb7d81223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d81228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8125180 con 0x7fb7d8133f50 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8124dc0 con 0x7fb7d80a0a70 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.277+0000 7fb7e037a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80a03e0 con 0x7fb7d80a1380 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51596/0 (socket says 172.21.15.125:51596) 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 -- 172.21.15.125:0/3698856657 learned_addr learned my addr 172.21.15.125:0/3698856657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7dd915700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d81228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de116700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d80a0a70 0x7fb7d81223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 -- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 msgr2=0x7fb7d81228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d81228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 -- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d80a0a70 msgr2=0x7fb7d81223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d80a0a70 0x7fb7d81223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 -- 172.21.15.125:0/3698856657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094a0 con 0x7fb7d8133f50 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7dd915700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d81228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7de917700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000efc0 tx=0x7fb7d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003c20 con 0x7fb7d8133f50 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000f040 con 0x7fb7d8133f50 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c80094a0 con 0x7fb7d8133f50 2023-10-03T10:13:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0009e60 con 0x7fb7d8133f50 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.278+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8125e40 con 0x7fb7d8133f50 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.279+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7d000c880 con 0x7fb7d8133f50 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.279+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7d003f8b0 con 0x7fb7d8133f50 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.279+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d811f760 con 0x7fb7d8133f50 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.284+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7d001c360 con 0x7fb7d8133f50 2023-10-03T10:13:46.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.438+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf84072980 con 0x7faf84134120 2023-10-03T10:13:46.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.438+0000 7faf817fa700 1 -- 172.21.15.125:0/4073129074 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf7c02c020 con 0x7faf84134120 2023-10-03T10:13:46.439 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:46.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 msgr2=0x7faf84123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 0x7faf84123190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faf7c016000 tx=0x7faf7c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 shutdown_connections 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf84134120 0x7faf84123190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf840a0a70 0x7faf84122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 --2- 172.21.15.125:0/4073129074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf840a1380 0x7faf84122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 >> 172.21.15.125:0/4073129074 conn(0x7faf840a6610 msgr2=0x7faf8409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 shutdown_connections 2023-10-03T10:13:46.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.441+0000 7faf8ad05700 1 -- 172.21.15.125:0/4073129074 wait complete. 2023-10-03T10:13:46.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:46.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.478+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb7d804f2a0 con 0x7fb7d8133f50 2023-10-03T10:13:46.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.479+0000 7fb7ceffd700 1 -- 172.21.15.125:0/3698856657 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7d0014e00 con 0x7fb7d8133f50 2023-10-03T10:13:46.479 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:46.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 msgr2=0x7fb7d8122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000efc0 tx=0x7fb7d000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 shutdown_connections 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7d8133f50 0x7fb7d8122e30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7d80a0a70 0x7fb7d81223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 --2- 172.21.15.125:0/3698856657 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb7d80a1380 0x7fb7d81228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.480+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 >> 172.21.15.125:0/3698856657 conn(0x7fb7d80a6610 msgr2=0x7fb7d811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.481+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 shutdown_connections 2023-10-03T10:13:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.481+0000 7fb7e037a700 1 -- 172.21.15.125:0/3698856657 wait complete. 2023-10-03T10:13:46.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:46.527 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:46.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.658+0000 7f8d8c817700 1 Processor -- start 2023-10-03T10:13:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.658+0000 7f8d8c817700 1 -- start start 2023-10-03T10:13:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8c817700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8c817700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8c817700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8809b110 con 0x7f8d8809ad40 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8c817700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880a3b60 con 0x7f8d88134140 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8c817700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880a1a80 con 0x7f8d88134570 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d85d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50144/0 (socket says 172.21.15.125:50144) 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d85d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56310/0 (socket says 172.21.15.125:56310) 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 -- 172.21.15.125:0/1226648147 learned_addr learned my addr 172.21.15.125:0/1226648147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d8559a700 1 -- 172.21.15.125:0/1226648147 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875185309 0 0) 0x7f8d8809b110 con 0x7f8d8809ad40 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 -- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 msgr2=0x7f8d88138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 -- 172.21.15.125:0/1226648147 >> v1:172.21.15.125:6789/0 conn(0x7f8d8809ad40 legacy=0x7f8d88133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 -- 172.21.15.125:0/1226648147 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880a2fa0 con 0x7f8d88134570 2023-10-03T10:13:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d85d9b700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.659+0000 7f8d86d9d700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009e80 tx=0x7f8d8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320d45b1c280f218 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8559a700 1 -- 172.21.15.125:0/1226648147 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000e070 con 0x7f8d88134570 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8559a700 1 -- 172.21.15.125:0/1226648147 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000b910 con 0x7f8d88134570 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8559a700 1 -- 172.21.15.125:0/1226648147 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000bcc0 con 0x7f8d88134570 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 -- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 msgr2=0x7f8d8813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009e80 tx=0x7f8d8000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 -- 172.21.15.125:0/1226648147 shutdown_connections 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134570 0x7f8d8813b3d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 --2- 172.21.15.125:0/1226648147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d88134140 0x7f8d88138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 -- 172.21.15.125:0/1226648147 >> 172.21.15.125:0/1226648147 conn(0x7f8d88099c40 msgr2=0x7f8d8806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 -- 172.21.15.125:0/1226648147 shutdown_connections 2023-10-03T10:13:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.660+0000 7f8d8c817700 1 -- 172.21.15.125:0/1226648147 wait complete. 2023-10-03T10:13:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.661+0000 7f8d8c817700 1 Processor -- start 2023-10-03T10:13:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.661+0000 7f8d8c817700 1 -- start start 2023-10-03T10:13:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d8809ad40 0x7f8d8811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 0x7f8d8811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8813a120 con 0x7f8d88134570 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8811eb20 con 0x7f8d8809ad40 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8c817700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8809e250 con 0x7f8d88134140 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50158/0 (socket says 172.21.15.125:50158) 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 -- 172.21.15.125:0/2291492863 learned_addr learned my addr 172.21.15.125:0/2291492863 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d8659c700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d8809ad40 0x7f8d8811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d86d9d700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 0x7f8d8811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 -- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d8809ad40 msgr2=0x7f8d8811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d8809ad40 0x7f8d8811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 -- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 msgr2=0x7f8d8811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 0x7f8d8811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 -- 172.21.15.125:0/2291492863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0094a0 con 0x7f8d88134140 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d86d9d700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 0x7f8d8811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.662+0000 7f8d85d9b700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ebe0 tx=0x7f8d7c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00c850 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00c9b0 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80009b30 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00cd40 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8811e0b0 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.663+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d7c013470 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.664+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d7c03f7a0 con 0x7f8d88134140 2023-10-03T10:13:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.664+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8804f2a0 con 0x7f8d88134140 2023-10-03T10:13:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.668+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d7c013720 con 0x7f8d88134140 2023-10-03T10:13:46.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 Processor -- start 2023-10-03T10:13:46.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 -- start start 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac88139280 0x7fac8813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8806b2d0 con 0x7fac88133ad0 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac881345b0 con 0x7fac88139280 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac8df3e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac88133610 con 0x7fac88136960 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac87fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac88139280 0x7fac8813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac86ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac87fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac88139280 0x7fac8813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51614/0 (socket says 172.21.15.125:51614) 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac86ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50166/0 (socket says 172.21.15.125:50166) 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.702+0000 7fac87fff700 1 -- 172.21.15.125:0/674503297 learned_addr learned my addr 172.21.15.125:0/674503297 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac87fff700 1 -- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 msgr2=0x7fac88138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac87fff700 1 --2- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac87fff700 1 -- 172.21.15.125:0/674503297 >> v1:172.21.15.125:6789/0 conn(0x7fac88133ad0 legacy=0x7fac88133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac867fc700 1 -- 172.21.15.125:0/674503297 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597464481 0 0) 0x7fac8806b2d0 con 0x7fac88133ad0 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac87fff700 1 -- 172.21.15.125:0/674503297 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8809a500 con 0x7fac88139280 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac87fff700 1 --2- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac8813b660 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fac80009920 tx=0x7fac80009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1017fd2cedb6348 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac867fc700 1 -- 172.21.15.125:0/674503297 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80011830 con 0x7fac88139280 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac867fc700 1 -- 172.21.15.125:0/674503297 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80011990 con 0x7fac88139280 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac867fc700 1 -- 172.21.15.125:0/674503297 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80011d20 con 0x7fac88139280 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 -- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 msgr2=0x7fac8813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 --2- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac8813b660 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fac80009920 tx=0x7fac80009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 -- 172.21.15.125:0/674503297 shutdown_connections 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 --2- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac8813b660 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 --2- 172.21.15.125:0/674503297 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.703+0000 7fac8df3e700 1 -- 172.21.15.125:0/674503297 >> 172.21.15.125:0/674503297 conn(0x7fac88099c40 msgr2=0x7fac880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.704+0000 7fac8df3e700 1 -- 172.21.15.125:0/674503297 shutdown_connections 2023-10-03T10:13:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.704+0000 7fac8df3e700 1 -- 172.21.15.125:0/674503297 wait complete. 2023-10-03T10:13:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.705+0000 7fac8df3e700 1 Processor -- start 2023-10-03T10:13:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.705+0000 7fac8df3e700 1 -- start start 2023-10-03T10:13:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.705+0000 7fac8df3e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 0x7fac88071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8809f390 con 0x7fac88139280 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac88070230 con 0x7fac88133ad0 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac88131730 con 0x7fac88136960 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 0x7fac88071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51622/0 (socket says 172.21.15.125:51622) 2023-10-03T10:13:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 -- 172.21.15.125:0/2328185645 learned_addr learned my addr 172.21.15.125:0/2328185645 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac86ffd700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 -- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 msgr2=0x7fac88071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 -- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 msgr2=0x7fac88071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 0x7fac88071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 -- 172.21.15.125:0/2328185645 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009550 con 0x7fac88139280 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac877fe700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 0x7fac88071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac87fff700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac80013000 tx=0x7fac80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80004240 con 0x7fac88139280 2023-10-03T10:13:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8001f070 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800036a0 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8812ef50 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.706+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac88070bc0 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.707+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8804f2a0 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.708+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac80021030 con 0x7fac88139280 2023-10-03T10:13:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.708+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac80040bc0 con 0x7fac88139280 2023-10-03T10:13:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.716+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac80023790 con 0x7fac88139280 2023-10-03T10:13:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.864+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d880729d0 con 0x7f8d88134140 2023-10-03T10:13:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.864+0000 7f8d76ffd700 1 -- 172.21.15.125:0/2291492863 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d7c01b3b0 con 0x7f8d88134140 2023-10-03T10:13:46.865 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.866+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 msgr2=0x7f8d8811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.866+0000 7f8d8c817700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ebe0 tx=0x7f8d7c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 shutdown_connections 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d88134570 0x7f8d8811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d8809ad40 0x7f8d8811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 --2- 172.21.15.125:0/2291492863 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8d88134140 0x7f8d8811ce00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 >> 172.21.15.125:0/2291492863 conn(0x7f8d88099c40 msgr2=0x7f8d8809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 shutdown_connections 2023-10-03T10:13:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.867+0000 7f8d8c817700 1 -- 172.21.15.125:0/2291492863 wait complete. 2023-10-03T10:13:46.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:46.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.908+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac8809f0f0 con 0x7fac88139280 2023-10-03T10:13:46.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.908+0000 7fac6ffff700 1 -- 172.21.15.125:0/2328185645 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac80015070 con 0x7fac88139280 2023-10-03T10:13:46.909 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:46.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 msgr2=0x7fac88071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac80013000 tx=0x7fac80004750 comp rx=0 tx=0).stop 2023-10-03T10:13:46.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 shutdown_connections 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac88139280 0x7fac88071a90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac88133ad0 0x7fac88071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 --2- 172.21.15.125:0/2328185645 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac88136960 0x7fac88071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.910+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 >> 172.21.15.125:0/2328185645 conn(0x7fac88099c40 msgr2=0x7fac880a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.911+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 shutdown_connections 2023-10-03T10:13:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:46.911+0000 7fac8df3e700 1 -- 172.21.15.125:0/2328185645 wait complete. 2023-10-03T10:13:46.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:47.454 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:47.494 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:47.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 Processor -- start 2023-10-03T10:13:47.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 -- start start 2023-10-03T10:13:47.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd35c0a1380 0x7fd35c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c09dc00 con 0x7fd35c133f50 2023-10-03T10:13:47.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c09ea60 con 0x7fd35c0a1380 2023-10-03T10:13:47.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd361441700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c09dec0 con 0x7fd35c0a0a70 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd35c0a1380 0x7fd35c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd35c0a1380 0x7fd35c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51632/0 (socket says 172.21.15.125:51632) 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd35c133f50 0x7fd35c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53482/0 (socket says 172.21.15.125:53482) 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50186/0 (socket says 172.21.15.125:50186) 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.585+0000 7fd35a7fc700 1 -- 172.21.15.125:0/1960443156 learned_addr learned my addr 172.21.15.125:0/1960443156 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35a7fc700 1 -- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 msgr2=0x7fd35c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35a7fc700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35a7fc700 1 -- 172.21.15.125:0/1960443156 >> v1:172.21.15.125:6789/0 conn(0x7fd35c133f50 legacy=0x7fd35c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35a7fc700 1 -- 172.21.15.125:0/1960443156 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c09e6a0 con 0x7fd35c0a1380 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd359ffb700 1 -- 172.21.15.125:0/1960443156 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444782238 0 0) 0x7fd35c09dc00 con 0x7fd35c133f50 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35affd700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd35a7fc700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c133a10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd3500098f0 tx=0x7fd350009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e6857798ef7080 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd359ffb700 1 -- 172.21.15.125:0/1960443156 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350011830 con 0x7fd35c0a1380 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd359ffb700 1 -- 172.21.15.125:0/1960443156 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350011990 con 0x7fd35c0a1380 2023-10-03T10:13:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.586+0000 7fd359ffb700 1 -- 172.21.15.125:0/1960443156 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350011d20 con 0x7fd35c0a1380 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 -- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 msgr2=0x7fd35c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c133a10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd3500098f0 tx=0x7fd350009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 -- 172.21.15.125:0/1960443156 shutdown_connections 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 --2- 172.21.15.125:0/1960443156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c133a10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 -- 172.21.15.125:0/1960443156 >> 172.21.15.125:0/1960443156 conn(0x7fd35c0a6610 msgr2=0x7fd35c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 -- 172.21.15.125:0/1960443156 shutdown_connections 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.587+0000 7fd361441700 1 -- 172.21.15.125:0/1960443156 wait complete. 2023-10-03T10:13:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 Processor -- start 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 -- start start 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd35c133f50 0x7fd35c123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c126220 con 0x7fd35c0a1380 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c133960 con 0x7fd35c133f50 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd361441700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c133420 con 0x7fd35c0a0a70 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd35a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.588+0000 7fd35affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51642/0 (socket says 172.21.15.125:51642) 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50198/0 (socket says 172.21.15.125:50198) 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35a7fc700 1 -- 172.21.15.125:0/2052894040 learned_addr learned my addr 172.21.15.125:0/2052894040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35b7fe700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd35c133f50 0x7fd35c123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 -- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd35c133f50 msgr2=0x7fd35c123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd35c133f50 0x7fd35c123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 -- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 msgr2=0x7fd35c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 -- 172.21.15.125:0/2052894040 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0094a0 con 0x7fd35c0a0a70 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35a7fc700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd35affd700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e9e0 tx=0x7fd34c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00ee80 con 0x7fd35c0a0a70 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c00c850 con 0x7fd35c0a0a70 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd350009550 con 0x7fd35c0a0a70 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00cc00 con 0x7fd35c0a0a70 2023-10-03T10:13:47.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.589+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c126bb0 con 0x7fd35c0a0a70 2023-10-03T10:13:47.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.590+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd34c00cd60 con 0x7fd35c0a0a70 2023-10-03T10:13:47.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.590+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c04f2a0 con 0x7fd35c0a0a70 2023-10-03T10:13:47.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.590+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd34c03fae0 con 0x7fd35c0a0a70 2023-10-03T10:13:47.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.599+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd34c011d80 con 0x7fd35c0a0a70 2023-10-03T10:13:47.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 Processor -- start 2023-10-03T10:13:47.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 -- start start 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e009dc00 con 0x7fb0e00a1380 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e009ea90 con 0x7fb0e00a0a70 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0e5f18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e009dec0 con 0x7fb0e0134120 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0df7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0dffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0df7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51654/0 (socket says 172.21.15.125:51654) 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0dffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50214/0 (socket says 172.21.15.125:50214) 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0df7fe700 1 -- 172.21.15.125:0/3038019102 learned_addr learned my addr 172.21.15.125:0/3038019102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.628+0000 7fb0deffd700 1 --1- 172.21.15.125:0/3038019102 >> v1:172.21.15.125:6789/0 conn(0x7fb0e00a1380 0x7fb0e0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53496/0 (socket says 172.21.15.125:53496) 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0dffff700 1 -- 172.21.15.125:0/3038019102 >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 msgr2=0x7fb0e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0dffff700 1 --2- 172.21.15.125:0/3038019102 >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0dffff700 1 -- 172.21.15.125:0/3038019102 >> v1:172.21.15.125:6789/0 conn(0x7fb0e00a1380 legacy=0x7fb0e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0dffff700 1 -- 172.21.15.125:0/3038019102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e009e6a0 con 0x7fb0e0134120 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0df7fe700 1 --2- 172.21.15.125:0/3038019102 >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0dffff700 1 --2- 172.21.15.125:0/3038019102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009d90 tx=0x7fb0d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de1f7dc4528e223 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0de7fc700 1 -- 172.21.15.125:0/3038019102 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800e070 con 0x7fb0e0134120 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0de7fc700 1 -- 172.21.15.125:0/3038019102 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800bb20 con 0x7fb0e0134120 2023-10-03T10:13:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0de7fc700 1 -- 172.21.15.125:0/3038019102 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8012430 con 0x7fb0e0134120 2023-10-03T10:13:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 -- 172.21.15.125:0/3038019102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 msgr2=0x7fb0e013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/3038019102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009d90 tx=0x7fb0d800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 -- 172.21.15.125:0/3038019102 shutdown_connections 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/3038019102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e013bce0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/3038019102 >> v2:172.21.15.125:3300/0 conn(0x7fb0e00a0a70 0x7fb0e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.629+0000 7fb0e5f18700 1 -- 172.21.15.125:0/3038019102 >> 172.21.15.125:0/3038019102 conn(0x7fb0e00a6610 msgr2=0x7fb0e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.630+0000 7fb0e5f18700 1 -- 172.21.15.125:0/3038019102 shutdown_connections 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.630+0000 7fb0e5f18700 1 -- 172.21.15.125:0/3038019102 wait complete. 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.630+0000 7fb0e5f18700 1 Processor -- start 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 -- start start 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0e00a1380 0x7fb0e0122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e0123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0133850 con 0x7fb0e00a1380 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0133a80 con 0x7fb0e00a0a70 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0e5f18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01260d0 con 0x7fb0e0134120 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56342/0 (socket says 172.21.15.125:56342) 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 -- 172.21.15.125:0/2340149383 learned_addr learned my addr 172.21.15.125:0/2340149383 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0dffff700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e0123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0deffd700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0e00a1380 0x7fb0e0122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 -- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 msgr2=0x7fb0e0123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e0123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 -- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0e00a1380 msgr2=0x7fb0e0122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0e00a1380 0x7fb0e0122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.631+0000 7fb0df7fe700 1 -- 172.21.15.125:0/2340149383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009550 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0df7fe700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000ec10 tx=0x7fb0d000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000c850 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d000c9b0 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8009a70 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000cd40 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e0125e10 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.632+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d0013470 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.633+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e004f2a0 con 0x7fb0e00a0a70 2023-10-03T10:13:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.633+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0d003fc70 con 0x7fb0e00a0a70 2023-10-03T10:13:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.637+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d0021020 con 0x7fb0e00a0a70 2023-10-03T10:13:47.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.792+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd35c126010 con 0x7fd35c0a0a70 2023-10-03T10:13:47.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.792+0000 7fd3437fe700 1 -- 172.21.15.125:0/2052894040 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd34c021030 con 0x7fd35c0a0a70 2023-10-03T10:13:47.793 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:47.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 msgr2=0x7fd35c122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e9e0 tx=0x7fd34c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 shutdown_connections 2023-10-03T10:13:47.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd35c133f50 0x7fd35c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd35c0a0a70 0x7fd35c122900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 --2- 172.21.15.125:0/2052894040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35c0a1380 0x7fd35c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 >> 172.21.15.125:0/2052894040 conn(0x7fd35c0a6610 msgr2=0x7fd35c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 shutdown_connections 2023-10-03T10:13:47.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.794+0000 7fd361441700 1 -- 172.21.15.125:0/2052894040 wait complete. 2023-10-03T10:13:47.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:47.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.831+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0e0126ba0 con 0x7fb0e00a0a70 2023-10-03T10:13:47.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.831+0000 7fb0c7fff700 1 -- 172.21.15.125:0/2340149383 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d0013720 con 0x7fb0e00a0a70 2023-10-03T10:13:47.832 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.833+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 msgr2=0x7fb0e0122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.833+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000ec10 tx=0x7fb0d000ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 shutdown_connections 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0e0134120 0x7fb0e0123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0e00a0a70 0x7fb0e0122910 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 --2- 172.21.15.125:0/2340149383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0e00a1380 0x7fb0e0122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 >> 172.21.15.125:0/2340149383 conn(0x7fb0e00a6610 msgr2=0x7fb0e009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 shutdown_connections 2023-10-03T10:13:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:47.834+0000 7fb0e5f18700 1 -- 172.21.15.125:0/2340149383 wait complete. 2023-10-03T10:13:47.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:47.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:47.924 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.011+0000 7fcbe45d8700 1 Processor -- start 2023-10-03T10:13:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.011+0000 7fcbe45d8700 1 -- start start 2023-10-03T10:13:48.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe45d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 0x7fcbdc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe45d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe45d8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc09c970 con 0x7fcbdc131d70 2023-10-03T10:13:48.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe45d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0a0920 con 0x7fcbdc09f180 2023-10-03T10:13:48.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe45d8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc09f9c0 con 0x7fcbdc09e870 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2374700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 0x7fcbdc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe1b73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2b75700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcbdc131d70 0x7fcbdc138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53506/0 (socket says 172.21.15.125:53506) 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2b75700 1 -- 172.21.15.125:0/3341600401 learned_addr learned my addr 172.21.15.125:0/3341600401 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2374700 1 -- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 msgr2=0x7fcbdc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2374700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2374700 1 -- 172.21.15.125:0/3341600401 >> v1:172.21.15.125:6789/0 conn(0x7fcbdc131d70 legacy=0x7fcbdc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe2374700 1 -- 172.21.15.125:0/3341600401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc09bab0 con 0x7fcbdc09e870 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe1372700 1 -- 172.21.15.125:0/3341600401 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363873753 0 0) 0x7fcbdc09c970 con 0x7fcbdc131d70 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.012+0000 7fcbe1b73700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe2374700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 0x7fcbdc09ec40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009870 tx=0x7fcbd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1576c20df9c9594 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe1372700 1 -- 172.21.15.125:0/3341600401 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8011830 con 0x7fcbdc09e870 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe1372700 1 -- 172.21.15.125:0/3341600401 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd8011990 con 0x7fcbdc09e870 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe1372700 1 -- 172.21.15.125:0/3341600401 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8011d20 con 0x7fcbdc09e870 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 -- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 msgr2=0x7fcbdc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 0x7fcbdc09ec40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009870 tx=0x7fcbd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 -- 172.21.15.125:0/3341600401 shutdown_connections 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc09e870 0x7fcbdc09ec40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/3341600401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 -- 172.21.15.125:0/3341600401 >> 172.21.15.125:0/3341600401 conn(0x7fcbdc0a4430 msgr2=0x7fcbdc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.013+0000 7fcbe45d8700 1 -- 172.21.15.125:0/3341600401 shutdown_connections 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.014+0000 7fcbe45d8700 1 -- 172.21.15.125:0/3341600401 wait complete. 2023-10-03T10:13:48.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.014+0000 7fcbe45d8700 1 Processor -- start 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.014+0000 7fcbe45d8700 1 -- start start 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbdc09e870 0x7fcbdc1c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 0x7fcbdc1c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc11e640 con 0x7fcbdc09e870 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc11e450 con 0x7fcbdc09f180 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe45d8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc131830 con 0x7fcbdc131d70 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56360/0 (socket says 172.21.15.125:56360) 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 -- 172.21.15.125:0/238425027 learned_addr learned my addr 172.21.15.125:0/238425027 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe2b75700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 0x7fcbdc1c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe2374700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbdc09e870 0x7fcbdc1c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 -- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 msgr2=0x7fcbdc1c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 0x7fcbdc1c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 -- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbdc09e870 msgr2=0x7fcbdc1c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbdc09e870 0x7fcbdc1c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 -- 172.21.15.125:0/238425027 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc0094a0 con 0x7fcbdc09f180 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe2b75700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 0x7fcbdc1c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbe1b73700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00ebb0 tx=0x7fcbcc00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.015+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00c850 con 0x7fcbdc09f180 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc00c9b0 con 0x7fcbdc09f180 2023-10-03T10:13:48.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd80094a0 con 0x7fcbdc09f180 2023-10-03T10:13:48.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00cd40 con 0x7fcbdc09f180 2023-10-03T10:13:48.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc1203d0 con 0x7fcbdc09f180 2023-10-03T10:13:48.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbcc013470 con 0x7fcbdc09f180 2023-10-03T10:13:48.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.016+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbcc03f760 con 0x7fcbdc09f180 2023-10-03T10:13:48.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.017+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc11f120 con 0x7fcbdc09f180 2023-10-03T10:13:48.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.025+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbcc0232f0 con 0x7fcbdc09f180 2023-10-03T10:13:48.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.058+0000 7f38a3924700 1 Processor -- start 2023-10-03T10:13:48.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.058+0000 7f38a3924700 1 -- start start 2023-10-03T10:13:48.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a3924700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a3924700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a3924700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c09e9d0 con 0x7f389c0a0a70 2023-10-03T10:13:48.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a3924700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c09dc00 con 0x7f389c0a1550 2023-10-03T10:13:48.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a3924700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f389c09dec0 con 0x7f389c139200 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a0ebf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50252/0 (socket says 172.21.15.125:50252) 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a0ebf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51674/0 (socket says 172.21.15.125:51674) 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2126273911 learned_addr learned my addr 172.21.15.125:0/2126273911 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2126273911 >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 msgr2=0x7f389c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 --2- 172.21.15.125:0/2126273911 >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2126273911 >> v1:172.21.15.125:6789/0 conn(0x7f389c0a0a70 legacy=0x7f389c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2126273911 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c09e6a0 con 0x7f389c139200 2023-10-03T10:13:48.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f3893fff700 1 -- 172.21.15.125:0/2126273911 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087469860 0 0) 0x7f389c09e9d0 con 0x7f389c0a0a70 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a0ebf700 1 --2- 172.21.15.125:0/2126273911 >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f38a1ec1700 1 --2- 172.21.15.125:0/2126273911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3894009e50 tx=0x7f389400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a2fdd8a30345676 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.059+0000 7f3893fff700 1 -- 172.21.15.125:0/2126273911 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389400e070 con 0x7f389c139200 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f3893fff700 1 -- 172.21.15.125:0/2126273911 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389400b910 con 0x7f389c139200 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f3893fff700 1 -- 172.21.15.125:0/2126273911 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389400bcc0 con 0x7f389c139200 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 -- 172.21.15.125:0/2126273911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 msgr2=0x7f389c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 --2- 172.21.15.125:0/2126273911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3894009e50 tx=0x7f389400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 -- 172.21.15.125:0/2126273911 shutdown_connections 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 --2- 172.21.15.125:0/2126273911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c13b5e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 --2- 172.21.15.125:0/2126273911 >> v2:172.21.15.125:3300/0 conn(0x7f389c0a1550 0x7f389c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 -- 172.21.15.125:0/2126273911 >> 172.21.15.125:0/2126273911 conn(0x7f389c0a6610 msgr2=0x7f389c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 -- 172.21.15.125:0/2126273911 shutdown_connections 2023-10-03T10:13:48.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.060+0000 7f38a3924700 1 -- 172.21.15.125:0/2126273911 wait complete. 2023-10-03T10:13:48.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.062+0000 7f38a3924700 1 Processor -- start 2023-10-03T10:13:48.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.062+0000 7f38a3924700 1 -- start start 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.062+0000 7f38a3924700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f389c0a0a70 0x7f389c1208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.062+0000 7f38a3924700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f389c0a1550 0x7f389c120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.062+0000 7f38a3924700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a3924700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c1243c0 con 0x7f389c0a0a70 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a3924700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0a03e0 con 0x7f389c0a1550 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a3924700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f389c1224b0 con 0x7f389c139200 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a16c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f389c0a0a70 0x7f389c1208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50254/0 (socket says 172.21.15.125:50254) 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2758206225 learned_addr learned my addr 172.21.15.125:0/2758206225 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a0ebf700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f389c0a1550 0x7f389c120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f389c0a1550 msgr2=0x7f389c120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f389c0a1550 0x7f389c120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f389c0a0a70 msgr2=0x7f389c1208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f389c0a0a70 0x7f389c1208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 -- 172.21.15.125:0/2758206225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0094a0 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a1ec1700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3894012000 tx=0x7f3894004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894003ea0 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940048e0 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389401c680 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894009b30 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.063+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c123e20 con 0x7f389c139200 2023-10-03T10:13:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.064+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f389401c7e0 con 0x7f389c139200 2023-10-03T10:13:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.064+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3894041360 con 0x7f389c139200 2023-10-03T10:13:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.065+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c0a2700 con 0x7f389c139200 2023-10-03T10:13:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.069+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38940257d0 con 0x7f389c139200 2023-10-03T10:13:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.231+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbdc04f2a0 con 0x7fcbdc09f180 2023-10-03T10:13:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.232+0000 7fcbd2ffd700 1 -- 172.21.15.125:0/238425027 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbcc021030 con 0x7fcbdc09f180 2023-10-03T10:13:48.232 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:48.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 msgr2=0x7fcbdc1c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00ebb0 tx=0x7fcbcc00eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 shutdown_connections 2023-10-03T10:13:48.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcbdc131d70 0x7fcbdc1c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbdc09e870 0x7fcbdc1c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 --2- 172.21.15.125:0/238425027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbdc09f180 0x7fcbdc1c65b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 >> 172.21.15.125:0/238425027 conn(0x7fcbdc0a4430 msgr2=0x7fcbdc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 shutdown_connections 2023-10-03T10:13:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.234+0000 7fcbe45d8700 1 -- 172.21.15.125:0/238425027 wait complete. 2023-10-03T10:13:48.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.272+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f389c122d00 con 0x7f389c139200 2023-10-03T10:13:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.272+0000 7f3891ffb700 1 -- 172.21.15.125:0/2758206225 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3894034090 con 0x7f389c139200 2023-10-03T10:13:48.273 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 msgr2=0x7f389c121320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3894012000 tx=0x7f3894004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 shutdown_connections 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f389c139200 0x7f389c121320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f389c0a0a70 0x7f389c1208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 --2- 172.21.15.125:0/2758206225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f389c0a1550 0x7f389c120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 >> 172.21.15.125:0/2758206225 conn(0x7f389c0a6610 msgr2=0x7f389c136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 shutdown_connections 2023-10-03T10:13:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.274+0000 7f38a3924700 1 -- 172.21.15.125:0/2758206225 wait complete. 2023-10-03T10:13:48.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:48.808 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:48.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.934+0000 7f4d3b6c1700 1 Processor -- start 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.934+0000 7f4d3b6c1700 1 -- start start 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3b6c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3b6c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 0x7f4d34133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3b6c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3409dc00 con 0x7f4d34133f50 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3b6c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3409ea60 con 0x7f4d340a1380 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3b6c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3409dec0 con 0x7f4d340a0a70 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d38c5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 0x7f4d34133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56378/0 (socket says 172.21.15.125:56378) 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 -- 172.21.15.125:0/3331303427 learned_addr learned my addr 172.21.15.125:0/3331303427 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 -- 172.21.15.125:0/3331303427 >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 msgr2=0x7f4d34133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 --2- 172.21.15.125:0/3331303427 >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 0x7f4d34133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 -- 172.21.15.125:0/3331303427 >> v1:172.21.15.125:6789/0 conn(0x7f4d34133f50 legacy=0x7f4d3413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 -- 172.21.15.125:0/3331303427 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3409e6a0 con 0x7f4d340a0a70 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d38c5c700 1 --2- 172.21.15.125:0/3331303427 >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 0x7f4d34133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d3945d700 1 --2- 172.21.15.125:0/3331303427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098f0 tx=0x7f4d30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5720f7150df88b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d2bfff700 1 -- 172.21.15.125:0/3331303427 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011830 con 0x7f4d340a0a70 2023-10-03T10:13:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d2bfff700 1 -- 172.21.15.125:0/3331303427 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30011990 con 0x7f4d340a0a70 2023-10-03T10:13:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.935+0000 7f4d2bfff700 1 -- 172.21.15.125:0/3331303427 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011d20 con 0x7f4d340a0a70 2023-10-03T10:13:48.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/3331303427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 msgr2=0x7f4d340a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/3331303427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098f0 tx=0x7f4d30009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:48.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/3331303427 shutdown_connections 2023-10-03T10:13:48.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/3331303427 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340a0a70 0x7f4d340a0e40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/3331303427 >> v2:172.21.15.125:3300/0 conn(0x7f4d340a1380 0x7f4d34133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/3331303427 >> 172.21.15.125:0/3331303427 conn(0x7f4d340a6610 msgr2=0x7f4d340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/3331303427 shutdown_connections 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.936+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/3331303427 wait complete. 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 Processor -- start 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 -- start start 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d34133f50 0x7f4d3411f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341220d0 con 0x7f4d340a0a70 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341222d0 con 0x7f4d34133f50 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3b6c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34133980 con 0x7f4d340a1380 2023-10-03T10:13:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d3945d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.937+0000 7f4d38c5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d3945d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51696/0 (socket says 172.21.15.125:51696) 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d3945d700 1 -- 172.21.15.125:0/4195481938 learned_addr learned my addr 172.21.15.125:0/4195481938 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50264/0 (socket says 172.21.15.125:50264) 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d39c5e700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d34133f50 0x7f4d3411f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 -- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d34133f50 msgr2=0x7f4d3411f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d34133f50 0x7f4d3411f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 -- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 msgr2=0x7f4d3411e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 -- 172.21.15.125:0/4195481938 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240094a0 con 0x7f4d340a1380 2023-10-03T10:13:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d3945d700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d38c5c700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400e9b0 tx=0x7f4d2400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400ee50 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400c850 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30009550 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400cbe0 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.938+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d34133740 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.939+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d2400cd40 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.939+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d2403f830 con 0x7f4d340a1380 2023-10-03T10:13:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.939+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3404f2a0 con 0x7f4d340a1380 2023-10-03T10:13:48.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.944+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d240232f0 con 0x7f4d340a1380 2023-10-03T10:13:48.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 Processor -- start 2023-10-03T10:13:48.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 -- start start 2023-10-03T10:13:48.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c09dc00 con 0x7fe36c0a1380 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c09ea90 con 0x7fe36c134120 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe3728c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c09dec0 con 0x7fe36c0a0a70 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe36bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe36bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50274/0 (socket says 172.21.15.125:50274) 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe36bfff700 1 -- 172.21.15.125:0/3425418511 learned_addr learned my addr 172.21.15.125:0/3425418511 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.977+0000 7fe370e61700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe370e61700 1 -- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 msgr2=0x7fe36c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe370e61700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe36affd700 1 -- 172.21.15.125:0/3425418511 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657119743 0 0) 0x7fe36c09dc00 con 0x7fe36c0a1380 2023-10-03T10:13:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe370e61700 1 -- 172.21.15.125:0/3425418511 >> v1:172.21.15.125:6789/0 conn(0x7fe36c0a1380 legacy=0x7fe36c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe370e61700 1 -- 172.21.15.125:0/3425418511 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c09e6a0 con 0x7fe36c134120 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe36bfff700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe370e61700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c13bce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe364009dc0 tx=0x7fe36400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f554185d72cab14f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe36affd700 1 -- 172.21.15.125:0/3425418511 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400e070 con 0x7fe36c134120 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe36affd700 1 -- 172.21.15.125:0/3425418511 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400bb20 con 0x7fe36c134120 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.978+0000 7fe36affd700 1 -- 172.21.15.125:0/3425418511 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364012430 con 0x7fe36c134120 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 -- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 msgr2=0x7fe36c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c13bce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe364009dc0 tx=0x7fe36400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 -- 172.21.15.125:0/3425418511 shutdown_connections 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c13bce0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 --2- 172.21.15.125:0/3425418511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a0a70 0x7fe36c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 -- 172.21.15.125:0/3425418511 >> 172.21.15.125:0/3425418511 conn(0x7fe36c0a6610 msgr2=0x7fe36c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 -- 172.21.15.125:0/3425418511 shutdown_connections 2023-10-03T10:13:48.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.979+0000 7fe3728c4700 1 -- 172.21.15.125:0/3425418511 wait complete. 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 Processor -- start 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 -- start start 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 0x7fe36c122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 0x7fe36c122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c125930 con 0x7fe36c0a0a70 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c124320 con 0x7fe36c134120 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe3728c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0a5600 con 0x7fe36c0a1380 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe36b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 0x7fe36c122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe370e61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe36b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 0x7fe36c122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50276/0 (socket says 172.21.15.125:50276) 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe36b7fe700 1 -- 172.21.15.125:0/2889068651 learned_addr learned my addr 172.21.15.125:0/2889068651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.980+0000 7fe36bfff700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 0x7fe36c122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 -- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 msgr2=0x7fe36c122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 0x7fe36c122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 -- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 msgr2=0x7fe36c122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 0x7fe36c122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 -- 172.21.15.125:0/2889068651 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c009550 con 0x7fe36c134120 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe36bfff700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 0x7fe36c122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe370e61700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c123190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe364016000 tx=0x7fe364004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364004880 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364020070 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe364009a70 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640276c0 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.981+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c125c90 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.982+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe364012430 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.982+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe364022070 con 0x7fe36c134120 2023-10-03T10:13:48.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.982+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c04f2a0 con 0x7fe36c134120 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:48.986+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe36401b400 con 0x7fe36c134120 2023-10-03T10:13:49.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.134+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d34120b70 con 0x7f4d340a1380 2023-10-03T10:13:49.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.135+0000 7f4d29ffb700 1 -- 172.21.15.125:0/4195481938 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d2401bba0 con 0x7f4d340a1380 2023-10-03T10:13:49.135 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 msgr2=0x7f4d3411ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400e9b0 tx=0x7f4d2400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 shutdown_connections 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d34133f50 0x7f4d3411f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a0a70 0x7f4d3411e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 --2- 172.21.15.125:0/4195481938 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d340a1380 0x7f4d3411ecf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 >> 172.21.15.125:0/4195481938 conn(0x7f4d340a6610 msgr2=0x7f4d340a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 shutdown_connections 2023-10-03T10:13:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.137+0000 7f4d3b6c1700 1 -- 172.21.15.125:0/4195481938 wait complete. 2023-10-03T10:13:49.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:49.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.178+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe36c072980 con 0x7fe36c134120 2023-10-03T10:13:49.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.178+0000 7fe368ff9700 1 -- 172.21.15.125:0/2889068651 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe36402c020 con 0x7fe36c134120 2023-10-03T10:13:49.179 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:49.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 msgr2=0x7fe36c123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c123190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe364016000 tx=0x7fe364004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 shutdown_connections 2023-10-03T10:13:49.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe36c134120 0x7fe36c123190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe36c0a0a70 0x7fe36c122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 --2- 172.21.15.125:0/2889068651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe36c0a1380 0x7fe36c122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.180+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 >> 172.21.15.125:0/2889068651 conn(0x7fe36c0a6610 msgr2=0x7fe36c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.181+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 shutdown_connections 2023-10-03T10:13:49.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.181+0000 7fe3728c4700 1 -- 172.21.15.125:0/2889068651 wait complete. 2023-10-03T10:13:49.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:49.247 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:49.288 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:49.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.372+0000 7f0ca3aab700 1 Processor -- start 2023-10-03T10:13:49.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.372+0000 7f0ca3aab700 1 -- start start 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca3aab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c9c12feb0 0x7f0c9c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca3aab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c099af0 0x7f0c9c137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca3aab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c09a540 con 0x7f0c9c1307c0 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca3aab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c09ad40 con 0x7f0c9c12feb0 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca3aab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c09e640 con 0x7f0c9c099af0 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c9c12feb0 0x7f0c9c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca2048700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c099af0 0x7f0c9c137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1046700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0c9c1307c0 0x7f0c9c0993e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53534/0 (socket says 172.21.15.125:53534) 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c9c12feb0 0x7f0c9c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51708/0 (socket says 172.21.15.125:51708) 2023-10-03T10:13:49.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1046700 1 -- 172.21.15.125:0/1984820232 learned_addr learned my addr 172.21.15.125:0/1984820232 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 -- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c099af0 msgr2=0x7f0c9c137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 --2- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c099af0 0x7f0c9c137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 -- 172.21.15.125:0/1984820232 >> v1:172.21.15.125:6789/0 conn(0x7f0c9c1307c0 legacy=0x7f0c9c0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 -- 172.21.15.125:0/1984820232 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c09e3c0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca0845700 1 -- 172.21.15.125:0/1984820232 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320062491 0 0) 0x7f0c9c09a540 con 0x7f0c9c1307c0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca1847700 1 --2- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c12feb0 0x7f0c9c130280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800bac0 tx=0x7f0c9800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e987121da0f616 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca0845700 1 -- 172.21.15.125:0/1984820232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98005e30 con 0x7f0c9c12feb0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca0845700 1 -- 172.21.15.125:0/1984820232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800d860 con 0x7f0c9c12feb0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.373+0000 7f0ca0845700 1 -- 172.21.15.125:0/1984820232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800dbf0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 -- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c12feb0 msgr2=0x7f0c9c130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c12feb0 0x7f0c9c130280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800bac0 tx=0x7f0c9800bdd0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 -- 172.21.15.125:0/1984820232 shutdown_connections 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c099af0 0x7f0c9c137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/1984820232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c12feb0 0x7f0c9c130280 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 -- 172.21.15.125:0/1984820232 >> 172.21.15.125:0/1984820232 conn(0x7f0c9c0a2b30 msgr2=0x7f0c9c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 -- 172.21.15.125:0/1984820232 shutdown_connections 2023-10-03T10:13:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.374+0000 7f0ca3aab700 1 -- 172.21.15.125:0/1984820232 wait complete. 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 Processor -- start 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 -- start start 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c9c099af0 0x7f0c9c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 0x7f0c9c1c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c09fe50 con 0x7f0c9c1307c0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c072550 con 0x7f0c9c12feb0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.375+0000 7f0ca3aab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c06f020 con 0x7f0c9c099af0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca2048700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 0x7f0c9c1c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56440/0 (socket says 172.21.15.125:56440) 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 -- 172.21.15.125:0/2837053731 learned_addr learned my addr 172.21.15.125:0/2837053731 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1847700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c9c099af0 0x7f0c9c06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 -- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c9c099af0 msgr2=0x7f0c9c06f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c9c099af0 0x7f0c9c06f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 -- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 msgr2=0x7f0c9c1c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 0x7f0c9c1c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 -- 172.21.15.125:0/2837053731 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9800b6d0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca2048700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 0x7f0c9c1c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca1046700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00c550 tx=0x7f0c8c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c004c80 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c004de0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c007310 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c06f270 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.376+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c0705d0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.377+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c8c007470 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.377+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c12a250 con 0x7f0c9c12feb0 2023-10-03T10:13:49.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.377+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c8c03f370 con 0x7f0c9c12feb0 2023-10-03T10:13:49.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.386+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c8c0133c0 con 0x7f0c9c12feb0 2023-10-03T10:13:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 Processor -- start 2023-10-03T10:13:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 -- start start 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 0x7f98981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989809c970 con 0x7f989809e870 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980a0920 con 0x7f989809f350 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.418+0000 7f989fdea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f989809f9c0 con 0x7f98981371c0 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989d385700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989d385700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51714/0 (socket says 172.21.15.125:51714) 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 0x7f98981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989d385700 1 -- 172.21.15.125:0/240055445 learned_addr learned my addr 172.21.15.125:0/240055445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 -- 172.21.15.125:0/240055445 >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 msgr2=0x7f9898136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 --2- 172.21.15.125:0/240055445 >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 -- 172.21.15.125:0/240055445 >> v1:172.21.15.125:6789/0 conn(0x7f989809e870 legacy=0x7f989809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 -- 172.21.15.125:0/240055445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989809bab0 con 0x7f98981371c0 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989d385700 1 --2- 172.21.15.125:0/240055445 >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989e387700 1 --2- 172.21.15.125:0/240055445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 0x7f98981395a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6134281fc99d638e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989cb84700 1 -- 172.21.15.125:0/240055445 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000e070 con 0x7f98981371c0 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989cb84700 1 -- 172.21.15.125:0/240055445 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989000bb20 con 0x7f98981371c0 2023-10-03T10:13:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.419+0000 7f989cb84700 1 -- 172.21.15.125:0/240055445 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012430 con 0x7f98981371c0 2023-10-03T10:13:49.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 -- 172.21.15.125:0/240055445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 msgr2=0x7f98981395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 --2- 172.21.15.125:0/240055445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 0x7f98981395a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 -- 172.21.15.125:0/240055445 shutdown_connections 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 --2- 172.21.15.125:0/240055445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98981371c0 0x7f98981395a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 --2- 172.21.15.125:0/240055445 >> v2:172.21.15.125:3300/0 conn(0x7f989809f350 0x7f9898136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 -- 172.21.15.125:0/240055445 >> 172.21.15.125:0/240055445 conn(0x7f98980a4430 msgr2=0x7f98980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 -- 172.21.15.125:0/240055445 shutdown_connections 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.420+0000 7f989fdea700 1 -- 172.21.15.125:0/240055445 wait complete. 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.421+0000 7f989fdea700 1 Processor -- start 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.421+0000 7f989fdea700 1 -- start start 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 0x7f9898133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 0x7f9898133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98981371c0 0x7f98981c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898134470 con 0x7f989809e870 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989806d6b0 con 0x7f98981371c0 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989fdea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98981341e0 con 0x7f989809f350 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989db86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 0x7f9898133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989db86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 0x7f9898133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51718/0 (socket says 172.21.15.125:51718) 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989db86700 1 -- 172.21.15.125:0/661089650 learned_addr learned my addr 172.21.15.125:0/661089650 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 0x7f9898133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989e387700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98981371c0 0x7f98981c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 -- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98981371c0 msgr2=0x7f98981c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98981371c0 0x7f98981c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 -- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 msgr2=0x7f9898133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 0x7f9898133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 -- 172.21.15.125:0/661089650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888009550 con 0x7f989809f350 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.422+0000 7f989d385700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 0x7f9898133ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f988800e9d0 tx=0x7f988800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.423+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800ee70 con 0x7f989809f350 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.423+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888004030 con 0x7f989809f350 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.423+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890009a70 con 0x7f989809f350 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.423+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880043c0 con 0x7f989809f350 2023-10-03T10:13:49.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.423+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98980723a0 con 0x7f989809f350 2023-10-03T10:13:49.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.424+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989804f2a0 con 0x7f989809f350 2023-10-03T10:13:49.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.424+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f988800c850 con 0x7f989809f350 2023-10-03T10:13:49.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.424+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f988803f890 con 0x7f989809f350 2023-10-03T10:13:49.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.428+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9888011d90 con 0x7f989809f350 2023-10-03T10:13:49.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.578+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c9c0a0970 con 0x7f0c9c12feb0 2023-10-03T10:13:49.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.578+0000 7f0c927fc700 1 -- 172.21.15.125:0/2837053731 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c8c011360 con 0x7f0c9c12feb0 2023-10-03T10:13:49.579 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 msgr2=0x7f0c9c1c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00c550 tx=0x7f0c8c00c860 comp rx=0 tx=0).stop 2023-10-03T10:13:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 shutdown_connections 2023-10-03T10:13:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c9c1307c0 0x7f0c9c1c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c9c099af0 0x7f0c9c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 --2- 172.21.15.125:0/2837053731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c9c12feb0 0x7f0c9c1c3dc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 >> 172.21.15.125:0/2837053731 conn(0x7f0c9c0a2b30 msgr2=0x7f0c9c09c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 shutdown_connections 2023-10-03T10:13:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.580+0000 7f0ca3aab700 1 -- 172.21.15.125:0/2837053731 wait complete. 2023-10-03T10:13:49.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:49.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.618+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9898122c70 con 0x7f989809f350 2023-10-03T10:13:49.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.619+0000 7f988e7fc700 1 -- 172.21.15.125:0/661089650 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9888020030 con 0x7f989809f350 2023-10-03T10:13:49.619 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 msgr2=0x7f9898133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 0x7f9898133ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f988800e9d0 tx=0x7f988800ece0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 shutdown_connections 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98981371c0 0x7f98981c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f989809e870 0x7f9898133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 --2- 172.21.15.125:0/661089650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f989809f350 0x7f9898133ca0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 >> 172.21.15.125:0/661089650 conn(0x7f98980a4430 msgr2=0x7f9898134960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 shutdown_connections 2023-10-03T10:13:49.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:49.621+0000 7f989fdea700 1 -- 172.21.15.125:0/661089650 wait complete. 2023-10-03T10:13:49.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:50.150 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:50.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:50.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.277+0000 7f04bb79f700 1 Processor -- start 2023-10-03T10:13:50.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.277+0000 7f04bb79f700 1 -- start start 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04bb79f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04b40a0b50 0x7f04b40a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04bb79f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 0x7f04b41341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04bb79f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b40a1e60 con 0x7f04b40a2e10 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04bb79f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b409aa00 con 0x7f04b40a0b50 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04bb79f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40a2340 con 0x7f04b40a1460 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04b40a0b50 0x7f04b40a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b9d3c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 0x7f04b41341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04b40a0b50 0x7f04b40a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51724/0 (socket says 172.21.15.125:51724) 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 -- 172.21.15.125:0/1845137211 learned_addr learned my addr 172.21.15.125:0/1845137211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b8d3a700 1 --1- 172.21.15.125:0/1845137211 >> v1:172.21.15.125:6789/0 conn(0x7f04b40a2e10 0x7f04b4133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53544/0 (socket says 172.21.15.125:53544) 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 -- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 msgr2=0x7f04b41341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 0x7f04b41341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 -- 172.21.15.125:0/1845137211 >> v1:172.21.15.125:6789/0 conn(0x7f04b40a2e10 legacy=0x7f04b4133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 -- 172.21.15.125:0/1845137211 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b409a5b0 con 0x7f04b40a0b50 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b3fff700 1 -- 172.21.15.125:0/1845137211 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534786097 0 0) 0x7f04b40a1e60 con 0x7f04b40a2e10 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b9d3c700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 0x7f04b41341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b953b700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a0b50 0x7f04b40a0f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009e50 tx=0x7f04a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aedaade674a97b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b3fff700 1 -- 172.21.15.125:0/1845137211 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400e070 con 0x7f04b40a0b50 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b3fff700 1 -- 172.21.15.125:0/1845137211 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a400b910 con 0x7f04b40a0b50 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.278+0000 7f04b3fff700 1 -- 172.21.15.125:0/1845137211 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400bcc0 con 0x7f04b40a0b50 2023-10-03T10:13:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 -- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a0b50 msgr2=0x7f04b40a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a0b50 0x7f04b40a0f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009e50 tx=0x7f04a400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 -- 172.21.15.125:0/1845137211 shutdown_connections 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a1460 0x7f04b41341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1845137211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a0b50 0x7f04b40a0f20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 -- 172.21.15.125:0/1845137211 >> 172.21.15.125:0/1845137211 conn(0x7f04b406c780 msgr2=0x7f04b406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 -- 172.21.15.125:0/1845137211 shutdown_connections 2023-10-03T10:13:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.279+0000 7f04bb79f700 1 -- 172.21.15.125:0/1845137211 wait complete. 2023-10-03T10:13:50.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.280+0000 7f04bb79f700 1 Processor -- start 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.280+0000 7f04bb79f700 1 -- start start 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 0x7f04b4134030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 0x7f04b41c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b41234c0 con 0x7f04b40a1460 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4134570 con 0x7f04b40a2e10 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04bb79f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4121800 con 0x7f04b40a0b50 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50324/0 (socket says 172.21.15.125:50324) 2023-10-03T10:13:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 -- 172.21.15.125:0/1025681526 learned_addr learned my addr 172.21.15.125:0/1025681526 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b9d3c700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 0x7f04b41c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b8d3a700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 0x7f04b4134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 -- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 msgr2=0x7f04b41c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 0x7f04b41c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 -- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 msgr2=0x7f04b4134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 0x7f04b4134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b953b700 1 -- 172.21.15.125:0/1025681526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0094a0 con 0x7f04b40a0b50 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b9d3c700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 0x7f04b41c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.281+0000 7f04b8d3a700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 0x7f04b4134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04b953b700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04a400b370 tx=0x7f04a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4004970 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a40092e0 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a4009b30 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a401c680 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.282+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b409c730 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.283+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04a401c7e0 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.283+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04a4041250 con 0x7f04b40a0b50 2023-10-03T10:13:50.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.283+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b404f2a0 con 0x7f04b40a0b50 2023-10-03T10:13:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.288+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04a402d940 con 0x7f04b40a0b50 2023-10-03T10:13:50.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.320+0000 7f3262e64700 1 Processor -- start 2023-10-03T10:13:50.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.320+0000 7f3262e64700 1 -- start start 2023-10-03T10:13:50.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3262e64700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f325c0a1550 0x7f325c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3262e64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3262e64700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c09e9d0 con 0x7f325c0a0a70 2023-10-03T10:13:50.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3262e64700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c09dc00 con 0x7f325c0a1550 2023-10-03T10:13:50.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3262e64700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09dec0 con 0x7f325c139200 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f325c0a1550 0x7f325c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f325c0a1550 0x7f325c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51750/0 (socket says 172.21.15.125:51750) 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 -- 172.21.15.125:0/2631408164 learned_addr learned my addr 172.21.15.125:0/2631408164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3260c00700 1 --1- 172.21.15.125:0/2631408164 >> v1:172.21.15.125:6789/0 conn(0x7f325c0a0a70 0x7f325c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53548/0 (socket says 172.21.15.125:53548) 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f3261401700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 -- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 msgr2=0x7f325c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 -- 172.21.15.125:0/2631408164 >> v1:172.21.15.125:6789/0 conn(0x7f325c0a0a70 legacy=0x7f325c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 -- 172.21.15.125:0/2631408164 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c09e6a0 con 0x7f325c0a1550 2023-10-03T10:13:50.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.321+0000 7f325bfff700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a1550 0x7f325c138cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32480098f0 tx=0x7f3248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c6e205113d0f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f325b7fe700 1 -- 172.21.15.125:0/2631408164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248004230 con 0x7f325c0a1550 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f325b7fe700 1 -- 172.21.15.125:0/2631408164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3248004390 con 0x7f325c0a1550 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f325b7fe700 1 -- 172.21.15.125:0/2631408164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32480036a0 con 0x7f325c0a1550 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 -- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a1550 msgr2=0x7f325c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a1550 0x7f325c138cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32480098f0 tx=0x7f3248009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 -- 172.21.15.125:0/2631408164 shutdown_connections 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 --2- 172.21.15.125:0/2631408164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a1550 0x7f325c138cc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 -- 172.21.15.125:0/2631408164 >> 172.21.15.125:0/2631408164 conn(0x7f325c0a6610 msgr2=0x7f325c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 -- 172.21.15.125:0/2631408164 shutdown_connections 2023-10-03T10:13:50.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.322+0000 7f3262e64700 1 -- 172.21.15.125:0/2631408164 wait complete. 2023-10-03T10:13:50.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.323+0000 7f3262e64700 1 Processor -- start 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.323+0000 7f3262e64700 1 -- start start 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c0a5320 con 0x7f325c0a0a70 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c120550 con 0x7f325c0a1550 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3262e64700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c0a03e0 con 0x7f325c139200 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f325bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3261401700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f325bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56464/0 (socket says 172.21.15.125:56464) 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51756/0 (socket says 172.21.15.125:51756) 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f325bfff700 1 -- 172.21.15.125:0/15862012 learned_addr learned my addr 172.21.15.125:0/15862012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 -- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 msgr2=0x7f325c11f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c11f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 -- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 msgr2=0x7f325c11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 -- 172.21.15.125:0/15862012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248009550 con 0x7f325c0a0a70 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f325bfff700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.324+0000 7f3260c00700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f325000c780 tx=0x7f325000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.325+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250004c80 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.325+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250004de0 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.325+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c1220e0 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.325+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250007310 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.325+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c122b50 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.326+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3250007470 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.326+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f325003f3e0 con 0x7f325c0a0a70 2023-10-03T10:13:50.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.326+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c04f2a0 con 0x7f325c0a0a70 2023-10-03T10:13:50.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.335+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3250007720 con 0x7f325c0a0a70 2023-10-03T10:13:50.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.489+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04b4121ff0 con 0x7f04b40a0b50 2023-10-03T10:13:50.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.490+0000 7f04b1ffb700 1 -- 172.21.15.125:0/1025681526 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04a402d350 con 0x7f04b40a0b50 2023-10-03T10:13:50.490 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 msgr2=0x7f04b4133af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04a400b370 tx=0x7f04a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 shutdown_connections 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04b40a2e10 0x7f04b41c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04b40a0b50 0x7f04b4133af0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 --2- 172.21.15.125:0/1025681526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04b40a1460 0x7f04b4134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 >> 172.21.15.125:0/1025681526 conn(0x7f04b406c780 msgr2=0x7f04b40a5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 shutdown_connections 2023-10-03T10:13:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.492+0000 7f04bb79f700 1 -- 172.21.15.125:0/1025681526 wait complete. 2023-10-03T10:13:50.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:50.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.530+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f325c072980 con 0x7f325c0a0a70 2023-10-03T10:13:50.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.530+0000 7f32597fa700 1 -- 172.21.15.125:0/15862012 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3250011e80 con 0x7f325c0a0a70 2023-10-03T10:13:50.531 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 msgr2=0x7f325c11e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f325000c780 tx=0x7f325000ca90 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 shutdown_connections 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c139200 0x7f325c11f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c0a0a70 0x7f325c11e8a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 --2- 172.21.15.125:0/15862012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1550 0x7f325c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 >> 172.21.15.125:0/15862012 conn(0x7f325c0a6610 msgr2=0x7f325c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 shutdown_connections 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.532+0000 7f3262e64700 1 -- 172.21.15.125:0/15862012 wait complete. 2023-10-03T10:13:50.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:50.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:50.634 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:50.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.723+0000 7f0d8d7b0700 1 Processor -- start 2023-10-03T10:13:50.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.723+0000 7f0d8d7b0700 1 -- start start 2023-10-03T10:13:50.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d880a0a70 0x7f0d880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 0x7f0d881343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8809e9d0 con 0x7f0d880a0a70 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8809dc00 con 0x7f0d880a1380 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d8d7b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8809dec0 con 0x7f0d88133f50 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d867fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d880a0a70 0x7f0d880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 0x7f0d881343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d880a0a70 0x7f0d880a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51762/0 (socket says 172.21.15.125:51762) 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d867fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56474/0 (socket says 172.21.15.125:56474) 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 -- 172.21.15.125:0/1022320401 learned_addr learned my addr 172.21.15.125:0/1022320401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 -- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 msgr2=0x7f0d881343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 0x7f0d881343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 -- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 msgr2=0x7f0d88133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 -- 172.21.15.125:0/1022320401 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8809e6a0 con 0x7f0d880a0a70 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d867fc700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d877fe700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 0x7f0d881343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.724+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a0a70 0x7f0d880a0e40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0d780098f0 tx=0x7f0d78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eed10e3603e767 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d85ffb700 1 -- 172.21.15.125:0/1022320401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78011830 con 0x7f0d880a0a70 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d85ffb700 1 -- 172.21.15.125:0/1022320401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78011990 con 0x7f0d880a0a70 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d85ffb700 1 -- 172.21.15.125:0/1022320401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78011d20 con 0x7f0d880a0a70 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a0a70 msgr2=0x7f0d880a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a0a70 0x7f0d880a0e40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0d780098f0 tx=0x7f0d78009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/1022320401 shutdown_connections 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d88133f50 0x7f0d881343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a0a70 0x7f0d880a0e40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/1022320401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d880a1380 0x7f0d88133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/1022320401 >> 172.21.15.125:0/1022320401 conn(0x7f0d880a6610 msgr2=0x7f0d880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.725+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/1022320401 shutdown_connections 2023-10-03T10:13:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.726+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/1022320401 wait complete. 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.727+0000 7f0d8d7b0700 1 Processor -- start 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.727+0000 7f0d8d7b0700 1 -- start start 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 0x7f0d881222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 0x7f0d88122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 0x7f0d88122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88124dd0 con 0x7f0d880a1380 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d881240c0 con 0x7f0d88133f50 2023-10-03T10:13:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d8d7b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880a03e0 con 0x7f0d880a0a70 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 0x7f0d88122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 0x7f0d881222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 0x7f0d88122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56488/0 (socket says 172.21.15.125:56488) 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d877fe700 1 -- 172.21.15.125:0/3543521401 learned_addr learned my addr 172.21.15.125:0/3543521401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d867fc700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 0x7f0d88122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 msgr2=0x7f0d88122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 0x7f0d88122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 msgr2=0x7f0d88122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 0x7f0d88122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 -- 172.21.15.125:0/3543521401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0094a0 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d867fc700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 0x7f0d88122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d86ffd700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 0x7f0d881222c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d78016000 tx=0x7f0d78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.728+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78004240 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.729+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7801f070 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.729+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780036a0 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.729+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d80009a70 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.729+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d78009550 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.729+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d78021030 con 0x7f0d880a0a70 2023-10-03T10:13:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.730+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8804f2a0 con 0x7f0d880a0a70 2023-10-03T10:13:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.730+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d78040740 con 0x7f0d880a0a70 2023-10-03T10:13:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.734+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d78015020 con 0x7f0d880a0a70 2023-10-03T10:13:50.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.764+0000 7f7ff37f3700 1 Processor -- start 2023-10-03T10:13:50.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.764+0000 7f7ff37f3700 1 -- start start 2023-10-03T10:13:50.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 0x7f7fec134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec09e9d0 con 0x7f7fec0a1380 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec09dc00 con 0x7f7fec0a0a70 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff37f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec09dec0 con 0x7f7fec133f50 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff158f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff0d8e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 0x7f7fec134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff158f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56490/0 (socket says 172.21.15.125:56490) 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff158f700 1 -- 172.21.15.125:0/2918572242 learned_addr learned my addr 172.21.15.125:0/2918572242 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff0d8e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51776/0 (socket says 172.21.15.125:51776) 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 -- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 msgr2=0x7f7fec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 -- 172.21.15.125:0/2918572242 >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 msgr2=0x7f7fec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 --2- 172.21.15.125:0/2918572242 >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 -- 172.21.15.125:0/2918572242 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec09e6a0 con 0x7f7fec133f50 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff158f700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff0d8e700 1 --2- 172.21.15.125:0/2918572242 >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.765+0000 7f7ff1d90700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 0x7f7fec134380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90fcf30d59808aab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7fe3fff700 1 -- 172.21.15.125:0/2918572242 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400e070 con 0x7f7fec133f50 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7fe3fff700 1 -- 172.21.15.125:0/2918572242 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400bb20 con 0x7f7fec133f50 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7fe3fff700 1 -- 172.21.15.125:0/2918572242 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4012430 con 0x7f7fec133f50 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 msgr2=0x7f7fec134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 0x7f7fec134380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2918572242 shutdown_connections 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2918572242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec133f50 0x7f7fec134380 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2918572242 >> v2:172.21.15.125:3300/0 conn(0x7f7fec0a1380 0x7f7fec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.766+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2918572242 >> 172.21.15.125:0/2918572242 conn(0x7f7fec0a6610 msgr2=0x7f7fec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.767+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2918572242 shutdown_connections 2023-10-03T10:13:50.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.767+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2918572242 wait complete. 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.768+0000 7f7ff37f3700 1 Processor -- start 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.768+0000 7f7ff37f3700 1 -- start start 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.768+0000 7f7ff37f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec1c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 0x7f7fec1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec120df0 con 0x7f7fec133f50 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec122910 con 0x7f7fec0a0a70 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0a0430 con 0x7f7fec0a1380 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50378/0 (socket says 172.21.15.125:50378) 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 -- 172.21.15.125:0/2049197507 learned_addr learned my addr 172.21.15.125:0/2049197507 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff158f700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec1c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff1d90700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 0x7f7fec1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 -- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 msgr2=0x7f7fec1c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec1c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 -- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 msgr2=0x7f7fec1c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 0x7f7fec1c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 -- 172.21.15.125:0/2049197507 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8009550 con 0x7f7fec0a1380 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff1d90700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 0x7f7fec1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff0d8e700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00ebb0 tx=0x7f7fdc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00c850 con 0x7f7fec0a1380 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00c9b0 con 0x7f7fec0a1380 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc0094a0 con 0x7f7fec0a1380 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.769+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00cd40 con 0x7f7fec0a1380 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.770+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4009a70 con 0x7f7fec0a1380 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.771+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec04f2a0 con 0x7f7fec0a1380 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.771+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fdc013470 con 0x7f7fec0a1380 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.771+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fdc03fff0 con 0x7f7fec0a1380 2023-10-03T10:13:50.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.779+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fdc011350 con 0x7f7fec0a1380 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.937+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d88072980 con 0x7f0d880a0a70 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.937+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3543521401 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d78032070 con 0x7f0d880a0a70 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.939+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 msgr2=0x7f0d881222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.939+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 0x7f0d881222c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d78016000 tx=0x7f0d78004750 comp rx=0 tx=0).stop 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 shutdown_connections 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d88133f50 0x7f0d88122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d880a0a70 0x7f0d881222c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 --2- 172.21.15.125:0/3543521401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d880a1380 0x7f0d88122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 >> 172.21.15.125:0/3543521401 conn(0x7f0d880a6610 msgr2=0x7f0d8809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 shutdown_connections 2023-10-03T10:13:50.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.940+0000 7f0d8d7b0700 1 -- 172.21.15.125:0/3543521401 wait complete. 2023-10-03T10:13:50.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:50.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.971+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fec072980 con 0x7f7fec0a1380 2023-10-03T10:13:50.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.972+0000 7f7fe1ffb700 1 -- 172.21.15.125:0/2049197507 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fdc021020 con 0x7f7fec0a1380 2023-10-03T10:13:50.972 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 msgr2=0x7f7fec1c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00ebb0 tx=0x7f7fdc00eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 shutdown_connections 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fec133f50 0x7f7fec1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fec0a0a70 0x7f7fec1c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 --2- 172.21.15.125:0/2049197507 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fec0a1380 0x7f7fec1c8680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 >> 172.21.15.125:0/2049197507 conn(0x7f7fec0a6610 msgr2=0x7f7fec09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 shutdown_connections 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:50.974+0000 7f7ff37f3700 1 -- 172.21.15.125:0/2049197507 wait complete. 2023-10-03T10:13:50.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:51.505 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:51.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:51.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.632+0000 7f1a4b637700 1 Processor -- start 2023-10-03T10:13:51.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.632+0000 7f1a4b637700 1 -- start start 2023-10-03T10:13:51.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 0x7f1a44132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440a0920 con 0x7f1a44131d70 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4409c970 con 0x7f1a4409e870 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a4b637700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4409bab0 con 0x7f1a4409f180 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a493d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a49bd4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 0x7f1a44132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a49bd4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 0x7f1a44132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51788/0 (socket says 172.21.15.125:51788) 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50382/0 (socket says 172.21.15.125:50382) 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a49bd4700 1 -- 172.21.15.125:0/934504754 learned_addr learned my addr 172.21.15.125:0/934504754 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a493d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56512/0 (socket says 172.21.15.125:56512) 2023-10-03T10:13:51.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 -- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 msgr2=0x7f1a4409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 -- 172.21.15.125:0/934504754 >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 msgr2=0x7f1a44132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/934504754 >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 0x7f1a44132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 -- 172.21.15.125:0/934504754 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4409f9c0 con 0x7f1a4409f180 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a493d3700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.633+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009840 tx=0x7f1a34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508d81353206d18b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a3bfff700 1 -- 172.21.15.125:0/934504754 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011830 con 0x7f1a4409f180 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a3bfff700 1 -- 172.21.15.125:0/934504754 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34011990 con 0x7f1a4409f180 2023-10-03T10:13:51.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a3bfff700 1 -- 172.21.15.125:0/934504754 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011d20 con 0x7f1a4409f180 2023-10-03T10:13:51.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 -- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 msgr2=0x7f1a44131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009840 tx=0x7f1a34009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:51.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 -- 172.21.15.125:0/934504754 shutdown_connections 2023-10-03T10:13:51.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 --2- 172.21.15.125:0/934504754 >> v2:172.21.15.125:3300/0 conn(0x7f1a44131d70 0x7f1a44132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 --2- 172.21.15.125:0/934504754 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a44131830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.634+0000 7f1a4b637700 1 -- 172.21.15.125:0/934504754 >> 172.21.15.125:0/934504754 conn(0x7f1a440a4430 msgr2=0x7f1a440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.635+0000 7f1a4b637700 1 -- 172.21.15.125:0/934504754 shutdown_connections 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.635+0000 7f1a4b637700 1 -- 172.21.15.125:0/934504754 wait complete. 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 Processor -- start 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 -- start start 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a4411f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44120d60 con 0x7f1a44131d70 2023-10-03T10:13:51.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44120650 con 0x7f1a4409e870 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.636+0000 7f1a4b637700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44121bf0 con 0x7f1a4409f180 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a49bd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a4411f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a49bd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51798/0 (socket says 172.21.15.125:51798) 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a49bd4700 1 -- 172.21.15.125:0/2588422887 learned_addr learned my addr 172.21.15.125:0/2588422887 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a493d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 -- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 msgr2=0x7f1a4411f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4411f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 -- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 msgr2=0x7f1a4411fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 -- 172.21.15.125:0/2588422887 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400094a0 con 0x7f1a4409f180 2023-10-03T10:13:51.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a49bd4700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a493d3700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a48bd2700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a4411f730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a34016000 tx=0x7f1a34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004450 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3401f070 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340038e0 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.637+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a340094a0 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.638+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a440a2bf0 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.638+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a34003a40 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.638+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a34021070 con 0x7f1a4409f180 2023-10-03T10:13:51.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.639+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a440a0270 con 0x7f1a4409f180 2023-10-03T10:13:51.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.643+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a34015080 con 0x7f1a4409f180 2023-10-03T10:13:51.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 Processor -- start 2023-10-03T10:13:51.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 -- start start 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 0x7fdf00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 0x7fdf0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0009e9d0 con 0x7fdf000a0a70 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.674+0000 7fdf05fb9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0009dc00 con 0x7fdf000a1550 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdf05fb9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0009dec0 con 0x7fdf00139200 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdeff7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdf000a0a70 0x7fdf000a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53560/0 (socket says 172.21.15.125:53560) 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 0x7fdf00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdeff7fe700 1 -- 172.21.15.125:0/2591957303 learned_addr learned my addr 172.21.15.125:0/2591957303 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefffff700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 0x7fdf0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 -- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 msgr2=0x7fdf0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefe7fc700 1 -- 172.21.15.125:0/2591957303 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269321647 0 0) 0x7fdf0009e9d0 con 0x7fdf000a0a70 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 0x7fdf0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 -- 172.21.15.125:0/2591957303 >> v1:172.21.15.125:6789/0 conn(0x7fdf000a0a70 legacy=0x7fdf000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 -- 172.21.15.125:0/2591957303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0009e6a0 con 0x7fdf000a1550 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefffff700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 0x7fdf0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefeffd700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 0x7fdf00138cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9da6f22803cb5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefe7fc700 1 -- 172.21.15.125:0/2591957303 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8011830 con 0x7fdf000a1550 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefe7fc700 1 -- 172.21.15.125:0/2591957303 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8011990 con 0x7fdf000a1550 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.675+0000 7fdefe7fc700 1 -- 172.21.15.125:0/2591957303 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8011d20 con 0x7fdf000a1550 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 -- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 msgr2=0x7fdf00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 0x7fdf00138cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 -- 172.21.15.125:0/2591957303 shutdown_connections 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf00139200 0x7fdf0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/2591957303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf000a1550 0x7fdf00138cc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 -- 172.21.15.125:0/2591957303 >> 172.21.15.125:0/2591957303 conn(0x7fdf000a6610 msgr2=0x7fdf000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 -- 172.21.15.125:0/2591957303 shutdown_connections 2023-10-03T10:13:51.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.676+0000 7fdf05fb9700 1 -- 172.21.15.125:0/2591957303 wait complete. 2023-10-03T10:13:51.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.677+0000 7fdf05fb9700 1 Processor -- start 2023-10-03T10:13:51.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.677+0000 7fdf05fb9700 1 -- start start 2023-10-03T10:13:51.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf000a0a70 0x7fdf00120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 0x7fdf00120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00123e10 con 0x7fdf000a1550 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000a5100 con 0x7fdf00139200 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000a03e0 con 0x7fdf000a0a70 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf000a0a70 0x7fdf00120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56534/0 (socket says 172.21.15.125:56534) 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 -- 172.21.15.125:0/1631759242 learned_addr learned my addr 172.21.15.125:0/1631759242 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 0x7fdf00120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 -- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf000a0a70 msgr2=0x7fdf00120850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf000a0a70 0x7fdf00120850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 -- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 msgr2=0x7fdf00120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 0x7fdf00120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 -- 172.21.15.125:0/1631759242 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009a70 con 0x7fdf00139200 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefeffd700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 0x7fdf00120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdefffff700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdef800efb0 tx=0x7fdef800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800cc90 con 0x7fdf00139200 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800f040 con 0x7fdf00139200 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee80094a0 con 0x7fdf00139200 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8014480 con 0x7fdf00139200 2023-10-03T10:13:51.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.678+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf00123ff0 con 0x7fdf00139200 2023-10-03T10:13:51.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.679+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef80145e0 con 0x7fdf00139200 2023-10-03T10:13:51.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.679+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdef80402c0 con 0x7fdf00139200 2023-10-03T10:13:51.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.679+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00122c10 con 0x7fdf00139200 2023-10-03T10:13:51.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.684+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef80076f0 con 0x7fdf00139200 2023-10-03T10:13:51.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.837+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a4404f2a0 con 0x7f1a4409f180 2023-10-03T10:13:51.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.838+0000 7f1a39ffb700 1 -- 172.21.15.125:0/2588422887 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a3402b020 con 0x7f1a4409f180 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 msgr2=0x7f1a4411f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a4411f730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a34016000 tx=0x7f1a34004750 comp rx=0 tx=0).stop 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 shutdown_connections 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a44131d70 0x7f1a4411fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a4409e870 0x7f1a4411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 --2- 172.21.15.125:0/2588422887 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a4409f180 0x7f1a4411f730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 >> 172.21.15.125:0/2588422887 conn(0x7f1a440a4430 msgr2=0x7f1a44071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 shutdown_connections 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.840+0000 7f1a4b637700 1 -- 172.21.15.125:0/2588422887 wait complete. 2023-10-03T10:13:51.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.877+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf0004f2a0 con 0x7fdf00139200 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.878+0000 7fdef7fff700 1 -- 172.21.15.125:0/1631759242 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef802a070 con 0x7fdf00139200 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 msgr2=0x7fdf001212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdef800efb0 tx=0x7fdef800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 shutdown_connections 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf00139200 0x7fdf001212d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf000a0a70 0x7fdf00120850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 --2- 172.21.15.125:0/1631759242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf000a1550 0x7fdf00120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 >> 172.21.15.125:0/1631759242 conn(0x7fdf000a6610 msgr2=0x7fdf000a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 shutdown_connections 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:51.880+0000 7fdf05fb9700 1 -- 172.21.15.125:0/1631759242 wait complete. 2023-10-03T10:13:51.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:51.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:51.987 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.079+0000 7f68e4578700 1 Processor -- start 2023-10-03T10:13:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.079+0000 7f68e4578700 1 -- start start 2023-10-03T10:13:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e4578700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 0x7f68dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e4578700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 0x7f68dc13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e4578700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc06bec0 con 0x7f68dc09f180 2023-10-03T10:13:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e4578700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc06ce60 con 0x7f68dc09e870 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e4578700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc09fa00 con 0x7f68dc1343a0 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e2314700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 0x7f68dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e2b15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 0x7f68dc13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e1b13700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f68dc09f180 0x7f68dc133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53570/0 (socket says 172.21.15.125:53570) 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.080+0000 7f68e1b13700 1 -- 172.21.15.125:0/662367836 learned_addr learned my addr 172.21.15.125:0/662367836 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2b15700 1 -- 172.21.15.125:0/662367836 >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 msgr2=0x7f68dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2b15700 1 --2- 172.21.15.125:0/662367836 >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 0x7f68dc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2b15700 1 -- 172.21.15.125:0/662367836 >> v1:172.21.15.125:6789/0 conn(0x7f68dc09f180 legacy=0x7f68dc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e1312700 1 -- 172.21.15.125:0/662367836 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504138424 0 0) 0x7f68dc06bec0 con 0x7f68dc09f180 2023-10-03T10:13:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2b15700 1 -- 172.21.15.125:0/662367836 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc09ad80 con 0x7f68dc1343a0 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2314700 1 --2- 172.21.15.125:0/662367836 >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 0x7f68dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e2b15700 1 --2- 172.21.15.125:0/662367836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 0x7f68dc13bf60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009d90 tx=0x7f68d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c4bcb68171b253 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e1312700 1 -- 172.21.15.125:0/662367836 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400e070 con 0x7f68dc1343a0 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e1312700 1 -- 172.21.15.125:0/662367836 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d400bb20 con 0x7f68dc1343a0 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e1312700 1 -- 172.21.15.125:0/662367836 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4012430 con 0x7f68dc1343a0 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e4578700 1 -- 172.21.15.125:0/662367836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 msgr2=0x7f68dc13bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.081+0000 7f68e4578700 1 --2- 172.21.15.125:0/662367836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 0x7f68dc13bf60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009d90 tx=0x7f68d400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 -- 172.21.15.125:0/662367836 shutdown_connections 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 --2- 172.21.15.125:0/662367836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc1343a0 0x7f68dc13bf60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 --2- 172.21.15.125:0/662367836 >> v2:172.21.15.125:3300/0 conn(0x7f68dc09e870 0x7f68dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 -- 172.21.15.125:0/662367836 >> 172.21.15.125:0/662367836 conn(0x7f68dc0a4430 msgr2=0x7f68dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 -- 172.21.15.125:0/662367836 shutdown_connections 2023-10-03T10:13:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 -- 172.21.15.125:0/662367836 wait complete. 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.082+0000 7f68e4578700 1 Processor -- start 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 -- start start 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 0x7f68dc124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 0x7f68dc122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc126040 con 0x7f68dc1343a0 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc126300 con 0x7f68dc09e870 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e4578700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc126d70 con 0x7f68dc09f180 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e1b13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 0x7f68dc122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51806/0 (socket says 172.21.15.125:51806) 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 -- 172.21.15.125:0/3884206059 learned_addr learned my addr 172.21.15.125:0/3884206059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2314700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 0x7f68dc124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 -- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 msgr2=0x7f68dc122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 0x7f68dc122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 -- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 msgr2=0x7f68dc124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 0x7f68dc124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2b15700 1 -- 172.21.15.125:0/3884206059 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80094a0 con 0x7f68dc1343a0 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e2314700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 0x7f68dc124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.083+0000 7f68e1b13700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 0x7f68dc122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68e2b15700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f68d4014040 tx=0x7f68d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4012430 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4020070 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4004280 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d4009a70 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.084+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc123810 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.085+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68d40043e0 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.085+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68d4022070 con 0x7f68dc1343a0 2023-10-03T10:13:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.085+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc124760 con 0x7f68dc1343a0 2023-10-03T10:13:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.089+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68d401a970 con 0x7f68dc1343a0 2023-10-03T10:13:52.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.123+0000 7f112e87e700 1 Processor -- start 2023-10-03T10:13:52.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.123+0000 7f112e87e700 1 -- start start 2023-10-03T10:13:52.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112e87e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 0x7f1128133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112e87e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11281343a0 0x7f11280a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112e87e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112809b110 con 0x7f1128133f70 2023-10-03T10:13:52.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112e87e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11280a3b60 con 0x7f11281343a0 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112e87e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11280a2fa0 con 0x7f112809ad40 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f11277fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1128133f70 0x7f11280a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53584/0 (socket says 172.21.15.125:53584) 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f11277fe700 1 -- 172.21.15.125:0/2768504149 learned_addr learned my addr 172.21.15.125:0/2768504149 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 --2- 172.21.15.125:0/2768504149 >> v2:172.21.15.125:3300/0 conn(0x7f11281343a0 0x7f11280a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1127fff700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 0x7f1128133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1126ffd700 1 -- 172.21.15.125:0/2768504149 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169751117 0 0) 0x7f112809b110 con 0x7f1128133f70 2023-10-03T10:13:52.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1126ffd700 1 -- 172.21.15.125:0/2768504149 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11100035b0 con 0x7f1128133f70 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 -- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 msgr2=0x7f1128133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 0x7f1128133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 -- 172.21.15.125:0/2768504149 >> v1:172.21.15.125:6789/0 conn(0x7f1128133f70 legacy=0x7f11280a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 -- 172.21.15.125:0/2768504149 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112809a280 con 0x7f11281343a0 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1127fff700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 0x7f1128133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f112ce1b700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11281343a0 0x7f11280a1180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1120009d90 tx=0x7f112000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a9d444ecb71027 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1126ffd700 1 -- 172.21.15.125:0/2768504149 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000e070 con 0x7f11281343a0 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1126ffd700 1 -- 172.21.15.125:0/2768504149 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112000bb20 con 0x7f11281343a0 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.124+0000 7f1126ffd700 1 -- 172.21.15.125:0/2768504149 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000be90 con 0x7f11281343a0 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 -- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11281343a0 msgr2=0x7f11280a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11281343a0 0x7f11280a1180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1120009d90 tx=0x7f112000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 -- 172.21.15.125:0/2768504149 shutdown_connections 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11281343a0 0x7f11280a1180 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 --2- 172.21.15.125:0/2768504149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112809ad40 0x7f1128133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 -- 172.21.15.125:0/2768504149 >> 172.21.15.125:0/2768504149 conn(0x7f1128099c40 msgr2=0x7f112806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 -- 172.21.15.125:0/2768504149 shutdown_connections 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.125+0000 7f112e87e700 1 -- 172.21.15.125:0/2768504149 wait complete. 2023-10-03T10:13:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.126+0000 7f112e87e700 1 Processor -- start 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.126+0000 7f112e87e700 1 -- start start 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 0x7f11281c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11281343a0 0x7f112811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11281bd070 con 0x7f112809ad40 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1128133580 con 0x7f1128133f70 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1128120b80 con 0x7f11281343a0 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f1127fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 0x7f11281c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56572/0 (socket says 172.21.15.125:56572) 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 -- 172.21.15.125:0/1986329532 learned_addr learned my addr 172.21.15.125:0/1986329532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112ce1b700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11281343a0 0x7f112811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 -- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11281343a0 msgr2=0x7f112811ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11281343a0 0x7f112811ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 -- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 msgr2=0x7f11281c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 0x7f11281c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 -- 172.21.15.125:0/1986329532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180094a0 con 0x7f1128133f70 2023-10-03T10:13:52.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f1127fff700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 0x7f11281c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f11277fe700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c700 tx=0x7f111c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c005d70 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c0070d0 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120009a70 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c007460 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.127+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1128120dc0 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.128+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1128121ea0 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.128+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f111c0075c0 con 0x7f1128133f70 2023-10-03T10:13:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.129+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f111c03eaf0 con 0x7f1128133f70 2023-10-03T10:13:52.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.137+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f111c00f260 con 0x7f1128133f70 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.285+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68dc04f2a0 con 0x7f68dc1343a0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.285+0000 7f68d2ffd700 1 -- 172.21.15.125:0/3884206059 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68d401a380 con 0x7f68dc1343a0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:52.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 msgr2=0x7f68dc1232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f68d4014040 tx=0x7f68d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 shutdown_connections 2023-10-03T10:13:52.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc1343a0 0x7f68dc1232d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc09e870 0x7f68dc124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 --2- 172.21.15.125:0/3884206059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68dc09f180 0x7f68dc122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 >> 172.21.15.125:0/3884206059 conn(0x7f68dc0a4430 msgr2=0x7f68dc070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 shutdown_connections 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.287+0000 7f68e4578700 1 -- 172.21.15.125:0/3884206059 wait complete. 2023-10-03T10:13:52.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.324+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1128120630 con 0x7f1128133f70 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.324+0000 7f1124ff9700 1 -- 172.21.15.125:0/1986329532 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f111c03ee60 con 0x7f1128133f70 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:52.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 msgr2=0x7f11281c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c700 tx=0x7f111c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 shutdown_connections 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11281343a0 0x7f112811ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112809ad40 0x7f11281c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 --2- 172.21.15.125:0/1986329532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1128133f70 0x7f11281c8a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 >> 172.21.15.125:0/1986329532 conn(0x7f1128099c40 msgr2=0x7f11281bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 shutdown_connections 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.326+0000 7f112e87e700 1 -- 172.21.15.125:0/1986329532 wait complete. 2023-10-03T10:13:52.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:52.853 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:52.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:52.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.981+0000 7f8356f0a700 1 Processor -- start 2023-10-03T10:13:52.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.981+0000 7f8356f0a700 1 -- start start 2023-10-03T10:13:52.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8356f0a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 0x7f835009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8356f0a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 0x7f8350131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8356f0a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835009c970 con 0x7f8350131d70 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8356f0a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500a0920 con 0x7f835009f180 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8356f0a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f835009f9c0 con 0x7f835009e870 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 0x7f835009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f834ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 0x7f8350131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f83554a7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8350131d70 0x7f8350138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53600/0 (socket says 172.21.15.125:53600) 2023-10-03T10:13:52.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f83554a7700 1 -- 172.21.15.125:0/3295417929 learned_addr learned my addr 172.21.15.125:0/3295417929 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:52.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 -- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 msgr2=0x7f8350131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 0x7f8350131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 -- 172.21.15.125:0/3295417929 >> v1:172.21.15.125:6789/0 conn(0x7f8350131d70 legacy=0x7f8350138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f834f7fe700 1 -- 172.21.15.125:0/3295417929 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408950787 0 0) 0x7f835009c970 con 0x7f8350131d70 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 -- 172.21.15.125:0/3295417929 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835009bab0 con 0x7f835009e870 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f834ffff700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 0x7f8350131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.982+0000 7f8354ca6700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 0x7f835009ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8344009870 tx=0x7f8344009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821bde0fdeb26ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f834f7fe700 1 -- 172.21.15.125:0/3295417929 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344011830 con 0x7f835009e870 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f834f7fe700 1 -- 172.21.15.125:0/3295417929 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8344011990 con 0x7f835009e870 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f834f7fe700 1 -- 172.21.15.125:0/3295417929 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344011d20 con 0x7f835009e870 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 -- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 msgr2=0x7f835009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 0x7f835009ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8344009870 tx=0x7f8344009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:52.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 -- 172.21.15.125:0/3295417929 shutdown_connections 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009e870 0x7f835009ec40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 --2- 172.21.15.125:0/3295417929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f835009f180 0x7f8350131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 -- 172.21.15.125:0/3295417929 >> 172.21.15.125:0/3295417929 conn(0x7f83500a4430 msgr2=0x7f83500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 -- 172.21.15.125:0/3295417929 shutdown_connections 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.983+0000 7f8356f0a700 1 -- 172.21.15.125:0/3295417929 wait complete. 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.984+0000 7f8356f0a700 1 Processor -- start 2023-10-03T10:13:52.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.984+0000 7f8356f0a700 1 -- start start 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 0x7f83501c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 0x7f83501c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835011e640 con 0x7f835009e870 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835011e450 con 0x7f8350131d70 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8356f0a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8350131830 con 0x7f835009f180 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 0x7f83501c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f834ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f83554a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 0x7f83501c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f834ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50456/0 (socket says 172.21.15.125:50456) 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f834ffff700 1 -- 172.21.15.125:0/1069712052 learned_addr learned my addr 172.21.15.125:0/1069712052 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 -- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 msgr2=0x7f83501c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 -- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 msgr2=0x7f83501c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 0x7f83501c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 -- 172.21.15.125:0/1069712052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0094a0 con 0x7f835009e870 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f834ffff700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f83554a7700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 0x7f83501c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f8354ca6700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 0x7f83501c6070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8344016000 tx=0x7f8344004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.985+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344004510 con 0x7f835009e870 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834401e070 con 0x7f835009e870 2023-10-03T10:13:52.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440038e0 con 0x7f835009e870 2023-10-03T10:13:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83440094a0 con 0x7f835009e870 2023-10-03T10:13:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83501203d0 con 0x7f835009e870 2023-10-03T10:13:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8344003a40 con 0x7f835009e870 2023-10-03T10:13:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.986+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835004f2a0 con 0x7f835009e870 2023-10-03T10:13:52.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.987+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83440402b0 con 0x7f835009e870 2023-10-03T10:13:52.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:52.991+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f834402c3b0 con 0x7f835009e870 2023-10-03T10:13:53.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.023+0000 7efc92b9e700 1 Processor -- start 2023-10-03T10:13:53.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.023+0000 7efc92b9e700 1 -- start start 2023-10-03T10:13:53.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 0x7efc8c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 0x7efc8c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c09e9d0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c09dc00 con 0x7efc8c133f50 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc92b9e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c09dec0 con 0x7efc8c0a1380 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 0x7efc8c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51838/0 (socket says 172.21.15.125:51838) 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 -- 172.21.15.125:0/3772253816 learned_addr learned my addr 172.21.15.125:0/3772253816 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9113b700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 0x7efc8c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 -- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 msgr2=0x7efc8c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 0x7efc8c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 -- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 msgr2=0x7efc8c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 0x7efc8c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9093a700 1 -- 172.21.15.125:0/3772253816 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c09e6a0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc8bfff700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 0x7efc8c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.024+0000 7efc9113b700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 0x7efc8c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.025+0000 7efc9093a700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc800098f0 tx=0x7efc80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05b397d28cc5738 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.025+0000 7efc8b7fe700 1 -- 172.21.15.125:0/3772253816 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011830 con 0x7efc8c0a0a70 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.025+0000 7efc8b7fe700 1 -- 172.21.15.125:0/3772253816 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80011990 con 0x7efc8c0a0a70 2023-10-03T10:13:53.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.025+0000 7efc8b7fe700 1 -- 172.21.15.125:0/3772253816 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011d20 con 0x7efc8c0a0a70 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 -- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c0a0a70 msgr2=0x7efc8c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc800098f0 tx=0x7efc80009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 -- 172.21.15.125:0/3772253816 shutdown_connections 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c133f50 0x7efc8c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 --2- 172.21.15.125:0/3772253816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a1380 0x7efc8c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 -- 172.21.15.125:0/3772253816 >> 172.21.15.125:0/3772253816 conn(0x7efc8c0a6610 msgr2=0x7efc8c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 -- 172.21.15.125:0/3772253816 shutdown_connections 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 -- 172.21.15.125:0/3772253816 wait complete. 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.026+0000 7efc92b9e700 1 Processor -- start 2023-10-03T10:13:53.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 -- start start 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 0x7efc8c121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 0x7efc8c121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 0x7efc8c122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c132900 con 0x7efc8c133f50 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c123fd0 con 0x7efc8c0a1380 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc92b9e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c124ab0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 0x7efc8c121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc9113b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 0x7efc8c122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 0x7efc8c121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56614/0 (socket says 172.21.15.125:56614) 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc9093a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 0x7efc8c121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.027+0000 7efc8bfff700 1 -- 172.21.15.125:0/38015398 learned_addr learned my addr 172.21.15.125:0/38015398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 -- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 msgr2=0x7efc8c121ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 0x7efc8c121ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 -- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 msgr2=0x7efc8c122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 0x7efc8c122000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 -- 172.21.15.125:0/38015398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780094a0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9113b700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 0x7efc8c122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc9093a700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 0x7efc8c121580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0a72d0 tx=0x7efc80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80004240 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8001f070 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc84009a70 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800036a0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.028+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80009550 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.029+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc80021030 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.029+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc800407a0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.029+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c11e040 con 0x7efc8c0a0a70 2023-10-03T10:13:53.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.034+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc800199a0 con 0x7efc8c0a0a70 2023-10-03T10:13:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.188+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f835011f0c0 con 0x7f835009e870 2023-10-03T10:13:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.189+0000 7f834d7fa700 1 -- 172.21.15.125:0/1069712052 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8344015020 con 0x7f835009e870 2023-10-03T10:13:53.189 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.190+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 msgr2=0x7f83501c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.190+0000 7f8356f0a700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 0x7f83501c6070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8344016000 tx=0x7f8344004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 shutdown_connections 2023-10-03T10:13:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8350131d70 0x7f83501c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f835009e870 0x7f83501c6070 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 --2- 172.21.15.125:0/1069712052 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f835009f180 0x7f83501c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 >> 172.21.15.125:0/1069712052 conn(0x7f83500a4430 msgr2=0x7f835009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 shutdown_connections 2023-10-03T10:13:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.191+0000 7f8356f0a700 1 -- 172.21.15.125:0/1069712052 wait complete. 2023-10-03T10:13:53.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:53.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.227+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc8c133a10 con 0x7efc8c0a0a70 2023-10-03T10:13:53.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.227+0000 7efc897fa700 1 -- 172.21.15.125:0/38015398 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc80015020 con 0x7efc8c0a0a70 2023-10-03T10:13:53.228 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 msgr2=0x7efc8c121580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 0x7efc8c121580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0a72d0 tx=0x7efc80004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 shutdown_connections 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc8c133f50 0x7efc8c122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc8c0a0a70 0x7efc8c121580 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 --2- 172.21.15.125:0/38015398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc8c0a1380 0x7efc8c121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 >> 172.21.15.125:0/38015398 conn(0x7efc8c0a6610 msgr2=0x7efc8c1332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 shutdown_connections 2023-10-03T10:13:53.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.229+0000 7efc92b9e700 1 -- 172.21.15.125:0/38015398 wait complete. 2023-10-03T10:13:53.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:53.301 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:53.339 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:53.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.426+0000 7f58df49f700 1 Processor -- start 2023-10-03T10:13:53.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.426+0000 7f58df49f700 1 -- start start 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.426+0000 7f58df49f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 0x7f58d8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58df49f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58d8133f70 0x7f58d81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58df49f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d809b110 con 0x7f58d80a0a70 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58df49f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d80a3b60 con 0x7f58d8133f70 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58df49f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81348e0 con 0x7f58d809ad40 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58d8133f70 0x7f58d81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dd23b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 0x7f58d8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58d8133f70 0x7f58d81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51850/0 (socket says 172.21.15.125:51850) 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 -- 172.21.15.125:0/1024429570 learned_addr learned my addr 172.21.15.125:0/1024429570 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dda3c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f58d80a0a70 0x7f58d80a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53602/0 (socket says 172.21.15.125:53602) 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 -- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 msgr2=0x7f58d8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 0x7f58d8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 -- 172.21.15.125:0/1024429570 >> v1:172.21.15.125:6789/0 conn(0x7f58d80a0a70 legacy=0x7f58d80a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 -- 172.21.15.125:0/1024429570 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80a2fa0 con 0x7f58d8133f70 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58cffff700 1 -- 172.21.15.125:0/1024429570 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917043398 0 0) 0x7f58d809b110 con 0x7f58d80a0a70 2023-10-03T10:13:53.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dd23b700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 0x7f58d8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58dca3a700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d8133f70 0x7f58d81343a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f58c80098f0 tx=0x7f58c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec14bbd2da1f084a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58cffff700 1 -- 172.21.15.125:0/1024429570 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8011830 con 0x7f58d8133f70 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58cffff700 1 -- 172.21.15.125:0/1024429570 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c8011990 con 0x7f58d8133f70 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.427+0000 7f58cffff700 1 -- 172.21.15.125:0/1024429570 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8011d20 con 0x7f58d8133f70 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 -- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d8133f70 msgr2=0x7f58d81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d8133f70 0x7f58d81343a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f58c80098f0 tx=0x7f58c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 -- 172.21.15.125:0/1024429570 shutdown_connections 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d809ad40 0x7f58d8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 --2- 172.21.15.125:0/1024429570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d8133f70 0x7f58d81343a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 -- 172.21.15.125:0/1024429570 >> 172.21.15.125:0/1024429570 conn(0x7f58d8099c40 msgr2=0x7f58d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 -- 172.21.15.125:0/1024429570 shutdown_connections 2023-10-03T10:13:53.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.428+0000 7f58df49f700 1 -- 172.21.15.125:0/1024429570 wait complete. 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.429+0000 7f58df49f700 1 Processor -- start 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.429+0000 7f58df49f700 1 -- start start 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d80a0a70 0x7f58d811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d8133f70 0x7f58d811f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81220b0 con 0x7f58d809ad40 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8120600 con 0x7f58d8133f70 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58df49f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80a4110 con 0x7f58d80a0a70 2023-10-03T10:13:53.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dda3c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d8133f70 0x7f58d811f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51856/0 (socket says 172.21.15.125:51856) 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 -- 172.21.15.125:0/1658581973 learned_addr learned my addr 172.21.15.125:0/1658581973 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dca3a700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d80a0a70 0x7f58d811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 -- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d80a0a70 msgr2=0x7f58d811ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d80a0a70 0x7f58d811ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 -- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d8133f70 msgr2=0x7f58d811f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d8133f70 0x7f58d811f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.430+0000 7f58dd23b700 1 -- 172.21.15.125:0/1658581973 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40094a0 con 0x7f58d809ad40 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58dd23b700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f58d400ebe0 tx=0x7f58d400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4009760 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d400c850 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c8009550 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400cbe0 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.431+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8122b20 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.432+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58d400cd40 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.432+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58d403fbb0 con 0x7f58d809ad40 2023-10-03T10:13:53.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.432+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d804f2a0 con 0x7f58d809ad40 2023-10-03T10:13:53.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.437+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58d4021080 con 0x7f58d809ad40 2023-10-03T10:13:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.469+0000 7fc903a35700 1 Processor -- start 2023-10-03T10:13:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.469+0000 7fc903a35700 1 -- start start 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc903a35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc903a35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 0x7fc8fc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc903a35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc09c970 con 0x7fc8fc09e870 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc903a35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0a0920 con 0x7fc8fc1371c0 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc903a35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc09f9c0 con 0x7fc8fc09f350 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc9017d1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc8fc09e870 0x7fc8fc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53614/0 (socket says 172.21.15.125:53614) 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc901fd2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 0x7fc8fc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc9017d1700 1 -- 172.21.15.125:0/1942167900 learned_addr learned my addr 172.21.15.125:0/1942167900 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc8f3fff700 1 -- 172.21.15.125:0/1942167900 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106937301 0 0) 0x7fc8fc09c970 con 0x7fc8fc09e870 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 -- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 msgr2=0x7fc8fc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 0x7fc8fc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 -- 172.21.15.125:0/1942167900 >> v1:172.21.15.125:6789/0 conn(0x7fc8fc09e870 legacy=0x7fc8fc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 -- 172.21.15.125:0/1942167900 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc09bab0 con 0x7fc8fc09f350 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc901fd2700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 0x7fc8fc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc900fd0700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc136c80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4883d0ae69e4eeec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.470+0000 7fc8f3fff700 1 -- 172.21.15.125:0/1942167900 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011830 con 0x7fc8fc09f350 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc8f3fff700 1 -- 172.21.15.125:0/1942167900 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec011990 con 0x7fc8fc09f350 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc8f3fff700 1 -- 172.21.15.125:0/1942167900 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011d20 con 0x7fc8fc09f350 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 -- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 msgr2=0x7fc8fc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc136c80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 -- 172.21.15.125:0/1942167900 shutdown_connections 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc1371c0 0x7fc8fc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 --2- 172.21.15.125:0/1942167900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc136c80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 -- 172.21.15.125:0/1942167900 >> 172.21.15.125:0/1942167900 conn(0x7fc8fc0a4430 msgr2=0x7fc8fc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 -- 172.21.15.125:0/1942167900 shutdown_connections 2023-10-03T10:13:53.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.471+0000 7fc903a35700 1 -- 172.21.15.125:0/1942167900 wait complete. 2023-10-03T10:13:53.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.472+0000 7fc903a35700 1 Processor -- start 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.472+0000 7fc903a35700 1 -- start start 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.472+0000 7fc903a35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc09e870 0x7fc8fc1c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.472+0000 7fc903a35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc903a35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 0x7fc8fc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc903a35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06d430 con 0x7fc8fc1371c0 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc903a35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc1c91f0 con 0x7fc8fc09e870 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc903a35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc09dba0 con 0x7fc8fc09f350 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50504/0 (socket says 172.21.15.125:50504) 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc901fd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 0x7fc8fc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 -- 172.21.15.125:0/698233768 learned_addr learned my addr 172.21.15.125:0/698233768 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc9017d1700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc09e870 0x7fc8fc1c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 -- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc09e870 msgr2=0x7fc8fc1c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc09e870 0x7fc8fc1c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 -- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 msgr2=0x7fc8fc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 0x7fc8fc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 -- 172.21.15.125:0/698233768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4009a70 con 0x7fc8fc09f350 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc901fd2700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 0x7fc8fc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc900fd0700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc09fb50 tx=0x7fc8ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec004450 con 0x7fc8fc09f350 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec01f070 con 0x7fc8fc09f350 2023-10-03T10:13:53.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0038a0 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.473+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0094a0 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.474+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc1261f0 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.474+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8ec003a00 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.475+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc8ec021070 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.474+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc125e90 con 0x7fc8fc09f350 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.479+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8ec015020 con 0x7fc8fc09f350 2023-10-03T10:13:53.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.629+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58d80729d0 con 0x7f58d809ad40 2023-10-03T10:13:53.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.630+0000 7f58cdffb700 1 -- 172.21.15.125:0/1658581973 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58d401b3b0 con 0x7f58d809ad40 2023-10-03T10:13:53.630 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 msgr2=0x7f58d811e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f58d400ebe0 tx=0x7f58d400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 shutdown_connections 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d8133f70 0x7f58d811f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d809ad40 0x7f58d811e8e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 --2- 172.21.15.125:0/1658581973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58d80a0a70 0x7f58d811ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 >> 172.21.15.125:0/1658581973 conn(0x7f58d8099c40 msgr2=0x7f58d809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 shutdown_connections 2023-10-03T10:13:53.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.632+0000 7f58df49f700 1 -- 172.21.15.125:0/1658581973 wait complete. 2023-10-03T10:13:53.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.670+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8fc126050 con 0x7fc8fc09f350 2023-10-03T10:13:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.671+0000 7fc8f1ffb700 1 -- 172.21.15.125:0/698233768 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8fc126050 con 0x7fc8fc09f350 2023-10-03T10:13:53.671 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:53.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 msgr2=0x7fc8fc1c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc09fb50 tx=0x7fc8ec004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 shutdown_connections 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8fc1371c0 0x7fc8fc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc8fc09e870 0x7fc8fc1c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 --2- 172.21.15.125:0/698233768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc8fc09f350 0x7fc8fc1c8cb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 >> 172.21.15.125:0/698233768 conn(0x7fc8fc0a4430 msgr2=0x7fc8fc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 shutdown_connections 2023-10-03T10:13:53.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:53.673+0000 7fc903a35700 1 -- 172.21.15.125:0/698233768 wait complete. 2023-10-03T10:13:53.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:54.207 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:54.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.337+0000 7f8f1a40a700 1 Processor -- start 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.337+0000 7f8f1a40a700 1 -- start start 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.337+0000 7f8f1a40a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f14133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f1a40a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 0x7f8f141304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f1a40a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f1a40a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1406b2d0 con 0x7f8f141309f0 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f1a40a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14133610 con 0x7f8f14133ad0 2023-10-03T10:13:54.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f1a40a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1409a500 con 0x7f8f141300a0 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f137fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 0x7f8f141304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f189a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f14133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f189a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51874/0 (socket says 172.21.15.125:51874) 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f137fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 0x7f8f141304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50508/0 (socket says 172.21.15.125:50508) 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f189a7700 1 -- 172.21.15.125:0/36012030 learned_addr learned my addr 172.21.15.125:0/36012030 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 -- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 msgr2=0x7f8f141304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 --2- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 0x7f8f141304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 -- 172.21.15.125:0/36012030 >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 msgr2=0x7f8f1413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 --2- 172.21.15.125:0/36012030 >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 -- 172.21.15.125:0/36012030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f141338b0 con 0x7f8f14133ad0 2023-10-03T10:13:54.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f189a7700 1 --2- 172.21.15.125:0/36012030 >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f13fff700 1 --2- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f14133ea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009840 tx=0x7f8f04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52d42a928351a98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f12ffd700 1 -- 172.21.15.125:0/36012030 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04011830 con 0x7f8f14133ad0 2023-10-03T10:13:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f12ffd700 1 -- 172.21.15.125:0/36012030 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04011990 con 0x7f8f14133ad0 2023-10-03T10:13:54.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.338+0000 7f8f12ffd700 1 -- 172.21.15.125:0/36012030 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04011d20 con 0x7f8f14133ad0 2023-10-03T10:13:54.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 -- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 msgr2=0x7f8f14133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f14133ea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009840 tx=0x7f8f04009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 -- 172.21.15.125:0/36012030 shutdown_connections 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f14133ea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/36012030 >> v2:172.21.15.125:3300/0 conn(0x7f8f141309f0 0x7f8f1413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/36012030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141300a0 0x7f8f141304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 -- 172.21.15.125:0/36012030 >> 172.21.15.125:0/36012030 conn(0x7f8f14099c40 msgr2=0x7f8f140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 -- 172.21.15.125:0/36012030 shutdown_connections 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.339+0000 7f8f1a40a700 1 -- 172.21.15.125:0/36012030 wait complete. 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.340+0000 7f8f1a40a700 1 Processor -- start 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 -- start start 2023-10-03T10:13:54.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 0x7f8f1411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 0x7f8f1411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14120210 con 0x7f8f141300a0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1412dd00 con 0x7f8f14133ad0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f1a40a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1412fe60 con 0x7f8f141309f0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f189a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f13fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 0x7f8f1411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f189a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56648/0 (socket says 172.21.15.125:56648) 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f189a7700 1 -- 172.21.15.125:0/878389078 learned_addr learned my addr 172.21.15.125:0/878389078 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.341+0000 7f8f137fe700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 0x7f8f1411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 -- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 msgr2=0x7f8f1411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 0x7f8f1411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 -- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 msgr2=0x7f8f1411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 0x7f8f1411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 -- 172.21.15.125:0/878389078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c009b30 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f137fe700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 0x7f8f1411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f13fff700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 0x7f8f1411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f189a7700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00efc0 tx=0x7f8f0c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c018070 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00f040 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f040094a0 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c003c40 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.342+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1411fe90 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.343+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f0c00c880 con 0x7f8f14133ad0 2023-10-03T10:13:54.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.343+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f0c03f6e0 con 0x7f8f14133ad0 2023-10-03T10:13:54.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.343+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1404f2a0 con 0x7f8f14133ad0 2023-10-03T10:13:54.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.348+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f0c014480 con 0x7f8f14133ad0 2023-10-03T10:13:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.375+0000 7f33f7794700 1 Processor -- start 2023-10-03T10:13:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 -- start start 2023-10-03T10:13:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33f00a1380 0x7f33f0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f009dc00 con 0x7f33f0133f50 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f009ea60 con 0x7f33f00a1380 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f7794700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f009dec0 con 0x7f33f00a0a70 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f4d2f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33f00a1380 0x7f33f0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f4d2f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33f00a1380 0x7f33f0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51882/0 (socket says 172.21.15.125:51882) 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f5d31700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f33f0133f50 0x7f33f013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53624/0 (socket says 172.21.15.125:53624) 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f4d2f700 1 -- 172.21.15.125:0/3484661329 learned_addr learned my addr 172.21.15.125:0/3484661329 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.376+0000 7f33f5530700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f4d2f700 1 -- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 msgr2=0x7f33f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f4d2f700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f4d2f700 1 -- 172.21.15.125:0/3484661329 >> v1:172.21.15.125:6789/0 conn(0x7f33f0133f50 legacy=0x7f33f013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f4d2f700 1 -- 172.21.15.125:0/3484661329 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f009e6a0 con 0x7f33f00a1380 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33e7fff700 1 -- 172.21.15.125:0/3484661329 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361832636 0 0) 0x7f33f009dc00 con 0x7f33f0133f50 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f5530700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33f4d2f700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0133a10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098f0 tx=0x7f33e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ca4e73c0a31e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33e7fff700 1 -- 172.21.15.125:0/3484661329 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011830 con 0x7f33f00a1380 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33e7fff700 1 -- 172.21.15.125:0/3484661329 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0011990 con 0x7f33f00a1380 2023-10-03T10:13:54.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.377+0000 7f33e7fff700 1 -- 172.21.15.125:0/3484661329 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011d20 con 0x7f33f00a1380 2023-10-03T10:13:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 -- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 msgr2=0x7f33f0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0133a10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098f0 tx=0x7f33e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 -- 172.21.15.125:0/3484661329 shutdown_connections 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 --2- 172.21.15.125:0/3484661329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0133a10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 -- 172.21.15.125:0/3484661329 >> 172.21.15.125:0/3484661329 conn(0x7f33f00a6610 msgr2=0x7f33f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 -- 172.21.15.125:0/3484661329 shutdown_connections 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.378+0000 7f33f7794700 1 -- 172.21.15.125:0/3484661329 wait complete. 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 Processor -- start 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 -- start start 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f0122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 0x7f33f0123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0126220 con 0x7f33f00a1380 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0133960 con 0x7f33f0133f50 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f7794700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0133420 con 0x7f33f00a0a70 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f4d2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f4d2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51892/0 (socket says 172.21.15.125:51892) 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f5d31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 0x7f33f0123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.379+0000 7f33f4d2f700 1 -- 172.21.15.125:0/4188410080 learned_addr learned my addr 172.21.15.125:0/4188410080 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f5530700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f0122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 -- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 msgr2=0x7f33f0122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f0122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 -- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 msgr2=0x7f33f0123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 0x7f33f0123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 -- 172.21.15.125:0/4188410080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094a0 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f5d31700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 0x7f33f0123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f4d2f700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009c40 tx=0x7f33e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0004300 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e001f070 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e0009550 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00036a0 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.380+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0126bb0 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.381+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e0021030 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.381+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f004f2a0 con 0x7f33f00a1380 2023-10-03T10:13:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.381+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33e0040a20 con 0x7f33f00a1380 2023-10-03T10:13:54.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.386+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e0015020 con 0x7f33f00a1380 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.542+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f140008d0 con 0x7f8f14133ad0 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.542+0000 7f8f10ff9700 1 -- 172.21.15.125:0/878389078 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f0c01cbb0 con 0x7f8f14133ad0 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 msgr2=0x7f8f1411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00efc0 tx=0x7f8f0c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 shutdown_connections 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f14133ad0 0x7f8f1411e4c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f141300a0 0x7f8f1411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 --2- 172.21.15.125:0/878389078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f141309f0 0x7f8f1411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 >> 172.21.15.125:0/878389078 conn(0x7f8f14099c40 msgr2=0x7f8f141321e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 shutdown_connections 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.544+0000 7f8f1a40a700 1 -- 172.21.15.125:0/878389078 wait complete. 2023-10-03T10:13:54.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.579+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33f0072980 con 0x7f33f00a1380 2023-10-03T10:13:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.580+0000 7f33e5ffb700 1 -- 172.21.15.125:0/4188410080 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e0006d80 con 0x7f33f00a1380 2023-10-03T10:13:54.580 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 msgr2=0x7f33f0122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009c40 tx=0x7f33e0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 shutdown_connections 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f0133f50 0x7f33f0123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f00a0a70 0x7f33f0122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 --2- 172.21.15.125:0/4188410080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f00a1380 0x7f33f0122e40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 >> 172.21.15.125:0/4188410080 conn(0x7f33f00a6610 msgr2=0x7f33f00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 shutdown_connections 2023-10-03T10:13:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.582+0000 7f33f7794700 1 -- 172.21.15.125:0/4188410080 wait complete. 2023-10-03T10:13:54.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:54.645 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:54.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.772+0000 7f9473c16700 1 Processor -- start 2023-10-03T10:13:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.772+0000 7f9473c16700 1 -- start start 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f9473c16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 0x7f946c138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f9473c16700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f9473c16700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c06bec0 con 0x7f946c09e870 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f9473c16700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c06ce60 con 0x7f946c139480 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f9473c16700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f946c09f740 con 0x7f946c09f350 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94711b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 0x7f946c138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94719b2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f946c09e870 0x7f946c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53638/0 (socket says 172.21.15.125:53638) 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94719b2700 1 -- 172.21.15.125:0/2762235557 learned_addr learned my addr 172.21.15.125:0/2762235557 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94709b0700 1 -- 172.21.15.125:0/2762235557 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140632412 0 0) 0x7f946c06bec0 con 0x7f946c09e870 2023-10-03T10:13:54.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 -- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 msgr2=0x7f946c138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 0x7f946c138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 -- 172.21.15.125:0/2762235557 >> v1:172.21.15.125:6789/0 conn(0x7f946c09e870 legacy=0x7f946c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 -- 172.21.15.125:0/2762235557 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c09fa00 con 0x7f946c139480 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94711b1700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 0x7f946c138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.773+0000 7f94721b3700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c13b860 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9464009df0 tx=0x7f946400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4306f5a5efb7fdb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f94709b0700 1 -- 172.21.15.125:0/2762235557 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400e070 con 0x7f946c139480 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f94709b0700 1 -- 172.21.15.125:0/2762235557 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400bae0 con 0x7f946c139480 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f94709b0700 1 -- 172.21.15.125:0/2762235557 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400be90 con 0x7f946c139480 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 -- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 msgr2=0x7f946c13b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c13b860 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9464009df0 tx=0x7f946400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 -- 172.21.15.125:0/2762235557 shutdown_connections 2023-10-03T10:13:54.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c13b860 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 --2- 172.21.15.125:0/2762235557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09f350 0x7f946c138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 -- 172.21.15.125:0/2762235557 >> 172.21.15.125:0/2762235557 conn(0x7f946c0a4430 msgr2=0x7f946c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 -- 172.21.15.125:0/2762235557 shutdown_connections 2023-10-03T10:13:54.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.774+0000 7f9473c16700 1 -- 172.21.15.125:0/2762235557 wait complete. 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.775+0000 7f9473c16700 1 Processor -- start 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.775+0000 7f9473c16700 1 -- start start 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f946c09f350 0x7f946c11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c134200 con 0x7f946c09f350 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c1347c0 con 0x7f946c139480 2023-10-03T10:13:54.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f946c120d40 con 0x7f946c09e870 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94711b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f946c09f350 0x7f946c11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50550/0 (socket says 172.21.15.125:50550) 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94721b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 -- 172.21.15.125:0/3203895575 learned_addr learned my addr 172.21.15.125:0/3203895575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 -- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 msgr2=0x7f946c11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 -- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f946c09f350 msgr2=0x7f946c11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f946c09f350 0x7f946c11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 -- 172.21.15.125:0/3203895575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0094a0 con 0x7f946c09e870 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94721b3700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94719b2700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f946800c520 tx=0x7f946800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468004c80 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468004de0 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464009a70 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468007310 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.776+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c09dd50 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.777+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9468007470 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.777+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f946803f240 con 0x7f946c09e870 2023-10-03T10:13:54.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.777+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c04f2a0 con 0x7f946c09e870 2023-10-03T10:13:54.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.782+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94680123b0 con 0x7f946c09e870 2023-10-03T10:13:54.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.814+0000 7f0d451aa700 1 Processor -- start 2023-10-03T10:13:54.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.814+0000 7f0d451aa700 1 -- start start 2023-10-03T10:13:54.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d40133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400a3b60 con 0x7f0d40133f70 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401348e0 con 0x7f0d4009ad40 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d451aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4009b110 con 0x7f0d400a0a70 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d40133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51902/0 (socket says 172.21.15.125:51902) 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50554/0 (socket says 172.21.15.125:50554) 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3e59c700 1 -- 172.21.15.125:0/610069157 learned_addr learned my addr 172.21.15.125:0/610069157 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 msgr2=0x7f0d400a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/610069157 >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 msgr2=0x7f0d401343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/610069157 >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/610069157 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400a2fa0 con 0x7f0d4009ad40 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3f59e700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.815+0000 7f0d3e59c700 1 --2- 172.21.15.125:0/610069157 >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d40133a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57437978c0ab6816 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d3dd9b700 1 -- 172.21.15.125:0/610069157 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30011830 con 0x7f0d4009ad40 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d3dd9b700 1 -- 172.21.15.125:0/610069157 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30011990 con 0x7f0d4009ad40 2023-10-03T10:13:54.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d3dd9b700 1 -- 172.21.15.125:0/610069157 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30011d20 con 0x7f0d4009ad40 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 -- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 msgr2=0x7f0d40133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d40133a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 -- 172.21.15.125:0/610069157 shutdown_connections 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d40133a30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 --2- 172.21.15.125:0/610069157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d400a0a70 0x7f0d400a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 --2- 172.21.15.125:0/610069157 >> v2:172.21.15.125:3300/0 conn(0x7f0d40133f70 0x7f0d401343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 -- 172.21.15.125:0/610069157 >> 172.21.15.125:0/610069157 conn(0x7f0d40099c40 msgr2=0x7f0d4006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 -- 172.21.15.125:0/610069157 shutdown_connections 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.816+0000 7f0d451aa700 1 -- 172.21.15.125:0/610069157 wait complete. 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 Processor -- start 2023-10-03T10:13:54.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 -- start start 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d401c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 0x7f0d401c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401208f0 con 0x7f0d400a0a70 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40120700 con 0x7f0d4009ad40 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d451aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4009be70 con 0x7f0d40133f70 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 0x7f0d401c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51916/0 (socket says 172.21.15.125:51916) 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3f59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 0x7f0d401c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50568/0 (socket says 172.21.15.125:50568) 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3e59c700 1 -- 172.21.15.125:0/912737817 learned_addr learned my addr 172.21.15.125:0/912737817 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:54.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.818+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d401c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 msgr2=0x7f0d401c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 0x7f0d401c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 msgr2=0x7f0d401c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 -- 172.21.15.125:0/912737817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38009a70 con 0x7f0d4009ad40 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3e59c700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d3ed9d700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d401c8290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30004450 con 0x7f0d4009ad40 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3001e070 con 0x7f0d4009ad40 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300038a0 con 0x7f0d4009ad40 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34009550 con 0x7f0d4009ad40 2023-10-03T10:13:54.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.819+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d300094a0 con 0x7f0d4009ad40 2023-10-03T10:13:54.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.820+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d30003a00 con 0x7f0d4009ad40 2023-10-03T10:13:54.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.820+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d30020070 con 0x7f0d4009ad40 2023-10-03T10:13:54.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.820+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d40120f50 con 0x7f0d4009ad40 2023-10-03T10:13:54.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.829+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d3002a080 con 0x7f0d4009ad40 2023-10-03T10:13:54.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.978+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f946c072d60 con 0x7f946c09e870 2023-10-03T10:13:54.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.978+0000 7f94627fc700 1 -- 172.21.15.125:0/3203895575 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94680102c0 con 0x7f946c09e870 2023-10-03T10:13:54.979 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 msgr2=0x7f946c11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f946800c520 tx=0x7f946800c830 comp rx=0 tx=0).stop 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 shutdown_connections 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f946c139480 0x7f946c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f946c09e870 0x7f946c11ead0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 --2- 172.21.15.125:0/3203895575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f946c09f350 0x7f946c11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 >> 172.21.15.125:0/3203895575 conn(0x7f946c0a4430 msgr2=0x7f946c136ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 shutdown_connections 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:54.980+0000 7f9473c16700 1 -- 172.21.15.125:0/3203895575 wait complete. 2023-10-03T10:13:54.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:55.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.021+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d4004f2a0 con 0x7f0d4009ad40 2023-10-03T10:13:55.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.021+0000 7f0d277fe700 1 -- 172.21.15.125:0/912737817 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d30015020 con 0x7f0d4009ad40 2023-10-03T10:13:55.022 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 msgr2=0x7f0d401c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d401c8290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30004750 comp rx=0 tx=0).stop 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 shutdown_connections 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d40133f70 0x7f0d401c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d4009ad40 0x7f0d401c8290 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 --2- 172.21.15.125:0/912737817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d400a0a70 0x7f0d401c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 >> 172.21.15.125:0/912737817 conn(0x7f0d40099c40 msgr2=0x7f0d401bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 shutdown_connections 2023-10-03T10:13:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.023+0000 7f0d451aa700 1 -- 172.21.15.125:0/912737817 wait complete. 2023-10-03T10:13:55.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:55.558 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:55.596 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 Processor -- start 2023-10-03T10:13:55.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 -- start start 2023-10-03T10:13:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 0x7f4f4c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0a0920 con 0x7f4f4c09f180 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c09c970 con 0x7f4f4c09e870 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.687+0000 7f4f50d55700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c09bab0 con 0x7f4f4c131d70 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f49d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 0x7f4f4c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43560/0 (socket says 172.21.15.125:43560) 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4a59c700 1 -- 172.21.15.125:0/3871992574 learned_addr learned my addr 172.21.15.125:0/3871992574 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 msgr2=0x7f4f4c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/3871992574 >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 msgr2=0x7f4f4c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/3871992574 >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 0x7f4f4c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/3871992574 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c09f9c0 con 0x7f4f4c131d70 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4a59c700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f49d9b700 1 --2- 172.21.15.125:0/3871992574 >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 0x7f4f4c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c132210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009d90 tx=0x7f4f4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636cceb8eb3dd90f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4959a700 1 -- 172.21.15.125:0/3871992574 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400e070 con 0x7f4f4c131d70 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4959a700 1 -- 172.21.15.125:0/3871992574 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400bb20 con 0x7f4f4c131d70 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.688+0000 7f4f4959a700 1 -- 172.21.15.125:0/3871992574 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44012430 con 0x7f4f4c131d70 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 -- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 msgr2=0x7f4f4c132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c132210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009d90 tx=0x7f4f4400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 -- 172.21.15.125:0/3871992574 shutdown_connections 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09e870 0x7f4f4c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 --2- 172.21.15.125:0/3871992574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c132210 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 --2- 172.21.15.125:0/3871992574 >> v2:172.21.15.125:3300/0 conn(0x7f4f4c09f180 0x7f4f4c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 -- 172.21.15.125:0/3871992574 >> 172.21.15.125:0/3871992574 conn(0x7f4f4c0a4430 msgr2=0x7f4f4c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 -- 172.21.15.125:0/3871992574 shutdown_connections 2023-10-03T10:13:55.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.689+0000 7f4f50d55700 1 -- 172.21.15.125:0/3871992574 wait complete. 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 Processor -- start 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 -- start start 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 0x7f4f4c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0a0210 con 0x7f4f4c09e870 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c06cd10 con 0x7f4f4c09f180 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.690+0000 7f4f50d55700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c125c70 con 0x7f4f4c131d70 2023-10-03T10:13:55.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f49d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 0x7f4f4c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38472/0 (socket says 172.21.15.125:38472) 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f49d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 0x7f4f4c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43574/0 (socket says 172.21.15.125:43574) 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4a59c700 1 -- 172.21.15.125:0/2367359118 learned_addr learned my addr 172.21.15.125:0/2367359118 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 msgr2=0x7f4f4c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 0x7f4f4c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 msgr2=0x7f4f4c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 -- 172.21.15.125:0/2367359118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009550 con 0x7f4f4c131d70 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4a59c700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f4ad9d700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c06c330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009d90 tx=0x7f4f44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44004880 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f44020070 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f400094a0 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440276c0 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.691+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f44009a70 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.692+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f44012430 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.692+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f44022070 con 0x7f4f4c131d70 2023-10-03T10:13:55.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.692+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c04f2a0 con 0x7f4f4c131d70 2023-10-03T10:13:55.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.697+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f4401b400 con 0x7f4f4c131d70 2023-10-03T10:13:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.735+0000 7f46cebfb700 1 Processor -- start 2023-10-03T10:13:55.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.735+0000 7f46cebfb700 1 -- start start 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.735+0000 7f46cebfb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46c809e340 0x7f46c81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cebfb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c8135f20 0x7f46c8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cebfb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c809aaa0 con 0x7f46c809d860 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cebfb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c809e730 con 0x7f46c809e340 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cebfb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c809f870 con 0x7f46c8135f20 2023-10-03T10:13:55.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46c809e340 0x7f46c81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46c809e340 0x7f46c81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38480/0 (socket says 172.21.15.125:38480) 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cc997700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f46c809d860 0x7f46c809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52500/0 (socket says 172.21.15.125:52500) 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 -- 172.21.15.125:0/3863115238 learned_addr learned my addr 172.21.15.125:0/3863115238 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46cd198700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c8135f20 0x7f46c8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 -- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c8135f20 msgr2=0x7f46c8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c8135f20 0x7f46c8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 -- 172.21.15.125:0/3863115238 >> v1:172.21.15.125:6789/0 conn(0x7f46c809d860 legacy=0x7f46c809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 -- 172.21.15.125:0/3863115238 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c809b360 con 0x7f46c809e340 2023-10-03T10:13:55.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c77fe700 1 -- 172.21.15.125:0/3863115238 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439450252 0 0) 0x7f46c809aaa0 con 0x7f46c809d860 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c7fff700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c809e340 0x7f46c81359e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46b400bb90 tx=0x7f46b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b060927866e8b59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c77fe700 1 -- 172.21.15.125:0/3863115238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400dd30 con 0x7f46c809e340 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c77fe700 1 -- 172.21.15.125:0/3863115238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400de90 con 0x7f46c809e340 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.736+0000 7f46c77fe700 1 -- 172.21.15.125:0/3863115238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4010690 con 0x7f46c809e340 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 -- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c809e340 msgr2=0x7f46c81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c809e340 0x7f46c81359e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46b400bb90 tx=0x7f46b400bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 -- 172.21.15.125:0/3863115238 shutdown_connections 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c8135f20 0x7f46c8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 --2- 172.21.15.125:0/3863115238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c809e340 0x7f46c81359e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 -- 172.21.15.125:0/3863115238 >> 172.21.15.125:0/3863115238 conn(0x7f46c8099c40 msgr2=0x7f46c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 -- 172.21.15.125:0/3863115238 shutdown_connections 2023-10-03T10:13:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.737+0000 7f46cebfb700 1 -- 172.21.15.125:0/3863115238 wait complete. 2023-10-03T10:13:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 Processor -- start 2023-10-03T10:13:55.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 -- start start 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 0x7f46c811b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46c809e340 0x7f46c811b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c811e940 con 0x7f46c8135f20 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c811c740 con 0x7f46c809d860 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cebfb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80a2020 con 0x7f46c809e340 2023-10-03T10:13:55.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.738+0000 7f46cd198700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cc997700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 0x7f46c811b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46c7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46c809e340 0x7f46c811b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38492/0 (socket says 172.21.15.125:38492) 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 -- 172.21.15.125:0/1352568534 learned_addr learned my addr 172.21.15.125:0/1352568534 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 -- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46c809e340 msgr2=0x7f46c811b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46c809e340 0x7f46c811b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 -- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 msgr2=0x7f46c811b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 0x7f46c811b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 -- 172.21.15.125:0/1352568534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b400b7f0 con 0x7f46c8135f20 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cc997700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 0x7f46c811b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cd198700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46c000efc0 tx=0x7f46c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000cc90 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c000f040 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c809c8b0 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0014480 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.739+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c811eb20 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.740+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46c0014600 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.740+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c811e770 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.740+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46c003fee0 con 0x7f46c8135f20 2023-10-03T10:13:55.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.745+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46c00118b0 con 0x7f46c8135f20 2023-10-03T10:13:55.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.898+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f4c131b50 con 0x7f4f4c131d70 2023-10-03T10:13:55.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.899+0000 7f4f3affd700 1 -- 172.21.15.125:0/2367359118 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f44011390 con 0x7f4f4c131d70 2023-10-03T10:13:55.900 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:55.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 msgr2=0x7f4f4c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c06c330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009d90 tx=0x7f4f44004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 shutdown_connections 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f4c131d70 0x7f4f4c06c330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c09e870 0x7f4f4c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 --2- 172.21.15.125:0/2367359118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f4c09f180 0x7f4f4c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 >> 172.21.15.125:0/2367359118 conn(0x7f4f4c0a4430 msgr2=0x7f4f4c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 shutdown_connections 2023-10-03T10:13:55.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.901+0000 7f4f50d55700 1 -- 172.21.15.125:0/2367359118 wait complete. 2023-10-03T10:13:55.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.938+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46c809b670 con 0x7f46c8135f20 2023-10-03T10:13:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.938+0000 7f46c57fa700 1 -- 172.21.15.125:0/1352568534 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46c0018030 con 0x7f46c8135f20 2023-10-03T10:13:55.939 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.940+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 msgr2=0x7f46c811bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.940+0000 7f46cebfb700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46c000efc0 tx=0x7f46c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 shutdown_connections 2023-10-03T10:13:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46c8135f20 0x7f46c811bd60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46c809d860 0x7f46c811b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 --2- 172.21.15.125:0/1352568534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46c809e340 0x7f46c811b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 >> 172.21.15.125:0/1352568534 conn(0x7f46c8099c40 msgr2=0x7f46c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 shutdown_connections 2023-10-03T10:13:55.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:55.941+0000 7f46cebfb700 1 -- 172.21.15.125:0/1352568534 wait complete. 2023-10-03T10:13:55.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:55.993 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:56.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:56.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 Processor -- start 2023-10-03T10:13:56.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 -- start start 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f4944133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.119+0000 7f4949510700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494406b2d0 con 0x7f49441309f0 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4949510700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4944133610 con 0x7f4944133ad0 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4949510700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494409a500 con 0x7f49441300a0 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49427fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49427fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39374/0 (socket says 172.21.15.125:39374) 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38496/0 (socket says 172.21.15.125:38496) 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49427fc700 1 -- 172.21.15.125:0/880089159 learned_addr learned my addr 172.21.15.125:0/880089159 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f4944133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 -- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 msgr2=0x7f49441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 -- 172.21.15.125:0/880089159 >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 msgr2=0x7f494413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 --2- 172.21.15.125:0/880089159 >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 -- 172.21.15.125:0/880089159 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49441338b0 con 0x7f4944133ad0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49437fe700 1 --2- 172.21.15.125:0/880089159 >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f49427fc700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4942ffd700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f4944133ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4934009840 tx=0x7f4934009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e37d1e9cca149a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4941ffb700 1 -- 172.21.15.125:0/880089159 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934011830 con 0x7f4944133ad0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4941ffb700 1 -- 172.21.15.125:0/880089159 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934011990 con 0x7f4944133ad0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.120+0000 7f4941ffb700 1 -- 172.21.15.125:0/880089159 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934011d20 con 0x7f4944133ad0 2023-10-03T10:13:56.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 -- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 msgr2=0x7f4944133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f4944133ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4934009840 tx=0x7f4934009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 -- 172.21.15.125:0/880089159 shutdown_connections 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f4944133ea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 --2- 172.21.15.125:0/880089159 >> v2:172.21.15.125:3300/0 conn(0x7f49441309f0 0x7f494413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 --2- 172.21.15.125:0/880089159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f49441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 -- 172.21.15.125:0/880089159 >> 172.21.15.125:0/880089159 conn(0x7f4944099c40 msgr2=0x7f49440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 -- 172.21.15.125:0/880089159 shutdown_connections 2023-10-03T10:13:56.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.121+0000 7f4949510700 1 -- 172.21.15.125:0/880089159 wait complete. 2023-10-03T10:13:56.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.122+0000 7f4949510700 1 Processor -- start 2023-10-03T10:13:56.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.122+0000 7f4949510700 1 -- start start 2023-10-03T10:13:56.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f494411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f494411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4944120e70 con 0x7f49441309f0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494412fd60 con 0x7f4944133ad0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4949510700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494412dd00 con 0x7f49441300a0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f494411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38498/0 (socket says 172.21.15.125:38498) 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49427fc700 1 -- 172.21.15.125:0/3797876840 learned_addr learned my addr 172.21.15.125:0/3797876840 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f4942ffd700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f494411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 -- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 msgr2=0x7f494411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f494411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 -- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 msgr2=0x7f494411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49437fe700 1 -- 172.21.15.125:0/3797876840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009550 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.123+0000 7f49427fc700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f49437fe700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f494411e4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f493c00efc0 tx=0x7f493c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c009e80 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00f040 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c009a70 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00ccd0 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.124+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49340094a0 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.125+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f493c014480 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.125+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f493c03fa70 con 0x7f4944133ad0 2023-10-03T10:13:56.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.125+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494404f2a0 con 0x7f4944133ad0 2023-10-03T10:13:56.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.130+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f493c01d410 con 0x7f4944133ad0 2023-10-03T10:13:56.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.163+0000 7f349fc2c700 1 Processor -- start 2023-10-03T10:13:56.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 -- start start 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 0x7f3498133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349809b110 con 0x7f34980a0a70 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980a3b60 con 0x7f349809ad40 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349fc2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34981348e0 con 0x7f3498133f70 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d9c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 0x7f3498133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d1c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d9c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 0x7f3498133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38510/0 (socket says 172.21.15.125:38510) 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d9c8700 1 -- 172.21.15.125:0/2658403906 learned_addr learned my addr 172.21.15.125:0/2658403906 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349e1c9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f34980a0a70 0x7f34980a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52502/0 (socket says 172.21.15.125:52502) 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d1c7700 1 -- 172.21.15.125:0/2658403906 >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 msgr2=0x7f3498133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d1c7700 1 --2- 172.21.15.125:0/2658403906 >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 0x7f3498133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.164+0000 7f349d1c7700 1 -- 172.21.15.125:0/2658403906 >> v1:172.21.15.125:6789/0 conn(0x7f34980a0a70 legacy=0x7f34980a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349d1c7700 1 -- 172.21.15.125:0/2658403906 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980a2fa0 con 0x7f3498133f70 2023-10-03T10:13:56.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349d1c7700 1 --2- 172.21.15.125:0/2658403906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981343a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3488009840 tx=0x7f3488009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a18cdc6a4784a78a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349c9c6700 1 -- 172.21.15.125:0/2658403906 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488011830 con 0x7f3498133f70 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349c9c6700 1 -- 172.21.15.125:0/2658403906 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488011990 con 0x7f3498133f70 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349c9c6700 1 -- 172.21.15.125:0/2658403906 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488011d20 con 0x7f3498133f70 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 -- 172.21.15.125:0/2658403906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 msgr2=0x7f34981343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 --2- 172.21.15.125:0/2658403906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981343a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3488009840 tx=0x7f3488009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 -- 172.21.15.125:0/2658403906 shutdown_connections 2023-10-03T10:13:56.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 --2- 172.21.15.125:0/2658403906 >> v2:172.21.15.125:3300/0 conn(0x7f349809ad40 0x7f3498133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 --2- 172.21.15.125:0/2658403906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981343a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 -- 172.21.15.125:0/2658403906 >> 172.21.15.125:0/2658403906 conn(0x7f3498099c40 msgr2=0x7f349806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 -- 172.21.15.125:0/2658403906 shutdown_connections 2023-10-03T10:13:56.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.165+0000 7f349fc2c700 1 -- 172.21.15.125:0/2658403906 wait complete. 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 Processor -- start 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 -- start start 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34980a0a70 0x7f34981c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34981c5cd0 con 0x7f34980a0a70 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349809c7e0 con 0x7f349809ad40 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349fc2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349811fc10 con 0x7f3498133f70 2023-10-03T10:13:56.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349d9c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349d9c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43624/0 (socket says 172.21.15.125:43624) 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349d9c8700 1 -- 172.21.15.125:0/3712433503 learned_addr learned my addr 172.21.15.125:0/3712433503 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349e1c9700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.167+0000 7f349d1c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34980a0a70 0x7f34981c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 -- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 msgr2=0x7f34981c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 -- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34980a0a70 msgr2=0x7f34981c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34980a0a70 0x7f34981c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 -- 172.21.15.125:0/3712433503 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880094a0 con 0x7f349809ad40 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349d9c8700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f349400e8b0 tx=0x7f349400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009600 con 0x7f349809ad40 2023-10-03T10:13:56.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494013680 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349809bb50 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494013a30 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.168+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498121b20 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.169+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3494013b90 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.169+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f349403f560 con 0x7f349809ad40 2023-10-03T10:13:56.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.169+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349804f2a0 con 0x7f349809ad40 2023-10-03T10:13:56.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.174+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34940123d0 con 0x7f349809ad40 2023-10-03T10:13:56.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.324+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f494406c3b0 con 0x7f4944133ad0 2023-10-03T10:13:56.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.324+0000 7f492b7fe700 1 -- 172.21.15.125:0/3797876840 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f493c01c3b0 con 0x7f4944133ad0 2023-10-03T10:13:56.325 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 msgr2=0x7f494411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f494411e4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f493c00efc0 tx=0x7f493c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 shutdown_connections 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4944133ad0 0x7f494411e4c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49441300a0 0x7f494411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 --2- 172.21.15.125:0/3797876840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49441309f0 0x7f494411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 >> 172.21.15.125:0/3797876840 conn(0x7f4944099c40 msgr2=0x7f494409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 shutdown_connections 2023-10-03T10:13:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.326+0000 7f4949510700 1 -- 172.21.15.125:0/3797876840 wait complete. 2023-10-03T10:13:56.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:56.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.369+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34980729d0 con 0x7f349809ad40 2023-10-03T10:13:56.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.369+0000 7f348e7fc700 1 -- 172.21.15.125:0/3712433503 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3494021030 con 0x7f349809ad40 2023-10-03T10:13:56.369 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 msgr2=0x7f34981c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f349400e8b0 tx=0x7f349400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 shutdown_connections 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3498133f70 0x7f34981c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f349809ad40 0x7f34981c5250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 --2- 172.21.15.125:0/3712433503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34980a0a70 0x7f34981c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 >> 172.21.15.125:0/3712433503 conn(0x7f3498099c40 msgr2=0x7f3498132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 shutdown_connections 2023-10-03T10:13:56.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:56.371+0000 7f349fc2c700 1 -- 172.21.15.125:0/3712433503 wait complete. 2023-10-03T10:13:56.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:56.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:56.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 Processor -- start 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 -- start start 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025409aa00 con 0x7f0254099a60 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025409a080 con 0x7f02540a0ff0 2023-10-03T10:13:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.047+0000 7f025b01f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0254133750 con 0x7f0254133b80 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02595bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0253fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0254099a60 0x7f02540a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52514/0 (socket says 172.21.15.125:52514) 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02595bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38522/0 (socket says 172.21.15.125:38522) 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43640/0 (socket says 172.21.15.125:43640) 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0253fff700 1 -- 172.21.15.125:0/949886486 learned_addr learned my addr 172.21.15.125:0/949886486 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 -- 172.21.15.125:0/949886486 >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 msgr2=0x7f025413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 --2- 172.21.15.125:0/949886486 >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 -- 172.21.15.125:0/949886486 >> v1:172.21.15.125:6789/0 conn(0x7f0254099a60 legacy=0x7f02540a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 -- 172.21.15.125:0/949886486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025409a760 con 0x7f0254133b80 2023-10-03T10:13:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02595bc700 1 --2- 172.21.15.125:0/949886486 >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f0258dbb700 1 --2- 172.21.15.125:0/949886486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0248009820 tx=0x7f0248009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4995b7e0e2609c1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02537fe700 1 -- 172.21.15.125:0/949886486 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248005e30 con 0x7f0254133b80 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02537fe700 1 -- 172.21.15.125:0/949886486 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248006030 con 0x7f0254133b80 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.048+0000 7f02537fe700 1 -- 172.21.15.125:0/949886486 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02480063c0 con 0x7f0254133b80 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 -- 172.21.15.125:0/949886486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 msgr2=0x7f0254133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 --2- 172.21.15.125:0/949886486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0248009820 tx=0x7f0248009b30 comp rx=0 tx=0).stop 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 -- 172.21.15.125:0/949886486 shutdown_connections 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 --2- 172.21.15.125:0/949886486 >> v2:172.21.15.125:3300/0 conn(0x7f02540a0ff0 0x7f025413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 --2- 172.21.15.125:0/949886486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0254133b80 0x7f0254133f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 -- 172.21.15.125:0/949886486 >> 172.21.15.125:0/949886486 conn(0x7f02540a2980 msgr2=0x7f02540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 -- 172.21.15.125:0/949886486 shutdown_connections 2023-10-03T10:13:57.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.049+0000 7f025b01f700 1 -- 172.21.15.125:0/949886486 wait complete. 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.050+0000 7f025b01f700 1 Processor -- start 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.050+0000 7f025b01f700 1 -- start start 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02540a0ff0 0x7f025411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 0x7f025411f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02541223e0 con 0x7f0254099a60 2023-10-03T10:13:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0254122630 con 0x7f02540a0ff0 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f025b01f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025412feb0 con 0x7f0254133b80 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f0258dbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f0253fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02540a0ff0 0x7f025411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 0x7f025411f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f0258dbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38524/0 (socket says 172.21.15.125:38524) 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f0258dbb700 1 -- 172.21.15.125:0/187062194 learned_addr learned my addr 172.21.15.125:0/187062194 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 -- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02540a0ff0 msgr2=0x7f025411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02540a0ff0 0x7f025411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 -- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 msgr2=0x7f025411eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f02595bc700 1 -- 172.21.15.125:0/187062194 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009a70 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.051+0000 7f0258dbb700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f02595bc700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 0x7f025411f620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f024c00efc0 tx=0x7f024c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00ca90 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00f040 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0248009430 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00ce30 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.052+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025412f630 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.053+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025404f2a0 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.053+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f024c003a20 con 0x7f0254133b80 2023-10-03T10:13:57.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.053+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f024c040730 con 0x7f0254133b80 2023-10-03T10:13:57.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.057+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f024c01c7c0 con 0x7f0254133b80 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.081+0000 7f656b9f4700 1 Processor -- start 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.081+0000 7f656b9f4700 1 -- start start 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f656b9f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 0x7f6564138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f656b9f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 0x7f656413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f656b9f4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656409e9d0 con 0x7f65640a0a70 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f656b9f4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656409dc00 con 0x7f65640a1550 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f656b9f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f656409dec0 con 0x7f6564139200 2023-10-03T10:13:57.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6568f8f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 0x7f6564138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569790700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f65640a0a70 0x7f65640a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52528/0 (socket says 172.21.15.125:52528) 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569790700 1 -- 172.21.15.125:0/2503303358 learned_addr learned my addr 172.21.15.125:0/2503303358 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569f91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 0x7f656413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569f91700 1 -- 172.21.15.125:0/2503303358 >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 msgr2=0x7f6564138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569f91700 1 --2- 172.21.15.125:0/2503303358 >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 0x7f6564138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569f91700 1 -- 172.21.15.125:0/2503303358 >> v1:172.21.15.125:6789/0 conn(0x7f65640a0a70 legacy=0x7f65640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6569f91700 1 -- 172.21.15.125:0/2503303358 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656409e6a0 con 0x7f6564139200 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f655bfff700 1 -- 172.21.15.125:0/2503303358 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514677500 0 0) 0x7f656409e9d0 con 0x7f65640a0a70 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.082+0000 7f6568f8f700 1 --2- 172.21.15.125:0/2503303358 >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 0x7f6564138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f6569f91700 1 --2- 172.21.15.125:0/2503303358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 0x7f656413b5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f655c009d90 tx=0x7f655c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd0c7fe00b179aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f655bfff700 1 -- 172.21.15.125:0/2503303358 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00e070 con 0x7f6564139200 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f655bfff700 1 -- 172.21.15.125:0/2503303358 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00bb20 con 0x7f6564139200 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f655bfff700 1 -- 172.21.15.125:0/2503303358 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c012430 con 0x7f6564139200 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 -- 172.21.15.125:0/2503303358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 msgr2=0x7f656413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2503303358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 0x7f656413b5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f655c009d90 tx=0x7f655c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 -- 172.21.15.125:0/2503303358 shutdown_connections 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2503303358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6564139200 0x7f656413b5e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2503303358 >> v2:172.21.15.125:3300/0 conn(0x7f65640a1550 0x7f6564138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 -- 172.21.15.125:0/2503303358 >> 172.21.15.125:0/2503303358 conn(0x7f65640a6610 msgr2=0x7f65640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 -- 172.21.15.125:0/2503303358 shutdown_connections 2023-10-03T10:13:57.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.083+0000 7f656b9f4700 1 -- 172.21.15.125:0/2503303358 wait complete. 2023-10-03T10:13:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 Processor -- start 2023-10-03T10:13:57.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 -- start start 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f65640a0a70 0x7f656411e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6564139200 0x7f656411f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a03e0 con 0x7f65640a1550 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6564121990 con 0x7f6564139200 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f656b9f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6564121eb0 con 0x7f65640a0a70 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f6568f8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f6568f8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38544/0 (socket says 172.21.15.125:38544) 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f6568f8f700 1 -- 172.21.15.125:0/2232134829 learned_addr learned my addr 172.21.15.125:0/2232134829 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f6569f91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6564139200 0x7f656411f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.085+0000 7f6569790700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f65640a0a70 0x7f656411e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 -- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f65640a0a70 msgr2=0x7f656411e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f65640a0a70 0x7f656411e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 -- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6564139200 msgr2=0x7f656411f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6564139200 0x7f656411f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 -- 172.21.15.125:0/2232134829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540094a0 con 0x7f65640a1550 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6568f8f700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f655400ebe0 tx=0x7f655400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400c850 con 0x7f65640a1550 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400c9b0 con 0x7f65640a1550 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c009a70 con 0x7f65640a1550 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400cd40 con 0x7f65640a1550 2023-10-03T10:13:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.086+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6564122920 con 0x7f65640a1550 2023-10-03T10:13:57.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.087+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656404f2a0 con 0x7f65640a1550 2023-10-03T10:13:57.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.088+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6554013470 con 0x7f65640a1550 2023-10-03T10:13:57.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.088+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f655403ffc0 con 0x7f65640a1550 2023-10-03T10:13:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.092+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6554013720 con 0x7f65640a1550 2023-10-03T10:13:57.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.254+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f025412fa60 con 0x7f0254133b80 2023-10-03T10:13:57.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.254+0000 7f02517fa700 1 -- 172.21.15.125:0/187062194 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f024c02b090 con 0x7f0254133b80 2023-10-03T10:13:57.255 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:57.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 msgr2=0x7f025411f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 0x7f025411f620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f024c00efc0 tx=0x7f024c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 shutdown_connections 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0254133b80 0x7f025411f620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0254099a60 0x7f025411eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 --2- 172.21.15.125:0/187062194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02540a0ff0 0x7f025411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 >> 172.21.15.125:0/187062194 conn(0x7f02540a2980 msgr2=0x7f0254132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 shutdown_connections 2023-10-03T10:13:57.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.256+0000 7f025b01f700 1 -- 172.21.15.125:0/187062194 wait complete. 2023-10-03T10:13:57.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:57.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.285+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6564072980 con 0x7f65640a1550 2023-10-03T10:13:57.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.285+0000 7f6559ffb700 1 -- 172.21.15.125:0/2232134829 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f655402a090 con 0x7f65640a1550 2023-10-03T10:13:57.286 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 msgr2=0x7f656411ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f655400ebe0 tx=0x7f655400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 shutdown_connections 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6564139200 0x7f656411f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f65640a0a70 0x7f656411e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 --2- 172.21.15.125:0/2232134829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65640a1550 0x7f656411ebb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 >> 172.21.15.125:0/2232134829 conn(0x7f65640a6610 msgr2=0x7f6564136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 shutdown_connections 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.287+0000 7f656b9f4700 1 -- 172.21.15.125:0/2232134829 wait complete. 2023-10-03T10:13:57.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:57.340 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:57.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.469+0000 7f7f1e0e3700 1 Processor -- start 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.469+0000 7f7f1e0e3700 1 -- start start 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f1e0e3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f1e0e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f180a1380 0x7f7f18133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f16ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f180a1380 0x7f7f18133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43652/0 (socket says 172.21.15.125:43652) 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f177fe700 1 -- 172.21.15.125:0/1858312623 learned_addr learned my addr 172.21.15.125:0/1858312623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1809dc00 con 0x7f7f18133f50 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1809ea60 con 0x7f7f180a1380 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.470+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1809dec0 con 0x7f7f180a0a70 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f16ffd700 1 -- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 msgr2=0x7f7f180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f16ffd700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f16ffd700 1 -- 172.21.15.125:0/1858312623 >> v1:172.21.15.125:6789/0 conn(0x7f7f18133f50 legacy=0x7f7f1813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f16ffd700 1 -- 172.21.15.125:0/1858312623 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1809e6a0 con 0x7f7f180a1380 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f167fc700 1 -- 172.21.15.125:0/1858312623 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688741104 0 0) 0x7f7f1809dc00 con 0x7f7f18133f50 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f177fe700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f16ffd700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f180a1380 0x7f7f18133a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009840 tx=0x7f7f0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a00dad49461e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f167fc700 1 -- 172.21.15.125:0/1858312623 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011830 con 0x7f7f180a1380 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f167fc700 1 -- 172.21.15.125:0/1858312623 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c011990 con 0x7f7f180a1380 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.471+0000 7f7f167fc700 1 -- 172.21.15.125:0/1858312623 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011d20 con 0x7f7f180a1380 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f180a1380 msgr2=0x7f7f18133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f180a1380 0x7f7f18133a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009840 tx=0x7f7f0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 shutdown_connections 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/1858312623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f180a1380 0x7f7f18133a10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 >> 172.21.15.125:0/1858312623 conn(0x7f7f180a6610 msgr2=0x7f7f180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 shutdown_connections 2023-10-03T10:13:57.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.472+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/1858312623 wait complete. 2023-10-03T10:13:57.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.473+0000 7f7f1e0e3700 1 Processor -- start 2023-10-03T10:13:57.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.473+0000 7f7f1e0e3700 1 -- start start 2023-10-03T10:13:57.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f18133f50 0x7f7f18123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18124d90 con 0x7f7f18133f50 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18133aa0 con 0x7f7f180a0a70 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f1e0e3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18124680 con 0x7f7f180a1380 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39444/0 (socket says 172.21.15.125:39444) 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43656/0 (socket says 172.21.15.125:43656) 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f16ffd700 1 -- 172.21.15.125:0/4143255674 learned_addr learned my addr 172.21.15.125:0/4143255674 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f17fff700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f18133f50 0x7f7f18123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 -- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 msgr2=0x7f7f18122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 -- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f18133f50 msgr2=0x7f7f18123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f18133f50 0x7f7f18123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 -- 172.21.15.125:0/4143255674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009550 con 0x7f7f180a0a70 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f16ffd700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.474+0000 7f7f177fe700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800e9a0 tx=0x7f7f0800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004030 con 0x7f7f180a0a70 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08004190 con 0x7f7f180a0a70 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004520 con 0x7f7f180a0a70 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0094a0 con 0x7f7f180a0a70 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f18126130 con 0x7f7f180a0a70 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.475+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f080036a0 con 0x7f7f180a0a70 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.476+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f0803f8c0 con 0x7f7f180a0a70 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.476+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1804f2a0 con 0x7f7f180a0a70 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.481+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f08011db0 con 0x7f7f180a0a70 2023-10-03T10:13:57.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.520+0000 7faa047b2700 1 Processor -- start 2023-10-03T10:13:57.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.520+0000 7faa047b2700 1 -- start start 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa047b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa047b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa047b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc09a760 con 0x7fa9fc134210 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa047b2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc1336e0 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa047b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc09a080 con 0x7fa9fc133900 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa02d4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43670/0 (socket says 172.21.15.125:43670) 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa02d4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38580/0 (socket says 172.21.15.125:38580) 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa01d4d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa9fc134210 0x7fa9fc0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52556/0 (socket says 172.21.15.125:52556) 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 -- 172.21.15.125:0/2408469971 learned_addr learned my addr 172.21.15.125:0/2408469971 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 -- 172.21.15.125:0/2408469971 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 msgr2=0x7fa9fc13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 --2- 172.21.15.125:0/2408469971 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 -- 172.21.15.125:0/2408469971 >> v1:172.21.15.125:6789/0 conn(0x7fa9fc134210 legacy=0x7fa9fc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 -- 172.21.15.125:0/2408469971 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0a23e0 con 0x7fa9fc133900 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0154c700 1 -- 172.21.15.125:0/2408469971 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511408187 0 0) 0x7fa9fc09a760 con 0x7fa9fc134210 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa02d4f700 1 --2- 172.21.15.125:0/2408469971 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0254e700 1 --2- 172.21.15.125:0/2408469971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78679567cf9b3a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.521+0000 7faa0154c700 1 -- 172.21.15.125:0/2408469971 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8005e30 con 0x7fa9fc133900 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa0154c700 1 -- 172.21.15.125:0/2408469971 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8004030 con 0x7fa9fc133900 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa0154c700 1 -- 172.21.15.125:0/2408469971 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80043e0 con 0x7fa9fc133900 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 -- 172.21.15.125:0/2408469971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 msgr2=0x7fa9fc133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 --2- 172.21.15.125:0/2408469971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 -- 172.21.15.125:0/2408469971 shutdown_connections 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 --2- 172.21.15.125:0/2408469971 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a10b0 0x7fa9fc13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 --2- 172.21.15.125:0/2408469971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc133900 0x7fa9fc133cd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 -- 172.21.15.125:0/2408469971 >> 172.21.15.125:0/2408469971 conn(0x7fa9fc0a2980 msgr2=0x7fa9fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 -- 172.21.15.125:0/2408469971 shutdown_connections 2023-10-03T10:13:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.522+0000 7faa047b2700 1 -- 172.21.15.125:0/2408469971 wait complete. 2023-10-03T10:13:57.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.523+0000 7faa047b2700 1 Processor -- start 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.523+0000 7faa047b2700 1 -- start start 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133900 0x7fa9fc11dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc134210 0x7fa9fc11e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc11eba0 con 0x7fa9fc134210 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc11f300 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc120550 con 0x7fa9fc133900 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43680/0 (socket says 172.21.15.125:43680) 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 -- 172.21.15.125:0/740521476 learned_addr learned my addr 172.21.15.125:0/740521476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa02d4f700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc134210 0x7fa9fc11e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 -- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133900 msgr2=0x7fa9fc11dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133900 0x7fa9fc11dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 -- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc134210 msgr2=0x7fa9fc11e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc134210 0x7fa9fc11e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 -- 172.21.15.125:0/740521476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4009a70 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa0254e700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009c10 tx=0x7fa9f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8003dd0 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f801c420 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8009500 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f801c7b0 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.524+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc132cf0 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.525+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f801c910 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.525+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9f8040780 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.525+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc11a590 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.530+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f802a020 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.676+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f18126c00 con 0x7f7f180a0a70 2023-10-03T10:13:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.676+0000 7f7efffff700 1 -- 172.21.15.125:0/4143255674 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f08020020 con 0x7f7f180a0a70 2023-10-03T10:13:57.677 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:57.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 msgr2=0x7f7f18122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800e9a0 tx=0x7f7f0800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 shutdown_connections 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f18133f50 0x7f7f18123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f180a0a70 0x7f7f18122980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 --2- 172.21.15.125:0/4143255674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f180a1380 0x7f7f18122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 >> 172.21.15.125:0/4143255674 conn(0x7f7f180a6610 msgr2=0x7f7f1809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 shutdown_connections 2023-10-03T10:13:57.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.678+0000 7f7f1e0e3700 1 -- 172.21.15.125:0/4143255674 wait complete. 2023-10-03T10:13:57.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:57.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.725+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9fc09a2c0 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.726+0000 7fa9f2ffd700 1 -- 172.21.15.125:0/740521476 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9f8016070 con 0x7fa9fc0a10b0 2023-10-03T10:13:57.727 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 msgr2=0x7fa9fc11d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009c10 tx=0x7fa9f8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 shutdown_connections 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc134210 0x7fa9fc11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a10b0 0x7fa9fc11d6f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 --2- 172.21.15.125:0/740521476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133900 0x7fa9fc11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 >> 172.21.15.125:0/740521476 conn(0x7fa9fc0a2980 msgr2=0x7fa9fc1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 shutdown_connections 2023-10-03T10:13:57.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:57.728+0000 7faa047b2700 1 -- 172.21.15.125:0/740521476 wait complete. 2023-10-03T10:13:57.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:58.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:58.301 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:58.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.400+0000 7f4073313700 1 Processor -- start 2023-10-03T10:13:58.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.400+0000 7f4073313700 1 -- start start 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f4073313700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f4073313700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f406c0a1380 0x7f406c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f4073313700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c09dc00 con 0x7f406c133f50 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f4073313700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c09ea60 con 0x7f406c0a1380 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f4073313700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c09dec0 con 0x7f406c0a0a70 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40710af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f406c0a1380 0x7f406c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f406c0a1380 0x7f406c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38592/0 (socket says 172.21.15.125:38592) 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40710af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43694/0 (socket says 172.21.15.125:43694) 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 -- 172.21.15.125:0/298585904 learned_addr learned my addr 172.21.15.125:0/298585904 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40718b0700 1 --1- 172.21.15.125:0/298585904 >> v1:172.21.15.125:6789/0 conn(0x7f406c133f50 0x7f406c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52572/0 (socket says 172.21.15.125:52572) 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 -- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 msgr2=0x7f406c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 -- 172.21.15.125:0/298585904 >> v1:172.21.15.125:6789/0 conn(0x7f406c133f50 legacy=0x7f406c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40708ae700 1 -- 172.21.15.125:0/298585904 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c09e6a0 con 0x7f406c0a1380 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.401+0000 7f40710af700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f40708ae700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c0a1380 0x7f406c133a10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f405c0098f0 tx=0x7f405c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa90d96d6d5f57d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4063fff700 1 -- 172.21.15.125:0/298585904 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c011830 con 0x7f406c0a1380 2023-10-03T10:13:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4063fff700 1 -- 172.21.15.125:0/298585904 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c011990 con 0x7f406c0a1380 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4063fff700 1 -- 172.21.15.125:0/298585904 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c011d20 con 0x7f406c0a1380 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 -- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c0a1380 msgr2=0x7f406c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c0a1380 0x7f406c133a10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f405c0098f0 tx=0x7f405c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 -- 172.21.15.125:0/298585904 shutdown_connections 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a0a70 0x7f406c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 --2- 172.21.15.125:0/298585904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c0a1380 0x7f406c133a10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 -- 172.21.15.125:0/298585904 >> 172.21.15.125:0/298585904 conn(0x7f406c0a6610 msgr2=0x7f406c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.402+0000 7f4073313700 1 -- 172.21.15.125:0/298585904 shutdown_connections 2023-10-03T10:13:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.403+0000 7f4073313700 1 -- 172.21.15.125:0/298585904 wait complete. 2023-10-03T10:13:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.403+0000 7f4073313700 1 Processor -- start 2023-10-03T10:13:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.403+0000 7f4073313700 1 -- start start 2023-10-03T10:13:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 0x7f406c1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 0x7f406c1c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1253f0 con 0x7f406c133f50 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c124680 con 0x7f406c0a1380 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f4073313700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f406c122f50 con 0x7f406c0a0a70 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40708ae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 0x7f406c1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40718b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 0x7f406c1c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39458/0 (socket says 172.21.15.125:39458) 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40708ae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 0x7f406c1c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43696/0 (socket says 172.21.15.125:43696) 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 -- 172.21.15.125:0/2946231768 learned_addr learned my addr 172.21.15.125:0/2946231768 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 -- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 msgr2=0x7f406c1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 0x7f406c1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 -- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 msgr2=0x7f406c1c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 0x7f406c1c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40710af700 1 -- 172.21.15.125:0/2946231768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680094a0 con 0x7f406c0a0a70 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.404+0000 7f40718b0700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 0x7f406c1c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f40710af700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f406800ec10 tx=0x7f406800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800c850 con 0x7f406c0a0a70 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800c9b0 con 0x7f406c0a0a70 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c009550 con 0x7f406c0a0a70 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800cd40 con 0x7f406c0a0a70 2023-10-03T10:13:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.405+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c1262b0 con 0x7f406c0a0a70 2023-10-03T10:13:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.406+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c04f2a0 con 0x7f406c0a0a70 2023-10-03T10:13:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.406+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4068026480 con 0x7f406c0a0a70 2023-10-03T10:13:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.406+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4068040000 con 0x7f406c0a0a70 2023-10-03T10:13:58.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.410+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4068026730 con 0x7f406c0a0a70 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.440+0000 7f57c27c1700 1 Processor -- start 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.440+0000 7f57c27c1700 1 -- start start 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c27c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c27c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c27c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc09b110 con 0x7f57bc133f70 2023-10-03T10:13:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c27c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57bc0a3b60 con 0x7f57bc1343a0 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c27c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0a2fa0 con 0x7f57bc09ad40 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c0d5e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c0d5e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38606/0 (socket says 172.21.15.125:38606) 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43712/0 (socket says 172.21.15.125:43712) 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c0d5e700 1 -- 172.21.15.125:0/3082314899 learned_addr learned my addr 172.21.15.125:0/3082314899 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bb7fe700 1 --1- 172.21.15.125:0/3082314899 >> v1:172.21.15.125:6789/0 conn(0x7f57bc133f70 0x7f57bc0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52582/0 (socket says 172.21.15.125:52582) 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 -- 172.21.15.125:0/3082314899 >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 msgr2=0x7f57bc0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 --2- 172.21.15.125:0/3082314899 >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 -- 172.21.15.125:0/3082314899 >> v1:172.21.15.125:6789/0 conn(0x7f57bc133f70 legacy=0x7f57bc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 -- 172.21.15.125:0/3082314899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc09a280 con 0x7f57bc09ad40 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57baffd700 1 -- 172.21.15.125:0/3082314899 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482015302 0 0) 0x7f57bc09b110 con 0x7f57bc133f70 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57c0d5e700 1 --2- 172.21.15.125:0/3082314899 >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57bbfff700 1 --2- 172.21.15.125:0/3082314899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c9fec49bc249ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.441+0000 7f57baffd700 1 -- 172.21.15.125:0/3082314899 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011830 con 0x7f57bc09ad40 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57baffd700 1 -- 172.21.15.125:0/3082314899 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac011990 con 0x7f57bc09ad40 2023-10-03T10:13:58.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57baffd700 1 -- 172.21.15.125:0/3082314899 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011d20 con 0x7f57bc09ad40 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 -- 172.21.15.125:0/3082314899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 msgr2=0x7f57bc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3082314899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 -- 172.21.15.125:0/3082314899 shutdown_connections 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3082314899 >> v2:172.21.15.125:3300/0 conn(0x7f57bc1343a0 0x7f57bc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3082314899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc133a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 -- 172.21.15.125:0/3082314899 >> 172.21.15.125:0/3082314899 conn(0x7f57bc099c40 msgr2=0x7f57bc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 -- 172.21.15.125:0/3082314899 shutdown_connections 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.442+0000 7f57c27c1700 1 -- 172.21.15.125:0/3082314899 wait complete. 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.443+0000 7f57c27c1700 1 Processor -- start 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.443+0000 7f57c27c1700 1 -- start start 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.443+0000 7f57c27c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.443+0000 7f57c27c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 0x7f57bc11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57bc1343a0 0x7f57bc11ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc1216d0 con 0x7f57bc1343a0 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc09c7e0 con 0x7f57bc09ad40 2023-10-03T10:13:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc11fff0 con 0x7f57bc133f70 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43728/0 (socket says 172.21.15.125:43728) 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 -- 172.21.15.125:0/3241521455 learned_addr learned my addr 172.21.15.125:0/3241521455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c0d5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57bc1343a0 0x7f57bc11ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bb7fe700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 0x7f57bc11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 -- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 msgr2=0x7f57bc11e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 0x7f57bc11e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 -- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57bc1343a0 msgr2=0x7f57bc11ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57bc1343a0 0x7f57bc11ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 -- 172.21.15.125:0/3241521455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009b30 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bb7fe700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 0x7f57bc11e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57bbfff700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0090b0 tx=0x7f57ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0036a0 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac01e070 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0094a0 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac003a20 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.444+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc121e60 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.445+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57ac003b80 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.445+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57ac020070 con 0x7f57bc09ad40 2023-10-03T10:13:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.445+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc04f2a0 con 0x7f57bc09ad40 2023-10-03T10:13:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.450+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57ac015070 con 0x7f57bc09ad40 2023-10-03T10:13:58.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.610+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f406c0a2710 con 0x7f406c0a0a70 2023-10-03T10:13:58.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.610+0000 7f4061ffb700 1 -- 172.21.15.125:0/2946231768 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f406802b090 con 0x7f406c0a0a70 2023-10-03T10:13:58.611 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:58.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 msgr2=0x7f406c1c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f406800ec10 tx=0x7f406800ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:58.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 shutdown_connections 2023-10-03T10:13:58.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f406c133f50 0x7f406c1c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f406c0a0a70 0x7f406c1c8270 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 --2- 172.21.15.125:0/2946231768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f406c0a1380 0x7f406c1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 >> 172.21.15.125:0/2946231768 conn(0x7f406c0a6610 msgr2=0x7f406c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 shutdown_connections 2023-10-03T10:13:58.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.612+0000 7f4073313700 1 -- 172.21.15.125:0/2946231768 wait complete. 2023-10-03T10:13:58.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:13:58.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.644+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57bc133d50 con 0x7f57bc09ad40 2023-10-03T10:13:58.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.645+0000 7f57b8ff9700 1 -- 172.21.15.125:0/3241521455 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57ac003e30 con 0x7f57bc09ad40 2023-10-03T10:13:58.645 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:13:58.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 msgr2=0x7f57bc11e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0090b0 tx=0x7f57ac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:58.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 shutdown_connections 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57bc1343a0 0x7f57bc11ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57bc09ad40 0x7f57bc11e410 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 --2- 172.21.15.125:0/3241521455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57bc133f70 0x7f57bc11e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 >> 172.21.15.125:0/3241521455 conn(0x7f57bc099c40 msgr2=0x7f57bc09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 shutdown_connections 2023-10-03T10:13:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.647+0000 7f57c27c1700 1 -- 172.21.15.125:0/3241521455 wait complete. 2023-10-03T10:13:58.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:13:58.692 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:58.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:58.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.827+0000 7f02e745a700 1 Processor -- start 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.827+0000 7f02e745a700 1 -- start start 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e745a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e745a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e745a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e009b110 con 0x7f02e0133f70 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e745a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00a3b60 con 0x7f02e009ad40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e745a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00a2fa0 con 0x7f02e01343a0 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e49f5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f02e0133f70 0x7f02e00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52584/0 (socket says 172.21.15.125:52584) 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e49f5700 1 -- 172.21.15.125:0/882690118 learned_addr learned my addr 172.21.15.125:0/882690118 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e51f6700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02d7fff700 1 -- 172.21.15.125:0/882690118 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501344060 0 0) 0x7f02e009b110 con 0x7f02e0133f70 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02d7fff700 1 -- 172.21.15.125:0/882690118 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02cc0035b0 con 0x7f02e0133f70 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 -- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 msgr2=0x7f02e0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 -- 172.21.15.125:0/882690118 >> v1:172.21.15.125:6789/0 conn(0x7f02e0133f70 legacy=0x7f02e00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 -- 172.21.15.125:0/882690118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e009a280 con 0x7f02e01343a0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e51f6700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.828+0000 7f02e59f7700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e00a1180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009dc0 tx=0x7f02d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee640482173bdbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02d7fff700 1 -- 172.21.15.125:0/882690118 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800e070 con 0x7f02e01343a0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02d7fff700 1 -- 172.21.15.125:0/882690118 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800bb20 con 0x7f02e01343a0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02d7fff700 1 -- 172.21.15.125:0/882690118 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8012430 con 0x7f02e01343a0 2023-10-03T10:13:58.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 -- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 msgr2=0x7f02e00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e00a1180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009dc0 tx=0x7f02d800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 -- 172.21.15.125:0/882690118 shutdown_connections 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e00a1180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 --2- 172.21.15.125:0/882690118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 -- 172.21.15.125:0/882690118 >> 172.21.15.125:0/882690118 conn(0x7f02e0099c40 msgr2=0x7f02e006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 -- 172.21.15.125:0/882690118 shutdown_connections 2023-10-03T10:13:58.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.829+0000 7f02e745a700 1 -- 172.21.15.125:0/882690118 wait complete. 2023-10-03T10:13:58.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.830+0000 7f02e745a700 1 Processor -- start 2023-10-03T10:13:58.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.830+0000 7f02e745a700 1 -- start start 2023-10-03T10:13:58.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e01c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0122450 con 0x7f02e0133f70 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0120d70 con 0x7f02e009ad40 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e745a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e009c870 con 0x7f02e01343a0 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e51f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e49f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e51f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43734/0 (socket says 172.21.15.125:43734) 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e51f6700 1 -- 172.21.15.125:0/2575134285 learned_addr learned my addr 172.21.15.125:0/2575134285 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e49f5700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38632/0 (socket says 172.21.15.125:38632) 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e01c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 -- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 msgr2=0x7f02e011f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 -- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 msgr2=0x7f02e011fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 -- 172.21.15.125:0/2575134285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0094a0 con 0x7f02e01343a0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e51f6700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e49f5700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.831+0000 7f02e59f7700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e01c8080 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02e006b550 tx=0x7f02d8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.832+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8012430 con 0x7f02e01343a0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.832+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8020070 con 0x7f02e01343a0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.832+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d8009a70 con 0x7f02e01343a0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.832+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8003e30 con 0x7f02e01343a0 2023-10-03T10:13:58.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.832+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e009e680 con 0x7f02e01343a0 2023-10-03T10:13:58.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.833+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02d8004040 con 0x7f02e01343a0 2023-10-03T10:13:58.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.833+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f02d8022070 con 0x7f02e01343a0 2023-10-03T10:13:58.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.833+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e004f2a0 con 0x7f02e01343a0 2023-10-03T10:13:58.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.841+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02d801a970 con 0x7f02e01343a0 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 Processor -- start 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 -- start start 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 0x7fed1c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c09dc00 con 0x7fed1c0a1380 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c09ea90 con 0x7fed1c0a0a70 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed234dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c09dec0 con 0x7fed1c134120 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed21a7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.872+0000 7fed20a78700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fed1c0a1380 0x7fed1c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52586/0 (socket says 172.21.15.125:52586) 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed20a78700 1 -- 172.21.15.125:0/1277515872 learned_addr learned my addr 172.21.15.125:0/1277515872 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21279700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 0x7fed1c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed13fff700 1 -- 172.21.15.125:0/1277515872 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531696559 0 0) 0x7fed1c09dc00 con 0x7fed1c0a1380 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed13fff700 1 -- 172.21.15.125:0/1277515872 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed080035b0 con 0x7fed1c0a1380 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21a7a700 1 -- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 msgr2=0x7fed1c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21a7a700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 0x7fed1c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21a7a700 1 -- 172.21.15.125:0/1277515872 >> v1:172.21.15.125:6789/0 conn(0x7fed1c0a1380 legacy=0x7fed1c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21a7a700 1 -- 172.21.15.125:0/1277515872 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c09e6a0 con 0x7fed1c134120 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21279700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 0x7fed1c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed21a7a700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c13bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed14009dc0 tx=0x7fed1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25a2870c8c171904 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed13fff700 1 -- 172.21.15.125:0/1277515872 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400e070 con 0x7fed1c134120 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed13fff700 1 -- 172.21.15.125:0/1277515872 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400bb20 con 0x7fed1c134120 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.873+0000 7fed13fff700 1 -- 172.21.15.125:0/1277515872 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14012430 con 0x7fed1c134120 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 -- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 msgr2=0x7fed1c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c13bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed14009dc0 tx=0x7fed1400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 -- 172.21.15.125:0/1277515872 shutdown_connections 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c13bce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 --2- 172.21.15.125:0/1277515872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a0a70 0x7fed1c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 -- 172.21.15.125:0/1277515872 >> 172.21.15.125:0/1277515872 conn(0x7fed1c0a6610 msgr2=0x7fed1c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 -- 172.21.15.125:0/1277515872 shutdown_connections 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.874+0000 7fed234dd700 1 -- 172.21.15.125:0/1277515872 wait complete. 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.875+0000 7fed234dd700 1 Processor -- start 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.875+0000 7fed234dd700 1 -- start start 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 0x7fed1c1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c125ee0 con 0x7fed1c0a0a70 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c126fd0 con 0x7fed1c0a1380 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c124ac0 con 0x7fed1c134120 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43748/0 (socket says 172.21.15.125:43748) 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed21279700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 0x7fed1c1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 -- 172.21.15.125:0/3206953985 learned_addr learned my addr 172.21.15.125:0/3206953985 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed21a7a700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 -- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 msgr2=0x7fed1c123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 -- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 msgr2=0x7fed1c1228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 0x7fed1c1228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 -- 172.21.15.125:0/3206953985 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180094a0 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed21279700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 0x7fed1c1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed20a78700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c700 tx=0x7fed0c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c005d70 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c0070d0 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.876+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed14009a70 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.877+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c007460 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.877+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c1244e0 con 0x7fed1c0a1380 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.877+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed0c0075c0 con 0x7fed1c0a1380 2023-10-03T10:13:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.877+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed0c03eaa0 con 0x7fed1c0a1380 2023-10-03T10:13:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.878+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c125d30 con 0x7fed1c0a1380 2023-10-03T10:13:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:58.882+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed0c00f260 con 0x7fed1c0a1380 2023-10-03T10:13:59.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.035+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f02e01226f0 con 0x7f02e01343a0 2023-10-03T10:13:59.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.036+0000 7f02d5ffb700 1 -- 172.21.15.125:0/2575134285 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02d8011390 con 0x7f02e01343a0 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 msgr2=0x7f02e01c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e01c8080 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02e006b550 tx=0x7f02d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 shutdown_connections 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02e01343a0 0x7f02e01c8080 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e009ad40 0x7f02e011f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 --2- 172.21.15.125:0/2575134285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e0133f70 0x7f02e011fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 >> 172.21.15.125:0/2575134285 conn(0x7f02e0099c40 msgr2=0x7f02e01bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 shutdown_connections 2023-10-03T10:13:59.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.038+0000 7f02e745a700 1 -- 172.21.15.125:0/2575134285 wait complete. 2023-10-03T10:13:59.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:13:59.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.075+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed1c0a03e0 con 0x7fed1c0a1380 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.075+0000 7fed11ffb700 1 -- 172.21.15.125:0/3206953985 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed0c017020 con 0x7fed1c0a1380 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:13:59.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 msgr2=0x7fed1c122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c700 tx=0x7fed0c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 shutdown_connections 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed1c134120 0x7fed1c123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed1c0a0a70 0x7fed1c1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 --2- 172.21.15.125:0/3206953985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1c0a1380 0x7fed1c122e10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 >> 172.21.15.125:0/3206953985 conn(0x7fed1c0a6610 msgr2=0x7fed1c0a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 shutdown_connections 2023-10-03T10:13:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.078+0000 7fed234dd700 1 -- 172.21.15.125:0/3206953985 wait complete. 2023-10-03T10:13:59.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:13:59.626 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:59.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:59.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.754+0000 7ff40604f700 1 Processor -- start 2023-10-03T10:13:59.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.754+0000 7ff40604f700 1 -- start start 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff40604f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 0x7ff40009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff40604f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff400131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff40604f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40009c970 con 0x7ff400131d70 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff40604f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000a0920 con 0x7ff40009e870 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff40604f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff40009f9c0 con 0x7ff40009f180 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3fffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff400131d70 0x7ff400138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52592/0 (socket says 172.21.15.125:52592) 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3fffff700 1 -- 172.21.15.125:0/4111892079 learned_addr learned my addr 172.21.15.125:0/4111892079 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff400131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3ff7fe700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 0x7ff40009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 -- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 msgr2=0x7ff40009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 0x7ff40009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 -- 172.21.15.125:0/4111892079 >> v1:172.21.15.125:6789/0 conn(0x7ff400131d70 legacy=0x7ff400138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 -- 172.21.15.125:0/4111892079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40009bab0 con 0x7ff40009f180 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3fe7fc700 1 -- 172.21.15.125:0/4111892079 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433388210 0 0) 0x7ff40009c970 con 0x7ff400131d70 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3ff7fe700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 0x7ff40009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.755+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff400131830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009870 tx=0x7ff3f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ddbf1b2ae45679 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff3fe7fc700 1 -- 172.21.15.125:0/4111892079 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4011830 con 0x7ff40009f180 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff3fe7fc700 1 -- 172.21.15.125:0/4111892079 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4011990 con 0x7ff40009f180 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff3fe7fc700 1 -- 172.21.15.125:0/4111892079 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4011d20 con 0x7ff40009f180 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 -- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 msgr2=0x7ff400131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff400131830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009870 tx=0x7ff3f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 -- 172.21.15.125:0/4111892079 shutdown_connections 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff40009e870 0x7ff40009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 --2- 172.21.15.125:0/4111892079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff400131830 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 -- 172.21.15.125:0/4111892079 >> 172.21.15.125:0/4111892079 conn(0x7ff4000a4430 msgr2=0x7ff4000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 -- 172.21.15.125:0/4111892079 shutdown_connections 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.756+0000 7ff40604f700 1 -- 172.21.15.125:0/4111892079 wait complete. 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.757+0000 7ff40604f700 1 Processor -- start 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.757+0000 7ff40604f700 1 -- start start 2023-10-03T10:13:59.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40009e870 0x7ff4001c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff400131d70 0x7ff4001c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40011e6f0 con 0x7ff40009e870 2023-10-03T10:13:59.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40011e8d0 con 0x7ff400131d70 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff40604f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff40011c2a0 con 0x7ff40009f180 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff400131d70 0x7ff4001c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39498/0 (socket says 172.21.15.125:39498) 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 -- 172.21.15.125:0/4068972063 learned_addr learned my addr 172.21.15.125:0/4068972063 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3ff7fe700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40009e870 0x7ff4001c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 -- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff400131d70 msgr2=0x7ff4001c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff400131d70 0x7ff4001c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 -- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40009e870 msgr2=0x7ff4001c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40009e870 0x7ff4001c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 -- 172.21.15.125:0/4068972063 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00094a0 con 0x7ff40009f180 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.758+0000 7ff3feffd700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40090b0 tx=0x7ff3f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4004550 con 0x7ff40009f180 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f401f070 con 0x7ff40009f180 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f40094a0 con 0x7ff40009f180 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40038e0 con 0x7ff40009f180 2023-10-03T10:13:59.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40011db80 con 0x7ff40009f180 2023-10-03T10:13:59.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3f4003a40 con 0x7ff40009f180 2023-10-03T10:13:59.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.759+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3f4021070 con 0x7ff40009f180 2023-10-03T10:13:59.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.760+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4001c39c0 con 0x7ff40009f180 2023-10-03T10:13:59.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.765+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3f402b020 con 0x7ff40009f180 2023-10-03T10:13:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.802+0000 7f2550a77700 1 Processor -- start 2023-10-03T10:13:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.802+0000 7f2550a77700 1 -- start start 2023-10-03T10:13:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2550a77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2550a77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2550a77700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c09c970 con 0x7f254c09e870 2023-10-03T10:13:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2550a77700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0a0920 con 0x7f254c09f350 2023-10-03T10:13:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2550a77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f254c09f9c0 con 0x7f254c1371c0 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f254c09e870 0x7f254c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52598/0 (socket says 172.21.15.125:52598) 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254a59c700 1 -- 172.21.15.125:0/930266229 learned_addr learned my addr 172.21.15.125:0/930266229 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2549d9b700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 -- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 msgr2=0x7f254c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 -- 172.21.15.125:0/930266229 >> v1:172.21.15.125:6789/0 conn(0x7f254c09e870 legacy=0x7f254c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254959a700 1 -- 172.21.15.125:0/930266229 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796873638 0 0) 0x7f254c09c970 con 0x7f254c09e870 2023-10-03T10:13:59.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 -- 172.21.15.125:0/930266229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c09bab0 con 0x7f254c1371c0 2023-10-03T10:13:59.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f2549d9b700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.803+0000 7f254ad9d700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c1395a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2544009dc0 tx=0x7f254400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676559e7404ee413 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f254959a700 1 -- 172.21.15.125:0/930266229 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400e070 con 0x7f254c1371c0 2023-10-03T10:13:59.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f254959a700 1 -- 172.21.15.125:0/930266229 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400bb20 con 0x7f254c1371c0 2023-10-03T10:13:59.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f254959a700 1 -- 172.21.15.125:0/930266229 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544012430 con 0x7f254c1371c0 2023-10-03T10:13:59.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 -- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 msgr2=0x7f254c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c1395a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2544009dc0 tx=0x7f254400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 -- 172.21.15.125:0/930266229 shutdown_connections 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c1395a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 --2- 172.21.15.125:0/930266229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 -- 172.21.15.125:0/930266229 >> 172.21.15.125:0/930266229 conn(0x7f254c0a4430 msgr2=0x7f254c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 -- 172.21.15.125:0/930266229 shutdown_connections 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.804+0000 7f2550a77700 1 -- 172.21.15.125:0/930266229 wait complete. 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.805+0000 7f2550a77700 1 Processor -- start 2023-10-03T10:13:59.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.805+0000 7f2550a77700 1 -- start start 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c09e870 0x7f254c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c06cd80 con 0x7f254c09e870 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c126370 con 0x7f254c09f350 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2550a77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f254c06d4c0 con 0x7f254c1371c0 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43770/0 (socket says 172.21.15.125:43770) 2023-10-03T10:13:59.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 -- 172.21.15.125:0/337308758 learned_addr learned my addr 172.21.15.125:0/337308758 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f254a59c700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c09e870 0x7f254c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f254ad9d700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 -- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 msgr2=0x7f254c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 -- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c09e870 msgr2=0x7f254c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c09e870 0x7f254c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 -- 172.21.15.125:0/337308758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400094a0 con 0x7f254c09f350 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.806+0000 7f2549d9b700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f254000ebe0 tx=0x7f254000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.807+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000c850 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.807+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000c9b0 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.807+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2544009a70 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.807+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000cd40 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.807+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c125dd0 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.808+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2540013470 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.808+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c04f2a0 con 0x7f254c09f350 2023-10-03T10:13:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.808+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f254003faf0 con 0x7f254c09f350 2023-10-03T10:13:59.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.812+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2540013aa0 con 0x7f254c09f350 2023-10-03T10:13:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.967+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff40004f2a0 con 0x7ff40009f180 2023-10-03T10:13:59.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.967+0000 7ff3e7fff700 1 -- 172.21.15.125:0/4068972063 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3f401a430 con 0x7ff40009f180 2023-10-03T10:13:59.968 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:13:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 msgr2=0x7ff4001c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40090b0 tx=0x7ff3f4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 shutdown_connections 2023-10-03T10:13:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff400131d70 0x7ff4001c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40009e870 0x7ff4001c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 --2- 172.21.15.125:0/4068972063 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff40009f180 0x7ff4001c3480 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.969+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 >> 172.21.15.125:0/4068972063 conn(0x7ff4000a4430 msgr2=0x7ff40012fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.970+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 shutdown_connections 2023-10-03T10:13:59.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:13:59.970+0000 7ff40604f700 1 -- 172.21.15.125:0/4068972063 wait complete. 2023-10-03T10:13:59.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:00.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.003+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f254c124c50 con 0x7f254c09f350 2023-10-03T10:14:00.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.003+0000 7f253affd700 1 -- 172.21.15.125:0/337308758 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2540017070 con 0x7f254c09f350 2023-10-03T10:14:00.004 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:00.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.005+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 msgr2=0x7f254c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.005+0000 7f2550a77700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f254000ebe0 tx=0x7f254000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 shutdown_connections 2023-10-03T10:14:00.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f254c1371c0 0x7f254c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c09e870 0x7f254c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 --2- 172.21.15.125:0/337308758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f254c09f350 0x7f254c06bdf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 >> 172.21.15.125:0/337308758 conn(0x7f254c0a4430 msgr2=0x7f254c0a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 shutdown_connections 2023-10-03T10:14:00.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.006+0000 7f2550a77700 1 -- 172.21.15.125:0/337308758 wait complete. 2023-10-03T10:14:00.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:00.051 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:00.091 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:00.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 Processor -- start 2023-10-03T10:14:00.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 -- start start 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 0x7f4d601343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600a3b60 con 0x7f4d60133f70 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601348e0 con 0x7f4d600a0a70 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d6608d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6009b110 con 0x7f4d6009ad40 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43778/0 (socket says 172.21.15.125:43778) 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5ffff700 1 -- 172.21.15.125:0/187110261 learned_addr learned my addr 172.21.15.125:0/187110261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39518/0 (socket says 172.21.15.125:39518) 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 0x7f4d601343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.185+0000 7f4d5ffff700 1 -- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 msgr2=0x7f4d60133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5ffff700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5ffff700 1 -- 172.21.15.125:0/187110261 >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 msgr2=0x7f4d601343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5ffff700 1 --2- 172.21.15.125:0/187110261 >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 0x7f4d601343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5ffff700 1 -- 172.21.15.125:0/187110261 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600a2fa0 con 0x7f4d600a0a70 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5f7fe700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5effd700 1 --2- 172.21.15.125:0/187110261 >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 0x7f4d601343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5ffff700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009e50 tx=0x7f4d5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca5eae3bf28a716a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5e7fc700 1 -- 172.21.15.125:0/187110261 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800e070 con 0x7f4d600a0a70 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5e7fc700 1 -- 172.21.15.125:0/187110261 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5800b910 con 0x7f4d600a0a70 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d5e7fc700 1 -- 172.21.15.125:0/187110261 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800bcc0 con 0x7f4d600a0a70 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 -- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 msgr2=0x7f4d600a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009e50 tx=0x7f4d5800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 -- 172.21.15.125:0/187110261 shutdown_connections 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d600a0a70 0x7f4d600a0ed0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 --2- 172.21.15.125:0/187110261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d6009ad40 0x7f4d60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 --2- 172.21.15.125:0/187110261 >> v2:172.21.15.125:3300/0 conn(0x7f4d60133f70 0x7f4d601343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.186+0000 7f4d6608d700 1 -- 172.21.15.125:0/187110261 >> 172.21.15.125:0/187110261 conn(0x7f4d60099c40 msgr2=0x7f4d6006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.187+0000 7f4d6608d700 1 -- 172.21.15.125:0/187110261 shutdown_connections 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.187+0000 7f4d6608d700 1 -- 172.21.15.125:0/187110261 wait complete. 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.187+0000 7f4d6608d700 1 Processor -- start 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 -- start start 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d60133f70 0x7f4d60121e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60122880 con 0x7f4d60133f70 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60132780 con 0x7f4d6009ad40 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d6608d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60123e50 con 0x7f4d600a0a70 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43788/0 (socket says 172.21.15.125:43788) 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39524/0 (socket says 172.21.15.125:39524) 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5f7fe700 1 -- 172.21.15.125:0/2729183607 learned_addr learned my addr 172.21.15.125:0/2729183607 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5ffff700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d60133f70 0x7f4d60121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.188+0000 7f4d5effd700 1 -- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 msgr2=0x7f4d601213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5effd700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5effd700 1 -- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d60133f70 msgr2=0x7f4d60121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5effd700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d60133f70 0x7f4d60121e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5effd700 1 -- 172.21.15.125:0/2729183607 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500094a0 con 0x7f4d600a0a70 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5f7fe700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d5effd700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400e9b0 tx=0x7f4d5400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400ee50 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400c850 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540094a0 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400cbe0 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.189+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d58009b30 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.190+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d5400cd40 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.190+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d5403f630 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.190+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6009d360 con 0x7f4d600a0a70 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.195+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d540232f0 con 0x7f4d600a0a70 2023-10-03T10:14:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.227+0000 7f0adef9d700 1 Processor -- start 2023-10-03T10:14:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 -- start start 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80a2640 con 0x7f0ad8133de0 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad809dde0 con 0x7f0ad80a1280 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0adef9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80a2820 con 0x7f0ad80a0970 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0add79a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43798/0 (socket says 172.21.15.125:43798) 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0ade79c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ad8133de0 0x7f0ad813ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52600/0 (socket says 172.21.15.125:52600) 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0addf9b700 1 -- 172.21.15.125:0/2127603786 learned_addr learned my addr 172.21.15.125:0/2127603786 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.228+0000 7f0add79a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38682/0 (socket says 172.21.15.125:38682) 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0addf9b700 1 -- 172.21.15.125:0/2127603786 >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 msgr2=0x7f0ad81338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0addf9b700 1 --2- 172.21.15.125:0/2127603786 >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0addf9b700 1 -- 172.21.15.125:0/2127603786 >> v1:172.21.15.125:6789/0 conn(0x7f0ad8133de0 legacy=0x7f0ad813ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0addf9b700 1 -- 172.21.15.125:0/2127603786 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80a2330 con 0x7f0ad80a0970 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adcf99700 1 -- 172.21.15.125:0/2127603786 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294941119 0 0) 0x7f0ad80a2640 con 0x7f0ad8133de0 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0add79a700 1 --2- 172.21.15.125:0/2127603786 >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0addf9b700 1 --2- 172.21.15.125:0/2127603786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098f0 tx=0x7f0ad4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3133cb87bcdb31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adcf99700 1 -- 172.21.15.125:0/2127603786 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4011830 con 0x7f0ad80a0970 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adcf99700 1 -- 172.21.15.125:0/2127603786 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4011990 con 0x7f0ad80a0970 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adcf99700 1 -- 172.21.15.125:0/2127603786 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4011d20 con 0x7f0ad80a0970 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 -- 172.21.15.125:0/2127603786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 msgr2=0x7f0ad80a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 --2- 172.21.15.125:0/2127603786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098f0 tx=0x7f0ad4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 -- 172.21.15.125:0/2127603786 shutdown_connections 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 --2- 172.21.15.125:0/2127603786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a0970 0x7f0ad80a0d40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 --2- 172.21.15.125:0/2127603786 >> v2:172.21.15.125:3300/0 conn(0x7f0ad80a1280 0x7f0ad81338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.229+0000 7f0adef9d700 1 -- 172.21.15.125:0/2127603786 >> 172.21.15.125:0/2127603786 conn(0x7f0ad80a6070 msgr2=0x7f0ad80a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.230+0000 7f0adef9d700 1 -- 172.21.15.125:0/2127603786 shutdown_connections 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.230+0000 7f0adef9d700 1 -- 172.21.15.125:0/2127603786 wait complete. 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.230+0000 7f0adef9d700 1 Processor -- start 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.230+0000 7f0adef9d700 1 -- start start 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a1280 0x7f0ad811fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8122d60 con 0x7f0ad80a0970 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8123e50 con 0x7f0ad80a1280 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0adef9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8122f90 con 0x7f0ad8133de0 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39526/0 (socket says 172.21.15.125:39526) 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38694/0 (socket says 172.21.15.125:38694) 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 -- 172.21.15.125:0/3581679117 learned_addr learned my addr 172.21.15.125:0/3581679117 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0add79a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a1280 0x7f0ad811fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 -- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a1280 msgr2=0x7f0ad811fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a1280 0x7f0ad811fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 -- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 msgr2=0x7f0ad811f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 -- 172.21.15.125:0/3581679117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80094a0 con 0x7f0ad8133de0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0addf9b700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.231+0000 7f0ade79c700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000cc70 tx=0x7f0ad000cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.232+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000aac0 con 0x7f0ad8133de0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.232+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad000ac40 con 0x7f0ad8133de0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.232+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad4009550 con 0x7f0ad8133de0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.232+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00070d0 con 0x7f0ad8133de0 2023-10-03T10:14:00.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.232+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81302e0 con 0x7f0ad8133de0 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.233+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad804f2a0 con 0x7f0ad8133de0 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.233+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ad0007250 con 0x7f0ad8133de0 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.233+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ad003f4f0 con 0x7f0ad8133de0 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.238+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad0007500 con 0x7f0ad8133de0 2023-10-03T10:14:00.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.390+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d6009c7e0 con 0x7f4d600a0a70 2023-10-03T10:14:00.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.390+0000 7f4d47fff700 1 -- 172.21.15.125:0/2729183607 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d54021030 con 0x7f4d600a0a70 2023-10-03T10:14:00.391 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 msgr2=0x7f4d601218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400e9b0 tx=0x7f4d5400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 shutdown_connections 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d60133f70 0x7f4d60121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d6009ad40 0x7f4d601213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 --2- 172.21.15.125:0/2729183607 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d600a0a70 0x7f4d601218f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 >> 172.21.15.125:0/2729183607 conn(0x7f4d60099c40 msgr2=0x7f4d60132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 shutdown_connections 2023-10-03T10:14:00.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.393+0000 7f4d6608d700 1 -- 172.21.15.125:0/2729183607 wait complete. 2023-10-03T10:14:00.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:00.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.432+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ad809bdc0 con 0x7f0ad8133de0 2023-10-03T10:14:00.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.433+0000 7f0ace7fc700 1 -- 172.21.15.125:0/3581679117 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ad0018020 con 0x7f0ad8133de0 2023-10-03T10:14:00.433 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:00.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.434+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 msgr2=0x7f0ad81202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.434+0000 7f0adef9d700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000cc70 tx=0x7f0ad000cf80 comp rx=0 tx=0).stop 2023-10-03T10:14:00.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 shutdown_connections 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ad8133de0 0x7f0ad81202a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad80a0970 0x7f0ad811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 --2- 172.21.15.125:0/3581679117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ad80a1280 0x7f0ad811fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 >> 172.21.15.125:0/3581679117 conn(0x7f0ad80a6070 msgr2=0x7f0ad80a3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 shutdown_connections 2023-10-03T10:14:00.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:00.435+0000 7f0adef9d700 1 -- 172.21.15.125:0/3581679117 wait complete. 2023-10-03T10:14:00.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:00.984 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:01.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:01.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 Processor -- start 2023-10-03T10:14:01.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 -- start start 2023-10-03T10:14:01.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 0x7fcdfc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc09b110 con 0x7fcdfc0a0a70 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0a3b60 con 0x7fcdfc133f70 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce0426c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1348e0 con 0x7fcdfc09ad40 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce01807700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.115+0000 7fce02008700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 0x7fcdfc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02809700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcdfc0a0a70 0x7fcdfc0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52610/0 (socket says 172.21.15.125:52610) 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01807700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38710/0 (socket says 172.21.15.125:38710) 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02809700 1 -- 172.21.15.125:0/1948305796 learned_addr learned my addr 172.21.15.125:0/1948305796 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:01.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02008700 1 -- 172.21.15.125:0/1948305796 >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 msgr2=0x7fcdfc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02008700 1 --2- 172.21.15.125:0/1948305796 >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02008700 1 -- 172.21.15.125:0/1948305796 >> v1:172.21.15.125:6789/0 conn(0x7fcdfc0a0a70 legacy=0x7fcdfc0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02008700 1 -- 172.21.15.125:0/1948305796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0a2fa0 con 0x7fcdfc09ad40 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01006700 1 -- 172.21.15.125:0/1948305796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887988127 0 0) 0x7fcdfc09b110 con 0x7fcdfc0a0a70 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01807700 1 --2- 172.21.15.125:0/1948305796 >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce02008700 1 --2- 172.21.15.125:0/1948305796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 0x7fcdfc133a30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009870 tx=0x7fcdf8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da5128b0234b84f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01006700 1 -- 172.21.15.125:0/1948305796 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8011830 con 0x7fcdfc09ad40 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01006700 1 -- 172.21.15.125:0/1948305796 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf8011990 con 0x7fcdfc09ad40 2023-10-03T10:14:01.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.116+0000 7fce01006700 1 -- 172.21.15.125:0/1948305796 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8011d20 con 0x7fcdfc09ad40 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 -- 172.21.15.125:0/1948305796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 msgr2=0x7fcdfc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 --2- 172.21.15.125:0/1948305796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 0x7fcdfc133a30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009870 tx=0x7fcdf8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 -- 172.21.15.125:0/1948305796 shutdown_connections 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 --2- 172.21.15.125:0/1948305796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc09ad40 0x7fcdfc133a30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 --2- 172.21.15.125:0/1948305796 >> v2:172.21.15.125:3300/0 conn(0x7fcdfc133f70 0x7fcdfc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 -- 172.21.15.125:0/1948305796 >> 172.21.15.125:0/1948305796 conn(0x7fcdfc099c40 msgr2=0x7fcdfc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 -- 172.21.15.125:0/1948305796 shutdown_connections 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.117+0000 7fce0426c700 1 -- 172.21.15.125:0/1948305796 wait complete. 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 Processor -- start 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 -- start start 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 0x7fcdfc11f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 0x7fcdfc1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc122600 con 0x7fcdfc09ad40 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1336c0 con 0x7fcdfc133f70 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.118+0000 7fce0426c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc120180 con 0x7fcdfc0a0a70 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce01807700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 0x7fcdfc1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce01807700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39536/0 (socket says 172.21.15.125:39536) 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce01807700 1 -- 172.21.15.125:0/830970620 learned_addr learned my addr 172.21.15.125:0/830970620 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02008700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 0x7fcdfc11f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 -- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 msgr2=0x7fcdfc11fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 -- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 msgr2=0x7fcdfc11f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 0x7fcdfc11f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 -- 172.21.15.125:0/830970620 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0094a0 con 0x7fcdfc133f70 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce01807700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02008700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 0x7fcdfc11f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:01.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.119+0000 7fce02809700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 0x7fcdfc1c8330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400cbe0 tx=0x7fcdf400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.122+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400aaf0 con 0x7fcdfc133f70 2023-10-03T10:14:01.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.122+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf400ac70 con 0x7fcdfc133f70 2023-10-03T10:14:01.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.122+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40070d0 con 0x7fcdfc133f70 2023-10-03T10:14:01.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.122+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80094a0 con 0x7fcdfc133f70 2023-10-03T10:14:01.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.122+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc1228a0 con 0x7fcdfc133f70 2023-10-03T10:14:01.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.123+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdf4007230 con 0x7fcdfc133f70 2023-10-03T10:14:01.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.123+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc09c7e0 con 0x7fcdfc133f70 2023-10-03T10:14:01.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.123+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcdf403f020 con 0x7fcdfc133f70 2023-10-03T10:14:01.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.128+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdf4019680 con 0x7fcdfc133f70 2023-10-03T10:14:01.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.155+0000 7f4738dd0700 1 Processor -- start 2023-10-03T10:14:01.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.155+0000 7f4738dd0700 1 -- start start 2023-10-03T10:14:01.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4738dd0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 0x7f4734138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4738dd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4738dd0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473409e9d0 con 0x7f47340a0a70 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4738dd0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473409dc00 con 0x7f47340a1550 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4738dd0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473409dec0 con 0x7f4734139200 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f47340a0a70 0x7f47340a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52622/0 (socket says 172.21.15.125:52622) 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43834/0 (socket says 172.21.15.125:43834) 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473259c700 1 -- 172.21.15.125:0/3175161267 learned_addr learned my addr 172.21.15.125:0/3175161267 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:01.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4731d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 0x7f4734138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 -- 172.21.15.125:0/3175161267 >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 msgr2=0x7f4734138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 --2- 172.21.15.125:0/3175161267 >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 0x7f4734138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 -- 172.21.15.125:0/3175161267 >> v1:172.21.15.125:6789/0 conn(0x7f47340a0a70 legacy=0x7f47340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 -- 172.21.15.125:0/3175161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473409e6a0 con 0x7f4734139200 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473159a700 1 -- 172.21.15.125:0/3175161267 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910964932 0 0) 0x7f473409e9d0 con 0x7f47340a0a70 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4731d9b700 1 --2- 172.21.15.125:0/3175161267 >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 0x7f4734138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f4732d9d700 1 --2- 172.21.15.125:0/3175161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f472c009d90 tx=0x7f472c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f5b5641cd8e6c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473159a700 1 -- 172.21.15.125:0/3175161267 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00e070 con 0x7f4734139200 2023-10-03T10:14:01.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473159a700 1 -- 172.21.15.125:0/3175161267 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00bb20 con 0x7f4734139200 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.156+0000 7f473159a700 1 -- 172.21.15.125:0/3175161267 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c012430 con 0x7f4734139200 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 -- 172.21.15.125:0/3175161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 msgr2=0x7f473413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 --2- 172.21.15.125:0/3175161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f472c009d90 tx=0x7f472c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 -- 172.21.15.125:0/3175161267 shutdown_connections 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 --2- 172.21.15.125:0/3175161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f473413b5e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 --2- 172.21.15.125:0/3175161267 >> v2:172.21.15.125:3300/0 conn(0x7f47340a1550 0x7f4734138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 -- 172.21.15.125:0/3175161267 >> 172.21.15.125:0/3175161267 conn(0x7f47340a6610 msgr2=0x7f47340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 -- 172.21.15.125:0/3175161267 shutdown_connections 2023-10-03T10:14:01.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.157+0000 7f4738dd0700 1 -- 172.21.15.125:0/3175161267 wait complete. 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.158+0000 7f4738dd0700 1 Processor -- start 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.158+0000 7f4738dd0700 1 -- start start 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 0x7f4734120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f4734121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341243c0 con 0x7f47340a0a70 2023-10-03T10:14:01.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340a03e0 con 0x7f4734139200 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47341224b0 con 0x7f47340a1550 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38742/0 (socket says 172.21.15.125:38742) 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 -- 172.21.15.125:0/4044758968 learned_addr learned my addr 172.21.15.125:0/4044758968 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4732d9d700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f4734121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4731d9b700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 0x7f4734120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 -- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 msgr2=0x7f4734120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 0x7f4734120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 -- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 msgr2=0x7f4734121320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f4734121320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 -- 172.21.15.125:0/4044758968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094a0 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4732d9d700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f4734121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4731d9b700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 0x7f4734120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f473259c700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f472400c520 tx=0x7f472400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724004c80 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724004e00 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c009a70 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724007310 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.159+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473409c560 con 0x7f47340a0a70 2023-10-03T10:14:01.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.160+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4724007470 con 0x7f47340a0a70 2023-10-03T10:14:01.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.160+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f472403f320 con 0x7f47340a0a70 2023-10-03T10:14:01.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.161+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47340a2700 con 0x7f47340a0a70 2023-10-03T10:14:01.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.165+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47240123b0 con 0x7f47340a0a70 2023-10-03T10:14:01.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.321+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdfc1228a0 con 0x7fcdfc133f70 2023-10-03T10:14:01.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.321+0000 7fcdf2ffd700 1 -- 172.21.15.125:0/830970620 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdfc1228a0 con 0x7fcdfc133f70 2023-10-03T10:14:01.322 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:01.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 msgr2=0x7fcdfc1c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 0x7fcdfc1c8330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400cbe0 tx=0x7fcdf400cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 shutdown_connections 2023-10-03T10:14:01.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdfc133f70 0x7fcdfc1c8330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdfc09ad40 0x7fcdfc11f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 --2- 172.21.15.125:0/830970620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdfc0a0a70 0x7fcdfc11fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 >> 172.21.15.125:0/830970620 conn(0x7fcdfc099c40 msgr2=0x7fcdfc1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 shutdown_connections 2023-10-03T10:14:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.323+0000 7fce0426c700 1 -- 172.21.15.125:0/830970620 wait complete. 2023-10-03T10:14:01.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:01.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.357+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f473406ccf0 con 0x7f47340a0a70 2023-10-03T10:14:01.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.358+0000 7f4722ffd700 1 -- 172.21.15.125:0/4044758968 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4724011360 con 0x7f47340a0a70 2023-10-03T10:14:01.358 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:01.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 msgr2=0x7f47341208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f472400c520 tx=0x7f472400c830 comp rx=0 tx=0).stop 2023-10-03T10:14:01.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 shutdown_connections 2023-10-03T10:14:01.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4734139200 0x7f4734121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47340a0a70 0x7f47341208a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 --2- 172.21.15.125:0/4044758968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f47340a1550 0x7f4734120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 >> 172.21.15.125:0/4044758968 conn(0x7f47340a6610 msgr2=0x7f4734136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 shutdown_connections 2023-10-03T10:14:01.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.360+0000 7f4738dd0700 1 -- 172.21.15.125:0/4044758968 wait complete. 2023-10-03T10:14:01.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:01.407 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:01.448 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:01.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.537+0000 7f690f6ba700 1 Processor -- start 2023-10-03T10:14:01.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.537+0000 7f690f6ba700 1 -- start start 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6908133f70 0x7f69081343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69080a3b60 con 0x7f6908133f70 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69081348e0 con 0x7f69080a0a70 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690f6ba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690809b110 con 0x7f690809ad40 2023-10-03T10:14:01.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690dc57700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690d456700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6908133f70 0x7f69081343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690d456700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39566/0 (socket says 172.21.15.125:39566) 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690dc57700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43850/0 (socket says 172.21.15.125:43850) 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690d456700 1 -- 172.21.15.125:0/1108484133 learned_addr learned my addr 172.21.15.125:0/1108484133 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 -- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 msgr2=0x7f6908133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 -- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 msgr2=0x7f69080a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690cc55700 1 -- 172.21.15.125:0/1108484133 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080a2fa0 con 0x7f6908133f70 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690dc57700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.538+0000 7f690d456700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690cc55700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6908133f70 0x7f69081343a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009870 tx=0x7f68f8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aa3bcbd5d06ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f68fffff700 1 -- 172.21.15.125:0/1108484133 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8011830 con 0x7f6908133f70 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f68fffff700 1 -- 172.21.15.125:0/1108484133 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8011990 con 0x7f6908133f70 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f68fffff700 1 -- 172.21.15.125:0/1108484133 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8011d20 con 0x7f6908133f70 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 -- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6908133f70 msgr2=0x7f69081343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6908133f70 0x7f69081343a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009870 tx=0x7f68f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 -- 172.21.15.125:0/1108484133 shutdown_connections 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69080a0a70 0x7f69080a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f690809ad40 0x7f6908133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1108484133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6908133f70 0x7f69081343a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 -- 172.21.15.125:0/1108484133 >> 172.21.15.125:0/1108484133 conn(0x7f6908099c40 msgr2=0x7f690806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 -- 172.21.15.125:0/1108484133 shutdown_connections 2023-10-03T10:14:01.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.539+0000 7f690f6ba700 1 -- 172.21.15.125:0/1108484133 wait complete. 2023-10-03T10:14:01.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.540+0000 7f690f6ba700 1 Processor -- start 2023-10-03T10:14:01.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.540+0000 7f690f6ba700 1 -- start start 2023-10-03T10:14:01.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 0x7f690811f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6908122490 con 0x7f69080a0a70 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6908122670 con 0x7f690809ad40 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690f6ba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69081334e0 con 0x7f6908133f70 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690cc55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39580/0 (socket says 172.21.15.125:39580) 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690cc55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38756/0 (socket says 172.21.15.125:38756) 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 -- 172.21.15.125:0/1948828196 learned_addr learned my addr 172.21.15.125:0/1948828196 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690d456700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 0x7f690811f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 -- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 msgr2=0x7f690811f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 0x7f690811f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 -- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 msgr2=0x7f690811fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 -- 172.21.15.125:0/1948828196 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009550 con 0x7f6908133f70 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690cc55700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690d456700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 0x7f690811f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.541+0000 7f690dc57700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6900009f00 tx=0x7f690000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900009d70 con 0x7f6908133f70 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000f040 con 0x7f6908133f70 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000cd60 con 0x7f6908133f70 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6900009a70 con 0x7f6908133f70 2023-10-03T10:14:01.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f80094a0 con 0x7f6908133f70 2023-10-03T10:14:01.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.542+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6900014480 con 0x7f6908133f70 2023-10-03T10:14:01.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.543+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f690003fca0 con 0x7f6908133f70 2023-10-03T10:14:01.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.543+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690809c7e0 con 0x7f6908133f70 2023-10-03T10:14:01.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.551+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6900012930 con 0x7f6908133f70 2023-10-03T10:14:01.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.583+0000 7f8b67fb5700 1 Processor -- start 2023-10-03T10:14:01.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 -- start start 2023-10-03T10:14:01.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 0x7f8b60136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6009c970 con 0x7f8b6009e870 2023-10-03T10:14:01.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600a0920 con 0x7f8b601371c0 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b67fb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6009f9c0 con 0x7f8b6009f350 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b65d51700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8b6009e870 0x7f8b6009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52624/0 (socket says 172.21.15.125:52624) 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b65d51700 1 -- 172.21.15.125:0/543581425 learned_addr learned my addr 172.21.15.125:0/543581425 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b66552700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b65550700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 0x7f8b60136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b64d4f700 1 -- 172.21.15.125:0/543581425 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369666297 0 0) 0x7f8b6009c970 con 0x7f8b6009e870 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b64d4f700 1 -- 172.21.15.125:0/543581425 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c0035b0 con 0x7f8b6009e870 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b66552700 1 -- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 msgr2=0x7f8b60136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b66552700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 0x7f8b60136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.584+0000 7f8b66552700 1 -- 172.21.15.125:0/543581425 >> v1:172.21.15.125:6789/0 conn(0x7f8b6009e870 legacy=0x7f8b6009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b66552700 1 -- 172.21.15.125:0/543581425 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6009bab0 con 0x7f8b601371c0 2023-10-03T10:14:01.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b65550700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 0x7f8b60136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b66552700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601395a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009dc0 tx=0x7f8b5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dada23bfe35d067a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b64d4f700 1 -- 172.21.15.125:0/543581425 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800e070 con 0x7f8b601371c0 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b64d4f700 1 -- 172.21.15.125:0/543581425 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800bb20 con 0x7f8b601371c0 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b64d4f700 1 -- 172.21.15.125:0/543581425 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58012430 con 0x7f8b601371c0 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 -- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 msgr2=0x7f8b601395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601395a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009dc0 tx=0x7f8b5800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 -- 172.21.15.125:0/543581425 shutdown_connections 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601395a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/543581425 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009f350 0x7f8b60136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 -- 172.21.15.125:0/543581425 >> 172.21.15.125:0/543581425 conn(0x7f8b600a4430 msgr2=0x7f8b600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.585+0000 7f8b67fb5700 1 -- 172.21.15.125:0/543581425 shutdown_connections 2023-10-03T10:14:01.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.586+0000 7f8b67fb5700 1 -- 172.21.15.125:0/543581425 wait complete. 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.586+0000 7f8b67fb5700 1 Processor -- start 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.586+0000 7f8b67fb5700 1 -- start start 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009e870 0x7f8b60120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601213c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60124460 con 0x7f8b6009f350 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60072220 con 0x7f8b601371c0 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b67fb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6009dba0 con 0x7f8b6009e870 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38764/0 (socket says 172.21.15.125:38764) 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 -- 172.21.15.125:0/1046088760 learned_addr learned my addr 172.21.15.125:0/1046088760 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:01.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b66552700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601213c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65d51700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009e870 0x7f8b60120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 -- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009e870 msgr2=0x7f8b60120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009e870 0x7f8b60120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 -- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 msgr2=0x7f8b601213c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601213c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 -- 172.21.15.125:0/1046088760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500094a0 con 0x7f8b6009f350 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b66552700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601213c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.587+0000 7f8b65550700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000ebe0 tx=0x7f8b5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000c850 con 0x7f8b6009f350 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5000c9b0 con 0x7f8b6009f350 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b58009a70 con 0x7f8b6009f350 2023-10-03T10:14:01.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000cd40 con 0x7f8b6009f350 2023-10-03T10:14:01.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60123ec0 con 0x7f8b6009f350 2023-10-03T10:14:01.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.588+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b50013470 con 0x7f8b6009f350 2023-10-03T10:14:01.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.589+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b5003f810 con 0x7f8b6009f350 2023-10-03T10:14:01.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.589+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6009d7a0 con 0x7f8b6009f350 2023-10-03T10:14:01.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.597+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b50021080 con 0x7f8b6009f350 2023-10-03T10:14:01.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.747+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f690804f2a0 con 0x7f6908133f70 2023-10-03T10:14:01.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.747+0000 7f68fdffb700 1 -- 172.21.15.125:0/1948828196 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f690002a090 con 0x7f6908133f70 2023-10-03T10:14:01.748 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:01.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.750+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 msgr2=0x7f69081c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.750+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6900009f00 tx=0x7f690000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.750+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 shutdown_connections 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.750+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6908133f70 0x7f69081c8300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.751+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f690809ad40 0x7f690811f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.751+0000 7f690f6ba700 1 --2- 172.21.15.125:0/1948828196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69080a0a70 0x7f690811fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.751+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 >> 172.21.15.125:0/1948828196 conn(0x7f6908099c40 msgr2=0x7f69081bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.751+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 shutdown_connections 2023-10-03T10:14:01.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.751+0000 7f690f6ba700 1 -- 172.21.15.125:0/1948828196 wait complete. 2023-10-03T10:14:01.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:01.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.796+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b6004f2a0 con 0x7f8b6009f350 2023-10-03T10:14:01.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.796+0000 7f8b567fc700 1 -- 172.21.15.125:0/1046088760 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b50013720 con 0x7f8b6009f350 2023-10-03T10:14:01.797 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 msgr2=0x7f8b60120e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000ebe0 tx=0x7f8b5000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 shutdown_connections 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b601371c0 0x7f8b601213c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8b6009e870 0x7f8b60120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 --2- 172.21.15.125:0/1046088760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b6009f350 0x7f8b60120e80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 >> 172.21.15.125:0/1046088760 conn(0x7f8b600a4430 msgr2=0x7f8b600a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 shutdown_connections 2023-10-03T10:14:01.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:01.798+0000 7f8b67fb5700 1 -- 172.21.15.125:0/1046088760 wait complete. 2023-10-03T10:14:01.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:02.337 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:02.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:02.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 Processor -- start 2023-10-03T10:14:02.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 -- start start 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a40a1380 0x7f13a4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a409dc00 con 0x7f13a4133f50 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a409ea60 con 0x7f13a40a1380 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a9f60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a409dec0 con 0x7f13a40a0a70 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a40a1380 0x7f13a4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13a4133f50 0x7f13a413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52630/0 (socket says 172.21.15.125:52630) 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a40a1380 0x7f13a4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38780/0 (socket says 172.21.15.125:38780) 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.465+0000 7f13a3fff700 1 -- 172.21.15.125:0/2286762530 learned_addr learned my addr 172.21.15.125:0/2286762530 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:02.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a2ffd700 1 -- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 msgr2=0x7f13a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a2ffd700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a2ffd700 1 -- 172.21.15.125:0/2286762530 >> v1:172.21.15.125:6789/0 conn(0x7f13a4133f50 legacy=0x7f13a413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a2ffd700 1 -- 172.21.15.125:0/2286762530 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a409e6a0 con 0x7f13a40a1380 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a27fc700 1 -- 172.21.15.125:0/2286762530 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426945158 0 0) 0x7f13a409dc00 con 0x7f13a4133f50 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a37fe700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a2ffd700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a40a1380 0x7f13a4133a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f1022b29c85551 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a27fc700 1 -- 172.21.15.125:0/2286762530 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011830 con 0x7f13a40a1380 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a27fc700 1 -- 172.21.15.125:0/2286762530 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398011990 con 0x7f13a40a1380 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.466+0000 7f13a27fc700 1 -- 172.21.15.125:0/2286762530 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011d20 con 0x7f13a40a1380 2023-10-03T10:14:02.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 -- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a40a1380 msgr2=0x7f13a4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a40a1380 0x7f13a4133a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 -- 172.21.15.125:0/2286762530 shutdown_connections 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 --2- 172.21.15.125:0/2286762530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a40a1380 0x7f13a4133a10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 -- 172.21.15.125:0/2286762530 >> 172.21.15.125:0/2286762530 conn(0x7f13a40a6610 msgr2=0x7f13a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 -- 172.21.15.125:0/2286762530 shutdown_connections 2023-10-03T10:14:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.467+0000 7f13a9f60700 1 -- 172.21.15.125:0/2286762530 wait complete. 2023-10-03T10:14:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 Processor -- start 2023-10-03T10:14:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 -- start start 2023-10-03T10:14:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 0x7f13a4122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 0x7f13a4123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a41245d0 con 0x7f13a4133f50 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4124cf0 con 0x7f13a40a0a70 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a9f60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a41333d0 con 0x7f13a40a1380 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 0x7f13a4123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43900/0 (socket says 172.21.15.125:43900) 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a37fe700 1 -- 172.21.15.125:0/3764471606 learned_addr learned my addr 172.21.15.125:0/3764471606 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.468+0000 7f13a2ffd700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 0x7f13a4122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 -- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 msgr2=0x7f13a4122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 0x7f13a4122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 -- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 msgr2=0x7f13a41228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 -- 172.21.15.125:0/3764471606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940094a0 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a2ffd700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 0x7f13a4122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a37fe700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a3fff700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 0x7f13a4123330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f139c00cbe0 tx=0x7f139c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00aa40 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00abc0 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980094a0 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0070d0 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.469+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a4133800 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.470+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f139c007230 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.470+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a404f2a0 con 0x7f13a4133f50 2023-10-03T10:14:02.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.470+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f139c03f3e0 con 0x7f13a4133f50 2023-10-03T10:14:02.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.475+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f139c018070 con 0x7f13a4133f50 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 Processor -- start 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 -- start start 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 0x7fd96c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 0x7fd96c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c09dc00 con 0x7fd96c0a1380 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c09ea90 con 0x7fd96c134120 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.507+0000 7fd972ee0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c09dec0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd970c7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 0x7fd96c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd96c0a1380 0x7fd96c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52642/0 (socket says 172.21.15.125:52642) 2023-10-03T10:14:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 0x7fd96c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96bfff700 1 -- 172.21.15.125:0/942523419 learned_addr learned my addr 172.21.15.125:0/942523419 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd970c7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 0x7fd96c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39624/0 (socket says 172.21.15.125:39624) 2023-10-03T10:14:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 -- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 msgr2=0x7fd96c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 --2- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 0x7fd96c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 -- 172.21.15.125:0/942523419 >> v1:172.21.15.125:6789/0 conn(0x7fd96c0a1380 legacy=0x7fd96c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96b7fe700 1 -- 172.21.15.125:0/942523419 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266409661 0 0) 0x7fd96c09dc00 con 0x7fd96c0a1380 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 -- 172.21.15.125:0/942523419 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c09e6a0 con 0x7fd96c134120 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd97147d700 1 --2- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 0x7fd96c13bce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd964009dc0 tx=0x7fd96400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785c5baf0d9ed14a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96b7fe700 1 -- 172.21.15.125:0/942523419 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96400e070 con 0x7fd96c134120 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96b7fe700 1 -- 172.21.15.125:0/942523419 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96400bb20 con 0x7fd96c134120 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.508+0000 7fd96b7fe700 1 -- 172.21.15.125:0/942523419 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964012430 con 0x7fd96c134120 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 -- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 msgr2=0x7fd96c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 --2- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 0x7fd96c13bce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd964009dc0 tx=0x7fd96400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 -- 172.21.15.125:0/942523419 shutdown_connections 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 --2- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c134120 0x7fd96c13bce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 --2- 172.21.15.125:0/942523419 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c0a0a70 0x7fd96c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 -- 172.21.15.125:0/942523419 >> 172.21.15.125:0/942523419 conn(0x7fd96c0a6610 msgr2=0x7fd96c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 -- 172.21.15.125:0/942523419 shutdown_connections 2023-10-03T10:14:02.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.509+0000 7fd972ee0700 1 -- 172.21.15.125:0/942523419 wait complete. 2023-10-03T10:14:02.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.510+0000 7fd972ee0700 1 Processor -- start 2023-10-03T10:14:02.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.510+0000 7fd972ee0700 1 -- start start 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 0x7fd96c122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 0x7fd96c122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c125930 con 0x7fd96c0a1380 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c124320 con 0x7fd96c0a0a70 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd972ee0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0a5600 con 0x7fd96c134120 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd97147d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 0x7fd96c122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd97147d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39638/0 (socket says 172.21.15.125:39638) 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd97147d700 1 -- 172.21.15.125:0/2434830022 learned_addr learned my addr 172.21.15.125:0/2434830022 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd96bfff700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 0x7fd96c122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 -- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 msgr2=0x7fd96c123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 -- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 msgr2=0x7fd96c122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 0x7fd96c122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd970c7c700 1 -- 172.21.15.125:0/2434830022 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964009a70 con 0x7fd96c0a0a70 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd97147d700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.511+0000 7fd96bfff700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 0x7fd96c122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd970c7c700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 0x7fd96c122710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e900 tx=0x7fd96000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960013680 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9600137e0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960013b50 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c126230 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.512+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c125f50 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.513+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd960013cb0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.513+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c1336f0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.513+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd96003f870 con 0x7fd96c0a0a70 2023-10-03T10:14:02.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.517+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd96001b7c0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.669+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13a4072980 con 0x7f13a4133f50 2023-10-03T10:14:02.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.670+0000 7f138bfff700 1 -- 172.21.15.125:0/3764471606 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f139c0074e0 con 0x7f13a4133f50 2023-10-03T10:14:02.670 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:02.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.671+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 msgr2=0x7f13a4123330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.671+0000 7f13a9f60700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 0x7f13a4123330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f139c00cbe0 tx=0x7f139c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 shutdown_connections 2023-10-03T10:14:02.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a4133f50 0x7f13a4123330 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a40a0a70 0x7f13a41228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 --2- 172.21.15.125:0/3764471606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a40a1380 0x7f13a4122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 >> 172.21.15.125:0/3764471606 conn(0x7f13a40a6610 msgr2=0x7f13a409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 shutdown_connections 2023-10-03T10:14:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.672+0000 7f13a9f60700 1 -- 172.21.15.125:0/3764471606 wait complete. 2023-10-03T10:14:02.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:02.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.708+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd96c04f2a0 con 0x7fd96c0a0a70 2023-10-03T10:14:02.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.708+0000 7fd9697fa700 1 -- 172.21.15.125:0/2434830022 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd960017030 con 0x7fd96c0a0a70 2023-10-03T10:14:02.709 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 msgr2=0x7fd96c122710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 0x7fd96c122710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e900 tx=0x7fd96000ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 shutdown_connections 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd96c134120 0x7fd96c123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd96c0a0a70 0x7fd96c122710 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 --2- 172.21.15.125:0/2434830022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd96c0a1380 0x7fd96c122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 >> 172.21.15.125:0/2434830022 conn(0x7fd96c0a6610 msgr2=0x7fd96c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 shutdown_connections 2023-10-03T10:14:02.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.710+0000 7fd972ee0700 1 -- 172.21.15.125:0/2434830022 wait complete. 2023-10-03T10:14:02.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:02.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:02.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:02.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.893+0000 7f61331ac700 1 Processor -- start 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.893+0000 7f61331ac700 1 -- start start 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.893+0000 7f61331ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f612c0a1550 0x7f612c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f61331ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 0x7f612c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f61331ac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c09e9d0 con 0x7f612c0a0a70 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f61331ac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c09dc00 con 0x7f612c0a1550 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f61331ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c09dec0 con 0x7f612c139200 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f6131749700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 0x7f612c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f6130f48700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f612c0a0a70 0x7f612c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52658/0 (socket says 172.21.15.125:52658) 2023-10-03T10:14:02.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f612c0a1550 0x7f612c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f6130f48700 1 -- 172.21.15.125:0/1101670084 learned_addr learned my addr 172.21.15.125:0/1101670084 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 -- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 msgr2=0x7f612c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 0x7f612c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 -- 172.21.15.125:0/1101670084 >> v1:172.21.15.125:6789/0 conn(0x7f612c0a0a70 legacy=0x7f612c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612b7fe700 1 -- 172.21.15.125:0/1101670084 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480310152 0 0) 0x7f612c09e9d0 con 0x7f612c0a0a70 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 -- 172.21.15.125:0/1101670084 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c09e6a0 con 0x7f612c0a1550 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f6131749700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 0x7f612c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612bfff700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c138cc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6118009840 tx=0x7f6118009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1840f0113d9eb417 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612b7fe700 1 -- 172.21.15.125:0/1101670084 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011830 con 0x7f612c0a1550 2023-10-03T10:14:02.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612b7fe700 1 -- 172.21.15.125:0/1101670084 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118011990 con 0x7f612c0a1550 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.894+0000 7f612b7fe700 1 -- 172.21.15.125:0/1101670084 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011d20 con 0x7f612c0a1550 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 -- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 msgr2=0x7f612c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c138cc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6118009840 tx=0x7f6118009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 -- 172.21.15.125:0/1101670084 shutdown_connections 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c139200 0x7f612c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 --2- 172.21.15.125:0/1101670084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c138cc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 -- 172.21.15.125:0/1101670084 >> 172.21.15.125:0/1101670084 conn(0x7f612c0a6610 msgr2=0x7f612c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 -- 172.21.15.125:0/1101670084 shutdown_connections 2023-10-03T10:14:02.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.895+0000 7f61331ac700 1 -- 172.21.15.125:0/1101670084 wait complete. 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.896+0000 7f61331ac700 1 Processor -- start 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.896+0000 7f61331ac700 1 -- start start 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.896+0000 7f61331ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c124420 con 0x7f612c0a1550 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0a5100 con 0x7f612c0a0a70 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612c123ac0 con 0x7f612c139200 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6130f48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6130f48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43930/0 (socket says 172.21.15.125:43930) 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39654/0 (socket says 172.21.15.125:39654) 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6130f48700 1 -- 172.21.15.125:0/563153273 learned_addr learned my addr 172.21.15.125:0/563153273 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f612bfff700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 -- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 msgr2=0x7f612c1207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 -- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 msgr2=0x7f612c120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 -- 172.21.15.125:0/563153273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124009a70 con 0x7f612c139200 2023-10-03T10:14:02.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6130f48700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f6131749700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f612400ef90 tx=0x7f612400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400ca90 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612400f040 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61180094a0 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400ce30 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.897+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c124030 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.898+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6124014480 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.898+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f612403fc50 con 0x7f612c139200 2023-10-03T10:14:02.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.898+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c04f2a0 con 0x7f612c139200 2023-10-03T10:14:02.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.903+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6124012930 con 0x7f612c139200 2023-10-03T10:14:02.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.937+0000 7f4369f79700 1 Processor -- start 2023-10-03T10:14:02.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.937+0000 7f4369f79700 1 -- start start 2023-10-03T10:14:02.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.937+0000 7f4369f79700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.937+0000 7f4369f79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.937+0000 7f4369f79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f43641321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4369f79700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640a0920 con 0x7f436409e870 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4369f79700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436409c970 con 0x7f4364131d70 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4369f79700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f436409bab0 con 0x7f436409f180 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43637fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39668/0 (socket says 172.21.15.125:39668) 2023-10-03T10:14:02.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43637fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38814/0 (socket says 172.21.15.125:38814) 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 -- 172.21.15.125:0/695822151 learned_addr learned my addr 172.21.15.125:0/695822151 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4363fff700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f43641321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 -- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 msgr2=0x7f43641321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f43641321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 -- 172.21.15.125:0/695822151 >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 msgr2=0x7f436409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 --2- 172.21.15.125:0/695822151 >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 -- 172.21.15.125:0/695822151 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436409f9c0 con 0x7f436409f180 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4363fff700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f43641321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43637fe700 1 --2- 172.21.15.125:0/695822151 >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f4362ffd700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098f0 tx=0x7f434c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b56ba586887ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43627fc700 1 -- 172.21.15.125:0/695822151 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011830 con 0x7f436409f180 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43627fc700 1 -- 172.21.15.125:0/695822151 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c011990 con 0x7f436409f180 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.938+0000 7f43627fc700 1 -- 172.21.15.125:0/695822151 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011d20 con 0x7f436409f180 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 -- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 msgr2=0x7f4364131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098f0 tx=0x7f434c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 -- 172.21.15.125:0/695822151 shutdown_connections 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f43641321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 --2- 172.21.15.125:0/695822151 >> v2:172.21.15.125:3300/0 conn(0x7f436409e870 0x7f436409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 --2- 172.21.15.125:0/695822151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f4364131830 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 -- 172.21.15.125:0/695822151 >> 172.21.15.125:0/695822151 conn(0x7f43640a4430 msgr2=0x7f43640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 -- 172.21.15.125:0/695822151 shutdown_connections 2023-10-03T10:14:02.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.939+0000 7f4369f79700 1 -- 172.21.15.125:0/695822151 wait complete. 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 Processor -- start 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 -- start start 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 0x7f436411bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f436411c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4364120330 con 0x7f436409e870 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436411da60 con 0x7f4364131d70 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4369f79700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f436411e080 con 0x7f436409f180 2023-10-03T10:14:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f43637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 0x7f436411bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.940+0000 7f4363fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4363fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43956/0 (socket says 172.21.15.125:43956) 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4363fff700 1 -- 172.21.15.125:0/87494584 learned_addr learned my addr 172.21.15.125:0/87494584 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4362ffd700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f436411c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 -- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 msgr2=0x7f436411c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f436411c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 -- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 msgr2=0x7f436411c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 -- 172.21.15.125:0/87494584 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435400f050 con 0x7f436409e870 2023-10-03T10:14:02.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4363fff700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f43637fe700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 0x7f436411bea0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f435400f560 tx=0x7f435400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354014040 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354003a20 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354003dd0 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0094a0 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.941+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c009550 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.942+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4354004030 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.942+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4364071090 con 0x7f436409e870 2023-10-03T10:14:02.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.942+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43540438f0 con 0x7f436409e870 2023-10-03T10:14:02.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:02.947+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4354019480 con 0x7f436409e870 2023-10-03T10:14:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.095+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f612c0a03e0 con 0x7f612c139200 2023-10-03T10:14:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.096+0000 7f61297fa700 1 -- 172.21.15.125:0/563153273 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6124012340 con 0x7f612c139200 2023-10-03T10:14:03.096 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:03.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.097+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 msgr2=0x7f612c121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.097+0000 7f61331ac700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f612400ef90 tx=0x7f612400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 shutdown_connections 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612c139200 0x7f612c121270 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f612c0a0a70 0x7f612c1207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 --2- 172.21.15.125:0/563153273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f612c0a1550 0x7f612c120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 >> 172.21.15.125:0/563153273 conn(0x7f612c0a6610 msgr2=0x7f612c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 shutdown_connections 2023-10-03T10:14:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.098+0000 7f61331ac700 1 -- 172.21.15.125:0/563153273 wait complete. 2023-10-03T10:14:03.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:03.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.139+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f436409dba0 con 0x7f436409e870 2023-10-03T10:14:03.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.140+0000 7f435bfff700 1 -- 172.21.15.125:0/87494584 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f435401e030 con 0x7f436409e870 2023-10-03T10:14:03.140 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:03.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 msgr2=0x7f436411bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 0x7f436411bea0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f435400f560 tx=0x7f435400f870 comp rx=0 tx=0).stop 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 shutdown_connections 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4364131d70 0x7f436411c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f436409e870 0x7f436411bea0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 --2- 172.21.15.125:0/87494584 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f436409f180 0x7f436411c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 >> 172.21.15.125:0/87494584 conn(0x7f43640a4430 msgr2=0x7f4364130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 shutdown_connections 2023-10-03T10:14:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.142+0000 7f4369f79700 1 -- 172.21.15.125:0/87494584 wait complete. 2023-10-03T10:14:03.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:03.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:03.723 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:03.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.814+0000 7f3dbd6db700 1 Processor -- start 2023-10-03T10:14:03.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.814+0000 7f3dbd6db700 1 -- start start 2023-10-03T10:14:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3dbd6db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3dbd6db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3dbd6db700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db809c970 con 0x7f3db8131d70 2023-10-03T10:14:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3dbd6db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80a0920 con 0x7f3db809e870 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3dbd6db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db809f9c0 con 0x7f3db809f180 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3db8131d70 0x7f3db8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52670/0 (socket says 172.21.15.125:52670) 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39682/0 (socket says 172.21.15.125:39682) 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db77fe700 1 -- 172.21.15.125:0/1108719535 learned_addr learned my addr 172.21.15.125:0/1108719535 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 -- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 msgr2=0x7f3db809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db5ffb700 1 -- 172.21.15.125:0/1108719535 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215690845 0 0) 0x7f3db809c970 con 0x7f3db8131d70 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 -- 172.21.15.125:0/1108719535 >> v1:172.21.15.125:6789/0 conn(0x7f3db8131d70 legacy=0x7f3db8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db67fc700 1 -- 172.21.15.125:0/1108719535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db809bab0 con 0x7f3db809f180 2023-10-03T10:14:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.815+0000 7f3db6ffd700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.816+0000 7f3db67fc700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972fe429b59bd8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.816+0000 7f3db5ffb700 1 -- 172.21.15.125:0/1108719535 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011830 con 0x7f3db809f180 2023-10-03T10:14:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.816+0000 7f3db5ffb700 1 -- 172.21.15.125:0/1108719535 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac011990 con 0x7f3db809f180 2023-10-03T10:14:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.816+0000 7f3db5ffb700 1 -- 172.21.15.125:0/1108719535 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011d20 con 0x7f3db809f180 2023-10-03T10:14:03.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 -- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 msgr2=0x7f3db8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 -- 172.21.15.125:0/1108719535 shutdown_connections 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/1108719535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db8131830 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 -- 172.21.15.125:0/1108719535 >> 172.21.15.125:0/1108719535 conn(0x7f3db80a4430 msgr2=0x7f3db80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 -- 172.21.15.125:0/1108719535 shutdown_connections 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.817+0000 7f3dbd6db700 1 -- 172.21.15.125:0/1108719535 wait complete. 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 Processor -- start 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 -- start start 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 0x7f3db806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db806d510 con 0x7f3db8131d70 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8125cb0 con 0x7f3db809e870 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3dbd6db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db809b160 con 0x7f3db809f180 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43974/0 (socket says 172.21.15.125:43974) 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db6ffd700 1 -- 172.21.15.125:0/2005686355 learned_addr learned my addr 172.21.15.125:0/2005686355 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39694/0 (socket says 172.21.15.125:39694) 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.818+0000 7f3db77fe700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 0x7f3db806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 -- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 msgr2=0x7f3db806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 -- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 msgr2=0x7f3db806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 0x7f3db806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 -- 172.21.15.125:0/2005686355 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80094a0 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db77fe700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 0x7f3db806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db6ffd700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3db67fc700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3dac016000 tx=0x7f3dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac004510 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac01f070 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac0094a0 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0038e0 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.819+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db8124870 con 0x7f3db809f180 2023-10-03T10:14:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.820+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3dac003a40 con 0x7f3db809f180 2023-10-03T10:14:03.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.820+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db804f2a0 con 0x7f3db809f180 2023-10-03T10:14:03.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.820+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3dac021070 con 0x7f3db809f180 2023-10-03T10:14:03.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.825+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3dac003cf0 con 0x7f3db809f180 2023-10-03T10:14:03.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.854+0000 7fa4750a2700 1 Processor -- start 2023-10-03T10:14:03.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.854+0000 7fa4750a2700 1 -- start start 2023-10-03T10:14:03.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa4750a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa4750a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 0x7fa4700a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa4750a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47009b110 con 0x7fa470133f70 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa4750a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700a3b60 con 0x7fa47009ad40 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa4750a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700a2fa0 con 0x7fa4701343a0 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43980/0 (socket says 172.21.15.125:43980) 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46ed9d700 1 -- 172.21.15.125:0/1491201826 learned_addr learned my addr 172.21.15.125:0/1491201826 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 0x7fa4700a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 -- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 msgr2=0x7fa470133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 -- 172.21.15.125:0/1491201826 >> v1:172.21.15.125:6789/0 conn(0x7fa470133f70 legacy=0x7fa4700a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 -- 172.21.15.125:0/1491201826 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47009a280 con 0x7fa4701343a0 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46ed9d700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46f59e700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 0x7fa4700a1180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa468009dc0 tx=0x7fa46800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35a69ff346049138 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46dd9b700 1 -- 172.21.15.125:0/1491201826 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800e070 con 0x7fa4701343a0 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46dd9b700 1 -- 172.21.15.125:0/1491201826 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800bb20 con 0x7fa4701343a0 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.855+0000 7fa46dd9b700 1 -- 172.21.15.125:0/1491201826 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468012430 con 0x7fa4701343a0 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 -- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 msgr2=0x7fa4700a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 0x7fa4700a1180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa468009dc0 tx=0x7fa46800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 -- 172.21.15.125:0/1491201826 shutdown_connections 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4701343a0 0x7fa4700a1180 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1491201826 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa470133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 -- 172.21.15.125:0/1491201826 >> 172.21.15.125:0/1491201826 conn(0x7fa470099c40 msgr2=0x7fa47006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 -- 172.21.15.125:0/1491201826 shutdown_connections 2023-10-03T10:14:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.856+0000 7fa4750a2700 1 -- 172.21.15.125:0/1491201826 wait complete. 2023-10-03T10:14:03.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.857+0000 7fa4750a2700 1 Processor -- start 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 -- start start 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa470133f70 0x7fa47011e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 0x7fa47011ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47011fdd0 con 0x7fa4701343a0 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa470121020 con 0x7fa47009ad40 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa4750a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701203c0 con 0x7fa470133f70 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 0x7fa47011ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:43994/0 (socket says 172.21.15.125:43994) 2023-10-03T10:14:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 0x7fa47011ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38846/0 (socket says 172.21.15.125:38846) 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46ed9d700 1 -- 172.21.15.125:0/1988002743 learned_addr learned my addr 172.21.15.125:0/1988002743 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.858+0000 7fa46e59c700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa470133f70 0x7fa47011e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 -- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa470133f70 msgr2=0x7fa47011e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa470133f70 0x7fa47011e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 -- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 msgr2=0x7fa47011ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 0x7fa47011ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 -- 172.21.15.125:0/1988002743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460009550 con 0x7fa47009ad40 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa46ed9d700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa46000e9e0 tx=0x7fa46000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000ee80 con 0x7fa47009ad40 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46000c850 con 0x7fa47009ad40 2023-10-03T10:14:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000cbc0 con 0x7fa47009ad40 2023-10-03T10:14:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa468009a70 con 0x7fa47009ad40 2023-10-03T10:14:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.859+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47009e9a0 con 0x7fa47009ad40 2023-10-03T10:14:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.860+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa46000cd20 con 0x7fa47009ad40 2023-10-03T10:14:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.860+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47009c7e0 con 0x7fa47009ad40 2023-10-03T10:14:03.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.860+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa46003fac0 con 0x7fa47009ad40 2023-10-03T10:14:03.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:03.864+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa46001acf0 con 0x7fa47009ad40 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.018+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3db81259c0 con 0x7f3db809f180 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.018+0000 7f3d9f7fe700 1 -- 172.21.15.125:0/2005686355 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3dac015070 con 0x7f3db809f180 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 msgr2=0x7f3db806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3dac016000 tx=0x7f3dac004750 comp rx=0 tx=0).stop 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 shutdown_connections 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3db8131d70 0x7f3db806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3db809e870 0x7f3db806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 --2- 172.21.15.125:0/2005686355 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3db809f180 0x7f3db806bdc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 >> 172.21.15.125:0/2005686355 conn(0x7f3db80a4430 msgr2=0x7f3db811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 shutdown_connections 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.020+0000 7f3dbd6db700 1 -- 172.21.15.125:0/2005686355 wait complete. 2023-10-03T10:14:04.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.060+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa47004f2a0 con 0x7fa47009ad40 2023-10-03T10:14:04.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.060+0000 7fa4577fe700 1 -- 172.21.15.125:0/1988002743 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa460021030 con 0x7fa47009ad40 2023-10-03T10:14:04.061 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 msgr2=0x7fa47011e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa46000e9e0 tx=0x7fa46000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 shutdown_connections 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4701343a0 0x7fa47011ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa47009ad40 0x7fa47011e250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 --2- 172.21.15.125:0/1988002743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa470133f70 0x7fa47011e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.062+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 >> 172.21.15.125:0/1988002743 conn(0x7fa470099c40 msgr2=0x7fa4701332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.063+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 shutdown_connections 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.063+0000 7fa4750a2700 1 -- 172.21.15.125:0/1988002743 wait complete. 2023-10-03T10:14:04.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:04.111 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:04.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.240+0000 7fd761f2f700 1 Processor -- start 2023-10-03T10:14:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.240+0000 7fd761f2f700 1 -- start start 2023-10-03T10:14:04.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd761f2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd761f2f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd761f2f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c09c970 con 0x7fd75c09e870 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd761f2f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0a0920 con 0x7fd75c09f350 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd761f2f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c09f9c0 con 0x7fd75c1371c0 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd75bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd75b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd75c09e870 0x7fd75c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52684/0 (socket says 172.21.15.125:52684) 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd75affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.241+0000 7fd75b7fe700 1 -- 172.21.15.125:0/1684354019 learned_addr learned my addr 172.21.15.125:0/1684354019 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75affd700 1 -- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 msgr2=0x7fd75c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75affd700 1 --2- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75affd700 1 -- 172.21.15.125:0/1684354019 >> v1:172.21.15.125:6789/0 conn(0x7fd75c09e870 legacy=0x7fd75c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75a7fc700 1 -- 172.21.15.125:0/1684354019 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472489821 0 0) 0x7fd75c09c970 con 0x7fd75c09e870 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75affd700 1 -- 172.21.15.125:0/1684354019 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c09bab0 con 0x7fd75c09f350 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75affd700 1 --2- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c136c80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd750009870 tx=0x7fd750009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=838fab508c340943 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75a7fc700 1 -- 172.21.15.125:0/1684354019 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011830 con 0x7fd75c09f350 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75a7fc700 1 -- 172.21.15.125:0/1684354019 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750011990 con 0x7fd75c09f350 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.242+0000 7fd75a7fc700 1 -- 172.21.15.125:0/1684354019 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011d20 con 0x7fd75c09f350 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 -- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 msgr2=0x7fd75c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 --2- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c136c80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd750009870 tx=0x7fd750009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 -- 172.21.15.125:0/1684354019 shutdown_connections 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 --2- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 --2- 172.21.15.125:0/1684354019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 -- 172.21.15.125:0/1684354019 >> 172.21.15.125:0/1684354019 conn(0x7fd75c0a4430 msgr2=0x7fd75c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 -- 172.21.15.125:0/1684354019 shutdown_connections 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.243+0000 7fd761f2f700 1 -- 172.21.15.125:0/1684354019 wait complete. 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.244+0000 7fd761f2f700 1 Processor -- start 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.244+0000 7fd761f2f700 1 -- start start 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 0x7fd75c120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c136150 con 0x7fd75c09e870 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c136730 con 0x7fd75c09f350 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd761f2f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c122cb0 con 0x7fd75c1371c0 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 0x7fd75c120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39732/0 (socket says 172.21.15.125:39732) 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 -- 172.21.15.125:0/79960344 learned_addr learned my addr 172.21.15.125:0/79960344 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 -- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 msgr2=0x7fd75c120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 -- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 msgr2=0x7fd75c120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 0x7fd75c120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75bfff700 1 -- 172.21.15.125:0/79960344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500094a0 con 0x7fd75c1371c0 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.245+0000 7fd75b7fe700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 0x7fd75c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd75bfff700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ef90 tx=0x7fd75400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400cc90 con 0x7fd75c1371c0 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400f040 con 0x7fd75c1371c0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c124360 con 0x7fd75c1371c0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754014480 con 0x7fd75c1371c0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c09dba0 con 0x7fd75c1371c0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.246+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7540145e0 con 0x7fd75c1371c0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.247+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7540402b0 con 0x7fd75c1371c0 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.247+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c04f2a0 con 0x7fd75c1371c0 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.252+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd754018080 con 0x7fd75c1371c0 2023-10-03T10:14:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.296+0000 7f248a8eb700 1 Processor -- start 2023-10-03T10:14:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.296+0000 7f248a8eb700 1 -- start start 2023-10-03T10:14:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24840a1380 0x7f2484133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 0x7f2484134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248409e9d0 con 0x7f24840a1380 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248409dc00 con 0x7f2484133f50 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f248a8eb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f248409dec0 con 0x7f24840a0a70 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f2483fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f2488e88700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 0x7f2484134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f2483fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39744/0 (socket says 172.21.15.125:39744) 2023-10-03T10:14:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f2483fff700 1 -- 172.21.15.125:0/588735556 learned_addr learned my addr 172.21.15.125:0/588735556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.297+0000 7f24837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24840a1380 0x7f2484133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 -- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 msgr2=0x7f24840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 -- 172.21.15.125:0/588735556 >> v2:172.21.15.125:3300/0 conn(0x7f24840a1380 msgr2=0x7f2484133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 --2- 172.21.15.125:0/588735556 >> v2:172.21.15.125:3300/0 conn(0x7f24840a1380 0x7f2484133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 -- 172.21.15.125:0/588735556 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248409e6a0 con 0x7f2484133f50 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2483fff700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2488e88700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 0x7f2484134380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f247c009d90 tx=0x7f247c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d7a90b75db2cb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2482ffd700 1 -- 172.21.15.125:0/588735556 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c00e070 con 0x7f2484133f50 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2482ffd700 1 -- 172.21.15.125:0/588735556 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00bb20 con 0x7f2484133f50 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f2482ffd700 1 -- 172.21.15.125:0/588735556 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c012430 con 0x7f2484133f50 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 -- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 msgr2=0x7f2484134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 0x7f2484134380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f247c009d90 tx=0x7f247c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 -- 172.21.15.125:0/588735556 shutdown_connections 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2484133f50 0x7f2484134380 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 --2- 172.21.15.125:0/588735556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f24840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 --2- 172.21.15.125:0/588735556 >> v2:172.21.15.125:3300/0 conn(0x7f24840a1380 0x7f2484133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.298+0000 7f248a8eb700 1 -- 172.21.15.125:0/588735556 >> 172.21.15.125:0/588735556 conn(0x7f24840a6610 msgr2=0x7f24840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.299+0000 7f248a8eb700 1 -- 172.21.15.125:0/588735556 shutdown_connections 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.299+0000 7f248a8eb700 1 -- 172.21.15.125:0/588735556 wait complete. 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.299+0000 7f248a8eb700 1 Processor -- start 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 -- start start 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f2484122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 0x7f2484122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484124a20 con 0x7f2484133f50 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840a03e0 con 0x7f24840a1380 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f248a8eb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f248409d340 con 0x7f24840a0a70 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f24837fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 0x7f2484122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f24837fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44024/0 (socket says 172.21.15.125:44024) 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f24837fe700 1 -- 172.21.15.125:0/2078423558 learned_addr learned my addr 172.21.15.125:0/2078423558 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2483fff700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f2484122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 -- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 msgr2=0x7f2484122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f2484122520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 -- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 msgr2=0x7f2484122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2488e88700 1 -- 172.21.15.125:0/2078423558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474009550 con 0x7f2484133f50 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f24837fe700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.300+0000 7f2483fff700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f2484122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f2488e88700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 0x7f2484122fa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f24840672b0 tx=0x7f247c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0048b0 con 0x7f2484133f50 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c020070 con 0x7f2484133f50 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c009a70 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0276c0 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2484124fa0 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.301+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f247c012430 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.302+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248411f760 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.302+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f247c022070 con 0x7f2484133f50 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.306+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f247c02c020 con 0x7f2484133f50 2023-10-03T10:14:04.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.462+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd75c06b2a0 con 0x7fd75c1371c0 2023-10-03T10:14:04.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.462+0000 7fd743fff700 1 -- 172.21.15.125:0/79960344 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd754007510 con 0x7fd75c1371c0 2023-10-03T10:14:04.463 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:04.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 msgr2=0x7fd75c1212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ef90 tx=0x7fd75400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 shutdown_connections 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd75c1371c0 0x7fd75c1212c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c09e870 0x7fd75c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 --2- 172.21.15.125:0/79960344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd75c09f350 0x7fd75c120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.464+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 >> 172.21.15.125:0/79960344 conn(0x7fd75c0a4430 msgr2=0x7fd75c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.465+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 shutdown_connections 2023-10-03T10:14:04.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.465+0000 7fd761f2f700 1 -- 172.21.15.125:0/79960344 wait complete. 2023-10-03T10:14:04.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:04.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.501+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f248404f2a0 con 0x7f2484133f50 2023-10-03T10:14:04.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.501+0000 7f2480ff9700 1 -- 172.21.15.125:0/2078423558 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f247c01a380 con 0x7f2484133f50 2023-10-03T10:14:04.502 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 msgr2=0x7f2484122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 0x7f2484122fa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f24840672b0 tx=0x7f247c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 shutdown_connections 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2484133f50 0x7f2484122fa0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24840a0a70 0x7f2484122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 --2- 172.21.15.125:0/2078423558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24840a1380 0x7f2484122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 >> 172.21.15.125:0/2078423558 conn(0x7f24840a6610 msgr2=0x7f248411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 shutdown_connections 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:04.503+0000 7f248a8eb700 1 -- 172.21.15.125:0/2078423558 wait complete. 2023-10-03T10:14:04.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:05.033 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:05.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:05.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.164+0000 7f49b72a2700 1 Processor -- start 2023-10-03T10:14:05.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.164+0000 7f49b72a2700 1 -- start start 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b72a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b72a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 0x7f49b013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b72a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b009fa00 con 0x7f49b009f180 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b72a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00a0370 con 0x7f49b0134330 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b72a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49b006bec0 con 0x7f49b009e870 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b503e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 0x7f49b013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b503e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39762/0 (socket says 172.21.15.125:39762) 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b483d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f49b009f180 0x7f49b0133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52688/0 (socket says 172.21.15.125:52688) 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b503e700 1 -- 172.21.15.125:0/227660806 learned_addr learned my addr 172.21.15.125:0/227660806 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 -- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 msgr2=0x7f49b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49a7fff700 1 -- 172.21.15.125:0/227660806 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241766065 0 0) 0x7f49b009fa00 con 0x7f49b009f180 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 -- 172.21.15.125:0/227660806 >> v1:172.21.15.125:6789/0 conn(0x7f49b009f180 legacy=0x7f49b0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 -- 172.21.15.125:0/227660806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b009ada0 con 0x7f49b0134330 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b503e700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.165+0000 7f49b583f700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 0x7f49b013be80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009dc0 tx=0x7f49a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930b98d9709567b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49a7fff700 1 -- 172.21.15.125:0/227660806 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a800e070 con 0x7f49b0134330 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49a7fff700 1 -- 172.21.15.125:0/227660806 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a800bb20 con 0x7f49b0134330 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49a7fff700 1 -- 172.21.15.125:0/227660806 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8012430 con 0x7f49b0134330 2023-10-03T10:14:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 -- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 msgr2=0x7f49b013be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 0x7f49b013be80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009dc0 tx=0x7f49a800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 -- 172.21.15.125:0/227660806 shutdown_connections 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b0134330 0x7f49b013be80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 --2- 172.21.15.125:0/227660806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b009e870 0x7f49b009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 -- 172.21.15.125:0/227660806 >> 172.21.15.125:0/227660806 conn(0x7f49b00a4430 msgr2=0x7f49b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 -- 172.21.15.125:0/227660806 shutdown_connections 2023-10-03T10:14:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.166+0000 7f49b72a2700 1 -- 172.21.15.125:0/227660806 wait complete. 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.167+0000 7f49b72a2700 1 Processor -- start 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.167+0000 7f49b72a2700 1 -- start start 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 0x7f49b0122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b0134330 0x7f49b0123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0126310 con 0x7f49b009e870 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0124400 con 0x7f49b009f180 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b72a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00a16c0 con 0x7f49b0134330 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b503e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 0x7f49b0122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b503e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38892/0 (socket says 172.21.15.125:38892) 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b503e700 1 -- 172.21.15.125:0/1037329898 learned_addr learned my addr 172.21.15.125:0/1037329898 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b583f700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b0134330 0x7f49b0123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 -- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b0134330 msgr2=0x7f49b0123270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b0134330 0x7f49b0123270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 -- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 msgr2=0x7f49b01227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 -- 172.21.15.125:0/1037329898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009550 con 0x7f49b009f180 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b503e700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.168+0000 7f49b483d700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 0x7f49b0122d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49b0067390 tx=0x7f49a000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0004c80 con 0x7f49b009f180 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0004de0 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a8009a70 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007310 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b0133310 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.169+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49a0007470 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.170+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49a003f220 con 0x7f49b009f180 2023-10-03T10:14:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.170+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b0125c80 con 0x7f49b009f180 2023-10-03T10:14:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.175+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49a0007720 con 0x7f49b009f180 2023-10-03T10:14:05.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.203+0000 7fbb78cb5700 1 Processor -- start 2023-10-03T10:14:05.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.203+0000 7fbb78cb5700 1 -- start start 2023-10-03T10:14:05.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb78cb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb74133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb78cb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb741343a0 0x7fbb740a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb78cb5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7409b110 con 0x7fbb74133f70 2023-10-03T10:14:05.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb78cb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740a3b60 con 0x7fbb741343a0 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb78cb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740a2fa0 con 0x7fbb7409ad40 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb74133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb71d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbb74133f70 0x7fbb740a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52702/0 (socket says 172.21.15.125:52702) 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb71d9b700 1 -- 172.21.15.125:0/399213637 learned_addr learned my addr 172.21.15.125:0/399213637 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb72d9d700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb741343a0 0x7fbb740a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7259c700 1 -- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb741343a0 msgr2=0x7fbb740a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7259c700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb741343a0 0x7fbb740a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7259c700 1 -- 172.21.15.125:0/399213637 >> v1:172.21.15.125:6789/0 conn(0x7fbb74133f70 legacy=0x7fbb740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7259c700 1 -- 172.21.15.125:0/399213637 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7409a280 con 0x7fbb7409ad40 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.204+0000 7fbb7159a700 1 -- 172.21.15.125:0/399213637 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719195877 0 0) 0x7fbb7409b110 con 0x7fbb74133f70 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb7259c700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb74133a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009870 tx=0x7fbb64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a75ecf3be966a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb7159a700 1 -- 172.21.15.125:0/399213637 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64011830 con 0x7fbb7409ad40 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb7159a700 1 -- 172.21.15.125:0/399213637 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64011990 con 0x7fbb7409ad40 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb7159a700 1 -- 172.21.15.125:0/399213637 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64011d20 con 0x7fbb7409ad40 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 -- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 msgr2=0x7fbb74133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb74133a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009870 tx=0x7fbb64009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 -- 172.21.15.125:0/399213637 shutdown_connections 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb741343a0 0x7fbb740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/399213637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb74133a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 -- 172.21.15.125:0/399213637 >> 172.21.15.125:0/399213637 conn(0x7fbb74099c40 msgr2=0x7fbb7406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.205+0000 7fbb78cb5700 1 -- 172.21.15.125:0/399213637 shutdown_connections 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.206+0000 7fbb78cb5700 1 -- 172.21.15.125:0/399213637 wait complete. 2023-10-03T10:14:05.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.206+0000 7fbb78cb5700 1 Processor -- start 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 -- start start 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 0x7fbb741c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 0x7fbb741c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7409ea30 con 0x7fbb741343a0 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7409c7e0 con 0x7fbb74133f70 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb78cb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb741214d0 con 0x7fbb7409ad40 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39790/0 (socket says 172.21.15.125:39790) 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb7259c700 1 -- 172.21.15.125:0/593573296 learned_addr learned my addr 172.21.15.125:0/593573296 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 0x7fbb741c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb72d9d700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 0x7fbb741c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 -- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 msgr2=0x7fbb741c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 -- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 msgr2=0x7fbb741c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 0x7fbb741c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb71d9b700 1 -- 172.21.15.125:0/593573296 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640094a0 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb7259c700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.207+0000 7fbb72d9d700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 0x7fbb741c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb71d9b700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 0x7fbb741c8c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c470 tx=0x7fbb6800c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68004c80 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68004de0 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb74121790 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007310 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7411fc00 con 0x7fbb74133f70 2023-10-03T10:14:05.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.208+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb68007470 con 0x7fbb74133f70 2023-10-03T10:14:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.209+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb6803f1c0 con 0x7fbb74133f70 2023-10-03T10:14:05.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.209+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7404f2a0 con 0x7fbb74133f70 2023-10-03T10:14:05.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.213+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb6800ce40 con 0x7fbb74133f70 2023-10-03T10:14:05.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.367+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49b004f2a0 con 0x7f49b009f180 2023-10-03T10:14:05.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.367+0000 7f49a5ffb700 1 -- 172.21.15.125:0/1037329898 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49a001b340 con 0x7f49b009f180 2023-10-03T10:14:05.368 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 msgr2=0x7f49b0122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 0x7f49b0122d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49b0067390 tx=0x7f49a000c750 comp rx=0 tx=0).stop 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 shutdown_connections 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49b0134330 0x7f49b0123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b009e870 0x7f49b01227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 --2- 172.21.15.125:0/1037329898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49b009f180 0x7f49b0122d30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 >> 172.21.15.125:0/1037329898 conn(0x7f49b00a4430 msgr2=0x7f49b0070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 shutdown_connections 2023-10-03T10:14:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.369+0000 7f49b72a2700 1 -- 172.21.15.125:0/1037329898 wait complete. 2023-10-03T10:14:05.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:05.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.408+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb741219d0 con 0x7fbb74133f70 2023-10-03T10:14:05.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.409+0000 7fbb62ffd700 1 -- 172.21.15.125:0/593573296 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb741219d0 con 0x7fbb74133f70 2023-10-03T10:14:05.409 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:05.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 msgr2=0x7fbb741c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 0x7fbb741c8c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c470 tx=0x7fbb6800c780 comp rx=0 tx=0).stop 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 shutdown_connections 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb741343a0 0x7fbb741c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb7409ad40 0x7fbb741c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 --2- 172.21.15.125:0/593573296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb74133f70 0x7fbb741c8c80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 >> 172.21.15.125:0/593573296 conn(0x7fbb74099c40 msgr2=0x7fbb74133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 shutdown_connections 2023-10-03T10:14:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.411+0000 7fbb78cb5700 1 -- 172.21.15.125:0/593573296 wait complete. 2023-10-03T10:14:05.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:05.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:05.516 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:05.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.606+0000 7faf66efc700 1 Processor -- start 2023-10-03T10:14:05.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.606+0000 7faf66efc700 1 -- start start 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.606+0000 7faf66efc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf66efc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 0x7faf6013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf66efc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6009fa00 con 0x7faf6009e870 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf66efc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf600a0370 con 0x7faf601393a0 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf66efc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006bec0 con 0x7faf6009f350 2023-10-03T10:14:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53976/0 (socket says 172.21.15.125:53976) 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 -- 172.21.15.125:0/2339253543 learned_addr learned my addr 172.21.15.125:0/2339253543 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf65499700 1 --2- 172.21.15.125:0/2339253543 >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 0x7faf6013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 -- 172.21.15.125:0/2339253543 >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 msgr2=0x7faf6013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2339253543 >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 0x7faf6013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 -- 172.21.15.125:0/2339253543 >> v1:172.21.15.125:6789/0 conn(0x7faf6009e870 legacy=0x7faf6009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5f7fe700 1 -- 172.21.15.125:0/2339253543 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283622664 0 0) 0x7faf6009fa00 con 0x7faf6009e870 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 -- 172.21.15.125:0/2339253543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6009ada0 con 0x7faf6009f350 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf65499700 1 --2- 172.21.15.125:0/2339253543 >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 0x7faf6013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2339253543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0098f0 tx=0x7faf4c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9128d7f9dc57050 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5f7fe700 1 -- 172.21.15.125:0/2339253543 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c011830 con 0x7faf6009f350 2023-10-03T10:14:05.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5f7fe700 1 -- 172.21.15.125:0/2339253543 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c011990 con 0x7faf6009f350 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.607+0000 7faf5f7fe700 1 -- 172.21.15.125:0/2339253543 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c011d20 con 0x7faf6009f350 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 -- 172.21.15.125:0/2339253543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 msgr2=0x7faf60138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 --2- 172.21.15.125:0/2339253543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0098f0 tx=0x7faf4c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 -- 172.21.15.125:0/2339253543 shutdown_connections 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 --2- 172.21.15.125:0/2339253543 >> v2:172.21.15.125:3300/0 conn(0x7faf601393a0 0x7faf6013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 --2- 172.21.15.125:0/2339253543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60138e60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 -- 172.21.15.125:0/2339253543 >> 172.21.15.125:0/2339253543 conn(0x7faf600a4430 msgr2=0x7faf600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 -- 172.21.15.125:0/2339253543 shutdown_connections 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.608+0000 7faf66efc700 1 -- 172.21.15.125:0/2339253543 wait complete. 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 Processor -- start 2023-10-03T10:14:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 -- start start 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 0x7faf60120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60120f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60122610 con 0x7faf601393a0 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60122c30 con 0x7faf6009f350 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.609+0000 7faf66efc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006d010 con 0x7faf6009e870 2023-10-03T10:14:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf65499700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf64c98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 0x7faf60120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf65499700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54416/0 (socket says 172.21.15.125:54416) 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf65499700 1 -- 172.21.15.125:0/2829378761 learned_addr learned my addr 172.21.15.125:0/2829378761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60120f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 -- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 msgr2=0x7faf60120a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 0x7faf60120a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 -- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 msgr2=0x7faf60121480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 -- 172.21.15.125:0/2829378761 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58009a70 con 0x7faf6009f350 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf64c98700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 0x7faf60120a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf65499700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5ffff700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60120f40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf4c016000 tx=0x7faf4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c004300 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c01f070 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c009550 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0036a0 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.610+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60124290 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.611+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf4c021030 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.611+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf4c040880 con 0x7faf6009f350 2023-10-03T10:14:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.611+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60124290 con 0x7faf6009f350 2023-10-03T10:14:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.616+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf60124290 con 0x7faf6009f350 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.648+0000 7f945b4b5700 1 Processor -- start 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.648+0000 7f945b4b5700 1 -- start start 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f945b4b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f945b4b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9454131ec0 0x7f9454139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f945b4b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945409da80 con 0x7f945406b080 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f945b4b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945409dce0 con 0x7f9454131ec0 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f945b4b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f945409eb20 con 0x7f945406a770 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459251700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9454131ec0 0x7f9454139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9458a50700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f945406b080 0x7f94541317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55458/0 (socket says 172.21.15.125:55458) 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9458a50700 1 -- 172.21.15.125:0/39011966 learned_addr learned my addr 172.21.15.125:0/39011966 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9454131ec0 0x7f9454139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54432/0 (socket says 172.21.15.125:54432) 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459251700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48028/0 (socket says 172.21.15.125:48028) 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 -- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 msgr2=0x7f945406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 -- 172.21.15.125:0/39011966 >> v1:172.21.15.125:6789/0 conn(0x7f945406b080 legacy=0x7f94541317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 -- 172.21.15.125:0/39011966 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945409d860 con 0x7f9454131ec0 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f944bfff700 1 -- 172.21.15.125:0/39011966 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271312456 0 0) 0x7f945409da80 con 0x7f945406b080 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459251700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f9459a52700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9454131ec0 0x7f9454139c20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f944c009d90 tx=0x7f944c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ead1fd1f55409d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f944bfff700 1 -- 172.21.15.125:0/39011966 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00e070 con 0x7f9454131ec0 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f944bfff700 1 -- 172.21.15.125:0/39011966 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c00bb20 con 0x7f9454131ec0 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.649+0000 7f944bfff700 1 -- 172.21.15.125:0/39011966 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c012430 con 0x7f9454131ec0 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 -- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9454131ec0 msgr2=0x7f9454139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9454131ec0 0x7f9454139c20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f944c009d90 tx=0x7f944c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 -- 172.21.15.125:0/39011966 shutdown_connections 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9454131ec0 0x7f9454139c20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 --2- 172.21.15.125:0/39011966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f945406a770 0x7f945406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 -- 172.21.15.125:0/39011966 >> 172.21.15.125:0/39011966 conn(0x7f9454099c40 msgr2=0x7f94540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 -- 172.21.15.125:0/39011966 shutdown_connections 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.650+0000 7f945b4b5700 1 -- 172.21.15.125:0/39011966 wait complete. 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.651+0000 7f945b4b5700 1 Processor -- start 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.651+0000 7f945b4b5700 1 -- start start 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f945406b080 0x7f94541c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 0x7f94541c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454121620 con 0x7f945406a770 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94541223b0 con 0x7f945406b080 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f945b4b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f945409c010 con 0x7f9454131ec0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f9459251700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f9459a52700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 0x7f94541c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f9459251700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54434/0 (socket says 172.21.15.125:54434) 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f9459251700 1 -- 172.21.15.125:0/1251636076 learned_addr learned my addr 172.21.15.125:0/1251636076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.652+0000 7f9458a50700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f945406b080 0x7f94541c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 -- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f945406b080 msgr2=0x7f94541c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f945406b080 0x7f94541c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 -- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 msgr2=0x7f94541c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 -- 172.21.15.125:0/1251636076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500094a0 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459251700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9459a52700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 0x7f94541c8ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f944c016000 tx=0x7f944c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c012430 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c020070 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c009a70 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c004280 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.653+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454071e10 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.654+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f944c0043e0 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.654+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945404f2a0 con 0x7f9454131ec0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.654+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f944c022070 con 0x7f9454131ec0 2023-10-03T10:14:05.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.659+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f944c01a380 con 0x7f9454131ec0 2023-10-03T10:14:05.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.809+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf60124290 con 0x7faf6009f350 2023-10-03T10:14:05.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.810+0000 7faf5d7fa700 1 -- 172.21.15.125:0/2829378761 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf60124290 con 0x7faf6009f350 2023-10-03T10:14:05.810 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.811+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 msgr2=0x7faf60120f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.811+0000 7faf66efc700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60120f40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf4c016000 tx=0x7faf4c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 shutdown_connections 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf601393a0 0x7faf60121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf6009e870 0x7faf60120a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 --2- 172.21.15.125:0/2829378761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf6009f350 0x7faf60120f40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 >> 172.21.15.125:0/2829378761 conn(0x7faf600a4430 msgr2=0x7faf60070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 shutdown_connections 2023-10-03T10:14:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.812+0000 7faf66efc700 1 -- 172.21.15.125:0/2829378761 wait complete. 2023-10-03T10:14:05.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.851+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9454122da0 con 0x7f9454131ec0 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.851+0000 7f9449ffb700 1 -- 172.21.15.125:0/1251636076 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f944c036090 con 0x7f9454131ec0 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 msgr2=0x7f94541c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 0x7f94541c8ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f944c016000 tx=0x7f944c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 shutdown_connections 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9454131ec0 0x7f94541c8ab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f945406a770 0x7f94541c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 --2- 172.21.15.125:0/1251636076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f945406b080 0x7f94541c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 >> 172.21.15.125:0/1251636076 conn(0x7f9454099c40 msgr2=0x7f94541b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 shutdown_connections 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:05.854+0000 7f945b4b5700 1 -- 172.21.15.125:0/1251636076 wait complete. 2023-10-03T10:14:05.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:06.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:06.424 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:06.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 Processor -- start 2023-10-03T10:14:06.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 -- start start 2023-10-03T10:14:06.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b809b6d0 con 0x7f08b809e950 2023-10-03T10:14:06.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b809afb0 con 0x7f08b809f430 2023-10-03T10:14:06.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.513+0000 7f08c0754700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80a0970 con 0x7f08b8137010 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bdcef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08be4f0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f08b809e950 0x7f08b809ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55460/0 (socket says 172.21.15.125:55460) 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bdcef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54004/0 (socket says 172.21.15.125:54004) 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48050/0 (socket says 172.21.15.125:48050) 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08be4f0700 1 -- 172.21.15.125:0/3677965927 learned_addr learned my addr 172.21.15.125:0/3677965927 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bd4ee700 1 -- 172.21.15.125:0/3677965927 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650525720 0 0) 0x7f08b809b6d0 con 0x7f08b809e950 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 -- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 msgr2=0x7f08b8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 -- 172.21.15.125:0/3677965927 >> v1:172.21.15.125:6789/0 conn(0x7f08b809e950 legacy=0x7f08b809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 -- 172.21.15.125:0/3677965927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80a0320 con 0x7f08b8137010 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bdcef700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08becf1700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009df0 tx=0x7f08b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282aef5a14e4ea84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bd4ee700 1 -- 172.21.15.125:0/3677965927 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000e070 con 0x7f08b8137010 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bd4ee700 1 -- 172.21.15.125:0/3677965927 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b000bae0 con 0x7f08b8137010 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.514+0000 7f08bd4ee700 1 -- 172.21.15.125:0/3677965927 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000be90 con 0x7f08b8137010 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 -- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 msgr2=0x7f08b81393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009df0 tx=0x7f08b000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 -- 172.21.15.125:0/3677965927 shutdown_connections 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81393f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 --2- 172.21.15.125:0/3677965927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 -- 172.21.15.125:0/3677965927 >> 172.21.15.125:0/3677965927 conn(0x7f08b80a0f70 msgr2=0x7f08b80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 -- 172.21.15.125:0/3677965927 shutdown_connections 2023-10-03T10:14:06.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.515+0000 7f08c0754700 1 -- 172.21.15.125:0/3677965927 wait complete. 2023-10-03T10:14:06.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 Processor -- start 2023-10-03T10:14:06.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 -- start start 2023-10-03T10:14:06.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8132570 con 0x7f08b809e950 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b809b240 con 0x7f08b809f430 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08c0754700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b809da40 con 0x7f08b8137010 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08be4f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.516+0000 7f08bdcef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08becf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08bdcef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54006/0 (socket says 172.21.15.125:54006) 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08bdcef700 1 -- 172.21.15.125:0/3682321465 learned_addr learned my addr 172.21.15.125:0/3682321465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:06.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08becf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48066/0 (socket says 172.21.15.125:48066) 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54436/0 (socket says 172.21.15.125:54436) 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 -- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 msgr2=0x7f08b81c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 -- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 msgr2=0x7f08b81c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 -- 172.21.15.125:0/3682321465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80094a0 con 0x7f08b809e950 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08becf1700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08bdcef700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08be4f0700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c750 tx=0x7f08b400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40074e0 con 0x7f08b809e950 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4007640 con 0x7f08b809e950 2023-10-03T10:14:06.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b0009a70 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4005a70 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.517+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b8122260 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.518+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08b4005bd0 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.518+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08b403ea60 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.518+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b804f2a0 con 0x7f08b809e950 2023-10-03T10:14:06.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.523+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08b4017080 con 0x7f08b809e950 2023-10-03T10:14:06.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.554+0000 7f63ab3a7700 1 Processor -- start 2023-10-03T10:14:06.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.554+0000 7f63ab3a7700 1 -- start start 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63ab3a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63a40a1550 0x7f63a4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63ab3a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 0x7f63a413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63ab3a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a409e9d0 con 0x7f63a40a0a70 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63ab3a7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a409dc00 con 0x7f63a40a1550 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63ab3a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a409dec0 con 0x7f63a4139200 2023-10-03T10:14:06.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63a40a1550 0x7f63a4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a9944700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 0x7f63a413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a9143700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f63a40a0a70 0x7f63a40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55476/0 (socket says 172.21.15.125:55476) 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63a40a1550 0x7f63a4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54452/0 (socket says 172.21.15.125:54452) 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a9944700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 0x7f63a413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54018/0 (socket says 172.21.15.125:54018) 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 -- 172.21.15.125:0/3638115707 learned_addr learned my addr 172.21.15.125:0/3638115707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 -- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 msgr2=0x7f63a413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 --2- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 0x7f63a413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 -- 172.21.15.125:0/3638115707 >> v1:172.21.15.125:6789/0 conn(0x7f63a40a0a70 legacy=0x7f63a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f63a8942700 1 -- 172.21.15.125:0/3638115707 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a409e6a0 con 0x7f63a40a1550 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.555+0000 7f639bfff700 1 -- 172.21.15.125:0/3638115707 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954038763 0 0) 0x7f63a409e9d0 con 0x7f63a40a0a70 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63a8942700 1 --2- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a4138cc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f63940098f0 tx=0x7f6394009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7859671e099dec5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f639bfff700 1 -- 172.21.15.125:0/3638115707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394011830 con 0x7f63a40a1550 2023-10-03T10:14:06.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f639bfff700 1 -- 172.21.15.125:0/3638115707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394011990 con 0x7f63a40a1550 2023-10-03T10:14:06.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f639bfff700 1 -- 172.21.15.125:0/3638115707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394011d20 con 0x7f63a40a1550 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 -- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 msgr2=0x7f63a4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a4138cc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f63940098f0 tx=0x7f6394009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 -- 172.21.15.125:0/3638115707 shutdown_connections 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a4139200 0x7f63a413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/3638115707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a4138cc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 -- 172.21.15.125:0/3638115707 >> 172.21.15.125:0/3638115707 conn(0x7f63a40a6610 msgr2=0x7f63a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 -- 172.21.15.125:0/3638115707 shutdown_connections 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.556+0000 7f63ab3a7700 1 -- 172.21.15.125:0/3638115707 wait complete. 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.557+0000 7f63ab3a7700 1 Processor -- start 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.557+0000 7f63ab3a7700 1 -- start start 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 0x7f63a411e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 0x7f63a411f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a41345d0 con 0x7f63a40a1550 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4120b10 con 0x7f63a40a0a70 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40a5100 con 0x7f63a4139200 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a8942700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a8942700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54454/0 (socket says 172.21.15.125:54454) 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 0x7f63a411e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a8942700 1 -- 172.21.15.125:0/2036082533 learned_addr learned my addr 172.21.15.125:0/2036082533 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9944700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 0x7f63a411f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 -- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 msgr2=0x7f63a411f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 0x7f63a411f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 -- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 msgr2=0x7f63a411ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 -- 172.21.15.125:0/2036082533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394009550 con 0x7f63a40a0a70 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a8942700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9944700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 0x7f63a411f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63a9143700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 0x7f63a411e780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63a000c470 tx=0x7f63a000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0004c80 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0004de0 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a40a03e0 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.558+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0007310 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.559+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a4122990 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.559+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63a0007470 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.559+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63a003f220 con 0x7f63a40a0a70 2023-10-03T10:14:06.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.560+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a404f2a0 con 0x7f63a40a0a70 2023-10-03T10:14:06.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.564+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63a0007720 con 0x7f63a40a0a70 2023-10-03T10:14:06.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.716+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08b809b8b0 con 0x7f08b809e950 2023-10-03T10:14:06.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.717+0000 7f08aeffd700 1 -- 172.21.15.125:0/3682321465 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08b4019cd0 con 0x7f08b809e950 2023-10-03T10:14:06.717 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:06.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.718+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 msgr2=0x7f08b81c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c750 tx=0x7f08b400ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:06.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 shutdown_connections 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08b8137010 0x7f08b81c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b809e950 0x7f08b81c8320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 --2- 172.21.15.125:0/3682321465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08b809f430 0x7f08b81c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 >> 172.21.15.125:0/3682321465 conn(0x7f08b80a0f70 msgr2=0x7f08b8134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 shutdown_connections 2023-10-03T10:14:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.719+0000 7f08c0754700 1 -- 172.21.15.125:0/3682321465 wait complete. 2023-10-03T10:14:06.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:06.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.757+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63a4072980 con 0x7f63a40a0a70 2023-10-03T10:14:06.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.757+0000 7f6399ffb700 1 -- 172.21.15.125:0/2036082533 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63a0011e80 con 0x7f63a40a0a70 2023-10-03T10:14:06.758 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:06.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 msgr2=0x7f63a411e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 0x7f63a411e780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63a000c470 tx=0x7f63a000c780 comp rx=0 tx=0).stop 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 shutdown_connections 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a4139200 0x7f63a411f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a40a0a70 0x7f63a411e780 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 --2- 172.21.15.125:0/2036082533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a40a1550 0x7f63a411ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 >> 172.21.15.125:0/2036082533 conn(0x7f63a40a6610 msgr2=0x7f63a40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 shutdown_connections 2023-10-03T10:14:06.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.760+0000 7f63ab3a7700 1 -- 172.21.15.125:0/2036082533 wait complete. 2023-10-03T10:14:06.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:06.824 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:06.867 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.949+0000 7f4faf75f700 1 Processor -- start 2023-10-03T10:14:06.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.949+0000 7f4faf75f700 1 -- start start 2023-10-03T10:14:06.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4fa8134160 0x7f4fa8134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa80a0370 con 0x7f4fa8134160 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa809fa00 con 0x7f4fa809e870 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faf75f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa809ada0 con 0x7f4fa809f180 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4fa8134160 0x7f4fa8134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faccfa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fad4fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4fa8134160 0x7f4fa8134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54460/0 (socket says 172.21.15.125:54460) 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fad4fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54038/0 (socket says 172.21.15.125:54038) 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faccfa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48090/0 (socket says 172.21.15.125:48090) 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 -- 172.21.15.125:0/3489964333 learned_addr learned my addr 172.21.15.125:0/3489964333 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 -- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 msgr2=0x7f4fa8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 -- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 msgr2=0x7f4fa809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 -- 172.21.15.125:0/3489964333 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa806bec0 con 0x7f4fa8134160 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fad4fb700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4faccfa700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.950+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa8134160 0x7f4fa8134600 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009e50 tx=0x7f4fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd11d4c14733e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4f9ffff700 1 -- 172.21.15.125:0/3489964333 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000e070 con 0x7f4fa8134160 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4f9ffff700 1 -- 172.21.15.125:0/3489964333 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000b910 con 0x7f4fa8134160 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4f9ffff700 1 -- 172.21.15.125:0/3489964333 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000bcc0 con 0x7f4fa8134160 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 -- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa8134160 msgr2=0x7f4fa8134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa8134160 0x7f4fa8134600 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009e50 tx=0x7f4fa000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 -- 172.21.15.125:0/3489964333 shutdown_connections 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809e870 0x7f4fa809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa8134160 0x7f4fa8134600 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 --2- 172.21.15.125:0/3489964333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa809f180 0x7f4fa8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 -- 172.21.15.125:0/3489964333 >> 172.21.15.125:0/3489964333 conn(0x7f4fa80a4430 msgr2=0x7f4fa80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 -- 172.21.15.125:0/3489964333 shutdown_connections 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.951+0000 7f4faf75f700 1 -- 172.21.15.125:0/3489964333 wait complete. 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.952+0000 7f4faf75f700 1 Processor -- start 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.952+0000 7f4faf75f700 1 -- start start 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 0x7f4fa8122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 0x7f4fa8122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa8125fa0 con 0x7f4fa809e870 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa8124f20 con 0x7f4fa809f180 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faf75f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa806cfa0 con 0x7f4fa8134160 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faccfa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 0x7f4fa8122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faccfa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54040/0 (socket says 172.21.15.125:54040) 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faccfa700 1 -- 172.21.15.125:0/1793445212 learned_addr learned my addr 172.21.15.125:0/1793445212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fad4fb700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 0x7f4fa8122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 -- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 msgr2=0x7f4fa81229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 -- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 msgr2=0x7f4fa8122480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 0x7f4fa8122480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 -- 172.21.15.125:0/1793445212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40094a0 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4faccfa700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fad4fb700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 0x7f4fa8122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4fadcfc700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 0x7f4fa8122f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa809e630 tx=0x7f4fa0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0004450 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.953+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa00045d0 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.954+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f980094a0 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.954+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00092e0 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.954+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa0009b30 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.954+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fa0025460 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.955+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fa00411c0 con 0x7f4fa8134160 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.955+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa804f2a0 con 0x7f4fa8134160 2023-10-03T10:14:06.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:06.959+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fa000ce80 con 0x7f4fa8134160 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.002+0000 7f449f2f5700 1 Processor -- start 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.002+0000 7f449f2f5700 1 -- start start 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449f2f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f449809e870 0x7f449809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449f2f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449f2f5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449809c970 con 0x7f449809f180 2023-10-03T10:14:07.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449f2f5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980a0920 con 0x7f449809e870 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449f2f5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449809f9c0 con 0x7f4498131f40 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d892700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f449809e870 0x7f449809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449c890700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f449809f180 0x7f4498131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55486/0 (socket says 172.21.15.125:55486) 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d892700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54056/0 (socket says 172.21.15.125:54056) 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449c890700 1 -- 172.21.15.125:0/2488316899 learned_addr learned my addr 172.21.15.125:0/2488316899 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 -- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 msgr2=0x7f4498139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 -- 172.21.15.125:0/2488316899 >> v1:172.21.15.125:6789/0 conn(0x7f449809f180 legacy=0x7f4498131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 -- 172.21.15.125:0/2488316899 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449809bab0 con 0x7f449809e870 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f448ffff700 1 -- 172.21.15.125:0/2488316899 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851276207 0 0) 0x7f449809c970 con 0x7f449809f180 2023-10-03T10:14:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d892700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.003+0000 7f449d091700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809e870 0x7f449809ec40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4494009840 tx=0x7f4494009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e66a38b0f5c6c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f448ffff700 1 -- 172.21.15.125:0/2488316899 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011830 con 0x7f449809e870 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f448ffff700 1 -- 172.21.15.125:0/2488316899 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494011990 con 0x7f449809e870 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f448ffff700 1 -- 172.21.15.125:0/2488316899 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011d20 con 0x7f449809e870 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 -- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809e870 msgr2=0x7f449809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809e870 0x7f449809ec40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4494009840 tx=0x7f4494009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 -- 172.21.15.125:0/2488316899 shutdown_connections 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4498131f40 0x7f4498139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 --2- 172.21.15.125:0/2488316899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809e870 0x7f449809ec40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 -- 172.21.15.125:0/2488316899 >> 172.21.15.125:0/2488316899 conn(0x7f44980a4430 msgr2=0x7f44980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 -- 172.21.15.125:0/2488316899 shutdown_connections 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.004+0000 7f449f2f5700 1 -- 172.21.15.125:0/2488316899 wait complete. 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.005+0000 7f449f2f5700 1 Processor -- start 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.005+0000 7f449f2f5700 1 -- start start 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 0x7f449806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 0x7f44981c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449806bd90 con 0x7f449809f180 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449806cd00 con 0x7f449809e870 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44981217c0 con 0x7f4498131f40 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449d091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 0x7f449806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449d091700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 0x7f449806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54062/0 (socket says 172.21.15.125:54062) 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54476/0 (socket says 172.21.15.125:54476) 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449d091700 1 -- 172.21.15.125:0/3513686403 learned_addr learned my addr 172.21.15.125:0/3513686403 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449d892700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 0x7f44981c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 -- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 msgr2=0x7f44981c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 0x7f44981c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 -- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 msgr2=0x7f449806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 0x7f449806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 -- 172.21.15.125:0/3513686403 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490009a70 con 0x7f449809f180 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449d892700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 0x7f44981c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449c890700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f448800c470 tx=0x7f448800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488004c80 con 0x7f449809f180 2023-10-03T10:14:07.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488004de0 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940094a0 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.006+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488007310 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.007+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44981223e0 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.007+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4488007470 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.007+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f448803f240 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.007+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449806d580 con 0x7f449809f180 2023-10-03T10:14:07.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.013+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4488007720 con 0x7f449809f180 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.167+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fa8124090 con 0x7f4fa8134160 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.168+0000 7f4f9dffb700 1 -- 172.21.15.125:0/1793445212 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fa0011390 con 0x7f4fa8134160 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:07.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 msgr2=0x7f4fa8122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 0x7f4fa8122f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa809e630 tx=0x7f4fa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 shutdown_connections 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa8134160 0x7f4fa8122f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa809e870 0x7f4fa8122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 --2- 172.21.15.125:0/1793445212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa809f180 0x7f4fa81229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 >> 172.21.15.125:0/1793445212 conn(0x7f4fa80a4430 msgr2=0x7f4fa8072570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 shutdown_connections 2023-10-03T10:14:07.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.170+0000 7f4faf75f700 1 -- 172.21.15.125:0/1793445212 wait complete. 2023-10-03T10:14:07.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:07.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.206+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f449804f2a0 con 0x7f449809f180 2023-10-03T10:14:07.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.206+0000 7f448dffb700 1 -- 172.21.15.125:0/3513686403 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4488011360 con 0x7f449809f180 2023-10-03T10:14:07.207 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:07.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 msgr2=0x7f449806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f448800c470 tx=0x7f448800c780 comp rx=0 tx=0).stop 2023-10-03T10:14:07.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 shutdown_connections 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4498131f40 0x7f44981c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f449809e870 0x7f449806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 --2- 172.21.15.125:0/3513686403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f449809f180 0x7f449806c7c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 >> 172.21.15.125:0/3513686403 conn(0x7f44980a4430 msgr2=0x7f44980a2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 shutdown_connections 2023-10-03T10:14:07.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.209+0000 7f449f2f5700 1 -- 172.21.15.125:0/3513686403 wait complete. 2023-10-03T10:14:07.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:07.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:07.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:07.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.861+0000 7fcc9e5ca700 1 Processor -- start 2023-10-03T10:14:07.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.861+0000 7fcc9e5ca700 1 -- start start 2023-10-03T10:14:07.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc9e5ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcc9809e870 0x7fcc9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc9e5ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc9e5ca700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9809c970 con 0x7fcc98131d70 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc9e5ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980a0920 con 0x7fcc9809e870 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc9e5ca700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9809f9c0 con 0x7fcc9809f180 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc97fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcc9809e870 0x7fcc9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54064/0 (socket says 172.21.15.125:54064) 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc977fe700 1 -- 172.21.15.125:0/1253198792 learned_addr learned my addr 172.21.15.125:0/1253198792 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc97fff700 1 -- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 msgr2=0x7fcc98131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc97fff700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc97fff700 1 -- 172.21.15.125:0/1253198792 >> v1:172.21.15.125:6789/0 conn(0x7fcc98131d70 legacy=0x7fcc98138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc97fff700 1 -- 172.21.15.125:0/1253198792 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9809bab0 con 0x7fcc9809e870 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc96ffd700 1 -- 172.21.15.125:0/1253198792 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573543913 0 0) 0x7fcc9809c970 con 0x7fcc98131d70 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.862+0000 7fcc977fe700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc97fff700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809e870 0x7fcc9809ec40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009840 tx=0x7fcc88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3e3a0315adf6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc96ffd700 1 -- 172.21.15.125:0/1253198792 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011830 con 0x7fcc9809e870 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc96ffd700 1 -- 172.21.15.125:0/1253198792 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc88011990 con 0x7fcc9809e870 2023-10-03T10:14:07.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc96ffd700 1 -- 172.21.15.125:0/1253198792 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011d20 con 0x7fcc9809e870 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809e870 msgr2=0x7fcc9809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809e870 0x7fcc9809ec40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009840 tx=0x7fcc88009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1253198792 shutdown_connections 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809e870 0x7fcc9809ec40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1253198792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809f180 0x7fcc98131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.863+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1253198792 >> 172.21.15.125:0/1253198792 conn(0x7fcc980a4430 msgr2=0x7fcc980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.864+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1253198792 shutdown_connections 2023-10-03T10:14:07.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.864+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1253198792 wait complete. 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.864+0000 7fcc9e5ca700 1 Processor -- start 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 -- start start 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 0x7fcc9811f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 0x7fcc9811fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981205b0 con 0x7fcc9809f180 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98122b90 con 0x7fcc9809e870 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9e5ca700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98122680 con 0x7fcc98131d70 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc9cb67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 0x7fcc9811fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54500/0 (socket says 172.21.15.125:54500) 2023-10-03T10:14:07.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 -- 172.21.15.125:0/1009219599 learned_addr learned my addr 172.21.15.125:0/1009219599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc97fff700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 0x7fcc9811f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 -- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 msgr2=0x7fcc9811fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 0x7fcc9811fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 -- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 msgr2=0x7fcc9811f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 0x7fcc9811f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.865+0000 7fcc977fe700 1 -- 172.21.15.125:0/1009219599 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c009550 con 0x7fcc9809f180 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc97fff700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 0x7fcc9811f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc9cb67700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 0x7fcc9811fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc977fe700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00ec10 tx=0x7fcc8c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00c850 con 0x7fcc9809f180 2023-10-03T10:14:07.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00c9b0 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc880094a0 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00cd40 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.866+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc980a2b10 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.867+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc8c013470 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.867+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcc8c03f890 con 0x7fcc9809f180 2023-10-03T10:14:07.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.867+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9811be60 con 0x7fcc9809f180 2023-10-03T10:14:07.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.871+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc8c013720 con 0x7fcc9809f180 2023-10-03T10:14:07.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 Processor -- start 2023-10-03T10:14:07.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 -- start start 2023-10-03T10:14:07.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 0x7f9ff00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ff00a1380 0x7f9ff0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff009e9d0 con 0x7f9ff00a1380 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff009dc00 con 0x7f9ff00a0a70 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff6371700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff009dec0 con 0x7f9ff0133f50 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9fef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ff00a1380 0x7f9ff0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9feffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 0x7f9ff00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9ff490e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9fef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ff00a1380 0x7f9ff0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54514/0 (socket says 172.21.15.125:54514) 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.902+0000 7f9fef7fe700 1 -- 172.21.15.125:0/907845179 learned_addr learned my addr 172.21.15.125:0/907845179 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 -- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 msgr2=0x7f9ff0134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff0134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 -- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 msgr2=0x7f9ff00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 0x7f9ff00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 -- 172.21.15.125:0/907845179 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff009e6a0 con 0x7f9ff00a1380 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9feffff700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 0x7f9ff00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9fef7fe700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a1380 0x7f9ff0133a10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40098f0 tx=0x7f9fe4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127746865f918af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9feeffd700 1 -- 172.21.15.125:0/907845179 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4011830 con 0x7f9ff00a1380 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9feeffd700 1 -- 172.21.15.125:0/907845179 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4011990 con 0x7f9ff00a1380 2023-10-03T10:14:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.903+0000 7f9feeffd700 1 -- 172.21.15.125:0/907845179 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4011d20 con 0x7f9ff00a1380 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a1380 msgr2=0x7f9ff0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a1380 0x7f9ff0133a10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40098f0 tx=0x7f9fe4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- 172.21.15.125:0/907845179 shutdown_connections 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a0a70 0x7f9ff00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- 172.21.15.125:0/907845179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a1380 0x7f9ff0133a10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- 172.21.15.125:0/907845179 >> 172.21.15.125:0/907845179 conn(0x7f9ff00a6610 msgr2=0x7f9ff00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- 172.21.15.125:0/907845179 shutdown_connections 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- 172.21.15.125:0/907845179 wait complete. 2023-10-03T10:14:07.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 Processor -- start 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- start start 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a1380 0x7f9ff011f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff011ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01214e0 con 0x7f9ff00a0a70 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0122780 con 0x7f9ff00a1380 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff6371700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00a03e0 con 0x7f9ff0133f50 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9feffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9ff490e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff011ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9feffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54526/0 (socket says 172.21.15.125:54526) 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9feffff700 1 -- 172.21.15.125:0/2758261501 learned_addr learned my addr 172.21.15.125:0/2758261501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9fef7fe700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a1380 0x7f9ff011f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.905+0000 7f9feffff700 1 -- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 msgr2=0x7f9ff011ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9feffff700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff011ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9feffff700 1 -- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a1380 msgr2=0x7f9ff011f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9feffff700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a1380 0x7f9ff011f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9feffff700 1 -- 172.21.15.125:0/2758261501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094a0 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9feffff700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e980 tx=0x7f9fe000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00096e0 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0013680 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe4009550 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0013a10 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.907+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff0122970 con 0x7f9ff00a0a70 2023-10-03T10:14:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.908+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fe0013b70 con 0x7f9ff00a0a70 2023-10-03T10:14:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.908+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0122b60 con 0x7f9ff00a0a70 2023-10-03T10:14:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.908+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9fe003f6d0 con 0x7f9ff00a0a70 2023-10-03T10:14:07.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:07.911+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fe001ba00 con 0x7f9ff00a0a70 2023-10-03T10:14:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.066+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcc9804f2a0 con 0x7fcc9809f180 2023-10-03T10:14:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.066+0000 7fcc94ff9700 1 -- 172.21.15.125:0/1009219599 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc8c01bb60 con 0x7fcc9809f180 2023-10-03T10:14:08.066 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 msgr2=0x7fcc9811f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00ec10 tx=0x7fcc8c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 shutdown_connections 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc98131d70 0x7fcc9811fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc9809e870 0x7fcc9811f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 --2- 172.21.15.125:0/1009219599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc9809f180 0x7fcc9811f640 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 >> 172.21.15.125:0/1009219599 conn(0x7fcc980a4430 msgr2=0x7fcc98131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 shutdown_connections 2023-10-03T10:14:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.068+0000 7fcc9e5ca700 1 -- 172.21.15.125:0/1009219599 wait complete. 2023-10-03T10:14:08.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:08.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.104+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ff0132280 con 0x7f9ff00a0a70 2023-10-03T10:14:08.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.104+0000 7f9fecff9700 1 -- 172.21.15.125:0/2758261501 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fe0021030 con 0x7f9ff00a0a70 2023-10-03T10:14:08.103 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 msgr2=0x7f9ff011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e980 tx=0x7f9fe000ec90 comp rx=0 tx=0).stop 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 shutdown_connections 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9ff0133f50 0x7f9ff011ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ff00a0a70 0x7f9ff011f480 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 --2- 172.21.15.125:0/2758261501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ff00a1380 0x7f9ff011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 >> 172.21.15.125:0/2758261501 conn(0x7f9ff00a6610 msgr2=0x7f9ff00a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 shutdown_connections 2023-10-03T10:14:08.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.106+0000 7f9ff6371700 1 -- 172.21.15.125:0/2758261501 wait complete. 2023-10-03T10:14:08.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:08.183 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:08.222 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.312+0000 7f7d6c233700 1 Processor -- start 2023-10-03T10:14:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 -- start start 2023-10-03T10:14:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6409e9d0 con 0x7f7d640a0a70 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6409dc00 con 0x7f7d64139200 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6c233700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6409dec0 con 0x7f7d640a1550 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d697ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6a7d0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d69fcf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7d640a0a70 0x7f7d640a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55502/0 (socket says 172.21.15.125:55502) 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d69fcf700 1 -- 172.21.15.125:0/2216883501 learned_addr learned my addr 172.21.15.125:0/2216883501 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d6a7d0700 1 --2- 172.21.15.125:0/2216883501 >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54536/0 (socket says 172.21.15.125:54536) 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.313+0000 7f7d697ce700 1 --2- 172.21.15.125:0/2216883501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54102/0 (socket says 172.21.15.125:54102) 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d697ce700 1 -- 172.21.15.125:0/2216883501 >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 msgr2=0x7f7d6413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d697ce700 1 --2- 172.21.15.125:0/2216883501 >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d697ce700 1 -- 172.21.15.125:0/2216883501 >> v1:172.21.15.125:6789/0 conn(0x7f7d640a0a70 legacy=0x7f7d640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d68fcd700 1 -- 172.21.15.125:0/2216883501 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866834428 0 0) 0x7f7d6409e9d0 con 0x7f7d640a0a70 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d697ce700 1 -- 172.21.15.125:0/2216883501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6409e6a0 con 0x7f7d640a1550 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d6a7d0700 1 --2- 172.21.15.125:0/2216883501 >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d697ce700 1 --2- 172.21.15.125:0/2216883501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54136b633d92521a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d68fcd700 1 -- 172.21.15.125:0/2216883501 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011830 con 0x7f7d640a1550 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d68fcd700 1 -- 172.21.15.125:0/2216883501 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54011990 con 0x7f7d640a1550 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.314+0000 7f7d68fcd700 1 -- 172.21.15.125:0/2216883501 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011d20 con 0x7f7d640a1550 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 -- 172.21.15.125:0/2216883501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 msgr2=0x7f7d64138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 --2- 172.21.15.125:0/2216883501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 -- 172.21.15.125:0/2216883501 shutdown_connections 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 --2- 172.21.15.125:0/2216883501 >> v2:172.21.15.125:3300/0 conn(0x7f7d64139200 0x7f7d6413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 --2- 172.21.15.125:0/2216883501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d64138cc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 -- 172.21.15.125:0/2216883501 >> 172.21.15.125:0/2216883501 conn(0x7f7d640a6610 msgr2=0x7f7d640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 -- 172.21.15.125:0/2216883501 shutdown_connections 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.315+0000 7f7d6c233700 1 -- 172.21.15.125:0/2216883501 wait complete. 2023-10-03T10:14:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.316+0000 7f7d6c233700 1 Processor -- start 2023-10-03T10:14:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.316+0000 7f7d6c233700 1 -- start start 2023-10-03T10:14:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 0x7f7d6411e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 0x7f7d6411f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6409cbb0 con 0x7f7d640a0a70 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64122370 con 0x7f7d640a1550 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6c233700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64121a10 con 0x7f7d64139200 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54112/0 (socket says 172.21.15.125:54112) 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 -- 172.21.15.125:0/3239106141 learned_addr learned my addr 172.21.15.125:0/3239106141 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6a7d0700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 0x7f7d6411f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d69fcf700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 0x7f7d6411e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 -- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 msgr2=0x7f7d6411f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 0x7f7d6411f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 -- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 msgr2=0x7f7d6411e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 0x7f7d6411e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 -- 172.21.15.125:0/3239106141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c009a70 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d69fcf700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 0x7f7d6411e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d6a7d0700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 0x7f7d6411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d697ce700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009fd0 tx=0x7f7d54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540045d0 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.317+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5401f070 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.318+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540038a0 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.318+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d540094a0 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.318+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d64121f80 con 0x7f7d640a1550 2023-10-03T10:14:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.318+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d54003a00 con 0x7f7d640a1550 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.318+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d640a03e0 con 0x7f7d640a1550 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.319+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d54021070 con 0x7f7d640a1550 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.323+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d54024c00 con 0x7f7d640a1550 2023-10-03T10:14:08.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.354+0000 7fa8cb082700 1 Processor -- start 2023-10-03T10:14:08.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.354+0000 7fa8cb082700 1 -- start start 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8cb082700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8cb082700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8c40a1380 0x7fa8c4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8cb082700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c409dc00 con 0x7fa8c4133f50 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8cb082700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c409ea60 con 0x7fa8c40a1380 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8cb082700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c409dec0 con 0x7fa8c40a0a70 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c8e1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8c40a1380 0x7fa8c4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c8e1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54120/0 (socket says 172.21.15.125:54120) 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8c40a1380 0x7fa8c4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54562/0 (socket says 172.21.15.125:54562) 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c8e1e700 1 -- 172.21.15.125:0/2743187314 learned_addr learned my addr 172.21.15.125:0/2743187314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 -- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 msgr2=0x7fa8c40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 -- 172.21.15.125:0/2743187314 >> v1:172.21.15.125:6789/0 conn(0x7fa8c4133f50 legacy=0x7fa8c413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c3fff700 1 -- 172.21.15.125:0/2743187314 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c409e6a0 con 0x7fa8c40a1380 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.355+0000 7fa8c8e1e700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8c3fff700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c4133a10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009840 tx=0x7fa8b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d85e2af8bb3f6d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8c37fe700 1 -- 172.21.15.125:0/2743187314 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011830 con 0x7fa8c40a1380 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8c37fe700 1 -- 172.21.15.125:0/2743187314 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0011990 con 0x7fa8c40a1380 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8c37fe700 1 -- 172.21.15.125:0/2743187314 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011d20 con 0x7fa8c40a1380 2023-10-03T10:14:08.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 -- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 msgr2=0x7fa8c4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c4133a10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009840 tx=0x7fa8b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 -- 172.21.15.125:0/2743187314 shutdown_connections 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 --2- 172.21.15.125:0/2743187314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c4133a10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 -- 172.21.15.125:0/2743187314 >> 172.21.15.125:0/2743187314 conn(0x7fa8c40a6610 msgr2=0x7fa8c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 -- 172.21.15.125:0/2743187314 shutdown_connections 2023-10-03T10:14:08.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.356+0000 7fa8cb082700 1 -- 172.21.15.125:0/2743187314 wait complete. 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.357+0000 7fa8cb082700 1 Processor -- start 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.357+0000 7fa8cb082700 1 -- start start 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c41c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 0x7fa8c41c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41253f0 con 0x7fa8c40a1380 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4124680 con 0x7fa8c40a0a70 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8cb082700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4122f50 con 0x7fa8c4133f50 2023-10-03T10:14:08.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 0x7fa8c41c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c8e1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c41c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54576/0 (socket says 172.21.15.125:54576) 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c3fff700 1 -- 172.21.15.125:0/459296280 learned_addr learned my addr 172.21.15.125:0/459296280 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 -- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 msgr2=0x7fa8c41c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c41c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 -- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 msgr2=0x7fa8c41c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 -- 172.21.15.125:0/459296280 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009550 con 0x7fa8c4133f50 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c3fff700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c961f700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 0x7fa8c41c8cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00cbc0 tx=0x7fa8bc00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.358+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003c00 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc003d60 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00094a0 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00aa40 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c41262b0 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8bc00aba0 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa8bc03f640 con 0x7fa8c4133f50 2023-10-03T10:14:08.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.359+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c404f2a0 con 0x7fa8c4133f50 2023-10-03T10:14:08.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.364+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8bc0102e0 con 0x7fa8c4133f50 2023-10-03T10:14:08.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.520+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d640a2710 con 0x7f7d640a1550 2023-10-03T10:14:08.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.520+0000 7f7d5a7fc700 1 -- 172.21.15.125:0/3239106141 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d5402b070 con 0x7f7d640a1550 2023-10-03T10:14:08.519 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 msgr2=0x7f7d6411ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009fd0 tx=0x7f7d54004750 comp rx=0 tx=0).stop 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 shutdown_connections 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d64139200 0x7f7d6411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a0a70 0x7f7d6411e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 --2- 172.21.15.125:0/3239106141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d640a1550 0x7f7d6411ed10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 >> 172.21.15.125:0/3239106141 conn(0x7f7d640a6610 msgr2=0x7f7d64138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 shutdown_connections 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.522+0000 7f7d6c233700 1 -- 172.21.15.125:0/3239106141 wait complete. 2023-10-03T10:14:08.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.557+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8c40a2710 con 0x7fa8c4133f50 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.557+0000 7fa8c17fa700 1 -- 172.21.15.125:0/459296280 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8bc01a360 con 0x7fa8c4133f50 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 msgr2=0x7fa8c41c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 0x7fa8c41c8cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00cbc0 tx=0x7fa8bc00ced0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 shutdown_connections 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8c4133f50 0x7fa8c41c8cf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8c40a0a70 0x7fa8c41c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 --2- 172.21.15.125:0/459296280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8c40a1380 0x7fa8c41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 >> 172.21.15.125:0/459296280 conn(0x7fa8c40a6610 msgr2=0x7fa8c40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 shutdown_connections 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:08.559+0000 7fa8cb082700 1 -- 172.21.15.125:0/459296280 wait complete. 2023-10-03T10:14:08.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:09.081 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:09.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.213+0000 7f5e044a0700 1 Processor -- start 2023-10-03T10:14:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.213+0000 7f5e044a0700 1 -- start start 2023-10-03T10:14:09.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e044a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5dfc0a1550 0x7f5dfc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e044a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 0x7f5dfc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e044a0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc09e9d0 con 0x7f5dfc0a0a70 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e044a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc09dc00 con 0x7f5dfc0a1550 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e044a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc09dec0 con 0x7f5dfc139200 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e01a3b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5dfc0a1550 0x7f5dfc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e0223c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5dfc0a0a70 0x7f5dfc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55518/0 (socket says 172.21.15.125:55518) 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e01a3b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5dfc0a1550 0x7f5dfc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54582/0 (socket says 172.21.15.125:54582) 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e0223c700 1 -- 172.21.15.125:0/631220693 learned_addr learned my addr 172.21.15.125:0/631220693 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.214+0000 7f5e02a3d700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 0x7f5dfc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e01a3b700 1 -- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 msgr2=0x7f5dfc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e01a3b700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 0x7f5dfc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e01a3b700 1 -- 172.21.15.125:0/631220693 >> v1:172.21.15.125:6789/0 conn(0x7f5dfc0a0a70 legacy=0x7f5dfc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e01a3b700 1 -- 172.21.15.125:0/631220693 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc09e6a0 con 0x7f5dfc0a1550 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e0123a700 1 -- 172.21.15.125:0/631220693 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552628429 0 0) 0x7f5dfc09e9d0 con 0x7f5dfc0a0a70 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e02a3d700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 0x7f5dfc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e01a3b700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc0a1550 0x7f5dfc138cc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009840 tx=0x7f5dec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8587db179e64afce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e0123a700 1 -- 172.21.15.125:0/631220693 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011830 con 0x7f5dfc0a1550 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e0123a700 1 -- 172.21.15.125:0/631220693 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec011990 con 0x7f5dfc0a1550 2023-10-03T10:14:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.215+0000 7f5e0123a700 1 -- 172.21.15.125:0/631220693 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec011d20 con 0x7f5dfc0a1550 2023-10-03T10:14:09.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 -- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc0a1550 msgr2=0x7f5dfc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc0a1550 0x7f5dfc138cc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009840 tx=0x7f5dec009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 -- 172.21.15.125:0/631220693 shutdown_connections 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc139200 0x7f5dfc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 --2- 172.21.15.125:0/631220693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc0a1550 0x7f5dfc138cc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 -- 172.21.15.125:0/631220693 >> 172.21.15.125:0/631220693 conn(0x7f5dfc0a6610 msgr2=0x7f5dfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 -- 172.21.15.125:0/631220693 shutdown_connections 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.216+0000 7f5e044a0700 1 -- 172.21.15.125:0/631220693 wait complete. 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 Processor -- start 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 -- start start 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5dfc0a0a70 0x7f5dfc1207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc0a1550 0x7f5dfc120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc124420 con 0x7f5dfc139200 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0a5100 con 0x7f5dfc0a1550 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e044a0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc123ac0 con 0x7f5dfc0a0a70 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e02a3d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e0223c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5dfc0a0a70 0x7f5dfc1207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e01a3b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc0a1550 0x7f5dfc120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e02a3d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54588/0 (socket says 172.21.15.125:54588) 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.217+0000 7f5e02a3d700 1 -- 172.21.15.125:0/1715364009 learned_addr learned my addr 172.21.15.125:0/1715364009 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 -- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5dfc0a0a70 msgr2=0x7f5dfc1207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5dfc0a0a70 0x7f5dfc1207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 -- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc0a1550 msgr2=0x7f5dfc120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc0a1550 0x7f5dfc120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 -- 172.21.15.125:0/1715364009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009a70 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e02a3d700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5df400efb0 tx=0x7f5df400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400cc90 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400f040 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0094a0 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4014480 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.218+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc124030 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.219+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5df40145e0 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.219+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5df4040310 con 0x7f5dfc139200 2023-10-03T10:14:09.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.219+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc04f2a0 con 0x7f5dfc139200 2023-10-03T10:14:09.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.224+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5df40076f0 con 0x7f5dfc139200 2023-10-03T10:14:09.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.253+0000 7f0479d04700 1 Processor -- start 2023-10-03T10:14:09.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 -- start start 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f047413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047409dc00 con 0x7f04740a1380 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047409ea90 con 0x7f04740a0a70 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0479d04700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047409dec0 con 0x7f0474134120 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f04737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0473fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f047413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f04737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54594/0 (socket says 172.21.15.125:54594) 2023-10-03T10:14:09.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f04737fe700 1 -- 172.21.15.125:0/4193524773 learned_addr learned my addr 172.21.15.125:0/4193524773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f04727fc700 1 -- 172.21.15.125:0/4193524773 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088568264 0 0) 0x7f047409dc00 con 0x7f04740a1380 2023-10-03T10:14:09.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f04727fc700 1 -- 172.21.15.125:0/4193524773 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c0035b0 con 0x7f04740a1380 2023-10-03T10:14:09.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0473fff700 1 -- 172.21.15.125:0/4193524773 >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 msgr2=0x7f04740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.254+0000 7f0473fff700 1 --2- 172.21.15.125:0/4193524773 >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0473fff700 1 -- 172.21.15.125:0/4193524773 >> v1:172.21.15.125:6789/0 conn(0x7f04740a1380 legacy=0x7f0474133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0473fff700 1 -- 172.21.15.125:0/4193524773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047409e6a0 con 0x7f0474134120 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f04737fe700 1 --2- 172.21.15.125:0/4193524773 >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0473fff700 1 --2- 172.21.15.125:0/4193524773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f047413bce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f046c009840 tx=0x7f046c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1da7b3a163a0692 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f04727fc700 1 -- 172.21.15.125:0/4193524773 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011830 con 0x7f0474134120 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f04727fc700 1 -- 172.21.15.125:0/4193524773 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c011990 con 0x7f0474134120 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f04727fc700 1 -- 172.21.15.125:0/4193524773 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011d20 con 0x7f0474134120 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 -- 172.21.15.125:0/4193524773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 msgr2=0x7f047413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 --2- 172.21.15.125:0/4193524773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f047413bce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f046c009840 tx=0x7f046c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:09.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 -- 172.21.15.125:0/4193524773 shutdown_connections 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 --2- 172.21.15.125:0/4193524773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f047413bce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 --2- 172.21.15.125:0/4193524773 >> v2:172.21.15.125:3300/0 conn(0x7f04740a0a70 0x7f04740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 -- 172.21.15.125:0/4193524773 >> 172.21.15.125:0/4193524773 conn(0x7f04740a6610 msgr2=0x7f04740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 -- 172.21.15.125:0/4193524773 shutdown_connections 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.255+0000 7f0479d04700 1 -- 172.21.15.125:0/4193524773 wait complete. 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.256+0000 7f0479d04700 1 Processor -- start 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 -- start start 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 0x7f0474122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f04741230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0474124b30 con 0x7f04740a1380 2023-10-03T10:14:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0474125e90 con 0x7f0474134120 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0479d04700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0474124370 con 0x7f04740a0a70 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0473fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f04741230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48194/0 (socket says 172.21.15.125:48194) 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0472ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 0x7f0474122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 -- 172.21.15.125:0/2460658535 learned_addr learned my addr 172.21.15.125:0/2460658535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 -- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 msgr2=0x7f04741230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f04741230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 -- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 msgr2=0x7f0474122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 0x7f0474122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f04737fe700 1 -- 172.21.15.125:0/2460658535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464009b30 con 0x7f04740a0a70 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0473fff700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f04741230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.257+0000 7f0472ffd700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 0x7f0474122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f04737fe700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0464009f20 tx=0x7f046400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046400cbc0 con 0x7f04740a0a70 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400f040 con 0x7f04740a0a70 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464014480 con 0x7f04740a0a70 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c0094a0 con 0x7f04740a0a70 2023-10-03T10:14:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.258+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0474133170 con 0x7f04740a0a70 2023-10-03T10:14:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.259+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04640145e0 con 0x7f04740a0a70 2023-10-03T10:14:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.259+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047404f2a0 con 0x7f04740a0a70 2023-10-03T10:14:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.259+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f046403fba0 con 0x7f04740a0a70 2023-10-03T10:14:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.263+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0464012700 con 0x7f04740a0a70 2023-10-03T10:14:09.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.419+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5dfc0a03e0 con 0x7f5dfc139200 2023-10-03T10:14:09.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.419+0000 7f5df2ffd700 1 -- 172.21.15.125:0/1715364009 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5df402c090 con 0x7f5dfc139200 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 msgr2=0x7f5dfc121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5df400efb0 tx=0x7f5df400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 shutdown_connections 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dfc139200 0x7f5dfc121270 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5dfc0a0a70 0x7f5dfc1207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 --2- 172.21.15.125:0/1715364009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dfc0a1550 0x7f5dfc120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 >> 172.21.15.125:0/1715364009 conn(0x7f5dfc0a6610 msgr2=0x7f5dfc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 shutdown_connections 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.421+0000 7f5e044a0700 1 -- 172.21.15.125:0/1715364009 wait complete. 2023-10-03T10:14:09.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:09.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.458+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0474072980 con 0x7f04740a0a70 2023-10-03T10:14:09.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.458+0000 7f045bfff700 1 -- 172.21.15.125:0/2460658535 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0464012340 con 0x7f04740a0a70 2023-10-03T10:14:09.458 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 msgr2=0x7f0474122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0464009f20 tx=0x7f046400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 shutdown_connections 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0474134120 0x7f04741230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f04740a0a70 0x7f0474122650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 --2- 172.21.15.125:0/2460658535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04740a1380 0x7f0474122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 >> 172.21.15.125:0/2460658535 conn(0x7f04740a6610 msgr2=0x7f04740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 shutdown_connections 2023-10-03T10:14:09.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.460+0000 7f0479d04700 1 -- 172.21.15.125:0/2460658535 wait complete. 2023-10-03T10:14:09.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:09.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:09.571 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:09.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.664+0000 7fd224158700 1 Processor -- start 2023-10-03T10:14:09.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.664+0000 7fd224158700 1 -- start start 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.664+0000 7fd224158700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 0x7fd21c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd224158700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 0x7fd21c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd224158700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c06b5c0 con 0x7fd21c131a00 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd224158700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c06e900 con 0x7fd21c06a770 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd224158700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c09d180 con 0x7fd21c09dec0 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 0x7fd21c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2226f5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd21c131a00 0x7fd21c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55532/0 (socket says 172.21.15.125:55532) 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2226f5700 1 -- 172.21.15.125:0/160685135 learned_addr learned my addr 172.21.15.125:0/160685135 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd221ef4700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 0x7fd21c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 -- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 msgr2=0x7fd21c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 0x7fd21c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd220ef2700 1 -- 172.21.15.125:0/160685135 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176498049 0 0) 0x7fd21c06b5c0 con 0x7fd21c131a00 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 -- 172.21.15.125:0/160685135 >> v1:172.21.15.125:6789/0 conn(0x7fd21c131a00 legacy=0x7fd21c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 -- 172.21.15.125:0/160685135 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c09e780 con 0x7fd21c09dec0 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd221ef4700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 0x7fd21c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd2216f3700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 0x7fd21c06b080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009870 tx=0x7fd20c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbcde739e6daf6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd220ef2700 1 -- 172.21.15.125:0/160685135 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011830 con 0x7fd21c09dec0 2023-10-03T10:14:09.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd220ef2700 1 -- 172.21.15.125:0/160685135 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c011990 con 0x7fd21c09dec0 2023-10-03T10:14:09.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.665+0000 7fd220ef2700 1 -- 172.21.15.125:0/160685135 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011d20 con 0x7fd21c09dec0 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 -- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 msgr2=0x7fd21c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 0x7fd21c06b080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009870 tx=0x7fd20c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 -- 172.21.15.125:0/160685135 shutdown_connections 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c06a770 0x7fd21c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 --2- 172.21.15.125:0/160685135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c09dec0 0x7fd21c06b080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 -- 172.21.15.125:0/160685135 >> 172.21.15.125:0/160685135 conn(0x7fd21c099c40 msgr2=0x7fd21c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 -- 172.21.15.125:0/160685135 shutdown_connections 2023-10-03T10:14:09.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.666+0000 7fd224158700 1 -- 172.21.15.125:0/160685135 wait complete. 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.667+0000 7fd224158700 1 Processor -- start 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.667+0000 7fd224158700 1 -- start start 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 0x7fd21c11a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 0x7fd21c11a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c11d1d0 con 0x7fd21c131a00 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c071ce0 con 0x7fd21c09dec0 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd224158700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c130d50 con 0x7fd21c06a770 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd221ef4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2216f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 0x7fd21c11a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd221ef4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48210/0 (socket says 172.21.15.125:48210) 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 0x7fd21c11a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd221ef4700 1 -- 172.21.15.125:0/1438804344 learned_addr learned my addr 172.21.15.125:0/1438804344 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2216f3700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 0x7fd21c11a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54192/0 (socket says 172.21.15.125:54192) 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 -- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 msgr2=0x7fd21c119f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 -- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 msgr2=0x7fd21c11a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 0x7fd21c11a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd2226f5700 1 -- 172.21.15.125:0/1438804344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180094a0 con 0x7fd21c131a00 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.668+0000 7fd221ef4700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd2226f5700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 0x7fd21c11a9a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cbe0 tx=0x7fd21400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400aa40 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400abc0 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c0094a0 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2140070d0 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.669+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c11cd80 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.670+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd214007230 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.670+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c04f2a0 con 0x7fd21c131a00 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.670+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd21403f390 con 0x7fd21c131a00 2023-10-03T10:14:09.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.674+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2140074e0 con 0x7fd21c131a00 2023-10-03T10:14:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.705+0000 7f6c5fd5c700 1 Processor -- start 2023-10-03T10:14:09.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 -- start start 2023-10-03T10:14:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580a3b60 con 0x7f6c580a0a70 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581348e0 con 0x7f6c58133f70 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.706+0000 7f6c5fd5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5809b110 con 0x7f6c5809ad40 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5e2f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5d2f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5e2f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54626/0 (socket says 172.21.15.125:54626) 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5d2f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54208/0 (socket says 172.21.15.125:54208) 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5e2f9700 1 -- 172.21.15.125:0/3593206665 learned_addr learned my addr 172.21.15.125:0/3593206665 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48214/0 (socket says 172.21.15.125:48214) 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 msgr2=0x7f6c581343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3593206665 >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 msgr2=0x7f6c580a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3593206665 >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3593206665 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580a2fa0 con 0x7f6c5809ad40 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5d2f7700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5e2f9700 1 --2- 172.21.15.125:0/3593206665 >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009840 tx=0x7f6c54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e49de848e716e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5caf6700 1 -- 172.21.15.125:0/3593206665 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54011830 con 0x7f6c5809ad40 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5caf6700 1 -- 172.21.15.125:0/3593206665 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54011990 con 0x7f6c5809ad40 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.707+0000 7f6c5caf6700 1 -- 172.21.15.125:0/3593206665 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54011d20 con 0x7f6c5809ad40 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 msgr2=0x7f6c58133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009840 tx=0x7f6c54009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:09.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3593206665 shutdown_connections 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3593206665 >> v2:172.21.15.125:3300/0 conn(0x7f6c580a0a70 0x7f6c580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c5809ad40 0x7f6c58133a30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3593206665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3593206665 >> 172.21.15.125:0/3593206665 conn(0x7f6c58099c40 msgr2=0x7f6c5806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3593206665 shutdown_connections 2023-10-03T10:14:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.708+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3593206665 wait complete. 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 Processor -- start 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 -- start start 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c58121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581327d0 con 0x7f6c5809ad40 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58124ca0 con 0x7f6c58133f70 2023-10-03T10:14:09.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5fd5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5809d360 con 0x7f6c580a0a70 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5d2f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5daf8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5d2f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48218/0 (socket says 172.21.15.125:48218) 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5daf8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54642/0 (socket says 172.21.15.125:54642) 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5d2f7700 1 -- 172.21.15.125:0/3288717818 learned_addr learned my addr 172.21.15.125:0/3288717818 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.709+0000 7f6c5e2f9700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c58121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 msgr2=0x7f6c58121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 msgr2=0x7f6c58121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c58121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 -- 172.21.15.125:0/3288717818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009b30 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5d2f7700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5daf8700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009840 tx=0x7f6c54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54004450 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5401e070 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c480094a0 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540038a0 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.710+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540094a0 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.711+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c54003a00 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.711+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c54020070 con 0x7f6c5809ad40 2023-10-03T10:14:09.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.711+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58124ae0 con 0x7f6c5809ad40 2023-10-03T10:14:09.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.716+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c54015080 con 0x7f6c5809ad40 2023-10-03T10:14:09.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.880+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd21c11d5c0 con 0x7fd21c131a00 2023-10-03T10:14:09.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.880+0000 7fd2127fc700 1 -- 172.21.15.125:0/1438804344 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd214018020 con 0x7fd21c131a00 2023-10-03T10:14:09.880 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 msgr2=0x7fd21c11a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 0x7fd21c11a9a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cbe0 tx=0x7fd21400cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 shutdown_connections 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd21c131a00 0x7fd21c11a9a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd21c06a770 0x7fd21c119f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 --2- 172.21.15.125:0/1438804344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd21c09dec0 0x7fd21c11a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 >> 172.21.15.125:0/1438804344 conn(0x7fd21c099c40 msgr2=0x7fd21c12ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 shutdown_connections 2023-10-03T10:14:09.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.882+0000 7fd224158700 1 -- 172.21.15.125:0/1438804344 wait complete. 2023-10-03T10:14:09.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:09.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.921+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c581257d0 con 0x7f6c5809ad40 2023-10-03T10:14:09.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.921+0000 7f6c4e7fc700 1 -- 172.21.15.125:0/3288717818 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c540045b0 con 0x7f6c5809ad40 2023-10-03T10:14:09.921 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:09.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 msgr2=0x7f6c581214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009840 tx=0x7f6c54004750 comp rx=0 tx=0).stop 2023-10-03T10:14:09.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 shutdown_connections 2023-10-03T10:14:09.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c58133f70 0x7f6c58121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c5809ad40 0x7f6c581214e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.923+0000 7f6c5fd5c700 1 --2- 172.21.15.125:0/3288717818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c580a0a70 0x7f6c58121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.924+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 >> 172.21.15.125:0/3288717818 conn(0x7f6c58099c40 msgr2=0x7f6c5809e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.924+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 shutdown_connections 2023-10-03T10:14:09.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:09.924+0000 7f6c5fd5c700 1 -- 172.21.15.125:0/3288717818 wait complete. 2023-10-03T10:14:09.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:10.433 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:10.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:10.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.560+0000 7f98ad8e0700 1 Processor -- start 2023-10-03T10:14:10.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 -- start start 2023-10-03T10:14:10.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98a80a1380 0x7f98a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a809dc00 con 0x7f98a8133f50 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a809ea60 con 0x7f98a80a1380 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98ad8e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a809dec0 con 0x7f98a80a0a70 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98a80a1380 0x7f98a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54228/0 (socket says 172.21.15.125:54228) 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98a80a1380 0x7f98a8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54650/0 (socket says 172.21.15.125:54650) 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a6ffd700 1 -- 172.21.15.125:0/397560034 learned_addr learned my addr 172.21.15.125:0/397560034 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a77fe700 1 --1- 172.21.15.125:0/397560034 >> v1:172.21.15.125:6789/0 conn(0x7f98a8133f50 0x7f98a813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55540/0 (socket says 172.21.15.125:55540) 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 -- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 msgr2=0x7f98a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 -- 172.21.15.125:0/397560034 >> v1:172.21.15.125:6789/0 conn(0x7f98a8133f50 legacy=0x7f98a813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a67fc700 1 -- 172.21.15.125:0/397560034 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a809e6a0 con 0x7f98a80a1380 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98a6ffd700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.561+0000 7f98a5ffb700 1 -- 172.21.15.125:0/397560034 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166468999 0 0) 0x7f98a809dc00 con 0x7f98a8133f50 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98a67fc700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8133a10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f989c009840 tx=0x7f989c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9175161af8d996 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98a5ffb700 1 -- 172.21.15.125:0/397560034 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011830 con 0x7f98a80a1380 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98a5ffb700 1 -- 172.21.15.125:0/397560034 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c011990 con 0x7f98a80a1380 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98a5ffb700 1 -- 172.21.15.125:0/397560034 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011d20 con 0x7f98a80a1380 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 -- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 msgr2=0x7f98a8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8133a10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f989c009840 tx=0x7f989c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 -- 172.21.15.125:0/397560034 shutdown_connections 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/397560034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8133a10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 -- 172.21.15.125:0/397560034 >> 172.21.15.125:0/397560034 conn(0x7f98a80a6610 msgr2=0x7f98a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.562+0000 7f98ad8e0700 1 -- 172.21.15.125:0/397560034 shutdown_connections 2023-10-03T10:14:10.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.563+0000 7f98ad8e0700 1 -- 172.21.15.125:0/397560034 wait complete. 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.563+0000 7f98ad8e0700 1 Processor -- start 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 -- start start 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 0x7f98a8123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8126220 con 0x7f98a80a1380 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8133960 con 0x7f98a80a0a70 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98ad8e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8133420 con 0x7f98a8133f50 2023-10-03T10:14:10.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 0x7f98a8123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54230/0 (socket says 172.21.15.125:54230) 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 0x7f98a8123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48228/0 (socket says 172.21.15.125:48228) 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 -- 172.21.15.125:0/1679311741 learned_addr learned my addr 172.21.15.125:0/1679311741 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a67fc700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 -- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 msgr2=0x7f98a8123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 0x7f98a8123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 -- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 msgr2=0x7f98a8122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.564+0000 7f98a6ffd700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f98a6ffd700 1 -- 172.21.15.125:0/1679311741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009550 con 0x7f98a80a0a70 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f98a6ffd700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f989800ec10 tx=0x7f989800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800c850 con 0x7f98a80a0a70 2023-10-03T10:14:10.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989800c9b0 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c0094a0 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800cd40 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.565+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a8126bb0 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.566+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9898013470 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.566+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f989803fc40 con 0x7f98a80a0a70 2023-10-03T10:14:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.566+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a804f2a0 con 0x7f98a80a0a70 2023-10-03T10:14:10.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.571+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9898013720 con 0x7f98a80a0a70 2023-10-03T10:14:10.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.602+0000 7f8bbfc5f700 1 Processor -- start 2023-10-03T10:14:10.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.602+0000 7f8bbfc5f700 1 -- start start 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbfc5f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bb809ad40 0x7f8bb8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbfc5f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb8133f70 0x7f8bb81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbfc5f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb809b110 con 0x7f8bb80a0a70 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbfc5f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80a3b60 con 0x7f8bb809ad40 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbfc5f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb81348e0 con 0x7f8bb8133f70 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bb809ad40 0x7f8bb8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bb809ad40 0x7f8bb8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54666/0 (socket says 172.21.15.125:54666) 2023-10-03T10:14:10.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd1fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb8133f70 0x7f8bb81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/2466024495 learned_addr learned my addr 172.21.15.125:0/2466024495 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbe1fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8bb80a0a70 0x7f8bb80a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55550/0 (socket says 172.21.15.125:55550) 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb8133f70 msgr2=0x7f8bb81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 --2- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb8133f70 0x7f8bb81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/2466024495 >> v1:172.21.15.125:6789/0 conn(0x7f8bb80a0a70 legacy=0x7f8bb80a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbc9f9700 1 -- 172.21.15.125:0/2466024495 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909779967 0 0) 0x7f8bb809b110 con 0x7f8bb80a0a70 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.603+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/2466024495 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80a2fa0 con 0x7f8bb809ad40 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbd9fb700 1 --2- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb809ad40 0x7f8bb8133a30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098f0 tx=0x7f8bb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2c9ee5da390268 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbc9f9700 1 -- 172.21.15.125:0/2466024495 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011830 con 0x7f8bb809ad40 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbc9f9700 1 -- 172.21.15.125:0/2466024495 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4011990 con 0x7f8bb809ad40 2023-10-03T10:14:10.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbc9f9700 1 -- 172.21.15.125:0/2466024495 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011d20 con 0x7f8bb809ad40 2023-10-03T10:14:10.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb809ad40 msgr2=0x7f8bb8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb809ad40 0x7f8bb8133a30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40098f0 tx=0x7f8bb4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/2466024495 shutdown_connections 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb809ad40 0x7f8bb8133a30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/2466024495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb8133f70 0x7f8bb81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/2466024495 >> 172.21.15.125:0/2466024495 conn(0x7f8bb8099c40 msgr2=0x7f8bb806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/2466024495 shutdown_connections 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.604+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/2466024495 wait complete. 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.605+0000 7f8bbfc5f700 1 Processor -- start 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.605+0000 7f8bbfc5f700 1 -- start start 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bb80a0a70 0x7f8bb8121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb8133f70 0x7f8bb8121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8123d00 con 0x7f8bb8133f70 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb81256d0 con 0x7f8bb80a0a70 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbfc5f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8124d10 con 0x7f8bb809ad40 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbe1fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb8133f70 0x7f8bb8121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48252/0 (socket says 172.21.15.125:48252) 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/1661423406 learned_addr learned my addr 172.21.15.125:0/1661423406 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd1fa700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bb80a0a70 0x7f8bb8121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bb80a0a70 msgr2=0x7f8bb8121730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bb80a0a70 0x7f8bb8121730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb8133f70 msgr2=0x7f8bb8121c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb8133f70 0x7f8bb8121c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 -- 172.21.15.125:0/1661423406 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb4009550 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.606+0000 7f8bbd9fb700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4014040 tx=0x7f8bb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4004510 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb401e070 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb8124800 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40038c0 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb809c7e0 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.607+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bb4003a20 con 0x7f8bb809ad40 2023-10-03T10:14:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.608+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb811e060 con 0x7f8bb809ad40 2023-10-03T10:14:10.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.608+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bb4040610 con 0x7f8bb809ad40 2023-10-03T10:14:10.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.616+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bb4015070 con 0x7f8bb809ad40 2023-10-03T10:14:10.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.769+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98a8072980 con 0x7f98a80a0a70 2023-10-03T10:14:10.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.769+0000 7f988ffff700 1 -- 172.21.15.125:0/1679311741 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9898021070 con 0x7f98a80a0a70 2023-10-03T10:14:10.769 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 msgr2=0x7f98a8122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f989800ec10 tx=0x7f989800ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 shutdown_connections 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98a8133f50 0x7f98a8123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98a80a0a70 0x7f98a8122900 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 --2- 172.21.15.125:0/1679311741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98a80a1380 0x7f98a8122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 >> 172.21.15.125:0/1679311741 conn(0x7f98a80a6610 msgr2=0x7f98a80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 shutdown_connections 2023-10-03T10:14:10.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.771+0000 7f98ad8e0700 1 -- 172.21.15.125:0/1679311741 wait complete. 2023-10-03T10:14:10.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:10.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.809+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bb804f2a0 con 0x7f8bb809ad40 2023-10-03T10:14:10.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.809+0000 7f8bae7fc700 1 -- 172.21.15.125:0/1661423406 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bb4003cd0 con 0x7f8bb809ad40 2023-10-03T10:14:10.809 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:10.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 msgr2=0x7f8bb81211f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4014040 tx=0x7f8bb4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 shutdown_connections 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bb8133f70 0x7f8bb8121c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bb809ad40 0x7f8bb81211f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 --2- 172.21.15.125:0/1661423406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bb80a0a70 0x7f8bb8121730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 >> 172.21.15.125:0/1661423406 conn(0x7f8bb8099c40 msgr2=0x7f8bb8133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 shutdown_connections 2023-10-03T10:14:10.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:10.812+0000 7f8bbfc5f700 1 -- 172.21.15.125:0/1661423406 wait complete. 2023-10-03T10:14:10.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:10.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:10.935 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:11.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 Processor -- start 2023-10-03T10:14:11.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 -- start start 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 0x7f0ddc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ddc134120 0x7f0ddc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc09dc00 con 0x7f0ddc0a1380 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc09ea60 con 0x7f0ddc134120 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.022+0000 7f0de1580700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc09dec0 con 0x7f0ddc0a0a70 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ddc134120 0x7f0ddc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ddc134120 0x7f0ddc13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54674/0 (socket says 172.21.15.125:54674) 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 0x7f0ddc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 -- 172.21.15.125:0/1112171339 learned_addr learned my addr 172.21.15.125:0/1112171339 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0dda7fc700 1 --1- 172.21.15.125:0/1112171339 >> v1:172.21.15.125:6789/0 conn(0x7f0ddc0a1380 0x7f0ddc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55554/0 (socket says 172.21.15.125:55554) 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 -- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 msgr2=0x7f0ddc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 0x7f0ddc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 -- 172.21.15.125:0/1112171339 >> v1:172.21.15.125:6789/0 conn(0x7f0ddc0a1380 legacy=0x7f0ddc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0dd9ffb700 1 -- 172.21.15.125:0/1112171339 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555359640 0 0) 0x7f0ddc09dc00 con 0x7f0ddc0a1380 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 -- 172.21.15.125:0/1112171339 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc09e6a0 con 0x7f0ddc134120 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddaffd700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 0x7f0ddc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0ddb7fe700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc134120 0x7f0ddc13bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009e50 tx=0x7f0dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b66938229232b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0dd9ffb700 1 -- 172.21.15.125:0/1112171339 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400e070 con 0x7f0ddc134120 2023-10-03T10:14:11.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0dd9ffb700 1 -- 172.21.15.125:0/1112171339 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400b910 con 0x7f0ddc134120 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.023+0000 7f0dd9ffb700 1 -- 172.21.15.125:0/1112171339 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400bcc0 con 0x7f0ddc134120 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 -- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc134120 msgr2=0x7f0ddc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc134120 0x7f0ddc13bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009e50 tx=0x7f0dd400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 -- 172.21.15.125:0/1112171339 shutdown_connections 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc134120 0x7f0ddc13bce0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 --2- 172.21.15.125:0/1112171339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a0a70 0x7f0ddc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 -- 172.21.15.125:0/1112171339 >> 172.21.15.125:0/1112171339 conn(0x7f0ddc0a6610 msgr2=0x7f0ddc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 -- 172.21.15.125:0/1112171339 shutdown_connections 2023-10-03T10:14:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.024+0000 7f0de1580700 1 -- 172.21.15.125:0/1112171339 wait complete. 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 Processor -- start 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 -- start start 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc0a0a70 0x7f0ddc122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 0x7f0ddc123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1259a0 con 0x7f0ddc0a0a70 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc124390 con 0x7f0ddc134120 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0de1580700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc133350 con 0x7f0ddc0a1380 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0ddaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc0a0a70 0x7f0ddc122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.025+0000 7f0dda7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48274/0 (socket says 172.21.15.125:48274) 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 -- 172.21.15.125:0/591107544 learned_addr learned my addr 172.21.15.125:0/591107544 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0ddb7fe700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 0x7f0ddc123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 -- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 msgr2=0x7f0ddc123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 0x7f0ddc123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 -- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc0a0a70 msgr2=0x7f0ddc122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc0a0a70 0x7f0ddc122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 -- 172.21.15.125:0/591107544 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0094a0 con 0x7f0ddc0a1380 2023-10-03T10:14:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0ddb7fe700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 0x7f0ddc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dda7fc700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c520 tx=0x7f0dd000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0004c80 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0004de0 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0007310 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd4009b30 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.026+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc0a03e0 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.027+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dd0007470 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.027+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0dd003f250 con 0x7f0ddc0a1380 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.027+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc04f2a0 con 0x7f0ddc0a1380 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.032+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dd00123b0 con 0x7f0ddc0a1380 2023-10-03T10:14:11.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 Processor -- start 2023-10-03T10:14:11.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 -- start start 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 0x7effd409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd409fa00 con 0x7effd409f180 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd40a0370 con 0x7effd409e870 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.063+0000 7effdb186700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd406bec0 con 0x7effd4134330 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd8f22700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 0x7effd409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48284/0 (socket says 172.21.15.125:48284) 2023-10-03T10:14:11.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 -- 172.21.15.125:0/1412746357 learned_addr learned my addr 172.21.15.125:0/1412746357 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 -- 172.21.15.125:0/1412746357 >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 msgr2=0x7effd409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 --2- 172.21.15.125:0/1412746357 >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 0x7effd409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 -- 172.21.15.125:0/1412746357 >> v1:172.21.15.125:6789/0 conn(0x7effd409f180 legacy=0x7effd4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 -- 172.21.15.125:0/1412746357 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd409ada0 con 0x7effd4134330 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd37fe700 1 -- 172.21.15.125:0/1412746357 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617205372 0 0) 0x7effd409fa00 con 0x7effd409f180 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd8f22700 1 --2- 172.21.15.125:0/1412746357 >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 0x7effd409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd9723700 1 --2- 172.21.15.125:0/1412746357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effcc009e50 tx=0x7effcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a9c80b22742e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd37fe700 1 -- 172.21.15.125:0/1412746357 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc00e070 con 0x7effd4134330 2023-10-03T10:14:11.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd37fe700 1 -- 172.21.15.125:0/1412746357 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc00b910 con 0x7effd4134330 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.064+0000 7effd37fe700 1 -- 172.21.15.125:0/1412746357 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc00bcc0 con 0x7effd4134330 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 -- 172.21.15.125:0/1412746357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 msgr2=0x7effd413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 --2- 172.21.15.125:0/1412746357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effcc009e50 tx=0x7effcc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 -- 172.21.15.125:0/1412746357 shutdown_connections 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 --2- 172.21.15.125:0/1412746357 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd413be80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 --2- 172.21.15.125:0/1412746357 >> v2:172.21.15.125:3300/0 conn(0x7effd409e870 0x7effd409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 -- 172.21.15.125:0/1412746357 >> 172.21.15.125:0/1412746357 conn(0x7effd40a4430 msgr2=0x7effd40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 -- 172.21.15.125:0/1412746357 shutdown_connections 2023-10-03T10:14:11.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.065+0000 7effdb186700 1 -- 172.21.15.125:0/1412746357 wait complete. 2023-10-03T10:14:11.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.066+0000 7effdb186700 1 Processor -- start 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.066+0000 7effdb186700 1 -- start start 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 0x7effd4122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409f180 0x7effd4122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4126290 con 0x7effd409e870 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd406cfa0 con 0x7effd409f180 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effdb186700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd4124380 con 0x7effd4134330 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd8f22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 0x7effd4122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd8f22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 0x7effd4122770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54704/0 (socket says 172.21.15.125:54704) 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409f180 0x7effd4122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48298/0 (socket says 172.21.15.125:48298) 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd8f22700 1 -- 172.21.15.125:0/2086510532 learned_addr learned my addr 172.21.15.125:0/2086510532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 -- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409f180 msgr2=0x7effd4122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409f180 0x7effd4122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 -- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 msgr2=0x7effd4122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 0x7effd4122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.067+0000 7effd9723700 1 -- 172.21.15.125:0/2086510532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80094a0 con 0x7effd4134330 2023-10-03T10:14:11.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effd9723700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effcc015000 tx=0x7effcc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc004880 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc0092e0 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc009b30 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc01c660 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.068+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd41336c0 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.069+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effcc01c7c0 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.069+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effcc040e70 con 0x7effd4134330 2023-10-03T10:14:11.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.069+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd404f2a0 con 0x7effd4134330 2023-10-03T10:14:11.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.073+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effcc0123f0 con 0x7effd4134330 2023-10-03T10:14:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.223+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ddc072980 con 0x7f0ddc0a1380 2023-10-03T10:14:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.224+0000 7f0dc37fe700 1 -- 172.21.15.125:0/591107544 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dd0011360 con 0x7f0ddc0a1380 2023-10-03T10:14:11.223 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:11.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.225+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 msgr2=0x7f0ddc122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.225+0000 7f0de1580700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c520 tx=0x7f0dd000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:11.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 shutdown_connections 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ddc134120 0x7f0ddc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ddc0a0a70 0x7f0ddc122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 --2- 172.21.15.125:0/591107544 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ddc0a1380 0x7f0ddc122cc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 >> 172.21.15.125:0/591107544 conn(0x7f0ddc0a6610 msgr2=0x7f0ddc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 shutdown_connections 2023-10-03T10:14:11.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.226+0000 7f0de1580700 1 -- 172.21.15.125:0/591107544 wait complete. 2023-10-03T10:14:11.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:11.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.265+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7effd4133290 con 0x7effd4134330 2023-10-03T10:14:11.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.265+0000 7effd17fa700 1 -- 172.21.15.125:0/2086510532 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effcc024820 con 0x7effd4134330 2023-10-03T10:14:11.264 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:11.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 msgr2=0x7effd41231f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effcc015000 tx=0x7effcc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 shutdown_connections 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd4134330 0x7effd41231f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd409e870 0x7effd4122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 --2- 172.21.15.125:0/2086510532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409f180 0x7effd4122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 >> 172.21.15.125:0/2086510532 conn(0x7effd40a4430 msgr2=0x7effd40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 shutdown_connections 2023-10-03T10:14:11.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.267+0000 7effdb186700 1 -- 172.21.15.125:0/2086510532 wait complete. 2023-10-03T10:14:11.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:11.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:11.823 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.912+0000 7f5d66622700 1 Processor -- start 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.912+0000 7f5d66622700 1 -- start start 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.912+0000 7f5d66622700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.912+0000 7f5d66622700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 0x7f5d60133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d66622700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d60133f50 0x7f5d601343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d66622700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6009e9d0 con 0x7f5d60133f50 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d66622700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6009dc00 con 0x7f5d600a0a70 2023-10-03T10:14:11.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d66622700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6009dec0 con 0x7f5d600a1380 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 0x7f5d60133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d60133f50 0x7f5d601343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54260/0 (socket says 172.21.15.125:54260) 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d60133f50 0x7f5d601343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54716/0 (socket says 172.21.15.125:54716) 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5ffff700 1 -- 172.21.15.125:0/3086200204 learned_addr learned my addr 172.21.15.125:0/3086200204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 0x7f5d60133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48310/0 (socket says 172.21.15.125:48310) 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 -- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 msgr2=0x7f5d60133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 0x7f5d60133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 -- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 msgr2=0x7f5d600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 -- 172.21.15.125:0/3086200204 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6009e6a0 con 0x7f5d60133f50 2023-10-03T10:14:11.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5ffff700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d64bbf700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d60133f50 0x7f5d601343f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009d90 tx=0x7f5d5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a22417ad5699d7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5effd700 1 -- 172.21.15.125:0/3086200204 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800e070 con 0x7f5d60133f50 2023-10-03T10:14:11.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5effd700 1 -- 172.21.15.125:0/3086200204 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5800bb20 con 0x7f5d60133f50 2023-10-03T10:14:11.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.913+0000 7f5d5effd700 1 -- 172.21.15.125:0/3086200204 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58012430 con 0x7f5d60133f50 2023-10-03T10:14:11.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 -- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d60133f50 msgr2=0x7f5d601343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d60133f50 0x7f5d601343f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009d90 tx=0x7f5d5800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 -- 172.21.15.125:0/3086200204 shutdown_connections 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a0a70 0x7f5d600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d60133f50 0x7f5d601343f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 --2- 172.21.15.125:0/3086200204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d600a1380 0x7f5d60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 -- 172.21.15.125:0/3086200204 >> 172.21.15.125:0/3086200204 conn(0x7f5d600a6610 msgr2=0x7f5d600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 -- 172.21.15.125:0/3086200204 shutdown_connections 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.914+0000 7f5d66622700 1 -- 172.21.15.125:0/3086200204 wait complete. 2023-10-03T10:14:11.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.915+0000 7f5d66622700 1 Processor -- start 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.915+0000 7f5d66622700 1 -- start start 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 0x7f5d6011f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d60133f50 0x7f5d6011fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60122df0 con 0x7f5d600a0a70 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d601228e0 con 0x7f5d600a1380 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60121d80 con 0x7f5d60133f50 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54726/0 (socket says 172.21.15.125:54726) 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 0x7f5d6011f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 -- 172.21.15.125:0/4226602895 learned_addr learned my addr 172.21.15.125:0/4226602895 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d64bbf700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d60133f50 0x7f5d6011fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 -- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d60133f50 msgr2=0x7f5d6011fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d60133f50 0x7f5d6011fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 -- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 msgr2=0x7f5d6011f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 0x7f5d6011f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 -- 172.21.15.125:0/4226602895 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50009550 con 0x7f5d600a0a70 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5f7fe700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 0x7f5d6011f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5ffff700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ebe0 tx=0x7f5d5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50004030 con 0x7f5d600a0a70 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50004190 con 0x7f5d600a0a70 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d58009a70 con 0x7f5d600a0a70 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.916+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50004520 con 0x7f5d600a0a70 2023-10-03T10:14:11.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.917+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d60133a60 con 0x7f5d600a0a70 2023-10-03T10:14:11.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.917+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6004f2a0 con 0x7f5d600a0a70 2023-10-03T10:14:11.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.918+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d5000c7f0 con 0x7f5d600a0a70 2023-10-03T10:14:11.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.918+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d5003fd20 con 0x7f5d600a0a70 2023-10-03T10:14:11.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.922+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d500036a0 con 0x7f5d600a0a70 2023-10-03T10:14:11.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.953+0000 7f6fa6851700 1 Processor -- start 2023-10-03T10:14:11.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.953+0000 7f6fa6851700 1 -- start start 2023-10-03T10:14:11.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa6851700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa6851700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa0099f20 0x7f6fa0137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa6851700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa009a580 con 0x7f6fa00993e0 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa6851700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa012d410 con 0x7f6fa012cb00 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa6851700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa012c8e0 con 0x7f6fa0099f20 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54286/0 (socket says 172.21.15.125:54286) 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 -- 172.21.15.125:0/4102310191 learned_addr learned my addr 172.21.15.125:0/4102310191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9f7fe700 1 --1- 172.21.15.125:0/4102310191 >> v1:172.21.15.125:6789/0 conn(0x7f6fa00993e0 0x7f6fa0099810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55574/0 (socket says 172.21.15.125:55574) 2023-10-03T10:14:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6fa4dee700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa0099f20 0x7f6fa0137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 -- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa0099f20 msgr2=0x7f6fa0137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa0099f20 0x7f6fa0137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 -- 172.21.15.125:0/4102310191 >> v1:172.21.15.125:6789/0 conn(0x7f6fa00993e0 legacy=0x7f6fa0099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9effd700 1 -- 172.21.15.125:0/4102310191 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751291033 0 0) 0x7f6fa009a580 con 0x7f6fa00993e0 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.954+0000 7f6f9ffff700 1 -- 172.21.15.125:0/4102310191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa009abe0 con 0x7f6fa012cb00 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6f9ffff700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b9a0 tx=0x7f6f9000bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d934a58c39f22f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6f9effd700 1 -- 172.21.15.125:0/4102310191 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90009070 con 0x7f6fa012cb00 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6f9effd700 1 -- 172.21.15.125:0/4102310191 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90005e30 con 0x7f6fa012cb00 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6f9effd700 1 -- 172.21.15.125:0/4102310191 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90004270 con 0x7f6fa012cb00 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 -- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 msgr2=0x7f6fa012ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b9a0 tx=0x7f6f9000bcb0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 -- 172.21.15.125:0/4102310191 shutdown_connections 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa0099f20 0x7f6fa0137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 --2- 172.21.15.125:0/4102310191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa012ced0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 -- 172.21.15.125:0/4102310191 >> 172.21.15.125:0/4102310191 conn(0x7f6fa00a2b30 msgr2=0x7f6fa009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 -- 172.21.15.125:0/4102310191 shutdown_connections 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.955+0000 7f6fa6851700 1 -- 172.21.15.125:0/4102310191 wait complete. 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.956+0000 7f6fa6851700 1 Processor -- start 2023-10-03T10:14:11.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.956+0000 7f6fa6851700 1 -- start start 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 0x7f6fa01c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa01c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00a0df0 con 0x7f6fa0099f20 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa012a120 con 0x7f6fa012cb00 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa6851700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa006fa90 con 0x7f6fa00993e0 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 0x7f6fa01c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 0x7f6fa01c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48350/0 (socket says 172.21.15.125:48350) 2023-10-03T10:14:11.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54736/0 (socket says 172.21.15.125:54736) 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9ffff700 1 -- 172.21.15.125:0/2894179469 learned_addr learned my addr 172.21.15.125:0/2894179469 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6fa4dee700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa01c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 -- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 msgr2=0x7f6fa01c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 0x7f6fa01c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 -- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 msgr2=0x7f6fa01c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa01c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 -- 172.21.15.125:0/2894179469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9000b5b0 con 0x7f6fa0099f20 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.957+0000 7f6f9f7fe700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6fa009b1e0 tx=0x7f6f9400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004c80 con 0x7f6fa0099f20 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94004de0 con 0x7f6fa0099f20 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa0129e30 con 0x7f6fa0099f20 2023-10-03T10:14:11.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94007310 con 0x7f6fa0099f20 2023-10-03T10:14:11.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01289e0 con 0x7f6fa0099f20 2023-10-03T10:14:11.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f94007470 con 0x7f6fa0099f20 2023-10-03T10:14:11.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.958+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f9403f1c0 con 0x7f6fa0099f20 2023-10-03T10:14:11.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.959+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa009d800 con 0x7f6fa0099f20 2023-10-03T10:14:11.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:11.963+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f94007720 con 0x7f6fa0099f20 2023-10-03T10:14:12.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.115+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d60120790 con 0x7f5d600a0a70 2023-10-03T10:14:12.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.115+0000 7f5d5cff9700 1 -- 172.21.15.125:0/4226602895 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d50023cd0 con 0x7f5d600a0a70 2023-10-03T10:14:12.115 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:12.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.117+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 msgr2=0x7f5d6011f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.117+0000 7f5d66622700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ebe0 tx=0x7f5d5000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 shutdown_connections 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d60133f50 0x7f5d6011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d600a0a70 0x7f5d6011f2d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 --2- 172.21.15.125:0/4226602895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d600a1380 0x7f5d6011f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 >> 172.21.15.125:0/4226602895 conn(0x7f5d600a6610 msgr2=0x7f5d6009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 shutdown_connections 2023-10-03T10:14:12.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.118+0000 7f5d66622700 1 -- 172.21.15.125:0/4226602895 wait complete. 2023-10-03T10:14:12.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.157+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fa004f2a0 con 0x7f6fa0099f20 2023-10-03T10:14:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.157+0000 7f6f9cff9700 1 -- 172.21.15.125:0/2894179469 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f9401ce30 con 0x7f6fa0099f20 2023-10-03T10:14:12.157 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 msgr2=0x7f6fa01c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6fa009b1e0 tx=0x7f6f9400c750 comp rx=0 tx=0).stop 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 shutdown_connections 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6fa012cb00 0x7f6fa01c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6fa00993e0 0x7f6fa01c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 --2- 172.21.15.125:0/2894179469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa0099f20 0x7f6fa01c4360 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 >> 172.21.15.125:0/2894179469 conn(0x7f6fa00a2b30 msgr2=0x7f6fa01b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 shutdown_connections 2023-10-03T10:14:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.159+0000 7f6fa6851700 1 -- 172.21.15.125:0/2894179469 wait complete. 2023-10-03T10:14:12.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:12.238 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:12.279 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 Processor -- start 2023-10-03T10:14:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 -- start start 2023-10-03T10:14:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc09aaa0 con 0x7ff8bc09d860 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc09e730 con 0x7ff8bc09e340 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c3ba4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc09f870 con 0x7ff8bc135f20 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.365+0000 7ff8c2141700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c113f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48362/0 (socket says 172.21.15.125:48362) 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c113f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54738/0 (socket says 172.21.15.125:54738) 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 -- 172.21.15.125:0/1285555693 learned_addr learned my addr 172.21.15.125:0/1285555693 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 -- 172.21.15.125:0/1285555693 >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 msgr2=0x7ff8bc1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 --2- 172.21.15.125:0/1285555693 >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 -- 172.21.15.125:0/1285555693 >> v1:172.21.15.125:6789/0 conn(0x7ff8bc09d860 legacy=0x7ff8bc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 -- 172.21.15.125:0/1285555693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc09b360 con 0x7ff8bc135f20 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c093e700 1 -- 172.21.15.125:0/1285555693 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928333305 0 0) 0x7ff8bc09aaa0 con 0x7ff8bc09d860 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c113f700 1 --2- 172.21.15.125:0/1285555693 >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c2141700 1 --2- 172.21.15.125:0/1285555693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009e80 tx=0x7ff8b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f093825309851a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c093e700 1 -- 172.21.15.125:0/1285555693 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400e070 con 0x7ff8bc135f20 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c093e700 1 -- 172.21.15.125:0/1285555693 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400b8d0 con 0x7ff8bc135f20 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.366+0000 7ff8c093e700 1 -- 172.21.15.125:0/1285555693 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400bc80 con 0x7ff8bc135f20 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/1285555693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 msgr2=0x7ff8bc138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/1285555693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009e80 tx=0x7ff8b400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/1285555693 shutdown_connections 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/1285555693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc135f20 0x7ff8bc138300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/1285555693 >> v2:172.21.15.125:3300/0 conn(0x7ff8bc09e340 0x7ff8bc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/1285555693 >> 172.21.15.125:0/1285555693 conn(0x7ff8bc099c40 msgr2=0x7ff8bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/1285555693 shutdown_connections 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.367+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/1285555693 wait complete. 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 Processor -- start 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 -- start start 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 0x7ff8bc1c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8bc135f20 0x7ff8bc06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0706c0 con 0x7ff8bc09d860 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc135650 con 0x7ff8bc135f20 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c3ba4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc126200 con 0x7ff8bc09e340 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c113f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c1940700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 0x7ff8bc1c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c2141700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8bc135f20 0x7ff8bc06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c113f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48364/0 (socket says 172.21.15.125:48364) 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.368+0000 7ff8c113f700 1 -- 172.21.15.125:0/590223845 learned_addr learned my addr 172.21.15.125:0/590223845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 -- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8bc135f20 msgr2=0x7ff8bc06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8bc135f20 0x7ff8bc06e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 -- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 msgr2=0x7ff8bc1c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 0x7ff8bc1c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 -- 172.21.15.125:0/590223845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0094a0 con 0x7ff8bc09e340 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c1940700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 0x7ff8bc1c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c113f700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00ebe0 tx=0x7ff8ac00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00c850 con 0x7ff8bc09e340 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac00c9b0 con 0x7ff8bc09e340 2023-10-03T10:14:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00cd40 con 0x7ff8bc09e340 2023-10-03T10:14:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4009b30 con 0x7ff8bc09e340 2023-10-03T10:14:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.369+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc09c8b0 con 0x7ff8bc09e340 2023-10-03T10:14:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.370+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8ac013470 con 0x7ff8bc09e340 2023-10-03T10:14:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.370+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff8ac03fb10 con 0x7ff8bc09e340 2023-10-03T10:14:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.370+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc04f2a0 con 0x7ff8bc09e340 2023-10-03T10:14:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.378+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8ac013720 con 0x7ff8bc09e340 2023-10-03T10:14:12.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.412+0000 7fa11c566700 1 Processor -- start 2023-10-03T10:14:12.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.412+0000 7fa11c566700 1 -- start start 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.412+0000 7fa11c566700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11c566700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa11413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11c566700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11406bec0 con 0x7fa11409e870 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11c566700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406ce60 con 0x7fa11409f350 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11c566700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa11409f740 con 0x7fa114139480 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa11413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11a302700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa11409e870 0x7fa11409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55596/0 (socket says 172.21.15.125:55596) 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11a302700 1 -- 172.21.15.125:0/3540122678 learned_addr learned my addr 172.21.15.125:0/3540122678 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:12.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119b01700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119300700 1 -- 172.21.15.125:0/3540122678 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170612341 0 0) 0x7fa11406bec0 con 0x7fa11409e870 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 -- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 msgr2=0x7fa114138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 -- 172.21.15.125:0/3540122678 >> v1:172.21.15.125:6789/0 conn(0x7fa11409e870 legacy=0x7fa11409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 -- 172.21.15.125:0/3540122678 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11409fa00 con 0x7fa114139480 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119b01700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa11ab03700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa11413b860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009dc0 tx=0x7fa10c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5357d08b871b06e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119300700 1 -- 172.21.15.125:0/3540122678 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00e070 con 0x7fa114139480 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119300700 1 -- 172.21.15.125:0/3540122678 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00bb20 con 0x7fa114139480 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.413+0000 7fa119300700 1 -- 172.21.15.125:0/3540122678 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c012430 con 0x7fa114139480 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 -- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 msgr2=0x7fa11413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa11413b860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009dc0 tx=0x7fa10c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 -- 172.21.15.125:0/3540122678 shutdown_connections 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa11413b860 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 --2- 172.21.15.125:0/3540122678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 -- 172.21.15.125:0/3540122678 >> 172.21.15.125:0/3540122678 conn(0x7fa1140a4430 msgr2=0x7fa1140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 -- 172.21.15.125:0/3540122678 shutdown_connections 2023-10-03T10:14:12.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.414+0000 7fa11c566700 1 -- 172.21.15.125:0/3540122678 wait complete. 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 Processor -- start 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 -- start start 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa11409e870 0x7fa114120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa1141213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406cfa0 con 0x7fa11409e870 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa114123c40 con 0x7fa11409f350 2023-10-03T10:14:12.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa11c566700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa114124160 con 0x7fa114139480 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.415+0000 7fa119b01700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa1141213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa119b01700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114120e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54320/0 (socket says 172.21.15.125:54320) 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa119b01700 1 -- 172.21.15.125:0/2720264211 learned_addr learned my addr 172.21.15.125:0/2720264211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11a302700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa11409e870 0x7fa114120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 -- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 msgr2=0x7fa114120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 -- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa11409e870 msgr2=0x7fa114120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa11409e870 0x7fa114120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 -- 172.21.15.125:0/2720264211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040094a0 con 0x7fa114139480 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11ab03700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa1141213a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa11409b0b0 tx=0x7fa10c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c01b810 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c020070 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c009a70 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c01bbf0 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.416+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114124bd0 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.417+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa10c01bd50 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.417+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa10c022070 con 0x7fa114139480 2023-10-03T10:14:12.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.417+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa114123de0 con 0x7fa114139480 2023-10-03T10:14:12.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.422+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa114123de0 con 0x7fa114139480 2023-10-03T10:14:12.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.575+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff8bc09b580 con 0x7ff8bc09e340 2023-10-03T10:14:12.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.575+0000 7ff8b27fc700 1 -- 172.21.15.125:0/590223845 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8ac02a090 con 0x7ff8bc09e340 2023-10-03T10:14:12.574 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 msgr2=0x7ff8bc1c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00ebe0 tx=0x7ff8ac00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 shutdown_connections 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8bc135f20 0x7ff8bc06e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8bc09d860 0x7ff8bc1c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 --2- 172.21.15.125:0/590223845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff8bc09e340 0x7ff8bc1c8920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 >> 172.21.15.125:0/590223845 conn(0x7ff8bc099c40 msgr2=0x7ff8bc070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 shutdown_connections 2023-10-03T10:14:12.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.577+0000 7ff8c3ba4700 1 -- 172.21.15.125:0/590223845 wait complete. 2023-10-03T10:14:12.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:12.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.616+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa114123de0 con 0x7fa114139480 2023-10-03T10:14:12.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.617+0000 7fa10affd700 1 -- 172.21.15.125:0/2720264211 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa114123de0 con 0x7fa114139480 2023-10-03T10:14:12.616 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:12.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.618+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 msgr2=0x7fa1141213a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.618+0000 7fa11c566700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa1141213a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa11409b0b0 tx=0x7fa10c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.618+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 shutdown_connections 2023-10-03T10:14:12.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa114139480 0x7fa1141213a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa11409e870 0x7fa114120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 --2- 172.21.15.125:0/2720264211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa11409f350 0x7fa114120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 >> 172.21.15.125:0/2720264211 conn(0x7fa1140a4430 msgr2=0x7fa1140a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 shutdown_connections 2023-10-03T10:14:12.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:12.619+0000 7fa11c566700 1 -- 172.21.15.125:0/2720264211 wait complete. 2023-10-03T10:14:12.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:13.130 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:13.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:13.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.258+0000 7f9d91688700 1 Processor -- start 2023-10-03T10:14:13.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.258+0000 7f9d91688700 1 -- start start 2023-10-03T10:14:13.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d91688700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d91688700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 0x7f9d8c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d91688700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c09dc00 con 0x7f9d8c0a1380 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d91688700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c09ea90 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d91688700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c09dec0 con 0x7f9d8c134120 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 0x7f9d8c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d8c0a1380 0x7f9d8c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55612/0 (socket says 172.21.15.125:55612) 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8a7fc700 1 -- 172.21.15.125:0/4060658614 learned_addr learned my addr 172.21.15.125:0/4060658614 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:13.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54326/0 (socket says 172.21.15.125:54326) 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 -- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 msgr2=0x7f9d8c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 0x7f9d8c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 -- 172.21.15.125:0/4060658614 >> v1:172.21.15.125:6789/0 conn(0x7f9d8c0a1380 legacy=0x7f9d8c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d89ffb700 1 -- 172.21.15.125:0/4060658614 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026407329 0 0) 0x7f9d8c09dc00 con 0x7f9d8c0a1380 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8affd700 1 -- 172.21.15.125:0/4060658614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c09e6a0 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.259+0000 7f9d8b7fe700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 0x7f9d8c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d8affd700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009870 tx=0x7f9d7c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ae50f12fd002a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d89ffb700 1 -- 172.21.15.125:0/4060658614 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011830 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d89ffb700 1 -- 172.21.15.125:0/4060658614 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c011990 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d89ffb700 1 -- 172.21.15.125:0/4060658614 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011d20 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 -- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 msgr2=0x7f9d8c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009870 tx=0x7f9d7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 -- 172.21.15.125:0/4060658614 shutdown_connections 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c134120 0x7f9d8c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 --2- 172.21.15.125:0/4060658614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c0a0e40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 -- 172.21.15.125:0/4060658614 >> 172.21.15.125:0/4060658614 conn(0x7f9d8c0a6610 msgr2=0x7f9d8c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 -- 172.21.15.125:0/4060658614 shutdown_connections 2023-10-03T10:14:13.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.260+0000 7f9d91688700 1 -- 172.21.15.125:0/4060658614 wait complete. 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.261+0000 7f9d91688700 1 Processor -- start 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.261+0000 7f9d91688700 1 -- start start 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d8c134120 0x7f9d8c1c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1264b0 con 0x7f9d8c134120 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1247a0 con 0x7f9d8c0a0a70 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d91688700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c124d50 con 0x7f9d8c0a1380 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48398/0 (socket says 172.21.15.125:48398) 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d8c134120 0x7f9d8c1c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 -- 172.21.15.125:0/2937774632 learned_addr learned my addr 172.21.15.125:0/2937774632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 -- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 msgr2=0x7f9d8c1c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c1c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 -- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d8c134120 msgr2=0x7f9d8c1c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d8c134120 0x7f9d8c1c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 -- 172.21.15.125:0/2937774632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84009a70 con 0x7f9d8c0a1380 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8affd700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.262+0000 7f9d8a7fc700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d80001eb0 tx=0x7f9d8000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.263+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80004c80 con 0x7f9d8c0a1380 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.263+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80004de0 con 0x7f9d8c0a1380 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.263+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80007310 con 0x7f9d8c0a1380 2023-10-03T10:14:13.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.263+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c0094a0 con 0x7f9d8c0a1380 2023-10-03T10:14:13.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.263+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c09d390 con 0x7f9d8c0a1380 2023-10-03T10:14:13.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.264+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d80007470 con 0x7f9d8c0a1380 2023-10-03T10:14:13.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.264+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d8003f2b0 con 0x7f9d8c0a1380 2023-10-03T10:14:13.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.264+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c04f2a0 con 0x7f9d8c0a1380 2023-10-03T10:14:13.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.272+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d800123b0 con 0x7f9d8c0a1380 2023-10-03T10:14:13.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 Processor -- start 2023-10-03T10:14:13.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 -- start start 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e809b700 con 0x7f95e8130460 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e809c350 con 0x7f95e812cb80 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95ecfdf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e81308d0 con 0x7f95e812fab0 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95e659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.303+0000 7f95e5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48406/0 (socket says 172.21.15.125:48406) 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54348/0 (socket says 172.21.15.125:54348) 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e5d9b700 1 -- 172.21.15.125:0/1646048869 learned_addr learned my addr 172.21.15.125:0/1646048869 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e559a700 1 -- 172.21.15.125:0/1646048869 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093518994 0 0) 0x7f95e809b700 con 0x7f95e8130460 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e559a700 1 -- 172.21.15.125:0/1646048869 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d00057c0 con 0x7f95e8130460 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 -- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 msgr2=0x7f95e812ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 -- 172.21.15.125:0/1646048869 >> v1:172.21.15.125:6789/0 conn(0x7f95e8130460 legacy=0x7f95e8136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 -- 172.21.15.125:0/1646048869 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e809abf0 con 0x7f95e812cb80 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e5d9b700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e659c700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009870 tx=0x7f95d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c425a2abf6538e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e559a700 1 -- 172.21.15.125:0/1646048869 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011830 con 0x7f95e812cb80 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e559a700 1 -- 172.21.15.125:0/1646048869 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8011990 con 0x7f95e812cb80 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.304+0000 7f95e559a700 1 -- 172.21.15.125:0/1646048869 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011d20 con 0x7f95e812cb80 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 -- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 msgr2=0x7f95e812cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009870 tx=0x7f95d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 -- 172.21.15.125:0/1646048869 shutdown_connections 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e812cb80 0x7f95e812cf50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/1646048869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812fab0 0x7f95e812ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 -- 172.21.15.125:0/1646048869 >> 172.21.15.125:0/1646048869 conn(0x7f95e80a2eb0 msgr2=0x7f95e809eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 -- 172.21.15.125:0/1646048869 shutdown_connections 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.305+0000 7f95ecfdf700 1 -- 172.21.15.125:0/1646048869 wait complete. 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 Processor -- start 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 -- start start 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812cb80 0x7f95e81c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 0x7f95e81c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 0x7f95e81c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e808ca40 con 0x7f95e812fab0 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80724a0 con 0x7f95e8130460 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.306+0000 7f95ecfdf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e808bac0 con 0x7f95e812cb80 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 0x7f95e81c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 0x7f95e81c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 0x7f95e81c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54768/0 (socket says 172.21.15.125:54768) 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812cb80 0x7f95e81c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e5d9b700 1 -- 172.21.15.125:0/3646119073 learned_addr learned my addr 172.21.15.125:0/3646119073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 -- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812cb80 msgr2=0x7f95e81c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812cb80 0x7f95e81c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 -- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 msgr2=0x7f95e81c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 0x7f95e81c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 -- 172.21.15.125:0/3646119073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc00a6f0 con 0x7f95e8130460 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95e6d9d700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 0x7f95e81c8e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95e000cbc0 tx=0x7f95e000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0003c00 con 0x7f95e8130460 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0003d60 con 0x7f95e8130460 2023-10-03T10:14:13.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000aa80 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d80094a0 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.307+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e812d510 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.308+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95e000abe0 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.308+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e809b050 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.308+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95e003f560 con 0x7f95e8130460 2023-10-03T10:14:13.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.313+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95e00196c0 con 0x7f95e8130460 2023-10-03T10:14:13.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.470+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d8c06d660 con 0x7f9d8c0a1380 2023-10-03T10:14:13.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.470+0000 7f9d737fe700 1 -- 172.21.15.125:0/2937774632 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d80011360 con 0x7f9d8c0a1380 2023-10-03T10:14:13.469 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 msgr2=0x7f9d8c1c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d80001eb0 tx=0x7f9d8000c800 comp rx=0 tx=0).stop 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 shutdown_connections 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d8c134120 0x7f9d8c1c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8c0a0a70 0x7f9d8c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 --2- 172.21.15.125:0/2937774632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d8c0a1380 0x7f9d8c1c8a70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 >> 172.21.15.125:0/2937774632 conn(0x7f9d8c0a6610 msgr2=0x7f9d8c09abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 shutdown_connections 2023-10-03T10:14:13.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.472+0000 7f9d91688700 1 -- 172.21.15.125:0/2937774632 wait complete. 2023-10-03T10:14:13.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.506+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95e804f2a0 con 0x7f95e8130460 2023-10-03T10:14:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.507+0000 7f95d6ffd700 1 -- 172.21.15.125:0/3646119073 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95e0019300 con 0x7f95e8130460 2023-10-03T10:14:13.506 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:13.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 msgr2=0x7f95e81c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 0x7f95e81c8e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95e000cbc0 tx=0x7f95e000ced0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 shutdown_connections 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e8130460 0x7f95e81c8e20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e812cb80 0x7f95e81c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 --2- 172.21.15.125:0/3646119073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e812fab0 0x7f95e81c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 >> 172.21.15.125:0/3646119073 conn(0x7f95e80a2eb0 msgr2=0x7f95e809cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 shutdown_connections 2023-10-03T10:14:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.509+0000 7f95ecfdf700 1 -- 172.21.15.125:0/3646119073 wait complete. 2023-10-03T10:14:13.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:13.589 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:13.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.716+0000 7f9a59530700 1 Processor -- start 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.716+0000 7f9a59530700 1 -- start start 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.716+0000 7f9a59530700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 0x7f9a5409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a59530700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a54131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a59530700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5409c970 con 0x7f9a54131d70 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a59530700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540a0920 con 0x7f9a5409e870 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a59530700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5409f9c0 con 0x7f9a5409f180 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a52ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 0x7f9a5409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a54131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a537fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9a54131d70 0x7f9a54138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55640/0 (socket says 172.21.15.125:55640) 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a537fe700 1 -- 172.21.15.125:0/3984214958 learned_addr learned my addr 172.21.15.125:0/3984214958 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 -- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 msgr2=0x7f9a5409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 0x7f9a5409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 -- 172.21.15.125:0/3984214958 >> v1:172.21.15.125:6789/0 conn(0x7f9a54131d70 legacy=0x7f9a54138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 -- 172.21.15.125:0/3984214958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5409bab0 con 0x7f9a5409f180 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a51ffb700 1 -- 172.21.15.125:0/3984214958 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401344278 0 0) 0x7f9a5409c970 con 0x7f9a54131d70 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a52ffd700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 0x7f9a5409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a54131830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009870 tx=0x7f9a48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2200fabc56311f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a51ffb700 1 -- 172.21.15.125:0/3984214958 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48011830 con 0x7f9a5409f180 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a51ffb700 1 -- 172.21.15.125:0/3984214958 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48011990 con 0x7f9a5409f180 2023-10-03T10:14:13.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.717+0000 7f9a51ffb700 1 -- 172.21.15.125:0/3984214958 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48011d20 con 0x7f9a5409f180 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 -- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 msgr2=0x7f9a54131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a54131830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009870 tx=0x7f9a48009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 -- 172.21.15.125:0/3984214958 shutdown_connections 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a5409e870 0x7f9a5409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 --2- 172.21.15.125:0/3984214958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a54131830 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 -- 172.21.15.125:0/3984214958 >> 172.21.15.125:0/3984214958 conn(0x7f9a540a4430 msgr2=0x7f9a540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 -- 172.21.15.125:0/3984214958 shutdown_connections 2023-10-03T10:14:13.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.718+0000 7f9a59530700 1 -- 172.21.15.125:0/3984214958 wait complete. 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.719+0000 7f9a59530700 1 Processor -- start 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.719+0000 7f9a59530700 1 -- start start 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.719+0000 7f9a59530700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.719+0000 7f9a59530700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a541b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.719+0000 7f9a59530700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a54131d70 0x7f9a541b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a59530700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5409dba0 con 0x7f9a5409e870 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a59530700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a541bad30 con 0x7f9a54131d70 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a59530700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5411fb40 con 0x7f9a5409f180 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a52ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a537fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a54131d70 0x7f9a541b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a52ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54784/0 (socket says 172.21.15.125:54784) 2023-10-03T10:14:13.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a52ffd700 1 -- 172.21.15.125:0/3794699849 learned_addr learned my addr 172.21.15.125:0/3794699849 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a541b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 -- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a54131d70 msgr2=0x7f9a541b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a54131d70 0x7f9a541b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 -- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 msgr2=0x7f9a541b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 -- 172.21.15.125:0/3794699849 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440094a0 con 0x7f9a5409f180 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a52ffd700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a527fc700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a541b95e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a48016000 tx=0x7f9a48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48004510 con 0x7f9a5409f180 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4801f070 con 0x7f9a5409f180 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a480094a0 con 0x7f9a5409f180 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a480038e0 con 0x7f9a5409f180 2023-10-03T10:14:13.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.720+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a541bb410 con 0x7f9a5409f180 2023-10-03T10:14:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.721+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a48003a40 con 0x7f9a5409f180 2023-10-03T10:14:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.721+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9a48021070 con 0x7f9a5409f180 2023-10-03T10:14:13.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.721+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a54071090 con 0x7f9a5409f180 2023-10-03T10:14:13.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.730+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a48015070 con 0x7f9a5409f180 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.761+0000 7f11cbb56700 1 Processor -- start 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 -- start start 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c40a0920 con 0x7f11c409f180 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c409c970 con 0x7f11c409e870 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11cbb56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c409bab0 con 0x7f11c4131d70 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11c90f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11ca0f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11c90f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54788/0 (socket says 172.21.15.125:54788) 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.762+0000 7f11c90f1700 1 -- 172.21.15.125:0/284448643 learned_addr learned my addr 172.21.15.125:0/284448643 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11c98f2700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 -- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 msgr2=0x7f11c409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 -- 172.21.15.125:0/284448643 >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 msgr2=0x7f11c4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 --2- 172.21.15.125:0/284448643 >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 -- 172.21.15.125:0/284448643 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c409f9c0 con 0x7f11c4131d70 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11c90f1700 1 --2- 172.21.15.125:0/284448643 >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11ca0f3700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4132210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009d90 tx=0x7f11bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a878d3d807577e70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11c88f0700 1 -- 172.21.15.125:0/284448643 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00e070 con 0x7f11c4131d70 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11c88f0700 1 -- 172.21.15.125:0/284448643 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00bb20 con 0x7f11c4131d70 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.763+0000 7f11c88f0700 1 -- 172.21.15.125:0/284448643 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc012430 con 0x7f11c4131d70 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 -- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 msgr2=0x7f11c4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4132210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009d90 tx=0x7f11bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 -- 172.21.15.125:0/284448643 shutdown_connections 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 --2- 172.21.15.125:0/284448643 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4132210 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 --2- 172.21.15.125:0/284448643 >> v2:172.21.15.125:3300/0 conn(0x7f11c409f180 0x7f11c4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 -- 172.21.15.125:0/284448643 >> 172.21.15.125:0/284448643 conn(0x7f11c40a4430 msgr2=0x7f11c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 -- 172.21.15.125:0/284448643 shutdown_connections 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.764+0000 7f11cbb56700 1 -- 172.21.15.125:0/284448643 wait complete. 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.765+0000 7f11cbb56700 1 Processor -- start 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.765+0000 7f11cbb56700 1 -- start start 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c4120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4123a70 con 0x7f11c409f180 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4122cf0 con 0x7f11c409e870 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11cbb56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4123840 con 0x7f11c4131d70 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11c90f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11c90f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54796/0 (socket says 172.21.15.125:54796) 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11c90f1700 1 -- 172.21.15.125:0/1640523687 learned_addr learned my addr 172.21.15.125:0/1640523687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11ca0f3700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.766+0000 7f11c98f2700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c4120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 -- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 msgr2=0x7f11c4120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 -- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 msgr2=0x7f11c4120300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c4120300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 -- 172.21.15.125:0/1640523687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009550 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11c90f1700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f11b400ec10 tx=0x7f11b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400c850 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b400c9b0 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400cd60 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc009a70 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.767+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c4121720 con 0x7f11c409f180 2023-10-03T10:14:13.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.768+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11b4013470 con 0x7f11c409f180 2023-10-03T10:14:13.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.768+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11b403f780 con 0x7f11c409f180 2023-10-03T10:14:13.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.768+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c404f2a0 con 0x7f11c409f180 2023-10-03T10:14:13.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.772+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11b40232f0 con 0x7f11c409f180 2023-10-03T10:14:13.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.924+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a5404f2a0 con 0x7f9a5409f180 2023-10-03T10:14:13.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.925+0000 7f9a3b7fe700 1 -- 172.21.15.125:0/3794699849 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a48003cf0 con 0x7f9a5409f180 2023-10-03T10:14:13.924 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 msgr2=0x7f9a541b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a541b95e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a48016000 tx=0x7f9a48004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 shutdown_connections 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a54131d70 0x7f9a541b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a5409e870 0x7f9a541b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 --2- 172.21.15.125:0/3794699849 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9a5409f180 0x7f9a541b95e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 >> 172.21.15.125:0/3794699849 conn(0x7f9a540a4430 msgr2=0x7f9a541312e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 shutdown_connections 2023-10-03T10:14:13.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.927+0000 7f9a59530700 1 -- 172.21.15.125:0/3794699849 wait complete. 2023-10-03T10:14:13.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:13.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.966+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f11c4131b50 con 0x7f11c409f180 2023-10-03T10:14:13.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.966+0000 7f11ba7fc700 1 -- 172.21.15.125:0/1640523687 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11b402a090 con 0x7f11c409f180 2023-10-03T10:14:13.966 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:13.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.968+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 msgr2=0x7f11c4120840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.968+0000 7f11cbb56700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f11b400ec10 tx=0x7f11b400ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:13.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 shutdown_connections 2023-10-03T10:14:13.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11c4131d70 0x7f11c4120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c409e870 0x7f11c4120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 --2- 172.21.15.125:0/1640523687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c409f180 0x7f11c4120840 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 >> 172.21.15.125:0/1640523687 conn(0x7f11c40a4430 msgr2=0x7f11c406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 shutdown_connections 2023-10-03T10:14:13.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:13.969+0000 7f11cbb56700 1 -- 172.21.15.125:0/1640523687 wait complete. 2023-10-03T10:14:13.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:14.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:14.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:14.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.614+0000 7fc5fcb35700 1 Processor -- start 2023-10-03T10:14:14.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.614+0000 7fc5fcb35700 1 -- start start 2023-10-03T10:14:14.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 0x7fc5f8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 0x7fc5f81321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f80a0920 con 0x7fc5f809e870 2023-10-03T10:14:14.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809c970 con 0x7fc5f809f180 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5fcb35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809bab0 con 0x7fc5f8131d70 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 0x7fc5f81321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 0x7fc5f8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54808/0 (socket says 172.21.15.125:54808) 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f659c700 1 -- 172.21.15.125:0/160508376 learned_addr learned my addr 172.21.15.125:0/160508376 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 msgr2=0x7fc5f81321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 0x7fc5f81321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/160508376 >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 msgr2=0x7fc5f809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/160508376 >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/160508376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f809f9c0 con 0x7fc5f809f180 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f659c700 1 --2- 172.21.15.125:0/160508376 >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f6d9d700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 0x7fc5f81321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 0x7fc5f8131830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009870 tx=0x7fc5ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1f9d3d1a99f6ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f559a700 1 -- 172.21.15.125:0/160508376 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011830 con 0x7fc5f809f180 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f559a700 1 -- 172.21.15.125:0/160508376 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec011990 con 0x7fc5f809f180 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.615+0000 7fc5f559a700 1 -- 172.21.15.125:0/160508376 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011d20 con 0x7fc5f809f180 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 -- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 msgr2=0x7fc5f8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 0x7fc5f8131830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009870 tx=0x7fc5ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 -- 172.21.15.125:0/160508376 shutdown_connections 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f8131d70 0x7fc5f81321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/160508376 >> v2:172.21.15.125:3300/0 conn(0x7fc5f809e870 0x7fc5f809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/160508376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809f180 0x7fc5f8131830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 -- 172.21.15.125:0/160508376 >> 172.21.15.125:0/160508376 conn(0x7fc5f80a4430 msgr2=0x7fc5f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 -- 172.21.15.125:0/160508376 shutdown_connections 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.616+0000 7fc5fcb35700 1 -- 172.21.15.125:0/160508376 wait complete. 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 Processor -- start 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 -- start start 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 0x7fc5f8120c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8121f70 con 0x7fc5f8131d70 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8122c80 con 0x7fc5f809e870 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5fcb35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8123040 con 0x7fc5f809f180 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48472/0 (socket says 172.21.15.125:48472) 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54428/0 (socket says 172.21.15.125:54428) 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/2723285410 learned_addr learned my addr 172.21.15.125:0/2723285410 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.618+0000 7fc5f6d9d700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 0x7fc5f8120c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 msgr2=0x7fc5f81201e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 msgr2=0x7fc5f8120c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 0x7fc5f8120c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 -- 172.21.15.125:0/2723285410 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e8009550 con 0x7fc5f809f180 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f659c700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f6d9d700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 0x7fc5f8120c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5f5d9b700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0090b0 tx=0x7fc5ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0044d0 con 0x7fc5f809f180 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec01f070 con 0x7fc5f809f180 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f0009a70 con 0x7fc5f809f180 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0038c0 con 0x7fc5f809f180 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.619+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec0094a0 con 0x7fc5f809f180 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.620+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5ec003a20 con 0x7fc5f809f180 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.620+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5ec021070 con 0x7fc5f809f180 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.620+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f804f2a0 con 0x7fc5f809f180 2023-10-03T10:14:14.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.629+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5ec015080 con 0x7fc5f809f180 2023-10-03T10:14:14.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.657+0000 7facb24d1700 1 Processor -- start 2023-10-03T10:14:14.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.657+0000 7facb24d1700 1 -- start start 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb24d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facac0a1550 0x7facac138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb24d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb24d1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac09e9d0 con 0x7facac0a0a70 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb24d1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac09dc00 con 0x7facac0a1550 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb24d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facac09dec0 con 0x7facac139200 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facac0a1550 0x7facac138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facac0a1550 0x7facac138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54820/0 (socket says 172.21.15.125:54820) 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facabfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7facac0a0a70 0x7facac0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55656/0 (socket says 172.21.15.125:55656) 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb0a6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 -- 172.21.15.125:0/2001031251 learned_addr learned my addr 172.21.15.125:0/2001031251 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 -- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 msgr2=0x7facac13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 -- 172.21.15.125:0/2001031251 >> v1:172.21.15.125:6789/0 conn(0x7facac0a0a70 legacy=0x7facac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 -- 172.21.15.125:0/2001031251 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac09e6a0 con 0x7facac0a1550 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facb0a6e700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.658+0000 7facab7fe700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac138cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7faca00098f0 tx=0x7faca0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1b0fe42cf80a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facaaffd700 1 -- 172.21.15.125:0/2001031251 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0011830 con 0x7facac0a1550 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facaaffd700 1 -- 172.21.15.125:0/2001031251 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0011990 con 0x7facac0a1550 2023-10-03T10:14:14.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facaaffd700 1 -- 172.21.15.125:0/2001031251 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0011d20 con 0x7facac0a1550 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 -- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 msgr2=0x7facac138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac138cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7faca00098f0 tx=0x7faca0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 -- 172.21.15.125:0/2001031251 shutdown_connections 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 --2- 172.21.15.125:0/2001031251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac138cc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 -- 172.21.15.125:0/2001031251 >> 172.21.15.125:0/2001031251 conn(0x7facac0a6610 msgr2=0x7facac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 -- 172.21.15.125:0/2001031251 shutdown_connections 2023-10-03T10:14:14.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.659+0000 7facb24d1700 1 -- 172.21.15.125:0/2001031251 wait complete. 2023-10-03T10:14:14.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.660+0000 7facb24d1700 1 Processor -- start 2023-10-03T10:14:14.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 -- start start 2023-10-03T10:14:14.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 0x7facac11e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac11ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac120410 con 0x7facac0a1550 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac120a30 con 0x7facac0a0a70 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb24d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facac1220e0 con 0x7facac139200 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facabfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 0x7facac11e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb0a6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb0a6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48502/0 (socket says 172.21.15.125:48502) 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facabfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 0x7facac11e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54436/0 (socket says 172.21.15.125:54436) 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facb0a6e700 1 -- 172.21.15.125:0/668546497 learned_addr learned my addr 172.21.15.125:0/668546497 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.661+0000 7facab7fe700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac11ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 -- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 msgr2=0x7facac11e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 0x7facac11e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 -- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 msgr2=0x7facac11ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac11ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 -- 172.21.15.125:0/668546497 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4009a70 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb0a6e700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faca400efb0 tx=0x7faca400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400cc90 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400f040 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca0009550 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4014480 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.662+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac120c00 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.663+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac04f2a0 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.663+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faca40145e0 con 0x7facac139200 2023-10-03T10:14:14.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.663+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faca40404e0 con 0x7facac139200 2023-10-03T10:14:14.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.669+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faca4012930 con 0x7facac139200 2023-10-03T10:14:14.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.824+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5f806b2a0 con 0x7fc5f809f180 2023-10-03T10:14:14.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.824+0000 7fc5e6ffd700 1 -- 172.21.15.125:0/2723285410 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5ec02b020 con 0x7fc5f809f180 2023-10-03T10:14:14.823 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:14.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 msgr2=0x7fc5f8120720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0090b0 tx=0x7fc5ec004750 comp rx=0 tx=0).stop 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 shutdown_connections 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f8131d70 0x7fc5f8120c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5f809e870 0x7fc5f81201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 --2- 172.21.15.125:0/2723285410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5f809f180 0x7fc5f8120720 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 >> 172.21.15.125:0/2723285410 conn(0x7fc5f80a4430 msgr2=0x7fc5f809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 shutdown_connections 2023-10-03T10:14:14.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.826+0000 7fc5fcb35700 1 -- 172.21.15.125:0/2723285410 wait complete. 2023-10-03T10:14:14.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.859+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7facac072980 con 0x7facac139200 2023-10-03T10:14:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.860+0000 7faca8ff9700 1 -- 172.21.15.125:0/668546497 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faca401c3b0 con 0x7facac139200 2023-10-03T10:14:14.859 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:14.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 msgr2=0x7facac11f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faca400efb0 tx=0x7faca400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 shutdown_connections 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facac139200 0x7facac11f280 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facac0a0a70 0x7facac11e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 --2- 172.21.15.125:0/668546497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facac0a1550 0x7facac11ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 >> 172.21.15.125:0/668546497 conn(0x7facac0a6610 msgr2=0x7facac09a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 shutdown_connections 2023-10-03T10:14:14.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:14.862+0000 7facb24d1700 1 -- 172.21.15.125:0/668546497 wait complete. 2023-10-03T10:14:14.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:14.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:14.980 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:15.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 Processor -- start 2023-10-03T10:14:15.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 -- start start 2023-10-03T10:14:15.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 0x7fbf5c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c09e9d0 con 0x7fbf5c0a1380 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c09dc00 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf627a4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c09dec0 con 0x7fbf5c133f50 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf60d41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf5b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 0x7fbf5c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54438/0 (socket says 172.21.15.125:54438) 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf60d41700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48514/0 (socket says 172.21.15.125:48514) 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.067+0000 7fbf5bfff700 1 -- 172.21.15.125:0/2305271302 learned_addr learned my addr 172.21.15.125:0/2305271302 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 -- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 msgr2=0x7fbf5c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 -- 172.21.15.125:0/2305271302 >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 msgr2=0x7fbf5c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/2305271302 >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 0x7fbf5c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 -- 172.21.15.125:0/2305271302 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c09e6a0 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5b7fe700 1 --2- 172.21.15.125:0/2305271302 >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 0x7fbf5c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf60d41700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098f0 tx=0x7fbf4c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290ab504d7ba4e32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5affd700 1 -- 172.21.15.125:0/2305271302 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011830 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5affd700 1 -- 172.21.15.125:0/2305271302 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c011990 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf5affd700 1 -- 172.21.15.125:0/2305271302 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011d20 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf627a4700 1 -- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 msgr2=0x7fbf5c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.068+0000 7fbf627a4700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098f0 tx=0x7fbf4c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 -- 172.21.15.125:0/2305271302 shutdown_connections 2023-10-03T10:14:15.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c0a0e40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 --2- 172.21.15.125:0/2305271302 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c133f50 0x7fbf5c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 --2- 172.21.15.125:0/2305271302 >> v2:172.21.15.125:3300/0 conn(0x7fbf5c0a1380 0x7fbf5c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 -- 172.21.15.125:0/2305271302 >> 172.21.15.125:0/2305271302 conn(0x7fbf5c0a6610 msgr2=0x7fbf5c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 -- 172.21.15.125:0/2305271302 shutdown_connections 2023-10-03T10:14:15.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 -- 172.21.15.125:0/2305271302 wait complete. 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.069+0000 7fbf627a4700 1 Processor -- start 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 -- start start 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 0x7fbf5c122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c125c40 con 0x7fbf5c133f50 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c125a10 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf627a4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c124ea0 con 0x7fbf5c0a1380 2023-10-03T10:14:15.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf60d41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 0x7fbf5c122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54450/0 (socket says 172.21.15.125:54450) 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48518/0 (socket says 172.21.15.125:48518) 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 -- 172.21.15.125:0/1252015614 learned_addr learned my addr 172.21.15.125:0/1252015614 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 -- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 msgr2=0x7fbf5c122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 -- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 msgr2=0x7fbf5c122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 0x7fbf5c122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.070+0000 7fbf5bfff700 1 -- 172.21.15.125:0/1252015614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500094a0 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf5b7fe700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf60d41700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 0x7fbf5c122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf5bfff700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009c40 tx=0x7fbf4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c004450 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c01e070 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf54009a70 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0038e0 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.071+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c009550 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.072+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf4c003a40 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.072+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c11f760 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.072+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf4c0403d0 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.077+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf4c02d450 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.110+0000 7fb9a4d48700 1 Processor -- start 2023-10-03T10:14:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.110+0000 7fb9a4d48700 1 -- start start 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb9a4d48700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb9a4d48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb9a4d48700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a009aaa0 con 0x7fb9a009d860 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb9a4d48700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a009e730 con 0x7fb9a0135f20 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb9a4d48700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a009f870 con 0x7fb9a009e340 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb9a009d860 0x7fb9a009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55658/0 (socket says 172.21.15.125:55658) 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54456/0 (socket says 172.21.15.125:54456) 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:48534/0 (socket says 172.21.15.125:48534) 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99e59c700 1 -- 172.21.15.125:0/2807218202 learned_addr learned my addr 172.21.15.125:0/2807218202 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 -- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 msgr2=0x7fb9a01359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 -- 172.21.15.125:0/2807218202 >> v1:172.21.15.125:6789/0 conn(0x7fb9a009d860 legacy=0x7fb9a009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 -- 172.21.15.125:0/2807218202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a009b360 con 0x7fb9a0135f20 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99d59a700 1 -- 172.21.15.125:0/2807218202 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404263090 0 0) 0x7fb9a009aaa0 con 0x7fb9a009d860 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99dd9b700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99ed9d700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bfd0 tx=0x7fb99800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43d47b0d568c02d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.111+0000 7fb99d59a700 1 -- 172.21.15.125:0/2807218202 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998010070 con 0x7fb9a0135f20 2023-10-03T10:14:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb99d59a700 1 -- 172.21.15.125:0/2807218202 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99800b2e0 con 0x7fb9a0135f20 2023-10-03T10:14:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb99d59a700 1 -- 172.21.15.125:0/2807218202 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800dc70 con 0x7fb9a0135f20 2023-10-03T10:14:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 -- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 msgr2=0x7fb9a0138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb99800bfd0 tx=0x7fb99800d330 comp rx=0 tx=0).stop 2023-10-03T10:14:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 -- 172.21.15.125:0/2807218202 shutdown_connections 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a0135f20 0x7fb9a0138300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/2807218202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a009e340 0x7fb9a01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 -- 172.21.15.125:0/2807218202 >> 172.21.15.125:0/2807218202 conn(0x7fb9a0099c40 msgr2=0x7fb9a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 -- 172.21.15.125:0/2807218202 shutdown_connections 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.112+0000 7fb9a4d48700 1 -- 172.21.15.125:0/2807218202 wait complete. 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 Processor -- start 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 -- start start 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9a009e340 0x7fb9a011b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a0135f20 0x7fb9a011bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a011c7a0 con 0x7fb9a009e340 2023-10-03T10:14:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a011d490 con 0x7fb9a009d860 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb9a4d48700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00a0810 con 0x7fb9a0135f20 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb99e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb99dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9a009e340 0x7fb9a011b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb99e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54470/0 (socket says 172.21.15.125:54470) 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb99e59c700 1 -- 172.21.15.125:0/1417107372 learned_addr learned my addr 172.21.15.125:0/1417107372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.114+0000 7fb99ed9d700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a0135f20 0x7fb9a011bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 -- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a0135f20 msgr2=0x7fb9a011bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a0135f20 0x7fb9a011bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 -- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9a009e340 msgr2=0x7fb9a011b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9a009e340 0x7fb9a011b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 -- 172.21.15.125:0/1417107372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940094a0 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb99e59c700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c520 tx=0x7fb99000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990004c80 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990004de0 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99800bc80 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990007310 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.115+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a011edf0 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.116+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb990007470 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.116+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a011e6c0 con 0x7fb9a009d860 2023-10-03T10:14:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.116+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb99003f260 con 0x7fb9a009d860 2023-10-03T10:14:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.121+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9900133c0 con 0x7fb9a009d860 2023-10-03T10:14:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.271+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf5c0a5160 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.271+0000 7fbf58ff9700 1 -- 172.21.15.125:0/1252015614 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf4c015070 con 0x7fbf5c0a0a70 2023-10-03T10:14:15.271 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 msgr2=0x7fbf5c122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009c40 tx=0x7fbf4c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 shutdown_connections 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5c133f50 0x7fbf5c122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf5c0a0a70 0x7fbf5c122400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 --2- 172.21.15.125:0/1252015614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf5c0a1380 0x7fbf5c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 >> 172.21.15.125:0/1252015614 conn(0x7fbf5c0a6610 msgr2=0x7fbf5c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 shutdown_connections 2023-10-03T10:14:15.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.273+0000 7fbf627a4700 1 -- 172.21.15.125:0/1252015614 wait complete. 2023-10-03T10:14:15.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:15.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.314+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9a011d690 con 0x7fb9a009d860 2023-10-03T10:14:15.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.314+0000 7fb98effd700 1 -- 172.21.15.125:0/1417107372 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb990010900 con 0x7fb9a009d860 2023-10-03T10:14:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 msgr2=0x7fb9a011b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c520 tx=0x7fb99000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 shutdown_connections 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9a0135f20 0x7fb9a011bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9a009d860 0x7fb9a011b2d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 --2- 172.21.15.125:0/1417107372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9a009e340 0x7fb9a011b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 >> 172.21.15.125:0/1417107372 conn(0x7fb9a0099c40 msgr2=0x7fb9a0132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 shutdown_connections 2023-10-03T10:14:15.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.316+0000 7fb9a4d48700 1 -- 172.21.15.125:0/1417107372 wait complete. 2023-10-03T10:14:15.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:15.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:15.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:15.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.968+0000 7f5096515700 1 Processor -- start 2023-10-03T10:14:15.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.968+0000 7f5096515700 1 -- start start 2023-10-03T10:14:15.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.968+0000 7f5096515700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 0x7f509009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f5096515700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f509009f180 0x7f5090131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f5096515700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509009c970 con 0x7f5090131d70 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f5096515700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50900a0920 con 0x7f509009f180 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f5096515700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509009f9c0 con 0x7f509009e870 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f509009f180 0x7f5090131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 0x7f509009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 0x7f509009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41438/0 (socket says 172.21.15.125:41438) 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f509009f180 0x7f5090131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51804/0 (socket says 172.21.15.125:51804) 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508ffff700 1 -- 172.21.15.125:0/3407190536 learned_addr learned my addr 172.21.15.125:0/3407190536 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f5094ab2700 1 --1- 172.21.15.125:0/3407190536 >> v1:172.21.15.125:6789/0 conn(0x7f5090131d70 0x7f5090138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47024/0 (socket says 172.21.15.125:47024) 2023-10-03T10:14:15.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 -- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 msgr2=0x7f509009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 --2- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 0x7f509009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 -- 172.21.15.125:0/3407190536 >> v1:172.21.15.125:6789/0 conn(0x7f5090131d70 legacy=0x7f5090138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 -- 172.21.15.125:0/3407190536 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509009bab0 con 0x7f509009f180 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508f7fe700 1 --2- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f5090131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5084009840 tx=0x7f5084009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993dc16c65d6d798 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508effd700 1 -- 172.21.15.125:0/3407190536 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011830 con 0x7f509009f180 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508effd700 1 -- 172.21.15.125:0/3407190536 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084011990 con 0x7f509009f180 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.969+0000 7f508effd700 1 -- 172.21.15.125:0/3407190536 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011d20 con 0x7f509009f180 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 -- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 msgr2=0x7f5090131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 --2- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f5090131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5084009840 tx=0x7f5084009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 -- 172.21.15.125:0/3407190536 shutdown_connections 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 --2- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f509009e870 0x7f509009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 --2- 172.21.15.125:0/3407190536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f5090131830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 -- 172.21.15.125:0/3407190536 >> 172.21.15.125:0/3407190536 conn(0x7f50900a4430 msgr2=0x7f50900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 -- 172.21.15.125:0/3407190536 shutdown_connections 2023-10-03T10:14:15.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.970+0000 7f5096515700 1 -- 172.21.15.125:0/3407190536 wait complete. 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.971+0000 7f5096515700 1 Processor -- start 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.971+0000 7f5096515700 1 -- start start 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.971+0000 7f5096515700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f50901c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 0x7f50901c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090125120 con 0x7f509009f180 2023-10-03T10:14:15.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509009dc10 con 0x7f5090131d70 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f509006d640 con 0x7f509009e870 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46630/0 (socket says 172.21.15.125:46630) 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 -- 172.21.15.125:0/382455546 learned_addr learned my addr 172.21.15.125:0/382455546 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5094ab2700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 0x7f50901c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508f7fe700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f50901c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 -- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 msgr2=0x7f50901c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 0x7f50901c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 -- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 msgr2=0x7f50901c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f50901c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 -- 172.21.15.125:0/382455546 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840094a0 con 0x7f509009e870 2023-10-03T10:14:15.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5094ab2700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 0x7f50901c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508f7fe700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f50901c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508ffff700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f508000e8e0 tx=0x7f508000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080009600 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080013680 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5090126350 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080013a30 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.972+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5090124be0 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.973+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5080013b90 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.973+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f508003f920 con 0x7f509009e870 2023-10-03T10:14:15.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.973+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5090132660 con 0x7f509009e870 2023-10-03T10:14:15.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:15.978+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5080021020 con 0x7f509009e870 2023-10-03T10:14:16.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.008+0000 7fc5266dc700 1 Processor -- start 2023-10-03T10:14:16.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.008+0000 7fc5266dc700 1 -- start start 2023-10-03T10:14:16.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.008+0000 7fc5266dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.008+0000 7fc5266dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.008+0000 7fc5266dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52009dc00 con 0x7fc520133f50 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc5266dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52009ea60 con 0x7fc5200a1380 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc5266dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52009dec0 con 0x7fc5200a0a70 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41462/0 (socket says 172.21.15.125:41462) 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51ffff700 1 -- 172.21.15.125:0/3400101903 learned_addr learned my addr 172.21.15.125:0/3400101903 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 -- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 msgr2=0x7fc5200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 -- 172.21.15.125:0/3400101903 >> v1:172.21.15.125:6789/0 conn(0x7fc520133f50 legacy=0x7fc52013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 -- 172.21.15.125:0/3400101903 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52009e6a0 con 0x7fc5200a1380 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51ffff700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51f7fe700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a1380 0x7fc520133a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc514009840 tx=0x7fc514009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4e6bcc83d74d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51effd700 1 -- 172.21.15.125:0/3400101903 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514011830 con 0x7fc5200a1380 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51effd700 1 -- 172.21.15.125:0/3400101903 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514011990 con 0x7fc5200a1380 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.009+0000 7fc51effd700 1 -- 172.21.15.125:0/3400101903 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514011d20 con 0x7fc5200a1380 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 -- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a1380 msgr2=0x7fc520133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a1380 0x7fc520133a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc514009840 tx=0x7fc514009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 -- 172.21.15.125:0/3400101903 shutdown_connections 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 --2- 172.21.15.125:0/3400101903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 -- 172.21.15.125:0/3400101903 >> 172.21.15.125:0/3400101903 conn(0x7fc5200a6610 msgr2=0x7fc5200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 -- 172.21.15.125:0/3400101903 shutdown_connections 2023-10-03T10:14:16.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.010+0000 7fc5266dc700 1 -- 172.21.15.125:0/3400101903 wait complete. 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 Processor -- start 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 -- start start 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5201c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc5201c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520133850 con 0x7fc520133f50 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520122100 con 0x7fc5200a0a70 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.011+0000 7fc5266dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc520121e40 con 0x7fc5200a1380 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5201c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51834/0 (socket says 172.21.15.125:51834) 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 -- 172.21.15.125:0/1766467345 learned_addr learned my addr 172.21.15.125:0/1766467345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51f7fe700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc5201c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 -- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 msgr2=0x7fc5201c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc5201c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 -- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 msgr2=0x7fc5201c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5201c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 -- 172.21.15.125:0/1766467345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009550 con 0x7fc520133f50 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51ffff700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5201c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51f7fe700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc5201c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc524c79700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc51800cc50 tx=0x7fc51800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518003c00 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518003d60 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5140094a0 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800aab0 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.012+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200a03e0 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.013+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5200a2700 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.013+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc51800ac10 con 0x7fc520133f50 2023-10-03T10:14:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.014+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc518040120 con 0x7fc520133f50 2023-10-03T10:14:16.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.022+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5180050d0 con 0x7fc520133f50 2023-10-03T10:14:16.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.177+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f509004f2a0 con 0x7f509009e870 2023-10-03T10:14:16.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.177+0000 7f508cff9700 1 -- 172.21.15.125:0/382455546 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5080011db0 con 0x7f509009e870 2023-10-03T10:14:16.177 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 msgr2=0x7f50901c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f508000e8e0 tx=0x7f508000ebf0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 shutdown_connections 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5090131d70 0x7f50901c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f509009e870 0x7f50901c88e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 --2- 172.21.15.125:0/382455546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509009f180 0x7f50901c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 >> 172.21.15.125:0/382455546 conn(0x7f50900a4430 msgr2=0x7f509006fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 shutdown_connections 2023-10-03T10:14:16.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.179+0000 7f5096515700 1 -- 172.21.15.125:0/382455546 wait complete. 2023-10-03T10:14:16.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:16.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.215+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc520120d30 con 0x7fc520133f50 2023-10-03T10:14:16.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.216+0000 7fc51cff9700 1 -- 172.21.15.125:0/1766467345 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc518011380 con 0x7fc520133f50 2023-10-03T10:14:16.215 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 msgr2=0x7fc52011e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc51800cc50 tx=0x7fc51800cf60 comp rx=0 tx=0).stop 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 shutdown_connections 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc52011e950 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a0a70 0x7fc5201c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 --2- 172.21.15.125:0/1766467345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc5201c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 >> 172.21.15.125:0/1766467345 conn(0x7fc5200a6610 msgr2=0x7fc5200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 shutdown_connections 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.218+0000 7fc5266dc700 1 -- 172.21.15.125:0/1766467345 wait complete. 2023-10-03T10:14:16.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:16.286 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:16.328 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 Processor -- start 2023-10-03T10:14:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 -- start start 2023-10-03T10:14:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc09ac40 con 0x7f6bdc133e50 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc09a740 con 0x7f6bdc12cef0 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6be2132700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc09f3a0 con 0x7f6bdc133540 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6bdaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6bdb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6bdaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41484/0 (socket says 172.21.15.125:41484) 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6bdb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51836/0 (socket says 172.21.15.125:51836) 2023-10-03T10:14:16.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.413+0000 7f6bdaffd700 1 -- 172.21.15.125:0/3698214363 learned_addr learned my addr 172.21.15.125:0/3698214363 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdb7fe700 1 -- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 msgr2=0x7f6bdc133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdb7fe700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdb7fe700 1 -- 172.21.15.125:0/3698214363 >> v1:172.21.15.125:6789/0 conn(0x7f6bdc133e50 legacy=0x7f6bdc13a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdb7fe700 1 -- 172.21.15.125:0/3698214363 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc09b010 con 0x7f6bdc12cef0 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bda7fc700 1 -- 172.21.15.125:0/3698214363 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573837487 0 0) 0x7f6bdc09ac40 con 0x7f6bdc133e50 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdaffd700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bdb7fe700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009840 tx=0x7f6bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965f04039687594c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bda7fc700 1 -- 172.21.15.125:0/3698214363 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc011830 con 0x7f6bdc12cef0 2023-10-03T10:14:16.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bda7fc700 1 -- 172.21.15.125:0/3698214363 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc011990 con 0x7f6bdc12cef0 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6bda7fc700 1 -- 172.21.15.125:0/3698214363 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc011d20 con 0x7f6bdc12cef0 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6be2132700 1 -- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 msgr2=0x7f6bdc12d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.414+0000 7f6be2132700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009840 tx=0x7f6bcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 -- 172.21.15.125:0/3698214363 shutdown_connections 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc12d2c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 --2- 172.21.15.125:0/3698214363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 -- 172.21.15.125:0/3698214363 >> 172.21.15.125:0/3698214363 conn(0x7f6bdc099c40 msgr2=0x7f6bdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 -- 172.21.15.125:0/3698214363 shutdown_connections 2023-10-03T10:14:16.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 -- 172.21.15.125:0/3698214363 wait complete. 2023-10-03T10:14:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.415+0000 7f6be2132700 1 Processor -- start 2023-10-03T10:14:16.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 -- start start 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc11ec00 con 0x7f6bdc12cef0 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0a3400 con 0x7f6bdc133540 2023-10-03T10:14:16.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6be2132700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc12dbb0 con 0x7f6bdc133e50 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51842/0 (socket says 172.21.15.125:51842) 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46646/0 (socket says 172.21.15.125:46646) 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdb7fe700 1 -- 172.21.15.125:0/4271894793 learned_addr learned my addr 172.21.15.125:0/4271894793 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdbfff700 1 -- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 msgr2=0x7f6bdc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.416+0000 7f6bdbfff700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bdbfff700 1 -- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 msgr2=0x7f6bdc070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bdbfff700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bdbfff700 1 -- 172.21.15.125:0/4271894793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009550 con 0x7f6bdc133e50 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bdb7fe700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bdbfff700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c7c0 tx=0x7f6bd400cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4003e30 con 0x7f6bdc133e50 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4005070 con 0x7f6bdc133e50 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0094a0 con 0x7f6bdc133e50 2023-10-03T10:14:16.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4005420 con 0x7f6bdc133e50 2023-10-03T10:14:16.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.417+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc11eee0 con 0x7f6bdc133e50 2023-10-03T10:14:16.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.418+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bd4005580 con 0x7f6bdc133e50 2023-10-03T10:14:16.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.418+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bd403ec80 con 0x7f6bdc133e50 2023-10-03T10:14:16.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.418+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc11e170 con 0x7f6bdc133e50 2023-10-03T10:14:16.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.423+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bd4010d60 con 0x7f6bdc133e50 2023-10-03T10:14:16.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.454+0000 7fc53b11f700 1 Processor -- start 2023-10-03T10:14:16.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.454+0000 7fc53b11f700 1 -- start start 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc53b11f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5340a0a70 0x7fc5340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc53b11f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 0x7fc534133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc53b11f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53409dc00 con 0x7fc534133f50 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc53b11f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53409ea60 con 0x7fc5340a0a70 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc53b11f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53409dec0 con 0x7fc5340a1380 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc533fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 0x7fc534133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5340a0a70 0x7fc5340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5340a0a70 0x7fc5340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51846/0 (socket says 172.21.15.125:51846) 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc533fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 0x7fc534133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41502/0 (socket says 172.21.15.125:41502) 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 -- 172.21.15.125:0/3377827378 learned_addr learned my addr 172.21.15.125:0/3377827378 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 -- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 msgr2=0x7fc534133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 --2- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 0x7fc534133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 -- 172.21.15.125:0/3377827378 >> v1:172.21.15.125:6789/0 conn(0x7fc534133f50 legacy=0x7fc53413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 -- 172.21.15.125:0/3377827378 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53409e6a0 con 0x7fc5340a0a70 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc5337fe700 1 -- 172.21.15.125:0/3377827378 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625463493 0 0) 0x7fc53409dc00 con 0x7fc534133f50 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc538ebb700 1 --2- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc5340a0e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc5280098f0 tx=0x7fc528009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4f88df4c0aae12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc5337fe700 1 -- 172.21.15.125:0/3377827378 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528011830 con 0x7fc5340a0a70 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc5337fe700 1 -- 172.21.15.125:0/3377827378 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528011990 con 0x7fc5340a0a70 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.455+0000 7fc5337fe700 1 -- 172.21.15.125:0/3377827378 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528011d20 con 0x7fc5340a0a70 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 -- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 msgr2=0x7fc5340a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 --2- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc5340a0e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc5280098f0 tx=0x7fc528009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:16.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 -- 172.21.15.125:0/3377827378 shutdown_connections 2023-10-03T10:14:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 --2- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc5340a0e40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 --2- 172.21.15.125:0/3377827378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5340a1380 0x7fc534133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 -- 172.21.15.125:0/3377827378 >> 172.21.15.125:0/3377827378 conn(0x7fc5340a6610 msgr2=0x7fc5340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 -- 172.21.15.125:0/3377827378 shutdown_connections 2023-10-03T10:14:16.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.456+0000 7fc53b11f700 1 -- 172.21.15.125:0/3377827378 wait complete. 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 Processor -- start 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 -- start start 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 0x7fc534122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534133f50 0x7fc5341232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc534133ad0 con 0x7fc5340a0a70 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc534125de0 con 0x7fc534133f50 2023-10-03T10:14:16.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.457+0000 7fc53b11f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc534124510 con 0x7fc5340a1380 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc533fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 0x7fc534122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51858/0 (socket says 172.21.15.125:51858) 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc533fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 0x7fc534122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46648/0 (socket says 172.21.15.125:46648) 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 -- 172.21.15.125:0/2637220978 learned_addr learned my addr 172.21.15.125:0/2637220978 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc5396bc700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534133f50 0x7fc5341232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 -- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 msgr2=0x7fc534122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 0x7fc534122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 -- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534133f50 msgr2=0x7fc5341232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534133f50 0x7fc5341232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 -- 172.21.15.125:0/2637220978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528009550 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc538ebb700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc528009c40 tx=0x7fc528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528004510 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5280036a0 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528003a50 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5341260a0 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.458+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc534126380 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.459+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc528021070 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.459+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc528040ab0 con 0x7fc5340a0a70 2023-10-03T10:14:16.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.459+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53404f2a0 con 0x7fc5340a0a70 2023-10-03T10:14:16.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.464+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc528029080 con 0x7fc5340a0a70 2023-10-03T10:14:16.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.618+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bdc04f2a0 con 0x7f6bdc133e50 2023-10-03T10:14:16.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.618+0000 7f6bc3fff700 1 -- 172.21.15.125:0/4271894793 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bd4010300 con 0x7f6bdc133e50 2023-10-03T10:14:16.618 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:16.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.620+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 msgr2=0x7f6bdc070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.620+0000 7f6be2132700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c7c0 tx=0x7f6bd400cad0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 shutdown_connections 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bdc133e50 0x7f6bdc070dd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bdc12cef0 0x7f6bdc070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 --2- 172.21.15.125:0/4271894793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bdc133540 0x7f6bdc070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 >> 172.21.15.125:0/4271894793 conn(0x7f6bdc099c40 msgr2=0x7f6bdc131980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 shutdown_connections 2023-10-03T10:14:16.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.621+0000 7f6be2132700 1 -- 172.21.15.125:0/4271894793 wait complete. 2023-10-03T10:14:16.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:16.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.656+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc534072980 con 0x7fc5340a0a70 2023-10-03T10:14:16.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.656+0000 7fc5317fa700 1 -- 172.21.15.125:0/2637220978 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc528015020 con 0x7fc5340a0a70 2023-10-03T10:14:16.656 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 msgr2=0x7fc534122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc528009c40 tx=0x7fc528004750 comp rx=0 tx=0).stop 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 shutdown_connections 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534133f50 0x7fc5341232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340a0a70 0x7fc534122860 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 --2- 172.21.15.125:0/2637220978 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5340a1380 0x7fc534122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 >> 172.21.15.125:0/2637220978 conn(0x7fc5340a6610 msgr2=0x7fc53409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 shutdown_connections 2023-10-03T10:14:16.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:16.658+0000 7fc53b11f700 1 -- 172.21.15.125:0/2637220978 wait complete. 2023-10-03T10:14:16.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:17.191 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:17.230 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 Processor -- start 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 -- start start 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c09e9d0 con 0x7fad4c0a1380 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c09dc00 con 0x7fad4c133f50 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.320+0000 7fad5219c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c09dec0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41516/0 (socket says 172.21.15.125:41516) 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51866/0 (socket says 172.21.15.125:51866) 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 -- 172.21.15.125:0/62490532 learned_addr learned my addr 172.21.15.125:0/62490532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 -- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 msgr2=0x7fad4c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 --2- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 -- 172.21.15.125:0/62490532 >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 msgr2=0x7fad4c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 --2- 172.21.15.125:0/62490532 >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 -- 172.21.15.125:0/62490532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c09e6a0 con 0x7fad4c133f50 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4affd700 1 --2- 172.21.15.125:0/62490532 >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4bfff700 1 --2- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e50 tx=0x7fad4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37173bf0d067765 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4a7fc700 1 -- 172.21.15.125:0/62490532 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400e070 con 0x7fad4c133f50 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4a7fc700 1 -- 172.21.15.125:0/62490532 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400b910 con 0x7fad4c133f50 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.321+0000 7fad4a7fc700 1 -- 172.21.15.125:0/62490532 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400bcc0 con 0x7fad4c133f50 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 -- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 msgr2=0x7fad4c134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 --2- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e50 tx=0x7fad4400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 -- 172.21.15.125:0/62490532 shutdown_connections 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 --2- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c134380 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 --2- 172.21.15.125:0/62490532 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 --2- 172.21.15.125:0/62490532 >> v2:172.21.15.125:3300/0 conn(0x7fad4c0a1380 0x7fad4c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 -- 172.21.15.125:0/62490532 >> 172.21.15.125:0/62490532 conn(0x7fad4c0a6610 msgr2=0x7fad4c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 -- 172.21.15.125:0/62490532 shutdown_connections 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.322+0000 7fad5219c700 1 -- 172.21.15.125:0/62490532 wait complete. 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 Processor -- start 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 -- start start 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 0x7fad4c122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c123800 con 0x7fad4c0a1380 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c125bb0 con 0x7fad4c133f50 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad5219c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c126300 con 0x7fad4c0a0a70 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad4b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad4b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46678/0 (socket says 172.21.15.125:46678) 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad4b7fe700 1 -- 172.21.15.125:0/2517028377 learned_addr learned my addr 172.21.15.125:0/2517028377 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.323+0000 7fad4affd700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 0x7fad4c122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4bfff700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 -- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 msgr2=0x7fad4c122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 -- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 msgr2=0x7fad4c122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 0x7fad4c122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 -- 172.21.15.125:0/2517028377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400094a0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4affd700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 0x7fad4c122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad4b7fe700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00e870 tx=0x7fad3c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c013680 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0137e0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad44009b30 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c013b90 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.324+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c0a03e0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.325+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad3c013cf0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.325+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad3c03f4e0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.325+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c123ef0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.330+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad3c021020 con 0x7fad4c0a0a70 2023-10-03T10:14:17.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.360+0000 7fc64a4b8700 1 Processor -- start 2023-10-03T10:14:17.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.360+0000 7fc64a4b8700 1 -- start start 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 0x7fc6441343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64409e9d0 con 0x7fc6440a0a70 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64409dc00 con 0x7fc644133f50 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc64a4b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64409dec0 con 0x7fc6440a1380 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc643fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc643fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51890/0 (socket says 172.21.15.125:51890) 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc643fff700 1 -- 172.21.15.125:0/3350960178 learned_addr learned my addr 172.21.15.125:0/3350960178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 0x7fc6441343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 -- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 msgr2=0x7fc644133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 -- 172.21.15.125:0/3350960178 >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 msgr2=0x7fc6440a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 --2- 172.21.15.125:0/3350960178 >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc648a55700 1 -- 172.21.15.125:0/3350960178 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64409e6a0 con 0x7fc644133f50 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc643fff700 1 --2- 172.21.15.125:0/3350960178 >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.361+0000 7fc6437fe700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc648a55700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 0x7fc6441343b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009d90 tx=0x7fc63c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a506e1423cc84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc642ffd700 1 -- 172.21.15.125:0/3350960178 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00e070 con 0x7fc644133f50 2023-10-03T10:14:17.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc642ffd700 1 -- 172.21.15.125:0/3350960178 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00bb20 con 0x7fc644133f50 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc642ffd700 1 -- 172.21.15.125:0/3350960178 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c012430 con 0x7fc644133f50 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 -- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 msgr2=0x7fc6441343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 0x7fc6441343b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009d90 tx=0x7fc63c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 -- 172.21.15.125:0/3350960178 shutdown_connections 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc644133f50 0x7fc6441343b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/3350960178 >> v2:172.21.15.125:3300/0 conn(0x7fc6440a0a70 0x7fc6440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/3350960178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 -- 172.21.15.125:0/3350960178 >> 172.21.15.125:0/3350960178 conn(0x7fc6440a6610 msgr2=0x7fc6440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 -- 172.21.15.125:0/3350960178 shutdown_connections 2023-10-03T10:14:17.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.362+0000 7fc64a4b8700 1 -- 172.21.15.125:0/3350960178 wait complete. 2023-10-03T10:14:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.363+0000 7fc64a4b8700 1 Processor -- start 2023-10-03T10:14:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 -- start start 2023-10-03T10:14:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 0x7fc644121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 0x7fc644121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc644124e50 con 0x7fc644133f50 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc644123dd0 con 0x7fc6440a0a70 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc64a4b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440a03e0 con 0x7fc6440a1380 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc643fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 0x7fc644121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46694/0 (socket says 172.21.15.125:46694) 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc643fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 0x7fc644121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41548/0 (socket says 172.21.15.125:41548) 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc6437fe700 1 -- 172.21.15.125:0/4113662378 learned_addr learned my addr 172.21.15.125:0/4113662378 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.364+0000 7fc648a55700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 0x7fc644121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 -- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 msgr2=0x7fc644121330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 0x7fc644121330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 -- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 msgr2=0x7fc644121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 0x7fc644121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 -- 172.21.15.125:0/4113662378 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634009550 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc648a55700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 0x7fc644121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc6437fe700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc63800ebe0 tx=0x7fc63800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638009800 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800c850 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380094a0 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800cbc0 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.365+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c009a70 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.366+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc63800cd20 con 0x7fc6440a1380 2023-10-03T10:14:17.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.366+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64411e040 con 0x7fc6440a1380 2023-10-03T10:14:17.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.366+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc63803f800 con 0x7fc6440a1380 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.375+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc63801be10 con 0x7fc6440a1380 2023-10-03T10:14:17.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.526+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad4c04f2a0 con 0x7fad4c0a0a70 2023-10-03T10:14:17.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.526+0000 7fad33fff700 1 -- 172.21.15.125:0/2517028377 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad3c017070 con 0x7fad4c0a0a70 2023-10-03T10:14:17.526 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:17.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 msgr2=0x7fad4c122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00e870 tx=0x7fad3c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 shutdown_connections 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad4c133f50 0x7fad4c122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad4c0a0a70 0x7fad4c122330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 --2- 172.21.15.125:0/2517028377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0a1380 0x7fad4c122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 >> 172.21.15.125:0/2517028377 conn(0x7fad4c0a6610 msgr2=0x7fad4c09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 shutdown_connections 2023-10-03T10:14:17.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.528+0000 7fad5219c700 1 -- 172.21.15.125:0/2517028377 wait complete. 2023-10-03T10:14:17.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:17.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.562+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc64404f2a0 con 0x7fc6440a1380 2023-10-03T10:14:17.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.563+0000 7fc640ff9700 1 -- 172.21.15.125:0/4113662378 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc63801b3b0 con 0x7fc6440a1380 2023-10-03T10:14:17.562 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:17.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 msgr2=0x7fc644121870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc63800ebe0 tx=0x7fc63800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 shutdown_connections 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc644133f50 0x7fc644121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6440a0a70 0x7fc644121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 --2- 172.21.15.125:0/4113662378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6440a1380 0x7fc644121870 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 >> 172.21.15.125:0/4113662378 conn(0x7fc6440a6610 msgr2=0x7fc644133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 shutdown_connections 2023-10-03T10:14:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.565+0000 7fc64a4b8700 1 -- 172.21.15.125:0/4113662378 wait complete. 2023-10-03T10:14:17.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:17.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:17.670 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:17.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.763+0000 7f91c0e7b700 1 Processor -- start 2023-10-03T10:14:17.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.763+0000 7f91c0e7b700 1 -- start start 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc131670 con 0x7f91bc09d860 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc09aaa0 con 0x7f91bc130ce0 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91c0e7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc09f870 con 0x7f91bc09e170 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91bad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46706/0 (socket says 172.21.15.125:46706) 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91bad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41558/0 (socket says 172.21.15.125:41558) 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 -- 172.21.15.125:0/446139418 learned_addr learned my addr 172.21.15.125:0/446139418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51906/0 (socket says 172.21.15.125:51906) 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 -- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 msgr2=0x7f91bc131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 -- 172.21.15.125:0/446139418 >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 msgr2=0x7f91bc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/446139418 >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 -- 172.21.15.125:0/446139418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc09b360 con 0x7f91bc09e170 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91ba59c700 1 --2- 172.21.15.125:0/446139418 >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91bad9d700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.764+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009920 tx=0x7f91b0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e16fef9c71fbd078 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91b959a700 1 -- 172.21.15.125:0/446139418 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000f8a0 con 0x7f91bc09e170 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91b959a700 1 -- 172.21.15.125:0/446139418 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000fa00 con 0x7f91bc09e170 2023-10-03T10:14:17.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91b959a700 1 -- 172.21.15.125:0/446139418 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000fd90 con 0x7f91bc09e170 2023-10-03T10:14:17.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 -- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 msgr2=0x7f91bc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009920 tx=0x7f91b0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:17.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 -- 172.21.15.125:0/446139418 shutdown_connections 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/446139418 >> v2:172.21.15.125:3300/0 conn(0x7f91bc09d860 0x7f91bc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/446139418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09e170 0x7f91bc1307a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 -- 172.21.15.125:0/446139418 >> 172.21.15.125:0/446139418 conn(0x7f91bc099c40 msgr2=0x7f91bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 -- 172.21.15.125:0/446139418 shutdown_connections 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.765+0000 7f91c0e7b700 1 -- 172.21.15.125:0/446139418 wait complete. 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.766+0000 7f91c0e7b700 1 Processor -- start 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.766+0000 7f91c0e7b700 1 -- start start 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 0x7f91bc120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc123f00 con 0x7f91bc09e170 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0a22f0 con 0x7f91bc130ce0 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91c0e7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc09c8b0 con 0x7f91bc09d860 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91ba59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 0x7f91bc120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91ba59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46708/0 (socket says 172.21.15.125:46708) 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91ba59c700 1 -- 172.21.15.125:0/1988976356 learned_addr learned my addr 172.21.15.125:0/1988976356 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91bad9d700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 -- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 msgr2=0x7f91bc1202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 -- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 msgr2=0x7f91bc120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 -- 172.21.15.125:0/1988976356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0094a0 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91ba59c700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.767+0000 7f91b9d9b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 0x7f91bc120810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f91b0018000 tx=0x7f91b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.768+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0003ab0 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.768+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0003c10 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.768+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b4009a70 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.768+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0004560 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.768+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b0009550 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.769+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91b0022440 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.769+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc123c30 con 0x7f91bc09e170 2023-10-03T10:14:17.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.769+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91b0040940 con 0x7f91bc09e170 2023-10-03T10:14:17.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.773+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91b0019400 con 0x7f91bc09e170 2023-10-03T10:14:17.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 Processor -- start 2023-10-03T10:14:17.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 -- start start 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77700a0a70 0x7f77700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 0x7f7770133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777009e9d0 con 0x7f77700a0a70 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777009dc00 con 0x7f77700a1380 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.802+0000 7f7774bad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777009dec0 con 0x7f7770133f50 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77700a0a70 0x7f77700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 0x7f7770133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77700a0a70 0x7f77700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51932/0 (socket says 172.21.15.125:51932) 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46724/0 (socket says 172.21.15.125:46724) 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 -- 172.21.15.125:0/1919673098 learned_addr learned my addr 172.21.15.125:0/1919673098 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 -- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 msgr2=0x7f77701343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 -- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 msgr2=0x7f7770133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 0x7f7770133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 -- 172.21.15.125:0/1919673098 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777009e6a0 con 0x7f77700a0a70 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776ed9d700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776dd9b700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 0x7f7770133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776e59c700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77700a0a70 0x7f77700a0e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f77600098f0 tx=0x7f7760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5873f164e60c5ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776d59a700 1 -- 172.21.15.125:0/1919673098 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011830 con 0x7f77700a0a70 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776d59a700 1 -- 172.21.15.125:0/1919673098 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760011990 con 0x7f77700a0a70 2023-10-03T10:14:17.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.803+0000 7f776d59a700 1 -- 172.21.15.125:0/1919673098 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011d20 con 0x7f77700a0a70 2023-10-03T10:14:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 -- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77700a0a70 msgr2=0x7f77700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77700a0a70 0x7f77700a0e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f77600098f0 tx=0x7f7760009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 -- 172.21.15.125:0/1919673098 shutdown_connections 2023-10-03T10:14:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7770133f50 0x7f77701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77700a0a70 0x7f77700a0e40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 --2- 172.21.15.125:0/1919673098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a1380 0x7f7770133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 -- 172.21.15.125:0/1919673098 >> 172.21.15.125:0/1919673098 conn(0x7f77700a6610 msgr2=0x7f77700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 -- 172.21.15.125:0/1919673098 shutdown_connections 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.804+0000 7f7774bad700 1 -- 172.21.15.125:0/1919673098 wait complete. 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 Processor -- start 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 -- start start 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 0x7f77701228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 0x7f7770122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7770125f20 con 0x7f7770133f50 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77701251c0 con 0x7f77700a0a70 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f7774bad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77701240f0 con 0x7f77700a1380 2023-10-03T10:14:17.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.805+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 0x7f77701228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 0x7f77701228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46732/0 (socket says 172.21.15.125:46732) 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776dd9b700 1 -- 172.21.15.125:0/2603216086 learned_addr learned my addr 172.21.15.125:0/2603216086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41576/0 (socket says 172.21.15.125:41576) 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 0x7f7770122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 -- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 msgr2=0x7f77701228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 0x7f77701228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 -- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 msgr2=0x7f7770122360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 -- 172.21.15.125:0/2603216086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640094a0 con 0x7f7770133f50 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776e59c700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f776ed9d700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 0x7f7770122de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e50 tx=0x7f776800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800ca90 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776800f040 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800ce50 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7768009a70 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.806+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760009550 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.807+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7768014480 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.807+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f776803fbd0 con 0x7f7770133f50 2023-10-03T10:14:17.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.807+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777004f2a0 con 0x7f7770133f50 2023-10-03T10:14:17.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.812+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7768012930 con 0x7f7770133f50 2023-10-03T10:14:17.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.966+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91bc04f2a0 con 0x7f91bc09e170 2023-10-03T10:14:17.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.967+0000 7f91aaffd700 1 -- 172.21.15.125:0/1988976356 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91b000c150 con 0x7f91bc09e170 2023-10-03T10:14:17.966 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:17.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 msgr2=0x7f91bc120810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 0x7f91bc120810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f91b0018000 tx=0x7f91b0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:17.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 shutdown_connections 2023-10-03T10:14:17.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91bc130ce0 0x7f91bc120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91bc09d860 0x7f91bc1202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.968+0000 7f91c0e7b700 1 --2- 172.21.15.125:0/1988976356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc09e170 0x7f91bc120810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.969+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 >> 172.21.15.125:0/1988976356 conn(0x7f91bc099c40 msgr2=0x7f91bc130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.969+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 shutdown_connections 2023-10-03T10:14:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:17.969+0000 7f91c0e7b700 1 -- 172.21.15.125:0/1988976356 wait complete. 2023-10-03T10:14:17.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:18.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.006+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77700a2710 con 0x7f7770133f50 2023-10-03T10:14:18.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.007+0000 7f775effd700 1 -- 172.21.15.125:0/2603216086 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7768012340 con 0x7f7770133f50 2023-10-03T10:14:18.006 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:18.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 msgr2=0x7f7770122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 0x7f7770122de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e50 tx=0x7f776800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 shutdown_connections 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770133f50 0x7f7770122de0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77700a0a70 0x7f7770122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 --2- 172.21.15.125:0/2603216086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77700a1380 0x7f77701228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 >> 172.21.15.125:0/2603216086 conn(0x7f77700a6610 msgr2=0x7f777009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 shutdown_connections 2023-10-03T10:14:18.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.009+0000 7f7774bad700 1 -- 172.21.15.125:0/2603216086 wait complete. 2023-10-03T10:14:18.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:18.541 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:18.577 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:18.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.670+0000 7f270a283700 1 Processor -- start 2023-10-03T10:14:18.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.670+0000 7f270a283700 1 -- start start 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f270a283700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f270a283700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f270a283700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270409dc00 con 0x7f2704133f50 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f270a283700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270409ea60 con 0x7f27040a1380 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f270a283700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270409dec0 con 0x7f27040a0a70 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f27037fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41588/0 (socket says 172.21.15.125:41588) 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f27037fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51942/0 (socket says 172.21.15.125:51942) 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2708820700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2704133f50 0x7f270413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47046/0 (socket says 172.21.15.125:47046) 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 -- 172.21.15.125:0/2907837553 learned_addr learned my addr 172.21.15.125:0/2907837553 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 -- 172.21.15.125:0/2907837553 >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 msgr2=0x7f2704133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 --2- 172.21.15.125:0/2907837553 >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 -- 172.21.15.125:0/2907837553 >> v1:172.21.15.125:6789/0 conn(0x7f2704133f50 legacy=0x7f270413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 -- 172.21.15.125:0/2907837553 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270409e6a0 con 0x7f27040a0a70 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f27037fe700 1 --2- 172.21.15.125:0/2907837553 >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2703fff700 1 --2- 172.21.15.125:0/2907837553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f26f40098f0 tx=0x7f26f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b14903879eae19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2702ffd700 1 -- 172.21.15.125:0/2907837553 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4011830 con 0x7f27040a0a70 2023-10-03T10:14:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2702ffd700 1 -- 172.21.15.125:0/2907837553 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4011990 con 0x7f27040a0a70 2023-10-03T10:14:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.671+0000 7f2702ffd700 1 -- 172.21.15.125:0/2907837553 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4011d20 con 0x7f27040a0a70 2023-10-03T10:14:18.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 -- 172.21.15.125:0/2907837553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 msgr2=0x7f27040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 --2- 172.21.15.125:0/2907837553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f26f40098f0 tx=0x7f26f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 -- 172.21.15.125:0/2907837553 shutdown_connections 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 --2- 172.21.15.125:0/2907837553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a0a70 0x7f27040a0e40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 --2- 172.21.15.125:0/2907837553 >> v2:172.21.15.125:3300/0 conn(0x7f27040a1380 0x7f2704133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 -- 172.21.15.125:0/2907837553 >> 172.21.15.125:0/2907837553 conn(0x7f27040a6610 msgr2=0x7f27040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 -- 172.21.15.125:0/2907837553 shutdown_connections 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.672+0000 7f270a283700 1 -- 172.21.15.125:0/2907837553 wait complete. 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.673+0000 7f270a283700 1 Processor -- start 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.673+0000 7f270a283700 1 -- start start 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 0x7f27041c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 0x7f27041c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 0x7f27041c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041247f0 con 0x7f27040a0a70 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2704124600 con 0x7f27040a1380 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27041252e0 con 0x7f2704133f50 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 0x7f27041c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 0x7f27041c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 0x7f27041c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51952/0 (socket says 172.21.15.125:51952) 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2703fff700 1 -- 172.21.15.125:0/2272291409 learned_addr learned my addr 172.21.15.125:0/2272291409 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f27037fe700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 0x7f27041c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 -- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 msgr2=0x7f27041c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 0x7f27041c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 -- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 msgr2=0x7f27041c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 0x7f27041c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 -- 172.21.15.125:0/2272291409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80094a0 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f27037fe700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 0x7f27041c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2708820700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 0x7f27041c8c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00cb40 tx=0x7f26fc00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00a9a0 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00ab00 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f4009550 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.674+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00ae70 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.675+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2704126230 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.675+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26fc007070 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.675+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26fc03f310 con 0x7f2704133f50 2023-10-03T10:14:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.676+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2704125ed0 con 0x7f2704133f50 2023-10-03T10:14:18.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.680+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2704125ed0 con 0x7f2704133f50 2023-10-03T10:14:18.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 Processor -- start 2023-10-03T10:14:18.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 -- start start 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f1014138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1014134570 0x7f101413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101409b110 con 0x7f101409ad40 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140a3b60 con 0x7f1014134570 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.711+0000 7f101945f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a1a80 con 0x7f1014134140 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1014134570 0x7f101413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1014134570 0x7f101413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51954/0 (socket says 172.21.15.125:51954) 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10127fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f1014138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 -- 172.21.15.125:0/3519200960 learned_addr learned my addr 172.21.15.125:0/3519200960 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f1012ffd700 1 --1- 172.21.15.125:0/3519200960 >> v1:172.21.15.125:6789/0 conn(0x7f101409ad40 0x7f1014133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47050/0 (socket says 172.21.15.125:47050) 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 -- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 msgr2=0x7f1014138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f1014138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 -- 172.21.15.125:0/3519200960 >> v1:172.21.15.125:6789/0 conn(0x7f101409ad40 legacy=0x7f1014133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 -- 172.21.15.125:0/3519200960 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140a2fa0 con 0x7f1014134570 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f1011ffb700 1 -- 172.21.15.125:0/3519200960 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562038443 0 0) 0x7f101409b110 con 0x7f101409ad40 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10127fc700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f1014138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f10137fe700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1014134570 0x7f101413b3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f100c009e50 tx=0x7f100c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ac7e7d96a3ac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f1011ffb700 1 -- 172.21.15.125:0/3519200960 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00e070 con 0x7f1014134570 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f1011ffb700 1 -- 172.21.15.125:0/3519200960 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00b910 con 0x7f1014134570 2023-10-03T10:14:18.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.712+0000 7f1011ffb700 1 -- 172.21.15.125:0/3519200960 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00bcc0 con 0x7f1014134570 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 -- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1014134570 msgr2=0x7f101413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1014134570 0x7f101413b3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f100c009e50 tx=0x7f100c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 -- 172.21.15.125:0/3519200960 shutdown_connections 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1014134570 0x7f101413b3d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 --2- 172.21.15.125:0/3519200960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f1014138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 -- 172.21.15.125:0/3519200960 >> 172.21.15.125:0/3519200960 conn(0x7f1014099c40 msgr2=0x7f101406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 -- 172.21.15.125:0/3519200960 shutdown_connections 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.713+0000 7f101945f700 1 -- 172.21.15.125:0/3519200960 wait complete. 2023-10-03T10:14:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 Processor -- start 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 -- start start 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f101409ad40 0x7f101411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f101411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101411dd10 con 0x7f101409ad40 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101411ec90 con 0x7f1014134140 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.714+0000 7f101945f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f101409c7e0 con 0x7f1014134570 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10137fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f101411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10137fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46742/0 (socket says 172.21.15.125:46742) 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10137fe700 1 -- 172.21.15.125:0/626892066 learned_addr learned my addr 172.21.15.125:0/626892066 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f1012ffd700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f101409ad40 0x7f101411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 -- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 msgr2=0x7f101411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 -- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f101409ad40 msgr2=0x7f101411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f101409ad40 0x7f101411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 -- 172.21.15.125:0/626892066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080094a0 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10137fe700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f10127fc700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f101411ce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f100800e9b0 tx=0x7f100800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800ee50 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800c850 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800cc00 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c009b30 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.715+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101411e930 con 0x7f1014134140 2023-10-03T10:14:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.716+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1008013470 con 0x7f1014134140 2023-10-03T10:14:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.716+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f100803f6e0 con 0x7f1014134140 2023-10-03T10:14:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.716+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101404f2a0 con 0x7f1014134140 2023-10-03T10:14:18.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.721+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1008013720 con 0x7f1014134140 2023-10-03T10:14:18.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.873+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2704125ed0 con 0x7f2704133f50 2023-10-03T10:14:18.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.874+0000 7f2700ff9700 1 -- 172.21.15.125:0/2272291409 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2704125ed0 con 0x7f2704133f50 2023-10-03T10:14:18.873 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:18.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 msgr2=0x7f27041c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 0x7f27041c8c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00cb40 tx=0x7f26fc00ce50 comp rx=0 tx=0).stop 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 shutdown_connections 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2704133f50 0x7f27041c8c80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27040a0a70 0x7f27041c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 --2- 172.21.15.125:0/2272291409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27040a1380 0x7f27041c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 >> 172.21.15.125:0/2272291409 conn(0x7f27040a6610 msgr2=0x7f27040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 shutdown_connections 2023-10-03T10:14:18.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.876+0000 7f270a283700 1 -- 172.21.15.125:0/2272291409 wait complete. 2023-10-03T10:14:18.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:18.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.915+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10140a4330 con 0x7f1014134140 2023-10-03T10:14:18.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.916+0000 7f0ffb7fe700 1 -- 172.21.15.125:0/626892066 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1008011350 con 0x7f1014134140 2023-10-03T10:14:18.915 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 msgr2=0x7f101411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f101411ce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f100800e9b0 tx=0x7f100800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 shutdown_connections 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1014134570 0x7f101411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f101409ad40 0x7f101411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 --2- 172.21.15.125:0/626892066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1014134140 0x7f101411ce00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 >> 172.21.15.125:0/626892066 conn(0x7f1014099c40 msgr2=0x7f101413b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 shutdown_connections 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:18.918+0000 7f101945f700 1 -- 172.21.15.125:0/626892066 wait complete. 2023-10-03T10:14:18.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:18.981 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:19.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:19.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.106+0000 7f5bf1f24700 1 Processor -- start 2023-10-03T10:14:19.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.106+0000 7f5bf1f24700 1 -- start start 2023-10-03T10:14:19.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec09e9d0 con 0x7f5bec133f50 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec09dc00 con 0x7f5bec0a0a70 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bf1f24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec09dec0 con 0x7f5bec0a1380 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bebfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bebfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51968/0 (socket says 172.21.15.125:51968) 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bebfff700 1 -- 172.21.15.125:0/2243527229 learned_addr learned my addr 172.21.15.125:0/2243527229 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41616/0 (socket says 172.21.15.125:41616) 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 -- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 msgr2=0x7f5bec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 -- 172.21.15.125:0/2243527229 >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 msgr2=0x7f5bec1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/2243527229 >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 -- 172.21.15.125:0/2243527229 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec09e6a0 con 0x7f5bec0a0a70 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5bebfff700 1 --2- 172.21.15.125:0/2243527229 >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beaffd700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.107+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009d90 tx=0x7f5bdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b378cb47b0f31e73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bea7fc700 1 -- 172.21.15.125:0/2243527229 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00e070 con 0x7f5bec0a0a70 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bea7fc700 1 -- 172.21.15.125:0/2243527229 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00bb20 con 0x7f5bec0a0a70 2023-10-03T10:14:19.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bea7fc700 1 -- 172.21.15.125:0/2243527229 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc012430 con 0x7f5bec0a0a70 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 -- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 msgr2=0x7f5bec0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009d90 tx=0x7f5bdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 -- 172.21.15.125:0/2243527229 shutdown_connections 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec0a0e40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/2243527229 >> v2:172.21.15.125:3300/0 conn(0x7f5bec133f50 0x7f5bec1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/2243527229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 -- 172.21.15.125:0/2243527229 >> 172.21.15.125:0/2243527229 conn(0x7f5bec0a6610 msgr2=0x7f5bec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 -- 172.21.15.125:0/2243527229 shutdown_connections 2023-10-03T10:14:19.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.108+0000 7f5bf1f24700 1 -- 172.21.15.125:0/2243527229 wait complete. 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.109+0000 7f5bf1f24700 1 Processor -- start 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.109+0000 7f5bf1f24700 1 -- start start 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 0x7f5bec11ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec121170 con 0x7f5bec133f50 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec120f80 con 0x7f5bec0a0a70 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1215a0 con 0x7f5bec0a1380 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41630/0 (socket says 172.21.15.125:41630) 2023-10-03T10:14:19.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46764/0 (socket says 172.21.15.125:46764) 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 -- 172.21.15.125:0/880933338 learned_addr learned my addr 172.21.15.125:0/880933338 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bebfff700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 0x7f5bec11ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 -- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 msgr2=0x7f5bec11f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 -- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 msgr2=0x7f5bec11ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 0x7f5bec11ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 -- 172.21.15.125:0/880933338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40094a0 con 0x7f5bec0a0a70 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beaffd700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bebfff700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 0x7f5bec11ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5beb7fe700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5bec09dd40 tx=0x7f5bdc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc004880 con 0x7f5bec0a0a70 2023-10-03T10:14:19.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc020070 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0276c0 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.110+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be4009550 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.111+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc009a70 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.111+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bdc012430 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.111+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bdc022070 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.111+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0a03e0 con 0x7f5bec0a0a70 2023-10-03T10:14:19.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.116+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bdc02c080 con 0x7f5bec0a0a70 2023-10-03T10:14:19.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.149+0000 7fdb7433f700 1 Processor -- start 2023-10-03T10:14:19.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 -- start start 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 0x7fdb6c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c0a0920 con 0x7fdb6c131d70 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c09c970 con 0x7fdb6c09e870 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb7433f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c09bab0 con 0x7fdb6c09f180 2023-10-03T10:14:19.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb720db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb718da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 0x7fdb6c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb728dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb720db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41644/0 (socket says 172.21.15.125:41644) 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb718da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 0x7fdb6c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46768/0 (socket says 172.21.15.125:46768) 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb728dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51982/0 (socket says 172.21.15.125:51982) 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.150+0000 7fdb720db700 1 -- 172.21.15.125:0/2925223076 learned_addr learned my addr 172.21.15.125:0/2925223076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 -- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 msgr2=0x7fdb6c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 --2- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 0x7fdb6c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 -- 172.21.15.125:0/2925223076 >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 msgr2=0x7fdb6c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 --2- 172.21.15.125:0/2925223076 >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 -- 172.21.15.125:0/2925223076 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c09f9c0 con 0x7fdb6c09e870 2023-10-03T10:14:19.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb728dc700 1 --2- 172.21.15.125:0/2925223076 >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb720db700 1 --2- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdb680098f0 tx=0x7fdb68009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f5e547d56d18d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb710d9700 1 -- 172.21.15.125:0/2925223076 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68011830 con 0x7fdb6c09e870 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb710d9700 1 -- 172.21.15.125:0/2925223076 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68011990 con 0x7fdb6c09e870 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb710d9700 1 -- 172.21.15.125:0/2925223076 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68011d20 con 0x7fdb6c09e870 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb7433f700 1 -- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 msgr2=0x7fdb6c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.151+0000 7fdb7433f700 1 --2- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdb680098f0 tx=0x7fdb68009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 -- 172.21.15.125:0/2925223076 shutdown_connections 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 --2- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09e870 0x7fdb6c09ec40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 --2- 172.21.15.125:0/2925223076 >> v2:172.21.15.125:3300/0 conn(0x7fdb6c131d70 0x7fdb6c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 --2- 172.21.15.125:0/2925223076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c09f180 0x7fdb6c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 -- 172.21.15.125:0/2925223076 >> 172.21.15.125:0/2925223076 conn(0x7fdb6c0a4430 msgr2=0x7fdb6c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 -- 172.21.15.125:0/2925223076 shutdown_connections 2023-10-03T10:14:19.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 -- 172.21.15.125:0/2925223076 wait complete. 2023-10-03T10:14:19.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 Processor -- start 2023-10-03T10:14:19.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.152+0000 7fdb7433f700 1 -- start start 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 0x7fdb6c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c122b40 con 0x7fdb6c09e870 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c121c40 con 0x7fdb6c09f180 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb7433f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0a0210 con 0x7fdb6c131d70 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb720db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb728dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 0x7fdb6c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb720db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51994/0 (socket says 172.21.15.125:51994) 2023-10-03T10:14:19.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41646/0 (socket says 172.21.15.125:41646) 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb728dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 0x7fdb6c120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46772/0 (socket says 172.21.15.125:46772) 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb720db700 1 -- 172.21.15.125:0/547289782 learned_addr learned my addr 172.21.15.125:0/547289782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 -- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 msgr2=0x7fdb6c120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 0x7fdb6c120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 -- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 msgr2=0x7fdb6c1201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 -- 172.21.15.125:0/547289782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009a70 con 0x7fdb6c09f180 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb720db700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.153+0000 7fdb718da700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00e840 tx=0x7fdb5c00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c013680 con 0x7fdb6c09f180 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0137e0 con 0x7fdb6c09f180 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb68009550 con 0x7fdb6c09f180 2023-10-03T10:14:19.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c013b70 con 0x7fdb6c09f180 2023-10-03T10:14:19.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c1235b0 con 0x7fdb6c09f180 2023-10-03T10:14:19.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.154+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb5c013cd0 con 0x7fdb6c09f180 2023-10-03T10:14:19.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.155+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb5c03f570 con 0x7fdb6c09f180 2023-10-03T10:14:19.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.155+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c1237a0 con 0x7fdb6c09f180 2023-10-03T10:14:19.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.159+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb5c00cd40 con 0x7fdb6c09f180 2023-10-03T10:14:19.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.329+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5bec04f2a0 con 0x7f5bec0a0a70 2023-10-03T10:14:19.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.330+0000 7f5be3fff700 1 -- 172.21.15.125:0/880933338 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bdc01a380 con 0x7f5bec0a0a70 2023-10-03T10:14:19.329 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 msgr2=0x7f5bec11f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5bec09dd40 tx=0x7f5bdc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 shutdown_connections 2023-10-03T10:14:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bec133f50 0x7f5bec11ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bec0a0a70 0x7f5bec11f4b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.331+0000 7f5bf1f24700 1 --2- 172.21.15.125:0/880933338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bec0a1380 0x7f5bec11f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.332+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 >> 172.21.15.125:0/880933338 conn(0x7f5bec0a6610 msgr2=0x7f5bec09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.332+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 shutdown_connections 2023-10-03T10:14:19.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.332+0000 7f5bf1f24700 1 -- 172.21.15.125:0/880933338 wait complete. 2023-10-03T10:14:19.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.371+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb6c11ce70 con 0x7fdb6c09f180 2023-10-03T10:14:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.371+0000 7fdb62ffd700 1 -- 172.21.15.125:0/547289782 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb5c021020 con 0x7fdb6c09f180 2023-10-03T10:14:19.371 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 msgr2=0x7fdb6c120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00e840 tx=0x7fdb5c00eb50 comp rx=0 tx=0).stop 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 shutdown_connections 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb6c131d70 0x7fdb6c120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb6c09e870 0x7fdb6c1201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 --2- 172.21.15.125:0/547289782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb6c09f180 0x7fdb6c120700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 >> 172.21.15.125:0/547289782 conn(0x7fdb6c0a4430 msgr2=0x7fdb6c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 shutdown_connections 2023-10-03T10:14:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:19.373+0000 7fdb7433f700 1 -- 172.21.15.125:0/547289782 wait complete. 2023-10-03T10:14:19.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:19.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:19.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:20.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.018+0000 7ff39f72f700 1 Processor -- start 2023-10-03T10:14:20.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 -- start start 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff398134120 0x7ff39813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39809dc00 con 0x7ff3980a1380 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39809ea60 con 0x7ff398134120 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39f72f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39809dec0 con 0x7ff3980a0a70 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39d4cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39d4cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41654/0 (socket says 172.21.15.125:41654) 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39dccc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff398134120 0x7ff39813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39d4cb700 1 -- 172.21.15.125:0/1352931399 learned_addr learned my addr 172.21.15.125:0/1352931399 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39dccc700 1 -- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 msgr2=0x7ff3980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39dccc700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.019+0000 7ff39dccc700 1 -- 172.21.15.125:0/1352931399 >> v1:172.21.15.125:6789/0 conn(0x7ff3980a1380 legacy=0x7ff398133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff39dccc700 1 -- 172.21.15.125:0/1352931399 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39809e6a0 con 0x7ff398134120 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff38ffff700 1 -- 172.21.15.125:0/1352931399 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301565972 0 0) 0x7ff39809dc00 con 0x7ff3980a1380 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff39d4cb700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff39dccc700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff39813bce0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff390009d90 tx=0x7ff39000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68921354fa576ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff38ffff700 1 -- 172.21.15.125:0/1352931399 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000e070 con 0x7ff398134120 2023-10-03T10:14:20.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff38ffff700 1 -- 172.21.15.125:0/1352931399 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000bb20 con 0x7ff398134120 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff38ffff700 1 -- 172.21.15.125:0/1352931399 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390012430 con 0x7ff398134120 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff39f72f700 1 -- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 msgr2=0x7ff39813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.020+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff39813bce0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff390009d90 tx=0x7ff39000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 -- 172.21.15.125:0/1352931399 shutdown_connections 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff39813bce0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1352931399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff3980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 -- 172.21.15.125:0/1352931399 >> 172.21.15.125:0/1352931399 conn(0x7ff3980a6610 msgr2=0x7ff3980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 -- 172.21.15.125:0/1352931399 shutdown_connections 2023-10-03T10:14:20.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 -- 172.21.15.125:0/1352931399 wait complete. 2023-10-03T10:14:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.021+0000 7ff39f72f700 1 Processor -- start 2023-10-03T10:14:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 -- start start 2023-10-03T10:14:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff398122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 0x7ff398122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981332b0 con 0x7ff398134120 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981258b0 con 0x7ff3980a0a70 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39f72f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981242c0 con 0x7ff3980a1380 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39ccca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 0x7ff398122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52008/0 (socket says 172.21.15.125:52008) 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 -- 172.21.15.125:0/1918919952 learned_addr learned my addr 172.21.15.125:0/1918919952 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39d4cb700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff398122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 -- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 msgr2=0x7ff398122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 0x7ff398122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 -- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 msgr2=0x7ff398122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff398122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39dccc700 1 -- 172.21.15.125:0/1918919952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009550 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39d4cb700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff398122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.022+0000 7ff39ccca700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 0x7ff398122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff39dccc700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b680 tx=0x7ff390004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390012430 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390020070 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390004280 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff390009a70 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.023+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff398125c30 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.024+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3900043e0 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.024+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff390022070 con 0x7ff398134120 2023-10-03T10:14:20.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.024+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39804f2a0 con 0x7ff398134120 2023-10-03T10:14:20.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.029+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff390012e10 con 0x7ff398134120 2023-10-03T10:14:20.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 Processor -- start 2023-10-03T10:14:20.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 -- start start 2023-10-03T10:14:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 0x7f52f8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f809e9d0 con 0x7f52f80a1380 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f809dc00 con 0x7f52f8133f50 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.059+0000 7f52fcc72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52f809dec0 con 0x7f52f80a0a70 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 0x7f52f8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46788/0 (socket says 172.21.15.125:46788) 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52012/0 (socket says 172.21.15.125:52012) 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f659c700 1 -- 172.21.15.125:0/3404571048 learned_addr learned my addr 172.21.15.125:0/3404571048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 -- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 msgr2=0x7f52f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 -- 172.21.15.125:0/3404571048 >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 msgr2=0x7f52f8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 --2- 172.21.15.125:0/3404571048 >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 -- 172.21.15.125:0/3404571048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f809e6a0 con 0x7f52f8133f50 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f5d9b700 1 --2- 172.21.15.125:0/3404571048 >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f659c700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f6d9d700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 0x7f52f8134380 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009d90 tx=0x7f52f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b1ae8ed1af93a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f559a700 1 -- 172.21.15.125:0/3404571048 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000e070 con 0x7f52f8133f50 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f559a700 1 -- 172.21.15.125:0/3404571048 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f000bb20 con 0x7f52f8133f50 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.060+0000 7f52f559a700 1 -- 172.21.15.125:0/3404571048 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0012430 con 0x7f52f8133f50 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 -- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 msgr2=0x7f52f8134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 0x7f52f8134380 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009d90 tx=0x7f52f000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 -- 172.21.15.125:0/3404571048 shutdown_connections 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f8133f50 0x7f52f8134380 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 --2- 172.21.15.125:0/3404571048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f80a0a70 0x7f52f80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 --2- 172.21.15.125:0/3404571048 >> v2:172.21.15.125:3300/0 conn(0x7f52f80a1380 0x7f52f8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 -- 172.21.15.125:0/3404571048 >> 172.21.15.125:0/3404571048 conn(0x7f52f80a6610 msgr2=0x7f52f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 -- 172.21.15.125:0/3404571048 shutdown_connections 2023-10-03T10:14:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.061+0000 7f52fcc72700 1 -- 172.21.15.125:0/3404571048 wait complete. 2023-10-03T10:14:20.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 Processor -- start 2023-10-03T10:14:20.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 -- start start 2023-10-03T10:14:20.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 0x7f52f81c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 0x7f52f81c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8122770 con 0x7f52f80a1380 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8120950 con 0x7f52f80a0a70 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.062+0000 7f52fcc72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80a03e0 con 0x7f52f8133f50 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52020/0 (socket says 172.21.15.125:52020) 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 0x7f52f81c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 -- 172.21.15.125:0/1190298386 learned_addr learned my addr 172.21.15.125:0/1190298386 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f6d9d700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 0x7f52f81c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 -- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 msgr2=0x7f52f81c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 0x7f52f81c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 -- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 msgr2=0x7f52f81c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 0x7f52f81c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 -- 172.21.15.125:0/1190298386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009550 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f659c700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 0x7f52f81c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f6d9d700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 0x7f52f81c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52f5d9b700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00ebb0 tx=0x7f52ec00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00c850 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00c9b0 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00cd40 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec0094a0 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.063+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f0009a70 con 0x7f52f80a1380 2023-10-03T10:14:20.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.064+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f804f2a0 con 0x7f52f80a1380 2023-10-03T10:14:20.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.065+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52ec013470 con 0x7f52f80a1380 2023-10-03T10:14:20.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.065+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52ec03ffc0 con 0x7f52f80a1380 2023-10-03T10:14:20.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.071+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52ec024760 con 0x7f52f80a1380 2023-10-03T10:14:20.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.218+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff398072980 con 0x7ff398134120 2023-10-03T10:14:20.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.218+0000 7ff38dffb700 1 -- 172.21.15.125:0/1918919952 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff39001a380 con 0x7ff398134120 2023-10-03T10:14:20.219 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 msgr2=0x7ff3981231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b680 tx=0x7ff390004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 shutdown_connections 2023-10-03T10:14:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff398134120 0x7ff3981231d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3980a0a70 0x7ff398122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 --2- 172.21.15.125:0/1918919952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3980a1380 0x7ff398122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 >> 172.21.15.125:0/1918919952 conn(0x7ff3980a6610 msgr2=0x7ff39811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 shutdown_connections 2023-10-03T10:14:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.221+0000 7ff39f72f700 1 -- 172.21.15.125:0/1918919952 wait complete. 2023-10-03T10:14:20.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:20.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.260+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52f8072980 con 0x7f52f80a1380 2023-10-03T10:14:20.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.260+0000 7f52e6ffd700 1 -- 172.21.15.125:0/1190298386 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52ec017070 con 0x7f52f80a1380 2023-10-03T10:14:20.260 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 msgr2=0x7f52f81c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00ebb0 tx=0x7f52ec00eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 shutdown_connections 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52f8133f50 0x7f52f81c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80a0a70 0x7f52f81c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 --2- 172.21.15.125:0/1190298386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80a1380 0x7f52f81c8720 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 >> 172.21.15.125:0/1190298386 conn(0x7f52f80a6610 msgr2=0x7f52f809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 shutdown_connections 2023-10-03T10:14:20.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.262+0000 7f52fcc72700 1 -- 172.21.15.125:0/1190298386 wait complete. 2023-10-03T10:14:20.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:20.344 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:20.385 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:20.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 Processor -- start 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 -- start start 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad180a0a30 0x7fad180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180a1e70 con 0x7fad180a1340 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1809a720 con 0x7fad180a0a30 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad1d388700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad1809b300 con 0x7fad18130670 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad177fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad16ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad180a0a30 0x7fad180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad177fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46806/0 (socket says 172.21.15.125:46806) 2023-10-03T10:14:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.472+0000 7fad177fe700 1 -- 172.21.15.125:0/3112360632 learned_addr learned my addr 172.21.15.125:0/3112360632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad16ffd700 1 -- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 msgr2=0x7fad181381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad16ffd700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad16ffd700 1 -- 172.21.15.125:0/3112360632 >> v1:172.21.15.125:6789/0 conn(0x7fad180a1340 legacy=0x7fad1812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad16ffd700 1 -- 172.21.15.125:0/3112360632 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1809abc0 con 0x7fad180a0a30 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad15ffb700 1 -- 172.21.15.125:0/3112360632 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771752012 0 0) 0x7fad180a1e70 con 0x7fad180a1340 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad177fe700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad16ffd700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad180a0a30 0x7fad180a0e00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fad08009820 tx=0x7fad08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26447cd61beb4ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad15ffb700 1 -- 172.21.15.125:0/3112360632 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08005e30 con 0x7fad180a0a30 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad15ffb700 1 -- 172.21.15.125:0/3112360632 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08006030 con 0x7fad180a0a30 2023-10-03T10:14:20.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.473+0000 7fad15ffb700 1 -- 172.21.15.125:0/3112360632 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad080063c0 con 0x7fad180a0a30 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 -- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad180a0a30 msgr2=0x7fad180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad180a0a30 0x7fad180a0e00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fad08009820 tx=0x7fad08009b30 comp rx=0 tx=0).stop 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 -- 172.21.15.125:0/3112360632 shutdown_connections 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad18130670 0x7fad181381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 --2- 172.21.15.125:0/3112360632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad180a0a30 0x7fad180a0e00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 -- 172.21.15.125:0/3112360632 >> 172.21.15.125:0/3112360632 conn(0x7fad180a2980 msgr2=0x7fad180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 -- 172.21.15.125:0/3112360632 shutdown_connections 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.474+0000 7fad1d388700 1 -- 172.21.15.125:0/3112360632 wait complete. 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 Processor -- start 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 -- start start 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 0x7fad181380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad18130670 0x7fad18138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18138ca0 con 0x7fad18130670 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad181359b0 con 0x7fad180a0a30 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad1d388700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad18134960 con 0x7fad180a1340 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41694/0 (socket says 172.21.15.125:41694) 2023-10-03T10:14:20.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad167fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 0x7fad181380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad16ffd700 1 -- 172.21.15.125:0/3855629530 learned_addr learned my addr 172.21.15.125:0/3855629530 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.475+0000 7fad177fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad18130670 0x7fad18138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 -- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 msgr2=0x7fad181380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 0x7fad181380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 -- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad18130670 msgr2=0x7fad18138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad18130670 0x7fad18138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 -- 172.21.15.125:0/3855629530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10009b30 con 0x7fad180a0a30 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad167fc700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 0x7fad181380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad16ffd700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fad180a2000 tx=0x7fad08004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad080063a0 con 0x7fad180a0a30 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08020070 con 0x7fad180a0a30 2023-10-03T10:14:20.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08009430 con 0x7fad180a0a30 2023-10-03T10:14:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08006760 con 0x7fad180a0a30 2023-10-03T10:14:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.476+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1809ae00 con 0x7fad180a0a30 2023-10-03T10:14:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.477+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad08022030 con 0x7fad180a0a30 2023-10-03T10:14:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.477+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad08040c50 con 0x7fad180a0a30 2023-10-03T10:14:20.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.477+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1804f2a0 con 0x7fad180a0a30 2023-10-03T10:14:20.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.482+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad0802e440 con 0x7fad180a0a30 2023-10-03T10:14:20.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.514+0000 7fd87a38c700 1 Processor -- start 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.514+0000 7fd87a38c700 1 -- start start 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd87a38c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd87a38c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 0x7fd87413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd87a38c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87409b110 con 0x7fd87409ad40 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd87a38c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8740a3b60 con 0x7fd874134140 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd87a38c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740a1a80 con 0x7fd8741345a0 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd8737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 0x7fd87413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd8737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52044/0 (socket says 172.21.15.125:52044) 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd8737fe700 1 -- 172.21.15.125:0/2849914598 learned_addr learned my addr 172.21.15.125:0/2849914598 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 -- 172.21.15.125:0/2849914598 >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 msgr2=0x7fd874138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 --2- 172.21.15.125:0/2849914598 >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 -- 172.21.15.125:0/2849914598 >> v1:172.21.15.125:6789/0 conn(0x7fd87409ad40 legacy=0x7fd874133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd872ffd700 1 -- 172.21.15.125:0/2849914598 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531412986 0 0) 0x7fd87409b110 con 0x7fd87409ad40 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 -- 172.21.15.125:0/2849914598 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740a2fa0 con 0x7fd8741345a0 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd8737fe700 1 --2- 172.21.15.125:0/2849914598 >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.515+0000 7fd878929700 1 --2- 172.21.15.125:0/2849914598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 0x7fd87413b3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009d90 tx=0x7fd86c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbc3eeeb89e966f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd872ffd700 1 -- 172.21.15.125:0/2849914598 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00e070 con 0x7fd8741345a0 2023-10-03T10:14:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd872ffd700 1 -- 172.21.15.125:0/2849914598 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c00bb20 con 0x7fd8741345a0 2023-10-03T10:14:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd872ffd700 1 -- 172.21.15.125:0/2849914598 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c012430 con 0x7fd8741345a0 2023-10-03T10:14:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 -- 172.21.15.125:0/2849914598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 msgr2=0x7fd87413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 --2- 172.21.15.125:0/2849914598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 0x7fd87413b3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009d90 tx=0x7fd86c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 -- 172.21.15.125:0/2849914598 shutdown_connections 2023-10-03T10:14:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 --2- 172.21.15.125:0/2849914598 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8741345a0 0x7fd87413b3d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 --2- 172.21.15.125:0/2849914598 >> v2:172.21.15.125:3300/0 conn(0x7fd874134140 0x7fd874138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 -- 172.21.15.125:0/2849914598 >> 172.21.15.125:0/2849914598 conn(0x7fd874099c40 msgr2=0x7fd87406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 -- 172.21.15.125:0/2849914598 shutdown_connections 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.516+0000 7fd87a38c700 1 -- 172.21.15.125:0/2849914598 wait complete. 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.517+0000 7fd87a38c700 1 Processor -- start 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.517+0000 7fd87a38c700 1 -- start start 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd87409ad40 0x7fd874139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87411ea20 con 0x7fd8741345a0 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87411cd50 con 0x7fd874134140 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd87411dfa0 con 0x7fd87409ad40 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd8737fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52046/0 (socket says 172.21.15.125:52046) 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd8737fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41700/0 (socket says 172.21.15.125:41700) 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 -- 172.21.15.125:0/3304779671 learned_addr learned my addr 172.21.15.125:0/3304779671 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd873fff700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd87409ad40 0x7fd874139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 -- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd87409ad40 msgr2=0x7fd874139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd87409ad40 0x7fd874139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 -- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 msgr2=0x7fd874139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 -- 172.21.15.125:0/3304779671 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868009550 con 0x7fd8741345a0 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd8737fe700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd878929700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd87409cca0 tx=0x7fd86c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c012430 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c020070 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c004280 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c009a70 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.518+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87409c7e0 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.519+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd86c0043e0 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.519+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd86c022070 con 0x7fd8741345a0 2023-10-03T10:14:20.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.519+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8741361e0 con 0x7fd8741345a0 2023-10-03T10:14:20.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.528+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd86c01c400 con 0x7fd8741345a0 2023-10-03T10:14:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.681+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad1806bce0 con 0x7fad180a0a30 2023-10-03T10:14:20.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.682+0000 7facff7fe700 1 -- 172.21.15.125:0/3855629530 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad0801c410 con 0x7fad180a0a30 2023-10-03T10:14:20.682 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:20.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 msgr2=0x7fad18137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fad180a2000 tx=0x7fad08004750 comp rx=0 tx=0).stop 2023-10-03T10:14:20.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 shutdown_connections 2023-10-03T10:14:20.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad18130670 0x7fad18138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad180a0a30 0x7fad18137bb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 --2- 172.21.15.125:0/3855629530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad180a1340 0x7fad181380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 >> 172.21.15.125:0/3855629530 conn(0x7fad180a2980 msgr2=0x7fad18070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 shutdown_connections 2023-10-03T10:14:20.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.684+0000 7fad1d388700 1 -- 172.21.15.125:0/3855629530 wait complete. 2023-10-03T10:14:20.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:20.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.720+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd87404f2a0 con 0x7fd8741345a0 2023-10-03T10:14:20.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.720+0000 7fd870ff9700 1 -- 172.21.15.125:0/3304779671 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd86c035090 con 0x7fd8741345a0 2023-10-03T10:14:20.721 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 msgr2=0x7fd874139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd87409cca0 tx=0x7fd86c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 shutdown_connections 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8741345a0 0x7fd874139da0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd87409ad40 0x7fd874139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 --2- 172.21.15.125:0/3304779671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd874134140 0x7fd874139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 >> 172.21.15.125:0/3304779671 conn(0x7fd874099c40 msgr2=0x7fd87413af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 shutdown_connections 2023-10-03T10:14:20.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:20.722+0000 7fd87a38c700 1 -- 172.21.15.125:0/3304779671 wait complete. 2023-10-03T10:14:20.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:21.234 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:21.275 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.362+0000 7f6968153700 1 Processor -- start 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.362+0000 7f6968153700 1 -- start start 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6968153700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 0x7f69600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6968153700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 0x7f696013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6968153700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696009dc00 con 0x7f69600a1380 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6968153700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696009ea90 con 0x7f69600a0a70 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6968153700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696009dec0 con 0x7f6960134120 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6965eef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 0x7f69600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69666f0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 0x7f696013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69656ee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f69600a1380 0x7f6960133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47100/0 (socket says 172.21.15.125:47100) 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69656ee700 1 -- 172.21.15.125:0/2713232423 learned_addr learned my addr 172.21.15.125:0/2713232423 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6964eed700 1 -- 172.21.15.125:0/2713232423 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055006639 0 0) 0x7f696009dc00 con 0x7f69600a1380 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6964eed700 1 -- 172.21.15.125:0/2713232423 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c0035b0 con 0x7f69600a1380 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69666f0700 1 -- 172.21.15.125:0/2713232423 >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 msgr2=0x7f69600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69666f0700 1 --2- 172.21.15.125:0/2713232423 >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 0x7f69600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69666f0700 1 -- 172.21.15.125:0/2713232423 >> v1:172.21.15.125:6789/0 conn(0x7f69600a1380 legacy=0x7f6960133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f69666f0700 1 -- 172.21.15.125:0/2713232423 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696009e6a0 con 0x7f6960134120 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.363+0000 7f6965eef700 1 --2- 172.21.15.125:0/2713232423 >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 0x7f69600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f69666f0700 1 --2- 172.21.15.125:0/2713232423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 0x7f696013bce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6958009d90 tx=0x7f695800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4664f0fe01d373 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6964eed700 1 -- 172.21.15.125:0/2713232423 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800e070 con 0x7f6960134120 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6964eed700 1 -- 172.21.15.125:0/2713232423 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800bb20 con 0x7f6960134120 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6964eed700 1 -- 172.21.15.125:0/2713232423 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958012430 con 0x7f6960134120 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 -- 172.21.15.125:0/2713232423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 msgr2=0x7f696013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 --2- 172.21.15.125:0/2713232423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 0x7f696013bce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6958009d90 tx=0x7f695800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 -- 172.21.15.125:0/2713232423 shutdown_connections 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 --2- 172.21.15.125:0/2713232423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6960134120 0x7f696013bce0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 --2- 172.21.15.125:0/2713232423 >> v2:172.21.15.125:3300/0 conn(0x7f69600a0a70 0x7f69600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 -- 172.21.15.125:0/2713232423 >> 172.21.15.125:0/2713232423 conn(0x7f69600a6610 msgr2=0x7f69600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.364+0000 7f6968153700 1 -- 172.21.15.125:0/2713232423 shutdown_connections 2023-10-03T10:14:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.365+0000 7f6968153700 1 -- 172.21.15.125:0/2713232423 wait complete. 2023-10-03T10:14:21.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.366+0000 7f6968153700 1 Processor -- start 2023-10-03T10:14:21.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.366+0000 7f6968153700 1 -- start start 2023-10-03T10:14:21.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.366+0000 7f6968153700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.366+0000 7f6968153700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 0x7f6960122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6960134120 0x7f69601230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960124b30 con 0x7f69600a0a70 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6960125e90 con 0x7f6960134120 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6960124370 con 0x7f69600a1380 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69656ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 0x7f6960122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69656ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 0x7f6960122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46846/0 (socket says 172.21.15.125:46846) 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52068/0 (socket says 172.21.15.125:52068) 2023-10-03T10:14:21.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69656ee700 1 -- 172.21.15.125:0/4040895135 learned_addr learned my addr 172.21.15.125:0/4040895135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69666f0700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6960134120 0x7f69601230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 -- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 msgr2=0x7f6960122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 0x7f6960122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 -- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6960134120 msgr2=0x7f69601230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6960134120 0x7f69601230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 -- 172.21.15.125:0/4040895135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0094a0 con 0x7f69600a0a70 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6965eef700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f695c00e9e0 tx=0x7f695c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00c850 con 0x7f69600a0a70 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00c9b0 con 0x7f69600a0a70 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00cd40 con 0x7f69600a0a70 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6958009a70 con 0x7f69600a0a70 2023-10-03T10:14:21.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.367+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6960133170 con 0x7f69600a0a70 2023-10-03T10:14:21.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.368+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f695c013470 con 0x7f69600a0a70 2023-10-03T10:14:21.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.368+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f695c03f590 con 0x7f69600a0a70 2023-10-03T10:14:21.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.368+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696004f2a0 con 0x7f69600a0a70 2023-10-03T10:14:21.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.373+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f695c013720 con 0x7f69600a0a70 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.403+0000 7f6ac4bef700 1 Processor -- start 2023-10-03T10:14:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.403+0000 7f6ac4bef700 1 -- start start 2023-10-03T10:14:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6ac4bef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 0x7f6ac00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6ac4bef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6ac4bef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac009dc00 con 0x7f6ac00a1380 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6ac4bef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac009ea60 con 0x7f6ac0134120 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6ac4bef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac009dec0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 0x7f6ac00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52070/0 (socket says 172.21.15.125:52070) 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abed9d700 1 -- 172.21.15.125:0/3507141217 learned_addr learned my addr 172.21.15.125:0/3507141217 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 -- 172.21.15.125:0/3507141217 >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 msgr2=0x7f6ac013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 --2- 172.21.15.125:0/3507141217 >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 -- 172.21.15.125:0/3507141217 >> v1:172.21.15.125:6789/0 conn(0x7f6ac00a1380 legacy=0x7f6ac0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 -- 172.21.15.125:0/3507141217 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac009e6a0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abed9d700 1 --2- 172.21.15.125:0/3507141217 >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abe59c700 1 --2- 172.21.15.125:0/3507141217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 0x7f6ac00a0e40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009840 tx=0x7f6ab0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8560fa232e42b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abd59a700 1 -- 172.21.15.125:0/3507141217 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0011830 con 0x7f6ac00a0a70 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abd59a700 1 -- 172.21.15.125:0/3507141217 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab0011990 con 0x7f6ac00a0a70 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.404+0000 7f6abd59a700 1 -- 172.21.15.125:0/3507141217 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0011d20 con 0x7f6ac00a0a70 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 -- 172.21.15.125:0/3507141217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 msgr2=0x7f6ac00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/3507141217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 0x7f6ac00a0e40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009840 tx=0x7f6ab0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 -- 172.21.15.125:0/3507141217 shutdown_connections 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/3507141217 >> v2:172.21.15.125:3300/0 conn(0x7f6ac0134120 0x7f6ac013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/3507141217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a0a70 0x7f6ac00a0e40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 -- 172.21.15.125:0/3507141217 >> 172.21.15.125:0/3507141217 conn(0x7f6ac00a6610 msgr2=0x7f6ac00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 -- 172.21.15.125:0/3507141217 shutdown_connections 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.405+0000 7f6ac4bef700 1 -- 172.21.15.125:0/3507141217 wait complete. 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.406+0000 7f6ac4bef700 1 Processor -- start 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.406+0000 7f6ac4bef700 1 -- start start 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.406+0000 7f6ac4bef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.406+0000 7f6ac4bef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a1380 0x7f6ac0122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.406+0000 7f6ac4bef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ac0134120 0x7f6ac01233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6ac4bef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0133a90 con 0x7f6ac00a0a70 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6ac4bef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00a03e0 con 0x7f6ac0134120 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6ac4bef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01337f0 con 0x7f6ac00a1380 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abdd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a1380 0x7f6ac0122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52074/0 (socket says 172.21.15.125:52074) 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 -- 172.21.15.125:0/450807005 learned_addr learned my addr 172.21.15.125:0/450807005 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abed9d700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ac0134120 0x7f6ac01233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 -- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a1380 msgr2=0x7f6ac0122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a1380 0x7f6ac0122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 -- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ac0134120 msgr2=0x7f6ac01233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ac0134120 0x7f6ac01233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 -- 172.21.15.125:0/450807005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009b30 con 0x7f6ac00a0a70 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6abe59c700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009fd0 tx=0x7f6ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00036a0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab001f070 con 0x7f6ac00a0a70 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00094a0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0003a60 con 0x7f6ac00a0a70 2023-10-03T10:14:21.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.407+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac0126b50 con 0x7f6ac00a0a70 2023-10-03T10:14:21.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.408+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0125ed0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.409+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ab0003bc0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.409+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ab0021070 con 0x7f6ac00a0a70 2023-10-03T10:14:21.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.417+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ab00197c0 con 0x7f6ac00a0a70 2023-10-03T10:14:21.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.571+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6960126960 con 0x7f69600a0a70 2023-10-03T10:14:21.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.572+0000 7f69567fc700 1 -- 172.21.15.125:0/4040895135 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f695c01bba0 con 0x7f69600a0a70 2023-10-03T10:14:21.572 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:21.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 msgr2=0x7f6960122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f695c00e9e0 tx=0x7f695c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 shutdown_connections 2023-10-03T10:14:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6960134120 0x7f69601230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69600a0a70 0x7f6960122650 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 --2- 172.21.15.125:0/4040895135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69600a1380 0x7f6960122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 >> 172.21.15.125:0/4040895135 conn(0x7f69600a6610 msgr2=0x7f69600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 shutdown_connections 2023-10-03T10:14:21.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.574+0000 7f6968153700 1 -- 172.21.15.125:0/4040895135 wait complete. 2023-10-03T10:14:21.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.611+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ac00a2710 con 0x7f6ac00a0a70 2023-10-03T10:14:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.611+0000 7f6aaeffd700 1 -- 172.21.15.125:0/450807005 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ab0015030 con 0x7f6ac00a0a70 2023-10-03T10:14:21.612 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 msgr2=0x7f6ac0122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009fd0 tx=0x7f6ab0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 shutdown_connections 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ac0134120 0x7f6ac01233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ac00a0a70 0x7f6ac0122970 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 --2- 172.21.15.125:0/450807005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6ac00a1380 0x7f6ac0122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 >> 172.21.15.125:0/450807005 conn(0x7f6ac00a6610 msgr2=0x7f6ac00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 shutdown_connections 2023-10-03T10:14:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.613+0000 7f6ac4bef700 1 -- 172.21.15.125:0/450807005 wait complete. 2023-10-03T10:14:21.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:21.696 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:21.735 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.821+0000 7fd95ba6c700 1 Processor -- start 2023-10-03T10:14:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 -- start start 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9540a0a70 0x7fd9540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95409dc00 con 0x7fd954133f50 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95409ea60 con 0x7fd9540a0a70 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95ba6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95409dec0 con 0x7fd9540a1380 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959007700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9540a0a70 0x7fd9540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9540a0a70 0x7fd9540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52082/0 (socket says 172.21.15.125:52082) 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959007700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41734/0 (socket says 172.21.15.125:41734) 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd95a009700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd954133f50 0x7fd95413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47120/0 (socket says 172.21.15.125:47120) 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 -- 172.21.15.125:0/1573215807 learned_addr learned my addr 172.21.15.125:0/1573215807 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 -- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 msgr2=0x7fd954133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 -- 172.21.15.125:0/1573215807 >> v1:172.21.15.125:6789/0 conn(0x7fd954133f50 legacy=0x7fd95413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959808700 1 -- 172.21.15.125:0/1573215807 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95409e6a0 con 0x7fd9540a0a70 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd958806700 1 -- 172.21.15.125:0/1573215807 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082257422 0 0) 0x7fd95409dc00 con 0x7fd954133f50 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.822+0000 7fd959007700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd959808700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9540a0a70 0x7fd9540a0e40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd9500098f0 tx=0x7fd950009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d525f76c0aaf422 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd958806700 1 -- 172.21.15.125:0/1573215807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950011830 con 0x7fd9540a0a70 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd958806700 1 -- 172.21.15.125:0/1573215807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950011990 con 0x7fd9540a0a70 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd958806700 1 -- 172.21.15.125:0/1573215807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950011d20 con 0x7fd9540a0a70 2023-10-03T10:14:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 -- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9540a0a70 msgr2=0x7fd9540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9540a0a70 0x7fd9540a0e40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd9500098f0 tx=0x7fd950009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 -- 172.21.15.125:0/1573215807 shutdown_connections 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9540a0a70 0x7fd9540a0e40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/1573215807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a1380 0x7fd954133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.823+0000 7fd95ba6c700 1 -- 172.21.15.125:0/1573215807 >> 172.21.15.125:0/1573215807 conn(0x7fd9540a6610 msgr2=0x7fd9540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.824+0000 7fd95ba6c700 1 -- 172.21.15.125:0/1573215807 shutdown_connections 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.824+0000 7fd95ba6c700 1 -- 172.21.15.125:0/1573215807 wait complete. 2023-10-03T10:14:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.824+0000 7fd95ba6c700 1 Processor -- start 2023-10-03T10:14:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.824+0000 7fd95ba6c700 1 -- start start 2023-10-03T10:14:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 0x7fd954122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954133ad0 con 0x7fd954133f50 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd954125de0 con 0x7fd9540a0a70 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95ba6c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd954124510 con 0x7fd9540a1380 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd959007700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52098/0 (socket says 172.21.15.125:52098) 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd959007700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46874/0 (socket says 172.21.15.125:46874) 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 -- 172.21.15.125:0/2192310266 learned_addr learned my addr 172.21.15.125:0/2192310266 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd959808700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 0x7fd954122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 -- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 msgr2=0x7fd954122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 -- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 msgr2=0x7fd954122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 0x7fd954122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 -- 172.21.15.125:0/2192310266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440094a0 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd959007700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd959808700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 0x7fd954122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.825+0000 7fd95a009700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd94c002230 tx=0x7fd94c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.826+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00aac0 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.826+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd950009550 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.826+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00ac40 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.826+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0070d0 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.826+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9540a0430 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.827+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd94c007250 con 0x7fd954133f50 2023-10-03T10:14:21.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.827+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95404f2a0 con 0x7fd954133f50 2023-10-03T10:14:21.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.827+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd94c03f110 con 0x7fd954133f50 2023-10-03T10:14:21.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.831+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd94c018020 con 0x7fd954133f50 2023-10-03T10:14:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 Processor -- start 2023-10-03T10:14:21.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 -- start start 2023-10-03T10:14:21.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc09dc00 con 0x7f63fc0a1380 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc09ea90 con 0x7f63fc0a0a70 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6403fc5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc09dec0 con 0x7f63fc134120 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6401d61700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.864+0000 7f6402562700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6401d61700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52106/0 (socket says 172.21.15.125:52106) 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41752/0 (socket says 172.21.15.125:41752) 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6401d61700 1 -- 172.21.15.125:0/2587538339 learned_addr learned my addr 172.21.15.125:0/2587538339 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6401560700 1 --1- 172.21.15.125:0/2587538339 >> v1:172.21.15.125:6789/0 conn(0x7f63fc0a1380 0x7f63fc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47134/0 (socket says 172.21.15.125:47134) 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 -- 172.21.15.125:0/2587538339 >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 msgr2=0x7f63fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 --2- 172.21.15.125:0/2587538339 >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 -- 172.21.15.125:0/2587538339 >> v1:172.21.15.125:6789/0 conn(0x7f63fc0a1380 legacy=0x7f63fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 -- 172.21.15.125:0/2587538339 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc09e6a0 con 0x7f63fc134120 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6401d61700 1 --2- 172.21.15.125:0/2587538339 >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6402562700 1 --2- 172.21.15.125:0/2587538339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009d90 tx=0x7f63f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38aa34e37a6d37d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6400d5f700 1 -- 172.21.15.125:0/2587538339 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f400e070 con 0x7f63fc134120 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6400d5f700 1 -- 172.21.15.125:0/2587538339 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f400bb20 con 0x7f63fc134120 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.865+0000 7f6400d5f700 1 -- 172.21.15.125:0/2587538339 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4012430 con 0x7f63fc134120 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 -- 172.21.15.125:0/2587538339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 msgr2=0x7f63fc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2587538339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009d90 tx=0x7f63f400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 -- 172.21.15.125:0/2587538339 shutdown_connections 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2587538339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc13bce0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2587538339 >> v2:172.21.15.125:3300/0 conn(0x7f63fc0a0a70 0x7f63fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 -- 172.21.15.125:0/2587538339 >> 172.21.15.125:0/2587538339 conn(0x7f63fc0a6610 msgr2=0x7f63fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 -- 172.21.15.125:0/2587538339 shutdown_connections 2023-10-03T10:14:21.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.866+0000 7f6403fc5700 1 -- 172.21.15.125:0/2587538339 wait complete. 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 Processor -- start 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 -- start start 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63fc0a1380 0x7f63fc122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc133850 con 0x7f63fc0a0a70 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc133a80 con 0x7f63fc134120 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6403fc5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1260d0 con 0x7f63fc0a1380 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6401d61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6401560700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63fc0a1380 0x7f63fc122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6401d61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52120/0 (socket says 172.21.15.125:52120) 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6401d61700 1 -- 172.21.15.125:0/2191373002 learned_addr learned my addr 172.21.15.125:0/2191373002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6402562700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.867+0000 7f6401d61700 1 -- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63fc0a1380 msgr2=0x7f63fc122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6401d61700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63fc0a1380 0x7f63fc122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6401d61700 1 -- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 msgr2=0x7f63fc123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6401d61700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6401d61700 1 -- 172.21.15.125:0/2191373002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009550 con 0x7f63fc0a0a70 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6401d61700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f63f800ec10 tx=0x7f63f800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800c7f0 con 0x7f63fc0a0a70 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800c950 con 0x7f63fc0a0a70 2023-10-03T10:14:21.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f4009a70 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800cce0 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.868+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc125e10 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.869+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63f8013470 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.869+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63f803fbe0 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.869+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc04f2a0 con 0x7f63fc0a0a70 2023-10-03T10:14:21.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:21.873+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63f8013720 con 0x7f63fc0a0a70 2023-10-03T10:14:22.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.025+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd954133810 con 0x7fd954133f50 2023-10-03T10:14:22.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.025+0000 7fd94a7fc700 1 -- 172.21.15.125:0/2192310266 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd954133810 con 0x7fd954133f50 2023-10-03T10:14:22.026 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 msgr2=0x7fd9541232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd94c002230 tx=0x7fd94c00cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 shutdown_connections 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd954133f50 0x7fd9541232e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9540a0a70 0x7fd954122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 --2- 172.21.15.125:0/2192310266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9540a1380 0x7fd954122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 >> 172.21.15.125:0/2192310266 conn(0x7fd9540a6610 msgr2=0x7fd95409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 shutdown_connections 2023-10-03T10:14:22.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.027+0000 7fd95ba6c700 1 -- 172.21.15.125:0/2192310266 wait complete. 2023-10-03T10:14:22.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.065+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63fc126210 con 0x7f63fc0a0a70 2023-10-03T10:14:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.065+0000 7f63f27fc700 1 -- 172.21.15.125:0/2191373002 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63fc126210 con 0x7f63fc0a0a70 2023-10-03T10:14:22.066 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 msgr2=0x7f63fc122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f63f800ec10 tx=0x7f63f800ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 shutdown_connections 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63fc134120 0x7f63fc123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63fc0a0a70 0x7f63fc122910 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 --2- 172.21.15.125:0/2191373002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63fc0a1380 0x7f63fc122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 >> 172.21.15.125:0/2191373002 conn(0x7f63fc0a6610 msgr2=0x7f63fc09ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 shutdown_connections 2023-10-03T10:14:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.067+0000 7f6403fc5700 1 -- 172.21.15.125:0/2191373002 wait complete. 2023-10-03T10:14:22.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:22.587 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:22.627 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:22.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.716+0000 7ffa6439e700 1 Processor -- start 2023-10-03T10:14:22.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.716+0000 7ffa6439e700 1 -- start start 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6439e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6439e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6439e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c09e9d0 con 0x7ffa5c0a0a70 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6439e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09dc00 con 0x7ffa5c0a1550 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6439e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09dec0 con 0x7ffa5c139200 2023-10-03T10:14:22.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6293b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6293b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46888/0 (socket says 172.21.15.125:46888) 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41772/0 (socket says 172.21.15.125:41772) 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6213a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ffa5c0a0a70 0x7ffa5c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47148/0 (socket says 172.21.15.125:47148) 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6293b700 1 -- 172.21.15.125:0/6112336 learned_addr learned my addr 172.21.15.125:0/6112336 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 -- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 msgr2=0x7ffa5c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61138700 1 -- 172.21.15.125:0/6112336 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736226353 0 0) 0x7ffa5c09e9d0 con 0x7ffa5c0a0a70 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 -- 172.21.15.125:0/6112336 >> v1:172.21.15.125:6789/0 conn(0x7ffa5c0a0a70 legacy=0x7ffa5c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 -- 172.21.15.125:0/6112336 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c09e6a0 con 0x7ffa5c0a1550 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa6293b700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61939700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009870 tx=0x7ffa4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=885b6e3433d4ce71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61138700 1 -- 172.21.15.125:0/6112336 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c011830 con 0x7ffa5c0a1550 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.717+0000 7ffa61138700 1 -- 172.21.15.125:0/6112336 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c011990 con 0x7ffa5c0a1550 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa61138700 1 -- 172.21.15.125:0/6112336 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c011d20 con 0x7ffa5c0a1550 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 -- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 msgr2=0x7ffa5c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009870 tx=0x7ffa4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 -- 172.21.15.125:0/6112336 shutdown_connections 2023-10-03T10:14:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c139200 0x7ffa5c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 --2- 172.21.15.125:0/6112336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a1550 0x7ffa5c138cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 -- 172.21.15.125:0/6112336 >> 172.21.15.125:0/6112336 conn(0x7ffa5c0a6610 msgr2=0x7ffa5c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 -- 172.21.15.125:0/6112336 shutdown_connections 2023-10-03T10:14:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.718+0000 7ffa6439e700 1 -- 172.21.15.125:0/6112336 wait complete. 2023-10-03T10:14:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.719+0000 7ffa6439e700 1 Processor -- start 2023-10-03T10:14:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.719+0000 7ffa6439e700 1 -- start start 2023-10-03T10:14:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a0a70 0x7ffa5c1207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 0x7ffa5c121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c136650 con 0x7ffa5c139200 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0a03e0 con 0x7ffa5c0a0a70 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c122bd0 con 0x7ffa5c0a1550 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6293b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 0x7ffa5c121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46904/0 (socket says 172.21.15.125:46904) 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 -- 172.21.15.125:0/2220862719 learned_addr learned my addr 172.21.15.125:0/2220862719 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6213a700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a0a70 0x7ffa5c1207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 -- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a0a70 msgr2=0x7ffa5c1207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a0a70 0x7ffa5c1207b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 -- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 msgr2=0x7ffa5c121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 0x7ffa5c121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 -- 172.21.15.125:0/2220862719 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54009b30 con 0x7ffa5c0a1550 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6293b700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 0x7ffa5c121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa61939700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0090b0 tx=0x7ffa4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c004510 con 0x7ffa5c0a1550 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c01f070 con 0x7ffa5c0a1550 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0038e0 con 0x7ffa5c0a1550 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c0094a0 con 0x7ffa5c0a1550 2023-10-03T10:14:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.720+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c123a10 con 0x7ffa5c0a1550 2023-10-03T10:14:22.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.721+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa4c003a40 con 0x7ffa5c0a1550 2023-10-03T10:14:22.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.721+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa4c021070 con 0x7ffa5c0a1550 2023-10-03T10:14:22.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.721+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c04f2a0 con 0x7ffa5c0a1550 2023-10-03T10:14:22.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.726+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa4c015020 con 0x7ffa5c0a1550 2023-10-03T10:14:22.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.758+0000 7fafc6ae6700 1 Processor -- start 2023-10-03T10:14:22.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.758+0000 7fafc6ae6700 1 -- start start 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc6ae6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fafc009ad40 0x7fafc0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc6ae6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 0x7fafc00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc6ae6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc009b110 con 0x7fafc0133f70 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc6ae6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc00a3b60 con 0x7fafc009ad40 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc6ae6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0134850 con 0x7fafc01343d0 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fafc009ad40 0x7fafc0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc5083700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 0x7fafc00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafbffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fafc0133f70 0x7fafc00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47150/0 (socket says 172.21.15.125:47150) 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafbffff700 1 -- 172.21.15.125:0/2067715418 learned_addr learned my addr 172.21.15.125:0/2067715418 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 -- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 msgr2=0x7fafc00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 0x7fafc00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 -- 172.21.15.125:0/2067715418 >> v1:172.21.15.125:6789/0 conn(0x7fafc0133f70 legacy=0x7fafc00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 -- 172.21.15.125:0/2067715418 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00a2fa0 con 0x7fafc009ad40 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafbf7fe700 1 -- 172.21.15.125:0/2067715418 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679380995 0 0) 0x7fafc009b110 con 0x7fafc0133f70 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc5083700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 0x7fafc00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.759+0000 7fafc4882700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc0133a30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5fa8f8c744648 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafbf7fe700 1 -- 172.21.15.125:0/2067715418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011830 con 0x7fafc009ad40 2023-10-03T10:14:22.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafbf7fe700 1 -- 172.21.15.125:0/2067715418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4011990 con 0x7fafc009ad40 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafbf7fe700 1 -- 172.21.15.125:0/2067715418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011d20 con 0x7fafc009ad40 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 -- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 msgr2=0x7fafc0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc0133a30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 -- 172.21.15.125:0/2067715418 shutdown_connections 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc01343d0 0x7fafc00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/2067715418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc0133a30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 -- 172.21.15.125:0/2067715418 >> 172.21.15.125:0/2067715418 conn(0x7fafc0099c40 msgr2=0x7fafc006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 -- 172.21.15.125:0/2067715418 shutdown_connections 2023-10-03T10:14:22.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.760+0000 7fafc6ae6700 1 -- 172.21.15.125:0/2067715418 wait complete. 2023-10-03T10:14:22.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.761+0000 7fafc6ae6700 1 Processor -- start 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 -- start start 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 0x7fafc01c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 0x7fafc01c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc011f950 con 0x7fafc009ad40 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc011fd60 con 0x7fafc01343d0 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc6ae6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0120550 con 0x7fafc0133f70 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc4882700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafbffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 0x7fafc01c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc4882700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52140/0 (socket says 172.21.15.125:52140) 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc4882700 1 -- 172.21.15.125:0/770327812 learned_addr learned my addr 172.21.15.125:0/770327812 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.762+0000 7fafc5083700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 0x7fafc01c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 -- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 msgr2=0x7fafc01c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 0x7fafc01c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 -- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 msgr2=0x7fafc01c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 0x7fafc01c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 -- 172.21.15.125:0/770327812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8009a70 con 0x7fafc009ad40 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafbffff700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 0x7fafc01c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc5083700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 0x7fafc01c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc4882700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009fd0 tx=0x7fafb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40045d0 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb401e070 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb40094a0 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40038e0 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.763+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc011ebe0 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.764+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafb4003a40 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.764+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fafb4020070 con 0x7fafc009ad40 2023-10-03T10:14:22.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.764+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc011edd0 con 0x7fafc009ad40 2023-10-03T10:14:22.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.769+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafb400bdc0 con 0x7fafc009ad40 2023-10-03T10:14:22.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.919+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa5c123c00 con 0x7ffa5c0a1550 2023-10-03T10:14:22.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.919+0000 7ffa52ffd700 1 -- 172.21.15.125:0/2220862719 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa4c01a430 con 0x7ffa5c0a1550 2023-10-03T10:14:22.920 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:22.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 msgr2=0x7ffa5c120cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0090b0 tx=0x7ffa4c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:22.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 shutdown_connections 2023-10-03T10:14:22.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa5c139200 0x7ffa5c121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa5c0a0a70 0x7ffa5c1207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 --2- 172.21.15.125:0/2220862719 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa5c0a1550 0x7ffa5c120cf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 >> 172.21.15.125:0/2220862719 conn(0x7ffa5c0a6610 msgr2=0x7ffa5c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 shutdown_connections 2023-10-03T10:14:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.921+0000 7ffa6439e700 1 -- 172.21.15.125:0/2220862719 wait complete. 2023-10-03T10:14:22.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.962+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fafc004f2a0 con 0x7fafc009ad40 2023-10-03T10:14:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.962+0000 7fafbd7fa700 1 -- 172.21.15.125:0/770327812 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafb4015030 con 0x7fafc009ad40 2023-10-03T10:14:22.963 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 msgr2=0x7fafc01c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009fd0 tx=0x7fafb4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 shutdown_connections 2023-10-03T10:14:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafc01343d0 0x7fafc01c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc009ad40 0x7fafc01c87b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 --2- 172.21.15.125:0/770327812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fafc0133f70 0x7fafc01c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 >> 172.21.15.125:0/770327812 conn(0x7fafc0099c40 msgr2=0x7fafc0132200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 shutdown_connections 2023-10-03T10:14:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:22.964+0000 7fafc6ae6700 1 -- 172.21.15.125:0/770327812 wait complete. 2023-10-03T10:14:22.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:23.040 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:23.080 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:23.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.166+0000 7f66aab46700 1 Processor -- start 2023-10-03T10:14:23.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.166+0000 7f66aab46700 1 -- start start 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66a409ad40 0x7f66a4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 0x7f66a40a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40a3b60 con 0x7f66a409ad40 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41348e0 con 0x7f66a4133f70 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66aab46700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a409b110 con 0x7f66a40a0a70 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66a409ad40 0x7f66a4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a90e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 0x7f66a40a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66a409ad40 0x7f66a4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52144/0 (socket says 172.21.15.125:52144) 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41788/0 (socket says 172.21.15.125:41788) 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 -- 172.21.15.125:0/123836347 learned_addr learned my addr 172.21.15.125:0/123836347 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 -- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 msgr2=0x7f66a40a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 0x7f66a40a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 -- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 msgr2=0x7f66a41343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 -- 172.21.15.125:0/123836347 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40a2fa0 con 0x7f66a409ad40 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a90e3700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 0x7f66a40a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a3fff700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a88e2700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a4133a30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6698009920 tx=0x7f6698009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c338b137f115f947 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a37fe700 1 -- 172.21.15.125:0/123836347 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011830 con 0x7f66a409ad40 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a37fe700 1 -- 172.21.15.125:0/123836347 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698011990 con 0x7f66a409ad40 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.167+0000 7f66a37fe700 1 -- 172.21.15.125:0/123836347 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011d20 con 0x7f66a409ad40 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 -- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 msgr2=0x7f66a4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a4133a30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6698009920 tx=0x7f6698009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 -- 172.21.15.125:0/123836347 shutdown_connections 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a40a0a70 0x7f66a40a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a4133a30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 --2- 172.21.15.125:0/123836347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a4133f70 0x7f66a41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 -- 172.21.15.125:0/123836347 >> 172.21.15.125:0/123836347 conn(0x7f66a4099c40 msgr2=0x7f66a406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 -- 172.21.15.125:0/123836347 shutdown_connections 2023-10-03T10:14:23.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.168+0000 7f66aab46700 1 -- 172.21.15.125:0/123836347 wait complete. 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.169+0000 7f66aab46700 1 Processor -- start 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.169+0000 7f66aab46700 1 -- start start 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 0x7f66a4122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 0x7f66a4122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41249c0 con 0x7f66a409ad40 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a409c7e0 con 0x7f66a40a0a70 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a409d360 con 0x7f66a4133f70 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a90e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 0x7f66a4122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 0x7f66a4122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52150/0 (socket says 172.21.15.125:52150) 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 -- 172.21.15.125:0/2782959343 learned_addr learned my addr 172.21.15.125:0/2782959343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 -- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 msgr2=0x7f66a4122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 0x7f66a4122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 -- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 msgr2=0x7f66a4122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 0x7f66a4122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 -- 172.21.15.125:0/2782959343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c009a70 con 0x7f66a409ad40 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a90e3700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 0x7f66a4122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a3fff700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 0x7f66a4122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a88e2700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6698000c00 tx=0x7f6698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698004450 con 0x7f66a409ad40 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669801e070 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66900094a0 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980038e0 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.170+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6698009550 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.171+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6698003a40 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.171+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6698020070 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.171+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4126100 con 0x7f66a409ad40 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.176+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6698003cf0 con 0x7f66a409ad40 2023-10-03T10:14:23.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 Processor -- start 2023-10-03T10:14:23.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 -- start start 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735409b110 con 0x7f73540a0a70 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540a3b60 con 0x7f7354133f70 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.210+0000 7f735c590700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73541348e0 con 0x7f735409ad40 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735a32c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735a32c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46936/0 (socket says 172.21.15.125:46936) 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735a32c700 1 -- 172.21.15.125:0/2684262888 learned_addr learned my addr 172.21.15.125:0/2684262888 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41806/0 (socket says 172.21.15.125:41806) 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735ab2d700 1 --1- 172.21.15.125:0/2684262888 >> v1:172.21.15.125:6789/0 conn(0x7f73540a0a70 0x7f73540a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47158/0 (socket says 172.21.15.125:47158) 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735932a700 1 -- 172.21.15.125:0/2684262888 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290087764 0 0) 0x7f735409b110 con 0x7f73540a0a70 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 -- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 msgr2=0x7f7354133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 -- 172.21.15.125:0/2684262888 >> v1:172.21.15.125:6789/0 conn(0x7f73540a0a70 legacy=0x7f73540a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 -- 172.21.15.125:0/2684262888 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540a2fa0 con 0x7f7354133f70 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735a32c700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f7359b2b700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7344009870 tx=0x7f7344009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5401ab32a317b0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735932a700 1 -- 172.21.15.125:0/2684262888 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344011830 con 0x7f7354133f70 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735932a700 1 -- 172.21.15.125:0/2684262888 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344011990 con 0x7f7354133f70 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.211+0000 7f735932a700 1 -- 172.21.15.125:0/2684262888 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344011d20 con 0x7f7354133f70 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 -- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 msgr2=0x7f73541343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7344009870 tx=0x7f7344009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 -- 172.21.15.125:0/2684262888 shutdown_connections 2023-10-03T10:14:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f735409ad40 0x7f7354133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 --2- 172.21.15.125:0/2684262888 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7354133f70 0x7f73541343a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 -- 172.21.15.125:0/2684262888 >> 172.21.15.125:0/2684262888 conn(0x7f7354099c40 msgr2=0x7f735406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 -- 172.21.15.125:0/2684262888 shutdown_connections 2023-10-03T10:14:23.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.212+0000 7f735c590700 1 -- 172.21.15.125:0/2684262888 wait complete. 2023-10-03T10:14:23.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 Processor -- start 2023-10-03T10:14:23.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 -- start start 2023-10-03T10:14:23.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73540a0a70 0x7f7354121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7354133f70 0x7f7354121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354123e80 con 0x7f735409ad40 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7354122f80 con 0x7f73540a0a70 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735c590700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735409c7e0 con 0x7f7354133f70 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735a32c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735a32c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52152/0 (socket says 172.21.15.125:52152) 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735a32c700 1 -- 172.21.15.125:0/523157755 learned_addr learned my addr 172.21.15.125:0/523157755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f7359b2b700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73540a0a70 0x7f7354121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.213+0000 7f735ab2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7354133f70 0x7f7354121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 -- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7354133f70 msgr2=0x7f7354121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7354133f70 0x7f7354121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 -- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73540a0a70 msgr2=0x7f7354121980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73540a0a70 0x7f7354121980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 -- 172.21.15.125:0/523157755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350009550 con 0x7f735409ad40 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735a32c700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9b0 tx=0x7f735000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000c850 con 0x7f735409ad40 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735000c9b0 con 0x7f735409ad40 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73440094a0 con 0x7f735409ad40 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000cd20 con 0x7f735409ad40 2023-10-03T10:14:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.214+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7354124c10 con 0x7f735409ad40 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.215+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7350013470 con 0x7f735409ad40 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.215+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f735003f430 con 0x7f735409ad40 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.215+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354124260 con 0x7f735409ad40 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.220+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73500102b0 con 0x7f735409ad40 2023-10-03T10:14:23.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.369+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66a404f2a0 con 0x7f66a409ad40 2023-10-03T10:14:23.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.369+0000 7f66a17fa700 1 -- 172.21.15.125:0/2782959343 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6698015020 con 0x7f66a409ad40 2023-10-03T10:14:23.370 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 msgr2=0x7f66a41224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6698000c00 tx=0x7f6698004750 comp rx=0 tx=0).stop 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 shutdown_connections 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66a4133f70 0x7f66a4122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66a409ad40 0x7f66a41224e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 --2- 172.21.15.125:0/2782959343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66a40a0a70 0x7f66a4122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 >> 172.21.15.125:0/2782959343 conn(0x7f66a4099c40 msgr2=0x7f66a40a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 shutdown_connections 2023-10-03T10:14:23.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.371+0000 7f66aab46700 1 -- 172.21.15.125:0/2782959343 wait complete. 2023-10-03T10:14:23.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:23.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.413+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f735411e060 con 0x7f735409ad40 2023-10-03T10:14:23.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.413+0000 7f734affd700 1 -- 172.21.15.125:0/523157755 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7350021070 con 0x7f735409ad40 2023-10-03T10:14:23.414 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:23.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 msgr2=0x7f7354121440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9b0 tx=0x7f735000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 shutdown_connections 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7354133f70 0x7f7354121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735409ad40 0x7f7354121440 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 --2- 172.21.15.125:0/523157755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73540a0a70 0x7f7354121980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 >> 172.21.15.125:0/523157755 conn(0x7f7354099c40 msgr2=0x7f7354133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 shutdown_connections 2023-10-03T10:14:23.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:23.416+0000 7f735c590700 1 -- 172.21.15.125:0/523157755 wait complete. 2023-10-03T10:14:23.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:23.935 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:23.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:24.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.063+0000 7ffa00029700 1 Processor -- start 2023-10-03T10:14:24.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 -- start start 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 0x7ff9f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 0x7ff9f813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f809dc00 con 0x7ff9f80a1380 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f809ea90 con 0x7ff9f8134120 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.064+0000 7ffa00029700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f809dec0 con 0x7ff9f80a0a70 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 0x7ff9f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fd5c4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff9f80a1380 0x7ff9f8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47168/0 (socket says 172.21.15.125:47168) 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fe5c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 0x7ff9f813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fd5c4700 1 -- 172.21.15.125:0/2808157923 learned_addr learned my addr 172.21.15.125:0/2808157923 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 -- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 msgr2=0x7ff9f813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 0x7ff9f813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 -- 172.21.15.125:0/2808157923 >> v1:172.21.15.125:6789/0 conn(0x7ff9f80a1380 legacy=0x7ff9f8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fcdc3700 1 -- 172.21.15.125:0/2808157923 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240363581 0 0) 0x7ff9f809dc00 con 0x7ff9f80a1380 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 -- 172.21.15.125:0/2808157923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f809e6a0 con 0x7ff9f80a0a70 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fe5c6700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 0x7ff9f813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fddc5700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 0x7ff9f80a0e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009870 tx=0x7ff9f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e36c35211c7af9f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fcdc3700 1 -- 172.21.15.125:0/2808157923 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011830 con 0x7ff9f80a0a70 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fcdc3700 1 -- 172.21.15.125:0/2808157923 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4011990 con 0x7ff9f80a0a70 2023-10-03T10:14:24.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.065+0000 7ff9fcdc3700 1 -- 172.21.15.125:0/2808157923 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011d20 con 0x7ff9f80a0a70 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 -- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 msgr2=0x7ff9f80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 0x7ff9f80a0e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009870 tx=0x7ff9f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 -- 172.21.15.125:0/2808157923 shutdown_connections 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f8134120 0x7ff9f813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 --2- 172.21.15.125:0/2808157923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f80a0a70 0x7ff9f80a0e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 -- 172.21.15.125:0/2808157923 >> 172.21.15.125:0/2808157923 conn(0x7ff9f80a6610 msgr2=0x7ff9f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 -- 172.21.15.125:0/2808157923 shutdown_connections 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.066+0000 7ffa00029700 1 -- 172.21.15.125:0/2808157923 wait complete. 2023-10-03T10:14:24.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.067+0000 7ffa00029700 1 Processor -- start 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.067+0000 7ffa00029700 1 -- start start 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 0x7ff9f8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 0x7ff9f8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8125920 con 0x7ff9f80a0a70 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8124310 con 0x7ff9f80a1380 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81332d0 con 0x7ff9f8134120 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fddc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 0x7ff9f8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fddc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52168/0 (socket says 172.21.15.125:52168) 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fddc5700 1 -- 172.21.15.125:0/3970419126 learned_addr learned my addr 172.21.15.125:0/3970419126 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fd5c4700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 0x7ff9f8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 -- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 msgr2=0x7ff9f8122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 0x7ff9f8122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 -- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 msgr2=0x7ff9f8122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 -- 172.21.15.125:0/3970419126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009a70 con 0x7ff9f8134120 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fddc5700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fd5c4700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 0x7ff9f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9fe5c6700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 0x7ff9f8123180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e50 tx=0x7ff9f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000ca90 con 0x7ff9f8134120 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000f040 con 0x7ff9f8134120 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f40094a0 con 0x7ff9f8134120 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000ce50 con 0x7ff9f8134120 2023-10-03T10:14:24.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.068+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f80a03e0 con 0x7ff9f8134120 2023-10-03T10:14:24.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.069+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9f0014480 con 0x7ff9f8134120 2023-10-03T10:14:24.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.069+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff9f003fb80 con 0x7ff9f8134120 2023-10-03T10:14:24.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.070+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f804f2a0 con 0x7ff9f8134120 2023-10-03T10:14:24.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.075+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9f003fe60 con 0x7ff9f8134120 2023-10-03T10:14:24.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.104+0000 7f588cb13700 1 Processor -- start 2023-10-03T10:14:24.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.104+0000 7f588cb13700 1 -- start start 2023-10-03T10:14:24.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588cb13700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588cb13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588cb13700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588809dc00 con 0x7f5888133f50 2023-10-03T10:14:24.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588cb13700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588809ea60 con 0x7f58880a0a70 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588cb13700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f588809dec0 con 0x7f58880a1380 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41846/0 (socket says 172.21.15.125:41846) 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46970/0 (socket says 172.21.15.125:46970) 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588659c700 1 -- 172.21.15.125:0/444012751 learned_addr learned my addr 172.21.15.125:0/444012751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5886d9d700 1 --1- 172.21.15.125:0/444012751 >> v1:172.21.15.125:6789/0 conn(0x7f5888133f50 0x7f588813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47176/0 (socket says 172.21.15.125:47176) 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 -- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 msgr2=0x7f58880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 -- 172.21.15.125:0/444012751 >> v1:172.21.15.125:6789/0 conn(0x7f5888133f50 legacy=0x7f588813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588559a700 1 -- 172.21.15.125:0/444012751 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208758102 0 0) 0x7f588809dc00 con 0x7f5888133f50 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f5885d9b700 1 -- 172.21.15.125:0/444012751 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588809e6a0 con 0x7f58880a1380 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.105+0000 7f588659c700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f5885d9b700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29b35ac6d573bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588559a700 1 -- 172.21.15.125:0/444012751 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011830 con 0x7f58880a1380 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588559a700 1 -- 172.21.15.125:0/444012751 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c011990 con 0x7f58880a1380 2023-10-03T10:14:24.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588559a700 1 -- 172.21.15.125:0/444012751 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011d20 con 0x7f58880a1380 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 -- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 msgr2=0x7f5888133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 -- 172.21.15.125:0/444012751 shutdown_connections 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58880a0a70 0x7f58880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 --2- 172.21.15.125:0/444012751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888133a10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 -- 172.21.15.125:0/444012751 >> 172.21.15.125:0/444012751 conn(0x7f58880a6610 msgr2=0x7f58880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.106+0000 7f588cb13700 1 -- 172.21.15.125:0/444012751 shutdown_connections 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.107+0000 7f588cb13700 1 -- 172.21.15.125:0/444012751 wait complete. 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.108+0000 7f588cb13700 1 Processor -- start 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.108+0000 7f588cb13700 1 -- start start 2023-10-03T10:14:24.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.108+0000 7f588cb13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58880a0a70 0x7f5888122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888126110 con 0x7f58880a0a70 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5888123cf0 con 0x7f5888133f50 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5888126360 con 0x7f58880a1380 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41848/0 (socket says 172.21.15.125:41848) 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 -- 172.21.15.125:0/2624235417 learned_addr learned my addr 172.21.15.125:0/2624235417 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5885d9b700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588659c700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58880a0a70 0x7f5888122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 -- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 msgr2=0x7f5888122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 -- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58880a0a70 msgr2=0x7f5888122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58880a0a70 0x7f5888122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 -- 172.21.15.125:0/2624235417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009550 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5886d9d700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5880002230 tx=0x7f588000cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000aac0 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000ac40 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0094a0 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58800070d0 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.109+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5888133360 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.110+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5880007250 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.110+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f588003f430 con 0x7f5888133f50 2023-10-03T10:14:24.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.110+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5888133790 con 0x7f5888133f50 2023-10-03T10:14:24.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.119+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5880007500 con 0x7f5888133f50 2023-10-03T10:14:24.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.271+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9f8072980 con 0x7ff9f8134120 2023-10-03T10:14:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.271+0000 7ff9ee7fc700 1 -- 172.21.15.125:0/3970419126 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9f0012520 con 0x7ff9f8134120 2023-10-03T10:14:24.272 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 msgr2=0x7ff9f8123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 0x7ff9f8123180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e50 tx=0x7ff9f000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 shutdown_connections 2023-10-03T10:14:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9f8134120 0x7ff9f8123180 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f80a0a70 0x7ff9f8122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 --2- 172.21.15.125:0/3970419126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f80a1380 0x7ff9f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.273+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 >> 172.21.15.125:0/3970419126 conn(0x7ff9f80a6610 msgr2=0x7ff9f809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.274+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 shutdown_connections 2023-10-03T10:14:24.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.274+0000 7ffa00029700 1 -- 172.21.15.125:0/3970419126 wait complete. 2023-10-03T10:14:24.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:24.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.312+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f588804f2a0 con 0x7f5888133f50 2023-10-03T10:14:24.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.313+0000 7f5876ffd700 1 -- 172.21.15.125:0/2624235417 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5880018020 con 0x7f5888133f50 2023-10-03T10:14:24.313 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 msgr2=0x7f5888123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5880002230 tx=0x7f588000cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 shutdown_connections 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5888133f50 0x7f5888123310 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58880a0a70 0x7f5888122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 --2- 172.21.15.125:0/2624235417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f58880a1380 0x7f5888122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 >> 172.21.15.125:0/2624235417 conn(0x7f58880a6610 msgr2=0x7f588809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 shutdown_connections 2023-10-03T10:14:24.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.315+0000 7f588cb13700 1 -- 172.21.15.125:0/2624235417 wait complete. 2023-10-03T10:14:24.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:24.385 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:24.429 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 Processor -- start 2023-10-03T10:14:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 -- start start 2023-10-03T10:14:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 0x7faf74132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7409f770 con 0x7faf7406a770 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7409dce0 con 0x7faf7406b080 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf7af31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf7409da80 con 0x7faf74131cf0 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf78ccd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf73fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf73fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41864/0 (socket says 172.21.15.125:41864) 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf794ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 0x7faf74132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf73fff700 1 -- 172.21.15.125:0/1605298717 learned_addr learned my addr 172.21.15.125:0/1605298717 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.514+0000 7faf78ccd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52188/0 (socket says 172.21.15.125:52188) 2023-10-03T10:14:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 -- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 msgr2=0x7faf74132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 0x7faf74132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 -- 172.21.15.125:0/1605298717 >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 msgr2=0x7faf7406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 --2- 172.21.15.125:0/1605298717 >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 -- 172.21.15.125:0/1605298717 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7409eb20 con 0x7faf7406b080 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf78ccd700 1 --2- 172.21.15.125:0/1605298717 >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf794ce700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 0x7faf74132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf73fff700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faf600098f0 tx=0x7faf60009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c227741a4ff58b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf737fe700 1 -- 172.21.15.125:0/1605298717 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011830 con 0x7faf7406b080 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf737fe700 1 -- 172.21.15.125:0/1605298717 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60011990 con 0x7faf7406b080 2023-10-03T10:14:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.515+0000 7faf737fe700 1 -- 172.21.15.125:0/1605298717 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011d20 con 0x7faf7406b080 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 -- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 msgr2=0x7faf741317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faf600098f0 tx=0x7faf60009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 -- 172.21.15.125:0/1605298717 shutdown_connections 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf74131cf0 0x7faf74132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 --2- 172.21.15.125:0/1605298717 >> v2:172.21.15.125:3300/0 conn(0x7faf7406a770 0x7faf7406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 --2- 172.21.15.125:0/1605298717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406b080 0x7faf741317b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 -- 172.21.15.125:0/1605298717 >> 172.21.15.125:0/1605298717 conn(0x7faf74099c40 msgr2=0x7faf740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 -- 172.21.15.125:0/1605298717 shutdown_connections 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.516+0000 7faf7af31700 1 -- 172.21.15.125:0/1605298717 wait complete. 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.517+0000 7faf7af31700 1 Processor -- start 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.517+0000 7faf7af31700 1 -- start start 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 0x7faf7411d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 0x7faf741c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf741204f0 con 0x7faf74131cf0 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf74131360 con 0x7faf7406a770 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf7af31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf7411ce90 con 0x7faf7406b080 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf78ccd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 0x7faf7411d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf78ccd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41880/0 (socket says 172.21.15.125:41880) 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf78ccd700 1 -- 172.21.15.125:0/3269443232 learned_addr learned my addr 172.21.15.125:0/3269443232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf794ce700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 0x7faf741c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 -- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 msgr2=0x7faf7411d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 -- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 msgr2=0x7faf741c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 0x7faf741c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf73fff700 1 -- 172.21.15.125:0/3269443232 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680094a0 con 0x7faf7406b080 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf78ccd700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.518+0000 7faf794ce700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 0x7faf741c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf73fff700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 0x7faf7411d7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf60016000 tx=0x7faf60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60004240 con 0x7faf7406b080 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6001f070 con 0x7faf7406b080 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c009a70 con 0x7faf7406b080 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600036a0 con 0x7faf7406b080 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.519+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60009550 con 0x7faf7406b080 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.520+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf60021030 con 0x7faf7406b080 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.520+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7411f530 con 0x7faf7406b080 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.520+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf60040650 con 0x7faf7406b080 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.524+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf6000b9d0 con 0x7faf7406b080 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.555+0000 7f129ccac700 1 Processor -- start 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.555+0000 7f129ccac700 1 -- start start 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129ccac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806a770 0x7f129806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129ccac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f129806b080 0x7f12981317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129ccac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129809da80 con 0x7f1298131cf0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129ccac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129809dce0 con 0x7f129806b080 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129ccac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129809eb20 con 0x7f129806a770 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f129806b080 0x7f12981317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f129806b080 0x7f12981317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52206/0 (socket says 172.21.15.125:52206) 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1296d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1298131cf0 0x7f1298138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47186/0 (socket says 172.21.15.125:47186) 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 -- 172.21.15.125:0/1275048404 learned_addr learned my addr 172.21.15.125:0/1275048404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f129659c700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806a770 0x7f129806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 -- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806a770 msgr2=0x7f129806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806a770 0x7f129806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 -- 172.21.15.125:0/1275048404 >> v1:172.21.15.125:6789/0 conn(0x7f1298131cf0 legacy=0x7f1298138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 -- 172.21.15.125:0/1275048404 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129809d860 con 0x7f129806b080 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.556+0000 7f1295d9b700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129806b080 0x7f12981317b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f12880098f0 tx=0x7f1288009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3608f67a34b8a9a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129559a700 1 -- 172.21.15.125:0/1275048404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288011830 con 0x7f129806b080 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129559a700 1 -- 172.21.15.125:0/1275048404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288011990 con 0x7f129806b080 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129559a700 1 -- 172.21.15.125:0/1275048404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288011d20 con 0x7f129806b080 2023-10-03T10:14:24.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 -- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129806b080 msgr2=0x7f12981317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129806b080 0x7f12981317b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f12880098f0 tx=0x7f1288009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 -- 172.21.15.125:0/1275048404 shutdown_connections 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806a770 0x7f129806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 --2- 172.21.15.125:0/1275048404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129806b080 0x7f12981317b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 -- 172.21.15.125:0/1275048404 >> 172.21.15.125:0/1275048404 conn(0x7f1298099c40 msgr2=0x7f12980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 -- 172.21.15.125:0/1275048404 shutdown_connections 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.557+0000 7f129ccac700 1 -- 172.21.15.125:0/1275048404 wait complete. 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.558+0000 7f129ccac700 1 Processor -- start 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.558+0000 7f129ccac700 1 -- start start 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 0x7f129809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 0x7f12981c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1298131870 con 0x7f1298131cf0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1298071e10 con 0x7f129806b080 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129ccac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12981313a0 con 0x7f129806a770 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 0x7f129809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1296d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 0x7f12981c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:41902/0 (socket says 172.21.15.125:41902) 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f129659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 0x7f129809ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46994/0 (socket says 172.21.15.125:46994) 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 -- 172.21.15.125:0/1304536725 learned_addr learned my addr 172.21.15.125:0/1304536725 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 -- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 msgr2=0x7f129809ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 0x7f129809ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 -- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 msgr2=0x7f12981c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 0x7f12981c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 -- 172.21.15.125:0/1304536725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009550 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1296d9d700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 0x7f12981c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1295d9b700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.559+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12880036a0 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288003800 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129809a970 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288003bb0 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129809c0a0 con 0x7f129806b080 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1288021070 con 0x7f129806b080 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.560+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1288040c90 con 0x7f129806b080 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.561+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1298121530 con 0x7f129806b080 2023-10-03T10:14:24.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.565+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1288029020 con 0x7f129806b080 2023-10-03T10:14:24.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.722+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf7409d2f0 con 0x7faf7406b080 2023-10-03T10:14:24.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.722+0000 7faf717fa700 1 -- 172.21.15.125:0/3269443232 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf60015070 con 0x7faf7406b080 2023-10-03T10:14:24.723 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.724+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 msgr2=0x7faf7411d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.724+0000 7faf7af31700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 0x7faf7411d7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf60016000 tx=0x7faf60004750 comp rx=0 tx=0).stop 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.724+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 shutdown_connections 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.724+0000 7faf7af31700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf74131cf0 0x7faf741c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.725+0000 7faf7af31700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf7406a770 0x7faf7411d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.725+0000 7faf7af31700 1 --2- 172.21.15.125:0/3269443232 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf7406b080 0x7faf7411d7e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.725+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 >> 172.21.15.125:0/3269443232 conn(0x7faf74099c40 msgr2=0x7faf741b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.725+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 shutdown_connections 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.725+0000 7faf7af31700 1 -- 172.21.15.125:0/3269443232 wait complete. 2023-10-03T10:14:24.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.757+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f129804f2a0 con 0x7f129806b080 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.757+0000 7f1286ffd700 1 -- 172.21.15.125:0/1304536725 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1288015070 con 0x7f129806b080 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 msgr2=0x7f129809b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288004750 comp rx=0 tx=0).stop 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 shutdown_connections 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1298131cf0 0x7f12981c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f129806a770 0x7f129809ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 --2- 172.21.15.125:0/1304536725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f129806b080 0x7f129809b3a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 >> 172.21.15.125:0/1304536725 conn(0x7f1298099c40 msgr2=0x7f129806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 shutdown_connections 2023-10-03T10:14:24.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:24.759+0000 7f129ccac700 1 -- 172.21.15.125:0/1304536725 wait complete. 2023-10-03T10:14:24.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:25.287 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:25.328 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:25.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.414+0000 7f33ec60d700 1 Processor -- start 2023-10-03T10:14:25.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.414+0000 7f33ec60d700 1 -- start start 2023-10-03T10:14:25.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ec60d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ec60d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 0x7f33e412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ec60d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40a1e70 con 0x7f33e41304a0 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ec60d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e409a720 con 0x7f33e40a1340 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ec60d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e409b300 con 0x7f33e40a0a30 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ea3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33e9ba8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 0x7f33e412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ea3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39314/0 (socket says 172.21.15.125:39314) 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33eabaa700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f33e41304a0 0x7f33e41371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49148/0 (socket says 172.21.15.125:49148) 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.415+0000 7f33ea3a9700 1 -- 172.21.15.125:0/934572559 learned_addr learned my addr 172.21.15.125:0/934572559 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33ea3a9700 1 -- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 msgr2=0x7f33e412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33ea3a9700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 0x7f33e412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33e93a7700 1 -- 172.21.15.125:0/934572559 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810370145 0 0) 0x7f33e40a1e70 con 0x7f33e41304a0 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33ea3a9700 1 -- 172.21.15.125:0/934572559 >> v1:172.21.15.125:6789/0 conn(0x7f33e41304a0 legacy=0x7f33e41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33ea3a9700 1 -- 172.21.15.125:0/934572559 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e409abc0 con 0x7f33e40a0a30 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33e9ba8700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 0x7f33e412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33ea3a9700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f33e000bb90 tx=0x7f33e000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d437b7afdb40f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33e93a7700 1 -- 172.21.15.125:0/934572559 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0005c20 con 0x7f33e40a0a30 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33e93a7700 1 -- 172.21.15.125:0/934572559 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0005d80 con 0x7f33e40a0a30 2023-10-03T10:14:25.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.416+0000 7f33e93a7700 1 -- 172.21.15.125:0/934572559 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000dc40 con 0x7f33e40a0a30 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 -- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 msgr2=0x7f33e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f33e000bb90 tx=0x7f33e000bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 -- 172.21.15.125:0/934572559 shutdown_connections 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e40a0e00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 --2- 172.21.15.125:0/934572559 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e40a1340 0x7f33e412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 -- 172.21.15.125:0/934572559 >> 172.21.15.125:0/934572559 conn(0x7f33e40a2980 msgr2=0x7f33e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 -- 172.21.15.125:0/934572559 shutdown_connections 2023-10-03T10:14:25.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.417+0000 7f33ec60d700 1 -- 172.21.15.125:0/934572559 wait complete. 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 Processor -- start 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 -- start start 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e411fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 0x7f33e41c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4122d50 con 0x7f33e40a1340 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e411f790 con 0x7f33e41304a0 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ec60d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e409f920 con 0x7f33e40a0a30 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ea3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e411fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33e9ba8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33e9ba8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37766/0 (socket says 172.21.15.125:37766) 2023-10-03T10:14:25.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33ea3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e411fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39316/0 (socket says 172.21.15.125:39316) 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33e9ba8700 1 -- 172.21.15.125:0/71796573 learned_addr learned my addr 172.21.15.125:0/71796573 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.418+0000 7f33eabaa700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 0x7f33e41c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 -- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 msgr2=0x7f33e411fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e411fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 -- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 msgr2=0x7f33e41c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 0x7f33e41c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 -- 172.21.15.125:0/71796573 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40094a0 con 0x7f33e40a1340 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33eabaa700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 0x7f33e41c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33e9ba8700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f33d400ebb0 tx=0x7f33d400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400c850 con 0x7f33e40a1340 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400c9b0 con 0x7f33e40a1340 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e000b7a0 con 0x7f33e40a1340 2023-10-03T10:14:25.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400cd40 con 0x7f33e40a1340 2023-10-03T10:14:25.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.419+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4121d80 con 0x7f33e40a1340 2023-10-03T10:14:25.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.420+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33d4013470 con 0x7f33e40a1340 2023-10-03T10:14:25.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.420+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33d403f860 con 0x7f33e40a1340 2023-10-03T10:14:25.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.420+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e404f2a0 con 0x7f33e40a1340 2023-10-03T10:14:25.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.425+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33d4017080 con 0x7f33e40a1340 2023-10-03T10:14:25.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.456+0000 7f7fd738d700 1 Processor -- start 2023-10-03T10:14:25.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.456+0000 7f7fd738d700 1 -- start start 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd013c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd013eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00a0a70 con 0x7f7fd009b400 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd009b190 con 0x7f7fd013c760 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd738d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd009a820 con 0x7f7fd009bd10 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd5129700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd5129700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37780/0 (socket says 172.21.15.125:37780) 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd5129700 1 -- 172.21.15.125:0/1686643924 learned_addr learned my addr 172.21.15.125:0/1686643924 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd592a700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd013eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 -- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 msgr2=0x7f7fd013eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd013eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 -- 172.21.15.125:0/1686643924 >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 msgr2=0x7f7fd009b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 --2- 172.21.15.125:0/1686643924 >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 -- 172.21.15.125:0/1686643924 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd009a280 con 0x7f7fd009bd10 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd5129700 1 --2- 172.21.15.125:0/1686643924 >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fd4928700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd013c220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6200badab54c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fc7fff700 1 -- 172.21.15.125:0/1686643924 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011830 con 0x7f7fd009bd10 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fc7fff700 1 -- 172.21.15.125:0/1686643924 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0011990 con 0x7f7fd009bd10 2023-10-03T10:14:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.457+0000 7f7fc7fff700 1 -- 172.21.15.125:0/1686643924 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011d20 con 0x7f7fd009bd10 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 -- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 msgr2=0x7f7fd013c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd013c220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 -- 172.21.15.125:0/1686643924 shutdown_connections 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd013eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 --2- 172.21.15.125:0/1686643924 >> v2:172.21.15.125:3300/0 conn(0x7f7fd009b400 0x7f7fd009b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 --2- 172.21.15.125:0/1686643924 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd013c220 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 -- 172.21.15.125:0/1686643924 >> 172.21.15.125:0/1686643924 conn(0x7f7fd0099c40 msgr2=0x7f7fd006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 -- 172.21.15.125:0/1686643924 shutdown_connections 2023-10-03T10:14:25.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.458+0000 7f7fd738d700 1 -- 172.21.15.125:0/1686643924 wait complete. 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 Processor -- start 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 -- start start 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd01cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0129480 con 0x7f7fd009b400 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0129020 con 0x7f7fd013c760 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd738d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd012ad40 con 0x7f7fd009bd10 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.459+0000 7f7fd4928700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd5129700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39334/0 (socket says 172.21.15.125:39334) 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd5129700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37784/0 (socket says 172.21.15.125:37784) 2023-10-03T10:14:25.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 -- 172.21.15.125:0/2289780025 learned_addr learned my addr 172.21.15.125:0/2289780025 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd592a700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd01cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 -- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 msgr2=0x7f7fd01cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd01cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 -- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 msgr2=0x7f7fd01cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 -- 172.21.15.125:0/2289780025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc009550 con 0x7f7fd009bd10 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd5129700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd592a700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd01cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd4928700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009840 tx=0x7f7fc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0004450 con 0x7f7fd009bd10 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc001f070 con 0x7f7fd009bd10 2023-10-03T10:14:25.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc00094a0 con 0x7f7fd009bd10 2023-10-03T10:14:25.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00038e0 con 0x7f7fd009bd10 2023-10-03T10:14:25.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.460+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd012aa60 con 0x7f7fd009bd10 2023-10-03T10:14:25.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.461+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fc0003a40 con 0x7f7fd009bd10 2023-10-03T10:14:25.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.461+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fc0021070 con 0x7f7fd009bd10 2023-10-03T10:14:25.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.461+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd0074f10 con 0x7f7fd009bd10 2023-10-03T10:14:25.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.466+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fc002b080 con 0x7f7fd009bd10 2023-10-03T10:14:25.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.619+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33e406bce0 con 0x7f33e40a1340 2023-10-03T10:14:25.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.620+0000 7f33daffd700 1 -- 172.21.15.125:0/71796573 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33d4021020 con 0x7f33e40a1340 2023-10-03T10:14:25.620 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:25.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 msgr2=0x7f33e4120090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f33d400ebb0 tx=0x7f33d400eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 shutdown_connections 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e41304a0 0x7f33e41c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33e40a0a30 0x7f33e411fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 --2- 172.21.15.125:0/71796573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e40a1340 0x7f33e4120090 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 >> 172.21.15.125:0/71796573 conn(0x7f33e40a2980 msgr2=0x7f33e41b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 shutdown_connections 2023-10-03T10:14:25.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.622+0000 7f33ec60d700 1 -- 172.21.15.125:0/71796573 wait complete. 2023-10-03T10:14:25.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:25.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.659+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7fd012a700 con 0x7f7fd009bd10 2023-10-03T10:14:25.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.659+0000 7f7fc5ffb700 1 -- 172.21.15.125:0/2289780025 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fd012a700 con 0x7f7fd009bd10 2023-10-03T10:14:25.659 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 msgr2=0x7f7fd01ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009840 tx=0x7f7fc0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 shutdown_connections 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd013c760 0x7f7fd01cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd009b400 0x7f7fd01cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 --2- 172.21.15.125:0/2289780025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd009bd10 0x7f7fd01ccea0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 >> 172.21.15.125:0/2289780025 conn(0x7f7fd0099c40 msgr2=0x7f7fd006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 shutdown_connections 2023-10-03T10:14:25.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.661+0000 7f7fd738d700 1 -- 172.21.15.125:0/2289780025 wait complete. 2023-10-03T10:14:25.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:25.738 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:25.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.863+0000 7f4ab4f49700 1 Processor -- start 2023-10-03T10:14:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.863+0000 7f4ab4f49700 1 -- start start 2023-10-03T10:14:25.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 0x7f4ab0137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab009bb90 con 0x7f4ab009a3d0 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab009c210 con 0x7f4ab0099a60 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4ab4f49700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab009a870 con 0x7f4ab012d380 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aae59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aadd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aaed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 0x7f4ab0137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aae59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39342/0 (socket says 172.21.15.125:39342) 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aadd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47192/0 (socket says 172.21.15.125:47192) 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.864+0000 7f4aae59c700 1 -- 172.21.15.125:0/3288278306 learned_addr learned my addr 172.21.15.125:0/3288278306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 -- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 msgr2=0x7f4ab0099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 -- 172.21.15.125:0/3288278306 >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 msgr2=0x7f4ab0137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 --2- 172.21.15.125:0/3288278306 >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 0x7f4ab0137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 -- 172.21.15.125:0/3288278306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab009ced0 con 0x7f4ab012d380 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aaed9d700 1 --2- 172.21.15.125:0/3288278306 >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 0x7f4ab0137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aadd9b700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aae59c700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006fd0 tx=0x7f4aa0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0e1852fe89539f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aad59a700 1 -- 172.21.15.125:0/3288278306 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0005e30 con 0x7f4ab012d380 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aad59a700 1 -- 172.21.15.125:0/3288278306 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0004030 con 0x7f4ab012d380 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4aad59a700 1 -- 172.21.15.125:0/3288278306 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00043e0 con 0x7f4ab012d380 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4ab4f49700 1 -- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 msgr2=0x7f4ab012d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.865+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006fd0 tx=0x7f4aa0009bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 -- 172.21.15.125:0/3288278306 shutdown_connections 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/3288278306 >> v2:172.21.15.125:3300/0 conn(0x7f4ab009a3d0 0x7f4ab0137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab012d380 0x7f4ab012d750 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/3288278306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab0099a60 0x7f4ab0099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 -- 172.21.15.125:0/3288278306 >> 172.21.15.125:0/3288278306 conn(0x7f4ab00a2980 msgr2=0x7f4ab00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 -- 172.21.15.125:0/3288278306 shutdown_connections 2023-10-03T10:14:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.866+0000 7f4ab4f49700 1 -- 172.21.15.125:0/3288278306 wait complete. 2023-10-03T10:14:25.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 Processor -- start 2023-10-03T10:14:25.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 -- start start 2023-10-03T10:14:25.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 0x7f4ab01c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab009a3d0 0x7f4ab01c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab011bf30 con 0x7f4ab012d380 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab009b3e0 con 0x7f4ab009a3d0 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4ab4f49700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0122a10 con 0x7f4ab0099a60 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4aaed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4aaed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37790/0 (socket says 172.21.15.125:37790) 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4aaed9d700 1 -- 172.21.15.125:0/1293462164 learned_addr learned my addr 172.21.15.125:0/1293462164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4aae59c700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 0x7f4ab01c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.867+0000 7f4aadd9b700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab009a3d0 0x7f4ab01c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 -- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 msgr2=0x7f4ab01c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 0x7f4ab01c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 -- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab009a3d0 msgr2=0x7f4ab01c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab009a3d0 0x7f4ab01c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 -- 172.21.15.125:0/1293462164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40094a0 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aae59c700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 0x7f4ab01c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4aaed9d700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800efc0 tx=0x7f4aa800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800ca90 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800f040 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800ce30 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa8009a70 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.868+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0009500 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.869+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4aa8014480 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.869+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4aa803fd70 con 0x7f4ab012d380 2023-10-03T10:14:25.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.869+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab0122850 con 0x7f4ab012d380 2023-10-03T10:14:25.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.873+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4aa8012930 con 0x7f4ab012d380 2023-10-03T10:14:25.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.906+0000 7faee43d6700 1 Processor -- start 2023-10-03T10:14:25.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 -- start start 2023-10-03T10:14:25.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 0x7faedc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc09e9d0 con 0x7faedc0a0a70 2023-10-03T10:14:25.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc09dc00 con 0x7faedc139200 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee43d6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc09dec0 con 0x7faedc0a1550 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee1971700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee2973700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 0x7faedc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee1971700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47214/0 (socket says 172.21.15.125:47214) 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee2973700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 0x7faedc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37798/0 (socket says 172.21.15.125:37798) 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee2172700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faedc0a0a70 0x7faedc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49154/0 (socket says 172.21.15.125:49154) 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.907+0000 7faee1971700 1 -- 172.21.15.125:0/2545449092 learned_addr learned my addr 172.21.15.125:0/2545449092 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1971700 1 -- 172.21.15.125:0/2545449092 >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 msgr2=0x7faedc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1971700 1 --2- 172.21.15.125:0/2545449092 >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 0x7faedc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1971700 1 -- 172.21.15.125:0/2545449092 >> v1:172.21.15.125:6789/0 conn(0x7faedc0a0a70 legacy=0x7faedc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1971700 1 -- 172.21.15.125:0/2545449092 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc09e6a0 con 0x7faedc0a1550 2023-10-03T10:14:25.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1971700 1 --2- 172.21.15.125:0/2545449092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faed00098f0 tx=0x7faed0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd5f09745f5d2f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1170700 1 -- 172.21.15.125:0/2545449092 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0011830 con 0x7faedc0a1550 2023-10-03T10:14:25.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1170700 1 -- 172.21.15.125:0/2545449092 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0011990 con 0x7faedc0a1550 2023-10-03T10:14:25.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee1170700 1 -- 172.21.15.125:0/2545449092 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0011d20 con 0x7faedc0a1550 2023-10-03T10:14:25.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee43d6700 1 -- 172.21.15.125:0/2545449092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 msgr2=0x7faedc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.908+0000 7faee43d6700 1 --2- 172.21.15.125:0/2545449092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faed00098f0 tx=0x7faed0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 -- 172.21.15.125:0/2545449092 shutdown_connections 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 --2- 172.21.15.125:0/2545449092 >> v2:172.21.15.125:3300/0 conn(0x7faedc139200 0x7faedc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 --2- 172.21.15.125:0/2545449092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a1550 0x7faedc138cc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 -- 172.21.15.125:0/2545449092 >> 172.21.15.125:0/2545449092 conn(0x7faedc0a6610 msgr2=0x7faedc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 -- 172.21.15.125:0/2545449092 shutdown_connections 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 -- 172.21.15.125:0/2545449092 wait complete. 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 Processor -- start 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.909+0000 7faee43d6700 1 -- start start 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 0x7faedc11f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a52b0 con 0x7faedc0a1550 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc120540 con 0x7faedc0a0a70 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee43d6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faedc121e10 con 0x7faedc139200 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2172700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 0x7faedc11f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee1971700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2172700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47228/0 (socket says 172.21.15.125:47228) 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2172700 1 -- 172.21.15.125:0/2123397292 learned_addr learned my addr 172.21.15.125:0/2123397292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee1971700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37814/0 (socket says 172.21.15.125:37814) 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 -- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 msgr2=0x7faedc11e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 -- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 msgr2=0x7faedc11eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2973700 1 -- 172.21.15.125:0/2123397292 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009550 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee2172700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.910+0000 7faee1971700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faee2973700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 0x7faedc11f3e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faed400e880 tx=0x7faed400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4013680 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed40137e0 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4013b70 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc134350 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.911+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc120c20 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.912+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faed4013cd0 con 0x7faedc139200 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.912+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc04f2a0 con 0x7faedc139200 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.912+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faed403f960 con 0x7faedc139200 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:25.920+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faed4011db0 con 0x7faedc139200 2023-10-03T10:14:26.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.074+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ab012d180 con 0x7f4ab012d380 2023-10-03T10:14:26.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.074+0000 7f4a9effd700 1 -- 172.21.15.125:0/1293462164 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4aa8012340 con 0x7f4ab012d380 2023-10-03T10:14:26.075 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 msgr2=0x7f4ab01c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800efc0 tx=0x7f4aa800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 shutdown_connections 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab012d380 0x7f4ab01c9210 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ab0099a60 0x7f4ab01c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 --2- 172.21.15.125:0/1293462164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ab009a3d0 0x7f4ab01c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 >> 172.21.15.125:0/1293462164 conn(0x7f4ab00a2980 msgr2=0x7f4ab009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 shutdown_connections 2023-10-03T10:14:26.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.076+0000 7f4ab4f49700 1 -- 172.21.15.125:0/1293462164 wait complete. 2023-10-03T10:14:26.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.113+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faedc072980 con 0x7faedc139200 2023-10-03T10:14:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.113+0000 7faedaffd700 1 -- 172.21.15.125:0/2123397292 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faed4017070 con 0x7faedc139200 2023-10-03T10:14:26.114 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 msgr2=0x7faedc11f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 0x7faedc11f3e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faed400e880 tx=0x7faed400eb90 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 shutdown_connections 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc139200 0x7faedc11f3e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc0a0a70 0x7faedc11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 --2- 172.21.15.125:0/2123397292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc0a1550 0x7faedc11eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 >> 172.21.15.125:0/2123397292 conn(0x7faedc0a6610 msgr2=0x7faedc136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.115+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 shutdown_connections 2023-10-03T10:14:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.116+0000 7faee43d6700 1 -- 172.21.15.125:0/2123397292 wait complete. 2023-10-03T10:14:26.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:26.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:26.675 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:26.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.765+0000 7f567ebb6700 1 Processor -- start 2023-10-03T10:14:26.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.765+0000 7f567ebb6700 1 -- start start 2023-10-03T10:14:26.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567ebb6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567ebb6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567ebb6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567809b110 con 0x7f56780a0a70 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567ebb6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780a3b60 con 0x7f5678133f70 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567ebb6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56781348e0 con 0x7f567809ad40 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f5677fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39360/0 (socket says 172.21.15.125:39360) 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f5677fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37822/0 (socket says 172.21.15.125:37822) 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 -- 172.21.15.125:0/379887591 learned_addr learned my addr 172.21.15.125:0/379887591 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:26.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567d153700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f56780a0a70 0x7f56780a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49166/0 (socket says 172.21.15.125:49166) 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 -- 172.21.15.125:0/379887591 >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 msgr2=0x7f56781343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 --2- 172.21.15.125:0/379887591 >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 -- 172.21.15.125:0/379887591 >> v1:172.21.15.125:6789/0 conn(0x7f56780a0a70 legacy=0x7f56780a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 -- 172.21.15.125:0/379887591 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780a2fa0 con 0x7f567809ad40 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f5677fff700 1 --2- 172.21.15.125:0/379887591 >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f56777fe700 1 -- 172.21.15.125:0/379887591 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975785746 0 0) 0x7f567809b110 con 0x7f56780a0a70 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f567c952700 1 --2- 172.21.15.125:0/379887591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f566c009920 tx=0x7f566c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ada0f3e9907a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f56777fe700 1 -- 172.21.15.125:0/379887591 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011830 con 0x7f567809ad40 2023-10-03T10:14:26.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.766+0000 7f56777fe700 1 -- 172.21.15.125:0/379887591 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c011990 con 0x7f567809ad40 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f56777fe700 1 -- 172.21.15.125:0/379887591 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011d20 con 0x7f567809ad40 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 -- 172.21.15.125:0/379887591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 msgr2=0x7f5678133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 --2- 172.21.15.125:0/379887591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f566c009920 tx=0x7f566c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 -- 172.21.15.125:0/379887591 shutdown_connections 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 --2- 172.21.15.125:0/379887591 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567809ad40 0x7f5678133a30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 --2- 172.21.15.125:0/379887591 >> v2:172.21.15.125:3300/0 conn(0x7f5678133f70 0x7f56781343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 -- 172.21.15.125:0/379887591 >> 172.21.15.125:0/379887591 conn(0x7f5678099c40 msgr2=0x7f567806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 -- 172.21.15.125:0/379887591 shutdown_connections 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.767+0000 7f567ebb6700 1 -- 172.21.15.125:0/379887591 wait complete. 2023-10-03T10:14:26.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.768+0000 7f567ebb6700 1 Processor -- start 2023-10-03T10:14:26.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.768+0000 7f567ebb6700 1 -- start start 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 0x7f56781c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 0x7f56781c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678122200 con 0x7f567809ad40 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56781205d0 con 0x7f56780a0a70 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567ebb6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5678120b50 con 0x7f5678133f70 2023-10-03T10:14:26.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f5677fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 0x7f56781c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39372/0 (socket says 172.21.15.125:39372) 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 -- 172.21.15.125:0/3624990180 learned_addr learned my addr 172.21.15.125:0/3624990180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567c952700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 0x7f56781c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 -- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 msgr2=0x7f56781c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 0x7f56781c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 -- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 msgr2=0x7f56781c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 0x7f56781c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 -- 172.21.15.125:0/3624990180 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56640094a0 con 0x7f5678133f70 2023-10-03T10:14:26.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567c952700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 0x7f56781c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f5677fff700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 0x7f56781c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f567d153700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5670002230 tx=0x7f567000cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.769+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000aac0 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.770+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567000ac40 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.770+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700070d0 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.770+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c009550 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.770+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678122c70 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.770+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5670007250 con 0x7f5678133f70 2023-10-03T10:14:26.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.771+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f567003f160 con 0x7f5678133f70 2023-10-03T10:14:26.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.771+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804f2a0 con 0x7f5678133f70 2023-10-03T10:14:26.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.776+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5670018080 con 0x7f5678133f70 2023-10-03T10:14:26.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.806+0000 7f76fe4b3700 1 Processor -- start 2023-10-03T10:14:26.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.806+0000 7f76fe4b3700 1 -- start start 2023-10-03T10:14:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fe4b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 0x7f76f8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fe4b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fe4b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f809e9d0 con 0x7f76f80a0a70 2023-10-03T10:14:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fe4b3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f809dc00 con 0x7f76f80a1550 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fe4b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f809dec0 con 0x7f76f8139200 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76f77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 0x7f76f8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47240/0 (socket says 172.21.15.125:47240) 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 -- 172.21.15.125:0/46731973 learned_addr learned my addr 172.21.15.125:0/46731973 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76f7fff700 1 --1- 172.21.15.125:0/46731973 >> v1:172.21.15.125:6789/0 conn(0x7f76f80a0a70 0x7f76f80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49170/0 (socket says 172.21.15.125:49170) 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 -- 172.21.15.125:0/46731973 >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 msgr2=0x7f76f8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 --2- 172.21.15.125:0/46731973 >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 0x7f76f8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 -- 172.21.15.125:0/46731973 >> v1:172.21.15.125:6789/0 conn(0x7f76f80a0a70 legacy=0x7f76f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76fca50700 1 -- 172.21.15.125:0/46731973 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f809e6a0 con 0x7f76f8139200 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76f6ffd700 1 -- 172.21.15.125:0/46731973 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606157997 0 0) 0x7f76f809e9d0 con 0x7f76f80a0a70 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.807+0000 7f76f77fe700 1 --2- 172.21.15.125:0/46731973 >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 0x7f76f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fca50700 1 --2- 172.21.15.125:0/46731973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e50 tx=0x7f76f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa937820e51d6fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76f6ffd700 1 -- 172.21.15.125:0/46731973 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000e070 con 0x7f76f8139200 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76f6ffd700 1 -- 172.21.15.125:0/46731973 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000b910 con 0x7f76f8139200 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76f6ffd700 1 -- 172.21.15.125:0/46731973 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000bcc0 con 0x7f76f8139200 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 -- 172.21.15.125:0/46731973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 msgr2=0x7f76f813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/46731973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e50 tx=0x7f76f000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 -- 172.21.15.125:0/46731973 shutdown_connections 2023-10-03T10:14:26.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/46731973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f8139200 0x7f76f813b5e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/46731973 >> v2:172.21.15.125:3300/0 conn(0x7f76f80a1550 0x7f76f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 -- 172.21.15.125:0/46731973 >> 172.21.15.125:0/46731973 conn(0x7f76f80a6610 msgr2=0x7f76f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 -- 172.21.15.125:0/46731973 shutdown_connections 2023-10-03T10:14:26.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.808+0000 7f76fe4b3700 1 -- 172.21.15.125:0/46731973 wait complete. 2023-10-03T10:14:26.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.809+0000 7f76fe4b3700 1 Processor -- start 2023-10-03T10:14:26.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.809+0000 7f76fe4b3700 1 -- start start 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 0x7f76f811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 0x7f76f811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80a03e0 con 0x7f76f8139200 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8121990 con 0x7f76f80a1550 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fe4b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8121eb0 con 0x7f76f80a0a70 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 0x7f76f811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39380/0 (socket says 172.21.15.125:39380) 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f7fff700 1 -- 172.21.15.125:0/2012192358 learned_addr learned my addr 172.21.15.125:0/2012192358 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fca50700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 0x7f76f811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 -- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 msgr2=0x7f76f811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 -- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 msgr2=0x7f76f811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 0x7f76f811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 -- 172.21.15.125:0/2012192358 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0094a0 con 0x7f76f80a1550 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76fca50700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 0x7f76f811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f7fff700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.810+0000 7f76f77fe700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 0x7f76f811ebb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00e9b0 tx=0x7f76ec00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00ee50 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec00c850 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00cc00 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0009b30 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f80a5700 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76ec013470 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.811+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76ec03fa70 con 0x7f76f80a1550 2023-10-03T10:14:26.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.812+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f8121cf0 con 0x7f76f80a1550 2023-10-03T10:14:26.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.816+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76ec013720 con 0x7f76f80a1550 2023-10-03T10:14:26.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.971+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56780729d0 con 0x7f5678133f70 2023-10-03T10:14:26.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.971+0000 7f56757fa700 1 -- 172.21.15.125:0/3624990180 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5670007500 con 0x7f5678133f70 2023-10-03T10:14:26.972 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 msgr2=0x7f56781c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5670002230 tx=0x7f567000cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 shutdown_connections 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5678133f70 0x7f56781c8c10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f567809ad40 0x7f56781c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 --2- 172.21.15.125:0/3624990180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56780a0a70 0x7f56781c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 >> 172.21.15.125:0/3624990180 conn(0x7f5678099c40 msgr2=0x7f567809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 shutdown_connections 2023-10-03T10:14:26.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:26.973+0000 7f567ebb6700 1 -- 172.21.15.125:0/3624990180 wait complete. 2023-10-03T10:14:26.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:27.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.009+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f76f8121b50 con 0x7f76f80a1550 2023-10-03T10:14:27.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.010+0000 7f76f4ff9700 1 -- 172.21.15.125:0/2012192358 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76f8121b50 con 0x7f76f80a1550 2023-10-03T10:14:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:27.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 msgr2=0x7f76f811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 0x7f76f811ebb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00e9b0 tx=0x7f76ec00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 shutdown_connections 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76f8139200 0x7f76f811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f76f80a0a70 0x7f76f811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 --2- 172.21.15.125:0/2012192358 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76f80a1550 0x7f76f811ebb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 >> 172.21.15.125:0/2012192358 conn(0x7f76f80a6610 msgr2=0x7f76f8136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 shutdown_connections 2023-10-03T10:14:27.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.012+0000 7f76fe4b3700 1 -- 172.21.15.125:0/2012192358 wait complete. 2023-10-03T10:14:27.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:27.089 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:27.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.217+0000 7f1e2eddb700 1 Processor -- start 2023-10-03T10:14:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 -- start start 2023-10-03T10:14:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 0x7f1e28133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e28133f50 0x7f1e281343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2809e9d0 con 0x7f1e28133f50 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2809dc00 con 0x7f1e280a0a70 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2eddb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2809dec0 con 0x7f1e280a1380 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2cb77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e28133f50 0x7f1e281343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2cb77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47258/0 (socket says 172.21.15.125:47258) 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2cb77700 1 -- 172.21.15.125:0/212200288 learned_addr learned my addr 172.21.15.125:0/212200288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e27fff700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 0x7f1e28133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 -- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 msgr2=0x7f1e28133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 0x7f1e28133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 -- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 msgr2=0x7f1e280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2d378700 1 -- 172.21.15.125:0/212200288 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2809e6a0 con 0x7f1e28133f50 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e27fff700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 0x7f1e28133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.218+0000 7f1e2cb77700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2d378700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e28133f50 0x7f1e281343f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009d90 tx=0x7f1e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489017b7b5cb1292 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e277fe700 1 -- 172.21.15.125:0/212200288 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000e070 con 0x7f1e28133f50 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e277fe700 1 -- 172.21.15.125:0/212200288 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000bb20 con 0x7f1e28133f50 2023-10-03T10:14:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e277fe700 1 -- 172.21.15.125:0/212200288 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20012430 con 0x7f1e28133f50 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 -- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e28133f50 msgr2=0x7f1e281343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e28133f50 0x7f1e281343f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009d90 tx=0x7f1e2000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 -- 172.21.15.125:0/212200288 shutdown_connections 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e28133f50 0x7f1e281343f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/212200288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e280a1380 0x7f1e28133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 -- 172.21.15.125:0/212200288 >> 172.21.15.125:0/212200288 conn(0x7f1e280a6610 msgr2=0x7f1e280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 -- 172.21.15.125:0/212200288 shutdown_connections 2023-10-03T10:14:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.219+0000 7f1e2eddb700 1 -- 172.21.15.125:0/212200288 wait complete. 2023-10-03T10:14:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.220+0000 7f1e2eddb700 1 Processor -- start 2023-10-03T10:14:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.220+0000 7f1e2eddb700 1 -- start start 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e2811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e28133f50 0x7f1e2811fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28122df0 con 0x7f1e280a1380 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e281228e0 con 0x7f1e280a0a70 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2eddb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28121d80 con 0x7f1e28133f50 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e27fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e2811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e27fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37878/0 (socket says 172.21.15.125:37878) 2023-10-03T10:14:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e27fff700 1 -- 172.21.15.125:0/442579699 learned_addr learned my addr 172.21.15.125:0/442579699 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2d378700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e28133f50 0x7f1e2811fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 -- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e28133f50 msgr2=0x7f1e2811fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e28133f50 0x7f1e2811fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 -- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 msgr2=0x7f1e2811f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e2cb77700 1 -- 172.21.15.125:0/442579699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009550 con 0x7f1e280a0a70 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.221+0000 7f1e27fff700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e2cb77700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e2811f2d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00e9e0 tx=0x7f1e1c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00c5e0 con 0x7f1e280a0a70 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140094a0 con 0x7f1e280a0a70 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00c740 con 0x7f1e280a0a70 2023-10-03T10:14:27.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00cad0 con 0x7f1e280a0a70 2023-10-03T10:14:27.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.222+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e20009a70 con 0x7f1e280a0a70 2023-10-03T10:14:27.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.223+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e1c013470 con 0x7f1e280a0a70 2023-10-03T10:14:27.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.223+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e1c03fa10 con 0x7f1e280a0a70 2023-10-03T10:14:27.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.223+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2804f2a0 con 0x7f1e280a0a70 2023-10-03T10:14:27.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.228+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e1c017020 con 0x7f1e280a0a70 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.259+0000 7fa8f8fa6700 1 Processor -- start 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.259+0000 7fa8f8fa6700 1 -- start start 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f8fa6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a0a70 0x7fa8f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f8fa6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8f40a1380 0x7fa8f4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f8fa6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f409dc00 con 0x7fa8f4133f50 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f8fa6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f409ea60 con 0x7fa8f40a1380 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f8fa6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f409dec0 con 0x7fa8f40a0a70 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8f40a1380 0x7fa8f4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8f40a1380 0x7fa8f4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37890/0 (socket says 172.21.15.125:37890) 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f2d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa8f4133f50 0x7fa8f413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49182/0 (socket says 172.21.15.125:49182) 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 -- 172.21.15.125:0/3412347837 learned_addr learned my addr 172.21.15.125:0/3412347837 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f259c700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a0a70 0x7fa8f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 -- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a0a70 msgr2=0x7fa8f40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a0a70 0x7fa8f40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 -- 172.21.15.125:0/3412347837 >> v1:172.21.15.125:6789/0 conn(0x7fa8f4133f50 legacy=0x7fa8f413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f1d9b700 1 -- 172.21.15.125:0/3412347837 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f409e6a0 con 0x7fa8f40a1380 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.260+0000 7fa8f159a700 1 -- 172.21.15.125:0/3412347837 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660530944 0 0) 0x7fa8f409dc00 con 0x7fa8f4133f50 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f1d9b700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f40a1380 0x7fa8f4133a10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098f0 tx=0x7fa8e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b593f97335d7e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f159a700 1 -- 172.21.15.125:0/3412347837 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4011830 con 0x7fa8f40a1380 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f159a700 1 -- 172.21.15.125:0/3412347837 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4011990 con 0x7fa8f40a1380 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f159a700 1 -- 172.21.15.125:0/3412347837 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4011d20 con 0x7fa8f40a1380 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f40a1380 msgr2=0x7fa8f4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f40a1380 0x7fa8f4133a10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098f0 tx=0x7fa8e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/3412347837 shutdown_connections 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a0a70 0x7fa8f40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/3412347837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f40a1380 0x7fa8f4133a10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/3412347837 >> 172.21.15.125:0/3412347837 conn(0x7fa8f40a6610 msgr2=0x7fa8f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/3412347837 shutdown_connections 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.261+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/3412347837 wait complete. 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 Processor -- start 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 -- start start 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a1380 0x7fa8f411f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 0x7fa8f41c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40a17b0 con 0x7fa8f4133f50 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f411fee0 con 0x7fa8f40a1380 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.263+0000 7fa8f8fa6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4120f00 con 0x7fa8f40a0a70 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 0x7fa8f41c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39410/0 (socket says 172.21.15.125:39410) 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 -- 172.21.15.125:0/1039016795 learned_addr learned my addr 172.21.15.125:0/1039016795 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f1d9b700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a1380 0x7fa8f411f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 -- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a1380 msgr2=0x7fa8f411f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a1380 0x7fa8f411f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 -- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 msgr2=0x7fa8f41c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 0x7fa8f41c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 -- 172.21.15.125:0/1039016795 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4009550 con 0x7fa8f40a0a70 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f2d9d700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 0x7fa8f41c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f259c700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e9b0 tx=0x7fa8e800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8009710 con 0x7fa8f40a0a70 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800ee50 con 0x7fa8f40a0a70 2023-10-03T10:14:27.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40a03e0 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800ca50 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.264+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4133420 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.265+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8e800cbb0 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.265+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa8e803f750 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.265+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f404f2a0 con 0x7fa8f40a0a70 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.270+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8e8017080 con 0x7fa8f40a0a70 2023-10-03T10:14:27.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.424+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e28120ee0 con 0x7f1e280a0a70 2023-10-03T10:14:27.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.424+0000 7f1e257fa700 1 -- 172.21.15.125:0/442579699 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e1c02a090 con 0x7f1e280a0a70 2023-10-03T10:14:27.425 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 msgr2=0x7f1e2811f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e2811f2d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00e9e0 tx=0x7f1e1c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 shutdown_connections 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e28133f50 0x7f1e2811fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e280a0a70 0x7f1e2811f2d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 --2- 172.21.15.125:0/442579699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e280a1380 0x7f1e2811f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 >> 172.21.15.125:0/442579699 conn(0x7f1e280a6610 msgr2=0x7f1e2809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 shutdown_connections 2023-10-03T10:14:27.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.426+0000 7f1e2eddb700 1 -- 172.21.15.125:0/442579699 wait complete. 2023-10-03T10:14:27.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:27.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.462+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8f409cba0 con 0x7fa8f40a0a70 2023-10-03T10:14:27.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.462+0000 7fa8e2ffd700 1 -- 172.21.15.125:0/1039016795 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8e801be10 con 0x7fa8f40a0a70 2023-10-03T10:14:27.463 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 msgr2=0x7fa8f411f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e9b0 tx=0x7fa8e800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 shutdown_connections 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8f4133f50 0x7fa8f41c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa8f40a0a70 0x7fa8f411f460 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 --2- 172.21.15.125:0/1039016795 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8f40a1380 0x7fa8f411f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 >> 172.21.15.125:0/1039016795 conn(0x7fa8f40a6610 msgr2=0x7fa8f40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 shutdown_connections 2023-10-03T10:14:27.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:27.464+0000 7fa8f8fa6700 1 -- 172.21.15.125:0/1039016795 wait complete. 2023-10-03T10:14:27.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:27.987 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:28.025 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:28.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 Processor -- start 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 -- start start 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 0x7f29d41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d406b2d0 con 0x7f29d41300a0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4133610 con 0x7f29d41309f0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d9c8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d409a500 con 0x7f29d4133ad0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 0x7f29d41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47296/0 (socket says 172.21.15.125:47296) 2023-10-03T10:14:28.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39422/0 (socket says 172.21.15.125:39422) 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.114+0000 7f29d3fff700 1 -- 172.21.15.125:0/166772168 learned_addr learned my addr 172.21.15.125:0/166772168 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 -- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 msgr2=0x7f29d413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 -- 172.21.15.125:0/166772168 >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 msgr2=0x7f29d41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 --2- 172.21.15.125:0/166772168 >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 0x7f29d41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 -- 172.21.15.125:0/166772168 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d41338b0 con 0x7f29d4133ad0 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d2ffd700 1 --2- 172.21.15.125:0/166772168 >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 0x7f29d41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d3fff700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d37fe700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009840 tx=0x7f29c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f934ff28a7e78e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d27fc700 1 -- 172.21.15.125:0/166772168 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4011830 con 0x7f29d4133ad0 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d27fc700 1 -- 172.21.15.125:0/166772168 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4011990 con 0x7f29d4133ad0 2023-10-03T10:14:28.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.115+0000 7f29d27fc700 1 -- 172.21.15.125:0/166772168 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4011d20 con 0x7f29d4133ad0 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 -- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 msgr2=0x7f29d4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009840 tx=0x7f29c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 -- 172.21.15.125:0/166772168 shutdown_connections 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41309f0 0x7f29d413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/166772168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d4133ad0 0x7f29d4133ea0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/166772168 >> v2:172.21.15.125:3300/0 conn(0x7f29d41300a0 0x7f29d41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 -- 172.21.15.125:0/166772168 >> 172.21.15.125:0/166772168 conn(0x7f29d4099c40 msgr2=0x7f29d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 -- 172.21.15.125:0/166772168 shutdown_connections 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.116+0000 7f29d9c8d700 1 -- 172.21.15.125:0/166772168 wait complete. 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 Processor -- start 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 -- start start 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 0x7f29d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 0x7f29d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d411fd90 con 0x7f29d4133ad0 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4071ff0 con 0x7f29d41300a0 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d9c8d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d411ffe0 con 0x7f29d41309f0 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39432/0 (socket says 172.21.15.125:39432) 2023-10-03T10:14:28.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d2ffd700 1 -- 172.21.15.125:0/2006514899 learned_addr learned my addr 172.21.15.125:0/2006514899 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d3fff700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 0x7f29d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.117+0000 7f29d37fe700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 0x7f29d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 -- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 msgr2=0x7f29d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 -- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 msgr2=0x7f29d411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 0x7f29d411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 -- 172.21.15.125:0/2006514899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80094a0 con 0x7f29d41300a0 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d2ffd700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d3fff700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 0x7f29d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d37fe700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 0x7f29d411da40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f29d406e4e0 tx=0x7f29c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4004450 con 0x7f29d41300a0 2023-10-03T10:14:28.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c40036a0 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40045f0 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc009b30 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.118+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40094a0 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.119+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c4003a50 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.119+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29c40407f0 con 0x7f29d41300a0 2023-10-03T10:14:28.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.119+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d412dd00 con 0x7f29d41300a0 2023-10-03T10:14:28.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.124+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c401a420 con 0x7f29d41300a0 2023-10-03T10:14:28.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.159+0000 7fd7249e8700 1 Processor -- start 2023-10-03T10:14:28.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.159+0000 7fd7249e8700 1 -- start start 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd7249e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd7249e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 0x7fd720130a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd7249e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72006b0a0 con 0x7fd7201334b0 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd7249e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72006ab40 con 0x7fd7201305d0 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd7249e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd720130f60 con 0x7fd72006a770 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 0x7fd720130a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47310/0 (socket says 172.21.15.125:47310) 2023-10-03T10:14:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 0x7fd720130a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37930/0 (socket says 172.21.15.125:37930) 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd7201334b0 0x7fd7201338f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49194/0 (socket says 172.21.15.125:49194) 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 -- 172.21.15.125:0/615505267 learned_addr learned my addr 172.21.15.125:0/615505267 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 -- 172.21.15.125:0/615505267 >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 msgr2=0x7fd720130a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 --2- 172.21.15.125:0/615505267 >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 0x7fd720130a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 -- 172.21.15.125:0/615505267 >> v1:172.21.15.125:6789/0 conn(0x7fd7201334b0 legacy=0x7fd7201338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 -- 172.21.15.125:0/615505267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72009f670 con 0x7fd72006a770 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71e59c700 1 --2- 172.21.15.125:0/615505267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd7100098f0 tx=0x7fd710009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67f256630e7c00d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71d59a700 1 -- 172.21.15.125:0/615505267 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710011830 con 0x7fd72006a770 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71d59a700 1 -- 172.21.15.125:0/615505267 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd710011990 con 0x7fd72006a770 2023-10-03T10:14:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.160+0000 7fd71d59a700 1 -- 172.21.15.125:0/615505267 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710011d20 con 0x7fd72006a770 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 -- 172.21.15.125:0/615505267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 msgr2=0x7fd72012ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 --2- 172.21.15.125:0/615505267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd7100098f0 tx=0x7fd710009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 -- 172.21.15.125:0/615505267 shutdown_connections 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 --2- 172.21.15.125:0/615505267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72012ff10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 --2- 172.21.15.125:0/615505267 >> v2:172.21.15.125:3300/0 conn(0x7fd7201305d0 0x7fd720130a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 -- 172.21.15.125:0/615505267 >> 172.21.15.125:0/615505267 conn(0x7fd7200a2ef0 msgr2=0x7fd7200a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 -- 172.21.15.125:0/615505267 shutdown_connections 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.161+0000 7fd7249e8700 1 -- 172.21.15.125:0/615505267 wait complete. 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.162+0000 7fd7249e8700 1 Processor -- start 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.162+0000 7fd7249e8700 1 -- start start 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72011d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72012db30 con 0x7fd7201334b0 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72011fd20 con 0x7fd72006a770 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200a0460 con 0x7fd7201305d0 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37946/0 (socket says 172.21.15.125:37946) 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39438/0 (socket says 172.21.15.125:39438) 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71ed9d700 1 -- 172.21.15.125:0/2251407727 learned_addr learned my addr 172.21.15.125:0/2251407727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71e59c700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72011d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 -- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 msgr2=0x7fd72011d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72011d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 -- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 msgr2=0x7fd72011e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 -- 172.21.15.125:0/2251407727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009550 con 0x7fd7201305d0 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71ed9d700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd71dd9b700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd71400e8d0 tx=0x7fd71400ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714013680 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140137e0 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72011fa60 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714013b50 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.163+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72011ea80 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.164+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd714013cb0 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.164+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd71403f9b0 con 0x7fd7201305d0 2023-10-03T10:14:28.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.165+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72004f2a0 con 0x7fd7201305d0 2023-10-03T10:14:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.169+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd71401a9b0 con 0x7fd7201305d0 2023-10-03T10:14:28.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.318+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29d411fbd0 con 0x7f29d41300a0 2023-10-03T10:14:28.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.319+0000 7f29bbfff700 1 -- 172.21.15.125:0/2006514899 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29d411fbd0 con 0x7f29d41300a0 2023-10-03T10:14:28.319 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 msgr2=0x7f29d411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 0x7f29d411da40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f29d406e4e0 tx=0x7f29c4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 shutdown_connections 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d4133ad0 0x7f29d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d41300a0 0x7f29d411da40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 --2- 172.21.15.125:0/2006514899 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d41309f0 0x7f29d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 >> 172.21.15.125:0/2006514899 conn(0x7f29d4099c40 msgr2=0x7f29d412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 shutdown_connections 2023-10-03T10:14:28.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.321+0000 7f29d9c8d700 1 -- 172.21.15.125:0/2006514899 wait complete. 2023-10-03T10:14:28.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:28.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.363+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd72006c300 con 0x7fd7201305d0 2023-10-03T10:14:28.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.363+0000 7fd70effd700 1 -- 172.21.15.125:0/2251407727 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd714017020 con 0x7fd7201305d0 2023-10-03T10:14:28.364 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 msgr2=0x7fd72011de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd71400e8d0 tx=0x7fd71400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 shutdown_connections 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7201334b0 0x7fd72011e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd72006a770 0x7fd72011d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 --2- 172.21.15.125:0/2251407727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7201305d0 0x7fd72011de90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 >> 172.21.15.125:0/2251407727 conn(0x7fd7200a2ef0 msgr2=0x7fd7201313b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 shutdown_connections 2023-10-03T10:14:28.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.365+0000 7fd7249e8700 1 -- 172.21.15.125:0/2251407727 wait complete. 2023-10-03T10:14:28.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:28.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:28.479 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.568+0000 7fd464b4a700 1 Processor -- start 2023-10-03T10:14:28.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.568+0000 7fd464b4a700 1 -- start start 2023-10-03T10:14:28.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600a0370 con 0x7fd46009f180 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46009fa00 con 0x7fd460134160 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd464b4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd46009ada0 con 0x7fd46009e870 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37962/0 (socket says 172.21.15.125:37962) 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39448/0 (socket says 172.21.15.125:39448) 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47332/0 (socket says 172.21.15.125:47332) 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.569+0000 7fd45dd9b700 1 -- 172.21.15.125:0/841694560 learned_addr learned my addr 172.21.15.125:0/841694560 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 -- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 msgr2=0x7fd460134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 -- 172.21.15.125:0/841694560 >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 msgr2=0x7fd460133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 --2- 172.21.15.125:0/841694560 >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 -- 172.21.15.125:0/841694560 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46006bec0 con 0x7fd46009e870 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45dd9b700 1 --2- 172.21.15.125:0/841694560 >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45ed9d700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45e59c700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd450009870 tx=0x7fd450009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d0ef0ec4bd4182 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45d59a700 1 -- 172.21.15.125:0/841694560 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011830 con 0x7fd46009e870 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45d59a700 1 -- 172.21.15.125:0/841694560 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450011990 con 0x7fd46009e870 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd45d59a700 1 -- 172.21.15.125:0/841694560 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011d20 con 0x7fd46009e870 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd464b4a700 1 -- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 msgr2=0x7fd46009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.570+0000 7fd464b4a700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd450009870 tx=0x7fd450009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 -- 172.21.15.125:0/841694560 shutdown_connections 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd460134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 --2- 172.21.15.125:0/841694560 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd46009ec40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 --2- 172.21.15.125:0/841694560 >> v2:172.21.15.125:3300/0 conn(0x7fd46009f180 0x7fd460133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 -- 172.21.15.125:0/841694560 >> 172.21.15.125:0/841694560 conn(0x7fd4600a4430 msgr2=0x7fd4600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 -- 172.21.15.125:0/841694560 shutdown_connections 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.571+0000 7fd464b4a700 1 -- 172.21.15.125:0/841694560 wait complete. 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 Processor -- start 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 -- start start 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd460122660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600a3bd0 con 0x7fd46009f180 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd460124100 con 0x7fd460134160 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd464b4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd460125fe0 con 0x7fd46009e870 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47338/0 (socket says 172.21.15.125:47338) 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37972/0 (socket says 172.21.15.125:37972) 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45ed9d700 1 -- 172.21.15.125:0/3527356796 learned_addr learned my addr 172.21.15.125:0/3527356796 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.572+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd460122660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 -- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 msgr2=0x7fd460122660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd460122660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 -- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 msgr2=0x7fd460122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 -- 172.21.15.125:0/3527356796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454009550 con 0x7fd460134160 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45dd9b700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45e59c700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd460122660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd45ed9d700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd45800efc0 tx=0x7fd45800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800ca90 con 0x7fd460134160 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800f040 con 0x7fd460134160 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd458009a70 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800ce10 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.573+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4500094a0 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.574+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd458014480 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.574+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460125bd0 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.574+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd45803fda0 con 0x7fd460134160 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.579+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd460125bd0 con 0x7fd460134160 2023-10-03T10:14:28.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.609+0000 7f19a865a700 1 Processor -- start 2023-10-03T10:14:28.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.609+0000 7f19a865a700 1 -- start start 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a865a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 0x7f19a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a865a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 0x7f19a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a865a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a009dc00 con 0x7f19a00a1380 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a865a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009ea90 con 0x7f19a00a0a70 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a865a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009dec0 con 0x7f19a0134120 2023-10-03T10:14:28.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 0x7f19a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a5bf5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f19a00a1380 0x7f19a0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49204/0 (socket says 172.21.15.125:49204) 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a5bf5700 1 -- 172.21.15.125:0/1904380877 learned_addr learned my addr 172.21.15.125:0/1904380877 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a63f6700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 0x7f19a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 -- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 msgr2=0x7f19a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 0x7f19a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 -- 172.21.15.125:0/1904380877 >> v1:172.21.15.125:6789/0 conn(0x7f19a00a1380 legacy=0x7f19a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 -- 172.21.15.125:0/1904380877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a009e6a0 con 0x7f19a0134120 2023-10-03T10:14:28.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a63f6700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 0x7f19a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a6bf7700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 0x7f19a013bce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1998009dc0 tx=0x7f199800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a23edb151059acf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a53f4700 1 -- 172.21.15.125:0/1904380877 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800e070 con 0x7f19a0134120 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a53f4700 1 -- 172.21.15.125:0/1904380877 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800bb20 con 0x7f19a0134120 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.610+0000 7f19a53f4700 1 -- 172.21.15.125:0/1904380877 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998012430 con 0x7f19a0134120 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 -- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 msgr2=0x7f19a013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 0x7f19a013bce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1998009dc0 tx=0x7f199800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 -- 172.21.15.125:0/1904380877 shutdown_connections 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a0134120 0x7f19a013bce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 --2- 172.21.15.125:0/1904380877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a0a70 0x7f19a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 -- 172.21.15.125:0/1904380877 >> 172.21.15.125:0/1904380877 conn(0x7f19a00a6610 msgr2=0x7f19a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 -- 172.21.15.125:0/1904380877 shutdown_connections 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.611+0000 7f19a865a700 1 -- 172.21.15.125:0/1904380877 wait complete. 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 Processor -- start 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 -- start start 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a1380 0x7f19a0122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19a0134120 0x7f19a0123470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0126280 con 0x7f19a0134120 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01339c0 con 0x7f19a00a1380 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.612+0000 7f19a865a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0133480 con 0x7f19a00a0a70 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39490/0 (socket says 172.21.15.125:39490) 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 -- 172.21.15.125:0/3417917207 learned_addr learned my addr 172.21.15.125:0/3417917207 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a6bf7700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19a0134120 0x7f19a0123470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a5bf5700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a1380 0x7f19a0122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 -- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a1380 msgr2=0x7f19a0122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a1380 0x7f19a0122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 -- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19a0134120 msgr2=0x7f19a0123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19a0134120 0x7f19a0123470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 -- 172.21.15.125:0/3417917207 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0094a0 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a63f6700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f199c00ec10 tx=0x7f199c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00c850 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00c9b0 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1998009a70 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00cd20 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.613+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0126c10 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.614+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f199c013470 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.614+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a004f2a0 con 0x7f19a00a0a70 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.614+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f199c03fb30 con 0x7f19a00a0a70 2023-10-03T10:14:28.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.623+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f199c013720 con 0x7f19a00a0a70 2023-10-03T10:14:28.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.775+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd460125bd0 con 0x7fd460134160 2023-10-03T10:14:28.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.776+0000 7fd44effd700 1 -- 172.21.15.125:0/3527356796 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd460125bd0 con 0x7fd460134160 2023-10-03T10:14:28.776 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:28.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.777+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 msgr2=0x7fd4601230e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.777+0000 7fd464b4a700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd45800efc0 tx=0x7fd45800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 shutdown_connections 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd460134160 0x7fd4601230e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd46009e870 0x7fd460122660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 --2- 172.21.15.125:0/3527356796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd46009f180 0x7fd460122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 >> 172.21.15.125:0/3527356796 conn(0x7fd4600a4430 msgr2=0x7fd4600a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 shutdown_connections 2023-10-03T10:14:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.778+0000 7fd464b4a700 1 -- 172.21.15.125:0/3527356796 wait complete. 2023-10-03T10:14:28.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:28.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.813+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19a00a03e0 con 0x7f19a00a0a70 2023-10-03T10:14:28.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.813+0000 7f1996ffd700 1 -- 172.21.15.125:0/3417917207 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f199c021020 con 0x7f19a00a0a70 2023-10-03T10:14:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:28.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 msgr2=0x7f19a01229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f199c00ec10 tx=0x7f199c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:28.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 shutdown_connections 2023-10-03T10:14:28.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19a0134120 0x7f19a0123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f19a00a0a70 0x7f19a01229f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 --2- 172.21.15.125:0/3417917207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19a00a1380 0x7f19a0122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 >> 172.21.15.125:0/3417917207 conn(0x7f19a00a6610 msgr2=0x7f19a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 shutdown_connections 2023-10-03T10:14:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:28.815+0000 7f19a865a700 1 -- 172.21.15.125:0/3417917207 wait complete. 2023-10-03T10:14:28.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:29.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:29.378 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.462+0000 7feb7692f700 1 Processor -- start 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.462+0000 7feb7692f700 1 -- start start 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb7692f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb7692f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb7692f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7006bec0 con 0x7feb7009f180 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb7692f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7006ce60 con 0x7feb7009e870 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb7692f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7009fa00 con 0x7feb701343a0 2023-10-03T10:14:29.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38000/0 (socket says 172.21.15.125:38000) 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feb7009f180 0x7feb70133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49208/0 (socket says 172.21.15.125:49208) 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47362/0 (socket says 172.21.15.125:47362) 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6ffff700 1 -- 172.21.15.125:0/1244036340 learned_addr learned my addr 172.21.15.125:0/1244036340 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 -- 172.21.15.125:0/1244036340 >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 msgr2=0x7feb7009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 --2- 172.21.15.125:0/1244036340 >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 -- 172.21.15.125:0/1244036340 >> v1:172.21.15.125:6789/0 conn(0x7feb7009f180 legacy=0x7feb70133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 -- 172.21.15.125:0/1244036340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7009ad80 con 0x7feb701343a0 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6ffff700 1 --2- 172.21.15.125:0/1244036340 >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb74ecc700 1 --2- 172.21.15.125:0/1244036340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb68009d90 tx=0x7feb6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53fa870979b9cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.463+0000 7feb6effd700 1 -- 172.21.15.125:0/1244036340 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800e070 con 0x7feb701343a0 2023-10-03T10:14:29.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb6effd700 1 -- 172.21.15.125:0/1244036340 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800bb20 con 0x7feb701343a0 2023-10-03T10:14:29.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb6effd700 1 -- 172.21.15.125:0/1244036340 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68012430 con 0x7feb701343a0 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 -- 172.21.15.125:0/1244036340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 msgr2=0x7feb7013bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 --2- 172.21.15.125:0/1244036340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb68009d90 tx=0x7feb6800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 -- 172.21.15.125:0/1244036340 shutdown_connections 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 --2- 172.21.15.125:0/1244036340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb701343a0 0x7feb7013bf60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 --2- 172.21.15.125:0/1244036340 >> v2:172.21.15.125:3300/0 conn(0x7feb7009e870 0x7feb7009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 -- 172.21.15.125:0/1244036340 >> 172.21.15.125:0/1244036340 conn(0x7feb700a4430 msgr2=0x7feb700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 -- 172.21.15.125:0/1244036340 shutdown_connections 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.464+0000 7feb7692f700 1 -- 172.21.15.125:0/1244036340 wait complete. 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 Processor -- start 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 -- start start 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb7009f180 0x7feb70122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb701343a0 0x7feb70123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70124e60 con 0x7feb7009e870 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7006d010 con 0x7feb7009f180 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb7692f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb7006fbf0 con 0x7feb701343a0 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.466+0000 7feb6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38016/0 (socket says 172.21.15.125:38016) 2023-10-03T10:14:29.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 -- 172.21.15.125:0/1663169608 learned_addr learned my addr 172.21.15.125:0/1663169608 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb74ecc700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb701343a0 0x7feb70123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6f7fe700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb7009f180 0x7feb70122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 -- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb701343a0 msgr2=0x7feb70123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb701343a0 0x7feb70123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 -- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb7009f180 msgr2=0x7feb70122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb7009f180 0x7feb70122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 -- 172.21.15.125:0/1663169608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009550 con 0x7feb7009e870 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6ffff700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feb6000ebe0 tx=0x7feb6000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000c7f0 con 0x7feb7009e870 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000c950 con 0x7feb7009e870 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb68009a70 con 0x7feb7009e870 2023-10-03T10:14:29.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000cce0 con 0x7feb7009e870 2023-10-03T10:14:29.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.467+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70133950 con 0x7feb7009e870 2023-10-03T10:14:29.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.468+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb60013470 con 0x7feb7009e870 2023-10-03T10:14:29.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.468+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70126310 con 0x7feb7009e870 2023-10-03T10:14:29.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.468+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb6003fbe0 con 0x7feb7009e870 2023-10-03T10:14:29.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.473+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb60013720 con 0x7feb7009e870 2023-10-03T10:14:29.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 Processor -- start 2023-10-03T10:14:29.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 -- start start 2023-10-03T10:14:29.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 0x7fcd8c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0a3b60 con 0x7fcd8c133f70 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c1348e0 con 0x7fcd8c0a0a70 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd9112a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c09b110 con 0x7fcd8c09ad40 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd8a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 0x7fcd8c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd8b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39500/0 (socket says 172.21.15.125:39500) 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.505+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/872978625 learned_addr learned my addr 172.21.15.125:0/872978625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 msgr2=0x7fcd8c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c0a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/872978625 >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 msgr2=0x7fcd8c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/872978625 >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 0x7fcd8c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/872978625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0a2fa0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8b59e700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8a59c700 1 --2- 172.21.15.125:0/872978625 >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 0x7fcd8c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009920 tx=0x7fcd7c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df71e98761714d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd89d9b700 1 -- 172.21.15.125:0/872978625 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011830 con 0x7fcd8c09ad40 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd89d9b700 1 -- 172.21.15.125:0/872978625 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c011990 con 0x7fcd8c09ad40 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd89d9b700 1 -- 172.21.15.125:0/872978625 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011d20 con 0x7fcd8c09ad40 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 -- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 msgr2=0x7fcd8c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009920 tx=0x7fcd7c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 -- 172.21.15.125:0/872978625 shutdown_connections 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 --2- 172.21.15.125:0/872978625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c133a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 --2- 172.21.15.125:0/872978625 >> v2:172.21.15.125:3300/0 conn(0x7fcd8c133f70 0x7fcd8c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 -- 172.21.15.125:0/872978625 >> 172.21.15.125:0/872978625 conn(0x7fcd8c099c40 msgr2=0x7fcd8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.506+0000 7fcd9112a700 1 -- 172.21.15.125:0/872978625 shutdown_connections 2023-10-03T10:14:29.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.507+0000 7fcd9112a700 1 -- 172.21.15.125:0/872978625 wait complete. 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 Processor -- start 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 -- start start 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c11fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8c133f70 0x7fcd8c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c122450 con 0x7fcd8c133f70 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c122630 con 0x7fcd8c0a0a70 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd9112a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c1334a0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd8a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c11fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd8ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39514/0 (socket says 172.21.15.125:39514) 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/836730287 learned_addr learned my addr 172.21.15.125:0/836730287 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.508+0000 7fcd8b59e700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8c133f70 0x7fcd8c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 msgr2=0x7fcd8c11fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c11fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8c133f70 msgr2=0x7fcd8c1c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8c133f70 0x7fcd8c1c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 -- 172.21.15.125:0/836730287 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84009a70 con 0x7fcd8c09ad40 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd8ad9d700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c014040 tx=0x7fcd7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c004450 con 0x7fcd8c09ad40 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c01e070 con 0x7fcd8c09ad40 2023-10-03T10:14:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd800094a0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0038e0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.509+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c009550 con 0x7fcd8c09ad40 2023-10-03T10:14:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.510+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c09c840 con 0x7fcd8c09ad40 2023-10-03T10:14:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.510+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd7c003a40 con 0x7fcd8c09ad40 2023-10-03T10:14:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.511+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd7c040da0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.515+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd7c003cf0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.661+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feb7004f2a0 con 0x7feb7009e870 2023-10-03T10:14:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.661+0000 7feb6cff9700 1 -- 172.21.15.125:0/1663169608 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb60011350 con 0x7feb7009e870 2023-10-03T10:14:29.662 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 msgr2=0x7feb701229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feb6000ebe0 tx=0x7feb6000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 shutdown_connections 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb701343a0 0x7feb70123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb7009e870 0x7feb701229b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 --2- 172.21.15.125:0/1663169608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb7009f180 0x7feb70122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 >> 172.21.15.125:0/1663169608 conn(0x7feb700a4430 msgr2=0x7feb70071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 shutdown_connections 2023-10-03T10:14:29.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.663+0000 7feb7692f700 1 -- 172.21.15.125:0/1663169608 wait complete. 2023-10-03T10:14:29.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:29.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.704+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd8c04f2a0 con 0x7fcd8c09ad40 2023-10-03T10:14:29.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.704+0000 7fcd737fe700 1 -- 172.21.15.125:0/836730287 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd7c015020 con 0x7fcd8c09ad40 2023-10-03T10:14:29.704 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 msgr2=0x7fcd8c11f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c014040 tx=0x7fcd7c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 shutdown_connections 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8c133f70 0x7fcd8c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcd8c09ad40 0x7fcd8c11f570 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 --2- 172.21.15.125:0/836730287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd8c0a0a70 0x7fcd8c11fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 >> 172.21.15.125:0/836730287 conn(0x7fcd8c099c40 msgr2=0x7fcd8c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 shutdown_connections 2023-10-03T10:14:29.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.706+0000 7fcd9112a700 1 -- 172.21.15.125:0/836730287 wait complete. 2023-10-03T10:14:29.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:29.791 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:29.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:29.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 Processor -- start 2023-10-03T10:14:29.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 -- start start 2023-10-03T10:14:29.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a50134120 0x7f2a5013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5009dc00 con 0x7f2a500a1380 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5009ea90 con 0x7f2a500a0a70 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a56e4d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5009dec0 con 0x7f2a50134120 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.917+0000 7f2a54be9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38042/0 (socket says 172.21.15.125:38042) 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 -- 172.21.15.125:0/3944876620 learned_addr learned my addr 172.21.15.125:0/3944876620 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a553ea700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a50134120 0x7f2a5013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 -- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a50134120 msgr2=0x7f2a5013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a50134120 0x7f2a5013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 -- 172.21.15.125:0/3944876620 >> v1:172.21.15.125:6789/0 conn(0x7f2a500a1380 legacy=0x7f2a50133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 -- 172.21.15.125:0/3944876620 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5009e6a0 con 0x7f2a500a0a70 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a4f7fe700 1 -- 172.21.15.125:0/3944876620 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804191788 0 0) 0x7f2a5009dc00 con 0x7f2a500a1380 2023-10-03T10:14:29.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a54be9700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2a440098f0 tx=0x7f2a44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac7e717890b3702 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a4f7fe700 1 -- 172.21.15.125:0/3944876620 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011830 con 0x7f2a500a0a70 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a4f7fe700 1 -- 172.21.15.125:0/3944876620 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44011990 con 0x7f2a500a0a70 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.918+0000 7f2a4f7fe700 1 -- 172.21.15.125:0/3944876620 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011d20 con 0x7f2a500a0a70 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 -- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a500a0a70 msgr2=0x7f2a500a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2a440098f0 tx=0x7f2a44009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 -- 172.21.15.125:0/3944876620 shutdown_connections 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a50134120 0x7f2a5013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/3944876620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 -- 172.21.15.125:0/3944876620 >> 172.21.15.125:0/3944876620 conn(0x7f2a500a6610 msgr2=0x7f2a500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 -- 172.21.15.125:0/3944876620 shutdown_connections 2023-10-03T10:14:29.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.919+0000 7f2a56e4d700 1 -- 172.21.15.125:0/3944876620 wait complete. 2023-10-03T10:14:29.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 Processor -- start 2023-10-03T10:14:29.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 -- start start 2023-10-03T10:14:29.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500a1380 0x7f2a50122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 0x7f2a50123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50124360 con 0x7f2a50134120 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501336a0 con 0x7f2a500a1380 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a56e4d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501332e0 con 0x7f2a500a0a70 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a54be9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.920+0000 7f2a4ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500a1380 0x7f2a50122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39542/0 (socket says 172.21.15.125:39542) 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 -- 172.21.15.125:0/826928314 learned_addr learned my addr 172.21.15.125:0/826928314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a553ea700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 0x7f2a50123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 -- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500a1380 msgr2=0x7f2a50122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500a1380 0x7f2a50122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 -- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 msgr2=0x7f2a50123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 0x7f2a50123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 -- 172.21.15.125:0/826928314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009550 con 0x7f2a500a0a70 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a553ea700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 0x7f2a50123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a54be9700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009c40 tx=0x7f2a44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44004510 con 0x7f2a500a0a70 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440036a0 con 0x7f2a500a0a70 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003a50 con 0x7f2a500a0a70 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a501339e0 con 0x7f2a500a0a70 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.921+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50126a00 con 0x7f2a500a0a70 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.922+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a44021070 con 0x7f2a500a0a70 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.922+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5004f2a0 con 0x7f2a500a0a70 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.922+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a44040b20 con 0x7f2a500a0a70 2023-10-03T10:14:29.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.927+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a44003bb0 con 0x7f2a500a0a70 2023-10-03T10:14:29.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 Processor -- start 2023-10-03T10:14:29.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 -- start start 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 0x7f4b7413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7409e9d0 con 0x7f4b740a0a70 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409dc00 con 0x7f4b740a1550 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b79541700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409dec0 con 0x7f4b74139200 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b727fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b72ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b740a0a70 0x7f4b740a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49230/0 (socket says 172.21.15.125:49230) 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b727fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47412/0 (socket says 172.21.15.125:47412) 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b72ffd700 1 -- 172.21.15.125:0/2576458619 learned_addr learned my addr 172.21.15.125:0/2576458619 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b737fe700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 0x7f4b7413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.960+0000 7f4b71ffb700 1 -- 172.21.15.125:0/2576458619 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50449769 0 0) 0x7f4b7409e9d0 con 0x7f4b740a0a70 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b71ffb700 1 -- 172.21.15.125:0/2576458619 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c0035b0 con 0x7f4b740a0a70 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b727fc700 1 -- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 msgr2=0x7f4b7413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b727fc700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 0x7f4b7413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b727fc700 1 -- 172.21.15.125:0/2576458619 >> v1:172.21.15.125:6789/0 conn(0x7f4b740a0a70 legacy=0x7f4b740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b727fc700 1 -- 172.21.15.125:0/2576458619 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7409e6a0 con 0x7f4b740a1550 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b737fe700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 0x7f4b7413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b727fc700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009870 tx=0x7f4b68009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c63a9bbd4d9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b71ffb700 1 -- 172.21.15.125:0/2576458619 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011830 con 0x7f4b740a1550 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b71ffb700 1 -- 172.21.15.125:0/2576458619 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68011990 con 0x7f4b740a1550 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b71ffb700 1 -- 172.21.15.125:0/2576458619 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011d00 con 0x7f4b740a1550 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 -- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 msgr2=0x7f4b74138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009870 tx=0x7f4b68009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 -- 172.21.15.125:0/2576458619 shutdown_connections 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b74139200 0x7f4b7413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 --2- 172.21.15.125:0/2576458619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b74138cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.961+0000 7f4b79541700 1 -- 172.21.15.125:0/2576458619 >> 172.21.15.125:0/2576458619 conn(0x7f4b740a6610 msgr2=0x7f4b740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.962+0000 7f4b79541700 1 -- 172.21.15.125:0/2576458619 shutdown_connections 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.962+0000 7f4b79541700 1 -- 172.21.15.125:0/2576458619 wait complete. 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.962+0000 7f4b79541700 1 Processor -- start 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 -- start start 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 0x7f4b7411e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b7411ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740a5100 con 0x7f4b74139200 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74122370 con 0x7f4b740a1550 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b79541700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74121a10 con 0x7f4b740a0a70 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 0x7f4b7411e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38054/0 (socket says 172.21.15.125:38054) 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b737fe700 1 -- 172.21.15.125:0/3338905912 learned_addr learned my addr 172.21.15.125:0/3338905912 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b727fc700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b7411ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 -- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 msgr2=0x7f4b7411ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b7411ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 -- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 msgr2=0x7f4b7411f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b72ffd700 1 -- 172.21.15.125:0/3338905912 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c009a70 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.963+0000 7f4b737fe700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b72ffd700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 0x7f4b7411e740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c4c0 tx=0x7f4b6400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64005d70 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b640070d0 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680094a0 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64007440 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.964+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b74121d20 con 0x7f4b740a0a70 2023-10-03T10:14:29.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.965+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7404f2a0 con 0x7f4b740a0a70 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.965+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b640075a0 con 0x7f4b740a0a70 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.965+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b6403ef00 con 0x7f4b740a0a70 2023-10-03T10:14:29.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:29.974+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b6401bb10 con 0x7f4b740a0a70 2023-10-03T10:14:30.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.129+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a50125eb0 con 0x7f2a500a0a70 2023-10-03T10:14:30.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.129+0000 7f2a4d7fa700 1 -- 172.21.15.125:0/826928314 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a44029030 con 0x7f2a500a0a70 2023-10-03T10:14:30.130 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 msgr2=0x7f2a501227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009c40 tx=0x7f2a44004750 comp rx=0 tx=0).stop 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 shutdown_connections 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50134120 0x7f2a50123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a500a0a70 0x7f2a501227e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 --2- 172.21.15.125:0/826928314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500a1380 0x7f2a50122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 >> 172.21.15.125:0/826928314 conn(0x7f2a500a6610 msgr2=0x7f2a5009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 shutdown_connections 2023-10-03T10:14:30.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.131+0000 7f2a56e4d700 1 -- 172.21.15.125:0/826928314 wait complete. 2023-10-03T10:14:30.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:30.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.168+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b74120b40 con 0x7f4b740a0a70 2023-10-03T10:14:30.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.168+0000 7f4b5b7fe700 1 -- 172.21.15.125:0/3338905912 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b64017020 con 0x7f4b740a0a70 2023-10-03T10:14:30.169 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 msgr2=0x7f4b7411e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 0x7f4b7411e740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c4c0 tx=0x7f4b6400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 shutdown_connections 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b74139200 0x7f4b7411f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b740a0a70 0x7f4b7411e740 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 --2- 172.21.15.125:0/3338905912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b740a1550 0x7f4b7411ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.170+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 >> 172.21.15.125:0/3338905912 conn(0x7f4b740a6610 msgr2=0x7f4b740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.171+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 shutdown_connections 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.171+0000 7f4b79541700 1 -- 172.21.15.125:0/3338905912 wait complete. 2023-10-03T10:14:30.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:30.677 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:30.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.802+0000 7fecbd2fa700 1 Processor -- start 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.802+0000 7fecbd2fa700 1 -- start start 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecbd2fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecbd2fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecbd2fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb809c970 con 0x7fecb8131d70 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecbd2fa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80a0920 con 0x7fecb809f180 2023-10-03T10:14:30.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecbd2fa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb809f9c0 con 0x7fecb809e870 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39566/0 (socket says 172.21.15.125:39566) 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38056/0 (socket says 172.21.15.125:38056) 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 -- 172.21.15.125:0/406279442 learned_addr learned my addr 172.21.15.125:0/406279442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fecb8131d70 0x7fecb8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49242/0 (socket says 172.21.15.125:49242) 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb5ffb700 1 -- 172.21.15.125:0/406279442 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379539591 0 0) 0x7fecb809c970 con 0x7fecb8131d70 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb5ffb700 1 -- 172.21.15.125:0/406279442 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca00035b0 con 0x7fecb8131d70 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 -- 172.21.15.125:0/406279442 >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 msgr2=0x7fecb8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 --2- 172.21.15.125:0/406279442 >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 -- 172.21.15.125:0/406279442 >> v1:172.21.15.125:6789/0 conn(0x7fecb8131d70 legacy=0x7fecb8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb6ffd700 1 -- 172.21.15.125:0/406279442 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb809bab0 con 0x7fecb809e870 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.803+0000 7fecb67fc700 1 --2- 172.21.15.125:0/406279442 >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecb6ffd700 1 --2- 172.21.15.125:0/406279442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feca80098f0 tx=0x7feca8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2100cd31f33c49f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecb5ffb700 1 -- 172.21.15.125:0/406279442 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011830 con 0x7fecb809e870 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecb5ffb700 1 -- 172.21.15.125:0/406279442 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca8011990 con 0x7fecb809e870 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecb5ffb700 1 -- 172.21.15.125:0/406279442 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011d20 con 0x7fecb809e870 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 -- 172.21.15.125:0/406279442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 msgr2=0x7fecb809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/406279442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feca80098f0 tx=0x7feca8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 -- 172.21.15.125:0/406279442 shutdown_connections 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/406279442 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb809e870 0x7fecb809ec40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/406279442 >> v2:172.21.15.125:3300/0 conn(0x7fecb809f180 0x7fecb8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 -- 172.21.15.125:0/406279442 >> 172.21.15.125:0/406279442 conn(0x7fecb80a4430 msgr2=0x7fecb80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 -- 172.21.15.125:0/406279442 shutdown_connections 2023-10-03T10:14:30.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.804+0000 7fecbd2fa700 1 -- 172.21.15.125:0/406279442 wait complete. 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.805+0000 7fecbd2fa700 1 Processor -- start 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.805+0000 7fecbd2fa700 1 -- start start 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 0x7fecb81202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 0x7fecb8120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb81227b0 con 0x7fecb809e870 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb809b160 con 0x7fecb809f180 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecbd2fa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8123df0 con 0x7fecb8131d70 2023-10-03T10:14:30.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 0x7fecb81202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 0x7fecb81202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38060/0 (socket says 172.21.15.125:38060) 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39582/0 (socket says 172.21.15.125:39582) 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb6ffd700 1 -- 172.21.15.125:0/1826991322 learned_addr learned my addr 172.21.15.125:0/1826991322 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 0x7fecb8120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 -- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 msgr2=0x7fecb8120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 -- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 msgr2=0x7fecb81202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 0x7fecb81202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb67fc700 1 -- 172.21.15.125:0/1826991322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0094a0 con 0x7fecb809f180 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.806+0000 7fecb77fe700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fecb67fc700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 0x7fecb8120810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fecac00e980 tx=0x7fecac00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00c690 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00c7f0 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca8009550 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00cb80 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.807+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb8122d00 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.808+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb811d580 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.808+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecac00cce0 con 0x7fecb809f180 2023-10-03T10:14:30.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.808+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecac03f720 con 0x7fecb809f180 2023-10-03T10:14:30.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.816+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecac0232f0 con 0x7fecb809f180 2023-10-03T10:14:30.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.848+0000 7f10fe32d700 1 Processor -- start 2023-10-03T10:14:30.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.848+0000 7f10fe32d700 1 -- start start 2023-10-03T10:14:30.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10fe32d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 0x7f10f809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10fe32d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10fe32d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f809c970 con 0x7f10f8131d70 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10fe32d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80a0920 con 0x7f10f809e870 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10fe32d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f809f9c0 con 0x7f10f809f180 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39592/0 (socket says 172.21.15.125:39592) 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 -- 172.21.15.125:0/907349878 learned_addr learned my addr 172.21.15.125:0/907349878 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f7fff700 1 --2- 172.21.15.125:0/907349878 >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 0x7f10f809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 -- 172.21.15.125:0/907349878 >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 msgr2=0x7f10f809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 --2- 172.21.15.125:0/907349878 >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 0x7f10f809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 -- 172.21.15.125:0/907349878 >> v1:172.21.15.125:6789/0 conn(0x7f10f8131d70 legacy=0x7f10f8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 -- 172.21.15.125:0/907349878 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f809bab0 con 0x7f10f809f180 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f6ffd700 1 -- 172.21.15.125:0/907349878 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068461728 0 0) 0x7f10f809c970 con 0x7f10f8131d70 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f7fff700 1 --2- 172.21.15.125:0/907349878 >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 0x7f10f809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f77fe700 1 --2- 172.21.15.125:0/907349878 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0098f0 tx=0x7f10ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766b7ffb3d9272ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.849+0000 7f10f6ffd700 1 -- 172.21.15.125:0/907349878 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011830 con 0x7f10f809f180 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10f6ffd700 1 -- 172.21.15.125:0/907349878 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec011990 con 0x7f10f809f180 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10f6ffd700 1 -- 172.21.15.125:0/907349878 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011d20 con 0x7f10f809f180 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 -- 172.21.15.125:0/907349878 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 msgr2=0x7f10f8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 --2- 172.21.15.125:0/907349878 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0098f0 tx=0x7f10ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 -- 172.21.15.125:0/907349878 shutdown_connections 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 --2- 172.21.15.125:0/907349878 >> v2:172.21.15.125:3300/0 conn(0x7f10f809e870 0x7f10f809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 --2- 172.21.15.125:0/907349878 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809f180 0x7f10f8131830 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 -- 172.21.15.125:0/907349878 >> 172.21.15.125:0/907349878 conn(0x7f10f80a4430 msgr2=0x7f10f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 -- 172.21.15.125:0/907349878 shutdown_connections 2023-10-03T10:14:30.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.850+0000 7f10fe32d700 1 -- 172.21.15.125:0/907349878 wait complete. 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.851+0000 7f10fe32d700 1 Processor -- start 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.851+0000 7f10fe32d700 1 -- start start 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f809f180 0x7f10f811f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 0x7f10f811fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8121da0 con 0x7f10f809f180 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8122db0 con 0x7f10f8131d70 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81228a0 con 0x7f10f809e870 2023-10-03T10:14:30.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39596/0 (socket says 172.21.15.125:39596) 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fc8ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 0x7f10f811fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 -- 172.21.15.125:0/298410291 learned_addr learned my addr 172.21.15.125:0/298410291 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f77fe700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f809f180 0x7f10f811f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 -- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 msgr2=0x7f10f811fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 0x7f10f811fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 -- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f809f180 msgr2=0x7f10f811f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f809f180 0x7f10f811f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 -- 172.21.15.125:0/298410291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80094a0 con 0x7f10f809e870 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fc8ca700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 0x7f10f811fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f7fff700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ec10 tx=0x7f10e800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8009760 con 0x7f10f809e870 2023-10-03T10:14:30.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800c850 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec009550 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.852+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800cbe0 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.853+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8130660 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.854+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f811be60 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.854+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e800cd40 con 0x7f10f809e870 2023-10-03T10:14:30.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.854+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10e8040000 con 0x7f10f809e870 2023-10-03T10:14:30.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:30.858+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e8011350 con 0x7f10f809e870 2023-10-03T10:14:31.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.013+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fecb804f2a0 con 0x7fecb809f180 2023-10-03T10:14:31.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.013+0000 7fec9f7fe700 1 -- 172.21.15.125:0/1826991322 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecac017070 con 0x7fecb809f180 2023-10-03T10:14:31.014 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:31.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 msgr2=0x7fecb8120810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 0x7fecb8120810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fecac00e980 tx=0x7fecac00ec90 comp rx=0 tx=0).stop 2023-10-03T10:14:31.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 shutdown_connections 2023-10-03T10:14:31.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fecb8131d70 0x7fecb8120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb809e870 0x7fecb81202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 --2- 172.21.15.125:0/1826991322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb809f180 0x7fecb8120810 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 >> 172.21.15.125:0/1826991322 conn(0x7fecb80a4430 msgr2=0x7fecb811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 shutdown_connections 2023-10-03T10:14:31.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.015+0000 7fecbd2fa700 1 -- 172.21.15.125:0/1826991322 wait complete. 2023-10-03T10:14:31.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:31.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.052+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10f809b0e0 con 0x7f10f809e870 2023-10-03T10:14:31.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.052+0000 7f10f4ff9700 1 -- 172.21.15.125:0/298410291 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e8017030 con 0x7f10f809e870 2023-10-03T10:14:31.052 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:31.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 msgr2=0x7f10f811f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ec10 tx=0x7f10e800ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 shutdown_connections 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10f8131d70 0x7f10f811fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10f809e870 0x7f10f811f2e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 --2- 172.21.15.125:0/298410291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f809f180 0x7f10f811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 >> 172.21.15.125:0/298410291 conn(0x7f10f80a4430 msgr2=0x7f10f8131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 shutdown_connections 2023-10-03T10:14:31.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.054+0000 7f10fe32d700 1 -- 172.21.15.125:0/298410291 wait complete. 2023-10-03T10:14:31.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:31.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:31.183 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:31.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.270+0000 7f8629974700 1 Processor -- start 2023-10-03T10:14:31.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.270+0000 7f8629974700 1 -- start start 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8629974700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8629974700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8629974700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862409e9d0 con 0x7f86240a0a70 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8629974700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862409dc00 con 0x7f86240a1550 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8629974700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f862409dec0 con 0x7f8624139200 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8622ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f86240a0a70 0x7f86240a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49260/0 (socket says 172.21.15.125:49260) 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38098/0 (socket says 172.21.15.125:38098) 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8622ffd700 1 -- 172.21.15.125:0/3704846731 learned_addr learned my addr 172.21.15.125:0/3704846731 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 -- 172.21.15.125:0/3704846731 >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 msgr2=0x7f8624138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 --2- 172.21.15.125:0/3704846731 >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 -- 172.21.15.125:0/3704846731 >> v1:172.21.15.125:6789/0 conn(0x7f86240a0a70 legacy=0x7f86240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 -- 172.21.15.125:0/3704846731 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862409e6a0 con 0x7f8624139200 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f8621ffb700 1 -- 172.21.15.125:0/3704846731 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207381527 0 0) 0x7f862409e9d0 con 0x7f86240a0a70 2023-10-03T10:14:31.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86227fc700 1 --2- 172.21.15.125:0/3704846731 >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.271+0000 7f86237fe700 1 --2- 172.21.15.125:0/3704846731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862413b5e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee530ab3628356b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8621ffb700 1 -- 172.21.15.125:0/3704846731 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00e070 con 0x7f8624139200 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8621ffb700 1 -- 172.21.15.125:0/3704846731 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00bb20 con 0x7f8624139200 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8621ffb700 1 -- 172.21.15.125:0/3704846731 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c012430 con 0x7f8624139200 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 -- 172.21.15.125:0/3704846731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 msgr2=0x7f862413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 --2- 172.21.15.125:0/3704846731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862413b5e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 -- 172.21.15.125:0/3704846731 shutdown_connections 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 --2- 172.21.15.125:0/3704846731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862413b5e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 --2- 172.21.15.125:0/3704846731 >> v2:172.21.15.125:3300/0 conn(0x7f86240a1550 0x7f8624138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 -- 172.21.15.125:0/3704846731 >> 172.21.15.125:0/3704846731 conn(0x7f86240a6610 msgr2=0x7f86240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 -- 172.21.15.125:0/3704846731 shutdown_connections 2023-10-03T10:14:31.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.272+0000 7f8629974700 1 -- 172.21.15.125:0/3704846731 wait complete. 2023-10-03T10:14:31.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.273+0000 7f8629974700 1 Processor -- start 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 -- start start 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 0x7f862411ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862411f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240a03e0 con 0x7f86240a1550 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8624121990 con 0x7f86240a0a70 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8629974700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8624121eb0 con 0x7f8624139200 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8622ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f86237fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862411f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f86227fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 0x7f862411ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8622ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47468/0 (socket says 172.21.15.125:47468) 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f86237fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862411f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39606/0 (socket says 172.21.15.125:39606) 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.274+0000 7f8622ffd700 1 -- 172.21.15.125:0/2897513689 learned_addr learned my addr 172.21.15.125:0/2897513689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 -- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 msgr2=0x7f862411f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862411f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 -- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 msgr2=0x7f862411e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 -- 172.21.15.125:0/2897513689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86180094a0 con 0x7f86240a1550 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f8622ffd700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f86227fc700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 0x7f862411ebb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f861800e9b0 tx=0x7f861800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861800ee50 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861800c850 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861800cc00 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c009a70 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.275+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86240a5700 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.276+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8618013470 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.276+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f861803fa70 con 0x7f86240a1550 2023-10-03T10:14:31.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.276+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8624121cf0 con 0x7f86240a1550 2023-10-03T10:14:31.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.281+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8618013720 con 0x7f86240a1550 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 Processor -- start 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 -- start start 2023-10-03T10:14:31.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e30139240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3012dc80 con 0x7f9e3012e100 2023-10-03T10:14:31.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3009d930 con 0x7f9e30134540 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.328+0000 7f9e3741b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3009f7b0 con 0x7f9e30136e60 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e349b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e30139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e351b7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9e3012e100 0x7f9e3012e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49264/0 (socket says 172.21.15.125:49264) 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e351b7700 1 -- 172.21.15.125:0/2908279921 learned_addr learned my addr 172.21.15.125:0/2908279921 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e349b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38108/0 (socket says 172.21.15.125:38108) 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 -- 172.21.15.125:0/2908279921 >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 msgr2=0x7f9e30136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 --2- 172.21.15.125:0/2908279921 >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 -- 172.21.15.125:0/2908279921 >> v1:172.21.15.125:6789/0 conn(0x7f9e3012e100 legacy=0x7f9e3012e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 -- 172.21.15.125:0/2908279921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3009d0f0 con 0x7f9e30136e60 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e349b6700 1 --2- 172.21.15.125:0/2908279921 >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e359b8700 1 --2- 172.21.15.125:0/2908279921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e30139240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009d90 tx=0x7f9e2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985d9d41f28aa2e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e27fff700 1 -- 172.21.15.125:0/2908279921 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800e070 con 0x7f9e30136e60 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e27fff700 1 -- 172.21.15.125:0/2908279921 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800bb20 con 0x7f9e30136e60 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.329+0000 7f9e27fff700 1 -- 172.21.15.125:0/2908279921 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28012430 con 0x7f9e30136e60 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 -- 172.21.15.125:0/2908279921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 msgr2=0x7f9e30139240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 --2- 172.21.15.125:0/2908279921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e30139240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009d90 tx=0x7f9e2800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 -- 172.21.15.125:0/2908279921 shutdown_connections 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 --2- 172.21.15.125:0/2908279921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e30139240 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 --2- 172.21.15.125:0/2908279921 >> v2:172.21.15.125:3300/0 conn(0x7f9e30134540 0x7f9e30136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 -- 172.21.15.125:0/2908279921 >> 172.21.15.125:0/2908279921 conn(0x7f9e300a2ef0 msgr2=0x7f9e300a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 -- 172.21.15.125:0/2908279921 shutdown_connections 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.330+0000 7f9e3741b700 1 -- 172.21.15.125:0/2908279921 wait complete. 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 Processor -- start 2023-10-03T10:14:31.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 -- start start 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 0x7f9e301c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e301c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30070380 con 0x7f9e3012e100 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300722b0 con 0x7f9e30136e60 2023-10-03T10:14:31.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e3741b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30136930 con 0x7f9e30134540 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e351b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e349b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 0x7f9e301c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e359b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e301c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e351b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38116/0 (socket says 172.21.15.125:38116) 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.331+0000 7f9e351b7700 1 -- 172.21.15.125:0/302673188 learned_addr learned my addr 172.21.15.125:0/302673188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 -- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 msgr2=0x7f9e301c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 0x7f9e301c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 -- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 msgr2=0x7f9e301c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e301c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 -- 172.21.15.125:0/302673188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2000d940 con 0x7f9e3012e100 2023-10-03T10:14:31.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e359b8700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e301c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e349b6700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 0x7f9e301c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e351b7700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c480 tx=0x7f9e2c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c005d70 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00ce90 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28009a70 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0072d0 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.332+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30070af0 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.333+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e2c007430 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.333+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e2c03e9e0 con 0x7f9e3012e100 2023-10-03T10:14:31.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.333+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3004f2a0 con 0x7f9e3012e100 2023-10-03T10:14:31.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.338+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e2c01b3b0 con 0x7f9e3012e100 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.513+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8624121b50 con 0x7f86240a1550 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.513+0000 7f860bfff700 1 -- 172.21.15.125:0/2897513689 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8624121b50 con 0x7f86240a1550 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 msgr2=0x7f862411ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 0x7f862411ebb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f861800e9b0 tx=0x7f861800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 shutdown_connections 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8624139200 0x7f862411f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86240a0a70 0x7f862411e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 --2- 172.21.15.125:0/2897513689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86240a1550 0x7f862411ebb0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 >> 172.21.15.125:0/2897513689 conn(0x7f86240a6610 msgr2=0x7f8624136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 shutdown_connections 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.515+0000 7f8629974700 1 -- 172.21.15.125:0/2897513689 wait complete. 2023-10-03T10:14:31.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.548+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e3006c300 con 0x7f9e3012e100 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.548+0000 7f9e25ffb700 1 -- 172.21.15.125:0/302673188 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e2c017020 con 0x7f9e3012e100 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 msgr2=0x7f9e301c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c480 tx=0x7f9e2c00c790 comp rx=0 tx=0).stop 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 shutdown_connections 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e30136e60 0x7f9e301c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e3012e100 0x7f9e301c4030 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 --2- 172.21.15.125:0/302673188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e30134540 0x7f9e301c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 >> 172.21.15.125:0/302673188 conn(0x7f9e300a2ef0 msgr2=0x7f9e30134910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 shutdown_connections 2023-10-03T10:14:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:31.550+0000 7f9e3741b700 1 -- 172.21.15.125:0/302673188 wait complete. 2023-10-03T10:14:31.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:32.028 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:32.067 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:32.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.156+0000 7f09b7760700 1 Processor -- start 2023-10-03T10:14:32.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.156+0000 7f09b7760700 1 -- start start 2023-10-03T10:14:32.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09b00a0a70 0x7f09b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 0x7f09b01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b009e9d0 con 0x7f09b00a0a70 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b009dc00 con 0x7f09b0133f50 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b7760700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b009dec0 con 0x7f09b00a1380 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b4cfb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09b00a0a70 0x7f09b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09b00a0a70 0x7f09b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38124/0 (socket says 172.21.15.125:38124) 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 -- 172.21.15.125:0/2252380535 learned_addr learned my addr 172.21.15.125:0/2252380535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b5cfd700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 0x7f09b01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b4cfb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39620/0 (socket says 172.21.15.125:39620) 2023-10-03T10:14:32.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 -- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 msgr2=0x7f09b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 -- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 msgr2=0x7f09b01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 0x7f09b01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 -- 172.21.15.125:0/2252380535 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b009e6a0 con 0x7f09b00a0a70 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b5cfd700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 0x7f09b01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.157+0000 7f09b54fc700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b00a0a70 0x7f09b00a0e40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0098f0 tx=0x7f09ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8c2d1647989d6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.158+0000 7f09a7fff700 1 -- 172.21.15.125:0/2252380535 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac011830 con 0x7f09b00a0a70 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.158+0000 7f09a7fff700 1 -- 172.21.15.125:0/2252380535 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac011990 con 0x7f09b00a0a70 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.158+0000 7f09a7fff700 1 -- 172.21.15.125:0/2252380535 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac011d20 con 0x7f09b00a0a70 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 -- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b00a0a70 msgr2=0x7f09b00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b00a0a70 0x7f09b00a0e40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0098f0 tx=0x7f09ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 -- 172.21.15.125:0/2252380535 shutdown_connections 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b0133f50 0x7f09b01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b00a0a70 0x7f09b00a0e40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 --2- 172.21.15.125:0/2252380535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 -- 172.21.15.125:0/2252380535 >> 172.21.15.125:0/2252380535 conn(0x7f09b00a6610 msgr2=0x7f09b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 -- 172.21.15.125:0/2252380535 shutdown_connections 2023-10-03T10:14:32.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.159+0000 7f09b7760700 1 -- 172.21.15.125:0/2252380535 wait complete. 2023-10-03T10:14:32.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.160+0000 7f09b7760700 1 Processor -- start 2023-10-03T10:14:32.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.160+0000 7f09b7760700 1 -- start start 2023-10-03T10:14:32.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 0x7f09b0122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0132900 con 0x7f09b0133f50 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0123fd0 con 0x7f09b00a0a70 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0124ab0 con 0x7f09b00a1380 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b54fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b54fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47496/0 (socket says 172.21.15.125:47496) 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 0x7f09b0122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b54fc700 1 -- 172.21.15.125:0/3313218890 learned_addr learned my addr 172.21.15.125:0/3313218890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b4cfb700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 -- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 msgr2=0x7f09b0121ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0121ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 -- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 msgr2=0x7f09b0121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 -- 172.21.15.125:0/3313218890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009a70 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b4cfb700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b54fc700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b5cfd700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 0x7f09b0122000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009e50 tx=0x7f09a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800ca90 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800f040 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800ce50 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.161+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac009550 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.162+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01247e0 con 0x7f09b0133f50 2023-10-03T10:14:32.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.162+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09a8014480 con 0x7f09b0133f50 2023-10-03T10:14:32.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.162+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09a803fc30 con 0x7f09b0133f50 2023-10-03T10:14:32.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.163+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b011e040 con 0x7f09b0133f50 2023-10-03T10:14:32.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.167+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09a8012520 con 0x7f09b0133f50 2023-10-03T10:14:32.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.197+0000 7f87a4e91700 1 Processor -- start 2023-10-03T10:14:32.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 -- start start 2023-10-03T10:14:32.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87a00a0a70 0x7f87a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 0x7f87a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a009dc00 con 0x7f87a0133f50 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a009ea60 con 0x7f87a00a0a70 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f87a4e91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a009dec0 con 0x7f87a00a1380 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87a00a0a70 0x7f87a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 0x7f87a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87a00a0a70 0x7f87a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38132/0 (socket says 172.21.15.125:38132) 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f87a0133f50 0x7f87a013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49274/0 (socket says 172.21.15.125:49274) 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 0x7f87a0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47500/0 (socket says 172.21.15.125:47500) 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.198+0000 7f879e59c700 1 -- 172.21.15.125:0/4257283552 learned_addr learned my addr 172.21.15.125:0/4257283552 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879e59c700 1 -- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 msgr2=0x7f87a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879e59c700 1 --2- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 0x7f87a0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879e59c700 1 -- 172.21.15.125:0/4257283552 >> v1:172.21.15.125:6789/0 conn(0x7f87a0133f50 legacy=0x7f87a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879e59c700 1 -- 172.21.15.125:0/4257283552 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a009e6a0 con 0x7f87a00a0a70 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879d59a700 1 -- 172.21.15.125:0/4257283552 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291153677 0 0) 0x7f87a009dc00 con 0x7f87a0133f50 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879e59c700 1 --2- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a0a70 0x7f87a00a0e40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f87900098f0 tx=0x7f8790009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be50840e36e561d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879d59a700 1 -- 172.21.15.125:0/4257283552 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011830 con 0x7f87a00a0a70 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879d59a700 1 -- 172.21.15.125:0/4257283552 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790011990 con 0x7f87a00a0a70 2023-10-03T10:14:32.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f879d59a700 1 -- 172.21.15.125:0/4257283552 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011d20 con 0x7f87a00a0a70 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f87a4e91700 1 -- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a0a70 msgr2=0x7f87a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.199+0000 7f87a4e91700 1 --2- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a0a70 0x7f87a00a0e40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f87900098f0 tx=0x7f8790009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 -- 172.21.15.125:0/4257283552 shutdown_connections 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 --2- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a0a70 0x7f87a00a0e40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 --2- 172.21.15.125:0/4257283552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a00a1380 0x7f87a0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 -- 172.21.15.125:0/4257283552 >> 172.21.15.125:0/4257283552 conn(0x7f87a00a6610 msgr2=0x7f87a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 -- 172.21.15.125:0/4257283552 shutdown_connections 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.200+0000 7f87a4e91700 1 -- 172.21.15.125:0/4257283552 wait complete. 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 Processor -- start 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 -- start start 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f87a00a0a70 0x7f87a01c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a0133f50 0x7f87a01c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a01209e0 con 0x7f87a00a1380 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a01207f0 con 0x7f87a0133f50 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f87a4e91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a0122700 con 0x7f87a00a0a70 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f879dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f879ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a0133f50 0x7f87a01c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f879dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38140/0 (socket says 172.21.15.125:38140) 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.201+0000 7f879dd9b700 1 -- 172.21.15.125:0/40517563 learned_addr learned my addr 172.21.15.125:0/40517563 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879e59c700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f87a00a0a70 0x7f87a01c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 -- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f87a00a0a70 msgr2=0x7f87a01c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f87a00a0a70 0x7f87a01c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 -- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a0133f50 msgr2=0x7f87a01c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a0133f50 0x7f87a01c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 -- 172.21.15.125:0/40517563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790009550 con 0x7f87a00a1380 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f879dd9b700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f879400e9b0 tx=0x7f879400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ee50 con 0x7f87a00a1380 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400c850 con 0x7f87a00a1380 2023-10-03T10:14:32.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a00a17b0 con 0x7f87a00a1380 2023-10-03T10:14:32.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400cbc0 con 0x7f87a00a1380 2023-10-03T10:14:32.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.202+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a0120fe0 con 0x7f87a00a1380 2023-10-03T10:14:32.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.203+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f879400cd20 con 0x7f87a00a1380 2023-10-03T10:14:32.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.203+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a00a4fd0 con 0x7f87a00a1380 2023-10-03T10:14:32.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.203+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f879403f6f0 con 0x7f87a00a1380 2023-10-03T10:14:32.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.208+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f879401bdd0 con 0x7f87a00a1380 2023-10-03T10:14:32.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.364+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09b00a03e0 con 0x7f09b0133f50 2023-10-03T10:14:32.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.364+0000 7f09a5ffb700 1 -- 172.21.15.125:0/3313218890 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09a8012340 con 0x7f09b0133f50 2023-10-03T10:14:32.365 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:32.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 msgr2=0x7f09b0122000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 0x7f09b0122000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009e50 tx=0x7f09a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 shutdown_connections 2023-10-03T10:14:32.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09b0133f50 0x7f09b0122000 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09b00a0a70 0x7f09b0121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 --2- 172.21.15.125:0/3313218890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09b00a1380 0x7f09b0121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 >> 172.21.15.125:0/3313218890 conn(0x7f09b00a6610 msgr2=0x7f09b01332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 shutdown_connections 2023-10-03T10:14:32.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.366+0000 7f09b7760700 1 -- 172.21.15.125:0/3313218890 wait complete. 2023-10-03T10:14:32.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.404+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87a004f2a0 con 0x7f87a00a1380 2023-10-03T10:14:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.404+0000 7f878effd700 1 -- 172.21.15.125:0/40517563 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8794021070 con 0x7f87a00a1380 2023-10-03T10:14:32.405 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 msgr2=0x7f87a01c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f879400e9b0 tx=0x7f879400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 shutdown_connections 2023-10-03T10:14:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87a0133f50 0x7f87a01c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f87a00a0a70 0x7f87a01c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.406+0000 7f87a4e91700 1 --2- 172.21.15.125:0/40517563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87a00a1380 0x7f87a01c8bb0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.407+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 >> 172.21.15.125:0/40517563 conn(0x7f87a00a6610 msgr2=0x7f87a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.407+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 shutdown_connections 2023-10-03T10:14:32.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.407+0000 7f87a4e91700 1 -- 172.21.15.125:0/40517563 wait complete. 2023-10-03T10:14:32.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:32.529 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:32.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.654+0000 7f540bf28700 1 Processor -- start 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.654+0000 7f540bf28700 1 -- start start 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540bf28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540bf28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540bf28700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540409dc00 con 0x7f54040a1380 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540bf28700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540409ea60 con 0x7f5404134120 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540bf28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540409dec0 con 0x7f54040a0a70 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540a4c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540a4c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38144/0 (socket says 172.21.15.125:38144) 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540a4c5700 1 -- 172.21.15.125:0/1902335744 learned_addr learned my addr 172.21.15.125:0/1902335744 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39644/0 (socket says 172.21.15.125:39644) 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f54094c3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f54040a1380 0x7f5404133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49278/0 (socket says 172.21.15.125:49278) 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 -- 172.21.15.125:0/1902335744 >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 msgr2=0x7f540413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 --2- 172.21.15.125:0/1902335744 >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 -- 172.21.15.125:0/1902335744 >> v1:172.21.15.125:6789/0 conn(0x7f54040a1380 legacy=0x7f5404133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5409cc4700 1 -- 172.21.15.125:0/1902335744 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540409e6a0 con 0x7f54040a0a70 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f540a4c5700 1 --2- 172.21.15.125:0/1902335744 >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.655+0000 7f5408cc2700 1 -- 172.21.15.125:0/1902335744 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044258153 0 0) 0x7f540409dc00 con 0x7f54040a1380 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f5409cc4700 1 --2- 172.21.15.125:0/1902335744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98bcd33ec6b0b56d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f5408cc2700 1 -- 172.21.15.125:0/1902335744 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011830 con 0x7f54040a0a70 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f5408cc2700 1 -- 172.21.15.125:0/1902335744 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400011990 con 0x7f54040a0a70 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f5408cc2700 1 -- 172.21.15.125:0/1902335744 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011d20 con 0x7f54040a0a70 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 -- 172.21.15.125:0/1902335744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 msgr2=0x7f54040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 --2- 172.21.15.125:0/1902335744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 -- 172.21.15.125:0/1902335744 shutdown_connections 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 --2- 172.21.15.125:0/1902335744 >> v2:172.21.15.125:3300/0 conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 --2- 172.21.15.125:0/1902335744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 -- 172.21.15.125:0/1902335744 >> 172.21.15.125:0/1902335744 conn(0x7f54040a6610 msgr2=0x7f54040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.656+0000 7f540bf28700 1 -- 172.21.15.125:0/1902335744 shutdown_connections 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.657+0000 7f540bf28700 1 -- 172.21.15.125:0/1902335744 wait complete. 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 Processor -- start 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 -- start start 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a1380 0x7f5404122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5404133300 con 0x7f5404134120 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5404125aa0 con 0x7f54040a1380 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f540bf28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5404133650 con 0x7f54040a0a70 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f5409cc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f5409cc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39648/0 (socket says 172.21.15.125:39648) 2023-10-03T10:14:32.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.658+0000 7f5409cc4700 1 -- 172.21.15.125:0/1079244206 learned_addr learned my addr 172.21.15.125:0/1079244206 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f540a4c5700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f54094c3700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a1380 0x7f5404122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 -- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a1380 msgr2=0x7f5404122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a1380 0x7f5404122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 -- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 msgr2=0x7f5404123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 -- 172.21.15.125:0/1079244206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009b30 con 0x7f54040a0a70 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f540a4c5700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f5409cc4700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5400009fd0 tx=0x7f5400004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000036a0 con 0x7f54040a0a70 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540001f070 con 0x7f54040a0a70 2023-10-03T10:14:32.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54000094a0 con 0x7f54040a0a70 2023-10-03T10:14:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400003a20 con 0x7f54040a0a70 2023-10-03T10:14:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.659+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5404133990 con 0x7f54040a0a70 2023-10-03T10:14:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.660+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5404125e60 con 0x7f54040a0a70 2023-10-03T10:14:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.660+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5400003b80 con 0x7f54040a0a70 2023-10-03T10:14:32.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.661+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5400021070 con 0x7f54040a0a70 2023-10-03T10:14:32.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.665+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5400003e30 con 0x7f54040a0a70 2023-10-03T10:14:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 Processor -- start 2023-10-03T10:14:32.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 -- start start 2023-10-03T10:14:32.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 0x7f9cc8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc809aaa0 con 0x7f9cc809e170 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc809f870 con 0x7f9cc8130eb0 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccf494700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc809b360 con 0x7f9cc809d860 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccda31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 0x7f9cc8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccd230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccca2f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9cc809e170 0x7f9cc81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49286/0 (socket says 172.21.15.125:49286) 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccda31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 0x7f9cc8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47524/0 (socket says 172.21.15.125:47524) 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccca2f700 1 -- 172.21.15.125:0/1989710777 learned_addr learned my addr 172.21.15.125:0/1989710777 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.709+0000 7f9ccd230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39652/0 (socket says 172.21.15.125:39652) 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9ccd230700 1 -- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 msgr2=0x7f9cc8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9cbffff700 1 -- 172.21.15.125:0/1989710777 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743346629 0 0) 0x7f9cc809aaa0 con 0x7f9cc809e170 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9ccd230700 1 --2- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 0x7f9cc8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9ccd230700 1 -- 172.21.15.125:0/1989710777 >> v1:172.21.15.125:6789/0 conn(0x7f9cc809e170 legacy=0x7f9cc81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9ccd230700 1 -- 172.21.15.125:0/1989710777 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc809b620 con 0x7f9cc809d860 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9ccd230700 1 --2- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400bb10 tx=0x7f9cc400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc306dfa6e4a6c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9cbffff700 1 -- 172.21.15.125:0/1989710777 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400dc70 con 0x7f9cc809d860 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9cbffff700 1 -- 172.21.15.125:0/1989710777 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc400ddd0 con 0x7f9cc809d860 2023-10-03T10:14:32.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.710+0000 7f9cbffff700 1 -- 172.21.15.125:0/1989710777 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4010690 con 0x7f9cc809d860 2023-10-03T10:14:32.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 -- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 msgr2=0x7f9cc809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 --2- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400bb10 tx=0x7f9cc400be20 comp rx=0 tx=0).stop 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 -- 172.21.15.125:0/1989710777 shutdown_connections 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 --2- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc8130eb0 0x7f9cc8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 --2- 172.21.15.125:0/1989710777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc809d860 0x7f9cc809dc30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 -- 172.21.15.125:0/1989710777 >> 172.21.15.125:0/1989710777 conn(0x7f9cc8099c40 msgr2=0x7f9cc80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 -- 172.21.15.125:0/1989710777 shutdown_connections 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.711+0000 7f9ccf494700 1 -- 172.21.15.125:0/1989710777 wait complete. 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 Processor -- start 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 -- start start 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 0x7f9cc811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc8130eb0 0x7f9cc811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8120490 con 0x7f9cc809d860 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80a2190 con 0x7f9cc809e170 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccf494700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc809c8b0 con 0x7f9cc8130eb0 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccd230700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccd230700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38164/0 (socket says 172.21.15.125:38164) 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccd230700 1 -- 172.21.15.125:0/373579881 learned_addr learned my addr 172.21.15.125:0/373579881 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccca2f700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 0x7f9cc811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.712+0000 7f9ccda31700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc8130eb0 0x7f9cc811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 -- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc8130eb0 msgr2=0x7f9cc811ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc8130eb0 0x7f9cc811ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 -- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 msgr2=0x7f9cc811e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 -- 172.21.15.125:0/373579881 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc400b740 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccd230700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccca2f700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 0x7f9cc811e810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9cc809a100 tx=0x7f9cb800c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8004c80 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8004de0 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8007310 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc8121580 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.713+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc8122580 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.714+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cb8007470 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.714+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc8121770 con 0x7f9cc809e170 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.714+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cb803f1a0 con 0x7f9cc809e170 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.719+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cb801bbc0 con 0x7f9cc809e170 2023-10-03T10:14:32.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.871+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f540404f2a0 con 0x7f54040a0a70 2023-10-03T10:14:32.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.871+0000 7f53fa7fc700 1 -- 172.21.15.125:0/1079244206 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5400034090 con 0x7f54040a0a70 2023-10-03T10:14:32.872 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 msgr2=0x7f5404122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5400009fd0 tx=0x7f5400004750 comp rx=0 tx=0).stop 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 shutdown_connections 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f5404122790 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 --2- 172.21.15.125:0/1079244206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a1380 0x7f5404122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 >> 172.21.15.125:0/1079244206 conn(0x7f54040a6610 msgr2=0x7f54040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 shutdown_connections 2023-10-03T10:14:32.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.873+0000 7f540bf28700 1 -- 172.21.15.125:0/1079244206 wait complete. 2023-10-03T10:14:32.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.906+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9cc804f2a0 con 0x7f9cc809e170 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.906+0000 7f9cbdffb700 1 -- 172.21.15.125:0/373579881 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cb801ce50 con 0x7f9cc809e170 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 msgr2=0x7f9cc811e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 0x7f9cc811e810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9cc809a100 tx=0x7f9cb800c750 comp rx=0 tx=0).stop 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 shutdown_connections 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9cc8130eb0 0x7f9cc811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9cc809d860 0x7f9cc811e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 --2- 172.21.15.125:0/373579881 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9cc809e170 0x7f9cc811e810 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 >> 172.21.15.125:0/373579881 conn(0x7f9cc8099c40 msgr2=0x7f9cc80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 shutdown_connections 2023-10-03T10:14:32.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:32.908+0000 7f9ccf494700 1 -- 172.21.15.125:0/373579881 wait complete. 2023-10-03T10:14:32.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:33.380 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:33.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:33.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 Processor -- start 2023-10-03T10:14:33.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 -- start start 2023-10-03T10:14:33.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a0133f70 0x7ff6a01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00a3b60 con 0x7ff6a0133f70 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a01348e0 con 0x7ff6a009ad40 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.508+0000 7ff6a49da700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a009b110 con 0x7ff6a00a0a70 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a0133f70 0x7ff6a01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39672/0 (socket says 172.21.15.125:39672) 2023-10-03T10:14:33.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a0133f70 0x7ff6a01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38176/0 (socket says 172.21.15.125:38176) 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47540/0 (socket says 172.21.15.125:47540) 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69ed9d700 1 -- 172.21.15.125:0/18126086 learned_addr learned my addr 172.21.15.125:0/18126086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 -- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 msgr2=0x7ff6a00a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 -- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 msgr2=0x7ff6a0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 -- 172.21.15.125:0/18126086 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00a2fa0 con 0x7ff6a0133f70 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69ed9d700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69e59c700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a0133f70 0x7ff6a01343a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff694009870 tx=0x7ff694009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2710b2e4d697fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69d59a700 1 -- 172.21.15.125:0/18126086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011830 con 0x7ff6a0133f70 2023-10-03T10:14:33.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69d59a700 1 -- 172.21.15.125:0/18126086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694011990 con 0x7ff6a0133f70 2023-10-03T10:14:33.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.509+0000 7ff69d59a700 1 -- 172.21.15.125:0/18126086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011d20 con 0x7ff6a0133f70 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 -- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a0133f70 msgr2=0x7ff6a01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a0133f70 0x7ff6a01343a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff694009870 tx=0x7ff694009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 -- 172.21.15.125:0/18126086 shutdown_connections 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a009ad40 0x7ff6a0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a00a0a70 0x7ff6a00a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 --2- 172.21.15.125:0/18126086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a0133f70 0x7ff6a01343a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 -- 172.21.15.125:0/18126086 >> 172.21.15.125:0/18126086 conn(0x7ff6a0099c40 msgr2=0x7ff6a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 -- 172.21.15.125:0/18126086 shutdown_connections 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.510+0000 7ff6a49da700 1 -- 172.21.15.125:0/18126086 wait complete. 2023-10-03T10:14:33.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 Processor -- start 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 -- start start 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 0x7ff6a01c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a0133f70 0x7ff6a01c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0121010 con 0x7ff6a00a0a70 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0133890 con 0x7ff6a0133f70 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.511+0000 7ff6a49da700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a009c7e0 con 0x7ff6a009ad40 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 0x7ff6a01c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 0x7ff6a01c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39684/0 (socket says 172.21.15.125:39684) 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a0133f70 0x7ff6a01c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69e59c700 1 -- 172.21.15.125:0/3309174027 learned_addr learned my addr 172.21.15.125:0/3309174027 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38192/0 (socket says 172.21.15.125:38192) 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 -- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 msgr2=0x7ff6a01c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 0x7ff6a01c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 -- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a0133f70 msgr2=0x7ff6a01c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a0133f70 0x7ff6a01c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 -- 172.21.15.125:0/3309174027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900094a0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff69dd9b700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff6a006b550 tx=0x7ff694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004240 con 0x7ff6a00a0a70 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69401f070 con 0x7ff6a00a0a70 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940045a0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff698009b30 con 0x7ff6a00a0a70 2023-10-03T10:14:33.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.512+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940094a0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.513+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff694021030 con 0x7ff6a00a0a70 2023-10-03T10:14:33.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.513+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a004f2a0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.513+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6940404d0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.518+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6940036a0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.548+0000 7fc2bc6a5700 1 Processor -- start 2023-10-03T10:14:33.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.548+0000 7fc2bc6a5700 1 -- start start 2023-10-03T10:14:33.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bc6a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bc6a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 0x7fc2b409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bc6a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b409af80 con 0x7fc2b4133c20 2023-10-03T10:14:33.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bc6a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b409a520 con 0x7fc2b409edb0 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bc6a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b409fe00 con 0x7fc2b409a150 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2ba441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2b9c40700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 0x7fc2b409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bac42700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2b4133c20 0x7fc2b41340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49300/0 (socket says 172.21.15.125:49300) 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2ba441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39696/0 (socket says 172.21.15.125:39696) 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2bac42700 1 -- 172.21.15.125:0/1922669904 learned_addr learned my addr 172.21.15.125:0/1922669904 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2b943f700 1 -- 172.21.15.125:0/1922669904 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981578000 0 0) 0x7fc2b409af80 con 0x7fc2b4133c20 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2b943f700 1 -- 172.21.15.125:0/1922669904 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a00035b0 con 0x7fc2b4133c20 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2b9c40700 1 -- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 msgr2=0x7fc2b409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.549+0000 7fc2b9c40700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b9c40700 1 -- 172.21.15.125:0/1922669904 >> v1:172.21.15.125:6789/0 conn(0x7fc2b4133c20 legacy=0x7fc2b41340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b9c40700 1 -- 172.21.15.125:0/1922669904 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b409f6e0 con 0x7fc2b409edb0 2023-10-03T10:14:33.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2ba441700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b9c40700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 0x7fc2b409f1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40098a0 tx=0x7fc2a4009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f519e31518c772e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b943f700 1 -- 172.21.15.125:0/1922669904 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011830 con 0x7fc2b409edb0 2023-10-03T10:14:33.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b943f700 1 -- 172.21.15.125:0/1922669904 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4011990 con 0x7fc2b409edb0 2023-10-03T10:14:33.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2b943f700 1 -- 172.21.15.125:0/1922669904 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011d20 con 0x7fc2b409edb0 2023-10-03T10:14:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 msgr2=0x7fc2b409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.550+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 0x7fc2b409f1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40098a0 tx=0x7fc2a4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/1922669904 shutdown_connections 2023-10-03T10:14:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409a150 0x7fc2b409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/1922669904 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b409edb0 0x7fc2b409f1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/1922669904 >> 172.21.15.125:0/1922669904 conn(0x7fc2b40a4430 msgr2=0x7fc2b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/1922669904 shutdown_connections 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/1922669904 wait complete. 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 Processor -- start 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.551+0000 7fc2bc6a5700 1 -- start start 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4124ab0 con 0x7fc2b409a150 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40a39f0 con 0x7fc2b4133c20 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bc6a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41250e0 con 0x7fc2b409edb0 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2ba441700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bac42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39704/0 (socket says 172.21.15.125:39704) 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bac42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47556/0 (socket says 172.21.15.125:47556) 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2ba441700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38202/0 (socket says 172.21.15.125:38202) 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 -- 172.21.15.125:0/4041410109 learned_addr learned my addr 172.21.15.125:0/4041410109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 -- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 msgr2=0x7fc2b4123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 -- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 msgr2=0x7fc2b41227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2b9c40700 1 -- 172.21.15.125:0/4041410109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00094a0 con 0x7fc2b409edb0 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2ba441700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.552+0000 7fc2bac42700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2b9c40700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40090b0 tx=0x7fc2a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004240 con 0x7fc2b409edb0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a401f070 con 0x7fc2b409edb0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a40094a0 con 0x7fc2b409edb0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40045e0 con 0x7fc2b409edb0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.553+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b4125ef0 con 0x7fc2b409edb0 2023-10-03T10:14:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.554+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b409fa30 con 0x7fc2b409edb0 2023-10-03T10:14:33.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.554+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2a4021030 con 0x7fc2b409edb0 2023-10-03T10:14:33.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.554+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2a4040c40 con 0x7fc2b409edb0 2023-10-03T10:14:33.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.558+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2a4019d40 con 0x7fc2b409edb0 2023-10-03T10:14:33.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.711+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff6a01225b0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.711+0000 7ff68effd700 1 -- 172.21.15.125:0/3309174027 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6940233d0 con 0x7ff6a00a0a70 2023-10-03T10:14:33.712 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:33.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.713+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 msgr2=0x7ff6a01c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.713+0000 7ff6a49da700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff6a006b550 tx=0x7ff694004750 comp rx=0 tx=0).stop 2023-10-03T10:14:33.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 shutdown_connections 2023-10-03T10:14:33.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6a0133f70 0x7ff6a01c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6a009ad40 0x7ff6a01c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 --2- 172.21.15.125:0/3309174027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a00a0a70 0x7ff6a01c8840 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 >> 172.21.15.125:0/3309174027 conn(0x7ff6a0099c40 msgr2=0x7ff6a009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 shutdown_connections 2023-10-03T10:14:33.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.714+0000 7ff6a49da700 1 -- 172.21.15.125:0/3309174027 wait complete. 2023-10-03T10:14:33.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:33.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.751+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2b409f6e0 con 0x7fc2b409edb0 2023-10-03T10:14:33.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.752+0000 7fc2aaffd700 1 -- 172.21.15.125:0/4041410109 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2b409f6e0 con 0x7fc2b409edb0 2023-10-03T10:14:33.752 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:33.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 msgr2=0x7fc2b4122d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40090b0 tx=0x7fc2a4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 shutdown_connections 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2b4133c20 0x7fc2b4123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b409a150 0x7fc2b41227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 --2- 172.21.15.125:0/4041410109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2b409edb0 0x7fc2b4122d20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 >> 172.21.15.125:0/4041410109 conn(0x7fc2b40a4430 msgr2=0x7fc2b4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 shutdown_connections 2023-10-03T10:14:33.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:33.754+0000 7fc2bc6a5700 1 -- 172.21.15.125:0/4041410109 wait complete. 2023-10-03T10:14:33.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:33.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:33.921 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:34.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.011+0000 7f8fc99a8700 1 Processor -- start 2023-10-03T10:14:34.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.011+0000 7f8fc99a8700 1 -- start start 2023-10-03T10:14:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc99a8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fc4134140 0x7f8fc4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc99a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc99a8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc409b110 con 0x7f8fc409ad40 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc99a8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40a3b60 con 0x7f8fc4134140 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc99a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40a1a80 con 0x7f8fc41345a0 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fc4134140 0x7f8fc4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8fc409ad40 0x7f8fc4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49316/0 (socket says 172.21.15.125:49316) 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fc4134140 0x7f8fc4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38206/0 (socket says 172.21.15.125:38206) 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47566/0 (socket says 172.21.15.125:47566) 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc2ffd700 1 -- 172.21.15.125:0/3979989739 learned_addr learned my addr 172.21.15.125:0/3979989739 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 -- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 msgr2=0x7f8fc413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 -- 172.21.15.125:0/3979989739 >> v1:172.21.15.125:6789/0 conn(0x7f8fc409ad40 legacy=0x7f8fc4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 -- 172.21.15.125:0/3979989739 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40a2fa0 con 0x7f8fc4134140 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc1ffb700 1 -- 172.21.15.125:0/3979989739 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788079391 0 0) 0x7f8fc409b110 con 0x7f8fc409ad40 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc37fe700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.012+0000 7f8fc27fc700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc4138e80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009840 tx=0x7f8fb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3898d3e8909df80f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc1ffb700 1 -- 172.21.15.125:0/3979989739 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8011830 con 0x7f8fc4134140 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc1ffb700 1 -- 172.21.15.125:0/3979989739 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8011990 con 0x7f8fc4134140 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc1ffb700 1 -- 172.21.15.125:0/3979989739 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8011d20 con 0x7f8fc4134140 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 -- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 msgr2=0x7f8fc4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc4138e80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009840 tx=0x7f8fb8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 -- 172.21.15.125:0/3979989739 shutdown_connections 2023-10-03T10:14:34.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc41345a0 0x7f8fc413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/3979989739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc4138e80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 -- 172.21.15.125:0/3979989739 >> 172.21.15.125:0/3979989739 conn(0x7f8fc4099c40 msgr2=0x7f8fc406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 -- 172.21.15.125:0/3979989739 shutdown_connections 2023-10-03T10:14:34.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.013+0000 7f8fc99a8700 1 -- 172.21.15.125:0/3979989739 wait complete. 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.014+0000 7f8fc99a8700 1 Processor -- start 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 -- start start 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 0x7f8fc411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc411edf0 con 0x7f8fc4134140 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc413a980 con 0x7f8fc409ad40 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc99a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc411e1c0 con 0x7f8fc41345a0 2023-10-03T10:14:34.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47576/0 (socket says 172.21.15.125:47576) 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc2ffd700 1 -- 172.21.15.125:0/54070693 learned_addr learned my addr 172.21.15.125:0/54070693 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc37fe700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 0x7f8fc411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.015+0000 7f8fc27fc700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 -- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 msgr2=0x7f8fc411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 -- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 msgr2=0x7f8fc411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 -- 172.21.15.125:0/54070693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009a70 con 0x7f8fc41345a0 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc2ffd700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc27fc700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc37fe700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 0x7f8fc411d340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009e50 tx=0x7f8fbc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00ca90 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00f040 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb80094a0 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00ce50 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.016+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc4133710 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.017+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fbc014480 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.017+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fbc03fc10 con 0x7f8fc41345a0 2023-10-03T10:14:34.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.017+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc411e7b0 con 0x7f8fc41345a0 2023-10-03T10:14:34.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.022+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fc411e7b0 con 0x7f8fc41345a0 2023-10-03T10:14:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 Processor -- start 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 -- start start 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 0x7f218c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c09a540 con 0x7f218c1307c0 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c09ad40 con 0x7f218c099920 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f2193441700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f218c09e640 con 0x7f218c12feb0 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21919de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21909dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21911dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 0x7f218c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21909dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38210/0 (socket says 172.21.15.125:38210) 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21919de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47586/0 (socket says 172.21.15.125:47586) 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.055+0000 7f21909dc700 1 -- 172.21.15.125:0/3216757288 learned_addr learned my addr 172.21.15.125:0/3216757288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 -- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 msgr2=0x7f218c130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 0x7f218c130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 -- 172.21.15.125:0/3216757288 >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 msgr2=0x7f218c0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 --2- 172.21.15.125:0/3216757288 >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 -- 172.21.15.125:0/3216757288 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c09e3c0 con 0x7f218c099920 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21911dd700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 0x7f218c130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21909dc700 1 --2- 172.21.15.125:0/3216757288 >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f21919de700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f217c009840 tx=0x7f217c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4865d08f0728c732 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f218bfff700 1 -- 172.21.15.125:0/3216757288 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c010a90 con 0x7f218c099920 2023-10-03T10:14:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f218bfff700 1 -- 172.21.15.125:0/3216757288 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c010bf0 con 0x7f218c099920 2023-10-03T10:14:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.056+0000 7f218bfff700 1 -- 172.21.15.125:0/3216757288 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c018440 con 0x7f218c099920 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 -- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 msgr2=0x7f218c099dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f217c009840 tx=0x7f217c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 -- 172.21.15.125:0/3216757288 shutdown_connections 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c099dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 --2- 172.21.15.125:0/3216757288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c12feb0 0x7f218c130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 --2- 172.21.15.125:0/3216757288 >> v2:172.21.15.125:3300/0 conn(0x7f218c1307c0 0x7f218c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 -- 172.21.15.125:0/3216757288 >> 172.21.15.125:0/3216757288 conn(0x7f218c0a2b30 msgr2=0x7f218c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 -- 172.21.15.125:0/3216757288 shutdown_connections 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.057+0000 7f2193441700 1 -- 172.21.15.125:0/3216757288 wait complete. 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.058+0000 7f2193441700 1 Processor -- start 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.058+0000 7f2193441700 1 -- start start 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c128d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f218c12feb0 0x7f218c129260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c06e670 con 0x7f218c12feb0 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c12a200 con 0x7f218c099920 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f2193441700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f218c06d7e0 con 0x7f218c1307c0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21911dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c128d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39736/0 (socket says 172.21.15.125:39736) 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 -- 172.21.15.125:0/1195328433 learned_addr learned my addr 172.21.15.125:0/1195328433 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21909dc700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f218c12feb0 0x7f218c129260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 -- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 msgr2=0x7f218c128d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c128d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 -- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f218c12feb0 msgr2=0x7f218c129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f218c12feb0 0x7f218c129260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.059+0000 7f21919de700 1 -- 172.21.15.125:0/1195328433 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184009a70 con 0x7f218c1307c0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f21919de700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f217c0090b0 tx=0x7f217c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c003ab0 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c003c30 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218000b7f0 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c018640 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.060+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c0094a0 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.061+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f217c01f070 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.061+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c04f2a0 con 0x7f218c1307c0 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.061+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f217c044fd0 con 0x7f218c1307c0 2023-10-03T10:14:34.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.065+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f217c01d070 con 0x7f218c1307c0 2023-10-03T10:14:34.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.216+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8fc411e7b0 con 0x7f8fc41345a0 2023-10-03T10:14:34.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.216+0000 7f8fabfff700 1 -- 172.21.15.125:0/54070693 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fc411e7b0 con 0x7f8fc41345a0 2023-10-03T10:14:34.217 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 msgr2=0x7f8fc411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 0x7f8fc411d340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009e50 tx=0x7f8fbc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 shutdown_connections 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8fc41345a0 0x7f8fc411d340 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8fc409ad40 0x7f8fc411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 --2- 172.21.15.125:0/54070693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fc4134140 0x7f8fc411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 >> 172.21.15.125:0/54070693 conn(0x7f8fc4099c40 msgr2=0x7f8fc409b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.218+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 shutdown_connections 2023-10-03T10:14:34.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.219+0000 7f8fc99a8700 1 -- 172.21.15.125:0/54070693 wait complete. 2023-10-03T10:14:34.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.261+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f218c06ad40 con 0x7f218c1307c0 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.261+0000 7f2189ffb700 1 -- 172.21.15.125:0/1195328433 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f218c06ad40 con 0x7f218c1307c0 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 msgr2=0x7f218c1c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f217c0090b0 tx=0x7f217c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 shutdown_connections 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218c1307c0 0x7f218c1c4150 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218c099920 0x7f218c128d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 --2- 172.21.15.125:0/1195328433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f218c12feb0 0x7f218c129260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 >> 172.21.15.125:0/1195328433 conn(0x7f218c0a2b30 msgr2=0x7f218c12c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 shutdown_connections 2023-10-03T10:14:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.263+0000 7f2193441700 1 -- 172.21.15.125:0/1195328433 wait complete. 2023-10-03T10:14:34.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:34.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:34.767 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 Processor -- start 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 -- start start 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 0x7fee4c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0a3b60 con 0x7fee4c09ad40 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1348e0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee5249c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c09b110 con 0x7fee4c133f70 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee4b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee4bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee4bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38220/0 (socket says 172.21.15.125:38220) 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee4b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39746/0 (socket says 172.21.15.125:39746) 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee4bfff700 1 -- 172.21.15.125:0/112153159 learned_addr learned my addr 172.21.15.125:0/112153159 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.854+0000 7fee50a39700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 0x7fee4c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 -- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 msgr2=0x7fee4c0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 0x7fee4c0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 -- 172.21.15.125:0/112153159 >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 msgr2=0x7fee4c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/112153159 >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 -- 172.21.15.125:0/112153159 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0a2fa0 con 0x7fee4c133f70 2023-10-03T10:14:34.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4bfff700 1 --2- 172.21.15.125:0/112153159 >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee50a39700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 0x7fee4c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fee40009870 tx=0x7fee40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd924d1629bf9ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4affd700 1 -- 172.21.15.125:0/112153159 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40011830 con 0x7fee4c133f70 2023-10-03T10:14:34.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4affd700 1 -- 172.21.15.125:0/112153159 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee40011990 con 0x7fee4c133f70 2023-10-03T10:14:34.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.855+0000 7fee4affd700 1 -- 172.21.15.125:0/112153159 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40011d20 con 0x7fee4c133f70 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 -- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 msgr2=0x7fee4c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fee40009870 tx=0x7fee40009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 -- 172.21.15.125:0/112153159 shutdown_connections 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c0a0a70 0x7fee4c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 --2- 172.21.15.125:0/112153159 >> v2:172.21.15.125:3300/0 conn(0x7fee4c09ad40 0x7fee4c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 --2- 172.21.15.125:0/112153159 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c133f70 0x7fee4c1343a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 -- 172.21.15.125:0/112153159 >> 172.21.15.125:0/112153159 conn(0x7fee4c099c40 msgr2=0x7fee4c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 -- 172.21.15.125:0/112153159 shutdown_connections 2023-10-03T10:14:34.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.856+0000 7fee5249c700 1 -- 172.21.15.125:0/112153159 wait complete. 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 Processor -- start 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 -- start start 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 0x7fee4c1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 0x7fee4c122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1237a0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c125130 con 0x7fee4c133f70 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee5249c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c124060 con 0x7fee4c09ad40 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee4b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee4bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 0x7fee4c1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee4b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38234/0 (socket says 172.21.15.125:38234) 2023-10-03T10:14:34.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee4b7fe700 1 -- 172.21.15.125:0/3782800343 learned_addr learned my addr 172.21.15.125:0/3782800343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.857+0000 7fee50a39700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 0x7fee4c122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 -- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 msgr2=0x7fee4c1222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 0x7fee4c1222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 -- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 msgr2=0x7fee4c122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 0x7fee4c122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 -- 172.21.15.125:0/3782800343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009550 con 0x7fee4c0a0a70 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4bfff700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 0x7fee4c1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee50a39700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 0x7fee4c122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee4b7fe700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fee400097c0 tx=0x7fee40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee400044d0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee400036a0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee44009a70 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40003a10 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.858+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400094a0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.859+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee40003b70 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.859+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c09c7e0 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.859+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee40040550 con 0x7fee4c0a0a70 2023-10-03T10:14:34.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.864+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee4002b770 con 0x7fee4c0a0a70 2023-10-03T10:14:34.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.896+0000 7f6bb8dbd700 1 Processor -- start 2023-10-03T10:14:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.896+0000 7f6bb8dbd700 1 -- start start 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb8dbd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bb40a0a70 0x7f6bb40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb8dbd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb8dbd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb409dc00 con 0x7f6bb40a1380 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb8dbd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb409ea90 con 0x7f6bb40a0a70 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb8dbd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb409dec0 con 0x7f6bb4134120 2023-10-03T10:14:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bb40a0a70 0x7f6bb40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bb40a0a70 0x7f6bb40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38248/0 (socket says 172.21.15.125:38248) 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39768/0 (socket says 172.21.15.125:39768) 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb1d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6bb40a1380 0x7f6bb4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49320/0 (socket says 172.21.15.125:49320) 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 -- 172.21.15.125:0/4056455738 learned_addr learned my addr 172.21.15.125:0/4056455738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 -- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 msgr2=0x7f6bb413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 -- 172.21.15.125:0/4056455738 >> v1:172.21.15.125:6789/0 conn(0x7f6bb40a1380 legacy=0x7f6bb4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 -- 172.21.15.125:0/4056455738 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb409e6a0 con 0x7f6bb40a0a70 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb2d9d700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.897+0000 7f6bb259c700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb40a0a70 0x7f6bb40a0e40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40098f0 tx=0x7f6ba4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15674514086bb47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb159a700 1 -- 172.21.15.125:0/4056455738 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011830 con 0x7f6bb40a0a70 2023-10-03T10:14:34.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb159a700 1 -- 172.21.15.125:0/4056455738 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011990 con 0x7f6bb40a0a70 2023-10-03T10:14:34.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb159a700 1 -- 172.21.15.125:0/4056455738 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011d20 con 0x7f6bb40a0a70 2023-10-03T10:14:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb40a0a70 msgr2=0x7f6bb40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb40a0a70 0x7f6bb40a0e40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40098f0 tx=0x7f6ba4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/4056455738 shutdown_connections 2023-10-03T10:14:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb4134120 0x7f6bb413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/4056455738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb40a0a70 0x7f6bb40a0e40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/4056455738 >> 172.21.15.125:0/4056455738 conn(0x7f6bb40a6610 msgr2=0x7f6bb40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/4056455738 shutdown_connections 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.898+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/4056455738 wait complete. 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.899+0000 7f6bb8dbd700 1 Processor -- start 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.899+0000 7f6bb8dbd700 1 -- start start 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 0x7f6bb4123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 0x7f6bb41c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4133aa0 con 0x7f6bb4134120 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40a03e0 con 0x7f6bb40a1380 2023-10-03T10:14:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb8dbd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4125300 con 0x7f6bb40a0a70 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:39776/0 (socket says 172.21.15.125:39776) 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 0x7f6bb4123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 -- 172.21.15.125:0/3847638155 learned_addr learned my addr 172.21.15.125:0/3847638155 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb2d9d700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 0x7f6bb41c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 -- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 msgr2=0x7f6bb4123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 0x7f6bb4123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 -- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 msgr2=0x7f6bb41c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 0x7f6bb41c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 -- 172.21.15.125:0/3847638155 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009a70 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb2d9d700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 0x7f6bb41c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb1d9b700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 0x7f6bb4123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.900+0000 7f6bb259c700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40043c0 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba401f070 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba4009550 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40038c0 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4126d30 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.901+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ba4021030 con 0x7f6bb40a0a70 2023-10-03T10:14:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.902+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ba4040920 con 0x7f6bb40a0a70 2023-10-03T10:14:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.902+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb409c8f0 con 0x7f6bb40a0a70 2023-10-03T10:14:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:34.906+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ba4015080 con 0x7f6bb40a0a70 2023-10-03T10:14:35.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.058+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee4c04f2a0 con 0x7fee4c0a0a70 2023-10-03T10:14:35.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.059+0000 7fee48ff9700 1 -- 172.21.15.125:0/3782800343 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee40028070 con 0x7fee4c0a0a70 2023-10-03T10:14:35.059 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:35.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.060+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 msgr2=0x7fee4c122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.060+0000 7fee5249c700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fee400097c0 tx=0x7fee40004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 shutdown_connections 2023-10-03T10:14:35.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee4c133f70 0x7fee4c122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee4c09ad40 0x7fee4c1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 --2- 172.21.15.125:0/3782800343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee4c0a0a70 0x7fee4c122810 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 >> 172.21.15.125:0/3782800343 conn(0x7fee4c099c40 msgr2=0x7fee4c0a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 shutdown_connections 2023-10-03T10:14:35.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.061+0000 7fee5249c700 1 -- 172.21.15.125:0/3782800343 wait complete. 2023-10-03T10:14:35.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.098+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bb404f2a0 con 0x7f6bb40a0a70 2023-10-03T10:14:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.099+0000 7f6ba2ffd700 1 -- 172.21.15.125:0/3847638155 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ba4004560 con 0x7f6bb40a0a70 2023-10-03T10:14:35.099 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 msgr2=0x7f6bb4123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 shutdown_connections 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4134120 0x7f6bb41c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bb40a0a70 0x7f6bb4123350 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 --2- 172.21.15.125:0/3847638155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40a1380 0x7f6bb4123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 >> 172.21.15.125:0/3847638155 conn(0x7f6bb40a6610 msgr2=0x7f6bb40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 shutdown_connections 2023-10-03T10:14:35.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.101+0000 7f6bb8dbd700 1 -- 172.21.15.125:0/3847638155 wait complete. 2023-10-03T10:14:35.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:35.232 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:35.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 Processor -- start 2023-10-03T10:14:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 -- start start 2023-10-03T10:14:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c900a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c90133f50 0x7f3c901343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9009e9d0 con 0x7f3c90133f50 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9009dc00 con 0x7f3c900a0a70 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c964af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9009dec0 con 0x7f3c900a1380 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c8f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.358+0000 7f3c94a4c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c90133f50 0x7f3c901343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c90133f50 0x7f3c901343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60852/0 (socket says 172.21.15.125:60852) 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57562/0 (socket says 172.21.15.125:57562) 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c900a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8f7fe700 1 -- 172.21.15.125:0/960314119 learned_addr learned my addr 172.21.15.125:0/960314119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 -- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 msgr2=0x7f3c90133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 -- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 msgr2=0x7f3c900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c900a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 -- 172.21.15.125:0/960314119 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9009e6a0 con 0x7f3c90133f50 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8f7fe700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8ffff700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c90133f50 0x7f3c901343f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009d90 tx=0x7f3c8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58d7deb42585def server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8effd700 1 -- 172.21.15.125:0/960314119 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800e070 con 0x7f3c90133f50 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8effd700 1 -- 172.21.15.125:0/960314119 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800bb20 con 0x7f3c90133f50 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.359+0000 7f3c8effd700 1 -- 172.21.15.125:0/960314119 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88012430 con 0x7f3c90133f50 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 -- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c90133f50 msgr2=0x7f3c901343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c90133f50 0x7f3c901343f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009d90 tx=0x7f3c8800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 -- 172.21.15.125:0/960314119 shutdown_connections 2023-10-03T10:14:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c90133f50 0x7f3c901343f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 --2- 172.21.15.125:0/960314119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c900a1380 0x7f3c90133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 -- 172.21.15.125:0/960314119 >> 172.21.15.125:0/960314119 conn(0x7f3c900a6610 msgr2=0x7f3c900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 -- 172.21.15.125:0/960314119 shutdown_connections 2023-10-03T10:14:35.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.360+0000 7f3c964af700 1 -- 172.21.15.125:0/960314119 wait complete. 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 Processor -- start 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 -- start start 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c9011f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90122df0 con 0x7f3c900a1380 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c901228e0 con 0x7f3c900a0a70 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c964af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90121d80 con 0x7f3c90133f50 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c94a4c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c94a4c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57574/0 (socket says 172.21.15.125:57574) 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60856/0 (socket says 172.21.15.125:60856) 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c94a4c700 1 -- 172.21.15.125:0/1587809171 learned_addr learned my addr 172.21.15.125:0/1587809171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.361+0000 7f3c8ffff700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c9011f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 -- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 msgr2=0x7f3c9011f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c9011f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 -- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 msgr2=0x7f3c9011f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 -- 172.21.15.125:0/1587809171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800094a0 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c8f7fe700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c8ffff700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c9011f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c94a4c700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3c88014040 tx=0x7f3c88004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88004450 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88020070 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c84009550 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88004810 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.362+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c88009a70 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.363+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c88012430 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.363+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900a0440 con 0x7f3c90133f50 2023-10-03T10:14:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.363+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3c88022070 con 0x7f3c90133f50 2023-10-03T10:14:35.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.372+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c88025740 con 0x7f3c90133f50 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.403+0000 7f02d68c3700 1 Processor -- start 2023-10-03T10:14:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.403+0000 7f02d68c3700 1 -- start start 2023-10-03T10:14:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d68c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d68c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02d00a1380 0x7f02d0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d68c3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d009dc00 con 0x7f02d0133f50 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d68c3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d009ea60 con 0x7f02d00a1380 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d68c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02d009dec0 con 0x7f02d00a0a70 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02d00a1380 0x7f02d0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57582/0 (socket says 172.21.15.125:57582) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02d4e60700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f02d0133f50 0x7f02d013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39776/0 (socket says 172.21.15.125:39776) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02d00a1380 0x7f02d0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60868/0 (socket says 172.21.15.125:60868) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cffff700 1 -- 172.21.15.125:0/3940419364 learned_addr learned my addr 172.21.15.125:0/3940419364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 -- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 msgr2=0x7f02d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 -- 172.21.15.125:0/3940419364 >> v1:172.21.15.125:6789/0 conn(0x7f02d0133f50 legacy=0x7f02d013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 -- 172.21.15.125:0/3940419364 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d009e6a0 con 0x7f02d00a1380 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02ceffd700 1 -- 172.21.15.125:0/3940419364 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980412013 0 0) 0x7f02d009dc00 con 0x7f02d0133f50 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cffff700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02cf7fe700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d00a1380 0x7f02d0133a10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009840 tx=0x7f02c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9832ecb78ddcbb34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02ceffd700 1 -- 172.21.15.125:0/3940419364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4011830 con 0x7f02d00a1380 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02ceffd700 1 -- 172.21.15.125:0/3940419364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4011990 con 0x7f02d00a1380 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.404+0000 7f02ceffd700 1 -- 172.21.15.125:0/3940419364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4011d20 con 0x7f02d00a1380 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 -- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d00a1380 msgr2=0x7f02d0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d00a1380 0x7f02d0133a10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009840 tx=0x7f02c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 -- 172.21.15.125:0/3940419364 shutdown_connections 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3940419364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d00a1380 0x7f02d0133a10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 -- 172.21.15.125:0/3940419364 >> 172.21.15.125:0/3940419364 conn(0x7f02d00a6610 msgr2=0x7f02d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 -- 172.21.15.125:0/3940419364 shutdown_connections 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.405+0000 7f02d68c3700 1 -- 172.21.15.125:0/3940419364 wait complete. 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 Processor -- start 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 -- start start 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d00a1380 0x7f02d0122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 0x7f02d0123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0126220 con 0x7f02d0133f50 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0133960 con 0x7f02d00a1380 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.406+0000 7f02d68c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0133420 con 0x7f02d00a0a70 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02d4e60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 0x7f02d0123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d00a1380 0x7f02d0122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57584/0 (socket says 172.21.15.125:57584) 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 -- 172.21.15.125:0/3404053599 learned_addr learned my addr 172.21.15.125:0/3404053599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02d4e60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 0x7f02d0123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60874/0 (socket says 172.21.15.125:60874) 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 -- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d00a1380 msgr2=0x7f02d0122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d00a1380 0x7f02d0122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 -- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 msgr2=0x7f02d0123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 0x7f02d0123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 -- 172.21.15.125:0/3404053599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009550 con 0x7f02d00a0a70 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02cffff700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f02c000ec10 tx=0x7f02c000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000c850 con 0x7f02d00a0a70 2023-10-03T10:14:35.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000c9b0 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c40094a0 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000cd40 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.407+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d0126bb0 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.408+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02c0013470 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.408+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f02c003fc40 con 0x7f02d00a0a70 2023-10-03T10:14:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.408+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d004f2a0 con 0x7f02d00a0a70 2023-10-03T10:14:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.413+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02c0013720 con 0x7f02d00a0a70 2023-10-03T10:14:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.563+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c9004f2a0 con 0x7f3c90133f50 2023-10-03T10:14:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.564+0000 7f3c8cff9700 1 -- 172.21.15.125:0/1587809171 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c88025ba0 con 0x7f3c90133f50 2023-10-03T10:14:35.564 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 msgr2=0x7f3c9011fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3c88014040 tx=0x7f3c88004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 shutdown_connections 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c90133f50 0x7f3c9011fd50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c900a0a70 0x7f3c9011f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 --2- 172.21.15.125:0/1587809171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c900a1380 0x7f3c9011f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 >> 172.21.15.125:0/1587809171 conn(0x7f3c900a6610 msgr2=0x7f3c9009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 shutdown_connections 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.567+0000 7f3c964af700 1 -- 172.21.15.125:0/1587809171 wait complete. 2023-10-03T10:14:35.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:35.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.614+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02d0126010 con 0x7f02d00a0a70 2023-10-03T10:14:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.614+0000 7f02ccff9700 1 -- 172.21.15.125:0/3404053599 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02c0021070 con 0x7f02d00a0a70 2023-10-03T10:14:35.615 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 msgr2=0x7f02d0122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f02c000ec10 tx=0x7f02c000ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 shutdown_connections 2023-10-03T10:14:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d0133f50 0x7f02d0123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02d00a0a70 0x7f02d0122900 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 --2- 172.21.15.125:0/3404053599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d00a1380 0x7f02d0122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.616+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 >> 172.21.15.125:0/3404053599 conn(0x7f02d00a6610 msgr2=0x7f02d00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.617+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 shutdown_connections 2023-10-03T10:14:35.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:35.617+0000 7f02d68c3700 1 -- 172.21.15.125:0/3404053599 wait complete. 2023-10-03T10:14:35.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:36.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:36.114 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:36.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 Processor -- start 2023-10-03T10:14:36.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 -- start start 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 0x7f0648131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064809c970 con 0x7f0648131d70 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480a0920 con 0x7f064809f180 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064efa8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064809f9c0 con 0x7f064809e870 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f0647fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 0x7f0648131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064d545700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0648131d70 0x7f0648138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39786/0 (socket says 172.21.15.125:39786) 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064d545700 1 -- 172.21.15.125:0/938848423 learned_addr learned my addr 172.21.15.125:0/938848423 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.205+0000 7f064cd44700 1 --2- 172.21.15.125:0/938848423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064cd44700 1 -- 172.21.15.125:0/938848423 >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 msgr2=0x7f0648131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064cd44700 1 --2- 172.21.15.125:0/938848423 >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 0x7f0648131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064cd44700 1 -- 172.21.15.125:0/938848423 >> v1:172.21.15.125:6789/0 conn(0x7f0648131d70 legacy=0x7f0648138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064cd44700 1 -- 172.21.15.125:0/938848423 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064809bab0 con 0x7f064809e870 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f0647fff700 1 --2- 172.21.15.125:0/938848423 >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 0x7f0648131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f06477fe700 1 -- 172.21.15.125:0/938848423 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417267364 0 0) 0x7f064809c970 con 0x7f0648131d70 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064cd44700 1 --2- 172.21.15.125:0/938848423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064809ec40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f063c009840 tx=0x7f063c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a6bfb7c050a734 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f06477fe700 1 -- 172.21.15.125:0/938848423 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011830 con 0x7f064809e870 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f06477fe700 1 -- 172.21.15.125:0/938848423 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c011990 con 0x7f064809e870 2023-10-03T10:14:36.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f06477fe700 1 -- 172.21.15.125:0/938848423 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011d20 con 0x7f064809e870 2023-10-03T10:14:36.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064efa8700 1 -- 172.21.15.125:0/938848423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 msgr2=0x7f064809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.206+0000 7f064efa8700 1 --2- 172.21.15.125:0/938848423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064809ec40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f063c009840 tx=0x7f063c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 -- 172.21.15.125:0/938848423 shutdown_connections 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 --2- 172.21.15.125:0/938848423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064809ec40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 --2- 172.21.15.125:0/938848423 >> v2:172.21.15.125:3300/0 conn(0x7f064809f180 0x7f0648131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 -- 172.21.15.125:0/938848423 >> 172.21.15.125:0/938848423 conn(0x7f06480a4430 msgr2=0x7f06480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 -- 172.21.15.125:0/938848423 shutdown_connections 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 -- 172.21.15.125:0/938848423 wait complete. 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.207+0000 7f064efa8700 1 Processor -- start 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 -- start start 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f064809f180 0x7f064811d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 0x7f06481c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06481312d0 con 0x7f0648131d70 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0648120210 con 0x7f064809f180 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064efa8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064811ce30 con 0x7f064809e870 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064cd44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064d545700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 0x7f06481c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064cd44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57602/0 (socket says 172.21.15.125:57602) 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f064cd44700 1 -- 172.21.15.125:0/3643347558 learned_addr learned my addr 172.21.15.125:0/3643347558 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.208+0000 7f0647fff700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f064809f180 0x7f064811d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 -- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 msgr2=0x7f064811d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 -- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f064809f180 msgr2=0x7f064811d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f064809f180 0x7f064811d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 -- 172.21.15.125:0/3643347558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340094a0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064cd44700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064d545700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 0x7f06481c6020 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f064000cbe0 tx=0x7f064000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000aa40 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000abc0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0094a0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400070d0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.209+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064809dba0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.210+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0640007230 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.210+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f064003f3e0 con 0x7f0648131d70 2023-10-03T10:14:36.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.210+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064811eda0 con 0x7f0648131d70 2023-10-03T10:14:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.219+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0640018070 con 0x7f0648131d70 2023-10-03T10:14:36.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 Processor -- start 2023-10-03T10:14:36.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 -- start start 2023-10-03T10:14:36.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e409b110 con 0x7f97e409ad40 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40a3b60 con 0x7f97e4134570 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e8acb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40a1a80 con 0x7f97e4134140 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97e409ad40 0x7f97e4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39802/0 (socket says 172.21.15.125:39802) 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57614/0 (socket says 172.21.15.125:57614) 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57210/0 (socket says 172.21.15.125:57210) 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.247+0000 7f97e259c700 1 -- 172.21.15.125:0/3086915905 learned_addr learned my addr 172.21.15.125:0/3086915905 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e2d9d700 1 -- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 msgr2=0x7f97e4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e2d9d700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e159a700 1 -- 172.21.15.125:0/3086915905 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697408232 0 0) 0x7f97e409b110 con 0x7f97e409ad40 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e2d9d700 1 -- 172.21.15.125:0/3086915905 >> v1:172.21.15.125:6789/0 conn(0x7f97e409ad40 legacy=0x7f97e4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e2d9d700 1 -- 172.21.15.125:0/3086915905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e40a2fa0 con 0x7f97e4134570 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e1d9b700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e2d9d700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009df0 tx=0x7f97dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=709584cd8e2f47a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e159a700 1 -- 172.21.15.125:0/3086915905 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00e070 con 0x7f97e4134570 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e159a700 1 -- 172.21.15.125:0/3086915905 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00bae0 con 0x7f97e4134570 2023-10-03T10:14:36.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.248+0000 7f97e159a700 1 -- 172.21.15.125:0/3086915905 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00be90 con 0x7f97e4134570 2023-10-03T10:14:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 -- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 msgr2=0x7f97e413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009df0 tx=0x7f97dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 -- 172.21.15.125:0/3086915905 shutdown_connections 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e4134570 0x7f97e413b3d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 --2- 172.21.15.125:0/3086915905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 -- 172.21.15.125:0/3086915905 >> 172.21.15.125:0/3086915905 conn(0x7f97e4099c40 msgr2=0x7f97e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 -- 172.21.15.125:0/3086915905 shutdown_connections 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.249+0000 7f97e8acb700 1 -- 172.21.15.125:0/3086915905 wait complete. 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 Processor -- start 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 -- start start 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 0x7f97e4139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e411cf70 con 0x7f97e4134570 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e411ea90 con 0x7f97e409ad40 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e8acb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e409e490 con 0x7f97e4134140 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57216/0 (socket says 172.21.15.125:57216) 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e259c700 1 -- 172.21.15.125:0/1401056460 learned_addr learned my addr 172.21.15.125:0/1401056460 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57620/0 (socket says 172.21.15.125:57620) 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.250+0000 7f97e2d9d700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 0x7f97e4139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 -- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 msgr2=0x7f97e4139420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 -- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 msgr2=0x7f97e4139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 0x7f97e4139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 -- 172.21.15.125:0/1401056460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80094a0 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e2d9d700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 0x7f97e4139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e259c700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e1d9b700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e9b0 tx=0x7f97d800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800ee50 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800c850 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc009a70 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800cc00 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.251+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e411d650 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.252+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d8013470 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.252+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97d803f750 con 0x7f97e4134140 2023-10-03T10:14:36.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.252+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e41361e0 con 0x7f97e4134140 2023-10-03T10:14:36.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.257+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d8013720 con 0x7f97e4134140 2023-10-03T10:14:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.412+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f064804f2a0 con 0x7f0648131d70 2023-10-03T10:14:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.413+0000 7f06457fa700 1 -- 172.21.15.125:0/3643347558 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06400074e0 con 0x7f0648131d70 2023-10-03T10:14:36.414 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:36.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 msgr2=0x7f06481c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 0x7f06481c6020 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f064000cbe0 tx=0x7f064000cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 shutdown_connections 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0648131d70 0x7f06481c6020 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f064809e870 0x7f064811d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 --2- 172.21.15.125:0/3643347558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f064809f180 0x7f064811d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 >> 172.21.15.125:0/3643347558 conn(0x7f06480a4430 msgr2=0x7f06481b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 shutdown_connections 2023-10-03T10:14:36.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.415+0000 7f064efa8700 1 -- 172.21.15.125:0/3643347558 wait complete. 2023-10-03T10:14:36.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:36.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.452+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97e404f2a0 con 0x7f97e4134140 2023-10-03T10:14:36.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.452+0000 7f97d2ffd700 1 -- 172.21.15.125:0/1401056460 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97d8017020 con 0x7f97e4134140 2023-10-03T10:14:36.453 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:36.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.454+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 msgr2=0x7f97e4139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.454+0000 7f97e8acb700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e9b0 tx=0x7f97d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 shutdown_connections 2023-10-03T10:14:36.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4134570 0x7f97e4139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409ad40 0x7f97e4139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 --2- 172.21.15.125:0/1401056460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e4134140 0x7f97e4139960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 >> 172.21.15.125:0/1401056460 conn(0x7f97e4099c40 msgr2=0x7f97e413b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 shutdown_connections 2023-10-03T10:14:36.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.455+0000 7f97e8acb700 1 -- 172.21.15.125:0/1401056460 wait complete. 2023-10-03T10:14:36.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:36.584 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:36.629 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 Processor -- start 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 -- start start 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8410139480 0x7f841013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841006bec0 con 0x7f841009e870 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841006ce60 con 0x7f8410139480 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.710+0000 7f8416d67700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841009f740 con 0x7f841009f350 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8410139480 0x7f841013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57222/0 (socket says 172.21.15.125:57222) 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8410139480 0x7f841013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60908/0 (socket says 172.21.15.125:60908) 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840ffff700 1 -- 172.21.15.125:0/486749262 learned_addr learned my addr 172.21.15.125:0/486749262 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8414b03700 1 --1- 172.21.15.125:0/486749262 >> v1:172.21.15.125:6789/0 conn(0x7f841009e870 0x7f841009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39816/0 (socket says 172.21.15.125:39816) 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 -- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 msgr2=0x7f8410138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 -- 172.21.15.125:0/486749262 >> v1:172.21.15.125:6789/0 conn(0x7f841009e870 legacy=0x7f841009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 -- 172.21.15.125:0/486749262 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841009fa00 con 0x7f8410139480 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840ffff700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840f7fe700 1 -- 172.21.15.125:0/486749262 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474707020 0 0) 0x7f841006bec0 con 0x7f841009e870 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f8415304700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8410139480 0x7f841013b860 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8408009d90 tx=0x7f840800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6906e029e0b3fe1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840f7fe700 1 -- 172.21.15.125:0/486749262 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840800e070 con 0x7f8410139480 2023-10-03T10:14:36.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840f7fe700 1 -- 172.21.15.125:0/486749262 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840800bb20 con 0x7f8410139480 2023-10-03T10:14:36.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.711+0000 7f840f7fe700 1 -- 172.21.15.125:0/486749262 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408012430 con 0x7f8410139480 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 -- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8410139480 msgr2=0x7f841013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8410139480 0x7f841013b860 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8408009d90 tx=0x7f840800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 -- 172.21.15.125:0/486749262 shutdown_connections 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8410139480 0x7f841013b860 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 --2- 172.21.15.125:0/486749262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f841009f350 0x7f8410138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 -- 172.21.15.125:0/486749262 >> 172.21.15.125:0/486749262 conn(0x7f84100a4430 msgr2=0x7f84100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 -- 172.21.15.125:0/486749262 shutdown_connections 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.712+0000 7f8416d67700 1 -- 172.21.15.125:0/486749262 wait complete. 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 Processor -- start 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 -- start start 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f841009e870 0x7f841011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 0x7f841011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410122350 con 0x7f841009e870 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841006cfa0 con 0x7f8410139480 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.713+0000 7f8416d67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84100a3c40 con 0x7f841009f350 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8415304700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 0x7f841011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8415304700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57224/0 (socket says 172.21.15.125:57224) 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8415304700 1 -- 172.21.15.125:0/2402680854 learned_addr learned my addr 172.21.15.125:0/2402680854 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8414b03700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f841009e870 0x7f841011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 -- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 msgr2=0x7f841011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 -- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f841009e870 msgr2=0x7f841011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f841009e870 0x7f841011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 -- 172.21.15.125:0/2402680854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc009550 con 0x7f841009f350 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8415304700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840ffff700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 0x7f841011f010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00e9a0 tx=0x7f83fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004030 con 0x7f841009f350 2023-10-03T10:14:36.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc004190 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8408009a70 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004520 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.714+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8410121fd0 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.715+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83fc0036a0 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.715+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83fc03f590 con 0x7f841009f350 2023-10-03T10:14:36.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.715+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841004f2a0 con 0x7f841009f350 2023-10-03T10:14:36.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.720+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83fc019d60 con 0x7f841009f350 2023-10-03T10:14:36.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 Processor -- start 2023-10-03T10:14:36.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 -- start start 2023-10-03T10:14:36.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 0x7f040413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040406b2d0 con 0x7f04041309f0 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0404133610 con 0x7f04041300a0 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f040b24c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f040409a500 con 0x7f0404133ad0 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f0403fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f0408fe8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f0408fe8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57642/0 (socket says 172.21.15.125:57642) 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f0403fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57228/0 (socket says 172.21.15.125:57228) 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f0408fe8700 1 -- 172.21.15.125:0/427885977 learned_addr learned my addr 172.21.15.125:0/427885977 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.755+0000 7f04097e9700 1 --2- 172.21.15.125:0/427885977 >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 0x7f040413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 -- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 msgr2=0x7f0404133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 -- 172.21.15.125:0/427885977 >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 msgr2=0x7f040413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 --2- 172.21.15.125:0/427885977 >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 0x7f040413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 -- 172.21.15.125:0/427885977 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04041338b0 con 0x7f04041300a0 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0408fe8700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f04097e9700 1 --2- 172.21.15.125:0/427885977 >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 0x7f040413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f0403fff700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009840 tx=0x7f03f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77de0a2dc5663e7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f04037fe700 1 -- 172.21.15.125:0/427885977 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0011830 con 0x7f04041300a0 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f04037fe700 1 -- 172.21.15.125:0/427885977 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0011990 con 0x7f04041300a0 2023-10-03T10:14:36.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.756+0000 7f04037fe700 1 -- 172.21.15.125:0/427885977 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0011d20 con 0x7f04041300a0 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 -- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 msgr2=0x7f04041304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009840 tx=0x7f03f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 -- 172.21.15.125:0/427885977 shutdown_connections 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 --2- 172.21.15.125:0/427885977 >> v2:172.21.15.125:3300/0 conn(0x7f04041309f0 0x7f040413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f0404133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 --2- 172.21.15.125:0/427885977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f04041304b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 -- 172.21.15.125:0/427885977 >> 172.21.15.125:0/427885977 conn(0x7f0404099c40 msgr2=0x7f04040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 -- 172.21.15.125:0/427885977 shutdown_connections 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.757+0000 7f040b24c700 1 -- 172.21.15.125:0/427885977 wait complete. 2023-10-03T10:14:36.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 Processor -- start 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 -- start start 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 0x7f040411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f040411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040412dd00 con 0x7f04041309f0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0404120d90 con 0x7f04041300a0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f040b24c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f040411fc10 con 0x7f0404133ad0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f0408fe8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f04097e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f040411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f0403fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 0x7f040411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f0408fe8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57234/0 (socket says 172.21.15.125:57234) 2023-10-03T10:14:36.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f04097e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f040411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57654/0 (socket says 172.21.15.125:57654) 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f0403fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 0x7f040411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60936/0 (socket says 172.21.15.125:60936) 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.758+0000 7f0408fe8700 1 -- 172.21.15.125:0/4156126187 learned_addr learned my addr 172.21.15.125:0/4156126187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 -- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 msgr2=0x7f040411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f040411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 -- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 msgr2=0x7f040411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 0x7f040411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 -- 172.21.15.125:0/4156126187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc009a70 con 0x7f04041300a0 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f0408fe8700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f03f800ebe0 tx=0x7f03f800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f800c850 con 0x7f04041300a0 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f800c9b0 con 0x7f04041300a0 2023-10-03T10:14:36.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f8009550 con 0x7f04041300a0 2023-10-03T10:14:36.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f800cd20 con 0x7f04041300a0 2023-10-03T10:14:36.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.759+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00094a0 con 0x7f04041300a0 2023-10-03T10:14:36.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.760+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03f8013470 con 0x7f04041300a0 2023-10-03T10:14:36.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.760+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040404f2a0 con 0x7f04041300a0 2023-10-03T10:14:36.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.760+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03f803f6f0 con 0x7f04041300a0 2023-10-03T10:14:36.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.765+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03f80232f0 con 0x7f04041300a0 2023-10-03T10:14:36.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.914+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84101215f0 con 0x7f841009f350 2023-10-03T10:14:36.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.914+0000 7f840d7fa700 1 -- 172.21.15.125:0/2402680854 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83fc019300 con 0x7f841009f350 2023-10-03T10:14:36.915 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.916+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 msgr2=0x7f841011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.916+0000 7f8416d67700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 0x7f841011f010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00e9a0 tx=0x7f83fc00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 shutdown_connections 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8410139480 0x7f841011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f841009e870 0x7f841011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 --2- 172.21.15.125:0/2402680854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f841009f350 0x7f841011f010 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 >> 172.21.15.125:0/2402680854 conn(0x7f84100a4430 msgr2=0x7f84100a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 shutdown_connections 2023-10-03T10:14:36.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.917+0000 7f8416d67700 1 -- 172.21.15.125:0/2402680854 wait complete. 2023-10-03T10:14:36.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:36.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.955+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f040411fff0 con 0x7f04041300a0 2023-10-03T10:14:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.956+0000 7f04017fa700 1 -- 172.21.15.125:0/4156126187 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03f8021070 con 0x7f04041300a0 2023-10-03T10:14:36.956 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 msgr2=0x7f040411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f03f800ebe0 tx=0x7f03f800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 shutdown_connections 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0404133ad0 0x7f040411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04041300a0 0x7f040411da40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 --2- 172.21.15.125:0/4156126187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04041309f0 0x7f040411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 >> 172.21.15.125:0/4156126187 conn(0x7f0404099c40 msgr2=0x7f0404131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 shutdown_connections 2023-10-03T10:14:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:36.958+0000 7f040b24c700 1 -- 172.21.15.125:0/4156126187 wait complete. 2023-10-03T10:14:36.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:37.428 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:37.468 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 Processor -- start 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 -- start start 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 0x7f5298133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529809b110 con 0x7f52980a0a70 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.558+0000 7f529dbe0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980a3b60 con 0x7f529809ad40 2023-10-03T10:14:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f529dbe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52981348e0 con 0x7f5298133f70 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 0x7f5298133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57240/0 (socket says 172.21.15.125:57240) 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 0x7f5298133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60942/0 (socket says 172.21.15.125:60942) 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 -- 172.21.15.125:0/1991303261 learned_addr learned my addr 172.21.15.125:0/1991303261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52967fc700 1 -- 172.21.15.125:0/1991303261 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154917995 0 0) 0x7f529809b110 con 0x7f52980a0a70 2023-10-03T10:14:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 -- 172.21.15.125:0/1991303261 >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 msgr2=0x7f5298133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 --2- 172.21.15.125:0/1991303261 >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 0x7f5298133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 -- 172.21.15.125:0/1991303261 >> v1:172.21.15.125:6789/0 conn(0x7f52980a0a70 legacy=0x7f52980a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 -- 172.21.15.125:0/1991303261 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980a2fa0 con 0x7f5298133f70 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f5296ffd700 1 --2- 172.21.15.125:0/1991303261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f52800098f0 tx=0x7f5280009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37492abf6c0715dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52967fc700 1 -- 172.21.15.125:0/1991303261 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011830 con 0x7f5298133f70 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52967fc700 1 -- 172.21.15.125:0/1991303261 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280011990 con 0x7f5298133f70 2023-10-03T10:14:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.559+0000 7f52967fc700 1 -- 172.21.15.125:0/1991303261 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011d20 con 0x7f5298133f70 2023-10-03T10:14:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 -- 172.21.15.125:0/1991303261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 msgr2=0x7f52981343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 --2- 172.21.15.125:0/1991303261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f52800098f0 tx=0x7f5280009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 -- 172.21.15.125:0/1991303261 shutdown_connections 2023-10-03T10:14:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 --2- 172.21.15.125:0/1991303261 >> v2:172.21.15.125:3300/0 conn(0x7f529809ad40 0x7f5298133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 --2- 172.21.15.125:0/1991303261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f52981343a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 -- 172.21.15.125:0/1991303261 >> 172.21.15.125:0/1991303261 conn(0x7f5298099c40 msgr2=0x7f529806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 -- 172.21.15.125:0/1991303261 shutdown_connections 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.560+0000 7f529dbe0700 1 -- 172.21.15.125:0/1991303261 wait complete. 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 Processor -- start 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 -- start start 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529809ad40 0x7f52981212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5298122eb0 con 0x7f529809ad40 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5298123d40 con 0x7f5298133f70 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.561+0000 7f529dbe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5298124820 con 0x7f52980a0a70 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5296ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57666/0 (socket says 172.21.15.125:57666) 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57242/0 (socket says 172.21.15.125:57242) 2023-10-03T10:14:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5296ffd700 1 -- 172.21.15.125:0/3301650537 learned_addr learned my addr 172.21.15.125:0/3301650537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f52977fe700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529809ad40 0x7f52981212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 -- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 msgr2=0x7f5298121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 -- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529809ad40 msgr2=0x7f52981212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529809ad40 0x7f52981212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 -- 172.21.15.125:0/3301650537 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280009550 con 0x7f5298133f70 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5296ffd700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f5297fff700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f529000c430 tx=0x7f529000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900052e0 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290005440 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5298124ae0 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900038c0 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.562+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52980a0f30 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.563+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5290003a20 con 0x7f5298133f70 2023-10-03T10:14:37.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.563+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5298124670 con 0x7f5298133f70 2023-10-03T10:14:37.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.563+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f529003e9b0 con 0x7f5298133f70 2023-10-03T10:14:37.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.568+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5290019b40 con 0x7f5298133f70 2023-10-03T10:14:37.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.597+0000 7fe4b3c95700 1 Processor -- start 2023-10-03T10:14:37.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.597+0000 7fe4b3c95700 1 -- start start 2023-10-03T10:14:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.597+0000 7fe4b3c95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.597+0000 7fe4b3c95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b3c95700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b3c95700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac09de10 con 0x7fe4ac133f40 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b3c95700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac09db90 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b3c95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0a2560 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b2232700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1a31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57680/0 (socket says 172.21.15.125:57680) 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b2232700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60960/0 (socket says 172.21.15.125:60960) 2023-10-03T10:14:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1a31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57258/0 (socket says 172.21.15.125:57258) 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 -- 172.21.15.125:0/2009949862 learned_addr learned my addr 172.21.15.125:0/2009949862 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 -- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 msgr2=0x7fe4ac0a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 -- 172.21.15.125:0/2009949862 >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 msgr2=0x7fe4ac1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 --2- 172.21.15.125:0/2009949862 >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 -- 172.21.15.125:0/2009949862 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0a1f60 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b2232700 1 --2- 172.21.15.125:0/2009949862 >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1a31700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b1230700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098f0 tx=0x7fe49c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7115b092c9daac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b0a2f700 1 -- 172.21.15.125:0/2009949862 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011830 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b0a2f700 1 -- 172.21.15.125:0/2009949862 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c011990 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.598+0000 7fe4b0a2f700 1 -- 172.21.15.125:0/2009949862 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011d20 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 -- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 msgr2=0x7fe4ac133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098f0 tx=0x7fe49c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 -- 172.21.15.125:0/2009949862 shutdown_connections 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a09e0 0x7fe4ac0a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/2009949862 >> v2:172.21.15.125:3300/0 conn(0x7fe4ac133f40 0x7fe4ac1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/2009949862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a12f0 0x7fe4ac133a00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 -- 172.21.15.125:0/2009949862 >> 172.21.15.125:0/2009949862 conn(0x7fe4ac0a3000 msgr2=0x7fe4ac0a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 -- 172.21.15.125:0/2009949862 shutdown_connections 2023-10-03T10:14:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.599+0000 7fe4b3c95700 1 -- 172.21.15.125:0/2009949862 wait complete. 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 Processor -- start 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 -- start start 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4ac133f40 0x7fe4ac1c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac124f10 con 0x7fe4ac133f40 2023-10-03T10:14:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0a4d30 con 0x7fe4ac0a12f0 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b3c95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac126270 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b1230700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b1a31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b1230700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57264/0 (socket says 172.21.15.125:57264) 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b1a31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57688/0 (socket says 172.21.15.125:57688) 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.600+0000 7fe4b1230700 1 -- 172.21.15.125:0/694071446 learned_addr learned my addr 172.21.15.125:0/694071446 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b2232700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4ac133f40 0x7fe4ac1c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 -- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 msgr2=0x7fe4ac123800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 -- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4ac133f40 msgr2=0x7fe4ac1c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4ac133f40 0x7fe4ac1c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 -- 172.21.15.125:0/694071446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80094a0 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1230700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b1a31700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800e9e0 tx=0x7fe4a800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800ee70 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800c850 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4009a70 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800cc00 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.601+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c009550 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.602+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4a800cd60 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.602+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac122e80 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.602+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4a803f710 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.607+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4a801be10 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.757+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f529811e060 con 0x7f5298133f70 2023-10-03T10:14:37.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.758+0000 7f528ffff700 1 -- 172.21.15.125:0/3301650537 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5290010e20 con 0x7f5298133f70 2023-10-03T10:14:37.758 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:37.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 msgr2=0x7f5298121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f529000c430 tx=0x7f529000c740 comp rx=0 tx=0).stop 2023-10-03T10:14:37.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 shutdown_connections 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5298133f70 0x7f5298121d70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529809ad40 0x7f52981212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 --2- 172.21.15.125:0/3301650537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52980a0a70 0x7f5298121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 >> 172.21.15.125:0/3301650537 conn(0x7f5298099c40 msgr2=0x7f52981332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 shutdown_connections 2023-10-03T10:14:37.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.761+0000 7f529dbe0700 1 -- 172.21.15.125:0/3301650537 wait complete. 2023-10-03T10:14:37.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:37.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.798+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4ac04f2a0 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.798+0000 7fe4a27fc700 1 -- 172.21.15.125:0/694071446 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4a801b3b0 con 0x7fe4ac0a09e0 2023-10-03T10:14:37.799 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:37.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 msgr2=0x7fe4ac1232c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800e9e0 tx=0x7fe4a800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 shutdown_connections 2023-10-03T10:14:37.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4ac133f40 0x7fe4ac1c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe4ac0a09e0 0x7fe4ac1232c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 --2- 172.21.15.125:0/694071446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe4ac0a12f0 0x7fe4ac123800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 >> 172.21.15.125:0/694071446 conn(0x7fe4ac0a3000 msgr2=0x7fe4ac09ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 shutdown_connections 2023-10-03T10:14:37.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:37.800+0000 7fe4b3c95700 1 -- 172.21.15.125:0/694071446 wait complete. 2023-10-03T10:14:37.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:37.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:37.971 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:38.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 Processor -- start 2023-10-03T10:14:38.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 -- start start 2023-10-03T10:14:38.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff84c1343a0 0x7ff84c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c09b110 con 0x7ff84c133f70 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0a3b60 con 0x7ff84c1343a0 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff851d9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0a2fa0 con 0x7ff84c09ad40 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff84b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff84b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57704/0 (socket says 172.21.15.125:57704) 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff84b7fe700 1 -- 172.21.15.125:0/3773943400 learned_addr learned my addr 172.21.15.125:0/3773943400 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff84bfff700 1 --2- 172.21.15.125:0/3773943400 >> v2:172.21.15.125:3300/0 conn(0x7ff84c1343a0 0x7ff84c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.056+0000 7ff84bfff700 1 -- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 msgr2=0x7ff84c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84bfff700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84bfff700 1 -- 172.21.15.125:0/3773943400 >> v1:172.21.15.125:6789/0 conn(0x7ff84c133f70 legacy=0x7ff84c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84bfff700 1 -- 172.21.15.125:0/3773943400 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c09a280 con 0x7ff84c1343a0 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84a7fc700 1 -- 172.21.15.125:0/3773943400 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038019706 0 0) 0x7ff84c09b110 con 0x7ff84c133f70 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84b7fe700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84bfff700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c1343a0 0x7ff84c0a1180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf9195ff7fe272e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84a7fc700 1 -- 172.21.15.125:0/3773943400 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400e070 con 0x7ff84c1343a0 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84a7fc700 1 -- 172.21.15.125:0/3773943400 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400bb20 con 0x7ff84c1343a0 2023-10-03T10:14:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff84a7fc700 1 -- 172.21.15.125:0/3773943400 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844012430 con 0x7ff84c1343a0 2023-10-03T10:14:38.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 -- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c1343a0 msgr2=0x7ff84c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c1343a0 0x7ff84c0a1180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 -- 172.21.15.125:0/3773943400 shutdown_connections 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c1343a0 0x7ff84c0a1180 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 --2- 172.21.15.125:0/3773943400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c09ad40 0x7ff84c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.057+0000 7ff851d9b700 1 -- 172.21.15.125:0/3773943400 >> 172.21.15.125:0/3773943400 conn(0x7ff84c099c40 msgr2=0x7ff84c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.058+0000 7ff851d9b700 1 -- 172.21.15.125:0/3773943400 shutdown_connections 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.058+0000 7ff851d9b700 1 -- 172.21.15.125:0/3773943400 wait complete. 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.058+0000 7ff851d9b700 1 Processor -- start 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 -- start start 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff84c09ad40 0x7ff84c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 0x7ff84c1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c11efd0 con 0x7ff84c133f70 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c120730 con 0x7ff84c09ad40 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff851d9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c122740 con 0x7ff84c1343a0 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 0x7ff84c1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57710/0 (socket says 172.21.15.125:57710) 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 -- 172.21.15.125:0/886727746 learned_addr learned my addr 172.21.15.125:0/886727746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84b7fe700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff84c09ad40 0x7ff84c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 -- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff84c09ad40 msgr2=0x7ff84c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff84c09ad40 0x7ff84c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 -- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 msgr2=0x7ff84c1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 0x7ff84c1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84bfff700 1 -- 172.21.15.125:0/886727746 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009550 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.059+0000 7ff84affd700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 0x7ff84c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff84bfff700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff84400b680 tx=0x7ff844004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844012430 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844020070 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844009a70 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84401bbc0 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.060+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c120f20 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.061+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff84401bd20 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.061+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff844041300 con 0x7ff84c1343a0 2023-10-03T10:14:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.061+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c04f2a0 con 0x7ff84c1343a0 2023-10-03T10:14:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.065+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff84402d310 con 0x7ff84c1343a0 2023-10-03T10:14:38.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.098+0000 7fb6fa5c6700 1 Processor -- start 2023-10-03T10:14:38.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 -- start start 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 0x7fb6f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f409c970 con 0x7fb6f409f180 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40a0920 con 0x7fb6f409e870 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6fa5c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f409f9c0 con 0x7fb6f4131f40 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57724/0 (socket says 172.21.15.125:57724) 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 0x7fb6f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 -- 172.21.15.125:0/1578254551 learned_addr learned my addr 172.21.15.125:0/1578254551 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 -- 172.21.15.125:0/1578254551 >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 msgr2=0x7fb6f409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 --2- 172.21.15.125:0/1578254551 >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 0x7fb6f409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 -- 172.21.15.125:0/1578254551 >> v1:172.21.15.125:6789/0 conn(0x7fb6f409f180 legacy=0x7fb6f4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f8b63700 1 -- 172.21.15.125:0/1578254551 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f409bab0 con 0x7fb6f4131f40 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.099+0000 7fb6f3fff700 1 --2- 172.21.15.125:0/1578254551 >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 0x7fb6f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6f8b63700 1 --2- 172.21.15.125:0/1578254551 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009e50 tx=0x7fb6ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c230c6911a789c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6f2ffd700 1 -- 172.21.15.125:0/1578254551 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00e070 con 0x7fb6f4131f40 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6f2ffd700 1 -- 172.21.15.125:0/1578254551 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec00b910 con 0x7fb6f4131f40 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6f2ffd700 1 -- 172.21.15.125:0/1578254551 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00bcc0 con 0x7fb6f4131f40 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/1578254551 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 msgr2=0x7fb6f4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/1578254551 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009e50 tx=0x7fb6ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/1578254551 shutdown_connections 2023-10-03T10:14:38.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/1578254551 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f4131f40 0x7fb6f4139ca0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/1578254551 >> v2:172.21.15.125:3300/0 conn(0x7fb6f409e870 0x7fb6f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/1578254551 >> 172.21.15.125:0/1578254551 conn(0x7fb6f40a4430 msgr2=0x7fb6f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/1578254551 shutdown_connections 2023-10-03T10:14:38.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.100+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/1578254551 wait complete. 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.101+0000 7fb6fa5c6700 1 Processor -- start 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.101+0000 7fb6fa5c6700 1 -- start start 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6f409e870 0x7fb6f406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f406d580 con 0x7fb6f4131f40 2023-10-03T10:14:38.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4125c10 con 0x7fb6f409e870 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6fa5c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40a2ec0 con 0x7fb6f409f180 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57728/0 (socket says 172.21.15.125:57728) 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32768/0 (socket says 172.21.15.125:32768) 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f37fe700 1 -- 172.21.15.125:0/2534143810 learned_addr learned my addr 172.21.15.125:0/2534143810 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f3fff700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6f409e870 0x7fb6f406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 -- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 msgr2=0x7fb6f406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 -- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6f409e870 msgr2=0x7fb6f406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6f409e870 0x7fb6f406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f8b63700 1 -- 172.21.15.125:0/2534143810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e40094a0 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.102+0000 7fb6f37fe700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6f8b63700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec015000 tx=0x7fb6ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004800 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec004960 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec009b30 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec01c680 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.103+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6ec01c7e0 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.104+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f41247d0 con 0x7fb6f4131f40 2023-10-03T10:14:38.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.104+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6ec01b9f0 con 0x7fb6f4131f40 2023-10-03T10:14:38.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.104+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f404f2a0 con 0x7fb6f4131f40 2023-10-03T10:14:38.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.109+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6ec0243b0 con 0x7fb6f4131f40 2023-10-03T10:14:38.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.260+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff84c0729d0 con 0x7ff84c1343a0 2023-10-03T10:14:38.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.260+0000 7ff833fff700 1 -- 172.21.15.125:0/886727746 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff84402eb40 con 0x7ff84c1343a0 2023-10-03T10:14:38.261 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 msgr2=0x7ff84c1c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff84400b680 tx=0x7ff844004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 shutdown_connections 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff84c1343a0 0x7ff84c1c8ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff84c09ad40 0x7ff84c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 --2- 172.21.15.125:0/886727746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84c133f70 0x7ff84c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 >> 172.21.15.125:0/886727746 conn(0x7ff84c099c40 msgr2=0x7ff84c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 shutdown_connections 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.262+0000 7ff851d9b700 1 -- 172.21.15.125:0/886727746 wait complete. 2023-10-03T10:14:38.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.301+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6f406b2a0 con 0x7fb6f4131f40 2023-10-03T10:14:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.301+0000 7fb6f0ff9700 1 -- 172.21.15.125:0/2534143810 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6ec023b50 con 0x7fb6f4131f40 2023-10-03T10:14:38.302 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 msgr2=0x7fb6f406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec015000 tx=0x7fb6ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 shutdown_connections 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6f4131f40 0x7fb6f406c330 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6f409e870 0x7fb6f406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 --2- 172.21.15.125:0/2534143810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6f409f180 0x7fb6f406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 >> 172.21.15.125:0/2534143810 conn(0x7fb6f40a4430 msgr2=0x7fb6f40721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 shutdown_connections 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.303+0000 7fb6fa5c6700 1 -- 172.21.15.125:0/2534143810 wait complete. 2023-10-03T10:14:38.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:38.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:38.814 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.908+0000 7f9097dc8700 1 Processor -- start 2023-10-03T10:14:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 -- start start 2023-10-03T10:14:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 0x7f9090138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 0x7f909013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909009e9d0 con 0x7f90900a0a70 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909009dc00 con 0x7f9090139200 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9097dc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909009dec0 con 0x7f90900a1550 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9096365700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 0x7f909013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095363700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 0x7f9090138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095b64700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90900a0a70 0x7f90900a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39864/0 (socket says 172.21.15.125:39864) 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095b64700 1 -- 172.21.15.125:0/3565373532 learned_addr learned my addr 172.21.15.125:0/3565373532 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095363700 1 -- 172.21.15.125:0/3565373532 >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 msgr2=0x7f909013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095363700 1 --2- 172.21.15.125:0/3565373532 >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 0x7f909013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095363700 1 -- 172.21.15.125:0/3565373532 >> v1:172.21.15.125:6789/0 conn(0x7f90900a0a70 legacy=0x7f90900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.909+0000 7f9095363700 1 -- 172.21.15.125:0/3565373532 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909009e6a0 con 0x7f90900a1550 2023-10-03T10:14:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9096365700 1 --2- 172.21.15.125:0/3565373532 >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 0x7f909013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9095363700 1 --2- 172.21.15.125:0/3565373532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 0x7f9090138cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9080009840 tx=0x7f9080009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8edbfd1a5e1e173e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9094b62700 1 -- 172.21.15.125:0/3565373532 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080011830 con 0x7f90900a1550 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9094b62700 1 -- 172.21.15.125:0/3565373532 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080011990 con 0x7f90900a1550 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9094b62700 1 -- 172.21.15.125:0/3565373532 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080011d20 con 0x7f90900a1550 2023-10-03T10:14:38.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 -- 172.21.15.125:0/3565373532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 msgr2=0x7f9090138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3565373532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 0x7f9090138cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9080009840 tx=0x7f9080009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:38.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 -- 172.21.15.125:0/3565373532 shutdown_connections 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3565373532 >> v2:172.21.15.125:3300/0 conn(0x7f9090139200 0x7f909013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3565373532 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90900a1550 0x7f9090138cc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.910+0000 7f9097dc8700 1 -- 172.21.15.125:0/3565373532 >> 172.21.15.125:0/3565373532 conn(0x7f90900a6610 msgr2=0x7f90900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.911+0000 7f9097dc8700 1 -- 172.21.15.125:0/3565373532 shutdown_connections 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.911+0000 7f9097dc8700 1 -- 172.21.15.125:0/3565373532 wait complete. 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.911+0000 7f9097dc8700 1 Processor -- start 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.911+0000 7f9097dc8700 1 -- start start 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 0x7f909011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90901224a0 con 0x7f90900a0a70 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90901220a0 con 0x7f9090139200 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9097dc8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9090121af0 con 0x7f90900a1550 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9096365700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9096365700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57312/0 (socket says 172.21.15.125:57312) 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57742/0 (socket says 172.21.15.125:57742) 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9096365700 1 -- 172.21.15.125:0/3561464068 learned_addr learned my addr 172.21.15.125:0/3561464068 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095b64700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 0x7f909011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 -- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 msgr2=0x7f909011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 -- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 msgr2=0x7f909011e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 0x7f909011e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095363700 1 -- 172.21.15.125:0/3561464068 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009a70 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9096365700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.912+0000 7f9095b64700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 0x7f909011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f9095363700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9080016000 tx=0x7f9080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800036a0 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908001f070 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800094a0 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080003a60 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9090120580 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.913+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9080003bc0 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.914+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9080021070 con 0x7f90900a1550 2023-10-03T10:14:38.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.914+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909004f2a0 con 0x7f90900a1550 2023-10-03T10:14:38.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.918+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f908002b020 con 0x7f90900a1550 2023-10-03T10:14:38.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.947+0000 7f57022a8700 1 Processor -- start 2023-10-03T10:14:38.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.947+0000 7f57022a8700 1 -- start start 2023-10-03T10:14:38.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56fc133f50 0x7f56fc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc09e9d0 con 0x7f56fc133f50 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc09dc00 con 0x7f56fc0a1380 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f57022a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc09dec0 con 0x7f56fc0a0a70 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56fc133f50 0x7f56fc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57316/0 (socket says 172.21.15.125:57316) 2023-10-03T10:14:38.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fb7fe700 1 -- 172.21.15.125:0/3150053364 learned_addr learned my addr 172.21.15.125:0/3150053364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56fc133f50 0x7f56fc1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32788/0 (socket says 172.21.15.125:32788) 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 -- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 msgr2=0x7f56fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 -- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 msgr2=0x7f56fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 -- 172.21.15.125:0/3150053364 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc09e6a0 con 0x7f56fc133f50 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fbfff700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f56fb7fe700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.948+0000 7f5700845700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc133f50 0x7f56fc1343f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009d90 tx=0x7f56f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cbcb1aabda9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f56faffd700 1 -- 172.21.15.125:0/3150053364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400e070 con 0x7f56fc133f50 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f56faffd700 1 -- 172.21.15.125:0/3150053364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f400bb20 con 0x7f56fc133f50 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f56faffd700 1 -- 172.21.15.125:0/3150053364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4012430 con 0x7f56fc133f50 2023-10-03T10:14:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 -- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc133f50 msgr2=0x7f56fc1343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc133f50 0x7f56fc1343f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009d90 tx=0x7f56f400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 -- 172.21.15.125:0/3150053364 shutdown_connections 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc133f50 0x7f56fc1343f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 --2- 172.21.15.125:0/3150053364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc0a1380 0x7f56fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 -- 172.21.15.125:0/3150053364 >> 172.21.15.125:0/3150053364 conn(0x7f56fc0a6610 msgr2=0x7f56fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 -- 172.21.15.125:0/3150053364 shutdown_connections 2023-10-03T10:14:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.949+0000 7f57022a8700 1 -- 172.21.15.125:0/3150053364 wait complete. 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.950+0000 7f57022a8700 1 Processor -- start 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.950+0000 7f57022a8700 1 -- start start 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc0a1380 0x7f56fc122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc133f50 0x7f56fc122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc126090 con 0x7f56fc0a1380 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0a03e0 con 0x7f56fc133f50 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f57022a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc09d340 con 0x7f56fc0a0a70 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57752/0 (socket says 172.21.15.125:57752) 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 -- 172.21.15.125:0/3227960730 learned_addr learned my addr 172.21.15.125:0/3227960730 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f5700845700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc133f50 0x7f56fc122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fb7fe700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc0a1380 0x7f56fc122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 -- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc133f50 msgr2=0x7f56fc122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc133f50 0x7f56fc122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 -- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc0a1380 msgr2=0x7f56fc122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc0a1380 0x7f56fc122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 -- 172.21.15.125:0/3227960730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0094a0 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56fbfff700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ebe0 tx=0x7f56ec00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec009780 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.951+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec00c850 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00cbe0 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0009550 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f4009a70 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56ec00cd40 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56ec03f710 con 0x7f56fc0a0a70 2023-10-03T10:14:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.952+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc11f760 con 0x7f56fc0a0a70 2023-10-03T10:14:38.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:38.957+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56ec0232f0 con 0x7f56fc0a0a70 2023-10-03T10:14:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.112+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9090120c60 con 0x7f90900a1550 2023-10-03T10:14:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.112+0000 7f90867fc700 1 -- 172.21.15.125:0/3561464068 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9080015070 con 0x7f90900a1550 2023-10-03T10:14:39.113 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 msgr2=0x7f909011eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9080016000 tx=0x7f9080004750 comp rx=0 tx=0).stop 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 shutdown_connections 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9090139200 0x7f909011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90900a0a70 0x7f909011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 --2- 172.21.15.125:0/3561464068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90900a1550 0x7f909011eda0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 >> 172.21.15.125:0/3561464068 conn(0x7f90900a6610 msgr2=0x7f90901381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 shutdown_connections 2023-10-03T10:14:39.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.114+0000 7f9097dc8700 1 -- 172.21.15.125:0/3561464068 wait complete. 2023-10-03T10:14:39.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:39.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.151+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56fc125c30 con 0x7f56fc0a0a70 2023-10-03T10:14:39.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.152+0000 7f56f8ff9700 1 -- 172.21.15.125:0/3227960730 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56ec021020 con 0x7f56fc0a0a70 2023-10-03T10:14:39.152 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:39.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 msgr2=0x7f56fc122570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ebe0 tx=0x7f56ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 shutdown_connections 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56fc133f50 0x7f56fc122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56fc0a0a70 0x7f56fc122570 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 --2- 172.21.15.125:0/3227960730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56fc0a1380 0x7f56fc122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 >> 172.21.15.125:0/3227960730 conn(0x7f56fc0a6610 msgr2=0x7f56fc11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 shutdown_connections 2023-10-03T10:14:39.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.154+0000 7f57022a8700 1 -- 172.21.15.125:0/3227960730 wait complete. 2023-10-03T10:14:39.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:39.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:39.316 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.405+0000 7fb5f3b2d700 1 Processor -- start 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.405+0000 7fb5f3b2d700 1 -- start start 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.405+0000 7fb5f3b2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.405+0000 7fb5f3b2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.405+0000 7fb5f3b2d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec06b2d0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f3b2d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec133610 con 0x7fb5ec1300a0 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f3b2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec09a500 con 0x7fb5ec133ad0 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f10c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f10c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32804/0 (socket says 172.21.15.125:32804) 2023-10-03T10:14:39.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57756/0 (socket says 172.21.15.125:57756) 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f10c8700 1 -- 172.21.15.125:0/1141527096 learned_addr learned my addr 172.21.15.125:0/1141527096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f20ca700 1 --1- 172.21.15.125:0/1141527096 >> v1:172.21.15.125:6789/0 conn(0x7fb5ec1309f0 0x7fb5ec13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39872/0 (socket says 172.21.15.125:39872) 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 -- 172.21.15.125:0/1141527096 >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 msgr2=0x7fb5ec1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 --2- 172.21.15.125:0/1141527096 >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 -- 172.21.15.125:0/1141527096 >> v1:172.21.15.125:6789/0 conn(0x7fb5ec1309f0 legacy=0x7fb5ec13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 -- 172.21.15.125:0/1141527096 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec1338b0 con 0x7fb5ec133ad0 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f10c8700 1 --2- 172.21.15.125:0/1141527096 >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f18c9700 1 --2- 172.21.15.125:0/1141527096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009840 tx=0x7fb5e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c911b0ee2f0804 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f08c7700 1 -- 172.21.15.125:0/1141527096 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011830 con 0x7fb5ec133ad0 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f08c7700 1 -- 172.21.15.125:0/1141527096 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8011990 con 0x7fb5ec133ad0 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.406+0000 7fb5f08c7700 1 -- 172.21.15.125:0/1141527096 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011d20 con 0x7fb5ec133ad0 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/1141527096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 msgr2=0x7fb5ec133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/1141527096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009840 tx=0x7fb5e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/1141527096 shutdown_connections 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/1141527096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec133ad0 0x7fb5ec133ea0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/1141527096 >> v2:172.21.15.125:3300/0 conn(0x7fb5ec1300a0 0x7fb5ec1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/1141527096 >> 172.21.15.125:0/1141527096 conn(0x7fb5ec099c40 msgr2=0x7fb5ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/1141527096 shutdown_connections 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.407+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/1141527096 wait complete. 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 Processor -- start 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 -- start start 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 0x7fb5ec11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 0x7fb5ec11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1200c0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec11fb20 con 0x7fb5ec133ad0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f3b2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec11f040 con 0x7fb5ec1300a0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f10c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f18c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 0x7fb5ec11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f10c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32808/0 (socket says 172.21.15.125:32808) 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f18c9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 0x7fb5ec11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57768/0 (socket says 172.21.15.125:57768) 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f10c8700 1 -- 172.21.15.125:0/3094700037 learned_addr learned my addr 172.21.15.125:0/3094700037 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.408+0000 7fb5f20ca700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 0x7fb5ec11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 -- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 msgr2=0x7fb5ec11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 0x7fb5ec11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 -- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 msgr2=0x7fb5ec11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 0x7fb5ec11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 -- 172.21.15.125:0/3094700037 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009550 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f20ca700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 0x7fb5ec11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f10c8700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00ec10 tx=0x7fb5dc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00c850 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00c9b0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80094a0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00cd60 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.409+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec12dd00 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.410+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5dc013470 con 0x7fb5ec1309f0 2023-10-03T10:14:39.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.410+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5dc03f7b0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.410+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec04f2a0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.415+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5dc0232f0 con 0x7fb5ec1309f0 2023-10-03T10:14:39.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.446+0000 7f5bf5b77700 1 Processor -- start 2023-10-03T10:14:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.446+0000 7f5bf5b77700 1 -- start start 2023-10-03T10:14:39.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.446+0000 7f5bf5b77700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bf0067c10 0x7f5bf0133b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.446+0000 7f5bf5b77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf00a0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bf5b77700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf009a460 con 0x7f5bf0134430 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bf5b77700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf0067fe0 con 0x7f5bf0067c10 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bf5b77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00a21a0 con 0x7f5bf0134040 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf00a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5bf0134430 0x7f5bf00a0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39886/0 (socket says 172.21.15.125:39886) 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beffff700 1 -- 172.21.15.125:0/1841597250 learned_addr learned my addr 172.21.15.125:0/1841597250 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bf0067c10 0x7f5bf0133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 -- 172.21.15.125:0/1841597250 >> v2:172.21.15.125:3300/0 conn(0x7f5bf0067c10 msgr2=0x7f5bf0133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bee7fc700 1 -- 172.21.15.125:0/1841597250 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918265279 0 0) 0x7f5bf009a460 con 0x7f5bf0134430 2023-10-03T10:14:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 --2- 172.21.15.125:0/1841597250 >> v2:172.21.15.125:3300/0 conn(0x7f5bf0067c10 0x7f5bf0133b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 -- 172.21.15.125:0/1841597250 >> v1:172.21.15.125:6789/0 conn(0x7f5bf0134430 legacy=0x7f5bf00a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 -- 172.21.15.125:0/1841597250 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf009a960 con 0x7f5bf0134040 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5beeffd700 1 --2- 172.21.15.125:0/1841597250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf00a0980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009840 tx=0x7f5be4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33fb5f00a87c024 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bee7fc700 1 -- 172.21.15.125:0/1841597250 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4011830 con 0x7f5bf0134040 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bee7fc700 1 -- 172.21.15.125:0/1841597250 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be4011990 con 0x7f5bf0134040 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.447+0000 7f5bee7fc700 1 -- 172.21.15.125:0/1841597250 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4011d20 con 0x7f5bf0134040 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 -- 172.21.15.125:0/1841597250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 msgr2=0x7f5bf00a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/1841597250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf00a0980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009840 tx=0x7f5be4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 -- 172.21.15.125:0/1841597250 shutdown_connections 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/1841597250 >> v2:172.21.15.125:3300/0 conn(0x7f5bf0067c10 0x7f5bf0133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/1841597250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf00a0980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 -- 172.21.15.125:0/1841597250 >> 172.21.15.125:0/1841597250 conn(0x7f5bf00a2980 msgr2=0x7f5bf00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 -- 172.21.15.125:0/1841597250 shutdown_connections 2023-10-03T10:14:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.448+0000 7f5bf5b77700 1 -- 172.21.15.125:0/1841597250 wait complete. 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 Processor -- start 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 -- start start 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 0x7f5bf01c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bf0134430 0x7f5bf01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf011c720 con 0x7f5bf0067c10 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0132cc0 con 0x7f5bf0134430 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bf5b77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf011d340 con 0x7f5bf0134040 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5beeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.449+0000 7f5bef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 0x7f5bf01c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5beeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57790/0 (socket says 172.21.15.125:57790) 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5beeffd700 1 -- 172.21.15.125:0/4093329804 learned_addr learned my addr 172.21.15.125:0/4093329804 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5beffff700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bf0134430 0x7f5bf01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 -- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 msgr2=0x7f5bf01c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 -- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bf0134430 msgr2=0x7f5bf01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bf0134430 0x7f5bf01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 -- 172.21.15.125:0/4093329804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40094a0 con 0x7f5bf0067c10 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5beeffd700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bef7fe700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 0x7f5bf01c51b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5be000efc0 tx=0x7f5be000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000cd10 con 0x7f5bf0067c10 2023-10-03T10:14:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000f040 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf01338d0 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00146a0 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.450+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf011b960 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.451+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5be0014800 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.451+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5be0040220 con 0x7f5bf0067c10 2023-10-03T10:14:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.451+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf011d8d0 con 0x7f5bf0067c10 2023-10-03T10:14:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.456+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5be001d400 con 0x7f5bf0067c10 2023-10-03T10:14:39.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.609+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5ec12d970 con 0x7fb5ec1309f0 2023-10-03T10:14:39.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.609+0000 7fb5e27fc700 1 -- 172.21.15.125:0/3094700037 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5dc021020 con 0x7fb5ec1309f0 2023-10-03T10:14:39.609 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:39.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 msgr2=0x7fb5ec11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00ec10 tx=0x7fb5dc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 shutdown_connections 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5ec133ad0 0x7fb5ec11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5ec1300a0 0x7fb5ec11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 --2- 172.21.15.125:0/3094700037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec1309f0 0x7fb5ec11df80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 >> 172.21.15.125:0/3094700037 conn(0x7fb5ec099c40 msgr2=0x7fb5ec1320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 shutdown_connections 2023-10-03T10:14:39.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.611+0000 7fb5f3b2d700 1 -- 172.21.15.125:0/3094700037 wait complete. 2023-10-03T10:14:39.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.649+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bf004f2a0 con 0x7f5bf0067c10 2023-10-03T10:14:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.650+0000 7f5bd7fff700 1 -- 172.21.15.125:0/4093329804 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5be002c090 con 0x7f5bf0067c10 2023-10-03T10:14:39.650 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 msgr2=0x7f5bf01c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 0x7f5bf01c51b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5be000efc0 tx=0x7f5be000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 shutdown_connections 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bf0134430 0x7f5bf01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bf0067c10 0x7f5bf01c51b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 --2- 172.21.15.125:0/4093329804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bf0134040 0x7f5bf01c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 >> 172.21.15.125:0/4093329804 conn(0x7f5bf00a2980 msgr2=0x7f5bf01bad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 shutdown_connections 2023-10-03T10:14:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:39.652+0000 7f5bf5b77700 1 -- 172.21.15.125:0/4093329804 wait complete. 2023-10-03T10:14:39.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:40.127 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:40.167 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:40.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.255+0000 7ff209879700 1 Processor -- start 2023-10-03T10:14:40.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 -- start start 2023-10-03T10:14:40.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20409b110 con 0x7ff2040a0a70 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040a3b60 con 0x7ff204133f70 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff209879700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041348e0 con 0x7ff20409ad40 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff202ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff2027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff2027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32826/0 (socket says 172.21.15.125:32826) 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff202ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57802/0 (socket says 172.21.15.125:57802) 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff2027fc700 1 -- 172.21.15.125:0/2410682761 learned_addr learned my addr 172.21.15.125:0/2410682761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff202ffd700 1 -- 172.21.15.125:0/2410682761 >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 msgr2=0x7ff2041343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff202ffd700 1 --2- 172.21.15.125:0/2410682761 >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.256+0000 7ff202ffd700 1 -- 172.21.15.125:0/2410682761 >> v1:172.21.15.125:6789/0 conn(0x7ff2040a0a70 legacy=0x7ff2040a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff202ffd700 1 -- 172.21.15.125:0/2410682761 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040a2fa0 con 0x7ff20409ad40 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff201ffb700 1 -- 172.21.15.125:0/2410682761 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669641813 0 0) 0x7ff20409b110 con 0x7ff2040a0a70 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff2027fc700 1 --2- 172.21.15.125:0/2410682761 >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff202ffd700 1 --2- 172.21.15.125:0/2410682761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009870 tx=0x7ff1f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1045f40e8059526 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff201ffb700 1 -- 172.21.15.125:0/2410682761 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4011830 con 0x7ff20409ad40 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff201ffb700 1 -- 172.21.15.125:0/2410682761 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4011990 con 0x7ff20409ad40 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff201ffb700 1 -- 172.21.15.125:0/2410682761 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4011d20 con 0x7ff20409ad40 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 -- 172.21.15.125:0/2410682761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 msgr2=0x7ff204133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 --2- 172.21.15.125:0/2410682761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009870 tx=0x7ff1f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 -- 172.21.15.125:0/2410682761 shutdown_connections 2023-10-03T10:14:40.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 --2- 172.21.15.125:0/2410682761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff204133a30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 --2- 172.21.15.125:0/2410682761 >> v2:172.21.15.125:3300/0 conn(0x7ff204133f70 0x7ff2041343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 -- 172.21.15.125:0/2410682761 >> 172.21.15.125:0/2410682761 conn(0x7ff204099c40 msgr2=0x7ff20406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 -- 172.21.15.125:0/2410682761 shutdown_connections 2023-10-03T10:14:40.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.257+0000 7ff209879700 1 -- 172.21.15.125:0/2410682761 wait complete. 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.259+0000 7ff209879700 1 Processor -- start 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.259+0000 7ff209879700 1 -- start start 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff204133f70 0x7ff2041c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204122600 con 0x7ff2040a0a70 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041336c0 con 0x7ff204133f70 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff204120180 con 0x7ff20409ad40 2023-10-03T10:14:40.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff2027fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff204133f70 0x7ff2041c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff2027fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32830/0 (socket says 172.21.15.125:32830) 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57814/0 (socket says 172.21.15.125:57814) 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff2027fc700 1 -- 172.21.15.125:0/1769970283 learned_addr learned my addr 172.21.15.125:0/1769970283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 -- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff204133f70 msgr2=0x7ff2041c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff204133f70 0x7ff2041c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 -- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 msgr2=0x7ff20411fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 -- 172.21.15.125:0/1769970283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8009550 con 0x7ff20409ad40 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff2027fc700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff202ffd700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4016000 tx=0x7ff1f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40036a0 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f401e070 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4003a40 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.260+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40094a0 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.261+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204120940 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.261+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1f4003ba0 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.261+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff1f4040580 con 0x7ff20409ad40 2023-10-03T10:14:40.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.262+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2040a4170 con 0x7ff20409ad40 2023-10-03T10:14:40.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.266+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1f401a420 con 0x7ff20409ad40 2023-10-03T10:14:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 Processor -- start 2023-10-03T10:14:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 -- start start 2023-10-03T10:14:40.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80d009e870 0x7f80d009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d009c970 con 0x7f80d0131d70 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00a0920 con 0x7f80d009e870 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d71e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80d009f9c0 con 0x7f80d009f180 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.297+0000 7f80d4f82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80d009e870 0x7f80d009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d5783700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f80d0131d70 0x7f80d0138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39904/0 (socket says 172.21.15.125:39904) 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80d009e870 0x7f80d009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32834/0 (socket says 172.21.15.125:32834) 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d5783700 1 -- 172.21.15.125:0/976148165 learned_addr learned my addr 172.21.15.125:0/976148165 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cffff700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 -- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 msgr2=0x7f80d0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 -- 172.21.15.125:0/976148165 >> v1:172.21.15.125:6789/0 conn(0x7f80d0131d70 legacy=0x7f80d0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 -- 172.21.15.125:0/976148165 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d009bab0 con 0x7f80d009e870 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cf7fe700 1 -- 172.21.15.125:0/976148165 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094886554 0 0) 0x7f80d009c970 con 0x7f80d0131d70 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cffff700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80d4f82700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d009e870 0x7f80d009ec40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009840 tx=0x7f80c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1199a4ca35bd5418 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cf7fe700 1 -- 172.21.15.125:0/976148165 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4011830 con 0x7f80d009e870 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cf7fe700 1 -- 172.21.15.125:0/976148165 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4011990 con 0x7f80d009e870 2023-10-03T10:14:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.298+0000 7f80cf7fe700 1 -- 172.21.15.125:0/976148165 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4011d20 con 0x7f80d009e870 2023-10-03T10:14:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 -- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d009e870 msgr2=0x7f80d009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d009e870 0x7f80d009ec40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009840 tx=0x7f80c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 -- 172.21.15.125:0/976148165 shutdown_connections 2023-10-03T10:14:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d009e870 0x7f80d009ec40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 --2- 172.21.15.125:0/976148165 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 -- 172.21.15.125:0/976148165 >> 172.21.15.125:0/976148165 conn(0x7f80d00a4430 msgr2=0x7f80d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 -- 172.21.15.125:0/976148165 shutdown_connections 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.299+0000 7f80d71e6700 1 -- 172.21.15.125:0/976148165 wait complete. 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.300+0000 7f80d71e6700 1 Processor -- start 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.300+0000 7f80d71e6700 1 -- start start 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80d009e870 0x7f80d011f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d011f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d01206e0 con 0x7f80d0131d70 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d01305e0 con 0x7f80d009e870 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d71e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0121cb0 con 0x7f80d009f180 2023-10-03T10:14:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32836/0 (socket says 172.21.15.125:32836) 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d011f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 -- 172.21.15.125:0/362628897 learned_addr learned my addr 172.21.15.125:0/362628897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d4f82700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80d009e870 0x7f80d011f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 -- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 msgr2=0x7f80d011f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d011f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 -- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80d009e870 msgr2=0x7f80d011f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80d009e870 0x7f80d011f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 -- 172.21.15.125:0/362628897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0094a0 con 0x7f80d0131d70 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80cffff700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d011f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.301+0000 7f80d5783700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80c800cc70 tx=0x7f80c800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.302+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800aac0 con 0x7f80d0131d70 2023-10-03T10:14:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.302+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800ac40 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.302+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40094a0 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.302+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80070d0 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.302+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d0122510 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.303+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80c8007250 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.303+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d011be60 con 0x7f80d0131d70 2023-10-03T10:14:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.303+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80c803f4f0 con 0x7f80d0131d70 2023-10-03T10:14:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.307+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80c8007500 con 0x7f80d0131d70 2023-10-03T10:14:40.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.462+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2041221b0 con 0x7ff20409ad40 2023-10-03T10:14:40.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.462+0000 7ff1ebfff700 1 -- 172.21.15.125:0/1769970283 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1f4015030 con 0x7ff20409ad40 2023-10-03T10:14:40.463 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 msgr2=0x7ff20411f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4016000 tx=0x7ff1f4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 shutdown_connections 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff204133f70 0x7ff2041c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff20409ad40 0x7ff20411f700 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 --2- 172.21.15.125:0/1769970283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2040a0a70 0x7ff20411fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 >> 172.21.15.125:0/1769970283 conn(0x7ff204099c40 msgr2=0x7ff2041bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 shutdown_connections 2023-10-03T10:14:40.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.464+0000 7ff209879700 1 -- 172.21.15.125:0/1769970283 wait complete. 2023-10-03T10:14:40.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:40.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.499+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80d004f2a0 con 0x7f80d0131d70 2023-10-03T10:14:40.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.500+0000 7f80cd7fa700 1 -- 172.21.15.125:0/362628897 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80c8018020 con 0x7f80d0131d70 2023-10-03T10:14:40.500 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:40.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 msgr2=0x7f80d011fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80c800cc70 tx=0x7f80c800cf80 comp rx=0 tx=0).stop 2023-10-03T10:14:40.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 shutdown_connections 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80d0131d70 0x7f80d011fc90 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80d009e870 0x7f80d011f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 --2- 172.21.15.125:0/362628897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f80d009f180 0x7f80d011f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 >> 172.21.15.125:0/362628897 conn(0x7f80d00a4430 msgr2=0x7f80d0131140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 shutdown_connections 2023-10-03T10:14:40.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.502+0000 7f80d71e6700 1 -- 172.21.15.125:0/362628897 wait complete. 2023-10-03T10:14:40.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:40.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:40.665 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:40.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.749+0000 7fb50cc91700 1 Processor -- start 2023-10-03T10:14:40.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.749+0000 7fb50cc91700 1 -- start start 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50cc91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50cc91700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb508133f70 0x7fb5081343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50cc91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50809b110 con 0x7fb5080a0a70 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50cc91700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5080a3b60 con 0x7fb508133f70 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50cc91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081348e0 con 0x7fb50809ad40 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb505d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb508133f70 0x7fb5081343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57826/0 (socket says 172.21.15.125:57826) 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb505d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb508133f70 0x7fb5081343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32842/0 (socket says 172.21.15.125:32842) 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb50659c700 1 -- 172.21.15.125:0/126343057 learned_addr learned my addr 172.21.15.125:0/126343057 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb506d9d700 1 --1- 172.21.15.125:0/126343057 >> v1:172.21.15.125:6789/0 conn(0x7fb5080a0a70 0x7fb5080a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39920/0 (socket says 172.21.15.125:39920) 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb505d9b700 1 -- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 msgr2=0x7fb508133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb505d9b700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.750+0000 7fb505d9b700 1 -- 172.21.15.125:0/126343057 >> v1:172.21.15.125:6789/0 conn(0x7fb5080a0a70 legacy=0x7fb5080a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb505d9b700 1 -- 172.21.15.125:0/126343057 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080a2fa0 con 0x7fb508133f70 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50659c700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50559a700 1 -- 172.21.15.125:0/126343057 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234453044 0 0) 0x7fb50809b110 con 0x7fb5080a0a70 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb505d9b700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb508133f70 0x7fb5081343a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009840 tx=0x7fb4fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af844ca3ef78d4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50559a700 1 -- 172.21.15.125:0/126343057 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011830 con 0x7fb508133f70 2023-10-03T10:14:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50559a700 1 -- 172.21.15.125:0/126343057 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc011990 con 0x7fb508133f70 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50559a700 1 -- 172.21.15.125:0/126343057 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011d20 con 0x7fb508133f70 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 -- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb508133f70 msgr2=0x7fb5081343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb508133f70 0x7fb5081343a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009840 tx=0x7fb4fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 -- 172.21.15.125:0/126343057 shutdown_connections 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb50809ad40 0x7fb508133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 --2- 172.21.15.125:0/126343057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb508133f70 0x7fb5081343a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.751+0000 7fb50cc91700 1 -- 172.21.15.125:0/126343057 >> 172.21.15.125:0/126343057 conn(0x7fb508099c40 msgr2=0x7fb50806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.752+0000 7fb50cc91700 1 -- 172.21.15.125:0/126343057 shutdown_connections 2023-10-03T10:14:40.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.752+0000 7fb50cc91700 1 -- 172.21.15.125:0/126343057 wait complete. 2023-10-03T10:14:40.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 Processor -- start 2023-10-03T10:14:40.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 -- start start 2023-10-03T10:14:40.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5080a0a70 0x7fb50811fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb508133f70 0x7fb5081c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50811f0b0 con 0x7fb50809ad40 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081337a0 con 0x7fb5080a0a70 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50cc91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb508133560 con 0x7fb508133f70 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32848/0 (socket says 172.21.15.125:32848) 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 -- 172.21.15.125:0/1054720605 learned_addr learned my addr 172.21.15.125:0/1054720605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb506d9d700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb508133f70 0x7fb5081c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb505d9b700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5080a0a70 0x7fb50811fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 -- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb508133f70 msgr2=0x7fb5081c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb508133f70 0x7fb5081c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 -- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5080a0a70 msgr2=0x7fb50811fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5080a0a70 0x7fb50811fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.753+0000 7fb50659c700 1 -- 172.21.15.125:0/1054720605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8009550 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb50659c700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9e0 tx=0x7fb4f800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800ee80 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f800c850 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc0094a0 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800cbc0 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.754+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50809d360 con 0x7fb50809ad40 2023-10-03T10:14:40.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.755+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f800cd20 con 0x7fb50809ad40 2023-10-03T10:14:40.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.755+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50804f2a0 con 0x7fb50809ad40 2023-10-03T10:14:40.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.755+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4f803f6c0 con 0x7fb50809ad40 2023-10-03T10:14:40.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.759+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f80232f0 con 0x7fb50809ad40 2023-10-03T10:14:40.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.792+0000 7f9e02ad7700 1 Processor -- start 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.792+0000 7f9e02ad7700 1 -- start start 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e02ad7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 0x7f9dfc138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e02ad7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e02ad7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc06bec0 con 0x7f9dfc09e870 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e02ad7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc06ce60 con 0x7f9dfc09f350 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e02ad7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc09fa00 con 0x7f9dfc139480 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9dfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 0x7f9dfc138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9dfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 0x7f9dfc138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32856/0 (socket says 172.21.15.125:32856) 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9dfbfff700 1 -- 172.21.15.125:0/416327798 learned_addr learned my addr 172.21.15.125:0/416327798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e00873700 1 --1- 172.21.15.125:0/416327798 >> v1:172.21.15.125:6789/0 conn(0x7f9dfc09e870 0x7f9dfc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39926/0 (socket says 172.21.15.125:39926) 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 -- 172.21.15.125:0/416327798 >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 msgr2=0x7f9dfc138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 --2- 172.21.15.125:0/416327798 >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 0x7f9dfc138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 -- 172.21.15.125:0/416327798 >> v1:172.21.15.125:6789/0 conn(0x7f9dfc09e870 legacy=0x7f9dfc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 -- 172.21.15.125:0/416327798 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc09ad80 con 0x7f9dfc139480 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.793+0000 7f9e01074700 1 --2- 172.21.15.125:0/416327798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc13b860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d3167ca7865621a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9dfb7fe700 1 -- 172.21.15.125:0/416327798 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400e070 con 0x7f9dfc139480 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9dfb7fe700 1 -- 172.21.15.125:0/416327798 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400bb20 con 0x7f9dfc139480 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9dfb7fe700 1 -- 172.21.15.125:0/416327798 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012430 con 0x7f9dfc139480 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 -- 172.21.15.125:0/416327798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 msgr2=0x7f9dfc13b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/416327798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc13b860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 -- 172.21.15.125:0/416327798 shutdown_connections 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/416327798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc13b860 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/416327798 >> v2:172.21.15.125:3300/0 conn(0x7f9dfc09f350 0x7f9dfc138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 -- 172.21.15.125:0/416327798 >> 172.21.15.125:0/416327798 conn(0x7f9dfc0a4430 msgr2=0x7f9dfc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 -- 172.21.15.125:0/416327798 shutdown_connections 2023-10-03T10:14:40.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.794+0000 7f9e02ad7700 1 -- 172.21.15.125:0/416327798 wait complete. 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.795+0000 7f9e02ad7700 1 Processor -- start 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.795+0000 7f9e02ad7700 1 -- start start 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 0x7f9dfc11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 0x7f9dfc11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc072670 con 0x7f9dfc09f350 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc06cfa0 con 0x7f9dfc139480 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc120670 con 0x7f9dfc09e870 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 0x7f9dfc11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e00873700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 0x7f9dfc11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 0x7f9dfc11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32858/0 (socket says 172.21.15.125:32858) 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57388/0 (socket says 172.21.15.125:57388) 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9dfbfff700 1 -- 172.21.15.125:0/1315245434 learned_addr learned my addr 172.21.15.125:0/1315245434 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 -- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 msgr2=0x7f9dfc11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 0x7f9dfc11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 -- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 msgr2=0x7f9dfc11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 0x7f9dfc11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 -- 172.21.15.125:0/1315245434 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009a70 con 0x7f9dfc139480 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e00873700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 0x7f9dfc11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e01074700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9df4016000 tx=0x7f9df4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012430 con 0x7f9dfc139480 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4020070 con 0x7f9dfc139480 2023-10-03T10:14:40.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004040 con 0x7f9dfc139480 2023-10-03T10:14:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.796+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc122190 con 0x7f9dfc139480 2023-10-03T10:14:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.797+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc121b20 con 0x7f9dfc139480 2023-10-03T10:14:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.797+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9df40041a0 con 0x7f9dfc139480 2023-10-03T10:14:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.797+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc04f2a0 con 0x7f9dfc139480 2023-10-03T10:14:40.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.798+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9df4022070 con 0x7f9dfc139480 2023-10-03T10:14:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.802+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9df4004450 con 0x7f9dfc139480 2023-10-03T10:14:40.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.952+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5080a5f80 con 0x7fb50809ad40 2023-10-03T10:14:40.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.953+0000 7fb4f6ffd700 1 -- 172.21.15.125:0/1054720605 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4f8021020 con 0x7fb50809ad40 2023-10-03T10:14:40.953 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:40.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 msgr2=0x7fb50811f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9e0 tx=0x7fb4f800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 shutdown_connections 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb508133f70 0x7fb5081c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb50809ad40 0x7fb50811f4f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 --2- 172.21.15.125:0/1054720605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5080a0a70 0x7fb50811fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 >> 172.21.15.125:0/1054720605 conn(0x7fb508099c40 msgr2=0x7fb50809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 shutdown_connections 2023-10-03T10:14:40.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.955+0000 7fb50cc91700 1 -- 172.21.15.125:0/1054720605 wait complete. 2023-10-03T10:14:40.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:40.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.993+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dfc072d60 con 0x7f9dfc139480 2023-10-03T10:14:40.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.994+0000 7f9df97fa700 1 -- 172.21.15.125:0/1315245434 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9df40263e0 con 0x7f9dfc139480 2023-10-03T10:14:40.994 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:40.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 msgr2=0x7f9dfc11f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9df4016000 tx=0x7f9df4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 shutdown_connections 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dfc139480 0x7f9dfc11f550 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dfc09e870 0x7f9dfc11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 --2- 172.21.15.125:0/1315245434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dfc09f350 0x7f9dfc11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 >> 172.21.15.125:0/1315245434 conn(0x7f9dfc0a4430 msgr2=0x7f9dfc0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 shutdown_connections 2023-10-03T10:14:40.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:40.996+0000 7f9e02ad7700 1 -- 172.21.15.125:0/1315245434 wait complete. 2023-10-03T10:14:41.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:41.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:41.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:41.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.605+0000 7fd964316700 1 Processor -- start 2023-10-03T10:14:41.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.605+0000 7fd964316700 1 -- start start 2023-10-03T10:14:41.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 0x7fd95c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 0x7fd95c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c09e9d0 con 0x7fd95c133f50 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c09dc00 con 0x7fd95c0a0a70 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd964316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c09dec0 con 0x7fd95c0a1380 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9620b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9628b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 0x7fd95c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9620b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57396/0 (socket says 172.21.15.125:57396) 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 0x7fd95c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9620b2700 1 -- 172.21.15.125:0/3358327646 learned_addr learned my addr 172.21.15.125:0/3358327646 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 -- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 msgr2=0x7fd95c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 -- 172.21.15.125:0/3358327646 >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 msgr2=0x7fd95c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 --2- 172.21.15.125:0/3358327646 >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 0x7fd95c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9618b1700 1 -- 172.21.15.125:0/3358327646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c09e6a0 con 0x7fd95c0a1380 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9628b3700 1 --2- 172.21.15.125:0/3358327646 >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 0x7fd95c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.606+0000 7fd9620b2700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd9618b1700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 0x7fd95c133a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009840 tx=0x7fd94c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ba06972f28d8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd9610b0700 1 -- 172.21.15.125:0/3358327646 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c011830 con 0x7fd95c0a1380 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd9610b0700 1 -- 172.21.15.125:0/3358327646 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c011990 con 0x7fd95c0a1380 2023-10-03T10:14:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd9610b0700 1 -- 172.21.15.125:0/3358327646 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c011d20 con 0x7fd95c0a1380 2023-10-03T10:14:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 -- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 msgr2=0x7fd95c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 0x7fd95c133a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009840 tx=0x7fd94c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 -- 172.21.15.125:0/3358327646 shutdown_connections 2023-10-03T10:14:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a0a70 0x7fd95c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 --2- 172.21.15.125:0/3358327646 >> v2:172.21.15.125:3300/0 conn(0x7fd95c133f50 0x7fd95c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 --2- 172.21.15.125:0/3358327646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a1380 0x7fd95c133a10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.607+0000 7fd964316700 1 -- 172.21.15.125:0/3358327646 >> 172.21.15.125:0/3358327646 conn(0x7fd95c0a6610 msgr2=0x7fd95c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.608+0000 7fd964316700 1 -- 172.21.15.125:0/3358327646 shutdown_connections 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.608+0000 7fd964316700 1 -- 172.21.15.125:0/3358327646 wait complete. 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.609+0000 7fd964316700 1 Processor -- start 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.609+0000 7fd964316700 1 -- start start 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.609+0000 7fd964316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a1380 0x7fd95c122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c125df0 con 0x7fd95c133f50 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c123aa0 con 0x7fd95c0a1380 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c1242d0 con 0x7fd95c0a0a70 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9620b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9620b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57868/0 (socket says 172.21.15.125:57868) 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9620b2700 1 -- 172.21.15.125:0/3609187616 learned_addr learned my addr 172.21.15.125:0/3609187616 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32888/0 (socket says 172.21.15.125:32888) 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9618b1700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a1380 0x7fd95c122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 -- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 msgr2=0x7fd95c122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 -- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a1380 msgr2=0x7fd95c122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a1380 0x7fd95c122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 -- 172.21.15.125:0/3609187616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009550 con 0x7fd95c133f50 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9620b2700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd9628b3700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd954009e50 tx=0x7fd95400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400ca90 con 0x7fd95c133f50 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400f040 con 0x7fd95c133f50 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd954009a70 con 0x7fd95c133f50 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400ce50 con 0x7fd95c133f50 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.610+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c0094a0 con 0x7fd95c133f50 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.611+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd954014480 con 0x7fd95c133f50 2023-10-03T10:14:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.611+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd95403fd40 con 0x7fd95c133f50 2023-10-03T10:14:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.611+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c0a4600 con 0x7fd95c133f50 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.616+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd954012520 con 0x7fd95c133f50 2023-10-03T10:14:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.647+0000 7ffad03f3700 1 Processor -- start 2023-10-03T10:14:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.647+0000 7ffad03f3700 1 -- start start 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffad03f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 0x7ffac8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffad03f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffad03f3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac809c970 con 0x7ffac809e870 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffad03f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80a0920 con 0x7ffac809f350 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffad03f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac809f9c0 con 0x7ffac81371c0 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57872/0 (socket says 172.21.15.125:57872) 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface18f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ffac809e870 0x7ffac809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39942/0 (socket says 172.21.15.125:39942) 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 -- 172.21.15.125:0/600998055 learned_addr learned my addr 172.21.15.125:0/600998055 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffacd98e700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 0x7ffac8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 -- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 msgr2=0x7ffac8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 0x7ffac8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 -- 172.21.15.125:0/600998055 >> v1:172.21.15.125:6789/0 conn(0x7ffac809e870 legacy=0x7ffac809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffacd18d700 1 -- 172.21.15.125:0/600998055 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102988946 0 0) 0x7ffac809c970 con 0x7ffac809e870 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 -- 172.21.15.125:0/600998055 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac809bab0 con 0x7ffac81371c0 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffacd98e700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 0x7ffac8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7fface990700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e80 tx=0x7ffac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43b75a9a6691945 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.648+0000 7ffacd18d700 1 -- 172.21.15.125:0/600998055 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000e070 con 0x7ffac81371c0 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffacd18d700 1 -- 172.21.15.125:0/600998055 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000b910 con 0x7ffac81371c0 2023-10-03T10:14:41.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffacd18d700 1 -- 172.21.15.125:0/600998055 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000bcc0 con 0x7ffac81371c0 2023-10-03T10:14:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 -- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 msgr2=0x7ffac81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e80 tx=0x7ffac000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 -- 172.21.15.125:0/600998055 shutdown_connections 2023-10-03T10:14:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac81371c0 0x7ffac81395a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 --2- 172.21.15.125:0/600998055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809f350 0x7ffac8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 -- 172.21.15.125:0/600998055 >> 172.21.15.125:0/600998055 conn(0x7ffac80a4430 msgr2=0x7ffac80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 -- 172.21.15.125:0/600998055 shutdown_connections 2023-10-03T10:14:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.649+0000 7ffad03f3700 1 -- 172.21.15.125:0/600998055 wait complete. 2023-10-03T10:14:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 Processor -- start 2023-10-03T10:14:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 -- start start 2023-10-03T10:14:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 0x7ffac8120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac81371c0 0x7ffac81210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8124210 con 0x7ffac81371c0 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8121ab0 con 0x7ffac809e870 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.651+0000 7ffad03f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8072130 con 0x7ffac809f350 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57424/0 (socket says 172.21.15.125:57424) 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 -- 172.21.15.125:0/3120790606 learned_addr learned my addr 172.21.15.125:0/3120790606 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffacd98e700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 0x7ffac8120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface990700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac81371c0 0x7ffac81210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 -- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 msgr2=0x7ffac8120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 0x7ffac8120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 -- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac81371c0 msgr2=0x7ffac81210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac81371c0 0x7ffac81210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 -- 172.21.15.125:0/3120790606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40094a0 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffacd98e700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 0x7ffac8120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7fface18f700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c520 tx=0x7ffab800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004c80 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab8004e00 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac0009b30 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8007310 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.652+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac8122a50 con 0x7ffac809e870 2023-10-03T10:14:41.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.653+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab8007470 con 0x7ffac809e870 2023-10-03T10:14:41.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.653+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffab803f3a0 con 0x7ffac809e870 2023-10-03T10:14:41.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.653+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac8123ae0 con 0x7ffac809e870 2023-10-03T10:14:41.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.658+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab80123b0 con 0x7ffac809e870 2023-10-03T10:14:41.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.811+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd95c04f2a0 con 0x7fd95c133f50 2023-10-03T10:14:41.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.811+0000 7fd952ffd700 1 -- 172.21.15.125:0/3609187616 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd954012340 con 0x7fd95c133f50 2023-10-03T10:14:41.814 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 msgr2=0x7fd95c1230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd954009e50 tx=0x7fd95400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 shutdown_connections 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c133f50 0x7fd95c1230c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd95c0a0a70 0x7fd95c122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 --2- 172.21.15.125:0/3609187616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95c0a1380 0x7fd95c122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 >> 172.21.15.125:0/3609187616 conn(0x7fd95c0a6610 msgr2=0x7fd95c09f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 shutdown_connections 2023-10-03T10:14:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.813+0000 7fd964316700 1 -- 172.21.15.125:0/3609187616 wait complete. 2023-10-03T10:14:41.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:41.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.851+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffac804f2a0 con 0x7ffac809e870 2023-10-03T10:14:41.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.852+0000 7ffabeffd700 1 -- 172.21.15.125:0/3120790606 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffab8011360 con 0x7ffac809e870 2023-10-03T10:14:41.852 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:41.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 msgr2=0x7ffac8120650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c520 tx=0x7ffab800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 shutdown_connections 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac81371c0 0x7ffac81210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffac809e870 0x7ffac8120650 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 --2- 172.21.15.125:0/3120790606 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffac809f350 0x7ffac8120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 >> 172.21.15.125:0/3120790606 conn(0x7ffac80a4430 msgr2=0x7ffac80a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 shutdown_connections 2023-10-03T10:14:41.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:41.854+0000 7ffad03f3700 1 -- 172.21.15.125:0/3120790606 wait complete. 2023-10-03T10:14:41.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:41.968 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:42.009 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:42.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 Processor -- start 2023-10-03T10:14:42.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 -- start start 2023-10-03T10:14:42.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 0x7fbfdc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc09dc00 con 0x7fbfdc133f50 2023-10-03T10:14:42.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc09ea60 con 0x7fbfdc0a1380 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe2dc2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc09dec0 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe0b5e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe0b5e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57440/0 (socket says 172.21.15.125:57440) 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfe0b5e700 1 -- 172.21.15.125:0/2544883723 learned_addr learned my addr 172.21.15.125:0/2544883723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.093+0000 7fbfdbfff700 1 --2- 172.21.15.125:0/2544883723 >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 0x7fbfdc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfe0b5e700 1 -- 172.21.15.125:0/2544883723 >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 msgr2=0x7fbfdc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfe0b5e700 1 --2- 172.21.15.125:0/2544883723 >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 0x7fbfdc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfe0b5e700 1 -- 172.21.15.125:0/2544883723 >> v1:172.21.15.125:6789/0 conn(0x7fbfdc133f50 legacy=0x7fbfdc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfe0b5e700 1 -- 172.21.15.125:0/2544883723 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc09e6a0 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfdbfff700 1 --2- 172.21.15.125:0/2544883723 >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 0x7fbfdc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfe0b5e700 1 --2- 172.21.15.125:0/2544883723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb99a8ac5bbdd4fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfdb7fe700 1 -- 172.21.15.125:0/2544883723 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011830 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfdb7fe700 1 -- 172.21.15.125:0/2544883723 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0011990 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.094+0000 7fbfdb7fe700 1 -- 172.21.15.125:0/2544883723 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011d20 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2544883723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 msgr2=0x7fbfdc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2544883723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2544883723 shutdown_connections 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2544883723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc0a0a70 0x7fbfdc0a0e40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2544883723 >> v2:172.21.15.125:3300/0 conn(0x7fbfdc0a1380 0x7fbfdc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2544883723 >> 172.21.15.125:0/2544883723 conn(0x7fbfdc0a6610 msgr2=0x7fbfdc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2544883723 shutdown_connections 2023-10-03T10:14:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.095+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2544883723 wait complete. 2023-10-03T10:14:42.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 Processor -- start 2023-10-03T10:14:42.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 -- start start 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfdc0a1380 0x7fbfdc1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc1247f0 con 0x7fbfdc0a0a70 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc124600 con 0x7fbfdc133f50 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe2dc2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc1252e0 con 0x7fbfdc0a1380 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe135f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe0b5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe135f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57454/0 (socket says 172.21.15.125:57454) 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe0b5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32928/0 (socket says 172.21.15.125:32928) 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfe135f700 1 -- 172.21.15.125:0/2002912383 learned_addr learned my addr 172.21.15.125:0/2002912383 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.096+0000 7fbfdbfff700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfdc0a1380 0x7fbfdc1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 -- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfdc0a1380 msgr2=0x7fbfdc1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfdc0a1380 0x7fbfdc1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 -- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 msgr2=0x7fbfdc1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 -- 172.21.15.125:0/2002912383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80094a0 con 0x7fbfdc133f50 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe0b5e700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe135f700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400cc50 tx=0x7fbfd400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4003c00 con 0x7fbfdc133f50 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd4003d60 con 0x7fbfdc133f50 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd0009550 con 0x7fbfdc133f50 2023-10-03T10:14:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400aab0 con 0x7fbfdc133f50 2023-10-03T10:14:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.097+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc126230 con 0x7fbfdc133f50 2023-10-03T10:14:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.098+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfd400ac10 con 0x7fbfdc133f50 2023-10-03T10:14:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.098+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfd403f620 con 0x7fbfdc133f50 2023-10-03T10:14:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.098+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc04f2a0 con 0x7fbfdc133f50 2023-10-03T10:14:42.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.103+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfd40050d0 con 0x7fbfdc133f50 2023-10-03T10:14:42.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.136+0000 7f63ad1ce700 1 Processor -- start 2023-10-03T10:14:42.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.136+0000 7f63ad1ce700 1 -- start start 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.136+0000 7f63ad1ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 0x7f63a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.136+0000 7f63ad1ce700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63a809f180 0x7f63a8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.136+0000 7f63ad1ce700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a809c970 con 0x7f63a8131d70 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63ad1ce700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80a0920 con 0x7f63a809f180 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63ad1ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a809f9c0 con 0x7f63a809e870 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63a809f180 0x7f63a8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 0x7f63a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a759e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f63a8131d70 0x7f63a8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39968/0 (socket says 172.21.15.125:39968) 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a759e700 1 -- 172.21.15.125:0/2144565182 learned_addr learned my addr 172.21.15.125:0/2144565182 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2144565182 >> v2:172.21.15.125:3300/0 conn(0x7f63a809f180 msgr2=0x7f63a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 --2- 172.21.15.125:0/2144565182 >> v2:172.21.15.125:3300/0 conn(0x7f63a809f180 0x7f63a8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2144565182 >> v1:172.21.15.125:6789/0 conn(0x7f63a8131d70 legacy=0x7f63a8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2144565182 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a809bab0 con 0x7f63a809e870 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a5d9b700 1 -- 172.21.15.125:0/2144565182 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368558989 0 0) 0x7f63a809c970 con 0x7f63a8131d70 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a6d9d700 1 --2- 172.21.15.125:0/2144565182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 0x7f63a809ec40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6398009d90 tx=0x7f639800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78729486f321c7d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a5d9b700 1 -- 172.21.15.125:0/2144565182 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800e070 con 0x7f63a809e870 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a5d9b700 1 -- 172.21.15.125:0/2144565182 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800bb20 con 0x7f63a809e870 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.137+0000 7f63a5d9b700 1 -- 172.21.15.125:0/2144565182 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398012430 con 0x7f63a809e870 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2144565182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 msgr2=0x7f63a809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2144565182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 0x7f63a809ec40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6398009d90 tx=0x7f639800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2144565182 shutdown_connections 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2144565182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a809e870 0x7f63a809ec40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2144565182 >> v2:172.21.15.125:3300/0 conn(0x7f63a809f180 0x7f63a8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2144565182 >> 172.21.15.125:0/2144565182 conn(0x7f63a80a4430 msgr2=0x7f63a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2144565182 shutdown_connections 2023-10-03T10:14:42.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.138+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2144565182 wait complete. 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.139+0000 7f63ad1ce700 1 Processor -- start 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.139+0000 7f63ad1ce700 1 -- start start 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.139+0000 7f63ad1ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 0x7f63a806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80a2a40 con 0x7f63a809e870 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a806cd00 con 0x7f63a809f180 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8130410 con 0x7f63a8131d70 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57910/0 (socket says 172.21.15.125:57910) 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a759e700 1 -- 172.21.15.125:0/2102988306 learned_addr learned my addr 172.21.15.125:0/2102988306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32938/0 (socket says 172.21.15.125:32938) 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a659c700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 0x7f63a806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 msgr2=0x7f63a81c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 msgr2=0x7f63a806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 0x7f63a806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 -- 172.21.15.125:0/2102988306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398009a70 con 0x7f63a809e870 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a759e700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a659c700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 0x7f63a806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63a6d9d700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6398016000 tx=0x7f6398004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398012430 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398020070 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a806bd90 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398004280 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.140+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a81305e0 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.141+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a81205a0 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.142+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63980043e0 con 0x7f63a809e870 2023-10-03T10:14:42.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.142+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6398022070 con 0x7f63a809e870 2023-10-03T10:14:42.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.146+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6398031430 con 0x7f63a809e870 2023-10-03T10:14:42.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.300+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbfdc124b70 con 0x7fbfdc133f50 2023-10-03T10:14:42.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.301+0000 7fbfd97fa700 1 -- 172.21.15.125:0/2002912383 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfd4011380 con 0x7fbfdc133f50 2023-10-03T10:14:42.301 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 msgr2=0x7fbfdc1c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400cc50 tx=0x7fbfd400cf60 comp rx=0 tx=0).stop 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 shutdown_connections 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfdc133f50 0x7fbfdc1c8c80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfdc0a0a70 0x7fbfdc1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 --2- 172.21.15.125:0/2002912383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfdc0a1380 0x7fbfdc1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 >> 172.21.15.125:0/2002912383 conn(0x7fbfdc0a6610 msgr2=0x7fbfdc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 shutdown_connections 2023-10-03T10:14:42.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.303+0000 7fbfe2dc2700 1 -- 172.21.15.125:0/2002912383 wait complete. 2023-10-03T10:14:42.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:42.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.340+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63a804f2a0 con 0x7f63a809e870 2023-10-03T10:14:42.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.340+0000 7f639f7fe700 1 -- 172.21.15.125:0/2102988306 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6398035090 con 0x7f63a809e870 2023-10-03T10:14:42.340 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:42.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 msgr2=0x7f63a806c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6398016000 tx=0x7f6398004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 shutdown_connections 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f63a8131d70 0x7f63a81c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63a809e870 0x7f63a806c280 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 --2- 172.21.15.125:0/2102988306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63a809f180 0x7f63a806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 >> 172.21.15.125:0/2102988306 conn(0x7f63a80a4430 msgr2=0x7f63a809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 shutdown_connections 2023-10-03T10:14:42.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.342+0000 7f63ad1ce700 1 -- 172.21.15.125:0/2102988306 wait complete. 2023-10-03T10:14:42.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:42.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:42.866 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.955+0000 7f5f444f8700 1 Processor -- start 2023-10-03T10:14:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.955+0000 7f5f444f8700 1 -- start start 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f444f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 0x7f5f3c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f444f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 0x7f5f3c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f444f8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c09c970 con 0x7f5f3c09e870 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f444f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0a0920 con 0x7f5f3c09f350 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f444f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c09f9c0 con 0x7f5f3c1371c0 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 0x7f5f3c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41a93700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 0x7f5f3c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42294700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f3c09e870 0x7f5f3c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39980/0 (socket says 172.21.15.125:39980) 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42294700 1 -- 172.21.15.125:0/3624859688 learned_addr learned my addr 172.21.15.125:0/3624859688 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 -- 172.21.15.125:0/3624859688 >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 msgr2=0x7f5f3c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 --2- 172.21.15.125:0/3624859688 >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 0x7f5f3c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41292700 1 -- 172.21.15.125:0/3624859688 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863400554 0 0) 0x7f5f3c09c970 con 0x7f5f3c09e870 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 -- 172.21.15.125:0/3624859688 >> v1:172.21.15.125:6789/0 conn(0x7f5f3c09e870 legacy=0x7f5f3c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 -- 172.21.15.125:0/3624859688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c09bab0 con 0x7f5f3c1371c0 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41a93700 1 --2- 172.21.15.125:0/3624859688 >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 0x7f5f3c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f42a95700 1 --2- 172.21.15.125:0/3624859688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 0x7f5f3c1395a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009d90 tx=0x7f5f3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b617529292019dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41292700 1 -- 172.21.15.125:0/3624859688 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400e070 con 0x7f5f3c1371c0 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41292700 1 -- 172.21.15.125:0/3624859688 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400bb20 con 0x7f5f3c1371c0 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.956+0000 7f5f41292700 1 -- 172.21.15.125:0/3624859688 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34012430 con 0x7f5f3c1371c0 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 -- 172.21.15.125:0/3624859688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 msgr2=0x7f5f3c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 --2- 172.21.15.125:0/3624859688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 0x7f5f3c1395a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009d90 tx=0x7f5f3400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 -- 172.21.15.125:0/3624859688 shutdown_connections 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 --2- 172.21.15.125:0/3624859688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c1371c0 0x7f5f3c1395a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 --2- 172.21.15.125:0/3624859688 >> v2:172.21.15.125:3300/0 conn(0x7f5f3c09f350 0x7f5f3c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 -- 172.21.15.125:0/3624859688 >> 172.21.15.125:0/3624859688 conn(0x7f5f3c0a4430 msgr2=0x7f5f3c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 -- 172.21.15.125:0/3624859688 shutdown_connections 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.957+0000 7f5f444f8700 1 -- 172.21.15.125:0/3624859688 wait complete. 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 Processor -- start 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 -- start start 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f3c09f350 0x7f5f3c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3c1371c0 0x7f5f3c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c126170 con 0x7f5f3c1371c0 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c09dba0 con 0x7f5f3c09e870 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.958+0000 7f5f444f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c06d5d0 con 0x7f5f3c09f350 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57476/0 (socket says 172.21.15.125:57476) 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 -- 172.21.15.125:0/325062614 learned_addr learned my addr 172.21.15.125:0/325062614 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42a95700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3c1371c0 0x7f5f3c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f41a93700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f3c09f350 0x7f5f3c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 -- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f3c09f350 msgr2=0x7f5f3c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f3c09f350 0x7f5f3c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 -- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3c1371c0 msgr2=0x7f5f3c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3c1371c0 0x7f5f3c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 -- 172.21.15.125:0/325062614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0094a0 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f42294700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c550 tx=0x7f5f3800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004c80 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38004e00 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f34009a70 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38007310 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.959+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c126be0 con 0x7f5f3c09e870 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.960+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f38007470 con 0x7f5f3c09e870 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.960+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f3803f300 con 0x7f5f3c09e870 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.960+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c04f2a0 con 0x7f5f3c09e870 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.965+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f380123b0 con 0x7f5f3c09e870 2023-10-03T10:14:42.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.994+0000 7ff5ede5d700 1 Processor -- start 2023-10-03T10:14:42.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.994+0000 7ff5ede5d700 1 -- start start 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 0x7ff5e8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 0x7ff5e81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e809e9d0 con 0x7ff5e8133f50 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e809dc00 con 0x7ff5e80a1380 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5ede5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e809dec0 con 0x7ff5e80a0a70 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 0x7ff5e8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57932/0 (socket says 172.21.15.125:57932) 2023-10-03T10:14:42.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e77fe700 1 -- 172.21.15.125:0/3214256485 learned_addr learned my addr 172.21.15.125:0/3214256485 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e7fff700 1 --2- 172.21.15.125:0/3214256485 >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 0x7ff5e81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 -- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 msgr2=0x7ff5e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 -- 172.21.15.125:0/3214256485 >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 msgr2=0x7ff5e81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 --2- 172.21.15.125:0/3214256485 >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 0x7ff5e81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 -- 172.21.15.125:0/3214256485 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e809e6a0 con 0x7ff5e80a1380 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e7fff700 1 --2- 172.21.15.125:0/3214256485 >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 0x7ff5e81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e77fe700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e6ffd700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 0x7ff5e8133a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009840 tx=0x7ff5dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebec4e461e83584 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e67fc700 1 -- 172.21.15.125:0/3214256485 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc011830 con 0x7ff5e80a1380 2023-10-03T10:14:42.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e67fc700 1 -- 172.21.15.125:0/3214256485 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc011990 con 0x7ff5e80a1380 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.995+0000 7ff5e67fc700 1 -- 172.21.15.125:0/3214256485 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc011d20 con 0x7ff5e80a1380 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 -- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 msgr2=0x7ff5e8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 0x7ff5e8133a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009840 tx=0x7ff5dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 -- 172.21.15.125:0/3214256485 shutdown_connections 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/3214256485 >> v2:172.21.15.125:3300/0 conn(0x7ff5e8133f50 0x7ff5e81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a0a70 0x7ff5e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/3214256485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e80a1380 0x7ff5e8133a10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 -- 172.21.15.125:0/3214256485 >> 172.21.15.125:0/3214256485 conn(0x7ff5e80a6610 msgr2=0x7ff5e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 -- 172.21.15.125:0/3214256485 shutdown_connections 2023-10-03T10:14:42.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.996+0000 7ff5ede5d700 1 -- 172.21.15.125:0/3214256485 wait complete. 2023-10-03T10:14:43.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.997+0000 7ff5ede5d700 1 Processor -- start 2023-10-03T10:14:43.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.997+0000 7ff5ede5d700 1 -- start start 2023-10-03T10:14:43.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.997+0000 7ff5ede5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.997+0000 7ff5ede5d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 0x7ff5e811f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 0x7ff5e811fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8122e70 con 0x7ff5e80a0a70 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8122960 con 0x7ff5e8133f50 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8121e00 con 0x7ff5e80a1380 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 0x7ff5e811f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 0x7ff5e811fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32980/0 (socket says 172.21.15.125:32980) 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 0x7ff5e811f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57936/0 (socket says 172.21.15.125:57936) 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 -- 172.21.15.125:0/4173588722 learned_addr learned my addr 172.21.15.125:0/4173588722 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:43.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 -- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 msgr2=0x7ff5e811f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 0x7ff5e811f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 -- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 msgr2=0x7ff5e811fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 0x7ff5e811fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 -- 172.21.15.125:0/4173588722 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009550 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e7fff700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 0x7ff5e811fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5e77fe700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800ebe0 tx=0x7ff5d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8004030 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8004190 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0009a70 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8004520 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.998+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0094a0 con 0x7ff5e80a0a70 2023-10-03T10:14:43.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.999+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5d800c7f0 con 0x7ff5e80a0a70 2023-10-03T10:14:43.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.999+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5d803f570 con 0x7ff5e80a0a70 2023-10-03T10:14:43.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:42.999+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e809c520 con 0x7ff5e80a0a70 2023-10-03T10:14:43.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.004+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5d80036a0 con 0x7ff5e80a0a70 2023-10-03T10:14:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.152+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f3c06b2a0 con 0x7f5f3c09e870 2023-10-03T10:14:43.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.153+0000 7f5f32ffd700 1 -- 172.21.15.125:0/325062614 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f38011360 con 0x7f5f3c09e870 2023-10-03T10:14:43.154 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:43.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 msgr2=0x7f5f3c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c550 tx=0x7f5f3800c860 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 shutdown_connections 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3c1371c0 0x7f5f3c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f3c09e870 0x7f5f3c06b8b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 --2- 172.21.15.125:0/325062614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f3c09f350 0x7f5f3c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 >> 172.21.15.125:0/325062614 conn(0x7f5f3c0a4430 msgr2=0x7f5f3c0a2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 shutdown_connections 2023-10-03T10:14:43.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.155+0000 7f5f444f8700 1 -- 172.21.15.125:0/325062614 wait complete. 2023-10-03T10:14:43.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:43.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.194+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5e804f2a0 con 0x7ff5e80a0a70 2023-10-03T10:14:43.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.195+0000 7ff5cffff700 1 -- 172.21.15.125:0/4173588722 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5d8019ab0 con 0x7ff5e80a0a70 2023-10-03T10:14:43.197 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 msgr2=0x7ff5e811f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800ebe0 tx=0x7ff5d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 shutdown_connections 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5e8133f50 0x7ff5e811fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5e80a0a70 0x7ff5e811f350 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 --2- 172.21.15.125:0/4173588722 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5e80a1380 0x7ff5e811f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 >> 172.21.15.125:0/4173588722 conn(0x7ff5e80a6610 msgr2=0x7ff5e809f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 shutdown_connections 2023-10-03T10:14:43.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.197+0000 7ff5ede5d700 1 -- 172.21.15.125:0/4173588722 wait complete. 2023-10-03T10:14:43.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:43.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:43.355 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:43.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.445+0000 7f74d37e0700 1 Processor -- start 2023-10-03T10:14:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.445+0000 7f74d37e0700 1 -- start start 2023-10-03T10:14:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d37e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d37e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d37e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc09dc00 con 0x7f74cc0a1380 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d37e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc09ea90 con 0x7f74cc134120 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d37e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc09dec0 con 0x7f74cc0a0a70 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d0d7b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f74cc0a1380 0x7f74cc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39982/0 (socket says 172.21.15.125:39982) 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d0d7b700 1 -- 172.21.15.125:0/547881804 learned_addr learned my addr 172.21.15.125:0/547881804 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d1d7d700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d157c700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74c3fff700 1 -- 172.21.15.125:0/547881804 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034153216 0 0) 0x7f74cc09dc00 con 0x7f74cc0a1380 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d157c700 1 -- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 msgr2=0x7f74cc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d157c700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d157c700 1 -- 172.21.15.125:0/547881804 >> v1:172.21.15.125:6789/0 conn(0x7f74cc0a1380 legacy=0x7f74cc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d157c700 1 -- 172.21.15.125:0/547881804 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc09e6a0 con 0x7f74cc0a0a70 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.446+0000 7f74d1d7d700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d157c700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc0a0e40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009870 tx=0x7f74c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9caae0bcbb9986 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74c3fff700 1 -- 172.21.15.125:0/547881804 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011830 con 0x7f74cc0a0a70 2023-10-03T10:14:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74c3fff700 1 -- 172.21.15.125:0/547881804 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8011990 con 0x7f74cc0a0a70 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74c3fff700 1 -- 172.21.15.125:0/547881804 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011d20 con 0x7f74cc0a0a70 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 -- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 msgr2=0x7f74cc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc0a0e40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009870 tx=0x7f74c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 -- 172.21.15.125:0/547881804 shutdown_connections 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 --2- 172.21.15.125:0/547881804 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc0a0e40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 -- 172.21.15.125:0/547881804 >> 172.21.15.125:0/547881804 conn(0x7f74cc0a6610 msgr2=0x7f74cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 -- 172.21.15.125:0/547881804 shutdown_connections 2023-10-03T10:14:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.447+0000 7f74d37e0700 1 -- 172.21.15.125:0/547881804 wait complete. 2023-10-03T10:14:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 Processor -- start 2023-10-03T10:14:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 -- start start 2023-10-03T10:14:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74cc0a1380 0x7f74cc122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc125920 con 0x7f74cc0a1380 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc124310 con 0x7f74cc134120 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d37e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1332d0 con 0x7f74cc0a0a70 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d1d7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d0d7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74cc0a1380 0x7f74cc122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d1d7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57522/0 (socket says 172.21.15.125:57522) 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d1d7d700 1 -- 172.21.15.125:0/602606950 learned_addr learned my addr 172.21.15.125:0/602606950 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.449+0000 7f74d157c700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 -- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 msgr2=0x7f74cc122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 -- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74cc0a1380 msgr2=0x7f74cc122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74cc0a1380 0x7f74cc122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 -- 172.21.15.125:0/602606950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74cc134120 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d1d7d700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74c400efc0 tx=0x7f74c400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400ca90 con 0x7f74cc134120 2023-10-03T10:14:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400f040 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80094a0 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400ce10 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.450+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc0a03e0 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.451+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74c4014480 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.451+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74c403fc90 con 0x7f74cc134120 2023-10-03T10:14:43.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.451+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc04f2a0 con 0x7f74cc134120 2023-10-03T10:14:43.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.456+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74c4012700 con 0x7f74cc134120 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.493+0000 7fb0dfaba700 1 Processor -- start 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.493+0000 7fb0dfaba700 1 -- start start 2023-10-03T10:14:43.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d806b5c0 con 0x7fb0d8131a00 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d806e900 con 0x7fb0d809dec0 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dfaba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809d180 con 0x7fb0d806a770 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd856700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0de057700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0de057700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33000/0 (socket says 172.21.15.125:33000) 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0de057700 1 -- 172.21.15.125:0/3209679212 learned_addr learned my addr 172.21.15.125:0/3209679212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57532/0 (socket says 172.21.15.125:57532) 2023-10-03T10:14:43.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd856700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57968/0 (socket says 172.21.15.125:57968) 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 -- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 msgr2=0x7fb0d806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 -- 172.21.15.125:0/3209679212 >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 msgr2=0x7fb0d8131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 --2- 172.21.15.125:0/3209679212 >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 -- 172.21.15.125:0/3209679212 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d809e780 con 0x7fb0d809dec0 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0de057700 1 --2- 172.21.15.125:0/3209679212 >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd856700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.494+0000 7fb0dd055700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f538d810f902f596 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dc854700 1 -- 172.21.15.125:0/3209679212 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011830 con 0x7fb0d809dec0 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dc854700 1 -- 172.21.15.125:0/3209679212 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8011990 con 0x7fb0d809dec0 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dc854700 1 -- 172.21.15.125:0/3209679212 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011d20 con 0x7fb0d809dec0 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 -- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 msgr2=0x7fb0d806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 -- 172.21.15.125:0/3209679212 shutdown_connections 2023-10-03T10:14:43.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/3209679212 >> v2:172.21.15.125:3300/0 conn(0x7fb0d8131a00 0x7fb0d8131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d806a770 0x7fb0d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/3209679212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d806b080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 -- 172.21.15.125:0/3209679212 >> 172.21.15.125:0/3209679212 conn(0x7fb0d8099c40 msgr2=0x7fb0d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 -- 172.21.15.125:0/3209679212 shutdown_connections 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.495+0000 7fb0dfaba700 1 -- 172.21.15.125:0/3209679212 wait complete. 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.496+0000 7fb0dfaba700 1 Processor -- start 2023-10-03T10:14:43.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.496+0000 7fb0dfaba700 1 -- start start 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 0x7fb0d811a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d811d9e0 con 0x7fb0d806a770 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d811c0f0 con 0x7fb0d809dec0 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d811cdb0 con 0x7fb0d8131a00 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd856700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57534/0 (socket says 172.21.15.125:57534) 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd856700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33014/0 (socket says 172.21.15.125:33014) 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 -- 172.21.15.125:0/1796849184 learned_addr learned my addr 172.21.15.125:0/1796849184 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0de057700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 0x7fb0d811a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 -- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 msgr2=0x7fb0d811a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 0x7fb0d811a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 -- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 msgr2=0x7fb0d8119ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 -- 172.21.15.125:0/1796849184 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40094a0 con 0x7fb0d809dec0 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0de057700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 0x7fb0d811a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd856700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dd055700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000c00 tx=0x7fb0c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8004450 con 0x7fb0d809dec0 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c801f070 con 0x7fb0d809dec0 2023-10-03T10:14:43.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d0009b30 con 0x7fb0d809dec0 2023-10-03T10:14:43.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80038e0 con 0x7fb0d809dec0 2023-10-03T10:14:43.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.497+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c80094a0 con 0x7fb0d809dec0 2023-10-03T10:14:43.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.498+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0c8003a40 con 0x7fb0d809dec0 2023-10-03T10:14:43.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.498+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0c8021070 con 0x7fb0d809dec0 2023-10-03T10:14:43.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.498+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d811d560 con 0x7fb0d809dec0 2023-10-03T10:14:43.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.503+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d811d560 con 0x7fb0d809dec0 2023-10-03T10:14:43.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.648+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74cc072980 con 0x7f74cc134120 2023-10-03T10:14:43.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.649+0000 7f74c1ffb700 1 -- 172.21.15.125:0/602606950 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74c402a090 con 0x7f74cc134120 2023-10-03T10:14:43.650 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:43.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 msgr2=0x7f74cc123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74c400efc0 tx=0x7f74c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 shutdown_connections 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74cc134120 0x7f74cc123180 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f74cc0a0a70 0x7f74cc122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 --2- 172.21.15.125:0/602606950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74cc0a1380 0x7f74cc122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 >> 172.21.15.125:0/602606950 conn(0x7f74cc0a6610 msgr2=0x7f74cc09aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 shutdown_connections 2023-10-03T10:14:43.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.651+0000 7f74d37e0700 1 -- 172.21.15.125:0/602606950 wait complete. 2023-10-03T10:14:43.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:43.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.693+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0d811d560 con 0x7fb0d809dec0 2023-10-03T10:14:43.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.694+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/1796849184 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d811d560 con 0x7fb0d809dec0 2023-10-03T10:14:43.694 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:43.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 msgr2=0x7fb0d811a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000c00 tx=0x7fb0c8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 shutdown_connections 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8131a00 0x7fb0d811a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d806a770 0x7fb0d8119ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 --2- 172.21.15.125:0/1796849184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d809dec0 0x7fb0d811a400 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 >> 172.21.15.125:0/1796849184 conn(0x7fb0d8099c40 msgr2=0x7fb0d812ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 shutdown_connections 2023-10-03T10:14:43.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:43.696+0000 7fb0dfaba700 1 -- 172.21.15.125:0/1796849184 wait complete. 2023-10-03T10:14:43.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:44.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:44.213 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.302+0000 7f1da3042700 1 Processor -- start 2023-10-03T10:14:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.302+0000 7f1da3042700 1 -- start start 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da3042700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da3042700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9c133f70 0x7f1d9c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da3042700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c09b110 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da3042700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0a3b60 con 0x7f1d9c133f70 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da3042700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1348e0 con 0x7f1d9c09ad40 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da0dde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9c133f70 0x7f1d9c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9c133f70 0x7f1d9c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33028/0 (socket says 172.21.15.125:33028) 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da0dde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57544/0 (socket says 172.21.15.125:57544) 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 -- 172.21.15.125:0/1351282556 learned_addr learned my addr 172.21.15.125:0/1351282556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 -- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 msgr2=0x7f1d9c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 -- 172.21.15.125:0/1351282556 >> v1:172.21.15.125:6789/0 conn(0x7f1d9c0a0a70 legacy=0x7f1d9c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 -- 172.21.15.125:0/1351282556 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0a2fa0 con 0x7f1d9c133f70 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9b7fe700 1 -- 172.21.15.125:0/1351282556 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757297724 0 0) 0x7f1d9c09b110 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1da0dde700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.303+0000 7f1d9bfff700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c133f70 0x7f1d9c1343a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1d880098f0 tx=0x7f1d88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf78afd81b1ba5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1d9b7fe700 1 -- 172.21.15.125:0/1351282556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88011830 con 0x7f1d9c133f70 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1d9b7fe700 1 -- 172.21.15.125:0/1351282556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88011990 con 0x7f1d9c133f70 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1d9b7fe700 1 -- 172.21.15.125:0/1351282556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88011d20 con 0x7f1d9c133f70 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 -- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c133f70 msgr2=0x7f1d9c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c133f70 0x7f1d9c1343a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1d880098f0 tx=0x7f1d88009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 -- 172.21.15.125:0/1351282556 shutdown_connections 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c09ad40 0x7f1d9c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 --2- 172.21.15.125:0/1351282556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c133f70 0x7f1d9c1343a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 -- 172.21.15.125:0/1351282556 >> 172.21.15.125:0/1351282556 conn(0x7f1d9c099c40 msgr2=0x7f1d9c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 -- 172.21.15.125:0/1351282556 shutdown_connections 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.304+0000 7f1da3042700 1 -- 172.21.15.125:0/1351282556 wait complete. 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.306+0000 7f1da3042700 1 Processor -- start 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.306+0000 7f1da3042700 1 -- start start 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.306+0000 7f1da3042700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 0x7f1d9c1c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 0x7f1d9c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1334c0 con 0x7f1d9c09ad40 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c122120 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1bd0e0 con 0x7f1d9c133f70 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57558/0 (socket says 172.21.15.125:57558) 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da0dde700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 0x7f1d9c1c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 -- 172.21.15.125:0/2797011838 learned_addr learned my addr 172.21.15.125:0/2797011838 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da15df700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 0x7f1d9c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 -- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 msgr2=0x7f1d9c11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 0x7f1d9c11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 -- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 msgr2=0x7f1d9c1c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 0x7f1d9c1c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 -- 172.21.15.125:0/2797011838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094a0 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da15df700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 0x7f1d9c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da0dde700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 0x7f1d9c1c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d9bfff700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1d88013000 tx=0x7f1d88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8801a710 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8801f070 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88009550 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8801aab0 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.307+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0a4160 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.308+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d88021030 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.308+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c1205b0 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.308+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d88040c10 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.313+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d8802d440 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 Processor -- start 2023-10-03T10:14:44.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 -- start start 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 0x7f90a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 0x7f90a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a009dc00 con 0x7f90a00a1380 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a009ea90 con 0x7f90a00a0a70 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.344+0000 7f90a5877700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a009dec0 con 0x7f90a0134120 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 0x7f90a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90a00a1380 0x7f90a0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40002/0 (socket says 172.21.15.125:40002) 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909e7fc700 1 -- 172.21.15.125:0/242895206 learned_addr learned my addr 172.21.15.125:0/242895206 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909effd700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 0x7f90a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 -- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 msgr2=0x7f90a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 0x7f90a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909dffb700 1 -- 172.21.15.125:0/242895206 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576421098 0 0) 0x7f90a009dc00 con 0x7f90a00a1380 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 -- 172.21.15.125:0/242895206 >> v1:172.21.15.125:6789/0 conn(0x7f90a00a1380 legacy=0x7f90a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 -- 172.21.15.125:0/242895206 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a009e6a0 con 0x7f90a0134120 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909effd700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 0x7f90a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909f7fe700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 0x7f90a013bce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9098009dc0 tx=0x7f909800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43f73c3b297dacd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909dffb700 1 -- 172.21.15.125:0/242895206 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800e070 con 0x7f90a0134120 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909dffb700 1 -- 172.21.15.125:0/242895206 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800bb20 con 0x7f90a0134120 2023-10-03T10:14:44.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.345+0000 7f909dffb700 1 -- 172.21.15.125:0/242895206 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098012430 con 0x7f90a0134120 2023-10-03T10:14:44.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 -- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 msgr2=0x7f90a013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 0x7f90a013bce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9098009dc0 tx=0x7f909800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 -- 172.21.15.125:0/242895206 shutdown_connections 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a0134120 0x7f90a013bce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 --2- 172.21.15.125:0/242895206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a0a70 0x7f90a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 -- 172.21.15.125:0/242895206 >> 172.21.15.125:0/242895206 conn(0x7f90a00a6610 msgr2=0x7f90a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 -- 172.21.15.125:0/242895206 shutdown_connections 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.346+0000 7f90a5877700 1 -- 172.21.15.125:0/242895206 wait complete. 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 Processor -- start 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 -- start start 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 0x7f90a0122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 0x7f90a0123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01258f0 con 0x7f90a0134120 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0133640 con 0x7f90a00a1380 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f90a5877700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01262f0 con 0x7f90a00a0a70 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.347+0000 7f909e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 0x7f90a0122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57570/0 (socket says 172.21.15.125:57570) 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909e7fc700 1 -- 172.21.15.125:0/1264462146 learned_addr learned my addr 172.21.15.125:0/1264462146 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909f7fe700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 0x7f90a0123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 -- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 msgr2=0x7f90a0122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 -- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 msgr2=0x7f90a0123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 0x7f90a0123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 -- 172.21.15.125:0/1264462146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900094a0 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909e7fc700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909f7fe700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 0x7f90a0123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f909effd700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 0x7f90a0122890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f909000e9b0 tx=0x7f909000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000ee50 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909000c850 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000cc00 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9098009a70 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.348+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0125c70 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.349+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9090013470 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.349+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f909003f7d0 con 0x7f90a00a0a70 2023-10-03T10:14:44.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.349+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a004f2a0 con 0x7f90a00a0a70 2023-10-03T10:14:44.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.354+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9090021080 con 0x7f90a00a0a70 2023-10-03T10:14:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.508+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d9c04f2a0 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.508+0000 7f1d997fa700 1 -- 172.21.15.125:0/2797011838 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d88015020 con 0x7f1d9c0a0a70 2023-10-03T10:14:44.508 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 msgr2=0x7f1d9c1c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1d88013000 tx=0x7f1d88004750 comp rx=0 tx=0).stop 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 shutdown_connections 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d9c133f70 0x7f1d9c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9c09ad40 0x7f1d9c1c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 --2- 172.21.15.125:0/2797011838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9c0a0a70 0x7f1d9c1c8960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 >> 172.21.15.125:0/2797011838 conn(0x7f1d9c099c40 msgr2=0x7f1d9c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 shutdown_connections 2023-10-03T10:14:44.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.510+0000 7f1da3042700 1 -- 172.21.15.125:0/2797011838 wait complete. 2023-10-03T10:14:44.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:44.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.546+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f90a0126a00 con 0x7f90a00a0a70 2023-10-03T10:14:44.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.546+0000 7f9087fff700 1 -- 172.21.15.125:0/1264462146 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9090017020 con 0x7f90a00a0a70 2023-10-03T10:14:44.546 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 msgr2=0x7f90a0122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 0x7f90a0122890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f909000e9b0 tx=0x7f909000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 shutdown_connections 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0134120 0x7f90a0123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90a00a0a70 0x7f90a0122890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 --2- 172.21.15.125:0/1264462146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a00a1380 0x7f90a0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 >> 172.21.15.125:0/1264462146 conn(0x7f90a00a6610 msgr2=0x7f90a009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 shutdown_connections 2023-10-03T10:14:44.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.548+0000 7f90a5877700 1 -- 172.21.15.125:0/1264462146 wait complete. 2023-10-03T10:14:44.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:44.664 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:44.709 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:44.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.789+0000 7effc363f700 1 Processor -- start 2023-10-03T10:14:44.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.789+0000 7effc363f700 1 -- start start 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc363f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effbc09ef80 0x7effbc138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc363f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc363f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc09af80 con 0x7effbc09a150 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc363f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc09a520 con 0x7effbc09ef80 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc363f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09fe00 con 0x7effbc09f370 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc1bdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effbc09ef80 0x7effbc138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc13db700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7effbc09a150 0x7effbc09e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40010/0 (socket says 172.21.15.125:40010) 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc1bdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58004/0 (socket says 172.21.15.125:58004) 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc13db700 1 -- 172.21.15.125:0/805416114 learned_addr learned my addr 172.21.15.125:0/805416114 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 -- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 msgr2=0x7effbc13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 --2- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 -- 172.21.15.125:0/805416114 >> v1:172.21.15.125:6789/0 conn(0x7effbc09a150 legacy=0x7effbc09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effb3fff700 1 -- 172.21.15.125:0/805416114 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148531521 0 0) 0x7effbc09af80 con 0x7effbc09a150 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 -- 172.21.15.125:0/805416114 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc06bc20 con 0x7effbc09ef80 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effc0bda700 1 --2- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc138e60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effac009840 tx=0x7effac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beedd3c3641f120c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effb3fff700 1 -- 172.21.15.125:0/805416114 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011830 con 0x7effbc09ef80 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effb3fff700 1 -- 172.21.15.125:0/805416114 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac011990 con 0x7effbc09ef80 2023-10-03T10:14:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.790+0000 7effb3fff700 1 -- 172.21.15.125:0/805416114 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011d20 con 0x7effbc09ef80 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 -- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 msgr2=0x7effbc138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 --2- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc138e60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effac009840 tx=0x7effac009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 -- 172.21.15.125:0/805416114 shutdown_connections 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 --2- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 --2- 172.21.15.125:0/805416114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc138e60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 -- 172.21.15.125:0/805416114 >> 172.21.15.125:0/805416114 conn(0x7effbc0a4430 msgr2=0x7effbc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 -- 172.21.15.125:0/805416114 shutdown_connections 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.791+0000 7effc363f700 1 -- 172.21.15.125:0/805416114 wait complete. 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.792+0000 7effc363f700 1 Processor -- start 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.792+0000 7effc363f700 1 -- start start 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 0x7effbc070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09b870 con 0x7effbc09ef80 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0a0440 con 0x7effbc09a150 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc363f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc11fa30 con 0x7effbc09f370 2023-10-03T10:14:44.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc0bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc1bdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc0bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33056/0 (socket says 172.21.15.125:33056) 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc1bdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58014/0 (socket says 172.21.15.125:58014) 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc0bda700 1 -- 172.21.15.125:0/1489978088 learned_addr learned my addr 172.21.15.125:0/1489978088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.793+0000 7effc13db700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 0x7effbc070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 -- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 msgr2=0x7effbc071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 -- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 msgr2=0x7effbc070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 0x7effbc070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 -- 172.21.15.125:0/1489978088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0094a0 con 0x7effbc09ef80 2023-10-03T10:14:44.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc1bdc700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc13db700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 0x7effbc070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc0bda700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac01a7e0 con 0x7effbc09ef80 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac01a940 con 0x7effbc09ef80 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc11ffc0 con 0x7effbc09ef80 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac01acf0 con 0x7effbc09ef80 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.794+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc120a30 con 0x7effbc09ef80 2023-10-03T10:14:44.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.795+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effac022070 con 0x7effbc09ef80 2023-10-03T10:14:44.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.795+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effac0407f0 con 0x7effbc09ef80 2023-10-03T10:14:44.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.795+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc09fa30 con 0x7effbc09ef80 2023-10-03T10:14:44.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.803+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effac029070 con 0x7effbc09ef80 2023-10-03T10:14:44.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.836+0000 7fd434a73700 1 Processor -- start 2023-10-03T10:14:44.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.836+0000 7fd434a73700 1 -- start start 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43009e9d0 con 0x7fd4300a1380 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43009dc00 con 0x7fd430133f50 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd434a73700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd43009dec0 con 0x7fd4300a0a70 2023-10-03T10:14:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33058/0 (socket says 172.21.15.125:33058) 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58028/0 (socket says 172.21.15.125:58028) 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57588/0 (socket says 172.21.15.125:57588) 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42dd9b700 1 -- 172.21.15.125:0/3363873324 learned_addr learned my addr 172.21.15.125:0/3363873324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 -- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 msgr2=0x7fd430134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 -- 172.21.15.125:0/3363873324 >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 msgr2=0x7fd430133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 --2- 172.21.15.125:0/3363873324 >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 -- 172.21.15.125:0/3363873324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43009e6a0 con 0x7fd4300a0a70 2023-10-03T10:14:44.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42dd9b700 1 --2- 172.21.15.125:0/3363873324 >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42ed9d700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42e59c700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd420009840 tx=0x7fd420009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba84f743f531764 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.837+0000 7fd42d59a700 1 -- 172.21.15.125:0/3363873324 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420011830 con 0x7fd4300a0a70 2023-10-03T10:14:44.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd42d59a700 1 -- 172.21.15.125:0/3363873324 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420011990 con 0x7fd4300a0a70 2023-10-03T10:14:44.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd42d59a700 1 -- 172.21.15.125:0/3363873324 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420011d20 con 0x7fd4300a0a70 2023-10-03T10:14:44.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 -- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 msgr2=0x7fd4300a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd420009840 tx=0x7fd420009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 -- 172.21.15.125:0/3363873324 shutdown_connections 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd430133f50 0x7fd430134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 --2- 172.21.15.125:0/3363873324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4300a0a70 0x7fd4300a0e40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 --2- 172.21.15.125:0/3363873324 >> v2:172.21.15.125:3300/0 conn(0x7fd4300a1380 0x7fd430133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 -- 172.21.15.125:0/3363873324 >> 172.21.15.125:0/3363873324 conn(0x7fd4300a6610 msgr2=0x7fd4300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 -- 172.21.15.125:0/3363873324 shutdown_connections 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.838+0000 7fd434a73700 1 -- 172.21.15.125:0/3363873324 wait complete. 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.839+0000 7fd434a73700 1 Processor -- start 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.839+0000 7fd434a73700 1 -- start start 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 0x7fd4301229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 0x7fd430122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430125f90 con 0x7fd4300a1380 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300a0450 con 0x7fd4300a0a70 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd434a73700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300a5120 con 0x7fd430133f50 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57592/0 (socket says 172.21.15.125:57592) 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 -- 172.21.15.125:0/1106083249 learned_addr learned my addr 172.21.15.125:0/1106083249 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42ed9d700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 0x7fd430122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42dd9b700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 0x7fd4301229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 -- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 msgr2=0x7fd430122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 0x7fd430122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 -- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 msgr2=0x7fd4301229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 0x7fd4301229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 -- 172.21.15.125:0/1106083249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424009550 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42dd9b700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 0x7fd4301229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42ed9d700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 0x7fd430122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.840+0000 7fd42e59c700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd420009fd0 tx=0x7fd420004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420004450 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42001e070 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200038e0 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd434a73700 1 -- 172.21.15.125:0/1106083249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd428009a70 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd434a73700 1 -- 172.21.15.125:0/1106083249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4200094a0 con 0x7fd4300a0a70 2023-10-03T10:14:44.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.841+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd420003a40 con 0x7fd4300a0a70 2023-10-03T10:14:44.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.842+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd420040490 con 0x7fd4300a0a70 2023-10-03T10:14:44.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.842+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4080052e0 con 0x7fd4300a0a70 2023-10-03T10:14:44.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.846+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd420015030 con 0x7fd4300a0a70 2023-10-03T10:14:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.995+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effbc04f2a0 con 0x7effbc09ef80 2023-10-03T10:14:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.996+0000 7effb1ffb700 1 -- 172.21.15.125:0/1489978088 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effac0226e0 con 0x7effbc09ef80 2023-10-03T10:14:44.996 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 msgr2=0x7effbc070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac004750 comp rx=0 tx=0).stop 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 shutdown_connections 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effbc09f370 0x7effbc071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effbc09a150 0x7effbc070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 --2- 172.21.15.125:0/1489978088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effbc09ef80 0x7effbc070f50 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 >> 172.21.15.125:0/1489978088 conn(0x7effbc0a4430 msgr2=0x7effbc09d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 shutdown_connections 2023-10-03T10:14:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:44.998+0000 7effc363f700 1 -- 172.21.15.125:0/1489978088 wait complete. 2023-10-03T10:14:45.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.040+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd408005590 con 0x7fd4300a0a70 2023-10-03T10:14:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.040+0000 7fd41effd700 1 -- 172.21.15.125:0/1106083249 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd420003cf0 con 0x7fd4300a0a70 2023-10-03T10:14:45.040 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 msgr2=0x7fd430122470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd420009fd0 tx=0x7fd420004750 comp rx=0 tx=0).stop 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 shutdown_connections 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd430133f50 0x7fd430122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4300a0a70 0x7fd430122470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 --2- 172.21.15.125:0/1106083249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4300a1380 0x7fd4301229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 >> 172.21.15.125:0/1106083249 conn(0x7fd4300a6610 msgr2=0x7fd43009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 shutdown_connections 2023-10-03T10:14:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.042+0000 7fd41cff9700 1 -- 172.21.15.125:0/1106083249 wait complete. 2023-10-03T10:14:45.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:45.524 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:45.561 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:45.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.652+0000 7f938b6e3700 1 Processor -- start 2023-10-03T10:14:45.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.652+0000 7f938b6e3700 1 -- start start 2023-10-03T10:14:45.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f938409ad40 0x7f9384133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 0x7f93841343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 0x7f93840a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840a3b60 con 0x7f938409ad40 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93841348e0 con 0x7f9384133f70 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938b6e3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f938409b110 con 0x7f93840a0a70 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f9389c80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 0x7f93840a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f9388c7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 0x7f93841343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f938409ad40 0x7f9384133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f9389c80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 0x7f93840a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37722/0 (socket says 172.21.15.125:37722) 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f9388c7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 0x7f93841343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34448/0 (socket says 172.21.15.125:34448) 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f9389c80700 1 -- 172.21.15.125:0/840723699 learned_addr learned my addr 172.21.15.125:0/840723699 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 -- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 msgr2=0x7f93840a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 0x7f93840a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 -- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 msgr2=0x7f93841343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 0x7f93841343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.653+0000 7f938947f700 1 -- 172.21.15.125:0/840723699 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840a2fa0 con 0x7f938409ad40 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938947f700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f938409ad40 0x7f9384133a30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9380009870 tx=0x7f9380009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9e5809d6d5e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f937bfff700 1 -- 172.21.15.125:0/840723699 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011830 con 0x7f938409ad40 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f937bfff700 1 -- 172.21.15.125:0/840723699 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380011990 con 0x7f938409ad40 2023-10-03T10:14:45.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f937bfff700 1 -- 172.21.15.125:0/840723699 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011d20 con 0x7f938409ad40 2023-10-03T10:14:45.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 -- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f938409ad40 msgr2=0x7f9384133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f938409ad40 0x7f9384133a30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9380009870 tx=0x7f9380009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 -- 172.21.15.125:0/840723699 shutdown_connections 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93840a0a70 0x7f93840a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f938409ad40 0x7f9384133a30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 --2- 172.21.15.125:0/840723699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9384133f70 0x7f93841343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.654+0000 7f938b6e3700 1 -- 172.21.15.125:0/840723699 >> 172.21.15.125:0/840723699 conn(0x7f9384099c40 msgr2=0x7f938406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.655+0000 7f938b6e3700 1 -- 172.21.15.125:0/840723699 shutdown_connections 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.655+0000 7f938b6e3700 1 -- 172.21.15.125:0/840723699 wait complete. 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.656+0000 7f938b6e3700 1 Processor -- start 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.656+0000 7f938b6e3700 1 -- start start 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.656+0000 7f938b6e3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f938409ad40 0x7f9384121450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.656+0000 7f938b6e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938b6e3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938b6e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384122920 con 0x7f93840a0a70 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938b6e3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938409c7e0 con 0x7f938409ad40 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938b6e3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93841249d0 con 0x7f9384133f70 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9388c7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37734/0 (socket says 172.21.15.125:37734) 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9388c7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53040/0 (socket says 172.21.15.125:53040) 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 -- 172.21.15.125:0/4136618736 learned_addr learned my addr 172.21.15.125:0/4136618736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938947f700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f938409ad40 0x7f9384121450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 -- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f938409ad40 msgr2=0x7f9384121450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f938409ad40 0x7f9384121450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 -- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 msgr2=0x7f9384121990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 -- 172.21.15.125:0/4136618736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094a0 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9388c7e700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9389c80700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f937c00ef00 tx=0x7f937c00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c010040 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c003a20 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384123880 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.657+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c003dd0 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.658+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938409d3c0 con 0x7f9384133f70 2023-10-03T10:14:45.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.658+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f937c00b870 con 0x7f9384133f70 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.658+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f937c03f370 con 0x7f9384133f70 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.658+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938404f2a0 con 0x7f9384133f70 2023-10-03T10:14:45.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.663+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f937c004030 con 0x7f9384133f70 2023-10-03T10:14:45.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.693+0000 7f81cffa9700 1 Processor -- start 2023-10-03T10:14:45.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 -- start start 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81c8133f50 0x7f81c81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c809e9d0 con 0x7f81c8133f50 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c809dc00 con 0x7f81c80a0a70 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cffa9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c809dec0 con 0x7f81c80a1380 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cdd45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81ce546700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81c8133f50 0x7f81c81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cd544700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cdd45700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34464/0 (socket says 172.21.15.125:34464) 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81ce546700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f81c8133f50 0x7f81c81343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53052/0 (socket says 172.21.15.125:53052) 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.694+0000 7f81cdd45700 1 -- 172.21.15.125:0/656842491 learned_addr learned my addr 172.21.15.125:0/656842491 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 -- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 msgr2=0x7f81c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 -- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 msgr2=0x7f81c80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 -- 172.21.15.125:0/656842491 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c809e6a0 con 0x7f81c8133f50 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cdd45700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cd544700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ce546700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c8133f50 0x7f81c81343f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009d90 tx=0x7f81c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd21325c4861057e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ccd43700 1 -- 172.21.15.125:0/656842491 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000e070 con 0x7f81c8133f50 2023-10-03T10:14:45.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ccd43700 1 -- 172.21.15.125:0/656842491 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000bb20 con 0x7f81c8133f50 2023-10-03T10:14:45.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81ccd43700 1 -- 172.21.15.125:0/656842491 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0012430 con 0x7f81c8133f50 2023-10-03T10:14:45.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 -- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c8133f50 msgr2=0x7f81c81343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c8133f50 0x7f81c81343f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009d90 tx=0x7f81c000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 -- 172.21.15.125:0/656842491 shutdown_connections 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c80a0a70 0x7f81c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c8133f50 0x7f81c81343f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 --2- 172.21.15.125:0/656842491 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.695+0000 7f81cffa9700 1 -- 172.21.15.125:0/656842491 >> 172.21.15.125:0/656842491 conn(0x7f81c80a6610 msgr2=0x7f81c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.696+0000 7f81cffa9700 1 -- 172.21.15.125:0/656842491 shutdown_connections 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.696+0000 7f81cffa9700 1 -- 172.21.15.125:0/656842491 wait complete. 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.696+0000 7f81cffa9700 1 Processor -- start 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.696+0000 7f81cffa9700 1 -- start start 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c811fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 0x7f81c81c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8122710 con 0x7f81c80a0a70 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c811f3e0 con 0x7f81c8133f50 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cffa9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8120ae0 con 0x7f81c80a1380 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53054/0 (socket says 172.21.15.125:53054) 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 -- 172.21.15.125:0/2621162768 learned_addr learned my addr 172.21.15.125:0/2621162768 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cd544700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c811fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81ce546700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 0x7f81c81c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 -- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 msgr2=0x7f81c811fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c811fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 -- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 msgr2=0x7f81c81c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 0x7f81c81c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 -- 172.21.15.125:0/2621162768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009550 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cd544700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c811fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81ce546700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 0x7f81c81c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81cdd45700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f81c400ebe0 tx=0x7f81c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.697+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004030 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4004190 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b80094a0 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004520 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c0009a70 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c400c850 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.698+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81c403f650 con 0x7f81c80a0a70 2023-10-03T10:14:45.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.699+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c806cc40 con 0x7f81c80a0a70 2023-10-03T10:14:45.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.703+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c40036a0 con 0x7f81c80a0a70 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.857+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9384124d50 con 0x7f9384133f70 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.858+0000 7f9379ffb700 1 -- 172.21.15.125:0/4136618736 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f937c01a030 con 0x7f9384133f70 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 msgr2=0x7f9384121ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f937c00ef00 tx=0x7f937c00b390 comp rx=0 tx=0).stop 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 shutdown_connections 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9384133f70 0x7f9384121ed0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f938409ad40 0x7f9384121450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 --2- 172.21.15.125:0/4136618736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93840a0a70 0x7f9384121990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 >> 172.21.15.125:0/4136618736 conn(0x7f9384099c40 msgr2=0x7f93840a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 shutdown_connections 2023-10-03T10:14:45.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.860+0000 7f938b6e3700 1 -- 172.21.15.125:0/4136618736 wait complete. 2023-10-03T10:14:45.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.896+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81c804f2a0 con 0x7f81c80a0a70 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.897+0000 7f81be7fc700 1 -- 172.21.15.125:0/2621162768 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81c4019ab0 con 0x7f81c80a0a70 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:45.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 msgr2=0x7f81c811f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f81c400ebe0 tx=0x7f81c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 shutdown_connections 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81c8133f50 0x7f81c81c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81c80a0a70 0x7f81c811f660 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 --2- 172.21.15.125:0/2621162768 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81c80a1380 0x7f81c811fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 >> 172.21.15.125:0/2621162768 conn(0x7f81c80a6610 msgr2=0x7f81c809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 shutdown_connections 2023-10-03T10:14:45.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:45.899+0000 7f81cffa9700 1 -- 172.21.15.125:0/2621162768 wait complete. 2023-10-03T10:14:45.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:46.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:46.056 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:46.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.136+0000 7f77dcd9b700 1 Processor -- start 2023-10-03T10:14:46.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.136+0000 7f77dcd9b700 1 -- start start 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77dcd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77dcd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 0x7f77d80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77dcd9b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d809b110 con 0x7f77d8133f70 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77dcd9b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80a3b60 con 0x7f77d81343a0 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77dcd9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80a2fa0 con 0x7f77d809ad40 2023-10-03T10:14:46.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 0x7f77d80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d5d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77d8133f70 0x7f77d80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40854/0 (socket says 172.21.15.125:40854) 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d5d9b700 1 -- 172.21.15.125:0/3915620083 learned_addr learned my addr 172.21.15.125:0/3915620083 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d559a700 1 -- 172.21.15.125:0/3915620083 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305987717 0 0) 0x7f77d809b110 con 0x7f77d8133f70 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.137+0000 7f77d659c700 1 -- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 msgr2=0x7f77d80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d659c700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 0x7f77d80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d659c700 1 -- 172.21.15.125:0/3915620083 >> v1:172.21.15.125:6789/0 conn(0x7f77d8133f70 legacy=0x7f77d80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d659c700 1 -- 172.21.15.125:0/3915620083 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d809a280 con 0x7f77d809ad40 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d6d9d700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 0x7f77d80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d659c700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d8133a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009870 tx=0x7f77c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f240a6a51c0da10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d559a700 1 -- 172.21.15.125:0/3915620083 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011830 con 0x7f77d809ad40 2023-10-03T10:14:46.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d559a700 1 -- 172.21.15.125:0/3915620083 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8011990 con 0x7f77d809ad40 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77d559a700 1 -- 172.21.15.125:0/3915620083 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011d20 con 0x7f77d809ad40 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77dcd9b700 1 -- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 msgr2=0x7f77d8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.138+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d8133a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009870 tx=0x7f77c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 -- 172.21.15.125:0/3915620083 shutdown_connections 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d81343a0 0x7f77d80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/3915620083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d8133a30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 -- 172.21.15.125:0/3915620083 >> 172.21.15.125:0/3915620083 conn(0x7f77d8099c40 msgr2=0x7f77d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 -- 172.21.15.125:0/3915620083 shutdown_connections 2023-10-03T10:14:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.139+0000 7f77dcd9b700 1 -- 172.21.15.125:0/3915620083 wait complete. 2023-10-03T10:14:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 Processor -- start 2023-10-03T10:14:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 -- start start 2023-10-03T10:14:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d81c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 0x7f77d81c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8121c70 con 0x7f77d81343a0 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81218f0 con 0x7f77d8133f70 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77dcd9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81c5cd0 con 0x7f77d809ad40 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 0x7f77d81c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53066/0 (socket says 172.21.15.125:53066) 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d6d9d700 1 -- 172.21.15.125:0/732923030 learned_addr learned my addr 172.21.15.125:0/732923030 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d659c700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d81c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 -- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 msgr2=0x7f77d81c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d81c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 -- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 msgr2=0x7f77d81c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d5d9b700 1 -- 172.21.15.125:0/732923030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009a70 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.140+0000 7f77d6d9d700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77d5d9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 0x7f77d81c5790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c470 tx=0x7f77cc00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc004c80 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc004de0 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80094a0 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007310 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.141+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d809c7e0 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.142+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77cc007470 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.142+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d809e9a0 con 0x7f77d8133f70 2023-10-03T10:14:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.142+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77cc03f1c0 con 0x7f77d8133f70 2023-10-03T10:14:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.147+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77cc00ce40 con 0x7f77d8133f70 2023-10-03T10:14:46.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 Processor -- start 2023-10-03T10:14:46.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 -- start start 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1b009e870 0x7fc1b009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b006bec0 con 0x7fc1b009f180 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b006ce60 con 0x7fc1b009e870 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b68c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b009fa00 con 0x7fc1b01343a0 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1affff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1b009e870 0x7fc1b009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.182+0000 7fc1b4e63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1af7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc1b009f180 0x7fc1b0133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40864/0 (socket says 172.21.15.125:40864) 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1af7fe700 1 -- 172.21.15.125:0/3398289166 learned_addr learned my addr 172.21.15.125:0/3398289166 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1b009e870 0x7fc1b009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53072/0 (socket says 172.21.15.125:53072) 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1b4e63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37758/0 (socket says 172.21.15.125:37758) 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 -- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 msgr2=0x7fc1b013bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 -- 172.21.15.125:0/3398289166 >> v1:172.21.15.125:6789/0 conn(0x7fc1b009f180 legacy=0x7fc1b0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1aeffd700 1 -- 172.21.15.125:0/3398289166 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623533243 0 0) 0x7fc1b006bec0 con 0x7fc1b009f180 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 -- 172.21.15.125:0/3398289166 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b009ad80 con 0x7fc1b009e870 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1b4e63700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1affff700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009e870 0x7fc1b009ec40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009840 tx=0x7fc1a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54877631c0a51dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1aeffd700 1 -- 172.21.15.125:0/3398289166 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0011830 con 0x7fc1b009e870 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1aeffd700 1 -- 172.21.15.125:0/3398289166 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0011990 con 0x7fc1b009e870 2023-10-03T10:14:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.183+0000 7fc1aeffd700 1 -- 172.21.15.125:0/3398289166 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0011d20 con 0x7fc1b009e870 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 -- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009e870 msgr2=0x7fc1b009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009e870 0x7fc1b009ec40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009840 tx=0x7fc1a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 -- 172.21.15.125:0/3398289166 shutdown_connections 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b013bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/3398289166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009e870 0x7fc1b009ec40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 -- 172.21.15.125:0/3398289166 >> 172.21.15.125:0/3398289166 conn(0x7fc1b00a4430 msgr2=0x7fc1b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 -- 172.21.15.125:0/3398289166 shutdown_connections 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.184+0000 7fc1b68c6700 1 -- 172.21.15.125:0/3398289166 wait complete. 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.185+0000 7fc1b68c6700 1 Processor -- start 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.185+0000 7fc1b68c6700 1 -- start start 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 0x7fc1b01228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 0x7fc1b0122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b0123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0133430 con 0x7fc1b009f180 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0125e20 con 0x7fc1b009e870 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b68c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01263c0 con 0x7fc1b01343a0 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1affff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 0x7fc1b01228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b0123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1affff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 0x7fc1b01228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34510/0 (socket says 172.21.15.125:34510) 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1affff700 1 -- 172.21.15.125:0/1832320937 learned_addr learned my addr 172.21.15.125:0/1832320937 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1af7fe700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 0x7fc1b0122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 -- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 msgr2=0x7fc1b01228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 0x7fc1b01228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 -- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 msgr2=0x7fc1b0122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 0x7fc1b0122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 -- 172.21.15.125:0/1832320937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009a70 con 0x7fc1b01343a0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1af7fe700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 0x7fc1b0122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.186+0000 7fc1b4e63700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b0123320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009e50 tx=0x7fc1a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800ca90 con 0x7fc1b01343a0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a800f040 con 0x7fc1b01343a0 2023-10-03T10:14:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a00094a0 con 0x7fc1b01343a0 2023-10-03T10:14:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800ce50 con 0x7fc1b01343a0 2023-10-03T10:14:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b006cfa0 con 0x7fc1b01343a0 2023-10-03T10:14:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.187+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1a8014480 con 0x7fc1b01343a0 2023-10-03T10:14:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.188+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b01337f0 con 0x7fc1b01343a0 2023-10-03T10:14:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.188+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1a803fc60 con 0x7fc1b01343a0 2023-10-03T10:14:46.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.192+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1a8012930 con 0x7fc1b01343a0 2023-10-03T10:14:46.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.338+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77d804f2a0 con 0x7f77d8133f70 2023-10-03T10:14:46.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.339+0000 7f77c6ffd700 1 -- 172.21.15.125:0/732923030 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77cc01ce30 con 0x7f77d8133f70 2023-10-03T10:14:46.339 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:46.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 msgr2=0x7f77d81c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 0x7f77d81c5790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c470 tx=0x7f77cc00c780 comp rx=0 tx=0).stop 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 shutdown_connections 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d81343a0 0x7f77d81c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77d809ad40 0x7f77d81c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 --2- 172.21.15.125:0/732923030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77d8133f70 0x7f77d81c5790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 >> 172.21.15.125:0/732923030 conn(0x7f77d8099c40 msgr2=0x7f77d8133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 shutdown_connections 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.341+0000 7f77dcd9b700 1 -- 172.21.15.125:0/732923030 wait complete. 2023-10-03T10:14:46.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:46.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.381+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1b006c670 con 0x7fc1b01343a0 2023-10-03T10:14:46.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.382+0000 7fc1acff9700 1 -- 172.21.15.125:0/1832320937 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1a8012340 con 0x7fc1b01343a0 2023-10-03T10:14:46.382 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:46.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.383+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 msgr2=0x7fc1b0123320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.383+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b0123320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009e50 tx=0x7fc1a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 shutdown_connections 2023-10-03T10:14:46.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1b01343a0 0x7fc1b0123320 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1b009e870 0x7fc1b01228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 --2- 172.21.15.125:0/1832320937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b009f180 0x7fc1b0122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 >> 172.21.15.125:0/1832320937 conn(0x7fc1b00a4430 msgr2=0x7fc1b0070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 shutdown_connections 2023-10-03T10:14:46.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.384+0000 7fc1b68c6700 1 -- 172.21.15.125:0/1832320937 wait complete. 2023-10-03T10:14:46.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:46.873 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:46.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.999+0000 7f33f8947700 1 Processor -- start 2023-10-03T10:14:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:46.999+0000 7f33f8947700 1 -- start start 2023-10-03T10:14:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f8947700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f8947700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 0x7f33f413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f8947700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f409dc00 con 0x7f33f40a1380 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f8947700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f409ea90 con 0x7f33f40a0a70 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f8947700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f409dec0 con 0x7f33f4134120 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 0x7f33f413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34526/0 (socket says 172.21.15.125:34526) 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f1d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f33f40a1380 0x7f33f4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40870/0 (socket says 172.21.15.125:40870) 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.000+0000 7f33f259c700 1 -- 172.21.15.125:0/25202830 learned_addr learned my addr 172.21.15.125:0/25202830 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f259c700 1 -- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 msgr2=0x7f33f413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f259c700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 0x7f33f413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f259c700 1 -- 172.21.15.125:0/25202830 >> v1:172.21.15.125:6789/0 conn(0x7f33f40a1380 legacy=0x7f33f4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f159a700 1 -- 172.21.15.125:0/25202830 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437476901 0 0) 0x7f33f409dc00 con 0x7f33f40a1380 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f259c700 1 -- 172.21.15.125:0/25202830 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f409e6a0 con 0x7f33f40a0a70 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f2d9d700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 0x7f33f413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f259c700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009920 tx=0x7f33e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ab4a24e87717e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f159a700 1 -- 172.21.15.125:0/25202830 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011830 con 0x7f33f40a0a70 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f159a700 1 -- 172.21.15.125:0/25202830 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4011990 con 0x7f33f40a0a70 2023-10-03T10:14:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.001+0000 7f33f159a700 1 -- 172.21.15.125:0/25202830 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011d20 con 0x7f33f40a0a70 2023-10-03T10:14:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 -- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 msgr2=0x7f33f40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009920 tx=0x7f33e4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 -- 172.21.15.125:0/25202830 shutdown_connections 2023-10-03T10:14:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f4134120 0x7f33f413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 --2- 172.21.15.125:0/25202830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f40a0e40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 -- 172.21.15.125:0/25202830 >> 172.21.15.125:0/25202830 conn(0x7f33f40a6610 msgr2=0x7f33f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 -- 172.21.15.125:0/25202830 shutdown_connections 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.002+0000 7f33f8947700 1 -- 172.21.15.125:0/25202830 wait complete. 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.003+0000 7f33f8947700 1 Processor -- start 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.003+0000 7f33f8947700 1 -- start start 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 0x7f33f4122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f4134120 0x7f33f4123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4124550 con 0x7f33f4134120 2023-10-03T10:14:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4124e20 con 0x7f33f40a0a70 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f8947700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f409d340 con 0x7f33f40a1380 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 0x7f33f4122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34540/0 (socket says 172.21.15.125:34540) 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 -- 172.21.15.125:0/1416281493 learned_addr learned my addr 172.21.15.125:0/1416281493 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f2d9d700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f4134120 0x7f33f4123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 -- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 msgr2=0x7f33f4122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 0x7f33f4122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 -- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f4134120 msgr2=0x7f33f4123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f4134120 0x7f33f4123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 -- 172.21.15.125:0/1416281493 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec009a70 con 0x7f33f40a0a70 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f1d9b700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 0x7f33f4122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.004+0000 7f33f259c700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009130 tx=0x7f33e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004450 con 0x7f33f40a0a70 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e401f070 con 0x7f33f40a0a70 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4009550 con 0x7f33f40a0a70 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40038e0 con 0x7f33f40a0a70 2023-10-03T10:14:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f4126180 con 0x7f33f40a0a70 2023-10-03T10:14:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e4003a40 con 0x7f33f40a0a70 2023-10-03T10:14:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.005+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33e4021070 con 0x7f33f40a0a70 2023-10-03T10:14:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.006+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f404f2a0 con 0x7f33f40a0a70 2023-10-03T10:14:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.010+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e402b080 con 0x7f33f40a0a70 2023-10-03T10:14:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.041+0000 7f6f83e30700 1 Processor -- start 2023-10-03T10:14:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.041+0000 7f6f83e30700 1 -- start start 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f83e30700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f7c09d860 0x7f6f7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f83e30700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f83e30700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c09aaa0 con 0x7f6f7c09e170 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f83e30700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c09f870 con 0x7f6f7c09d860 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f83e30700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c09b360 con 0x7f6f7c130eb0 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f7c09d860 0x7f6f7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f823cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f7c09d860 0x7f6f7c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53096/0 (socket says 172.21.15.125:53096) 2023-10-03T10:14:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 -- 172.21.15.125:0/1898757707 learned_addr learned my addr 172.21.15.125:0/1898757707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f813cb700 1 --1- 172.21.15.125:0/1898757707 >> v1:172.21.15.125:6789/0 conn(0x7f6f7c09e170 0x7f6f7c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40880/0 (socket says 172.21.15.125:40880) 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f823cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37800/0 (socket says 172.21.15.125:37800) 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 -- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 msgr2=0x7f6f7c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 -- 172.21.15.125:0/1898757707 >> v1:172.21.15.125:6789/0 conn(0x7f6f7c09e170 legacy=0x7f6f7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 -- 172.21.15.125:0/1898757707 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c09b620 con 0x7f6f7c09d860 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f80bca700 1 -- 172.21.15.125:0/1898757707 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827983718 0 0) 0x7f6f7c09aaa0 con 0x7f6f7c09e170 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f823cd700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f81bcc700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c09d860 0x7f6f7c09dc30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6f780098f0 tx=0x7f6f78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafb7b5e5cd66584 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f80bca700 1 -- 172.21.15.125:0/1898757707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78011830 con 0x7f6f7c09d860 2023-10-03T10:14:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f80bca700 1 -- 172.21.15.125:0/1898757707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78011990 con 0x7f6f7c09d860 2023-10-03T10:14:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.042+0000 7f6f80bca700 1 -- 172.21.15.125:0/1898757707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78011d20 con 0x7f6f7c09d860 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 -- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c09d860 msgr2=0x7f6f7c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c09d860 0x7f6f7c09dc30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6f780098f0 tx=0x7f6f78009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 -- 172.21.15.125:0/1898757707 shutdown_connections 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c130eb0 0x7f6f7c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 --2- 172.21.15.125:0/1898757707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c09d860 0x7f6f7c09dc30 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 -- 172.21.15.125:0/1898757707 >> 172.21.15.125:0/1898757707 conn(0x7f6f7c099c40 msgr2=0x7f6f7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 -- 172.21.15.125:0/1898757707 shutdown_connections 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.043+0000 7f6f83e30700 1 -- 172.21.15.125:0/1898757707 wait complete. 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.044+0000 7f6f83e30700 1 Processor -- start 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.044+0000 7f6f83e30700 1 -- start start 2023-10-03T10:14:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 0x7f6f7c121550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c130eb0 0x7f6f7c121fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c130400 con 0x7f6f7c130eb0 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c123750 con 0x7f6f7c09e170 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f83e30700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1228f0 con 0x7f6f7c09d860 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f813cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f813cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34544/0 (socket says 172.21.15.125:34544) 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f813cb700 1 -- 172.21.15.125:0/2604930806 learned_addr learned my addr 172.21.15.125:0/2604930806 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f81bcc700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 0x7f6f7c121550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f823cd700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c130eb0 0x7f6f7c121fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f813cb700 1 -- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 msgr2=0x7f6f7c121550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.045+0000 7f6f813cb700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 0x7f6f7c121550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f813cb700 1 -- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c130eb0 msgr2=0x7f6f7c121fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f813cb700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c130eb0 0x7f6f7c121fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f813cb700 1 -- 172.21.15.125:0/2604930806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74009a70 con 0x7f6f7c09e170 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f81bcc700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 0x7f6f7c121550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f813cb700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c001eb0 tx=0x7f6f6c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c004c80 con 0x7f6f7c09e170 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c004de0 con 0x7f6f7c09e170 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78009550 con 0x7f6f7c09e170 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c007310 con 0x7f6f7c09e170 2023-10-03T10:14:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.046+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c09c900 con 0x7f6f7c09e170 2023-10-03T10:14:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.047+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f6c007470 con 0x7f6f7c09e170 2023-10-03T10:14:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.047+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c04f2a0 con 0x7f6f7c09e170 2023-10-03T10:14:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.047+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f6c03f2a0 con 0x7f6f7c09e170 2023-10-03T10:14:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.051+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f6c0133c0 con 0x7f6f7c09e170 2023-10-03T10:14:47.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.205+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33f409cba0 con 0x7f33f40a0a70 2023-10-03T10:14:47.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.205+0000 7f33e2ffd700 1 -- 172.21.15.125:0/1416281493 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e4015020 con 0x7f33f40a0a70 2023-10-03T10:14:47.206 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:47.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 msgr2=0x7f33f4122a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009130 tx=0x7f33e4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:47.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 shutdown_connections 2023-10-03T10:14:47.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33f4134120 0x7f33f4123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33f40a0a70 0x7f33f4122a00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 --2- 172.21.15.125:0/1416281493 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33f40a1380 0x7f33f4122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.207+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 >> 172.21.15.125:0/1416281493 conn(0x7f33f40a6610 msgr2=0x7f33f409acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.208+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 shutdown_connections 2023-10-03T10:14:47.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.208+0000 7f33f8947700 1 -- 172.21.15.125:0/1416281493 wait complete. 2023-10-03T10:14:47.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.246+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f7c06c3b0 con 0x7f6f7c09e170 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.246+0000 7f6f727fc700 1 -- 172.21.15.125:0/2604930806 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f6c011360 con 0x7f6f7c09e170 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 msgr2=0x7f6f7c121a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c001eb0 tx=0x7f6f6c00c800 comp rx=0 tx=0).stop 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 shutdown_connections 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7c130eb0 0x7f6f7c121fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6f7c09d860 0x7f6f7c121550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 --2- 172.21.15.125:0/2604930806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7c09e170 0x7f6f7c121a90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 >> 172.21.15.125:0/2604930806 conn(0x7f6f7c099c40 msgr2=0x7f6f7c119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 shutdown_connections 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.249+0000 7f6f83e30700 1 -- 172.21.15.125:0/2604930806 wait complete. 2023-10-03T10:14:47.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:47.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:47.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:47.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 Processor -- start 2023-10-03T10:14:47.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 -- start start 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 0x7f73a4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a409c970 con 0x7f73a4131d70 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a40a0920 con 0x7f73a409e870 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73aaaea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73a409f9c0 con 0x7f73a409f180 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73a8886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73a9087700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f73a4131d70 0x7f73a4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40882/0 (socket says 172.21.15.125:40882) 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 0x7f73a4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73a8886700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34552/0 (socket says 172.21.15.125:34552) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.480+0000 7f73a9087700 1 -- 172.21.15.125:0/1094268234 learned_addr learned my addr 172.21.15.125:0/1094268234 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a8886700 1 -- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 msgr2=0x7f73a4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a37fe700 1 -- 172.21.15.125:0/1094268234 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738433504 0 0) 0x7f73a409c970 con 0x7f73a4131d70 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a8886700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 0x7f73a4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a8886700 1 -- 172.21.15.125:0/1094268234 >> v1:172.21.15.125:6789/0 conn(0x7f73a4131d70 legacy=0x7f73a4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a8886700 1 -- 172.21.15.125:0/1094268234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a409bab0 con 0x7f73a409e870 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a3fff700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 0x7f73a4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a8886700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7398009870 tx=0x7f7398009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359b2039e055b90d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a37fe700 1 -- 172.21.15.125:0/1094268234 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398011830 con 0x7f73a409e870 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a37fe700 1 -- 172.21.15.125:0/1094268234 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398011990 con 0x7f73a409e870 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73a37fe700 1 -- 172.21.15.125:0/1094268234 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398011d20 con 0x7f73a409e870 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73aaaea700 1 -- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 msgr2=0x7f73a409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73aaaea700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7398009870 tx=0x7f7398009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73aaaea700 1 -- 172.21.15.125:0/1094268234 shutdown_connections 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73aaaea700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a409e870 0x7f73a409ec40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.481+0000 7f73aaaea700 1 --2- 172.21.15.125:0/1094268234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409f180 0x7f73a4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.482+0000 7f73aaaea700 1 -- 172.21.15.125:0/1094268234 >> 172.21.15.125:0/1094268234 conn(0x7f73a40a4430 msgr2=0x7f73a40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.482+0000 7f73aaaea700 1 -- 172.21.15.125:0/1094268234 shutdown_connections 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.482+0000 7f73aaaea700 1 -- 172.21.15.125:0/1094268234 wait complete. 2023-10-03T10:14:47.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.482+0000 7f73aaaea700 1 Processor -- start 2023-10-03T10:14:47.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.482+0000 7f73aaaea700 1 -- start start 2023-10-03T10:14:47.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 0x7f73a411f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a4131d70 0x7f73a411fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41227a0 con 0x7f73a409f180 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4130580 con 0x7f73a4131d70 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73aaaea700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4120610 con 0x7f73a409e870 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a8886700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 0x7f73a411f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53118/0 (socket says 172.21.15.125:53118) 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a3fff700 1 -- 172.21.15.125:0/3643186311 learned_addr learned my addr 172.21.15.125:0/3643186311 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a9087700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a4131d70 0x7f73a411fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a8886700 1 -- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a4131d70 msgr2=0x7f73a411fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a8886700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a4131d70 0x7f73a411fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a8886700 1 -- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 msgr2=0x7f73a411f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.483+0000 7f73a8886700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a8886700 1 -- 172.21.15.125:0/3643186311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900094a0 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a3fff700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a8886700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 0x7f73a411f1b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7398016000 tx=0x7f7398004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398004550 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739801e070 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73980094a0 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980038e0 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.484+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a409dba0 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.485+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7398003a40 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.485+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73980405d0 con 0x7f73a409e870 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.485+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a411be60 con 0x7f73a409e870 2023-10-03T10:14:47.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.490+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7398015020 con 0x7f73a409e870 2023-10-03T10:14:47.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.522+0000 7f9c10f5c700 1 Processor -- start 2023-10-03T10:14:47.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.522+0000 7f9c10f5c700 1 -- start start 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c10f5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c0c0a0a70 0x7f9c0c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c10f5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c10f5c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c09dc00 con 0x7f9c0c133f50 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c10f5c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c09ea60 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c10f5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c09dec0 con 0x7f9c0c0a1380 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c0a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c0c0a0a70 0x7f9c0c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c0ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9c0c133f50 0x7f9c0c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40888/0 (socket says 172.21.15.125:40888) 2023-10-03T10:14:47.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c0ad9d700 1 -- 172.21.15.125:0/3455193890 learned_addr learned my addr 172.21.15.125:0/3455193890 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.523+0000 7f9c09d9b700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0a59c700 1 -- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 msgr2=0x7f9c0c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0a59c700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0a59c700 1 -- 172.21.15.125:0/3455193890 >> v1:172.21.15.125:6789/0 conn(0x7f9c0c133f50 legacy=0x7f9c0c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0a59c700 1 -- 172.21.15.125:0/3455193890 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c09e6a0 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0959a700 1 -- 172.21.15.125:0/3455193890 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277169472 0 0) 0x7f9c0c09dc00 con 0x7f9c0c133f50 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0a59c700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c0a0a70 0x7f9c0c0a0e40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009840 tx=0x7f9bfc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605b923236498389 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0959a700 1 -- 172.21.15.125:0/3455193890 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc011830 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0959a700 1 -- 172.21.15.125:0/3455193890 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc011990 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c0959a700 1 -- 172.21.15.125:0/3455193890 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc011d20 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 -- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c0a0a70 msgr2=0x7f9c0c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c0a0a70 0x7f9c0c0a0e40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009840 tx=0x7f9bfc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 -- 172.21.15.125:0/3455193890 shutdown_connections 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c0a0a70 0x7f9c0c0a0e40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/3455193890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 -- 172.21.15.125:0/3455193890 >> 172.21.15.125:0/3455193890 conn(0x7f9c0c0a6610 msgr2=0x7f9c0c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.524+0000 7f9c10f5c700 1 -- 172.21.15.125:0/3455193890 shutdown_connections 2023-10-03T10:14:47.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.525+0000 7f9c10f5c700 1 -- 172.21.15.125:0/3455193890 wait complete. 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.525+0000 7f9c10f5c700 1 Processor -- start 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 -- start start 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c0c0a0a70 0x7f9c0c1c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c1c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c1209e0 con 0x7f9c0c133f50 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c1207f0 con 0x7f9c0c0a1380 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c10f5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c122700 con 0x7f9c0c0a0a70 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c09d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c1c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53132/0 (socket says 172.21.15.125:53132) 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 -- 172.21.15.125:0/2122893997 learned_addr learned my addr 172.21.15.125:0/2122893997 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c09d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c1c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34582/0 (socket says 172.21.15.125:34582) 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 -- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c0c0a0a70 msgr2=0x7f9c0c1c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c0c0a0a70 0x7f9c0c1c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 -- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 msgr2=0x7f9c0c1c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c1c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 -- 172.21.15.125:0/2122893997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0094a0 con 0x7f9c0c133f50 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.526+0000 7f9c0ad9d700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9c04002230 tx=0x7f9c0400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400ab70 con 0x7f9c0c133f50 2023-10-03T10:14:47.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0400acf0 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04007310 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c0a17b0 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c120fe0 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.527+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c04007470 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.528+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c0403f190 con 0x7f9c0c133f50 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.528+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c0a4fd0 con 0x7f9c0c133f50 2023-10-03T10:14:47.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.532+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c04018080 con 0x7f9c0c133f50 2023-10-03T10:14:47.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.681+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f73a404f2a0 con 0x7f73a409e870 2023-10-03T10:14:47.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.682+0000 7f73a17fa700 1 -- 172.21.15.125:0/3643186311 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f739802d7d0 con 0x7f73a409e870 2023-10-03T10:14:47.682 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 msgr2=0x7f73a411f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 0x7f73a411f1b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7398016000 tx=0x7f7398004750 comp rx=0 tx=0).stop 2023-10-03T10:14:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 shutdown_connections 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73a4131d70 0x7f73a411fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73a409e870 0x7f73a411f1b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 --2- 172.21.15.125:0/3643186311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73a409f180 0x7f73a411f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 >> 172.21.15.125:0/3643186311 conn(0x7f73a40a4430 msgr2=0x7f73a4131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 shutdown_connections 2023-10-03T10:14:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.684+0000 7f73aaaea700 1 -- 172.21.15.125:0/3643186311 wait complete. 2023-10-03T10:14:47.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:47.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.725+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c0c04f2a0 con 0x7f9c0c133f50 2023-10-03T10:14:47.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.725+0000 7f9bfaffd700 1 -- 172.21.15.125:0/2122893997 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c0400ae60 con 0x7f9c0c133f50 2023-10-03T10:14:47.726 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 msgr2=0x7f9c0c1c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9c04002230 tx=0x7f9c0400cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 shutdown_connections 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c0c133f50 0x7f9c0c1c90f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c0c0a0a70 0x7f9c0c1c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 --2- 172.21.15.125:0/2122893997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c0c0a1380 0x7f9c0c1c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 >> 172.21.15.125:0/2122893997 conn(0x7f9c0c0a6610 msgr2=0x7f9c0c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 shutdown_connections 2023-10-03T10:14:47.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:47.727+0000 7f9c10f5c700 1 -- 172.21.15.125:0/2122893997 wait complete. 2023-10-03T10:14:47.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:48.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:48.261 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.349+0000 7f4d9ecd4700 1 Processor -- start 2023-10-03T10:14:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.349+0000 7f4d9ecd4700 1 -- start start 2023-10-03T10:14:48.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d98131d70 0x7f4d98132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980a0920 con 0x7f4d98131d70 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9809c970 con 0x7f4d9809f180 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ecd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9809bab0 con 0x7f4d9809e870 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34586/0 (socket says 172.21.15.125:34586) 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 -- 172.21.15.125:0/529849421 learned_addr learned my addr 172.21.15.125:0/529849421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9ca70700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d9d271700 1 --2- 172.21.15.125:0/529849421 >> v2:172.21.15.125:3300/0 conn(0x7f4d98131d70 0x7f4d98132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 -- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 msgr2=0x7f4d9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d9809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 -- 172.21.15.125:0/529849421 >> v2:172.21.15.125:3300/0 conn(0x7f4d98131d70 msgr2=0x7f4d98132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 --2- 172.21.15.125:0/529849421 >> v2:172.21.15.125:3300/0 conn(0x7f4d98131d70 0x7f4d98132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 -- 172.21.15.125:0/529849421 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9809f9c0 con 0x7f4d9809f180 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d97fff700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d840098f0 tx=0x7f4d84009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa07debf2d4d93e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d977fe700 1 -- 172.21.15.125:0/529849421 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84011830 con 0x7f4d9809f180 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d977fe700 1 -- 172.21.15.125:0/529849421 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84011990 con 0x7f4d9809f180 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.350+0000 7f4d977fe700 1 -- 172.21.15.125:0/529849421 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84011d20 con 0x7f4d9809f180 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 msgr2=0x7f4d98131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d840098f0 tx=0x7f4d84009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/529849421 shutdown_connections 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/529849421 >> v2:172.21.15.125:3300/0 conn(0x7f4d98131d70 0x7f4d98132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/529849421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d98131830 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/529849421 >> 172.21.15.125:0/529849421 conn(0x7f4d980a4430 msgr2=0x7f4d980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/529849421 shutdown_connections 2023-10-03T10:14:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.351+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/529849421 wait complete. 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.352+0000 7f4d9ecd4700 1 Processor -- start 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.352+0000 7f4d9ecd4700 1 -- start start 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d98120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98123940 con 0x7f4d98131d70 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98121c70 con 0x7f4d9809f180 2023-10-03T10:14:48.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98122b00 con 0x7f4d9809e870 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9d271700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9d271700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53150/0 (socket says 172.21.15.125:53150) 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34598/0 (socket says 172.21.15.125:34598) 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9d271700 1 -- 172.21.15.125:0/3064866351 learned_addr learned my addr 172.21.15.125:0/3064866351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ca70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d98120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 -- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 msgr2=0x7f4d98120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d98120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 -- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 msgr2=0x7f4d98120ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 -- 172.21.15.125:0/3064866351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009550 con 0x7f4d9809f180 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ca70700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d98120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9d271700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d97fff700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806b820 tx=0x7f4d84004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84004240 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8401f070 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840036a0 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.353+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d981235e0 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.354+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980a0210 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.354+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d84021030 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.354+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d84040860 con 0x7f4d9809f180 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.354+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9811d580 con 0x7f4d9809f180 2023-10-03T10:14:48.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.359+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d84015020 con 0x7f4d9809f180 2023-10-03T10:14:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.390+0000 7f99c0f60700 1 Processor -- start 2023-10-03T10:14:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.390+0000 7f99c0f60700 1 -- start start 2023-10-03T10:14:48.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99c0f60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99bc09e870 0x7f99bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99c0f60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 0x7f99bc13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99c0f60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc06bec0 con 0x7f99bc09f180 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99c0f60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc06ce60 con 0x7f99bc09e870 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99c0f60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc09fa00 con 0x7f99bc1343a0 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99bc09e870 0x7f99bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99bc09e870 0x7f99bc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53158/0 (socket says 172.21.15.125:53158) 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99b9d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f99bc09f180 0x7f99bc133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40902/0 (socket says 172.21.15.125:40902) 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 -- 172.21.15.125:0/376215451 learned_addr learned my addr 172.21.15.125:0/376215451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99bad9d700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 0x7f99bc13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 -- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 msgr2=0x7f99bc13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 0x7f99bc13bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 -- 172.21.15.125:0/376215451 >> v1:172.21.15.125:6789/0 conn(0x7f99bc09f180 legacy=0x7f99bc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 -- 172.21.15.125:0/376215451 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc09ad80 con 0x7f99bc09e870 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99b959a700 1 -- 172.21.15.125:0/376215451 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519235098 0 0) 0x7f99bc06bec0 con 0x7f99bc09f180 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99bad9d700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 0x7f99bc13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99ba59c700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09e870 0x7f99bc09ec40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f99b40098f0 tx=0x7f99b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f10b94d49a8fce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99b959a700 1 -- 172.21.15.125:0/376215451 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4011830 con 0x7f99bc09e870 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99b959a700 1 -- 172.21.15.125:0/376215451 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4011990 con 0x7f99bc09e870 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.391+0000 7f99b959a700 1 -- 172.21.15.125:0/376215451 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4011d20 con 0x7f99bc09e870 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 -- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09e870 msgr2=0x7f99bc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09e870 0x7f99bc09ec40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f99b40098f0 tx=0x7f99b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 -- 172.21.15.125:0/376215451 shutdown_connections 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc1343a0 0x7f99bc13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 --2- 172.21.15.125:0/376215451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09e870 0x7f99bc09ec40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 -- 172.21.15.125:0/376215451 >> 172.21.15.125:0/376215451 conn(0x7f99bc0a4430 msgr2=0x7f99bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 -- 172.21.15.125:0/376215451 shutdown_connections 2023-10-03T10:14:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.392+0000 7f99c0f60700 1 -- 172.21.15.125:0/376215451 wait complete. 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.393+0000 7f99c0f60700 1 Processor -- start 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.393+0000 7f99c0f60700 1 -- start start 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 0x7f99bc1228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99bc1343a0 0x7f99bc123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc133430 con 0x7f99bc09f180 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc125e20 con 0x7f99bc1343a0 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1263c0 con 0x7f99bc09e870 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53174/0 (socket says 172.21.15.125:53174) 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 -- 172.21.15.125:0/2817497300 learned_addr learned my addr 172.21.15.125:0/2817497300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99bad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99bc1343a0 0x7f99bc123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99ba59c700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 0x7f99bc1228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 -- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 msgr2=0x7f99bc1228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 0x7f99bc1228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 -- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99bc1343a0 msgr2=0x7f99bc123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99bc1343a0 0x7f99bc123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 -- 172.21.15.125:0/2817497300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009a70 con 0x7f99bc09f180 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99ba59c700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 0x7f99bc1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99b9d9b700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c550 tx=0x7f99b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0004c80 con 0x7f99bc09f180 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0004e00 con 0x7f99bc09f180 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4009550 con 0x7f99bc09f180 2023-10-03T10:14:48.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0007310 con 0x7f99bc09f180 2023-10-03T10:14:48.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.394+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc06cfa0 con 0x7f99bc09f180 2023-10-03T10:14:48.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.395+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04f2a0 con 0x7f99bc09f180 2023-10-03T10:14:48.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.396+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99b0007470 con 0x7f99bc09f180 2023-10-03T10:14:48.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.396+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99b003f8f0 con 0x7f99bc09f180 2023-10-03T10:14:48.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.400+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99b00133c0 con 0x7f99bc09f180 2023-10-03T10:14:48.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.551+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d9804f2a0 con 0x7f4d9809f180 2023-10-03T10:14:48.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.552+0000 7f4d957fa700 1 -- 172.21.15.125:0/3064866351 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d84015020 con 0x7f4d9809f180 2023-10-03T10:14:48.552 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:48.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 msgr2=0x7f4d981205a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806b820 tx=0x7f4d84004750 comp rx=0 tx=0).stop 2023-10-03T10:14:48.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 shutdown_connections 2023-10-03T10:14:48.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d98131d70 0x7f4d98120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d9809e870 0x7f4d98120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 --2- 172.21.15.125:0/3064866351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d9809f180 0x7f4d981205a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 >> 172.21.15.125:0/3064866351 conn(0x7f4d980a4430 msgr2=0x7f4d9811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 shutdown_connections 2023-10-03T10:14:48.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.554+0000 7f4d9ecd4700 1 -- 172.21.15.125:0/3064866351 wait complete. 2023-10-03T10:14:48.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:48.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.593+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99bc06c670 con 0x7f99bc09f180 2023-10-03T10:14:48.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.593+0000 7f99aaffd700 1 -- 172.21.15.125:0/2817497300 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99b0011360 con 0x7f99bc09f180 2023-10-03T10:14:48.594 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 msgr2=0x7f99bc122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c550 tx=0x7f99b000c860 comp rx=0 tx=0).stop 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 shutdown_connections 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99bc1343a0 0x7f99bc123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99bc09e870 0x7f99bc1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 --2- 172.21.15.125:0/2817497300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99bc09f180 0x7f99bc122de0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 >> 172.21.15.125:0/2817497300 conn(0x7f99bc0a4430 msgr2=0x7f99bc070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 shutdown_connections 2023-10-03T10:14:48.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.595+0000 7f99c0f60700 1 -- 172.21.15.125:0/2817497300 wait complete. 2023-10-03T10:14:48.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:48.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:48.740 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:48.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 Processor -- start 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 -- start start 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1409dc00 con 0x7f7c14133f50 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1409ea60 con 0x7f7c140a1380 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c1a29a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1409dec0 con 0x7f7c140a0a70 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37886/0 (socket says 172.21.15.125:37886) 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34610/0 (socket says 172.21.15.125:34610) 2023-10-03T10:14:48.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.825+0000 7f7c13fff700 1 -- 172.21.15.125:0/1152822455 learned_addr learned my addr 172.21.15.125:0/1152822455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c13fff700 1 -- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 msgr2=0x7f7c14133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c13fff700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c12ffd700 1 -- 172.21.15.125:0/1152822455 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290798070 0 0) 0x7f7c1409dc00 con 0x7f7c14133f50 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c13fff700 1 -- 172.21.15.125:0/1152822455 >> v1:172.21.15.125:6789/0 conn(0x7f7c14133f50 legacy=0x7f7c1413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c13fff700 1 -- 172.21.15.125:0/1152822455 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1409e6a0 con 0x7f7c140a0a70 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c137fe700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c13fff700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009920 tx=0x7f7c04009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=474d3f8023d42abc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c12ffd700 1 -- 172.21.15.125:0/1152822455 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011830 con 0x7f7c140a0a70 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c12ffd700 1 -- 172.21.15.125:0/1152822455 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04011990 con 0x7f7c140a0a70 2023-10-03T10:14:48.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.826+0000 7f7c12ffd700 1 -- 172.21.15.125:0/1152822455 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011d20 con 0x7f7c140a0a70 2023-10-03T10:14:48.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 -- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 msgr2=0x7f7c140a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009920 tx=0x7f7c04009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:48.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 -- 172.21.15.125:0/1152822455 shutdown_connections 2023-10-03T10:14:48.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c140a0a70 0x7f7c140a0e40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/1152822455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a1380 0x7f7c14133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 -- 172.21.15.125:0/1152822455 >> 172.21.15.125:0/1152822455 conn(0x7f7c140a6610 msgr2=0x7f7c140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 -- 172.21.15.125:0/1152822455 shutdown_connections 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.827+0000 7f7c1a29a700 1 -- 172.21.15.125:0/1152822455 wait complete. 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 Processor -- start 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 -- start start 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a0a70 0x7f7c14122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140a03e0 con 0x7f7c140a1380 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14126070 con 0x7f7c140a0a70 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c1a29a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14124ca0 con 0x7f7c14133f50 2023-10-03T10:14:48.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c18837700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53190/0 (socket says 172.21.15.125:53190) 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c18837700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37898/0 (socket says 172.21.15.125:37898) 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c137fe700 1 -- 172.21.15.125:0/4220814006 learned_addr learned my addr 172.21.15.125:0/4220814006 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.828+0000 7f7c13fff700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a0a70 0x7f7c14122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 -- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 msgr2=0x7f7c141232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 -- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a0a70 msgr2=0x7f7c14122830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a0a70 0x7f7c14122830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 -- 172.21.15.125:0/4220814006 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080094a0 con 0x7f7c140a1380 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c18837700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c137fe700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800ebe0 tx=0x7f7c0800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800c850 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800c9b0 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c04009550 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800cd40 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.829+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140a5690 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.830+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c08013470 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.830+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1404f2a0 con 0x7f7c140a1380 2023-10-03T10:14:48.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.830+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c0803faf0 con 0x7f7c140a1380 2023-10-03T10:14:48.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.835+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c08013720 con 0x7f7c140a1380 2023-10-03T10:14:48.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 Processor -- start 2023-10-03T10:14:48.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 -- start start 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09c009f350 0x7f09c0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c01371c0 0x7f09c01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c009c970 con 0x7f09c009e870 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.868+0000 7f09c5e28700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00a0920 con 0x7f09c009f350 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09c5e28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c009f9c0 con 0x7f09c01371c0 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09c009f350 0x7f09c0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09bf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f09c009e870 0x7f09c009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40912/0 (socket says 172.21.15.125:40912) 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09bf7fe700 1 -- 172.21.15.125:0/1479217717 learned_addr learned my addr 172.21.15.125:0/1479217717 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:48.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09bffff700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c01371c0 0x7f09c01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 -- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c01371c0 msgr2=0x7f09c01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c01371c0 0x7f09c01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 -- 172.21.15.125:0/1479217717 >> v1:172.21.15.125:6789/0 conn(0x7f09c009e870 legacy=0x7f09c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 -- 172.21.15.125:0/1479217717 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c009bab0 con 0x7f09c009f350 2023-10-03T10:14:48.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09be7fc700 1 -- 172.21.15.125:0/1479217717 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338335279 0 0) 0x7f09c009c970 con 0x7f09c009e870 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09beffd700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c009f350 0x7f09c0136c80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009840 tx=0x7f09b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd73dcbd8da33d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09be7fc700 1 -- 172.21.15.125:0/1479217717 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4011830 con 0x7f09c009f350 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09be7fc700 1 -- 172.21.15.125:0/1479217717 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b4011990 con 0x7f09c009f350 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.869+0000 7f09be7fc700 1 -- 172.21.15.125:0/1479217717 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4011d20 con 0x7f09c009f350 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 -- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c009f350 msgr2=0x7f09c0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c009f350 0x7f09c0136c80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009840 tx=0x7f09b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 -- 172.21.15.125:0/1479217717 shutdown_connections 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c01371c0 0x7f09c01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1479217717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c009f350 0x7f09c0136c80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 -- 172.21.15.125:0/1479217717 >> 172.21.15.125:0/1479217717 conn(0x7f09c00a4430 msgr2=0x7f09c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 -- 172.21.15.125:0/1479217717 shutdown_connections 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.870+0000 7f09c5e28700 1 -- 172.21.15.125:0/1479217717 wait complete. 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 Processor -- start 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 -- start start 2023-10-03T10:14:48.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 0x7f09c006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 0x7f09c006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0125f10 con 0x7f09c01371c0 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c006d560 con 0x7f09c009f350 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09c5e28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0126140 con 0x7f09c009e870 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09beffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09bffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 0x7f09c006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09beffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34642/0 (socket says 172.21.15.125:34642) 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09beffd700 1 -- 172.21.15.125:0/1921527913 learned_addr learned my addr 172.21.15.125:0/1921527913 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.871+0000 7f09bf7fe700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 0x7f09c006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 -- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 msgr2=0x7f09c006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 0x7f09c006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 -- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 msgr2=0x7f09c006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 0x7f09c006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 -- 172.21.15.125:0/1921527913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40094a0 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09bffff700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 0x7f09c006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09bf7fe700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 0x7f09c006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09beffd700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009fd0 tx=0x7f09b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40036a0 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b401f070 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c00722c0 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4003a60 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.872+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c0126bb0 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.873+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09b4003bc0 con 0x7f09c009f350 2023-10-03T10:14:48.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.873+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09b4021070 con 0x7f09c009f350 2023-10-03T10:14:48.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.873+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c004f2a0 con 0x7f09c009f350 2023-10-03T10:14:48.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:48.878+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09b4015020 con 0x7f09c009f350 2023-10-03T10:14:49.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.028+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c14072980 con 0x7f7c140a1380 2023-10-03T10:14:49.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.029+0000 7f7c10ff9700 1 -- 172.21.15.125:0/4220814006 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c0803fe60 con 0x7f7c140a1380 2023-10-03T10:14:49.029 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 msgr2=0x7f7c14122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800ebe0 tx=0x7f7c0800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 shutdown_connections 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7c14133f50 0x7f7c141232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c140a0a70 0x7f7c14122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 --2- 172.21.15.125:0/4220814006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c140a1380 0x7f7c14122d70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 >> 172.21.15.125:0/4220814006 conn(0x7f7c140a6610 msgr2=0x7f7c140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 shutdown_connections 2023-10-03T10:14:49.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.031+0000 7f7c1a29a700 1 -- 172.21.15.125:0/4220814006 wait complete. 2023-10-03T10:14:49.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:49.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.071+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09c006b2a0 con 0x7f09c009f350 2023-10-03T10:14:49.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.071+0000 7f09a7fff700 1 -- 172.21.15.125:0/1921527913 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09b40253e0 con 0x7f09c009f350 2023-10-03T10:14:49.072 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 msgr2=0x7f09c006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009fd0 tx=0x7f09b4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 shutdown_connections 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01371c0 0x7f09c006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09c009e870 0x7f09c006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 --2- 172.21.15.125:0/1921527913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09c009f350 0x7f09c006bdf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 >> 172.21.15.125:0/1921527913 conn(0x7f09c00a4430 msgr2=0x7f09c00a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 shutdown_connections 2023-10-03T10:14:49.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.073+0000 7f09c5e28700 1 -- 172.21.15.125:0/1921527913 wait complete. 2023-10-03T10:14:49.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:49.567 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:49.609 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.696+0000 7f2cfb977700 1 Processor -- start 2023-10-03T10:14:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.696+0000 7f2cfb977700 1 -- start start 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cfb977700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cfb977700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf409edb0 0x7f2cf409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cfb977700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf409af80 con 0x7f2cf4133c20 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cfb977700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf409fe00 con 0x7f2cf409edb0 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cfb977700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf406bec0 con 0x7f2cf409a150 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf409edb0 0x7f2cf409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf9713700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cf409edb0 0x7f2cf409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53212/0 (socket says 172.21.15.125:53212) 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf9713700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34646/0 (socket says 172.21.15.125:34646) 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 -- 172.21.15.125:0/2228711650 learned_addr learned my addr 172.21.15.125:0/2228711650 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf9f14700 1 --1- 172.21.15.125:0/2228711650 >> v1:172.21.15.125:6789/0 conn(0x7f2cf4133c20 0x7f2cf4134070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40914/0 (socket says 172.21.15.125:40914) 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 -- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 msgr2=0x7f2cf409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 -- 172.21.15.125:0/2228711650 >> v1:172.21.15.125:6789/0 conn(0x7f2cf4133c20 legacy=0x7f2cf4134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 -- 172.21.15.125:0/2228711650 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf409f6e0 con 0x7f2cf409edb0 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cebfff700 1 -- 172.21.15.125:0/2228711650 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276123662 0 0) 0x7f2cf409af80 con 0x7f2cf4133c20 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf9713700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.697+0000 7f2cf8f12700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409edb0 0x7f2cf409f1a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40098f0 tx=0x7f2ce4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5e2a7262f34889 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cebfff700 1 -- 172.21.15.125:0/2228711650 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4011830 con 0x7f2cf409edb0 2023-10-03T10:14:49.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cebfff700 1 -- 172.21.15.125:0/2228711650 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4011990 con 0x7f2cf409edb0 2023-10-03T10:14:49.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cebfff700 1 -- 172.21.15.125:0/2228711650 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4011d20 con 0x7f2cf409edb0 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 -- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409edb0 msgr2=0x7f2cf409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409edb0 0x7f2cf409f1a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40098f0 tx=0x7f2ce4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 -- 172.21.15.125:0/2228711650 shutdown_connections 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf409a150 0x7f2cf409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 --2- 172.21.15.125:0/2228711650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409edb0 0x7f2cf409f1a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 -- 172.21.15.125:0/2228711650 >> 172.21.15.125:0/2228711650 conn(0x7f2cf40a4430 msgr2=0x7f2cf40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 -- 172.21.15.125:0/2228711650 shutdown_connections 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.698+0000 7f2cfb977700 1 -- 172.21.15.125:0/2228711650 wait complete. 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.699+0000 7f2cfb977700 1 Processor -- start 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.699+0000 7f2cfb977700 1 -- start start 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf409edb0 0x7f2cf4122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf4133c20 0x7f2cf4123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4126110 con 0x7f2cf409a150 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4125090 con 0x7f2cf4133c20 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41258a0 con 0x7f2cf409edb0 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53220/0 (socket says 172.21.15.125:53220) 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 -- 172.21.15.125:0/3636297384 learned_addr learned my addr 172.21.15.125:0/3636297384 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9f14700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf4133c20 0x7f2cf4123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf8f12700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf409edb0 0x7f2cf4122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 -- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf409edb0 msgr2=0x7f2cf4122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf409edb0 0x7f2cf4122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 -- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf4133c20 msgr2=0x7f2cf4123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf4133c20 0x7f2cf4123070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 -- 172.21.15.125:0/3636297384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00094a0 con 0x7f2cf409a150 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cf9713700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000ebe0 tx=0x7f2cf000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0009760 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000c850 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.700+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4009550 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.701+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cbe0 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.701+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf41339c0 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.702+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf409fa30 con 0x7f2cf409a150 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.702+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf000cd40 con 0x7f2cf409a150 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.702+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cf0040180 con 0x7f2cf409a150 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.706+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cf0011350 con 0x7f2cf409a150 2023-10-03T10:14:49.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.736+0000 7f805f24e700 1 Processor -- start 2023-10-03T10:14:49.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 -- start start 2023-10-03T10:14:49.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 0x7f80580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f805813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805809dc00 con 0x7f80580a1380 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805809ea90 con 0x7f80580a0a70 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805f24e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f805809dec0 con 0x7f8058134120 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805d7eb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f805813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f805cfea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 0x7f80580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f8057fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f80580a1380 0x7f8058133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40916/0 (socket says 172.21.15.125:40916) 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.737+0000 7f8057fff700 1 -- 172.21.15.125:0/2442906594 learned_addr learned my addr 172.21.15.125:0/2442906594 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805cfea700 1 -- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 msgr2=0x7f805813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805cfea700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f805813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805cfea700 1 -- 172.21.15.125:0/2442906594 >> v1:172.21.15.125:6789/0 conn(0x7f80580a1380 legacy=0x7f8058133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805cfea700 1 -- 172.21.15.125:0/2442906594 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805809e6a0 con 0x7f80580a0a70 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805d7eb700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f805813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f805cfea700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 0x7f80580a0e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f804c009870 tx=0x7f804c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b180875f146f81b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f80577fe700 1 -- 172.21.15.125:0/2442906594 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c011830 con 0x7f80580a0a70 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f80577fe700 1 -- 172.21.15.125:0/2442906594 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c011990 con 0x7f80580a0a70 2023-10-03T10:14:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.738+0000 7f80577fe700 1 -- 172.21.15.125:0/2442906594 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c011d20 con 0x7f80580a0a70 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 -- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 msgr2=0x7f80580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 0x7f80580a0e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f804c009870 tx=0x7f804c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 -- 172.21.15.125:0/2442906594 shutdown_connections 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f805813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 --2- 172.21.15.125:0/2442906594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a0a70 0x7f80580a0e40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 -- 172.21.15.125:0/2442906594 >> 172.21.15.125:0/2442906594 conn(0x7f80580a6610 msgr2=0x7f80580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 -- 172.21.15.125:0/2442906594 shutdown_connections 2023-10-03T10:14:49.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.739+0000 7f805f24e700 1 -- 172.21.15.125:0/2442906594 wait complete. 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.740+0000 7f805f24e700 1 Processor -- start 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.740+0000 7f805f24e700 1 -- start start 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f8058123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058124670 con 0x7f80580a0a70 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8058133aa0 con 0x7f80580a1380 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805f24e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8058123d20 con 0x7f8058134120 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f8057fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f8057fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34658/0 (socket says 172.21.15.125:34658) 2023-10-03T10:14:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53236/0 (socket says 172.21.15.125:53236) 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f8057fff700 1 -- 172.21.15.125:0/1589315464 learned_addr learned my addr 172.21.15.125:0/1589315464 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805d7eb700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f8058123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 -- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 msgr2=0x7f8058123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f8058123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 -- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 msgr2=0x7f8058122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f805cfea700 1 -- 172.21.15.125:0/1589315464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050009a70 con 0x7f80580a0a70 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.741+0000 7f8057fff700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f805cfea700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f804c016000 tx=0x7f804c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c004450 con 0x7f80580a0a70 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c01f070 con 0x7f80580a0a70 2023-10-03T10:14:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0038e0 con 0x7f80580a0a70 2023-10-03T10:14:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c0094a0 con 0x7f80580a0a70 2023-10-03T10:14:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8058124d00 con 0x7f80580a0a70 2023-10-03T10:14:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.742+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f804c003a40 con 0x7f80580a0a70 2023-10-03T10:14:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.743+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f804c021070 con 0x7f80580a0a70 2023-10-03T10:14:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.743+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805804f2a0 con 0x7f80580a0a70 2023-10-03T10:14:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.752+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f804c02b020 con 0x7f80580a0a70 2023-10-03T10:14:49.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.905+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2cf4125c30 con 0x7f2cf409a150 2023-10-03T10:14:49.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.905+0000 7f2ce9ffb700 1 -- 172.21.15.125:0/3636297384 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf0017020 con 0x7f2cf409a150 2023-10-03T10:14:49.906 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 msgr2=0x7f2cf41225f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000ebe0 tx=0x7f2cf000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 shutdown_connections 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2cf4133c20 0x7f2cf4123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cf409a150 0x7f2cf41225f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 --2- 172.21.15.125:0/3636297384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2cf409edb0 0x7f2cf4122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 >> 172.21.15.125:0/3636297384 conn(0x7f2cf40a4430 msgr2=0x7f2cf40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 shutdown_connections 2023-10-03T10:14:49.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.907+0000 7f2cfb977700 1 -- 172.21.15.125:0/3636297384 wait complete. 2023-10-03T10:14:49.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:49.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.946+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80580a2710 con 0x7f80580a0a70 2023-10-03T10:14:49.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.947+0000 7f80557fa700 1 -- 172.21.15.125:0/1589315464 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f804c01a7b0 con 0x7f80580a0a70 2023-10-03T10:14:49.947 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.948+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 msgr2=0x7f80581228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.948+0000 7f805f24e700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f804c016000 tx=0x7f804c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 shutdown_connections 2023-10-03T10:14:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8058134120 0x7f8058123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80580a0a70 0x7f80581228e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 --2- 172.21.15.125:0/1589315464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80580a1380 0x7f8058122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 >> 172.21.15.125:0/1589315464 conn(0x7f80580a6610 msgr2=0x7f80580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 shutdown_connections 2023-10-03T10:14:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:49.949+0000 7f805f24e700 1 -- 172.21.15.125:0/1589315464 wait complete. 2023-10-03T10:14:49.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:50.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:50.086 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:50.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.171+0000 7f66c70c4700 1 Processor -- start 2023-10-03T10:14:50.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.171+0000 7f66c70c4700 1 -- start start 2023-10-03T10:14:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c70c4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c70c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c70c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c009dc00 con 0x7f66c00a1380 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c70c4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c009ea90 con 0x7f66c00a0a70 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c70c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c009dec0 con 0x7f66c0134120 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66bffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f66c00a1380 0x7f66c0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40932/0 (socket says 172.21.15.125:40932) 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c4e60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66bffff700 1 -- 172.21.15.125:0/2081719313 learned_addr learned my addr 172.21.15.125:0/2081719313 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66c5661700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.172+0000 7f66bf7fe700 1 -- 172.21.15.125:0/2081719313 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490033776 0 0) 0x7f66c009dc00 con 0x7f66c00a1380 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c4e60700 1 -- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 msgr2=0x7f66c013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c4e60700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c4e60700 1 -- 172.21.15.125:0/2081719313 >> v1:172.21.15.125:6789/0 conn(0x7f66c00a1380 legacy=0x7f66c0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c4e60700 1 -- 172.21.15.125:0/2081719313 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c009e6a0 con 0x7f66c00a0a70 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c5661700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66c4e60700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c00a0e40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009870 tx=0x7f66b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b6edf76ca938a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66bf7fe700 1 -- 172.21.15.125:0/2081719313 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011830 con 0x7f66c00a0a70 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66bf7fe700 1 -- 172.21.15.125:0/2081719313 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4011990 con 0x7f66c00a0a70 2023-10-03T10:14:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.173+0000 7f66bf7fe700 1 -- 172.21.15.125:0/2081719313 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4011d20 con 0x7f66c00a0a70 2023-10-03T10:14:50.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 -- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 msgr2=0x7f66c00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c00a0e40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009870 tx=0x7f66b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:50.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 -- 172.21.15.125:0/2081719313 shutdown_connections 2023-10-03T10:14:50.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 --2- 172.21.15.125:0/2081719313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c00a0e40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 -- 172.21.15.125:0/2081719313 >> 172.21.15.125:0/2081719313 conn(0x7f66c00a6610 msgr2=0x7f66c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 -- 172.21.15.125:0/2081719313 shutdown_connections 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.174+0000 7f66c70c4700 1 -- 172.21.15.125:0/2081719313 wait complete. 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.175+0000 7f66c70c4700 1 Processor -- start 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.175+0000 7f66c70c4700 1 -- start start 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c01c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c00a1380 0x7f66c01c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c01264b0 con 0x7f66c00a1380 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c01247a0 con 0x7f66c00a0a70 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c70c4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0124d50 con 0x7f66c0134120 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c5661700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c5661700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37960/0 (socket says 172.21.15.125:37960) 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c5661700 1 -- 172.21.15.125:0/4047809953 learned_addr learned my addr 172.21.15.125:0/4047809953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.176+0000 7f66c4e60700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c01c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 -- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 msgr2=0x7f66c01c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c01c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 -- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c00a1380 msgr2=0x7f66c01c8a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c00a1380 0x7f66c01c8a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 -- 172.21.15.125:0/4047809953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8009a70 con 0x7f66c0134120 2023-10-03T10:14:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c4e60700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c01c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.177+0000 7f66c5661700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f66b800efc0 tx=0x7f66b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800cbe0 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800f040 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40094a0 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8003a20 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c009d390 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.178+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66b8003b80 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.179+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66b8040100 con 0x7f66c0134120 2023-10-03T10:14:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.179+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c004f2a0 con 0x7f66c0134120 2023-10-03T10:14:50.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.184+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66b8003e30 con 0x7f66c0134120 2023-10-03T10:14:50.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 Processor -- start 2023-10-03T10:14:50.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 -- start start 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c139200 0x7fe71c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c09e9d0 con 0x7fe71c0a0a70 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.214+0000 7fe723058700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c09dc00 con 0x7fe71c139200 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe723058700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c09dec0 con 0x7fe71c0a1550 2023-10-03T10:14:50.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c139200 0x7fe71c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c139200 0x7fe71c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53248/0 (socket says 172.21.15.125:53248) 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34688/0 (socket says 172.21.15.125:34688) 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 -- 172.21.15.125:0/2646846936 learned_addr learned my addr 172.21.15.125:0/2646846936 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 -- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 msgr2=0x7fe71c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 -- 172.21.15.125:0/2646846936 >> v1:172.21.15.125:6789/0 conn(0x7fe71c0a0a70 legacy=0x7fe71c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 -- 172.21.15.125:0/2646846936 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c09e6a0 con 0x7fe71c139200 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71b7fe700 1 -- 172.21.15.125:0/2646846936 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986028422 0 0) 0x7fe71c09e9d0 con 0x7fe71c0a0a70 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71bfff700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe7215f5700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c139200 0x7fe71c13b5e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e50 tx=0x7fe71400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f67b872c75fe4c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71b7fe700 1 -- 172.21.15.125:0/2646846936 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400e070 con 0x7fe71c139200 2023-10-03T10:14:50.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71b7fe700 1 -- 172.21.15.125:0/2646846936 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400b910 con 0x7fe71c139200 2023-10-03T10:14:50.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.215+0000 7fe71b7fe700 1 -- 172.21.15.125:0/2646846936 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400bcc0 con 0x7fe71c139200 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 -- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c139200 msgr2=0x7fe71c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c139200 0x7fe71c13b5e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e50 tx=0x7fe71400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 -- 172.21.15.125:0/2646846936 shutdown_connections 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c139200 0x7fe71c13b5e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 --2- 172.21.15.125:0/2646846936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c0a1550 0x7fe71c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 -- 172.21.15.125:0/2646846936 >> 172.21.15.125:0/2646846936 conn(0x7fe71c0a6610 msgr2=0x7fe71c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 -- 172.21.15.125:0/2646846936 shutdown_connections 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.216+0000 7fe723058700 1 -- 172.21.15.125:0/2646846936 wait complete. 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 Processor -- start 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 -- start start 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 0x7fe71c1216f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c139200 0x7fe71c122170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c125180 con 0x7fe71c0a1550 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c124550 con 0x7fe71c139200 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.218+0000 7fe723058700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0a55f0 con 0x7fe71c0a0a70 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe720df4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 0x7fe71c1216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53252/0 (socket says 172.21.15.125:53252) 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 -- 172.21.15.125:0/737842223 learned_addr learned my addr 172.21.15.125:0/737842223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe7215f5700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c139200 0x7fe71c122170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 -- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 msgr2=0x7fe71c1216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 0x7fe71c1216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 -- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c139200 msgr2=0x7fe71c122170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c139200 0x7fe71c122170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 -- 172.21.15.125:0/737842223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080094a0 con 0x7fe71c0a1550 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe720df4700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 0x7fe71c1216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe71bfff700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe70800ebe0 tx=0x7fe70800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800c850 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800c9b0 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe714009b30 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.219+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800cd40 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.220+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c0a03e0 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.220+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe708013470 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.220+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe70803f730 con 0x7fe71c0a1550 2023-10-03T10:14:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.220+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c04f2a0 con 0x7fe71c0a1550 2023-10-03T10:14:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.225+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe708013720 con 0x7fe71c0a1550 2023-10-03T10:14:50.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.380+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66c006d660 con 0x7f66c0134120 2023-10-03T10:14:50.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.380+0000 7f66bd7fa700 1 -- 172.21.15.125:0/4047809953 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66b802c090 con 0x7f66c0134120 2023-10-03T10:14:50.381 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:50.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 msgr2=0x7f66c01c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f66b800efc0 tx=0x7f66b800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 shutdown_connections 2023-10-03T10:14:50.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66c0134120 0x7f66c01c8fb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66c00a0a70 0x7f66c01c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 --2- 172.21.15.125:0/4047809953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c00a1380 0x7f66c01c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 >> 172.21.15.125:0/4047809953 conn(0x7f66c00a6610 msgr2=0x7f66c009abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 shutdown_connections 2023-10-03T10:14:50.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.382+0000 7f66c70c4700 1 -- 172.21.15.125:0/4047809953 wait complete. 2023-10-03T10:14:50.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.415+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe71c123230 con 0x7fe71c0a1550 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.416+0000 7fe7197fa700 1 -- 172.21.15.125:0/737842223 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe708021020 con 0x7fe71c0a1550 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:50.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 msgr2=0x7fe71c121c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe70800ebe0 tx=0x7fe70800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 shutdown_connections 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe71c139200 0x7fe71c122170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe71c0a0a70 0x7fe71c1216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 --2- 172.21.15.125:0/737842223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0a1550 0x7fe71c121c30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 >> 172.21.15.125:0/737842223 conn(0x7fe71c0a6610 msgr2=0x7fe71c137cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 shutdown_connections 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:50.418+0000 7fe723058700 1 -- 172.21.15.125:0/737842223 wait complete. 2023-10-03T10:14:50.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:50.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:50.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:51.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.048+0000 7f822a733700 1 Processor -- start 2023-10-03T10:14:51.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.048+0000 7f822a733700 1 -- start start 2023-10-03T10:14:51.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f822a733700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f822a733700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82240a1380 0x7f8224133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f822a733700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822409dc00 con 0x7f8224133f50 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f822a733700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822409ea60 con 0x7f82240a1380 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f822a733700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822409dec0 con 0x7f82240a0a70 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f8223fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f8223fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34706/0 (socket says 172.21.15.125:34706) 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f8223fff700 1 -- 172.21.15.125:0/4101276814 learned_addr learned my addr 172.21.15.125:0/4101276814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f82237fe700 1 --2- 172.21.15.125:0/4101276814 >> v2:172.21.15.125:3300/0 conn(0x7f82240a1380 0x7f8224133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f82237fe700 1 -- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 msgr2=0x7f82240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f82237fe700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f82237fe700 1 -- 172.21.15.125:0/4101276814 >> v1:172.21.15.125:6789/0 conn(0x7f8224133f50 legacy=0x7f822413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f8222ffd700 1 -- 172.21.15.125:0/4101276814 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487097168 0 0) 0x7f822409dc00 con 0x7f8224133f50 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f82237fe700 1 -- 172.21.15.125:0/4101276814 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822409e6a0 con 0x7f82240a1380 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.049+0000 7f8223fff700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f82237fe700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a1380 0x7f8224133a10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8218009840 tx=0x7f8218009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3990fbbbd8b4c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f8222ffd700 1 -- 172.21.15.125:0/4101276814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218011830 con 0x7f82240a1380 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f8222ffd700 1 -- 172.21.15.125:0/4101276814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218011990 con 0x7f82240a1380 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f8222ffd700 1 -- 172.21.15.125:0/4101276814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218011d20 con 0x7f82240a1380 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 -- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a1380 msgr2=0x7f8224133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a1380 0x7f8224133a10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8218009840 tx=0x7f8218009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 -- 172.21.15.125:0/4101276814 shutdown_connections 2023-10-03T10:14:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82240a0a70 0x7f82240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 --2- 172.21.15.125:0/4101276814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a1380 0x7f8224133a10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 -- 172.21.15.125:0/4101276814 >> 172.21.15.125:0/4101276814 conn(0x7f82240a6610 msgr2=0x7f82240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.050+0000 7f822a733700 1 -- 172.21.15.125:0/4101276814 shutdown_connections 2023-10-03T10:14:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.051+0000 7f822a733700 1 -- 172.21.15.125:0/4101276814 wait complete. 2023-10-03T10:14:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.052+0000 7f822a733700 1 Processor -- start 2023-10-03T10:14:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.052+0000 7f822a733700 1 -- start start 2023-10-03T10:14:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.052+0000 7f822a733700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 0x7f8224122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.052+0000 7f822a733700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 0x7f8224122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224126220 con 0x7f82240a0a70 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8224133960 con 0x7f8224133f50 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8224133420 con 0x7f82240a1380 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8228cd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 0x7f8224122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8228cd0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34718/0 (socket says 172.21.15.125:34718) 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8223fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 0x7f8224122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8228cd0700 1 -- 172.21.15.125:0/781263587 learned_addr learned my addr 172.21.15.125:0/781263587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 -- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 msgr2=0x7f8224123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 -- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 msgr2=0x7f8224122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 0x7f8224122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 -- 172.21.15.125:0/781263587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009550 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8228cd0700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8223fff700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 0x7f8224122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f82237fe700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 0x7f8224122e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82240a0370 tx=0x7f8218004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180036a0 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821801f070 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180094a0 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218003a40 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.053+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8224126bb0 con 0x7f82240a1380 2023-10-03T10:14:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.054+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8218003ba0 con 0x7f82240a1380 2023-10-03T10:14:51.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.054+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822404f2a0 con 0x7f82240a1380 2023-10-03T10:14:51.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.055+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8218021070 con 0x7f82240a1380 2023-10-03T10:14:51.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.059+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8218010d50 con 0x7f82240a1380 2023-10-03T10:14:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.089+0000 7f13e0416700 1 Processor -- start 2023-10-03T10:14:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.089+0000 7f13e0416700 1 -- start start 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13e0416700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13e0416700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13d8134120 0x7f13d813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13e0416700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d809dc00 con 0x7f13d80a1380 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13e0416700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d809ea60 con 0x7f13d8134120 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13e0416700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d809dec0 con 0x7f13d80a0a70 2023-10-03T10:14:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de9b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13d8134120 0x7f13d813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de1b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de1b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37986/0 (socket says 172.21.15.125:37986) 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de9b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13d8134120 0x7f13d813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53274/0 (socket says 172.21.15.125:53274) 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13dd9b1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13d80a1380 0x7f13d8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40944/0 (socket says 172.21.15.125:40944) 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de1b2700 1 -- 172.21.15.125:0/4090973300 learned_addr learned my addr 172.21.15.125:0/4090973300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.090+0000 7f13de9b3700 1 -- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 msgr2=0x7f13d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13de9b3700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13de9b3700 1 -- 172.21.15.125:0/4090973300 >> v1:172.21.15.125:6789/0 conn(0x7f13d80a1380 legacy=0x7f13d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13de9b3700 1 -- 172.21.15.125:0/4090973300 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d809e6a0 con 0x7f13d8134120 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13dd1b0700 1 -- 172.21.15.125:0/4090973300 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455897495 0 0) 0x7f13d809dc00 con 0x7f13d80a1380 2023-10-03T10:14:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13de1b2700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13de9b3700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d8134120 0x7f13d813bce0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009d90 tx=0x7f13d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171013d264cacba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13dd1b0700 1 -- 172.21.15.125:0/4090973300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000e070 con 0x7f13d8134120 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13dd1b0700 1 -- 172.21.15.125:0/4090973300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000bb20 con 0x7f13d8134120 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13dd1b0700 1 -- 172.21.15.125:0/4090973300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0012430 con 0x7f13d8134120 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 -- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d8134120 msgr2=0x7f13d813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d8134120 0x7f13d813bce0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009d90 tx=0x7f13d000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 -- 172.21.15.125:0/4090973300 shutdown_connections 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d8134120 0x7f13d813bce0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 --2- 172.21.15.125:0/4090973300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a0a70 0x7f13d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.091+0000 7f13e0416700 1 -- 172.21.15.125:0/4090973300 >> 172.21.15.125:0/4090973300 conn(0x7f13d80a6610 msgr2=0x7f13d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.092+0000 7f13e0416700 1 -- 172.21.15.125:0/4090973300 shutdown_connections 2023-10-03T10:14:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.092+0000 7f13e0416700 1 -- 172.21.15.125:0/4090973300 wait complete. 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.092+0000 7f13e0416700 1 Processor -- start 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.092+0000 7f13e0416700 1 -- start start 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13d8134120 0x7f13d8123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81259a0 con 0x7f13d80a0a70 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8124390 con 0x7f13d8134120 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13e0416700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8133350 con 0x7f13d80a1380 2023-10-03T10:14:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13de1b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38002/0 (socket says 172.21.15.125:38002) 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13de1b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53284/0 (socket says 172.21.15.125:53284) 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 -- 172.21.15.125:0/227219833 learned_addr learned my addr 172.21.15.125:0/227219833 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 -- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13d8134120 msgr2=0x7f13d8123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13d8134120 0x7f13d8123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 -- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 msgr2=0x7f13d8122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 -- 172.21.15.125:0/227219833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009550 con 0x7f13d80a1380 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13de1b2700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.093+0000 7f13dd9b1700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c520 tx=0x7f13c800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8004c80 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8004de0 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d0009a70 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8007310 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d80a03e0 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.094+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13c8007470 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.095+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d804f2a0 con 0x7f13d80a1380 2023-10-03T10:14:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.095+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13c803f320 con 0x7f13d80a1380 2023-10-03T10:14:51.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.103+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13c80123b0 con 0x7f13d80a1380 2023-10-03T10:14:51.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.257+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8224072980 con 0x7f82240a1380 2023-10-03T10:14:51.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.258+0000 7f8220ff9700 1 -- 172.21.15.125:0/781263587 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8218015030 con 0x7f82240a1380 2023-10-03T10:14:51.258 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:51.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 msgr2=0x7f8224122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 0x7f8224122e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82240a0370 tx=0x7f8218004750 comp rx=0 tx=0).stop 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 shutdown_connections 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8224133f50 0x7f8224123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82240a0a70 0x7f8224122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 --2- 172.21.15.125:0/781263587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82240a1380 0x7f8224122e40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 >> 172.21.15.125:0/781263587 conn(0x7f82240a6610 msgr2=0x7f82240a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 shutdown_connections 2023-10-03T10:14:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.260+0000 7f822a733700 1 -- 172.21.15.125:0/781263587 wait complete. 2023-10-03T10:14:51.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.297+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13d8072980 con 0x7f13d80a1380 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.297+0000 7f13ceffd700 1 -- 172.21.15.125:0/227219833 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13c8011360 con 0x7f13d80a1380 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 msgr2=0x7f13d8122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c520 tx=0x7f13c800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 shutdown_connections 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13d8134120 0x7f13d8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80a0a70 0x7f13d8122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 --2- 172.21.15.125:0/227219833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13d80a1380 0x7f13d8122cc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 >> 172.21.15.125:0/227219833 conn(0x7f13d80a6610 msgr2=0x7f13d809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 shutdown_connections 2023-10-03T10:14:51.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.299+0000 7f13e0416700 1 -- 172.21.15.125:0/227219833 wait complete. 2023-10-03T10:14:51.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:51.396 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:51.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:51.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 Processor -- start 2023-10-03T10:14:51.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 -- start start 2023-10-03T10:14:51.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce009c970 con 0x7f0ce009e870 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00a0920 con 0x7f0ce009f350 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.523+0000 7f0ce7a1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce009f9c0 con 0x7f0ce01371c0 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce4fb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce57ba700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ce009e870 0x7f0ce009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40960/0 (socket says 172.21.15.125:40960) 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce57ba700 1 -- 172.21.15.125:0/2565586731 learned_addr learned my addr 172.21.15.125:0/2565586731 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 -- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 msgr2=0x7f0ce0136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0cd7fff700 1 -- 172.21.15.125:0/2565586731 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129757 0 0) 0x7f0ce009c970 con 0x7f0ce009e870 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 -- 172.21.15.125:0/2565586731 >> v1:172.21.15.125:6789/0 conn(0x7f0ce009e870 legacy=0x7f0ce009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 -- 172.21.15.125:0/2565586731 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce009bab0 con 0x7f0ce01371c0 2023-10-03T10:14:51.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce4fb9700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0ce5fbb700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009dc0 tx=0x7f0cd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a898ca9aebe146d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0cd7fff700 1 -- 172.21.15.125:0/2565586731 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800e070 con 0x7f0ce01371c0 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0cd7fff700 1 -- 172.21.15.125:0/2565586731 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800bb20 con 0x7f0ce01371c0 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.524+0000 7f0cd7fff700 1 -- 172.21.15.125:0/2565586731 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8012430 con 0x7f0ce01371c0 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 msgr2=0x7f0ce01395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009dc0 tx=0x7f0cd800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/2565586731 shutdown_connections 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/2565586731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/2565586731 >> 172.21.15.125:0/2565586731 conn(0x7f0ce00a4430 msgr2=0x7f0ce00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/2565586731 shutdown_connections 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.525+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/2565586731 wait complete. 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.526+0000 7f0ce7a1e700 1 Processor -- start 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.526+0000 7f0ce7a1e700 1 -- start start 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 0x7f0ce01207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0124250 con 0x7f0ce009e870 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0123cb0 con 0x7f0ce009f350 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce7a1e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01222d0 con 0x7f0ce01371c0 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce5fbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce5fbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38020/0 (socket says 172.21.15.125:38020) 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce5fbb700 1 -- 172.21.15.125:0/1197107910 learned_addr learned my addr 172.21.15.125:0/1197107910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce57ba700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 0x7f0ce01207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 -- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 msgr2=0x7f0ce0121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 -- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 msgr2=0x7f0ce01207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 0x7f0ce01207b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce4fb9700 1 -- 172.21.15.125:0/1197107910 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094a0 con 0x7f0ce009f350 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce5fbb700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.527+0000 7f0ce57ba700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 0x7f0ce01207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0ce4fb9700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0120cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000e9b0 tx=0x7f0cd000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000ee50 con 0x7f0ce009f350 2023-10-03T10:14:51.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd000c850 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd8009a70 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000cc00 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.528+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce009dba0 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.529+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd0013470 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.529+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cd003fa70 con 0x7f0ce009f350 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.529+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0124aa0 con 0x7f0ce009f350 2023-10-03T10:14:51.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.534+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd0013720 con 0x7f0ce009f350 2023-10-03T10:14:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 Processor -- start 2023-10-03T10:14:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 -- start start 2023-10-03T10:14:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 0x7f14c4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c409e9d0 con 0x7f14c40a0a70 2023-10-03T10:14:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409dc00 con 0x7f14c40a1550 2023-10-03T10:14:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14cb1e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409dec0 con 0x7f14c4139200 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.566+0000 7f14c9781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38022/0 (socket says 172.21.15.125:38022) 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 -- 172.21.15.125:0/4262867714 learned_addr learned my addr 172.21.15.125:0/4262867714 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c8f80700 1 --1- 172.21.15.125:0/4262867714 >> v1:172.21.15.125:6789/0 conn(0x7f14c40a0a70 0x7f14c40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40968/0 (socket says 172.21.15.125:40968) 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c3fff700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 0x7f14c4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 -- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 msgr2=0x7f14c4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 0x7f14c4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 -- 172.21.15.125:0/4262867714 >> v1:172.21.15.125:6789/0 conn(0x7f14c40a0a70 legacy=0x7f14c40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c37fe700 1 -- 172.21.15.125:0/4262867714 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349896385 0 0) 0x7f14c409e9d0 con 0x7f14c40a0a70 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 -- 172.21.15.125:0/4262867714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c409e6a0 con 0x7f14c4139200 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c3fff700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 0x7f14c4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c9781700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009e80 tx=0x7f14bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad5d656be7e8543d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c37fe700 1 -- 172.21.15.125:0/4262867714 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00e070 con 0x7f14c4139200 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c37fe700 1 -- 172.21.15.125:0/4262867714 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00b910 con 0x7f14c4139200 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.567+0000 7f14c37fe700 1 -- 172.21.15.125:0/4262867714 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00bcc0 con 0x7f14c4139200 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 -- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 msgr2=0x7f14c413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009e80 tx=0x7f14bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 -- 172.21.15.125:0/4262867714 shutdown_connections 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c4139200 0x7f14c413b5e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/4262867714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c40a1550 0x7f14c4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 -- 172.21.15.125:0/4262867714 >> 172.21.15.125:0/4262867714 conn(0x7f14c40a6610 msgr2=0x7f14c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 -- 172.21.15.125:0/4262867714 shutdown_connections 2023-10-03T10:14:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.568+0000 7f14cb1e4700 1 -- 172.21.15.125:0/4262867714 wait complete. 2023-10-03T10:14:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 Processor -- start 2023-10-03T10:14:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 -- start start 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 0x7f14c411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 0x7f14c411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4122080 con 0x7f14c40a0a70 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4120560 con 0x7f14c4139200 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14cb1e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14c409d340 con 0x7f14c40a1550 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c8f80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 0x7f14c411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c8f80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 0x7f14c411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53300/0 (socket says 172.21.15.125:53300) 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38038/0 (socket says 172.21.15.125:38038) 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c8f80700 1 -- 172.21.15.125:0/3102063526 learned_addr learned my addr 172.21.15.125:0/3102063526 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.569+0000 7f14c9781700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 0x7f14c411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 -- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 msgr2=0x7f14c411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 0x7f14c411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 -- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 msgr2=0x7f14c411e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 0x7f14c411e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 -- 172.21.15.125:0/3102063526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00094a0 con 0x7f14c40a1550 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c9781700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 0x7f14c411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c3fff700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f14b000e9b0 tx=0x7f14b000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000ee50 con 0x7f14c40a1550 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000c850 con 0x7f14c40a1550 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000cc00 con 0x7f14c40a1550 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc009b30 con 0x7f14c40a1550 2023-10-03T10:14:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.570+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c4134730 con 0x7f14c40a1550 2023-10-03T10:14:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.571+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14b0013470 con 0x7f14c40a1550 2023-10-03T10:14:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.571+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c404f2a0 con 0x7f14c40a1550 2023-10-03T10:14:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.571+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14b003fa70 con 0x7f14c40a1550 2023-10-03T10:14:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.576+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14b0041e60 con 0x7f14c40a1550 2023-10-03T10:14:51.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.726+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ce004f2a0 con 0x7f0ce009f350 2023-10-03T10:14:51.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.727+0000 7f0cd5ffb700 1 -- 172.21.15.125:0/1197107910 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cd0017020 con 0x7f0ce009f350 2023-10-03T10:14:51.727 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 msgr2=0x7f0ce0120cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0120cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000e9b0 tx=0x7f0cd000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 shutdown_connections 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ce01371c0 0x7f0ce0121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce009e870 0x7f0ce01207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 --2- 172.21.15.125:0/1197107910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce009f350 0x7f0ce0120cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 >> 172.21.15.125:0/1197107910 conn(0x7f0ce00a4430 msgr2=0x7f0ce00704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 shutdown_connections 2023-10-03T10:14:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.729+0000 7f0ce7a1e700 1 -- 172.21.15.125:0/1197107910 wait complete. 2023-10-03T10:14:51.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:51.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.769+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14c409cba0 con 0x7f14c40a1550 2023-10-03T10:14:51.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.769+0000 7f14c17fa700 1 -- 172.21.15.125:0/3102063526 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14b0021020 con 0x7f14c40a1550 2023-10-03T10:14:51.769 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 msgr2=0x7f14c411ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f14b000e9b0 tx=0x7f14b000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 shutdown_connections 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14c4139200 0x7f14c411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14c40a0a70 0x7f14c411e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 --2- 172.21.15.125:0/3102063526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14c40a1550 0x7f14c411ece0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 >> 172.21.15.125:0/3102063526 conn(0x7f14c40a6610 msgr2=0x7f14c40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 shutdown_connections 2023-10-03T10:14:51.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:51.771+0000 7f14cb1e4700 1 -- 172.21.15.125:0/3102063526 wait complete. 2023-10-03T10:14:51.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:52.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:52.312 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.401+0000 7facc0d0b700 1 Processor -- start 2023-10-03T10:14:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.401+0000 7facc0d0b700 1 -- start start 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facc0d0b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facc0d0b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facc0d0b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc09b110 con 0x7facbc0a0a70 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facc0d0b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0a3b60 con 0x7facbc09ad40 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facc0d0b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc1348e0 con 0x7facbc133f70 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34756/0 (socket says 172.21.15.125:34756) 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facba59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53314/0 (socket says 172.21.15.125:53314) 2023-10-03T10:14:52.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 -- 172.21.15.125:0/2656595426 learned_addr learned my addr 172.21.15.125:0/2656595426 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb959a700 1 -- 172.21.15.125:0/2656595426 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418205659 0 0) 0x7facbc09b110 con 0x7facbc0a0a70 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 -- 172.21.15.125:0/2656595426 >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 msgr2=0x7facbc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 --2- 172.21.15.125:0/2656595426 >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 -- 172.21.15.125:0/2656595426 >> v1:172.21.15.125:6789/0 conn(0x7facbc0a0a70 legacy=0x7facbc0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 -- 172.21.15.125:0/2656595426 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0a2fa0 con 0x7facbc133f70 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facba59c700 1 --2- 172.21.15.125:0/2656595426 >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb9d9b700 1 --2- 172.21.15.125:0/2656595426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7facb00098f0 tx=0x7facb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a5741f783fb772f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb959a700 1 -- 172.21.15.125:0/2656595426 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0011830 con 0x7facbc133f70 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb959a700 1 -- 172.21.15.125:0/2656595426 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0011990 con 0x7facbc133f70 2023-10-03T10:14:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.402+0000 7facb959a700 1 -- 172.21.15.125:0/2656595426 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0011d20 con 0x7facbc133f70 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 -- 172.21.15.125:0/2656595426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 msgr2=0x7facbc1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2656595426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7facb00098f0 tx=0x7facb0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 -- 172.21.15.125:0/2656595426 shutdown_connections 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2656595426 >> v2:172.21.15.125:3300/0 conn(0x7facbc09ad40 0x7facbc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2656595426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc133f70 0x7facbc1343a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 -- 172.21.15.125:0/2656595426 >> 172.21.15.125:0/2656595426 conn(0x7facbc099c40 msgr2=0x7facbc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 -- 172.21.15.125:0/2656595426 shutdown_connections 2023-10-03T10:14:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.403+0000 7facc0d0b700 1 -- 172.21.15.125:0/2656595426 wait complete. 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.404+0000 7facc0d0b700 1 Processor -- start 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.404+0000 7facc0d0b700 1 -- start start 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facbc09ad40 0x7facbc1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 0x7facbc121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc122eb0 con 0x7facbc09ad40 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc123d40 con 0x7facbc0a0a70 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facc0d0b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facbc124820 con 0x7facbc133f70 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facb9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facbad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 0x7facbc121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facb9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34764/0 (socket says 172.21.15.125:34764) 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facb9d9b700 1 -- 172.21.15.125:0/2777492874 learned_addr learned my addr 172.21.15.125:0/2777492874 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.405+0000 7facba59c700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facbc09ad40 0x7facbc1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 -- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 msgr2=0x7facbc121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 0x7facbc121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 -- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facbc09ad40 msgr2=0x7facbc1212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facbc09ad40 0x7facbc1212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 -- 172.21.15.125:0/2777492874 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0094a0 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facbad9d700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 0x7facbc121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facb9d9b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7facb0009f50 tx=0x7facb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0004510 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00036a0 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0009550 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0003a30 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.406+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc09c7e0 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.407+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facb0003b90 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.407+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7facb0040dd0 con 0x7facbc0a0a70 2023-10-03T10:14:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.407+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc11e060 con 0x7facbc0a0a70 2023-10-03T10:14:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.412+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facb0015020 con 0x7facbc0a0a70 2023-10-03T10:14:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 Processor -- start 2023-10-03T10:14:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 -- start start 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35409dc00 con 0x7fc354133f50 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35409ea60 con 0x7fc3540a1380 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35c359700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc35409dec0 con 0x7fc3540a0a70 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35a0f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc3598f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35a0f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38058/0 (socket says 172.21.15.125:38058) 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc3598f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34778/0 (socket says 172.21.15.125:34778) 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35a0f5700 1 -- 172.21.15.125:0/1247535086 learned_addr learned my addr 172.21.15.125:0/1247535086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.442+0000 7fc35a8f6700 1 --1- 172.21.15.125:0/1247535086 >> v1:172.21.15.125:6789/0 conn(0x7fc354133f50 0x7fc35413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40980/0 (socket says 172.21.15.125:40980) 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3598f4700 1 -- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 msgr2=0x7fc3540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3590f3700 1 -- 172.21.15.125:0/1247535086 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307604907 0 0) 0x7fc35409dc00 con 0x7fc354133f50 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3598f4700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3598f4700 1 -- 172.21.15.125:0/1247535086 >> v1:172.21.15.125:6789/0 conn(0x7fc354133f50 legacy=0x7fc35413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3598f4700 1 -- 172.21.15.125:0/1247535086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35409e6a0 con 0x7fc3540a1380 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc35a0f5700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3598f4700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc344009870 tx=0x7fc344009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5641bd5212e30ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3590f3700 1 -- 172.21.15.125:0/1247535086 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344011830 con 0x7fc3540a1380 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3590f3700 1 -- 172.21.15.125:0/1247535086 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344011990 con 0x7fc3540a1380 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.443+0000 7fc3590f3700 1 -- 172.21.15.125:0/1247535086 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344011d20 con 0x7fc3540a1380 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 -- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 msgr2=0x7fc354133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc344009870 tx=0x7fc344009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 -- 172.21.15.125:0/1247535086 shutdown_connections 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3540a0a70 0x7fc3540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 --2- 172.21.15.125:0/1247535086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a1380 0x7fc354133a10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 -- 172.21.15.125:0/1247535086 >> 172.21.15.125:0/1247535086 conn(0x7fc3540a6610 msgr2=0x7fc3540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 -- 172.21.15.125:0/1247535086 shutdown_connections 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.444+0000 7fc35c359700 1 -- 172.21.15.125:0/1247535086 wait complete. 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 Processor -- start 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 -- start start 2023-10-03T10:14:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 0x7fc3541c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 0x7fc3541c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354124fa0 con 0x7fc3540a1380 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc354126370 con 0x7fc3540a0a70 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35c359700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541246b0 con 0x7fc354133f50 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34790/0 (socket says 172.21.15.125:34790) 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 -- 172.21.15.125:0/1683131763 learned_addr learned my addr 172.21.15.125:0/1683131763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a8f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 0x7fc3541c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc3598f4700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 0x7fc3541c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 -- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 msgr2=0x7fc3541c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 0x7fc3541c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 -- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 msgr2=0x7fc3541c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 0x7fc3541c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a0f5700 1 -- 172.21.15.125:0/1683131763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009550 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc3598f4700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 0x7fc3541c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.445+0000 7fc35a8f6700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 0x7fc3541c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc35a0f5700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc35000ebe0 tx=0x7fc35000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000c850 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35000c9b0 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3440094a0 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000cd20 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3540a03e0 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.446+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc350013470 con 0x7fc3540a0a70 2023-10-03T10:14:52.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.447+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc35003fbe0 con 0x7fc3540a0a70 2023-10-03T10:14:52.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.447+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3541253e0 con 0x7fc3540a0a70 2023-10-03T10:14:52.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.451+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc35001b3b0 con 0x7fc3540a0a70 2023-10-03T10:14:52.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.607+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7facbc124960 con 0x7facbc0a0a70 2023-10-03T10:14:52.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.607+0000 7facaaffd700 1 -- 172.21.15.125:0/2777492874 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facb0035090 con 0x7facbc0a0a70 2023-10-03T10:14:52.607 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 msgr2=0x7facbc121830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7facb0009f50 tx=0x7facb0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 shutdown_connections 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facbc133f70 0x7facbc121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facbc09ad40 0x7facbc1212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 --2- 172.21.15.125:0/2777492874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facbc0a0a70 0x7facbc121830 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 >> 172.21.15.125:0/2777492874 conn(0x7facbc099c40 msgr2=0x7facbc1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 shutdown_connections 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.609+0000 7facc0d0b700 1 -- 172.21.15.125:0/2777492874 wait complete. 2023-10-03T10:14:52.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.645+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc35404f2a0 con 0x7fc3540a0a70 2023-10-03T10:14:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.646+0000 7fc34affd700 1 -- 172.21.15.125:0/1683131763 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc350017030 con 0x7fc3540a0a70 2023-10-03T10:14:52.646 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:52.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 msgr2=0x7fc3541c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc35000ebe0 tx=0x7fc35000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 shutdown_connections 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc354133f50 0x7fc3541c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3540a0a70 0x7fc3541c82d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 --2- 172.21.15.125:0/1683131763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3540a1380 0x7fc3541c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 >> 172.21.15.125:0/1683131763 conn(0x7fc3540a6610 msgr2=0x7fc3540a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 shutdown_connections 2023-10-03T10:14:52.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.648+0000 7fc35c359700 1 -- 172.21.15.125:0/1683131763 wait complete. 2023-10-03T10:14:52.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:52.743 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:52.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:52.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 Processor -- start 2023-10-03T10:14:52.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 -- start start 2023-10-03T10:14:52.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f0950133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095009dc00 con 0x7f0950133f50 2023-10-03T10:14:52.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095009ea60 con 0x7f09500a0a70 2023-10-03T10:14:52.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f0956052700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095009dec0 con 0x7f09500a1380 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f094f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f094f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53350/0 (socket says 172.21.15.125:53350) 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f094ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0950133f50 0x7f095013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40984/0 (socket says 172.21.15.125:40984) 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f094f7fe700 1 -- 172.21.15.125:0/150037119 learned_addr learned my addr 172.21.15.125:0/150037119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.868+0000 7f094effd700 1 --2- 172.21.15.125:0/150037119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f0950133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094effd700 1 -- 172.21.15.125:0/150037119 >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 msgr2=0x7f09500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094effd700 1 --2- 172.21.15.125:0/150037119 >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094effd700 1 -- 172.21.15.125:0/150037119 >> v1:172.21.15.125:6789/0 conn(0x7f0950133f50 legacy=0x7f095013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094effd700 1 -- 172.21.15.125:0/150037119 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095009e6a0 con 0x7f09500a1380 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094e7fc700 1 -- 172.21.15.125:0/150037119 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138562981 0 0) 0x7f095009dc00 con 0x7f0950133f50 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094f7fe700 1 --2- 172.21.15.125:0/150037119 >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094effd700 1 --2- 172.21.15.125:0/150037119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f0950133a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0944009840 tx=0x7f0944009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30c3ee6a5bd7ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094e7fc700 1 -- 172.21.15.125:0/150037119 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011830 con 0x7f09500a1380 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094e7fc700 1 -- 172.21.15.125:0/150037119 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944011990 con 0x7f09500a1380 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.869+0000 7f094e7fc700 1 -- 172.21.15.125:0/150037119 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011d20 con 0x7f09500a1380 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 -- 172.21.15.125:0/150037119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 msgr2=0x7f0950133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 --2- 172.21.15.125:0/150037119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f0950133a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0944009840 tx=0x7f0944009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 -- 172.21.15.125:0/150037119 shutdown_connections 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 --2- 172.21.15.125:0/150037119 >> v2:172.21.15.125:3300/0 conn(0x7f09500a0a70 0x7f09500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 --2- 172.21.15.125:0/150037119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f0950133a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 -- 172.21.15.125:0/150037119 >> 172.21.15.125:0/150037119 conn(0x7f09500a6610 msgr2=0x7f09500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 -- 172.21.15.125:0/150037119 shutdown_connections 2023-10-03T10:14:52.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.870+0000 7f0956052700 1 -- 172.21.15.125:0/150037119 wait complete. 2023-10-03T10:14:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.871+0000 7f0956052700 1 Processor -- start 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.871+0000 7f0956052700 1 -- start start 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f09501c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0950133f50 0x7f09501c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950122320 con 0x7f09500a0a70 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950120660 con 0x7f09500a1380 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f0956052700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09500a17b0 con 0x7f0950133f50 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0950133f50 0x7f09501c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53356/0 (socket says 172.21.15.125:53356) 2023-10-03T10:14:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 -- 172.21.15.125:0/1809816847 learned_addr learned my addr 172.21.15.125:0/1809816847 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094effd700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f09501c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 -- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0950133f50 msgr2=0x7f09501c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0950133f50 0x7f09501c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 -- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 msgr2=0x7f09501c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f09501c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 -- 172.21.15.125:0/1809816847 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940009550 con 0x7f09500a0a70 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094effd700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f09501c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.872+0000 7f094f7fe700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f094000ebe0 tx=0x7f094000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000c850 con 0x7f09500a0a70 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000c9b0 con 0x7f09500a0a70 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440094a0 con 0x7f09500a0a70 2023-10-03T10:14:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000cd40 con 0x7f09500a0a70 2023-10-03T10:14:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0950120e50 con 0x7f09500a0a70 2023-10-03T10:14:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.873+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0940013470 con 0x7f09500a0a70 2023-10-03T10:14:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.874+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f094003f970 con 0x7f09500a0a70 2023-10-03T10:14:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.874+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095004f2a0 con 0x7f09500a0a70 2023-10-03T10:14:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.878+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0940021080 con 0x7f09500a0a70 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.910+0000 7f4cd2d02700 1 Processor -- start 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.910+0000 7f4cd2d02700 1 -- start start 2023-10-03T10:14:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd2d02700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd2d02700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ccc139200 0x7f4ccc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd2d02700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc09e9d0 con 0x7f4ccc0a0a70 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd2d02700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ccc09dc00 con 0x7f4ccc139200 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd2d02700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc09dec0 con 0x7f4ccc0a1550 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ccc139200 0x7f4ccc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd0a9e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4ccc0a0a70 0x7f4ccc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40990/0 (socket says 172.21.15.125:40990) 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd0a9e700 1 -- 172.21.15.125:0/1925006796 learned_addr learned my addr 172.21.15.125:0/1925006796 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccb7fe700 1 -- 172.21.15.125:0/1925006796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352703892 0 0) 0x7f4ccc09e9d0 con 0x7f4ccc0a0a70 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccb7fe700 1 -- 172.21.15.125:0/1925006796 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc0035b0 con 0x7f4ccc0a0a70 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 -- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 msgr2=0x7f4ccc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 --2- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 -- 172.21.15.125:0/1925006796 >> v1:172.21.15.125:6789/0 conn(0x7f4ccc0a0a70 legacy=0x7f4ccc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 -- 172.21.15.125:0/1925006796 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc09e6a0 con 0x7f4ccc139200 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4cd129f700 1 --2- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc139200 0x7f4ccc13b5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009d90 tx=0x7f4cc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c4abb126b784d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccb7fe700 1 -- 172.21.15.125:0/1925006796 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400e070 con 0x7f4ccc139200 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccb7fe700 1 -- 172.21.15.125:0/1925006796 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc400bb20 con 0x7f4ccc139200 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.911+0000 7f4ccb7fe700 1 -- 172.21.15.125:0/1925006796 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4012430 con 0x7f4ccc139200 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 -- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc139200 msgr2=0x7f4ccc13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc139200 0x7f4ccc13b5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009d90 tx=0x7f4cc400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 -- 172.21.15.125:0/1925006796 shutdown_connections 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc139200 0x7f4ccc13b5e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/1925006796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 -- 172.21.15.125:0/1925006796 >> 172.21.15.125:0/1925006796 conn(0x7f4ccc0a6610 msgr2=0x7f4ccc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 -- 172.21.15.125:0/1925006796 shutdown_connections 2023-10-03T10:14:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.912+0000 7f4cd2d02700 1 -- 172.21.15.125:0/1925006796 wait complete. 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.913+0000 7f4cd2d02700 1 Processor -- start 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.913+0000 7f4cd2d02700 1 -- start start 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.913+0000 7f4cd2d02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 0x7f4ccc1205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.913+0000 7f4cd2d02700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc139200 0x7f4ccc121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc1221e0 con 0x7f4ccc0a0a70 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc123430 con 0x7f4ccc139200 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc123e10 con 0x7f4ccc0a1550 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd0a9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 0x7f4ccc1205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38106/0 (socket says 172.21.15.125:38106) 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 -- 172.21.15.125:0/3738197998 learned_addr learned my addr 172.21.15.125:0/3738197998 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd129f700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc139200 0x7f4ccc121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 -- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc139200 msgr2=0x7f4ccc121050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc139200 0x7f4ccc121050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 -- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 msgr2=0x7f4ccc1205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 0x7f4ccc1205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 -- 172.21.15.125:0/3738197998 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4009a70 con 0x7f4ccc0a1550 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd0a9e700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 0x7f4ccc1205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4ccbfff700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800ee50 con 0x7f4ccc0a1550 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800c850 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cbc0 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc122a10 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.914+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc0a03e0 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.915+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cb800cd20 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.915+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cb803f7d0 con 0x7f4ccc0a1550 2023-10-03T10:14:52.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.915+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc04f2a0 con 0x7f4ccc0a1550 2023-10-03T10:14:52.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:52.920+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cb8021070 con 0x7f4ccc0a1550 2023-10-03T10:14:53.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.072+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09500a5660 con 0x7f09500a0a70 2023-10-03T10:14:53.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.073+0000 7f0937fff700 1 -- 172.21.15.125:0/1809816847 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0940017020 con 0x7f09500a0a70 2023-10-03T10:14:53.073 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:53.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 msgr2=0x7f09501c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f094000ebe0 tx=0x7f094000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 shutdown_connections 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0950133f50 0x7f09501c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09500a0a70 0x7f09501c8460 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 --2- 172.21.15.125:0/1809816847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09500a1380 0x7f09501c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 >> 172.21.15.125:0/1809816847 conn(0x7f09500a6610 msgr2=0x7f09500a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 shutdown_connections 2023-10-03T10:14:53.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.075+0000 7f0956052700 1 -- 172.21.15.125:0/1809816847 wait complete. 2023-10-03T10:14:53.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:53.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.113+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ccc123940 con 0x7f4ccc0a1550 2023-10-03T10:14:53.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.113+0000 7f4cc97fa700 1 -- 172.21.15.125:0/3738197998 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cb801bde0 con 0x7f4ccc0a1550 2023-10-03T10:14:53.114 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:53.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 msgr2=0x7f4ccc120b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 shutdown_connections 2023-10-03T10:14:53.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc139200 0x7f4ccc121050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc0a0a70 0x7f4ccc1205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 --2- 172.21.15.125:0/3738197998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ccc0a1550 0x7f4ccc120b10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 >> 172.21.15.125:0/3738197998 conn(0x7f4ccc0a6610 msgr2=0x7f4ccc0a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 shutdown_connections 2023-10-03T10:14:53.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.116+0000 7f4cd2d02700 1 -- 172.21.15.125:0/3738197998 wait complete. 2023-10-03T10:14:53.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:53.622 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:53.661 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 Processor -- start 2023-10-03T10:14:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 -- start start 2023-10-03T10:14:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 0x7f093c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c09b110 con 0x7f093c0a0a70 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c0a3b60 con 0x7f093c133f70 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f0941462700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1348e0 con 0x7f093c09ad40 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f093a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f093affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 0x7f093c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f093b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f093c0a0a70 0x7f093c0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40994/0 (socket says 172.21.15.125:40994) 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f093a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53376/0 (socket says 172.21.15.125:53376) 2023-10-03T10:14:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.757+0000 7f093b7fe700 1 -- 172.21.15.125:0/1780173730 learned_addr learned my addr 172.21.15.125:0/1780173730 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093affd700 1 -- 172.21.15.125:0/1780173730 >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 msgr2=0x7f093c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0939ffb700 1 -- 172.21.15.125:0/1780173730 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418770539 0 0) 0x7f093c09b110 con 0x7f093c0a0a70 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093affd700 1 --2- 172.21.15.125:0/1780173730 >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093affd700 1 -- 172.21.15.125:0/1780173730 >> v1:172.21.15.125:6789/0 conn(0x7f093c0a0a70 legacy=0x7f093c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093affd700 1 -- 172.21.15.125:0/1780173730 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0a2fa0 con 0x7f093c09ad40 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093a7fc700 1 --2- 172.21.15.125:0/1780173730 >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f093affd700 1 --2- 172.21.15.125:0/1780173730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 0x7f093c133a30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f092c009870 tx=0x7f092c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c27d9f7780ed9708 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0939ffb700 1 -- 172.21.15.125:0/1780173730 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c011830 con 0x7f093c09ad40 2023-10-03T10:14:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0939ffb700 1 -- 172.21.15.125:0/1780173730 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c011990 con 0x7f093c09ad40 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0939ffb700 1 -- 172.21.15.125:0/1780173730 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c011d20 con 0x7f093c09ad40 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 -- 172.21.15.125:0/1780173730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 msgr2=0x7f093c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 --2- 172.21.15.125:0/1780173730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 0x7f093c133a30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f092c009870 tx=0x7f092c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 -- 172.21.15.125:0/1780173730 shutdown_connections 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 --2- 172.21.15.125:0/1780173730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c09ad40 0x7f093c133a30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 --2- 172.21.15.125:0/1780173730 >> v2:172.21.15.125:3300/0 conn(0x7f093c133f70 0x7f093c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.758+0000 7f0941462700 1 -- 172.21.15.125:0/1780173730 >> 172.21.15.125:0/1780173730 conn(0x7f093c099c40 msgr2=0x7f093c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.759+0000 7f0941462700 1 -- 172.21.15.125:0/1780173730 shutdown_connections 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.759+0000 7f0941462700 1 -- 172.21.15.125:0/1780173730 wait complete. 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 Processor -- start 2023-10-03T10:14:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 -- start start 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 0x7f093c11fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 0x7f093c1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c122600 con 0x7f093c09ad40 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1336c0 con 0x7f093c0a0a70 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f0941462700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f093c120180 con 0x7f093c133f70 2023-10-03T10:14:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 0x7f093c1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53386/0 (socket says 172.21.15.125:53386) 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 -- 172.21.15.125:0/2975074922 learned_addr learned my addr 172.21.15.125:0/2975074922 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093a7fc700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 0x7f093c11fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 -- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 msgr2=0x7f093c1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 0x7f093c1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 -- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 msgr2=0x7f093c11fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 0x7f093c11fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.760+0000 7f093affd700 1 -- 172.21.15.125:0/2975074922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300094a0 con 0x7f093c09ad40 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f093b7fe700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 0x7f093c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f093a7fc700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 0x7f093c11fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f093affd700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f092c0090b0 tx=0x7f092c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c0036a0 con 0x7f093c09ad40 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c01e070 con 0x7f093c09ad40 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c0094a0 con 0x7f093c09ad40 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c003a20 con 0x7f093c09ad40 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.761+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c120940 con 0x7f093c09ad40 2023-10-03T10:14:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.762+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f092c003b80 con 0x7f093c09ad40 2023-10-03T10:14:53.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.762+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f092c0405f0 con 0x7f093c09ad40 2023-10-03T10:14:53.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.762+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c0a4170 con 0x7f093c09ad40 2023-10-03T10:14:53.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.770+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f092c015080 con 0x7f093c09ad40 2023-10-03T10:14:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.800+0000 7f9dc3c28700 1 Processor -- start 2023-10-03T10:14:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.800+0000 7f9dc3c28700 1 -- start start 2023-10-03T10:14:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc3c28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dbc0a1550 0x7f9dbc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc3c28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc3c28700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc09e9d0 con 0x7f9dbc0a0a70 2023-10-03T10:14:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc3c28700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc09dc00 con 0x7f9dbc0a1550 2023-10-03T10:14:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc3c28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc09dec0 con 0x7f9dbc139200 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dbc0a1550 0x7f9dbc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc21c5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc19c4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9dbc0a0a70 0x7f9dbc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41002/0 (socket says 172.21.15.125:41002) 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc19c4700 1 -- 172.21.15.125:0/1785291238 learned_addr learned my addr 172.21.15.125:0/1785291238 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9dbc0a1550 0x7f9dbc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53388/0 (socket says 172.21.15.125:53388) 2023-10-03T10:14:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc21c5700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38138/0 (socket says 172.21.15.125:38138) 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 -- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 msgr2=0x7f9dbc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 -- 172.21.15.125:0/1785291238 >> v1:172.21.15.125:6789/0 conn(0x7f9dbc0a0a70 legacy=0x7f9dbc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 -- 172.21.15.125:0/1785291238 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc09e6a0 con 0x7f9dbc0a1550 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc09c2700 1 -- 172.21.15.125:0/1785291238 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433483382 0 0) 0x7f9dbc09e9d0 con 0x7f9dbc0a0a70 2023-10-03T10:14:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc21c5700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.801+0000 7f9dc11c3700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc0a1550 0x7f9dbc138cc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009840 tx=0x7f9dac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c5e455510d2d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc09c2700 1 -- 172.21.15.125:0/1785291238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac011830 con 0x7f9dbc0a1550 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc09c2700 1 -- 172.21.15.125:0/1785291238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac011990 con 0x7f9dbc0a1550 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc09c2700 1 -- 172.21.15.125:0/1785291238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac011d20 con 0x7f9dbc0a1550 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 -- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc0a1550 msgr2=0x7f9dbc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc0a1550 0x7f9dbc138cc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009840 tx=0x7f9dac009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 -- 172.21.15.125:0/1785291238 shutdown_connections 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc139200 0x7f9dbc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/1785291238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc0a1550 0x7f9dbc138cc0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 -- 172.21.15.125:0/1785291238 >> 172.21.15.125:0/1785291238 conn(0x7f9dbc0a6610 msgr2=0x7f9dbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 -- 172.21.15.125:0/1785291238 shutdown_connections 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.802+0000 7f9dc3c28700 1 -- 172.21.15.125:0/1785291238 wait complete. 2023-10-03T10:14:53.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.803+0000 7f9dc3c28700 1 Processor -- start 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.803+0000 7f9dc3c28700 1 -- start start 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dbc0a1550 0x7f9dbc120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 0x7f9dbc121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc124420 con 0x7f9dbc139200 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0a5100 con 0x7f9dbc0a1550 2023-10-03T10:14:53.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc123ac0 con 0x7f9dbc0a0a70 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc19c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 0x7f9dbc121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc19c4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38148/0 (socket says 172.21.15.125:38148) 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc19c4700 1 -- 172.21.15.125:0/249195813 learned_addr learned my addr 172.21.15.125:0/249195813 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 -- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 msgr2=0x7f9dbc1207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 -- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dbc0a1550 msgr2=0x7f9dbc120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dbc0a1550 0x7f9dbc120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 -- 172.21.15.125:0/249195813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009a70 con 0x7f9dbc139200 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc19c4700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc21c5700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 0x7f9dbc121270 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9db400ef90 tx=0x7f9db400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400cb40 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400f040 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0094a0 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4003a20 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.804+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc124030 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.805+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9db4014480 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.805+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc04f2a0 con 0x7f9dbc139200 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.805+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9db4040020 con 0x7f9dbc139200 2023-10-03T10:14:53.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.812+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9db4012930 con 0x7f9dbc139200 2023-10-03T10:14:53.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.966+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f093c1221b0 con 0x7f093c09ad40 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.967+0000 7f09237fe700 1 -- 172.21.15.125:0/2975074922 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f092c010790 con 0x7f093c09ad40 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 msgr2=0x7f093c11f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f092c0090b0 tx=0x7f092c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 shutdown_connections 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f093c133f70 0x7f093c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c09ad40 0x7f093c11f700 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 --2- 172.21.15.125:0/2975074922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f093c0a0a70 0x7f093c11fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 >> 172.21.15.125:0/2975074922 conn(0x7f093c099c40 msgr2=0x7f093c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 shutdown_connections 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:53.969+0000 7f0941462700 1 -- 172.21.15.125:0/2975074922 wait complete. 2023-10-03T10:14:53.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:54.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.004+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9dbc0a03e0 con 0x7f9dbc139200 2023-10-03T10:14:54.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.004+0000 7f9db27fc700 1 -- 172.21.15.125:0/249195813 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9db4009cc0 con 0x7f9dbc139200 2023-10-03T10:14:54.005 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 msgr2=0x7f9dbc121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 0x7f9dbc121270 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9db400ef90 tx=0x7f9db400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 shutdown_connections 2023-10-03T10:14:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dbc139200 0x7f9dbc121270 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dbc0a0a70 0x7f9dbc1207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 --2- 172.21.15.125:0/249195813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dbc0a1550 0x7f9dbc120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 >> 172.21.15.125:0/249195813 conn(0x7f9dbc0a6610 msgr2=0x7f9dbc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 shutdown_connections 2023-10-03T10:14:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.006+0000 7f9dc3c28700 1 -- 172.21.15.125:0/249195813 wait complete. 2023-10-03T10:14:54.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:54.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:54.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.217+0000 7f293fe33700 1 Processor -- start 2023-10-03T10:14:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.217+0000 7f293fe33700 1 -- start start 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293fe33700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293fe33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293fe33700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293809dc00 con 0x7f2938133f50 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293fe33700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293809ea60 con 0x7f29380a0a70 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293fe33700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f293809dec0 con 0x7f29380a1380 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293dbcf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293dbcf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34844/0 (socket says 172.21.15.125:34844) 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293dbcf700 1 -- 172.21.15.125:0/4251102142 learned_addr learned my addr 172.21.15.125:0/4251102142 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 -- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 msgr2=0x7f29380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 -- 172.21.15.125:0/4251102142 >> v1:172.21.15.125:6789/0 conn(0x7f2938133f50 legacy=0x7f293813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293cbcd700 1 -- 172.21.15.125:0/4251102142 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858935835 0 0) 0x7f293809dc00 con 0x7f2938133f50 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 -- 172.21.15.125:0/4251102142 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293809e6a0 con 0x7f29380a1380 2023-10-03T10:14:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293dbcf700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293d3ce700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938133a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2928009870 tx=0x7f2928009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a83298350285d80a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293cbcd700 1 -- 172.21.15.125:0/4251102142 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928011830 con 0x7f29380a1380 2023-10-03T10:14:54.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293cbcd700 1 -- 172.21.15.125:0/4251102142 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928011990 con 0x7f29380a1380 2023-10-03T10:14:54.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.218+0000 7f293cbcd700 1 -- 172.21.15.125:0/4251102142 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928011d20 con 0x7f29380a1380 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 -- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 msgr2=0x7f2938133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938133a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2928009870 tx=0x7f2928009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 -- 172.21.15.125:0/4251102142 shutdown_connections 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29380a0a70 0x7f29380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 --2- 172.21.15.125:0/4251102142 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938133a10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 -- 172.21.15.125:0/4251102142 >> 172.21.15.125:0/4251102142 conn(0x7f29380a6610 msgr2=0x7f29380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 -- 172.21.15.125:0/4251102142 shutdown_connections 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.219+0000 7f293fe33700 1 -- 172.21.15.125:0/4251102142 wait complete. 2023-10-03T10:14:54.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.220+0000 7f293fe33700 1 Processor -- start 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.220+0000 7f293fe33700 1 -- start start 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 0x7f2938122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2938133f50 0x7f2938123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2938126110 con 0x7f29380a0a70 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2938123cf0 con 0x7f2938133f50 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293fe33700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2938126360 con 0x7f29380a1380 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293dbcf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 0x7f2938122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38178/0 (socket says 172.21.15.125:38178) 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 -- 172.21.15.125:0/908578714 learned_addr learned my addr 172.21.15.125:0/908578714 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293dbcf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 0x7f2938122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53412/0 (socket says 172.21.15.125:53412) 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293e3d0700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2938133f50 0x7f2938123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 -- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2938133f50 msgr2=0x7f2938123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2938133f50 0x7f2938123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 -- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 msgr2=0x7f2938122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 0x7f2938122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 -- 172.21.15.125:0/908578714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009550 con 0x7f29380a1380 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.221+0000 7f293d3ce700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2928013000 tx=0x7f2928004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.222+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928004510 con 0x7f29380a1380 2023-10-03T10:14:54.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.222+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292801f070 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.222+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29280094a0 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.222+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280038c0 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.222+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29380a03e0 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.223+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293804f2a0 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.223+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2928003a20 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.223+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2928021070 con 0x7f29380a1380 2023-10-03T10:14:54.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.227+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2928010ba0 con 0x7f29380a1380 2023-10-03T10:14:54.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.262+0000 7f39e6245700 1 Processor -- start 2023-10-03T10:14:54.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.262+0000 7f39e6245700 1 -- start start 2023-10-03T10:14:54.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39e6245700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39e6245700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 0x7f39e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39e6245700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e009c970 con 0x7f39e009f180 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39e6245700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00a0920 con 0x7f39e0131f40 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39e6245700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39e009f9c0 con 0x7f39e009e870 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39df7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39df7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38180/0 (socket says 172.21.15.125:38180) 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39df7fe700 1 -- 172.21.15.125:0/2458471874 learned_addr learned my addr 172.21.15.125:0/2458471874 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39dffff700 1 --2- 172.21.15.125:0/2458471874 >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 0x7f39e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39de7fc700 1 -- 172.21.15.125:0/2458471874 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670888853 0 0) 0x7f39e009c970 con 0x7f39e009f180 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.263+0000 7f39de7fc700 1 -- 172.21.15.125:0/2458471874 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc0035b0 con 0x7f39e009f180 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39df7fe700 1 -- 172.21.15.125:0/2458471874 >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 msgr2=0x7f39e0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39df7fe700 1 --2- 172.21.15.125:0/2458471874 >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 0x7f39e0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39df7fe700 1 -- 172.21.15.125:0/2458471874 >> v1:172.21.15.125:6789/0 conn(0x7f39e009f180 legacy=0x7f39e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39df7fe700 1 -- 172.21.15.125:0/2458471874 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e009bab0 con 0x7f39e009e870 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39dffff700 1 --2- 172.21.15.125:0/2458471874 >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 0x7f39e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39df7fe700 1 --2- 172.21.15.125:0/2458471874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009e50 tx=0x7f39d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22569cdc3f501c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39de7fc700 1 -- 172.21.15.125:0/2458471874 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000e070 con 0x7f39e009e870 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39de7fc700 1 -- 172.21.15.125:0/2458471874 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0003a20 con 0x7f39e009e870 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39de7fc700 1 -- 172.21.15.125:0/2458471874 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0003d90 con 0x7f39e009e870 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 -- 172.21.15.125:0/2458471874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 msgr2=0x7f39e009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 --2- 172.21.15.125:0/2458471874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009e50 tx=0x7f39d000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 -- 172.21.15.125:0/2458471874 shutdown_connections 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 --2- 172.21.15.125:0/2458471874 >> v2:172.21.15.125:3300/0 conn(0x7f39e0131f40 0x7f39e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 --2- 172.21.15.125:0/2458471874 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009e870 0x7f39e009ec40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.264+0000 7f39e6245700 1 -- 172.21.15.125:0/2458471874 >> 172.21.15.125:0/2458471874 conn(0x7f39e00a4430 msgr2=0x7f39e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.265+0000 7f39e6245700 1 -- 172.21.15.125:0/2458471874 shutdown_connections 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.265+0000 7f39e6245700 1 -- 172.21.15.125:0/2458471874 wait complete. 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.265+0000 7f39e6245700 1 Processor -- start 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 -- start start 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 0x7f39e01c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 0x7f39e01c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 0x7f39e01c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e009dc10 con 0x7f39e009e870 2023-10-03T10:14:54.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01202d0 con 0x7f39e0131f40 2023-10-03T10:14:54.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39e6245700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39e011e980 con 0x7f39e009f180 2023-10-03T10:14:54.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39deffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 0x7f39e01c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39dffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 0x7f39e01c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39dffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 0x7f39e01c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34858/0 (socket says 172.21.15.125:34858) 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 0x7f39e01c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39deffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 0x7f39e01c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38190/0 (socket says 172.21.15.125:38190) 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39dffff700 1 -- 172.21.15.125:0/369281024 learned_addr learned my addr 172.21.15.125:0/369281024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 -- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 msgr2=0x7f39e01c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 0x7f39e01c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 -- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 msgr2=0x7f39e01c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 0x7f39e01c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.266+0000 7f39df7fe700 1 -- 172.21.15.125:0/369281024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80094a0 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39df7fe700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 0x7f39e01c6000 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39d0014000 tx=0x7f39d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0004440 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00045c0 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0009b30 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0004970 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e011fff0 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.267+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39d0019030 con 0x7f39e009e870 2023-10-03T10:14:54.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.268+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39d00405b0 con 0x7f39e009e870 2023-10-03T10:14:54.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.268+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e004f2a0 con 0x7f39e009e870 2023-10-03T10:14:54.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.272+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39d0017020 con 0x7f39e009e870 2023-10-03T10:14:54.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.422+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2938133360 con 0x7f29380a1380 2023-10-03T10:14:54.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.422+0000 7f292e7fc700 1 -- 172.21.15.125:0/908578714 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2928034020 con 0x7f29380a1380 2023-10-03T10:14:54.423 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 msgr2=0x7f2938122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2928013000 tx=0x7f2928004750 comp rx=0 tx=0).stop 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 shutdown_connections 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2938133f50 0x7f2938123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29380a0a70 0x7f2938122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 --2- 172.21.15.125:0/908578714 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29380a1380 0x7f2938122dd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 >> 172.21.15.125:0/908578714 conn(0x7f29380a6610 msgr2=0x7f293809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 shutdown_connections 2023-10-03T10:14:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.425+0000 7f293fe33700 1 -- 172.21.15.125:0/908578714 wait complete. 2023-10-03T10:14:54.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:54.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.464+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f39e011fc90 con 0x7f39e009e870 2023-10-03T10:14:54.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.465+0000 7f39d7fff700 1 -- 172.21.15.125:0/369281024 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39d0012430 con 0x7f39e009e870 2023-10-03T10:14:54.465 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 msgr2=0x7f39e01c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 0x7f39e01c6000 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39d0014000 tx=0x7f39d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 shutdown_connections 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39e0131f40 0x7f39e01c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39e009e870 0x7f39e01c6000 secure :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39d0014000 tx=0x7f39d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 --2- 172.21.15.125:0/369281024 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f39e009f180 0x7f39e01c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 >> 172.21.15.125:0/369281024 conn(0x7f39e00a4430 msgr2=0x7f39e01b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 shutdown_connections 2023-10-03T10:14:54.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:54.467+0000 7f39e6245700 1 -- 172.21.15.125:0/369281024 wait complete. 2023-10-03T10:14:54.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:54.983 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:55.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:55.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.112+0000 7f966c54e700 1 Processor -- start 2023-10-03T10:14:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.112+0000 7f966c54e700 1 -- start start 2023-10-03T10:14:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966c54e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966c54e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966c54e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966409dc00 con 0x7f9664133f50 2023-10-03T10:14:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966c54e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966409ea60 con 0x7f96640a0a70 2023-10-03T10:14:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966c54e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f966409dec0 con 0x7f96640a1380 2023-10-03T10:14:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f9669ae9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34874/0 (socket says 172.21.15.125:34874) 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f9669ae9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38200/0 (socket says 172.21.15.125:38200) 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 -- 172.21.15.125:0/2872096422 learned_addr learned my addr 172.21.15.125:0/2872096422 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966aaeb700 1 --1- 172.21.15.125:0/2872096422 >> v1:172.21.15.125:6789/0 conn(0x7f9664133f50 0x7f966413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41018/0 (socket says 172.21.15.125:41018) 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 -- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 msgr2=0x7f9664133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 -- 172.21.15.125:0/2872096422 >> v1:172.21.15.125:6789/0 conn(0x7f9664133f50 legacy=0x7f966413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 -- 172.21.15.125:0/2872096422 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966409e6a0 con 0x7f96640a0a70 2023-10-03T10:14:55.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f96692e8700 1 -- 172.21.15.125:0/2872096422 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522781398 0 0) 0x7f966409dc00 con 0x7f9664133f50 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f9669ae9700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f966a2ea700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9660009920 tx=0x7f9660009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5300d5e96c8109 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.113+0000 7f96692e8700 1 -- 172.21.15.125:0/2872096422 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011830 con 0x7f96640a0a70 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f96692e8700 1 -- 172.21.15.125:0/2872096422 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660011990 con 0x7f96640a0a70 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f96692e8700 1 -- 172.21.15.125:0/2872096422 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011d20 con 0x7f96640a0a70 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 -- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 msgr2=0x7f96640a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9660009920 tx=0x7f9660009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 -- 172.21.15.125:0/2872096422 shutdown_connections 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 --2- 172.21.15.125:0/2872096422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 -- 172.21.15.125:0/2872096422 >> 172.21.15.125:0/2872096422 conn(0x7f96640a6610 msgr2=0x7f96640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 -- 172.21.15.125:0/2872096422 shutdown_connections 2023-10-03T10:14:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.114+0000 7f966c54e700 1 -- 172.21.15.125:0/2872096422 wait complete. 2023-10-03T10:14:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.115+0000 7f966c54e700 1 Processor -- start 2023-10-03T10:14:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 -- start start 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 0x7f9664122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 0x7f9664122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96640a0450 con 0x7f96640a0a70 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664126fb0 con 0x7f96640a1380 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966c54e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9664125e30 con 0x7f9664133f50 2023-10-03T10:14:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966aaeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f9669ae9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 0x7f9664122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966aaeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38208/0 (socket says 172.21.15.125:38208) 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966aaeb700 1 -- 172.21.15.125:0/3789146641 learned_addr learned my addr 172.21.15.125:0/3789146641 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.116+0000 7f966a2ea700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 0x7f9664122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 -- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 msgr2=0x7f9664122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 0x7f9664122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 -- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 msgr2=0x7f9664122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 0x7f9664122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 -- 172.21.15.125:0/3789146641 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540094a0 con 0x7f9664133f50 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f9669ae9700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 0x7f9664122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966a2ea700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 0x7f9664122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966aaeb700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f965c00cc70 tx=0x7f965c00cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00aac0 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00ac40 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9660009550 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0070d0 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.117+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9664124530 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.118+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f965c007250 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.118+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f965c03f4c0 con 0x7f9664133f50 2023-10-03T10:14:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.118+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966404f2a0 con 0x7f9664133f50 2023-10-03T10:14:55.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.123+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f965c018080 con 0x7f9664133f50 2023-10-03T10:14:55.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.155+0000 7f8dfdf3a700 1 Processor -- start 2023-10-03T10:14:55.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.155+0000 7f8dfdf3a700 1 -- start start 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8dfdf3a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8df80a0a70 0x7f8df80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8dfdf3a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8dfdf3a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df809dc00 con 0x7f8df80a1380 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8dfdf3a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df809ea90 con 0x7f8df80a0a70 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8dfdf3a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df809dec0 con 0x7f8df8134120 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8df77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8df80a0a70 0x7f8df80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8df77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8df80a0a70 0x7f8df80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53456/0 (socket says 172.21.15.125:53456) 2023-10-03T10:14:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:34904/0 (socket says 172.21.15.125:34904) 2023-10-03T10:14:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.156+0000 7f8df77fe700 1 -- 172.21.15.125:0/1358993996 learned_addr learned my addr 172.21.15.125:0/1358993996 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df77fe700 1 -- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 msgr2=0x7f8df813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df77fe700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df77fe700 1 -- 172.21.15.125:0/1358993996 >> v1:172.21.15.125:6789/0 conn(0x7f8df80a1380 legacy=0x7f8df8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df77fe700 1 -- 172.21.15.125:0/1358993996 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df809e6a0 con 0x7f8df80a0a70 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df67fc700 1 -- 172.21.15.125:0/1358993996 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367803554 0 0) 0x7f8df809dc00 con 0x7f8df80a1380 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df7fff700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df77fe700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df80a0a70 0x7f8df80a0e40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098f0 tx=0x7f8df0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3568c2fc0c1194e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df67fc700 1 -- 172.21.15.125:0/1358993996 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011830 con 0x7f8df80a0a70 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df67fc700 1 -- 172.21.15.125:0/1358993996 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0011990 con 0x7f8df80a0a70 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.157+0000 7f8df67fc700 1 -- 172.21.15.125:0/1358993996 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011d20 con 0x7f8df80a0a70 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df80a0a70 msgr2=0x7f8df80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df80a0a70 0x7f8df80a0e40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098f0 tx=0x7f8df0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1358993996 shutdown_connections 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df8134120 0x7f8df813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1358993996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df80a0a70 0x7f8df80a0e40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1358993996 >> 172.21.15.125:0/1358993996 conn(0x7f8df80a6610 msgr2=0x7f8df80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1358993996 shutdown_connections 2023-10-03T10:14:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.158+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1358993996 wait complete. 2023-10-03T10:14:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 Processor -- start 2023-10-03T10:14:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 -- start start 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 0x7f8df8122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8133aa0 con 0x7f8df8134120 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80a03e0 con 0x7f8df80a0a70 2023-10-03T10:14:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.159+0000 7f8dfdf3a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8125d30 con 0x7f8df80a1380 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53472/0 (socket says 172.21.15.125:53472) 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 -- 172.21.15.125:0/1353389696 learned_addr learned my addr 172.21.15.125:0/1353389696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38224/0 (socket says 172.21.15.125:38224) 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df77fe700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 0x7f8df8122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 -- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 msgr2=0x7f8df8122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 -- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 msgr2=0x7f8df8122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 0x7f8df8122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 -- 172.21.15.125:0/1353389696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8009a70 con 0x7f8df8134120 2023-10-03T10:14:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df77fe700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 0x7f8df8122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df6ffd700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8df7fff700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8de800efc0 tx=0x7f8de800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800ca90 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de800f040 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df0009550 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800ce10 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.160+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df8126a60 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.161+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8de8014480 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.161+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8de803fcc0 con 0x7f8df8134120 2023-10-03T10:14:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.161+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df804f2a0 con 0x7f8df8134120 2023-10-03T10:14:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.166+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8de8012930 con 0x7f8df8134120 2023-10-03T10:14:55.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.316+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9664126bc0 con 0x7f9664133f50 2023-10-03T10:14:55.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.316+0000 7f965affd700 1 -- 172.21.15.125:0/3789146641 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f965c007500 con 0x7f9664133f50 2023-10-03T10:14:55.317 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:55.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.319+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 msgr2=0x7f96641234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.319+0000 7f966c54e700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f965c00cc70 tx=0x7f965c00cf80 comp rx=0 tx=0).stop 2023-10-03T10:14:55.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 shutdown_connections 2023-10-03T10:14:55.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f96641234a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a0a70 0x7f9664122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 --2- 172.21.15.125:0/3789146641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a1380 0x7f9664122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 >> 172.21.15.125:0/3789146641 conn(0x7f96640a6610 msgr2=0x7f96640a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 shutdown_connections 2023-10-03T10:14:55.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.320+0000 7f966c54e700 1 -- 172.21.15.125:0/3789146641 wait complete. 2023-10-03T10:14:55.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.361+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8df8072980 con 0x7f8df8134120 2023-10-03T10:14:55.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.361+0000 7f8deffff700 1 -- 172.21.15.125:0/1353389696 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8de802a090 con 0x7f8df8134120 2023-10-03T10:14:55.362 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 msgr2=0x7f8df81233c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8de800efc0 tx=0x7f8de800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 shutdown_connections 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8df8134120 0x7f8df81233c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8df80a0a70 0x7f8df8122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 --2- 172.21.15.125:0/1353389696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8df80a1380 0x7f8df8122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.363+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 >> 172.21.15.125:0/1353389696 conn(0x7f8df80a6610 msgr2=0x7f8df809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.364+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 shutdown_connections 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.364+0000 7f8dfdf3a700 1 -- 172.21.15.125:0/1353389696 wait complete. 2023-10-03T10:14:55.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:55.438 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:55.482 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:55.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.563+0000 7f2418821700 1 Processor -- start 2023-10-03T10:14:55.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.563+0000 7f2418821700 1 -- start start 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2418821700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 0x7f2414138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2418821700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2418821700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241409e9d0 con 0x7f24140a0a70 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2418821700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241409dc00 con 0x7f2414139200 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2418821700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f241409dec0 con 0x7f24140a1550 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2412d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 0x7f2414138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2412d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58266/0 (socket says 172.21.15.125:58266) 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2412d9d700 1 -- 172.21.15.125:0/840515715 learned_addr learned my addr 172.21.15.125:0/840515715 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f241259c700 1 --1- 172.21.15.125:0/840515715 >> v1:172.21.15.125:6789/0 conn(0x7f24140a0a70 0x7f24140a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55608/0 (socket says 172.21.15.125:55608) 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 -- 172.21.15.125:0/840515715 >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 msgr2=0x7f241413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 --2- 172.21.15.125:0/840515715 >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 -- 172.21.15.125:0/840515715 >> v1:172.21.15.125:6789/0 conn(0x7f24140a0a70 legacy=0x7f24140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 -- 172.21.15.125:0/840515715 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241409e6a0 con 0x7f24140a1550 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f241159a700 1 -- 172.21.15.125:0/840515715 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72508273 0 0) 0x7f241409e9d0 con 0x7f24140a0a70 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2412d9d700 1 --2- 172.21.15.125:0/840515715 >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f2411d9b700 1 --2- 172.21.15.125:0/840515715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 0x7f2414138cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2408009840 tx=0x7f2408009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c75a394acb74963 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f241159a700 1 -- 172.21.15.125:0/840515715 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011830 con 0x7f24140a1550 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f241159a700 1 -- 172.21.15.125:0/840515715 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408011990 con 0x7f24140a1550 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.564+0000 7f241159a700 1 -- 172.21.15.125:0/840515715 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011d20 con 0x7f24140a1550 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 -- 172.21.15.125:0/840515715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 msgr2=0x7f2414138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 --2- 172.21.15.125:0/840515715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 0x7f2414138cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2408009840 tx=0x7f2408009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 -- 172.21.15.125:0/840515715 shutdown_connections 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 --2- 172.21.15.125:0/840515715 >> v2:172.21.15.125:3300/0 conn(0x7f2414139200 0x7f241413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 --2- 172.21.15.125:0/840515715 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24140a1550 0x7f2414138cc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 -- 172.21.15.125:0/840515715 >> 172.21.15.125:0/840515715 conn(0x7f24140a6610 msgr2=0x7f24140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 -- 172.21.15.125:0/840515715 shutdown_connections 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.565+0000 7f2418821700 1 -- 172.21.15.125:0/840515715 wait complete. 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 Processor -- start 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 -- start start 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 0x7f2414121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 0x7f24141224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2414123680 con 0x7f24140a1550 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2414123ca0 con 0x7f24140a0a70 2023-10-03T10:14:55.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2418821700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24140a03e0 con 0x7f2414139200 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2411d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2412d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 0x7f24141224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f241259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 0x7f2414121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2411d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58274/0 (socket says 172.21.15.125:58274) 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.567+0000 7f2411d9b700 1 -- 172.21.15.125:0/1194194354 learned_addr learned my addr 172.21.15.125:0/1194194354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 -- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 msgr2=0x7f24141224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 0x7f24141224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 -- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 msgr2=0x7f2414121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 0x7f2414121a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 -- 172.21.15.125:0/1194194354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c009b30 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f241259c700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 0x7f2414121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2412d9d700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 0x7f24141224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2411d9b700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2408009fd0 tx=0x7f2408004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080036a0 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240801f070 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24080094a0 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408003a60 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.568+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2414124d70 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.569+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2408003bc0 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.569+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2408021070 con 0x7f24140a1550 2023-10-03T10:14:55.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.569+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2414124f50 con 0x7f24140a1550 2023-10-03T10:14:55.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.574+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2414124f50 con 0x7f24140a1550 2023-10-03T10:14:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.608+0000 7f72e9d3d700 1 Processor -- start 2023-10-03T10:14:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.608+0000 7f72e9d3d700 1 -- start start 2023-10-03T10:14:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e9d3d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e9d3d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72e41393a0 0x7f72e413b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e9d3d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e409fa00 con 0x7f72e409e870 2023-10-03T10:14:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e9d3d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40a0370 con 0x7f72e41393a0 2023-10-03T10:14:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e9d3d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e406bec0 con 0x7f72e409f350 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72e41393a0 0x7f72e413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53224/0 (socket says 172.21.15.125:53224) 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f72e409e870 0x7f72e409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55620/0 (socket says 172.21.15.125:55620) 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72e41393a0 0x7f72e413b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58290/0 (socket says 172.21.15.125:58290) 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e2ffd700 1 -- 172.21.15.125:0/1276662002 learned_addr learned my addr 172.21.15.125:0/1276662002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 -- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 msgr2=0x7f72e4138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 -- 172.21.15.125:0/1276662002 >> v1:172.21.15.125:6789/0 conn(0x7f72e409e870 legacy=0x7f72e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e3fff700 1 -- 172.21.15.125:0/1276662002 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e409ada0 con 0x7f72e41393a0 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e27fc700 1 -- 172.21.15.125:0/1276662002 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311903832 0 0) 0x7f72e409fa00 con 0x7f72e409e870 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.609+0000 7f72e2ffd700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e41393a0 0x7f72e413b780 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009840 tx=0x7f72d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d39a3775151c373 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e27fc700 1 -- 172.21.15.125:0/1276662002 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4011830 con 0x7f72e41393a0 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e27fc700 1 -- 172.21.15.125:0/1276662002 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4011990 con 0x7f72e41393a0 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e27fc700 1 -- 172.21.15.125:0/1276662002 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4011d20 con 0x7f72e41393a0 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e41393a0 msgr2=0x7f72e413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e41393a0 0x7f72e413b780 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009840 tx=0x7f72d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1276662002 shutdown_connections 2023-10-03T10:14:55.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e41393a0 0x7f72e413b780 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1276662002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e409f350 0x7f72e4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1276662002 >> 172.21.15.125:0/1276662002 conn(0x7f72e40a4430 msgr2=0x7f72e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1276662002 shutdown_connections 2023-10-03T10:14:55.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.610+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1276662002 wait complete. 2023-10-03T10:14:55.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.611+0000 7f72e9d3d700 1 Processor -- start 2023-10-03T10:14:55.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.611+0000 7f72e9d3d700 1 -- start start 2023-10-03T10:14:55.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 0x7f72e41225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4124de0 con 0x7f72e409e870 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4123760 con 0x7f72e41393a0 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e9d3d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40a1730 con 0x7f72e409f350 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58684/0 (socket says 172.21.15.125:58684) 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58304/0 (socket says 172.21.15.125:58304) 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e2ffd700 1 -- 172.21.15.125:0/1812810163 learned_addr learned my addr 172.21.15.125:0/1812810163 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:55.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 0x7f72e41225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 -- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 msgr2=0x7f72e4122090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 -- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 msgr2=0x7f72e4121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 -- 172.21.15.125:0/1812810163 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009550 con 0x7f72e41393a0 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e37fe700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e2ffd700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.612+0000 7f72e3fff700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 0x7f72e41225d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f72d4016000 tx=0x7f72d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4004590 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d401f070 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d40094a0 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40038e0 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e4123f20 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.613+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72d4003a40 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.614+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72d4021070 con 0x7f72e41393a0 2023-10-03T10:14:55.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.614+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e409a9d0 con 0x7f72e41393a0 2023-10-03T10:14:55.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.619+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72d4015020 con 0x7f72e41393a0 2023-10-03T10:14:55.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.764+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2414124f50 con 0x7f24140a1550 2023-10-03T10:14:55.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.764+0000 7f2402ffd700 1 -- 172.21.15.125:0/1194194354 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2414124f50 con 0x7f24140a1550 2023-10-03T10:14:55.765 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 msgr2=0x7f2414121fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2408009fd0 tx=0x7f2408004750 comp rx=0 tx=0).stop 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 shutdown_connections 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2414139200 0x7f24141224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24140a0a70 0x7f2414121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 --2- 172.21.15.125:0/1194194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24140a1550 0x7f2414121fb0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 >> 172.21.15.125:0/1194194354 conn(0x7f24140a6610 msgr2=0x7f24140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 shutdown_connections 2023-10-03T10:14:55.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.766+0000 7f2418821700 1 -- 172.21.15.125:0/1194194354 wait complete. 2023-10-03T10:14:55.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.808+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72e404f2a0 con 0x7f72e41393a0 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.808+0000 7f72cbfff700 1 -- 172.21.15.125:0/1812810163 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72d4010380 con 0x7f72e41393a0 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 msgr2=0x7f72e41225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 0x7f72e41225d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f72d4016000 tx=0x7f72d4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 shutdown_connections 2023-10-03T10:14:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72e41393a0 0x7f72e41225d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72e409e870 0x7f72e4121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 --2- 172.21.15.125:0/1812810163 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72e409f350 0x7f72e4122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 >> 172.21.15.125:0/1812810163 conn(0x7f72e40a4430 msgr2=0x7f72e4070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 shutdown_connections 2023-10-03T10:14:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:55.810+0000 7f72e9d3d700 1 -- 172.21.15.125:0/1812810163 wait complete. 2023-10-03T10:14:55.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:56.333 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:56.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.461+0000 7fdaa41aa700 1 Processor -- start 2023-10-03T10:14:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.461+0000 7fdaa41aa700 1 -- start start 2023-10-03T10:14:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c09e9d0 con 0x7fda9c0a0a70 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09dc00 con 0x7fda9c0a1380 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa41aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09dec0 con 0x7fda9c133f50 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1f46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1f46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58306/0 (socket says 172.21.15.125:58306) 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53240/0 (socket says 172.21.15.125:53240) 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1f46700 1 -- 172.21.15.125:0/4283541761 learned_addr learned my addr 172.21.15.125:0/4283541761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 -- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 msgr2=0x7fda9c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 --2- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 -- 172.21.15.125:0/4283541761 >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 msgr2=0x7fda9c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 --2- 172.21.15.125:0/4283541761 >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa2747700 1 -- 172.21.15.125:0/4283541761 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c09e6a0 con 0x7fda9c133f50 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.462+0000 7fdaa1f46700 1 --2- 172.21.15.125:0/4283541761 >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa2747700 1 --2- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c1343b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda94009d90 tx=0x7fda9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c909edac3185b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa0f44700 1 -- 172.21.15.125:0/4283541761 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400e070 con 0x7fda9c133f50 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa0f44700 1 -- 172.21.15.125:0/4283541761 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400bb20 con 0x7fda9c133f50 2023-10-03T10:14:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa0f44700 1 -- 172.21.15.125:0/4283541761 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94012430 con 0x7fda9c133f50 2023-10-03T10:14:56.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 -- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 msgr2=0x7fda9c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c1343b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda94009d90 tx=0x7fda9400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 -- 172.21.15.125:0/4283541761 shutdown_connections 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c1343b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/4283541761 >> v2:172.21.15.125:3300/0 conn(0x7fda9c0a0a70 0x7fda9c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/4283541761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.463+0000 7fdaa41aa700 1 -- 172.21.15.125:0/4283541761 >> 172.21.15.125:0/4283541761 conn(0x7fda9c0a6610 msgr2=0x7fda9c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.464+0000 7fdaa41aa700 1 -- 172.21.15.125:0/4283541761 shutdown_connections 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.464+0000 7fdaa41aa700 1 -- 172.21.15.125:0/4283541761 wait complete. 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.464+0000 7fdaa41aa700 1 Processor -- start 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 -- start start 2023-10-03T10:14:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 0x7fda9c121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c124cd0 con 0x7fda9c0a0a70 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c124eb0 con 0x7fda9c0a1380 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa41aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c122930 con 0x7fda9c133f50 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53254/0 (socket says 172.21.15.125:53254) 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 -- 172.21.15.125:0/2458066632 learned_addr learned my addr 172.21.15.125:0/2458066632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa2747700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1f46700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 0x7fda9c121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 -- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 msgr2=0x7fda9c121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 -- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 msgr2=0x7fda9c121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 0x7fda9c121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1745700 1 -- 172.21.15.125:0/2458066632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009550 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa2747700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.465+0000 7fdaa1f46700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 0x7fda9c121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fdaa1745700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9b0 tx=0x7fda8c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c009710 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00ee40 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94009a70 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00ca50 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.466+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c0a03e0 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.467+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda8c00cbb0 con 0x7fda9c0a1380 2023-10-03T10:14:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.467+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c124b10 con 0x7fda9c0a1380 2023-10-03T10:14:56.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.467+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda8c03fa20 con 0x7fda9c0a1380 2023-10-03T10:14:56.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.471+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda9c124b10 con 0x7fda9c0a1380 2023-10-03T10:14:56.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.501+0000 7f379379d700 1 Processor -- start 2023-10-03T10:14:56.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.501+0000 7f379379d700 1 -- start start 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f378c09e870 0x7f378c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09f180 0x7f378c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c0a0920 con 0x7f378c09e870 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c09c970 con 0x7f378c09f180 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f379379d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378c09bab0 con 0x7f378c131d70 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f378c09e870 0x7f378c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791d3a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3790d38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09f180 0x7f378c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f378c09e870 0x7f378c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58314/0 (socket says 172.21.15.125:58314) 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 -- 172.21.15.125:0/2947937585 learned_addr learned my addr 172.21.15.125:0/2947937585 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 -- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 msgr2=0x7f378c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 -- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09f180 msgr2=0x7f378c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09f180 0x7f378c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 -- 172.21.15.125:0/2947937585 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c09f9c0 con 0x7f378c09e870 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791d3a700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3791539700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09e870 0x7f378c09ec40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3788009920 tx=0x7f3788009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0159df95618c65f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3783fff700 1 -- 172.21.15.125:0/2947937585 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788011830 con 0x7f378c09e870 2023-10-03T10:14:56.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3783fff700 1 -- 172.21.15.125:0/2947937585 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788011990 con 0x7f378c09e870 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.502+0000 7f3783fff700 1 -- 172.21.15.125:0/2947937585 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788011d20 con 0x7f378c09e870 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 -- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09e870 msgr2=0x7f378c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09e870 0x7f378c09ec40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3788009920 tx=0x7f3788009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 -- 172.21.15.125:0/2947937585 shutdown_connections 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09e870 0x7f378c09ec40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 --2- 172.21.15.125:0/2947937585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09f180 0x7f378c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 -- 172.21.15.125:0/2947937585 >> 172.21.15.125:0/2947937585 conn(0x7f378c0a4430 msgr2=0x7f378c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 -- 172.21.15.125:0/2947937585 shutdown_connections 2023-10-03T10:14:56.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.503+0000 7f379379d700 1 -- 172.21.15.125:0/2947937585 wait complete. 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.504+0000 7f379379d700 1 Processor -- start 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.504+0000 7f379379d700 1 -- start start 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09f180 0x7f378c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c125fd0 con 0x7f378c09f180 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c09b160 con 0x7f378c09e870 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f379379d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378c09dba0 con 0x7f378c131d70 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791539700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791539700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53270/0 (socket says 172.21.15.125:53270) 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791539700 1 -- 172.21.15.125:0/839007521 learned_addr learned my addr 172.21.15.125:0/839007521 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3790d38700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09f180 0x7f378c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 -- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 msgr2=0x7f378c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 -- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09f180 msgr2=0x7f378c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09f180 0x7f378c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791d3a700 1 -- 172.21.15.125:0/839007521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009a70 con 0x7f378c131d70 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.505+0000 7f3791539700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f3791d3a700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c06c330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400ca90 con 0x7f378c131d70 2023-10-03T10:14:56.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400f040 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400ce30 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3788009550 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.506+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c125a30 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.507+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3784014480 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.507+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c06d570 con 0x7f378c131d70 2023-10-03T10:14:56.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.507+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f378403fd10 con 0x7f378c131d70 2023-10-03T10:14:56.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.512+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3784012930 con 0x7f378c131d70 2023-10-03T10:14:56.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.663+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda9c124b10 con 0x7fda9c0a1380 2023-10-03T10:14:56.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.663+0000 7fda927fc700 1 -- 172.21.15.125:0/2458066632 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda9c124b10 con 0x7fda9c0a1380 2023-10-03T10:14:56.664 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 msgr2=0x7fda9c121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9b0 tx=0x7fda8c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 shutdown_connections 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fda9c133f50 0x7fda9c121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda9c0a0a70 0x7fda9c121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 --2- 172.21.15.125:0/2458066632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda9c0a1380 0x7fda9c121aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 >> 172.21.15.125:0/2458066632 conn(0x7fda9c0a6610 msgr2=0x7fda9c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 shutdown_connections 2023-10-03T10:14:56.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.665+0000 7fdaa41aa700 1 -- 172.21.15.125:0/2458066632 wait complete. 2023-10-03T10:14:56.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:56.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.697+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f378c04f2a0 con 0x7f378c131d70 2023-10-03T10:14:56.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.698+0000 7f3781ffb700 1 -- 172.21.15.125:0/839007521 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3784012340 con 0x7f378c131d70 2023-10-03T10:14:56.698 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:56.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 msgr2=0x7f378c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c06c330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 shutdown_connections 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f378c131d70 0x7f378c06c330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f378c09e870 0x7f378c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 --2- 172.21.15.125:0/839007521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f378c09f180 0x7f378c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 >> 172.21.15.125:0/839007521 conn(0x7f378c0a4430 msgr2=0x7f378c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 shutdown_connections 2023-10-03T10:14:56.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.700+0000 7f379379d700 1 -- 172.21.15.125:0/839007521 wait complete. 2023-10-03T10:14:56.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:56.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:56.823 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:56.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 Processor -- start 2023-10-03T10:14:56.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 -- start start 2023-10-03T10:14:56.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac09dc00 con 0x7f4fac133f50 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac09ea60 con 0x7f4fac0a1380 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.907+0000 7f4fb38e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac09dec0 con 0x7f4fac0a0a70 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb167c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53272/0 (socket says 172.21.15.125:53272) 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb167c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58736/0 (socket says 172.21.15.125:58736) 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 -- 172.21.15.125:0/3623343536 learned_addr learned my addr 172.21.15.125:0/3623343536 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 -- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 msgr2=0x7f4fac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 -- 172.21.15.125:0/3623343536 >> v1:172.21.15.125:6789/0 conn(0x7f4fac133f50 legacy=0x7f4fac13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fa3fff700 1 -- 172.21.15.125:0/3623343536 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875405233 0 0) 0x7f4fac09dc00 con 0x7f4fac133f50 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 -- 172.21.15.125:0/3623343536 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac09e6a0 con 0x7f4fac0a1380 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb167c700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fb0e7b700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009920 tx=0x7f4f9c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a38635b4f26a2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fa3fff700 1 -- 172.21.15.125:0/3623343536 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c011830 con 0x7f4fac0a1380 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fa3fff700 1 -- 172.21.15.125:0/3623343536 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c011990 con 0x7f4fac0a1380 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.908+0000 7f4fa3fff700 1 -- 172.21.15.125:0/3623343536 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c011d20 con 0x7f4fac0a1380 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 -- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 msgr2=0x7f4fac133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009920 tx=0x7f4f9c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 -- 172.21.15.125:0/3623343536 shutdown_connections 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/3623343536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac0a1380 0x7f4fac133a10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 -- 172.21.15.125:0/3623343536 >> 172.21.15.125:0/3623343536 conn(0x7f4fac0a6610 msgr2=0x7f4fac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 -- 172.21.15.125:0/3623343536 shutdown_connections 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.909+0000 7f4fb38e0700 1 -- 172.21.15.125:0/3623343536 wait complete. 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.910+0000 7f4fb38e0700 1 Processor -- start 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.910+0000 7f4fb38e0700 1 -- start start 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 0x7f4fac123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac122fd0 con 0x7f4fac0a1380 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac125340 con 0x7f4fac133f50 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb38e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac126040 con 0x7f4fac0a0a70 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53288/0 (socket says 172.21.15.125:53288) 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb167c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 -- 172.21.15.125:0/1976006406 learned_addr learned my addr 172.21.15.125:0/1976006406 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb0e7b700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 0x7f4fac123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 -- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 msgr2=0x7f4fac123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 -- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 msgr2=0x7f4fac123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 0x7f4fac123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 -- 172.21.15.125:0/1976006406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa80094a0 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb167c700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb0e7b700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 0x7f4fac123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.911+0000 7f4fb1e7d700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c870 tx=0x7f4fa400cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4003e30 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4005070 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4005420 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c009550 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac1246d0 con 0x7f4fac133f50 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.912+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fa4005580 con 0x7f4fac133f50 2023-10-03T10:14:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.913+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fa403ed00 con 0x7f4fac133f50 2023-10-03T10:14:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.913+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac04f2a0 con 0x7f4fac133f50 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.918+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fa4017030 con 0x7f4fac133f50 2023-10-03T10:14:56.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.949+0000 7f9800ae4700 1 Processor -- start 2023-10-03T10:14:56.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.949+0000 7f9800ae4700 1 -- start start 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f9800ae4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f9800ae4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f9800ae4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97fc09dc00 con 0x7f97fc133f50 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f9800ae4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97fc09ea60 con 0x7f97fc0a0a70 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f9800ae4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc09dec0 con 0x7f97fc0a1380 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97fa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97fad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97fc133f50 0x7f97fc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55642/0 (socket says 172.21.15.125:55642) 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97fa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58334/0 (socket says 172.21.15.125:58334) 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58766/0 (socket says 172.21.15.125:58766) 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97fad9d700 1 -- 172.21.15.125:0/69900226 learned_addr learned my addr 172.21.15.125:0/69900226 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 -- 172.21.15.125:0/69900226 >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 msgr2=0x7f97fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 --2- 172.21.15.125:0/69900226 >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 -- 172.21.15.125:0/69900226 >> v1:172.21.15.125:6789/0 conn(0x7f97fc133f50 legacy=0x7f97fc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97f9d9b700 1 -- 172.21.15.125:0/69900226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc09e6a0 con 0x7f97fc0a1380 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.950+0000 7f97fa59c700 1 --2- 172.21.15.125:0/69900226 >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f97f9d9b700 1 --2- 172.21.15.125:0/69900226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009840 tx=0x7f97f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3160e28059e9f098 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f97f959a700 1 -- 172.21.15.125:0/69900226 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0011830 con 0x7f97fc0a1380 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f97f959a700 1 -- 172.21.15.125:0/69900226 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f0011990 con 0x7f97fc0a1380 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f97f959a700 1 -- 172.21.15.125:0/69900226 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0011d20 con 0x7f97fc0a1380 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 -- 172.21.15.125:0/69900226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 msgr2=0x7f97fc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 --2- 172.21.15.125:0/69900226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009840 tx=0x7f97f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 -- 172.21.15.125:0/69900226 shutdown_connections 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 --2- 172.21.15.125:0/69900226 >> v2:172.21.15.125:3300/0 conn(0x7f97fc0a0a70 0x7f97fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 --2- 172.21.15.125:0/69900226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc0a1380 0x7f97fc133a10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 -- 172.21.15.125:0/69900226 >> 172.21.15.125:0/69900226 conn(0x7f97fc0a6610 msgr2=0x7f97fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.951+0000 7f9800ae4700 1 -- 172.21.15.125:0/69900226 shutdown_connections 2023-10-03T10:14:56.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.952+0000 7f9800ae4700 1 -- 172.21.15.125:0/69900226 wait complete. 2023-10-03T10:14:56.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 Processor -- start 2023-10-03T10:14:56.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 -- start start 2023-10-03T10:14:56.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97fc0a0a70 0x7f97fc1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 0x7f97fc1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc122e90 con 0x7f97fc0a1380 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc133a10 con 0x7f97fc0a0a70 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f9800ae4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0a03e0 con 0x7f97fc133f50 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58350/0 (socket says 172.21.15.125:58350) 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 -- 172.21.15.125:0/4268741666 learned_addr learned my addr 172.21.15.125:0/4268741666 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97fa59c700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97fc0a0a70 0x7f97fc1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97fad9d700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 0x7f97fc1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 -- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 msgr2=0x7f97fc1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 0x7f97fc1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 -- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97fc0a0a70 msgr2=0x7f97fc1c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97fc0a0a70 0x7f97fc1c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97f9d9b700 1 -- 172.21.15.125:0/4268741666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0094a0 con 0x7f97fc0a1380 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.953+0000 7f97fad9d700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 0x7f97fc1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f97f9d9b700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009fd0 tx=0x7f97f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00036a0 con 0x7f97fc0a1380 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f001f070 con 0x7f97fc0a1380 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0003a60 con 0x7f97fc0a1380 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00094a0 con 0x7f97fc0a1380 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc1252e0 con 0x7f97fc0a1380 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.954+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97f0003bc0 con 0x7f97fc0a1380 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.955+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97f0021070 con 0x7f97fc0a1380 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.955+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc04f2a0 con 0x7f97fc0a1380 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:56.959+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97f0015080 con 0x7f97fc0a1380 2023-10-03T10:14:57.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.113+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fac126260 con 0x7f4fac133f50 2023-10-03T10:14:57.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.114+0000 7f4fa1ffb700 1 -- 172.21.15.125:0/1976006406 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fa400ad40 con 0x7f4fac133f50 2023-10-03T10:14:57.114 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 msgr2=0x7f4fac1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c870 tx=0x7f4fa400cb80 comp rx=0 tx=0).stop 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 shutdown_connections 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fac133f50 0x7f4fac1c82d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fac0a0a70 0x7f4fac123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 --2- 172.21.15.125:0/1976006406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fac0a1380 0x7f4fac123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 >> 172.21.15.125:0/1976006406 conn(0x7f4fac0a6610 msgr2=0x7f4fac09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 shutdown_connections 2023-10-03T10:14:57.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.116+0000 7f4fb38e0700 1 -- 172.21.15.125:0/1976006406 wait complete. 2023-10-03T10:14:57.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:57.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.152+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97fc126d70 con 0x7f97fc0a1380 2023-10-03T10:14:57.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.153+0000 7f97eaffd700 1 -- 172.21.15.125:0/4268741666 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97f002b020 con 0x7f97fc0a1380 2023-10-03T10:14:57.153 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:57.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 msgr2=0x7f97fc1c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009fd0 tx=0x7f97f0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 shutdown_connections 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97fc133f50 0x7f97fc1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97fc0a0a70 0x7f97fc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 --2- 172.21.15.125:0/4268741666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97fc0a1380 0x7f97fc1c8790 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 >> 172.21.15.125:0/4268741666 conn(0x7f97fc0a6610 msgr2=0x7f97fc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 shutdown_connections 2023-10-03T10:14:57.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.155+0000 7f9800ae4700 1 -- 172.21.15.125:0/4268741666 wait complete. 2023-10-03T10:14:57.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:57.679 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:57.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:57.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.808+0000 7fe2cd9b5700 1 Processor -- start 2023-10-03T10:14:57.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.808+0000 7fe2cd9b5700 1 -- start start 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2cd9b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2cd9b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2cd9b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c809dc00 con 0x7fe2c8133f50 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2cd9b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c809ea60 con 0x7fe2c80a0a70 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2cd9b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c809dec0 con 0x7fe2c80a1380 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58356/0 (socket says 172.21.15.125:58356) 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58782/0 (socket says 172.21.15.125:58782) 2023-10-03T10:14:57.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c6ffd700 1 -- 172.21.15.125:0/735256007 learned_addr learned my addr 172.21.15.125:0/735256007 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.809+0000 7fe2c77fe700 1 --1- 172.21.15.125:0/735256007 >> v1:172.21.15.125:6789/0 conn(0x7fe2c8133f50 0x7fe2c813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55650/0 (socket says 172.21.15.125:55650) 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c67fc700 1 -- 172.21.15.125:0/735256007 >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 msgr2=0x7fe2c80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c67fc700 1 --2- 172.21.15.125:0/735256007 >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c67fc700 1 -- 172.21.15.125:0/735256007 >> v1:172.21.15.125:6789/0 conn(0x7fe2c8133f50 legacy=0x7fe2c813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c67fc700 1 -- 172.21.15.125:0/735256007 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c809e6a0 con 0x7fe2c80a1380 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c6ffd700 1 --2- 172.21.15.125:0/735256007 >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c67fc700 1 --2- 172.21.15.125:0/735256007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009840 tx=0x7fe2bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffb8e32607b23513 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c5ffb700 1 -- 172.21.15.125:0/735256007 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc011830 con 0x7fe2c80a1380 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c5ffb700 1 -- 172.21.15.125:0/735256007 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc011990 con 0x7fe2c80a1380 2023-10-03T10:14:57.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.810+0000 7fe2c5ffb700 1 -- 172.21.15.125:0/735256007 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc011d20 con 0x7fe2c80a1380 2023-10-03T10:14:57.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/735256007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 msgr2=0x7fe2c8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/735256007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009840 tx=0x7fe2bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:57.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/735256007 shutdown_connections 2023-10-03T10:14:57.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/735256007 >> v2:172.21.15.125:3300/0 conn(0x7fe2c80a0a70 0x7fe2c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/735256007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c80a1380 0x7fe2c8133a10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/735256007 >> 172.21.15.125:0/735256007 conn(0x7fe2c80a6610 msgr2=0x7fe2c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/735256007 shutdown_connections 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.811+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/735256007 wait complete. 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.812+0000 7fe2cd9b5700 1 Processor -- start 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.812+0000 7fe2cd9b5700 1 -- start start 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 0x7fe2c81c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 0x7fe2c81c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8122e90 con 0x7fe2c80a0a70 2023-10-03T10:14:57.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8133a10 con 0x7fe2c80a1380 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2cd9b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80a03e0 con 0x7fe2c8133f50 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 0x7fe2c81c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58360/0 (socket says 172.21.15.125:58360) 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c6ffd700 1 -- 172.21.15.125:0/3099869313 learned_addr learned my addr 172.21.15.125:0/3099869313 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c77fe700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 0x7fe2c81c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.813+0000 7fe2c6ffd700 1 -- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 msgr2=0x7fe2c81c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c6ffd700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 0x7fe2c81c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c6ffd700 1 -- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 msgr2=0x7fe2c81c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c6ffd700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 0x7fe2c81c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c6ffd700 1 -- 172.21.15.125:0/3099869313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8009550 con 0x7fe2c80a0a70 2023-10-03T10:14:57.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c67fc700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 0x7fe2c81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c77fe700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 0x7fe2c81c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2c6ffd700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ebe0 tx=0x7fe2b800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800c850 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800c9b0 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc0094a0 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800cd40 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.814+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c8126030 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.815+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2b8013470 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.815+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c8126dd0 con 0x7fe2c80a0a70 2023-10-03T10:14:57.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.815+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2b803fc00 con 0x7fe2c80a0a70 2023-10-03T10:14:57.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.819+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2b801b3b0 con 0x7fe2c80a0a70 2023-10-03T10:14:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.849+0000 7fb16fb53700 1 Processor -- start 2023-10-03T10:14:57.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.849+0000 7fb16fb53700 1 -- start start 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16fb53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16fb53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16fb53700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16809dc00 con 0x7fb1680a1380 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16fb53700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16809ea60 con 0x7fb168134120 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16fb53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16809dec0 con 0x7fb1680a0a70 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16e0f0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d0ee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1680a1380 0x7fb168133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55666/0 (socket says 172.21.15.125:55666) 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d0ee700 1 -- 172.21.15.125:0/3542235088 learned_addr learned my addr 172.21.15.125:0/3542235088 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/3542235088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53326/0 (socket says 172.21.15.125:53326) 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16e0f0700 1 --2- 172.21.15.125:0/3542235088 >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58364/0 (socket says 172.21.15.125:58364) 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 -- 172.21.15.125:0/3542235088 >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 msgr2=0x7fb16813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/3542235088 >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 -- 172.21.15.125:0/3542235088 >> v1:172.21.15.125:6789/0 conn(0x7fb1680a1380 legacy=0x7fb168133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 -- 172.21.15.125:0/3542235088 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16809e6a0 con 0x7fb1680a0a70 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16e0f0700 1 --2- 172.21.15.125:0/3542235088 >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/3542235088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb164009840 tx=0x7fb164009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87362b2fcdc6b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16c8ed700 1 -- 172.21.15.125:0/3542235088 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164011830 con 0x7fb1680a0a70 2023-10-03T10:14:57.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16c8ed700 1 -- 172.21.15.125:0/3542235088 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164011990 con 0x7fb1680a0a70 2023-10-03T10:14:57.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.850+0000 7fb16c8ed700 1 -- 172.21.15.125:0/3542235088 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164011d20 con 0x7fb1680a0a70 2023-10-03T10:14:57.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 -- 172.21.15.125:0/3542235088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 msgr2=0x7fb1680a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 --2- 172.21.15.125:0/3542235088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb164009840 tx=0x7fb164009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 -- 172.21.15.125:0/3542235088 shutdown_connections 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 --2- 172.21.15.125:0/3542235088 >> v2:172.21.15.125:3300/0 conn(0x7fb168134120 0x7fb16813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 --2- 172.21.15.125:0/3542235088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a0a70 0x7fb1680a0e40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 -- 172.21.15.125:0/3542235088 >> 172.21.15.125:0/3542235088 conn(0x7fb1680a6610 msgr2=0x7fb1680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 -- 172.21.15.125:0/3542235088 shutdown_connections 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.851+0000 7fb16fb53700 1 -- 172.21.15.125:0/3542235088 wait complete. 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 Processor -- start 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 -- start start 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a1380 0x7fb168122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb168134120 0x7fb1681233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168133a90 con 0x7fb1680a0a70 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680a03e0 con 0x7fb1680a1380 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16fb53700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1681337f0 con 0x7fb168134120 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.853+0000 7fb16d8ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58368/0 (socket says 172.21.15.125:58368) 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 -- 172.21.15.125:0/1513987329 learned_addr learned my addr 172.21.15.125:0/1513987329 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d0ee700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a1380 0x7fb168122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16e0f0700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb168134120 0x7fb1681233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 -- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb168134120 msgr2=0x7fb1681233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb168134120 0x7fb1681233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 -- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a1380 msgr2=0x7fb168122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a1380 0x7fb168122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 -- 172.21.15.125:0/1513987329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009a70 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16d8ef700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb164009fd0 tx=0x7fb164004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640045d0 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16401f070 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640094a0 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640038e0 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.854+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb168126b50 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.855+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb164003a40 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.855+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb164021070 con 0x7fb1680a0a70 2023-10-03T10:14:57.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.855+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168125ed0 con 0x7fb1680a0a70 2023-10-03T10:14:57.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:57.860+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb164015020 con 0x7fb1680a0a70 2023-10-03T10:14:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.013+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2c81261c0 con 0x7fe2c80a0a70 2023-10-03T10:14:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.014+0000 7fe2affff700 1 -- 172.21.15.125:0/3099869313 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2b8024350 con 0x7fe2c80a0a70 2023-10-03T10:14:58.014 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:58.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.015+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 msgr2=0x7fe2c81c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.015+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ebe0 tx=0x7fe2b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 shutdown_connections 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2c8133f50 0x7fe2c81c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80a0a70 0x7fe2c81c8250 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 --2- 172.21.15.125:0/3099869313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2c80a1380 0x7fe2c81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 >> 172.21.15.125:0/3099869313 conn(0x7fe2c80a6610 msgr2=0x7fe2c80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 shutdown_connections 2023-10-03T10:14:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.016+0000 7fe2cd9b5700 1 -- 172.21.15.125:0/3099869313 wait complete. 2023-10-03T10:14:58.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.048+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb168126320 con 0x7fb1680a0a70 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.048+0000 7fb15e7fc700 1 -- 172.21.15.125:0/1513987329 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb168126320 con 0x7fb1680a0a70 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 msgr2=0x7fb168122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb164009fd0 tx=0x7fb164004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 shutdown_connections 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb168134120 0x7fb1681233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1680a0a70 0x7fb168122970 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 --2- 172.21.15.125:0/1513987329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1680a1380 0x7fb168122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 >> 172.21.15.125:0/1513987329 conn(0x7fb1680a6610 msgr2=0x7fb1680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 shutdown_connections 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.050+0000 7fb16fb53700 1 -- 172.21.15.125:0/1513987329 wait complete. 2023-10-03T10:14:58.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:58.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:58.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:58.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.256+0000 7f16aff75700 1 Processor -- start 2023-10-03T10:14:58.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.256+0000 7f16aff75700 1 -- start start 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16aff75700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16a809f350 0x7f16a8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16aff75700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16aff75700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a806c6a0 con 0x7f16a809e870 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16aff75700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a806bcd0 con 0x7f16a809f350 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16aff75700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809f780 con 0x7f16a81393a0 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16a809f350 0x7f16a8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ae512700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ae512700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58812/0 (socket says 172.21.15.125:58812) 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16a809f350 0x7f16a8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58370/0 (socket says 172.21.15.125:58370) 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ae512700 1 -- 172.21.15.125:0/1003668445 learned_addr learned my addr 172.21.15.125:0/1003668445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 -- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 msgr2=0x7f16a813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 -- 172.21.15.125:0/1003668445 >> v1:172.21.15.125:6789/0 conn(0x7f16a809e870 legacy=0x7f16a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 -- 172.21.15.125:0/1003668445 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a806bec0 con 0x7f16a809f350 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16acd0f700 1 -- 172.21.15.125:0/1003668445 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657438469 0 0) 0x7f16a806c6a0 con 0x7f16a809e870 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ae512700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16ad510700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809f350 0x7f16a8138e60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1698009840 tx=0x7f1698009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1274e4d226e1ef49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16acd0f700 1 -- 172.21.15.125:0/1003668445 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011830 con 0x7f16a809f350 2023-10-03T10:14:58.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16acd0f700 1 -- 172.21.15.125:0/1003668445 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698011990 con 0x7f16a809f350 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.257+0000 7f16acd0f700 1 -- 172.21.15.125:0/1003668445 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011d20 con 0x7f16a809f350 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 -- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809f350 msgr2=0x7f16a8138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809f350 0x7f16a8138e60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1698009840 tx=0x7f1698009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 -- 172.21.15.125:0/1003668445 shutdown_connections 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a81393a0 0x7f16a813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 --2- 172.21.15.125:0/1003668445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809f350 0x7f16a8138e60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 -- 172.21.15.125:0/1003668445 >> 172.21.15.125:0/1003668445 conn(0x7f16a80a4430 msgr2=0x7f16a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 -- 172.21.15.125:0/1003668445 shutdown_connections 2023-10-03T10:14:58.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.258+0000 7f16aff75700 1 -- 172.21.15.125:0/1003668445 wait complete. 2023-10-03T10:14:58.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.259+0000 7f16aff75700 1 Processor -- start 2023-10-03T10:14:58.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.259+0000 7f16aff75700 1 -- start start 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.259+0000 7f16aff75700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.259+0000 7f16aff75700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a81393a0 0x7f16a811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8122290 con 0x7f16a809e870 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8134820 con 0x7f16a81393a0 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8122470 con 0x7f16a809f350 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16add11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58816/0 (socket says 172.21.15.125:58816) 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16add11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58384/0 (socket says 172.21.15.125:58384) 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 -- 172.21.15.125:0/392427889 learned_addr learned my addr 172.21.15.125:0/392427889 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:58.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ae512700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a81393a0 0x7f16a811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 -- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a81393a0 msgr2=0x7f16a811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a81393a0 0x7f16a811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 -- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 msgr2=0x7f16a81c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 -- 172.21.15.125:0/392427889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0009b30 con 0x7f16a809f350 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16add11700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16ad510700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f16980090b0 tx=0x7f1698004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980036a0 con 0x7f16a809f350 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169801f070 con 0x7f16a809f350 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698003a60 con 0x7f16a809f350 2023-10-03T10:14:58.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16980094a0 con 0x7f16a809f350 2023-10-03T10:14:58.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.260+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a806cfa0 con 0x7f16a809f350 2023-10-03T10:14:58.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.261+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1698003bc0 con 0x7f16a809f350 2023-10-03T10:14:58.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.261+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1698021070 con 0x7f16a809f350 2023-10-03T10:14:58.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.261+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a804f2a0 con 0x7f16a809f350 2023-10-03T10:14:58.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.266+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1698015020 con 0x7f16a809f350 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.298+0000 7f206b0f8700 1 Processor -- start 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.298+0000 7f206b0f8700 1 -- start start 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f206b0f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f206b0f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f206b0f8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206409b110 con 0x7f20640a0a70 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f206b0f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640a3b60 con 0x7f2064133f70 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f206b0f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20641348e0 con 0x7f206409ad40 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2063fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2063fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58388/0 (socket says 172.21.15.125:58388) 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58830/0 (socket says 172.21.15.125:58830) 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2063fff700 1 -- 172.21.15.125:0/4051605622 learned_addr learned my addr 172.21.15.125:0/4051605622 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 -- 172.21.15.125:0/4051605622 >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 msgr2=0x7f20641343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 --2- 172.21.15.125:0/4051605622 >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 -- 172.21.15.125:0/4051605622 >> v1:172.21.15.125:6789/0 conn(0x7f20640a0a70 legacy=0x7f20640a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 -- 172.21.15.125:0/4051605622 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20640a2fa0 con 0x7f206409ad40 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2063fff700 1 --2- 172.21.15.125:0/4051605622 >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f20637fe700 1 -- 172.21.15.125:0/4051605622 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650733196 0 0) 0x7f206409b110 con 0x7f20640a0a70 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.299+0000 7f2068e94700 1 --2- 172.21.15.125:0/4051605622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2058009870 tx=0x7f2058009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d42db368b81971a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f20637fe700 1 -- 172.21.15.125:0/4051605622 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058011830 con 0x7f206409ad40 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f20637fe700 1 -- 172.21.15.125:0/4051605622 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058011990 con 0x7f206409ad40 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f20637fe700 1 -- 172.21.15.125:0/4051605622 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058011d20 con 0x7f206409ad40 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 -- 172.21.15.125:0/4051605622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 msgr2=0x7f2064133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 --2- 172.21.15.125:0/4051605622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2058009870 tx=0x7f2058009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 -- 172.21.15.125:0/4051605622 shutdown_connections 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 --2- 172.21.15.125:0/4051605622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f2064133a30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 --2- 172.21.15.125:0/4051605622 >> v2:172.21.15.125:3300/0 conn(0x7f2064133f70 0x7f20641343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 -- 172.21.15.125:0/4051605622 >> 172.21.15.125:0/4051605622 conn(0x7f2064099c40 msgr2=0x7f206406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 -- 172.21.15.125:0/4051605622 shutdown_connections 2023-10-03T10:14:58.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.300+0000 7f206b0f8700 1 -- 172.21.15.125:0/4051605622 wait complete. 2023-10-03T10:14:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.301+0000 7f206b0f8700 1 Processor -- start 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.301+0000 7f206b0f8700 1 -- start start 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 0x7f206411fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2064133f70 0x7f20641c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2064122600 con 0x7f20640a0a70 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20641336c0 con 0x7f2064133f70 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2064120180 con 0x7f206409ad40 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2063fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 0x7f206411fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58836/0 (socket says 172.21.15.125:58836) 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 -- 172.21.15.125:0/277628306 learned_addr learned my addr 172.21.15.125:0/277628306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 -- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2064133f70 msgr2=0x7f20641c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2064133f70 0x7f20641c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 -- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 msgr2=0x7f206411fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 0x7f206411fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 -- 172.21.15.125:0/277628306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050009550 con 0x7f206409ad40 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2063fff700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 0x7f206411fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f2068e94700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2058000c00 tx=0x7f2058004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580036a0 con 0x7f206409ad40 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205801e070 con 0x7f206409ad40 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20580094a0 con 0x7f206409ad40 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058003a00 con 0x7f206409ad40 2023-10-03T10:14:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.302+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20641228a0 con 0x7f206409ad40 2023-10-03T10:14:58.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.303+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2058003b60 con 0x7f206409ad40 2023-10-03T10:14:58.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.303+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20580403d0 con 0x7f206409ad40 2023-10-03T10:14:58.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.304+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20641228a0 con 0x7f206409ad40 2023-10-03T10:14:58.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.308+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20641228a0 con 0x7f206409ad40 2023-10-03T10:14:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.471+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16a8072d60 con 0x7f16a809f350 2023-10-03T10:14:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.471+0000 7f169e7fc700 1 -- 172.21.15.125:0/392427889 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1698010380 con 0x7f16a809f350 2023-10-03T10:14:58.472 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 msgr2=0x7f16a81c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f16980090b0 tx=0x7f1698004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 shutdown_connections 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a81393a0 0x7f16a811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a809e870 0x7f16a81c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 --2- 172.21.15.125:0/392427889 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16a809f350 0x7f16a81c8bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 >> 172.21.15.125:0/392427889 conn(0x7f16a80a4430 msgr2=0x7f16a8136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 shutdown_connections 2023-10-03T10:14:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.474+0000 7f16aff75700 1 -- 172.21.15.125:0/392427889 wait complete. 2023-10-03T10:14:58.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:58.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.512+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20641228a0 con 0x7f206409ad40 2023-10-03T10:14:58.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.513+0000 7f20617fa700 1 -- 172.21.15.125:0/277628306 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20641228a0 con 0x7f206409ad40 2023-10-03T10:14:58.513 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 msgr2=0x7f206411f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2058000c00 tx=0x7f2058004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 shutdown_connections 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2064133f70 0x7f20641c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f206409ad40 0x7f206411f700 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 --2- 172.21.15.125:0/277628306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20640a0a70 0x7f206411fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 >> 172.21.15.125:0/277628306 conn(0x7f2064099c40 msgr2=0x7f20641bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 shutdown_connections 2023-10-03T10:14:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:58.515+0000 7f206b0f8700 1 -- 172.21.15.125:0/277628306 wait complete. 2023-10-03T10:14:58.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:14:59.029 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:59.063 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:59.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 Processor -- start 2023-10-03T10:14:59.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 -- start start 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c09e9d0 con 0x7f970c0a0a70 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c09dc00 con 0x7f970c139200 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f9711128700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c09dec0 con 0x7f970c0a1550 2023-10-03T10:14:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f970a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f970ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f970c0a0a70 0x7f970c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55694/0 (socket says 172.21.15.125:55694) 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f970ad9d700 1 -- 172.21.15.125:0/840848010 learned_addr learned my addr 172.21.15.125:0/840848010 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.161+0000 7f970b59e700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970b59e700 1 -- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 msgr2=0x7f970c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970b59e700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970b59e700 1 -- 172.21.15.125:0/840848010 >> v1:172.21.15.125:6789/0 conn(0x7f970c0a0a70 legacy=0x7f970c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9709d9b700 1 -- 172.21.15.125:0/840848010 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738549565 0 0) 0x7f970c09e9d0 con 0x7f970c0a0a70 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970b59e700 1 -- 172.21.15.125:0/840848010 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c09e6a0 con 0x7f970c139200 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970a59c700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f970b59e700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c13b5e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9704009dc0 tx=0x7f970400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff10bae14ab2224 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9709d9b700 1 -- 172.21.15.125:0/840848010 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400e070 con 0x7f970c139200 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9709d9b700 1 -- 172.21.15.125:0/840848010 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400bb20 con 0x7f970c139200 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9709d9b700 1 -- 172.21.15.125:0/840848010 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704012430 con 0x7f970c139200 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 -- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 msgr2=0x7f970c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c13b5e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9704009dc0 tx=0x7f970400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 -- 172.21.15.125:0/840848010 shutdown_connections 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c13b5e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 --2- 172.21.15.125:0/840848010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 -- 172.21.15.125:0/840848010 >> 172.21.15.125:0/840848010 conn(0x7f970c0a6610 msgr2=0x7f970c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.162+0000 7f9711128700 1 -- 172.21.15.125:0/840848010 shutdown_connections 2023-10-03T10:14:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.163+0000 7f9711128700 1 -- 172.21.15.125:0/840848010 wait complete. 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 Processor -- start 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 -- start start 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f970c0a0a70 0x7f970c11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0a03e0 con 0x7f970c0a0a70 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1220d0 con 0x7f970c139200 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f9711128700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1205b0 con 0x7f970c0a1550 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58858/0 (socket says 172.21.15.125:58858) 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970b59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53378/0 (socket says 172.21.15.125:53378) 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970a59c700 1 -- 172.21.15.125:0/4250880728 learned_addr learned my addr 172.21.15.125:0/4250880728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.164+0000 7f970ad9d700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f970c0a0a70 0x7f970c11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 -- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 msgr2=0x7f970c11edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 -- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f970c0a0a70 msgr2=0x7f970c11e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f970c0a0a70 0x7f970c11e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 -- 172.21.15.125:0/4250880728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000094a0 con 0x7f970c139200 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970a59c700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f970b59e700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9704016000 tx=0x7f9704004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704004880 con 0x7f970c139200 2023-10-03T10:14:59.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704020070 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9704009a70 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040276c0 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.165+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c120e90 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.166+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9704012430 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.166+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9704022070 con 0x7f970c139200 2023-10-03T10:14:59.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.166+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c04f2a0 con 0x7f970c139200 2023-10-03T10:14:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.171+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f970401a970 con 0x7f970c139200 2023-10-03T10:14:59.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.202+0000 7ff64fb78700 1 Processor -- start 2023-10-03T10:14:59.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 -- start start 2023-10-03T10:14:59.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff6480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 0x7ff64813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64809dc00 con 0x7ff6480a1380 2023-10-03T10:14:59.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64809ea90 con 0x7ff6480a0a70 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64fb78700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff64809dec0 con 0x7ff648134120 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64e115700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 0x7ff64813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64d113700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff6480a1380 0x7ff648133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55708/0 (socket says 172.21.15.125:55708) 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64d113700 1 -- 172.21.15.125:0/595338811 learned_addr learned my addr 172.21.15.125:0/595338811 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64d914700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff6480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64c912700 1 -- 172.21.15.125:0/595338811 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118671297 0 0) 0x7ff64809dc00 con 0x7ff6480a1380 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64e115700 1 -- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 msgr2=0x7ff6480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64e115700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff6480a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64e115700 1 -- 172.21.15.125:0/595338811 >> v1:172.21.15.125:6789/0 conn(0x7ff6480a1380 legacy=0x7ff648133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64e115700 1 -- 172.21.15.125:0/595338811 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64809e6a0 con 0x7ff648134120 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.203+0000 7ff64d914700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff6480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64e115700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 0x7ff64813bce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff640009dc0 tx=0x7ff64000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46d435a110f4c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64c912700 1 -- 172.21.15.125:0/595338811 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000e070 con 0x7ff648134120 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64c912700 1 -- 172.21.15.125:0/595338811 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000bb20 con 0x7ff648134120 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64c912700 1 -- 172.21.15.125:0/595338811 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640012430 con 0x7ff648134120 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 -- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 msgr2=0x7ff64813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 0x7ff64813bce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff640009dc0 tx=0x7ff64000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 -- 172.21.15.125:0/595338811 shutdown_connections 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff648134120 0x7ff64813bce0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 --2- 172.21.15.125:0/595338811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff6480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 -- 172.21.15.125:0/595338811 >> 172.21.15.125:0/595338811 conn(0x7ff6480a6610 msgr2=0x7ff6480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.204+0000 7ff64fb78700 1 -- 172.21.15.125:0/595338811 shutdown_connections 2023-10-03T10:14:59.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.205+0000 7ff64fb78700 1 -- 172.21.15.125:0/595338811 wait complete. 2023-10-03T10:14:59.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.205+0000 7ff64fb78700 1 Processor -- start 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.205+0000 7ff64fb78700 1 -- start start 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff648122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 0x7ff648122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 0x7ff648123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481258f0 con 0x7ff648134120 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff648133640 con 0x7ff6480a0a70 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64fb78700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481262f0 con 0x7ff6480a1380 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d914700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff648122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 0x7ff648122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64e115700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 0x7ff648123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d914700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff648122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53384/0 (socket says 172.21.15.125:53384) 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d914700 1 -- 172.21.15.125:0/1694803656 learned_addr learned my addr 172.21.15.125:0/1694803656 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 -- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 msgr2=0x7ff648122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff648122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 -- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 msgr2=0x7ff648123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 0x7ff648123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 -- 172.21.15.125:0/1694803656 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440094a0 con 0x7ff6480a1380 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64e115700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 0x7ff648123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff64d113700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 0x7ff648122dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff6480a2b70 tx=0x7ff63800c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638004c80 con 0x7ff6480a1380 2023-10-03T10:14:59.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.206+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638004de0 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff640009a70 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638007310 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6480a0430 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff638007470 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff63803f1c0 con 0x7ff6480a1380 2023-10-03T10:14:59.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.207+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff648125ae0 con 0x7ff6480a1380 2023-10-03T10:14:59.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.216+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff638007720 con 0x7ff6480a1380 2023-10-03T10:14:59.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.368+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f970c0a56d0 con 0x7f970c139200 2023-10-03T10:14:59.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.368+0000 7f96f37fe700 1 -- 172.21.15.125:0/4250880728 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9704030390 con 0x7f970c139200 2023-10-03T10:14:59.369 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 msgr2=0x7f970c11f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9704016000 tx=0x7f9704004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 shutdown_connections 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f970c139200 0x7f970c11f310 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f970c0a0a70 0x7f970c11e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 --2- 172.21.15.125:0/4250880728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f970c0a1550 0x7f970c11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 >> 172.21.15.125:0/4250880728 conn(0x7f970c0a6610 msgr2=0x7f970c136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 shutdown_connections 2023-10-03T10:14:59.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.370+0000 7f9711128700 1 -- 172.21.15.125:0/4250880728 wait complete. 2023-10-03T10:14:59.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:14:59.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.412+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff648126a60 con 0x7ff6480a1380 2023-10-03T10:14:59.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.412+0000 7ff63e7fc700 1 -- 172.21.15.125:0/1694803656 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff63801ce30 con 0x7ff6480a1380 2023-10-03T10:14:59.412 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 msgr2=0x7ff648122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 0x7ff648122dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff6480a2b70 tx=0x7ff63800c750 comp rx=0 tx=0).stop 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 shutdown_connections 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff648134120 0x7ff648123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6480a0a70 0x7ff648122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 --2- 172.21.15.125:0/1694803656 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6480a1380 0x7ff648122dd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 >> 172.21.15.125:0/1694803656 conn(0x7ff6480a6610 msgr2=0x7ff64809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 shutdown_connections 2023-10-03T10:14:59.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.414+0000 7ff64fb78700 1 -- 172.21.15.125:0/1694803656 wait complete. 2023-10-03T10:14:59.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:59.487 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:59.528 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:59.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.612+0000 7f009b0e1700 1 Processor -- start 2023-10-03T10:14:59.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.612+0000 7f009b0e1700 1 -- start start 2023-10-03T10:14:59.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009b0e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 0x7f00940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009b0e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 0x7f0094133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009b0e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009409dc00 con 0x7f0094133f50 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009b0e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009409ea60 con 0x7f00940a1380 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009b0e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f009409dec0 con 0x7f00940a0a70 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0093fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 0x7f0094133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0098e7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 0x7f00940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009967e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0094133f50 0x7f009413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55718/0 (socket says 172.21.15.125:55718) 2023-10-03T10:14:59.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f009967e700 1 -- 172.21.15.125:0/3738383091 learned_addr learned my addr 172.21.15.125:0/3738383091 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0098e7d700 1 -- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 msgr2=0x7f0094133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0098e7d700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 0x7f0094133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0098e7d700 1 -- 172.21.15.125:0/3738383091 >> v1:172.21.15.125:6789/0 conn(0x7f0094133f50 legacy=0x7f009413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f00937fe700 1 -- 172.21.15.125:0/3738383091 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856509576 0 0) 0x7f009409dc00 con 0x7f0094133f50 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0098e7d700 1 -- 172.21.15.125:0/3738383091 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009409e6a0 con 0x7f00940a0a70 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.613+0000 7f0093fff700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 0x7f0094133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f0098e7d700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 0x7f00940a0e40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0088009870 tx=0x7f0088009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1583d294acdd75cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f00937fe700 1 -- 172.21.15.125:0/3738383091 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088011830 con 0x7f00940a0a70 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f00937fe700 1 -- 172.21.15.125:0/3738383091 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088011990 con 0x7f00940a0a70 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f00937fe700 1 -- 172.21.15.125:0/3738383091 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088011d20 con 0x7f00940a0a70 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 -- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 msgr2=0x7f00940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 0x7f00940a0e40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0088009870 tx=0x7f0088009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 -- 172.21.15.125:0/3738383091 shutdown_connections 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a0a70 0x7f00940a0e40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 --2- 172.21.15.125:0/3738383091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a1380 0x7f0094133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 -- 172.21.15.125:0/3738383091 >> 172.21.15.125:0/3738383091 conn(0x7f00940a6610 msgr2=0x7f00940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 -- 172.21.15.125:0/3738383091 shutdown_connections 2023-10-03T10:14:59.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.614+0000 7f009b0e1700 1 -- 172.21.15.125:0/3738383091 wait complete. 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.615+0000 7f009b0e1700 1 Processor -- start 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.615+0000 7f009b0e1700 1 -- start start 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 0x7f0094122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 0x7f00941232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941260b0 con 0x7f0094133f50 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094123cd0 con 0x7f00940a0a70 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009b0e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0094133970 con 0x7f00940a1380 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0098e7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 0x7f0094122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009967e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 0x7f00941232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0098e7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53394/0 (socket says 172.21.15.125:53394) 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0098e7d700 1 -- 172.21.15.125:0/4024028028 learned_addr learned my addr 172.21.15.125:0/4024028028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 -- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 msgr2=0x7f0094122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 -- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 msgr2=0x7f00941232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 0x7f00941232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0093fff700 1 -- 172.21.15.125:0/4024028028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800094a0 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f009967e700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 0x7f00941232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.616+0000 7f0098e7d700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f0093fff700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 0x7f0094122db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f008000e9b0 tx=0x7f008000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008000ee50 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008000c850 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880094a0 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008000cbe0 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094133300 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.617+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f008000cd40 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.618+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f008003f720 con 0x7f00940a1380 2023-10-03T10:14:59.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.618+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009404f2a0 con 0x7f00940a1380 2023-10-03T10:14:59.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.622+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00800232f0 con 0x7f00940a1380 2023-10-03T10:14:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.653+0000 7efecccb2700 1 Processor -- start 2023-10-03T10:14:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.653+0000 7efecccb2700 1 -- start start 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 0x7efec80a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec80a3b60 con 0x7efec8133f70 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec81348e0 con 0x7efec809ad40 2023-10-03T10:14:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efecccb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec809b110 con 0x7efec80a0a70 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 0x7efec80a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58426/0 (socket says 172.21.15.125:58426) 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53408/0 (socket says 172.21.15.125:53408) 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.654+0000 7efec5d9b700 1 -- 172.21.15.125:0/2975363274 learned_addr learned my addr 172.21.15.125:0/2975363274 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 -- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 msgr2=0x7efec8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 --2- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 -- 172.21.15.125:0/2975363274 >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 msgr2=0x7efec81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 --2- 172.21.15.125:0/2975363274 >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 -- 172.21.15.125:0/2975363274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec80a2fa0 con 0x7efec80a0a70 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec5d9b700 1 --2- 172.21.15.125:0/2975363274 >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec6d9d700 1 --2- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 0x7efec80a0ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efec0009dc0 tx=0x7efec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8261f013cf2577 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec559a700 1 -- 172.21.15.125:0/2975363274 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000e070 con 0x7efec80a0a70 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec559a700 1 -- 172.21.15.125:0/2975363274 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000bae0 con 0x7efec80a0a70 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efec559a700 1 -- 172.21.15.125:0/2975363274 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000be90 con 0x7efec80a0a70 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efecccb2700 1 -- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 msgr2=0x7efec80a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.655+0000 7efecccb2700 1 --2- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 0x7efec80a0ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efec0009dc0 tx=0x7efec000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 -- 172.21.15.125:0/2975363274 shutdown_connections 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 --2- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 --2- 172.21.15.125:0/2975363274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec80a0a70 0x7efec80a0ed0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 --2- 172.21.15.125:0/2975363274 >> v2:172.21.15.125:3300/0 conn(0x7efec8133f70 0x7efec81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 -- 172.21.15.125:0/2975363274 >> 172.21.15.125:0/2975363274 conn(0x7efec8099c40 msgr2=0x7efec806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 -- 172.21.15.125:0/2975363274 shutdown_connections 2023-10-03T10:14:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.656+0000 7efecccb2700 1 -- 172.21.15.125:0/2975363274 wait complete. 2023-10-03T10:14:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 Processor -- start 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 -- start start 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efec80a0a70 0x7efec81c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec8133f70 0x7efec81c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec81208d0 con 0x7efec80a0a70 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec81206e0 con 0x7efec809ad40 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efecccb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec81225f0 con 0x7efec8133f70 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efec659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efec659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53412/0 (socket says 172.21.15.125:53412) 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efec659c700 1 -- 172.21.15.125:0/4217570059 learned_addr learned my addr 172.21.15.125:0/4217570059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efec6d9d700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec8133f70 0x7efec81c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.657+0000 7efec5d9b700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efec80a0a70 0x7efec81c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 -- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec8133f70 msgr2=0x7efec81c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec8133f70 0x7efec81c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 -- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efec80a0a70 msgr2=0x7efec81c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efec80a0a70 0x7efec81c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 -- 172.21.15.125:0/4217570059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009550 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efec659c700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e870 tx=0x7efeb800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8013680 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80137e0 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec0009a70 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8013b90 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.658+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec8122310 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.659+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efeb8013cf0 con 0x7efec809ad40 2023-10-03T10:14:59.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.659+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec804f2a0 con 0x7efec809ad40 2023-10-03T10:14:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.659+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efeb803f530 con 0x7efec809ad40 2023-10-03T10:14:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.664+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efeb801be10 con 0x7efec809ad40 2023-10-03T10:14:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.811+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0094072980 con 0x7f00940a1380 2023-10-03T10:14:59.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.812+0000 7f00917fa700 1 -- 172.21.15.125:0/4024028028 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f008002b090 con 0x7f00940a1380 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 msgr2=0x7f0094122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 0x7f0094122db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f008000e9b0 tx=0x7f008000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 shutdown_connections 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0094133f50 0x7f00941232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00940a0a70 0x7f0094122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 --2- 172.21.15.125:0/4024028028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00940a1380 0x7f0094122db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 >> 172.21.15.125:0/4024028028 conn(0x7f00940a6610 msgr2=0x7f00940a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 shutdown_connections 2023-10-03T10:14:59.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.814+0000 7f009b0e1700 1 -- 172.21.15.125:0/4024028028 wait complete. 2023-10-03T10:14:59.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.853+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efec81220e0 con 0x7efec809ad40 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.854+0000 7efeb6ffd700 1 -- 172.21.15.125:0/4217570059 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efeb8020170 con 0x7efec809ad40 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 msgr2=0x7efec81c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e870 tx=0x7efeb800eb80 comp rx=0 tx=0).stop 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 shutdown_connections 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efec8133f70 0x7efec81c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efec809ad40 0x7efec81c8290 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 --2- 172.21.15.125:0/4217570059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efec80a0a70 0x7efec81c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 >> 172.21.15.125:0/4217570059 conn(0x7efec8099c40 msgr2=0x7efec81bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 shutdown_connections 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:14:59.856+0000 7efecccb2700 1 -- 172.21.15.125:0/4217570059 wait complete. 2023-10-03T10:14:59.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:00.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:00.427 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:00.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.518+0000 7f1dd660f700 1 Processor -- start 2023-10-03T10:15:00.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.518+0000 7f1dd660f700 1 -- start start 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd660f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 0x7f1dd00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd660f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd660f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd009dc00 con 0x7f1dd0133f50 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd660f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd009ea60 con 0x7f1dd00a0a70 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd660f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd009dec0 con 0x7f1dd00a1380 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 0x7f1dd00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53418/0 (socket says 172.21.15.125:53418) 2023-10-03T10:15:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dd4bac700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1dd0133f50 0x7f1dd013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55722/0 (socket says 172.21.15.125:55722) 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/3756024305 learned_addr learned my addr 172.21.15.125:0/3756024305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/3756024305 >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 msgr2=0x7f1dd00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 --2- 172.21.15.125:0/3756024305 >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 0x7f1dd00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/3756024305 >> v1:172.21.15.125:6789/0 conn(0x7f1dd0133f50 legacy=0x7f1dd013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/3756024305 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd009e6a0 con 0x7f1dd00a1380 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dceffd700 1 -- 172.21.15.125:0/3756024305 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664262632 0 0) 0x7f1dd009dc00 con 0x7f1dd0133f50 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcffff700 1 --2- 172.21.15.125:0/3756024305 >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 0x7f1dd00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.519+0000 7f1dcf7fe700 1 --2- 172.21.15.125:0/3756024305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40098f0 tx=0x7f1dc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ea1b6c61b47d08c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dceffd700 1 -- 172.21.15.125:0/3756024305 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011830 con 0x7f1dd00a1380 2023-10-03T10:15:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dceffd700 1 -- 172.21.15.125:0/3756024305 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4011990 con 0x7f1dd00a1380 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dceffd700 1 -- 172.21.15.125:0/3756024305 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011d20 con 0x7f1dd00a1380 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 -- 172.21.15.125:0/3756024305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 msgr2=0x7f1dd0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 --2- 172.21.15.125:0/3756024305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40098f0 tx=0x7f1dc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 -- 172.21.15.125:0/3756024305 shutdown_connections 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 --2- 172.21.15.125:0/3756024305 >> v2:172.21.15.125:3300/0 conn(0x7f1dd00a0a70 0x7f1dd00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 --2- 172.21.15.125:0/3756024305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd00a1380 0x7f1dd0133a10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 -- 172.21.15.125:0/3756024305 >> 172.21.15.125:0/3756024305 conn(0x7f1dd00a6610 msgr2=0x7f1dd00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 -- 172.21.15.125:0/3756024305 shutdown_connections 2023-10-03T10:15:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.520+0000 7f1dd660f700 1 -- 172.21.15.125:0/3756024305 wait complete. 2023-10-03T10:15:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.521+0000 7f1dd660f700 1 Processor -- start 2023-10-03T10:15:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.521+0000 7f1dd660f700 1 -- start start 2023-10-03T10:15:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 0x7f1dd011ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd0133f50 0x7f1dd011f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0121f40 con 0x7f1dd00a0a70 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0122120 con 0x7f1dd0133f50 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd660f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0133590 con 0x7f1dd00a1380 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 0x7f1dd011ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dd4bac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd0133f50 0x7f1dd011f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58450/0 (socket says 172.21.15.125:58450) 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcffff700 1 -- 172.21.15.125:0/2281090638 learned_addr learned my addr 172.21.15.125:0/2281090638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd0133f50 msgr2=0x7f1dd011f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd0133f50 0x7f1dd011f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 msgr2=0x7f1dd011e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 -- 172.21.15.125:0/2281090638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00094a0 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcffff700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dcf7fe700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 0x7f1dd011ec70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4016000 tx=0x7f1dc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.522+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4004550 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc401f070 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc4009550 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40038e0 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd01339e0 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1dc4003a40 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.523+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd004f2a0 con 0x7f1dd00a1380 2023-10-03T10:15:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.524+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1dc4021070 con 0x7f1dd00a1380 2023-10-03T10:15:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.528+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dc40269a0 con 0x7f1dd00a1380 2023-10-03T10:15:00.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.556+0000 7f0fb21c0700 1 Processor -- start 2023-10-03T10:15:00.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.556+0000 7f0fb21c0700 1 -- start start 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fb21c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fb21c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 0x7f0fac13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fb21c0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac09e9d0 con 0x7f0fac0a0a70 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fb21c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac09dc00 con 0x7f0fac0a1550 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fb21c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac09dec0 con 0x7f0fac139200 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53438/0 (socket says 172.21.15.125:53438) 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 -- 172.21.15.125:0/458014829 learned_addr learned my addr 172.21.15.125:0/458014829 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0fabfff700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 0x7f0fac13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 -- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 msgr2=0x7f0fac13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 0x7f0fac13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.557+0000 7f0faaffd700 1 -- 172.21.15.125:0/458014829 >> v1:172.21.15.125:6789/0 conn(0x7f0fac0a0a70 legacy=0x7f0fac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0faaffd700 1 -- 172.21.15.125:0/458014829 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac09e6a0 con 0x7f0fac0a1550 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fabfff700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 0x7f0fac13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0faaffd700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009920 tx=0x7f0f94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c84fdbaec48ba05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0faa7fc700 1 -- 172.21.15.125:0/458014829 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011830 con 0x7f0fac0a1550 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0faa7fc700 1 -- 172.21.15.125:0/458014829 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94011990 con 0x7f0fac0a1550 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0faa7fc700 1 -- 172.21.15.125:0/458014829 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011d20 con 0x7f0fac0a1550 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 -- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 msgr2=0x7f0fac138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009920 tx=0x7f0f94009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 -- 172.21.15.125:0/458014829 shutdown_connections 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac139200 0x7f0fac13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/458014829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac0a1550 0x7f0fac138cc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 -- 172.21.15.125:0/458014829 >> 172.21.15.125:0/458014829 conn(0x7f0fac0a6610 msgr2=0x7f0fac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 -- 172.21.15.125:0/458014829 shutdown_connections 2023-10-03T10:15:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.558+0000 7f0fb21c0700 1 -- 172.21.15.125:0/458014829 wait complete. 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.559+0000 7f0fb21c0700 1 Processor -- start 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 -- start start 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac0a0a70 0x7f0fac11ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 0x7f0fac11ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1227a0 con 0x7f0fac0a0a70 2023-10-03T10:15:00.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac120c00 con 0x7f0fac139200 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fb21c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0a5400 con 0x7f0fac0a1550 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0faaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 0x7f0fac11ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0faaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 0x7f0fac11ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58898/0 (socket says 172.21.15.125:58898) 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53446/0 (socket says 172.21.15.125:53446) 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0faaffd700 1 -- 172.21.15.125:0/1414378780 learned_addr learned my addr 172.21.15.125:0/1414378780 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fab7fe700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac0a0a70 0x7f0fac11ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 -- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 msgr2=0x7f0fac11ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 0x7f0fac11ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 -- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac0a0a70 msgr2=0x7f0fac11ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac0a0a70 0x7f0fac11ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.560+0000 7f0fabfff700 1 -- 172.21.15.125:0/1414378780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40094a0 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fabfff700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e8e0 tx=0x7f0fa400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4004020 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40041a0 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4004550 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f94009550 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac120750 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.561+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fa40036a0 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.562+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0fa403f6f0 con 0x7f0fac139200 2023-10-03T10:15:00.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.562+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac121ed0 con 0x7f0fac139200 2023-10-03T10:15:00.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.567+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fa4013680 con 0x7f0fac139200 2023-10-03T10:15:00.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.721+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1dd0120a00 con 0x7f1dd00a1380 2023-10-03T10:15:00.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.721+0000 7f1dccff9700 1 -- 172.21.15.125:0/2281090638 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1dc4015030 con 0x7f1dd00a1380 2023-10-03T10:15:00.722 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:00.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 msgr2=0x7f1dd011ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 0x7f1dd011ec70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4016000 tx=0x7f1dc4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 shutdown_connections 2023-10-03T10:15:00.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1dd0133f50 0x7f1dd011f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dd00a0a70 0x7f1dd011e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 --2- 172.21.15.125:0/2281090638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1dd00a1380 0x7f1dd011ec70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.723+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 >> 172.21.15.125:0/2281090638 conn(0x7f1dd00a6610 msgr2=0x7f1dd009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.724+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 shutdown_connections 2023-10-03T10:15:00.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.724+0000 7f1dd660f700 1 -- 172.21.15.125:0/2281090638 wait complete. 2023-10-03T10:15:00.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:00.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.757+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fac04f2a0 con 0x7f0fac139200 2023-10-03T10:15:00.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.758+0000 7f0fa3fff700 1 -- 172.21.15.125:0/1414378780 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fa4017020 con 0x7f0fac139200 2023-10-03T10:15:00.758 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:00.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 msgr2=0x7f0fac11f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e8e0 tx=0x7f0fa400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 shutdown_connections 2023-10-03T10:15:00.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fac139200 0x7f0fac11f4c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fac0a0a70 0x7f0fac11ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 --2- 172.21.15.125:0/1414378780 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0fac0a1550 0x7f0fac11ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 >> 172.21.15.125:0/1414378780 conn(0x7f0fac0a6610 msgr2=0x7f0fac1382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 shutdown_connections 2023-10-03T10:15:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.760+0000 7f0fb21c0700 1 -- 172.21.15.125:0/1414378780 wait complete. 2023-10-03T10:15:00.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:00.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:00.869 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:00.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.953+0000 7f6d989ee700 1 Processor -- start 2023-10-03T10:15:00.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.953+0000 7f6d989ee700 1 -- start start 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d989ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d940a0a70 0x7f6d940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d989ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d94134120 0x7f6d9413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d989ee700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9409dc00 con 0x7f6d940a1380 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d989ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9409ea60 con 0x7f6d94134120 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d989ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9409dec0 con 0x7f6d940a0a70 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d94134120 0x7f6d9413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d91d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6d940a1380 0x7f6d94133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55734/0 (socket says 172.21.15.125:55734) 2023-10-03T10:15:00.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d91d9b700 1 -- 172.21.15.125:0/2046024601 learned_addr learned my addr 172.21.15.125:0/2046024601 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d94134120 0x7f6d9413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58470/0 (socket says 172.21.15.125:58470) 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d9259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d940a0a70 0x7f6d940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d940a0a70 msgr2=0x7f6d940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d940a0a70 0x7f6d940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2046024601 >> v1:172.21.15.125:6789/0 conn(0x7f6d940a1380 legacy=0x7f6d94133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2046024601 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9409e6a0 con 0x7f6d94134120 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d9159a700 1 -- 172.21.15.125:0/2046024601 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285845649 0 0) 0x7f6d9409dc00 con 0x7f6d940a1380 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d94134120 0x7f6d9413bce0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009d90 tx=0x7f6d8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8ad92057413482 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d9159a700 1 -- 172.21.15.125:0/2046024601 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00e070 con 0x7f6d94134120 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d9159a700 1 -- 172.21.15.125:0/2046024601 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00bb20 con 0x7f6d94134120 2023-10-03T10:15:00.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.954+0000 7f6d9159a700 1 -- 172.21.15.125:0/2046024601 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c012430 con 0x7f6d94134120 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 -- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d94134120 msgr2=0x7f6d9413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 --2- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d94134120 0x7f6d9413bce0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009d90 tx=0x7f6d8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 -- 172.21.15.125:0/2046024601 shutdown_connections 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 --2- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d94134120 0x7f6d9413bce0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 --2- 172.21.15.125:0/2046024601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d940a0a70 0x7f6d940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 -- 172.21.15.125:0/2046024601 >> 172.21.15.125:0/2046024601 conn(0x7f6d940a6610 msgr2=0x7f6d940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 -- 172.21.15.125:0/2046024601 shutdown_connections 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.955+0000 7f6d989ee700 1 -- 172.21.15.125:0/2046024601 wait complete. 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.956+0000 7f6d989ee700 1 Processor -- start 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.956+0000 7f6d989ee700 1 -- start start 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940a0a70 0x7f6d94122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 0x7f6d94122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94125ab0 con 0x7f6d940a1380 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941332b0 con 0x7f6d940a0a70 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d989ee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94123b70 con 0x7f6d94134120 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d91d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 0x7f6d94122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d9259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940a0a70 0x7f6d94122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58908/0 (socket says 172.21.15.125:58908) 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3319818084 learned_addr learned my addr 172.21.15.125:0/3319818084 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940a0a70 msgr2=0x7f6d94122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940a0a70 0x7f6d94122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 msgr2=0x7f6d94122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 0x7f6d94122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3319818084 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009a70 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d91d9b700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 0x7f6d94122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d9409eba0 tx=0x7f6d8c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.957+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c012430 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c020070 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d941336c0 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004280 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d941339a0 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d8c0043e0 con 0x7f6d94134120 2023-10-03T10:15:00.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.958+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d8c022070 con 0x7f6d94134120 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.959+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d941336c0 con 0x7f6d94134120 2023-10-03T10:15:00.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.963+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d941336c0 con 0x7f6d94134120 2023-10-03T10:15:00.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 Processor -- start 2023-10-03T10:15:00.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 -- start start 2023-10-03T10:15:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b780a1450 0x7f3b78138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7813b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780a2640 con 0x7f3b780a0970 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7809dde0 con 0x7f3b780a1450 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7d59f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780a2820 con 0x7f3b78139090 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b7cd9e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b777fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b780a1450 0x7f3b78138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b77fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3b780a0970 0x7f3b780a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55746/0 (socket says 172.21.15.125:55746) 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b77fff700 1 -- 172.21.15.125:0/1958886999 learned_addr learned my addr 172.21.15.125:0/1958886999 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.996+0000 7f3b777fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b780a1450 0x7f3b78138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58498/0 (socket says 172.21.15.125:58498) 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b777fe700 1 -- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 msgr2=0x7f3b7813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b777fe700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b777fe700 1 -- 172.21.15.125:0/1958886999 >> v1:172.21.15.125:6789/0 conn(0x7f3b780a0970 legacy=0x7f3b780a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b777fe700 1 -- 172.21.15.125:0/1958886999 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780a2330 con 0x7f3b780a1450 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b7cd9e700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b777fe700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b78138b50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009840 tx=0x7f3b6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7557417611ba0eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b76ffd700 1 -- 172.21.15.125:0/1958886999 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011830 con 0x7f3b780a1450 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b76ffd700 1 -- 172.21.15.125:0/1958886999 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c011990 con 0x7f3b780a1450 2023-10-03T10:15:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b76ffd700 1 -- 172.21.15.125:0/1958886999 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011d20 con 0x7f3b780a1450 2023-10-03T10:15:01.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 msgr2=0x7f3b78138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.997+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b78138b50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009840 tx=0x7f3b6c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1958886999 shutdown_connections 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1958886999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b78138b50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1958886999 >> 172.21.15.125:0/1958886999 conn(0x7f3b780a6070 msgr2=0x7f3b780a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1958886999 shutdown_connections 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.998+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1958886999 wait complete. 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 Processor -- start 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 -- start start 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 0x7f3b7811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b7811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7809ce30 con 0x7f3b780a1450 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781205c0 con 0x7f3b78139090 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7d59f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78122070 con 0x7f3b780a0970 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 0x7f3b7811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7cd9e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7cd9e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53462/0 (socket says 172.21.15.125:53462) 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b7cd9e700 1 -- 172.21.15.125:0/1864737644 learned_addr learned my addr 172.21.15.125:0/1864737644 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 0x7f3b7811e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58910/0 (socket says 172.21.15.125:58910) 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:00.999+0000 7f3b777fe700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b7811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 -- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 msgr2=0x7f3b7811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 0x7f3b7811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 -- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 msgr2=0x7f3b7811eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b7811eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 -- 172.21.15.125:0/1864737644 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009a70 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b777fe700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b7811eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7cd9e700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000efc0 tx=0x7f3b7000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ca90 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7000f040 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0094a0 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ce10 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.000+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7809d260 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.001+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7804f2a0 con 0x7f3b78139090 2023-10-03T10:15:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.001+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b70003a20 con 0x7f3b78139090 2023-10-03T10:15:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.002+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b70040760 con 0x7f3b78139090 2023-10-03T10:15:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.006+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b7001c3b0 con 0x7f3b78139090 2023-10-03T10:15:01.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.151+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d941336c0 con 0x7f6d94134120 2023-10-03T10:15:01.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.151+0000 7f6d82ffd700 1 -- 172.21.15.125:0/3319818084 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d941336c0 con 0x7f6d94134120 2023-10-03T10:15:01.151 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:01.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 msgr2=0x7f6d94123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d9409eba0 tx=0x7f6d8c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 shutdown_connections 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d94134120 0x7f6d94123190 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940a0a70 0x7f6d94122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 --2- 172.21.15.125:0/3319818084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940a1380 0x7f6d94122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 >> 172.21.15.125:0/3319818084 conn(0x7f6d940a6610 msgr2=0x7f6d940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 shutdown_connections 2023-10-03T10:15:01.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.153+0000 7f6d989ee700 1 -- 172.21.15.125:0/3319818084 wait complete. 2023-10-03T10:15:01.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.193+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3b78121e60 con 0x7f3b78139090 2023-10-03T10:15:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.193+0000 7f3b74ff9700 1 -- 172.21.15.125:0/1864737644 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b7002b090 con 0x7f3b78139090 2023-10-03T10:15:01.193 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 msgr2=0x7f3b7811f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000efc0 tx=0x7f3b7000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 shutdown_connections 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b78139090 0x7f3b7811f3e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b780a0970 0x7f3b7811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 --2- 172.21.15.125:0/1864737644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b780a1450 0x7f3b7811eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 >> 172.21.15.125:0/1864737644 conn(0x7f3b780a6070 msgr2=0x7f3b78138040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 shutdown_connections 2023-10-03T10:15:01.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.195+0000 7f3b7d59f700 1 -- 172.21.15.125:0/1864737644 wait complete. 2023-10-03T10:15:01.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:01.738 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:01.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 Processor -- start 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 -- start start 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc09b110 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc0a3b60 con 0x7fd3dc133f70 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3e1133700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1348e0 con 0x7fd3dc09ad40 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3da59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3dad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3da59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58526/0 (socket says 172.21.15.125:58526) 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3dad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58920/0 (socket says 172.21.15.125:58920) 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3da59c700 1 -- 172.21.15.125:0/4039316042 learned_addr learned my addr 172.21.15.125:0/4039316042 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.866+0000 7fd3db59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd3dc0a0a70 0x7fd3dc0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55748/0 (socket says 172.21.15.125:55748) 2023-10-03T10:15:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3dad9d700 1 -- 172.21.15.125:0/4039316042 >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 msgr2=0x7fd3dc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3dad9d700 1 --2- 172.21.15.125:0/4039316042 >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3dad9d700 1 -- 172.21.15.125:0/4039316042 >> v1:172.21.15.125:6789/0 conn(0x7fd3dc0a0a70 legacy=0x7fd3dc0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3dad9d700 1 -- 172.21.15.125:0/4039316042 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0a2fa0 con 0x7fd3dc09ad40 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3d9d9b700 1 -- 172.21.15.125:0/4039316042 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699736195 0 0) 0x7fd3dc09b110 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3da59c700 1 --2- 172.21.15.125:0/4039316042 >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3dad9d700 1 --2- 172.21.15.125:0/4039316042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009870 tx=0x7fd3cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2582dd86cf67255 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3d9d9b700 1 -- 172.21.15.125:0/4039316042 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc011830 con 0x7fd3dc09ad40 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3d9d9b700 1 -- 172.21.15.125:0/4039316042 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc011990 con 0x7fd3dc09ad40 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.867+0000 7fd3d9d9b700 1 -- 172.21.15.125:0/4039316042 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc011d20 con 0x7fd3dc09ad40 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 -- 172.21.15.125:0/4039316042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 msgr2=0x7fd3dc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 --2- 172.21.15.125:0/4039316042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009870 tx=0x7fd3cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 -- 172.21.15.125:0/4039316042 shutdown_connections 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 --2- 172.21.15.125:0/4039316042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc09ad40 0x7fd3dc133a30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 --2- 172.21.15.125:0/4039316042 >> v2:172.21.15.125:3300/0 conn(0x7fd3dc133f70 0x7fd3dc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 -- 172.21.15.125:0/4039316042 >> 172.21.15.125:0/4039316042 conn(0x7fd3dc099c40 msgr2=0x7fd3dc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 -- 172.21.15.125:0/4039316042 shutdown_connections 2023-10-03T10:15:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.868+0000 7fd3e1133700 1 -- 172.21.15.125:0/4039316042 wait complete. 2023-10-03T10:15:01.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.869+0000 7fd3e1133700 1 Processor -- start 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.869+0000 7fd3e1133700 1 -- start start 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 0x7fd3dc11f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc122600 con 0x7fd3dc09ad40 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1336c0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3e1133700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc120180 con 0x7fd3dc133f70 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3db59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53468/0 (socket says 172.21.15.125:53468) 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3db59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58924/0 (socket says 172.21.15.125:58924) 2023-10-03T10:15:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 -- 172.21.15.125:0/158353550 learned_addr learned my addr 172.21.15.125:0/158353550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3dad9d700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 0x7fd3dc11f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 -- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 msgr2=0x7fd3dc1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 -- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 msgr2=0x7fd3dc11f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 0x7fd3dc11f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 -- 172.21.15.125:0/158353550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009550 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3db59e700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3dad9d700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 0x7fd3dc11f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.870+0000 7fd3da59c700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000ebe0 tx=0x7fd3d000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000c850 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d000c9b0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc0094a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000cd60 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc1228a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.871+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3d0013470 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.872+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3d003f5e0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.872+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc1228a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.876+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3dc1228a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:01.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.906+0000 7fa3b86af700 1 Processor -- start 2023-10-03T10:15:01.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.906+0000 7fa3b86af700 1 -- start start 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b86af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3b00a0a70 0x7fa3b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b86af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 0x7fa3b013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b86af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b009dc00 con 0x7fa3b00a1380 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b86af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b009ea90 con 0x7fa3b00a0a70 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b86af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b009dec0 con 0x7fa3b0134120 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b644b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3b00a0a70 0x7fa3b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b644b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3b00a0a70 0x7fa3b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58540/0 (socket says 172.21.15.125:58540) 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b644b700 1 -- 172.21.15.125:0/2533144892 learned_addr learned my addr 172.21.15.125:0/2533144892 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b6c4c700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 0x7fa3b013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.907+0000 7fa3b5c4a700 1 --1- 172.21.15.125:0/2533144892 >> v1:172.21.15.125:6789/0 conn(0x7fa3b00a1380 0x7fa3b0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55754/0 (socket says 172.21.15.125:55754) 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b644b700 1 -- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 msgr2=0x7fa3b013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b644b700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 0x7fa3b013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b644b700 1 -- 172.21.15.125:0/2533144892 >> v1:172.21.15.125:6789/0 conn(0x7fa3b00a1380 legacy=0x7fa3b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b644b700 1 -- 172.21.15.125:0/2533144892 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b009e6a0 con 0x7fa3b00a0a70 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b5449700 1 -- 172.21.15.125:0/2533144892 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131796166 0 0) 0x7fa3b009dc00 con 0x7fa3b00a1380 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b6c4c700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 0x7fa3b013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b644b700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b00a0a70 0x7fa3b00a0e40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0098f0 tx=0x7fa3ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4a7e14aa0fa002 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b5449700 1 -- 172.21.15.125:0/2533144892 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011830 con 0x7fa3b00a0a70 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b5449700 1 -- 172.21.15.125:0/2533144892 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac011990 con 0x7fa3b00a0a70 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b5449700 1 -- 172.21.15.125:0/2533144892 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011d20 con 0x7fa3b00a0a70 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 -- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b00a0a70 msgr2=0x7fa3b00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b00a0a70 0x7fa3b00a0e40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0098f0 tx=0x7fa3ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 -- 172.21.15.125:0/2533144892 shutdown_connections 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0134120 0x7fa3b013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 --2- 172.21.15.125:0/2533144892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b00a0a70 0x7fa3b00a0e40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 -- 172.21.15.125:0/2533144892 >> 172.21.15.125:0/2533144892 conn(0x7fa3b00a6610 msgr2=0x7fa3b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.908+0000 7fa3b86af700 1 -- 172.21.15.125:0/2533144892 shutdown_connections 2023-10-03T10:15:01.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.909+0000 7fa3b86af700 1 -- 172.21.15.125:0/2533144892 wait complete. 2023-10-03T10:15:01.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.909+0000 7fa3b86af700 1 Processor -- start 2023-10-03T10:15:01.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.909+0000 7fa3b86af700 1 -- start start 2023-10-03T10:15:01.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3b00a1380 0x7fa3b0122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 0x7fa3b0123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0133300 con 0x7fa3b0134120 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0125920 con 0x7fa3b00a0a70 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b86af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0124310 con 0x7fa3b00a1380 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53492/0 (socket says 172.21.15.125:53492) 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 -- 172.21.15.125:0/1324667639 learned_addr learned my addr 172.21.15.125:0/1324667639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b5c4a700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3b00a1380 0x7fa3b0122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b6c4c700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 0x7fa3b0123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 -- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3b00a1380 msgr2=0x7fa3b0122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3b00a1380 0x7fa3b0122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 -- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 msgr2=0x7fa3b0123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 0x7fa3b0123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 -- 172.21.15.125:0/1324667639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009a70 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b6c4c700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 0x7fa3b0123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.910+0000 7fa3b644b700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009c40 tx=0x7fa3ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac004340 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac01f070 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac009550 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0036a0 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0125c80 con 0x7fa3b00a0a70 2023-10-03T10:15:01.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.911+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3ac021030 con 0x7fa3b00a0a70 2023-10-03T10:15:01.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.912+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa3ac040940 con 0x7fa3b00a0a70 2023-10-03T10:15:01.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.912+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b004f2a0 con 0x7fa3b00a0a70 2023-10-03T10:15:01.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:01.916+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3ac0199a0 con 0x7fa3b00a0a70 2023-10-03T10:15:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.071+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3dc1228a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.071+0000 7fd3c37fe700 1 -- 172.21.15.125:0/158353550 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3dc1228a0 con 0x7fd3dc0a0a70 2023-10-03T10:15:02.072 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:02.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 msgr2=0x7fd3dc11fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000ebe0 tx=0x7fd3d000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 shutdown_connections 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3dc133f70 0x7fd3dc1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc09ad40 0x7fd3dc11f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 --2- 172.21.15.125:0/158353550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3dc0a0a70 0x7fd3dc11fc40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.073+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 >> 172.21.15.125:0/158353550 conn(0x7fd3dc099c40 msgr2=0x7fd3dc1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.074+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 shutdown_connections 2023-10-03T10:15:02.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.074+0000 7fd3e1133700 1 -- 172.21.15.125:0/158353550 wait complete. 2023-10-03T10:15:02.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:02.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.110+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3b0072980 con 0x7fa3b00a0a70 2023-10-03T10:15:02.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.111+0000 7fa3a6ffd700 1 -- 172.21.15.125:0/1324667639 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3ac0193b0 con 0x7fa3b00a0a70 2023-10-03T10:15:02.111 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 msgr2=0x7fa3b0122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009c40 tx=0x7fa3ac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 shutdown_connections 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b0134120 0x7fa3b0123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b00a0a70 0x7fa3b0122700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 --2- 172.21.15.125:0/1324667639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa3b00a1380 0x7fa3b0122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 >> 172.21.15.125:0/1324667639 conn(0x7fa3b00a6610 msgr2=0x7fa3b00a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 shutdown_connections 2023-10-03T10:15:02.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.113+0000 7fa3b86af700 1 -- 172.21.15.125:0/1324667639 wait complete. 2023-10-03T10:15:02.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:02.166 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:02.208 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.293+0000 7f7bdd414700 1 Processor -- start 2023-10-03T10:15:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.293+0000 7f7bdd414700 1 -- start start 2023-10-03T10:15:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 0x7f7bd8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 0x7f7bd8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd809e9d0 con 0x7f7bd80a1380 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd809dc00 con 0x7f7bd80a0a70 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bdd414700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd809dec0 con 0x7f7bd8133f50 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 0x7f7bd8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 0x7f7bd8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53504/0 (socket says 172.21.15.125:53504) 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 -- 172.21.15.125:0/3480078414 learned_addr learned my addr 172.21.15.125:0/3480078414 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 -- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 msgr2=0x7f7bd8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 0x7f7bd8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 -- 172.21.15.125:0/3480078414 >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 msgr2=0x7f7bd8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 --2- 172.21.15.125:0/3480078414 >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 0x7f7bd8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 -- 172.21.15.125:0/3480078414 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd809e6a0 con 0x7f7bd80a0a70 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd77fe700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 0x7f7bd8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd67fc700 1 --2- 172.21.15.125:0/3480078414 >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 0x7f7bd8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd6ffd700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80098f0 tx=0x7f7bc8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755b13b28769c9b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd5ffb700 1 -- 172.21.15.125:0/3480078414 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011830 con 0x7f7bd80a0a70 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd5ffb700 1 -- 172.21.15.125:0/3480078414 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc8011990 con 0x7f7bd80a0a70 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.294+0000 7f7bd5ffb700 1 -- 172.21.15.125:0/3480078414 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011d20 con 0x7f7bd80a0a70 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 -- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 msgr2=0x7f7bd80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80098f0 tx=0x7f7bc8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 -- 172.21.15.125:0/3480078414 shutdown_connections 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd80a0a70 0x7f7bd80a0e40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 --2- 172.21.15.125:0/3480078414 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd8133f50 0x7f7bd8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 --2- 172.21.15.125:0/3480078414 >> v2:172.21.15.125:3300/0 conn(0x7f7bd80a1380 0x7f7bd8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 -- 172.21.15.125:0/3480078414 >> 172.21.15.125:0/3480078414 conn(0x7f7bd80a6610 msgr2=0x7f7bd80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 -- 172.21.15.125:0/3480078414 shutdown_connections 2023-10-03T10:15:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.295+0000 7f7bdd414700 1 -- 172.21.15.125:0/3480078414 wait complete. 2023-10-03T10:15:02.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.296+0000 7f7bdd414700 1 Processor -- start 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 -- start start 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 0x7f7bd81224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 0x7f7bd8122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8125d20 con 0x7f7bd80a0a70 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8126000 con 0x7f7bd8133f50 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bdd414700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80a51f0 con 0x7f7bd80a1380 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bd77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bd77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53514/0 (socket says 172.21.15.125:53514) 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bd77fe700 1 -- 172.21.15.125:0/2882707816 learned_addr learned my addr 172.21.15.125:0/2882707816 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:02.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bd6ffd700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 0x7f7bd81224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.297+0000 7f7bd67fc700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 0x7f7bd8122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 -- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 msgr2=0x7f7bd8122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 0x7f7bd8122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 -- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 msgr2=0x7f7bd81224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 0x7f7bd81224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 -- 172.21.15.125:0/2882707816 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0094a0 con 0x7f7bd8133f50 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd6ffd700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 0x7f7bd81224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd67fc700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 0x7f7bd8122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bd77fe700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000efc0 tx=0x7f7bd000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000ca90 con 0x7f7bd8133f50 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000f040 con 0x7f7bd8133f50 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0009a70 con 0x7f7bd8133f50 2023-10-03T10:15:02.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000ce10 con 0x7f7bd8133f50 2023-10-03T10:15:02.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.298+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc8009550 con 0x7f7bd8133f50 2023-10-03T10:15:02.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.299+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bd0014480 con 0x7f7bd8133f50 2023-10-03T10:15:02.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.299+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7bd003fd80 con 0x7f7bd8133f50 2023-10-03T10:15:02.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.299+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd811f760 con 0x7f7bd8133f50 2023-10-03T10:15:02.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.304+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bd0012930 con 0x7f7bd8133f50 2023-10-03T10:15:02.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 Processor -- start 2023-10-03T10:15:02.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 -- start start 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 0x7fce781343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7809b110 con 0x7fce780a0a70 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce780a3b60 con 0x7fce7809ad40 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce7d56d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce781348e0 con 0x7fce78133f70 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53518/0 (socket says 172.21.15.125:53518) 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce777fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fce780a0a70 0x7fce780a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55760/0 (socket says 172.21.15.125:55760) 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce76ffd700 1 -- 172.21.15.125:0/2156402578 learned_addr learned my addr 172.21.15.125:0/2156402578 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.335+0000 7fce767fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 0x7fce781343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce76ffd700 1 -- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 msgr2=0x7fce781343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce76ffd700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 0x7fce781343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce76ffd700 1 -- 172.21.15.125:0/2156402578 >> v1:172.21.15.125:6789/0 conn(0x7fce780a0a70 legacy=0x7fce780a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce75ffb700 1 -- 172.21.15.125:0/2156402578 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545728565 0 0) 0x7fce7809b110 con 0x7fce780a0a70 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce76ffd700 1 -- 172.21.15.125:0/2156402578 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780a2fa0 con 0x7fce7809ad40 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce767fc700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 0x7fce781343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce76ffd700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fce68009920 tx=0x7fce68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4629307d5e7872 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce75ffb700 1 -- 172.21.15.125:0/2156402578 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011830 con 0x7fce7809ad40 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce75ffb700 1 -- 172.21.15.125:0/2156402578 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68011990 con 0x7fce7809ad40 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.336+0000 7fce75ffb700 1 -- 172.21.15.125:0/2156402578 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011d20 con 0x7fce7809ad40 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 -- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 msgr2=0x7fce78133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fce68009920 tx=0x7fce68009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 -- 172.21.15.125:0/2156402578 shutdown_connections 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce7809ad40 0x7fce78133a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 --2- 172.21.15.125:0/2156402578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce78133f70 0x7fce781343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 -- 172.21.15.125:0/2156402578 >> 172.21.15.125:0/2156402578 conn(0x7fce78099c40 msgr2=0x7fce7806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 -- 172.21.15.125:0/2156402578 shutdown_connections 2023-10-03T10:15:02.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.337+0000 7fce7d56d700 1 -- 172.21.15.125:0/2156402578 wait complete. 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 Processor -- start 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 -- start start 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 0x7fce7811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce78133f70 0x7fce781c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce78122310 con 0x7fce7809ad40 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce781224f0 con 0x7fce78133f70 2023-10-03T10:15:02.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce7d56d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce78133360 con 0x7fce780a0a70 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58582/0 (socket says 172.21.15.125:58582) 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce76ffd700 1 -- 172.21.15.125:0/3503057026 learned_addr learned my addr 172.21.15.125:0/3503057026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce767fc700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 0x7fce7811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce777fe700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce78133f70 0x7fce781c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.338+0000 7fce767fc700 1 -- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce78133f70 msgr2=0x7fce781c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce767fc700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce78133f70 0x7fce781c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce767fc700 1 -- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 msgr2=0x7fce7811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce767fc700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce767fc700 1 -- 172.21.15.125:0/3503057026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0094a0 con 0x7fce780a0a70 2023-10-03T10:15:02.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce76ffd700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce767fc700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 0x7fce7811f9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e980 tx=0x7fce6c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00c690 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00c7f0 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00cb80 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce68009550 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.339+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7809e680 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.340+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce6c00cce0 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.340+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7804f2a0 con 0x7fce780a0a70 2023-10-03T10:15:02.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.340+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce6c03fa20 con 0x7fce780a0a70 2023-10-03T10:15:02.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.344+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce6c01b3b0 con 0x7fce780a0a70 2023-10-03T10:15:02.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.503+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7bd8124f70 con 0x7f7bd8133f50 2023-10-03T10:15:02.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.503+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/2882707816 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bd002b090 con 0x7f7bd8133f50 2023-10-03T10:15:02.504 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:02.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 msgr2=0x7f7bd8122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000efc0 tx=0x7f7bd000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 shutdown_connections 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7bd8133f50 0x7f7bd8122f60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bd80a0a70 0x7f7bd81224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 --2- 172.21.15.125:0/2882707816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7bd80a1380 0x7f7bd8122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.505+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 >> 172.21.15.125:0/2882707816 conn(0x7f7bd80a6610 msgr2=0x7f7bd811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.506+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 shutdown_connections 2023-10-03T10:15:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.506+0000 7f7bdd414700 1 -- 172.21.15.125:0/2882707816 wait complete. 2023-10-03T10:15:02.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:02.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.540+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce78122170 con 0x7fce780a0a70 2023-10-03T10:15:02.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.540+0000 7fce5f7fe700 1 -- 172.21.15.125:0/3503057026 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce78122170 con 0x7fce780a0a70 2023-10-03T10:15:02.541 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 msgr2=0x7fce7811f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 0x7fce7811f9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e980 tx=0x7fce6c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 shutdown_connections 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce78133f70 0x7fce781c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce7809ad40 0x7fce7811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 --2- 172.21.15.125:0/3503057026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce780a0a70 0x7fce7811f9c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 >> 172.21.15.125:0/3503057026 conn(0x7fce78099c40 msgr2=0x7fce781bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 shutdown_connections 2023-10-03T10:15:02.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:02.542+0000 7fce7d56d700 1 -- 172.21.15.125:0/3503057026 wait complete. 2023-10-03T10:15:02.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:03.087 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:03.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.217+0000 7f6d2a1c2700 1 Processor -- start 2023-10-03T10:15:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 -- start start 2023-10-03T10:15:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d24133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 0x7f6d241343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2409b110 con 0x7f6d240a0a70 2023-10-03T10:15:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240a3b60 con 0x7f6d2409ad40 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d2a1c2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241348e0 con 0x7f6d24133f70 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 0x7f6d241343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d23fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6d240a0a70 0x7f6d240a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55766/0 (socket says 172.21.15.125:55766) 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d23fff700 1 -- 172.21.15.125:0/1921775629 learned_addr learned my addr 172.21.15.125:0/1921775629 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d237fe700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d24133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d22ffd700 1 -- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 msgr2=0x7f6d24133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d22ffd700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d24133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.218+0000 7f6d227fc700 1 -- 172.21.15.125:0/1921775629 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677600531 0 0) 0x7f6d2409b110 con 0x7f6d240a0a70 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d22ffd700 1 -- 172.21.15.125:0/1921775629 >> v1:172.21.15.125:6789/0 conn(0x7f6d240a0a70 legacy=0x7f6d240a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d22ffd700 1 -- 172.21.15.125:0/1921775629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240a2fa0 con 0x7f6d24133f70 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d22ffd700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 0x7f6d241343a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d757e07a375ecc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d227fc700 1 -- 172.21.15.125:0/1921775629 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18011830 con 0x7f6d24133f70 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d227fc700 1 -- 172.21.15.125:0/1921775629 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d18011990 con 0x7f6d24133f70 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d227fc700 1 -- 172.21.15.125:0/1921775629 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18011d20 con 0x7f6d24133f70 2023-10-03T10:15:03.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 msgr2=0x7f6d241343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 0x7f6d241343a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d18009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/1921775629 shutdown_connections 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d24133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/1921775629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d24133f70 0x7f6d241343a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.219+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/1921775629 >> 172.21.15.125:0/1921775629 conn(0x7f6d24099c40 msgr2=0x7f6d2406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.220+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/1921775629 shutdown_connections 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.220+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/1921775629 wait complete. 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.220+0000 7f6d2a1c2700 1 Processor -- start 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 -- start start 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d241213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d24133f70 0x7f6d24121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241327a0 con 0x7f6d24133f70 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24122830 con 0x7f6d2409ad40 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d2a1c2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24123e70 con 0x7f6d240a0a70 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d24133f70 0x7f6d24121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58982/0 (socket says 172.21.15.125:58982) 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d22ffd700 1 -- 172.21.15.125:0/3872934602 learned_addr learned my addr 172.21.15.125:0/3872934602 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.221+0000 7f6d237fe700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d241213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 -- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 msgr2=0x7f6d241213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d241213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 -- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d24133f70 msgr2=0x7f6d24121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d24133f70 0x7f6d24121e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 -- 172.21.15.125:0/3872934602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180094a0 con 0x7f6d240a0a70 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d22ffd700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009840 tx=0x7f6d18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18004510 con 0x7f6d240a0a70 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d180036a0 con 0x7f6d240a0a70 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18003a50 con 0x7f6d240a0a70 2023-10-03T10:15:03.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d24124950 con 0x7f6d240a0a70 2023-10-03T10:15:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.222+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d24124c70 con 0x7f6d240a0a70 2023-10-03T10:15:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.223+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d18003bb0 con 0x7f6d240a0a70 2023-10-03T10:15:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.223+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d18040960 con 0x7f6d240a0a70 2023-10-03T10:15:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.223+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d24124ae0 con 0x7f6d240a0a70 2023-10-03T10:15:03.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.228+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d18015020 con 0x7f6d240a0a70 2023-10-03T10:15:03.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 Processor -- start 2023-10-03T10:15:03.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 -- start start 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f7809ad40 0x7f5f78133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 0x7f5f780a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7809b110 con 0x7f5f78133f70 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780a3b60 con 0x7f5f7809ad40 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.258+0000 7f5f80222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78134850 con 0x7f5f781343d0 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f7809ad40 0x7f5f78133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7e7bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 0x7f5f780a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7d7bd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f78133f70 0x7f5f780a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55778/0 (socket says 172.21.15.125:55778) 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7d7bd700 1 -- 172.21.15.125:0/2148969799 learned_addr learned my addr 172.21.15.125:0/2148969799 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 -- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 msgr2=0x7f5f780a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 0x7f5f780a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 -- 172.21.15.125:0/2148969799 >> v1:172.21.15.125:6789/0 conn(0x7f5f78133f70 legacy=0x7f5f780a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 -- 172.21.15.125:0/2148969799 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780a2fa0 con 0x7f5f7809ad40 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7e7bf700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 0x7f5f780a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7cfbc700 1 -- 172.21.15.125:0/2148969799 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285376082 0 0) 0x7f5f7809b110 con 0x7f5f78133f70 2023-10-03T10:15:03.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7dfbe700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f7809ad40 0x7f5f78133a30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009840 tx=0x7f5f74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6a39a5c83706f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7cfbc700 1 -- 172.21.15.125:0/2148969799 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011830 con 0x7f5f7809ad40 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7cfbc700 1 -- 172.21.15.125:0/2148969799 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74011990 con 0x7f5f7809ad40 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.259+0000 7f5f7cfbc700 1 -- 172.21.15.125:0/2148969799 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011d20 con 0x7f5f7809ad40 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 -- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f7809ad40 msgr2=0x7f5f78133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f7809ad40 0x7f5f78133a30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009840 tx=0x7f5f74009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 -- 172.21.15.125:0/2148969799 shutdown_connections 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f781343d0 0x7f5f780a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 --2- 172.21.15.125:0/2148969799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f7809ad40 0x7f5f78133a30 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 -- 172.21.15.125:0/2148969799 >> 172.21.15.125:0/2148969799 conn(0x7f5f78099c40 msgr2=0x7f5f7806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 -- 172.21.15.125:0/2148969799 shutdown_connections 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.260+0000 7f5f80222700 1 -- 172.21.15.125:0/2148969799 wait complete. 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 Processor -- start 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 -- start start 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 0x7f5f7811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f781343d0 0x7f5f781c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7811f140 con 0x7f5f78133f70 2023-10-03T10:15:03.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78133790 con 0x7f5f781343d0 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f80222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78133550 con 0x7f5f7809ad40 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f7d7bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f7dfbe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 0x7f5f7811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f7d7bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58606/0 (socket says 172.21.15.125:58606) 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f7d7bd700 1 -- 172.21.15.125:0/105510703 learned_addr learned my addr 172.21.15.125:0/105510703 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.261+0000 7f5f7e7bf700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f781343d0 0x7f5f781c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 -- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 msgr2=0x7f5f7811f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 0x7f5f7811f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 -- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f781343d0 msgr2=0x7f5f781c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f781343d0 0x7f5f781c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 -- 172.21.15.125:0/105510703 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009a70 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7dfbe700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 0x7f5f7811f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f7d7bd700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c520 tx=0x7f5f6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68004c80 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68004e00 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f740094a0 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68007310 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.262+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f781207d0 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.263+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f68007470 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.263+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f6803f240 con 0x7f5f78133f70 2023-10-03T10:15:03.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.263+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7804f2a0 con 0x7f5f78133f70 2023-10-03T10:15:03.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.268+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f680123b0 con 0x7f5f78133f70 2023-10-03T10:15:03.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.421+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d2411e060 con 0x7f6d240a0a70 2023-10-03T10:15:03.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.421+0000 7f6d0bfff700 1 -- 172.21.15.125:0/3872934602 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d1802e970 con 0x7f6d240a0a70 2023-10-03T10:15:03.423 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:03.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 msgr2=0x7f6d24121910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009840 tx=0x7f6d18004750 comp rx=0 tx=0).stop 2023-10-03T10:15:03.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 shutdown_connections 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d24133f70 0x7f6d24121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d2409ad40 0x7f6d241213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 --2- 172.21.15.125:0/3872934602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d240a0a70 0x7f6d24121910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 >> 172.21.15.125:0/3872934602 conn(0x7f6d24099c40 msgr2=0x7f6d241332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 shutdown_connections 2023-10-03T10:15:03.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.423+0000 7f6d2a1c2700 1 -- 172.21.15.125:0/3872934602 wait complete. 2023-10-03T10:15:03.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:03.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.459+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f78120d50 con 0x7f5f78133f70 2023-10-03T10:15:03.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.459+0000 7f5f6e7fc700 1 -- 172.21.15.125:0/105510703 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f68011360 con 0x7f5f78133f70 2023-10-03T10:15:03.460 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 msgr2=0x7f5f7811fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c520 tx=0x7f5f6800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 shutdown_connections 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f781343d0 0x7f5f781c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f7809ad40 0x7f5f7811f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 --2- 172.21.15.125:0/105510703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f78133f70 0x7f5f7811fa30 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 >> 172.21.15.125:0/105510703 conn(0x7f5f78099c40 msgr2=0x7f5f780a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 shutdown_connections 2023-10-03T10:15:03.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.461+0000 7f5f80222700 1 -- 172.21.15.125:0/105510703 wait complete. 2023-10-03T10:15:03.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:03.519 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:03.556 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.647+0000 7ff56abb9700 1 Processor -- start 2023-10-03T10:15:03.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 -- start start 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff56409e340 0x7ff5641359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff564138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56409aaa0 con 0x7ff56409d860 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56409e730 con 0x7ff56409e340 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff56abb9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56409f870 con 0x7ff564135f20 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff56409e340 0x7ff5641359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff56409e340 0x7ff5641359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58616/0 (socket says 172.21.15.125:58616) 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 -- 172.21.15.125:0/1488144433 learned_addr learned my addr 172.21.15.125:0/1488144433 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff569156700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff564138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 -- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 msgr2=0x7ff564138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff564138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 -- 172.21.15.125:0/1488144433 >> v1:172.21.15.125:6789/0 conn(0x7ff56409d860 legacy=0x7ff56409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff563fff700 1 -- 172.21.15.125:0/1488144433 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56409b360 con 0x7ff56409e340 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.648+0000 7ff5637fe700 1 -- 172.21.15.125:0/1488144433 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082023113 0 0) 0x7ff56409aaa0 con 0x7ff56409d860 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff563fff700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff5641359e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff5500098f0 tx=0x7ff550009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1f08e2ae857989 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff5637fe700 1 -- 172.21.15.125:0/1488144433 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550011830 con 0x7ff56409e340 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff5637fe700 1 -- 172.21.15.125:0/1488144433 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550011990 con 0x7ff56409e340 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff5637fe700 1 -- 172.21.15.125:0/1488144433 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550011d20 con 0x7ff56409e340 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 -- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 msgr2=0x7ff5641359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff5641359e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff5500098f0 tx=0x7ff550009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 -- 172.21.15.125:0/1488144433 shutdown_connections 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff564138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 --2- 172.21.15.125:0/1488144433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff5641359e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 -- 172.21.15.125:0/1488144433 >> 172.21.15.125:0/1488144433 conn(0x7ff564099c40 msgr2=0x7ff5640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 -- 172.21.15.125:0/1488144433 shutdown_connections 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.649+0000 7ff56abb9700 1 -- 172.21.15.125:0/1488144433 wait complete. 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.651+0000 7ff56abb9700 1 Processor -- start 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.651+0000 7ff56abb9700 1 -- start start 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.651+0000 7ff56abb9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff56409d860 0x7ff56411d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff56411db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564131f60 con 0x7ff56409e340 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff564120e80 con 0x7ff564135f20 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff564121080 con 0x7ff56409d860 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff568955700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff56409d860 0x7ff56411d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff563fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff56411db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53554/0 (socket says 172.21.15.125:53554) 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 -- 172.21.15.125:0/2606308175 learned_addr learned my addr 172.21.15.125:0/2606308175 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 -- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff56409d860 msgr2=0x7ff56411d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff56409d860 0x7ff56411d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 -- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 msgr2=0x7ff56411db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff56411db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 -- 172.21.15.125:0/2606308175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550009550 con 0x7ff564135f20 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff563fff700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff56411db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff569156700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00efc0 tx=0x7ff55c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cc90 con 0x7ff564135f20 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00f040 con 0x7ff564135f20 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c014480 con 0x7ff564135f20 2023-10-03T10:15:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56411f160 con 0x7ff564135f20 2023-10-03T10:15:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.652+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5641320c0 con 0x7ff564135f20 2023-10-03T10:15:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.653+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff55c014600 con 0x7ff564135f20 2023-10-03T10:15:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.653+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56411f100 con 0x7ff564135f20 2023-10-03T10:15:03.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.653+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff55c03fe90 con 0x7ff564135f20 2023-10-03T10:15:03.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.658+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff55c018030 con 0x7ff564135f20 2023-10-03T10:15:03.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.689+0000 7f88eaef8700 1 Processor -- start 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.689+0000 7f88eaef8700 1 -- start start 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 0x7f88e41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e409e9d0 con 0x7f88e4133f50 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e409dc00 con 0x7f88e40a0a70 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88eaef8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e409dec0 con 0x7f88e40a1380 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e8c94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e8c94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53556/0 (socket says 172.21.15.125:53556) 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59024/0 (socket says 172.21.15.125:59024) 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e8c94700 1 -- 172.21.15.125:0/2674950818 learned_addr learned my addr 172.21.15.125:0/2674950818 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e9495700 1 --2- 172.21.15.125:0/2674950818 >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 0x7f88e41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 -- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 msgr2=0x7f88e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 -- 172.21.15.125:0/2674950818 >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 msgr2=0x7f88e41343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 --2- 172.21.15.125:0/2674950818 >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 0x7f88e41343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 -- 172.21.15.125:0/2674950818 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e409e6a0 con 0x7f88e40a1380 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e8c94700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e9495700 1 --2- 172.21.15.125:0/2674950818 >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 0x7f88e41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e3fff700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009840 tx=0x7f88d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fdd76e449dd16f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e37fe700 1 -- 172.21.15.125:0/2674950818 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0011830 con 0x7f88e40a1380 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.690+0000 7f88e37fe700 1 -- 172.21.15.125:0/2674950818 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0011990 con 0x7f88e40a1380 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88e37fe700 1 -- 172.21.15.125:0/2674950818 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0011d20 con 0x7f88e40a1380 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 -- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 msgr2=0x7f88e4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009840 tx=0x7f88d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 -- 172.21.15.125:0/2674950818 shutdown_connections 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a0a70 0x7f88e40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2674950818 >> v2:172.21.15.125:3300/0 conn(0x7f88e4133f50 0x7f88e41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2674950818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e40a1380 0x7f88e4133a10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 -- 172.21.15.125:0/2674950818 >> 172.21.15.125:0/2674950818 conn(0x7f88e40a6610 msgr2=0x7f88e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 -- 172.21.15.125:0/2674950818 shutdown_connections 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.691+0000 7f88eaef8700 1 -- 172.21.15.125:0/2674950818 wait complete. 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.692+0000 7f88eaef8700 1 Processor -- start 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.692+0000 7f88eaef8700 1 -- start start 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a1380 0x7f88e411fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40a5080 con 0x7f88e40a0a70 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41223c0 con 0x7f88e40a1380 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88eaef8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41228e0 con 0x7f88e4133f50 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e8c94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e9495700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e8c94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58632/0 (socket says 172.21.15.125:58632) 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e9495700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59040/0 (socket says 172.21.15.125:59040) 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e8c94700 1 -- 172.21.15.125:0/2484908636 learned_addr learned my addr 172.21.15.125:0/2484908636 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.693+0000 7f88e3fff700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a1380 0x7f88e411fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 -- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 msgr2=0x7f88e41c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 -- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a1380 msgr2=0x7f88e411fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a1380 0x7f88e411fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 -- 172.21.15.125:0/2484908636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009550 con 0x7f88e40a0a70 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e9495700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e8c94700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ebe0 tx=0x7f88d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8004030 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8004190 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc009a70 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8004520 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.694+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d00094a0 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.695+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e404f2a0 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.695+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88d800c7f0 con 0x7f88e40a0a70 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.695+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88d803f500 con 0x7f88e40a0a70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.700+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88d80036a0 con 0x7f88e40a0a70 2023-10-03T10:15:03.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.854+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff56404f2a0 con 0x7ff564135f20 2023-10-03T10:15:03.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.855+0000 7ff5617fa700 1 -- 172.21.15.125:0/2606308175 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff55c0133e0 con 0x7ff564135f20 2023-10-03T10:15:03.855 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 msgr2=0x7ff56411e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00efc0 tx=0x7ff55c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 shutdown_connections 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff564135f20 0x7ff56411e060 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff56409d860 0x7ff56411d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 --2- 172.21.15.125:0/2606308175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff56409e340 0x7ff56411db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 >> 172.21.15.125:0/2606308175 conn(0x7ff564099c40 msgr2=0x7ff5640710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 shutdown_connections 2023-10-03T10:15:03.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.857+0000 7ff56abb9700 1 -- 172.21.15.125:0/2606308175 wait complete. 2023-10-03T10:15:03.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:03.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.892+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88e4120ce0 con 0x7f88e40a0a70 2023-10-03T10:15:03.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.892+0000 7f88e17fa700 1 -- 172.21.15.125:0/2484908636 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88d8019ab0 con 0x7f88e40a0a70 2023-10-03T10:15:03.893 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 msgr2=0x7f88e411f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ebe0 tx=0x7f88d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 shutdown_connections 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f88e4133f50 0x7f88e41c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e40a0a70 0x7f88e411f5e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 --2- 172.21.15.125:0/2484908636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e40a1380 0x7f88e411fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 >> 172.21.15.125:0/2484908636 conn(0x7f88e40a6610 msgr2=0x7f88e41bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 shutdown_connections 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:03.894+0000 7f88eaef8700 1 -- 172.21.15.125:0/2484908636 wait complete. 2023-10-03T10:15:03.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:04.437 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:04.474 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:04.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 Processor -- start 2023-10-03T10:15:04.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 -- start start 2023-10-03T10:15:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 0x7effd4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd40a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd40a3b60 con 0x7effd409ad40 2023-10-03T10:15:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd41348e0 con 0x7effd4133f70 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd9a2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd409b110 con 0x7effd40a0a70 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 0x7effd4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 0x7effd4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58648/0 (socket says 172.21.15.125:58648) 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53586/0 (socket says 172.21.15.125:53586) 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd2ffd700 1 -- 172.21.15.125:0/2092719255 learned_addr learned my addr 172.21.15.125:0/2092719255 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.564+0000 7effd37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd40a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 -- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 msgr2=0x7effd40a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd40a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 -- 172.21.15.125:0/2092719255 >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 msgr2=0x7effd4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 --2- 172.21.15.125:0/2092719255 >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 0x7effd4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 -- 172.21.15.125:0/2092719255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40a2fa0 con 0x7effd4133f70 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd37fe700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd40a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd27fc700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7effc8009840 tx=0x7effc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bfeb15dac632003 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd1ffb700 1 -- 172.21.15.125:0/2092719255 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8011830 con 0x7effd4133f70 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd1ffb700 1 -- 172.21.15.125:0/2092719255 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8011990 con 0x7effd4133f70 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.565+0000 7effd1ffb700 1 -- 172.21.15.125:0/2092719255 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8011d20 con 0x7effd4133f70 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 -- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 msgr2=0x7effd41343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7effc8009840 tx=0x7effc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 -- 172.21.15.125:0/2092719255 shutdown_connections 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd40a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 --2- 172.21.15.125:0/2092719255 >> v2:172.21.15.125:3300/0 conn(0x7effd409ad40 0x7effd4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 --2- 172.21.15.125:0/2092719255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd4133f70 0x7effd41343a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 -- 172.21.15.125:0/2092719255 >> 172.21.15.125:0/2092719255 conn(0x7effd4099c40 msgr2=0x7effd406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 -- 172.21.15.125:0/2092719255 shutdown_connections 2023-10-03T10:15:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.566+0000 7effd9a2c700 1 -- 172.21.15.125:0/2092719255 wait complete. 2023-10-03T10:15:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 Processor -- start 2023-10-03T10:15:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 -- start start 2023-10-03T10:15:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd41c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 0x7effd41c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4122330 con 0x7effd4133f70 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd4133aa0 con 0x7effd409ad40 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd9a2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd4133800 con 0x7effd40a0a70 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 0x7effd41c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.567+0000 7effd2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 0x7effd41c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58652/0 (socket says 172.21.15.125:58652) 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd37fe700 1 -- 172.21.15.125:0/3015910941 learned_addr learned my addr 172.21.15.125:0/3015910941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53592/0 (socket says 172.21.15.125:53592) 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd27fc700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd41c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 -- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 msgr2=0x7effd41c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd41c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 -- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 msgr2=0x7effd41c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 0x7effd41c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 -- 172.21.15.125:0/3015910941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc009a70 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd27fc700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd41c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd2ffd700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7effc400e840 tx=0x7effc400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4013680 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc40137e0 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4013b90 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80094a0 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.568+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd409c7e0 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.569+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effc4013cf0 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.569+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effc403f4c0 con 0x7effd409ad40 2023-10-03T10:15:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.569+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4122e60 con 0x7effd409ad40 2023-10-03T10:15:04.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.574+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effc401bdf0 con 0x7effd409ad40 2023-10-03T10:15:04.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 Processor -- start 2023-10-03T10:15:04.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 -- start start 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec09dc00 con 0x7fa5ec133f50 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec09ea60 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f243c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec09dec0 con 0x7fa5ec0a1380 2023-10-03T10:15:04.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5ebfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5ebfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58656/0 (socket says 172.21.15.125:58656) 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5f09d9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa5ec133f50 0x7fa5ec13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55798/0 (socket says 172.21.15.125:55798) 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53598/0 (socket says 172.21.15.125:53598) 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.604+0000 7fa5ebfff700 1 -- 172.21.15.125:0/1984230831 learned_addr learned my addr 172.21.15.125:0/1984230831 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5ebfff700 1 -- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 msgr2=0x7fa5ec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5ebfff700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5ebfff700 1 -- 172.21.15.125:0/1984230831 >> v1:172.21.15.125:6789/0 conn(0x7fa5ec133f50 legacy=0x7fa5ec13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5ebfff700 1 -- 172.21.15.125:0/1984230831 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec09e6a0 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5eaffd700 1 -- 172.21.15.125:0/1984230831 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152646502 0 0) 0x7fa5ec09dc00 con 0x7fa5ec133f50 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5eb7fe700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5ebfff700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098f0 tx=0x7fa5dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaa3d2b9285bdbc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5eaffd700 1 -- 172.21.15.125:0/1984230831 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011830 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5eaffd700 1 -- 172.21.15.125:0/1984230831 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc011990 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.605+0000 7fa5eaffd700 1 -- 172.21.15.125:0/1984230831 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011d20 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 -- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a0a70 msgr2=0x7fa5ec0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098f0 tx=0x7fa5dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 -- 172.21.15.125:0/1984230831 shutdown_connections 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a0a70 0x7fa5ec0a0e40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 --2- 172.21.15.125:0/1984230831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec0a1380 0x7fa5ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 -- 172.21.15.125:0/1984230831 >> 172.21.15.125:0/1984230831 conn(0x7fa5ec0a6610 msgr2=0x7fa5ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 -- 172.21.15.125:0/1984230831 shutdown_connections 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.606+0000 7fa5f243c700 1 -- 172.21.15.125:0/1984230831 wait complete. 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.607+0000 7fa5f243c700 1 Processor -- start 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.607+0000 7fa5f243c700 1 -- start start 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5ec0a0a70 0x7fa5ec122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 0x7fa5ec1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec133ad0 con 0x7fa5ec0a1380 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec125de0 con 0x7fa5ec133f50 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec124510 con 0x7fa5ec0a0a70 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58672/0 (socket says 172.21.15.125:58672) 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f09d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 0x7fa5ec1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 -- 172.21.15.125:0/3985435202 learned_addr learned my addr 172.21.15.125:0/3985435202 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 -- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5ec0a0a70 msgr2=0x7fa5ec122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5ec0a0a70 0x7fa5ec122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 -- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 msgr2=0x7fa5ec1232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 0x7fa5ec1232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 -- 172.21.15.125:0/3985435202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00094a0 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f09d9700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 0x7fa5ec1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5eb7fe700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ebe0 tx=0x7fa5e000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0009800 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000c910 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000cc80 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.608+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc009550 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.609+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec133380 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.609+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5e0013470 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.609+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec04f2a0 con 0x7fa5ec0a1380 2023-10-03T10:15:04.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.609+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5e003f810 con 0x7fa5ec0a1380 2023-10-03T10:15:04.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.614+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5e0013720 con 0x7fa5ec0a1380 2023-10-03T10:15:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.767+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effd4122570 con 0x7effd409ad40 2023-10-03T10:15:04.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.767+0000 7effbbfff700 1 -- 172.21.15.125:0/3015910941 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc401b3b0 con 0x7effd409ad40 2023-10-03T10:15:04.768 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 msgr2=0x7effd41c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7effc400e840 tx=0x7effc400eb50 comp rx=0 tx=0).stop 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 shutdown_connections 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd4133f70 0x7effd41c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd409ad40 0x7effd41c8300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 --2- 172.21.15.125:0/3015910941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd40a0a70 0x7effd41c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 >> 172.21.15.125:0/3015910941 conn(0x7effd4099c40 msgr2=0x7effd409e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 shutdown_connections 2023-10-03T10:15:04.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.769+0000 7effd9a2c700 1 -- 172.21.15.125:0/3015910941 wait complete. 2023-10-03T10:15:04.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:04.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.805+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5ec1263e0 con 0x7fa5ec0a1380 2023-10-03T10:15:04.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.805+0000 7fa5e8ff9700 1 -- 172.21.15.125:0/3985435202 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5e0021030 con 0x7fa5ec0a1380 2023-10-03T10:15:04.806 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:04.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 msgr2=0x7fa5ec122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ebe0 tx=0x7fa5e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 shutdown_connections 2023-10-03T10:15:04.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5ec133f50 0x7fa5ec1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5ec0a0a70 0x7fa5ec122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 --2- 172.21.15.125:0/3985435202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5ec0a1380 0x7fa5ec122da0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 >> 172.21.15.125:0/3985435202 conn(0x7fa5ec0a6610 msgr2=0x7fa5ec09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.807+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 shutdown_connections 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.808+0000 7fa5f243c700 1 -- 172.21.15.125:0/3985435202 wait complete. 2023-10-03T10:15:04.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:04.870 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:04.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:04.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 Processor -- start 2023-10-03T10:15:04.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 -- start start 2023-10-03T10:15:05.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833409c970 con 0x7f833409f180 2023-10-03T10:15:05.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340a0920 con 0x7f8334131f40 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f833937b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f833409f9c0 con 0x7f833409e870 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f8332ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f83337fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f8332ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59082/0 (socket says 172.21.15.125:59082) 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.997+0000 7f8332ffd700 1 -- 172.21.15.125:0/3430637836 learned_addr learned my addr 172.21.15.125:0/3430637836 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f83337fe700 1 -- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 msgr2=0x7f833409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f83337fe700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f83337fe700 1 -- 172.21.15.125:0/3430637836 >> v1:172.21.15.125:6789/0 conn(0x7f833409f180 legacy=0x7f8334131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f8331ffb700 1 -- 172.21.15.125:0/3430637836 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165316880 0 0) 0x7f833409c970 con 0x7f833409f180 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f83337fe700 1 -- 172.21.15.125:0/3430637836 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833409bab0 con 0x7f8334131f40 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f8332ffd700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f83337fe700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334139ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f832c009dc0 tx=0x7f832c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6fc33d2736f81e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f8331ffb700 1 -- 172.21.15.125:0/3430637836 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00e070 con 0x7f8334131f40 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f8331ffb700 1 -- 172.21.15.125:0/3430637836 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c00bb20 con 0x7f8334131f40 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.998+0000 7f8331ffb700 1 -- 172.21.15.125:0/3430637836 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c012430 con 0x7f8334131f40 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 -- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 msgr2=0x7f8334139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334139ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f832c009dc0 tx=0x7f832c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 -- 172.21.15.125:0/3430637836 shutdown_connections 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334139ca0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 --2- 172.21.15.125:0/3430637836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409e870 0x7f833409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 -- 172.21.15.125:0/3430637836 >> 172.21.15.125:0/3430637836 conn(0x7f83340a4430 msgr2=0x7f83340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 -- 172.21.15.125:0/3430637836 shutdown_connections 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:04.999+0000 7f833937b700 1 -- 172.21.15.125:0/3430637836 wait complete. 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 Processor -- start 2023-10-03T10:15:05.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 -- start start 2023-10-03T10:15:05.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409f180 0x7f8334120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334122e20 con 0x7f833409e870 2023-10-03T10:15:05.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8334121d50 con 0x7f8334131f40 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f833937b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8334122a60 con 0x7f833409f180 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f8332ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f83337fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f8332ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58684/0 (socket says 172.21.15.125:58684) 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f8332ffd700 1 -- 172.21.15.125:0/297288188 learned_addr learned my addr 172.21.15.125:0/297288188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.000+0000 7f83327fc700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409f180 0x7f8334120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 -- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409f180 msgr2=0x7f8334120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409f180 0x7f8334120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 -- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 msgr2=0x7f833411ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 -- 172.21.15.125:0/297288188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009550 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f8332ffd700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f83337fe700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334120a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f832c016000 tx=0x7f832c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c004840 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c020070 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c009a70 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0276c0 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.001+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8334123540 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.002+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f832c027820 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.002+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f832c022070 con 0x7f8334131f40 2023-10-03T10:15:05.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.002+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833404f2a0 con 0x7f8334131f40 2023-10-03T10:15:05.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.007+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f832c0127b0 con 0x7f8334131f40 2023-10-03T10:15:05.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.039+0000 7f6233781700 1 Processor -- start 2023-10-03T10:15:05.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.039+0000 7f6233781700 1 -- start start 2023-10-03T10:15:05.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6233781700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6233781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6233781700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c09dc00 con 0x7f622c133f50 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6233781700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c09ea60 con 0x7f622c0a0a70 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6233781700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f622c09dec0 con 0x7f622c0a1380 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6230d1c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6230d1c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59108/0 (socket says 172.21.15.125:59108) 2023-10-03T10:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6231d1e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f622c133f50 0x7f622c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55814/0 (socket says 172.21.15.125:55814) 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53632/0 (socket says 172.21.15.125:53632) 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6230d1c700 1 -- 172.21.15.125:0/1066796909 learned_addr learned my addr 172.21.15.125:0/1066796909 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 -- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 msgr2=0x7f622c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 --2- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 -- 172.21.15.125:0/1066796909 >> v1:172.21.15.125:6789/0 conn(0x7f622c133f50 legacy=0x7f622c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f6223fff700 1 -- 172.21.15.125:0/1066796909 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318579606 0 0) 0x7f622c09dc00 con 0x7f622c133f50 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.040+0000 7f623151d700 1 -- 172.21.15.125:0/1066796909 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c09e6a0 con 0x7f622c0a0a70 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f623151d700 1 --2- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6228009870 tx=0x7f6228009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a11b14f16d90a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6223fff700 1 -- 172.21.15.125:0/1066796909 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228011830 con 0x7f622c0a0a70 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6223fff700 1 -- 172.21.15.125:0/1066796909 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228011990 con 0x7f622c0a0a70 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6223fff700 1 -- 172.21.15.125:0/1066796909 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228011d20 con 0x7f622c0a0a70 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 -- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 msgr2=0x7f622c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 --2- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6228009870 tx=0x7f6228009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 -- 172.21.15.125:0/1066796909 shutdown_connections 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 --2- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c0a0a70 0x7f622c0a0e40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 --2- 172.21.15.125:0/1066796909 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 -- 172.21.15.125:0/1066796909 >> 172.21.15.125:0/1066796909 conn(0x7f622c0a6610 msgr2=0x7f622c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 -- 172.21.15.125:0/1066796909 shutdown_connections 2023-10-03T10:15:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.041+0000 7f6233781700 1 -- 172.21.15.125:0/1066796909 wait complete. 2023-10-03T10:15:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.042+0000 7f6233781700 1 Processor -- start 2023-10-03T10:15:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.042+0000 7f6233781700 1 -- start start 2023-10-03T10:15:05.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 0x7f622c1233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c124630 con 0x7f622c0a0a70 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c1252a0 con 0x7f622c133f50 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6233781700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0a03e0 con 0x7f622c0a1380 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6231d1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6231d1e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53648/0 (socket says 172.21.15.125:53648) 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6231d1e700 1 -- 172.21.15.125:0/3453107782 learned_addr learned my addr 172.21.15.125:0/3453107782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 0x7f622c1233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6230d1c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 -- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 msgr2=0x7f622c123910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c123910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 -- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 msgr2=0x7f622c1c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 -- 172.21.15.125:0/3453107782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280094a0 con 0x7f622c0a0a70 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6231d1e700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f623151d700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 0x7f622c1233d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6228016000 tx=0x7f6228004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.043+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228004510 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.044+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622801f070 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.044+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c124ba0 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.044+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280038e0 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.044+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c126cd0 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.044+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6228003a40 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.045+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6228021070 con 0x7f622c0a0a70 2023-10-03T10:15:05.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.045+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c04f2a0 con 0x7f622c0a0a70 2023-10-03T10:15:05.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.049+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f622802b070 con 0x7f622c0a0a70 2023-10-03T10:15:05.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.202+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f833406b2a0 con 0x7f8334131f40 2023-10-03T10:15:05.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.203+0000 7f831b7fe700 1 -- 172.21.15.125:0/297288188 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f832c035020 con 0x7f8334131f40 2023-10-03T10:15:05.204 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:05.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 msgr2=0x7f8334120a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334120a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f832c016000 tx=0x7f832c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 shutdown_connections 2023-10-03T10:15:05.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8334131f40 0x7f8334120a40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f833409e870 0x7f833411ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 --2- 172.21.15.125:0/297288188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f833409f180 0x7f8334120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 >> 172.21.15.125:0/297288188 conn(0x7f83340a4430 msgr2=0x7f833409d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 shutdown_connections 2023-10-03T10:15:05.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.205+0000 7f833937b700 1 -- 172.21.15.125:0/297288188 wait complete. 2023-10-03T10:15:05.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.247+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f622c09c680 con 0x7f622c0a0a70 2023-10-03T10:15:05.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.247+0000 7f6221ffb700 1 -- 172.21.15.125:0/3453107782 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6228015030 con 0x7f622c0a0a70 2023-10-03T10:15:05.247 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 msgr2=0x7f622c1233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 0x7f622c1233d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6228016000 tx=0x7f6228004750 comp rx=0 tx=0).stop 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 shutdown_connections 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c133f50 0x7f622c1c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c0a0a70 0x7f622c1233d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 --2- 172.21.15.125:0/3453107782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f622c0a1380 0x7f622c123910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 >> 172.21.15.125:0/3453107782 conn(0x7f622c0a6610 msgr2=0x7f622c0a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 shutdown_connections 2023-10-03T10:15:05.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.249+0000 7f6233781700 1 -- 172.21.15.125:0/3453107782 wait complete. 2023-10-03T10:15:05.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:05.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:05.821 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:05.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.908+0000 7fa55797e700 1 Processor -- start 2023-10-03T10:15:05.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.908+0000 7fa55797e700 1 -- start start 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55797e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55797e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55797e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55009dc00 con 0x7fa5500a1380 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55797e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55009ea90 con 0x7fa5500a0a70 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55797e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55009dec0 con 0x7fa550134120 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55571a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55571a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35538/0 (socket says 172.21.15.125:35538) 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa554f19700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa5500a1380 0x7fa550133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34180/0 (socket says 172.21.15.125:34180) 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:45874/0 (socket says 172.21.15.125:45874) 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55571a700 1 -- 172.21.15.125:0/565387139 learned_addr learned my addr 172.21.15.125:0/565387139 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 -- 172.21.15.125:0/565387139 >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 msgr2=0x7fa5500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 --2- 172.21.15.125:0/565387139 >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 -- 172.21.15.125:0/565387139 >> v1:172.21.15.125:6789/0 conn(0x7fa5500a1380 legacy=0x7fa550133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 -- 172.21.15.125:0/565387139 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55009e6a0 con 0x7fa550134120 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa55571a700 1 --2- 172.21.15.125:0/565387139 >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa555f1b700 1 --2- 172.21.15.125:0/565387139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa548009d90 tx=0x7fa54800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad7a947fdf6f2c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa547fff700 1 -- 172.21.15.125:0/565387139 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800e070 con 0x7fa550134120 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa547fff700 1 -- 172.21.15.125:0/565387139 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800bb20 con 0x7fa550134120 2023-10-03T10:15:05.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.909+0000 7fa547fff700 1 -- 172.21.15.125:0/565387139 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548012430 con 0x7fa550134120 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 -- 172.21.15.125:0/565387139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 msgr2=0x7fa55013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 --2- 172.21.15.125:0/565387139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa548009d90 tx=0x7fa54800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 -- 172.21.15.125:0/565387139 shutdown_connections 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 --2- 172.21.15.125:0/565387139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa550134120 0x7fa55013bce0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 --2- 172.21.15.125:0/565387139 >> v2:172.21.15.125:3300/0 conn(0x7fa5500a0a70 0x7fa5500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 -- 172.21.15.125:0/565387139 >> 172.21.15.125:0/565387139 conn(0x7fa5500a6610 msgr2=0x7fa5500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 -- 172.21.15.125:0/565387139 shutdown_connections 2023-10-03T10:15:05.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.910+0000 7fa55797e700 1 -- 172.21.15.125:0/565387139 wait complete. 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 Processor -- start 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 -- start start 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5500a0a70 0x7fa550122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa550134120 0x7fa550123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550133850 con 0x7fa550134120 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa550133a80 con 0x7fa5500a0a70 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.911+0000 7fa55797e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5501260d0 con 0x7fa5500a1380 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa55571a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5500a0a70 0x7fa550122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:45882/0 (socket says 172.21.15.125:45882) 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 -- 172.21.15.125:0/2136624265 learned_addr learned my addr 172.21.15.125:0/2136624265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa555f1b700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa550134120 0x7fa550123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 -- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5500a0a70 msgr2=0x7fa550122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5500a0a70 0x7fa550122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 -- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa550134120 msgr2=0x7fa550123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa550134120 0x7fa550123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 -- 172.21.15.125:0/2136624265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009550 con 0x7fa5500a1380 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa554f19700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c520 tx=0x7fa54000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540005cb0 con 0x7fa5500a1380 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540005e10 con 0x7fa5500a1380 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400072d0 con 0x7fa5500a1380 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa548009a70 con 0x7fa5500a1380 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.912+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa550125e10 con 0x7fa5500a1380 2023-10-03T10:15:05.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.913+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa540007430 con 0x7fa5500a1380 2023-10-03T10:15:05.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.913+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa54003ea60 con 0x7fa5500a1380 2023-10-03T10:15:05.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.913+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55004f2a0 con 0x7fa5500a1380 2023-10-03T10:15:05.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.918+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa54001b3b0 con 0x7fa5500a1380 2023-10-03T10:15:05.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 Processor -- start 2023-10-03T10:15:05.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 -- start start 2023-10-03T10:15:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 0x7f20a813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a809e9d0 con 0x7f20a80a0a70 2023-10-03T10:15:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a809dc00 con 0x7f20a8139200 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20ae62d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a809dec0 con 0x7f20a80a1550 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20a77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20a7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f20a80a0a70 0x7f20a80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34184/0 (socket says 172.21.15.125:34184) 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20a7fff700 1 -- 172.21.15.125:0/4062654074 learned_addr learned my addr 172.21.15.125:0/4062654074 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.951+0000 7f20acbca700 1 --2- 172.21.15.125:0/4062654074 >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 0x7f20a813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a6ffd700 1 -- 172.21.15.125:0/4062654074 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211989091 0 0) 0x7f20a809e9d0 con 0x7f20a80a0a70 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a6ffd700 1 -- 172.21.15.125:0/4062654074 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20900035b0 con 0x7f20a80a0a70 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a77fe700 1 -- 172.21.15.125:0/4062654074 >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 msgr2=0x7f20a813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a77fe700 1 --2- 172.21.15.125:0/4062654074 >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 0x7f20a813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a77fe700 1 -- 172.21.15.125:0/4062654074 >> v1:172.21.15.125:6789/0 conn(0x7f20a80a0a70 legacy=0x7f20a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a77fe700 1 -- 172.21.15.125:0/4062654074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a809e6a0 con 0x7f20a80a1550 2023-10-03T10:15:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20acbca700 1 --2- 172.21.15.125:0/4062654074 >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 0x7f20a813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a77fe700 1 --2- 172.21.15.125:0/4062654074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8138cc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f209c009840 tx=0x7f209c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2428c66154c1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a6ffd700 1 -- 172.21.15.125:0/4062654074 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c011830 con 0x7f20a80a1550 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a6ffd700 1 -- 172.21.15.125:0/4062654074 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c011990 con 0x7f20a80a1550 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.952+0000 7f20a6ffd700 1 -- 172.21.15.125:0/4062654074 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c011d20 con 0x7f20a80a1550 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 -- 172.21.15.125:0/4062654074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 msgr2=0x7f20a8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 --2- 172.21.15.125:0/4062654074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8138cc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f209c009840 tx=0x7f209c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 -- 172.21.15.125:0/4062654074 shutdown_connections 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 --2- 172.21.15.125:0/4062654074 >> v2:172.21.15.125:3300/0 conn(0x7f20a8139200 0x7f20a813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 --2- 172.21.15.125:0/4062654074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8138cc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 -- 172.21.15.125:0/4062654074 >> 172.21.15.125:0/4062654074 conn(0x7f20a80a6610 msgr2=0x7f20a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 -- 172.21.15.125:0/4062654074 shutdown_connections 2023-10-03T10:15:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 -- 172.21.15.125:0/4062654074 wait complete. 2023-10-03T10:15:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.953+0000 7f20ae62d700 1 Processor -- start 2023-10-03T10:15:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 -- start start 2023-10-03T10:15:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 0x7f20a8121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8136010 con 0x7f20a8139200 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81365d0 con 0x7f20a80a1550 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20ae62d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8124200 con 0x7f20a80a0a70 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:45888/0 (socket says 172.21.15.125:45888) 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20a7fff700 1 -- 172.21.15.125:0/2759341254 learned_addr learned my addr 172.21.15.125:0/2759341254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20acbca700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 0x7f20a8121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.954+0000 7f20a77fe700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 -- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 msgr2=0x7f20a8120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 -- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 msgr2=0x7f20a8121160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 0x7f20a8121160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 -- 172.21.15.125:0/2759341254 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009a70 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20acbca700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 0x7f20a8121160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a7fff700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f209800c700 tx=0x7f209800ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098005d70 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980070d0 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c0094a0 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098007460 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.955+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a80a03e0 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.956+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20980075c0 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.956+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f209803eb30 con 0x7f20a80a0a70 2023-10-03T10:15:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.956+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a8122b50 con 0x7f20a80a0a70 2023-10-03T10:15:05.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:05.961+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f209800f260 con 0x7f20a80a0a70 2023-10-03T10:15:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.110+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa550126ba0 con 0x7fa5500a1380 2023-10-03T10:15:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.111+0000 7fa545ffb700 1 -- 172.21.15.125:0/2136624265 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa540017020 con 0x7fa5500a1380 2023-10-03T10:15:06.111 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 msgr2=0x7fa550122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c520 tx=0x7fa54000c830 comp rx=0 tx=0).stop 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 shutdown_connections 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa550134120 0x7fa550123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5500a0a70 0x7fa550122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 --2- 172.21.15.125:0/2136624265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5500a1380 0x7fa550122e50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 >> 172.21.15.125:0/2136624265 conn(0x7fa5500a6610 msgr2=0x7fa55009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 shutdown_connections 2023-10-03T10:15:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.113+0000 7fa55797e700 1 -- 172.21.15.125:0/2136624265 wait complete. 2023-10-03T10:15:06.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:06.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.154+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20a804f2a0 con 0x7f20a80a0a70 2023-10-03T10:15:06.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.154+0000 7f20a4ff9700 1 -- 172.21.15.125:0/2759341254 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2098017020 con 0x7f20a80a0a70 2023-10-03T10:15:06.154 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:06.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 msgr2=0x7f20a81206e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f209800c700 tx=0x7f209800ca10 comp rx=0 tx=0).stop 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 shutdown_connections 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20a8139200 0x7f20a8121160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20a80a0a70 0x7f20a81206e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 --2- 172.21.15.125:0/2759341254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20a80a1550 0x7f20a8120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 >> 172.21.15.125:0/2759341254 conn(0x7f20a80a6610 msgr2=0x7f20a80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 shutdown_connections 2023-10-03T10:15:06.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.156+0000 7f20ae62d700 1 -- 172.21.15.125:0/2759341254 wait complete. 2023-10-03T10:15:06.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:06.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:06.262 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.344+0000 7f551a6f2700 1 Processor -- start 2023-10-03T10:15:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.344+0000 7f551a6f2700 1 -- start start 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 0x7f55141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551409e9d0 con 0x7f55140a0a70 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551409dc00 con 0x7f55140a1380 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f551a6f2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f551409dec0 con 0x7f5514133f50 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f5513fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42138/0 (socket says 172.21.15.125:42138) 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f5513fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35572/0 (socket says 172.21.15.125:35572) 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 -- 172.21.15.125:0/3276034871 learned_addr learned my addr 172.21.15.125:0/3276034871 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f5518c8f700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 0x7f55141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 -- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 msgr2=0x7f55141343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 0x7f55141343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 -- 172.21.15.125:0/3276034871 >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 msgr2=0x7f55140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 --2- 172.21.15.125:0/3276034871 >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f55137fe700 1 -- 172.21.15.125:0/3276034871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551409e6a0 con 0x7f55140a1380 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f5513fff700 1 --2- 172.21.15.125:0/3276034871 >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.345+0000 7f5518c8f700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 0x7f55141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f55137fe700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f55080098f0 tx=0x7f5508009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb54b9e921ca540 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f5512ffd700 1 -- 172.21.15.125:0/3276034871 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508011830 con 0x7f55140a1380 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f5512ffd700 1 -- 172.21.15.125:0/3276034871 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508011990 con 0x7f55140a1380 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f5512ffd700 1 -- 172.21.15.125:0/3276034871 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508011d20 con 0x7f55140a1380 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 -- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 msgr2=0x7f5514133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f55080098f0 tx=0x7f5508009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 -- 172.21.15.125:0/3276034871 shutdown_connections 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5514133f50 0x7f55141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 --2- 172.21.15.125:0/3276034871 >> v2:172.21.15.125:3300/0 conn(0x7f55140a0a70 0x7f55140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 --2- 172.21.15.125:0/3276034871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a1380 0x7f5514133a10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 -- 172.21.15.125:0/3276034871 >> 172.21.15.125:0/3276034871 conn(0x7f55140a6610 msgr2=0x7f55140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.346+0000 7f551a6f2700 1 -- 172.21.15.125:0/3276034871 shutdown_connections 2023-10-03T10:15:06.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.347+0000 7f551a6f2700 1 -- 172.21.15.125:0/3276034871 wait complete. 2023-10-03T10:15:06.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.347+0000 7f551a6f2700 1 Processor -- start 2023-10-03T10:15:06.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 -- start start 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55140a1380 0x7f55141229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 0x7f5514122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141241a0 con 0x7f5514133f50 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5514124eb0 con 0x7f55140a0a70 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f551a6f2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5514125270 con 0x7f55140a1380 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5518c8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 0x7f5514122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42140/0 (socket says 172.21.15.125:42140) 2023-10-03T10:15:06.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 -- 172.21.15.125:0/4106977818 learned_addr learned my addr 172.21.15.125:0/4106977818 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f55137fe700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55140a1380 0x7f55141229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 -- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55140a1380 msgr2=0x7f55141229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55140a1380 0x7f55141229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 -- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 msgr2=0x7f5514122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 0x7f5514122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5513fff700 1 -- 172.21.15.125:0/4106977818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040094a0 con 0x7f55140a0a70 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.348+0000 7f5518c8f700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 0x7f5514122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f5513fff700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f550400ebe0 tx=0x7f550400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504009780 con 0x7f55140a0a70 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400c850 con 0x7f55140a0a70 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c009a70 con 0x7f55140a0a70 2023-10-03T10:15:06.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400cbe0 con 0x7f55140a0a70 2023-10-03T10:15:06.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5508009550 con 0x7f55140a0a70 2023-10-03T10:15:06.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.349+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f550400cd40 con 0x7f55140a0a70 2023-10-03T10:15:06.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.350+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f550403fac0 con 0x7f55140a0a70 2023-10-03T10:15:06.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.350+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551404f2a0 con 0x7f55140a0a70 2023-10-03T10:15:06.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.355+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5504011b00 con 0x7f55140a0a70 2023-10-03T10:15:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 Processor -- start 2023-10-03T10:15:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 -- start start 2023-10-03T10:15:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 0x7f0a0c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c09e9d0 con 0x7f0a0c0a0a70 2023-10-03T10:15:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c09dc00 con 0x7f0a0c133f50 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.388+0000 7f0a121df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c09dec0 con 0x7f0a0c0a1380 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35584/0 (socket says 172.21.15.125:35584) 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 0x7f0a0c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42152/0 (socket says 172.21.15.125:42152) 2023-10-03T10:15:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0b7fe700 1 -- 172.21.15.125:0/4241358561 learned_addr learned my addr 172.21.15.125:0/4241358561 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 -- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 msgr2=0x7f0a0c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 -- 172.21.15.125:0/4241358561 >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 msgr2=0x7f0a0c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 --2- 172.21.15.125:0/4241358561 >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 -- 172.21.15.125:0/4241358561 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c09e6a0 con 0x7f0a0c0a1380 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0b7fe700 1 --2- 172.21.15.125:0/4241358561 >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0bfff700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0affd700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 0x7f0a0c133a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009840 tx=0x7f0a00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd5391011d76681 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0a7fc700 1 -- 172.21.15.125:0/4241358561 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00011830 con 0x7f0a0c0a1380 2023-10-03T10:15:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0a7fc700 1 -- 172.21.15.125:0/4241358561 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00011990 con 0x7f0a0c0a1380 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.389+0000 7f0a0a7fc700 1 -- 172.21.15.125:0/4241358561 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00011d20 con 0x7f0a0c0a1380 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 -- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 msgr2=0x7f0a0c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 0x7f0a0c133a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009840 tx=0x7f0a00009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 -- 172.21.15.125:0/4241358561 shutdown_connections 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c133f50 0x7f0a0c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 --2- 172.21.15.125:0/4241358561 >> v2:172.21.15.125:3300/0 conn(0x7f0a0c0a0a70 0x7f0a0c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 --2- 172.21.15.125:0/4241358561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c0a1380 0x7f0a0c133a10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 -- 172.21.15.125:0/4241358561 >> 172.21.15.125:0/4241358561 conn(0x7f0a0c0a6610 msgr2=0x7f0a0c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 -- 172.21.15.125:0/4241358561 shutdown_connections 2023-10-03T10:15:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.390+0000 7f0a121df700 1 -- 172.21.15.125:0/4241358561 wait complete. 2023-10-03T10:15:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.391+0000 7f0a121df700 1 Processor -- start 2023-10-03T10:15:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.391+0000 7f0a121df700 1 -- start start 2023-10-03T10:15:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a0c0a0a70 0x7f0a0c1224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 0x7f0a0c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1241a0 con 0x7f0a0c0a0a70 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c124eb0 con 0x7f0a0c0a1380 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a121df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c125270 con 0x7f0a0c133f50 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 0x7f0a0c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42156/0 (socket says 172.21.15.125:42156) 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0affd700 1 -- 172.21.15.125:0/3784406344 learned_addr learned my addr 172.21.15.125:0/3784406344 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0b7fe700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a0c0a0a70 0x7f0a0c1224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 -- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 msgr2=0x7f0a0c1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 -- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a0c0a0a70 msgr2=0x7f0a0c1224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a0c0a0a70 0x7f0a0c1224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0bfff700 1 -- 172.21.15.125:0/3784406344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009550 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.392+0000 7f0a0affd700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f0a0bfff700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 0x7f0a0c122f30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e50 tx=0x7f0a0400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04009cc0 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a04009a70 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400f040 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400cd00 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a000094a0 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.393+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a04014480 con 0x7f0a0c133f50 2023-10-03T10:15:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.394+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a0403fc60 con 0x7f0a0c133f50 2023-10-03T10:15:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.394+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c04f2a0 con 0x7f0a0c133f50 2023-10-03T10:15:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.398+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a0401d410 con 0x7f0a0c133f50 2023-10-03T10:15:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.548+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5514072980 con 0x7f55140a0a70 2023-10-03T10:15:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.548+0000 7f5510ff9700 1 -- 172.21.15.125:0/4106977818 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5504021030 con 0x7f55140a0a70 2023-10-03T10:15:06.549 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 msgr2=0x7f55141224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f550400ebe0 tx=0x7f550400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 shutdown_connections 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5514133f50 0x7f5514122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55140a0a70 0x7f55141224b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 --2- 172.21.15.125:0/4106977818 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55140a1380 0x7f55141229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 >> 172.21.15.125:0/4106977818 conn(0x7f55140a6610 msgr2=0x7f551409b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 shutdown_connections 2023-10-03T10:15:06.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.551+0000 7f551a6f2700 1 -- 172.21.15.125:0/4106977818 wait complete. 2023-10-03T10:15:06.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.593+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a0c072980 con 0x7f0a0c133f50 2023-10-03T10:15:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.593+0000 7f09f3fff700 1 -- 172.21.15.125:0/3784406344 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a0401b360 con 0x7f0a0c133f50 2023-10-03T10:15:06.594 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 msgr2=0x7f0a0c122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 0x7f0a0c122f30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e50 tx=0x7f0a0400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 shutdown_connections 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a0c133f50 0x7f0a0c122f30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a0c0a0a70 0x7f0a0c1224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 --2- 172.21.15.125:0/3784406344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a0c0a1380 0x7f0a0c1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 >> 172.21.15.125:0/3784406344 conn(0x7f0a0c0a6610 msgr2=0x7f0a0c09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 shutdown_connections 2023-10-03T10:15:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:06.595+0000 7f0a121df700 1 -- 172.21.15.125:0/3784406344 wait complete. 2023-10-03T10:15:06.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:07.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:07.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 Processor -- start 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 -- start start 2023-10-03T10:15:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff17409ad40 0x7ff174133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17409b110 con 0x7ff174133f70 2023-10-03T10:15:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1740a3b60 con 0x7ff17409ad40 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17b3dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff174134850 con 0x7ff1741343d0 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17997a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff179179700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff17409ad40 0x7ff174133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff179179700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff17409ad40 0x7ff174133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35608/0 (socket says 172.21.15.125:35608) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff17997a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42162/0 (socket says 172.21.15.125:42162) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff179179700 1 -- 172.21.15.125:0/2163974705 learned_addr learned my addr 172.21.15.125:0/2163974705 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.257+0000 7ff178978700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff174133f70 0x7ff1740a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34188/0 (socket says 172.21.15.125:34188) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff179179700 1 -- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 msgr2=0x7ff1740a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff179179700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff179179700 1 -- 172.21.15.125:0/2163974705 >> v1:172.21.15.125:6789/0 conn(0x7ff174133f70 legacy=0x7ff1740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff16bfff700 1 -- 172.21.15.125:0/2163974705 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514286650 0 0) 0x7ff17409b110 con 0x7ff174133f70 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff179179700 1 -- 172.21.15.125:0/2163974705 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740a2fa0 con 0x7ff17409ad40 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff17997a700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff179179700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff174133a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098f0 tx=0x7ff170009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebe841240aac7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff16bfff700 1 -- 172.21.15.125:0/2163974705 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011830 con 0x7ff17409ad40 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff16bfff700 1 -- 172.21.15.125:0/2163974705 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170011990 con 0x7ff17409ad40 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.258+0000 7ff16bfff700 1 -- 172.21.15.125:0/2163974705 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011d20 con 0x7ff17409ad40 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 msgr2=0x7ff174133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff174133a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098f0 tx=0x7ff170009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2163974705 shutdown_connections 2023-10-03T10:15:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1741343d0 0x7ff1740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2163974705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff174133a30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2163974705 >> 172.21.15.125:0/2163974705 conn(0x7ff174099c40 msgr2=0x7ff17406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2163974705 shutdown_connections 2023-10-03T10:15:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.259+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2163974705 wait complete. 2023-10-03T10:15:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 Processor -- start 2023-10-03T10:15:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 -- start start 2023-10-03T10:15:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff17411f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 0x7ff1741c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17411f140 con 0x7ff17409ad40 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff174133790 con 0x7ff174133f70 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17b3dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff174133550 con 0x7ff1741343d0 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff178978700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff178978700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42172/0 (socket says 172.21.15.125:42172) 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff178978700 1 -- 172.21.15.125:0/2611469893 learned_addr learned my addr 172.21.15.125:0/2611469893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff17997a700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 0x7ff1741c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.260+0000 7ff179179700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff17411f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 -- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 msgr2=0x7ff1741c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 0x7ff1741c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 -- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 msgr2=0x7ff17411f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff17411f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 -- 172.21.15.125:0/2611469893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009a70 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff17997a700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 0x7ff1741c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff179179700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff17411f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff178978700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c550 tx=0x7ff16400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164004c80 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164004e00 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff170009550 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164007310 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.261+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1741207d0 con 0x7ff174133f70 2023-10-03T10:15:07.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.262+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff164007470 con 0x7ff174133f70 2023-10-03T10:15:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.262+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff16403f260 con 0x7ff174133f70 2023-10-03T10:15:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.262+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17404f2a0 con 0x7ff174133f70 2023-10-03T10:15:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.267+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1640123b0 con 0x7ff174133f70 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.310+0000 7f627b1b1700 1 Processor -- start 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 -- start start 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 0x7f62741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 0x7f6274131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627409aaa0 con 0x7f6274130ce0 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627409f870 con 0x7f627409e170 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627b1b1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627409b360 con 0x7f627409d860 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6273fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 0x7f62741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627974e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 0x7f6274131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:45950/0 (socket says 172.21.15.125:45950) 2023-10-03T10:15:07.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 -- 172.21.15.125:0/3838944029 learned_addr learned my addr 172.21.15.125:0/3838944029 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 -- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 msgr2=0x7f62741307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 0x7f62741307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 -- 172.21.15.125:0/3838944029 >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 msgr2=0x7f6274131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 --2- 172.21.15.125:0/3838944029 >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 0x7f6274131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6278f4d700 1 -- 172.21.15.125:0/3838944029 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627409b620 con 0x7f627409d860 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f627974e700 1 --2- 172.21.15.125:0/3838944029 >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 0x7f6274131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.311+0000 7f6273fff700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 0x7f62741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f6278f4d700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f626800bb90 tx=0x7f626800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c59c8c5e3b2e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f62737fe700 1 -- 172.21.15.125:0/3838944029 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800dd30 con 0x7f627409d860 2023-10-03T10:15:07.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f62737fe700 1 -- 172.21.15.125:0/3838944029 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800de90 con 0x7f627409d860 2023-10-03T10:15:07.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f62737fe700 1 -- 172.21.15.125:0/3838944029 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268010690 con 0x7f627409d860 2023-10-03T10:15:07.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 -- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 msgr2=0x7f627409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f626800bb90 tx=0x7f626800bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 -- 172.21.15.125:0/3838944029 shutdown_connections 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3838944029 >> v2:172.21.15.125:3300/0 conn(0x7f6274130ce0 0x7f6274131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f627409dc30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3838944029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f627409e170 0x7f62741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 -- 172.21.15.125:0/3838944029 >> 172.21.15.125:0/3838944029 conn(0x7f6274099c40 msgr2=0x7f62740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 -- 172.21.15.125:0/3838944029 shutdown_connections 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.312+0000 7f627b1b1700 1 -- 172.21.15.125:0/3838944029 wait complete. 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.313+0000 7f627b1b1700 1 Processor -- start 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.313+0000 7f627b1b1700 1 -- start start 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f6274119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 0x7f627411a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740a0710 con 0x7f627409e170 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627411b410 con 0x7f6274130ce0 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627b1b1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627411bca0 con 0x7f627409d860 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f6278f4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f6274119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42190/0 (socket says 172.21.15.125:42190) 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 -- 172.21.15.125:0/3398607775 learned_addr learned my addr 172.21.15.125:0/3398607775 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f6273fff700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 0x7f627411a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 -- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 msgr2=0x7f6274119f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f6274119f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 -- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 msgr2=0x7f627411a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 0x7f627411a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f627974e700 1 -- 172.21.15.125:0/3398607775 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094a0 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f6278f4d700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f6274119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.314+0000 7f6273fff700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 0x7f627411a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f627974e700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f626c00efc0 tx=0x7f626c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ca90 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c009a70 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ce10 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.315+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626800b7f0 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.316+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f626c014480 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.316+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f626c03fc90 con 0x7f6274130ce0 2023-10-03T10:15:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.316+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627409a5b0 con 0x7f6274130ce0 2023-10-03T10:15:07.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.321+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f626c012930 con 0x7f6274130ce0 2023-10-03T10:15:07.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.494+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff174120d50 con 0x7ff174133f70 2023-10-03T10:15:07.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.494+0000 7ff169ffb700 1 -- 172.21.15.125:0/2611469893 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff164011360 con 0x7ff174133f70 2023-10-03T10:15:07.495 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:07.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 msgr2=0x7ff17411fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c550 tx=0x7ff16400c860 comp rx=0 tx=0).stop 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 shutdown_connections 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1741343d0 0x7ff1741c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff17409ad40 0x7ff17411f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 --2- 172.21.15.125:0/2611469893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff174133f70 0x7ff17411fa30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 >> 172.21.15.125:0/2611469893 conn(0x7ff174099c40 msgr2=0x7ff1740a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 shutdown_connections 2023-10-03T10:15:07.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.497+0000 7ff17b3dd700 1 -- 172.21.15.125:0/2611469893 wait complete. 2023-10-03T10:15:07.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:07.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.529+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f627411d350 con 0x7f6274130ce0 2023-10-03T10:15:07.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.529+0000 7f62717fa700 1 -- 172.21.15.125:0/3398607775 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f627411d350 con 0x7f6274130ce0 2023-10-03T10:15:07.530 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 msgr2=0x7f627411a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f626c00efc0 tx=0x7f626c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 shutdown_connections 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6274130ce0 0x7f627411a9e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f627409d860 0x7f6274119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 --2- 172.21.15.125:0/3398607775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627409e170 0x7f627411a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 >> 172.21.15.125:0/3398607775 conn(0x7f6274099c40 msgr2=0x7f62740a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 shutdown_connections 2023-10-03T10:15:07.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.531+0000 7f627b1b1700 1 -- 172.21.15.125:0/3398607775 wait complete. 2023-10-03T10:15:07.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:07.565 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:07.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:07.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 Processor -- start 2023-10-03T10:15:07.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 -- start start 2023-10-03T10:15:07.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0980a09e0 0x7fb0980a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09809db90 con 0x7fb0980a12f0 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09809de10 con 0x7fb0980a09e0 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.710+0000 7fb09f1af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980a2560 con 0x7fb098134110 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09d74c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0980a09e0 0x7fb0980a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09d74c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:45972/0 (socket says 172.21.15.125:45972) 2023-10-03T10:15:07.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0980a09e0 0x7fb0980a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35650/0 (socket says 172.21.15.125:35650) 2023-10-03T10:15:07.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09d74c700 1 -- 172.21.15.125:0/644752559 learned_addr learned my addr 172.21.15.125:0/644752559 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb097fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb0980a12f0 0x7fb098133a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34196/0 (socket says 172.21.15.125:34196) 2023-10-03T10:15:07.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 -- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 msgr2=0x7fb09813bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 -- 172.21.15.125:0/644752559 >> v1:172.21.15.125:6789/0 conn(0x7fb0980a12f0 legacy=0x7fb098133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 -- 172.21.15.125:0/644752559 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980a1f60 con 0x7fb0980a09e0 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09d74c700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb0977fe700 1 -- 172.21.15.125:0/644752559 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611121131 0 0) 0x7fb09809db90 con 0x7fb0980a12f0 2023-10-03T10:15:07.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb09cf4b700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a09e0 0x7fb0980a0db0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009840 tx=0x7fb08c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629fcde948916dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb0977fe700 1 -- 172.21.15.125:0/644752559 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011830 con 0x7fb0980a09e0 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb0977fe700 1 -- 172.21.15.125:0/644752559 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c011990 con 0x7fb0980a09e0 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.711+0000 7fb0977fe700 1 -- 172.21.15.125:0/644752559 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011d20 con 0x7fb0980a09e0 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 -- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a09e0 msgr2=0x7fb0980a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a09e0 0x7fb0980a0db0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009840 tx=0x7fb08c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 -- 172.21.15.125:0/644752559 shutdown_connections 2023-10-03T10:15:07.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb09813bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 --2- 172.21.15.125:0/644752559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a09e0 0x7fb0980a0db0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 -- 172.21.15.125:0/644752559 >> 172.21.15.125:0/644752559 conn(0x7fb0980a3000 msgr2=0x7fb0980a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 -- 172.21.15.125:0/644752559 shutdown_connections 2023-10-03T10:15:07.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.712+0000 7fb09f1af700 1 -- 172.21.15.125:0/644752559 wait complete. 2023-10-03T10:15:07.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 Processor -- start 2023-10-03T10:15:07.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 -- start start 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a12f0 0x7fb098121ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb098122020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098124b20 con 0x7fb0980a12f0 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098132130 con 0x7fb0980a09e0 2023-10-03T10:15:07.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09f1af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980a4910 con 0x7fb098134110 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09cf4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09cf4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42202/0 (socket says 172.21.15.125:42202) 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb09cf4b700 1 -- 172.21.15.125:0/3319226398 learned_addr learned my addr 172.21.15.125:0/3319226398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.713+0000 7fb097fff700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a12f0 0x7fb098121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09d74c700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb098122020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 -- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 msgr2=0x7fb098122020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb098122020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 -- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a12f0 msgr2=0x7fb098121ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a12f0 0x7fb098121ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 -- 172.21.15.125:0/3319226398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090009b30 con 0x7fb0980a09e0 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09cf4b700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c004550 con 0x7fb0980a09e0 2023-10-03T10:15:07.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c01f070 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0094a0 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c0038e0 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.714+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09809cdc0 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.715+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb08c003a40 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.715+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb08c021070 con 0x7fb0980a09e0 2023-10-03T10:15:07.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.715+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09804f2a0 con 0x7fb0980a09e0 2023-10-03T10:15:07.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.720+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb08c015080 con 0x7fb0980a09e0 2023-10-03T10:15:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 Processor -- start 2023-10-03T10:15:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 -- start start 2023-10-03T10:15:07.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061009e9d0 con 0x7f06100a0a70 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061009dc00 con 0x7f0610133f50 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0618053700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061009dec0 con 0x7f06100a1380 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0615def700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f06165f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0615def700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35662/0 (socket says 172.21.15.125:35662) 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f06165f0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42218/0 (socket says 172.21.15.125:42218) 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f0615def700 1 -- 172.21.15.125:0/2178986741 learned_addr learned my addr 172.21.15.125:0/2178986741 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.753+0000 7f06155ee700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 -- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 msgr2=0x7f0610133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 -- 172.21.15.125:0/2178986741 >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 msgr2=0x7f06100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 --2- 172.21.15.125:0/2178986741 >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 -- 172.21.15.125:0/2178986741 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061009e6a0 con 0x7f0610133f50 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06155ee700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f0615def700 1 --2- 172.21.15.125:0/2178986741 >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f06165f0700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0608009d90 tx=0x7f060800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f06ae135b02742b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f0614ded700 1 -- 172.21.15.125:0/2178986741 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800e070 con 0x7f0610133f50 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f0614ded700 1 -- 172.21.15.125:0/2178986741 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060800bb20 con 0x7f0610133f50 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.754+0000 7f0614ded700 1 -- 172.21.15.125:0/2178986741 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608012430 con 0x7f0610133f50 2023-10-03T10:15:07.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 -- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 msgr2=0x7f06101343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0608009d90 tx=0x7f060800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 -- 172.21.15.125:0/2178986741 shutdown_connections 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0610133f50 0x7f06101343b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 --2- 172.21.15.125:0/2178986741 >> v2:172.21.15.125:3300/0 conn(0x7f06100a0a70 0x7f06100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 --2- 172.21.15.125:0/2178986741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 -- 172.21.15.125:0/2178986741 >> 172.21.15.125:0/2178986741 conn(0x7f06100a6610 msgr2=0x7f06100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 -- 172.21.15.125:0/2178986741 shutdown_connections 2023-10-03T10:15:07.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.755+0000 7f0618053700 1 -- 172.21.15.125:0/2178986741 wait complete. 2023-10-03T10:15:07.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 Processor -- start 2023-10-03T10:15:07.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 -- start start 2023-10-03T10:15:07.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0610133f50 0x7f0610121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610124e50 con 0x7f0610133f50 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0610123dd0 con 0x7f06100a0a70 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0618053700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06100a03e0 con 0x7f06100a1380 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42226/0 (socket says 172.21.15.125:42226) 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 -- 172.21.15.125:0/2106251486 learned_addr learned my addr 172.21.15.125:0/2106251486 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f06155ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f06165f0700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0610133f50 0x7f0610121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 -- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 msgr2=0x7f0610121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 -- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0610133f50 msgr2=0x7f0610121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.756+0000 7f0615def700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0610133f50 0x7f0610121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f0615def700 1 -- 172.21.15.125:0/2106251486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009550 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f06155ee700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f0615def700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f060c00ebe0 tx=0x7f060c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c004030 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c004190 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000094a0 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c004520 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.757+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0608009a70 con 0x7f06100a0a70 2023-10-03T10:15:07.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.758+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f060c00c850 con 0x7f06100a0a70 2023-10-03T10:15:07.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.758+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061011e040 con 0x7f06100a0a70 2023-10-03T10:15:07.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.758+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f060c03f5a0 con 0x7f06100a0a70 2023-10-03T10:15:07.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.766+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f060c0036a0 con 0x7f06100a0a70 2023-10-03T10:15:07.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.917+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb098072920 con 0x7fb0980a09e0 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.918+0000 7fb0957fa700 1 -- 172.21.15.125:0/3319226398 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb08c02b020 con 0x7fb0980a09e0 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 msgr2=0x7fb0981215a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 shutdown_connections 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb098134110 0x7fb098122020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0980a09e0 0x7fb0981215a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 --2- 172.21.15.125:0/3319226398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0980a12f0 0x7fb098121ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 >> 172.21.15.125:0/3319226398 conn(0x7fb0980a3000 msgr2=0x7fb09809ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 shutdown_connections 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.920+0000 7fb09f1af700 1 -- 172.21.15.125:0/3319226398 wait complete. 2023-10-03T10:15:07.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:07.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.958+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f061004f2a0 con 0x7f06100a0a70 2023-10-03T10:15:07.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.959+0000 7f06067fc700 1 -- 172.21.15.125:0/2106251486 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f060c0089b0 con 0x7f06100a0a70 2023-10-03T10:15:07.958 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:07.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 msgr2=0x7f0610121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f060c00ebe0 tx=0x7f060c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 shutdown_connections 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0610133f50 0x7f0610121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06100a0a70 0x7f0610121330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 --2- 172.21.15.125:0/2106251486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06100a1380 0x7f0610121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 >> 172.21.15.125:0/2106251486 conn(0x7f06100a6610 msgr2=0x7f0610133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 shutdown_connections 2023-10-03T10:15:07.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:07.961+0000 7f0618053700 1 -- 172.21.15.125:0/2106251486 wait complete. 2023-10-03T10:15:07.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:08.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:08.544 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:08.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.641+0000 7f0dff715700 1 Processor -- start 2023-10-03T10:15:08.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.641+0000 7f0dff715700 1 -- start start 2023-10-03T10:15:08.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dff715700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 0x7f0df809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dff715700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 0x7f0df8134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dff715700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df809af80 con 0x7f0df809edb0 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dff715700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df809a520 con 0x7f0df809f1a0 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dff715700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0df809fe00 con 0x7f0df809a150 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dfccb0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0df809edb0 0x7f0df8133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34212/0 (socket says 172.21.15.125:34212) 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dfccb0700 1 -- 172.21.15.125:0/2824182958 learned_addr learned my addr 172.21.15.125:0/2824182958 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dfd4b1700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 0x7f0df809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.642+0000 7f0dfdcb2700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 0x7f0df8134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0deffff700 1 -- 172.21.15.125:0/2824182958 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419665762 0 0) 0x7f0df809af80 con 0x7f0df809edb0 2023-10-03T10:15:08.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfd4b1700 1 -- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 msgr2=0x7f0df8134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfd4b1700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 0x7f0df8134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfd4b1700 1 -- 172.21.15.125:0/2824182958 >> v1:172.21.15.125:6789/0 conn(0x7f0df809edb0 legacy=0x7f0df8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfd4b1700 1 -- 172.21.15.125:0/2824182958 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df806bc20 con 0x7f0df809a150 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfdcb2700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 0x7f0df8134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0dfd4b1700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 0x7f0df809e870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0df40098a0 tx=0x7f0df4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906641ab112bdc17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0deffff700 1 -- 172.21.15.125:0/2824182958 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4011830 con 0x7f0df809a150 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0deffff700 1 -- 172.21.15.125:0/2824182958 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4011990 con 0x7f0df809a150 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.643+0000 7f0deffff700 1 -- 172.21.15.125:0/2824182958 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4011d20 con 0x7f0df809a150 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 -- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 msgr2=0x7f0df809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 0x7f0df809e870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0df40098a0 tx=0x7f0df4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 -- 172.21.15.125:0/2824182958 shutdown_connections 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809f1a0 0x7f0df8134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 --2- 172.21.15.125:0/2824182958 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809a150 0x7f0df809e870 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 -- 172.21.15.125:0/2824182958 >> 172.21.15.125:0/2824182958 conn(0x7f0df80a4430 msgr2=0x7f0df80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 -- 172.21.15.125:0/2824182958 shutdown_connections 2023-10-03T10:15:08.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.644+0000 7f0dff715700 1 -- 172.21.15.125:0/2824182958 wait complete. 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 Processor -- start 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 -- start start 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809a150 0x7f0df81c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 0x7f0df81c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df81aad00 con 0x7f0df809edb0 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df809bc40 con 0x7f0df809a150 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dff715700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80a0440 con 0x7f0df809f1a0 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dfccb0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dfccb0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35672/0 (socket says 172.21.15.125:35672) 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dfccb0700 1 -- 172.21.15.125:0/823946658 learned_addr learned my addr 172.21.15.125:0/823946658 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dfdcb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 0x7f0df81c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.645+0000 7f0dfd4b1700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809a150 0x7f0df81c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 -- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 msgr2=0x7f0df81c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 0x7f0df81c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 -- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809a150 msgr2=0x7f0df81c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809a150 0x7f0df81c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 -- 172.21.15.125:0/823946658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0009a70 con 0x7f0df809edb0 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfdcb2700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 0x7f0df81c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dfccb0700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0de8001eb0 tx=0x7f0de800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8004c80 con 0x7f0df809edb0 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8004de0 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8007310 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df40094a0 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.646+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df81aa0c0 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.647+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0de8007470 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.647+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0de803f090 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.647+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df809fa30 con 0x7f0df809edb0 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.652+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0de80102c0 con 0x7f0df809edb0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 Processor -- start 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 -- start start 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2ed009f350 0x7f2ed0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed009c970 con 0x7f2ed009e870 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00a0920 con 0x7f2ed009f350 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed6539700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed009f9c0 con 0x7f2ed01371c0 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed4ad6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed4ad6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46018/0 (socket says 172.21.15.125:46018) 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/3710540334 learned_addr learned my addr 172.21.15.125:0/3710540334 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.681+0000 7f2ecf7fe700 1 --2- 172.21.15.125:0/3710540334 >> v2:172.21.15.125:3300/0 conn(0x7f2ed009f350 0x7f2ed0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/3710540334 >> v2:172.21.15.125:3300/0 conn(0x7f2ed009f350 msgr2=0x7f2ed0136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed4ad6700 1 --2- 172.21.15.125:0/3710540334 >> v2:172.21.15.125:3300/0 conn(0x7f2ed009f350 0x7f2ed0136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/3710540334 >> v1:172.21.15.125:6789/0 conn(0x7f2ed009e870 legacy=0x7f2ed009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/3710540334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed009bab0 con 0x7f2ed01371c0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed4ad6700 1 --2- 172.21.15.125:0/3710540334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009e50 tx=0x7f2ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3990391373ea5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2eceffd700 1 -- 172.21.15.125:0/3710540334 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800e070 con 0x7f2ed01371c0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2eceffd700 1 -- 172.21.15.125:0/3710540334 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800b910 con 0x7f2ed01371c0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2eceffd700 1 -- 172.21.15.125:0/3710540334 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800bcc0 con 0x7f2ed01371c0 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 -- 172.21.15.125:0/3710540334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 msgr2=0x7f2ed01395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 --2- 172.21.15.125:0/3710540334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009e50 tx=0x7f2ec800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 -- 172.21.15.125:0/3710540334 shutdown_connections 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 --2- 172.21.15.125:0/3710540334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed01371c0 0x7f2ed01395a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 --2- 172.21.15.125:0/3710540334 >> v2:172.21.15.125:3300/0 conn(0x7f2ed009f350 0x7f2ed0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 -- 172.21.15.125:0/3710540334 >> 172.21.15.125:0/3710540334 conn(0x7f2ed00a4430 msgr2=0x7f2ed00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.682+0000 7f2ed6539700 1 -- 172.21.15.125:0/3710540334 shutdown_connections 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.683+0000 7f2ed6539700 1 -- 172.21.15.125:0/3710540334 wait complete. 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.683+0000 7f2ed6539700 1 Processor -- start 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 -- start start 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed009f350 0x7f2ed0120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 0x7f2ed0121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0124340 con 0x7f2ed01371c0 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0122d00 con 0x7f2ed009e870 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed6539700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0123af0 con 0x7f2ed009f350 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 0x7f2ed0121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42260/0 (socket says 172.21.15.125:42260) 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ecffff700 1 -- 172.21.15.125:0/1122000816 learned_addr learned my addr 172.21.15.125:0/1122000816 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:08.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ecf7fe700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed009f350 0x7f2ed0120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed009f350 msgr2=0x7f2ed0120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed009f350 0x7f2ed0120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 msgr2=0x7f2ed01208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ed4ad6700 1 -- 172.21.15.125:0/1122000816 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009b30 con 0x7f2ed01371c0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.684+0000 7f2ecffff700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2ed4ad6700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 0x7f2ed0121370 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0067370 tx=0x7f2ec8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8004800 con 0x7f2ed01371c0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8004960 con 0x7f2ed01371c0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0072320 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec801c680 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.685+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0122430 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.686+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec801c7e0 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.686+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ec8040e20 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.686+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed009fbc0 con 0x7f2ed01371c0 2023-10-03T10:15:08.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.690+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec80123f0 con 0x7f2ed01371c0 2023-10-03T10:15:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.871+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0df81aa0c0 con 0x7f0df809edb0 2023-10-03T10:15:08.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.871+0000 7f0dedffb700 1 -- 172.21.15.125:0/823946658 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0df81aa0c0 con 0x7f0df809edb0 2023-10-03T10:15:08.871 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 msgr2=0x7f0df81c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0de8001eb0 tx=0x7f0de800c800 comp rx=0 tx=0).stop 2023-10-03T10:15:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 shutdown_connections 2023-10-03T10:15:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0df809f1a0 0x7f0df81c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0df809a150 0x7f0df81c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 --2- 172.21.15.125:0/823946658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0df809edb0 0x7f0df81c8f40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 >> 172.21.15.125:0/823946658 conn(0x7f0df80a4430 msgr2=0x7f0df8072560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 shutdown_connections 2023-10-03T10:15:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.874+0000 7f0dff715700 1 -- 172.21.15.125:0/823946658 wait complete. 2023-10-03T10:15:08.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:08.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.917+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ed0136710 con 0x7f2ed01371c0 2023-10-03T10:15:08.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.917+0000 7f2eccff9700 1 -- 172.21.15.125:0/1122000816 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ec80243b0 con 0x7f2ed01371c0 2023-10-03T10:15:08.916 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 msgr2=0x7f2ed0121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 0x7f2ed0121370 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0067370 tx=0x7f2ec8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 shutdown_connections 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed01371c0 0x7f2ed0121370 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed009e870 0x7f2ed01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 --2- 172.21.15.125:0/1122000816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed009f350 0x7f2ed0120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 >> 172.21.15.125:0/1122000816 conn(0x7f2ed00a4430 msgr2=0x7f2ed00a2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 shutdown_connections 2023-10-03T10:15:08.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:08.919+0000 7f2ed6539700 1 -- 172.21.15.125:0/1122000816 wait complete. 2023-10-03T10:15:08.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:08.932 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:08.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:09.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.096+0000 7f079854e700 1 Processor -- start 2023-10-03T10:15:09.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.096+0000 7f079854e700 1 -- start start 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.096+0000 7f3723f4e700 1 Processor -- start 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 -- start start 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f371c0a1380 0x7f371c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f079854e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07900a1550 0x7f0790138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f079854e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0790139200 0x7f079013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f079854e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079009e9d0 con 0x7f07900a0a70 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f079854e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079009dc00 con 0x7f07900a1550 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f079854e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f079009dec0 con 0x7f0790139200 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c09dc00 con 0x7f371c133f50 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c09ea60 con 0x7f371c0a1380 2023-10-03T10:15:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3723f4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09dec0 con 0x7f371c0a0a70 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f07962ea700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f07900a0a70 0x7f07900a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34220/0 (socket says 172.21.15.125:34220) 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f07962ea700 1 -- 172.21.15.125:0/1904716812 learned_addr learned my addr 172.21.15.125:0/1904716812 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f0796aeb700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0790139200 0x7f079013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f0795ae9700 1 --2- 172.21.15.125:0/1904716812 >> v2:172.21.15.125:3300/0 conn(0x7f07900a1550 0x7f0790138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f3721cea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f37224eb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f371c133f50 0x7f371c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34232/0 (socket says 172.21.15.125:34232) 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f37224eb700 1 -- 172.21.15.125:0/43004914 learned_addr learned my addr 172.21.15.125:0/43004914 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.097+0000 7f37214e9700 1 --2- 172.21.15.125:0/43004914 >> v2:172.21.15.125:3300/0 conn(0x7f371c0a1380 0x7f371c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3721cea700 1 -- 172.21.15.125:0/43004914 >> v2:172.21.15.125:3300/0 conn(0x7f371c0a1380 msgr2=0x7f371c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3721cea700 1 --2- 172.21.15.125:0/43004914 >> v2:172.21.15.125:3300/0 conn(0x7f371c0a1380 0x7f371c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3721cea700 1 -- 172.21.15.125:0/43004914 >> v1:172.21.15.125:6789/0 conn(0x7f371c133f50 legacy=0x7f371c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3721cea700 1 -- 172.21.15.125:0/43004914 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c09e6a0 con 0x7f371c0a0a70 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f0795ae9700 1 -- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0790139200 msgr2=0x7f079013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f0795ae9700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0790139200 0x7f079013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f0795ae9700 1 -- 172.21.15.125:0/1904716812 >> v1:172.21.15.125:6789/0 conn(0x7f07900a0a70 legacy=0x7f07900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f0795ae9700 1 -- 172.21.15.125:0/1904716812 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079009e6a0 con 0x7f07900a1550 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f0795ae9700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f0790138cc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0780009840 tx=0x7f0780009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab8c64aa6e3cadf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3721cea700 1 --2- 172.21.15.125:0/43004914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c0a0e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f370c009d90 tx=0x7f370c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cf6cfa28bbd273 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3720ce8700 1 -- 172.21.15.125:0/43004914 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c00e070 con 0x7f371c0a0a70 2023-10-03T10:15:09.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f07952e8700 1 -- 172.21.15.125:0/1904716812 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780011830 con 0x7f07900a1550 2023-10-03T10:15:09.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3720ce8700 1 -- 172.21.15.125:0/43004914 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00bb20 con 0x7f371c0a0a70 2023-10-03T10:15:09.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f3720ce8700 1 -- 172.21.15.125:0/43004914 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c012430 con 0x7f371c0a0a70 2023-10-03T10:15:09.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f07952e8700 1 -- 172.21.15.125:0/1904716812 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780011990 con 0x7f07900a1550 2023-10-03T10:15:09.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.098+0000 7f07952e8700 1 -- 172.21.15.125:0/1904716812 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780011d20 con 0x7f07900a1550 2023-10-03T10:15:09.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 -- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 msgr2=0x7f0790138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 -- 172.21.15.125:0/43004914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 msgr2=0x7f371c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 --2- 172.21.15.125:0/43004914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c0a0e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f370c009d90 tx=0x7f370c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f0790138cc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0780009840 tx=0x7f0780009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 -- 172.21.15.125:0/43004914 shutdown_connections 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 --2- 172.21.15.125:0/43004914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c0a0e40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 --2- 172.21.15.125:0/43004914 >> v2:172.21.15.125:3300/0 conn(0x7f371c0a1380 0x7f371c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 -- 172.21.15.125:0/43004914 >> 172.21.15.125:0/43004914 conn(0x7f371c0a6610 msgr2=0x7f371c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 -- 172.21.15.125:0/1904716812 shutdown_connections 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0790139200 0x7f079013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 --2- 172.21.15.125:0/1904716812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f0790138cc0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 -- 172.21.15.125:0/1904716812 >> 172.21.15.125:0/1904716812 conn(0x7f07900a6610 msgr2=0x7f07900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 -- 172.21.15.125:0/1904716812 shutdown_connections 2023-10-03T10:15:09.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 -- 172.21.15.125:0/43004914 shutdown_connections 2023-10-03T10:15:09.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f3723f4e700 1 -- 172.21.15.125:0/43004914 wait complete. 2023-10-03T10:15:09.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.099+0000 7f079854e700 1 -- 172.21.15.125:0/1904716812 wait complete. 2023-10-03T10:15:09.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f3723f4e700 1 Processor -- start 2023-10-03T10:15:09.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f079854e700 1 Processor -- start 2023-10-03T10:15:09.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f3723f4e700 1 -- start start 2023-10-03T10:15:09.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f079854e700 1 -- start start 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f3723f4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.100+0000 7f3723f4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c0a1380 0x7f371c1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3723f4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 0x7f371c1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3723f4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1247f0 con 0x7f371c133f50 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3723f4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c124600 con 0x7f371c0a0a70 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3723f4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1252e0 con 0x7f371c0a1380 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3721cea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37214e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c0a1380 0x7f371c1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3721cea700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42266/0 (socket says 172.21.15.125:42266) 2023-10-03T10:15:09.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f3721cea700 1 -- 172.21.15.125:0/736343100 learned_addr learned my addr 172.21.15.125:0/736343100 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:09.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 0x7f371c1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 0x7f079011e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f079011edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 0x7f079011f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0790134160 con 0x7f07900a1550 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900a03e0 con 0x7f0790139200 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f079854e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0790122070 con 0x7f07900a0a70 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f07962ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 0x7f079011e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f07962ea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 0x7f079011e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46044/0 (socket says 172.21.15.125:46044) 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f07962ea700 1 -- 172.21.15.125:0/4054287202 learned_addr learned my addr 172.21.15.125:0/4054287202 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 0x7f079011f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0795ae9700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f079011edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 -- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 msgr2=0x7f079011e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 0x7f079011e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 -- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 msgr2=0x7f079011edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f079011edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 -- 172.21.15.125:0/4054287202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800094a0 con 0x7f0790139200 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 -- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c0a1380 msgr2=0x7f371c1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c0a1380 0x7f371c1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 -- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 msgr2=0x7f371c1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 -- 172.21.15.125:0/736343100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c009a70 con 0x7f371c133f50 2023-10-03T10:15:09.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f0796aeb700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 0x7f079011f300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f078800efc0 tx=0x7f078800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.101+0000 7f37224eb700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 0x7f371c1c8c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f371400c460 tx=0x7f371400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800cc90 con 0x7f0790139200 2023-10-03T10:15:09.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714005d70 con 0x7f371c133f50 2023-10-03T10:15:09.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400ce30 con 0x7f371c133f50 2023-10-03T10:15:09.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07900a5220 con 0x7f0790139200 2023-10-03T10:15:09.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800f040 con 0x7f0790139200 2023-10-03T10:15:09.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788009e60 con 0x7f0790139200 2023-10-03T10:15:09.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c0a03e0 con 0x7f371c133f50 2023-10-03T10:15:09.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c126560 con 0x7f371c133f50 2023-10-03T10:15:09.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140072d0 con 0x7f371c133f50 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0790120bf0 con 0x7f0790139200 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.102+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0788014480 con 0x7f0790139200 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f078803feb0 con 0x7f0790139200 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07901221b0 con 0x7f0790139200 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3714007430 con 0x7f371c133f50 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc0052e0 con 0x7f371c133f50 2023-10-03T10:15:09.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.103+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f371403e7d0 con 0x7f371c133f50 2023-10-03T10:15:09.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.107+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07901221b0 con 0x7f0790139200 2023-10-03T10:15:09.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.108+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37140198b0 con 0x7f371c133f50 2023-10-03T10:15:09.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.301+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36fc005590 con 0x7f371c133f50 2023-10-03T10:15:09.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.301+0000 7f371a7fc700 1 -- 172.21.15.125:0/736343100 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3714017030 con 0x7f371c133f50 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.301+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07901221b0 con 0x7f0790139200 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.301+0000 7f0786ffd700 1 -- 172.21.15.125:0/4054287202 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07901221b0 con 0x7f0790139200 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 msgr2=0x7f371c1c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 0x7f371c1c8c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f371400c460 tx=0x7f371400c770 comp rx=0 tx=0).stop 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 msgr2=0x7f079011f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 0x7f079011f300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f078800efc0 tx=0x7f078800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 shutdown_connections 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c133f50 0x7f371c1c8c80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c0a0a70 0x7f371c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 --2- 172.21.15.125:0/736343100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c0a1380 0x7f371c1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 >> 172.21.15.125:0/736343100 conn(0x7f371c0a6610 msgr2=0x7f371c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 shutdown_connections 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0790139200 0x7f079011f300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07900a0a70 0x7f079011e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 --2- 172.21.15.125:0/4054287202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07900a1550 0x7f079011edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 >> 172.21.15.125:0/4054287202 conn(0x7f07900a6610 msgr2=0x7f07901381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 shutdown_connections 2023-10-03T10:15:09.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.303+0000 7f3723f4e700 1 -- 172.21.15.125:0/736343100 wait complete. 2023-10-03T10:15:09.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.304+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 shutdown_connections 2023-10-03T10:15:09.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:09.304+0000 7f079854e700 1 -- 172.21.15.125:0/4054287202 wait complete. 2023-10-03T10:15:09.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:09.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:09.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:09.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:10.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 Processor -- start 2023-10-03T10:15:10.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 -- start start 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 0x7fa1180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa11813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11809dc00 con 0x7fa1180a1380 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809ea90 con 0x7fa1180a0a70 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11cf63700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809dec0 con 0x7fa118134120 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa11659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 0x7fa1180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa115d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa1180a1380 0x7fa118133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34246/0 (socket says 172.21.15.125:34246) 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.020+0000 7fa115d9b700 1 -- 172.21.15.125:0/3170924925 learned_addr learned my addr 172.21.15.125:0/3170924925 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa116d9d700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa11813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11559a700 1 -- 172.21.15.125:0/3170924925 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826522312 0 0) 0x7fa11809dc00 con 0x7fa1180a1380 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11659c700 1 -- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 msgr2=0x7fa11813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11659c700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa11813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11659c700 1 -- 172.21.15.125:0/3170924925 >> v1:172.21.15.125:6789/0 conn(0x7fa1180a1380 legacy=0x7fa118133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11659c700 1 -- 172.21.15.125:0/3170924925 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11809e6a0 con 0x7fa1180a0a70 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11659c700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 0x7fa1180a0e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa108009870 tx=0x7fa108009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1246fc779f2cb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11559a700 1 -- 172.21.15.125:0/3170924925 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108011830 con 0x7fa1180a0a70 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11559a700 1 -- 172.21.15.125:0/3170924925 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108011990 con 0x7fa1180a0a70 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.021+0000 7fa11559a700 1 -- 172.21.15.125:0/3170924925 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108011d20 con 0x7fa1180a0a70 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 -- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 msgr2=0x7fa1180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 0x7fa1180a0e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa108009870 tx=0x7fa108009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 -- 172.21.15.125:0/3170924925 shutdown_connections 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa11813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 --2- 172.21.15.125:0/3170924925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a0a70 0x7fa1180a0e40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 -- 172.21.15.125:0/3170924925 >> 172.21.15.125:0/3170924925 conn(0x7fa1180a6610 msgr2=0x7fa1180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 -- 172.21.15.125:0/3170924925 shutdown_connections 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.022+0000 7fa11cf63700 1 -- 172.21.15.125:0/3170924925 wait complete. 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.023+0000 7fa11cf63700 1 Processor -- start 2023-10-03T10:15:10.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.023+0000 7fa11cf63700 1 -- start start 2023-10-03T10:15:10.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a1380 0x7fa118122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa118123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118125ef0 con 0x7fa1180a0a70 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa118126fe0 con 0x7fa1180a1380 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11cf63700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa118124ad0 con 0x7fa118134120 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35750/0 (socket says 172.21.15.125:35750) 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11659c700 1 -- 172.21.15.125:0/642587305 learned_addr learned my addr 172.21.15.125:0/642587305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa115d9b700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a1380 0x7fa118122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa118123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 -- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a1380 msgr2=0x7fa118122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a1380 0x7fa118122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 -- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 msgr2=0x7fa1181228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 -- 172.21.15.125:0/642587305 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080094a0 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa11659c700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa116d9d700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa118123360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa11000efc0 tx=0x7fa11000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.024+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11000cc90 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.025+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11000f040 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.025+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa118126120 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.025+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100146c0 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.025+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118133400 con 0x7fa118134120 2023-10-03T10:15:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.025+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa110014820 con 0x7fa118134120 2023-10-03T10:15:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.026+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11804f2a0 con 0x7fa118134120 2023-10-03T10:15:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.026+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1100401f0 con 0x7fa118134120 2023-10-03T10:15:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.030+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa11001d400 con 0x7fa118134120 2023-10-03T10:15:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 Processor -- start 2023-10-03T10:15:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 -- start start 2023-10-03T10:15:10.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6a809a150 0x7fa6a809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a8134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a809a520 con 0x7fa6a809a150 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a809fe00 con 0x7fa6a809edb0 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ae3e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a806bec0 con 0x7fa6a8133c20 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6a77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.061+0000 7fa6ac983700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a8134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6a809a150 0x7fa6a809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42308/0 (socket says 172.21.15.125:42308) 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a77fe700 1 -- 172.21.15.125:0/3029957746 learned_addr learned my addr 172.21.15.125:0/3029957746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 -- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 msgr2=0x7fa6a8134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a8134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 -- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 msgr2=0x7fa6a809f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 -- 172.21.15.125:0/3029957746 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a809af80 con 0x7fa6a809a150 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a77fe700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6ac983700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a8134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a7fff700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809a150 0x7fa6a809e870 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa698009870 tx=0x7fa698009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3e1c8be893b851 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a6ffd700 1 -- 172.21.15.125:0/3029957746 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698011830 con 0x7fa6a809a150 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a6ffd700 1 -- 172.21.15.125:0/3029957746 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa698011990 con 0x7fa6a809a150 2023-10-03T10:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.062+0000 7fa6a6ffd700 1 -- 172.21.15.125:0/3029957746 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698011d20 con 0x7fa6a809a150 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809a150 msgr2=0x7fa6a809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809a150 0x7fa6a809e870 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa698009870 tx=0x7fa698009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3029957746 shutdown_connections 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a8134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809a150 0x7fa6a809e870 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3029957746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809edb0 0x7fa6a809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3029957746 >> 172.21.15.125:0/3029957746 conn(0x7fa6a80a4430 msgr2=0x7fa6a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3029957746 shutdown_connections 2023-10-03T10:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.063+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3029957746 wait complete. 2023-10-03T10:15:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.064+0000 7fa6ae3e6700 1 Processor -- start 2023-10-03T10:15:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.064+0000 7fa6ae3e6700 1 -- start start 2023-10-03T10:15:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 0x7fa6a811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 0x7fa6a811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8120930 con 0x7fa6a809edb0 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8120740 con 0x7fa6a809a150 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ae3e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80a1440 con 0x7fa6a8133c20 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 0x7fa6a811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46082/0 (socket says 172.21.15.125:46082) 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 0x7fa6a811ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42322/0 (socket says 172.21.15.125:42322) 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 -- 172.21.15.125:0/3991794300 learned_addr learned my addr 172.21.15.125:0/3991794300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6a77fe700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 0x7fa6a811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 -- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 msgr2=0x7fa6a811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 0x7fa6a811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 -- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 msgr2=0x7fa6a811f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 0x7fa6a811f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 -- 172.21.15.125:0/3991794300 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009550 con 0x7fa6a8133c20 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6a77fe700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 0x7fa6a811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6ac983700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000efc0 tx=0x7fa6a000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.065+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000ca90 con 0x7fa6a8133c20 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000f040 con 0x7fa6a8133c20 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0009a70 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000ce10 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980094a0 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6a0014480 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.066+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a809fa30 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.067+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6a003fcb0 con 0x7fa6a8133c20 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.071+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6a0012930 con 0x7fa6a8133c20 2023-10-03T10:15:10.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.226+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1180a56d0 con 0x7fa118134120 2023-10-03T10:15:10.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.227+0000 7fa106ffd700 1 -- 172.21.15.125:0/642587305 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa110007330 con 0x7fa118134120 2023-10-03T10:15:10.226 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:10.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 msgr2=0x7fa118123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa118123360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa11000efc0 tx=0x7fa11000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 shutdown_connections 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa118134120 0x7fa118123360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1180a0a70 0x7fa1181228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 --2- 172.21.15.125:0/642587305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1180a1380 0x7fa118122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 >> 172.21.15.125:0/642587305 conn(0x7fa1180a6610 msgr2=0x7fa11811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 shutdown_connections 2023-10-03T10:15:10.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.229+0000 7fa11cf63700 1 -- 172.21.15.125:0/642587305 wait complete. 2023-10-03T10:15:10.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:10.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.267+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6a8121fa0 con 0x7fa6a8133c20 2023-10-03T10:15:10.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.268+0000 7fa6a4ff9700 1 -- 172.21.15.125:0/3991794300 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6a001c3b0 con 0x7fa6a8133c20 2023-10-03T10:15:10.267 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:10.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 msgr2=0x7fa6a811f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000efc0 tx=0x7fa6a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 shutdown_connections 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6a8133c20 0x7fa6a811f7b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6a809a150 0x7fa6a811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 --2- 172.21.15.125:0/3991794300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6a809edb0 0x7fa6a811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 >> 172.21.15.125:0/3991794300 conn(0x7fa6a80a4430 msgr2=0x7fa6a809ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 shutdown_connections 2023-10-03T10:15:10.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.270+0000 7fa6ae3e6700 1 -- 172.21.15.125:0/3991794300 wait complete. 2023-10-03T10:15:10.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:10.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:10.318 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:10.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.448+0000 7f7eab2ce700 1 Processor -- start 2023-10-03T10:15:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.448+0000 7f66d1e7b700 1 Processor -- start 2023-10-03T10:15:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.448+0000 7f66d1e7b700 1 -- start start 2023-10-03T10:15:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.448+0000 7f7eab2ce700 1 -- start start 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66cc133ad0 0x7f66cc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc06b2d0 con 0x7f66cc133ad0 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc133610 con 0x7f66cc1300a0 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66d1e7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc09a500 con 0x7f66cc1309f0 2023-10-03T10:15:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7eab2ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4133ad0 0x7f7ea4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7eab2ce700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea4130bc0 0x7f7ea413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7eab2ce700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea406b2d0 con 0x7f7ea41300a0 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7eab2ce700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea4133610 con 0x7f7ea4130bc0 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7eab2ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea409a500 con 0x7f7ea4133ad0 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea986b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea4130bc0 0x7f7ea413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea8869700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7ea41300a0 0x7f7ea41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34260/0 (socket says 172.21.15.125:34260) 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea8869700 1 -- 172.21.15.125:0/981245612 learned_addr learned my addr 172.21.15.125:0/981245612 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66cc133ad0 0x7f66cc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66cc133ad0 0x7f66cc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35774/0 (socket says 172.21.15.125:35774) 2023-10-03T10:15:10.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46092/0 (socket says 172.21.15.125:46092) 2023-10-03T10:15:10.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 -- 172.21.15.125:0/3277289051 learned_addr learned my addr 172.21.15.125:0/3277289051 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea906a700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4133ad0 0x7f7ea4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66caffd700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 -- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 msgr2=0x7f66cc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 -- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 msgr2=0x7f66cc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f66cb7fe700 1 -- 172.21.15.125:0/3277289051 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc1338b0 con 0x7f66cc133ad0 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea986b700 1 -- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4133ad0 msgr2=0x7f7ea4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea986b700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4133ad0 0x7f7ea4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea986b700 1 -- 172.21.15.125:0/981245612 >> v1:172.21.15.125:6789/0 conn(0x7f7ea41300a0 legacy=0x7f7ea41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea986b700 1 -- 172.21.15.125:0/981245612 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea41338b0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.449+0000 7f7ea3fff700 1 -- 172.21.15.125:0/981245612 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475326511 0 0) 0x7f7ea406b2d0 con 0x7f7ea41300a0 2023-10-03T10:15:10.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66cb7fe700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc133ea0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0098f0 tx=0x7f66bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4830b6e9cc0619 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7ea986b700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4130bc0 0x7f7ea413b990 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c83472ceb5ef8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66ca7fc700 1 -- 172.21.15.125:0/3277289051 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc011830 con 0x7f66cc133ad0 2023-10-03T10:15:10.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66ca7fc700 1 -- 172.21.15.125:0/3277289051 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc011990 con 0x7f66cc133ad0 2023-10-03T10:15:10.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7ea3fff700 1 -- 172.21.15.125:0/981245612 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00e070 con 0x7f7ea4130bc0 2023-10-03T10:15:10.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66ca7fc700 1 -- 172.21.15.125:0/3277289051 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc011d20 con 0x7f66cc133ad0 2023-10-03T10:15:10.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7ea3fff700 1 -- 172.21.15.125:0/981245612 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00bb20 con 0x7f7ea4130bc0 2023-10-03T10:15:10.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7ea3fff700 1 -- 172.21.15.125:0/981245612 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c012430 con 0x7f7ea4130bc0 2023-10-03T10:15:10.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 -- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 msgr2=0x7f66cc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc133ea0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0098f0 tx=0x7f66bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:10.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7eab2ce700 1 -- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4130bc0 msgr2=0x7f7ea413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4130bc0 0x7f7ea413b990 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 -- 172.21.15.125:0/3277289051 shutdown_connections 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc133ea0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/3277289051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 -- 172.21.15.125:0/3277289051 >> 172.21.15.125:0/3277289051 conn(0x7f66cc099c40 msgr2=0x7f66cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f66d1e7b700 1 -- 172.21.15.125:0/3277289051 shutdown_connections 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7eab2ce700 1 -- 172.21.15.125:0/981245612 shutdown_connections 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4130bc0 0x7f7ea413b990 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.450+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/981245612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4133ad0 0x7f7ea4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.451+0000 7f7eab2ce700 1 -- 172.21.15.125:0/981245612 >> 172.21.15.125:0/981245612 conn(0x7f7ea4099c40 msgr2=0x7f7ea40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.451+0000 7f66d1e7b700 1 -- 172.21.15.125:0/3277289051 wait complete. 2023-10-03T10:15:10.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.451+0000 7f7eab2ce700 1 -- 172.21.15.125:0/981245612 shutdown_connections 2023-10-03T10:15:10.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.451+0000 7f7eab2ce700 1 -- 172.21.15.125:0/981245612 wait complete. 2023-10-03T10:15:10.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f66d1e7b700 1 Processor -- start 2023-10-03T10:15:10.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f7eab2ce700 1 Processor -- start 2023-10-03T10:15:10.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f7eab2ce700 1 -- start start 2023-10-03T10:15:10.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f66d1e7b700 1 -- start start 2023-10-03T10:15:10.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f7eab2ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.452+0000 7f7eab2ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 0x7f7ea411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7eab2ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4133ad0 0x7f7ea411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7eab2ce700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41208e0 con 0x7f7ea4133ad0 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7eab2ce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea411f9d0 con 0x7f7ea41300a0 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7eab2ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4120070 con 0x7f7ea4130bc0 2023-10-03T10:15:10.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc120950 con 0x7f66cc133ad0 2023-10-03T10:15:10.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0721d0 con 0x7f66cc1300a0 2023-10-03T10:15:10.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66d1e7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc12f850 con 0x7f66cc1309f0 2023-10-03T10:15:10.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea906a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 0x7f7ea411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea906a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42330/0 (socket says 172.21.15.125:42330) 2023-10-03T10:15:10.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea906a700 1 -- 172.21.15.125:0/540455799 learned_addr learned my addr 172.21.15.125:0/540455799 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35806/0 (socket says 172.21.15.125:35806) 2023-10-03T10:15:10.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 -- 172.21.15.125:0/2519103765 learned_addr learned my addr 172.21.15.125:0/2519103765 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:10.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66caffd700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea986b700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4133ad0 0x7f7ea411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cb7fe700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 -- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 msgr2=0x7f7ea411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 -- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4133ad0 msgr2=0x7f7ea411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4133ad0 0x7f7ea411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 -- 172.21.15.125:0/540455799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009a70 con 0x7f7ea4130bc0 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 -- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 msgr2=0x7f66cc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 -- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 msgr2=0x7f66cc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea906a700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 -- 172.21.15.125:0/2519103765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009550 con 0x7f66cc133ad0 2023-10-03T10:15:10.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea8869700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 0x7f7ea411df80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7ea409ea20 tx=0x7f7e9800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66cbfff700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f66c400efc0 tx=0x7f66c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98004c80 con 0x7f7ea4130bc0 2023-10-03T10:15:10.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.453+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4009ea0 con 0x7f66cc133ad0 2023-10-03T10:15:10.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e98004de0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea411ee50 con 0x7f7ea4130bc0 2023-10-03T10:15:10.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400f040 con 0x7f66cc133ad0 2023-10-03T10:15:10.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400ced0 con 0x7f66cc133ad0 2023-10-03T10:15:10.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007310 con 0x7f7ea4130bc0 2023-10-03T10:15:10.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc12dd00 con 0x7f66cc133ad0 2023-10-03T10:15:10.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc11fd00 con 0x7f66cc133ad0 2023-10-03T10:15:10.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.454+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea40a34a0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66c4014480 con 0x7f66cc133ad0 2023-10-03T10:15:10.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e98007470 con 0x7f7ea4130bc0 2023-10-03T10:15:10.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66c4040220 con 0x7f66cc133ad0 2023-10-03T10:15:10.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc09cb20 con 0x7f66cc133ad0 2023-10-03T10:15:10.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e9803f1e0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.455+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea409cb20 con 0x7f7ea4130bc0 2023-10-03T10:15:10.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.460+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66c4007920 con 0x7f66cc133ad0 2023-10-03T10:15:10.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.460+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e980102c0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.654+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ea404f2a0 con 0x7f7ea4130bc0 2023-10-03T10:15:10.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.654+0000 7f7ea1ffb700 1 -- 172.21.15.125:0/540455799 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e98011e80 con 0x7f7ea4130bc0 2023-10-03T10:15:10.654 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:10.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66cc04f2a0 con 0x7f66cc133ad0 2023-10-03T10:15:10.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 msgr2=0x7f7ea411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 0x7f7ea411df80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7ea409ea20 tx=0x7f7e9800c6a0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f66b3fff700 1 -- 172.21.15.125:0/2519103765 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66c402a030 con 0x7f66cc133ad0 2023-10-03T10:15:10.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 shutdown_connections 2023-10-03T10:15:10.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea4133ad0 0x7f7ea411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea41300a0 0x7f7ea411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 --2- 172.21.15.125:0/540455799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea4130bc0 0x7f7ea411df80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 >> 172.21.15.125:0/540455799 conn(0x7f7ea4099c40 msgr2=0x7f7ea4132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.657 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:10.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.656+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 shutdown_connections 2023-10-03T10:15:10.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.657+0000 7f7eab2ce700 1 -- 172.21.15.125:0/540455799 wait complete. 2023-10-03T10:15:10.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 msgr2=0x7f66cc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f66c400efc0 tx=0x7f66c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 shutdown_connections 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66cc133ad0 0x7f66cc11e4c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66cc1300a0 0x7f66cc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 --2- 172.21.15.125:0/2519103765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66cc1309f0 0x7f66cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.658+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 >> 172.21.15.125:0/2519103765 conn(0x7f66cc099c40 msgr2=0x7f66cc132c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.659+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 shutdown_connections 2023-10-03T10:15:10.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:10.659+0000 7f66d1e7b700 1 -- 172.21.15.125:0/2519103765 wait complete. 2023-10-03T10:15:10.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:10.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:11.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:11.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 Processor -- start 2023-10-03T10:15:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 -- start start 2023-10-03T10:15:11.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 0x7fc064133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc0641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06409e9d0 con 0x7fc0640a0a70 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06409dc00 con 0x7fc064133f50 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06900e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc06409dec0 con 0x7fc0640a1380 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc062d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 0x7fc064133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc062d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35820/0 (socket says 172.21.15.125:35820) 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc062d9d700 1 -- 172.21.15.125:0/1935791074 learned_addr learned my addr 172.21.15.125:0/1935791074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.376+0000 7fc06359e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc0641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 -- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 msgr2=0x7fc064133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 0x7fc064133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 -- 172.21.15.125:0/1935791074 >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 msgr2=0x7fc0640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 --2- 172.21.15.125:0/1935791074 >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 -- 172.21.15.125:0/1935791074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06409e6a0 con 0x7fc064133f50 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc062d9d700 1 --2- 172.21.15.125:0/1935791074 >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06259c700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 0x7fc064133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc06359e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc0641343b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fdadd459480e5b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc061d9b700 1 -- 172.21.15.125:0/1935791074 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc064133f50 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc061d9b700 1 -- 172.21.15.125:0/1935791074 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00bb20 con 0x7fc064133f50 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.377+0000 7fc061d9b700 1 -- 172.21.15.125:0/1935791074 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012430 con 0x7fc064133f50 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 -- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 msgr2=0x7fc0641343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc0641343b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 -- 172.21.15.125:0/1935791074 shutdown_connections 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc0641343b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 --2- 172.21.15.125:0/1935791074 >> v2:172.21.15.125:3300/0 conn(0x7fc0640a0a70 0x7fc0640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 --2- 172.21.15.125:0/1935791074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a1380 0x7fc064133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 -- 172.21.15.125:0/1935791074 >> 172.21.15.125:0/1935791074 conn(0x7fc0640a6610 msgr2=0x7fc0640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 -- 172.21.15.125:0/1935791074 shutdown_connections 2023-10-03T10:15:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.378+0000 7fc06900e700 1 -- 172.21.15.125:0/1935791074 wait complete. 2023-10-03T10:15:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 Processor -- start 2023-10-03T10:15:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 -- start start 2023-10-03T10:15:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 0x7fc064121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc064121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc064124e50 con 0x7fc0640a1380 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc064123dd0 con 0x7fc064133f50 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.379+0000 7fc06900e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640a03e0 con 0x7fc0640a0a70 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 0x7fc064121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46136/0 (socket says 172.21.15.125:46136) 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 -- 172.21.15.125:0/1370969623 learned_addr learned my addr 172.21.15.125:0/1370969623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06359e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc064121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 -- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 msgr2=0x7fc064121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc064121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 -- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 msgr2=0x7fc064121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 0x7fc064121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 -- 172.21.15.125:0/1370969623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009550 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06259c700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 0x7fc064121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06359e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc064121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc062d9d700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc05400ebb0 tx=0x7fc05400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054004030 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054004190 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054004520 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0580094a0 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.380+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c009a70 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.381+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc05400c850 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.381+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06411e040 con 0x7fc0640a0a70 2023-10-03T10:15:11.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.381+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc05403f5c0 con 0x7fc0640a0a70 2023-10-03T10:15:11.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.386+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0540036a0 con 0x7fc0640a0a70 2023-10-03T10:15:11.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.426+0000 7fae4382d700 1 Processor -- start 2023-10-03T10:15:11.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.426+0000 7fae4382d700 1 -- start start 2023-10-03T10:15:11.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae4382d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae3c0a0a70 0x7fae3c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae4382d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae4382d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c09dc00 con 0x7fae3c0a1380 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae4382d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c09ea90 con 0x7fae3c0a0a70 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae4382d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c09dec0 con 0x7fae3c134120 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae41dca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae415c9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae3c0a0a70 0x7fae3c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae415c9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae3c0a0a70 0x7fae3c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35834/0 (socket says 172.21.15.125:35834) 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae41dca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42370/0 (socket says 172.21.15.125:42370) 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae415c9700 1 -- 172.21.15.125:0/1056798952 learned_addr learned my addr 172.21.15.125:0/1056798952 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.427+0000 7fae40dc8700 1 --1- 172.21.15.125:0/1056798952 >> v1:172.21.15.125:6789/0 conn(0x7fae3c0a1380 0x7fae3c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34274/0 (socket says 172.21.15.125:34274) 2023-10-03T10:15:11.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae33fff700 1 -- 172.21.15.125:0/1056798952 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031288486 0 0) 0x7fae3c09dc00 con 0x7fae3c0a1380 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae33fff700 1 -- 172.21.15.125:0/1056798952 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae280035b0 con 0x7fae3c0a1380 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae415c9700 1 -- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 msgr2=0x7fae3c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae415c9700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae415c9700 1 -- 172.21.15.125:0/1056798952 >> v1:172.21.15.125:6789/0 conn(0x7fae3c0a1380 legacy=0x7fae3c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae415c9700 1 -- 172.21.15.125:0/1056798952 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c09e6a0 con 0x7fae3c0a0a70 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae41dca700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae415c9700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c0a0a70 0x7fae3c0a0e40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fae380098f0 tx=0x7fae38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fc2e9c1cc1b175 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae33fff700 1 -- 172.21.15.125:0/1056798952 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38011830 con 0x7fae3c0a0a70 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae33fff700 1 -- 172.21.15.125:0/1056798952 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38011990 con 0x7fae3c0a0a70 2023-10-03T10:15:11.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.428+0000 7fae33fff700 1 -- 172.21.15.125:0/1056798952 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38011d20 con 0x7fae3c0a0a70 2023-10-03T10:15:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 -- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c0a0a70 msgr2=0x7fae3c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c0a0a70 0x7fae3c0a0e40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fae380098f0 tx=0x7fae38009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 -- 172.21.15.125:0/1056798952 shutdown_connections 2023-10-03T10:15:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c134120 0x7fae3c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 --2- 172.21.15.125:0/1056798952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c0a0a70 0x7fae3c0a0e40 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 -- 172.21.15.125:0/1056798952 >> 172.21.15.125:0/1056798952 conn(0x7fae3c0a6610 msgr2=0x7fae3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 -- 172.21.15.125:0/1056798952 shutdown_connections 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.429+0000 7fae4382d700 1 -- 172.21.15.125:0/1056798952 wait complete. 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.430+0000 7fae4382d700 1 Processor -- start 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.430+0000 7fae4382d700 1 -- start start 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c0a1380 0x7fae3c122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c123b10 con 0x7fae3c134120 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c125c30 con 0x7fae3c0a0a70 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae4382d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c133600 con 0x7fae3c0a1380 2023-10-03T10:15:11.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35850/0 (socket says 172.21.15.125:35850) 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 -- 172.21.15.125:0/665021814 learned_addr learned my addr 172.21.15.125:0/665021814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae40dc8700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c0a1380 0x7fae3c122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae415c9700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 -- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c0a1380 msgr2=0x7fae3c122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c0a1380 0x7fae3c122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 -- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 msgr2=0x7fae3c1226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 -- 172.21.15.125:0/665021814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009a70 con 0x7fae3c134120 2023-10-03T10:15:11.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae41dca700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efc0 tx=0x7fae3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.431+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400ca90 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.432+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400f040 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.432+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae38009550 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.432+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400ce10 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.432+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c126960 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.432+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae34014480 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.433+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae3403fd60 con 0x7fae3c134120 2023-10-03T10:15:11.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.433+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c125e50 con 0x7fae3c134120 2023-10-03T10:15:11.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.438+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae34012930 con 0x7fae3c134120 2023-10-03T10:15:11.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.609+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc064122fa0 con 0x7fc0640a0a70 2023-10-03T10:15:11.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.610+0000 7fc04b7fe700 1 -- 172.21.15.125:0/1370969623 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc054013e60 con 0x7fc0640a0a70 2023-10-03T10:15:11.610 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 msgr2=0x7fc064121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc05400ebb0 tx=0x7fc05400eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 shutdown_connections 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc064133f50 0x7fc064121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc0640a0a70 0x7fc064121330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 --2- 172.21.15.125:0/1370969623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0640a1380 0x7fc064121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 >> 172.21.15.125:0/1370969623 conn(0x7fc0640a6610 msgr2=0x7fc064133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 shutdown_connections 2023-10-03T10:15:11.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.612+0000 7fc06900e700 1 -- 172.21.15.125:0/1370969623 wait complete. 2023-10-03T10:15:11.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:11.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.644+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae3c04f2a0 con 0x7fae3c134120 2023-10-03T10:15:11.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.644+0000 7fae31ffb700 1 -- 172.21.15.125:0/665021814 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae3402b090 con 0x7fae3c134120 2023-10-03T10:15:11.644 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 msgr2=0x7fae3c123130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efc0 tx=0x7fae3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 shutdown_connections 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c134120 0x7fae3c123130 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 --2- 172.21.15.125:0/665021814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c0a1380 0x7fae3c122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 >> 172.21.15.125:0/665021814 conn(0x7fae3c0a6610 msgr2=0x7fae3c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 shutdown_connections 2023-10-03T10:15:11.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.646+0000 7fae4382d700 1 -- 172.21.15.125:0/665021814 wait complete. 2023-10-03T10:15:11.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:11.670 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:11.671 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:11.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.822+0000 7f01f86b5700 1 Processor -- start 2023-10-03T10:15:11.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.822+0000 7f01f86b5700 1 -- start start 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.822+0000 7fd14d7d1700 1 Processor -- start 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.822+0000 7fd14d7d1700 1 -- start start 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 0x7fd14809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd14809a730 0x7fd148130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14809bf50 con 0x7fd14809a730 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd148099a60 con 0x7fd148130890 2023-10-03T10:15:11.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd14d7d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14809b230 con 0x7fd148099e20 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f86b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a1550 0x7f01f0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f86b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01f0139200 0x7f01f013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f86b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f009e9d0 con 0x7f01f00a0a70 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f86b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f009dc00 con 0x7f01f0139200 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f86b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01f009dec0 con 0x7f01f00a1550 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd1477fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd146ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 0x7fd14809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd1467fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd14809a730 0x7fd148130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd1477fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42390/0 (socket says 172.21.15.125:42390) 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7fd1477fe700 1 -- 172.21.15.125:0/2337264111 learned_addr learned my addr 172.21.15.125:0/2337264111 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f6c52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01f0139200 0x7f01f013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f6c52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01f0139200 0x7f01f013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35856/0 (socket says 172.21.15.125:35856) 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f6c52700 1 -- 172.21.15.125:0/331154196 learned_addr learned my addr 172.21.15.125:0/331154196 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.823+0000 7f01f5c50700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a1550 0x7f01f0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f6c52700 1 -- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a1550 msgr2=0x7f01f0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f6c52700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a1550 0x7f01f0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f6c52700 1 -- 172.21.15.125:0/331154196 >> v1:172.21.15.125:6789/0 conn(0x7f01f00a0a70 legacy=0x7f01f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f6c52700 1 -- 172.21.15.125:0/331154196 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f009e6a0 con 0x7f01f0139200 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 -- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 msgr2=0x7fd14809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 0x7fd14809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 -- 172.21.15.125:0/2337264111 >> v2:172.21.15.125:3300/0 conn(0x7fd14809a730 msgr2=0x7fd148130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 --2- 172.21.15.125:0/2337264111 >> v2:172.21.15.125:3300/0 conn(0x7fd14809a730 0x7fd148130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 -- 172.21.15.125:0/2337264111 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14809bb90 con 0x7fd148130890 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd146ffd700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 0x7fd14809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd1477fe700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d150 tx=0x7fd14000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c218acaabbba34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f6c52700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f013b5e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009e50 tx=0x7f01e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d149aaef31da9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd145ffb700 1 -- 172.21.15.125:0/2337264111 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140010070 con 0x7fd148130890 2023-10-03T10:15:11.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd145ffb700 1 -- 172.21.15.125:0/2337264111 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000dd10 con 0x7fd148130890 2023-10-03T10:15:11.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f544f700 1 -- 172.21.15.125:0/331154196 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e800e070 con 0x7f01f0139200 2023-10-03T10:15:11.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7fd145ffb700 1 -- 172.21.15.125:0/2337264111 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000b310 con 0x7fd148130890 2023-10-03T10:15:11.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f544f700 1 -- 172.21.15.125:0/331154196 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e800b910 con 0x7f01f0139200 2023-10-03T10:15:11.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.824+0000 7f01f544f700 1 -- 172.21.15.125:0/331154196 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e800bcc0 con 0x7f01f0139200 2023-10-03T10:15:11.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 -- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 msgr2=0x7fd148130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 -- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 msgr2=0x7f01f013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d150 tx=0x7fd14000d460 comp rx=0 tx=0).stop 2023-10-03T10:15:11.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f013b5e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009e50 tx=0x7f01e800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 -- 172.21.15.125:0/331154196 shutdown_connections 2023-10-03T10:15:11.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f013b5e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 --2- 172.21.15.125:0/331154196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a1550 0x7f01f0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 -- 172.21.15.125:0/331154196 >> 172.21.15.125:0/331154196 conn(0x7f01f00a6610 msgr2=0x7f01f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 -- 172.21.15.125:0/2337264111 shutdown_connections 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148130890 0x7fd148130d00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/2337264111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148099e20 0x7fd14809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/2337264111 >> v2:172.21.15.125:3300/0 conn(0x7fd14809a730 0x7fd148130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 -- 172.21.15.125:0/2337264111 >> 172.21.15.125:0/2337264111 conn(0x7fd1480a2980 msgr2=0x7fd1480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 -- 172.21.15.125:0/331154196 shutdown_connections 2023-10-03T10:15:11.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7f01f86b5700 1 -- 172.21.15.125:0/331154196 wait complete. 2023-10-03T10:15:11.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 -- 172.21.15.125:0/2337264111 shutdown_connections 2023-10-03T10:15:11.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.825+0000 7fd14d7d1700 1 -- 172.21.15.125:0/2337264111 wait complete. 2023-10-03T10:15:11.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 Processor -- start 2023-10-03T10:15:11.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 -- start start 2023-10-03T10:15:11.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 Processor -- start 2023-10-03T10:15:11.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 -- start start 2023-10-03T10:15:11.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 0x7f01f011e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f011f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00a0470 con 0x7f01f0139200 2023-10-03T10:15:11.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0122050 con 0x7f01f00a1550 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f86b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0121aa0 con 0x7f01f00a0a70 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f6451700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 0x7f01f011e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f5c50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f6451700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 0x7f01f011e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46168/0 (socket says 172.21.15.125:46168) 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f5c50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42400/0 (socket says 172.21.15.125:42400) 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f6451700 1 -- 172.21.15.125:0/3121596283 learned_addr learned my addr 172.21.15.125:0/3121596283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14809a730 0x7fd148120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 0x7fd148120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481217c0 con 0x7fd14809a730 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd148121050 con 0x7fd148099e20 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7fd14d7d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd148122db0 con 0x7fd148130890 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42408/0 (socket says 172.21.15.125:42408) 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 -- 172.21.15.125:0/413191450 learned_addr learned my addr 172.21.15.125:0/413191450 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.826+0000 7f01f6c52700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f011f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 -- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 msgr2=0x7f01f011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 0x7f01f011e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 -- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 msgr2=0x7f01f011f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f011f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 -- 172.21.15.125:0/3121596283 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8009b30 con 0x7f01f00a1550 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd1477fe700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 0x7fd148120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 -- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 msgr2=0x7fd148120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 0x7fd148120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f5c50700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e930 tx=0x7f01e000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 -- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14809a730 msgr2=0x7fd148120130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14809a730 0x7fd148120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 -- 172.21.15.125:0/413191450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009430 con 0x7fd148099e20 2023-10-03T10:15:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd1477fe700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 0x7fd148120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0013680 con 0x7f01f00a1550 2023-10-03T10:15:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00137e0 con 0x7f01f00a1550 2023-10-03T10:15:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0013b50 con 0x7f01f00a1550 2023-10-03T10:15:11.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f00a5190 con 0x7f01f00a1550 2023-10-03T10:15:11.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd146ffd700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd13800ec10 tx=0x7fd138009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0120c10 con 0x7f01f00a1550 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138005a20 con 0x7fd148099e20 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138005b80 con 0x7fd148099e20 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14000bd40 con 0x7fd148099e20 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.827+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800c940 con 0x7fd148099e20 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.828+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd148123130 con 0x7fd148099e20 2023-10-03T10:15:11.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.828+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd13800caa0 con 0x7fd148099e20 2023-10-03T10:15:11.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.828+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01e0013cb0 con 0x7f01f00a1550 2023-10-03T10:15:11.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.828+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01e003f6a0 con 0x7f01f00a1550 2023-10-03T10:15:11.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.828+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f004f2a0 con 0x7f01f00a1550 2023-10-03T10:15:11.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.829+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd13803faa0 con 0x7fd148099e20 2023-10-03T10:15:11.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.829+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14812d6e0 con 0x7fd148099e20 2023-10-03T10:15:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.833+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01e001be10 con 0x7f01f00a1550 2023-10-03T10:15:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:11.841+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd138020070 con 0x7fd148099e20 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.030+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01f0121cf0 con 0x7f01f00a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.030+0000 7f01e6ffd700 1 -- 172.21.15.125:0/3121596283 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01f0121cf0 con 0x7f01f00a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd14804f2a0 con 0x7fd148099e20 2023-10-03T10:15:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 msgr2=0x7f01f011ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e930 tx=0x7f01e000ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 shutdown_connections 2023-10-03T10:15:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01f0139200 0x7f01f011f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f01f00a0a70 0x7f01f011e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 --2- 172.21.15.125:0/3121596283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01f00a1550 0x7f01f011ede0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 >> 172.21.15.125:0/3121596283 conn(0x7f01f00a6610 msgr2=0x7f01f0136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 shutdown_connections 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7f01f86b5700 1 -- 172.21.15.125:0/3121596283 wait complete. 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.032+0000 7fd12f7fe700 1 -- 172.21.15.125:0/413191450 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd138029090 con 0x7fd148099e20 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 msgr2=0x7fd14811fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd13800ec10 tx=0x7fd138009ea0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 shutdown_connections 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd148130890 0x7fd148120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd148099e20 0x7fd14811fbf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 --2- 172.21.15.125:0/413191450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14809a730 0x7fd148120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 >> 172.21.15.125:0/413191450 conn(0x7fd1480a2980 msgr2=0x7fd14809faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 shutdown_connections 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.034+0000 7fd14d7d1700 1 -- 172.21.15.125:0/413191450 wait complete. 2023-10-03T10:15:12.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:12.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:12.625 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:12.658 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:12.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.760+0000 7fa797b9d700 1 Processor -- start 2023-10-03T10:15:12.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.760+0000 7fa797b9d700 1 -- start start 2023-10-03T10:15:12.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa797b9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa797b9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7900a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa797b9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79009b110 con 0x7fa790133f70 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa797b9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900a3b60 con 0x7fa7901343a0 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa797b9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900a2fa0 con 0x7fa79009ad40 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795138700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa790133f70 0x7fa7900a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34294/0 (socket says 172.21.15.125:34294) 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795138700 1 -- 172.21.15.125:0/4079671744 learned_addr learned my addr 172.21.15.125:0/4079671744 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46186/0 (socket says 172.21.15.125:46186) 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa79613a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7900a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa794937700 1 -- 172.21.15.125:0/4079671744 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236878424 0 0) 0x7fa79009b110 con 0x7fa790133f70 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 -- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 msgr2=0x7fa7900a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7900a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 -- 172.21.15.125:0/4079671744 >> v1:172.21.15.125:6789/0 conn(0x7fa790133f70 legacy=0x7fa7900a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 -- 172.21.15.125:0/4079671744 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79009a280 con 0x7fa79009ad40 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa79613a700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7900a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa795939700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009870 tx=0x7fa78c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe36f7131c91fd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa794937700 1 -- 172.21.15.125:0/4079671744 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011830 con 0x7fa79009ad40 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa794937700 1 -- 172.21.15.125:0/4079671744 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c011990 con 0x7fa79009ad40 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.761+0000 7fa794937700 1 -- 172.21.15.125:0/4079671744 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011d20 con 0x7fa79009ad40 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 -- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 msgr2=0x7fa790133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009870 tx=0x7fa78c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 -- 172.21.15.125:0/4079671744 shutdown_connections 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7900a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 --2- 172.21.15.125:0/4079671744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa790133a30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 -- 172.21.15.125:0/4079671744 >> 172.21.15.125:0/4079671744 conn(0x7fa790099c40 msgr2=0x7fa79006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 -- 172.21.15.125:0/4079671744 shutdown_connections 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.762+0000 7fa797b9d700 1 -- 172.21.15.125:0/4079671744 wait complete. 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.763+0000 7fa797b9d700 1 Processor -- start 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.763+0000 7fa797b9d700 1 -- start start 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa790133f70 0x7fa7901c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7901c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa790121c70 con 0x7fa790133f70 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7901218f0 con 0x7fa7901343a0 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa797b9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7901c5cd0 con 0x7fa79009ad40 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa795939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa79613a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7901c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa795939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46198/0 (socket says 172.21.15.125:46198) 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa795939700 1 -- 172.21.15.125:0/1138704361 learned_addr learned my addr 172.21.15.125:0/1138704361 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.764+0000 7fa795138700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa790133f70 0x7fa7901c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 -- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 msgr2=0x7fa7901c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 -- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa790133f70 msgr2=0x7fa7901c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa790133f70 0x7fa7901c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 -- 172.21.15.125:0/1138704361 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788009a70 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa795939700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa79613a700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7901c8290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa788009e50 tx=0x7fa78800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800ca90 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800f040 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c0094a0 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800ce50 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.765+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79009c7e0 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.766+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa788014480 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.766+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa78803fc60 con 0x7fa7901343a0 2023-10-03T10:15:12.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.766+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79009e9a0 con 0x7fa7901343a0 2023-10-03T10:15:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.770+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa788012930 con 0x7fa7901343a0 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 Processor -- start 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 -- start start 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 0x7faeec09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faeec09e170 0x7faeec1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec09aaa0 con 0x7faeec130ce0 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec09f870 con 0x7faeec09e170 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faef115e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec09b360 con 0x7faeec09d860 2023-10-03T10:15:12.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faeea59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faeec09e170 0x7faeec1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faeea59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faeec09e170 0x7faeec1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35888/0 (socket says 172.21.15.125:35888) 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faeea59c700 1 -- 172.21.15.125:0/3750761735 learned_addr learned my addr 172.21.15.125:0/3750761735 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faeeb59e700 1 --1- 172.21.15.125:0/3750761735 >> v1:172.21.15.125:6789/0 conn(0x7faeec130ce0 0x7faeec1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34298/0 (socket says 172.21.15.125:34298) 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.798+0000 7faeead9d700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 0x7faeec09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeea59c700 1 -- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 msgr2=0x7faeec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeea59c700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 0x7faeec09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeea59c700 1 -- 172.21.15.125:0/3750761735 >> v1:172.21.15.125:6789/0 conn(0x7faeec130ce0 legacy=0x7faeec1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeea59c700 1 -- 172.21.15.125:0/3750761735 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec09b620 con 0x7faeec09e170 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faee9d9b700 1 -- 172.21.15.125:0/3750761735 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225186707 0 0) 0x7faeec09aaa0 con 0x7faeec130ce0 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeead9d700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 0x7faeec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faeea59c700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09e170 0x7faeec1307a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7faedc00bb90 tx=0x7faedc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569ed281cfa2bf07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faee9d9b700 1 -- 172.21.15.125:0/3750761735 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00dd30 con 0x7faeec09e170 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faee9d9b700 1 -- 172.21.15.125:0/3750761735 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00de90 con 0x7faeec09e170 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faee9d9b700 1 -- 172.21.15.125:0/3750761735 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc010690 con 0x7faeec09e170 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 -- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09e170 msgr2=0x7faeec1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09e170 0x7faeec1307a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7faedc00bb90 tx=0x7faedc00bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 -- 172.21.15.125:0/3750761735 shutdown_connections 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09d860 0x7faeec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 --2- 172.21.15.125:0/3750761735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09e170 0x7faeec1307a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 -- 172.21.15.125:0/3750761735 >> 172.21.15.125:0/3750761735 conn(0x7faeec099c40 msgr2=0x7faeec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 -- 172.21.15.125:0/3750761735 shutdown_connections 2023-10-03T10:15:12.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.799+0000 7faef115e700 1 -- 172.21.15.125:0/3750761735 wait complete. 2023-10-03T10:15:12.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 Processor -- start 2023-10-03T10:15:12.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 -- start start 2023-10-03T10:15:12.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09d860 0x7faeec11e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec121c80 con 0x7faeec09d860 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec120160 con 0x7faeec09e170 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faef115e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeec120600 con 0x7faeec130ce0 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeeb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42452/0 (socket says 172.21.15.125:42452) 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeeb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46202/0 (socket says 172.21.15.125:46202) 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeea59c700 1 -- 172.21.15.125:0/2066393773 learned_addr learned my addr 172.21.15.125:0/2066393773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.801+0000 7faeead9d700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09d860 0x7faeec11e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 -- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 msgr2=0x7faeec11eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 -- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09d860 msgr2=0x7faeec11e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09d860 0x7faeec11e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 -- 172.21.15.125:0/2066393773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00094a0 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeeb59e700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faeea59c700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faedc000c00 tx=0x7faedc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc01f070 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc003970 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc003d40 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc00b7f0 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.802+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec072770 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.803+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faedc019400 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.803+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faedc042860 con 0x7faeec09e170 2023-10-03T10:15:12.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.803+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec1227b0 con 0x7faeec09e170 2023-10-03T10:15:12.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.808+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faedc00f3d0 con 0x7faeec09e170 2023-10-03T10:15:12.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.964+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa79004f2a0 con 0x7fa7901343a0 2023-10-03T10:15:12.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.965+0000 7fa7867fc700 1 -- 172.21.15.125:0/1138704361 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa78802a090 con 0x7fa7901343a0 2023-10-03T10:15:12.964 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:12.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 msgr2=0x7fa7901c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7901c8290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa788009e50 tx=0x7fa78800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 shutdown_connections 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7901343a0 0x7fa7901c8290 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa79009ad40 0x7fa7901c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 --2- 172.21.15.125:0/1138704361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa790133f70 0x7fa7901c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 >> 172.21.15.125:0/1138704361 conn(0x7fa790099c40 msgr2=0x7fa790133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 shutdown_connections 2023-10-03T10:15:12.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:12.967+0000 7fa797b9d700 1 -- 172.21.15.125:0/1138704361 wait complete. 2023-10-03T10:15:12.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:13.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.000+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faeec04f2a0 con 0x7faeec09e170 2023-10-03T10:15:13.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.001+0000 7faed37fe700 1 -- 172.21.15.125:0/2066393773 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faedc019e60 con 0x7faeec09e170 2023-10-03T10:15:13.000 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 msgr2=0x7faeec11e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faedc000c00 tx=0x7faedc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 shutdown_connections 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeec130ce0 0x7faeec11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeec09d860 0x7faeec11e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 --2- 172.21.15.125:0/2066393773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeec09e170 0x7faeec11e980 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 >> 172.21.15.125:0/2066393773 conn(0x7faeec099c40 msgr2=0x7faeec0a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 shutdown_connections 2023-10-03T10:15:13.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.003+0000 7faef115e700 1 -- 172.21.15.125:0/2066393773 wait complete. 2023-10-03T10:15:13.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:13.046 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:13.048 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:13.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.179+0000 7f4ce55be700 1 Processor -- start 2023-10-03T10:15:13.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 Processor -- start 2023-10-03T10:15:13.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 -- start start 2023-10-03T10:15:13.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 -- start start 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ce0133f50 0x7f4ce01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce009e9d0 con 0x7f4ce0133f50 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce009dc00 con 0x7f4ce00a1380 2023-10-03T10:15:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4ce55be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce009dec0 con 0x7f4ce00a0a70 2023-10-03T10:15:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 0x7f64c81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c809aaa0 con 0x7f64c809d860 2023-10-03T10:15:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c809e730 con 0x7f64c809e340 2023-10-03T10:15:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64cda43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c809f870 con 0x7f64c8135f20 2023-10-03T10:15:13.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4cde7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4cde7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42468/0 (socket says 172.21.15.125:42468) 2023-10-03T10:15:13.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4cde7fc700 1 -- 172.21.15.125:0/508545563 learned_addr learned my addr 172.21.15.125:0/508545563 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:13.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64c77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64c77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42476/0 (socket says 172.21.15.125:42476) 2023-10-03T10:15:13.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64c77fe700 1 -- 172.21.15.125:0/2404472984 learned_addr learned my addr 172.21.15.125:0/2404472984 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:13.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4cdeffd700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f64c67fc700 1 --2- 172.21.15.125:0/2404472984 >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 0x7f64c81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.180+0000 7f4cdf7fe700 1 --2- 172.21.15.125:0/508545563 >> v2:172.21.15.125:3300/0 conn(0x7f4ce0133f50 0x7f4ce01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c77fe700 1 -- 172.21.15.125:0/2404472984 >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 msgr2=0x7f64c81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c77fe700 1 --2- 172.21.15.125:0/2404472984 >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 0x7f64c81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c77fe700 1 -- 172.21.15.125:0/2404472984 >> v1:172.21.15.125:6789/0 conn(0x7f64c809d860 legacy=0x7f64c809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c77fe700 1 -- 172.21.15.125:0/2404472984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c809b360 con 0x7f64c8135f20 2023-10-03T10:15:13.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c67fc700 1 --2- 172.21.15.125:0/2404472984 >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 0x7f64c81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:13.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c77fe700 1 --2- 172.21.15.125:0/2404472984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009e80 tx=0x7f64c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68c9a723fad37023 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 -- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 msgr2=0x7f4ce00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 -- 172.21.15.125:0/508545563 >> v2:172.21.15.125:3300/0 conn(0x7f4ce0133f50 msgr2=0x7f4ce01343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/508545563 >> v2:172.21.15.125:3300/0 conn(0x7f4ce0133f50 0x7f4ce01343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 -- 172.21.15.125:0/508545563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce009e6a0 con 0x7f4ce00a1380 2023-10-03T10:15:13.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40098f0 tx=0x7f4cd4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89256b0cca9aaf55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c5ffb700 1 -- 172.21.15.125:0/2404472984 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000bb80 con 0x7f64c8135f20 2023-10-03T10:15:13.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c5ffb700 1 -- 172.21.15.125:0/2404472984 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000bce0 con 0x7f64c8135f20 2023-10-03T10:15:13.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f64c5ffb700 1 -- 172.21.15.125:0/2404472984 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c00116a0 con 0x7f64c8135f20 2023-10-03T10:15:13.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cddffb700 1 -- 172.21.15.125:0/508545563 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011830 con 0x7f4ce00a1380 2023-10-03T10:15:13.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cddffb700 1 -- 172.21.15.125:0/508545563 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4011990 con 0x7f4ce00a1380 2023-10-03T10:15:13.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.181+0000 7f4cddffb700 1 -- 172.21.15.125:0/508545563 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011d20 con 0x7f4ce00a1380 2023-10-03T10:15:13.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 -- 172.21.15.125:0/2404472984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 msgr2=0x7f64c8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 --2- 172.21.15.125:0/2404472984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009e80 tx=0x7f64c000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:13.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 -- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 msgr2=0x7f4ce0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40098f0 tx=0x7f4cd4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:13.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 -- 172.21.15.125:0/2404472984 shutdown_connections 2023-10-03T10:15:13.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 --2- 172.21.15.125:0/2404472984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c8135f20 0x7f64c8138300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 --2- 172.21.15.125:0/2404472984 >> v2:172.21.15.125:3300/0 conn(0x7f64c809e340 0x7f64c81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 -- 172.21.15.125:0/2404472984 >> 172.21.15.125:0/2404472984 conn(0x7f64c8099c40 msgr2=0x7f64c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 -- 172.21.15.125:0/508545563 shutdown_connections 2023-10-03T10:15:13.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 --2- 172.21.15.125:0/508545563 >> v2:172.21.15.125:3300/0 conn(0x7f4ce0133f50 0x7f4ce01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 --2- 172.21.15.125:0/508545563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00a1380 0x7f4ce0133a10 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40098f0 tx=0x7f4cd4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:13.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 -- 172.21.15.125:0/508545563 >> 172.21.15.125:0/508545563 conn(0x7f4ce00a6610 msgr2=0x7f4ce00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 -- 172.21.15.125:0/508545563 shutdown_connections 2023-10-03T10:15:13.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f4ce55be700 1 -- 172.21.15.125:0/508545563 wait complete. 2023-10-03T10:15:13.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 -- 172.21.15.125:0/2404472984 shutdown_connections 2023-10-03T10:15:13.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.182+0000 7f64cda43700 1 -- 172.21.15.125:0/2404472984 wait complete. 2023-10-03T10:15:13.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 Processor -- start 2023-10-03T10:15:13.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 Processor -- start 2023-10-03T10:15:13.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 -- start start 2023-10-03T10:15:13.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 -- start start 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce0122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 0x7f4ce0122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce0122ff0 0x7f4ce01ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0125e40 con 0x7f4ce0122ff0 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0124180 con 0x7f4ce0133f50 2023-10-03T10:15:13.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f4ce55be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0126090 con 0x7f4ce00a0a70 2023-10-03T10:15:13.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 0x7f64c81c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 0x7f64c8119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c811c840 con 0x7f64c809e340 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.183+0000 7f64cda43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c811b2b0 con 0x7f64c809d860 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42480/0 (socket says 172.21.15.125:42480) 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 -- 172.21.15.125:0/967426664 learned_addr learned my addr 172.21.15.125:0/967426664 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:13.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81c4eb0 con 0x7f64c8135f20 2023-10-03T10:15:13.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c77fe700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 0x7f64c8119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c67fc700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 0x7f64c81c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cdeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce0122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cdeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce0122570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46216/0 (socket says 172.21.15.125:46216) 2023-10-03T10:15:13.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cdeffd700 1 -- 172.21.15.125:0/865425306 learned_addr learned my addr 172.21.15.125:0/865425306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:13.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cdf7fe700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce0122ff0 0x7f4ce01ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 0x7f4ce0122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 -- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 msgr2=0x7f64c8119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 0x7f64c8119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 -- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 msgr2=0x7f64c81c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 0x7f64c81c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009b30 con 0x7f64c809d860 2023-10-03T10:15:13.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 -- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 msgr2=0x7f4ce0122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce0122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 -- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce0122ff0 msgr2=0x7f4ce01ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce0122ff0 0x7f4ce01ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 -- 172.21.15.125:0/865425306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009550 con 0x7f4ce0133f50 2023-10-03T10:15:13.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c77fe700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 0x7f64c8119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c67fc700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 0x7f64c81c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64c6ffd700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c510 tx=0x7f64b800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f4cde7fc700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 0x7f4ce0122ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4ce009e5c0 tx=0x7f4cd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.184+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80052d0 con 0x7f64c809d860 2023-10-03T10:15:13.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8005430 con 0x7f64c809d860 2023-10-03T10:15:13.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80038c0 con 0x7f64c809d860 2023-10-03T10:15:13.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c8130320 con 0x7f64c809d860 2023-10-03T10:15:13.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c811cb10 con 0x7f64c809d860 2023-10-03T10:15:13.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4004040 con 0x7f4ce0133f50 2023-10-03T10:15:13.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd40041c0 con 0x7f4ce0133f50 2023-10-03T10:15:13.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce0133910 con 0x7f4ce0133f50 2023-10-03T10:15:13.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce0133090 con 0x7f4ce0133f50 2023-10-03T10:15:13.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64b8003a20 con 0x7f64c809d860 2023-10-03T10:15:13.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.185+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4004570 con 0x7f4ce0133f50 2023-10-03T10:15:13.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cd40036a0 con 0x7f4ce0133f50 2023-10-03T10:15:13.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc00052e0 con 0x7f4ce0133f50 2023-10-03T10:15:13.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c811d180 con 0x7f64c809d860 2023-10-03T10:15:13.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64b803eac0 con 0x7f64c809d860 2023-10-03T10:15:13.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.186+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cd4048ba0 con 0x7f4ce0133f50 2023-10-03T10:15:13.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.190+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cd4034950 con 0x7f4ce0133f50 2023-10-03T10:15:13.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.195+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64b8017080 con 0x7f64c809d860 2023-10-03T10:15:13.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.378+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4cc0005590 con 0x7f4ce0133f50 2023-10-03T10:15:13.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.379+0000 7f4cc77fe700 1 -- 172.21.15.125:0/865425306 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cd4015070 con 0x7f4ce0133f50 2023-10-03T10:15:13.378 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:13.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 msgr2=0x7f4ce0122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 0x7f4ce0122ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4ce009e5c0 tx=0x7f4cd4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 shutdown_connections 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce0122ff0 0x7f4ce01ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4ce00a0a70 0x7f4ce0122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 --2- 172.21.15.125:0/865425306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce0133f50 0x7f4ce0122ab0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 >> 172.21.15.125:0/865425306 conn(0x7f4ce00a6610 msgr2=0x7f4ce009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 shutdown_connections 2023-10-03T10:15:13.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.381+0000 7f4ce55be700 1 -- 172.21.15.125:0/865425306 wait complete. 2023-10-03T10:15:13.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.383+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f64c811cce0 con 0x7f64c809d860 2023-10-03T10:15:13.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.384+0000 7f64affff700 1 -- 172.21.15.125:0/967426664 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64c811cce0 con 0x7f64c809d860 2023-10-03T10:15:13.383 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:13.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 msgr2=0x7f64c81c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c510 tx=0x7f64b800c820 comp rx=0 tx=0).stop 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 shutdown_connections 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8135f20 0x7f64c8119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c809d860 0x7f64c81c4430 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 --2- 172.21.15.125:0/967426664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c809e340 0x7f64c81c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 >> 172.21.15.125:0/967426664 conn(0x7f64c8099c40 msgr2=0x7f64c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 shutdown_connections 2023-10-03T10:15:13.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:13.386+0000 7f64cda43700 1 -- 172.21.15.125:0/967426664 wait complete. 2023-10-03T10:15:13.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:13.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:13.979 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:14.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.109+0000 7f6810ee1700 1 Processor -- start 2023-10-03T10:15:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.109+0000 7f6810ee1700 1 -- start start 2023-10-03T10:15:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6810ee1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 0x7f680c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6810ee1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 0x7f680c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6810ee1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c09dc00 con 0x7f680c0a1380 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6810ee1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c09ea60 con 0x7f680c134120 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6810ee1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f680c09dec0 con 0x7f680c0a0a70 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 0x7f680c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 0x7f680c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6809d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f680c0a1380 0x7f680c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34304/0 (socket says 172.21.15.125:34304) 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f6809d9b700 1 -- 172.21.15.125:0/1037701519 learned_addr learned my addr 172.21.15.125:0/1037701519 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680a59c700 1 -- 172.21.15.125:0/1037701519 >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 msgr2=0x7f680c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680a59c700 1 --2- 172.21.15.125:0/1037701519 >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 0x7f680c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680a59c700 1 -- 172.21.15.125:0/1037701519 >> v1:172.21.15.125:6789/0 conn(0x7f680c0a1380 legacy=0x7f680c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680a59c700 1 -- 172.21.15.125:0/1037701519 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c09e6a0 con 0x7f680c0a0a70 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680959a700 1 -- 172.21.15.125:0/1037701519 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517955766 0 0) 0x7f680c09dc00 con 0x7f680c0a1380 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.110+0000 7f680ad9d700 1 --2- 172.21.15.125:0/1037701519 >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 0x7f680c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f680a59c700 1 --2- 172.21.15.125:0/1037701519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 0x7f680c0a0e40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009840 tx=0x7f67fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8229e2730f35c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f680959a700 1 -- 172.21.15.125:0/1037701519 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011830 con 0x7f680c0a0a70 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f680959a700 1 -- 172.21.15.125:0/1037701519 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc011990 con 0x7f680c0a0a70 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f680959a700 1 -- 172.21.15.125:0/1037701519 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011d20 con 0x7f680c0a0a70 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 -- 172.21.15.125:0/1037701519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 msgr2=0x7f680c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 --2- 172.21.15.125:0/1037701519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 0x7f680c0a0e40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009840 tx=0x7f67fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 -- 172.21.15.125:0/1037701519 shutdown_connections 2023-10-03T10:15:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 --2- 172.21.15.125:0/1037701519 >> v2:172.21.15.125:3300/0 conn(0x7f680c134120 0x7f680c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 --2- 172.21.15.125:0/1037701519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a0a70 0x7f680c0a0e40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 -- 172.21.15.125:0/1037701519 >> 172.21.15.125:0/1037701519 conn(0x7f680c0a6610 msgr2=0x7f680c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 -- 172.21.15.125:0/1037701519 shutdown_connections 2023-10-03T10:15:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.111+0000 7f6810ee1700 1 -- 172.21.15.125:0/1037701519 wait complete. 2023-10-03T10:15:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.112+0000 7f6810ee1700 1 Processor -- start 2023-10-03T10:15:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 -- start start 2023-10-03T10:15:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 0x7f680c122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 0x7f680c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c133300 con 0x7f680c134120 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c125aa0 con 0x7f680c0a0a70 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6810ee1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f680c133650 con 0x7f680c0a1380 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6809d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 0x7f680c122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6809d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46228/0 (socket says 172.21.15.125:46228) 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6809d9b700 1 -- 172.21.15.125:0/204139268 learned_addr learned my addr 172.21.15.125:0/204139268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 0x7f680c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 -- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 msgr2=0x7f680c122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 -- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 msgr2=0x7f680c122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 0x7f680c122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680ad9d700 1 -- 172.21.15.125:0/204139268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804009a70 con 0x7f680c134120 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f680a59c700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 0x7f680c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.113+0000 7f6809d9b700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f680ad9d700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 0x7f680c123210 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f680400efc0 tx=0x7f680400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400ca90 con 0x7f680c134120 2023-10-03T10:15:14.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400f040 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0094a0 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400ce30 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c125cd0 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.114+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6804014480 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.115+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f680403fbd0 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.115+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c125e60 con 0x7f680c134120 2023-10-03T10:15:14.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.119+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6804012930 con 0x7f680c134120 2023-10-03T10:15:14.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.149+0000 7ff1e3105700 1 Processor -- start 2023-10-03T10:15:14.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 -- start start 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 0x7ff1dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 0x7ff1dc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc09dc00 con 0x7ff1dc0a1380 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc09ea90 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e3105700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc09dec0 con 0x7ff1dc134120 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e16a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 0x7ff1dc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1e0ea1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 0x7ff1dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1dbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff1dc0a1380 0x7ff1dc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34310/0 (socket says 172.21.15.125:34310) 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.150+0000 7ff1dbfff700 1 -- 172.21.15.125:0/1699858518 learned_addr learned my addr 172.21.15.125:0/1699858518 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e16a2700 1 -- 172.21.15.125:0/1699858518 >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 msgr2=0x7ff1dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e16a2700 1 --2- 172.21.15.125:0/1699858518 >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 0x7ff1dc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e16a2700 1 -- 172.21.15.125:0/1699858518 >> v1:172.21.15.125:6789/0 conn(0x7ff1dc0a1380 legacy=0x7ff1dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e16a2700 1 -- 172.21.15.125:0/1699858518 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc09e6a0 con 0x7ff1dc134120 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e0ea1700 1 --2- 172.21.15.125:0/1699858518 >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 0x7ff1dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1db7fe700 1 -- 172.21.15.125:0/1699858518 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145136662 0 0) 0x7ff1dc09dc00 con 0x7ff1dc0a1380 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1e16a2700 1 --2- 172.21.15.125:0/1699858518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 0x7ff1dc13bce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009d90 tx=0x7ff1d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409e55f7b3c3c8ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1db7fe700 1 -- 172.21.15.125:0/1699858518 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400e070 con 0x7ff1dc134120 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1db7fe700 1 -- 172.21.15.125:0/1699858518 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400bb20 con 0x7ff1dc134120 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.151+0000 7ff1db7fe700 1 -- 172.21.15.125:0/1699858518 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4012430 con 0x7ff1dc134120 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 -- 172.21.15.125:0/1699858518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 msgr2=0x7ff1dc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1699858518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 0x7ff1dc13bce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009d90 tx=0x7ff1d400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 -- 172.21.15.125:0/1699858518 shutdown_connections 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1699858518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc134120 0x7ff1dc13bce0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1699858518 >> v2:172.21.15.125:3300/0 conn(0x7ff1dc0a0a70 0x7ff1dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 -- 172.21.15.125:0/1699858518 >> 172.21.15.125:0/1699858518 conn(0x7ff1dc0a6610 msgr2=0x7ff1dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 -- 172.21.15.125:0/1699858518 shutdown_connections 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.152+0000 7ff1e3105700 1 -- 172.21.15.125:0/1699858518 wait complete. 2023-10-03T10:15:14.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 Processor -- start 2023-10-03T10:15:14.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 -- start start 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1dc0a1380 0x7ff1dc122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1dc134120 0x7ff1dc1231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc124360 con 0x7ff1dc0a1380 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc1336a0 con 0x7ff1dc134120 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e3105700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc1332e0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e0ea1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e0ea1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46248/0 (socket says 172.21.15.125:46248) 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e0ea1700 1 -- 172.21.15.125:0/1386694101 learned_addr learned my addr 172.21.15.125:0/1386694101 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1e16a2700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1dc134120 0x7ff1dc1231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.153+0000 7ff1dbfff700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1dc0a1380 0x7ff1dc122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 -- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1dc134120 msgr2=0x7ff1dc1231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1dc134120 0x7ff1dc1231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 -- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1dc0a1380 msgr2=0x7ff1dc122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1dc0a1380 0x7ff1dc122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 -- 172.21.15.125:0/1386694101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00094a0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e0ea1700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ebe0 tx=0x7ff1d000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000c850 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000c9b0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000cd40 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d4009a70 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.154+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc125cd0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.155+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1d0013470 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.155+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff1d003f8e0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.155+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc126ac0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.159+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1d0013720 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.314+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f680c126a70 con 0x7f680c134120 2023-10-03T10:15:14.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.314+0000 7f67faffd700 1 -- 172.21.15.125:0/204139268 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6804012340 con 0x7f680c134120 2023-10-03T10:15:14.314 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 msgr2=0x7f680c123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 0x7f680c123210 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f680400efc0 tx=0x7f680400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 shutdown_connections 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f680c134120 0x7f680c123210 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680c0a0a70 0x7f680c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 --2- 172.21.15.125:0/204139268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f680c0a1380 0x7f680c122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 >> 172.21.15.125:0/204139268 conn(0x7f680c0a6610 msgr2=0x7f680c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 shutdown_connections 2023-10-03T10:15:14.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.316+0000 7f6810ee1700 1 -- 172.21.15.125:0/204139268 wait complete. 2023-10-03T10:15:14.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:14.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.356+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1dc04f2a0 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.356+0000 7ff1d97fa700 1 -- 172.21.15.125:0/1386694101 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1d002a020 con 0x7ff1dc0a0a70 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:14.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 msgr2=0x7ff1dc122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ebe0 tx=0x7ff1d000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 shutdown_connections 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1dc134120 0x7ff1dc1231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1dc0a0a70 0x7ff1dc122750 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 --2- 172.21.15.125:0/1386694101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1dc0a1380 0x7ff1dc122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 >> 172.21.15.125:0/1386694101 conn(0x7ff1dc0a6610 msgr2=0x7ff1dc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 shutdown_connections 2023-10-03T10:15:14.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.359+0000 7ff1e3105700 1 -- 172.21.15.125:0/1386694101 wait complete. 2023-10-03T10:15:14.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:14.394 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:14.399 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:14.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.536+0000 7f7999ff6700 1 Processor -- start 2023-10-03T10:15:14.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.536+0000 7f7999ff6700 1 -- start start 2023-10-03T10:15:14.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.536+0000 7f25ccc5b700 1 Processor -- start 2023-10-03T10:15:14.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.536+0000 7f25ccc5b700 1 -- start start 2023-10-03T10:15:14.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7999ff6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79940a1550 0x7f7994138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7999ff6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f799413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7999ff6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799409e9d0 con 0x7f79940a0a70 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7999ff6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799409dc00 con 0x7f79940a1550 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7999ff6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799409dec0 con 0x7f7994139200 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79940a1550 0x7f7994138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f79937fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f79940a0a70 0x7f79940a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:34322/0 (socket says 172.21.15.125:34322) 2023-10-03T10:15:14.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7993fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f799413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f79937fe700 1 -- 172.21.15.125:0/1841896521 learned_addr learned my addr 172.21.15.125:0/1841896521 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79940a1550 0x7f7994138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36006/0 (socket says 172.21.15.125:36006) 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 -- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 msgr2=0x7f799413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 --2- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f799413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 -- 172.21.15.125:0/1841896521 >> v1:172.21.15.125:6789/0 conn(0x7f79940a0a70 legacy=0x7f79940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f7992ffd700 1 -- 172.21.15.125:0/1841896521 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799409e6a0 con 0x7f79940a1550 2023-10-03T10:15:14.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c81319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f79927fc700 1 -- 172.21.15.125:0/1841896521 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871099640 0 0) 0x7f799409e9d0 con 0x7f79940a0a70 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25c809bc70 0x7f25c809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c80667e0 con 0x7f25c809bc70 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80a23c0 con 0x7f25c8066410 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.537+0000 7f25ccc5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80a0f20 con 0x7f25c81314b0 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25c809bc70 0x7f25c809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25c809bc70 0x7f25c809c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36016/0 (socket says 172.21.15.125:36016) 2023-10-03T10:15:14.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46260/0 (socket says 172.21.15.125:46260) 2023-10-03T10:15:14.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3254434390 learned_addr learned my addr 172.21.15.125:0/3254434390 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:14.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c659c700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c81319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f7992ffd700 1 --2- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f7994138cc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7988009840 tx=0x7f7988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c762b98e2780aa0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 msgr2=0x7f25c8131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 msgr2=0x7f25c81319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c81319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3254434390 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80a16e0 con 0x7f25c809bc70 2023-10-03T10:15:14.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c5d9b700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c659c700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c81319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f79927fc700 1 -- 172.21.15.125:0/1841896521 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988011830 con 0x7f79940a1550 2023-10-03T10:15:14.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f79927fc700 1 -- 172.21.15.125:0/1841896521 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7988011990 con 0x7f79940a1550 2023-10-03T10:15:14.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f79927fc700 1 -- 172.21.15.125:0/1841896521 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988011d20 con 0x7f79940a1550 2023-10-03T10:15:14.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c809bc70 0x7f25c809c0f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009ee0 tx=0x7f25c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9ce85e0445a300 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c559a700 1 -- 172.21.15.125:0/3254434390 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000e070 con 0x7f25c809bc70 2023-10-03T10:15:14.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c559a700 1 -- 172.21.15.125:0/3254434390 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000b950 con 0x7f25c809bc70 2023-10-03T10:15:14.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.538+0000 7f25c559a700 1 -- 172.21.15.125:0/3254434390 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000bd00 con 0x7f25c809bc70 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 -- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 msgr2=0x7f7994138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f7994138cc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7988009840 tx=0x7f7988009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 -- 172.21.15.125:0/1841896521 shutdown_connections 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f799413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1841896521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f7994138cc0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 -- 172.21.15.125:0/1841896521 >> 172.21.15.125:0/1841896521 conn(0x7f79940a6610 msgr2=0x7f79940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 -- 172.21.15.125:0/1841896521 shutdown_connections 2023-10-03T10:15:14.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f7999ff6700 1 -- 172.21.15.125:0/1841896521 wait complete. 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c809bc70 msgr2=0x7f25c809c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c809bc70 0x7f25c809c0f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009ee0 tx=0x7f25c000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3254434390 shutdown_connections 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c81319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c809bc70 0x7f25c809c0f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3254434390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c81314b0 0x7f25c8131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3254434390 >> 172.21.15.125:0/3254434390 conn(0x7f25c80a2980 msgr2=0x7f25c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3254434390 shutdown_connections 2023-10-03T10:15:14.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.539+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3254434390 wait complete. 2023-10-03T10:15:14.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.540+0000 7f7999ff6700 1 Processor -- start 2023-10-03T10:15:14.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.540+0000 7f25ccc5b700 1 Processor -- start 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.540+0000 7f25ccc5b700 1 -- start start 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.540+0000 7f7999ff6700 1 -- start start 2023-10-03T10:15:14.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c8099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c809bc70 0x7f25c8099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8120110 con 0x7f25c81314b0 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8130b70 con 0x7f25c8066410 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25ccc5b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80a1d50 con 0x7f25c809bc70 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36018/0 (socket says 172.21.15.125:36018) 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3809000015 learned_addr learned my addr 172.21.15.125:0/3809000015 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:14.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c659c700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c8099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79940a0a70 0x7f799411f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c809bc70 msgr2=0x7f25c8099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c809bc70 0x7f25c8099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 msgr2=0x7f25c8099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c8099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 -- 172.21.15.125:0/3809000015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009430 con 0x7f25c81314b0 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f79941c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799411f460 con 0x7f79940a1550 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7994122360 con 0x7f7994139200 2023-10-03T10:15:14.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7999ff6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79941207c0 con 0x7f79940a0a70 2023-10-03T10:15:14.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36032/0 (socket says 172.21.15.125:36032) 2023-10-03T10:15:14.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 -- 172.21.15.125:0/1641929831 learned_addr learned my addr 172.21.15.125:0/1641929831 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:14.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7993fff700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f79941c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f25c6d9d700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f25c80a1ba0 tx=0x7f25c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 -- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79940a0a70 msgr2=0x7f799411f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79940a0a70 0x7f799411f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 -- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 msgr2=0x7f79941c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f79941c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.541+0000 7f7992ffd700 1 -- 172.21.15.125:0/1641929831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880094a0 con 0x7f79940a1550 2023-10-03T10:15:14.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000cec0 con 0x7f25c81314b0 2023-10-03T10:15:14.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c00092e0 con 0x7f25c81314b0 2023-10-03T10:15:14.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c001b650 con 0x7f25c81314b0 2023-10-03T10:15:14.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc0094a0 con 0x7f25c81314b0 2023-10-03T10:15:14.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0009b30 con 0x7f25c81314b0 2023-10-03T10:15:14.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f7992ffd700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7988009fd0 tx=0x7f7988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880036a0 con 0x7f79940a1550 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798801f070 con 0x7f79940a1550 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7994122dd0 con 0x7f79940a1550 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988003a20 con 0x7f79940a1550 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.542+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799411f050 con 0x7f79940a1550 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.543+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25c001b7b0 con 0x7f25c81314b0 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.543+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25c0040c90 con 0x7f25c81314b0 2023-10-03T10:15:14.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.543+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c812dd90 con 0x7f25c81314b0 2023-10-03T10:15:14.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.543+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7988003b80 con 0x7f79940a1550 2023-10-03T10:15:14.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.543+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7988021070 con 0x7f79940a1550 2023-10-03T10:15:14.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.544+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799406ccf0 con 0x7f79940a1550 2023-10-03T10:15:14.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.547+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c002b020 con 0x7f25c81314b0 2023-10-03T10:15:14.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.552+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7988015080 con 0x7f79940a1550 2023-10-03T10:15:14.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.740+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25c8120250 con 0x7f25c81314b0 2023-10-03T10:15:14.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.740+0000 7f25b6ffd700 1 -- 172.21.15.125:0/3809000015 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c8120250 con 0x7f25c81314b0 2023-10-03T10:15:14.740 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 msgr2=0x7f25c809a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f25c80a1ba0 tx=0x7f25c0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 shutdown_connections 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25c81314b0 0x7f25c809a510 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25c8066410 0x7f25c8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 --2- 172.21.15.125:0/3809000015 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25c809bc70 0x7f25c8099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 >> 172.21.15.125:0/3809000015 conn(0x7f25c80a2980 msgr2=0x7f25c81b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 shutdown_connections 2023-10-03T10:15:14.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f25ccc5b700 1 -- 172.21.15.125:0/3809000015 wait complete. 2023-10-03T10:15:14.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.742+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79940a2710 con 0x7f79940a1550 2023-10-03T10:15:14.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.743+0000 7f797bfff700 1 -- 172.21.15.125:0/1641929831 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7988003e30 con 0x7f79940a1550 2023-10-03T10:15:14.743 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 msgr2=0x7f79941c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7988009fd0 tx=0x7f7988004750 comp rx=0 tx=0).stop 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 shutdown_connections 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7994139200 0x7f79941c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79940a0a70 0x7f799411f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 --2- 172.21.15.125:0/1641929831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79940a1550 0x7f79941c8460 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 >> 172.21.15.125:0/1641929831 conn(0x7f79940a6610 msgr2=0x7f79940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 shutdown_connections 2023-10-03T10:15:14.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:14.745+0000 7f7999ff6700 1 -- 172.21.15.125:0/1641929831 wait complete. 2023-10-03T10:15:14.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:14.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:15.330 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:15.371 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:15.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.459+0000 7f83e8f3f700 1 Processor -- start 2023-10-03T10:15:15.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 -- start start 2023-10-03T10:15:15.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 0x7f83e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e409e9d0 con 0x7f83e40a0a70 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e409dc00 con 0x7f83e40a1550 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e8f3f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409dec0 con 0x7f83e4139200 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 0x7f83e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83e40a0a70 0x7f83e40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42672/0 (socket says 172.21.15.125:42672) 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.460+0000 7f83e259c700 1 -- 172.21.15.125:0/2285088387 learned_addr learned my addr 172.21.15.125:0/2285088387 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e2d9d700 1 -- 172.21.15.125:0/2285088387 >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 msgr2=0x7f83e4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e2d9d700 1 --2- 172.21.15.125:0/2285088387 >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 0x7f83e4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e2d9d700 1 -- 172.21.15.125:0/2285088387 >> v1:172.21.15.125:6789/0 conn(0x7f83e40a0a70 legacy=0x7f83e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e2d9d700 1 -- 172.21.15.125:0/2285088387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e409e6a0 con 0x7f83e4139200 2023-10-03T10:15:15.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e159a700 1 -- 172.21.15.125:0/2285088387 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316716888 0 0) 0x7f83e409e9d0 con 0x7f83e40a0a70 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e1d9b700 1 --2- 172.21.15.125:0/2285088387 >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 0x7f83e4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e2d9d700 1 --2- 172.21.15.125:0/2285088387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e413b5e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7ecd7b5fcf6025 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e159a700 1 -- 172.21.15.125:0/2285088387 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e070 con 0x7f83e4139200 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e159a700 1 -- 172.21.15.125:0/2285088387 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00bb20 con 0x7f83e4139200 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.461+0000 7f83e159a700 1 -- 172.21.15.125:0/2285088387 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc012430 con 0x7f83e4139200 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2285088387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 msgr2=0x7f83e413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2285088387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e413b5e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:15.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2285088387 shutdown_connections 2023-10-03T10:15:15.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2285088387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e413b5e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2285088387 >> v2:172.21.15.125:3300/0 conn(0x7f83e40a1550 0x7f83e4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2285088387 >> 172.21.15.125:0/2285088387 conn(0x7f83e40a6610 msgr2=0x7f83e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2285088387 shutdown_connections 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.462+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2285088387 wait complete. 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.463+0000 7f83e8f3f700 1 Processor -- start 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.463+0000 7f83e8f3f700 1 -- start start 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83e40a1550 0x7f83e411ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e411f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a03e0 con 0x7f83e40a0a70 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4121990 con 0x7f83e40a1550 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e8f3f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4121eb0 con 0x7f83e4139200 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e411f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46670/0 (socket says 172.21.15.125:46670) 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 -- 172.21.15.125:0/2989411348 learned_addr learned my addr 172.21.15.125:0/2989411348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e1d9b700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83e40a1550 0x7f83e411ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 -- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 msgr2=0x7f83e411f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e411f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 -- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83e40a1550 msgr2=0x7f83e411ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83e40a1550 0x7f83e411ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 -- 172.21.15.125:0/2989411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80094a0 con 0x7f83e40a0a70 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e2d9d700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e411f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83e259c700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c520 tx=0x7f83d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.464+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4004c80 con 0x7f83e40a0a70 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.465+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4004e00 con 0x7f83e40a0a70 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.465+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4007310 con 0x7f83e40a0a70 2023-10-03T10:15:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.465+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc009a70 con 0x7f83e40a0a70 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.465+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40a5700 con 0x7f83e40a0a70 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.465+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83d4007470 con 0x7f83e40a0a70 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.466+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e41229e0 con 0x7f83e40a0a70 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.466+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83d403f300 con 0x7f83e40a0a70 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.470+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83d40123b0 con 0x7f83e40a0a70 2023-10-03T10:15:15.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.500+0000 7f705de6f700 1 Processor -- start 2023-10-03T10:15:15.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 -- start start 2023-10-03T10:15:15.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70580a1380 0x7f7058133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705809dc00 con 0x7f7058133f50 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705809ea60 con 0x7f70580a1380 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f705de6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f705809dec0 con 0x7f70580a0a70 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f70577fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.501+0000 7f7056ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70580a1380 0x7f7058133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70577fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60832/0 (socket says 172.21.15.125:60832) 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7057fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7058133f50 0x7f705813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42682/0 (socket says 172.21.15.125:42682) 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70577fe700 1 -- 172.21.15.125:0/3401164879 learned_addr learned my addr 172.21.15.125:0/3401164879 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7056ffd700 1 -- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 msgr2=0x7f70580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7056ffd700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7056ffd700 1 -- 172.21.15.125:0/3401164879 >> v1:172.21.15.125:6789/0 conn(0x7f7058133f50 legacy=0x7f705813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7056ffd700 1 -- 172.21.15.125:0/3401164879 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705809e6a0 con 0x7f70580a1380 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70567fc700 1 -- 172.21.15.125:0/3401164879 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275343811 0 0) 0x7f705809dc00 con 0x7f7058133f50 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70577fe700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f7056ffd700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a1380 0x7f7058133a10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7040009840 tx=0x7f7040009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2f3390e3096ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70567fc700 1 -- 172.21.15.125:0/3401164879 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011830 con 0x7f70580a1380 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70567fc700 1 -- 172.21.15.125:0/3401164879 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040011990 con 0x7f70580a1380 2023-10-03T10:15:15.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.502+0000 7f70567fc700 1 -- 172.21.15.125:0/3401164879 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011d20 con 0x7f70580a1380 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 -- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a1380 msgr2=0x7f7058133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a1380 0x7f7058133a10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7040009840 tx=0x7f7040009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 -- 172.21.15.125:0/3401164879 shutdown_connections 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70580a0a70 0x7f70580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 --2- 172.21.15.125:0/3401164879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a1380 0x7f7058133a10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 -- 172.21.15.125:0/3401164879 >> 172.21.15.125:0/3401164879 conn(0x7f70580a6610 msgr2=0x7f70580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 -- 172.21.15.125:0/3401164879 shutdown_connections 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.503+0000 7f705de6f700 1 -- 172.21.15.125:0/3401164879 wait complete. 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 Processor -- start 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 -- start start 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70580a1380 0x7f7058122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7058133f50 0x7f7058123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058126220 con 0x7f70580a0a70 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058133960 con 0x7f70580a1380 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f705de6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7058133420 con 0x7f7058133f50 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f70577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f7057fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7058133f50 0x7f7058123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f70577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46694/0 (socket says 172.21.15.125:46694) 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f70577fe700 1 -- 172.21.15.125:0/2031495805 learned_addr learned my addr 172.21.15.125:0/2031495805 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.504+0000 7f7056ffd700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70580a1380 0x7f7058122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 -- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7058133f50 msgr2=0x7f7058123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7058133f50 0x7f7058123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 -- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70580a1380 msgr2=0x7f7058122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70580a1380 0x7f7058122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 -- 172.21.15.125:0/2031495805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009550 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f70577fe700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f705000ebe0 tx=0x7f705000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000c850 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000c9b0 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70400094a0 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000cd40 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.505+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7058126bb0 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.506+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7050013470 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.506+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f705003fbe0 con 0x7f70580a0a70 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.506+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705804f2a0 con 0x7f70580a0a70 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.511+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f705001b3b0 con 0x7f70580a0a70 2023-10-03T10:15:15.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.664+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83e4121cf0 con 0x7f83e40a0a70 2023-10-03T10:15:15.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.665+0000 7f83d2ffd700 1 -- 172.21.15.125:0/2989411348 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83d4011360 con 0x7f83e40a0a70 2023-10-03T10:15:15.664 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:15.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 msgr2=0x7f83e411e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c520 tx=0x7f83d400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 shutdown_connections 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83e4139200 0x7f83e411f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e40a0a70 0x7f83e411e670 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 --2- 172.21.15.125:0/2989411348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83e40a1550 0x7f83e411ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 >> 172.21.15.125:0/2989411348 conn(0x7f83e40a6610 msgr2=0x7f83e4136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 shutdown_connections 2023-10-03T10:15:15.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.667+0000 7f83e8f3f700 1 -- 172.21.15.125:0/2989411348 wait complete. 2023-10-03T10:15:15.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:15.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.703+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7058126010 con 0x7f70580a0a70 2023-10-03T10:15:15.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.703+0000 7f704ffff700 1 -- 172.21.15.125:0/2031495805 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7050011b40 con 0x7f70580a0a70 2023-10-03T10:15:15.702 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:15.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 msgr2=0x7f7058122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f705000ebe0 tx=0x7f705000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 shutdown_connections 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7058133f50 0x7f7058123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70580a0a70 0x7f7058122900 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 --2- 172.21.15.125:0/2031495805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70580a1380 0x7f7058122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 >> 172.21.15.125:0/2031495805 conn(0x7f70580a6610 msgr2=0x7f70580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 shutdown_connections 2023-10-03T10:15:15.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.705+0000 7f705de6f700 1 -- 172.21.15.125:0/2031495805 wait complete. 2023-10-03T10:15:15.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:15.756 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:15.758 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:15.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.882+0000 7f5e16cef700 1 Processor -- start 2023-10-03T10:15:15.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.882+0000 7f5e16cef700 1 -- start start 2023-10-03T10:15:15.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.882+0000 7f8c4ade9700 1 Processor -- start 2023-10-03T10:15:15.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.882+0000 7f8c4ade9700 1 -- start start 2023-10-03T10:15:15.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e16cef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e16cef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e101393c0 0x7f5e1013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e16cef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1009ac20 con 0x7f5e1009f260 2023-10-03T10:15:15.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e16cef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100a06c0 con 0x7f5e101393c0 2023-10-03T10:15:15.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e16cef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1009ae90 con 0x7f5e1009e950 2023-10-03T10:15:15.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c4ade9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c4ade9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c441300a0 0x7f8c441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c4ade9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4406b2d0 con 0x7f8c441309f0 2023-10-03T10:15:15.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c4ade9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44133610 con 0x7f8c44133ad0 2023-10-03T10:15:15.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c4ade9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4409a500 con 0x7f8c441300a0 2023-10-03T10:15:15.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e14a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e14a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47484/0 (socket says 172.21.15.125:47484) 2023-10-03T10:15:15.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e14a8b700 1 -- 172.21.15.125:0/2502712497 learned_addr learned my addr 172.21.15.125:0/2502712497 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 --2- 172.21.15.125:0/2502712497 >> v2:172.21.15.125:3300/0 conn(0x7f5e101393c0 0x7f5e1013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47496/0 (socket says 172.21.15.125:47496) 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 -- 172.21.15.125:0/2898248279 learned_addr learned my addr 172.21.15.125:0/2898248279 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c43fff700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c441300a0 0x7f8c441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 -- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 msgr2=0x7f5e1009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 -- 172.21.15.125:0/2502712497 >> v1:172.21.15.125:6789/0 conn(0x7f5e1009f260 legacy=0x7f5e10137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 -- 172.21.15.125:0/2502712497 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1006ba00 con 0x7f5e101393c0 2023-10-03T10:15:15.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e14a8b700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 -- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c441300a0 msgr2=0x7f8c441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c441300a0 0x7f8c441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c437fe700 1 -- 172.21.15.125:0/2898248279 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727636156 0 0) 0x7f8c4406b2d0 con 0x7f8c441309f0 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 -- 172.21.15.125:0/2898248279 >> v1:172.21.15.125:6789/0 conn(0x7f8c441309f0 legacy=0x7f8c4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f8c48b85700 1 -- 172.21.15.125:0/2898248279 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c441338b0 con 0x7f8c44133ad0 2023-10-03T10:15:15.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.883+0000 7f5e1528c700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e1013b7a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009d90 tx=0x7f5e0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647613bc763cd948 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c48b85700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009920 tx=0x7f8c38009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597a26d05f2d4c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e0f7fe700 1 -- 172.21.15.125:0/2502712497 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800e070 con 0x7f5e101393c0 2023-10-03T10:15:15.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e0f7fe700 1 -- 172.21.15.125:0/2502712497 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0800bb20 con 0x7f5e101393c0 2023-10-03T10:15:15.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e0f7fe700 1 -- 172.21.15.125:0/2502712497 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08012430 con 0x7f5e101393c0 2023-10-03T10:15:15.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c437fe700 1 -- 172.21.15.125:0/2898248279 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38011830 con 0x7f8c44133ad0 2023-10-03T10:15:15.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c437fe700 1 -- 172.21.15.125:0/2898248279 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38011990 con 0x7f8c44133ad0 2023-10-03T10:15:15.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c437fe700 1 -- 172.21.15.125:0/2898248279 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38011d20 con 0x7f8c44133ad0 2023-10-03T10:15:15.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 -- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 msgr2=0x7f5e1013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e1013b7a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009d90 tx=0x7f5e0800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 -- 172.21.15.125:0/2502712497 shutdown_connections 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e1013b7a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 --2- 172.21.15.125:0/2502712497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e950 0x7f5e1009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 -- 172.21.15.125:0/2502712497 >> 172.21.15.125:0/2502712497 conn(0x7f5e100a0f70 msgr2=0x7f5e100a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 -- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 msgr2=0x7f8c44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009920 tx=0x7f8c38009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 -- 172.21.15.125:0/2502712497 shutdown_connections 2023-10-03T10:15:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f5e16cef700 1 -- 172.21.15.125:0/2502712497 wait complete. 2023-10-03T10:15:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 -- 172.21.15.125:0/2898248279 shutdown_connections 2023-10-03T10:15:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c44133ad0 0x7f8c44133ea0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/2898248279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c441300a0 0x7f8c441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 -- 172.21.15.125:0/2898248279 >> 172.21.15.125:0/2898248279 conn(0x7f8c44099c40 msgr2=0x7f8c440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 -- 172.21.15.125:0/2898248279 shutdown_connections 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.884+0000 7f8c4ade9700 1 -- 172.21.15.125:0/2898248279 wait complete. 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.885+0000 7f5e16cef700 1 Processor -- start 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.885+0000 7f5e16cef700 1 -- start start 2023-10-03T10:15:15.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.885+0000 7f8c4ade9700 1 Processor -- start 2023-10-03T10:15:15.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.885+0000 7f8c4ade9700 1 -- start start 2023-10-03T10:15:15.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 0x7f5e101208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f260 0x7f5e10120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e10121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10122d10 con 0x7f5e101393c0 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10123b50 con 0x7f5e1009f260 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e16cef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100a0820 con 0x7f5e1009e950 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e14a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 0x7f5e101208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e14a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 0x7f5e101208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60860/0 (socket says 172.21.15.125:60860) 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e14a8b700 1 -- 172.21.15.125:0/3446411736 learned_addr learned my addr 172.21.15.125:0/3446411736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e10121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e0ffff700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f260 0x7f5e10120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 0x7f8c4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c44133ad0 0x7f8c4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4411fd50 con 0x7f8c441309f0 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44120030 con 0x7f8c441300a0 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c4ade9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4411ed90 con 0x7f8c44133ad0 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46720/0 (socket says 172.21.15.125:46720) 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c43fff700 1 -- 172.21.15.125:0/689161267 learned_addr learned my addr 172.21.15.125:0/689161267 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 0x7f8c4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 -- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c44133ad0 msgr2=0x7f8c4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c44133ad0 0x7f8c4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 -- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 msgr2=0x7f8c4411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f8c48b85700 1 -- 172.21.15.125:0/689161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009550 con 0x7f8c441300a0 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c43fff700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 -- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 msgr2=0x7f5e101208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 0x7f5e101208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 -- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f260 msgr2=0x7f5e10120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f260 0x7f5e10120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.886+0000 7f5e1528c700 1 -- 172.21.15.125:0/3446411736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009500 con 0x7f5e101393c0 2023-10-03T10:15:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c48b85700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 0x7f8c4411da40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c38016000 tx=0x7f8c38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e1528c700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e10121370 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5e08016000 tx=0x7f5e08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004510 con 0x7f8c441300a0 2023-10-03T10:15:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08012430 con 0x7f5e101393c0 2023-10-03T10:15:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380036a0 con 0x7f8c441300a0 2023-10-03T10:15:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08020070 con 0x7f5e101393c0 2023-10-03T10:15:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e08009a70 con 0x7f5e101393c0 2023-10-03T10:15:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38003a50 con 0x7f8c441300a0 2023-10-03T10:15:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c440a3400 con 0x7f8c441300a0 2023-10-03T10:15:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08004040 con 0x7f5e101393c0 2023-10-03T10:15:15.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e101224b0 con 0x7f5e101393c0 2023-10-03T10:15:15.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.887+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4411f400 con 0x7f8c441300a0 2023-10-03T10:15:15.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.888+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e080041a0 con 0x7f5e101393c0 2023-10-03T10:15:15.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.888+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e08022070 con 0x7f5e101393c0 2023-10-03T10:15:15.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.888+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c38003bb0 con 0x7f8c441300a0 2023-10-03T10:15:15.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.888+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c380404a0 con 0x7f8c441300a0 2023-10-03T10:15:15.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.888+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e10123d80 con 0x7f5e101393c0 2023-10-03T10:15:15.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.889+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4411fe90 con 0x7f8c441300a0 2023-10-03T10:15:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.893+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e10123d80 con 0x7f5e101393c0 2023-10-03T10:15:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:15.893+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c4411fe90 con 0x7f8c441300a0 2023-10-03T10:15:16.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.084+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e10123d80 con 0x7f5e101393c0 2023-10-03T10:15:16.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.084+0000 7f5e0d7fa700 1 -- 172.21.15.125:0/3446411736 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e10123d80 con 0x7f5e101393c0 2023-10-03T10:15:16.084 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:16.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.086+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c4411fe90 con 0x7f8c441300a0 2023-10-03T10:15:16.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.086+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 msgr2=0x7f5e10121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e10121370 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5e08016000 tx=0x7f5e08004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 shutdown_connections 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e101393c0 0x7f5e10121370 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e1009e950 0x7f5e101208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 --2- 172.21.15.125:0/3446411736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f260 0x7f5e10120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 >> 172.21.15.125:0/3446411736 conn(0x7f5e100a0f70 msgr2=0x7f5e10136d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f8c417fa700 1 -- 172.21.15.125:0/689161267 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c4411fe90 con 0x7f8c441300a0 2023-10-03T10:15:16.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 shutdown_connections 2023-10-03T10:15:16.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.087+0000 7f5e16cef700 1 -- 172.21.15.125:0/3446411736 wait complete. 2023-10-03T10:15:16.089 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 msgr2=0x7f8c4411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 0x7f8c4411da40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c38016000 tx=0x7f8c38004750 comp rx=0 tx=0).stop 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 shutdown_connections 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c44133ad0 0x7f8c4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c441300a0 0x7f8c4411da40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 --2- 172.21.15.125:0/689161267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c441309f0 0x7f8c4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 >> 172.21.15.125:0/689161267 conn(0x7f8c44099c40 msgr2=0x7f8c4412e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 shutdown_connections 2023-10-03T10:15:16.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.089+0000 7f8c4ade9700 1 -- 172.21.15.125:0/689161267 wait complete. 2023-10-03T10:15:16.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:16.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:16.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:16.717 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:16.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.812+0000 7fce36191700 1 Processor -- start 2023-10-03T10:15:16.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.812+0000 7fce36191700 1 -- start start 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 0x7fce301343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3009e9d0 con 0x7fce30133f50 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3009dc00 con 0x7fce300a1380 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce36191700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3009dec0 con 0x7fce300a0a70 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47532/0 (socket says 172.21.15.125:47532) 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2effd700 1 -- 172.21.15.125:0/2690675785 learned_addr learned my addr 172.21.15.125:0/2690675785 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2ffff700 1 --2- 172.21.15.125:0/2690675785 >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 0x7fce301343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 -- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 msgr2=0x7fce30133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 -- 172.21.15.125:0/2690675785 >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 msgr2=0x7fce301343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/2690675785 >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 0x7fce301343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 -- 172.21.15.125:0/2690675785 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3009e6a0 con 0x7fce300a0a70 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2effd700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2ffff700 1 --2- 172.21.15.125:0/2690675785 >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 0x7fce301343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce300a0e40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814f280de262cc95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.813+0000 7fce2e7fc700 1 -- 172.21.15.125:0/2690675785 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800e070 con 0x7fce300a0a70 2023-10-03T10:15:16.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce2e7fc700 1 -- 172.21.15.125:0/2690675785 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800bb20 con 0x7fce300a0a70 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce2e7fc700 1 -- 172.21.15.125:0/2690675785 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28012430 con 0x7fce300a0a70 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 -- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 msgr2=0x7fce300a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce300a0e40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 -- 172.21.15.125:0/2690675785 shutdown_connections 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 --2- 172.21.15.125:0/2690675785 >> v2:172.21.15.125:3300/0 conn(0x7fce30133f50 0x7fce301343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce300a0e40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 --2- 172.21.15.125:0/2690675785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce300a1380 0x7fce30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 -- 172.21.15.125:0/2690675785 >> 172.21.15.125:0/2690675785 conn(0x7fce300a6610 msgr2=0x7fce300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 -- 172.21.15.125:0/2690675785 shutdown_connections 2023-10-03T10:15:16.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.814+0000 7fce36191700 1 -- 172.21.15.125:0/2690675785 wait complete. 2023-10-03T10:15:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.815+0000 7fce36191700 1 Processor -- start 2023-10-03T10:15:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.815+0000 7fce36191700 1 -- start start 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce30122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 0x7fce30122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30133a90 con 0x7fce300a1380 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce301253a0 con 0x7fce30133f50 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce36191700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce30124fe0 con 0x7fce300a0a70 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce30122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46746/0 (socket says 172.21.15.125:46746) 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2effd700 1 -- 172.21.15.125:0/767969786 learned_addr learned my addr 172.21.15.125:0/767969786 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2ffff700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 0x7fce30122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 -- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 msgr2=0x7fce30122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 0x7fce30122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 -- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 msgr2=0x7fce30122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 -- 172.21.15.125:0/767969786 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009550 con 0x7fce300a0a70 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2ffff700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 0x7fce30122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2effd700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce2f7fe700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce30122540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fce28016000 tx=0x7fce28004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.816+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280048b0 con 0x7fce300a0a70 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28020070 con 0x7fce300a0a70 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce200094a0 con 0x7fce300a0a70 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280276c0 con 0x7fce300a0a70 2023-10-03T10:15:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28009a70 con 0x7fce300a0a70 2023-10-03T10:15:16.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce28012430 con 0x7fce300a0a70 2023-10-03T10:15:16.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.817+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce301257f0 con 0x7fce300a0a70 2023-10-03T10:15:16.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.818+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce28022070 con 0x7fce300a0a70 2023-10-03T10:15:16.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.822+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce28003e30 con 0x7fce300a0a70 2023-10-03T10:15:16.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.853+0000 7f1703d8f700 1 Processor -- start 2023-10-03T10:15:16.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.853+0000 7f1703d8f700 1 -- start start 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16fc09d860 0x7f16fc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc130ce0 0x7f16fc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc131670 con 0x7f16fc09d860 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09aaa0 con 0x7f16fc130ce0 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1703d8f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09f870 con 0x7f16fc09e170 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f170132a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f170132a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60908/0 (socket says 172.21.15.125:60908) 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f170232c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc130ce0 0x7f16fc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f170132a700 1 -- 172.21.15.125:0/1734471346 learned_addr learned my addr 172.21.15.125:0/1734471346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 --2- 172.21.15.125:0/1734471346 >> v2:172.21.15.125:3300/0 conn(0x7f16fc09d860 0x7f16fc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 -- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 msgr2=0x7f16fc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 -- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc130ce0 msgr2=0x7f16fc131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc130ce0 0x7f16fc131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 -- 172.21.15.125:0/1734471346 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc09b360 con 0x7f16fc09d860 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f170132a700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1701b2b700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09d860 0x7f16fc09dc30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009870 tx=0x7f16f8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3391e7a491b6db3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1700b29700 1 -- 172.21.15.125:0/1734471346 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8011830 con 0x7f16fc09d860 2023-10-03T10:15:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1700b29700 1 -- 172.21.15.125:0/1734471346 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8011990 con 0x7f16fc09d860 2023-10-03T10:15:16.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.854+0000 7f1700b29700 1 -- 172.21.15.125:0/1734471346 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8011d20 con 0x7f16fc09d860 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 -- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09d860 msgr2=0x7f16fc09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09d860 0x7f16fc09dc30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009870 tx=0x7f16f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 -- 172.21.15.125:0/1734471346 shutdown_connections 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc130ce0 0x7f16fc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09d860 0x7f16fc09dc30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 --2- 172.21.15.125:0/1734471346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc09e170 0x7f16fc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 -- 172.21.15.125:0/1734471346 >> 172.21.15.125:0/1734471346 conn(0x7f16fc099c40 msgr2=0x7f16fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 -- 172.21.15.125:0/1734471346 shutdown_connections 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.855+0000 7f1703d8f700 1 -- 172.21.15.125:0/1734471346 wait complete. 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.856+0000 7f1703d8f700 1 Processor -- start 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.856+0000 7f1703d8f700 1 -- start start 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 0x7f16fc11cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09a680 con 0x7f16fc09e170 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc11e430 con 0x7f16fc09d860 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1703d8f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09c8b0 con 0x7f16fc130ce0 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170232c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 0x7f16fc11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1701b2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1701b2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47562/0 (socket says 172.21.15.125:47562) 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46764/0 (socket says 172.21.15.125:46764) 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170232c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 0x7f16fc11cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60920/0 (socket says 172.21.15.125:60920) 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1701b2b700 1 -- 172.21.15.125:0/3075057125 learned_addr learned my addr 172.21.15.125:0/3075057125 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 -- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 msgr2=0x7f16fc11cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 0x7f16fc11cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 -- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 msgr2=0x7f16fc11c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f170132a700 1 -- 172.21.15.125:0/3075057125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec00b600 con 0x7f16fc09e170 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.857+0000 7f1701b2b700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f170132a700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00fbd0 tx=0x7f16ec00fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00dd10 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00de70 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f80094a0 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec018640 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc11fab0 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.858+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16ec0187a0 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.859+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc11f700 con 0x7f16fc09e170 2023-10-03T10:15:16.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.859+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16ec03fe40 con 0x7f16fc09e170 2023-10-03T10:15:16.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:16.863+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16ec017990 con 0x7f16fc09e170 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.016+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce3004f2a0 con 0x7fce300a0a70 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.017+0000 7fce27fff700 1 -- 172.21.15.125:0/767969786 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce2802c070 con 0x7fce300a0a70 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 msgr2=0x7fce30122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce30122540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fce28016000 tx=0x7fce28004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 shutdown_connections 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce30133f50 0x7fce30122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce300a0a70 0x7fce30122540 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 --2- 172.21.15.125:0/767969786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce300a1380 0x7fce30122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 >> 172.21.15.125:0/767969786 conn(0x7fce300a6610 msgr2=0x7fce3009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 shutdown_connections 2023-10-03T10:15:17.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.019+0000 7fce36191700 1 -- 172.21.15.125:0/767969786 wait complete. 2023-10-03T10:15:17.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:17.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.059+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16fc04f2a0 con 0x7f16fc09e170 2023-10-03T10:15:17.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.059+0000 7f16f27fc700 1 -- 172.21.15.125:0/3075057125 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16ec0173a0 con 0x7f16fc09e170 2023-10-03T10:15:17.058 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 msgr2=0x7f16fc11c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00fbd0 tx=0x7f16ec00fee0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 shutdown_connections 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16fc130ce0 0x7f16fc11cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16fc09d860 0x7f16fc11c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 --2- 172.21.15.125:0/3075057125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16fc09e170 0x7f16fc11c800 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 >> 172.21.15.125:0/3075057125 conn(0x7f16fc099c40 msgr2=0x7f16fc12e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 shutdown_connections 2023-10-03T10:15:17.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.061+0000 7f1703d8f700 1 -- 172.21.15.125:0/3075057125 wait complete. 2023-10-03T10:15:17.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:17.101 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:17.101 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:17.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.239+0000 7f57ef457700 1 Processor -- start 2023-10-03T10:15:17.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.239+0000 7f09a4b60700 1 Processor -- start 2023-10-03T10:15:17.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.239+0000 7f09a4b60700 1 -- start start 2023-10-03T10:15:17.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.239+0000 7f57ef457700 1 -- start start 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f09a4b60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 0x7f09a0135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f09a4b60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09a0135f80 0x7f09a0138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f09a4b60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a0099a60 con 0x7f09a0099e20 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f09a4b60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a009bf50 con 0x7f09a0135f80 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f09a4b60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09a009b230 con 0x7f09a0133660 2023-10-03T10:15:17.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ef457700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ef457700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f099dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 0x7f09a0135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f099dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 0x7f09a0135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60926/0 (socket says 172.21.15.125:60926) 2023-10-03T10:15:17.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f099dd9b700 1 -- 172.21.15.125:0/1397790110 learned_addr learned my addr 172.21.15.125:0/1397790110 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ef457700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e809b110 con 0x7f57e809ad40 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ed1f3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f57e809ad40 0x7f57e8133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42712/0 (socket says 172.21.15.125:42712) 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ed1f3700 1 -- 172.21.15.125:0/2767773516 learned_addr learned my addr 172.21.15.125:0/2767773516 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80a3b60 con 0x7f57e8134140 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80a1a80 con 0x7f57e8134570 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f57ed9f4700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.240+0000 7f099ed9d700 1 --2- 172.21.15.125:0/1397790110 >> v2:172.21.15.125:3300/0 conn(0x7f09a0135f80 0x7f09a0138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099ed9d700 1 -- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 msgr2=0x7f09a0135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099ed9d700 1 --2- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 0x7f09a0135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099ed9d700 1 -- 172.21.15.125:0/1397790110 >> v1:172.21.15.125:6789/0 conn(0x7f09a0099e20 legacy=0x7f09a009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099ed9d700 1 -- 172.21.15.125:0/1397790110 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a009bb90 con 0x7f09a0135f80 2023-10-03T10:15:17.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 msgr2=0x7f57e813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2767773516 >> v1:172.21.15.125:6789/0 conn(0x7f57e809ad40 legacy=0x7f57e8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2767773516 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80a2fa0 con 0x7f57e8134140 2023-10-03T10:15:17.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099ed9d700 1 --2- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0135f80 0x7f09a0138360 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce84666572b7e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099d59a700 1 -- 172.21.15.125:0/1397790110 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800e070 con 0x7f09a0135f80 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099d59a700 1 -- 172.21.15.125:0/1397790110 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800bb20 con 0x7f09a0135f80 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f099d59a700 1 -- 172.21.15.125:0/1397790110 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998012430 con 0x7f09a0135f80 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e8138e80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098a0 tx=0x7f57d8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69bf25e561a7198e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57dffff700 1 -- 172.21.15.125:0/2767773516 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004230 con 0x7f57e8134140 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57dffff700 1 -- 172.21.15.125:0/2767773516 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8004390 con 0x7f57e8134140 2023-10-03T10:15:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.241+0000 7f57dffff700 1 -- 172.21.15.125:0/2767773516 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80036a0 con 0x7f57e8134140 2023-10-03T10:15:17.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 -- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0135f80 msgr2=0x7f09a0138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 --2- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0135f80 0x7f09a0138360 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:17.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 -- 172.21.15.125:0/1397790110 shutdown_connections 2023-10-03T10:15:17.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 msgr2=0x7f57e8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 --2- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0135f80 0x7f09a0138360 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 --2- 172.21.15.125:0/1397790110 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0133660 0x7f09a0135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 -- 172.21.15.125:0/1397790110 >> 172.21.15.125:0/1397790110 conn(0x7f09a00a2980 msgr2=0x7f09a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e8138e80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098a0 tx=0x7f57d8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 shutdown_connections 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 --2- 172.21.15.125:0/2767773516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e8138e80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 -- 172.21.15.125:0/1397790110 shutdown_connections 2023-10-03T10:15:17.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f09a4b60700 1 -- 172.21.15.125:0/1397790110 wait complete. 2023-10-03T10:15:17.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 >> 172.21.15.125:0/2767773516 conn(0x7f57e8099c40 msgr2=0x7f57e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 shutdown_connections 2023-10-03T10:15:17.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.242+0000 7f57ef457700 1 -- 172.21.15.125:0/2767773516 wait complete. 2023-10-03T10:15:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 Processor -- start 2023-10-03T10:15:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 Processor -- start 2023-10-03T10:15:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 -- start start 2023-10-03T10:15:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 -- start start 2023-10-03T10:15:17.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57e809ad40 0x7f57e811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 0x7f09a01c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a0133660 0x7f09a01c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e811ee20 con 0x7f57e809ad40 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e809c7e0 con 0x7f57e8134140 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f57ef457700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57e809e930 con 0x7f57e8134570 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01c9050 con 0x7f09a0099e20 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a012d950 con 0x7f09a0133660 2023-10-03T10:15:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.243+0000 7f09a4b60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0071a30 con 0x7f09a0135f80 2023-10-03T10:15:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ed9f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47580/0 (socket says 172.21.15.125:47580) 2023-10-03T10:15:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2799426688 learned_addr learned my addr 172.21.15.125:0/2799426688 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60938/0 (socket says 172.21.15.125:60938) 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 -- 172.21.15.125:0/297090806 learned_addr learned my addr 172.21.15.125:0/297090806 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099e59c700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 0x7f09a01c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099dd9b700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a0133660 0x7f09a01c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 -- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a0133660 msgr2=0x7f09a01c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a0133660 0x7f09a01c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 -- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 msgr2=0x7f09a01c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 0x7f09a01c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 -- 172.21.15.125:0/297090806 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998009a70 con 0x7f09a0135f80 2023-10-03T10:15:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099e59c700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 0x7f09a01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 msgr2=0x7f57e811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57e809ad40 msgr2=0x7f57e811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57e809ad40 0x7f57e811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 -- 172.21.15.125:0/2799426688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80094a0 con 0x7f57e8134140 2023-10-03T10:15:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f099ed9d700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0998014040 tx=0x7f0998004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ec9f2700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57e809cca0 tx=0x7f57d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003da0 con 0x7f57e8134140 2023-10-03T10:15:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998012e40 con 0x7f09a0135f80 2023-10-03T10:15:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d801e070 con 0x7f57e8134140 2023-10-03T10:15:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998020070 con 0x7f09a0135f80 2023-10-03T10:15:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8011870 con 0x7f57e8134140 2023-10-03T10:15:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e811ea70 con 0x7f57e8134140 2023-10-03T10:15:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a011e560 con 0x7f09a0135f80 2023-10-03T10:15:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.244+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998004280 con 0x7f09a0135f80 2023-10-03T10:15:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.245+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a009b470 con 0x7f09a0135f80 2023-10-03T10:15:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.245+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e811dbc0 con 0x7f57e8134140 2023-10-03T10:15:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.245+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09980043e0 con 0x7f09a0135f80 2023-10-03T10:15:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.246+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e809f6c0 con 0x7f57e8134140 2023-10-03T10:15:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.246+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0072480 con 0x7f09a0135f80 2023-10-03T10:15:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.246+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0998022070 con 0x7f09a0135f80 2023-10-03T10:15:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.246+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57d80119d0 con 0x7f57e8134140 2023-10-03T10:15:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.246+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57d8040640 con 0x7f57e8134140 2023-10-03T10:15:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.250+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09a0072480 con 0x7f09a0135f80 2023-10-03T10:15:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.250+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57d8011c80 con 0x7f57e8134140 2023-10-03T10:15:17.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.443+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09a0072480 con 0x7f09a0135f80 2023-10-03T10:15:17.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.443+0000 7f098effd700 1 -- 172.21.15.125:0/297090806 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09a0072480 con 0x7f09a0135f80 2023-10-03T10:15:17.443 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:17.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.445+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57e811e620 con 0x7f57e8134140 2023-10-03T10:15:17.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.445+0000 7f57ddffb700 1 -- 172.21.15.125:0/2799426688 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57d8010b70 con 0x7f57e8134140 2023-10-03T10:15:17.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.445+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 msgr2=0x7f09a006fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.445+0000 7f09a4b60700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0998014040 tx=0x7f0998004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.445 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 shutdown_connections 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09a0135f80 0x7f09a006fe20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a0099e20 0x7f09a01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 --2- 172.21.15.125:0/297090806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a0133660 0x7f09a01c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 >> 172.21.15.125:0/297090806 conn(0x7f09a00a2980 msgr2=0x7f09a01324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 shutdown_connections 2023-10-03T10:15:17.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.446+0000 7f09a4b60700 1 -- 172.21.15.125:0/297090806 wait complete. 2023-10-03T10:15:17.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 msgr2=0x7f57e811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57e809cca0 tx=0x7f57d8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 shutdown_connections 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f57e8134570 0x7f57e811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57e809ad40 0x7f57e811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.447+0000 7f57ef457700 1 --2- 172.21.15.125:0/2799426688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e8134140 0x7f57e811ce00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.448+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 >> 172.21.15.125:0/2799426688 conn(0x7f57e8099c40 msgr2=0x7f57e80a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.448+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 shutdown_connections 2023-10-03T10:15:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:17.448+0000 7f57ef457700 1 -- 172.21.15.125:0/2799426688 wait complete. 2023-10-03T10:15:17.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:17.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:18.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:18.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:18.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.164+0000 7f6184089700 1 Processor -- start 2023-10-03T10:15:18.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.164+0000 7f6184089700 1 -- start start 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6184089700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6184089700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6184089700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c09aaa0 con 0x7f617c09e170 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6184089700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c09f870 con 0x7f617c09d860 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6184089700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617c09b360 con 0x7f617c130eb0 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6181e25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60950/0 (socket says 172.21.15.125:60950) 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6181e25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46806/0 (socket says 172.21.15.125:46806) 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6181624700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f617c09e170 0x7f617c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42726/0 (socket says 172.21.15.125:42726) 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 -- 172.21.15.125:0/2732441980 learned_addr learned my addr 172.21.15.125:0/2732441980 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 -- 172.21.15.125:0/2732441980 >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 msgr2=0x7f617c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 --2- 172.21.15.125:0/2732441980 >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 -- 172.21.15.125:0/2732441980 >> v1:172.21.15.125:6789/0 conn(0x7f617c09e170 legacy=0x7f617c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6182626700 1 -- 172.21.15.125:0/2732441980 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c09b620 con 0x7f617c130eb0 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6180e23700 1 -- 172.21.15.125:0/2732441980 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830502195 0 0) 0x7f617c09aaa0 con 0x7f617c09e170 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.165+0000 7f6181e25700 1 --2- 172.21.15.125:0/2732441980 >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6182626700 1 --2- 172.21.15.125:0/2732441980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f617400d150 tx=0x7f617400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98bda2e2312d6531 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6180e23700 1 -- 172.21.15.125:0/2732441980 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174010070 con 0x7f617c130eb0 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6180e23700 1 -- 172.21.15.125:0/2732441980 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617400dd10 con 0x7f617c130eb0 2023-10-03T10:15:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6180e23700 1 -- 172.21.15.125:0/2732441980 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617400b310 con 0x7f617c130eb0 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 -- 172.21.15.125:0/2732441980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 msgr2=0x7f617c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 --2- 172.21.15.125:0/2732441980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f617400d150 tx=0x7f617400d460 comp rx=0 tx=0).stop 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 -- 172.21.15.125:0/2732441980 shutdown_connections 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 --2- 172.21.15.125:0/2732441980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c130eb0 0x7f617c138a00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 --2- 172.21.15.125:0/2732441980 >> v2:172.21.15.125:3300/0 conn(0x7f617c09d860 0x7f617c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 -- 172.21.15.125:0/2732441980 >> 172.21.15.125:0/2732441980 conn(0x7f617c099c40 msgr2=0x7f617c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 -- 172.21.15.125:0/2732441980 shutdown_connections 2023-10-03T10:15:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.166+0000 7f6184089700 1 -- 172.21.15.125:0/2732441980 wait complete. 2023-10-03T10:15:18.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.167+0000 7f6184089700 1 Processor -- start 2023-10-03T10:15:18.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.167+0000 7f6184089700 1 -- start start 2023-10-03T10:15:18.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 0x7f617c122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 0x7f617c123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c123be0 con 0x7f617c09e170 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c125f50 con 0x7f617c130eb0 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6184089700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617c124430 con 0x7f617c09d860 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181624700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 0x7f617c122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60956/0 (socket says 172.21.15.125:60956) 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 -- 172.21.15.125:0/308169510 learned_addr learned my addr 172.21.15.125:0/308169510 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181624700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 0x7f617c122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46818/0 (socket says 172.21.15.125:46818) 2023-10-03T10:15:18.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6182626700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 0x7f617c123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 -- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 msgr2=0x7f617c123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 0x7f617c123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 -- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 msgr2=0x7f617c122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 0x7f617c122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 -- 172.21.15.125:0/308169510 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0094a0 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6182626700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 0x7f617c123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.168+0000 7f6181e25700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f616c00ebe0 tx=0x7f616c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00c850 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617400bd40 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00c9b0 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00cd40 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c130260 con 0x7f617c09d860 2023-10-03T10:15:18.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.169+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f616c013470 con 0x7f617c09d860 2023-10-03T10:15:18.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.170+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c125db0 con 0x7f617c09d860 2023-10-03T10:15:18.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.170+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f616c03f9d0 con 0x7f617c09d860 2023-10-03T10:15:18.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.178+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f617c125db0 con 0x7f617c09d860 2023-10-03T10:15:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.207+0000 7f8644b89700 1 Processor -- start 2023-10-03T10:15:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.207+0000 7f8644b89700 1 -- start start 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f8644b89700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8640133ad0 0x7f8640133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f8644b89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f8644b89700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864006b2d0 con 0x7f86401300a0 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f8644b89700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8640133610 con 0x7f8640133ad0 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f8644b89700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864009a500 con 0x7f8640130bc0 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8640133ad0 0x7f8640133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8640133ad0 0x7f8640133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46820/0 (socket says 172.21.15.125:46820) 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60964/0 (socket says 172.21.15.125:60964) 2023-10-03T10:15:18.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 -- 172.21.15.125:0/1946398749 learned_addr learned my addr 172.21.15.125:0/1946398749 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f86401300a0 0x7f86401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42736/0 (socket says 172.21.15.125:42736) 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 -- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 msgr2=0x7f864013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 -- 172.21.15.125:0/1946398749 >> v1:172.21.15.125:6789/0 conn(0x7f86401300a0 legacy=0x7f86401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 -- 172.21.15.125:0/1946398749 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86401338b0 con 0x7f8640133ad0 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863ed9d700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.208+0000 7f863e59c700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f8640133ea0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f86300098f0 tx=0x7f8630009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94adfa9e818bf15e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f863d59a700 1 -- 172.21.15.125:0/1946398749 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630011830 con 0x7f8640133ad0 2023-10-03T10:15:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f863d59a700 1 -- 172.21.15.125:0/1946398749 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630011990 con 0x7f8640133ad0 2023-10-03T10:15:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f863d59a700 1 -- 172.21.15.125:0/1946398749 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630011d20 con 0x7f8640133ad0 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 -- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 msgr2=0x7f8640133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f8640133ea0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f86300098f0 tx=0x7f8630009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 -- 172.21.15.125:0/1946398749 shutdown_connections 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 --2- 172.21.15.125:0/1946398749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f8640133ea0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.211+0000 7f8644b89700 1 -- 172.21.15.125:0/1946398749 >> 172.21.15.125:0/1946398749 conn(0x7f8640099c40 msgr2=0x7f86400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.212+0000 7f8644b89700 1 -- 172.21.15.125:0/1946398749 shutdown_connections 2023-10-03T10:15:18.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.212+0000 7f8644b89700 1 -- 172.21.15.125:0/1946398749 wait complete. 2023-10-03T10:15:18.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 Processor -- start 2023-10-03T10:15:18.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 -- start start 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640120e00 con 0x7f8640133ad0 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864012d580 con 0x7f86401300a0 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f8644b89700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864012dd00 con 0x7f8640130bc0 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46824/0 (socket says 172.21.15.125:46824) 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47616/0 (socket says 172.21.15.125:47616) 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863ed9d700 1 -- 172.21.15.125:0/3369224367 learned_addr learned my addr 172.21.15.125:0/3369224367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.213+0000 7f863dd9b700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 -- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 msgr2=0x7f864011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 -- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 msgr2=0x7f864011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 -- 172.21.15.125:0/3369224367 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009a70 con 0x7f86401300a0 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863dd9b700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863ed9d700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f863e59c700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8630016000 tx=0x7f8630004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300036a0 con 0x7f86401300a0 2023-10-03T10:15:18.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630003800 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630003b90 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8630009550 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.214+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86400721b0 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.215+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8630021070 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.215+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8630040720 con 0x7f86401300a0 2023-10-03T10:15:18.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.215+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864004f2a0 con 0x7f86401300a0 2023-10-03T10:15:18.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.220+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f863001a410 con 0x7f86401300a0 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.373+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f617c125db0 con 0x7f617c09d860 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.374+0000 7f61727fc700 1 -- 172.21.15.125:0/308169510 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f617c125db0 con 0x7f617c09d860 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 msgr2=0x7f617c122710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f616c00ebe0 tx=0x7f616c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 shutdown_connections 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617c130eb0 0x7f617c123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617c09d860 0x7f617c122710 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 --2- 172.21.15.125:0/308169510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617c09e170 0x7f617c122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 >> 172.21.15.125:0/308169510 conn(0x7f617c099c40 msgr2=0x7f617c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 shutdown_connections 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.376+0000 7f6184089700 1 -- 172.21.15.125:0/308169510 wait complete. 2023-10-03T10:15:18.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:18.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.415+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f864011fea0 con 0x7f86401300a0 2023-10-03T10:15:18.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.415+0000 7f862effd700 1 -- 172.21.15.125:0/3369224367 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8630015030 con 0x7f86401300a0 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 msgr2=0x7f864011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8630016000 tx=0x7f8630004750 comp rx=0 tx=0).stop 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 shutdown_connections 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8640133ad0 0x7f864011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86401300a0 0x7f864011da40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 --2- 172.21.15.125:0/3369224367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8640130bc0 0x7f864011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 >> 172.21.15.125:0/3369224367 conn(0x7f8640099c40 msgr2=0x7f8640132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 shutdown_connections 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.417+0000 7f8644b89700 1 -- 172.21.15.125:0/3369224367 wait complete. 2023-10-03T10:15:18.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:18.459 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:18.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:18.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.596+0000 7fd9e4706700 1 Processor -- start 2023-10-03T10:15:18.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.596+0000 7fd9e4706700 1 -- start start 2023-10-03T10:15:18.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.596+0000 7f643e512700 1 Processor -- start 2023-10-03T10:15:18.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.596+0000 7f643e512700 1 -- start start 2023-10-03T10:15:18.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e4706700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e4706700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643e512700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64380a0a70 0x7f64380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e4706700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc09dc00 con 0x7fd9dc133f50 2023-10-03T10:15:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e4706700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc09ea60 con 0x7fd9dc0a0a70 2023-10-03T10:15:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e4706700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc09dec0 con 0x7fd9dc0a1380 2023-10-03T10:15:18.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643e512700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643e512700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643809dc00 con 0x7f64380a1380 2023-10-03T10:15:18.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643e512700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643809ea90 con 0x7f64380a0a70 2023-10-03T10:15:18.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643e512700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643809dec0 con 0x7f6438134120 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60976/0 (socket says 172.21.15.125:60976) 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 -- 172.21.15.125:0/3850425985 learned_addr learned my addr 172.21.15.125:0/3850425985 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47630/0 (socket says 172.21.15.125:47630) 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 -- 172.21.15.125:0/2325331031 learned_addr learned my addr 172.21.15.125:0/2325331031 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e24a2700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f6437fff700 1 --2- 172.21.15.125:0/2325331031 >> v2:172.21.15.125:3300/0 conn(0x7f64380a0a70 0x7f64380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 -- 172.21.15.125:0/2325331031 >> v2:172.21.15.125:3300/0 conn(0x7f64380a0a70 msgr2=0x7f64380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 --2- 172.21.15.125:0/2325331031 >> v2:172.21.15.125:3300/0 conn(0x7f64380a0a70 0x7f64380a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 -- 172.21.15.125:0/2325331031 >> v1:172.21.15.125:6789/0 conn(0x7f64380a1380 legacy=0x7f6438133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 -- 172.21.15.125:0/2325331031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643809e6a0 con 0x7f6438134120 2023-10-03T10:15:18.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 -- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 msgr2=0x7fd9dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 -- 172.21.15.125:0/3850425985 >> v1:172.21.15.125:6789/0 conn(0x7fd9dc133f50 legacy=0x7fd9dc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 -- 172.21.15.125:0/3850425985 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc09e6a0 con 0x7fd9dc0a1380 2023-10-03T10:15:18.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7f643caaf700 1 --2- 172.21.15.125:0/2325331031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6430009e50 tx=0x7f643000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d66185755f7f20db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.597+0000 7fd9e1ca1700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009920 tx=0x7fd9cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8faaeee37fa9d72c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e14a0700 1 -- 172.21.15.125:0/3850425985 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011830 con 0x7fd9dc0a1380 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f6436ffd700 1 -- 172.21.15.125:0/2325331031 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000e070 con 0x7f6438134120 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f6436ffd700 1 -- 172.21.15.125:0/2325331031 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643000b9c0 con 0x7f6438134120 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f6436ffd700 1 -- 172.21.15.125:0/2325331031 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000bd70 con 0x7f6438134120 2023-10-03T10:15:18.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e14a0700 1 -- 172.21.15.125:0/3850425985 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc011990 con 0x7fd9dc0a1380 2023-10-03T10:15:18.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e14a0700 1 -- 172.21.15.125:0/3850425985 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011d20 con 0x7fd9dc0a1380 2023-10-03T10:15:18.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 -- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 msgr2=0x7fd9dc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009920 tx=0x7fd9cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 -- 172.21.15.125:0/2325331031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 msgr2=0x7f643813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 --2- 172.21.15.125:0/2325331031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6430009e50 tx=0x7f643000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 -- 172.21.15.125:0/2325331031 shutdown_connections 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 --2- 172.21.15.125:0/2325331031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f643813bce0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 --2- 172.21.15.125:0/2325331031 >> v2:172.21.15.125:3300/0 conn(0x7f64380a0a70 0x7f64380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 -- 172.21.15.125:0/2325331031 >> 172.21.15.125:0/2325331031 conn(0x7f64380a6610 msgr2=0x7f64380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 -- 172.21.15.125:0/3850425985 shutdown_connections 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3850425985 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc133a10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 -- 172.21.15.125:0/3850425985 >> 172.21.15.125:0/3850425985 conn(0x7fd9dc0a6610 msgr2=0x7fd9dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7fd9e4706700 1 -- 172.21.15.125:0/3850425985 shutdown_connections 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 -- 172.21.15.125:0/2325331031 shutdown_connections 2023-10-03T10:15:18.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.598+0000 7f643e512700 1 -- 172.21.15.125:0/2325331031 wait complete. 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.599+0000 7fd9e4706700 1 -- 172.21.15.125:0/3850425985 wait complete. 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.599+0000 7fd9e4706700 1 Processor -- start 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.599+0000 7f643e512700 1 Processor -- start 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.599+0000 7fd9e4706700 1 -- start start 2023-10-03T10:15:18.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 -- start start 2023-10-03T10:15:18.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc1c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 0x7fd9dc1c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc1248d0 con 0x7fd9dc133f50 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc1246e0 con 0x7fd9dc0a0a70 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e4706700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc133aa0 con 0x7fd9dc0a1380 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e24a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e24a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47644/0 (socket says 172.21.15.125:47644) 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 0x7fd9dc1c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e24a2700 1 -- 172.21.15.125:0/3591440135 learned_addr learned my addr 172.21.15.125:0/3591440135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64380a1380 0x7f6438122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f64381232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438126160 con 0x7f64380a1380 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6438126340 con 0x7f6438134120 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643e512700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6438125da0 con 0x7f64380a0a70 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f6437fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f6437fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60998/0 (socket says 172.21.15.125:60998) 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f6437fff700 1 -- 172.21.15.125:0/2279455927 learned_addr learned my addr 172.21.15.125:0/2279455927 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f643caaf700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f64381232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7f64377fe700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64380a1380 0x7f6438122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 -- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 msgr2=0x7f64381232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f64381232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 -- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64380a1380 msgr2=0x7f6438122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64380a1380 0x7f6438122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 -- 172.21.15.125:0/2279455927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430009b30 con 0x7f64380a0a70 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e1ca1700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc1c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 -- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 msgr2=0x7fd9dc1c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc1c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 -- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 msgr2=0x7fd9dc1c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e2ca3700 1 -- 172.21.15.125:0/3591440135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009550 con 0x7fd9dc133f50 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e1ca1700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc1c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.600+0000 7fd9e24a2700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9e2ca3700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 0x7fd9dc1c8d30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400cbc0 tx=0x7fd9d400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4003c00 con 0x7fd9dc133f50 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4003d60 con 0x7fd9dc133f50 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc126050 con 0x7fd9dc133f50 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400aaa0 con 0x7fd9dc133f50 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f6437fff700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f642800e840 tx=0x7f642800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7f643caaf700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f64381232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428013610 con 0x7f64380a0a70 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc126af0 con 0x7fd9dc133f50 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.601+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9d400ac00 con 0x7fd9dc133f50 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9d403f700 con 0x7fd9dc133f50 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428013770 con 0x7f64380a0a70 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428013b00 con 0x7f64380a0a70 2023-10-03T10:15:18.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64380a03e0 con 0x7f64380a0a70 2023-10-03T10:15:18.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc04f2a0 con 0x7fd9dc133f50 2023-10-03T10:15:18.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64381339b0 con 0x7f64380a0a70 2023-10-03T10:15:18.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.602+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6428013c60 con 0x7f64380a0a70 2023-10-03T10:15:18.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.603+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f642803f2b0 con 0x7f64380a0a70 2023-10-03T10:15:18.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.603+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643804f2a0 con 0x7f64380a0a70 2023-10-03T10:15:18.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.606+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9d40198f0 con 0x7fd9dc133f50 2023-10-03T10:15:18.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.608+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6428012370 con 0x7f64380a0a70 2023-10-03T10:15:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.799+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6438072980 con 0x7f64380a0a70 2023-10-03T10:15:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.800+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd9dc126270 con 0x7fd9dc133f50 2023-10-03T10:15:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.800+0000 7f6434ff9700 1 -- 172.21.15.125:0/2279455927 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6428010310 con 0x7f64380a0a70 2023-10-03T10:15:18.800 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.800+0000 7fd9d2ffd700 1 -- 172.21.15.125:0/3591440135 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9d4019300 con 0x7fd9dc133f50 2023-10-03T10:15:18.800 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 msgr2=0x7f6438122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f642800e840 tx=0x7f642800eb50 comp rx=0 tx=0).stop 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 shutdown_connections 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6438134120 0x7f64381232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64380a0a70 0x7f6438122820 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 --2- 172.21.15.125:0/2279455927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64380a1380 0x7f6438122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 >> 172.21.15.125:0/2279455927 conn(0x7f64380a6610 msgr2=0x7f64380a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 shutdown_connections 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7f643e512700 1 -- 172.21.15.125:0/2279455927 wait complete. 2023-10-03T10:15:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 msgr2=0x7fd9dc1c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 0x7fd9dc1c8d30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400cbc0 tx=0x7fd9d400ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 shutdown_connections 2023-10-03T10:15:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9dc133f50 0x7fd9dc1c8d30 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9dc0a0a70 0x7fd9dc1c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 --2- 172.21.15.125:0/3591440135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9dc0a1380 0x7fd9dc1c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 >> 172.21.15.125:0/3591440135 conn(0x7fd9dc0a6610 msgr2=0x7fd9dc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 shutdown_connections 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:18.802+0000 7fd9e4706700 1 -- 172.21.15.125:0/3591440135 wait complete. 2023-10-03T10:15:18.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:18.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:19.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:19.429 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:19.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.520+0000 7fdbe71f3700 1 Processor -- start 2023-10-03T10:15:19.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.520+0000 7fdbe71f3700 1 -- start start 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe71f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe71f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe71f3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe009dc00 con 0x7fdbe0133f50 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe71f3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe009ea60 con 0x7fdbe00a0a70 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe71f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe009dec0 con 0x7fdbe00a1380 2023-10-03T10:15:19.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe4f8f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe5790700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdbe0133f50 0x7fdbe013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42770/0 (socket says 172.21.15.125:42770) 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe4f8f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46854/0 (socket says 172.21.15.125:46854) 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe5790700 1 -- 172.21.15.125:0/2114938525 learned_addr learned my addr 172.21.15.125:0/2114938525 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 -- 172.21.15.125:0/2114938525 >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 msgr2=0x7fdbe00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 --2- 172.21.15.125:0/2114938525 >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 -- 172.21.15.125:0/2114938525 >> v1:172.21.15.125:6789/0 conn(0x7fdbe0133f50 legacy=0x7fdbe013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 -- 172.21.15.125:0/2114938525 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe009e6a0 con 0x7fdbe00a1380 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbe4f8f700 1 --2- 172.21.15.125:0/2114938525 >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdffff700 1 --2- 172.21.15.125:0/2114938525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe0133a10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009840 tx=0x7fdbcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b10efa3fd99059 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.521+0000 7fdbdf7fe700 1 -- 172.21.15.125:0/2114938525 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc011830 con 0x7fdbe00a1380 2023-10-03T10:15:19.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbdf7fe700 1 -- 172.21.15.125:0/2114938525 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc011990 con 0x7fdbe00a1380 2023-10-03T10:15:19.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbdf7fe700 1 -- 172.21.15.125:0/2114938525 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc011d20 con 0x7fdbe00a1380 2023-10-03T10:15:19.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2114938525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 msgr2=0x7fdbe0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2114938525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe0133a10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009840 tx=0x7fdbcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2114938525 shutdown_connections 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2114938525 >> v2:172.21.15.125:3300/0 conn(0x7fdbe00a0a70 0x7fdbe00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2114938525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe0133a10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2114938525 >> 172.21.15.125:0/2114938525 conn(0x7fdbe00a6610 msgr2=0x7fdbe00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2114938525 shutdown_connections 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.522+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2114938525 wait complete. 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.523+0000 7fdbe71f3700 1 Processor -- start 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.523+0000 7fdbe71f3700 1 -- start start 2023-10-03T10:15:19.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe00a0a70 0x7fdbe01c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe01c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0122e90 con 0x7fdbe00a0a70 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0133a10 con 0x7fdbe0133f50 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00a03e0 con 0x7fdbe00a1380 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47656/0 (socket says 172.21.15.125:47656) 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbdffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe01c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 -- 172.21.15.125:0/2205119599 learned_addr learned my addr 172.21.15.125:0/2205119599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe4f8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe00a0a70 0x7fdbe01c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 -- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 msgr2=0x7fdbe01c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe01c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 -- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe00a0a70 msgr2=0x7fdbe01c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe00a0a70 0x7fdbe01c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 -- 172.21.15.125:0/2205119599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40094a0 con 0x7fdbe0133f50 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbdffff700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe01c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe5790700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800cbc0 tx=0x7fdbd800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800a9e0 con 0x7fdbe0133f50 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800ab40 con 0x7fdbe0133f50 2023-10-03T10:15:19.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.524+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0094a0 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.525+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8012400 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.525+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe0126030 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.525+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbd801b3b0 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.525+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdbd803f290 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.525+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe0126dd0 con 0x7fdbe0133f50 2023-10-03T10:15:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.530+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbd80192c0 con 0x7fdbe0133f50 2023-10-03T10:15:19.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.559+0000 7fdf018bb700 1 Processor -- start 2023-10-03T10:15:19.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.559+0000 7fdf018bb700 1 -- start start 2023-10-03T10:15:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.559+0000 7fdf018bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 0x7fdefc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdf018bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 0x7fdefc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdf018bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc09b110 con 0x7fdefc0a0a70 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdf018bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0a3b60 con 0x7fdefc09ad40 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdf018bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1348e0 con 0x7fdefc133f70 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 0x7fdefc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdefc0a0a70 0x7fdefc0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42782/0 (socket says 172.21.15.125:42782) 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefb7fe700 1 -- 172.21.15.125:0/4132016839 learned_addr learned my addr 172.21.15.125:0/4132016839 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 0x7fdefc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdef9ffb700 1 -- 172.21.15.125:0/4132016839 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643588878 0 0) 0x7fdefc09b110 con 0x7fdefc0a0a70 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 -- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 msgr2=0x7fdefc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 0x7fdefc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 -- 172.21.15.125:0/4132016839 >> v1:172.21.15.125:6789/0 conn(0x7fdefc0a0a70 legacy=0x7fdefc0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 -- 172.21.15.125:0/4132016839 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0a2fa0 con 0x7fdefc133f70 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefaffd700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 0x7fdefc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdefa7fc700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 0x7fdefc1343a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009870 tx=0x7fdef0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae46f05aad98d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdef9ffb700 1 -- 172.21.15.125:0/4132016839 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011830 con 0x7fdefc133f70 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdef9ffb700 1 -- 172.21.15.125:0/4132016839 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0011990 con 0x7fdefc133f70 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.560+0000 7fdef9ffb700 1 -- 172.21.15.125:0/4132016839 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011d20 con 0x7fdefc133f70 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 -- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 msgr2=0x7fdefc1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 0x7fdefc1343a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009870 tx=0x7fdef0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 -- 172.21.15.125:0/4132016839 shutdown_connections 2023-10-03T10:15:19.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc09ad40 0x7fdefc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 --2- 172.21.15.125:0/4132016839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc133f70 0x7fdefc1343a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 -- 172.21.15.125:0/4132016839 >> 172.21.15.125:0/4132016839 conn(0x7fdefc099c40 msgr2=0x7fdefc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 -- 172.21.15.125:0/4132016839 shutdown_connections 2023-10-03T10:15:19.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.561+0000 7fdf018bb700 1 -- 172.21.15.125:0/4132016839 wait complete. 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 Processor -- start 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 -- start start 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 0x7fdefc1213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 0x7fdefc121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1327a0 con 0x7fdefc0a0a70 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc122830 con 0x7fdefc133f70 2023-10-03T10:15:19.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.562+0000 7fdf018bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc123e70 con 0x7fdefc09ad40 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 0x7fdefc1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 0x7fdefc121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46880/0 (socket says 172.21.15.125:46880) 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 0x7fdefc1213d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32808/0 (socket says 172.21.15.125:32808) 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefa7fc700 1 -- 172.21.15.125:0/1939296194 learned_addr learned my addr 172.21.15.125:0/1939296194 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 -- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 msgr2=0x7fdefc1213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 0x7fdefc1213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 -- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 msgr2=0x7fdefc121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 -- 172.21.15.125:0/1939296194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0094a0 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefa7fc700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdefb7fe700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 0x7fdefc121e50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdef400cc10 tx=0x7fdef400cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400aa00 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400ab80 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40070d0 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef00094a0 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.563+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc124680 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.564+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef4007230 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.564+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc11e060 con 0x7fdefc133f70 2023-10-03T10:15:19.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.564+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdef403f050 con 0x7fdefc133f70 2023-10-03T10:15:19.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.569+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef4018070 con 0x7fdefc133f70 2023-10-03T10:15:19.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.717+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbe01261c0 con 0x7fdbe0133f50 2023-10-03T10:15:19.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.717+0000 7fdbdd7fa700 1 -- 172.21.15.125:0/2205119599 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbd8017020 con 0x7fdbe0133f50 2023-10-03T10:15:19.717 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:19.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.719+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 msgr2=0x7fdbe01c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.719+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800cbc0 tx=0x7fdbd800ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 shutdown_connections 2023-10-03T10:15:19.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe0133f50 0x7fdbe01c8cd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe00a0a70 0x7fdbe01c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 --2- 172.21.15.125:0/2205119599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdbe00a1380 0x7fdbe01c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 >> 172.21.15.125:0/2205119599 conn(0x7fdbe00a6610 msgr2=0x7fdbe00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 shutdown_connections 2023-10-03T10:15:19.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.720+0000 7fdbe71f3700 1 -- 172.21.15.125:0/2205119599 wait complete. 2023-10-03T10:15:19.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.756+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdefc09e810 con 0x7fdefc133f70 2023-10-03T10:15:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.756+0000 7fdee3fff700 1 -- 172.21.15.125:0/1939296194 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef40074e0 con 0x7fdefc133f70 2023-10-03T10:15:19.756 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.758+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 msgr2=0x7fdefc121e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.758+0000 7fdf018bb700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 0x7fdefc121e50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdef400cc10 tx=0x7fdef400cf20 comp rx=0 tx=0).stop 2023-10-03T10:15:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 shutdown_connections 2023-10-03T10:15:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdefc133f70 0x7fdefc121e50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdefc09ad40 0x7fdefc1213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 --2- 172.21.15.125:0/1939296194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdefc0a0a70 0x7fdefc121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 >> 172.21.15.125:0/1939296194 conn(0x7fdefc099c40 msgr2=0x7fdefc1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 shutdown_connections 2023-10-03T10:15:19.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.759+0000 7fdf018bb700 1 -- 172.21.15.125:0/1939296194 wait complete. 2023-10-03T10:15:19.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:19.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:19.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:19.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.940+0000 7f6067986700 1 Processor -- start 2023-10-03T10:15:19.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.940+0000 7f082715f700 1 Processor -- start 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.940+0000 7f6067986700 1 -- start start 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.940+0000 7f082715f700 1 -- start start 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6067986700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 0x7f606009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6067986700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08200a1340 0x7f082012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6067986700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606009c970 con 0x7f606009f180 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6067986700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600a0920 con 0x7f606009e870 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6067986700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606009f9c0 con 0x7f6060131f40 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200a1e70 con 0x7f08200a1340 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082009a720 con 0x7f08201304a0 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f082715f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082009b300 con 0x7f08200a0a30 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47680/0 (socket says 172.21.15.125:47680) 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f0824efb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 -- 172.21.15.125:0/3012990511 learned_addr learned my addr 172.21.15.125:0/3012990511 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f081ffff700 1 --2- 172.21.15.125:0/3012990511 >> v2:172.21.15.125:3300/0 conn(0x7f08200a1340 0x7f082012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065722700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 0x7f606009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065722700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 0x7f606009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46894/0 (socket says 172.21.15.125:46894) 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32832/0 (socket says 172.21.15.125:32832) 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065722700 1 -- 172.21.15.125:0/3321195941 learned_addr learned my addr 172.21.15.125:0/3321195941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 -- 172.21.15.125:0/3321195941 >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 msgr2=0x7f606009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 --2- 172.21.15.125:0/3321195941 >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 0x7f606009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 -- 172.21.15.125:0/3321195941 >> v1:172.21.15.125:6789/0 conn(0x7f606009f180 legacy=0x7f6060131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6057fff700 1 -- 172.21.15.125:0/3321195941 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476894941 0 0) 0x7f606009c970 con 0x7f606009f180 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 -- 172.21.15.125:0/3321195941 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606009bab0 con 0x7f6060131f40 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 -- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 msgr2=0x7f08200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 --2- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 -- 172.21.15.125:0/3012990511 >> v2:172.21.15.125:3300/0 conn(0x7f08200a1340 msgr2=0x7f082012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 --2- 172.21.15.125:0/3012990511 >> v2:172.21.15.125:3300/0 conn(0x7f08200a1340 0x7f082012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 -- 172.21.15.125:0/3012990511 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082009abc0 con 0x7f08201304a0 2023-10-03T10:15:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f08256fc700 1 --2- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e80 tx=0x7f081800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2593734953238c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.941+0000 7f6065f23700 1 --2- 172.21.15.125:0/3321195941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6058009d90 tx=0x7f605800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cfb5bf020b514d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f081f7fe700 1 -- 172.21.15.125:0/3012990511 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800bad0 con 0x7f08201304a0 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6057fff700 1 -- 172.21.15.125:0/3321195941 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800e070 con 0x7f6060131f40 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6057fff700 1 -- 172.21.15.125:0/3321195941 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800bb20 con 0x7f6060131f40 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f081f7fe700 1 -- 172.21.15.125:0/3012990511 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800bc30 con 0x7f08201304a0 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f081f7fe700 1 -- 172.21.15.125:0/3012990511 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180104d0 con 0x7f08201304a0 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6057fff700 1 -- 172.21.15.125:0/3321195941 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058012430 con 0x7f6060131f40 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 -- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 msgr2=0x7f0820130940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 --2- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e80 tx=0x7f081800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 -- 172.21.15.125:0/3321195941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 msgr2=0x7f6060139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 --2- 172.21.15.125:0/3321195941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6058009d90 tx=0x7f605800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 -- 172.21.15.125:0/3321195941 shutdown_connections 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 --2- 172.21.15.125:0/3321195941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060131f40 0x7f6060139ca0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 -- 172.21.15.125:0/3012990511 shutdown_connections 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 --2- 172.21.15.125:0/3321195941 >> v2:172.21.15.125:3300/0 conn(0x7f606009e870 0x7f606009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 -- 172.21.15.125:0/3321195941 >> 172.21.15.125:0/3321195941 conn(0x7f60600a4430 msgr2=0x7f60600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 --2- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08201304a0 0x7f0820130940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 --2- 172.21.15.125:0/3012990511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 --2- 172.21.15.125:0/3012990511 >> v2:172.21.15.125:3300/0 conn(0x7f08200a1340 0x7f082012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 -- 172.21.15.125:0/3012990511 >> 172.21.15.125:0/3012990511 conn(0x7f08200a2980 msgr2=0x7f08200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 -- 172.21.15.125:0/3012990511 shutdown_connections 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f082715f700 1 -- 172.21.15.125:0/3012990511 wait complete. 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.942+0000 7f6067986700 1 -- 172.21.15.125:0/3321195941 shutdown_connections 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.943+0000 7f6067986700 1 -- 172.21.15.125:0/3321195941 wait complete. 2023-10-03T10:15:19.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.943+0000 7f6067986700 1 Processor -- start 2023-10-03T10:15:19.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.943+0000 7f6067986700 1 -- start start 2023-10-03T10:15:19.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f082715f700 1 Processor -- start 2023-10-03T10:15:19.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f082715f700 1 -- start start 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009e870 0x7f606006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 0x7f606006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060125070 con 0x7f6060131f40 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009dba0 con 0x7f606009e870 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6067986700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6060124680 con 0x7f606009f180 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6064f21700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 0x7f606006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46906/0 (socket says 172.21.15.125:46906) 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 -- 172.21.15.125:0/2109809087 learned_addr learned my addr 172.21.15.125:0/2109809087 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065722700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009e870 0x7f606006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 -- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 msgr2=0x7f606006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 0x7f606006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 -- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009e870 msgr2=0x7f606006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009e870 0x7f606006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 -- 172.21.15.125:0/2109809087 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058009a70 con 0x7f6060131f40 2023-10-03T10:15:19.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6064f21700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 0x7f606006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.944+0000 7f6065f23700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f605800b680 tx=0x7f6058004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08201c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058012430 con 0x7f6060131f40 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08201304a0 0x7f08201c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0820120f60 con 0x7f08201304a0 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820121140 con 0x7f08200a1340 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f082715f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08201c1710 con 0x7f08200a0a30 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f08256fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08201304a0 0x7f08201c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47712/0 (socket says 172.21.15.125:47712) 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 -- 172.21.15.125:0/1696276352 learned_addr learned my addr 172.21.15.125:0/1696276352 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058020070 con 0x7f6060131f40 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6060125d30 con 0x7f6060131f40 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058004280 con 0x7f6060131f40 2023-10-03T10:15:19.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f0824efb700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08201c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606006d690 con 0x7f6060131f40 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 -- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 msgr2=0x7f08201c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08201c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 -- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08201304a0 msgr2=0x7f08201c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08201304a0 0x7f08201c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 -- 172.21.15.125:0/1696276352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009b30 con 0x7f08200a1340 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.945+0000 7f081ffff700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e7e0 tx=0x7f080c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c013610 con 0x7f08200a1340 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c013770 con 0x7f08200a1340 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082009ae00 con 0x7f08200a1340 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c013ae0 con 0x7f08200a1340 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082011f230 con 0x7f08200a1340 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60580043e0 con 0x7f6060131f40 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f0824efb700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08201c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6058022070 con 0x7f6060131f40 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.946+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606011d580 con 0x7f6060131f40 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.947+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082004f2a0 con 0x7f08200a1340 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.947+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080c013c40 con 0x7f08200a1340 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.947+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f080c03f730 con 0x7f08200a1340 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.951+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f605801b400 con 0x7f6060131f40 2023-10-03T10:15:19.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:19.951+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f080c026430 con 0x7f08200a1340 2023-10-03T10:15:20.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.158+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6060125b70 con 0x7f6060131f40 2023-10-03T10:15:20.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.158+0000 7f6055ffb700 1 -- 172.21.15.125:0/2109809087 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6058035090 con 0x7f6060131f40 2023-10-03T10:15:20.159 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:20.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.159+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f082006bce0 con 0x7f08200a1340 2023-10-03T10:15:20.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.159+0000 7f081d7fa700 1 -- 172.21.15.125:0/1696276352 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f080c021070 con 0x7f08200a1340 2023-10-03T10:15:20.160 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:20.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 msgr2=0x7f606006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f605800b680 tx=0x7f6058004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 shutdown_connections 2023-10-03T10:15:20.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6060131f40 0x7f606006c330 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009e870 0x7f606006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 --2- 172.21.15.125:0/2109809087 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f606009f180 0x7f606006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 >> 172.21.15.125:0/2109809087 conn(0x7f60600a4430 msgr2=0x7f606011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 shutdown_connections 2023-10-03T10:15:20.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f6067986700 1 -- 172.21.15.125:0/2109809087 wait complete. 2023-10-03T10:15:20.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 msgr2=0x7f08201c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e7e0 tx=0x7f080c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 shutdown_connections 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08201304a0 0x7f08201c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08200a0a30 0x7f08201c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 --2- 172.21.15.125:0/1696276352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200a1340 0x7f08201c11d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 >> 172.21.15.125:0/1696276352 conn(0x7f08200a2980 msgr2=0x7f082012f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 shutdown_connections 2023-10-03T10:15:20.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.161+0000 7f082715f700 1 -- 172.21.15.125:0/1696276352 wait complete. 2023-10-03T10:15:20.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:20.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:20.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:20.771 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.862+0000 7f1ef4b5a700 1 Processor -- start 2023-10-03T10:15:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.862+0000 7f1ef4b5a700 1 -- start start 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1ef4b5a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef009f350 0x7f1ef0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1ef4b5a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1ef4b5a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef009c970 con 0x7f1ef009e870 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1ef4b5a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00a0920 con 0x7f1ef009f350 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1ef4b5a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef009f9c0 con 0x7f1ef01371c0 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eeed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef009f350 0x7f1ef0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef009f350 0x7f1ef0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46924/0 (socket says 172.21.15.125:46924) 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 -- 172.21.15.125:0/725259044 learned_addr learned my addr 172.21.15.125:0/725259044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eeed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32856/0 (socket says 172.21.15.125:32856) 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eee59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1ef009e870 0x7f1ef009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42804/0 (socket says 172.21.15.125:42804) 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 -- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 msgr2=0x7f1ef01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 -- 172.21.15.125:0/725259044 >> v1:172.21.15.125:6789/0 conn(0x7f1ef009e870 legacy=0x7f1ef009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 -- 172.21.15.125:0/725259044 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef009bab0 con 0x7f1ef009f350 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eed59a700 1 -- 172.21.15.125:0/725259044 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600494299 0 0) 0x7f1ef009c970 con 0x7f1ef009e870 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eeed9d700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0136c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e005c1edb3ea4f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eed59a700 1 -- 172.21.15.125:0/725259044 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011830 con 0x7f1ef009f350 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.863+0000 7f1eed59a700 1 -- 172.21.15.125:0/725259044 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4011990 con 0x7f1ef009f350 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1eed59a700 1 -- 172.21.15.125:0/725259044 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011d20 con 0x7f1ef009f350 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 msgr2=0x7f1ef0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0136c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/725259044 shutdown_connections 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/725259044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0136c80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/725259044 >> 172.21.15.125:0/725259044 conn(0x7f1ef00a4430 msgr2=0x7f1ef00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/725259044 shutdown_connections 2023-10-03T10:15:20.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.864+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/725259044 wait complete. 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.865+0000 7f1ef4b5a700 1 Processor -- start 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.865+0000 7f1ef4b5a700 1 -- start start 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 0x7f1ef01207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef0121260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01225e0 con 0x7f1ef009f350 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01223f0 con 0x7f1ef009e870 2023-10-03T10:15:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef009dba0 con 0x7f1ef01371c0 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 0x7f1ef01207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46928/0 (socket says 172.21.15.125:46928) 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eedd9b700 1 -- 172.21.15.125:0/226068048 learned_addr learned my addr 172.21.15.125:0/226068048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eeed9d700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef0121260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 -- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 msgr2=0x7f1ef0121260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef0121260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 -- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 msgr2=0x7f1ef0120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 -- 172.21.15.125:0/226068048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009a70 con 0x7f1ef009e870 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eeed9d700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef0121260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1eee59c700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 0x7f1ef01207e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c470 tx=0x7f1ee000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0004c80 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0004de0 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.866+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4009550 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.867+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0007310 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.867+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef0124020 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.867+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ee0007470 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.868+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ee003f270 con 0x7f1ef009e870 2023-10-03T10:15:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.868+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef0122c40 con 0x7f1ef009e870 2023-10-03T10:15:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.872+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ee0007720 con 0x7f1ef009e870 2023-10-03T10:15:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.903+0000 7f5b8c5b0700 1 Processor -- start 2023-10-03T10:15:20.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.903+0000 7f5b8c5b0700 1 -- start start 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8409e9d0 con 0x7f5b840a0a70 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8409dc00 con 0x7f5b84133f50 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8c5b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8409dec0 con 0x7f5b840a1380 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8a34c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8ab4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8a34c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46936/0 (socket says 172.21.15.125:46936) 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32886/0 (socket says 172.21.15.125:32886) 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8a34c700 1 -- 172.21.15.125:0/2141394689 learned_addr learned my addr 172.21.15.125:0/2141394689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8ab4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47742/0 (socket says 172.21.15.125:47742) 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 -- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 msgr2=0x7f5b841343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 -- 172.21.15.125:0/2141394689 >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 msgr2=0x7f5b840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 --2- 172.21.15.125:0/2141394689 >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 -- 172.21.15.125:0/2141394689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8409e6a0 con 0x7f5b840a1380 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8a34c700 1 --2- 172.21.15.125:0/2141394689 >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b8ab4d700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.904+0000 7f5b89b4b700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009840 tx=0x7f5b74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d82b8cfcc5d323b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8934a700 1 -- 172.21.15.125:0/2141394689 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74011830 con 0x7f5b840a1380 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8934a700 1 -- 172.21.15.125:0/2141394689 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74011990 con 0x7f5b840a1380 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8934a700 1 -- 172.21.15.125:0/2141394689 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74011d20 con 0x7f5b840a1380 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 msgr2=0x7f5b84133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009840 tx=0x7f5b74009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/2141394689 shutdown_connections 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b84133f50 0x7f5b841343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/2141394689 >> v2:172.21.15.125:3300/0 conn(0x7f5b840a0a70 0x7f5b840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/2141394689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b840a1380 0x7f5b84133a10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/2141394689 >> 172.21.15.125:0/2141394689 conn(0x7f5b840a6610 msgr2=0x7f5b840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/2141394689 shutdown_connections 2023-10-03T10:15:20.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.905+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/2141394689 wait complete. 2023-10-03T10:15:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.906+0000 7f5b8c5b0700 1 Processor -- start 2023-10-03T10:15:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.906+0000 7f5b8c5b0700 1 -- start start 2023-10-03T10:15:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b840a0a70 0x7f5b84122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84124600 con 0x7f5b840a1380 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84125c80 con 0x7f5b840a0a70 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840a03e0 con 0x7f5b84133f50 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b89b4b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b89b4b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46950/0 (socket says 172.21.15.125:46950) 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32896/0 (socket says 172.21.15.125:32896) 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b89b4b700 1 -- 172.21.15.125:0/730034710 learned_addr learned my addr 172.21.15.125:0/730034710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8a34c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b840a0a70 0x7f5b84122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 -- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b840a0a70 msgr2=0x7f5b84122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b840a0a70 0x7f5b84122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 -- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 msgr2=0x7f5b84122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 -- 172.21.15.125:0/730034710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009550 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b89b4b700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8ab4d700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00efc0 tx=0x7f5b7c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c009e60 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00f040 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c009a70 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.907+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00cd60 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.908+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b740094a0 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.908+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b7c014480 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.908+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b7c03fc00 con 0x7f5b84133f50 2023-10-03T10:15:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.908+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b84125920 con 0x7f5b84133f50 2023-10-03T10:15:20.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:20.913+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b7c012930 con 0x7f5b84133f50 2023-10-03T10:15:21.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.066+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ef004f2a0 con 0x7f1ef009e870 2023-10-03T10:15:21.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.067+0000 7f1edeffd700 1 -- 172.21.15.125:0/226068048 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ee0011e80 con 0x7f1ef009e870 2023-10-03T10:15:21.067 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:21.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 msgr2=0x7f1ef01207e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 0x7f1ef01207e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c470 tx=0x7f1ee000c780 comp rx=0 tx=0).stop 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 shutdown_connections 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01371c0 0x7f1ef0121260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef009e870 0x7f1ef01207e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 --2- 172.21.15.125:0/226068048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef009f350 0x7f1ef0120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 >> 172.21.15.125:0/226068048 conn(0x7f1ef00a4430 msgr2=0x7f1ef00a2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 shutdown_connections 2023-10-03T10:15:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.069+0000 7f1ef4b5a700 1 -- 172.21.15.125:0/226068048 wait complete. 2023-10-03T10:15:21.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:21.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.106+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b84124e40 con 0x7f5b84133f50 2023-10-03T10:15:21.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.106+0000 7f5b7affd700 1 -- 172.21.15.125:0/730034710 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b7c012340 con 0x7f5b84133f50 2023-10-03T10:15:21.107 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 msgr2=0x7f5b84122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00efc0 tx=0x7f5b7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 shutdown_connections 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b84133f50 0x7f5b84122fc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b840a0a70 0x7f5b84122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 --2- 172.21.15.125:0/730034710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b840a1380 0x7f5b84122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 >> 172.21.15.125:0/730034710 conn(0x7f5b840a6610 msgr2=0x7f5b8409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 shutdown_connections 2023-10-03T10:15:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.108+0000 7f5b8c5b0700 1 -- 172.21.15.125:0/730034710 wait complete. 2023-10-03T10:15:21.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:21.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:21.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:21.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 Processor -- start 2023-10-03T10:15:21.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 Processor -- start 2023-10-03T10:15:21.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 -- start start 2023-10-03T10:15:21.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 -- start start 2023-10-03T10:15:21.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7641368e0 0x7ff764138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764139200 0x7ff76413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76409a760 con 0x7ff764133900 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7641336e0 con 0x7ff7641368e0 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7ff769606700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76409a080 con 0x7ff764139200 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 0x7f27781367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27781314b0 0x7f2778138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780a0f20 con 0x7f2778066410 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780667e0 con 0x7f2778132100 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.301+0000 7f277d838700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27780a23c0 con 0x7f27781314b0 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff762ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff764133900 0x7ff764133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42820/0 (socket says 172.21.15.125:42820) 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff762ffd700 1 -- 172.21.15.125:0/961170317 learned_addr learned my addr 172.21.15.125:0/961170317 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7637fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764139200 0x7ff76413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 --2- 172.21.15.125:0/961170317 >> v2:172.21.15.125:3300/0 conn(0x7ff7641368e0 0x7ff764138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 0x7f27781367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f2776ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2778066410 0x7f27781319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42826/0 (socket says 172.21.15.125:42826) 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f2776ffd700 1 -- 172.21.15.125:0/1964596865 learned_addr learned my addr 172.21.15.125:0/1964596865 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27777fe700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27781314b0 0x7f2778138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 -- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764139200 msgr2=0x7ff76413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 --2- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764139200 0x7ff76413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 -- 172.21.15.125:0/961170317 >> v1:172.21.15.125:6789/0 conn(0x7ff764133900 legacy=0x7ff764133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 -- 172.21.15.125:0/961170317 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640a23e0 con 0x7ff7641368e0 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 -- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27781314b0 msgr2=0x7f2778138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27781314b0 0x7f2778138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 -- 172.21.15.125:0/1964596865 >> v1:172.21.15.125:6789/0 conn(0x7f2778066410 legacy=0x7f27781319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 -- 172.21.15.125:0/1964596865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780a16e0 con 0x7f2778132100 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f27767fc700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 0x7f27781367d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f276c0098a0 tx=0x7f276c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c59cedc87095a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff7627fc700 1 --2- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff764138cc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff758009840 tx=0x7ff758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f815985143338cab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f2775ffb700 1 -- 172.21.15.125:0/1964596865 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c011830 con 0x7f2778132100 2023-10-03T10:15:21.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f2775ffb700 1 -- 172.21.15.125:0/1964596865 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c011990 con 0x7f2778132100 2023-10-03T10:15:21.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7f2775ffb700 1 -- 172.21.15.125:0/1964596865 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c011d20 con 0x7f2778132100 2023-10-03T10:15:21.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.302+0000 7ff761ffb700 1 -- 172.21.15.125:0/961170317 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758011830 con 0x7ff7641368e0 2023-10-03T10:15:21.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff761ffb700 1 -- 172.21.15.125:0/961170317 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758011990 con 0x7ff7641368e0 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff761ffb700 1 -- 172.21.15.125:0/961170317 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758011d20 con 0x7ff7641368e0 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 -- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 msgr2=0x7f27781367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 0x7f27781367d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f276c0098a0 tx=0x7f276c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 -- 172.21.15.125:0/1964596865 shutdown_connections 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27781314b0 0x7f2778138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 --2- 172.21.15.125:0/1964596865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2778132100 0x7f27781367d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 -- 172.21.15.125:0/1964596865 >> 172.21.15.125:0/1964596865 conn(0x7f27780a2980 msgr2=0x7f27780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 -- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 msgr2=0x7ff764138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 --2- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff764138cc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff758009840 tx=0x7ff758009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 -- 172.21.15.125:0/961170317 shutdown_connections 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 --2- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764139200 0x7ff76413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 --2- 172.21.15.125:0/961170317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff764138cc0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 -- 172.21.15.125:0/961170317 >> 172.21.15.125:0/961170317 conn(0x7ff7640a2980 msgr2=0x7ff7640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 -- 172.21.15.125:0/1964596865 shutdown_connections 2023-10-03T10:15:21.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 -- 172.21.15.125:0/961170317 shutdown_connections 2023-10-03T10:15:21.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7ff769606700 1 -- 172.21.15.125:0/961170317 wait complete. 2023-10-03T10:15:21.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.303+0000 7f277d838700 1 -- 172.21.15.125:0/1964596865 wait complete. 2023-10-03T10:15:21.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.304+0000 7f277d838700 1 Processor -- start 2023-10-03T10:15:21.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.304+0000 7ff769606700 1 Processor -- start 2023-10-03T10:15:21.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.304+0000 7ff769606700 1 -- start start 2023-10-03T10:15:21.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.304+0000 7f277d838700 1 -- start start 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764133900 0x7ff76411b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 0x7f277812d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff764139200 0x7ff76411bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76411cc90 con 0x7ff7641368e0 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76411ede0 con 0x7ff764139200 2023-10-03T10:15:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff769606700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76411e330 con 0x7ff764133900 2023-10-03T10:15:21.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 0x7f2778099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f277812db00 0x7f2778099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778135a50 con 0x7f277812db00 2023-10-03T10:15:21.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2778136ec0 con 0x7f27781314b0 2023-10-03T10:15:21.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f277d838700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27780a1d50 con 0x7f2778066410 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46968/0 (socket says 172.21.15.125:46968) 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 -- 172.21.15.125:0/511569343 learned_addr learned my addr 172.21.15.125:0/511569343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff762ffd700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764133900 0x7ff76411b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f27767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 0x7f2778099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 0x7f277812d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f27767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 0x7f2778099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47778/0 (socket says 172.21.15.125:47778) 2023-10-03T10:15:21.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f27767fc700 1 -- 172.21.15.125:0/1396866298 learned_addr learned my addr 172.21.15.125:0/1396866298 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 -- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764133900 msgr2=0x7ff76411b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764133900 0x7ff76411b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 -- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff764139200 msgr2=0x7ff76411bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 -- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 msgr2=0x7f2778099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 0x7f2778099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 -- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f277812db00 msgr2=0x7f2778099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f277812db00 0x7f2778099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff764139200 0x7ff76411bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7ff7627fc700 1 -- 172.21.15.125:0/511569343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7580094a0 con 0x7ff7641368e0 2023-10-03T10:15:21.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.305+0000 7f2776ffd700 1 -- 172.21.15.125:0/1396866298 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0094a0 con 0x7f2778066410 2023-10-03T10:15:21.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff7627fc700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f2776ffd700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 0x7f277812d5c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f276800c500 tx=0x7f276800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27680074e0 con 0x7f2778066410 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768007640 con 0x7f2778066410 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277809b660 con 0x7f2778066410 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768005a50 con 0x7f2778066410 2023-10-03T10:15:21.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580036a0 con 0x7ff7641368e0 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2778138280 con 0x7f2778066410 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75801f070 con 0x7ff7641368e0 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7641358e0 con 0x7ff7641368e0 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76411d480 con 0x7ff7641368e0 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.306+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758003a60 con 0x7ff7641368e0 2023-10-03T10:15:21.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff758003bc0 con 0x7ff7641368e0 2023-10-03T10:15:21.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2768005bb0 con 0x7f2778066410 2023-10-03T10:15:21.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f276803e8e0 con 0x7f2778066410 2023-10-03T10:15:21.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff758021070 con 0x7ff7641368e0 2023-10-03T10:15:21.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277804f2a0 con 0x7f2778066410 2023-10-03T10:15:21.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.307+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7440052e0 con 0x7ff7641368e0 2023-10-03T10:15:21.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.312+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2768005e60 con 0x7f2778066410 2023-10-03T10:15:21.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.312+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff758015030 con 0x7ff7641368e0 2023-10-03T10:15:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.501+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27780724c0 con 0x7f2778066410 2023-10-03T10:15:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.502+0000 7f275ffff700 1 -- 172.21.15.125:0/1396866298 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2768017020 con 0x7f2778066410 2023-10-03T10:15:21.502 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:21.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 msgr2=0x7f277812d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 0x7f277812d5c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f276800c500 tx=0x7f276800c810 comp rx=0 tx=0).stop 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 shutdown_connections 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f277812db00 0x7f2778099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2778066410 0x7f277812d5c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 --2- 172.21.15.125:0/1396866298 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27781314b0 0x7f2778099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 >> 172.21.15.125:0/1396866298 conn(0x7f27780a2980 msgr2=0x7f277809daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 shutdown_connections 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7f277d838700 1 -- 172.21.15.125:0/1396866298 wait complete. 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff744005590 con 0x7ff7641368e0 2023-10-03T10:15:21.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.504+0000 7ff74b7fe700 1 -- 172.21.15.125:0/511569343 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff758010790 con 0x7ff7641368e0 2023-10-03T10:15:21.506 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 msgr2=0x7ff76411b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff758009fd0 tx=0x7ff758004750 comp rx=0 tx=0).stop 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 shutdown_connections 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff764139200 0x7ff76411bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff764133900 0x7ff76411b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 --2- 172.21.15.125:0/511569343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7641368e0 0x7ff76411b610 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 >> 172.21.15.125:0/511569343 conn(0x7ff7640a2980 msgr2=0x7ff7641346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 shutdown_connections 2023-10-03T10:15:21.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:21.506+0000 7ff769606700 1 -- 172.21.15.125:0/511569343 wait complete. 2023-10-03T10:15:21.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:21.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:22.082 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:22.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:22.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 Processor -- start 2023-10-03T10:15:22.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 -- start start 2023-10-03T10:15:22.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81c09aaa0 con 0x7ff81c130ce0 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c09f870 con 0x7ff81c09e170 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff821f26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c09b360 con 0x7ff81c09d860 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.212+0000 7ff81b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32926/0 (socket says 172.21.15.125:32926) 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81b7fe700 1 -- 172.21.15.125:0/2629857447 learned_addr learned my addr 172.21.15.125:0/2629857447 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 -- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 msgr2=0x7ff81c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 -- 172.21.15.125:0/2629857447 >> v1:172.21.15.125:6789/0 conn(0x7ff81c130ce0 legacy=0x7ff81c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 -- 172.21.15.125:0/2629857447 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c09b620 con 0x7ff81c09e170 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81b7fe700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81affd700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c1307a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff81000dc90 tx=0x7ff81000f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e98590a359a2f9c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81a7fc700 1 -- 172.21.15.125:0/2629857447 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810012070 con 0x7ff81c09e170 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81a7fc700 1 -- 172.21.15.125:0/2629857447 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000d2e0 con 0x7ff81c09e170 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.213+0000 7ff81a7fc700 1 -- 172.21.15.125:0/2629857447 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000f8f0 con 0x7ff81c09e170 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 -- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 msgr2=0x7ff81c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c1307a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff81000dc90 tx=0x7ff81000f050 comp rx=0 tx=0).stop 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 -- 172.21.15.125:0/2629857447 shutdown_connections 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c09d860 0x7ff81c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 --2- 172.21.15.125:0/2629857447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c1307a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 -- 172.21.15.125:0/2629857447 >> 172.21.15.125:0/2629857447 conn(0x7ff81c099c40 msgr2=0x7ff81c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 -- 172.21.15.125:0/2629857447 shutdown_connections 2023-10-03T10:15:22.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.214+0000 7ff821f26700 1 -- 172.21.15.125:0/2629857447 wait complete. 2023-10-03T10:15:22.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 Processor -- start 2023-10-03T10:15:22.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 -- start start 2023-10-03T10:15:22.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 0x7ff81c11f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c11fb50 con 0x7ff81c09d860 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c0a22d0 con 0x7ff81c09e170 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff821f26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c121ec0 con 0x7ff81c130ce0 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.215+0000 7ff81b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46984/0 (socket says 172.21.15.125:46984) 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 -- 172.21.15.125:0/549291905 learned_addr learned my addr 172.21.15.125:0/549291905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81bfff700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 0x7ff81c11f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81affd700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 -- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 msgr2=0x7ff81c11f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 0x7ff81c11f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 -- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 msgr2=0x7ff81c11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c11ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 -- 172.21.15.125:0/549291905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81400bb50 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81bfff700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 0x7ff81c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81affd700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff81b7fe700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff81400b540 tx=0x7ff8140084e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814010040 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140163f0 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814016760 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81000d940 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.216+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81c1203a0 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.217+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8140168c0 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.217+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff814040080 con 0x7ff81c09d860 2023-10-03T10:15:22.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.217+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81c121b10 con 0x7ff81c09d860 2023-10-03T10:15:22.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.222+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff814016b70 con 0x7ff81c09d860 2023-10-03T10:15:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 Processor -- start 2023-10-03T10:15:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 -- start start 2023-10-03T10:15:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 0x7f0c80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 0x7f0c801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8006b2d0 con 0x7f0c801300a0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80133610 con 0x7f0c801309f0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.252+0000 7f0c862f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8009a500 con 0x7f0c80133ad0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 0x7f0c80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47810/0 (socket says 172.21.15.125:47810) 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 -- 172.21.15.125:0/4192478998 learned_addr learned my addr 172.21.15.125:0/4192478998 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7f7fe700 1 --2- 172.21.15.125:0/4192478998 >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 0x7f0c801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 -- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 msgr2=0x7f0c80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 0x7f0c80133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 -- 172.21.15.125:0/4192478998 >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 msgr2=0x7f0c801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4192478998 >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 0x7f0c801304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 -- 172.21.15.125:0/4192478998 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c801338b0 con 0x7f0c801309f0 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7ffff700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 0x7f0c80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7f7fe700 1 --2- 172.21.15.125:0/4192478998 >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 0x7f0c801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e50 tx=0x7f0c7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9818b03e9955551f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7effd700 1 -- 172.21.15.125:0/4192478998 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x7f0c801309f0 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7effd700 1 -- 172.21.15.125:0/4192478998 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800b910 con 0x7f0c801309f0 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.253+0000 7f0c7effd700 1 -- 172.21.15.125:0/4192478998 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800bcc0 con 0x7f0c801309f0 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 -- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 msgr2=0x7f0c8013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e50 tx=0x7f0c7800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 -- 172.21.15.125:0/4192478998 shutdown_connections 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8013a980 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4192478998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c80133ad0 0x7f0c80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4192478998 >> v2:172.21.15.125:3300/0 conn(0x7f0c801300a0 0x7f0c801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 -- 172.21.15.125:0/4192478998 >> 172.21.15.125:0/4192478998 conn(0x7f0c80099c40 msgr2=0x7f0c800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 -- 172.21.15.125:0/4192478998 shutdown_connections 2023-10-03T10:15:22.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.254+0000 7f0c862f1700 1 -- 172.21.15.125:0/4192478998 wait complete. 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.255+0000 7f0c862f1700 1 Processor -- start 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.255+0000 7f0c862f1700 1 -- start start 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c801300a0 0x7f0c8011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 0x7f0c8011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800720b0 con 0x7f0c80133ad0 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80071ec0 con 0x7f0c801309f0 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c862f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80120880 con 0x7f0c801300a0 2023-10-03T10:15:22.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 0x7f0c8011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47818/0 (socket says 172.21.15.125:47818) 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c7f7fe700 1 -- 172.21.15.125:0/4273524487 learned_addr learned my addr 172.21.15.125:0/4273524487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c7ffff700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c801300a0 0x7f0c8011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 -- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c801300a0 msgr2=0x7f0c8011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c801300a0 0x7f0c8011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 -- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 msgr2=0x7f0c8011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c8488e700 1 -- 172.21.15.125:0/4273524487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680094a0 con 0x7f0c80133ad0 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.256+0000 7f0c7f7fe700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c8488e700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 0x7f0c8011e4c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0c78015000 tx=0x7f0c78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780092e0 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800ce80 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c700094a0 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780044b0 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.257+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c78009b30 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.258+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c800a2620 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.258+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c78004610 con 0x7f0c80133ad0 2023-10-03T10:15:22.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.258+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c780409b0 con 0x7f0c80133ad0 2023-10-03T10:15:22.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.262+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c7801a330 con 0x7f0c80133ad0 2023-10-03T10:15:22.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.418+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff81c04f2a0 con 0x7ff81c09d860 2023-10-03T10:15:22.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.418+0000 7ff803fff700 1 -- 172.21.15.125:0/549291905 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff81401d300 con 0x7ff81c09d860 2023-10-03T10:15:22.418 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 msgr2=0x7ff81c11e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff81400b540 tx=0x7ff8140084e0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 shutdown_connections 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff81c130ce0 0x7ff81c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff81c09d860 0x7ff81c11e680 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 --2- 172.21.15.125:0/549291905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff81c09e170 0x7ff81c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 >> 172.21.15.125:0/549291905 conn(0x7ff81c099c40 msgr2=0x7ff81c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 shutdown_connections 2023-10-03T10:15:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.420+0000 7ff821f26700 1 -- 172.21.15.125:0/549291905 wait complete. 2023-10-03T10:15:22.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:22.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.456+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c8011f8d0 con 0x7f0c80133ad0 2023-10-03T10:15:22.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.456+0000 7f0c7cff9700 1 -- 172.21.15.125:0/4273524487 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c78024e80 con 0x7f0c80133ad0 2023-10-03T10:15:22.457 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:22.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 msgr2=0x7f0c8011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 0x7f0c8011e4c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0c78015000 tx=0x7f0c78004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 shutdown_connections 2023-10-03T10:15:22.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80133ad0 0x7f0c8011e4c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c801300a0 0x7f0c8011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 --2- 172.21.15.125:0/4273524487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c801309f0 0x7f0c8011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 >> 172.21.15.125:0/4273524487 conn(0x7f0c80099c40 msgr2=0x7f0c80132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 shutdown_connections 2023-10-03T10:15:22.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.458+0000 7f0c862f1700 1 -- 172.21.15.125:0/4273524487 wait complete. 2023-10-03T10:15:22.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:22.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:22.519 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:22.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.643+0000 7f7e777e1700 1 Processor -- start 2023-10-03T10:15:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.643+0000 7f110401f700 1 Processor -- start 2023-10-03T10:15:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.643+0000 7f110401f700 1 -- start start 2023-10-03T10:15:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.643+0000 7f7e777e1700 1 -- start start 2023-10-03T10:15:22.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f110401f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 0x7f10fc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f110401f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 0x7f10fc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f110401f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc0a1e70 con 0x7f10fc0a0a30 2023-10-03T10:15:22.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f110401f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc09a720 con 0x7f10fc0a1510 2023-10-03T10:15:22.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f110401f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc09b300 con 0x7f10fc1356e0 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11025bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 0x7f10fc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11025bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 0x7f10fc137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32954/0 (socket says 172.21.15.125:32954) 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11025bc700 1 -- 172.21.15.125:0/601179928 learned_addr learned my addr 172.21.15.125:0/601179928 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f1101dbb700 1 --1- 172.21.15.125:0/601179928 >> v1:172.21.15.125:6789/0 conn(0x7f10fc0a0a30 0x7f10fc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42844/0 (socket says 172.21.15.125:42844) 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11015ba700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 0x7f10fc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e777e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e777e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e700a1380 0x7f7e70133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e777e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7009dc00 con 0x7f7e70133f50 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e777e1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7009ea60 con 0x7f7e700a1380 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e777e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7009dec0 con 0x7f7e700a0a70 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e700a1380 0x7f7e70133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e7557d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e700a1380 0x7f7e70133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47020/0 (socket says 172.21.15.125:47020) 2023-10-03T10:15:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 -- 172.21.15.125:0/3962483392 learned_addr learned my addr 172.21.15.125:0/3962483392 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11015ba700 1 -- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 msgr2=0x7f10fc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11015ba700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 0x7f10fc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11015ba700 1 -- 172.21.15.125:0/601179928 >> v1:172.21.15.125:6789/0 conn(0x7f10fc0a0a30 legacy=0x7f10fc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f11015ba700 1 -- 172.21.15.125:0/601179928 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc09abc0 con 0x7f10fc0a1510 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f1100db9700 1 -- 172.21.15.125:0/601179928 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540762191 0 0) 0x7f10fc0a1e70 con 0x7f10fc0a0a30 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f11015ba700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 0x7f10fc1351a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009870 tx=0x7f10ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778461bbca49372f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 -- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 msgr2=0x7f7e700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 --2- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e700a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 -- 172.21.15.125:0/3962483392 >> v1:172.21.15.125:6789/0 conn(0x7f7e70133f50 legacy=0x7f7e7013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.644+0000 7f7e74d7c700 1 -- 172.21.15.125:0/3962483392 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7009e6a0 con 0x7f7e700a1380 2023-10-03T10:15:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f1100db9700 1 -- 172.21.15.125:0/601179928 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011830 con 0x7f10fc0a1510 2023-10-03T10:15:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e74d7c700 1 --2- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e70133a10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7e600098f0 tx=0x7f7e60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c412d84b5224404a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f1100db9700 1 -- 172.21.15.125:0/601179928 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec011990 con 0x7f10fc0a1510 2023-10-03T10:15:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f1100db9700 1 -- 172.21.15.125:0/601179928 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011d20 con 0x7f10fc0a1510 2023-10-03T10:15:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e67fff700 1 -- 172.21.15.125:0/3962483392 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011830 con 0x7f7e700a1380 2023-10-03T10:15:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e67fff700 1 -- 172.21.15.125:0/3962483392 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60011990 con 0x7f7e700a1380 2023-10-03T10:15:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e67fff700 1 -- 172.21.15.125:0/3962483392 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011d20 con 0x7f7e700a1380 2023-10-03T10:15:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 -- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 msgr2=0x7f10fc1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 0x7f10fc1351a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009870 tx=0x7f10ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 -- 172.21.15.125:0/601179928 shutdown_connections 2023-10-03T10:15:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc1356e0 0x7f10fc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 --2- 172.21.15.125:0/601179928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc0a1510 0x7f10fc1351a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f110401f700 1 -- 172.21.15.125:0/601179928 >> 172.21.15.125:0/601179928 conn(0x7f10fc0a2980 msgr2=0x7f10fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e777e1700 1 -- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 msgr2=0x7f7e70133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.645+0000 7f7e777e1700 1 --2- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e70133a10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7e600098f0 tx=0x7f7e60009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f110401f700 1 -- 172.21.15.125:0/601179928 shutdown_connections 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f110401f700 1 -- 172.21.15.125:0/601179928 wait complete. 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 -- 172.21.15.125:0/3962483392 shutdown_connections 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 --2- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 --2- 172.21.15.125:0/3962483392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e70133a10 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 -- 172.21.15.125:0/3962483392 >> 172.21.15.125:0/3962483392 conn(0x7f7e700a6610 msgr2=0x7f7e700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 -- 172.21.15.125:0/3962483392 shutdown_connections 2023-10-03T10:15:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f7e777e1700 1 -- 172.21.15.125:0/3962483392 wait complete. 2023-10-03T10:15:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f110401f700 1 Processor -- start 2023-10-03T10:15:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.646+0000 7f110401f700 1 -- start start 2023-10-03T10:15:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 Processor -- start 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 -- start start 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10fc0a1510 0x7f10fc11d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 0x7f10fc11dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc11e3d0 con 0x7f10fc0a1510 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc1200a0 con 0x7f10fc1356e0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f110401f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc09ae00 con 0x7f10fc0a0a30 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e7011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e70133f50 0x7f7e7011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32964/0 (socket says 172.21.15.125:32964) 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f11015ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10fc0a1510 0x7f10fc11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700a03e0 con 0x7f7e700a1380 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701209f0 con 0x7f7e700a0a70 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e777e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70133940 con 0x7f7e70133f50 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e74d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 -- 172.21.15.125:0/2081911260 learned_addr learned my addr 172.21.15.125:0/2081911260 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f11025bc700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 0x7f10fc11dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e74d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47040/0 (socket says 172.21.15.125:47040) 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e74d7c700 1 -- 172.21.15.125:0/626595651 learned_addr learned my addr 172.21.15.125:0/626595651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e75d7e700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e70133f50 0x7f7e7011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f7e7557d700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e7011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 -- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 msgr2=0x7f10fc11dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 0x7f10fc11dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 -- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10fc0a1510 msgr2=0x7f10fc11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10fc0a1510 0x7f10fc11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f1101dbb700 1 -- 172.21.15.125:0/2081911260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0094a0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.647+0000 7f11025bc700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 0x7f10fc11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 -- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e70133f50 msgr2=0x7f7e7011f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e70133f50 0x7f7e7011f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 -- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 msgr2=0x7f7e7011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e7011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 -- 172.21.15.125:0/626595651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009550 con 0x7f7e700a1380 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f1101dbb700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c520 tx=0x7f10f800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80074e0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8007640 con 0x7f10fc0a0a30 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc09fcf0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e74d7c700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7e60000c00 tx=0x7f7e60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8005a70 con 0x7f10fc0a0a30 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc11fa70 con 0x7f10fc0a0a30 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60004480 con 0x7f7e700a1380 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70120c30 con 0x7f7e700a1380 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6001f070 con 0x7f7e700a1380 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600038c0 con 0x7f7e700a1380 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.649+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc04f2a0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.648+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70120440 con 0x7f7e700a1380 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.649+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e60021030 con 0x7f7e700a1380 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.649+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7004f2a0 con 0x7f7e700a1380 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.649+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e600409d0 con 0x7f7e700a1380 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.650+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10f8005bd0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.650+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10f803efb0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.654+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e60003cb0 con 0x7f7e700a1380 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.654+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10f800f260 con 0x7f10fc0a0a30 2023-10-03T10:15:22.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.847+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10fc11fdd0 con 0x7f10fc0a0a30 2023-10-03T10:15:22.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.847+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e70121d10 con 0x7f7e700a1380 2023-10-03T10:15:22.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.848+0000 7f10f27fc700 1 -- 172.21.15.125:0/2081911260 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10f8010300 con 0x7f10fc0a0a30 2023-10-03T10:15:22.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.848+0000 7f7e65ffb700 1 -- 172.21.15.125:0/626595651 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e60032020 con 0x7f7e700a1380 2023-10-03T10:15:22.849 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:22.849 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 msgr2=0x7f10fc11d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c520 tx=0x7f10f800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 msgr2=0x7f7e7011ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7e60000c00 tx=0x7f7e60004750 comp rx=0 tx=0).stop 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 shutdown_connections 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10fc1356e0 0x7f10fc11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10fc0a0a30 0x7f10fc11d200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 --2- 172.21.15.125:0/2081911260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10fc0a1510 0x7f10fc11d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 >> 172.21.15.125:0/2081911260 conn(0x7f10fc0a2980 msgr2=0x7f10fc130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 shutdown_connections 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 shutdown_connections 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e70133f50 0x7f7e7011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e700a0a70 0x7f7e7011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 --2- 172.21.15.125:0/626595651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e700a1380 0x7f7e7011ee00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 >> 172.21.15.125:0/626595651 conn(0x7f7e700a6610 msgr2=0x7f7e700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f110401f700 1 -- 172.21.15.125:0/2081911260 wait complete. 2023-10-03T10:15:22.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 shutdown_connections 2023-10-03T10:15:22.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:22.850+0000 7f7e777e1700 1 -- 172.21.15.125:0/626595651 wait complete. 2023-10-03T10:15:22.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:22.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:23.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:23.471 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:23.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.564+0000 7f13e20e6700 1 Processor -- start 2023-10-03T10:15:23.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.564+0000 7f13e20e6700 1 -- start start 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13e20e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13e20e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13e20e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc09e9d0 con 0x7f13dc0a0a70 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13e20e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc09dc00 con 0x7f13dc139200 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13e20e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc09dec0 con 0x7f13dc0a1550 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32980/0 (socket says 172.21.15.125:32980) 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47882/0 (socket says 172.21.15.125:47882) 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13db7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13dc0a0a70 0x7f13dc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42860/0 (socket says 172.21.15.125:42860) 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 -- 172.21.15.125:0/3021491927 learned_addr learned my addr 172.21.15.125:0/3021491927 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 -- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 msgr2=0x7f13dc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 -- 172.21.15.125:0/3021491927 >> v1:172.21.15.125:6789/0 conn(0x7f13dc0a0a70 legacy=0x7f13dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 -- 172.21.15.125:0/3021491927 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc09e6a0 con 0x7f13dc0a1550 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13da7fc700 1 -- 172.21.15.125:0/3021491927 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339890900 0 0) 0x7f13dc09e9d0 con 0x7f13dc0a0a70 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13dbfff700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13daffd700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009920 tx=0x7f13d0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a597fa46a306fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13da7fc700 1 -- 172.21.15.125:0/3021491927 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011830 con 0x7f13dc0a1550 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13da7fc700 1 -- 172.21.15.125:0/3021491927 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0011990 con 0x7f13dc0a1550 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.565+0000 7f13da7fc700 1 -- 172.21.15.125:0/3021491927 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011d20 con 0x7f13dc0a1550 2023-10-03T10:15:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 -- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 msgr2=0x7f13dc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009920 tx=0x7f13d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 -- 172.21.15.125:0/3021491927 shutdown_connections 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc139200 0x7f13dc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 --2- 172.21.15.125:0/3021491927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc0a1550 0x7f13dc138cc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 -- 172.21.15.125:0/3021491927 >> 172.21.15.125:0/3021491927 conn(0x7f13dc0a6610 msgr2=0x7f13dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 -- 172.21.15.125:0/3021491927 shutdown_connections 2023-10-03T10:15:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.566+0000 7f13e20e6700 1 -- 172.21.15.125:0/3021491927 wait complete. 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.567+0000 7f13e20e6700 1 Processor -- start 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.567+0000 7f13e20e6700 1 -- start start 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 0x7f13dc11e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc139200 0x7f13dc11f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc120370 con 0x7f13dc0a1550 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc134650 con 0x7f13dc0a0a70 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc121fa0 con 0x7f13dc139200 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 0x7f13dc11e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47048/0 (socket says 172.21.15.125:47048) 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 -- 172.21.15.125:0/1452658844 learned_addr learned my addr 172.21.15.125:0/1452658844 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13dbfff700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc139200 0x7f13dc11f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 -- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc139200 msgr2=0x7f13dc11f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc139200 0x7f13dc11f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 -- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 msgr2=0x7f13dc11e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 0x7f13dc11e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 -- 172.21.15.125:0/1452658844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009a70 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13db7fe700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 0x7f13dc11e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13daffd700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f13d0000c00 tx=0x7f13d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0004450 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d00045b0 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00038a0 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d0009550 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.568+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc120b90 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.569+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13d0003a00 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.569+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13d0021030 con 0x7f13dc0a1550 2023-10-03T10:15:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.569+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0a5160 con 0x7f13dc0a1550 2023-10-03T10:15:23.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.578+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13d0003cb0 con 0x7f13dc0a1550 2023-10-03T10:15:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 Processor -- start 2023-10-03T10:15:23.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 -- start start 2023-10-03T10:15:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faaf009f1a0 0x7faaf0134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf009af80 con 0x7faaf009edb0 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf009fe00 con 0x7faaf009f1a0 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.608+0000 7faaf6130700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf006bec0 con 0x7faaf009a150 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faaf009f1a0 0x7faaf0134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faaf009f1a0 0x7faaf0134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47064/0 (socket says 172.21.15.125:47064) 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32996/0 (socket says 172.21.15.125:32996) 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 -- 172.21.15.125:0/2087215954 learned_addr learned my addr 172.21.15.125:0/2087215954 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faae6ffd700 1 --1- 172.21.15.125:0/2087215954 >> v1:172.21.15.125:6789/0 conn(0x7faaf009edb0 0x7faaf0133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42874/0 (socket says 172.21.15.125:42874) 2023-10-03T10:15:23.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 -- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 msgr2=0x7faaf009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 -- 172.21.15.125:0/2087215954 >> v1:172.21.15.125:6789/0 conn(0x7faaf009edb0 legacy=0x7faaf0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 -- 172.21.15.125:0/2087215954 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf006bc20 con 0x7faaf009f1a0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeeffd700 1 -- 172.21.15.125:0/2087215954 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161444293 0 0) 0x7faaf009af80 con 0x7faaf009edb0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaef7fe700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeffff700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009f1a0 0x7faaf0134330 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e50 tx=0x7faae800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661349fde071ccb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeeffd700 1 -- 172.21.15.125:0/2087215954 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800e070 con 0x7faaf009f1a0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeeffd700 1 -- 172.21.15.125:0/2087215954 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800b910 con 0x7faaf009f1a0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.609+0000 7faaeeffd700 1 -- 172.21.15.125:0/2087215954 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800bcc0 con 0x7faaf009f1a0 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 -- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009f1a0 msgr2=0x7faaf0134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009f1a0 0x7faaf0134330 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e50 tx=0x7faae800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 -- 172.21.15.125:0/2087215954 shutdown_connections 2023-10-03T10:15:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009f1a0 0x7faaf0134330 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 --2- 172.21.15.125:0/2087215954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 -- 172.21.15.125:0/2087215954 >> 172.21.15.125:0/2087215954 conn(0x7faaf00a4430 msgr2=0x7faaf00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 -- 172.21.15.125:0/2087215954 shutdown_connections 2023-10-03T10:15:23.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.610+0000 7faaf6130700 1 -- 172.21.15.125:0/2087215954 wait complete. 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 Processor -- start 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 -- start start 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 0x7faaf0122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 0x7faaf0123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf01250e0 con 0x7faaf009edb0 2023-10-03T10:15:23.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf01339a0 con 0x7faaf009f1a0 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaf6130700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0123ad0 con 0x7faaf009a150 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaeffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 0x7faaf0123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33010/0 (socket says 172.21.15.125:33010) 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faae6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 0x7faaf0122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.611+0000 7faaef7fe700 1 -- 172.21.15.125:0/3939148894 learned_addr learned my addr 172.21.15.125:0/3939148894 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 -- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 msgr2=0x7faaf01226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 -- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 msgr2=0x7faaf0122c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 0x7faaf0122c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 -- 172.21.15.125:0/3939148894 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00094a0 con 0x7faaf009f1a0 2023-10-03T10:15:23.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaef7fe700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faae6ffd700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 0x7faaf0122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaeffff700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 0x7faaf0123160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e50 tx=0x7faae8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae801c640 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae801c7a0 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae801cb50 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae8009b30 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.612+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf009b750 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.613+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae801ccb0 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.613+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faae8041120 con 0x7faaf009f1a0 2023-10-03T10:15:23.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.613+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf009fa30 con 0x7faaf009f1a0 2023-10-03T10:15:23.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.618+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae8026de0 con 0x7faaf009f1a0 2023-10-03T10:15:23.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.773+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13dc0a03e0 con 0x7f13dc0a1550 2023-10-03T10:15:23.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.774+0000 7f13c3fff700 1 -- 172.21.15.125:0/1452658844 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13d002b030 con 0x7f13dc0a1550 2023-10-03T10:15:23.774 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:23.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 msgr2=0x7f13dc11ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f13d0000c00 tx=0x7f13d0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 shutdown_connections 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13dc139200 0x7f13dc11f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13dc0a0a70 0x7f13dc11e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 --2- 172.21.15.125:0/1452658844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13dc0a1550 0x7f13dc11ecf0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 >> 172.21.15.125:0/1452658844 conn(0x7f13dc0a6610 msgr2=0x7f13dc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 shutdown_connections 2023-10-03T10:15:23.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.776+0000 7f13e20e6700 1 -- 172.21.15.125:0/1452658844 wait complete. 2023-10-03T10:15:23.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:23.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.811+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faaf004f2a0 con 0x7faaf009f1a0 2023-10-03T10:15:23.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.811+0000 7faaecff9700 1 -- 172.21.15.125:0/3939148894 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faae80263b0 con 0x7faaf009f1a0 2023-10-03T10:15:23.812 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.813+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 msgr2=0x7faaf0123160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.813+0000 7faaf6130700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 0x7faaf0123160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e50 tx=0x7faae8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 shutdown_connections 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faaf009f1a0 0x7faaf0123160 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faaf009a150 0x7faaf01226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 --2- 172.21.15.125:0/3939148894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faaf009edb0 0x7faaf0122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 >> 172.21.15.125:0/3939148894 conn(0x7faaf00a4430 msgr2=0x7faaf0134110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 shutdown_connections 2023-10-03T10:15:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.814+0000 7faaf6130700 1 -- 172.21.15.125:0/3939148894 wait complete. 2023-10-03T10:15:23.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:23.865 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:23.866 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.991+0000 7f51cfe08700 1 Processor -- start 2023-10-03T10:15:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.991+0000 7f0d9f9e1700 1 Processor -- start 2023-10-03T10:15:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.991+0000 7f51cfe08700 1 -- start start 2023-10-03T10:15:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.991+0000 7f0d9f9e1700 1 -- start start 2023-10-03T10:15:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cfe08700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cfe08700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 0x7f51c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cfe08700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c809dc00 con 0x7f51c8133f50 2023-10-03T10:15:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cfe08700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c809ea60 con 0x7f51c80a1380 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cfe08700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c809dec0 con 0x7f51c80a0a70 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cd3a3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 0x7f51c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33022/0 (socket says 172.21.15.125:33022) 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cd3a3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 0x7f51c8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47074/0 (socket says 172.21.15.125:47074) 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 -- 172.21.15.125:0/3947110503 learned_addr learned my addr 172.21.15.125:0/3947110503 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51ce3a5700 1 --1- 172.21.15.125:0/3947110503 >> v1:172.21.15.125:6789/0 conn(0x7f51c8133f50 0x7f51c813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42876/0 (socket says 172.21.15.125:42876) 2023-10-03T10:15:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9f9e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9f9e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d98134120 0x7f0d9813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9f9e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9809dc00 con 0x7f0d980a1380 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9f9e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9809ea90 con 0x7f0d980a0a70 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9f9e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9809dec0 con 0x7f0d98134120 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47906/0 (socket says 172.21.15.125:47906) 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 -- 172.21.15.125:0/2262629595 learned_addr learned my addr 172.21.15.125:0/2262629595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 -- 172.21.15.125:0/3947110503 >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 msgr2=0x7f51c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 --2- 172.21.15.125:0/3947110503 >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 0x7f51c8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 -- 172.21.15.125:0/3947110503 >> v1:172.21.15.125:6789/0 conn(0x7f51c8133f50 legacy=0x7f51c813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 -- 172.21.15.125:0/3947110503 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c809e6a0 con 0x7f51c80a0a70 2023-10-03T10:15:23.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9df7e700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d98134120 0x7f0d9813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f51cdba4700 1 --2- 172.21.15.125:0/3947110503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f51c40098f0 tx=0x7f51c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f24e6b882bcd515 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 -- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d98134120 msgr2=0x7f0d9813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d98134120 0x7f0d9813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 -- 172.21.15.125:0/2262629595 >> v1:172.21.15.125:6789/0 conn(0x7f0d980a1380 legacy=0x7f0d98133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.992+0000 7f0d9d77d700 1 -- 172.21.15.125:0/2262629595 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9809e6a0 con 0x7f0d980a0a70 2023-10-03T10:15:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d9d77d700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009920 tx=0x7f0d94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39817e786326f69e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51ccba2700 1 -- 172.21.15.125:0/3947110503 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011830 con 0x7f51c80a0a70 2023-10-03T10:15:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51ccba2700 1 -- 172.21.15.125:0/3947110503 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4011990 con 0x7f51c80a0a70 2023-10-03T10:15:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51ccba2700 1 -- 172.21.15.125:0/3947110503 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011d20 con 0x7f51c80a0a70 2023-10-03T10:15:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d8ffff700 1 -- 172.21.15.125:0/2262629595 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400ba60 con 0x7f0d980a0a70 2023-10-03T10:15:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d8ffff700 1 -- 172.21.15.125:0/2262629595 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400bbc0 con 0x7f0d980a0a70 2023-10-03T10:15:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d8ffff700 1 -- 172.21.15.125:0/2262629595 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94009e70 con 0x7f0d980a0a70 2023-10-03T10:15:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 -- 172.21.15.125:0/3947110503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 msgr2=0x7f51c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 --2- 172.21.15.125:0/3947110503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f51c40098f0 tx=0x7f51c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 msgr2=0x7f0d980a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 -- 172.21.15.125:0/3947110503 shutdown_connections 2023-10-03T10:15:24.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 --2- 172.21.15.125:0/3947110503 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a0a70 0x7f51c80a0e40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009920 tx=0x7f0d94009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:24.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 --2- 172.21.15.125:0/3947110503 >> v2:172.21.15.125:3300/0 conn(0x7f51c80a1380 0x7f51c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f51cfe08700 1 -- 172.21.15.125:0/3947110503 >> 172.21.15.125:0/3947110503 conn(0x7f51c80a6610 msgr2=0x7f51c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.993+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/2262629595 shutdown_connections 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d98134120 0x7f0d9813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/2262629595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d980a0e40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/2262629595 >> 172.21.15.125:0/2262629595 conn(0x7f0d980a6610 msgr2=0x7f0d980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f51cfe08700 1 -- 172.21.15.125:0/3947110503 shutdown_connections 2023-10-03T10:15:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f51cfe08700 1 -- 172.21.15.125:0/3947110503 wait complete. 2023-10-03T10:15:24.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/2262629595 shutdown_connections 2023-10-03T10:15:24.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/2262629595 wait complete. 2023-10-03T10:15:24.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.994+0000 7f51cfe08700 1 Processor -- start 2023-10-03T10:15:24.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 -- start start 2023-10-03T10:15:24.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 Processor -- start 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51c80a0a70 0x7f51c81c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51c8133f50 0x7f51c81c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8133ad0 con 0x7f51c80a0a70 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8125300 con 0x7f51c8133f50 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cfe08700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8124690 con 0x7f51c80a1380 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33032/0 (socket says 172.21.15.125:33032) 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 -- 172.21.15.125:0/149201611 learned_addr learned my addr 172.21.15.125:0/149201611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cdba4700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51c80a0a70 0x7f51c81c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 -- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51c8133f50 msgr2=0x7f51c81c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51c8133f50 0x7f51c81c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 -- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51c80a0a70 msgr2=0x7f51c81c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51c80a0a70 0x7f51c81c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f51cd3a3700 1 -- 172.21.15.125:0/149201611 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4009550 con 0x7f51c80a1380 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 -- start start 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d980a1380 0x7f0d98122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 0x7f0d981233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98133aa0 con 0x7f0d98134120 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981333f0 con 0x7f0d980a0a70 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.995+0000 7f0d9f9e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981245f0 con 0x7f0d980a1380 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47918/0 (socket says 172.21.15.125:47918) 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9cf7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d980a1380 0x7f0d98122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 -- 172.21.15.125:0/1870837455 learned_addr learned my addr 172.21.15.125:0/1870837455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:24.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51cd3a3700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e980 tx=0x7f51b800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9df7e700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 0x7f0d981233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 -- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d980a1380 msgr2=0x7f0d98122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d980a1380 0x7f0d98122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 -- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 msgr2=0x7f0d981233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 0x7f0d981233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 -- 172.21.15.125:0/1870837455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94009550 con 0x7f0d980a0a70 2023-10-03T10:15:24.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9df7e700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 0x7f0d981233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8009710 con 0x7f51c80a1380 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800eed0 con 0x7f51c80a1380 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80a03e0 con 0x7f51c80a1380 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800ca70 con 0x7f51c80a1380 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f0d9d77d700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d940098f0 tx=0x7f0d94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.996+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c81262c0 con 0x7f51c80a1380 2023-10-03T10:15:24.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94004300 con 0x7f0d980a0a70 2023-10-03T10:15:24.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b800cbd0 con 0x7f51c80a1380 2023-10-03T10:15:24.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9401f070 con 0x7f0d980a0a70 2023-10-03T10:15:24.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98124ce0 con 0x7f0d980a0a70 2023-10-03T10:15:24.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d940036a0 con 0x7f0d980a0a70 2023-10-03T10:15:24.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51b8045060 con 0x7f51c80a1380 2023-10-03T10:15:24.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.997+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98133820 con 0x7f0d980a0a70 2023-10-03T10:15:24.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.998+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d94021030 con 0x7f0d980a0a70 2023-10-03T10:15:24.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.998+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c804f2a0 con 0x7f51c80a1380 2023-10-03T10:15:24.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.998+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d94040920 con 0x7f0d980a0a70 2023-10-03T10:15:24.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:23.998+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9804f2a0 con 0x7f0d980a0a70 2023-10-03T10:15:24.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.006+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b8017070 con 0x7f51c80a1380 2023-10-03T10:15:24.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.006+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d94015080 con 0x7f0d980a0a70 2023-10-03T10:15:24.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.198+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51c8072980 con 0x7f51c80a1380 2023-10-03T10:15:24.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.199+0000 7f51be7fc700 1 -- 172.21.15.125:0/149201611 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b8024020 con 0x7f51c80a1380 2023-10-03T10:15:24.199 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:24.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.199+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d98125ee0 con 0x7f0d980a0a70 2023-10-03T10:15:24.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.199+0000 7f0d8dffb700 1 -- 172.21.15.125:0/1870837455 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d940199a0 con 0x7f0d980a0a70 2023-10-03T10:15:24.200 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 msgr2=0x7f51c81c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f51b800e980 tx=0x7f51b800ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 shutdown_connections 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51c8133f50 0x7f51c81c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51c80a0a70 0x7f51c81c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 --2- 172.21.15.125:0/149201611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51c80a1380 0x7f51c81c8790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 >> 172.21.15.125:0/149201611 conn(0x7f51c80a6610 msgr2=0x7f51c80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 shutdown_connections 2023-10-03T10:15:24.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.201+0000 7f51cfe08700 1 -- 172.21.15.125:0/149201611 wait complete. 2023-10-03T10:15:24.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 msgr2=0x7f0d98122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d940098f0 tx=0x7f0d94004750 comp rx=0 tx=0).stop 2023-10-03T10:15:24.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 shutdown_connections 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d98134120 0x7f0d981233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d980a0a70 0x7f0d98122960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 --2- 172.21.15.125:0/1870837455 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d980a1380 0x7f0d98122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 >> 172.21.15.125:0/1870837455 conn(0x7f0d980a6610 msgr2=0x7f0d980a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 shutdown_connections 2023-10-03T10:15:24.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.202+0000 7f0d9f9e1700 1 -- 172.21.15.125:0/1870837455 wait complete. 2023-10-03T10:15:24.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:24.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:24.789 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:24.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.916+0000 7f9c1f323700 1 Processor -- start 2023-10-03T10:15:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.916+0000 7f9c1f323700 1 -- start start 2023-10-03T10:15:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1f323700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1f323700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1f323700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1809dc00 con 0x7f9c18133f50 2023-10-03T10:15:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1f323700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1809ea60 con 0x7f9c180a0a70 2023-10-03T10:15:24.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1f323700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1809dec0 con 0x7f9c180a1380 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1d0bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33048/0 (socket says 172.21.15.125:33048) 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1d8c0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9c18133f50 0x7f9c1813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42904/0 (socket says 172.21.15.125:42904) 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1d0bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47104/0 (socket says 172.21.15.125:47104) 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1d8c0700 1 -- 172.21.15.125:0/1466696822 learned_addr learned my addr 172.21.15.125:0/1466696822 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 -- 172.21.15.125:0/1466696822 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 msgr2=0x7f9c180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 --2- 172.21.15.125:0/1466696822 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 -- 172.21.15.125:0/1466696822 >> v1:172.21.15.125:6789/0 conn(0x7f9c18133f50 legacy=0x7f9c1813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1c8be700 1 -- 172.21.15.125:0/1466696822 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1809e6a0 con 0x7f9c180a1380 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c0ffff700 1 -- 172.21.15.125:0/1466696822 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336359363 0 0) 0x7f9c1809dc00 con 0x7f9c18133f50 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.917+0000 7f9c1d0bf700 1 --2- 172.21.15.125:0/1466696822 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1c8be700 1 --2- 172.21.15.125:0/1466696822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009840 tx=0x7f9c08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56403029c75ed79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c0ffff700 1 -- 172.21.15.125:0/1466696822 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011830 con 0x7f9c180a1380 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c0ffff700 1 -- 172.21.15.125:0/1466696822 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08011990 con 0x7f9c180a1380 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c0ffff700 1 -- 172.21.15.125:0/1466696822 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011d20 con 0x7f9c180a1380 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 -- 172.21.15.125:0/1466696822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 msgr2=0x7f9c18133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 --2- 172.21.15.125:0/1466696822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009840 tx=0x7f9c08009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:24.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 -- 172.21.15.125:0/1466696822 shutdown_connections 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 --2- 172.21.15.125:0/1466696822 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 --2- 172.21.15.125:0/1466696822 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c180a1380 0x7f9c18133a10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 -- 172.21.15.125:0/1466696822 >> 172.21.15.125:0/1466696822 conn(0x7f9c180a6610 msgr2=0x7f9c180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 -- 172.21.15.125:0/1466696822 shutdown_connections 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.918+0000 7f9c1f323700 1 -- 172.21.15.125:0/1466696822 wait complete. 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.919+0000 7f9c1f323700 1 Processor -- start 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.919+0000 7f9c1f323700 1 -- start start 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c181c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 0x7f9c181c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18122320 con 0x7f9c180a1380 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18120660 con 0x7f9c180a0a70 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180a17b0 con 0x7f9c18133f50 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1c8be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 0x7f9c181c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1c8be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47120/0 (socket says 172.21.15.125:47120) 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1c8be700 1 -- 172.21.15.125:0/4266275937 learned_addr learned my addr 172.21.15.125:0/4266275937 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d0bf700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c181c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 -- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 msgr2=0x7f9c181c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c181c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 -- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 msgr2=0x7f9c181c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 -- 172.21.15.125:0/4266275937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140094a0 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1c8be700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1d8c0700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 0x7f9c181c8ee0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000cbe0 tx=0x7f9c1000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000aa40 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000abc0 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c080094a0 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.920+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100070d0 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.921+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c18120e50 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.921+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c10007230 con 0x7f9c18133f50 2023-10-03T10:15:24.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.921+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c1003f390 con 0x7f9c18133f50 2023-10-03T10:15:24.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.922+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804f2a0 con 0x7f9c18133f50 2023-10-03T10:15:24.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.926+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c10018080 con 0x7f9c18133f50 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.958+0000 7fb761858700 1 Processor -- start 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.958+0000 7fb761858700 1 -- start start 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.958+0000 7fb761858700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 0x7fb75c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb761858700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c134120 0x7fb75c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb761858700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c09dc00 con 0x7fb75c0a1380 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb761858700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c09ea90 con 0x7fb75c134120 2023-10-03T10:15:24.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb761858700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c09dec0 con 0x7fb75c0a0a70 2023-10-03T10:15:24.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 0x7fb75c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb75c0a1380 0x7fb75c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42906/0 (socket says 172.21.15.125:42906) 2023-10-03T10:15:24.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75a7fc700 1 -- 172.21.15.125:0/2853966973 learned_addr learned my addr 172.21.15.125:0/2853966973 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:24.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75b7fe700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c134120 0x7fb75c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb759ffb700 1 -- 172.21.15.125:0/2853966973 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464949089 0 0) 0x7fb75c09dc00 con 0x7fb75c0a1380 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb759ffb700 1 -- 172.21.15.125:0/2853966973 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7440035b0 con 0x7fb75c0a1380 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 -- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c134120 msgr2=0x7fb75c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c134120 0x7fb75c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 -- 172.21.15.125:0/2853966973 >> v1:172.21.15.125:6789/0 conn(0x7fb75c0a1380 legacy=0x7fb75c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 -- 172.21.15.125:0/2853966973 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c09e6a0 con 0x7fb75c0a0a70 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb75affd700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 0x7fb75c0a0e40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009870 tx=0x7fb74c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7f56d79a432791 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb759ffb700 1 -- 172.21.15.125:0/2853966973 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c011830 con 0x7fb75c0a0a70 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb759ffb700 1 -- 172.21.15.125:0/2853966973 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c011990 con 0x7fb75c0a0a70 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.959+0000 7fb759ffb700 1 -- 172.21.15.125:0/2853966973 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c011d20 con 0x7fb75c0a0a70 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 -- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 msgr2=0x7fb75c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 0x7fb75c0a0e40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009870 tx=0x7fb74c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 -- 172.21.15.125:0/2853966973 shutdown_connections 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c134120 0x7fb75c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 --2- 172.21.15.125:0/2853966973 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a0a70 0x7fb75c0a0e40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 -- 172.21.15.125:0/2853966973 >> 172.21.15.125:0/2853966973 conn(0x7fb75c0a6610 msgr2=0x7fb75c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 -- 172.21.15.125:0/2853966973 shutdown_connections 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.960+0000 7fb761858700 1 -- 172.21.15.125:0/2853966973 wait complete. 2023-10-03T10:15:24.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.961+0000 7fb761858700 1 Processor -- start 2023-10-03T10:15:24.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.961+0000 7fb761858700 1 -- start start 2023-10-03T10:15:24.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.961+0000 7fb761858700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c0a0a70 0x7fb75c122af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb75c134120 0x7fb75c123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c125ef0 con 0x7fb75c134120 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c127110 con 0x7fb75c0a0a70 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c124ac0 con 0x7fb75c0a1380 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33068/0 (socket says 172.21.15.125:33068) 2023-10-03T10:15:24.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 -- 172.21.15.125:0/2363058436 learned_addr learned my addr 172.21.15.125:0/2363058436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:24.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c0a0a70 0x7fb75c122af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75b7fe700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb75c134120 0x7fb75c123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 -- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c0a0a70 msgr2=0x7fb75c122af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c0a0a70 0x7fb75c122af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 -- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb75c134120 msgr2=0x7fb75c123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb75c134120 0x7fb75c123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 -- 172.21.15.125:0/2363058436 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0094a0 con 0x7fb75c0a1380 2023-10-03T10:15:24.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb75a7fc700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb750005910 tx=0x7fb75000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750005d70 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7500070d0 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0a03e0 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750007460 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.962+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c126c20 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.963+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7500075c0 con 0x7fb75c0a1380 2023-10-03T10:15:24.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.963+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c04f2a0 con 0x7fb75c0a1380 2023-10-03T10:15:24.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.963+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb75003eab0 con 0x7fb75c0a1380 2023-10-03T10:15:24.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:24.968+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb750017020 con 0x7fb75c0a1380 2023-10-03T10:15:25.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.123+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c180a5660 con 0x7f9c18133f50 2023-10-03T10:15:25.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.123+0000 7f9c0dffb700 1 -- 172.21.15.125:0/4266275937 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c100074e0 con 0x7f9c18133f50 2023-10-03T10:15:25.124 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 msgr2=0x7f9c181c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 0x7f9c181c8ee0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000cbe0 tx=0x7f9c1000cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 shutdown_connections 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18133f50 0x7f9c181c8ee0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c181c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 --2- 172.21.15.125:0/4266275937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c181c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 >> 172.21.15.125:0/4266275937 conn(0x7f9c180a6610 msgr2=0x7f9c180a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 shutdown_connections 2023-10-03T10:15:25.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.125+0000 7f9c1f323700 1 -- 172.21.15.125:0/4266275937 wait complete. 2023-10-03T10:15:25.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.161+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb75c09fc00 con 0x7fb75c0a1380 2023-10-03T10:15:25.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.161+0000 7fb743fff700 1 -- 172.21.15.125:0/2363058436 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb75000f260 con 0x7fb75c0a1380 2023-10-03T10:15:25.162 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 msgr2=0x7fb75c123030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb750005910 tx=0x7fb75000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 shutdown_connections 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb75c134120 0x7fb75c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb75c0a0a70 0x7fb75c122af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 --2- 172.21.15.125:0/2363058436 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb75c0a1380 0x7fb75c123030 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 >> 172.21.15.125:0/2363058436 conn(0x7fb75c0a6610 msgr2=0x7fb75c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 shutdown_connections 2023-10-03T10:15:25.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.163+0000 7fb761858700 1 -- 172.21.15.125:0/2363058436 wait complete. 2023-10-03T10:15:25.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:25.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:25.217 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:25.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.341+0000 7f1e17717700 1 Processor -- start 2023-10-03T10:15:25.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 Processor -- start 2023-10-03T10:15:25.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 -- start start 2023-10-03T10:15:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 -- start start 2023-10-03T10:15:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1809aaa0 con 0x7fcc1809d860 2023-10-03T10:15:25.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1809e730 con 0x7fcc1809e340 2023-10-03T10:15:25.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1f140700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1809f870 con 0x7fcc18135f20 2023-10-03T10:15:25.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1d6dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc17fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1d6dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51030/0 (socket says 172.21.15.125:51030) 2023-10-03T10:15:25.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc17fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47222/0 (socket says 172.21.15.125:47222) 2023-10-03T10:15:25.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7fcc1d6dd700 1 -- 172.21.15.125:0/903822254 learned_addr learned my addr 172.21.15.125:0/903822254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1009aaa0 con 0x7f1e1009e170 2023-10-03T10:15:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1009f870 con 0x7f1e10130eb0 2023-10-03T10:15:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.342+0000 7f1e17717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1009b360 con 0x7f1e1009d860 2023-10-03T10:15:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e15cb4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51032/0 (socket says 172.21.15.125:51032) 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e14cb2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1e1009e170 0x7f1e101307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50748/0 (socket says 172.21.15.125:50748) 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 -- 172.21.15.125:0/3078789240 learned_addr learned my addr 172.21.15.125:0/3078789240 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e15cb4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47230/0 (socket says 172.21.15.125:47230) 2023-10-03T10:15:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc17fff700 1 -- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 msgr2=0x7fcc18138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc17fff700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc17fff700 1 -- 172.21.15.125:0/903822254 >> v1:172.21.15.125:6789/0 conn(0x7fcc1809d860 legacy=0x7fcc1809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc17fff700 1 -- 172.21.15.125:0/903822254 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1809b360 con 0x7fcc1809e340 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc177fe700 1 -- 172.21.15.125:0/903822254 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999895265 0 0) 0x7fcc1809aaa0 con 0x7fcc1809d860 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc1d6dd700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 -- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 msgr2=0x7f1e10138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 -- 172.21.15.125:0/3078789240 >> v1:172.21.15.125:6789/0 conn(0x7f1e1009e170 legacy=0x7f1e101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 -- 172.21.15.125:0/3078789240 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1009b620 con 0x7f1e1009d860 2023-10-03T10:15:25.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e15cb4700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc17fff700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009870 tx=0x7fcc04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3d0abf4c252d975 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e154b3700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009920 tx=0x7f1e0c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b009100785d7895 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc177fe700 1 -- 172.21.15.125:0/903822254 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04011830 con 0x7fcc1809e340 2023-10-03T10:15:25.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e07fff700 1 -- 172.21.15.125:0/3078789240 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011830 con 0x7f1e1009d860 2023-10-03T10:15:25.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc177fe700 1 -- 172.21.15.125:0/903822254 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04011990 con 0x7fcc1809e340 2023-10-03T10:15:25.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e07fff700 1 -- 172.21.15.125:0/3078789240 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c011990 con 0x7f1e1009d860 2023-10-03T10:15:25.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7f1e07fff700 1 -- 172.21.15.125:0/3078789240 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011d20 con 0x7f1e1009d860 2023-10-03T10:15:25.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.343+0000 7fcc177fe700 1 -- 172.21.15.125:0/903822254 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04011d20 con 0x7fcc1809e340 2023-10-03T10:15:25.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 -- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 msgr2=0x7fcc181359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009870 tx=0x7fcc04009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 -- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 msgr2=0x7f1e1009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009920 tx=0x7f1e0c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 -- 172.21.15.125:0/3078789240 shutdown_connections 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e10130eb0 0x7f1e10138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 --2- 172.21.15.125:0/3078789240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e1009d860 0x7f1e1009dc30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 -- 172.21.15.125:0/3078789240 >> 172.21.15.125:0/3078789240 conn(0x7f1e10099c40 msgr2=0x7f1e100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 -- 172.21.15.125:0/903822254 shutdown_connections 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc18138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 --2- 172.21.15.125:0/903822254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809e340 0x7fcc181359e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 -- 172.21.15.125:0/903822254 >> 172.21.15.125:0/903822254 conn(0x7fcc18099c40 msgr2=0x7fcc180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 -- 172.21.15.125:0/903822254 shutdown_connections 2023-10-03T10:15:25.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7fcc1f140700 1 -- 172.21.15.125:0/903822254 wait complete. 2023-10-03T10:15:25.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 -- 172.21.15.125:0/3078789240 shutdown_connections 2023-10-03T10:15:25.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.344+0000 7f1e17717700 1 -- 172.21.15.125:0/3078789240 wait complete. 2023-10-03T10:15:25.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.345+0000 7fcc1f140700 1 Processor -- start 2023-10-03T10:15:25.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.345+0000 7fcc1f140700 1 -- start start 2023-10-03T10:15:25.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.345+0000 7f1e17717700 1 Processor -- start 2023-10-03T10:15:25.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 -- start start 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809d860 0x7fcc18120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc181210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18122e00 con 0x7fcc1809e340 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180a33b0 con 0x7fcc1809d860 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1f140700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1809c8b0 con 0x7fcc18135f20 2023-10-03T10:15:25.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45458/0 (socket says 172.21.15.125:45458) 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1d6dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc181210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 -- 172.21.15.125:0/2472771380 learned_addr learned my addr 172.21.15.125:0/2472771380 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1cedc700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809d860 0x7fcc18120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 0x7f1e1013aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1009e170 0x7f1e10135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 0x7f1e10136310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10138ba0 con 0x7f1e1009d860 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10137230 con 0x7f1e1009e170 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e17717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100a2190 con 0x7f1e10130eb0 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 -- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 msgr2=0x7fcc181210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc181210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 -- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809d860 msgr2=0x7fcc18120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809d860 0x7fcc18120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 -- 172.21.15.125:0/2472771380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10009b30 con 0x7fcc1809e340 2023-10-03T10:15:25.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc1d6dd700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc181210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e154b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 0x7f1e1013aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e154b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 0x7f1e1013aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45464/0 (socket says 172.21.15.125:45464) 2023-10-03T10:15:25.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e154b3700 1 -- 172.21.15.125:0/797928100 learned_addr learned my addr 172.21.15.125:0/797928100 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:25.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e15cb4700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 0x7f1e10136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7f1e14cb2700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1009e170 0x7f1e10135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.346+0000 7fcc17fff700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009840 tx=0x7fcc04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 -- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1009e170 msgr2=0x7f1e10135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1009e170 0x7f1e10135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 -- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 msgr2=0x7f1e1013aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 0x7f1e1013aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 -- 172.21.15.125:0/797928100 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009a70 con 0x7f1e10130eb0 2023-10-03T10:15:25.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04004300 con 0x7fcc1809e340 2023-10-03T10:15:25.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0401f070 con 0x7fcc1809e340 2023-10-03T10:15:25.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040036a0 con 0x7fcc1809e340 2023-10-03T10:15:25.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc040094a0 con 0x7fcc1809e340 2023-10-03T10:15:25.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1806aa10 con 0x7fcc1809e340 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e15cb4700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 0x7f1e10136310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800efc0 tx=0x7f1e0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800cb40 con 0x7f1e10130eb0 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800f040 con 0x7f1e10130eb0 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08003a20 con 0x7f1e10130eb0 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.347+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c009550 con 0x7f1e10130eb0 2023-10-03T10:15:25.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.348+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc04021030 con 0x7fcc1809e340 2023-10-03T10:15:25.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.348+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e101392c0 con 0x7f1e10130eb0 2023-10-03T10:15:25.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.348+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcc04040610 con 0x7fcc1809e340 2023-10-03T10:15:25.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.348+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc18122c40 con 0x7fcc1809e340 2023-10-03T10:15:25.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.348+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e08014480 con 0x7f1e10130eb0 2023-10-03T10:15:25.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.349+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e10132af0 con 0x7f1e10130eb0 2023-10-03T10:15:25.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.349+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e08041780 con 0x7f1e10130eb0 2023-10-03T10:15:25.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.353+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc040199a0 con 0x7fcc1809e340 2023-10-03T10:15:25.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.353+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e08045060 con 0x7f1e10130eb0 2023-10-03T10:15:25.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.547+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e1004f2a0 con 0x7f1e10130eb0 2023-10-03T10:15:25.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.547+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc1804f2a0 con 0x7fcc1809e340 2023-10-03T10:15:25.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.547+0000 7f1e05ffb700 1 -- 172.21.15.125:0/797928100 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e08012930 con 0x7f1e10130eb0 2023-10-03T10:15:25.548 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:25.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.547+0000 7fcc157fa700 1 -- 172.21.15.125:0/2472771380 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc04015030 con 0x7fcc1809e340 2023-10-03T10:15:25.548 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 msgr2=0x7f1e10136310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 0x7f1e10136310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800efc0 tx=0x7f1e0800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 shutdown_connections 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e10130eb0 0x7f1e10136310 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e1009d860 0x7f1e1013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 --2- 172.21.15.125:0/797928100 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1009e170 0x7f1e10135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 >> 172.21.15.125:0/797928100 conn(0x7f1e10099c40 msgr2=0x7f1e1013b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 msgr2=0x7fcc18120b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009840 tx=0x7fcc04004750 comp rx=0 tx=0).stop 2023-10-03T10:15:25.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 shutdown_connections 2023-10-03T10:15:25.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7f1e17717700 1 -- 172.21.15.125:0/797928100 wait complete. 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 shutdown_connections 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc18135f20 0x7fcc181210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc1809d860 0x7fcc18120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 --2- 172.21.15.125:0/2472771380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc1809e340 0x7fcc18120b90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 >> 172.21.15.125:0/2472771380 conn(0x7fcc18099c40 msgr2=0x7fcc180a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.549+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 shutdown_connections 2023-10-03T10:15:25.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:25.550+0000 7fcc1f140700 1 -- 172.21.15.125:0/2472771380 wait complete. 2023-10-03T10:15:25.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:25.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:26.139 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:26.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:26.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.266+0000 7f11e3f9c700 1 Processor -- start 2023-10-03T10:15:26.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.266+0000 7f11e3f9c700 1 -- start start 2023-10-03T10:15:26.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e3f9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 0x7f11dc09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e3f9c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11dc09bd10 0x7f11dc13c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e3f9c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc0a0a70 con 0x7f11dc13c760 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e3f9c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc09b190 con 0x7f11dc09bd10 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e3f9c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc09a820 con 0x7f11dc09b400 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11dc09bd10 0x7f11dc13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1d38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 0x7f11dc09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e2539700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f11dc13c760 0x7f11dc13eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50754/0 (socket says 172.21.15.125:50754) 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e2539700 1 -- 172.21.15.125:0/1298053400 learned_addr learned my addr 172.21.15.125:0/1298053400 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 -- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 msgr2=0x7f11dc09b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 0x7f11dc09b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 -- 172.21.15.125:0/1298053400 >> v1:172.21.15.125:6789/0 conn(0x7f11dc13c760 legacy=0x7f11dc13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 -- 172.21.15.125:0/1298053400 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc09a280 con 0x7f11dc09bd10 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e0d36700 1 -- 172.21.15.125:0/1298053400 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917112080 0 0) 0x7f11dc0a0a70 con 0x7f11dc13c760 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1d38700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 0x7f11dc09b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.267+0000 7f11e1537700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc09bd10 0x7f11dc13c220 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009840 tx=0x7f11cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf732a4a86286de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e0d36700 1 -- 172.21.15.125:0/1298053400 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc011830 con 0x7f11dc09bd10 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e0d36700 1 -- 172.21.15.125:0/1298053400 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc011990 con 0x7f11dc09bd10 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e0d36700 1 -- 172.21.15.125:0/1298053400 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc011d20 con 0x7f11dc09bd10 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 -- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc09bd10 msgr2=0x7f11dc13c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc09bd10 0x7f11dc13c220 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009840 tx=0x7f11cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:26.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 -- 172.21.15.125:0/1298053400 shutdown_connections 2023-10-03T10:15:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09b400 0x7f11dc09b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/1298053400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc09bd10 0x7f11dc13c220 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 -- 172.21.15.125:0/1298053400 >> 172.21.15.125:0/1298053400 conn(0x7f11dc099c40 msgr2=0x7f11dc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 -- 172.21.15.125:0/1298053400 shutdown_connections 2023-10-03T10:15:26.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.268+0000 7f11e3f9c700 1 -- 172.21.15.125:0/1298053400 wait complete. 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.269+0000 7f11e3f9c700 1 Processor -- start 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.269+0000 7f11e3f9c700 1 -- start start 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11dc09b400 0x7f11dc1ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 0x7f11dc1270e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc128ee0 con 0x7f11dc13c760 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc128cf0 con 0x7f11dc09b400 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc13ba70 con 0x7f11dc09bd10 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e2539700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 0x7f11dc1270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51062/0 (socket says 172.21.15.125:51062) 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 -- 172.21.15.125:0/4246230426 learned_addr learned my addr 172.21.15.125:0/4246230426 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1d38700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11dc09b400 0x7f11dc1ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 -- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11dc09b400 msgr2=0x7f11dc1ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11dc09b400 0x7f11dc1ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 -- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 msgr2=0x7f11dc1270e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 0x7f11dc1270e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 -- 172.21.15.125:0/4246230426 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80094a0 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e2539700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 0x7f11dc1270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e1537700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0090b0 tx=0x7f11cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0036a0 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc01f070 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc0094a0 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.270+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003a60 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.271+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc12a920 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.271+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc04f2a0 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.272+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11cc003bc0 con 0x7f11dc09bd10 2023-10-03T10:15:26.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.272+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11cc021070 con 0x7f11dc09bd10 2023-10-03T10:15:26.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.280+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11cc0253e0 con 0x7f11dc09bd10 2023-10-03T10:15:26.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.310+0000 7fa6b094b700 1 Processor -- start 2023-10-03T10:15:26.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.310+0000 7fa6b094b700 1 -- start start 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6b094b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6b094b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6b094b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac09dc00 con 0x7fa6ac133f50 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6b094b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac09ea60 con 0x7fa6ac0a1380 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6b094b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac09dec0 con 0x7fa6ac0a0a70 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6aa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6aa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51066/0 (socket says 172.21.15.125:51066) 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47270/0 (socket says 172.21.15.125:47270) 2023-10-03T10:15:26.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6aa59c700 1 -- 172.21.15.125:0/961210960 learned_addr learned my addr 172.21.15.125:0/961210960 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 -- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 msgr2=0x7fa6ac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 -- 172.21.15.125:0/961210960 >> v1:172.21.15.125:6789/0 conn(0x7fa6ac133f50 legacy=0x7fa6ac13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a959a700 1 -- 172.21.15.125:0/961210960 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941273510 0 0) 0x7fa6ac09dc00 con 0x7fa6ac133f50 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 -- 172.21.15.125:0/961210960 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac09e6a0 con 0x7fa6ac0a1380 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6aa59c700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a9d9b700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b9068a73d4e0ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a959a700 1 -- 172.21.15.125:0/961210960 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0011830 con 0x7fa6ac0a1380 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a959a700 1 -- 172.21.15.125:0/961210960 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0011990 con 0x7fa6ac0a1380 2023-10-03T10:15:26.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.311+0000 7fa6a959a700 1 -- 172.21.15.125:0/961210960 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0011d20 con 0x7fa6ac0a1380 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 -- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 msgr2=0x7fa6ac133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 -- 172.21.15.125:0/961210960 shutdown_connections 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 --2- 172.21.15.125:0/961210960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac0a1380 0x7fa6ac133a10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 -- 172.21.15.125:0/961210960 >> 172.21.15.125:0/961210960 conn(0x7fa6ac0a6610 msgr2=0x7fa6ac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 -- 172.21.15.125:0/961210960 shutdown_connections 2023-10-03T10:15:26.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.312+0000 7fa6b094b700 1 -- 172.21.15.125:0/961210960 wait complete. 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 Processor -- start 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 -- start start 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac124fa0 con 0x7fa6ac0a1380 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac126370 con 0x7fa6ac133f50 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.313+0000 7fa6b094b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac1246b0 con 0x7fa6ac0a0a70 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6a9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47286/0 (socket says 172.21.15.125:47286) 2023-10-03T10:15:26.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 -- 172.21.15.125:0/1801652758 learned_addr learned my addr 172.21.15.125:0/1801652758 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6a9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45494/0 (socket says 172.21.15.125:45494) 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aa59c700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 -- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 msgr2=0x7fa6ac1c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac1c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 -- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 msgr2=0x7fa6ac1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 -- 172.21.15.125:0/1801652758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009550 con 0x7fa6ac133f50 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6a9d9b700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6aad9d700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4001560 tx=0x7fa6a400cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4003e30 con 0x7fa6ac133f50 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4005070 con 0x7fa6ac133f50 2023-10-03T10:15:26.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a00094a0 con 0x7fa6ac133f50 2023-10-03T10:15:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a40053e0 con 0x7fa6ac133f50 2023-10-03T10:15:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.314+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac0a03e0 con 0x7fa6ac133f50 2023-10-03T10:15:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.315+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6a4005540 con 0x7fa6ac133f50 2023-10-03T10:15:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.315+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6a403ecb0 con 0x7fa6ac133f50 2023-10-03T10:15:26.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.315+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ac1253e0 con 0x7fa6ac133f50 2023-10-03T10:15:26.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.320+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6a4017080 con 0x7fa6ac133f50 2023-10-03T10:15:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.473+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11dc09a570 con 0x7f11dc09bd10 2023-10-03T10:15:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.473+0000 7f11d27fc700 1 -- 172.21.15.125:0/4246230426 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11cc035090 con 0x7f11dc09bd10 2023-10-03T10:15:26.474 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 msgr2=0x7f11dc1cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0090b0 tx=0x7f11cc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 shutdown_connections 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc13c760 0x7f11dc1270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11dc09b400 0x7f11dc1ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 --2- 172.21.15.125:0/4246230426 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11dc09bd10 0x7f11dc1cd2d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 >> 172.21.15.125:0/4246230426 conn(0x7f11dc099c40 msgr2=0x7f11dc06da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 shutdown_connections 2023-10-03T10:15:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.476+0000 7f11e3f9c700 1 -- 172.21.15.125:0/4246230426 wait complete. 2023-10-03T10:15:26.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:26.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.513+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6ac04f2a0 con 0x7fa6ac133f50 2023-10-03T10:15:26.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.513+0000 7fa69affd700 1 -- 172.21.15.125:0/1801652758 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6a401b3b0 con 0x7fa6ac133f50 2023-10-03T10:15:26.513 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 msgr2=0x7fa6ac1c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4001560 tx=0x7fa6a400cb50 comp rx=0 tx=0).stop 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 shutdown_connections 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6ac133f50 0x7fa6ac1c8d50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa6ac0a0a70 0x7fa6ac1c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 --2- 172.21.15.125:0/1801652758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6ac0a1380 0x7fa6ac1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 >> 172.21.15.125:0/1801652758 conn(0x7fa6ac0a6610 msgr2=0x7fa6ac0a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 shutdown_connections 2023-10-03T10:15:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.515+0000 7fa6b094b700 1 -- 172.21.15.125:0/1801652758 wait complete. 2023-10-03T10:15:26.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:26.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:26.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:26.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f69d4326700 1 Processor -- start 2023-10-03T10:15:26.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 Processor -- start 2023-10-03T10:15:26.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f69d4326700 1 -- start start 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 -- start start 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409e340 0x7f09141359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 0x7f0914138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091409aaa0 con 0x7f091409d860 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091409e730 con 0x7f091409e340 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.691+0000 7f0919717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091409f870 con 0x7f0914135f20 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 0x7f0914138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0912ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f091409d860 0x7f091409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50770/0 (socket says 172.21.15.125:50770) 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0912ffd700 1 -- 172.21.15.125:0/2068066796 learned_addr learned my addr 172.21.15.125:0/2068066796 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09127fc700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409e340 0x7f09141359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d4326700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 0x7f69cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0911ffb700 1 -- 172.21.15.125:0/2068066796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336631589 0 0) 0x7f091409aaa0 con 0x7f091409d860 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 -- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409e340 msgr2=0x7f09141359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409e340 0x7f09141359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 -- 172.21.15.125:0/2068066796 >> v1:172.21.15.125:6789/0 conn(0x7f091409d860 legacy=0x7f091409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d4326700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f69cc134120 0x7f69cc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d4326700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc09dc00 con 0x7f69cc0a1380 2023-10-03T10:15:26.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d4326700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc09ea60 con 0x7f69cc134120 2023-10-03T10:15:26.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d4326700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc09dec0 con 0x7f69cc0a0a70 2023-10-03T10:15:26.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 -- 172.21.15.125:0/2068066796 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091409b360 con 0x7f0914135f20 2023-10-03T10:15:26.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d20c2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 0x7f69cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d18c1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f69cc0a1380 0x7f69cc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50774/0 (socket says 172.21.15.125:50774) 2023-10-03T10:15:26.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d18c1700 1 -- 172.21.15.125:0/617587700 learned_addr learned my addr 172.21.15.125:0/617587700 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:26.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d28c3700 1 --2- 172.21.15.125:0/617587700 >> v2:172.21.15.125:3300/0 conn(0x7f69cc134120 0x7f69cc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f09137fe700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 0x7f0914138300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f090c009df0 tx=0x7f090c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97307a3582b591e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d20c2700 1 -- 172.21.15.125:0/617587700 >> v2:172.21.15.125:3300/0 conn(0x7f69cc134120 msgr2=0x7f69cc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d20c2700 1 --2- 172.21.15.125:0/617587700 >> v2:172.21.15.125:3300/0 conn(0x7f69cc134120 0x7f69cc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d20c2700 1 -- 172.21.15.125:0/617587700 >> v1:172.21.15.125:6789/0 conn(0x7f69cc0a1380 legacy=0x7f69cc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0911ffb700 1 -- 172.21.15.125:0/2068066796 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00e070 con 0x7f0914135f20 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0911ffb700 1 -- 172.21.15.125:0/2068066796 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00bae0 con 0x7f0914135f20 2023-10-03T10:15:26.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f0911ffb700 1 -- 172.21.15.125:0/2068066796 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00be90 con 0x7f0914135f20 2023-10-03T10:15:26.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.692+0000 7f69d20c2700 1 -- 172.21.15.125:0/617587700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc09e6a0 con 0x7f69cc0a0a70 2023-10-03T10:15:26.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d20c2700 1 --2- 172.21.15.125:0/617587700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 0x7f69cc0a0e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009840 tx=0x7f69c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60edbfadae0218e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d10c0700 1 -- 172.21.15.125:0/617587700 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8004230 con 0x7f69cc0a0a70 2023-10-03T10:15:26.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d10c0700 1 -- 172.21.15.125:0/617587700 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8004390 con 0x7f69cc0a0a70 2023-10-03T10:15:26.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d10c0700 1 -- 172.21.15.125:0/617587700 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80036a0 con 0x7f69cc0a0a70 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 -- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 msgr2=0x7f0914138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 0x7f0914138300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f090c009df0 tx=0x7f090c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 -- 172.21.15.125:0/2068066796 shutdown_connections 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0914135f20 0x7f0914138300 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 --2- 172.21.15.125:0/2068066796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409e340 0x7f09141359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 -- 172.21.15.125:0/2068066796 >> 172.21.15.125:0/2068066796 conn(0x7f0914099c40 msgr2=0x7f09140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 -- 172.21.15.125:0/2068066796 shutdown_connections 2023-10-03T10:15:26.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f0919717700 1 -- 172.21.15.125:0/2068066796 wait complete. 2023-10-03T10:15:26.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 -- 172.21.15.125:0/617587700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 msgr2=0x7f69cc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 --2- 172.21.15.125:0/617587700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 0x7f69cc0a0e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009840 tx=0x7f69c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 -- 172.21.15.125:0/617587700 shutdown_connections 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 --2- 172.21.15.125:0/617587700 >> v2:172.21.15.125:3300/0 conn(0x7f69cc134120 0x7f69cc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 --2- 172.21.15.125:0/617587700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a0a70 0x7f69cc0a0e40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.693+0000 7f69d4326700 1 -- 172.21.15.125:0/617587700 >> 172.21.15.125:0/617587700 conn(0x7f69cc0a6610 msgr2=0x7f69cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f69d4326700 1 -- 172.21.15.125:0/617587700 shutdown_connections 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f69d4326700 1 -- 172.21.15.125:0/617587700 wait complete. 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f69d4326700 1 Processor -- start 2023-10-03T10:15:26.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f0919717700 1 Processor -- start 2023-10-03T10:15:26.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f69d4326700 1 -- start start 2023-10-03T10:15:26.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.694+0000 7f0919717700 1 -- start start 2023-10-03T10:15:26.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 0x7f69cc1236f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 0x7f091411b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 0x7f69cc123c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 0x7f091411bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091409c8b0 con 0x7f0914135f20 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091411d470 con 0x7f091409d860 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0919717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0914071fc0 con 0x7f091409e340 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09127fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09127fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51104/0 (socket says 172.21.15.125:51104) 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09127fc700 1 -- 172.21.15.125:0/383966053 learned_addr learned my addr 172.21.15.125:0/383966053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:26.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f0912ffd700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 0x7f091411b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc125430 con 0x7f69cc0a0a70 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0a03e0 con 0x7f69cc0a1380 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d4326700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1232c0 con 0x7f69cc134120 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d18c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 0x7f69cc123c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51118/0 (socket says 172.21.15.125:51118) 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d18c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 0x7f69cc123c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47324/0 (socket says 172.21.15.125:47324) 2023-10-03T10:15:26.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 -- 172.21.15.125:0/1271594044 learned_addr learned my addr 172.21.15.125:0/1271594044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:26.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 0x7f091411bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d20c2700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 0x7f69cc1236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 -- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 msgr2=0x7f69cc123c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 0x7f69cc123c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 -- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 msgr2=0x7f69cc1236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 0x7f69cc1236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d28c3700 1 -- 172.21.15.125:0/1271594044 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80094a0 con 0x7f69cc134120 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f69d20c2700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 0x7f69cc1236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 -- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 msgr2=0x7f091411b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 -- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 msgr2=0x7f091411b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 0x7f091411b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.695+0000 7f09137fe700 1 -- 172.21.15.125:0/383966053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009a70 con 0x7f0914135f20 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f0912ffd700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 0x7f091411b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f09127fc700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69d28c3700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b6d0 tx=0x7f69c400b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f09137fe700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 0x7f091411bdb0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f09140729f0 tx=0x7f090c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c004610 con 0x7f0914135f20 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4019070 con 0x7f69cc134120 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4007540 con 0x7f69cc134120 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc126030 con 0x7f69cc134120 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c020070 con 0x7f0914135f20 2023-10-03T10:15:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c027480 con 0x7f0914135f20 2023-10-03T10:15:26.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c40078d0 con 0x7f69cc134120 2023-10-03T10:15:26.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091411e530 con 0x7f0914135f20 2023-10-03T10:15:26.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091411d680 con 0x7f0914135f20 2023-10-03T10:15:26.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.696+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc126cd0 con 0x7f69cc134120 2023-10-03T10:15:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.697+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091411e720 con 0x7f0914135f20 2023-10-03T10:15:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.697+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69c4007a30 con 0x7f69cc134120 2023-10-03T10:15:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.697+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f090c012430 con 0x7f0914135f20 2023-10-03T10:15:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.697+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc074f10 con 0x7f69cc134120 2023-10-03T10:15:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.698+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f090c022070 con 0x7f0914135f20 2023-10-03T10:15:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.698+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f69c4047a30 con 0x7f69cc134120 2023-10-03T10:15:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.702+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f090c01b400 con 0x7f0914135f20 2023-10-03T10:15:26.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.702+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69c40268d0 con 0x7f69cc134120 2023-10-03T10:15:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.907+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69cc04f2a0 con 0x7f69cc134120 2023-10-03T10:15:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.907+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f091404f2a0 con 0x7f0914135f20 2023-10-03T10:15:26.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.907+0000 7f69c2ffd700 1 -- 172.21.15.125:0/1271594044 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69c4022070 con 0x7f69cc134120 2023-10-03T10:15:26.908 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:26.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.907+0000 7f08fb7fe700 1 -- 172.21.15.125:0/383966053 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f090c011390 con 0x7f0914135f20 2023-10-03T10:15:26.908 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:26.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 msgr2=0x7f69cc1c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b6d0 tx=0x7f69c400b9e0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 msgr2=0x7f091411bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 shutdown_connections 2023-10-03T10:15:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f69cc134120 0x7f69cc1c8440 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 0x7f091411bdb0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f09140729f0 tx=0x7f090c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69cc0a0a70 0x7f69cc1236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 --2- 172.21.15.125:0/1271594044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69cc0a1380 0x7f69cc123c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 >> 172.21.15.125:0/1271594044 conn(0x7f69cc0a6610 msgr2=0x7f69cc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 shutdown_connections 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0914135f20 0x7f091411bdb0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f091409d860 0x7f091411b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 --2- 172.21.15.125:0/383966053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f091409e340 0x7f091411b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 >> 172.21.15.125:0/383966053 conn(0x7f0914099c40 msgr2=0x7f0914132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 shutdown_connections 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 shutdown_connections 2023-10-03T10:15:26.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f0919717700 1 -- 172.21.15.125:0/383966053 wait complete. 2023-10-03T10:15:26.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:26.909+0000 7f69d4326700 1 -- 172.21.15.125:0/1271594044 wait complete. 2023-10-03T10:15:26.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:26.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:27.490 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:27.528 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.620+0000 7f9b1be3e700 1 Processor -- start 2023-10-03T10:15:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 -- start start 2023-10-03T10:15:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 0x7f9b140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 0x7f9b14133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1409dc00 con 0x7f9b14133f50 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1409ea60 con 0x7f9b140a1380 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1be3e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1409dec0 con 0x7f9b140a0a70 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b193d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 0x7f9b14133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b19bda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 0x7f9b140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1a3db700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9b14133f50 0x7f9b1413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50782/0 (socket says 172.21.15.125:50782) 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.621+0000 7f9b1a3db700 1 -- 172.21.15.125:0/2075743325 learned_addr learned my addr 172.21.15.125:0/2075743325 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b18bd8700 1 -- 172.21.15.125:0/2075743325 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715497102 0 0) 0x7f9b1409dc00 con 0x7f9b14133f50 2023-10-03T10:15:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b193d9700 1 -- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 msgr2=0x7f9b140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b193d9700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 0x7f9b140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b193d9700 1 -- 172.21.15.125:0/2075743325 >> v1:172.21.15.125:6789/0 conn(0x7f9b14133f50 legacy=0x7f9b1413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b193d9700 1 -- 172.21.15.125:0/2075743325 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1409e6a0 con 0x7f9b140a1380 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b19bda700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 0x7f9b140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b193d9700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 0x7f9b14133a10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009870 tx=0x7f9b04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e7d4e78ef62017f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b18bd8700 1 -- 172.21.15.125:0/2075743325 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011830 con 0x7f9b140a1380 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b18bd8700 1 -- 172.21.15.125:0/2075743325 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011990 con 0x7f9b140a1380 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.622+0000 7f9b18bd8700 1 -- 172.21.15.125:0/2075743325 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011d20 con 0x7f9b140a1380 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 msgr2=0x7f9b14133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 0x7f9b14133a10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009870 tx=0x7f9b04009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2075743325 shutdown_connections 2023-10-03T10:15:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a0a70 0x7f9b140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2075743325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b140a1380 0x7f9b14133a10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2075743325 >> 172.21.15.125:0/2075743325 conn(0x7f9b140a6610 msgr2=0x7f9b140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2075743325 shutdown_connections 2023-10-03T10:15:27.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.623+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2075743325 wait complete. 2023-10-03T10:15:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 Processor -- start 2023-10-03T10:15:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 -- start start 2023-10-03T10:15:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 0x7f9b141c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14124fa0 con 0x7f9b140a0a70 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14126370 con 0x7f9b14133f50 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1be3e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141246b0 con 0x7f9b140a1380 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b19bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b193d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b19bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45542/0 (socket says 172.21.15.125:45542) 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b193d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51128/0 (socket says 172.21.15.125:51128) 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b19bda700 1 -- 172.21.15.125:0/2844903340 learned_addr learned my addr 172.21.15.125:0/2844903340 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.624+0000 7f9b1a3db700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 0x7f9b141c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 -- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 msgr2=0x7f9b141c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 -- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 msgr2=0x7f9b141c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 -- 172.21.15.125:0/2844903340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100094a0 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b19bda700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b193d9700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1a3db700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 0x7f9b141c8d50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00cbe0 tx=0x7f9b0c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c00aa40 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00abc0 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040094a0 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0070d0 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.625+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b140a03e0 con 0x7f9b14133f50 2023-10-03T10:15:27.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.626+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b0c007230 con 0x7f9b14133f50 2023-10-03T10:15:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.626+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b0c03f3d0 con 0x7f9b14133f50 2023-10-03T10:15:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.626+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b141253e0 con 0x7f9b14133f50 2023-10-03T10:15:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.631+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b0c0074e0 con 0x7f9b14133f50 2023-10-03T10:15:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.659+0000 7faa648b3700 1 Processor -- start 2023-10-03T10:15:27.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.659+0000 7faa648b3700 1 -- start start 2023-10-03T10:15:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa648b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa6009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa648b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa6009f180 0x7faa60133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa648b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6009fa00 con 0x7faa60134160 2023-10-03T10:15:27.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa648b3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa600a0370 con 0x7faa6009f180 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa648b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6006bec0 con 0x7faa6009e870 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa6009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa6009f180 0x7faa60133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa6009f180 0x7faa60133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45556/0 (socket says 172.21.15.125:45556) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa6009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47348/0 (socket says 172.21.15.125:47348) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 -- 172.21.15.125:0/3548304497 learned_addr learned my addr 172.21.15.125:0/3548304497 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5ed9d700 1 --1- 172.21.15.125:0/3548304497 >> v1:172.21.15.125:6789/0 conn(0x7faa60134160 0x7faa6013ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50784/0 (socket says 172.21.15.125:50784) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 -- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 msgr2=0x7faa6009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 --2- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa6009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 -- 172.21.15.125:0/3548304497 >> v1:172.21.15.125:6789/0 conn(0x7faa60134160 legacy=0x7faa6013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5dd9b700 1 -- 172.21.15.125:0/3548304497 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6009ada0 con 0x7faa6009f180 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.660+0000 7faa5d59a700 1 -- 172.21.15.125:0/3548304497 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47118779 0 0) 0x7faa6009fa00 con 0x7faa60134160 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa5dd9b700 1 --2- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6009f180 0x7faa60133c20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faa540098f0 tx=0x7faa54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20f576db230082b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa5d59a700 1 -- 172.21.15.125:0/3548304497 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54011830 con 0x7faa6009f180 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa5d59a700 1 -- 172.21.15.125:0/3548304497 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa54011990 con 0x7faa6009f180 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa5d59a700 1 -- 172.21.15.125:0/3548304497 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54011d20 con 0x7faa6009f180 2023-10-03T10:15:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 -- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6009f180 msgr2=0x7faa60133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 --2- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6009f180 0x7faa60133c20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faa540098f0 tx=0x7faa54009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 -- 172.21.15.125:0/3548304497 shutdown_connections 2023-10-03T10:15:27.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 --2- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa6009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 --2- 172.21.15.125:0/3548304497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6009f180 0x7faa60133c20 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 -- 172.21.15.125:0/3548304497 >> 172.21.15.125:0/3548304497 conn(0x7faa600a4430 msgr2=0x7faa600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.661+0000 7faa648b3700 1 -- 172.21.15.125:0/3548304497 shutdown_connections 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.662+0000 7faa648b3700 1 -- 172.21.15.125:0/3548304497 wait complete. 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.662+0000 7faa648b3700 1 Processor -- start 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 -- start start 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa601228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 0x7faa60123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601334f0 con 0x7faa60134160 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa60125c90 con 0x7faa6009e870 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa648b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa60123d50 con 0x7faa6009f180 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 0x7faa60123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51140/0 (socket says 172.21.15.125:51140) 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 -- 172.21.15.125:0/837758650 learned_addr learned my addr 172.21.15.125:0/837758650 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5e59c700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa601228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 -- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 msgr2=0x7faa601228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa601228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 -- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 msgr2=0x7faa60123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 0x7faa60123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5dd9b700 1 -- 172.21.15.125:0/837758650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009550 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5e59c700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa601228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.663+0000 7faa5ed9d700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 0x7faa60123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa5dd9b700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa54009c40 tx=0x7faa54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54004550 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa540036a0 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa601338a0 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54003a30 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.664+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6006cfa0 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.665+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa54021070 con 0x7faa6009f180 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.665+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa60126050 con 0x7faa6009f180 2023-10-03T10:15:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.665+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa54040a80 con 0x7faa6009f180 2023-10-03T10:15:27.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.669+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa5400b7a0 con 0x7faa6009f180 2023-10-03T10:15:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.824+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b1404f2a0 con 0x7f9b14133f50 2023-10-03T10:15:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.825+0000 7f9b0a7fc700 1 -- 172.21.15.125:0/2844903340 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b0c018020 con 0x7f9b14133f50 2023-10-03T10:15:27.825 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:27.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 msgr2=0x7f9b141c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 0x7f9b141c8d50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00cbe0 tx=0x7f9b0c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 shutdown_connections 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b14133f50 0x7f9b141c8d50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b140a0a70 0x7f9b141c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 --2- 172.21.15.125:0/2844903340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9b140a1380 0x7f9b141c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 >> 172.21.15.125:0/2844903340 conn(0x7f9b140a6610 msgr2=0x7f9b140a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 shutdown_connections 2023-10-03T10:15:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.827+0000 7f9b1be3e700 1 -- 172.21.15.125:0/2844903340 wait complete. 2023-10-03T10:15:27.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.861+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa601338a0 con 0x7faa6009f180 2023-10-03T10:15:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.861+0000 7faa4effd700 1 -- 172.21.15.125:0/837758650 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa601338a0 con 0x7faa6009f180 2023-10-03T10:15:27.861 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 msgr2=0x7faa60122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa54009c40 tx=0x7faa54004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 shutdown_connections 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa60134160 0x7faa60123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6009e870 0x7faa601228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 --2- 172.21.15.125:0/837758650 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa6009f180 0x7faa60122e30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 >> 172.21.15.125:0/837758650 conn(0x7faa600a4430 msgr2=0x7faa600a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 shutdown_connections 2023-10-03T10:15:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:27.863+0000 7faa648b3700 1 -- 172.21.15.125:0/837758650 wait complete. 2023-10-03T10:15:27.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:27.924 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:27.925 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:28.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.048+0000 7f4e5d3bc700 1 Processor -- start 2023-10-03T10:15:28.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.048+0000 7f292248e700 1 Processor -- start 2023-10-03T10:15:28.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.048+0000 7f292248e700 1 -- start start 2023-10-03T10:15:28.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.048+0000 7f4e5d3bc700 1 -- start start 2023-10-03T10:15:28.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e5809e170 0x7f4e581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f291c09e870 0x7f291c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e58130ce0 0x7f4e58131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5809aaa0 con 0x7f4e5809e170 2023-10-03T10:15:28.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5809f870 con 0x7f4e5809d860 2023-10-03T10:15:28.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e5d3bc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5809b360 con 0x7f4e58130ce0 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0a0920 con 0x7f291c09e870 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c09c970 con 0x7f291c131d70 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f292248e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291c09bab0 con 0x7f291c09f180 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e56ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47368/0 (socket says 172.21.15.125:47368) 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e56ffd700 1 -- 172.21.15.125:0/1008584759 learned_addr learned my addr 172.21.15.125:0/1008584759 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e577fe700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e58130ce0 0x7f4e58131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f2920a2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51152/0 (socket says 172.21.15.125:51152) 2023-10-03T10:15:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f291b7fe700 1 -- 172.21.15.125:0/880282630 learned_addr learned my addr 172.21.15.125:0/880282630 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f291bfff700 1 --2- 172.21.15.125:0/880282630 >> v2:172.21.15.125:3300/0 conn(0x7f291c09e870 0x7f291c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.049+0000 7f4e567fc700 1 --2- 172.21.15.125:0/1008584759 >> v2:172.21.15.125:3300/0 conn(0x7f4e5809e170 0x7f4e581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 -- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e58130ce0 msgr2=0x7f4e58131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e58130ce0 0x7f4e58131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 -- 172.21.15.125:0/1008584759 >> v2:172.21.15.125:3300/0 conn(0x7f4e5809e170 msgr2=0x7f4e581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 --2- 172.21.15.125:0/1008584759 >> v2:172.21.15.125:3300/0 conn(0x7f4e5809e170 0x7f4e581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 -- 172.21.15.125:0/1008584759 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5809b620 con 0x7f4e5809d860 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 -- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 msgr2=0x7f291c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 --2- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 -- 172.21.15.125:0/880282630 >> v2:172.21.15.125:3300/0 conn(0x7f291c09e870 msgr2=0x7f291c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 --2- 172.21.15.125:0/880282630 >> v2:172.21.15.125:3300/0 conn(0x7f291c09e870 0x7f291c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 -- 172.21.15.125:0/880282630 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c09f9c0 con 0x7f291c131d70 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f2920a2b700 1 --2- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c1321f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f291400f3a0 tx=0x7f291400f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e1172e43eff18f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e56ffd700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009920 tx=0x7f4e48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=109f9882f92d7192 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f291affd700 1 -- 172.21.15.125:0/880282630 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914012070 con 0x7f291c131d70 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f291affd700 1 -- 172.21.15.125:0/880282630 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400fe60 con 0x7f291c131d70 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f291affd700 1 -- 172.21.15.125:0/880282630 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400d310 con 0x7f291c131d70 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e55ffb700 1 -- 172.21.15.125:0/1008584759 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48011830 con 0x7f4e5809d860 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e55ffb700 1 -- 172.21.15.125:0/1008584759 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e48011990 con 0x7f4e5809d860 2023-10-03T10:15:28.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.050+0000 7f4e55ffb700 1 -- 172.21.15.125:0/1008584759 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48011d20 con 0x7f4e5809d860 2023-10-03T10:15:28.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 -- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 msgr2=0x7f291c1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 --2- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c1321f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f291400f3a0 tx=0x7f291400f6b0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 msgr2=0x7f4e5809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009920 tx=0x7f4e48009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/1008584759 shutdown_connections 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e5809d860 0x7f4e5809dc30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/1008584759 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e58130ce0 0x7f4e58131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/1008584759 >> v2:172.21.15.125:3300/0 conn(0x7f4e5809e170 0x7f4e581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 -- 172.21.15.125:0/880282630 shutdown_connections 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/1008584759 >> 172.21.15.125:0/1008584759 conn(0x7f4e58099c40 msgr2=0x7f4e580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 --2- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c1321f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 --2- 172.21.15.125:0/880282630 >> v2:172.21.15.125:3300/0 conn(0x7f291c09e870 0x7f291c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 --2- 172.21.15.125:0/880282630 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 -- 172.21.15.125:0/880282630 >> 172.21.15.125:0/880282630 conn(0x7f291c0a4430 msgr2=0x7f291c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/1008584759 shutdown_connections 2023-10-03T10:15:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/1008584759 wait complete. 2023-10-03T10:15:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 -- 172.21.15.125:0/880282630 shutdown_connections 2023-10-03T10:15:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.051+0000 7f292248e700 1 -- 172.21.15.125:0/880282630 wait complete. 2023-10-03T10:15:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 Processor -- start 2023-10-03T10:15:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 -- start start 2023-10-03T10:15:28.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f4e5d3bc700 1 Processor -- start 2023-10-03T10:15:28.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f4e5d3bc700 1 -- start start 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f291c09e870 0x7f291c11ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c11f310 con 0x7f291c09e870 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c11ca40 con 0x7f291c131d70 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f292248e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291c11d060 con 0x7f291c09f180 2023-10-03T10:15:28.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f2920a2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.052+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2920a2b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47382/0 (socket says 172.21.15.125:47382) 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51160/0 (socket says 172.21.15.125:51160) 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2920a2b700 1 -- 172.21.15.125:0/3619297467 learned_addr learned my addr 172.21.15.125:0/3619297467 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 -- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 msgr2=0x7f291c11b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 -- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f291c09e870 msgr2=0x7f291c11ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f291c09e870 0x7f291c11ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 -- 172.21.15.125:0/3619297467 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291400f050 con 0x7f291c09f180 2023-10-03T10:15:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2920a2b700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e5809d860 0x7f4e581c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 0x7f4e581c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5811bb40 con 0x7f4e5809e170 2023-10-03T10:15:28.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581371a0 con 0x7f4e58130ce0 2023-10-03T10:15:28.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e5d3bc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581c2a50 con 0x7f4e5809d860 2023-10-03T10:15:28.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f291b7fe700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f291000e940 tx=0x7f291000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45622/0 (socket says 172.21.15.125:45622) 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 -- 172.21.15.125:0/2735860441 learned_addr learned my addr 172.21.15.125:0/2735860441 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e577fe700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 0x7f4e581c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e56ffd700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e5809d860 0x7f4e581c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000ee90 con 0x7f291c09f180 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 -- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e5809d860 msgr2=0x7f4e581c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e5809d860 0x7f4e581c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 -- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 msgr2=0x7f4e581c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 0x7f4e581c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f4e567fc700 1 -- 172.21.15.125:0/2735860441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009550 con 0x7f4e5809e170 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e577fe700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 0x7f4e581c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:28.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000c850 con 0x7f291c09f180 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000cbe0 con 0x7f291c09f180 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c11dc90 con 0x7f291c09f180 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.053+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c11e6c0 con 0x7f291c09f180 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e567fc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00e900 tx=0x7f4e4c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ee50 con 0x7f4e5809e170 2023-10-03T10:15:28.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00c850 con 0x7f4e5809e170 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00cbe0 con 0x7f4e5809e170 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5811b080 con 0x7f4e5809e170 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581c3990 con 0x7f4e5809e170 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f291000cd40 con 0x7f291c09f180 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.054+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f291003f900 con 0x7f291c09f180 2023-10-03T10:15:28.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.055+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c11e6c0 con 0x7f291c09f180 2023-10-03T10:15:28.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.055+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5811b980 con 0x7f4e5809e170 2023-10-03T10:15:28.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.055+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e4c00cd40 con 0x7f4e5809e170 2023-10-03T10:15:28.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.056+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e4c03faa0 con 0x7f4e5809e170 2023-10-03T10:15:28.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.059+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f291c11e6c0 con 0x7f291c09f180 2023-10-03T10:15:28.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.060+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e4c011db0 con 0x7f4e5809e170 2023-10-03T10:15:28.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.265+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f291c11e6c0 con 0x7f291c09f180 2023-10-03T10:15:28.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.265+0000 7f2918ff9700 1 -- 172.21.15.125:0/3619297467 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f291c11e6c0 con 0x7f291c09f180 2023-10-03T10:15:28.265 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 msgr2=0x7f291c11b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f291000e940 tx=0x7f291000ec50 comp rx=0 tx=0).stop 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 shutdown_connections 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f291c131d70 0x7f291c11b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f291c09e870 0x7f291c11ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 --2- 172.21.15.125:0/3619297467 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f291c09f180 0x7f291c11b370 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 >> 172.21.15.125:0/3619297467 conn(0x7f291c0a4430 msgr2=0x7f291c12fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 shutdown_connections 2023-10-03T10:15:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f292248e700 1 -- 172.21.15.125:0/3619297467 wait complete. 2023-10-03T10:15:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.267+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e5804f2a0 con 0x7f4e5809e170 2023-10-03T10:15:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.268+0000 7f4e3f7fe700 1 -- 172.21.15.125:0/2735860441 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e4c021020 con 0x7f4e5809e170 2023-10-03T10:15:28.269 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:28.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 msgr2=0x7f4e581c3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00e900 tx=0x7f4e4c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:28.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 shutdown_connections 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e58130ce0 0x7f4e581c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e5809d860 0x7f4e581c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 --2- 172.21.15.125:0/2735860441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e5809e170 0x7f4e581c3450 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 >> 172.21.15.125:0/2735860441 conn(0x7f4e58099c40 msgr2=0x7f4e580a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 shutdown_connections 2023-10-03T10:15:28.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.270+0000 7f4e5d3bc700 1 -- 172.21.15.125:0/2735860441 wait complete. 2023-10-03T10:15:28.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:28.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:28.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:28.876 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:28.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.968+0000 7f90901fb700 1 Processor -- start 2023-10-03T10:15:28.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.968+0000 7f90901fb700 1 -- start start 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f90901fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f90880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f90901fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9088134120 0x7f908813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f90901fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908809dc00 con 0x7f90880a1380 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f90901fb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908809ea60 con 0x7f9088134120 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f90901fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f908809dec0 con 0x7f90880a0a70 2023-10-03T10:15:28.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9088134120 0x7f908813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908df97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f90880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9088134120 0x7f908813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45624/0 (socket says 172.21.15.125:45624) 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 -- 172.21.15.125:0/1512673511 learned_addr learned my addr 172.21.15.125:0/1512673511 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908d796700 1 --1- 172.21.15.125:0/1512673511 >> v1:172.21.15.125:6789/0 conn(0x7f90880a1380 0x7f9088133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50786/0 (socket says 172.21.15.125:50786) 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 -- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 msgr2=0x7f90880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f90880a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 -- 172.21.15.125:0/1512673511 >> v1:172.21.15.125:6789/0 conn(0x7f90880a1380 legacy=0x7f9088133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908e798700 1 -- 172.21.15.125:0/1512673511 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908809e6a0 con 0x7f9088134120 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908cf95700 1 -- 172.21.15.125:0/1512673511 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626694968 0 0) 0x7f908809dc00 con 0x7f90880a1380 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.969+0000 7f908df97700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f90880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f908e798700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9088134120 0x7f908813bce0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e50 tx=0x7f908000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced9fa71562dddfa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f908cf95700 1 -- 172.21.15.125:0/1512673511 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000e070 con 0x7f9088134120 2023-10-03T10:15:28.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f908cf95700 1 -- 172.21.15.125:0/1512673511 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000b910 con 0x7f9088134120 2023-10-03T10:15:28.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f908cf95700 1 -- 172.21.15.125:0/1512673511 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000bcc0 con 0x7f9088134120 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 -- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9088134120 msgr2=0x7f908813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9088134120 0x7f908813bce0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e50 tx=0x7f908000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 -- 172.21.15.125:0/1512673511 shutdown_connections 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9088134120 0x7f908813bce0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 --2- 172.21.15.125:0/1512673511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f90880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 -- 172.21.15.125:0/1512673511 >> 172.21.15.125:0/1512673511 conn(0x7f90880a6610 msgr2=0x7f90880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 -- 172.21.15.125:0/1512673511 shutdown_connections 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.970+0000 7f90901fb700 1 -- 172.21.15.125:0/1512673511 wait complete. 2023-10-03T10:15:28.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.971+0000 7f90901fb700 1 Processor -- start 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.971+0000 7f90901fb700 1 -- start start 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f9088122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9088134120 0x7f90881231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881332b0 con 0x7f90880a1380 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90881258b0 con 0x7f9088134120 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f90901fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90881242c0 con 0x7f90880a0a70 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908df97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f9088122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45636/0 (socket says 172.21.15.125:45636) 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 -- 172.21.15.125:0/1931536602 learned_addr learned my addr 172.21.15.125:0/1931536602 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908e798700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9088134120 0x7f90881231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 -- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 msgr2=0x7f9088122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f9088122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 -- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9088134120 msgr2=0x7f90881231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9088134120 0x7f90881231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 -- 172.21.15.125:0/1931536602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840094a0 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908df97700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f9088122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f908d796700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f907800c520 tx=0x7f907800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.972+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078004c80 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078004de0 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078007310 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9080009b30 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9088125c30 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908804f2a0 con 0x7f90880a1380 2023-10-03T10:15:28.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.973+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9078007470 con 0x7f90880a1380 2023-10-03T10:15:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.974+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f907803f250 con 0x7f90880a1380 2023-10-03T10:15:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:28.978+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90780133c0 con 0x7f90880a1380 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.009+0000 7fd772290700 1 Processor -- start 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.009+0000 7fd772290700 1 -- start start 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd772290700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd772290700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd772290700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c06b2d0 con 0x7fd76c133ad0 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd772290700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c1345b0 con 0x7fd76c139280 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd772290700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c133610 con 0x7fd76c136960 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd77082d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd77082d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45644/0 (socket says 172.21.15.125:45644) 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51184/0 (socket says 172.21.15.125:51184) 2023-10-03T10:15:29.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd77082d700 1 -- 172.21.15.125:0/340951049 learned_addr learned my addr 172.21.15.125:0/340951049 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76bfff700 1 --1- 172.21.15.125:0/340951049 >> v1:172.21.15.125:6789/0 conn(0x7fd76c133ad0 0x7fd76c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50790/0 (socket says 172.21.15.125:50790) 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 -- 172.21.15.125:0/340951049 >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 msgr2=0x7fd76c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 --2- 172.21.15.125:0/340951049 >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 -- 172.21.15.125:0/340951049 >> v1:172.21.15.125:6789/0 conn(0x7fd76c133ad0 legacy=0x7fd76c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76affd700 1 -- 172.21.15.125:0/340951049 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715492982 0 0) 0x7fd76c06b2d0 con 0x7fd76c133ad0 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd76b7fe700 1 -- 172.21.15.125:0/340951049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c09a500 con 0x7fd76c136960 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.010+0000 7fd77082d700 1 --2- 172.21.15.125:0/340951049 >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd76b7fe700 1 --2- 172.21.15.125:0/340951049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd760009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e8905a551b890e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd76affd700 1 -- 172.21.15.125:0/340951049 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760011830 con 0x7fd76c136960 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd76affd700 1 -- 172.21.15.125:0/340951049 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760011990 con 0x7fd76c136960 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd76affd700 1 -- 172.21.15.125:0/340951049 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760011d20 con 0x7fd76c136960 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 -- 172.21.15.125:0/340951049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 msgr2=0x7fd76c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 --2- 172.21.15.125:0/340951049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd760009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 -- 172.21.15.125:0/340951049 shutdown_connections 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 --2- 172.21.15.125:0/340951049 >> v2:172.21.15.125:3300/0 conn(0x7fd76c139280 0x7fd76c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 --2- 172.21.15.125:0/340951049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c136960 0x7fd76c138d40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 -- 172.21.15.125:0/340951049 >> 172.21.15.125:0/340951049 conn(0x7fd76c099c40 msgr2=0x7fd76c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 -- 172.21.15.125:0/340951049 shutdown_connections 2023-10-03T10:15:29.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.011+0000 7fd772290700 1 -- 172.21.15.125:0/340951049 wait complete. 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.012+0000 7fd772290700 1 Processor -- start 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.012+0000 7fd772290700 1 -- start start 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd76c133ad0 0x7fd76c071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 0x7fd76c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1303b0 con 0x7fd76c136960 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c09f390 con 0x7fd76c133ad0 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd772290700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c130b60 con 0x7fd76c139280 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 0x7fd76c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 0x7fd76c071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45646/0 (socket says 172.21.15.125:45646) 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51188/0 (socket says 172.21.15.125:51188) 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd76b7fe700 1 -- 172.21.15.125:0/1500549119 learned_addr learned my addr 172.21.15.125:0/1500549119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd76bfff700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd76c133ad0 0x7fd76c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 -- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd76c133ad0 msgr2=0x7fd76c071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd76c133ad0 0x7fd76c071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 -- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 msgr2=0x7fd76c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 0x7fd76c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 -- 172.21.15.125:0/1500549119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764009b30 con 0x7fd76c139280 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd77082d700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd76c09f6c0 tx=0x7fd76400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.013+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764018070 con 0x7fd76c139280 2023-10-03T10:15:29.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.014+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400f040 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.014+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600094a0 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.014+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764003c60 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.014+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c070d70 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.015+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd76400c810 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.015+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c04f2a0 con 0x7fd76c139280 2023-10-03T10:15:29.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.015+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd76403f710 con 0x7fd76c139280 2023-10-03T10:15:29.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.019+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd76401cd90 con 0x7fd76c139280 2023-10-03T10:15:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.173+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9088072980 con 0x7f90880a1380 2023-10-03T10:15:29.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.174+0000 7f907e7fc700 1 -- 172.21.15.125:0/1931536602 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9078011360 con 0x7f90880a1380 2023-10-03T10:15:29.174 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:29.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 msgr2=0x7f9088122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f907800c520 tx=0x7f907800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:29.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 shutdown_connections 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9088134120 0x7f90881231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90880a0a70 0x7f9088122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 --2- 172.21.15.125:0/1931536602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90880a1380 0x7f9088122c90 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 >> 172.21.15.125:0/1931536602 conn(0x7f90880a6610 msgr2=0x7f908811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 shutdown_connections 2023-10-03T10:15:29.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.176+0000 7f90901fb700 1 -- 172.21.15.125:0/1931536602 wait complete. 2023-10-03T10:15:29.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:29.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.212+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd76c09f0f0 con 0x7fd76c139280 2023-10-03T10:15:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.212+0000 7fd768ff9700 1 -- 172.21.15.125:0/1500549119 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd76401de00 con 0x7fd76c139280 2023-10-03T10:15:29.213 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:29.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.214+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 msgr2=0x7fd76c1c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.214+0000 7fd772290700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd76c09f6c0 tx=0x7fd76400ef90 comp rx=0 tx=0).stop 2023-10-03T10:15:29.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 shutdown_connections 2023-10-03T10:15:29.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd76c139280 0x7fd76c1c8470 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd76c133ad0 0x7fd76c071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 --2- 172.21.15.125:0/1500549119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd76c136960 0x7fd76c071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 >> 172.21.15.125:0/1500549119 conn(0x7fd76c099c40 msgr2=0x7fd76c137150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 shutdown_connections 2023-10-03T10:15:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.215+0000 7fd772290700 1 -- 172.21.15.125:0/1500549119 wait complete. 2023-10-03T10:15:29.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:29.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:29.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:29.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.407+0000 7f27766cc700 1 Processor -- start 2023-10-03T10:15:29.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.407+0000 7f5c85745700 1 Processor -- start 2023-10-03T10:15:29.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.407+0000 7f5c85745700 1 -- start start 2023-10-03T10:15:29.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.407+0000 7f27766cc700 1 -- start start 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8006b2d0 con 0x7f5c801309f0 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80133610 con 0x7f5c80133ad0 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c85745700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8009a500 con 0x7f5c801300a0 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45652/0 (socket says 172.21.15.125:45652) 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7f7fe700 1 -- 172.21.15.125:0/1294243979 learned_addr learned my addr 172.21.15.125:0/1294243979 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51190/0 (socket says 172.21.15.125:51190) 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f27766cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 0x7f2770133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f27766cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 0x7f27701343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f27766cc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277009b110 con 0x7f27700a0a70 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f27766cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27700a3b60 con 0x7f2770133f70 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f27766cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27701348e0 con 0x7f277009ad40 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 0x7f27701343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f2774c69700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f27700a0a70 0x7f27700a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50800/0 (socket says 172.21.15.125:50800) 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f2774c69700 1 -- 172.21.15.125:0/2713020844 learned_addr learned my addr 172.21.15.125:0/2713020844 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 -- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 msgr2=0x7f5c80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f276ffff700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 0x7f2770133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c80133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 -- 172.21.15.125:0/1294243979 >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 msgr2=0x7f5c8013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 --2- 172.21.15.125:0/1294243979 >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 -- 172.21.15.125:0/1294243979 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c801338b0 con 0x7f5c801300a0 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7effd700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7f7fe700 1 --2- 172.21.15.125:0/1294243979 >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.408+0000 7f5c7e7fc700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5c74013150 tx=0x7f5c74013460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74521bef24091fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276effd700 1 -- 172.21.15.125:0/2713020844 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814634292 0 0) 0x7f277009b110 con 0x7f27700a0a70 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276ffff700 1 -- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 msgr2=0x7f27701343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276ffff700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 0x7f27701343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276ffff700 1 -- 172.21.15.125:0/2713020844 >> v1:172.21.15.125:6789/0 conn(0x7f27700a0a70 legacy=0x7f27700a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276ffff700 1 -- 172.21.15.125:0/2713020844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700a2fa0 con 0x7f277009ad40 2023-10-03T10:15:29.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276f7fe700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 0x7f27701343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f5c7dffb700 1 -- 172.21.15.125:0/1294243979 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74016070 con 0x7f5c801300a0 2023-10-03T10:15:29.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276ffff700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 0x7f2770133a30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2760009870 tx=0x7f2760009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ceb130de6b46dd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f5c7dffb700 1 -- 172.21.15.125:0/1294243979 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74013d10 con 0x7f5c801300a0 2023-10-03T10:15:29.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f5c7dffb700 1 -- 172.21.15.125:0/1294243979 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740112f0 con 0x7f5c801300a0 2023-10-03T10:15:29.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276effd700 1 -- 172.21.15.125:0/2713020844 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760011830 con 0x7f277009ad40 2023-10-03T10:15:29.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276effd700 1 -- 172.21.15.125:0/2713020844 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760011990 con 0x7f277009ad40 2023-10-03T10:15:29.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f276effd700 1 -- 172.21.15.125:0/2713020844 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760011d20 con 0x7f277009ad40 2023-10-03T10:15:29.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f5c85745700 1 -- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 msgr2=0x7f5c801304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.409+0000 7f5c85745700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5c74013150 tx=0x7f5c74013460 comp rx=0 tx=0).stop 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 -- 172.21.15.125:0/1294243979 shutdown_connections 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 -- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 msgr2=0x7f2770133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 --2- 172.21.15.125:0/1294243979 >> v2:172.21.15.125:3300/0 conn(0x7f5c801309f0 0x7f5c8013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 --2- 172.21.15.125:0/1294243979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801300a0 0x7f5c801304b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 -- 172.21.15.125:0/1294243979 >> 172.21.15.125:0/1294243979 conn(0x7f5c80099c40 msgr2=0x7f5c800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 0x7f2770133a30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2760009870 tx=0x7f2760009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 -- 172.21.15.125:0/2713020844 shutdown_connections 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f277009ad40 0x7f2770133a30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 --2- 172.21.15.125:0/2713020844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2770133f70 0x7f27701343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 -- 172.21.15.125:0/2713020844 >> 172.21.15.125:0/2713020844 conn(0x7f2770099c40 msgr2=0x7f277006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 -- 172.21.15.125:0/1294243979 shutdown_connections 2023-10-03T10:15:29.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 -- 172.21.15.125:0/2713020844 shutdown_connections 2023-10-03T10:15:29.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f5c85745700 1 -- 172.21.15.125:0/1294243979 wait complete. 2023-10-03T10:15:29.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.410+0000 7f27766cc700 1 -- 172.21.15.125:0/2713020844 wait complete. 2023-10-03T10:15:29.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 Processor -- start 2023-10-03T10:15:29.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 Processor -- start 2023-10-03T10:15:29.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 -- start start 2023-10-03T10:15:29.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 -- start start 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801309f0 0x7f5c8012a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c8012abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8012bb60 con 0x7f5c801300a0 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8012b5f0 con 0x7f5c80133ad0 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c85745700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8012b930 con 0x7f5c801309f0 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45660/0 (socket says 172.21.15.125:45660) 2023-10-03T10:15:29.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c7effd700 1 -- 172.21.15.125:0/4237522566 learned_addr learned my addr 172.21.15.125:0/4237522566 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:29.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 0x7f27701c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f5c7e7fc700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801309f0 0x7f5c8012a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2770133f70 0x7f277011ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770121fe0 con 0x7f27700a0a70 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277009e6a0 con 0x7f277009ad40 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f27766cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f277009c7e0 con 0x7f2770133f70 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f276ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f276ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47452/0 (socket says 172.21.15.125:47452) 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f276ffff700 1 -- 172.21.15.125:0/899428528 learned_addr learned my addr 172.21.15.125:0/899428528 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f276f7fe700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 0x7f27701c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.411+0000 7f2774c69700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2770133f70 0x7f277011ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7f7fe700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c8012abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 -- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801309f0 msgr2=0x7f5c8012a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801309f0 0x7f5c8012a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 -- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 msgr2=0x7f5c8012abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c8012abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 -- 172.21.15.125:0/4237522566 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009b30 con 0x7f5c801300a0 2023-10-03T10:15:29.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7f7fe700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c8012abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c7effd700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000ec10 tx=0x7f5c70009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 -- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2770133f70 msgr2=0x7f277011ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2770133f70 0x7f277011ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 -- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 msgr2=0x7f27701c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 -- 172.21.15.125:0/899428528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640094a0 con 0x7f27700a0a70 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276ffff700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:29.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000c940 con 0x7f5c801300a0 2023-10-03T10:15:29.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276f7fe700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 0x7f27701c8a90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f276400e980 tx=0x7f276400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000caa0 con 0x7f5c801300a0 2023-10-03T10:15:29.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000ce10 con 0x7f5c801300a0 2023-10-03T10:15:29.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c700094a0 con 0x7f5c801300a0 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400eed0 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276400c850 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27600094a0 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400cbe0 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27701bd1d0 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.413+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f276400cd40 con 0x7f27700a0a70 2023-10-03T10:15:29.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.413+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f276403faf0 con 0x7f27700a0a70 2023-10-03T10:15:29.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.412+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74011d40 con 0x7f5c801300a0 2023-10-03T10:15:29.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.413+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80127470 con 0x7f5c801300a0 2023-10-03T10:15:29.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.413+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2770122620 con 0x7f27700a0a70 2023-10-03T10:15:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.414+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c70013470 con 0x7f5c801300a0 2023-10-03T10:15:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.414+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c70040230 con 0x7f5c801300a0 2023-10-03T10:15:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.418+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c70011760 con 0x7f5c801300a0 2023-10-03T10:15:29.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.422+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2764011d60 con 0x7f27700a0a70 2023-10-03T10:15:29.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.609+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c80127bd0 con 0x7f5c801300a0 2023-10-03T10:15:29.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.609+0000 7f5c677fe700 1 -- 172.21.15.125:0/4237522566 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c70017070 con 0x7f5c801300a0 2023-10-03T10:15:29.610 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 msgr2=0x7f5c8012a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000ec10 tx=0x7f5c70009ec0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 shutdown_connections 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c80133ad0 0x7f5c8012abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c801300a0 0x7f5c8012a140 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 --2- 172.21.15.125:0/4237522566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c801309f0 0x7f5c8012a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.611+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 >> 172.21.15.125:0/4237522566 conn(0x7f5c80099c40 msgr2=0x7f5c8012c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.612+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 shutdown_connections 2023-10-03T10:15:29.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.612+0000 7f5c85745700 1 -- 172.21.15.125:0/4237522566 wait complete. 2023-10-03T10:15:29.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.615+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f277004f2a0 con 0x7f27700a0a70 2023-10-03T10:15:29.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.615+0000 7f276cff9700 1 -- 172.21.15.125:0/899428528 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2764017020 con 0x7f27700a0a70 2023-10-03T10:15:29.615 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:29.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 msgr2=0x7f27701c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 0x7f27701c8a90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f276400e980 tx=0x7f276400ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 shutdown_connections 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2770133f70 0x7f277011ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f277009ad40 0x7f27701c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 --2- 172.21.15.125:0/899428528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27700a0a70 0x7f27701c8a90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 >> 172.21.15.125:0/899428528 conn(0x7f2770099c40 msgr2=0x7f27701bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 shutdown_connections 2023-10-03T10:15:29.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:29.617+0000 7f27766cc700 1 -- 172.21.15.125:0/899428528 wait complete. 2023-10-03T10:15:29.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:29.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:30.189 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:30.230 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:30.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.315+0000 7f1d5c5f1700 1 Processor -- start 2023-10-03T10:15:30.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.315+0000 7f1d5c5f1700 1 -- start start 2023-10-03T10:15:30.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5c5f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5c5f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5c5f1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5409dc00 con 0x7f1d54133f50 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5c5f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5409ea60 con 0x7f1d540a0a70 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5c5f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5409dec0 con 0x7f1d540a1380 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d59b8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47468/0 (socket says 172.21.15.125:47468) 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 -- 172.21.15.125:0/4149243823 learned_addr learned my addr 172.21.15.125:0/4149243823 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d59b8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51238/0 (socket says 172.21.15.125:51238) 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 -- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 msgr2=0x7f1d54133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 -- 172.21.15.125:0/4149243823 >> v1:172.21.15.125:6789/0 conn(0x7f1d54133f50 legacy=0x7f1d5413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5a38d700 1 -- 172.21.15.125:0/4149243823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5409e6a0 con 0x7f1d540a0a70 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d5938b700 1 -- 172.21.15.125:0/4149243823 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085412047 0 0) 0x7f1d5409dc00 con 0x7f1d54133f50 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.316+0000 7f1d59b8c700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5a38d700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009920 tx=0x7f1d50009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98436ad0835c49d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5938b700 1 -- 172.21.15.125:0/4149243823 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011830 con 0x7f1d540a0a70 2023-10-03T10:15:30.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5938b700 1 -- 172.21.15.125:0/4149243823 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d50011990 con 0x7f1d540a0a70 2023-10-03T10:15:30.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5938b700 1 -- 172.21.15.125:0/4149243823 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011d20 con 0x7f1d540a0a70 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 msgr2=0x7f1d540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.317+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009920 tx=0x7f1d50009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/4149243823 shutdown_connections 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d540a0a70 0x7f1d540a0e40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/4149243823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a1380 0x7f1d54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/4149243823 >> 172.21.15.125:0/4149243823 conn(0x7f1d540a6610 msgr2=0x7f1d540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/4149243823 shutdown_connections 2023-10-03T10:15:30.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/4149243823 wait complete. 2023-10-03T10:15:30.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 Processor -- start 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.318+0000 7f1d5c5f1700 1 -- start start 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 0x7f1d541227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d54133f50 0x7f1d54123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541260e0 con 0x7f1d540a1380 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541262e0 con 0x7f1d54133f50 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5c5f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54133950 con 0x7f1d540a0a70 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d59b8c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 0x7f1d541227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d59b8c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45666/0 (socket says 172.21.15.125:45666) 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d59b8c700 1 -- 172.21.15.125:0/975879211 learned_addr learned my addr 172.21.15.125:0/975879211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5ab8e700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d54133f50 0x7f1d54123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 -- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d54133f50 msgr2=0x7f1d54123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d54133f50 0x7f1d54123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 -- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 msgr2=0x7f1d54122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 -- 172.21.15.125:0/975879211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440094a0 con 0x7f1d540a0a70 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d59b8c700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.319+0000 7f1d5a38d700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 0x7f1d541227c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1d50016000 tx=0x7f1d50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50004450 con 0x7f1d540a0a70 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5001f070 con 0x7f1d540a0a70 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d500038c0 con 0x7f1d540a0a70 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d50009550 con 0x7f1d540a0a70 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541332e0 con 0x7f1d540a0a70 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.320+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d50003a20 con 0x7f1d540a0a70 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.321+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5404f2a0 con 0x7f1d540a0a70 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.321+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d50021070 con 0x7f1d540a0a70 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.325+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d500045b0 con 0x7f1d540a0a70 2023-10-03T10:15:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.357+0000 7f61a3876700 1 Processor -- start 2023-10-03T10:15:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.357+0000 7f61a3876700 1 -- start start 2023-10-03T10:15:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a3876700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a3876700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f619c134120 0x7f619c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a3876700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c09dc00 con 0x7f619c0a1380 2023-10-03T10:15:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a3876700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c09ea60 con 0x7f619c134120 2023-10-03T10:15:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a3876700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619c09dec0 con 0x7f619c0a0a70 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1612700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f619c134120 0x7f619c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1612700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51256/0 (socket says 172.21.15.125:51256) 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f619c134120 0x7f619c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45682/0 (socket says 172.21.15.125:45682) 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a0e11700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f619c0a1380 0x7f619c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50822/0 (socket says 172.21.15.125:50822) 2023-10-03T10:15:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1612700 1 -- 172.21.15.125:0/72015723 learned_addr learned my addr 172.21.15.125:0/72015723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 -- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 msgr2=0x7f619c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 -- 172.21.15.125:0/72015723 >> v1:172.21.15.125:6789/0 conn(0x7f619c0a1380 legacy=0x7f619c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1e13700 1 -- 172.21.15.125:0/72015723 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c09e6a0 con 0x7f619c134120 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.358+0000 7f61a1612700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a1e13700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c134120 0x7f619c13bce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f783e03007dc763 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f6193fff700 1 -- 172.21.15.125:0/72015723 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400e070 con 0x7f619c134120 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f6193fff700 1 -- 172.21.15.125:0/72015723 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619400bb20 con 0x7f619c134120 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f6193fff700 1 -- 172.21.15.125:0/72015723 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194012430 con 0x7f619c134120 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 -- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c134120 msgr2=0x7f619c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c134120 0x7f619c13bce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 -- 172.21.15.125:0/72015723 shutdown_connections 2023-10-03T10:15:30.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c134120 0x7f619c13bce0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 --2- 172.21.15.125:0/72015723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c0a0a70 0x7f619c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 -- 172.21.15.125:0/72015723 >> 172.21.15.125:0/72015723 conn(0x7f619c0a6610 msgr2=0x7f619c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 -- 172.21.15.125:0/72015723 shutdown_connections 2023-10-03T10:15:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.359+0000 7f61a3876700 1 -- 172.21.15.125:0/72015723 wait complete. 2023-10-03T10:15:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.360+0000 7f61a3876700 1 Processor -- start 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.360+0000 7f61a3876700 1 -- start start 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 0x7f619c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 0x7f619c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c133ad0 con 0x7f619c0a1380 2023-10-03T10:15:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c125de0 con 0x7f619c0a0a70 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a3876700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619c124510 con 0x7f619c134120 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1e13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 0x7f619c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1e13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51266/0 (socket says 172.21.15.125:51266) 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1e13700 1 -- 172.21.15.125:0/3870832096 learned_addr learned my addr 172.21.15.125:0/3870832096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1612700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 0x7f619c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 -- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 msgr2=0x7f619c1232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 -- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 msgr2=0x7f619c122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 0x7f619c122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 -- 172.21.15.125:0/3870832096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6198009550 con 0x7f619c0a1380 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1e13700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a1612700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 0x7f619c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f61a0e11700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 0x7f619c122da0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f618c00c420 tx=0x7f618c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.361+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c005cb0 con 0x7f619c0a1380 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.362+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c005e10 con 0x7f619c0a1380 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.362+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6194009a70 con 0x7f619c0a1380 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.362+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0072d0 con 0x7f619c0a1380 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.362+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c0a0430 con 0x7f619c0a1380 2023-10-03T10:15:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.363+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f618c007430 con 0x7f619c0a1380 2023-10-03T10:15:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.363+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c04f2a0 con 0x7f619c0a1380 2023-10-03T10:15:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.363+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f618c03e940 con 0x7f619c0a1380 2023-10-03T10:15:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.367+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f618c0076e0 con 0x7f619c0a1380 2023-10-03T10:15:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.515+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d54072980 con 0x7f1d540a0a70 2023-10-03T10:15:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.515+0000 7f1d4affd700 1 -- 172.21.15.125:0/975879211 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d5002b030 con 0x7f1d540a0a70 2023-10-03T10:15:30.516 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:30.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.517+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 msgr2=0x7f1d541227c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.517+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 0x7f1d541227c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1d50016000 tx=0x7f1d50004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 shutdown_connections 2023-10-03T10:15:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d54133f50 0x7f1d54123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d540a0a70 0x7f1d541227c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 --2- 172.21.15.125:0/975879211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d540a1380 0x7f1d54122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 >> 172.21.15.125:0/975879211 conn(0x7f1d540a6610 msgr2=0x7f1d540a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 shutdown_connections 2023-10-03T10:15:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.518+0000 7f1d5c5f1700 1 -- 172.21.15.125:0/975879211 wait complete. 2023-10-03T10:15:30.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.555+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f619c1263e0 con 0x7f619c0a1380 2023-10-03T10:15:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.555+0000 7f6191ffb700 1 -- 172.21.15.125:0/3870832096 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f618c017030 con 0x7f619c0a1380 2023-10-03T10:15:30.555 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 msgr2=0x7f619c122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 0x7f619c122da0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f618c00c420 tx=0x7f618c00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 shutdown_connections 2023-10-03T10:15:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f619c134120 0x7f619c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f619c0a0a70 0x7f619c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 --2- 172.21.15.125:0/3870832096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f619c0a1380 0x7f619c122da0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 >> 172.21.15.125:0/3870832096 conn(0x7f619c0a6610 msgr2=0x7f619c0a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 shutdown_connections 2023-10-03T10:15:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.557+0000 7f61a3876700 1 -- 172.21.15.125:0/3870832096 wait complete. 2023-10-03T10:15:30.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:30.626 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:30.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:30.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.750+0000 7f40f4f9f700 1 Processor -- start 2023-10-03T10:15:30.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.750+0000 7f40f4f9f700 1 -- start start 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40f4f9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40f4f9f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40f4f9f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f009e9d0 con 0x7f40f00a0a70 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40f4f9f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f009dc00 con 0x7f40f0139200 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40f4f9f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40f009dec0 con 0x7f40f00a1550 2023-10-03T10:15:30.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40eed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40eed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47488/0 (socket says 172.21.15.125:47488) 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40eed9d700 1 -- 172.21.15.125:0/465820032 learned_addr learned my addr 172.21.15.125:0/465820032 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40ee59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f40f00a0a70 0x7f40f00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50834/0 (socket says 172.21.15.125:50834) 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 -- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 msgr2=0x7f40f013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 -- 172.21.15.125:0/465820032 >> v1:172.21.15.125:6789/0 conn(0x7f40f00a0a70 legacy=0x7f40f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 -- 172.21.15.125:0/465820032 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f009e6a0 con 0x7f40f00a1550 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40eed9d700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40ed59a700 1 -- 172.21.15.125:0/465820032 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017840965 0 0) 0x7f40f009e9d0 con 0x7f40f00a0a70 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.751+0000 7f40edd9b700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0138cc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009870 tx=0x7f40e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcee4b6fcdb35e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40ed59a700 1 -- 172.21.15.125:0/465820032 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4011830 con 0x7f40f00a1550 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40ed59a700 1 -- 172.21.15.125:0/465820032 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4011990 con 0x7f40f00a1550 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40ed59a700 1 -- 172.21.15.125:0/465820032 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4011d20 con 0x7f40f00a1550 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 -- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 msgr2=0x7f40f0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0138cc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009870 tx=0x7f40e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 -- 172.21.15.125:0/465820032 shutdown_connections 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f0139200 0x7f40f013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/465820032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0138cc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 -- 172.21.15.125:0/465820032 >> 172.21.15.125:0/465820032 conn(0x7f40f00a6610 msgr2=0x7f40f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 -- 172.21.15.125:0/465820032 shutdown_connections 2023-10-03T10:15:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.752+0000 7f40f4f9f700 1 -- 172.21.15.125:0/465820032 wait complete. 2023-10-03T10:15:30.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.753+0000 7f40f4f9f700 1 Processor -- start 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.753+0000 7f40f4f9f700 1 -- start start 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40f0139200 0x7f40f01211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0122360 con 0x7f40f0139200 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0136640 con 0x7f40f00a0a70 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40f4f9f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0123f90 con 0x7f40f00a1550 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40ee59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51298/0 (socket says 172.21.15.125:51298) 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 -- 172.21.15.125:0/3979394670 learned_addr learned my addr 172.21.15.125:0/3979394670 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40ee59c700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47498/0 (socket says 172.21.15.125:47498) 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40eed9d700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40f0139200 0x7f40f01211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 -- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 msgr2=0x7f40f0120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 -- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40f0139200 msgr2=0x7f40f01211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40f0139200 0x7f40f01211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 -- 172.21.15.125:0/3979394670 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009b30 con 0x7f40f00a1550 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40ee59c700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.754+0000 7f40edd9b700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40e40090b0 tx=0x7f40e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4004550 con 0x7f40f00a1550 2023-10-03T10:15:30.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e401f070 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40094a0 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40038e0 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f0122b80 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40e4003a40 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.755+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40e4021070 con 0x7f40f00a1550 2023-10-03T10:15:30.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.756+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f00a5100 con 0x7f40f00a1550 2023-10-03T10:15:30.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.760+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40e401a950 con 0x7f40f00a1550 2023-10-03T10:15:30.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.793+0000 7f93c649e700 1 Processor -- start 2023-10-03T10:15:30.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.793+0000 7f93c649e700 1 -- start start 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c649e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93c009d860 0x7f93c009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c649e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009e170 0x7f93c01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c649e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c009aaa0 con 0x7f93c0130ce0 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c649e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c009f870 con 0x7f93c009d860 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c649e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009b360 con 0x7f93c009e170 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93bffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93c009d860 0x7f93c009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93bf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009e170 0x7f93c01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93bffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93c009d860 0x7f93c009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45722/0 (socket says 172.21.15.125:45722) 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93bffff700 1 -- 172.21.15.125:0/322392835 learned_addr learned my addr 172.21.15.125:0/322392835 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.794+0000 7f93c4a3b700 1 --1- 172.21.15.125:0/322392835 >> v1:172.21.15.125:6789/0 conn(0x7f93c0130ce0 0x7f93c01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50842/0 (socket says 172.21.15.125:50842) 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93bffff700 1 -- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009e170 msgr2=0x7f93c01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93bffff700 1 --2- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009e170 0x7f93c01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93bffff700 1 -- 172.21.15.125:0/322392835 >> v1:172.21.15.125:6789/0 conn(0x7f93c0130ce0 legacy=0x7f93c01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93bffff700 1 -- 172.21.15.125:0/322392835 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c009b620 con 0x7f93c009d860 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93beffd700 1 -- 172.21.15.125:0/322392835 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657778153 0 0) 0x7f93c009aaa0 con 0x7f93c0130ce0 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93bffff700 1 --2- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c009d860 0x7f93c009dc30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f93b00098f0 tx=0x7f93b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce45eb9c67ca94d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93beffd700 1 -- 172.21.15.125:0/322392835 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0011830 con 0x7f93c009d860 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93beffd700 1 -- 172.21.15.125:0/322392835 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0011990 con 0x7f93c009d860 2023-10-03T10:15:30.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93beffd700 1 -- 172.21.15.125:0/322392835 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0011d20 con 0x7f93c009d860 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 -- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c009d860 msgr2=0x7f93c009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 --2- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c009d860 0x7f93c009dc30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f93b00098f0 tx=0x7f93b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 -- 172.21.15.125:0/322392835 shutdown_connections 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 --2- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c009d860 0x7f93c009dc30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 --2- 172.21.15.125:0/322392835 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009e170 0x7f93c01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 -- 172.21.15.125:0/322392835 >> 172.21.15.125:0/322392835 conn(0x7f93c0099c40 msgr2=0x7f93c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.795+0000 7f93c649e700 1 -- 172.21.15.125:0/322392835 shutdown_connections 2023-10-03T10:15:30.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.796+0000 7f93c649e700 1 -- 172.21.15.125:0/322392835 wait complete. 2023-10-03T10:15:30.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 Processor -- start 2023-10-03T10:15:30.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 -- start start 2023-10-03T10:15:30.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c009e170 0x7f93c011b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 0x7f93c011bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0130410 con 0x7f93c0130ce0 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c011d090 con 0x7f93c009e170 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.797+0000 7f93c649e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009c8b0 con 0x7f93c009d860 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51318/0 (socket says 172.21.15.125:51318) 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 -- 172.21.15.125:0/971381043 learned_addr learned my addr 172.21.15.125:0/971381043 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93c4a3b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 0x7f93c011bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 -- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c009e170 msgr2=0x7f93c011b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c009e170 0x7f93c011b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 -- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 msgr2=0x7f93c011bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 0x7f93c011bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 -- 172.21.15.125:0/971381043 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009550 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93c4a3b700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 0x7f93c011bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bffff700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f93c009f9b0 tx=0x7f93b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0004380 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0021070 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c011efa0 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00036a0 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.798+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c011d840 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.799+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93b0023030 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.799+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93b0042ca0 con 0x7f93c009d860 2023-10-03T10:15:30.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.799+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c004f2a0 con 0x7f93c009d860 2023-10-03T10:15:30.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.804+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93b0015080 con 0x7f93c009d860 2023-10-03T10:15:30.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.951+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40f00a03e0 con 0x7f40f00a1550 2023-10-03T10:15:30.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.951+0000 7f40deffd700 1 -- 172.21.15.125:0/3979394670 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40e4010b70 con 0x7f40f00a1550 2023-10-03T10:15:30.952 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:30.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 msgr2=0x7f40f0120c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40e40090b0 tx=0x7f40e4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 shutdown_connections 2023-10-03T10:15:30.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40f0139200 0x7f40f01211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40f00a0a70 0x7f40f0120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 --2- 172.21.15.125:0/3979394670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40f00a1550 0x7f40f0120c90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 >> 172.21.15.125:0/3979394670 conn(0x7f40f00a6610 msgr2=0x7f40f00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 shutdown_connections 2023-10-03T10:15:30.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.953+0000 7f40f4f9f700 1 -- 172.21.15.125:0/3979394670 wait complete. 2023-10-03T10:15:30.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:30.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.993+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93c0130ac0 con 0x7f93c009d860 2023-10-03T10:15:30.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.993+0000 7f93bcff9700 1 -- 172.21.15.125:0/971381043 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93b0006d80 con 0x7f93c009d860 2023-10-03T10:15:30.994 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:30.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.995+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 msgr2=0x7f93c011b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.995+0000 7f93c649e700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f93c009f9b0 tx=0x7f93b0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.995+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 shutdown_connections 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93c0130ce0 0x7f93c011bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93c009d860 0x7f93c011b480 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 --2- 172.21.15.125:0/971381043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93c009e170 0x7f93c011b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 >> 172.21.15.125:0/971381043 conn(0x7f93c0099c40 msgr2=0x7f93c00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 shutdown_connections 2023-10-03T10:15:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:30.996+0000 7f93c649e700 1 -- 172.21.15.125:0/971381043 wait complete. 2023-10-03T10:15:31.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:31.531 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:31.570 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:31.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.658+0000 7f13bbdab700 1 Processor -- start 2023-10-03T10:15:31.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 -- start start 2023-10-03T10:15:31.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b409b110 con 0x7f13b40a0a70 2023-10-03T10:15:31.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40a3b60 con 0x7f13b409ad40 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13bbdab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41348e0 con 0x7f13b4133f70 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9b47700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47508/0 (socket says 172.21.15.125:47508) 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9b47700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45752/0 (socket says 172.21.15.125:45752) 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 -- 172.21.15.125:0/2557859935 learned_addr learned my addr 172.21.15.125:0/2557859935 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:31.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 -- 172.21.15.125:0/2557859935 >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 msgr2=0x7f13b4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 --2- 172.21.15.125:0/2557859935 >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 -- 172.21.15.125:0/2557859935 >> v1:172.21.15.125:6789/0 conn(0x7f13b40a0a70 legacy=0x7f13b40a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9346700 1 -- 172.21.15.125:0/2557859935 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40a2fa0 con 0x7f13b4133f70 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.659+0000 7f13b9b47700 1 --2- 172.21.15.125:0/2557859935 >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13b9346700 1 --2- 172.21.15.125:0/2557859935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f13a40098f0 tx=0x7f13a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce9582b2b91c837d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13b8b45700 1 -- 172.21.15.125:0/2557859935 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011830 con 0x7f13b4133f70 2023-10-03T10:15:31.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13b8b45700 1 -- 172.21.15.125:0/2557859935 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4011990 con 0x7f13b4133f70 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13b8b45700 1 -- 172.21.15.125:0/2557859935 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011d20 con 0x7f13b4133f70 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 -- 172.21.15.125:0/2557859935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 msgr2=0x7f13b41343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 --2- 172.21.15.125:0/2557859935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f13a40098f0 tx=0x7f13a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 -- 172.21.15.125:0/2557859935 shutdown_connections 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 --2- 172.21.15.125:0/2557859935 >> v2:172.21.15.125:3300/0 conn(0x7f13b409ad40 0x7f13b4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 --2- 172.21.15.125:0/2557859935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b4133f70 0x7f13b41343a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 -- 172.21.15.125:0/2557859935 >> 172.21.15.125:0/2557859935 conn(0x7f13b4099c40 msgr2=0x7f13b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.660+0000 7f13bbdab700 1 -- 172.21.15.125:0/2557859935 shutdown_connections 2023-10-03T10:15:31.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.661+0000 7f13bbdab700 1 -- 172.21.15.125:0/2557859935 wait complete. 2023-10-03T10:15:31.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.661+0000 7f13bbdab700 1 Processor -- start 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.661+0000 7f13bbdab700 1 -- start start 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13b409ad40 0x7f13b411e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 0x7f13b411eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4122530 con 0x7f13b4133f70 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b411fc60 con 0x7f13b40a0a70 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13bbdab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4120280 con 0x7f13b409ad40 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13ba348700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 0x7f13b411eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47520/0 (socket says 172.21.15.125:47520) 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13ba348700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 0x7f13b411eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45758/0 (socket says 172.21.15.125:45758) 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 -- 172.21.15.125:0/104423080 learned_addr learned my addr 172.21.15.125:0/104423080 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9b47700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13b409ad40 0x7f13b411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 -- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13b409ad40 msgr2=0x7f13b411e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13b409ad40 0x7f13b411e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 -- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 msgr2=0x7f13b411eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 0x7f13b411eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 -- 172.21.15.125:0/104423080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00094a0 con 0x7f13b40a0a70 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13b9346700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f13b40a2420 tx=0x7f13a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.662+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4004510 con 0x7f13b40a0a70 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40036a0 con 0x7f13b40a0a70 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a4009550 con 0x7f13b40a0a70 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4003a50 con 0x7f13b40a0a70 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b40a0ed0 con 0x7f13b40a0a70 2023-10-03T10:15:31.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13a4003bb0 con 0x7f13b40a0a70 2023-10-03T10:15:31.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13a4040710 con 0x7f13b40a0a70 2023-10-03T10:15:31.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.663+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b409ed10 con 0x7f13b40a0a70 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.672+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13a4028080 con 0x7f13b40a0a70 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 Processor -- start 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 -- start start 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 0x7ff15c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c09dc00 con 0x7ff15c133f50 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c09ea60 con 0x7ff15c0a1380 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff161011700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c09dec0 con 0x7ff15c0a0a70 2023-10-03T10:15:31.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.702+0000 7ff15ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47536/0 (socket says 172.21.15.125:47536) 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 -- 172.21.15.125:0/461491173 learned_addr learned my addr 172.21.15.125:0/461491173 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15a59c700 1 --2- 172.21.15.125:0/461491173 >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 0x7ff15c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 -- 172.21.15.125:0/461491173 >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 msgr2=0x7ff15c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 --2- 172.21.15.125:0/461491173 >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 0x7ff15c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 -- 172.21.15.125:0/461491173 >> v1:172.21.15.125:6789/0 conn(0x7ff15c133f50 legacy=0x7ff15c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 -- 172.21.15.125:0/461491173 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c09e6a0 con 0x7ff15c0a0a70 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff159d9b700 1 -- 172.21.15.125:0/461491173 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219154094 0 0) 0x7ff15c09dc00 con 0x7ff15c133f50 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15a59c700 1 --2- 172.21.15.125:0/461491173 >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 0x7ff15c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff15ad9d700 1 --2- 172.21.15.125:0/461491173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098f0 tx=0x7ff14c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04248453e26e485 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff159d9b700 1 -- 172.21.15.125:0/461491173 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c011830 con 0x7ff15c0a0a70 2023-10-03T10:15:31.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff159d9b700 1 -- 172.21.15.125:0/461491173 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c011990 con 0x7ff15c0a0a70 2023-10-03T10:15:31.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.703+0000 7ff159d9b700 1 -- 172.21.15.125:0/461491173 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c011d20 con 0x7ff15c0a0a70 2023-10-03T10:15:31.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 -- 172.21.15.125:0/461491173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 msgr2=0x7ff15c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 --2- 172.21.15.125:0/461491173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098f0 tx=0x7ff14c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:31.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 -- 172.21.15.125:0/461491173 shutdown_connections 2023-10-03T10:15:31.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 --2- 172.21.15.125:0/461491173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c0a0e40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 --2- 172.21.15.125:0/461491173 >> v2:172.21.15.125:3300/0 conn(0x7ff15c0a1380 0x7ff15c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 -- 172.21.15.125:0/461491173 >> 172.21.15.125:0/461491173 conn(0x7ff15c0a6610 msgr2=0x7ff15c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 -- 172.21.15.125:0/461491173 shutdown_connections 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.704+0000 7ff161011700 1 -- 172.21.15.125:0/461491173 wait complete. 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.705+0000 7ff161011700 1 Processor -- start 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.705+0000 7ff161011700 1 -- start start 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff15c0a1380 0x7ff15c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c126140 con 0x7ff15c133f50 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c1244d0 con 0x7ff15c0a0a70 2023-10-03T10:15:31.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c126340 con 0x7ff15c0a1380 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff15c0a1380 0x7ff15c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45766/0 (socket says 172.21.15.125:45766) 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 -- 172.21.15.125:0/4195363086 learned_addr learned my addr 172.21.15.125:0/4195363086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 -- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff15c0a1380 msgr2=0x7ff15c122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff15c0a1380 0x7ff15c122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 -- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 msgr2=0x7ff15c122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 -- 172.21.15.125:0/4195363086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500094a0 con 0x7ff15c133f50 2023-10-03T10:15:31.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15ad9d700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff15b59e700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c870 tx=0x7ff15400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154003e30 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154005070 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154005420 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.706+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c009550 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.707+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c125da0 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.707+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff154005580 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.707+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff15403ed50 con 0x7ff15c133f50 2023-10-03T10:15:31.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.708+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c04f2a0 con 0x7ff15c133f50 2023-10-03T10:15:31.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.712+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff154017030 con 0x7ff15c133f50 2023-10-03T10:15:31.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.869+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13b404f2a0 con 0x7f13b40a0a70 2023-10-03T10:15:31.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.869+0000 7f13aa7fc700 1 -- 172.21.15.125:0/104423080 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13a4015020 con 0x7f13b40a0a70 2023-10-03T10:15:31.869 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:31.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 msgr2=0x7f13b411e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f13b40a2420 tx=0x7f13a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 shutdown_connections 2023-10-03T10:15:31.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13b4133f70 0x7f13b411eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13b409ad40 0x7f13b411e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 --2- 172.21.15.125:0/104423080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13b40a0a70 0x7f13b411e5e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 >> 172.21.15.125:0/104423080 conn(0x7f13b4099c40 msgr2=0x7f13b4133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 shutdown_connections 2023-10-03T10:15:31.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.871+0000 7f13bbdab700 1 -- 172.21.15.125:0/104423080 wait complete. 2023-10-03T10:15:31.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.903+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff15c1339b0 con 0x7ff15c133f50 2023-10-03T10:15:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.904+0000 7ff1437fe700 1 -- 172.21.15.125:0/4195363086 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff154005830 con 0x7ff15c133f50 2023-10-03T10:15:31.904 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:31.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 msgr2=0x7ff15c1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c870 tx=0x7ff15400cb80 comp rx=0 tx=0).stop 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 shutdown_connections 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff15c133f50 0x7ff15c1232a0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff15c0a0a70 0x7ff15c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 --2- 172.21.15.125:0/4195363086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff15c0a1380 0x7ff15c122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 >> 172.21.15.125:0/4195363086 conn(0x7ff15c0a6610 msgr2=0x7ff15c0a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 shutdown_connections 2023-10-03T10:15:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:31.906+0000 7ff161011700 1 -- 172.21.15.125:0/4195363086 wait complete. 2023-10-03T10:15:31.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:31.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:32.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 Processor -- start 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 -- start start 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36b00a0a70 0x7f36b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b009dc00 con 0x7f36b00a1380 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b009ea90 con 0x7f36b00a0a70 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36b5c7d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b009dec0 con 0x7f36b0134120 2023-10-03T10:15:32.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36affff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36affff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47562/0 (socket says 172.21.15.125:47562) 2023-10-03T10:15:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36affff700 1 -- 172.21.15.125:0/1586912482 learned_addr learned my addr 172.21.15.125:0/1586912482 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36af7fe700 1 --2- 172.21.15.125:0/1586912482 >> v2:172.21.15.125:3300/0 conn(0x7f36b00a0a70 0x7f36b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.094+0000 7f36aeffd700 1 --1- 172.21.15.125:0/1586912482 >> v1:172.21.15.125:6789/0 conn(0x7f36b00a1380 0x7f36b0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50880/0 (socket says 172.21.15.125:50880) 2023-10-03T10:15:32.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36affff700 1 -- 172.21.15.125:0/1586912482 >> v2:172.21.15.125:3300/0 conn(0x7f36b00a0a70 msgr2=0x7f36b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36affff700 1 --2- 172.21.15.125:0/1586912482 >> v2:172.21.15.125:3300/0 conn(0x7f36b00a0a70 0x7f36b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36affff700 1 -- 172.21.15.125:0/1586912482 >> v1:172.21.15.125:6789/0 conn(0x7f36b00a1380 legacy=0x7f36b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36affff700 1 -- 172.21.15.125:0/1586912482 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b009e6a0 con 0x7f36b0134120 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36ae7fc700 1 -- 172.21.15.125:0/1586912482 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909627683 0 0) 0x7f36b009dc00 con 0x7f36b00a1380 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36affff700 1 --2- 172.21.15.125:0/1586912482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009e50 tx=0x7f36a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43faa6f8e9e6b9a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36ae7fc700 1 -- 172.21.15.125:0/1586912482 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800e070 con 0x7f36b0134120 2023-10-03T10:15:32.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36ae7fc700 1 -- 172.21.15.125:0/1586912482 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a800b910 con 0x7f36b0134120 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36ae7fc700 1 -- 172.21.15.125:0/1586912482 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800bcc0 con 0x7f36b0134120 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1586912482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 msgr2=0x7f36b013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.095+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1586912482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009e50 tx=0x7f36a800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1586912482 shutdown_connections 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1586912482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b0134120 0x7f36b013bce0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1586912482 >> v2:172.21.15.125:3300/0 conn(0x7f36b00a0a70 0x7f36b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1586912482 >> 172.21.15.125:0/1586912482 conn(0x7f36b00a6610 msgr2=0x7f36b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1586912482 shutdown_connections 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1586912482 wait complete. 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.096+0000 7f36b5c7d700 1 Processor -- start 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 -- start start 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 0x7f36b0122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 0x7f36b01231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0124360 con 0x7f36b0134120 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01336a0 con 0x7f36b00a0a70 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36b5c7d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01332e0 con 0x7f36b00a1380 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36aeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 0x7f36b0122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47574/0 (socket says 172.21.15.125:47574) 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36af7fe700 1 -- 172.21.15.125:0/1601419845 learned_addr learned my addr 172.21.15.125:0/1601419845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.097+0000 7f36affff700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 0x7f36b01231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 -- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 msgr2=0x7f36b0122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 0x7f36b0122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 -- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 msgr2=0x7f36b0122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 -- 172.21.15.125:0/1601419845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8009b30 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36aeffd700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 0x7f36b0122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36af7fe700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36affff700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 0x7f36b01231d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f36b009ff60 tx=0x7f36a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8004840 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80099b0 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b0133a40 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a801c680 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.098+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b0126a00 con 0x7f36b0134120 2023-10-03T10:15:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.099+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b004f2a0 con 0x7f36b0134120 2023-10-03T10:15:32.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.099+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36a801c7e0 con 0x7f36b0134120 2023-10-03T10:15:32.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.099+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f36a80411c0 con 0x7f36b0134120 2023-10-03T10:15:32.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.103+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36a8023910 con 0x7f36b0134120 2023-10-03T10:15:32.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.136+0000 7efe8dd03700 1 Processor -- start 2023-10-03T10:15:32.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.136+0000 7efe8dd03700 1 -- start start 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe8dd03700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe8809e340 0x7efe881359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe8dd03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe88138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe8dd03700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8809aaa0 con 0x7efe8809d860 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe8dd03700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8809e730 con 0x7efe8809e340 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe8dd03700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8809f870 con 0x7efe88135f20 2023-10-03T10:15:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe8809e340 0x7efe881359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe87fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe88138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe877fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efe8809d860 0x7efe8809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50892/0 (socket says 172.21.15.125:50892) 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe8809e340 0x7efe881359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45788/0 (socket says 172.21.15.125:45788) 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe877fe700 1 -- 172.21.15.125:0/192634042 learned_addr learned my addr 172.21.15.125:0/192634042 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 -- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 msgr2=0x7efe88138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 --2- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe88138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 -- 172.21.15.125:0/192634042 >> v1:172.21.15.125:6789/0 conn(0x7efe8809d860 legacy=0x7efe8809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe86ffd700 1 -- 172.21.15.125:0/192634042 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8809b360 con 0x7efe8809e340 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.137+0000 7efe867fc700 1 -- 172.21.15.125:0/192634042 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162389000 0 0) 0x7efe8809aaa0 con 0x7efe8809d860 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe86ffd700 1 --2- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881359e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7efe70009840 tx=0x7efe70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61a28ef6685e03f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe867fc700 1 -- 172.21.15.125:0/192634042 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011830 con 0x7efe8809e340 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe867fc700 1 -- 172.21.15.125:0/192634042 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70011990 con 0x7efe8809e340 2023-10-03T10:15:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe867fc700 1 -- 172.21.15.125:0/192634042 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011d20 con 0x7efe8809e340 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 -- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 msgr2=0x7efe881359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 --2- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881359e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7efe70009840 tx=0x7efe70009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 -- 172.21.15.125:0/192634042 shutdown_connections 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 --2- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe88138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 --2- 172.21.15.125:0/192634042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881359e0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 -- 172.21.15.125:0/192634042 >> 172.21.15.125:0/192634042 conn(0x7efe88099c40 msgr2=0x7efe880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 -- 172.21.15.125:0/192634042 shutdown_connections 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.138+0000 7efe8dd03700 1 -- 172.21.15.125:0/192634042 wait complete. 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.140+0000 7efe8dd03700 1 Processor -- start 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.140+0000 7efe8dd03700 1 -- start start 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 0x7efe881c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88121380 con 0x7efe8809e340 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe88132320 con 0x7efe8809d860 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a20c0 con 0x7efe88135f20 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 0x7efe881c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51384/0 (socket says 172.21.15.125:51384) 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 -- 172.21.15.125:0/3897872537 learned_addr learned my addr 172.21.15.125:0/3897872537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe86ffd700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 -- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 msgr2=0x7efe881c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 0x7efe881c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 -- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 msgr2=0x7efe881c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 -- 172.21.15.125:0/3897872537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700094a0 con 0x7efe88135f20 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe877fe700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 0x7efe881c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe86ffd700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe87fff700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e900 tx=0x7efe8000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800096d0 con 0x7efe88135f20 2023-10-03T10:15:32.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80013680 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe88122fb0 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80013a10 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.141+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88121980 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.142+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe80013b70 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.142+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88121bd0 con 0x7efe88135f20 2023-10-03T10:15:32.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.143+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe8003fb30 con 0x7efe88135f20 2023-10-03T10:15:32.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.147+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe8001ada0 con 0x7efe88135f20 2023-10-03T10:15:32.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.298+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36b0125eb0 con 0x7f36b0134120 2023-10-03T10:15:32.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.298+0000 7f3697fff700 1 -- 172.21.15.125:0/1601419845 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36a80236e0 con 0x7f36b0134120 2023-10-03T10:15:32.299 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:32.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 msgr2=0x7f36b01231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 0x7f36b01231d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f36b009ff60 tx=0x7f36a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 shutdown_connections 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b0134120 0x7f36b01231d0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36b00a0a70 0x7f36b0122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 --2- 172.21.15.125:0/1601419845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f36b00a1380 0x7f36b0122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.300+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 >> 172.21.15.125:0/1601419845 conn(0x7f36b00a6610 msgr2=0x7f36b00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.301+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 shutdown_connections 2023-10-03T10:15:32.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.301+0000 7f36b5c7d700 1 -- 172.21.15.125:0/1601419845 wait complete. 2023-10-03T10:15:32.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:32.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.340+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe8804f2a0 con 0x7efe88135f20 2023-10-03T10:15:32.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.341+0000 7efe7ffff700 1 -- 172.21.15.125:0/3897872537 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe80021020 con 0x7efe88135f20 2023-10-03T10:15:32.341 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 msgr2=0x7efe881c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e900 tx=0x7efe8000ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 shutdown_connections 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efe88135f20 0x7efe881c8bc0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe8809d860 0x7efe881c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 --2- 172.21.15.125:0/3897872537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe8809e340 0x7efe881c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 >> 172.21.15.125:0/3897872537 conn(0x7efe88099c40 msgr2=0x7efe880a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 shutdown_connections 2023-10-03T10:15:32.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:32.343+0000 7efe8dd03700 1 -- 172.21.15.125:0/3897872537 wait complete. 2023-10-03T10:15:32.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:32.884 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:32.919 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:33.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 Processor -- start 2023-10-03T10:15:33.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 -- start start 2023-10-03T10:15:33.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff83413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83406bec0 con 0x7ff83409e870 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83406ce60 con 0x7ff834139480 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.011+0000 7ff83ae7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409f740 con 0x7ff83409f350 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff83941c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff83413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51398/0 (socket says 172.21.15.125:51398) 2023-10-03T10:15:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 -- 172.21.15.125:0/697238216 learned_addr learned my addr 172.21.15.125:0/697238216 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff838c1b700 1 --1- 172.21.15.125:0/697238216 >> v1:172.21.15.125:6789/0 conn(0x7ff83409e870 0x7ff83409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50898/0 (socket says 172.21.15.125:50898) 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff8337fe700 1 -- 172.21.15.125:0/697238216 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452870504 0 0) 0x7ff83406bec0 con 0x7ff83409e870 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff8337fe700 1 -- 172.21.15.125:0/697238216 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8240035b0 con 0x7ff83409e870 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 -- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 msgr2=0x7ff83413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff83413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 -- 172.21.15.125:0/697238216 >> v1:172.21.15.125:6789/0 conn(0x7ff83409e870 legacy=0x7ff83409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 -- 172.21.15.125:0/697238216 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83409fa00 con 0x7ff83409f350 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff83941c700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff83413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff833fff700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff820009920 tx=0x7ff820009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c369564763bf7eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff8337fe700 1 -- 172.21.15.125:0/697238216 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820011830 con 0x7ff83409f350 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff8337fe700 1 -- 172.21.15.125:0/697238216 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff820011990 con 0x7ff83409f350 2023-10-03T10:15:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.012+0000 7ff8337fe700 1 -- 172.21.15.125:0/697238216 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820011d20 con 0x7ff83409f350 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 -- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 msgr2=0x7ff834138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff820009920 tx=0x7ff820009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 -- 172.21.15.125:0/697238216 shutdown_connections 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff83413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/697238216 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834138f40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 -- 172.21.15.125:0/697238216 >> 172.21.15.125:0/697238216 conn(0x7ff8340a4430 msgr2=0x7ff8340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 -- 172.21.15.125:0/697238216 shutdown_connections 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.013+0000 7ff83ae7f700 1 -- 172.21.15.125:0/697238216 wait complete. 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 Processor -- start 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 -- start start 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 0x7ff834120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff8341213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff834136810 con 0x7ff83409e870 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834122d50 con 0x7ff834139480 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.014+0000 7ff83ae7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409dc80 con 0x7ff83409f350 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff833fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 0x7ff834120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff833fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51400/0 (socket says 172.21.15.125:51400) 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff833fff700 1 -- 172.21.15.125:0/2821231385 learned_addr learned my addr 172.21.15.125:0/2821231385 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff83941c700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff8341213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 -- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 msgr2=0x7ff834120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 -- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 msgr2=0x7ff8341213a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff8341213a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 -- 172.21.15.125:0/2821231385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009a70 con 0x7ff83409e870 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff833fff700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff83941c700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff8341213a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff838c1b700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 0x7ff834120920 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c490 tx=0x7ff82800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800cea0 con 0x7ff83409e870 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828005cb0 con 0x7ff83409e870 2023-10-03T10:15:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff820009550 con 0x7ff83409e870 2023-10-03T10:15:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007310 con 0x7ff83409e870 2023-10-03T10:15:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.015+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834124160 con 0x7ff83409e870 2023-10-03T10:15:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.016+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff828007470 con 0x7ff83409e870 2023-10-03T10:15:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.016+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83404f2a0 con 0x7ff83409e870 2023-10-03T10:15:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.016+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff82803e990 con 0x7ff83409e870 2023-10-03T10:15:33.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.021+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff828017080 con 0x7ff83409e870 2023-10-03T10:15:33.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 Processor -- start 2023-10-03T10:15:33.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 -- start start 2023-10-03T10:15:33.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd680139410 0x7fd68013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68006bec0 con 0x7fd68009e870 2023-10-03T10:15:33.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68009fdd0 con 0x7fd680139410 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd6866a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006b990 con 0x7fd68009f350 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.052+0000 7fd67f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd680139410 0x7fd68013b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51406/0 (socket says 172.21.15.125:51406) 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67f7fe700 1 -- 172.21.15.125:0/2155559095 learned_addr learned my addr 172.21.15.125:0/2155559095 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 -- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 msgr2=0x7fd680138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 -- 172.21.15.125:0/2155559095 >> v1:172.21.15.125:6789/0 conn(0x7fd68009e870 legacy=0x7fd68009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 -- 172.21.15.125:0/2155559095 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800a0870 con 0x7fd680139410 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67effd700 1 -- 172.21.15.125:0/2155559095 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723916602 0 0) 0x7fd68006bec0 con 0x7fd68009e870 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67f7fe700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd684c44700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680139410 0x7fd68013b7f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd678009d90 tx=0x7fd67800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df185f4075ccff79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67effd700 1 -- 172.21.15.125:0/2155559095 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800e070 con 0x7fd680139410 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67effd700 1 -- 172.21.15.125:0/2155559095 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67800bb20 con 0x7fd680139410 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.053+0000 7fd67effd700 1 -- 172.21.15.125:0/2155559095 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678012430 con 0x7fd680139410 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 -- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680139410 msgr2=0x7fd68013b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680139410 0x7fd68013b7f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd678009d90 tx=0x7fd67800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:33.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 -- 172.21.15.125:0/2155559095 shutdown_connections 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680139410 0x7fd68013b7f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 --2- 172.21.15.125:0/2155559095 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009f350 0x7fd680138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 -- 172.21.15.125:0/2155559095 >> 172.21.15.125:0/2155559095 conn(0x7fd6800a4430 msgr2=0x7fd6800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 -- 172.21.15.125:0/2155559095 shutdown_connections 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.054+0000 7fd6866a7700 1 -- 172.21.15.125:0/2155559095 wait complete. 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 Processor -- start 2023-10-03T10:15:33.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 -- start start 2023-10-03T10:15:33.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 0x7fd680120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd680139410 0x7fd6801213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680124fb0 con 0x7fd68009f350 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd680124180 con 0x7fd680139410 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd6866a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800a0440 con 0x7fd68009e870 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd67f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 0x7fd680120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd684c44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd680139410 0x7fd6801213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd67f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45828/0 (socket says 172.21.15.125:45828) 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.055+0000 7fd67f7fe700 1 -- 172.21.15.125:0/4244927906 learned_addr learned my addr 172.21.15.125:0/4244927906 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 -- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 msgr2=0x7fd680120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 0x7fd680120930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 -- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd680139410 msgr2=0x7fd6801213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd680139410 0x7fd6801213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 -- 172.21.15.125:0/4244927906 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674009550 con 0x7fd68009f350 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67ffff700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 0x7fd680120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67f7fe700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd67400ec10 tx=0x7fd67400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400c850 con 0x7fd68009f350 2023-10-03T10:15:33.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400c9b0 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678009a70 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400cd40 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.056+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801224c0 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.057+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd674013470 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.057+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd680124c20 con 0x7fd68009f350 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.057+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd67403f8c0 con 0x7fd68009f350 2023-10-03T10:15:33.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.066+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd674013720 con 0x7fd68009f350 2023-10-03T10:15:33.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.220+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff834072d60 con 0x7ff83409e870 2023-10-03T10:15:33.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.220+0000 7ff8317fa700 1 -- 172.21.15.125:0/2821231385 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff828019890 con 0x7ff83409e870 2023-10-03T10:15:33.221 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 msgr2=0x7ff834120920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 0x7ff834120920 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c490 tx=0x7ff82800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 shutdown_connections 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff834139480 0x7ff8341213a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff83409e870 0x7ff834120920 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 --2- 172.21.15.125:0/2821231385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff83409f350 0x7ff834120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 >> 172.21.15.125:0/2821231385 conn(0x7ff8340a4430 msgr2=0x7ff8340a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 shutdown_connections 2023-10-03T10:15:33.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.222+0000 7ff83ae7f700 1 -- 172.21.15.125:0/2821231385 wait complete. 2023-10-03T10:15:33.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.261+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd68004f2a0 con 0x7fd68009f350 2023-10-03T10:15:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.261+0000 7fd67cff9700 1 -- 172.21.15.125:0/4244927906 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd67401bb60 con 0x7fd68009f350 2023-10-03T10:15:33.261 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 msgr2=0x7fd680120e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd67400ec10 tx=0x7fd67400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 shutdown_connections 2023-10-03T10:15:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd680139410 0x7fd6801213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd68009e870 0x7fd680120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 --2- 172.21.15.125:0/4244927906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68009f350 0x7fd680120e70 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 >> 172.21.15.125:0/4244927906 conn(0x7fd6800a4430 msgr2=0x7fd680070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 shutdown_connections 2023-10-03T10:15:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.263+0000 7fd6866a7700 1 -- 172.21.15.125:0/4244927906 wait complete. 2023-10-03T10:15:33.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:33.314 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:33.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.441+0000 7f647a25c700 1 Processor -- start 2023-10-03T10:15:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.441+0000 7f647a25c700 1 -- start start 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f647a25c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647409ad40 0x7f6474133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f647a25c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f647a25c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647409b110 con 0x7f6474133f70 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f647a25c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740a3b60 con 0x7f647409ad40 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f647a25c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6474134850 con 0x7f64741343d0 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647409ad40 0x7f6474133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f6473fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647409ad40 0x7f6474133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45840/0 (socket says 172.21.15.125:45840) 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f6473fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51420/0 (socket says 172.21.15.125:51420) 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 -- 172.21.15.125:0/1222845537 learned_addr learned my addr 172.21.15.125:0/1222845537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 -- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 msgr2=0x7f64740a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 -- 172.21.15.125:0/1222845537 >> v1:172.21.15.125:6789/0 conn(0x7f6474133f70 legacy=0x7f64740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 -- 172.21.15.125:0/1222845537 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740a2fa0 con 0x7f647409ad40 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f6472ffd700 1 -- 172.21.15.125:0/1222845537 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126574818 0 0) 0x7f647409b110 con 0x7f6474133f70 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f6473fff700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.442+0000 7f64737fe700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647409ad40 0x7f6474133a30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f64640098f0 tx=0x7f6464009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a955e1e2656ceddc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f6472ffd700 1 -- 172.21.15.125:0/1222845537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011830 con 0x7f647409ad40 2023-10-03T10:15:33.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f6472ffd700 1 -- 172.21.15.125:0/1222845537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464011990 con 0x7f647409ad40 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f6472ffd700 1 -- 172.21.15.125:0/1222845537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011d20 con 0x7f647409ad40 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 -- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647409ad40 msgr2=0x7f6474133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647409ad40 0x7f6474133a30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f64640098f0 tx=0x7f6464009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 -- 172.21.15.125:0/1222845537 shutdown_connections 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64741343d0 0x7f64740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 --2- 172.21.15.125:0/1222845537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647409ad40 0x7f6474133a30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 -- 172.21.15.125:0/1222845537 >> 172.21.15.125:0/1222845537 conn(0x7f6474099c40 msgr2=0x7f647406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 -- 172.21.15.125:0/1222845537 shutdown_connections 2023-10-03T10:15:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.443+0000 7f647a25c700 1 -- 172.21.15.125:0/1222845537 wait complete. 2023-10-03T10:15:33.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.444+0000 7f647a25c700 1 Processor -- start 2023-10-03T10:15:33.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.444+0000 7f647a25c700 1 -- start start 2023-10-03T10:15:33.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f647409ad40 0x7f647411f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474133f70 0x7f647411fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647411f140 con 0x7f64741343d0 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6474133790 con 0x7f6474133f70 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6474133550 con 0x7f647409ad40 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f646bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474133f70 0x7f647411fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f64737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f647409ad40 0x7f647411f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45848/0 (socket says 172.21.15.125:45848) 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 -- 172.21.15.125:0/3008987346 learned_addr learned my addr 172.21.15.125:0/3008987346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 -- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f647409ad40 msgr2=0x7f647411f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f647409ad40 0x7f647411f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 -- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474133f70 msgr2=0x7f647411fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474133f70 0x7f647411fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 -- 172.21.15.125:0/3008987346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009a70 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6473fff700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f646c00efc0 tx=0x7f646c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00ca90 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c00f040 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464009550 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.445+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00ce10 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.446+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64741207d0 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.446+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f646c014480 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.447+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f646c03fcc0 con 0x7f64741343d0 2023-10-03T10:15:33.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.447+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647404f2a0 con 0x7f64741343d0 2023-10-03T10:15:33.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.451+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f646c012700 con 0x7f64741343d0 2023-10-03T10:15:33.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 Processor -- start 2023-10-03T10:15:33.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 -- start start 2023-10-03T10:15:33.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57009e9d0 con 0x7fc5700a0a70 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57009dc00 con 0x7fc570139200 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc576de1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57009dec0 con 0x7fc5700a1550 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc57537e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc56ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc57537e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45854/0 (socket says 172.21.15.125:45854) 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.485+0000 7fc574b7d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc5700a0a70 0x7fc5700a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50914/0 (socket says 172.21.15.125:50914) 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47626/0 (socket says 172.21.15.125:47626) 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc57537e700 1 -- 172.21.15.125:0/93669712 learned_addr learned my addr 172.21.15.125:0/93669712 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 -- 172.21.15.125:0/93669712 >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 msgr2=0x7fc57013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 --2- 172.21.15.125:0/93669712 >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 -- 172.21.15.125:0/93669712 >> v1:172.21.15.125:6789/0 conn(0x7fc5700a0a70 legacy=0x7fc5700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 -- 172.21.15.125:0/93669712 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57009e6a0 con 0x7fc5700a1550 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc57537e700 1 --2- 172.21.15.125:0/93669712 >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56ffff700 1 --2- 172.21.15.125:0/93669712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009840 tx=0x7fc55c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba0f97e3433e1e4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56f7fe700 1 -- 172.21.15.125:0/93669712 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011830 con 0x7fc5700a1550 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56f7fe700 1 -- 172.21.15.125:0/93669712 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c011990 con 0x7fc5700a1550 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.486+0000 7fc56f7fe700 1 -- 172.21.15.125:0/93669712 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011d20 con 0x7fc5700a1550 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 -- 172.21.15.125:0/93669712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 msgr2=0x7fc570138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 --2- 172.21.15.125:0/93669712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009840 tx=0x7fc55c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 -- 172.21.15.125:0/93669712 shutdown_connections 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 --2- 172.21.15.125:0/93669712 >> v2:172.21.15.125:3300/0 conn(0x7fc570139200 0x7fc57013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 --2- 172.21.15.125:0/93669712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc570138cc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 -- 172.21.15.125:0/93669712 >> 172.21.15.125:0/93669712 conn(0x7fc5700a6610 msgr2=0x7fc5700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 -- 172.21.15.125:0/93669712 shutdown_connections 2023-10-03T10:15:33.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.487+0000 7fc576de1700 1 -- 172.21.15.125:0/93669712 wait complete. 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 Processor -- start 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 -- start start 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 0x7fc57011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701224a0 con 0x7fc570139200 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701220a0 con 0x7fc5700a1550 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc576de1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc570121af0 con 0x7fc5700a0a70 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc574b7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc56ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc57537e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 0x7fc57011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc574b7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51434/0 (socket says 172.21.15.125:51434) 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc574b7d700 1 -- 172.21.15.125:0/820433331 learned_addr learned my addr 172.21.15.125:0/820433331 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc57537e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 0x7fc57011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45856/0 (socket says 172.21.15.125:45856) 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.488+0000 7fc56ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47632/0 (socket says 172.21.15.125:47632) 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 -- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 msgr2=0x7fc57011eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 -- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 msgr2=0x7fc57011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 0x7fc57011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 -- 172.21.15.125:0/820433331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009b30 con 0x7fc5700a0a70 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc56ffff700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc574b7d700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c520 tx=0x7fc56400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564005cb0 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564005e10 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c0094a0 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640072d0 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.489+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc570120580 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.490+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc564007430 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.490+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc56403ea10 con 0x7fc5700a0a70 2023-10-03T10:15:33.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.490+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57004f2a0 con 0x7fc5700a0a70 2023-10-03T10:15:33.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.495+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc564017070 con 0x7fc5700a0a70 2023-10-03T10:15:33.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.645+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6474120d50 con 0x7f64741343d0 2023-10-03T10:15:33.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.645+0000 7f6470ff9700 1 -- 172.21.15.125:0/3008987346 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f646c02a090 con 0x7f64741343d0 2023-10-03T10:15:33.646 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:33.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 msgr2=0x7f64741c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f646c00efc0 tx=0x7f646c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 shutdown_connections 2023-10-03T10:15:33.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64741343d0 0x7f64741c8230 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f647409ad40 0x7f647411f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 --2- 172.21.15.125:0/3008987346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474133f70 0x7f647411fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 >> 172.21.15.125:0/3008987346 conn(0x7f6474099c40 msgr2=0x7f64740a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 shutdown_connections 2023-10-03T10:15:33.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.648+0000 7f647a25c700 1 -- 172.21.15.125:0/3008987346 wait complete. 2023-10-03T10:15:33.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:33.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.689+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc570121d40 con 0x7fc5700a0a70 2023-10-03T10:15:33.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.689+0000 7fc56d7fa700 1 -- 172.21.15.125:0/820433331 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc570121d40 con 0x7fc5700a0a70 2023-10-03T10:15:33.690 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 msgr2=0x7fc57011e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c520 tx=0x7fc56400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 shutdown_connections 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc570139200 0x7fc57011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5700a0a70 0x7fc57011e860 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 --2- 172.21.15.125:0/820433331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5700a1550 0x7fc57011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 >> 172.21.15.125:0/820433331 conn(0x7fc5700a6610 msgr2=0x7fc5701381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 shutdown_connections 2023-10-03T10:15:33.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:33.691+0000 7fc576de1700 1 -- 172.21.15.125:0/820433331 wait complete. 2023-10-03T10:15:33.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:34.236 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:34.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:34.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.365+0000 7faf60deb700 1 Processor -- start 2023-10-03T10:15:34.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.365+0000 7faf60deb700 1 -- start start 2023-10-03T10:15:34.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf60deb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 0x7faf5c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf60deb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf60deb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c09c970 con 0x7faf5c131d70 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf60deb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0a0920 con 0x7faf5c09e870 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf60deb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c09f9c0 con 0x7faf5c09f180 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf5a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 0x7faf5c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51438/0 (socket says 172.21.15.125:51438) 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 -- 172.21.15.125:0/717368646 learned_addr learned my addr 172.21.15.125:0/717368646 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 -- 172.21.15.125:0/717368646 >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 msgr2=0x7faf5c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 --2- 172.21.15.125:0/717368646 >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 0x7faf5c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 -- 172.21.15.125:0/717368646 >> v1:172.21.15.125:6789/0 conn(0x7faf5c131d70 legacy=0x7faf5c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 -- 172.21.15.125:0/717368646 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c09bab0 con 0x7faf5c09f180 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf5959a700 1 -- 172.21.15.125:0/717368646 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577050627 0 0) 0x7faf5c09c970 con 0x7faf5c131d70 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf5a59c700 1 --2- 172.21.15.125:0/717368646 >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 0x7faf5c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.366+0000 7faf59d9b700 1 --2- 172.21.15.125:0/717368646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf500098f0 tx=0x7faf50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b628a271f2e212fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf5959a700 1 -- 172.21.15.125:0/717368646 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50011830 con 0x7faf5c09f180 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf5959a700 1 -- 172.21.15.125:0/717368646 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50011990 con 0x7faf5c09f180 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf5959a700 1 -- 172.21.15.125:0/717368646 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50011d20 con 0x7faf5c09f180 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 -- 172.21.15.125:0/717368646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 msgr2=0x7faf5c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 --2- 172.21.15.125:0/717368646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf500098f0 tx=0x7faf50009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 -- 172.21.15.125:0/717368646 shutdown_connections 2023-10-03T10:15:34.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 --2- 172.21.15.125:0/717368646 >> v2:172.21.15.125:3300/0 conn(0x7faf5c09e870 0x7faf5c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 --2- 172.21.15.125:0/717368646 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09f180 0x7faf5c131830 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 -- 172.21.15.125:0/717368646 >> 172.21.15.125:0/717368646 conn(0x7faf5c0a4430 msgr2=0x7faf5c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 -- 172.21.15.125:0/717368646 shutdown_connections 2023-10-03T10:15:34.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.367+0000 7faf60deb700 1 -- 172.21.15.125:0/717368646 wait complete. 2023-10-03T10:15:34.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.368+0000 7faf60deb700 1 Processor -- start 2023-10-03T10:15:34.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.368+0000 7faf60deb700 1 -- start start 2023-10-03T10:15:34.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c09f180 0x7faf5c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 0x7faf5c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c06d580 con 0x7faf5c09f180 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c124d00 con 0x7faf5c131d70 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf60deb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c09b160 con 0x7faf5c09e870 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51440/0 (socket says 172.21.15.125:51440) 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 -- 172.21.15.125:0/676393418 learned_addr learned my addr 172.21.15.125:0/676393418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5ad9d700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 0x7faf5c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf59d9b700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c09f180 0x7faf5c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 -- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 msgr2=0x7faf5c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 0x7faf5c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 -- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c09f180 msgr2=0x7faf5c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c09f180 0x7faf5c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 -- 172.21.15.125:0/676393418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0094a0 con 0x7faf5c09e870 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5ad9d700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 0x7faf5c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.369+0000 7faf5a59c700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ebe0 tx=0x7faf4c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.370+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c009760 con 0x7faf5c09e870 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.370+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00c850 con 0x7faf5c09e870 2023-10-03T10:15:34.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.370+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00cbe0 con 0x7faf5c09e870 2023-10-03T10:15:34.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.370+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf50009550 con 0x7faf5c09e870 2023-10-03T10:15:34.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.370+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1238c0 con 0x7faf5c09e870 2023-10-03T10:15:34.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.371+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf4c00cd40 con 0x7faf5c09e870 2023-10-03T10:15:34.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.371+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf4c03f710 con 0x7faf5c09e870 2023-10-03T10:15:34.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.371+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c04f2a0 con 0x7faf5c09e870 2023-10-03T10:15:34.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.379+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf4c0232f0 con 0x7faf5c09e870 2023-10-03T10:15:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.409+0000 7f8310640700 1 Processor -- start 2023-10-03T10:15:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 -- start start 2023-10-03T10:15:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 0x7f830809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f8308138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830809aaa0 con 0x7f830809e170 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830809f870 con 0x7f830809d860 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f8310640700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830809b360 con 0x7f8308130eb0 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f830ebdd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f8308138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f830dbdb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f830809e170 0x7f83081307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50940/0 (socket says 172.21.15.125:50940) 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f830dbdb700 1 -- 172.21.15.125:0/638505991 learned_addr learned my addr 172.21.15.125:0/638505991 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.410+0000 7f830e3dc700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 0x7f830809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830ebdd700 1 -- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 msgr2=0x7f830809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830ebdd700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 0x7f830809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830ebdd700 1 -- 172.21.15.125:0/638505991 >> v1:172.21.15.125:6789/0 conn(0x7f830809e170 legacy=0x7f83081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830ebdd700 1 -- 172.21.15.125:0/638505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830809b620 con 0x7f8308130eb0 2023-10-03T10:15:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830d3da700 1 -- 172.21.15.125:0/638505991 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830228050 0 0) 0x7f830809aaa0 con 0x7f830809e170 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830e3dc700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 0x7f830809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830ebdd700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f8308138a00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8300009dc0 tx=0x7f830000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3806e86ebaf0b9db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830d3da700 1 -- 172.21.15.125:0/638505991 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000e070 con 0x7f8308130eb0 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830d3da700 1 -- 172.21.15.125:0/638505991 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000bb20 con 0x7f8308130eb0 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.411+0000 7f830d3da700 1 -- 172.21.15.125:0/638505991 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300012430 con 0x7f8308130eb0 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 -- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 msgr2=0x7f8308138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f8308138a00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8300009dc0 tx=0x7f830000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 -- 172.21.15.125:0/638505991 shutdown_connections 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f8308138a00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 --2- 172.21.15.125:0/638505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809d860 0x7f830809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 -- 172.21.15.125:0/638505991 >> 172.21.15.125:0/638505991 conn(0x7f8308099c40 msgr2=0x7f83080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 -- 172.21.15.125:0/638505991 shutdown_connections 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.412+0000 7f8310640700 1 -- 172.21.15.125:0/638505991 wait complete. 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 Processor -- start 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 -- start start 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 0x7f830811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809e170 0x7f830811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308122c20 con 0x7f830809d860 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8308121100 con 0x7f830809e170 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f8310640700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83080a0740 con 0x7f8308130eb0 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830e3dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 0x7f830811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51458/0 (socket says 172.21.15.125:51458) 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830e3dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 0x7f830811f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45874/0 (socket says 172.21.15.125:45874) 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 -- 172.21.15.125:0/1067215121 learned_addr learned my addr 172.21.15.125:0/1067215121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830dbdb700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809e170 0x7f830811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 -- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809e170 msgr2=0x7f830811f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809e170 0x7f830811f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 -- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 msgr2=0x7f830811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 0x7f830811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.413+0000 7f830ebdd700 1 -- 172.21.15.125:0/1067215121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80094a0 con 0x7f8308130eb0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f830ebdd700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8300014040 tx=0x7f8300004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300012430 con 0x7f8308130eb0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300020070 con 0x7f8308130eb0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8300009a70 con 0x7f8308130eb0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300004280 con 0x7f8308130eb0 2023-10-03T10:15:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.414+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830809c910 con 0x7f8308130eb0 2023-10-03T10:15:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.415+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830804f2a0 con 0x7f8308130eb0 2023-10-03T10:15:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.415+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83000043e0 con 0x7f8308130eb0 2023-10-03T10:15:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.415+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8300022070 con 0x7f8308130eb0 2023-10-03T10:15:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.420+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8300011d60 con 0x7f8308130eb0 2023-10-03T10:15:34.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.577+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf5c131b50 con 0x7faf5c09e870 2023-10-03T10:15:34.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.577+0000 7faf4affd700 1 -- 172.21.15.125:0/676393418 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf4c021030 con 0x7faf5c09e870 2023-10-03T10:15:34.578 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:34.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 msgr2=0x7faf5c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ebe0 tx=0x7faf4c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 shutdown_connections 2023-10-03T10:15:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c131d70 0x7faf5c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faf5c09e870 0x7faf5c06b880 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 --2- 172.21.15.125:0/676393418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c09f180 0x7faf5c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 >> 172.21.15.125:0/676393418 conn(0x7faf5c0a4430 msgr2=0x7faf5c131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 shutdown_connections 2023-10-03T10:15:34.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.580+0000 7faf60deb700 1 -- 172.21.15.125:0/676393418 wait complete. 2023-10-03T10:15:34.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:34.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.617+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f830806c3b0 con 0x7f8308130eb0 2023-10-03T10:15:34.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.617+0000 7f82feffd700 1 -- 172.21.15.125:0/1067215121 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8300035090 con 0x7f8308130eb0 2023-10-03T10:15:34.617 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 msgr2=0x7f830811ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8300014040 tx=0x7f8300004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 shutdown_connections 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8308130eb0 0x7f830811ff00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f830809d860 0x7f830811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 --2- 172.21.15.125:0/1067215121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f830809e170 0x7f830811f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 >> 172.21.15.125:0/1067215121 conn(0x7f8308099c40 msgr2=0x7f8308119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 shutdown_connections 2023-10-03T10:15:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.619+0000 7f8310640700 1 -- 172.21.15.125:0/1067215121 wait complete. 2023-10-03T10:15:34.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:34.666 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:34.705 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:34.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.797+0000 7effddbb6700 1 Processor -- start 2023-10-03T10:15:34.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 -- start start 2023-10-03T10:15:34.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd809dc00 con 0x7effd8133f50 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd809ea60 con 0x7effd80a0a70 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effddbb6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd809dec0 con 0x7effd80a1380 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effd77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47670/0 (socket says 172.21.15.125:47670) 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effd77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45878/0 (socket says 172.21.15.125:45878) 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effceffd700 1 -- 172.21.15.125:0/827697222 learned_addr learned my addr 172.21.15.125:0/827697222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.798+0000 7effd7fff700 1 --1- 172.21.15.125:0/827697222 >> v1:172.21.15.125:6789/0 conn(0x7effd8133f50 0x7effd813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:50948/0 (socket says 172.21.15.125:50948) 2023-10-03T10:15:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effceffd700 1 -- 172.21.15.125:0/827697222 >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 msgr2=0x7effd80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effceffd700 1 --2- 172.21.15.125:0/827697222 >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effceffd700 1 -- 172.21.15.125:0/827697222 >> v1:172.21.15.125:6789/0 conn(0x7effd8133f50 legacy=0x7effd813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effceffd700 1 -- 172.21.15.125:0/827697222 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd809e6a0 con 0x7effd80a1380 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effd6ffd700 1 -- 172.21.15.125:0/827697222 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500488725 0 0) 0x7effd809dc00 con 0x7effd8133f50 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effd77fe700 1 --2- 172.21.15.125:0/827697222 >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effceffd700 1 --2- 172.21.15.125:0/827697222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7effc00098f0 tx=0x7effc0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efa23f76cb640557 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effd6ffd700 1 -- 172.21.15.125:0/827697222 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0011830 con 0x7effd80a1380 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effd6ffd700 1 -- 172.21.15.125:0/827697222 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0011990 con 0x7effd80a1380 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.799+0000 7effd6ffd700 1 -- 172.21.15.125:0/827697222 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0011d20 con 0x7effd80a1380 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 -- 172.21.15.125:0/827697222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 msgr2=0x7effd8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 --2- 172.21.15.125:0/827697222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7effc00098f0 tx=0x7effc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 -- 172.21.15.125:0/827697222 shutdown_connections 2023-10-03T10:15:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 --2- 172.21.15.125:0/827697222 >> v2:172.21.15.125:3300/0 conn(0x7effd80a0a70 0x7effd80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 --2- 172.21.15.125:0/827697222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd8133a10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 -- 172.21.15.125:0/827697222 >> 172.21.15.125:0/827697222 conn(0x7effd80a6610 msgr2=0x7effd80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 -- 172.21.15.125:0/827697222 shutdown_connections 2023-10-03T10:15:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.800+0000 7effddbb6700 1 -- 172.21.15.125:0/827697222 wait complete. 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 Processor -- start 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 -- start start 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 0x7effd81c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd8133f50 0x7effd81c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8122320 con 0x7effd80a0a70 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8120660 con 0x7effd80a1380 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effddbb6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd80a17b0 con 0x7effd8133f50 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effd77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 0x7effd81c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47674/0 (socket says 172.21.15.125:47674) 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effceffd700 1 -- 172.21.15.125:0/672446847 learned_addr learned my addr 172.21.15.125:0/672446847 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.801+0000 7effd7fff700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd8133f50 0x7effd81c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 -- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd8133f50 msgr2=0x7effd81c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd8133f50 0x7effd81c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 -- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 msgr2=0x7effd81c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 0x7effd81c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 -- 172.21.15.125:0/672446847 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80094a0 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effd77fe700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 0x7effd81c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effceffd700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7effc0009c40 tx=0x7effc0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0004510 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00036a0 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc0009550 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0003a50 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.802+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd8120e50 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.803+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effc0021070 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.803+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd804f2a0 con 0x7effd80a1380 2023-10-03T10:15:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.803+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effc0040cf0 con 0x7effd80a1380 2023-10-03T10:15:34.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.808+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effc000b3e0 con 0x7effd80a1380 2023-10-03T10:15:34.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 Processor -- start 2023-10-03T10:15:34.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 -- start start 2023-10-03T10:15:34.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5809e9d0 con 0x7f5a580a0a70 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809dc00 con 0x7f5a580a1550 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5d082700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809dec0 con 0x7f5a58139200 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51480/0 (socket says 172.21.15.125:51480) 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47676/0 (socket says 172.21.15.125:47676) 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.843+0000 7f5a5759e700 1 -- 172.21.15.125:0/1889794943 learned_addr learned my addr 172.21.15.125:0/1889794943 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5659c700 1 -- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 msgr2=0x7f5a5813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5659c700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5659c700 1 -- 172.21.15.125:0/1889794943 >> v1:172.21.15.125:6789/0 conn(0x7f5a580a0a70 legacy=0x7f5a580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5659c700 1 -- 172.21.15.125:0/1889794943 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5809e6a0 con 0x7f5a580a1550 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a55d9b700 1 -- 172.21.15.125:0/1889794943 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490603833 0 0) 0x7f5a5809e9d0 con 0x7f5a580a0a70 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5759e700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a5659c700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009870 tx=0x7f5a4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45fdf07c2d78463c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a55d9b700 1 -- 172.21.15.125:0/1889794943 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c011830 con 0x7f5a580a1550 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a55d9b700 1 -- 172.21.15.125:0/1889794943 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c011990 con 0x7f5a580a1550 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.844+0000 7f5a55d9b700 1 -- 172.21.15.125:0/1889794943 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c011d20 con 0x7f5a580a1550 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 -- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 msgr2=0x7f5a58138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009870 tx=0x7f5a4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:34.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 -- 172.21.15.125:0/1889794943 shutdown_connections 2023-10-03T10:15:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 --2- 172.21.15.125:0/1889794943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a1550 0x7f5a58138cc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 -- 172.21.15.125:0/1889794943 >> 172.21.15.125:0/1889794943 conn(0x7f5a580a6610 msgr2=0x7f5a580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 -- 172.21.15.125:0/1889794943 shutdown_connections 2023-10-03T10:15:34.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.845+0000 7f5a5d082700 1 -- 172.21.15.125:0/1889794943 wait complete. 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 Processor -- start 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 -- start start 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a0a70 0x7f5a58120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 0x7f5a58120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58123e10 con 0x7f5a580a1550 2023-10-03T10:15:34.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a580a5100 con 0x7f5a580a0a70 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5d082700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a580a03e0 con 0x7f5a58139200 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a56d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a0a70 0x7f5a58120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51486/0 (socket says 172.21.15.125:51486) 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.846+0000 7f5a5759e700 1 -- 172.21.15.125:0/423393987 learned_addr learned my addr 172.21.15.125:0/423393987 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5659c700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 0x7f5a58120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 -- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a0a70 msgr2=0x7f5a58120850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a0a70 0x7f5a58120850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 -- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 msgr2=0x7f5a58120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 0x7f5a58120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 -- 172.21.15.125:0/423393987 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50009b30 con 0x7f5a58139200 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5659c700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 0x7f5a58120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:34.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5759e700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000ef90 tx=0x7f5a5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50018070 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50003c60 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c0094a0 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.847+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a58123ff0 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.848+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a5000c930 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.848+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a5003f830 con 0x7f5a58139200 2023-10-03T10:15:34.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.848+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a58123c40 con 0x7f5a58139200 2023-10-03T10:15:34.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:34.853+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a50003dc0 con 0x7f5a58139200 2023-10-03T10:15:35.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.003+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7effd80a5660 con 0x7effd80a1380 2023-10-03T10:15:35.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.003+0000 7effd4ff9700 1 -- 172.21.15.125:0/672446847 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc0015070 con 0x7effd80a1380 2023-10-03T10:15:35.004 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 msgr2=0x7effd81c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7effc0009c40 tx=0x7effc0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 shutdown_connections 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd8133f50 0x7effd81c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd80a0a70 0x7effd81c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 --2- 172.21.15.125:0/672446847 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd80a1380 0x7effd81c89a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 >> 172.21.15.125:0/672446847 conn(0x7effd80a6610 msgr2=0x7effd80a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 shutdown_connections 2023-10-03T10:15:35.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.005+0000 7effddbb6700 1 -- 172.21.15.125:0/672446847 wait complete. 2023-10-03T10:15:35.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:35.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.045+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a5804f2a0 con 0x7f5a58139200 2023-10-03T10:15:35.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.045+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/423393987 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a5001cb70 con 0x7f5a58139200 2023-10-03T10:15:35.088 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 msgr2=0x7f5a581212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000ef90 tx=0x7f5a5000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 shutdown_connections 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a58139200 0x7f5a581212d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a580a0a70 0x7f5a58120850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 --2- 172.21.15.125:0/423393987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a580a1550 0x7f5a58120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 >> 172.21.15.125:0/423393987 conn(0x7f5a580a6610 msgr2=0x7f5a580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 shutdown_connections 2023-10-03T10:15:35.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.047+0000 7f5a5d082700 1 -- 172.21.15.125:0/423393987 wait complete. 2023-10-03T10:15:35.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:35.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:35.632 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.725+0000 7ffa899c3700 1 Processor -- start 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.725+0000 7ffa899c3700 1 -- start start 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa84133f50 0x7ffa841343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8409e9d0 con 0x7ffa84133f50 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8409dc00 con 0x7ffa840a0a70 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa899c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8409dec0 con 0x7ffa840a1380 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa82ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa827fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa82ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53910/0 (socket says 172.21.15.125:53910) 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa827fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36030/0 (socket says 172.21.15.125:36030) 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa82ffd700 1 -- 172.21.15.125:0/4122141856 learned_addr learned my addr 172.21.15.125:0/4122141856 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 --2- 172.21.15.125:0/4122141856 >> v2:172.21.15.125:3300/0 conn(0x7ffa84133f50 0x7ffa841343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 -- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 msgr2=0x7ffa84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 -- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 msgr2=0x7ffa840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 -- 172.21.15.125:0/4122141856 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8409e6a0 con 0x7ffa84133f50 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa827fc700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa82ffd700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.726+0000 7ffa837fe700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa84133f50 0x7ffa841343f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9d8818b62fec59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa81ffb700 1 -- 172.21.15.125:0/4122141856 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00e070 con 0x7ffa84133f50 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa81ffb700 1 -- 172.21.15.125:0/4122141856 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00bb20 con 0x7ffa84133f50 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa81ffb700 1 -- 172.21.15.125:0/4122141856 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c012430 con 0x7ffa84133f50 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 -- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa84133f50 msgr2=0x7ffa841343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa84133f50 0x7ffa841343f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 -- 172.21.15.125:0/4122141856 shutdown_connections 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa840a0a70 0x7ffa840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa84133f50 0x7ffa841343f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4122141856 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa84133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 -- 172.21.15.125:0/4122141856 >> 172.21.15.125:0/4122141856 conn(0x7ffa840a6610 msgr2=0x7ffa840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 -- 172.21.15.125:0/4122141856 shutdown_connections 2023-10-03T10:15:35.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.727+0000 7ffa899c3700 1 -- 172.21.15.125:0/4122141856 wait complete. 2023-10-03T10:15:35.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.728+0000 7ffa899c3700 1 Processor -- start 2023-10-03T10:15:35.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.728+0000 7ffa899c3700 1 -- start start 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa84133f50 0x7ffa841c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84120fa0 con 0x7ffa840a0a70 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841336d0 con 0x7ffa84133f50 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa899c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8411f200 con 0x7ffa840a1380 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa827fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa827fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36032/0 (socket says 172.21.15.125:36032) 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa827fc700 1 -- 172.21.15.125:0/4229890589 learned_addr learned my addr 172.21.15.125:0/4229890589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47462/0 (socket says 172.21.15.125:47462) 2023-10-03T10:15:35.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa837fe700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa84133f50 0x7ffa841c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 -- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 msgr2=0x7ffa8411fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 -- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa84133f50 msgr2=0x7ffa841c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa84133f50 0x7ffa841c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 -- 172.21.15.125:0/4229890589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009550 con 0x7ffa840a0a70 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa827fc700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.729+0000 7ffa82ffd700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e9e0 tx=0x7ffa7400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.730+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400c640 con 0x7ffa840a0a70 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.730+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400c7a0 con 0x7ffa840a0a70 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.730+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400cb30 con 0x7ffa840a0a70 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.730+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa780094a0 con 0x7ffa840a0a70 2023-10-03T10:15:35.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.730+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c009a70 con 0x7ffa840a0a70 2023-10-03T10:15:35.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.731+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa74013470 con 0x7ffa840a0a70 2023-10-03T10:15:35.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.731+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa7403f8e0 con 0x7ffa840a0a70 2023-10-03T10:15:35.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.731+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa84122610 con 0x7ffa840a0a70 2023-10-03T10:15:35.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.735+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa74013720 con 0x7ffa840a0a70 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.764+0000 7f8387694700 1 Processor -- start 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.764+0000 7f8387694700 1 -- start start 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.764+0000 7f8387694700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8387694700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8387694700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8387694700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838009e9d0 con 0x7f83800a0a70 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8387694700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838009dc00 con 0x7f83800a1380 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8387694700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838009dec0 con 0x7f8380133f50 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385c31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8384c2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385c31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36048/0 (socket says 172.21.15.125:36048) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8384c2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53924/0 (socket says 172.21.15.125:53924) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47478/0 (socket says 172.21.15.125:47478) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385c31700 1 -- 172.21.15.125:0/1959892196 learned_addr learned my addr 172.21.15.125:0/1959892196 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 -- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 msgr2=0x7f83801343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 -- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 msgr2=0x7f8380133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 -- 172.21.15.125:0/1959892196 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838009e6a0 con 0x7f83800a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8384c2f700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385c31700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8385430700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f837c009840 tx=0x7f837c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14575d1e95e7dcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8377fff700 1 -- 172.21.15.125:0/1959892196 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011830 con 0x7f83800a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8377fff700 1 -- 172.21.15.125:0/1959892196 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c011990 con 0x7f83800a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.765+0000 7f8377fff700 1 -- 172.21.15.125:0/1959892196 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011d20 con 0x7f83800a0a70 2023-10-03T10:15:35.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 -- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 msgr2=0x7f83800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f837c009840 tx=0x7f837c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 -- 172.21.15.125:0/1959892196 shutdown_connections 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f83801343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a0a70 0x7f83800a0e40 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 --2- 172.21.15.125:0/1959892196 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a1380 0x7f8380133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 -- 172.21.15.125:0/1959892196 >> 172.21.15.125:0/1959892196 conn(0x7f83800a6610 msgr2=0x7f83800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 -- 172.21.15.125:0/1959892196 shutdown_connections 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.766+0000 7f8387694700 1 -- 172.21.15.125:0/1959892196 wait complete. 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 Processor -- start 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 -- start start 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f8380122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380132900 con 0x7f83800a1380 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8380123fd0 con 0x7f83800a0a70 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8387694700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8380124ab0 con 0x7f8380133f50 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8384c2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8385c31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f8380122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8384c2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47482/0 (socket says 172.21.15.125:47482) 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8384c2f700 1 -- 172.21.15.125:0/3634571580 learned_addr learned my addr 172.21.15.125:0/3634571580 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.768+0000 7f8385430700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 -- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 msgr2=0x7f8380121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 -- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 msgr2=0x7f8380121ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 -- 172.21.15.125:0/3634571580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700094a0 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8384c2f700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8385c31700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f8380122000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8378009e50 tx=0x7f837800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378018070 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800f040 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8378009b30 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378003c40 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.769+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c0094a0 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.770+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f837800c880 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.770+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f837803f670 con 0x7f8380133f50 2023-10-03T10:15:35.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.770+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838011e040 con 0x7f8380133f50 2023-10-03T10:15:35.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.775+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8378012340 con 0x7f8380133f50 2023-10-03T10:15:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.931+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa8404f2a0 con 0x7ffa840a0a70 2023-10-03T10:15:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.931+0000 7ffa6bfff700 1 -- 172.21.15.125:0/4229890589 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa7401b3b0 con 0x7ffa840a0a70 2023-10-03T10:15:35.932 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:35.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.933+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 msgr2=0x7ffa8411f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e9e0 tx=0x7ffa7400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 shutdown_connections 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa84133f50 0x7ffa841c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa840a0a70 0x7ffa8411f7a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 --2- 172.21.15.125:0/4229890589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ffa840a1380 0x7ffa8411fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 >> 172.21.15.125:0/4229890589 conn(0x7ffa840a6610 msgr2=0x7ffa8409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 shutdown_connections 2023-10-03T10:15:35.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.934+0000 7ffa899c3700 1 -- 172.21.15.125:0/4229890589 wait complete. 2023-10-03T10:15:35.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:35.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.969+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8380133a10 con 0x7f8380133f50 2023-10-03T10:15:35.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.969+0000 7f8375ffb700 1 -- 172.21.15.125:0/3634571580 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837801de00 con 0x7f8380133f50 2023-10-03T10:15:35.970 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 msgr2=0x7f8380122000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f8380122000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8378009e50 tx=0x7f837800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 shutdown_connections 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8380133f50 0x7f8380122000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83800a0a70 0x7f8380121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 --2- 172.21.15.125:0/3634571580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83800a1380 0x7f8380121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 >> 172.21.15.125:0/3634571580 conn(0x7f83800a6610 msgr2=0x7f83801332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 shutdown_connections 2023-10-03T10:15:35.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:35.971+0000 7f8387694700 1 -- 172.21.15.125:0/3634571580 wait complete. 2023-10-03T10:15:35.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:36.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:36.091 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.149+0000 7fd526f6d700 1 Processor -- start 2023-10-03T10:15:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.149+0000 7fd526f6d700 1 -- start start 2023-10-03T10:15:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd526f6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd526f6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd526f6d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52009b110 con 0x7fd520133f70 2023-10-03T10:15:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd526f6d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200a3b60 con 0x7fd52009ad40 2023-10-03T10:15:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd526f6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd520134850 con 0x7fd5201343d0 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd524d09700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36070/0 (socket says 172.21.15.125:36070) 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd524d09700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47484/0 (socket says 172.21.15.125:47484) 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd51ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd520133f70 0x7fd5200a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45136/0 (socket says 172.21.15.125:45136) 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 -- 172.21.15.125:0/230257365 learned_addr learned my addr 172.21.15.125:0/230257365 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 -- 172.21.15.125:0/230257365 >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 msgr2=0x7fd520133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 --2- 172.21.15.125:0/230257365 >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 -- 172.21.15.125:0/230257365 >> v1:172.21.15.125:6789/0 conn(0x7fd520133f70 legacy=0x7fd5200a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 -- 172.21.15.125:0/230257365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200a2fa0 con 0x7fd5201343d0 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd51f7fe700 1 -- 172.21.15.125:0/230257365 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975638609 0 0) 0x7fd52009b110 con 0x7fd520133f70 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd524d09700 1 --2- 172.21.15.125:0/230257365 >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.150+0000 7fd52550a700 1 --2- 172.21.15.125:0/230257365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd518009e50 tx=0x7fd51800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c8a5d8eedfbbc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd51f7fe700 1 -- 172.21.15.125:0/230257365 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800e070 con 0x7fd5201343d0 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd51f7fe700 1 -- 172.21.15.125:0/230257365 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800b910 con 0x7fd5201343d0 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd51f7fe700 1 -- 172.21.15.125:0/230257365 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800bcc0 con 0x7fd5201343d0 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 -- 172.21.15.125:0/230257365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 msgr2=0x7fd5200a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 --2- 172.21.15.125:0/230257365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd518009e50 tx=0x7fd51800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 -- 172.21.15.125:0/230257365 shutdown_connections 2023-10-03T10:15:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 --2- 172.21.15.125:0/230257365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5200a1180 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 --2- 172.21.15.125:0/230257365 >> v2:172.21.15.125:3300/0 conn(0x7fd52009ad40 0x7fd520133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 -- 172.21.15.125:0/230257365 >> 172.21.15.125:0/230257365 conn(0x7fd520099c40 msgr2=0x7fd52006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 -- 172.21.15.125:0/230257365 shutdown_connections 2023-10-03T10:15:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.151+0000 7fd526f6d700 1 -- 172.21.15.125:0/230257365 wait complete. 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.152+0000 7fd526f6d700 1 Processor -- start 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.152+0000 7fd526f6d700 1 -- start start 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 0x7fd52011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5201c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200a4230 con 0x7fd520133f70 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201223c0 con 0x7fd52009ad40 2023-10-03T10:15:36.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd526f6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd520133510 con 0x7fd5201343d0 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47500/0 (socket says 172.21.15.125:47500) 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd52550a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5201c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd524d09700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 0x7fd52011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 -- 172.21.15.125:0/1959688676 learned_addr learned my addr 172.21.15.125:0/1959688676 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 -- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 msgr2=0x7fd5201c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5201c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 -- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 msgr2=0x7fd52011f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 0x7fd52011f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 -- 172.21.15.125:0/1959688676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140094a0 con 0x7fd520133f70 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd524d09700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 0x7fd52011f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd52550a700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5201c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51ffff700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c580 tx=0x7fd50c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.153+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c004c80 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.154+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c004e00 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.154+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518009b30 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.154+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c007310 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.154+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520120f80 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.154+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520120850 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.155+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd50c007470 con 0x7fd520133f70 2023-10-03T10:15:36.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.155+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd50c03f8f0 con 0x7fd520133f70 2023-10-03T10:15:36.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.159+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd50c0133c0 con 0x7fd520133f70 2023-10-03T10:15:36.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.216+0000 7f3798066700 1 Processor -- start 2023-10-03T10:15:36.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 -- start start 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f3790131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3790131d70 0x7f3790132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900a0920 con 0x7f3790131d70 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379009c970 con 0x7f379009e870 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3798066700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379009bab0 con 0x7f379009f180 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3795601700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f3790131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3795e02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3796603700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3790131d70 0x7f3790132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3795e02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53938/0 (socket says 172.21.15.125:53938) 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3795601700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f3790131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36086/0 (socket says 172.21.15.125:36086) 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.217+0000 7f3795e02700 1 -- 172.21.15.125:0/3673806276 learned_addr learned my addr 172.21.15.125:0/3673806276 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 -- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 msgr2=0x7f3790131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f3790131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 -- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 msgr2=0x7f379009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 -- 172.21.15.125:0/3673806276 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379009f9c0 con 0x7f3790131d70 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3795e02700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3796603700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f3790132210 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3788009d90 tx=0x7f378800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c0d8adc0a7055 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3794e00700 1 -- 172.21.15.125:0/3673806276 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800e070 con 0x7f3790131d70 2023-10-03T10:15:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3794e00700 1 -- 172.21.15.125:0/3673806276 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800bb20 con 0x7f3790131d70 2023-10-03T10:15:36.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.218+0000 7f3794e00700 1 -- 172.21.15.125:0/3673806276 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788012430 con 0x7f3790131d70 2023-10-03T10:15:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 -- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 msgr2=0x7f3790132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f3790132210 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3788009d90 tx=0x7f378800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 -- 172.21.15.125:0/3673806276 shutdown_connections 2023-10-03T10:15:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f3790132210 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 --2- 172.21.15.125:0/3673806276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f3790131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 -- 172.21.15.125:0/3673806276 >> 172.21.15.125:0/3673806276 conn(0x7f37900a4430 msgr2=0x7f37900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 -- 172.21.15.125:0/3673806276 shutdown_connections 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.219+0000 7f3798066700 1 -- 172.21.15.125:0/3673806276 wait complete. 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 Processor -- start 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 -- start start 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379011fc60 con 0x7f3790131d70 2023-10-03T10:15:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3790120af0 con 0x7f379009e870 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3798066700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37901215d0 con 0x7f379009f180 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3795601700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3796603700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.220+0000 7f3795e02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47520/0 (socket says 172.21.15.125:47520) 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3795601700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36098/0 (socket says 172.21.15.125:36098) 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3795e02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53954/0 (socket says 172.21.15.125:53954) 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 -- 172.21.15.125:0/2273760912 learned_addr learned my addr 172.21.15.125:0/2273760912 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 -- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 msgr2=0x7f379011e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 -- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 msgr2=0x7f379011e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 -- 172.21.15.125:0/2273760912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c009550 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3795e02700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3795601700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3796603700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f379009c870 tx=0x7f3788004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788004930 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788020070 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3788009a70 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880276c0 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.221+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379009dba0 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.222+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3788012430 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.222+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3788022070 con 0x7f3790131d70 2023-10-03T10:15:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.222+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379004f2a0 con 0x7f3790131d70 2023-10-03T10:15:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.227+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f378801c400 con 0x7f3790131d70 2023-10-03T10:15:36.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.351+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd52004f2a0 con 0x7fd520133f70 2023-10-03T10:15:36.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.352+0000 7fd51d7fa700 1 -- 172.21.15.125:0/1959688676 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd50c011360 con 0x7fd520133f70 2023-10-03T10:15:36.352 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:36.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 msgr2=0x7fd52011f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c580 tx=0x7fd50c00c890 comp rx=0 tx=0).stop 2023-10-03T10:15:36.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 shutdown_connections 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5201343d0 0x7fd5201c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd52009ad40 0x7fd52011f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 --2- 172.21.15.125:0/1959688676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd520133f70 0x7fd52011f990 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 >> 172.21.15.125:0/1959688676 conn(0x7fd520099c40 msgr2=0x7fd5201bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 shutdown_connections 2023-10-03T10:15:36.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.354+0000 7fd526f6d700 1 -- 172.21.15.125:0/1959688676 wait complete. 2023-10-03T10:15:36.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:36.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.418+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f379006b2a0 con 0x7f3790131d70 2023-10-03T10:15:36.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.418+0000 7f37867fc700 1 -- 172.21.15.125:0/2273760912 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3788011390 con 0x7f3790131d70 2023-10-03T10:15:36.419 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 msgr2=0x7f379011eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f379009c870 tx=0x7f3788004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 shutdown_connections 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3790131d70 0x7f379011eb60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f379009e870 0x7f379011e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 --2- 172.21.15.125:0/2273760912 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f379009f180 0x7f379011e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 >> 172.21.15.125:0/2273760912 conn(0x7f37900a4430 msgr2=0x7f3790130100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 shutdown_connections 2023-10-03T10:15:36.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:36.420+0000 7f3798066700 1 -- 172.21.15.125:0/2273760912 wait complete. 2023-10-03T10:15:36.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:36.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:36.984 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:37.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 Processor -- start 2023-10-03T10:15:37.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 -- start start 2023-10-03T10:15:37.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 0x7f1fc4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc409dc00 con 0x7f1fc4133f50 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc409ea60 con 0x7f1fc40a0a70 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.075+0000 7f1fcb701700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc409dec0 con 0x7f1fc40a1380 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc9c9e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1fc4133f50 0x7f1fc413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45140/0 (socket says 172.21.15.125:45140) 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc9c9e700 1 -- 172.21.15.125:0/234356408 learned_addr learned my addr 172.21.15.125:0/234356408 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 0x7f1fc4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc949d700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fbbfff700 1 -- 172.21.15.125:0/234356408 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420423259 0 0) 0x7f1fc409dc00 con 0x7f1fc4133f50 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fbbfff700 1 -- 172.21.15.125:0/234356408 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb00035b0 con 0x7f1fc4133f50 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 -- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 msgr2=0x7f1fc40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 -- 172.21.15.125:0/234356408 >> v1:172.21.15.125:6789/0 conn(0x7f1fc4133f50 legacy=0x7f1fc413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 -- 172.21.15.125:0/234356408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc409e6a0 con 0x7f1fc40a1380 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc949d700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fc8c9c700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 0x7f1fc4133a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009870 tx=0x7f1fb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8151d2b0c07988b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fbbfff700 1 -- 172.21.15.125:0/234356408 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4011830 con 0x7f1fc40a1380 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fbbfff700 1 -- 172.21.15.125:0/234356408 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4011990 con 0x7f1fc40a1380 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.076+0000 7f1fbbfff700 1 -- 172.21.15.125:0/234356408 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4011d00 con 0x7f1fc40a1380 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 -- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 msgr2=0x7f1fc4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 0x7f1fc4133a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009870 tx=0x7f1fb4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 -- 172.21.15.125:0/234356408 shutdown_connections 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 --2- 172.21.15.125:0/234356408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc40a1380 0x7f1fc4133a10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 -- 172.21.15.125:0/234356408 >> 172.21.15.125:0/234356408 conn(0x7f1fc40a6610 msgr2=0x7f1fc40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 -- 172.21.15.125:0/234356408 shutdown_connections 2023-10-03T10:15:37.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.077+0000 7f1fcb701700 1 -- 172.21.15.125:0/234356408 wait complete. 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.078+0000 7f1fcb701700 1 Processor -- start 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.078+0000 7f1fcb701700 1 -- start start 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc41228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 0x7f1fc4122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 0x7f1fc4123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc41245b0 con 0x7f1fc40a1380 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc41249a0 con 0x7f1fc40a0a70 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fcb701700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc40a03e0 con 0x7f1fc4133f50 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 0x7f1fc4123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc8c9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 0x7f1fc4122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc8c9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 0x7f1fc4122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47528/0 (socket says 172.21.15.125:47528) 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc8c9c700 1 -- 172.21.15.125:0/3573627579 learned_addr learned my addr 172.21.15.125:0/3573627579 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc949d700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc41228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 -- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 msgr2=0x7f1fc41228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc41228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 -- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 msgr2=0x7f1fc4122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 0x7f1fc4122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 -- 172.21.15.125:0/3573627579 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094a0 con 0x7f1fc4133f50 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.079+0000 7f1fc9c9e700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 0x7f1fc4123350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00ca80 tx=0x7f1fbc00cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.080+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00a9e0 con 0x7f1fc4133f50 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.080+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00ab40 con 0x7f1fc4133f50 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.080+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40094a0 con 0x7f1fc4133f50 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.080+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc012400 con 0x7f1fc4133f50 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.080+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc41339c0 con 0x7f1fc4133f50 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.081+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fbc01b3b0 con 0x7f1fc4133f50 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.081+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fbc03f230 con 0x7f1fc4133f50 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.081+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc4125ff0 con 0x7f1fc4133f50 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.085+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fbc017080 con 0x7f1fc4133f50 2023-10-03T10:15:37.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 Processor -- start 2023-10-03T10:15:37.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 -- start start 2023-10-03T10:15:37.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067009b110 con 0x7f067009ad40 2023-10-03T10:15:37.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700a3b60 con 0x7f0670134570 2023-10-03T10:15:37.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0677ecb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700a1a80 con 0x7f0670134140 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0676468700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0675466700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0676468700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47536/0 (socket says 172.21.15.125:47536) 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0675c67700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f067009ad40 0x7f0670133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45142/0 (socket says 172.21.15.125:45142) 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0675466700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53988/0 (socket says 172.21.15.125:53988) 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.118+0000 7f0676468700 1 -- 172.21.15.125:0/3645008481 learned_addr learned my addr 172.21.15.125:0/3645008481 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0675466700 1 -- 172.21.15.125:0/3645008481 >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 msgr2=0x7f067013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0675466700 1 --2- 172.21.15.125:0/3645008481 >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0675466700 1 -- 172.21.15.125:0/3645008481 >> v1:172.21.15.125:6789/0 conn(0x7f067009ad40 legacy=0x7f0670133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0675466700 1 -- 172.21.15.125:0/3645008481 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700a2fa0 con 0x7f0670134140 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0676468700 1 --2- 172.21.15.125:0/3645008481 >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0675466700 1 --2- 172.21.15.125:0/3645008481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0660009840 tx=0x7f0660009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3afa9eb74ce21b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0674c65700 1 -- 172.21.15.125:0/3645008481 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660011830 con 0x7f0670134140 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0674c65700 1 -- 172.21.15.125:0/3645008481 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0660011990 con 0x7f0670134140 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.119+0000 7f0674c65700 1 -- 172.21.15.125:0/3645008481 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660011d20 con 0x7f0670134140 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 -- 172.21.15.125:0/3645008481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 msgr2=0x7f0670138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 --2- 172.21.15.125:0/3645008481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0660009840 tx=0x7f0660009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 -- 172.21.15.125:0/3645008481 shutdown_connections 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 --2- 172.21.15.125:0/3645008481 >> v2:172.21.15.125:3300/0 conn(0x7f0670134570 0x7f067013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 --2- 172.21.15.125:0/3645008481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f0670138e80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 -- 172.21.15.125:0/3645008481 >> 172.21.15.125:0/3645008481 conn(0x7f0670099c40 msgr2=0x7f067006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 -- 172.21.15.125:0/3645008481 shutdown_connections 2023-10-03T10:15:37.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.120+0000 7f0677ecb700 1 -- 172.21.15.125:0/3645008481 wait complete. 2023-10-03T10:15:37.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 Processor -- start 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 -- start start 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f067009ad40 0x7f067011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f067011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067011ea60 con 0x7f067009ad40 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700a4110 con 0x7f0670134140 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0677ecb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f067009c7e0 con 0x7f0670134570 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0676468700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0676468700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36116/0 (socket says 172.21.15.125:36116) 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0676468700 1 -- 172.21.15.125:0/1432827639 learned_addr learned my addr 172.21.15.125:0/1432827639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0675c67700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f067009ad40 0x7f067011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.121+0000 7f0675466700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f067011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 -- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 msgr2=0x7f067011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f067011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 -- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f067009ad40 msgr2=0x7f067011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f067009ad40 0x7f067011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 -- 172.21.15.125:0/1432827639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0668009b30 con 0x7f0670134570 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0675466700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f067011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0676468700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0668009f10 tx=0x7f066800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668018070 con 0x7f0670134570 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800f040 con 0x7f0670134570 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600094a0 con 0x7f0670134570 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668003c40 con 0x7f0670134570 2023-10-03T10:15:37.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.122+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067011e6b0 con 0x7f0670134570 2023-10-03T10:15:37.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.123+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f066800c940 con 0x7f0670134570 2023-10-03T10:15:37.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.123+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f066803f7e0 con 0x7f0670134570 2023-10-03T10:15:37.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.123+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067011e8a0 con 0x7f0670134570 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.127+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0668012340 con 0x7f0670134570 2023-10-03T10:15:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.278+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1fc404f2a0 con 0x7f1fc4133f50 2023-10-03T10:15:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.278+0000 7f1fb9ffb700 1 -- 172.21.15.125:0/3573627579 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fbc0192c0 con 0x7f1fc4133f50 2023-10-03T10:15:37.279 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 msgr2=0x7f1fc4123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 0x7f1fc4123350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00ca80 tx=0x7f1fbc00cd90 comp rx=0 tx=0).stop 2023-10-03T10:15:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 shutdown_connections 2023-10-03T10:15:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fc4133f50 0x7f1fc4123350 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fc40a0a70 0x7f1fc41228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 --2- 172.21.15.125:0/3573627579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fc40a1380 0x7f1fc4122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.280+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 >> 172.21.15.125:0/3573627579 conn(0x7f1fc40a6610 msgr2=0x7f1fc40a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.281+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 shutdown_connections 2023-10-03T10:15:37.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.281+0000 7f1fcb701700 1 -- 172.21.15.125:0/3573627579 wait complete. 2023-10-03T10:15:37.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:37.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.316+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f067004f2a0 con 0x7f0670134570 2023-10-03T10:15:37.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.316+0000 7f06667fc700 1 -- 172.21.15.125:0/1432827639 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f066801de00 con 0x7f0670134570 2023-10-03T10:15:37.317 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:37.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 msgr2=0x7f067011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0668009f10 tx=0x7f066800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 shutdown_connections 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0670134570 0x7f067011d340 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f067009ad40 0x7f067011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 --2- 172.21.15.125:0/1432827639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0670134140 0x7f067011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 >> 172.21.15.125:0/1432827639 conn(0x7f0670099c40 msgr2=0x7f06700a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 shutdown_connections 2023-10-03T10:15:37.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.318+0000 7f0677ecb700 1 -- 172.21.15.125:0/1432827639 wait complete. 2023-10-03T10:15:37.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:37.367 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:37.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:37.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.495+0000 7fc6fc0c7700 1 Processor -- start 2023-10-03T10:15:37.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.495+0000 7fc6fc0c7700 1 -- start start 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 0x7fc6f4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 0x7fc6f41321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f40a0920 con 0x7fc6f409e870 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f409c970 con 0x7fc6f4131d70 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fc0c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f409bab0 con 0x7fc6f409f180 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9e63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9e63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47546/0 (socket says 172.21.15.125:47546) 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 0x7fc6f41321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9e63700 1 -- 172.21.15.125:0/1947211172 learned_addr learned my addr 172.21.15.125:0/1947211172 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9662700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 0x7fc6f4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 -- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 msgr2=0x7fc6f4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 0x7fc6f4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 -- 172.21.15.125:0/1947211172 >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 msgr2=0x7fc6f409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 --2- 172.21.15.125:0/1947211172 >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 -- 172.21.15.125:0/1947211172 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f409f9c0 con 0x7fc6f4131d70 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9e63700 1 --2- 172.21.15.125:0/1947211172 >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6f9662700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 0x7fc6f4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.496+0000 7fc6fa664700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 0x7fc6f41321f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009dc0 tx=0x7fc6ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6361b5a3bdd537 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6f8e61700 1 -- 172.21.15.125:0/1947211172 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00e070 con 0x7fc6f4131d70 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6f8e61700 1 -- 172.21.15.125:0/1947211172 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec00bae0 con 0x7fc6f4131d70 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6f8e61700 1 -- 172.21.15.125:0/1947211172 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00be90 con 0x7fc6f4131d70 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 msgr2=0x7fc6f41321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 0x7fc6f41321f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009dc0 tx=0x7fc6ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/1947211172 shutdown_connections 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f4131d70 0x7fc6f41321f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/1947211172 >> v2:172.21.15.125:3300/0 conn(0x7fc6f409e870 0x7fc6f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/1947211172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f409f180 0x7fc6f4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/1947211172 >> 172.21.15.125:0/1947211172 conn(0x7fc6f40a4430 msgr2=0x7fc6f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/1947211172 shutdown_connections 2023-10-03T10:15:37.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.497+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/1947211172 wait complete. 2023-10-03T10:15:37.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.498+0000 7fc6fc0c7700 1 Processor -- start 2023-10-03T10:15:37.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.498+0000 7fc6fc0c7700 1 -- start start 2023-10-03T10:15:37.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f406d4c0 con 0x7fc6f409f180 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f409dc10 con 0x7fc6f409e870 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f4130f20 con 0x7fc6f4131d70 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9662700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fa664700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9662700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47548/0 (socket says 172.21.15.125:47548) 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54018/0 (socket says 172.21.15.125:54018) 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fa664700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36124/0 (socket says 172.21.15.125:36124) 2023-10-03T10:15:37.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9662700 1 -- 172.21.15.125:0/2223035589 learned_addr learned my addr 172.21.15.125:0/2223035589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 -- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 msgr2=0x7fc6f406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 -- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 msgr2=0x7fc6f406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 -- 172.21.15.125:0/2223035589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009550 con 0x7fc6f409e870 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fa664700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9662700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6f9e63700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000e9b0 tx=0x7fc6f000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000c640 con 0x7fc6f409e870 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000c7a0 con 0x7fc6f409e870 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40094a0 con 0x7fc6f409e870 2023-10-03T10:15:37.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000cb30 con 0x7fc6f409e870 2023-10-03T10:15:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.499+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec009a70 con 0x7fc6f409e870 2023-10-03T10:15:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.500+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6f000cc90 con 0x7fc6f409e870 2023-10-03T10:15:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.500+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6f003faa0 con 0x7fc6f409e870 2023-10-03T10:15:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.500+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f404f2a0 con 0x7fc6f409e870 2023-10-03T10:15:37.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.505+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6f0011d60 con 0x7fc6f409e870 2023-10-03T10:15:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 Processor -- start 2023-10-03T10:15:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 -- start start 2023-10-03T10:15:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804409c970 con 0x7f804409f180 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440a0920 con 0x7f804409e870 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8049ab9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804409f9c0 con 0x7f8044131f40 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8043fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f80437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8043fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36128/0 (socket says 172.21.15.125:36128) 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f80437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54030/0 (socket says 172.21.15.125:54030) 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8043fff700 1 -- 172.21.15.125:0/1129156404 learned_addr learned my addr 172.21.15.125:0/1129156404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.559+0000 7f8042ffd700 1 --1- 172.21.15.125:0/1129156404 >> v1:172.21.15.125:6789/0 conn(0x7f804409f180 0x7f8044131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45152/0 (socket says 172.21.15.125:45152) 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8043fff700 1 -- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 msgr2=0x7f804409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8043fff700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8043fff700 1 -- 172.21.15.125:0/1129156404 >> v1:172.21.15.125:6789/0 conn(0x7f804409f180 legacy=0x7f8044131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8043fff700 1 -- 172.21.15.125:0/1129156404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804409bab0 con 0x7f8044131f40 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f80427fc700 1 -- 172.21.15.125:0/1129156404 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613786273 0 0) 0x7f804409c970 con 0x7f804409f180 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f80437fe700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8043fff700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f803c009e80 tx=0x7f803c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d648e504be472ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f80427fc700 1 -- 172.21.15.125:0/1129156404 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e070 con 0x7f8044131f40 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f80427fc700 1 -- 172.21.15.125:0/1129156404 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00b910 con 0x7f8044131f40 2023-10-03T10:15:37.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f80427fc700 1 -- 172.21.15.125:0/1129156404 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00bcc0 con 0x7f8044131f40 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8049ab9700 1 -- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 msgr2=0x7f8044139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.560+0000 7f8049ab9700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f803c009e80 tx=0x7f803c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 -- 172.21.15.125:0/1129156404 shutdown_connections 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8044131f40 0x7f8044139ca0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 --2- 172.21.15.125:0/1129156404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 -- 172.21.15.125:0/1129156404 >> 172.21.15.125:0/1129156404 conn(0x7f80440a4430 msgr2=0x7f80440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 -- 172.21.15.125:0/1129156404 shutdown_connections 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 -- 172.21.15.125:0/1129156404 wait complete. 2023-10-03T10:15:37.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.561+0000 7f8049ab9700 1 Processor -- start 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 -- start start 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 0x7f804406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804406cca0 con 0x7f8044131f40 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8044125820 con 0x7f804409e870 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8049ab9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80441246d0 con 0x7f804409f180 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f80437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f80437fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54040/0 (socket says 172.21.15.125:54040) 2023-10-03T10:15:37.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36140/0 (socket says 172.21.15.125:36140) 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f80437fe700 1 -- 172.21.15.125:0/3645138291 learned_addr learned my addr 172.21.15.125:0/3645138291 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.562+0000 7f8043fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 0x7f804406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 -- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 msgr2=0x7f804406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 -- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 msgr2=0x7f804406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 -- 172.21.15.125:0/3645138291 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094a0 con 0x7f8044131f40 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f80437fe700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8042ffd700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8043fff700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 0x7f804406c330 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f803c015000 tx=0x7f803c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c004450 con 0x7f8044131f40 2023-10-03T10:15:37.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c0045b0 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c009b30 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c004940 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.563+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804409dba0 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.564+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804404f2a0 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.564+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f803c025460 con 0x7f8044131f40 2023-10-03T10:15:37.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.564+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f803c041170 con 0x7f8044131f40 2023-10-03T10:15:37.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.569+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f803c025710 con 0x7f8044131f40 2023-10-03T10:15:37.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.699+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6f4131b50 con 0x7fc6f409e870 2023-10-03T10:15:37.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.699+0000 7fc6ea7fc700 1 -- 172.21.15.125:0/2223035589 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6f0017020 con 0x7fc6f409e870 2023-10-03T10:15:37.700 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 msgr2=0x7fc6f406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000e9b0 tx=0x7fc6f000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 shutdown_connections 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6f4131d70 0x7fc6f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6f409e870 0x7fc6f406b8b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 --2- 172.21.15.125:0/2223035589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6f409f180 0x7fc6f406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 >> 172.21.15.125:0/2223035589 conn(0x7fc6f40a4430 msgr2=0x7fc6f406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 shutdown_connections 2023-10-03T10:15:37.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.701+0000 7fc6fc0c7700 1 -- 172.21.15.125:0/2223035589 wait complete. 2023-10-03T10:15:37.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:37.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.760+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f804406b2a0 con 0x7f8044131f40 2023-10-03T10:15:37.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.760+0000 7f802bfff700 1 -- 172.21.15.125:0/3645138291 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f803c02eb90 con 0x7f8044131f40 2023-10-03T10:15:37.761 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:37.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 msgr2=0x7f804406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 0x7f804406c330 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f803c015000 tx=0x7f803c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 shutdown_connections 2023-10-03T10:15:37.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8044131f40 0x7f804406c330 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f804409e870 0x7f804406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 --2- 172.21.15.125:0/3645138291 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f804409f180 0x7f804406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 >> 172.21.15.125:0/3645138291 conn(0x7f80440a4430 msgr2=0x7f8044072230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 shutdown_connections 2023-10-03T10:15:37.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:37.762+0000 7f8049ab9700 1 -- 172.21.15.125:0/3645138291 wait complete. 2023-10-03T10:15:37.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:38.294 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:38.331 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 Processor -- start 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 -- start start 2023-10-03T10:15:38.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 0x7f08c009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c009aaa0 con 0x7f08c009e170 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c009f870 con 0x7f08c009d860 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.422+0000 7f08c728b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c009b360 con 0x7f08c0130eb0 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5828700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5828700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36142/0 (socket says 172.21.15.125:36142) 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 0x7f08c009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5828700 1 -- 172.21.15.125:0/2727221997 learned_addr learned my addr 172.21.15.125:0/2727221997 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c4826700 1 --1- 172.21.15.125:0/2727221997 >> v1:172.21.15.125:6789/0 conn(0x7f08c009e170 0x7f08c01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45158/0 (socket says 172.21.15.125:45158) 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08b7fff700 1 -- 172.21.15.125:0/2727221997 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420909879 0 0) 0x7f08c009aaa0 con 0x7f08c009e170 2023-10-03T10:15:38.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08b7fff700 1 -- 172.21.15.125:0/2727221997 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08ac0035b0 con 0x7f08c009e170 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 -- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 msgr2=0x7f08c0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 -- 172.21.15.125:0/2727221997 >> v1:172.21.15.125:6789/0 conn(0x7f08c009e170 legacy=0x7f08c01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 -- 172.21.15.125:0/2727221997 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c009b620 con 0x7f08c009d860 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5828700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08c5027700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 0x7f08c009dc30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009870 tx=0x7f08bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=466b92f4e74d28a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08b7fff700 1 -- 172.21.15.125:0/2727221997 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc011830 con 0x7f08c009d860 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08b7fff700 1 -- 172.21.15.125:0/2727221997 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc011990 con 0x7f08c009d860 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.423+0000 7f08b7fff700 1 -- 172.21.15.125:0/2727221997 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc011d20 con 0x7f08c009d860 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 -- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 msgr2=0x7f08c009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 0x7f08c009dc30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009870 tx=0x7f08bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:38.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 -- 172.21.15.125:0/2727221997 shutdown_connections 2023-10-03T10:15:38.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c0130eb0 0x7f08c0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 --2- 172.21.15.125:0/2727221997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009d860 0x7f08c009dc30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 -- 172.21.15.125:0/2727221997 >> 172.21.15.125:0/2727221997 conn(0x7f08c0099c40 msgr2=0x7f08c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 -- 172.21.15.125:0/2727221997 shutdown_connections 2023-10-03T10:15:38.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.424+0000 7f08c728b700 1 -- 172.21.15.125:0/2727221997 wait complete. 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 Processor -- start 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 -- start start 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 0x7f08c0123760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 0x7f08c01c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0125f40 con 0x7f08c0130eb0 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0122e30 con 0x7f08c009e170 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c728b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0124540 con 0x7f08c009d860 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c4826700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 0x7f08c0123760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c5027700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c5027700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36154/0 (socket says 172.21.15.125:36154) 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c4826700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 0x7f08c0123760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54056/0 (socket says 172.21.15.125:54056) 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c5027700 1 -- 172.21.15.125:0/3164856125 learned_addr learned my addr 172.21.15.125:0/3164856125 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.425+0000 7f08c5828700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 0x7f08c01c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 -- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 msgr2=0x7f08c0123760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 0x7f08c0123760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 -- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 msgr2=0x7f08c01c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 0x7f08c01c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 -- 172.21.15.125:0/3164856125 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009b30 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5828700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 0x7f08c01c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c5027700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f08bc000c00 tx=0x7f08bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc004240 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc01f070 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0094a0 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0036a0 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.426+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0124ab0 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.427+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08bc021030 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.427+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c009c8b0 con 0x7f08c009d860 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.428+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08bc048350 con 0x7f08c009d860 2023-10-03T10:15:38.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.432+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08bc045060 con 0x7f08c009d860 2023-10-03T10:15:38.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.464+0000 7f09dd717700 1 Processor -- start 2023-10-03T10:15:38.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.464+0000 7f09dd717700 1 -- start start 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 0x7f09d809dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 0x7f09d8137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d806dc20 con 0x7f09d809e280 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d809c1f0 con 0x7f09d809d8f0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09dd717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09d809b1f0 con 0x7f09d81309f0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 0x7f09d809dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 0x7f09d8137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36164/0 (socket says 172.21.15.125:36164) 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 -- 172.21.15.125:0/4143286558 learned_addr learned my addr 172.21.15.125:0/4143286558 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 -- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 msgr2=0x7f09d809dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 0x7f09d809dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 -- 172.21.15.125:0/4143286558 >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 msgr2=0x7f09d8137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/4143286558 >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 0x7f09d8137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 -- 172.21.15.125:0/4143286558 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8131300 con 0x7f09d81309f0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d67fc700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 0x7f09d809dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d77fe700 1 --2- 172.21.15.125:0/4143286558 >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 0x7f09d8137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f09c8006fd0 tx=0x7f09c800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2dd7a2269af694 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d5ffb700 1 -- 172.21.15.125:0/4143286558 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8005e30 con 0x7f09d81309f0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d5ffb700 1 -- 172.21.15.125:0/4143286558 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8004030 con 0x7f09d81309f0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.465+0000 7f09d5ffb700 1 -- 172.21.15.125:0/4143286558 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80043e0 con 0x7f09d81309f0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 -- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 msgr2=0x7f09d8130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f09c8006fd0 tx=0x7f09c800be70 comp rx=0 tx=0).stop 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 -- 172.21.15.125:0/4143286558 shutdown_connections 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 --2- 172.21.15.125:0/4143286558 >> v2:172.21.15.125:3300/0 conn(0x7f09d809e280 0x7f09d8137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d81309f0 0x7f09d8130dc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 --2- 172.21.15.125:0/4143286558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d809d8f0 0x7f09d809dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 -- 172.21.15.125:0/4143286558 >> 172.21.15.125:0/4143286558 conn(0x7f09d80a2b30 msgr2=0x7f09d809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 -- 172.21.15.125:0/4143286558 shutdown_connections 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.466+0000 7f09dd717700 1 -- 172.21.15.125:0/4143286558 wait complete. 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.467+0000 7f09dd717700 1 Processor -- start 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.467+0000 7f09dd717700 1 -- start start 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.467+0000 7f09dd717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 0x7f09d81c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 0x7f09d8129f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d812b8a0 con 0x7f09d809d8f0 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d809b430 con 0x7f09d81309f0 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09d812d280 con 0x7f09d809e280 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 0x7f09d81c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36170/0 (socket says 172.21.15.125:36170) 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d67fc700 1 -- 172.21.15.125:0/579520783 learned_addr learned my addr 172.21.15.125:0/579520783 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d77fe700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 0x7f09d8129f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 -- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 msgr2=0x7f09d81c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 -- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 msgr2=0x7f09d8129f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 0x7f09d8129f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 -- 172.21.15.125:0/579520783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0094a0 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d67fc700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d77fe700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 0x7f09d8129f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09d6ffd700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 0x7f09d81c8850 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f09c8016000 tx=0x7f09c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c801e070 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800dc20 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d0009a70 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80036a0 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.468+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c800b7a0 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.469+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d80747b0 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.470+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09c8003800 con 0x7f09d809d8f0 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.470+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09c8040450 con 0x7f09d809d8f0 2023-10-03T10:15:38.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.478+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09c802adc0 con 0x7f09d809d8f0 2023-10-03T10:15:38.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.628+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08c004f2a0 con 0x7f08c009d860 2023-10-03T10:15:38.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.629+0000 7f08b5ffb700 1 -- 172.21.15.125:0/3164856125 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08bc015020 con 0x7f08c009d860 2023-10-03T10:15:38.629 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 msgr2=0x7f08c0123220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f08bc000c00 tx=0x7f08bc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 shutdown_connections 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c0130eb0 0x7f08c01c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08c009d860 0x7f08c0123220 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 --2- 172.21.15.125:0/3164856125 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c009e170 0x7f08c0123760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 >> 172.21.15.125:0/3164856125 conn(0x7f08c0099c40 msgr2=0x7f08c00a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 shutdown_connections 2023-10-03T10:15:38.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.631+0000 7f08c728b700 1 -- 172.21.15.125:0/3164856125 wait complete. 2023-10-03T10:15:38.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:38.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.669+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09d804f2a0 con 0x7f09d809d8f0 2023-10-03T10:15:38.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.669+0000 7f09bf7fe700 1 -- 172.21.15.125:0/579520783 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09c8027030 con 0x7f09d809d8f0 2023-10-03T10:15:38.670 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 msgr2=0x7f09d81c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 0x7f09d81c8850 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f09c8016000 tx=0x7f09c8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 shutdown_connections 2023-10-03T10:15:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09d81309f0 0x7f09d8129f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09d809d8f0 0x7f09d81c8850 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 --2- 172.21.15.125:0/579520783 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09d809e280 0x7f09d81c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.671+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 >> 172.21.15.125:0/579520783 conn(0x7f09d80a2b30 msgr2=0x7f09d812e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.672+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 shutdown_connections 2023-10-03T10:15:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.672+0000 7f09dd717700 1 -- 172.21.15.125:0/579520783 wait complete. 2023-10-03T10:15:38.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:38.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:38.776 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:38.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.851+0000 7f59a6465700 1 Processor -- start 2023-10-03T10:15:38.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.851+0000 7f59a6465700 1 -- start start 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f59a6465700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f59a6465700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f59a6465700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a009dc00 con 0x7f59a0133f50 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f59a6465700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a009ea60 con 0x7f59a00a0a70 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f59a6465700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a009dec0 con 0x7f59a00a1380 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54082/0 (socket says 172.21.15.125:54082) 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36180/0 (socket says 172.21.15.125:36180) 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 -- 172.21.15.125:0/3526362161 learned_addr learned my addr 172.21.15.125:0/3526362161 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 -- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 msgr2=0x7f59a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 -- 172.21.15.125:0/3526362161 >> v1:172.21.15.125:6789/0 conn(0x7f59a0133f50 legacy=0x7f59a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 -- 172.21.15.125:0/3526362161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a009e6a0 con 0x7f59a00a0a70 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599f7fe700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599ffff700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5990009920 tx=0x7f5990009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c038d1c6a65844 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599effd700 1 -- 172.21.15.125:0/3526362161 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990011830 con 0x7f59a00a0a70 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599effd700 1 -- 172.21.15.125:0/3526362161 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990011990 con 0x7f59a00a0a70 2023-10-03T10:15:38.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.852+0000 7f599effd700 1 -- 172.21.15.125:0/3526362161 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990011d20 con 0x7f59a00a0a70 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 -- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 msgr2=0x7f59a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5990009920 tx=0x7f5990009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 -- 172.21.15.125:0/3526362161 shutdown_connections 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a0a70 0x7f59a00a0e40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 --2- 172.21.15.125:0/3526362161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a1380 0x7f59a0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 -- 172.21.15.125:0/3526362161 >> 172.21.15.125:0/3526362161 conn(0x7f59a00a6610 msgr2=0x7f59a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 -- 172.21.15.125:0/3526362161 shutdown_connections 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.853+0000 7f59a6465700 1 -- 172.21.15.125:0/3526362161 wait complete. 2023-10-03T10:15:38.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.854+0000 7f59a6465700 1 Processor -- start 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.854+0000 7f59a6465700 1 -- start start 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a0133f50 0x7f59a01c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0125300 con 0x7f59a0133f50 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0124780 con 0x7f59a00a1380 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00a03e0 con 0x7f59a00a0a70 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54090/0 (socket says 172.21.15.125:54090) 2023-10-03T10:15:38.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599f7fe700 1 -- 172.21.15.125:0/1753114057 learned_addr learned my addr 172.21.15.125:0/1753114057 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36196/0 (socket says 172.21.15.125:36196) 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a4a02700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a0133f50 0x7f59a01c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 -- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 msgr2=0x7f59a01c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 -- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a0133f50 msgr2=0x7f59a01c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a0133f50 0x7f59a01c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 -- 172.21.15.125:0/1753114057 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940094a0 con 0x7f59a00a0a70 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599f7fe700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599ffff700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5990016000 tx=0x7f5990004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990004450 con 0x7f59a00a0a70 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59900045b0 con 0x7f59a00a0a70 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.855+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5990009550 con 0x7f59a00a0a70 2023-10-03T10:15:38.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.856+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900038c0 con 0x7f59a00a0a70 2023-10-03T10:15:38.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.856+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0133a10 con 0x7f59a00a0a70 2023-10-03T10:15:38.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.856+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5990003a20 con 0x7f59a00a0a70 2023-10-03T10:15:38.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.856+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a004f2a0 con 0x7f59a00a0a70 2023-10-03T10:15:38.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.857+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5990021030 con 0x7f59a00a0a70 2023-10-03T10:15:38.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.861+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f599001a7b0 con 0x7f59a00a0a70 2023-10-03T10:15:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.902+0000 7f6851e35700 1 Processor -- start 2023-10-03T10:15:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 -- start start 2023-10-03T10:15:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c09c970 con 0x7f684c09f180 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0a0920 con 0x7f684c131f40 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f6851e35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f684c09f9c0 con 0x7f684c09e870 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36208/0 (socket says 172.21.15.125:36208) 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47602/0 (socket says 172.21.15.125:47602) 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 -- 172.21.15.125:0/4013456005 learned_addr learned my addr 172.21.15.125:0/4013456005 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684a7fc700 1 -- 172.21.15.125:0/4013456005 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925373399 0 0) 0x7f684c09c970 con 0x7f684c09f180 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684a7fc700 1 -- 172.21.15.125:0/4013456005 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68340035b0 con 0x7f684c09f180 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 -- 172.21.15.125:0/4013456005 >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 msgr2=0x7f684c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 --2- 172.21.15.125:0/4013456005 >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.903+0000 7f684b7fe700 1 -- 172.21.15.125:0/4013456005 >> v1:172.21.15.125:6789/0 conn(0x7f684c09f180 legacy=0x7f684c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684b7fe700 1 -- 172.21.15.125:0/4013456005 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c09bab0 con 0x7f684c09e870 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684bfff700 1 --2- 172.21.15.125:0/4013456005 >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684b7fe700 1 --2- 172.21.15.125:0/4013456005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f683c0098f0 tx=0x7f683c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f76218ceb5817d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684a7fc700 1 -- 172.21.15.125:0/4013456005 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c011830 con 0x7f684c09e870 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684a7fc700 1 -- 172.21.15.125:0/4013456005 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c011990 con 0x7f684c09e870 2023-10-03T10:15:38.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f684a7fc700 1 -- 172.21.15.125:0/4013456005 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c011d20 con 0x7f684c09e870 2023-10-03T10:15:38.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 -- 172.21.15.125:0/4013456005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 msgr2=0x7f684c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 --2- 172.21.15.125:0/4013456005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f683c0098f0 tx=0x7f683c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 -- 172.21.15.125:0/4013456005 shutdown_connections 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 --2- 172.21.15.125:0/4013456005 >> v2:172.21.15.125:3300/0 conn(0x7f684c131f40 0x7f684c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 --2- 172.21.15.125:0/4013456005 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c09ec40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 -- 172.21.15.125:0/4013456005 >> 172.21.15.125:0/4013456005 conn(0x7f684c0a4430 msgr2=0x7f684c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.904+0000 7f6851e35700 1 -- 172.21.15.125:0/4013456005 shutdown_connections 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.905+0000 7f6851e35700 1 -- 172.21.15.125:0/4013456005 wait complete. 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.905+0000 7f6851e35700 1 Processor -- start 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 -- start start 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f684c09f180 0x7f684c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c06cd80 con 0x7f684c131f40 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c125d40 con 0x7f684c09f180 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f6851e35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f684c1254d0 con 0x7f684c09e870 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36214/0 (socket says 172.21.15.125:36214) 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 -- 172.21.15.125:0/467212275 learned_addr learned my addr 172.21.15.125:0/467212275 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47614/0 (socket says 172.21.15.125:47614) 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 -- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f684c09f180 msgr2=0x7f684c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f684c09f180 0x7f684c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 -- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 msgr2=0x7f684c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684b7fe700 1 -- 172.21.15.125:0/467212275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844009a70 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.906+0000 7f684bfff700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f684b7fe700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f683c014040 tx=0x7f683c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0044d0 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c01e070 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0038e0 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c009550 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c09dba0 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.907+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f683c003a40 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.908+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f683c0406a0 con 0x7f684c09e870 2023-10-03T10:15:38.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.908+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c11ce70 con 0x7f684c09e870 2023-10-03T10:15:38.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:38.912+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f683c015080 con 0x7f684c09e870 2023-10-03T10:15:39.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.054+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f59a0072980 con 0x7f59a00a0a70 2023-10-03T10:15:39.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.054+0000 7f599cff9700 1 -- 172.21.15.125:0/1753114057 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f599002b030 con 0x7f59a00a0a70 2023-10-03T10:15:39.055 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 msgr2=0x7f59a01c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5990016000 tx=0x7f5990004750 comp rx=0 tx=0).stop 2023-10-03T10:15:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 shutdown_connections 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a0133f50 0x7f59a01c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a00a0a70 0x7f59a01c8260 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 --2- 172.21.15.125:0/1753114057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a00a1380 0x7f59a01c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 >> 172.21.15.125:0/1753114057 conn(0x7f59a00a6610 msgr2=0x7f59a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 shutdown_connections 2023-10-03T10:15:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.057+0000 7f59a6465700 1 -- 172.21.15.125:0/1753114057 wait complete. 2023-10-03T10:15:39.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.105+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f684c04f2a0 con 0x7f684c09e870 2023-10-03T10:15:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.105+0000 7f6833fff700 1 -- 172.21.15.125:0/467212275 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f683c003cf0 con 0x7f684c09e870 2023-10-03T10:15:39.106 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.107+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 msgr2=0x7f684c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.107+0000 7f6851e35700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f683c014040 tx=0x7f683c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 shutdown_connections 2023-10-03T10:15:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f684c131f40 0x7f684c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f684c09e870 0x7f684c06b8b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 --2- 172.21.15.125:0/467212275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f684c09f180 0x7f684c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 >> 172.21.15.125:0/467212275 conn(0x7f684c0a4430 msgr2=0x7f684c072360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 shutdown_connections 2023-10-03T10:15:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.108+0000 7f6851e35700 1 -- 172.21.15.125:0/467212275 wait complete. 2023-10-03T10:15:39.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:39.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:39.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:39.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.775+0000 7f8aa42c0700 1 Processor -- start 2023-10-03T10:15:39.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.775+0000 7f8aa42c0700 1 -- start start 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa42c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 0x7f8a9c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa42c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa42c0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c09dc00 con 0x7f8a9c133f50 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa42c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c09ea60 con 0x7f8a9c0a1380 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa42c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c09dec0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa185b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa185b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47624/0 (socket says 172.21.15.125:47624) 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa185b700 1 -- 172.21.15.125:0/1798957445 learned_addr learned my addr 172.21.15.125:0/1798957445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:39.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa285d700 1 --1- 172.21.15.125:0/1798957445 >> v1:172.21.15.125:6789/0 conn(0x7f8a9c133f50 0x7f8a9c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45188/0 (socket says 172.21.15.125:45188) 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1798957445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 0x7f8a9c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 -- 172.21.15.125:0/1798957445 >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 msgr2=0x7f8a9c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1798957445 >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 -- 172.21.15.125:0/1798957445 >> v1:172.21.15.125:6789/0 conn(0x7f8a9c133f50 legacy=0x7f8a9c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 -- 172.21.15.125:0/1798957445 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c09e6a0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa105a700 1 -- 172.21.15.125:0/1798957445 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726906617 0 0) 0x7f8a9c09dc00 con 0x7f8a9c133f50 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa185b700 1 --2- 172.21.15.125:0/1798957445 >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.776+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1798957445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 0x7f8a9c0a0e40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009840 tx=0x7f8a8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c692b2ddf7f2aa59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa105a700 1 -- 172.21.15.125:0/1798957445 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c011830 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa105a700 1 -- 172.21.15.125:0/1798957445 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c011990 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa105a700 1 -- 172.21.15.125:0/1798957445 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c011d20 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1798957445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 msgr2=0x7f8a9c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1798957445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 0x7f8a9c0a0e40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009840 tx=0x7f8a8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1798957445 shutdown_connections 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1798957445 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a0a70 0x7f8a9c0a0e40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1798957445 >> v2:172.21.15.125:3300/0 conn(0x7f8a9c0a1380 0x7f8a9c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1798957445 >> 172.21.15.125:0/1798957445 conn(0x7f8a9c0a6610 msgr2=0x7f8a9c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1798957445 shutdown_connections 2023-10-03T10:15:39.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.777+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1798957445 wait complete. 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.778+0000 7f8aa42c0700 1 Processor -- start 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.778+0000 7f8aa42c0700 1 -- start start 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 0x7f8a9c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 0x7f8a9c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a9c133f50 0x7f8a9c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c126140 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c1244d0 con 0x7f8a9c133f50 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c126340 con 0x7f8a9c0a1380 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa185b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 0x7f8a9c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa185b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 0x7f8a9c122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36232/0 (socket says 172.21.15.125:36232) 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa185b700 1 -- 172.21.15.125:0/1144007975 learned_addr learned my addr 172.21.15.125:0/1144007975 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 0x7f8a9c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 -- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 msgr2=0x7f8a9c122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 0x7f8a9c122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 -- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a9c133f50 msgr2=0x7f8a9c1232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a9c133f50 0x7f8a9c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 -- 172.21.15.125:0/1144007975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a98009550 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa205c700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 0x7f8a9c122820 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0a0370 tx=0x7f8a8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0036a0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c01f070 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c0094a0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c003a00 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.779+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c0a0430 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.780+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a8c003b60 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.780+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a8c021070 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.780+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c04f2a0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.785+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a8c015070 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.814+0000 7f6064f8b700 1 Processor -- start 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.814+0000 7f6064f8b700 1 -- start start 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 0x7f606013ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606009ad30 con 0x7f6060134160 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009a8e0 con 0x7f606009bd20 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f6064f8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6060134600 con 0x7f60601337d0 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 0x7f606013ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54118/0 (socket says 172.21.15.125:54118) 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 -- 172.21.15.125:0/818284431 learned_addr learned my addr 172.21.15.125:0/818284431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36242/0 (socket says 172.21.15.125:36242) 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 -- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 msgr2=0x7f6060133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 -- 172.21.15.125:0/818284431 >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 msgr2=0x7f606013ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 --2- 172.21.15.125:0/818284431 >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 0x7f606013ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 -- 172.21.15.125:0/818284431 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606009a620 con 0x7f606009bd20 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605ed9d700 1 --2- 172.21.15.125:0/818284431 >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 0x7f606013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605dd9b700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.815+0000 7f605e59c700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f60500098f0 tx=0x7f6050009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9019b834d44a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f605d59a700 1 -- 172.21.15.125:0/818284431 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050005e30 con 0x7f606009bd20 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f605d59a700 1 -- 172.21.15.125:0/818284431 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050004030 con 0x7f606009bd20 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f605d59a700 1 -- 172.21.15.125:0/818284431 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500043e0 con 0x7f606009bd20 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 -- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 msgr2=0x7f606009c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f60500098f0 tx=0x7f6050009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 -- 172.21.15.125:0/818284431 shutdown_connections 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606009c0f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 --2- 172.21.15.125:0/818284431 >> v2:172.21.15.125:3300/0 conn(0x7f6060134160 0x7f606013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 --2- 172.21.15.125:0/818284431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60601337d0 0x7f6060133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 -- 172.21.15.125:0/818284431 >> 172.21.15.125:0/818284431 conn(0x7f606009f9f0 msgr2=0x7f606009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 -- 172.21.15.125:0/818284431 shutdown_connections 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.816+0000 7f6064f8b700 1 -- 172.21.15.125:0/818284431 wait complete. 2023-10-03T10:15:39.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 Processor -- start 2023-10-03T10:15:39.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 -- start start 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60601337d0 0x7f606011e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 0x7f606011e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606011faa0 con 0x7f60601337d0 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009cc90 con 0x7f606009bd20 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f6064f8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60601216d0 con 0x7f6060134160 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f605e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f605dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60601337d0 0x7f606011e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f605ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 0x7f606011e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f605e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54122/0 (socket says 172.21.15.125:54122) 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.818+0000 7f605e59c700 1 -- 172.21.15.125:0/665860049 learned_addr learned my addr 172.21.15.125:0/665860049 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 -- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 msgr2=0x7f606011ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 -- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60601337d0 msgr2=0x7f606011e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60601337d0 0x7f606011e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 -- 172.21.15.125:0/665860049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540094a0 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605e59c700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f605ed9d700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 0x7f606011e950 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f605800efc0 tx=0x7f605800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ca90 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800f040 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058009a70 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ce30 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.819+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6050009500 con 0x7f6060134160 2023-10-03T10:15:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.820+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6058014480 con 0x7f6060134160 2023-10-03T10:15:39.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.820+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f605803fb30 con 0x7f6060134160 2023-10-03T10:15:39.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.820+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606011ad60 con 0x7f6060134160 2023-10-03T10:15:39.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.825+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6058012930 con 0x7f6060134160 2023-10-03T10:15:39.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.980+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a9c1339b0 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.980+0000 7f8a92ffd700 1 -- 172.21.15.125:0/1144007975 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a8c015030 con 0x7f8a9c0a0a70 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 msgr2=0x7f8a9c122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 0x7f8a9c122820 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0a0370 tx=0x7f8a8c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 shutdown_connections 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a9c133f50 0x7f8a9c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a9c0a0a70 0x7f8a9c122820 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 --2- 172.21.15.125:0/1144007975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a9c0a1380 0x7f8a9c122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 >> 172.21.15.125:0/1144007975 conn(0x7f8a9c0a6610 msgr2=0x7f8a9c0a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 shutdown_connections 2023-10-03T10:15:39.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:39.982+0000 7f8aa42c0700 1 -- 172.21.15.125:0/1144007975 wait complete. 2023-10-03T10:15:39.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:40.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.016+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f606009b840 con 0x7f6060134160 2023-10-03T10:15:40.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.016+0000 7f604effd700 1 -- 172.21.15.125:0/665860049 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6058012340 con 0x7f6060134160 2023-10-03T10:15:40.017 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:40.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 msgr2=0x7f606011e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 0x7f606011e950 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f605800efc0 tx=0x7f605800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 shutdown_connections 2023-10-03T10:15:40.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6060134160 0x7f606011e950 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f606009bd20 0x7f606011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 --2- 172.21.15.125:0/665860049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60601337d0 0x7f606011e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 >> 172.21.15.125:0/665860049 conn(0x7f606009f9f0 msgr2=0x7f6060132e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 shutdown_connections 2023-10-03T10:15:40.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.018+0000 7f6064f8b700 1 -- 172.21.15.125:0/665860049 wait complete. 2023-10-03T10:15:40.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:40.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:40.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:40.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 Processor -- start 2023-10-03T10:15:40.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 -- start start 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 0x7f38dc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc09e9d0 con 0x7f38dc133f50 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc09dc00 con 0x7f38dc0a1380 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38e2050700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc09dec0 con 0x7f38dc0a0a70 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.198+0000 7f38daffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 0x7f38dc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36266/0 (socket says 172.21.15.125:36266) 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38daffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54136/0 (socket says 172.21.15.125:54136) 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 -- 172.21.15.125:0/2372383198 learned_addr learned my addr 172.21.15.125:0/2372383198 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 -- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 msgr2=0x7f38dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 -- 172.21.15.125:0/2372383198 >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 msgr2=0x7f38dc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 --2- 172.21.15.125:0/2372383198 >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 0x7f38dc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 -- 172.21.15.125:0/2372383198 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc09e6a0 con 0x7f38dc0a0a70 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38dbfff700 1 --2- 172.21.15.125:0/2372383198 >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 0x7f38dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38daffd700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38db7fe700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009e50 tx=0x7f38cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b017f52f29693ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38da7fc700 1 -- 172.21.15.125:0/2372383198 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00e070 con 0x7f38dc0a0a70 2023-10-03T10:15:40.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38da7fc700 1 -- 172.21.15.125:0/2372383198 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc00b910 con 0x7f38dc0a0a70 2023-10-03T10:15:40.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.199+0000 7f38da7fc700 1 -- 172.21.15.125:0/2372383198 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00bcc0 con 0x7f38dc0a0a70 2023-10-03T10:15:40.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 -- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 msgr2=0x7f38dc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009e50 tx=0x7f38cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:40.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 -- 172.21.15.125:0/2372383198 shutdown_connections 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 --2- 172.21.15.125:0/2372383198 >> v2:172.21.15.125:3300/0 conn(0x7f38dc133f50 0x7f38dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a0a70 0x7f38dc0a0e40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 --2- 172.21.15.125:0/2372383198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc0a1380 0x7f38dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 -- 172.21.15.125:0/2372383198 >> 172.21.15.125:0/2372383198 conn(0x7f38dc0a6610 msgr2=0x7f38dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 -- 172.21.15.125:0/2372383198 shutdown_connections 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.200+0000 7f38e2050700 1 -- 172.21.15.125:0/2372383198 wait complete. 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 Processor -- start 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 -- start start 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 0x7f38dc122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 0x7f38dc122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc133a90 con 0x7f38dc0a0a70 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1253a0 con 0x7f38dc133f50 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.201+0000 7f38e2050700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc124fe0 con 0x7f38dc0a1380 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38dbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38dbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54138/0 (socket says 172.21.15.125:54138) 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38dbfff700 1 -- 172.21.15.125:0/3018580446 learned_addr learned my addr 172.21.15.125:0/3018580446 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 0x7f38dc122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38db7fe700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 0x7f38dc122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 -- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 msgr2=0x7f38dc122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 -- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 msgr2=0x7f38dc122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 0x7f38dc122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 -- 172.21.15.125:0/3018580446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00094a0 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38dbfff700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38db7fe700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 0x7f38dc122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38daffd700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 0x7f38dc122a80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0a2b70 tx=0x7f38d000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0004240 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d00043a0 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00036a0 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d40094a0 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.202+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc009b30 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.203+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc1257f0 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.204+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38d0003800 con 0x7f38dc0a1380 2023-10-03T10:15:40.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.204+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38d003fcd0 con 0x7f38dc0a1380 2023-10-03T10:15:40.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.208+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38d001b3b0 con 0x7f38dc0a1380 2023-10-03T10:15:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.245+0000 7f225ab89700 1 Processor -- start 2023-10-03T10:15:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.245+0000 7f225ab89700 1 -- start start 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f225ab89700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f225ab89700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2254135f20 0x7f2254138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f225ab89700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225409aaa0 con 0x7f225409d860 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f225ab89700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225409e730 con 0x7f2254135f20 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f225ab89700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225409f870 con 0x7f225409e340 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2253fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2254135f20 0x7f2254138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2253fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54152/0 (socket says 172.21.15.125:54152) 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2258925700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f225409d860 0x7f225409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45192/0 (socket says 172.21.15.125:45192) 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2253fff700 1 -- 172.21.15.125:0/3434588897 learned_addr learned my addr 172.21.15.125:0/3434588897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2254135f20 0x7f2254138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47690/0 (socket says 172.21.15.125:47690) 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 -- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 msgr2=0x7f22541359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 -- 172.21.15.125:0/3434588897 >> v1:172.21.15.125:6789/0 conn(0x7f225409d860 legacy=0x7f225409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2259126700 1 -- 172.21.15.125:0/3434588897 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225409b360 con 0x7f2254135f20 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f22537fe700 1 -- 172.21.15.125:0/3434588897 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707979601 0 0) 0x7f225409aaa0 con 0x7f225409d860 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.246+0000 7f2253fff700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f2259126700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f2254138300 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8194a9ff87f932d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f22537fe700 1 -- 172.21.15.125:0/3434588897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c00e070 con 0x7f2254135f20 2023-10-03T10:15:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f22537fe700 1 -- 172.21.15.125:0/3434588897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c00bb20 con 0x7f2254135f20 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f22537fe700 1 -- 172.21.15.125:0/3434588897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c012430 con 0x7f2254135f20 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 -- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 msgr2=0x7f2254138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f2254138300 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 -- 172.21.15.125:0/3434588897 shutdown_connections 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f2254138300 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 --2- 172.21.15.125:0/3434588897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 -- 172.21.15.125:0/3434588897 >> 172.21.15.125:0/3434588897 conn(0x7f2254099c40 msgr2=0x7f22540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 -- 172.21.15.125:0/3434588897 shutdown_connections 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.247+0000 7f225ab89700 1 -- 172.21.15.125:0/3434588897 wait complete. 2023-10-03T10:15:40.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.248+0000 7f225ab89700 1 Processor -- start 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.248+0000 7f225ab89700 1 -- start start 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f22541c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225409c970 con 0x7f2254135f20 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225406b4c0 con 0x7f225409e340 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f225ab89700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22541343a0 con 0x7f225409d860 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2258925700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2258925700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36276/0 (socket says 172.21.15.125:36276) 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2258925700 1 -- 172.21.15.125:0/2223684180 learned_addr learned my addr 172.21.15.125:0/2223684180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2259126700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f22541c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 -- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 msgr2=0x7f22541c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 -- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 msgr2=0x7f22541c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f22541c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 -- 172.21.15.125:0/2223684180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240009550 con 0x7f225409e340 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2259126700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f22541c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2258925700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.249+0000 7f2253fff700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541c65f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9a0 tx=0x7f224000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240004030 con 0x7f225409e340 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240004190 con 0x7f225409e340 2023-10-03T10:15:40.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c009a70 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240004520 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22541229e0 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.250+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22400036a0 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.251+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f224003f4b0 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.251+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225404f2a0 con 0x7f225409e340 2023-10-03T10:15:40.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.255+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2240019d60 con 0x7f225409e340 2023-10-03T10:15:40.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.402+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38dc04f2a0 con 0x7f38dc0a1380 2023-10-03T10:15:40.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.402+0000 7f38c3fff700 1 -- 172.21.15.125:0/3018580446 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38d0012bc0 con 0x7f38dc0a1380 2023-10-03T10:15:40.403 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 msgr2=0x7f38dc122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 0x7f38dc122a80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0a2b70 tx=0x7f38d000ec60 comp rx=0 tx=0).stop 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 shutdown_connections 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38dc133f50 0x7f38dc122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0a0a70 0x7f38dc122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 --2- 172.21.15.125:0/3018580446 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38dc0a1380 0x7f38dc122a80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 >> 172.21.15.125:0/3018580446 conn(0x7f38dc0a6610 msgr2=0x7f38dc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 shutdown_connections 2023-10-03T10:15:40.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.404+0000 7f38e2050700 1 -- 172.21.15.125:0/3018580446 wait complete. 2023-10-03T10:15:40.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:40.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.450+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2254122f90 con 0x7f225409e340 2023-10-03T10:15:40.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.450+0000 7f22517fa700 1 -- 172.21.15.125:0/2223684180 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2240019300 con 0x7f225409e340 2023-10-03T10:15:40.450 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 msgr2=0x7f22541c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541c65f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9a0 tx=0x7f224000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 shutdown_connections 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2254135f20 0x7f22541c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f225409d860 0x7f22541c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 --2- 172.21.15.125:0/2223684180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f225409e340 0x7f22541c65f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 >> 172.21.15.125:0/2223684180 conn(0x7f2254099c40 msgr2=0x7f22540a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 shutdown_connections 2023-10-03T10:15:40.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:40.452+0000 7f225ab89700 1 -- 172.21.15.125:0/2223684180 wait complete. 2023-10-03T10:15:40.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:40.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:41.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:41.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.126+0000 7fea46b26700 1 Processor -- start 2023-10-03T10:15:41.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.126+0000 7fea46b26700 1 -- start start 2023-10-03T10:15:41.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 0x7fea4009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea4009f180 0x7fea40131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 0x7fea40132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea400a0920 con 0x7fea4009f180 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4009c970 con 0x7fea4009e870 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea46b26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4009bab0 con 0x7fea40131d70 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea4009f180 0x7fea40131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea4009f180 0x7fea40131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47716/0 (socket says 172.21.15.125:47716) 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea450c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 0x7fea40132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 -- 172.21.15.125:0/3988757492 learned_addr learned my addr 172.21.15.125:0/3988757492 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea448c2700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 0x7fea4009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 -- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 msgr2=0x7fea40132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 0x7fea40132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 -- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 msgr2=0x7fea4009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 0x7fea4009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 -- 172.21.15.125:0/3988757492 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4009f9c0 con 0x7fea4009f180 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea450c3700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 0x7fea40132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea448c2700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 0x7fea4009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3ffff700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009f180 0x7fea40131830 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009920 tx=0x7fea2c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d182c0fef891ae1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3f7fe700 1 -- 172.21.15.125:0/3988757492 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011830 con 0x7fea4009f180 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3f7fe700 1 -- 172.21.15.125:0/3988757492 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c011990 con 0x7fea4009f180 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.127+0000 7fea3f7fe700 1 -- 172.21.15.125:0/3988757492 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011d20 con 0x7fea4009f180 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 -- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009f180 msgr2=0x7fea40131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009f180 0x7fea40131830 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009920 tx=0x7fea2c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 -- 172.21.15.125:0/3988757492 shutdown_connections 2023-10-03T10:15:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4009e870 0x7fea4009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea40131d70 0x7fea40132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 --2- 172.21.15.125:0/3988757492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009f180 0x7fea40131830 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 -- 172.21.15.125:0/3988757492 >> 172.21.15.125:0/3988757492 conn(0x7fea400a4430 msgr2=0x7fea400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 -- 172.21.15.125:0/3988757492 shutdown_connections 2023-10-03T10:15:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.128+0000 7fea46b26700 1 -- 172.21.15.125:0/3988757492 wait complete. 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.129+0000 7fea46b26700 1 Processor -- start 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.129+0000 7fea46b26700 1 -- start start 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.129+0000 7fea46b26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 0x7fea40122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 0x7fea401231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40126210 con 0x7fea4009e870 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea40124920 con 0x7fea40131d70 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea400a0280 con 0x7fea4009f180 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea450c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 0x7fea401231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47730/0 (socket says 172.21.15.125:47730) 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 -- 172.21.15.125:0/3508336966 learned_addr learned my addr 172.21.15.125:0/3508336966 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea3ffff700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 0x7fea40122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 -- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 msgr2=0x7fea40122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 0x7fea40122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 -- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 msgr2=0x7fea401231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 0x7fea401231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 -- 172.21.15.125:0/3508336966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340094a0 con 0x7fea4009e870 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea450c3700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 0x7fea401231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea3ffff700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 0x7fea40122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea448c2700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fea3400ec10 tx=0x7fea3400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34009780 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3400c7f0 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea38009a70 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3400cb80 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.130+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c009550 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.131+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea3400cce0 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.131+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea3403faf0 con 0x7fea4009e870 2023-10-03T10:15:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.132+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4004f2a0 con 0x7fea4009e870 2023-10-03T10:15:41.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.136+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea3401b3b0 con 0x7fea4009e870 2023-10-03T10:15:41.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.165+0000 7fd200aa4700 1 Processor -- start 2023-10-03T10:15:41.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.165+0000 7fd200aa4700 1 -- start start 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd200aa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd200aa4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd200aa4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1fc09dc00 con 0x7fd1fc133f50 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd200aa4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc09ea60 con 0x7fd1fc0a1380 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd200aa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc09dec0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1f9d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36308/0 (socket says 172.21.15.125:36308) 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1f9d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47740/0 (socket says 172.21.15.125:47740) 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 -- 172.21.15.125:0/230251799 learned_addr learned my addr 172.21.15.125:0/230251799 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd1fc133f50 0x7fd1fc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45208/0 (socket says 172.21.15.125:45208) 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 -- 172.21.15.125:0/230251799 >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 msgr2=0x7fd1fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 --2- 172.21.15.125:0/230251799 >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 -- 172.21.15.125:0/230251799 >> v1:172.21.15.125:6789/0 conn(0x7fd1fc133f50 legacy=0x7fd1fc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1f959a700 1 -- 172.21.15.125:0/230251799 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950598322 0 0) 0x7fd1fc09dc00 con 0x7fd1fc133f50 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1fa59c700 1 -- 172.21.15.125:0/230251799 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc09e6a0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.166+0000 7fd1f9d9b700 1 --2- 172.21.15.125:0/230251799 >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd1fa59c700 1 --2- 172.21.15.125:0/230251799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0098f0 tx=0x7fd1ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98cf9f4a6ac1fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd1f959a700 1 -- 172.21.15.125:0/230251799 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec011830 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd1f959a700 1 -- 172.21.15.125:0/230251799 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec011990 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd1f959a700 1 -- 172.21.15.125:0/230251799 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec011d20 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 -- 172.21.15.125:0/230251799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 msgr2=0x7fd1fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 --2- 172.21.15.125:0/230251799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0098f0 tx=0x7fd1ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 -- 172.21.15.125:0/230251799 shutdown_connections 2023-10-03T10:15:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 --2- 172.21.15.125:0/230251799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc0a0e40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 --2- 172.21.15.125:0/230251799 >> v2:172.21.15.125:3300/0 conn(0x7fd1fc0a1380 0x7fd1fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 -- 172.21.15.125:0/230251799 >> 172.21.15.125:0/230251799 conn(0x7fd1fc0a6610 msgr2=0x7fd1fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 -- 172.21.15.125:0/230251799 shutdown_connections 2023-10-03T10:15:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.167+0000 7fd200aa4700 1 -- 172.21.15.125:0/230251799 wait complete. 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.168+0000 7fd200aa4700 1 Processor -- start 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.168+0000 7fd200aa4700 1 -- start start 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1fc0a1380 0x7fd1fc122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1fc133f50 0x7fd1fc1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc126140 con 0x7fd1fc0a1380 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc1244d0 con 0x7fd1fc133f50 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd200aa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc126340 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36318/0 (socket says 172.21.15.125:36318) 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 -- 172.21.15.125:0/2701900334 learned_addr learned my addr 172.21.15.125:0/2701900334 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1fc133f50 0x7fd1fc1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1f9d9b700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1fc0a1380 0x7fd1fc122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 -- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1fc133f50 msgr2=0x7fd1fc1232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1fc133f50 0x7fd1fc1232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 -- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1fc0a1380 msgr2=0x7fd1fc122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1fc0a1380 0x7fd1fc122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 -- 172.21.15.125:0/2701900334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00094a0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.169+0000 7fd1fa59c700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc09e000 tx=0x7fd1ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004300 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec01f070 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec009550 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0036a0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc0a0430 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.170+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc04f2a0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.171+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1ec021030 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.171+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1ec040e00 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.175+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1ec0199a0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.327+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea4009f660 con 0x7fea4009e870 2023-10-03T10:15:41.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.327+0000 7fea3d7fa700 1 -- 172.21.15.125:0/3508336966 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea34017020 con 0x7fea4009e870 2023-10-03T10:15:41.328 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 msgr2=0x7fea40122740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fea3400ec10 tx=0x7fea3400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 shutdown_connections 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea40131d70 0x7fea401231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4009e870 0x7fea40122740 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 --2- 172.21.15.125:0/3508336966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fea4009f180 0x7fea40122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 >> 172.21.15.125:0/3508336966 conn(0x7fea400a4430 msgr2=0x7fea4009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 shutdown_connections 2023-10-03T10:15:41.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.329+0000 7fea46b26700 1 -- 172.21.15.125:0/3508336966 wait complete. 2023-10-03T10:15:41.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.361+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd1fc1339b0 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.362+0000 7fd1eaffd700 1 -- 172.21.15.125:0/2701900334 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1ec015070 con 0x7fd1fc0a0a70 2023-10-03T10:15:41.362 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:41.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 msgr2=0x7fd1fc122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc09e000 tx=0x7fd1ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 shutdown_connections 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1fc133f50 0x7fd1fc1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1fc0a0a70 0x7fd1fc122820 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 --2- 172.21.15.125:0/2701900334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1fc0a1380 0x7fd1fc122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 >> 172.21.15.125:0/2701900334 conn(0x7fd1fc0a6610 msgr2=0x7fd1fc0a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 shutdown_connections 2023-10-03T10:15:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.364+0000 7fd200aa4700 1 -- 172.21.15.125:0/2701900334 wait complete. 2023-10-03T10:15:41.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:41.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:41.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:41.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 Processor -- start 2023-10-03T10:15:41.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 -- start start 2023-10-03T10:15:41.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 0x7f6eb413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb409e9d0 con 0x7f6eb40a0a70 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb409dc00 con 0x7f6eb4139200 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.544+0000 7f6eba055700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb409dec0 con 0x7f6eb40a1550 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 0x7f6eb413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6eb40a0a70 0x7f6eb40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45224/0 (socket says 172.21.15.125:45224) 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb37fe700 1 -- 172.21.15.125:0/818453297 learned_addr learned my addr 172.21.15.125:0/818453297 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 -- 172.21.15.125:0/818453297 >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 msgr2=0x7f6eb413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 --2- 172.21.15.125:0/818453297 >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 0x7f6eb413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 -- 172.21.15.125:0/818453297 >> v1:172.21.15.125:6789/0 conn(0x7f6eb40a0a70 legacy=0x7f6eb40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 -- 172.21.15.125:0/818453297 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb409e6a0 con 0x7f6eb40a1550 2023-10-03T10:15:41.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb27fc700 1 -- 172.21.15.125:0/818453297 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214636789 0 0) 0x7f6eb409e9d0 con 0x7f6eb40a0a70 2023-10-03T10:15:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb3fff700 1 --2- 172.21.15.125:0/818453297 >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 0x7f6eb413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb2ffd700 1 --2- 172.21.15.125:0/818453297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4138cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009840 tx=0x7f6ea8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e49c5d5e1a651a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb27fc700 1 -- 172.21.15.125:0/818453297 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011830 con 0x7f6eb40a1550 2023-10-03T10:15:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb27fc700 1 -- 172.21.15.125:0/818453297 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8011990 con 0x7f6eb40a1550 2023-10-03T10:15:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.545+0000 7f6eb27fc700 1 -- 172.21.15.125:0/818453297 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011d20 con 0x7f6eb40a1550 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 -- 172.21.15.125:0/818453297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 msgr2=0x7f6eb4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 --2- 172.21.15.125:0/818453297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4138cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009840 tx=0x7f6ea8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 -- 172.21.15.125:0/818453297 shutdown_connections 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 --2- 172.21.15.125:0/818453297 >> v2:172.21.15.125:3300/0 conn(0x7f6eb4139200 0x7f6eb413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 --2- 172.21.15.125:0/818453297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4138cc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 -- 172.21.15.125:0/818453297 >> 172.21.15.125:0/818453297 conn(0x7f6eb40a6610 msgr2=0x7f6eb40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 -- 172.21.15.125:0/818453297 shutdown_connections 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.546+0000 7f6eba055700 1 -- 172.21.15.125:0/818453297 wait complete. 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 Processor -- start 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 -- start start 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 0x7f6eb4120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40a03e0 con 0x7f6eb4139200 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41239b0 con 0x7f6eb40a1550 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.547+0000 7f6eba055700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4123ed0 con 0x7f6eb40a0a70 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 0x7f6eb4120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47768/0 (socket says 172.21.15.125:47768) 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 -- 172.21.15.125:0/1294498230 learned_addr learned my addr 172.21.15.125:0/1294498230 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb2ffd700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 -- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 msgr2=0x7f6eb4120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 0x7f6eb4120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 -- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 msgr2=0x7f6eb4120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 -- 172.21.15.125:0/1294498230 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009a70 con 0x7f6eb4139200 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb37fe700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 0x7f6eb4120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb2ffd700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eb3fff700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00efc0 tx=0x7f6eac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00ca90 con 0x7f6eb4139200 2023-10-03T10:15:41.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00f040 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea80094a0 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00ce10 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.548+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4124940 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.549+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eac014480 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.549+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6eac03fd80 con 0x7f6eb4139200 2023-10-03T10:15:41.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.549+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4123d10 con 0x7f6eb4139200 2023-10-03T10:15:41.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.554+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eac012930 con 0x7f6eb4139200 2023-10-03T10:15:41.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 Processor -- start 2023-10-03T10:15:41.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 -- start start 2023-10-03T10:15:41.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0240a1550 0x7ff024138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02409e9d0 con 0x7ff0240a0a70 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02409dc00 con 0x7ff0240a1550 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff029e62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02409dec0 con 0x7ff024139200 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff022ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0240a1550 0x7ff024138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff0237fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff0240a0a70 0x7ff0240a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45228/0 (socket says 172.21.15.125:45228) 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff0237fe700 1 -- 172.21.15.125:0/1077658366 learned_addr learned my addr 172.21.15.125:0/1077658366 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff022ffd700 1 --2- 172.21.15.125:0/1077658366 >> v2:172.21.15.125:3300/0 conn(0x7ff0240a1550 0x7ff024138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47776/0 (socket says 172.21.15.125:47776) 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.591+0000 7ff023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54216/0 (socket says 172.21.15.125:54216) 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff022ffd700 1 -- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 msgr2=0x7ff02413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff022ffd700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff022ffd700 1 -- 172.21.15.125:0/1077658366 >> v1:172.21.15.125:6789/0 conn(0x7ff0240a0a70 legacy=0x7ff0240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff022ffd700 1 -- 172.21.15.125:0/1077658366 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02409e6a0 con 0x7ff0240a1550 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff023fff700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff022ffd700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a1550 0x7ff024138cc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff018009840 tx=0x7ff018009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34657a3292dde324 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff0227fc700 1 -- 172.21.15.125:0/1077658366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018011830 con 0x7ff0240a1550 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff0227fc700 1 -- 172.21.15.125:0/1077658366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018011990 con 0x7ff0240a1550 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.592+0000 7ff0227fc700 1 -- 172.21.15.125:0/1077658366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018011d20 con 0x7ff0240a1550 2023-10-03T10:15:41.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 -- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a1550 msgr2=0x7ff024138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a1550 0x7ff024138cc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff018009840 tx=0x7ff018009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 -- 172.21.15.125:0/1077658366 shutdown_connections 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 --2- 172.21.15.125:0/1077658366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a1550 0x7ff024138cc0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 -- 172.21.15.125:0/1077658366 >> 172.21.15.125:0/1077658366 conn(0x7ff0240a6610 msgr2=0x7ff0240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 -- 172.21.15.125:0/1077658366 shutdown_connections 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.593+0000 7ff029e62700 1 -- 172.21.15.125:0/1077658366 wait complete. 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 Processor -- start 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 -- start start 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 0x7ff02411ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024122070 con 0x7ff0240a0a70 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024120440 con 0x7ff024139200 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff029e62700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240a5290 con 0x7ff0240a1550 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 0x7ff02411ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47788/0 (socket says 172.21.15.125:47788) 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54226/0 (socket says 172.21.15.125:54226) 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.594+0000 7ff0237fe700 1 -- 172.21.15.125:0/1151961330 learned_addr learned my addr 172.21.15.125:0/1151961330 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 -- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 msgr2=0x7ff02411ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 0x7ff02411ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 -- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 msgr2=0x7ff02411f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 -- 172.21.15.125:0/1151961330 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c009a70 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff022ffd700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 0x7ff02411ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff023fff700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff0237fe700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c520 tx=0x7ff01400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014005d70 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0140070d0 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014007440 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0180094a0 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.595+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024121db0 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.596+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0140075a0 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.596+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff01403eb20 con 0x7ff0240a0a70 2023-10-03T10:15:41.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.596+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02404f2a0 con 0x7ff0240a0a70 2023-10-03T10:15:41.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.601+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff014017080 con 0x7ff0240a0a70 2023-10-03T10:15:41.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.745+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6eb4123b70 con 0x7f6eb4139200 2023-10-03T10:15:41.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.746+0000 7f6e9bfff700 1 -- 172.21.15.125:0/1294498230 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eb4123b70 con 0x7f6eb4139200 2023-10-03T10:15:41.746 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 msgr2=0x7f6eb4121110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00efc0 tx=0x7f6eac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 shutdown_connections 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb4139200 0x7f6eb4121110 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6eb40a0a70 0x7f6eb4120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 --2- 172.21.15.125:0/1294498230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6eb40a1550 0x7f6eb4120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 >> 172.21.15.125:0/1294498230 conn(0x7f6eb40a6610 msgr2=0x7f6eb40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 shutdown_connections 2023-10-03T10:15:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.748+0000 7f6eba055700 1 -- 172.21.15.125:0/1294498230 wait complete. 2023-10-03T10:15:41.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:41.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.790+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff024120c00 con 0x7ff0240a0a70 2023-10-03T10:15:41.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.791+0000 7ff00bfff700 1 -- 172.21.15.125:0/1151961330 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff014019b40 con 0x7ff0240a0a70 2023-10-03T10:15:41.791 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:41.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 msgr2=0x7ff02411e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c520 tx=0x7ff01400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:41.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 shutdown_connections 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff024139200 0x7ff02411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0240a0a70 0x7ff02411e830 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 --2- 172.21.15.125:0/1151961330 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0240a1550 0x7ff02411ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 >> 172.21.15.125:0/1151961330 conn(0x7ff0240a6610 msgr2=0x7ff024136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 shutdown_connections 2023-10-03T10:15:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:41.793+0000 7ff029e62700 1 -- 172.21.15.125:0/1151961330 wait complete. 2023-10-03T10:15:41.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:42.342 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:42.377 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:42.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.469+0000 7f839788d700 1 Processor -- start 2023-10-03T10:15:42.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 -- start start 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f839012f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f839009c8c0 0x7f839012fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839009a6c0 con 0x7f8390130180 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839009be00 con 0x7f839009c8c0 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.470+0000 7f839788d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839009ac80 con 0x7f839009a0a0 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f839012f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8394e28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f839009c8c0 0x7f839012fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395e2a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8390130180 0x7f83900980c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45240/0 (socket says 172.21.15.125:45240) 2023-10-03T10:15:42.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395e2a700 1 -- 172.21.15.125:0/1199787929 learned_addr learned my addr 172.21.15.125:0/1199787929 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8387fff700 1 -- 172.21.15.125:0/1199787929 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34691784 0 0) 0x7f839009a6c0 con 0x7f8390130180 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 -- 172.21.15.125:0/1199787929 >> v2:172.21.15.125:3300/0 conn(0x7f839009c8c0 msgr2=0x7f839012fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 --2- 172.21.15.125:0/1199787929 >> v2:172.21.15.125:3300/0 conn(0x7f839009c8c0 0x7f839012fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 -- 172.21.15.125:0/1199787929 >> v1:172.21.15.125:6789/0 conn(0x7f8390130180 legacy=0x7f83900980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 -- 172.21.15.125:0/1199787929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839009bff0 con 0x7f839009a0a0 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8395629700 1 --2- 172.21.15.125:0/1199787929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f839012f700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f838c009840 tx=0x7f838c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde81392a71cb17b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8387fff700 1 -- 172.21.15.125:0/1199787929 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011830 con 0x7f839009a0a0 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8387fff700 1 -- 172.21.15.125:0/1199787929 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c011990 con 0x7f839009a0a0 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.471+0000 7f8387fff700 1 -- 172.21.15.125:0/1199787929 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011d20 con 0x7f839009a0a0 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 -- 172.21.15.125:0/1199787929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 msgr2=0x7f839012f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 --2- 172.21.15.125:0/1199787929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f839012f700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f838c009840 tx=0x7f838c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 -- 172.21.15.125:0/1199787929 shutdown_connections 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 --2- 172.21.15.125:0/1199787929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f839012f700 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 --2- 172.21.15.125:0/1199787929 >> v2:172.21.15.125:3300/0 conn(0x7f839009c8c0 0x7f839012fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 -- 172.21.15.125:0/1199787929 >> 172.21.15.125:0/1199787929 conn(0x7f83900a1ee0 msgr2=0x7f83900a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 -- 172.21.15.125:0/1199787929 shutdown_connections 2023-10-03T10:15:42.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.472+0000 7f839788d700 1 -- 172.21.15.125:0/1199787929 wait complete. 2023-10-03T10:15:42.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.473+0000 7f839788d700 1 Processor -- start 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.473+0000 7f839788d700 1 -- start start 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f839009c8c0 0x7f839013a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8390130180 0x7f839013a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839013b950 con 0x7f8390130180 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390072790 con 0x7f839009a0a0 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f839788d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8390071ca0 con 0x7f839009c8c0 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54244/0 (socket says 172.21.15.125:54244) 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 -- 172.21.15.125:0/3940390828 learned_addr learned my addr 172.21.15.125:0/3940390828 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8394e28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f839009c8c0 0x7f839013a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395e2a700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8390130180 0x7f839013a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 -- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f839009c8c0 msgr2=0x7f839013a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f839009c8c0 0x7f839013a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 -- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8390130180 msgr2=0x7f839013a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8390130180 0x7f839013a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.474+0000 7f8395629700 1 -- 172.21.15.125:0/3940390828 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0094a0 con 0x7f839009a0a0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f8395629700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f838c0090b0 tx=0x7f838c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c004400 con 0x7f839009a0a0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c01f070 con 0x7f839009a0a0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0038a0 con 0x7f839009a0a0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839013b120 con 0x7f839009a0a0 2023-10-03T10:15:42.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.475+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390072510 con 0x7f839009a0a0 2023-10-03T10:15:42.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.476+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83900990d0 con 0x7f839009a0a0 2023-10-03T10:15:42.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.477+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838c021030 con 0x7f839009a0a0 2023-10-03T10:15:42.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.477+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f838c040e40 con 0x7f839009a0a0 2023-10-03T10:15:42.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.481+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f838c0199a0 con 0x7f839009a0a0 2023-10-03T10:15:42.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.513+0000 7fb5c84e0700 1 Processor -- start 2023-10-03T10:15:42.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.513+0000 7fb5c84e0700 1 -- start start 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5c00a0a70 0x7fb5c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 0x7fb5c01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c009e9d0 con 0x7fb5c00a0a70 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c009dc00 con 0x7fb5c00a1380 2023-10-03T10:15:42.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c84e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c009dec0 con 0x7fb5c0133f50 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5c00a0a70 0x7fb5c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c5a7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5c00a0a70 0x7fb5c00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47822/0 (socket says 172.21.15.125:47822) 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 -- 172.21.15.125:0/2285128245 learned_addr learned my addr 172.21.15.125:0/2285128245 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c5a7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54260/0 (socket says 172.21.15.125:54260) 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c6a7d700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 0x7fb5c01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 -- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 msgr2=0x7fb5c01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 0x7fb5c01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 -- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 msgr2=0x7fb5c0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 -- 172.21.15.125:0/2285128245 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c009e6a0 con 0x7fb5c00a0a70 2023-10-03T10:15:42.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c5a7b700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c6a7d700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 0x7fb5c01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c627c700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c00a0e40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098f0 tx=0x7fb5bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f4a23d5bc02ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c527a700 1 -- 172.21.15.125:0/2285128245 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011830 con 0x7fb5c00a0a70 2023-10-03T10:15:42.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c527a700 1 -- 172.21.15.125:0/2285128245 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc011990 con 0x7fb5c00a0a70 2023-10-03T10:15:42.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.514+0000 7fb5c527a700 1 -- 172.21.15.125:0/2285128245 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011d20 con 0x7fb5c00a0a70 2023-10-03T10:15:42.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 msgr2=0x7fb5c00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c00a0e40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098f0 tx=0x7fb5bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:42.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2285128245 shutdown_connections 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c0133f50 0x7fb5c01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c00a0e40 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2285128245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c00a1380 0x7fb5c0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2285128245 >> 172.21.15.125:0/2285128245 conn(0x7fb5c00a6610 msgr2=0x7fb5c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2285128245 shutdown_connections 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.515+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2285128245 wait complete. 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 Processor -- start 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 -- start start 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c0133f50 0x7fb5c0122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0132900 con 0x7fb5c00a0a70 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0123fd0 con 0x7fb5c0133f50 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.517+0000 7fb5c84e0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0124ab0 con 0x7fb5c00a1380 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c627c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36356/0 (socket says 172.21.15.125:36356) 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c627c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47838/0 (socket says 172.21.15.125:47838) 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 -- 172.21.15.125:0/2666576231 learned_addr learned my addr 172.21.15.125:0/2666576231 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c6a7d700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c0133f50 0x7fb5c0122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 -- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c0133f50 msgr2=0x7fb5c0122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c0133f50 0x7fb5c0122000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 -- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 msgr2=0x7fb5c0121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 -- 172.21.15.125:0/2666576231 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00094a0 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c627c700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c5a7b700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000ec10 tx=0x7fb5b000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0009780 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000c850 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b8009a70 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000cbe0 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.518+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc009550 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.519+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5b000cd40 con 0x7fb5c00a1380 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.519+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5b003fac0 con 0x7fb5c00a1380 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.519+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0124390 con 0x7fb5c00a1380 2023-10-03T10:15:42.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.524+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5b001b3b0 con 0x7fb5c00a1380 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.688+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f839004f2a0 con 0x7f839009a0a0 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.689+0000 7f8385ffb700 1 -- 172.21.15.125:0/3940390828 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f838c015030 con 0x7f839009a0a0 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 msgr2=0x7f8390139d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f838c0090b0 tx=0x7f838c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 shutdown_connections 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8390130180 0x7f839013a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f839009a0a0 0x7f8390139d70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 --2- 172.21.15.125:0/3940390828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f839009c8c0 0x7f839013a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 >> 172.21.15.125:0/3940390828 conn(0x7f83900a1ee0 msgr2=0x7f83900910c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 shutdown_connections 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.691+0000 7f839788d700 1 -- 172.21.15.125:0/3940390828 wait complete. 2023-10-03T10:15:42.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:42.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.729+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb5c011e040 con 0x7fb5c00a1380 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.729+0000 7fb5b6ffd700 1 -- 172.21.15.125:0/2666576231 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5b0017020 con 0x7fb5c00a1380 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 msgr2=0x7fb5c0121ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000ec10 tx=0x7fb5b000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 shutdown_connections 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5c0133f50 0x7fb5c0122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5c00a0a70 0x7fb5c0121580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 --2- 172.21.15.125:0/2666576231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5c00a1380 0x7fb5c0121ac0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 >> 172.21.15.125:0/2666576231 conn(0x7fb5c00a6610 msgr2=0x7fb5c01332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.731+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 shutdown_connections 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.732+0000 7fb5c84e0700 1 -- 172.21.15.125:0/2666576231 wait complete. 2023-10-03T10:15:42.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:42.761 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:42.806 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:42.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 Processor -- start 2023-10-03T10:15:42.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 -- start start 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 0x7faad809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 0x7faad8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad809c970 con 0x7faad8131d70 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80a0920 con 0x7faad809f180 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.910+0000 7faadf3a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad809f9c0 con 0x7faad809e870 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 0x7faad809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadc943700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 0x7faad8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd945700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faad8131d70 0x7faad8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45244/0 (socket says 172.21.15.125:45244) 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd945700 1 -- 172.21.15.125:0/1229722869 learned_addr learned my addr 172.21.15.125:0/1229722869 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 -- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 msgr2=0x7faad8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 0x7faad8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 -- 172.21.15.125:0/1229722869 >> v1:172.21.15.125:6789/0 conn(0x7faad8131d70 legacy=0x7faad8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faacffff700 1 -- 172.21.15.125:0/1229722869 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419557349 0 0) 0x7faad809c970 con 0x7faad8131d70 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 -- 172.21.15.125:0/1229722869 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad809bab0 con 0x7faad809e870 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadc943700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 0x7faad8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faadd144700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 0x7faad809ec40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c155562c8dc7052a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faacffff700 1 -- 172.21.15.125:0/1229722869 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4011830 con 0x7faad809e870 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faacffff700 1 -- 172.21.15.125:0/1229722869 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad4011990 con 0x7faad809e870 2023-10-03T10:15:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.911+0000 7faacffff700 1 -- 172.21.15.125:0/1229722869 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4011d20 con 0x7faad809e870 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 -- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 msgr2=0x7faad809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 0x7faad809ec40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 -- 172.21.15.125:0/1229722869 shutdown_connections 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809e870 0x7faad809ec40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 --2- 172.21.15.125:0/1229722869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad809f180 0x7faad8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 -- 172.21.15.125:0/1229722869 >> 172.21.15.125:0/1229722869 conn(0x7faad80a4430 msgr2=0x7faad80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 -- 172.21.15.125:0/1229722869 shutdown_connections 2023-10-03T10:15:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.912+0000 7faadf3a8700 1 -- 172.21.15.125:0/1229722869 wait complete. 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 Processor -- start 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 -- start start 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 0x7faad81c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad8131d70 0x7faad81c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad811e640 con 0x7faad809e870 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad811e450 con 0x7faad8131d70 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadf3a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad8131830 con 0x7faad809f180 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadd144700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadc943700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 0x7faad81c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadd144700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47840/0 (socket says 172.21.15.125:47840) 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadd144700 1 -- 172.21.15.125:0/231313421 learned_addr learned my addr 172.21.15.125:0/231313421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.913+0000 7faadd945700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad8131d70 0x7faad81c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 -- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 msgr2=0x7faad81c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 0x7faad81c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 -- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad8131d70 msgr2=0x7faad81c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad8131d70 0x7faad81c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 -- 172.21.15.125:0/231313421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80094a0 con 0x7faad809e870 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadc943700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 0x7faad81c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadd144700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faad4014040 tx=0x7faad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4004510 con 0x7faad809e870 2023-10-03T10:15:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad401e070 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40094a0 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40038e0 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.914+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad81203d0 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.915+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faad4003a40 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.915+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faad4040380 con 0x7faad809e870 2023-10-03T10:15:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.915+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad811ffa0 con 0x7faad809e870 2023-10-03T10:15:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.920+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faad402d450 con 0x7faad809e870 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.952+0000 7f99675a7700 1 Processor -- start 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 -- start start 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 0x7f99600993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996009a540 con 0x7f9960099920 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996009ad40 con 0x7f99601307c0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f99675a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996009e640 con 0x7f996012feb0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f9965343700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f9965343700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54302/0 (socket says 172.21.15.125:54302) 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f9965343700 1 -- 172.21.15.125:0/3019414135 learned_addr learned my addr 172.21.15.125:0/3019414135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f9964b42700 1 --2- 172.21.15.125:0/3019414135 >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 0x7f99600993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.953+0000 7f9965343700 1 -- 172.21.15.125:0/3019414135 >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 msgr2=0x7f99600993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f9965343700 1 --2- 172.21.15.125:0/3019414135 >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 0x7f99600993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f9965343700 1 -- 172.21.15.125:0/3019414135 >> v1:172.21.15.125:6789/0 conn(0x7f9960099920 legacy=0x7f9960136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f995ffff700 1 -- 172.21.15.125:0/3019414135 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133264559 0 0) 0x7f996009a540 con 0x7f9960099920 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f9965343700 1 -- 172.21.15.125:0/3019414135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996009e3c0 con 0x7f996012feb0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f9964b42700 1 --2- 172.21.15.125:0/3019414135 >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 0x7f99600993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f9965343700 1 --2- 172.21.15.125:0/3019414135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9958006fd0 tx=0x7f995800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ea30b74aa3cd01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f995ffff700 1 -- 172.21.15.125:0/3019414135 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958005c20 con 0x7f996012feb0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f995ffff700 1 -- 172.21.15.125:0/3019414135 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958005d80 con 0x7f996012feb0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f995ffff700 1 -- 172.21.15.125:0/3019414135 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800db80 con 0x7f996012feb0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 -- 172.21.15.125:0/3019414135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 msgr2=0x7f9960130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 --2- 172.21.15.125:0/3019414135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9958006fd0 tx=0x7f995800be70 comp rx=0 tx=0).stop 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 -- 172.21.15.125:0/3019414135 shutdown_connections 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 --2- 172.21.15.125:0/3019414135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f996012feb0 0x7f9960130280 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 --2- 172.21.15.125:0/3019414135 >> v2:172.21.15.125:3300/0 conn(0x7f99601307c0 0x7f99600993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.954+0000 7f99675a7700 1 -- 172.21.15.125:0/3019414135 >> 172.21.15.125:0/3019414135 conn(0x7f99600a2b30 msgr2=0x7f996009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.955+0000 7f99675a7700 1 -- 172.21.15.125:0/3019414135 shutdown_connections 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.955+0000 7f99675a7700 1 -- 172.21.15.125:0/3019414135 wait complete. 2023-10-03T10:15:42.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.955+0000 7f99675a7700 1 Processor -- start 2023-10-03T10:15:42.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.955+0000 7f99675a7700 1 -- start start 2023-10-03T10:15:42.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9960099920 0x7f99601c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f996012feb0 0x7f99601c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99601c8190 con 0x7f996012feb0 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996008bd60 con 0x7f99601307c0 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f99675a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f996012f780 con 0x7f9960099920 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54314/0 (socket says 172.21.15.125:54314) 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 -- 172.21.15.125:0/2206915898 learned_addr learned my addr 172.21.15.125:0/2206915898 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965343700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9960099920 0x7f99601c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9964b42700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f996012feb0 0x7f99601c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 -- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9960099920 msgr2=0x7f99601c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9960099920 0x7f99601c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 -- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f996012feb0 msgr2=0x7f99601c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f996012feb0 0x7f99601c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.956+0000 7f9965b44700 1 -- 172.21.15.125:0/2206915898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540094a0 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f9965b44700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9950001560 tx=0x7f995000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950003e30 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950005070 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995800b7a0 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950005420 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996008ba70 con 0x7f99601307c0 2023-10-03T10:15:42.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.957+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9950005580 con 0x7f99601307c0 2023-10-03T10:15:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.958+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f995003ec50 con 0x7f99601307c0 2023-10-03T10:15:42.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.958+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996004f2a0 con 0x7f99601307c0 2023-10-03T10:15:42.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:42.963+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f995001b3b0 con 0x7f99601307c0 2023-10-03T10:15:43.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.112+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faad804f2a0 con 0x7faad809e870 2023-10-03T10:15:43.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.113+0000 7faacdffb700 1 -- 172.21.15.125:0/231313421 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faad4015020 con 0x7faad809e870 2023-10-03T10:15:43.113 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:43.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 msgr2=0x7faad81c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faad4014040 tx=0x7faad4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 shutdown_connections 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad8131d70 0x7faad81c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad809e870 0x7faad81c6070 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 --2- 172.21.15.125:0/231313421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faad809f180 0x7faad81c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 >> 172.21.15.125:0/231313421 conn(0x7faad80a4430 msgr2=0x7faad809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 shutdown_connections 2023-10-03T10:15:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.115+0000 7faadf3a8700 1 -- 172.21.15.125:0/231313421 wait complete. 2023-10-03T10:15:43.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:43.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.150+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f996012d5b0 con 0x7f99601307c0 2023-10-03T10:15:43.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.150+0000 7f995dffb700 1 -- 172.21.15.125:0/2206915898 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9950010300 con 0x7f99601307c0 2023-10-03T10:15:43.151 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 msgr2=0x7f996012b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9950001560 tx=0x7f995000cb50 comp rx=0 tx=0).stop 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 shutdown_connections 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99601307c0 0x7f996012b8a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9960099920 0x7f99601c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 --2- 172.21.15.125:0/2206915898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f996012feb0 0x7f99601c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 >> 172.21.15.125:0/2206915898 conn(0x7f99600a2b30 msgr2=0x7f996009fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 shutdown_connections 2023-10-03T10:15:43.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.152+0000 7f99675a7700 1 -- 172.21.15.125:0/2206915898 wait complete. 2023-10-03T10:15:43.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:43.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:43.744 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:43.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 Processor -- start 2023-10-03T10:15:43.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 -- start start 2023-10-03T10:15:43.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7aa40a0a70 0x7f7aa40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa409dc00 con 0x7f7aa40a1380 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa409ea90 con 0x7f7aa40a0a70 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aac054700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa409dec0 con 0x7f7aa4134120 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.833+0000 7f7aa9df0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7aa40a0a70 0x7f7aa40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aaa5f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aaa5f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54326/0 (socket says 172.21.15.125:54326) 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7aa40a0a70 0x7f7aa40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47864/0 (socket says 172.21.15.125:47864) 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aaa5f1700 1 -- 172.21.15.125:0/1841170984 learned_addr learned my addr 172.21.15.125:0/1841170984 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa95ef700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7aa40a1380 0x7f7aa4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45258/0 (socket says 172.21.15.125:45258) 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 -- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 msgr2=0x7f7aa413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 -- 172.21.15.125:0/1841170984 >> v1:172.21.15.125:6789/0 conn(0x7f7aa40a1380 legacy=0x7f7aa4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 -- 172.21.15.125:0/1841170984 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa409e6a0 con 0x7f7aa40a0a70 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa8dee700 1 -- 172.21.15.125:0/1841170984 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354603670 0 0) 0x7f7aa409dc00 con 0x7f7aa40a1380 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aaa5f1700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa9df0700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa40a0e40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009840 tx=0x7f7aa0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9295890be45d235f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa8dee700 1 -- 172.21.15.125:0/1841170984 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0011830 con 0x7f7aa40a0a70 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa8dee700 1 -- 172.21.15.125:0/1841170984 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0011990 con 0x7f7aa40a0a70 2023-10-03T10:15:43.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.834+0000 7f7aa8dee700 1 -- 172.21.15.125:0/1841170984 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0011d20 con 0x7f7aa40a0a70 2023-10-03T10:15:43.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 -- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 msgr2=0x7f7aa40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa40a0e40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009840 tx=0x7f7aa0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 -- 172.21.15.125:0/1841170984 shutdown_connections 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa4134120 0x7f7aa413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 --2- 172.21.15.125:0/1841170984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa40a0e40 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 -- 172.21.15.125:0/1841170984 >> 172.21.15.125:0/1841170984 conn(0x7f7aa40a6610 msgr2=0x7f7aa40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 -- 172.21.15.125:0/1841170984 shutdown_connections 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.835+0000 7f7aac054700 1 -- 172.21.15.125:0/1841170984 wait complete. 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 Processor -- start 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 -- start start 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa4122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 0x7f7aa4122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 0x7f7aa4123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4133300 con 0x7f7aa40a0a70 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4125920 con 0x7f7aa40a1380 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aac054700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4124310 con 0x7f7aa4134120 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aa95ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 0x7f7aa4122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aa95ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 0x7f7aa4122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54328/0 (socket says 172.21.15.125:54328) 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aa95ef700 1 -- 172.21.15.125:0/2298356677 learned_addr learned my addr 172.21.15.125:0/2298356677 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aa9df0700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa4122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.836+0000 7f7aaa5f1700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 0x7f7aa4123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 -- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 msgr2=0x7f7aa4122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 0x7f7aa4122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 -- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 msgr2=0x7f7aa4122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa4122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 -- 172.21.15.125:0/2298356677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c009b30 con 0x7f7aa4134120 2023-10-03T10:15:43.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aa9df0700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa4122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aaa5f1700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 0x7f7aa4123180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00efc0 tx=0x7f7a9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c018070 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa00094a0 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00f040 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c003c60 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.837+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa4125c80 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.838+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a9c00c880 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.838+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a9c03f7d0 con 0x7f7aa4134120 2023-10-03T10:15:43.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.838+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa404f2a0 con 0x7f7aa4134120 2023-10-03T10:15:43.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.843+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a9c003dc0 con 0x7f7aa4134120 2023-10-03T10:15:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 Processor -- start 2023-10-03T10:15:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 -- start start 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 0x7f7d2c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2c09b110 con 0x7f7d2c133f70 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c0a3b60 con 0x7f7d2c1343a0 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d30862700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0a2fa0 con 0x7f7d2c09ad40 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d2a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.874+0000 7f7d2ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 0x7f7d2c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54340/0 (socket says 172.21.15.125:54340) 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 -- 172.21.15.125:0/473109370 learned_addr learned my addr 172.21.15.125:0/473109370 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:43.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d29d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7d2c133f70 0x7f7d2c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45268/0 (socket says 172.21.15.125:45268) 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 -- 172.21.15.125:0/473109370 >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 msgr2=0x7f7d2c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 --2- 172.21.15.125:0/473109370 >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 0x7f7d2c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 -- 172.21.15.125:0/473109370 >> v1:172.21.15.125:6789/0 conn(0x7f7d2c133f70 legacy=0x7f7d2c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 -- 172.21.15.125:0/473109370 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c09a280 con 0x7f7d2c09ad40 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2959a700 1 -- 172.21.15.125:0/473109370 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118788959 0 0) 0x7f7d2c09b110 con 0x7f7d2c133f70 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2ad9d700 1 --2- 172.21.15.125:0/473109370 >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 0x7f7d2c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2a59c700 1 --2- 172.21.15.125:0/473109370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009920 tx=0x7f7d1c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a53bca8d5e3fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2959a700 1 -- 172.21.15.125:0/473109370 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c011830 con 0x7f7d2c09ad40 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2959a700 1 -- 172.21.15.125:0/473109370 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c011990 con 0x7f7d2c09ad40 2023-10-03T10:15:43.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.875+0000 7f7d2959a700 1 -- 172.21.15.125:0/473109370 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c011d20 con 0x7f7d2c09ad40 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 -- 172.21.15.125:0/473109370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 msgr2=0x7f7d2c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 --2- 172.21.15.125:0/473109370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009920 tx=0x7f7d1c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 -- 172.21.15.125:0/473109370 shutdown_connections 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 --2- 172.21.15.125:0/473109370 >> v2:172.21.15.125:3300/0 conn(0x7f7d2c1343a0 0x7f7d2c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 --2- 172.21.15.125:0/473109370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c133a30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 -- 172.21.15.125:0/473109370 >> 172.21.15.125:0/473109370 conn(0x7f7d2c099c40 msgr2=0x7f7d2c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 -- 172.21.15.125:0/473109370 shutdown_connections 2023-10-03T10:15:43.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.876+0000 7f7d30862700 1 -- 172.21.15.125:0/473109370 wait complete. 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 Processor -- start 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 -- start start 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d2c133f70 0x7f7d2c11f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d2c1343a0 0x7f7d2c11fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c120e40 con 0x7f7d2c133f70 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c1229d0 con 0x7f7d2c09ad40 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d30862700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0a41a0 con 0x7f7d2c1343a0 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d2a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d2a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54350/0 (socket says 172.21.15.125:54350) 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d2a59c700 1 -- 172.21.15.125:0/374333413 learned_addr learned my addr 172.21.15.125:0/374333413 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:43.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.877+0000 7f7d29d9b700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d2c133f70 0x7f7d2c11f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2ad9d700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d2c1343a0 0x7f7d2c11fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 -- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d2c1343a0 msgr2=0x7f7d2c11fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d2c1343a0 0x7f7d2c11fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 -- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d2c133f70 msgr2=0x7f7d2c11f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d2c133f70 0x7f7d2c11f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 -- 172.21.15.125:0/374333413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24009a70 con 0x7f7d2c09ad40 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d2a59c700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009130 tx=0x7f7d1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0044d0 con 0x7f7d2c09ad40 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c01e070 con 0x7f7d2c09ad40 2023-10-03T10:15:43.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c009550 con 0x7f7d2c09ad40 2023-10-03T10:15:43.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0038e0 con 0x7f7d2c09ad40 2023-10-03T10:15:43.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.878+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c122710 con 0x7f7d2c09ad40 2023-10-03T10:15:43.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.879+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d1c003a40 con 0x7f7d2c09ad40 2023-10-03T10:15:43.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.879+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d1c020070 con 0x7f7d2c09ad40 2023-10-03T10:15:43.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.879+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c0a0430 con 0x7f7d2c09ad40 2023-10-03T10:15:43.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:43.884+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d1c01a420 con 0x7f7d2c09ad40 2023-10-03T10:15:44.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.055+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7aa4072980 con 0x7f7aa4134120 2023-10-03T10:15:44.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.056+0000 7f7a9a7fc700 1 -- 172.21.15.125:0/2298356677 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a9c01de00 con 0x7f7aa4134120 2023-10-03T10:15:44.056 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:44.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 msgr2=0x7f7aa4123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 0x7f7aa4123180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00efc0 tx=0x7f7a9c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 shutdown_connections 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7aa4134120 0x7f7aa4123180 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa40a0a70 0x7f7aa4122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 --2- 172.21.15.125:0/2298356677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa40a1380 0x7f7aa4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 >> 172.21.15.125:0/2298356677 conn(0x7f7aa40a6610 msgr2=0x7f7aa40a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 shutdown_connections 2023-10-03T10:15:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.059+0000 7f7aac054700 1 -- 172.21.15.125:0/2298356677 wait complete. 2023-10-03T10:15:44.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.100+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d2c04f2a0 con 0x7f7d2c09ad40 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.100+0000 7f7d1affd700 1 -- 172.21.15.125:0/374333413 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d1c015030 con 0x7f7d2c09ad40 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 msgr2=0x7f7d2c11f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009130 tx=0x7f7d1c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 shutdown_connections 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d2c1343a0 0x7f7d2c11fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d2c09ad40 0x7f7d2c11f2c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 --2- 172.21.15.125:0/374333413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d2c133f70 0x7f7d2c11f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 >> 172.21.15.125:0/374333413 conn(0x7f7d2c099c40 msgr2=0x7f7d2c09d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 shutdown_connections 2023-10-03T10:15:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.102+0000 7f7d30862700 1 -- 172.21.15.125:0/374333413 wait complete. 2023-10-03T10:15:44.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:44.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:44.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 Processor -- start 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 -- start start 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a1380 0x7f8be0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 0x7f8be01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be009e9d0 con 0x7f8be0133f50 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be009dc00 con 0x7f8be00a1380 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.282+0000 7f8be5ada700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8be009dec0 con 0x7f8be00a0a70 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36406/0 (socket says 172.21.15.125:36406) 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/2047620002 learned_addr learned my addr 172.21.15.125:0/2047620002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 0x7f8be01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdeffd700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a1380 0x7f8be0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a1380 msgr2=0x7f8be0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a1380 0x7f8be0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/2047620002 >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 msgr2=0x7f8be01343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/2047620002 >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 0x7f8be01343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/2047620002 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be009e6a0 con 0x7f8be00a0a70 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdffff700 1 --2- 172.21.15.125:0/2047620002 >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 0x7f8be01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009e50 tx=0x7f8bd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291ea1568f6a93fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bde7fc700 1 -- 172.21.15.125:0/2047620002 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000e070 con 0x7f8be00a0a70 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bde7fc700 1 -- 172.21.15.125:0/2047620002 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd000b910 con 0x7f8be00a0a70 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.283+0000 7f8bde7fc700 1 -- 172.21.15.125:0/2047620002 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000bcc0 con 0x7f8be00a0a70 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 -- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 msgr2=0x7f8be00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009e50 tx=0x7f8bd000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 -- 172.21.15.125:0/2047620002 shutdown_connections 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 --2- 172.21.15.125:0/2047620002 >> v2:172.21.15.125:3300/0 conn(0x7f8be0133f50 0x7f8be01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a0a70 0x7f8be00a0e40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 --2- 172.21.15.125:0/2047620002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a1380 0x7f8be0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 -- 172.21.15.125:0/2047620002 >> 172.21.15.125:0/2047620002 conn(0x7f8be00a6610 msgr2=0x7f8be00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 -- 172.21.15.125:0/2047620002 shutdown_connections 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.284+0000 7f8be5ada700 1 -- 172.21.15.125:0/2047620002 wait complete. 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 Processor -- start 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 -- start start 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8be0133f50 0x7f8be0122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.285+0000 7f8be5ada700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0133a90 con 0x7f8be0133f50 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8be5ada700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be01253a0 con 0x7f8be00a0a70 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8be5ada700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0124fe0 con 0x7f8be00a1380 2023-10-03T10:15:44.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54382/0 (socket says 172.21.15.125:54382) 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36420/0 (socket says 172.21.15.125:36420) 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/3791876459 learned_addr learned my addr 172.21.15.125:0/3791876459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdffff700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8be0133f50 0x7f8be0122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 msgr2=0x7f8be0122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8be0133f50 msgr2=0x7f8be0122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8be0133f50 0x7f8be0122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 -- 172.21.15.125:0/3791876459 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80094a0 con 0x7f8be00a0a70 2023-10-03T10:15:44.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdeffd700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bdf7fe700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b370 tx=0x7f8bd0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000ce80 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd0004250 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0004600 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0009b30 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.286+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be0125ac0 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.287+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bd0004760 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.287+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bd0040930 con 0x7f8be00a0a70 2023-10-03T10:15:44.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.287+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be01257f0 con 0x7f8be00a0a70 2023-10-03T10:15:44.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.292+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bd0019760 con 0x7f8be00a0a70 2023-10-03T10:15:44.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 Processor -- start 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 -- start start 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 0x7f4a00133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0009e9d0 con 0x7f4a000a1380 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0009dc00 con 0x7f4a000a0a70 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f4a053f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0009dec0 con 0x7f4a00133f50 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f49feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.325+0000 7f49ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49fe7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 0x7f4a00133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54394/0 (socket says 172.21.15.125:54394) 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36424/0 (socket says 172.21.15.125:36424) 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 -- 172.21.15.125:0/1994764353 learned_addr learned my addr 172.21.15.125:0/1994764353 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 -- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 msgr2=0x7f4a00134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 -- 172.21.15.125:0/1994764353 >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 msgr2=0x7f4a00133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 --2- 172.21.15.125:0/1994764353 >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 0x7f4a00133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 -- 172.21.15.125:0/1994764353 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0009e6a0 con 0x7f4a000a0a70 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49fe7fc700 1 --2- 172.21.15.125:0/1994764353 >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 0x7f4a00133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49ff7fe700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49feffd700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f49f00098f0 tx=0x7f49f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35809f3e48e8847 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49fdffb700 1 -- 172.21.15.125:0/1994764353 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0011830 con 0x7f4a000a0a70 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49fdffb700 1 -- 172.21.15.125:0/1994764353 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f0011990 con 0x7f4a000a0a70 2023-10-03T10:15:44.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.326+0000 7f49fdffb700 1 -- 172.21.15.125:0/1994764353 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0011d20 con 0x7f4a000a0a70 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 -- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 msgr2=0x7f4a000a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f49f00098f0 tx=0x7f49f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 -- 172.21.15.125:0/1994764353 shutdown_connections 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a000a0e40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 --2- 172.21.15.125:0/1994764353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 --2- 172.21.15.125:0/1994764353 >> v2:172.21.15.125:3300/0 conn(0x7f4a000a1380 0x7f4a00133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 -- 172.21.15.125:0/1994764353 >> 172.21.15.125:0/1994764353 conn(0x7f4a000a6610 msgr2=0x7f4a000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 -- 172.21.15.125:0/1994764353 shutdown_connections 2023-10-03T10:15:44.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.327+0000 7f4a053f7700 1 -- 172.21.15.125:0/1994764353 wait complete. 2023-10-03T10:15:44.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.328+0000 7f4a053f7700 1 Processor -- start 2023-10-03T10:15:44.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.328+0000 7f4a053f7700 1 -- start start 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a000a1380 0x7f4a00122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00125e70 con 0x7f4a000a1380 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00125960 con 0x7f4a000a0a70 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f4a053f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00124df0 con 0x7f4a00133f50 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54396/0 (socket says 172.21.15.125:54396) 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 -- 172.21.15.125:0/730302185 learned_addr learned my addr 172.21.15.125:0/730302185 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:44.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49fe7fc700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a000a1380 0x7f4a00122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 -- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 msgr2=0x7f4a00122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 -- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a000a1380 msgr2=0x7f4a00122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a000a1380 0x7f4a00122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 -- 172.21.15.125:0/730302185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40094a0 con 0x7f4a000a0a70 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49ff7fe700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.329+0000 7f49feffd700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009c40 tx=0x7f49f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0004450 con 0x7f4a000a0a70 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f001e070 con 0x7f4a000a0a70 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f00038e0 con 0x7f4a000a0a70 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f8009a70 con 0x7f4a000a0a70 2023-10-03T10:15:44.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f0009550 con 0x7f4a000a0a70 2023-10-03T10:15:44.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49f0003a40 con 0x7f4a000a0a70 2023-10-03T10:15:44.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.330+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49f00404b0 con 0x7f4a000a0a70 2023-10-03T10:15:44.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.331+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0011f760 con 0x7f4a000a0a70 2023-10-03T10:15:44.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.335+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49f002d7d0 con 0x7f4a000a0a70 2023-10-03T10:15:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.483+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8be004f2a0 con 0x7f8be00a0a70 2023-10-03T10:15:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.484+0000 7f8bc7fff700 1 -- 172.21.15.125:0/3791876459 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bd0019350 con 0x7f8be00a0a70 2023-10-03T10:15:44.484 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 msgr2=0x7f8be0122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b370 tx=0x7f8bd0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 shutdown_connections 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8be0133f50 0x7f8be0122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8be00a0a70 0x7f8be0122540 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 --2- 172.21.15.125:0/3791876459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8be00a1380 0x7f8be0122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 >> 172.21.15.125:0/3791876459 conn(0x7f8be00a6610 msgr2=0x7f8be009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 shutdown_connections 2023-10-03T10:15:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.486+0000 7f8be5ada700 1 -- 172.21.15.125:0/3791876459 wait complete. 2023-10-03T10:15:44.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:44.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.524+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a000a51f0 con 0x7f4a000a0a70 2023-10-03T10:15:44.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.524+0000 7f49e77fe700 1 -- 172.21.15.125:0/730302185 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49f0023ba0 con 0x7f4a000a0a70 2023-10-03T10:15:44.525 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 msgr2=0x7f4a00122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009c40 tx=0x7f49f0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 shutdown_connections 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a00133f50 0x7f4a00122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a000a0a70 0x7f4a00122350 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 --2- 172.21.15.125:0/730302185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a000a1380 0x7f4a00122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 >> 172.21.15.125:0/730302185 conn(0x7f4a000a6610 msgr2=0x7f4a0011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 shutdown_connections 2023-10-03T10:15:44.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:44.526+0000 7f4a053f7700 1 -- 172.21.15.125:0/730302185 wait complete. 2023-10-03T10:15:44.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:45.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:45.116 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:45.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.207+0000 7f1c6c7d9700 1 Processor -- start 2023-10-03T10:15:45.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.207+0000 7f1c6c7d9700 1 -- start start 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.207+0000 7f1c6c7d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.207+0000 7f1c6c7d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.207+0000 7f1c6c7d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6c7d9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6409e9d0 con 0x7f1c640a0a70 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6c7d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6409dc00 con 0x7f1c64133f50 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6c7d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6409dec0 con 0x7f1c640a1380 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69d74700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6a575700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54408/0 (socket says 172.21.15.125:54408) 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69d74700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36428/0 (socket says 172.21.15.125:36428) 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6a575700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47940/0 (socket says 172.21.15.125:47940) 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69d74700 1 -- 172.21.15.125:0/1034426661 learned_addr learned my addr 172.21.15.125:0/1034426661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 -- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 msgr2=0x7f1c64133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 -- 172.21.15.125:0/1034426661 >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 msgr2=0x7f1c640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 --2- 172.21.15.125:0/1034426661 >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 -- 172.21.15.125:0/1034426661 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6409e6a0 con 0x7f1c64133f50 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69d74700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6a575700 1 --2- 172.21.15.125:0/1034426661 >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c6ad76700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009d90 tx=0x7f1c5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e858549a5cfd38a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69573700 1 -- 172.21.15.125:0/1034426661 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00e070 con 0x7f1c64133f50 2023-10-03T10:15:45.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69573700 1 -- 172.21.15.125:0/1034426661 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00bb20 con 0x7f1c64133f50 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.208+0000 7f1c69573700 1 -- 172.21.15.125:0/1034426661 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c012430 con 0x7f1c64133f50 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 msgr2=0x7f1c641343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009d90 tx=0x7f1c5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/1034426661 shutdown_connections 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64133f50 0x7f1c641343b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/1034426661 >> v2:172.21.15.125:3300/0 conn(0x7f1c640a0a70 0x7f1c640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/1034426661 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/1034426661 >> 172.21.15.125:0/1034426661 conn(0x7f1c640a6610 msgr2=0x7f1c640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/1034426661 shutdown_connections 2023-10-03T10:15:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.209+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/1034426661 wait complete. 2023-10-03T10:15:45.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 Processor -- start 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 -- start start 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 0x7f1c64121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 0x7f1c64121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64124cd0 con 0x7f1c64133f50 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64124eb0 con 0x7f1c640a0a70 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.210+0000 7f1c6c7d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64122930 con 0x7f1c640a1380 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6a575700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 0x7f1c64121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6ad76700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 0x7f1c64121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36432/0 (socket says 172.21.15.125:36432) 2023-10-03T10:15:45.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 -- 172.21.15.125:0/4114544723 learned_addr learned my addr 172.21.15.125:0/4114544723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 -- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 msgr2=0x7f1c64121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 0x7f1c64121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 -- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 msgr2=0x7f1c64121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 0x7f1c64121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 -- 172.21.15.125:0/4114544723 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600094a0 con 0x7f1c640a1380 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6ad76700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 0x7f1c64121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6a575700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 0x7f1c64121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c69d74700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400ec10 tx=0x7f1c5400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400c850 con 0x7f1c640a1380 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400c9b0 con 0x7f1c640a1380 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400cd40 con 0x7f1c640a1380 2023-10-03T10:15:45.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54009550 con 0x7f1c640a1380 2023-10-03T10:15:45.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.211+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c009a70 con 0x7f1c640a1380 2023-10-03T10:15:45.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.212+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c54013470 con 0x7f1c640a1380 2023-10-03T10:15:45.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.212+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c5403fd10 con 0x7f1c640a1380 2023-10-03T10:15:45.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.212+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c64124b10 con 0x7f1c640a1380 2023-10-03T10:15:45.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.217+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c64124b10 con 0x7f1c640a1380 2023-10-03T10:15:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.246+0000 7f8c62053700 1 Processor -- start 2023-10-03T10:15:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 -- start start 2023-10-03T10:15:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 0x7f8c5c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c09dc00 con 0x7f8c5c133f50 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c09ea60 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c62053700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c09dec0 con 0x7f8c5c0a1380 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c5b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 0x7f8c5c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c52ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:36440/0 (socket says 172.21.15.125:36440) 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c52ffd700 1 -- 172.21.15.125:0/244536178 learned_addr learned my addr 172.21.15.125:0/244536178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.247+0000 7f8c5affd700 1 -- 172.21.15.125:0/244536178 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201489975 0 0) 0x7f8c5c09dc00 con 0x7f8c5c133f50 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 msgr2=0x7f8c5c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5b7fe700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/244536178 >> v1:172.21.15.125:6789/0 conn(0x7f8c5c133f50 legacy=0x7f8c5c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/244536178 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c09e6a0 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c52ffd700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5b7fe700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 0x7f8c5c0a0e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009870 tx=0x7f8c4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96ccc9a4628ff8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5affd700 1 -- 172.21.15.125:0/244536178 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011830 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5affd700 1 -- 172.21.15.125:0/244536178 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c011990 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c5affd700 1 -- 172.21.15.125:0/244536178 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011d20 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 -- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 msgr2=0x7f8c5c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 0x7f8c5c0a0e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009870 tx=0x7f8c4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 -- 172.21.15.125:0/244536178 shutdown_connections 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c0a0a70 0x7f8c5c0a0e40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 --2- 172.21.15.125:0/244536178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.248+0000 7f8c62053700 1 -- 172.21.15.125:0/244536178 >> 172.21.15.125:0/244536178 conn(0x7f8c5c0a6610 msgr2=0x7f8c5c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.249+0000 7f8c62053700 1 -- 172.21.15.125:0/244536178 shutdown_connections 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.249+0000 7f8c62053700 1 -- 172.21.15.125:0/244536178 wait complete. 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.249+0000 7f8c62053700 1 Processor -- start 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 -- start start 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c133f50 0x7f8c5c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c126170 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c126350 con 0x7f8c5c133f50 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c62053700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c125db0 con 0x7f8c5c0a1380 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47966/0 (socket says 172.21.15.125:47966) 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/2588760046 learned_addr learned my addr 172.21.15.125:0/2588760046 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5bfff700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c133f50 0x7f8c5c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c52ffd700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 msgr2=0x7f8c5c122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c133f50 msgr2=0x7f8c5c123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c133f50 0x7f8c5c123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.250+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/2588760046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009550 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c5b7fe700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c09eba0 tx=0x7f8c4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c004510 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c01f070 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c0094a0 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0038e0 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.251+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c133350 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.252+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c4c003a40 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.252+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c4c021070 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.252+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c04f2a0 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.256+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c4c015080 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.413+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c64124b10 con 0x7f1c640a1380 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.414+0000 7f1c5affd700 1 -- 172.21.15.125:0/4114544723 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c64124b10 con 0x7f1c640a1380 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 msgr2=0x7f1c64121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400ec10 tx=0x7f1c5400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 shutdown_connections 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c64133f50 0x7f1c64121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c640a0a70 0x7f1c64121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 --2- 172.21.15.125:0/4114544723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1c640a1380 0x7f1c64121aa0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 >> 172.21.15.125:0/4114544723 conn(0x7f1c640a6610 msgr2=0x7f1c6409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 shutdown_connections 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.416+0000 7f1c6c7d9700 1 -- 172.21.15.125:0/4114544723 wait complete. 2023-10-03T10:15:45.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.450+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c5c1339c0 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.450+0000 7f8c58ff9700 1 -- 172.21.15.125:0/2588760046 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c4c02b020 con 0x7f8c5c0a0a70 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 msgr2=0x7f8c5c1228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c09eba0 tx=0x7f8c4c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 shutdown_connections 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c5c133f50 0x7f8c5c123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c5c0a0a70 0x7f8c5c1228d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 --2- 172.21.15.125:0/2588760046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c5c0a1380 0x7f8c5c122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 >> 172.21.15.125:0/2588760046 conn(0x7f8c5c0a6610 msgr2=0x7f8c5c0a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 shutdown_connections 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.452+0000 7f8c62053700 1 -- 172.21.15.125:0/2588760046 wait complete. 2023-10-03T10:15:45.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:45.499 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:45.540 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.630+0000 7f78765a8700 1 Processor -- start 2023-10-03T10:15:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.630+0000 7f78765a8700 1 -- start start 2023-10-03T10:15:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f78765a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 0x7f78700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f78765a8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 0x7f7870133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f78765a8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787009dc00 con 0x7f7870133f50 2023-10-03T10:15:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f78765a8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787009ea60 con 0x7f78700a1380 2023-10-03T10:15:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f78765a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787009dec0 con 0x7f78700a0a70 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 0x7f7870133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 0x7f78700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f7874b45700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7870133f50 0x7f787013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37432/0 (socket says 172.21.15.125:37432) 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f7874b45700 1 -- 172.21.15.125:0/3301234780 learned_addr learned my addr 172.21.15.125:0/3301234780 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 -- 172.21.15.125:0/3301234780 >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 msgr2=0x7f7870133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 --2- 172.21.15.125:0/3301234780 >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 0x7f7870133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 -- 172.21.15.125:0/3301234780 >> v1:172.21.15.125:6789/0 conn(0x7f7870133f50 legacy=0x7f787013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786effd700 1 -- 172.21.15.125:0/3301234780 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237224947 0 0) 0x7f787009dc00 con 0x7f7870133f50 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 -- 172.21.15.125:0/3301234780 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787009e6a0 con 0x7f78700a0a70 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786f7fe700 1 --2- 172.21.15.125:0/3301234780 >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 0x7f7870133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.631+0000 7f786ffff700 1 --2- 172.21.15.125:0/3301234780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 0x7f78700a0e40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7860009840 tx=0x7f7860009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816631cfb309e4c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f786effd700 1 -- 172.21.15.125:0/3301234780 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011830 con 0x7f78700a0a70 2023-10-03T10:15:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f786effd700 1 -- 172.21.15.125:0/3301234780 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860011990 con 0x7f78700a0a70 2023-10-03T10:15:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f786effd700 1 -- 172.21.15.125:0/3301234780 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011d20 con 0x7f78700a0a70 2023-10-03T10:15:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 -- 172.21.15.125:0/3301234780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 msgr2=0x7f78700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 --2- 172.21.15.125:0/3301234780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 0x7f78700a0e40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7860009840 tx=0x7f7860009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 -- 172.21.15.125:0/3301234780 shutdown_connections 2023-10-03T10:15:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 --2- 172.21.15.125:0/3301234780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a0a70 0x7f78700a0e40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 --2- 172.21.15.125:0/3301234780 >> v2:172.21.15.125:3300/0 conn(0x7f78700a1380 0x7f7870133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 -- 172.21.15.125:0/3301234780 >> 172.21.15.125:0/3301234780 conn(0x7f78700a6610 msgr2=0x7f78700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 -- 172.21.15.125:0/3301234780 shutdown_connections 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.632+0000 7f78765a8700 1 -- 172.21.15.125:0/3301234780 wait complete. 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.633+0000 7f78765a8700 1 Processor -- start 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.633+0000 7f78765a8700 1 -- start start 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 0x7f7870122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 0x7f7870123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870126060 con 0x7f7870133f50 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7870124540 con 0x7f78700a1380 2023-10-03T10:15:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f78765a8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7870133aa0 con 0x7f78700a0a70 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 0x7f7870122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37144/0 (socket says 172.21.15.125:37144) 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786ffff700 1 -- 172.21.15.125:0/2302400949 learned_addr learned my addr 172.21.15.125:0/2302400949 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f7874b45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 0x7f7870123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 -- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 msgr2=0x7f78701228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 -- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 msgr2=0x7f7870123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 0x7f7870123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 -- 172.21.15.125:0/2302400949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640094a0 con 0x7f78700a1380 2023-10-03T10:15:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786ffff700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f7874b45700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 0x7f7870123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786f7fe700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 0x7f7870122df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f786400e980 tx=0x7f786400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.634+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400c690 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.635+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400c7f0 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.635+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400cb80 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.635+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78600094a0 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.635+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7870133340 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.635+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f786400cce0 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.636+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f786403fa70 con 0x7f78700a1380 2023-10-03T10:15:45.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.636+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787004f2a0 con 0x7f78700a1380 2023-10-03T10:15:45.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.640+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7864017020 con 0x7f78700a1380 2023-10-03T10:15:45.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 Processor -- start 2023-10-03T10:15:45.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 -- start start 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 0x7f5ee40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee409dc00 con 0x7f5ee40a1380 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee409ea90 con 0x7f5ee40a0a70 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eebb66700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee409dec0 con 0x7f5ee4134120 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eea103700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eea103700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37150/0 (socket says 172.21.15.125:37150) 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5eea103700 1 -- 172.21.15.125:0/1107436348 learned_addr learned my addr 172.21.15.125:0/1107436348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.673+0000 7f5ee9902700 1 --2- 172.21.15.125:0/1107436348 >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 0x7f5ee40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5eea103700 1 -- 172.21.15.125:0/1107436348 >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 msgr2=0x7f5ee40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5eea103700 1 --2- 172.21.15.125:0/1107436348 >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 0x7f5ee40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5eea103700 1 -- 172.21.15.125:0/1107436348 >> v1:172.21.15.125:6789/0 conn(0x7f5ee40a1380 legacy=0x7f5ee4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5eea103700 1 -- 172.21.15.125:0/1107436348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee409e6a0 con 0x7f5ee4134120 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5ee8900700 1 -- 172.21.15.125:0/1107436348 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089512848 0 0) 0x7f5ee409dc00 con 0x7f5ee40a1380 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5ee9902700 1 --2- 172.21.15.125:0/1107436348 >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 0x7f5ee40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5eea103700 1 --2- 172.21.15.125:0/1107436348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009e50 tx=0x7f5edc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7236bd4906eb890 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5ee8900700 1 -- 172.21.15.125:0/1107436348 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00e070 con 0x7f5ee4134120 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5ee8900700 1 -- 172.21.15.125:0/1107436348 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00b910 con 0x7f5ee4134120 2023-10-03T10:15:45.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.674+0000 7f5ee8900700 1 -- 172.21.15.125:0/1107436348 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00bcc0 con 0x7f5ee4134120 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 -- 172.21.15.125:0/1107436348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 msgr2=0x7f5ee413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 --2- 172.21.15.125:0/1107436348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009e50 tx=0x7f5edc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 -- 172.21.15.125:0/1107436348 shutdown_connections 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 --2- 172.21.15.125:0/1107436348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee413bce0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 --2- 172.21.15.125:0/1107436348 >> v2:172.21.15.125:3300/0 conn(0x7f5ee40a0a70 0x7f5ee40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 -- 172.21.15.125:0/1107436348 >> 172.21.15.125:0/1107436348 conn(0x7f5ee40a6610 msgr2=0x7f5ee40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 -- 172.21.15.125:0/1107436348 shutdown_connections 2023-10-03T10:15:45.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.675+0000 7f5eebb66700 1 -- 172.21.15.125:0/1107436348 wait complete. 2023-10-03T10:15:45.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 Processor -- start 2023-10-03T10:15:45.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 -- start start 2023-10-03T10:15:45.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ee40a1380 0x7f5ee4122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4125c30 con 0x7f5ee40a0a70 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4133600 con 0x7f5ee40a1380 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eebb66700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40a03e0 con 0x7f5ee4134120 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5ee9902700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eea103700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5ee9101700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ee40a1380 0x7f5ee4122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eea103700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37158/0 (socket says 172.21.15.125:37158) 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eea103700 1 -- 172.21.15.125:0/4163705618 learned_addr learned my addr 172.21.15.125:0/4163705618 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5ee9902700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40972/0 (socket says 172.21.15.125:40972) 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eea103700 1 -- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ee40a1380 msgr2=0x7f5ee4122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.676+0000 7f5eea103700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ee40a1380 0x7f5ee4122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eea103700 1 -- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 msgr2=0x7f5ee4122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eea103700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eea103700 1 -- 172.21.15.125:0/4163705618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00094a0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5ee9902700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eea103700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00b680 tx=0x7f5edc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0048b0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc0099b0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc01c680 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc009b30 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.677+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee4123ba0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.678+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5edc01c7e0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.678+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5edc0411d0 con 0x7f5ee4134120 2023-10-03T10:15:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.678+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee4125e50 con 0x7f5ee4134120 2023-10-03T10:15:45.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.682+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5edc0257d0 con 0x7f5ee4134120 2023-10-03T10:15:45.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.834+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7870126b30 con 0x7f78700a1380 2023-10-03T10:15:45.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.834+0000 7f786cff9700 1 -- 172.21.15.125:0/2302400949 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f786401b3b0 con 0x7f78700a1380 2023-10-03T10:15:45.835 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 msgr2=0x7f7870122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 0x7f7870122df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f786400e980 tx=0x7f786400ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 shutdown_connections 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7870133f50 0x7f7870123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78700a0a70 0x7f78701228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 --2- 172.21.15.125:0/2302400949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78700a1380 0x7f7870122df0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 >> 172.21.15.125:0/2302400949 conn(0x7f78700a6610 msgr2=0x7f787009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 shutdown_connections 2023-10-03T10:15:45.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.836+0000 7f78765a8700 1 -- 172.21.15.125:0/2302400949 wait complete. 2023-10-03T10:15:45.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.875+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ee404f2a0 con 0x7f5ee4134120 2023-10-03T10:15:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.875+0000 7f5eda7fc700 1 -- 172.21.15.125:0/4163705618 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5edc034090 con 0x7f5ee4134120 2023-10-03T10:15:45.876 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:45.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 msgr2=0x7f5ee41231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00b680 tx=0x7f5edc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 shutdown_connections 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ee4134120 0x7f5ee41231d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ee40a0a70 0x7f5ee4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 --2- 172.21.15.125:0/4163705618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ee40a1380 0x7f5ee4122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 >> 172.21.15.125:0/4163705618 conn(0x7f5ee40a6610 msgr2=0x7f5ee40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 shutdown_connections 2023-10-03T10:15:45.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:45.878+0000 7f5eebb66700 1 -- 172.21.15.125:0/4163705618 wait complete. 2023-10-03T10:15:45.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:46.430 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:46.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:46.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 Processor -- start 2023-10-03T10:15:46.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 -- start start 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d44134120 0x7f9d4413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4409dc00 con 0x7f9d440a1380 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.562+0000 7f9d496e1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4409ea60 con 0x7f9d44134120 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d496e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4409dec0 con 0x7f9d440a0a70 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d44134120 0x7f9d4413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d42ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d427fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d440a1380 0x7f9d44133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37452/0 (socket says 172.21.15.125:37452) 2023-10-03T10:15:46.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d427fc700 1 -- 172.21.15.125:0/1799266088 learned_addr learned my addr 172.21.15.125:0/1799266088 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 -- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 msgr2=0x7f9d440a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d440a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 -- 172.21.15.125:0/1799266088 >> v1:172.21.15.125:6789/0 conn(0x7f9d440a1380 legacy=0x7f9d44133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d41ffb700 1 -- 172.21.15.125:0/1799266088 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989023150 0 0) 0x7f9d4409dc00 con 0x7f9d440a1380 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 -- 172.21.15.125:0/1799266088 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4409e6a0 con 0x7f9d44134120 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d42ffd700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d437fe700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d4413bce0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009d90 tx=0x7f9d3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e74b8c3284aeae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d41ffb700 1 -- 172.21.15.125:0/1799266088 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00e070 con 0x7f9d44134120 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d41ffb700 1 -- 172.21.15.125:0/1799266088 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00bb20 con 0x7f9d44134120 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.563+0000 7f9d41ffb700 1 -- 172.21.15.125:0/1799266088 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c012430 con 0x7f9d44134120 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 -- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 msgr2=0x7f9d4413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d4413bce0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009d90 tx=0x7f9d3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 -- 172.21.15.125:0/1799266088 shutdown_connections 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d4413bce0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1799266088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 -- 172.21.15.125:0/1799266088 >> 172.21.15.125:0/1799266088 conn(0x7f9d440a6610 msgr2=0x7f9d440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 -- 172.21.15.125:0/1799266088 shutdown_connections 2023-10-03T10:15:46.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.564+0000 7f9d496e1700 1 -- 172.21.15.125:0/1799266088 wait complete. 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 Processor -- start 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 -- start start 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d440a1380 0x7f9d44122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d441231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441332b0 con 0x7f9d44134120 2023-10-03T10:15:46.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441258b0 con 0x7f9d440a0a70 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.565+0000 7f9d496e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441242c0 con 0x7f9d440a1380 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d437fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d441231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50606/0 (socket says 172.21.15.125:50606) 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 -- 172.21.15.125:0/1822354097 learned_addr learned my addr 172.21.15.125:0/1822354097 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d427fc700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d440a1380 0x7f9d44122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 -- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d440a1380 msgr2=0x7f9d44122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d440a1380 0x7f9d44122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 -- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 msgr2=0x7f9d441231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d441231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 -- 172.21.15.125:0/1822354097 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340094a0 con 0x7f9d440a0a70 2023-10-03T10:15:46.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d437fe700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d441231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d42ffd700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400ebe0 tx=0x7f9d3400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400c850 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400c9b0 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400cd40 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.566+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c009a70 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.567+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d44125c30 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.567+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d34013470 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.567+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4404f2a0 con 0x7f9d440a0a70 2023-10-03T10:15:46.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.568+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d3403f780 con 0x7f9d440a0a70 2023-10-03T10:15:46.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.572+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d34013720 con 0x7f9d440a0a70 2023-10-03T10:15:46.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.601+0000 7fedcc21e700 1 Processor -- start 2023-10-03T10:15:46.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.601+0000 7fedcc21e700 1 -- start start 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedcc21e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 0x7fedc40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedcc21e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 0x7fedc4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedcc21e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc409dc00 con 0x7fedc4133f50 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedcc21e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc409ea60 con 0x7fedc40a1380 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedcc21e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc409dec0 con 0x7fedc40a0a70 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 0x7fedc40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedca7bb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fedc4133f50 0x7fedc413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37466/0 (socket says 172.21.15.125:37466) 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedca7bb700 1 -- 172.21.15.125:0/1866516910 learned_addr learned my addr 172.21.15.125:0/1866516910 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc97b9700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 0x7fedc4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 -- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 msgr2=0x7fedc4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 0x7fedc4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 -- 172.21.15.125:0/1866516910 >> v1:172.21.15.125:6789/0 conn(0x7fedc4133f50 legacy=0x7fedc413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 -- 172.21.15.125:0/1866516910 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc409e6a0 con 0x7fedc40a0a70 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc8fb8700 1 -- 172.21.15.125:0/1866516910 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852922052 0 0) 0x7fedc409dc00 con 0x7fedc4133f50 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc97b9700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 0x7fedc4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.602+0000 7fedc9fba700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 0x7fedc40a0e40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009870 tx=0x7fedc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d768a403d030e29a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedc8fb8700 1 -- 172.21.15.125:0/1866516910 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0011830 con 0x7fedc40a0a70 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedc8fb8700 1 -- 172.21.15.125:0/1866516910 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0011990 con 0x7fedc40a0a70 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedc8fb8700 1 -- 172.21.15.125:0/1866516910 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0011d20 con 0x7fedc40a0a70 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 -- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 msgr2=0x7fedc40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 0x7fedc40a0e40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009870 tx=0x7fedc0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 -- 172.21.15.125:0/1866516910 shutdown_connections 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a0a70 0x7fedc40a0e40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1866516910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a1380 0x7fedc4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 -- 172.21.15.125:0/1866516910 >> 172.21.15.125:0/1866516910 conn(0x7fedc40a6610 msgr2=0x7fedc40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 -- 172.21.15.125:0/1866516910 shutdown_connections 2023-10-03T10:15:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.603+0000 7fedcc21e700 1 -- 172.21.15.125:0/1866516910 wait complete. 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 Processor -- start 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 -- start start 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a0a70 0x7fedc4122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedc4133f50 0x7fedc41232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41260b0 con 0x7fedc4133f50 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4123cd0 con 0x7fedc40a0a70 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.605+0000 7fedcc21e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4133970 con 0x7fedc40a1380 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37192/0 (socket says 172.21.15.125:37192) 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 -- 172.21.15.125:0/1351617411 learned_addr learned my addr 172.21.15.125:0/1351617411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc9fba700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a0a70 0x7fedc4122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedca7bb700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedc4133f50 0x7fedc41232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 -- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a0a70 msgr2=0x7fedc4122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a0a70 0x7fedc4122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 -- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedc4133f50 msgr2=0x7fedc41232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedc4133f50 0x7fedc41232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 -- 172.21.15.125:0/1351617411 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40094a0 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedc97b9700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fedb400ebe0 tx=0x7fedb400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400c850 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb400c9b0 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc00094a0 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400cd40 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.606+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc4133300 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.607+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedb4013470 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.607+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc404f2a0 con 0x7fedc40a1380 2023-10-03T10:15:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.607+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fedb403f7c0 con 0x7fedc40a1380 2023-10-03T10:15:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.612+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedb4013720 con 0x7fedc40a1380 2023-10-03T10:15:46.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.762+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d44072980 con 0x7f9d440a0a70 2023-10-03T10:15:46.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.763+0000 7f9d2b7fe700 1 -- 172.21.15.125:0/1822354097 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d34021030 con 0x7f9d440a0a70 2023-10-03T10:15:46.763 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:46.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 msgr2=0x7f9d44122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400ebe0 tx=0x7f9d3400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 shutdown_connections 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d44134120 0x7f9d441231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d440a0a70 0x7f9d44122750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 --2- 172.21.15.125:0/1822354097 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d440a1380 0x7f9d44122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 >> 172.21.15.125:0/1822354097 conn(0x7f9d440a6610 msgr2=0x7f9d4411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 shutdown_connections 2023-10-03T10:15:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.765+0000 7f9d496e1700 1 -- 172.21.15.125:0/1822354097 wait complete. 2023-10-03T10:15:46.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:46.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.799+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fedc4072980 con 0x7fedc40a1380 2023-10-03T10:15:46.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.799+0000 7fedba7fc700 1 -- 172.21.15.125:0/1351617411 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedb401b3b0 con 0x7fedc40a1380 2023-10-03T10:15:46.799 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 msgr2=0x7fedc4122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fedb400ebe0 tx=0x7fedb400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 shutdown_connections 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedc4133f50 0x7fedc41232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedc40a0a70 0x7fedc4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 --2- 172.21.15.125:0/1351617411 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fedc40a1380 0x7fedc4122db0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 >> 172.21.15.125:0/1351617411 conn(0x7fedc40a6610 msgr2=0x7fedc40a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 shutdown_connections 2023-10-03T10:15:46.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.801+0000 7fedcc21e700 1 -- 172.21.15.125:0/1351617411 wait complete. 2023-10-03T10:15:46.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:46.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:46.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.979+0000 7ff4ae496700 1 Processor -- start 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.979+0000 7ff4ae496700 1 -- start start 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a809e9d0 con 0x7ff4a80a1380 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a809dc00 con 0x7ff4a8133f50 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4ae496700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a809dec0 con 0x7ff4a80a0a70 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4aca33700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4aca33700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50624/0 (socket says 172.21.15.125:50624) 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41000/0 (socket says 172.21.15.125:41000) 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4aca33700 1 -- 172.21.15.125:0/2671695065 learned_addr learned my addr 172.21.15.125:0/2671695065 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 -- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 msgr2=0x7ff4a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 -- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 msgr2=0x7ff4a8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 -- 172.21.15.125:0/2671695065 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a809e6a0 con 0x7ff4a80a1380 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a7fff700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4aca33700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009840 tx=0x7ff49c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a074c2e422db7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a6ffd700 1 -- 172.21.15.125:0/2671695065 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c011830 con 0x7ff4a80a1380 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.980+0000 7ff4a6ffd700 1 -- 172.21.15.125:0/2671695065 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c011990 con 0x7ff4a80a1380 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4a6ffd700 1 -- 172.21.15.125:0/2671695065 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c011d20 con 0x7ff4a80a1380 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 -- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a80a1380 msgr2=0x7ff4a8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009840 tx=0x7ff49c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 -- 172.21.15.125:0/2671695065 shutdown_connections 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a8133f50 0x7ff4a8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 --2- 172.21.15.125:0/2671695065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 -- 172.21.15.125:0/2671695065 >> 172.21.15.125:0/2671695065 conn(0x7ff4a80a6610 msgr2=0x7ff4a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 -- 172.21.15.125:0/2671695065 shutdown_connections 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.981+0000 7ff4ae496700 1 -- 172.21.15.125:0/2671695065 wait complete. 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.982+0000 7ff4ae496700 1 Processor -- start 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 -- start start 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a1380 0x7ff4a812ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 0x7ff4a812f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a806f300 con 0x7ff4a8133f50 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80a03e0 con 0x7ff4a80a0a70 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4ae496700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80a4e40 con 0x7ff4a80a1380 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50636/0 (socket says 172.21.15.125:50636) 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4a7fff700 1 -- 172.21.15.125:0/1900511438 learned_addr learned my addr 172.21.15.125:0/1900511438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4aca33700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 0x7ff4a812f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.983+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a1380 0x7ff4a812ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 -- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a1380 msgr2=0x7ff4a812ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a1380 0x7ff4a812ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 -- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 msgr2=0x7ff4a812f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 0x7ff4a812f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 -- 172.21.15.125:0/1900511438 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498011d40 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4aca33700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 0x7ff4a812f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a7fff700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff498016340 tx=0x7ff498016650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498018040 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4980110d0 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498013160 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a0009b30 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.984+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0094a0 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.985+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff498011480 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.985+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff498047600 con 0x7ff4a80a0a70 2023-10-03T10:15:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.985+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a804f2a0 con 0x7ff4a80a0a70 2023-10-03T10:15:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:46.990+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff49800fa30 con 0x7ff4a80a0a70 2023-10-03T10:15:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 Processor -- start 2023-10-03T10:15:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 -- start start 2023-10-03T10:15:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 0x7fd7940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 0x7fd79413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79409dc00 con 0x7fd7940a1380 2023-10-03T10:15:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79409ea60 con 0x7fd794134120 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd799141700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79409dec0 con 0x7fd7940a0a70 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd792d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 0x7fd7940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd79259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd7940a1380 0x7fd794133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37480/0 (socket says 172.21.15.125:37480) 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd79259c700 1 -- 172.21.15.125:0/438019185 learned_addr learned my addr 172.21.15.125:0/438019185 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.022+0000 7fd79359e700 1 --2- 172.21.15.125:0/438019185 >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 0x7fd79413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd791d9b700 1 -- 172.21.15.125:0/438019185 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256108880 0 0) 0x7fd79409dc00 con 0x7fd7940a1380 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd792d9d700 1 -- 172.21.15.125:0/438019185 >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 msgr2=0x7fd79413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd792d9d700 1 --2- 172.21.15.125:0/438019185 >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 0x7fd79413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd792d9d700 1 -- 172.21.15.125:0/438019185 >> v1:172.21.15.125:6789/0 conn(0x7fd7940a1380 legacy=0x7fd794133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd792d9d700 1 -- 172.21.15.125:0/438019185 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79409e6a0 con 0x7fd7940a0a70 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd79359e700 1 --2- 172.21.15.125:0/438019185 >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 0x7fd79413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd792d9d700 1 --2- 172.21.15.125:0/438019185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 0x7fd7940a0e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd784009840 tx=0x7fd784009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e272a1cc1ebf4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd791d9b700 1 -- 172.21.15.125:0/438019185 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011830 con 0x7fd7940a0a70 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd791d9b700 1 -- 172.21.15.125:0/438019185 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784011990 con 0x7fd7940a0a70 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd791d9b700 1 -- 172.21.15.125:0/438019185 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011d20 con 0x7fd7940a0a70 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 -- 172.21.15.125:0/438019185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 msgr2=0x7fd7940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 --2- 172.21.15.125:0/438019185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 0x7fd7940a0e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd784009840 tx=0x7fd784009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 -- 172.21.15.125:0/438019185 shutdown_connections 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 --2- 172.21.15.125:0/438019185 >> v2:172.21.15.125:3300/0 conn(0x7fd794134120 0x7fd79413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 --2- 172.21.15.125:0/438019185 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd7940a0a70 0x7fd7940a0e40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.023+0000 7fd799141700 1 -- 172.21.15.125:0/438019185 >> 172.21.15.125:0/438019185 conn(0x7fd7940a6610 msgr2=0x7fd7940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.024+0000 7fd799141700 1 -- 172.21.15.125:0/438019185 shutdown_connections 2023-10-03T10:15:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.024+0000 7fd799141700 1 -- 172.21.15.125:0/438019185 wait complete. 2023-10-03T10:15:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.025+0000 7fd799141700 1 Processor -- start 2023-10-03T10:15:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.025+0000 7fd799141700 1 -- start start 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 0x7fd794122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 0x7fd794122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794124390 con 0x7fd7940a0a70 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd794133310 con 0x7fd7940a1380 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd799141700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd794125d00 con 0x7fd794134120 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 0x7fd794122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37238/0 (socket says 172.21.15.125:37238) 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 -- 172.21.15.125:0/1404294421 learned_addr learned my addr 172.21.15.125:0/1404294421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd792d9d700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 0x7fd794122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 -- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 msgr2=0x7fd794122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 0x7fd794122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 -- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 msgr2=0x7fd794122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 0x7fd794122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 -- 172.21.15.125:0/1404294421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c009a70 con 0x7fd794134120 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd792d9d700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 0x7fd794122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79259c700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 0x7fd794122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd79359e700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009f00 tx=0x7fd78c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.026+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c009d70 con 0x7fd794134120 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.027+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00f040 con 0x7fd794134120 2023-10-03T10:15:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.027+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7840094a0 con 0x7fd794134120 2023-10-03T10:15:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.027+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00cd70 con 0x7fd794134120 2023-10-03T10:15:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.027+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940a03e0 con 0x7fd794134120 2023-10-03T10:15:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.027+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd78c014480 con 0x7fd794134120 2023-10-03T10:15:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.028+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79404f2a0 con 0x7fd794134120 2023-10-03T10:15:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.028+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd78c03fcc0 con 0x7fd794134120 2023-10-03T10:15:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.036+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd78c012930 con 0x7fd794134120 2023-10-03T10:15:47.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.199+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff4a809be30 con 0x7ff4a80a0a70 2023-10-03T10:15:47.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.199+0000 7ff4a4ff9700 1 -- 172.21.15.125:0/1900511438 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff498023310 con 0x7ff4a80a0a70 2023-10-03T10:15:47.199 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:47.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 msgr2=0x7ff4a812e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff498016340 tx=0x7ff498016650 comp rx=0 tx=0).stop 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 shutdown_connections 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8133f50 0x7ff4a812f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4a80a0a70 0x7ff4a812e6d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 --2- 172.21.15.125:0/1900511438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4a80a1380 0x7ff4a812ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 >> 172.21.15.125:0/1900511438 conn(0x7ff4a80a6610 msgr2=0x7ff4a81334b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 shutdown_connections 2023-10-03T10:15:47.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.201+0000 7ff4ae496700 1 -- 172.21.15.125:0/1900511438 wait complete. 2023-10-03T10:15:47.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:47.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.240+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd794072980 con 0x7fd794134120 2023-10-03T10:15:47.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.240+0000 7fd77b7fe700 1 -- 172.21.15.125:0/1404294421 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd78c012340 con 0x7fd794134120 2023-10-03T10:15:47.241 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 msgr2=0x7fd794123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009f00 tx=0x7fd78c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 shutdown_connections 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd794134120 0x7fd794123200 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7940a0a70 0x7fd794122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 --2- 172.21.15.125:0/1404294421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7940a1380 0x7fd794122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 >> 172.21.15.125:0/1404294421 conn(0x7fd7940a6610 msgr2=0x7fd7940a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 shutdown_connections 2023-10-03T10:15:47.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.242+0000 7fd799141700 1 -- 172.21.15.125:0/1404294421 wait complete. 2023-10-03T10:15:47.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:47.778 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:47.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:47.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.910+0000 7f3320d92700 1 Processor -- start 2023-10-03T10:15:47.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.910+0000 7f3320d92700 1 -- start start 2023-10-03T10:15:47.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3320d92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3320d92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3320d92700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c09dc00 con 0x7f331c133f50 2023-10-03T10:15:47.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3320d92700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c09ea60 con 0x7f331c0a0a70 2023-10-03T10:15:47.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3320d92700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331c09dec0 con 0x7f331c0a1380 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f3319d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f331ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f331c133f50 0x7f331c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37486/0 (socket says 172.21.15.125:37486) 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f331ad9d700 1 -- 172.21.15.125:0/1929670827 learned_addr learned my addr 172.21.15.125:0/1929670827 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f331a59c700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.911+0000 7f331959a700 1 -- 172.21.15.125:0/1929670827 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406182938 0 0) 0x7f331c09dc00 con 0x7f331c133f50 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3319d9b700 1 -- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 msgr2=0x7f331c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3319d9b700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3319d9b700 1 -- 172.21.15.125:0/1929670827 >> v1:172.21.15.125:6789/0 conn(0x7f331c133f50 legacy=0x7f331c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3319d9b700 1 -- 172.21.15.125:0/1929670827 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c09e6a0 con 0x7f331c0a1380 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f331a59c700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3319d9b700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c133a10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3310009870 tx=0x7f3310009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439d88cf288cc4ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f331959a700 1 -- 172.21.15.125:0/1929670827 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011830 con 0x7f331c0a1380 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f331959a700 1 -- 172.21.15.125:0/1929670827 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310011990 con 0x7f331c0a1380 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f331959a700 1 -- 172.21.15.125:0/1929670827 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011d20 con 0x7f331c0a1380 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3320d92700 1 -- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 msgr2=0x7f331c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.912+0000 7f3320d92700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c133a10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3310009870 tx=0x7f3310009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:47.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 -- 172.21.15.125:0/1929670827 shutdown_connections 2023-10-03T10:15:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 --2- 172.21.15.125:0/1929670827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c133a10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 -- 172.21.15.125:0/1929670827 >> 172.21.15.125:0/1929670827 conn(0x7f331c0a6610 msgr2=0x7f331c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 -- 172.21.15.125:0/1929670827 shutdown_connections 2023-10-03T10:15:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.913+0000 7f3320d92700 1 -- 172.21.15.125:0/1929670827 wait complete. 2023-10-03T10:15:47.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 Processor -- start 2023-10-03T10:15:47.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 -- start start 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 0x7f331c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c126110 con 0x7f331c133f50 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c123cf0 con 0x7f331c0a0a70 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3320d92700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331c126360 con 0x7f331c0a1380 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f331a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f3319d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f331a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50666/0 (socket says 172.21.15.125:50666) 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f331a59c700 1 -- 172.21.15.125:0/975989624 learned_addr learned my addr 172.21.15.125:0/975989624 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:47.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.914+0000 7f331ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 0x7f331c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 -- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 msgr2=0x7f331c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 -- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 msgr2=0x7f331c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 0x7f331c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 -- 172.21.15.125:0/975989624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094a0 con 0x7f331c0a1380 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f331ad9d700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 0x7f331c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f331a59c700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3319d9b700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c122dd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3310016000 tx=0x7f3310004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310004510 con 0x7f331c0a1380 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331001f070 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33100094a0 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100038e0 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.915+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c0a03e0 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.916+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3310003a40 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.916+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3310021070 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.916+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c04f2a0 con 0x7f331c0a1380 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.921+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f331002b080 con 0x7f331c0a1380 2023-10-03T10:15:47.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.949+0000 7fa15d5e6700 1 Processor -- start 2023-10-03T10:15:47.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 -- start start 2023-10-03T10:15:47.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa158134120 0x7fa15813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15809dc00 con 0x7fa1580a1380 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15809ea60 con 0x7fa158134120 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa15d5e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa15809dec0 con 0x7fa1580a0a70 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa156ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa1577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa158134120 0x7fa15813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa156ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37264/0 (socket says 172.21.15.125:37264) 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.950+0000 7fa156ffd700 1 -- 172.21.15.125:0/3409922832 learned_addr learned my addr 172.21.15.125:0/3409922832 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa156ffd700 1 -- 172.21.15.125:0/3409922832 >> v2:172.21.15.125:3300/0 conn(0x7fa158134120 msgr2=0x7fa15813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa156ffd700 1 --2- 172.21.15.125:0/3409922832 >> v2:172.21.15.125:3300/0 conn(0x7fa158134120 0x7fa15813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa156ffd700 1 -- 172.21.15.125:0/3409922832 >> v1:172.21.15.125:6789/0 conn(0x7fa1580a1380 legacy=0x7fa158133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa156ffd700 1 -- 172.21.15.125:0/3409922832 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15809e6a0 con 0x7fa1580a0a70 2023-10-03T10:15:47.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa156ffd700 1 --2- 172.21.15.125:0/3409922832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1480098f0 tx=0x7fa148009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b8a95ae40e5691 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa155ffb700 1 -- 172.21.15.125:0/3409922832 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011830 con 0x7fa1580a0a70 2023-10-03T10:15:47.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa155ffb700 1 -- 172.21.15.125:0/3409922832 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148011990 con 0x7fa1580a0a70 2023-10-03T10:15:47.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.951+0000 7fa155ffb700 1 -- 172.21.15.125:0/3409922832 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011d20 con 0x7fa1580a0a70 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3409922832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 msgr2=0x7fa1580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3409922832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1480098f0 tx=0x7fa148009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3409922832 shutdown_connections 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3409922832 >> v2:172.21.15.125:3300/0 conn(0x7fa158134120 0x7fa15813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3409922832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa1580a0a70 0x7fa1580a0e40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3409922832 >> 172.21.15.125:0/3409922832 conn(0x7fa1580a6610 msgr2=0x7fa1580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3409922832 shutdown_connections 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.952+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3409922832 wait complete. 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.953+0000 7fa15d5e6700 1 Processor -- start 2023-10-03T10:15:47.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.953+0000 7fa15d5e6700 1 -- start start 2023-10-03T10:15:47.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa158134120 0x7fa158123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580a03e0 con 0x7fa1580a1380 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa158124660 con 0x7fa1580a0a70 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa15d5e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581333f0 con 0x7fa158134120 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa1567fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa1577fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa158134120 0x7fa158123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50672/0 (socket says 172.21.15.125:50672) 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa1567fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41070/0 (socket says 172.21.15.125:41070) 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 -- 172.21.15.125:0/3912503937 learned_addr learned my addr 172.21.15.125:0/3912503937 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:47.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 -- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa158134120 msgr2=0x7fa158123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa158134120 0x7fa158123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 -- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 msgr2=0x7fa158122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 -- 172.21.15.125:0/3912503937 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009550 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa1567fc700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.954+0000 7fa156ffd700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148004400 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14801f070 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480038e0 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158133aa0 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa158124d40 con 0x7fa1580a0a70 2023-10-03T10:15:47.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.955+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa148021030 con 0x7fa1580a0a70 2023-10-03T10:15:47.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.956+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15804f2a0 con 0x7fa1580a0a70 2023-10-03T10:15:47.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.956+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa148040a50 con 0x7fa1580a0a70 2023-10-03T10:15:47.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:47.960+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1480199a0 con 0x7fa1580a0a70 2023-10-03T10:15:48.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.117+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f331c133360 con 0x7f331c0a1380 2023-10-03T10:15:48.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.117+0000 7f330affd700 1 -- 172.21.15.125:0/975989624 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3310015020 con 0x7f331c0a1380 2023-10-03T10:15:48.118 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:48.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 msgr2=0x7f331c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c122dd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3310016000 tx=0x7f3310004750 comp rx=0 tx=0).stop 2023-10-03T10:15:48.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 shutdown_connections 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f331c133f50 0x7f331c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f331c0a0a70 0x7f331c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 --2- 172.21.15.125:0/975989624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f331c0a1380 0x7f331c122dd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 >> 172.21.15.125:0/975989624 conn(0x7f331c0a6610 msgr2=0x7f331c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 shutdown_connections 2023-10-03T10:15:48.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.120+0000 7f3320d92700 1 -- 172.21.15.125:0/975989624 wait complete. 2023-10-03T10:15:48.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:48.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.153+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa158133820 con 0x7fa1580a0a70 2023-10-03T10:15:48.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.153+0000 7fa13f7fe700 1 -- 172.21.15.125:0/3912503937 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1480193b0 con 0x7fa1580a0a70 2023-10-03T10:15:48.153 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 msgr2=0x7fa1581228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148004750 comp rx=0 tx=0).stop 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 shutdown_connections 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa158134120 0x7fa158123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1580a0a70 0x7fa1581228d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 --2- 172.21.15.125:0/3912503937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1580a1380 0x7fa158122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 >> 172.21.15.125:0/3912503937 conn(0x7fa1580a6610 msgr2=0x7fa1580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 shutdown_connections 2023-10-03T10:15:48.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.155+0000 7fa15d5e6700 1 -- 172.21.15.125:0/3912503937 wait complete. 2023-10-03T10:15:48.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:48.215 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:48.256 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.343+0000 7fa165725700 1 Processor -- start 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.343+0000 7fa165725700 1 -- start start 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa160134160 0x7fa160134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1600a0370 con 0x7fa160134160 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16009fa00 con 0x7fa16009e870 2023-10-03T10:15:48.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa165725700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa16009ada0 con 0x7fa16009f180 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa160134160 0x7fa160134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa160134160 0x7fa160134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41084/0 (socket says 172.21.15.125:41084) 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50688/0 (socket says 172.21.15.125:50688) 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 -- 172.21.15.125:0/1264754557 learned_addr learned my addr 172.21.15.125:0/1264754557 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 -- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 msgr2=0x7fa160133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 -- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 msgr2=0x7fa16009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 -- 172.21.15.125:0/1264754557 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16006bec0 con 0x7fa160134160 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15effd700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.344+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160134600 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e50 tx=0x7fa15800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3014bae481c9eb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa15dffb700 1 -- 172.21.15.125:0/1264754557 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800e070 con 0x7fa160134160 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa15dffb700 1 -- 172.21.15.125:0/1264754557 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800b910 con 0x7fa160134160 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa15dffb700 1 -- 172.21.15.125:0/1264754557 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800bcc0 con 0x7fa160134160 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 -- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 msgr2=0x7fa160134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160134600 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e50 tx=0x7fa15800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 -- 172.21.15.125:0/1264754557 shutdown_connections 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa16009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160134600 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 --2- 172.21.15.125:0/1264754557 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 -- 172.21.15.125:0/1264754557 >> 172.21.15.125:0/1264754557 conn(0x7fa1600a4430 msgr2=0x7fa1600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 -- 172.21.15.125:0/1264754557 shutdown_connections 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.345+0000 7fa165725700 1 -- 172.21.15.125:0/1264754557 wait complete. 2023-10-03T10:15:48.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.346+0000 7fa165725700 1 Processor -- start 2023-10-03T10:15:48.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.346+0000 7fa165725700 1 -- start start 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160124020 con 0x7fa160134160 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa160124eb0 con 0x7fa16009e870 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa165725700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa160125990 con 0x7fa16009f180 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50690/0 (socket says 172.21.15.125:50690) 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15effd700 1 -- 172.21.15.125:0/3782996268 learned_addr learned my addr 172.21.15.125:0/3782996268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 -- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 msgr2=0x7fa160122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 -- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 msgr2=0x7fa160122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 -- 172.21.15.125:0/3782996268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500094a0 con 0x7fa160134160 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15effd700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.347+0000 7fa15f7fe700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160122e90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa16009e630 tx=0x7fa158004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.348+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158004450 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.348+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1580045d0 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.348+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580092e0 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.348+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158009b30 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.348+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600a15e0 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.349+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa15801c410 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.349+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa160125b20 con 0x7fa160134160 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.349+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa158041150 con 0x7fa160134160 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.353+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa15801c6c0 con 0x7fa160134160 2023-10-03T10:15:48.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.384+0000 7faebe06d700 1 Processor -- start 2023-10-03T10:15:48.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.384+0000 7faebe06d700 1 -- start start 2023-10-03T10:15:48.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.384+0000 7faebe06d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faebe06d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 0x7faeb81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faebe06d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faebe06d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80a3b60 con 0x7faeb8133f70 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faebe06d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81348e0 con 0x7faeb809ad40 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faebe06d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb809b110 con 0x7faeb80a0a70 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50694/0 (socket says 172.21.15.125:50694) 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37302/0 (socket says 172.21.15.125:37302) 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb77fe700 1 -- 172.21.15.125:0/2193658610 learned_addr learned my addr 172.21.15.125:0/2193658610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb6ffd700 1 --2- 172.21.15.125:0/2193658610 >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 0x7faeb81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 -- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 msgr2=0x7faeb8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 -- 172.21.15.125:0/2193658610 >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 msgr2=0x7faeb81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 --2- 172.21.15.125:0/2193658610 >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 0x7faeb81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 -- 172.21.15.125:0/2193658610 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80a2fa0 con 0x7faeb80a0a70 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb6ffd700 1 --2- 172.21.15.125:0/2193658610 >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 0x7faeb81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb77fe700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb7fff700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009dc0 tx=0x7faeb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608ade8bf8076218 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb67fc700 1 -- 172.21.15.125:0/2193658610 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000e070 con 0x7faeb80a0a70 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb67fc700 1 -- 172.21.15.125:0/2193658610 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000bae0 con 0x7faeb80a0a70 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.385+0000 7faeb67fc700 1 -- 172.21.15.125:0/2193658610 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000be90 con 0x7faeb80a0a70 2023-10-03T10:15:48.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 -- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 msgr2=0x7faeb80a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009dc0 tx=0x7faeb000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 -- 172.21.15.125:0/2193658610 shutdown_connections 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb809ad40 0x7faeb8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 --2- 172.21.15.125:0/2193658610 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb80a0a70 0x7faeb80a0ed0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 --2- 172.21.15.125:0/2193658610 >> v2:172.21.15.125:3300/0 conn(0x7faeb8133f70 0x7faeb81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 -- 172.21.15.125:0/2193658610 >> 172.21.15.125:0/2193658610 conn(0x7faeb8099c40 msgr2=0x7faeb806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 -- 172.21.15.125:0/2193658610 shutdown_connections 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.386+0000 7faebe06d700 1 -- 172.21.15.125:0/2193658610 wait complete. 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 Processor -- start 2023-10-03T10:15:48.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 -- start start 2023-10-03T10:15:48.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb8133f70 0x7faeb81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8130870 con 0x7faeb809ad40 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb811f870 con 0x7faeb80a0a70 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.387+0000 7faebe06d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8120c10 con 0x7faeb8133f70 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50702/0 (socket says 172.21.15.125:50702) 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41124/0 (socket says 172.21.15.125:41124) 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 -- 172.21.15.125:0/3233512267 learned_addr learned my addr 172.21.15.125:0/3233512267 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb7fff700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb8133f70 0x7faeb81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 -- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb8133f70 msgr2=0x7faeb81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb8133f70 0x7faeb81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 -- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 msgr2=0x7faeb811d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 -- 172.21.15.125:0/3233512267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009550 con 0x7faeb80a0a70 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb77fe700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faeb6ffd700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faeac00ebb0 tx=0x7faeac00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00c850 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00c9b0 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0094a0 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00cd40 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.388+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb0009a70 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.389+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeac013470 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.389+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faeac03f7b0 con 0x7faeb80a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.389+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb804f2a0 con 0x7faeb80a0a70 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.394+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeac017030 con 0x7faeb80a0a70 2023-10-03T10:15:48.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.547+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa160125270 con 0x7fa160134160 2023-10-03T10:15:48.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.548+0000 7fa1477fe700 1 -- 172.21.15.125:0/3782996268 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa15802a030 con 0x7fa160134160 2023-10-03T10:15:48.548 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 msgr2=0x7fa160122e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160122e90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa16009e630 tx=0x7fa158004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 shutdown_connections 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa160134160 0x7fa160122e90 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa16009e870 0x7fa160122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 --2- 172.21.15.125:0/3782996268 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa16009f180 0x7fa160122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.549+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 >> 172.21.15.125:0/3782996268 conn(0x7fa1600a4430 msgr2=0x7fa160072570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.550+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 shutdown_connections 2023-10-03T10:15:48.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.550+0000 7fa165725700 1 -- 172.21.15.125:0/3782996268 wait complete. 2023-10-03T10:15:48.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:48.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.586+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faeb80729d0 con 0x7faeb80a0a70 2023-10-03T10:15:48.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.587+0000 7fae9ffff700 1 -- 172.21.15.125:0/3233512267 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeac02a090 con 0x7faeb80a0a70 2023-10-03T10:15:48.587 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:48.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 msgr2=0x7faeb811df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faeac00ebb0 tx=0x7faeac00eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 shutdown_connections 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faeb8133f70 0x7faeb81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb809ad40 0x7faeb811d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 --2- 172.21.15.125:0/3233512267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb80a0a70 0x7faeb811df10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 >> 172.21.15.125:0/3233512267 conn(0x7faeb8099c40 msgr2=0x7faeb8132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 shutdown_connections 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:48.589+0000 7faebe06d700 1 -- 172.21.15.125:0/3233512267 wait complete. 2023-10-03T10:15:48.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:49.133 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:49.168 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 Processor -- start 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 -- start start 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff194133f70 0x7ff1941343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19409b110 con 0x7ff1940a0a70 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1940a3b60 con 0x7ff194133f70 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.266+0000 7ff19a90a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1941348e0 con 0x7ff19409ad40 2023-10-03T10:15:49.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff1937fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff194133f70 0x7ff1941343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37316/0 (socket says 172.21.15.125:37316) 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 -- 172.21.15.125:0/341696028 learned_addr learned my addr 172.21.15.125:0/341696028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 -- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff194133f70 msgr2=0x7ff1941343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 --2- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff194133f70 0x7ff1941343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 -- 172.21.15.125:0/341696028 >> v1:172.21.15.125:6789/0 conn(0x7ff1940a0a70 legacy=0x7ff1940a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff192ffd700 1 -- 172.21.15.125:0/341696028 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378845518 0 0) 0x7ff19409b110 con 0x7ff1940a0a70 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 -- 172.21.15.125:0/341696028 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1940a2fa0 con 0x7ff19409ad40 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff193fff700 1 --2- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff184009920 tx=0x7ff184009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd2065b0df76aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff192ffd700 1 -- 172.21.15.125:0/341696028 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184011830 con 0x7ff19409ad40 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff192ffd700 1 -- 172.21.15.125:0/341696028 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184011990 con 0x7ff19409ad40 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.267+0000 7ff192ffd700 1 -- 172.21.15.125:0/341696028 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184011d20 con 0x7ff19409ad40 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 -- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 msgr2=0x7ff194133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 --2- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff184009920 tx=0x7ff184009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 -- 172.21.15.125:0/341696028 shutdown_connections 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 --2- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff19409ad40 0x7ff194133a30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 --2- 172.21.15.125:0/341696028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff194133f70 0x7ff1941343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 -- 172.21.15.125:0/341696028 >> 172.21.15.125:0/341696028 conn(0x7ff194099c40 msgr2=0x7ff19406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 -- 172.21.15.125:0/341696028 shutdown_connections 2023-10-03T10:15:49.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.268+0000 7ff19a90a700 1 -- 172.21.15.125:0/341696028 wait complete. 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 Processor -- start 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 -- start start 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 0x7ff19411f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff194133f70 0x7ff1941c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19411eee0 con 0x7ff1940a0a70 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff194133390 con 0x7ff19409ad40 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.269+0000 7ff19a90a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff194122240 con 0x7ff194133f70 2023-10-03T10:15:49.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50722/0 (socket says 172.21.15.125:50722) 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 -- 172.21.15.125:0/1709549803 learned_addr learned my addr 172.21.15.125:0/1709549803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff1937fe700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 0x7ff19411f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff198ea7700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff194133f70 0x7ff1941c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 -- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff194133f70 msgr2=0x7ff1941c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff194133f70 0x7ff1941c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 -- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 msgr2=0x7ff19411f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 0x7ff19411f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 -- 172.21.15.125:0/1709549803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff184009550 con 0x7ff19409ad40 2023-10-03T10:15:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff1937fe700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 0x7ff19411f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff193fff700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff1840098f0 tx=0x7ff184004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184004450 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1840045d0 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff194120610 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1840038e0 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.270+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff194120e00 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.271+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff184003a40 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.271+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff184020030 con 0x7ff19409ad40 2023-10-03T10:15:49.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.271+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19404f2a0 con 0x7ff19409ad40 2023-10-03T10:15:49.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.276+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff18401a420 con 0x7ff19409ad40 2023-10-03T10:15:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 Processor -- start 2023-10-03T10:15:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 -- start start 2023-10-03T10:15:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 0x7ff2b8130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b809c1f0 con 0x7ff2b809e280 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b806dc20 con 0x7ff2b81309f0 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2bd94e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b809b1f0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2b67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2b6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 0x7ff2b8130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2b67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50726/0 (socket says 172.21.15.125:50726) 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.305+0000 7ff2b67fc700 1 -- 172.21.15.125:0/665718051 learned_addr learned my addr 172.21.15.125:0/665718051 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b67fc700 1 -- 172.21.15.125:0/665718051 >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 msgr2=0x7ff2b8130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b67fc700 1 --2- 172.21.15.125:0/665718051 >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 0x7ff2b8130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b67fc700 1 -- 172.21.15.125:0/665718051 >> v1:172.21.15.125:6789/0 conn(0x7ff2b809e280 legacy=0x7ff2b8137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b67fc700 1 -- 172.21.15.125:0/665718051 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b809e700 con 0x7ff2b809d8f0 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b6ffd700 1 --2- 172.21.15.125:0/665718051 >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 0x7ff2b8130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b67fc700 1 --2- 172.21.15.125:0/665718051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0098f0 tx=0x7ff2ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9159edcb08e1ffd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b5ffb700 1 -- 172.21.15.125:0/665718051 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac011830 con 0x7ff2b809d8f0 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b5ffb700 1 -- 172.21.15.125:0/665718051 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac011990 con 0x7ff2b809d8f0 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.306+0000 7ff2b5ffb700 1 -- 172.21.15.125:0/665718051 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac011d20 con 0x7ff2b809d8f0 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 -- 172.21.15.125:0/665718051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 msgr2=0x7ff2b809dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/665718051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0098f0 tx=0x7ff2ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 -- 172.21.15.125:0/665718051 shutdown_connections 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/665718051 >> v2:172.21.15.125:3300/0 conn(0x7ff2b81309f0 0x7ff2b8130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/665718051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809d8f0 0x7ff2b809dd40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 -- 172.21.15.125:0/665718051 >> 172.21.15.125:0/665718051 conn(0x7ff2b80a2b30 msgr2=0x7ff2b809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 -- 172.21.15.125:0/665718051 shutdown_connections 2023-10-03T10:15:49.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.307+0000 7ff2bd94e700 1 -- 172.21.15.125:0/665718051 wait complete. 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.308+0000 7ff2bd94e700 1 Processor -- start 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.308+0000 7ff2bd94e700 1 -- start start 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 0x7ff2b812b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2b81309f0 0x7ff2b812bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b812cd30 con 0x7ff2b809d8f0 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b812c680 con 0x7ff2b809e280 2023-10-03T10:15:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2bd94e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b809b430 con 0x7ff2b81309f0 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50734/0 (socket says 172.21.15.125:50734) 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2b81309f0 0x7ff2b812bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b67fc700 1 -- 172.21.15.125:0/3996147828 learned_addr learned my addr 172.21.15.125:0/3996147828 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 0x7ff2b812b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 -- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2b81309f0 msgr2=0x7ff2b812bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2b81309f0 0x7ff2b812bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 -- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 msgr2=0x7ff2b812b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 -- 172.21.15.125:0/3996147828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8009430 con 0x7ff2b809d8f0 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b67fc700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.309+0000 7ff2b6ffd700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 0x7ff2b812b2b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e980 tx=0x7ff2a800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.310+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8005a20 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.310+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8005b80 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.310+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800c690 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.310+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac009550 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.310+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b812cfb0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.311+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b808b7c0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.311+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2a800c7f0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.311+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2a803fd50 con 0x7ff2b809d8f0 2023-10-03T10:15:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.315+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2a8006030 con 0x7ff2b809d8f0 2023-10-03T10:15:49.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.467+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff1940729d0 con 0x7ff19409ad40 2023-10-03T10:15:49.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.468+0000 7ff190ff9700 1 -- 172.21.15.125:0/1709549803 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff18402a030 con 0x7ff19409ad40 2023-10-03T10:15:49.468 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:49.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 msgr2=0x7ff19411f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff1840098f0 tx=0x7ff184004750 comp rx=0 tx=0).stop 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 shutdown_connections 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff194133f70 0x7ff1941c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff19409ad40 0x7ff19411f290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 --2- 172.21.15.125:0/1709549803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1940a0a70 0x7ff19411f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 >> 172.21.15.125:0/1709549803 conn(0x7ff194099c40 msgr2=0x7ff1941bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 shutdown_connections 2023-10-03T10:15:49.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.470+0000 7ff19a90a700 1 -- 172.21.15.125:0/1709549803 wait complete. 2023-10-03T10:15:49.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:49.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.506+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2b804f2a0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.507+0000 7ff29ffff700 1 -- 172.21.15.125:0/3996147828 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2a8024bd0 con 0x7ff2b809d8f0 2023-10-03T10:15:49.507 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 msgr2=0x7ff2b812b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 0x7ff2b812b2b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e980 tx=0x7ff2a800ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 shutdown_connections 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2b81309f0 0x7ff2b812bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b809d8f0 0x7ff2b812b2b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 --2- 172.21.15.125:0/3996147828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b809e280 0x7ff2b812b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 >> 172.21.15.125:0/3996147828 conn(0x7ff2b80a2b30 msgr2=0x7ff2b80702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 shutdown_connections 2023-10-03T10:15:49.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.509+0000 7ff2bd94e700 1 -- 172.21.15.125:0/3996147828 wait complete. 2023-10-03T10:15:49.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:49.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:49.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.688+0000 7f8c0bee1700 1 Processor -- start 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.688+0000 7f8c0bee1700 1 -- start start 2023-10-03T10:15:49.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 0x7f8c04134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0409e9d0 con 0x7f8c040a1380 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0409dc00 con 0x7f8c04133f50 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0bee1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0409dec0 con 0x7f8c040a0a70 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0947c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0a47e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 0x7f8c04134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37344/0 (socket says 172.21.15.125:37344) 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0947c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41160/0 (socket says 172.21.15.125:41160) 2023-10-03T10:15:49.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 -- 172.21.15.125:0/3791446955 learned_addr learned my addr 172.21.15.125:0/3791446955 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 -- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 msgr2=0x7f8c04134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 0x7f8c04134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 -- 172.21.15.125:0/3791446955 >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 msgr2=0x7f8c04133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 --2- 172.21.15.125:0/3791446955 >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 -- 172.21.15.125:0/3791446955 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0409e6a0 con 0x7f8c040a0a70 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0947c700 1 --2- 172.21.15.125:0/3791446955 >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c0a47e700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 0x7f8c04134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c09c7d700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c000098f0 tx=0x7f8c00009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de04d0e2a457476 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c08c7b700 1 -- 172.21.15.125:0/3791446955 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011830 con 0x7f8c040a0a70 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c08c7b700 1 -- 172.21.15.125:0/3791446955 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00011990 con 0x7f8c040a0a70 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.689+0000 7f8c08c7b700 1 -- 172.21.15.125:0/3791446955 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011d20 con 0x7f8c040a0a70 2023-10-03T10:15:49.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 -- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 msgr2=0x7f8c040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c000098f0 tx=0x7f8c00009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 -- 172.21.15.125:0/3791446955 shutdown_connections 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c04133f50 0x7f8c04134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/3791446955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c040a0a70 0x7f8c040a0e40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/3791446955 >> v2:172.21.15.125:3300/0 conn(0x7f8c040a1380 0x7f8c04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 -- 172.21.15.125:0/3791446955 >> 172.21.15.125:0/3791446955 conn(0x7f8c040a6610 msgr2=0x7f8c040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 -- 172.21.15.125:0/3791446955 shutdown_connections 2023-10-03T10:15:49.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.690+0000 7f8c0bee1700 1 -- 172.21.15.125:0/3791446955 wait complete. 2023-10-03T10:15:49.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 Processor -- start 2023-10-03T10:15:49.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 -- start start 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c040a0a70 0x7f8c041223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 0x7f8c04122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04124130 con 0x7f8c040a0a70 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04124e40 con 0x7f8c040a1380 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.691+0000 7f8c0bee1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04125200 con 0x7f8c04133f50 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0a47e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 0x7f8c04122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50760/0 (socket says 172.21.15.125:50760) 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 -- 172.21.15.125:0/4237651112 learned_addr learned my addr 172.21.15.125:0/4237651112 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c09c7d700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c040a0a70 0x7f8c041223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 -- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 msgr2=0x7f8c04122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 0x7f8c04122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 -- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c040a0a70 msgr2=0x7f8c041223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c040a0a70 0x7f8c041223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 -- 172.21.15.125:0/4237651112 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40094a0 con 0x7f8c040a1380 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0a47e700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 0x7f8c04122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0947c700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400ebb0 tx=0x7f8bf400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4009e80 con 0x7f8c040a1380 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf400c850 con 0x7f8c040a1380 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400cbc0 con 0x7f8c040a1380 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc009a70 con 0x7f8c040a1380 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.692+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c00009550 con 0x7f8c040a1380 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.693+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bf400cd20 con 0x7f8c040a1380 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.693+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bf403f6b0 con 0x7f8c040a1380 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.693+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0404f2a0 con 0x7f8c040a1380 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.698+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf40232f0 con 0x7f8c040a1380 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 Processor -- start 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 -- start start 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c09aa00 con 0x7f487c099a60 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c09a080 con 0x7f487c0a0e20 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4880f95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487c133750 con 0x7f487c133b80 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f487ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f487a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.747+0000 7f4879d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50770/0 (socket says 172.21.15.125:50770) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37366/0 (socket says 172.21.15.125:37366) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487ad9d700 1 -- 172.21.15.125:0/2895398762 learned_addr learned my addr 172.21.15.125:0/2895398762 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f4879d9b700 1 --2- 172.21.15.125:0/2895398762 >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41190/0 (socket says 172.21.15.125:41190) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 -- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 msgr2=0x7f487c0a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 -- 172.21.15.125:0/2895398762 >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 msgr2=0x7f487c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 --2- 172.21.15.125:0/2895398762 >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 -- 172.21.15.125:0/2895398762 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c09a760 con 0x7f487c133b80 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487ad9d700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f4879d9b700 1 --2- 172.21.15.125:0/2895398762 >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487a59c700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f486c009820 tx=0x7f486c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf6579b840d4727 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487959a700 1 -- 172.21.15.125:0/2895398762 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c005e30 con 0x7f487c133b80 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487959a700 1 -- 172.21.15.125:0/2895398762 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c006030 con 0x7f487c133b80 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.748+0000 7f487959a700 1 -- 172.21.15.125:0/2895398762 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0063c0 con 0x7f487c133b80 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 -- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 msgr2=0x7f487c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f486c009820 tx=0x7f486c009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 -- 172.21.15.125:0/2895398762 shutdown_connections 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c0a0e20 0x7f487c0a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 --2- 172.21.15.125:0/2895398762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c133b80 0x7f487c133f50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 --2- 172.21.15.125:0/2895398762 >> v2:172.21.15.125:3300/0 conn(0x7f487c099a60 0x7f487c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 -- 172.21.15.125:0/2895398762 >> 172.21.15.125:0/2895398762 conn(0x7f487c0a2980 msgr2=0x7f487c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 -- 172.21.15.125:0/2895398762 shutdown_connections 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.749+0000 7f4880f95700 1 -- 172.21.15.125:0/2895398762 wait complete. 2023-10-03T10:15:49.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 Processor -- start 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 -- start start 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 0x7f487c11a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c11c3a0 con 0x7f487c0a0e20 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c11d5f0 con 0x7f487c133b80 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4880f95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487c11c980 con 0x7f487c099a60 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f4879d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.750+0000 7f487a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 0x7f487c11a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50776/0 (socket says 172.21.15.125:50776) 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f4879d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41198/0 (socket says 172.21.15.125:41198) 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 -- 172.21.15.125:0/1907088124 learned_addr learned my addr 172.21.15.125:0/1907088124 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 -- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 msgr2=0x7f487c11a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 0x7f487c11a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 -- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 msgr2=0x7f487c11acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 -- 172.21.15.125:0/1907088124 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700094a0 con 0x7f487c133b80 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f4879d9b700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487a59c700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 0x7f487c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f487ad9d700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f10 tx=0x7f487400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874018070 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400f040 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4874009b30 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874003c40 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.751+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c009430 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.752+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f487400c940 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.752+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c130af0 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.752+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f487403f6d0 con 0x7f487c133b80 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.757+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f487400ce80 con 0x7f487c133b80 2023-10-03T10:15:49.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.912+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c04072980 con 0x7f8c040a1380 2023-10-03T10:15:49.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.912+0000 7f8bfa7fc700 1 -- 172.21.15.125:0/4237651112 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bf4021020 con 0x7f8c040a1380 2023-10-03T10:15:49.913 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 msgr2=0x7f8c041228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400ebb0 tx=0x7f8bf400eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 shutdown_connections 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c04133f50 0x7f8c04122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c040a0a70 0x7f8c041223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 --2- 172.21.15.125:0/4237651112 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c040a1380 0x7f8c041228e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 >> 172.21.15.125:0/4237651112 conn(0x7f8c040a6610 msgr2=0x7f8c0409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 shutdown_connections 2023-10-03T10:15:49.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.914+0000 7f8c0bee1700 1 -- 172.21.15.125:0/4237651112 wait complete. 2023-10-03T10:15:49.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.949+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f487c09e9b0 con 0x7f487c133b80 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.950+0000 7f486affd700 1 -- 172.21.15.125:0/1907088124 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f487401cbb0 con 0x7f487c133b80 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 msgr2=0x7f487c11b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f10 tx=0x7f487400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 shutdown_connections 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487c133b80 0x7f487c11b210 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487c099a60 0x7f487c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 --2- 172.21.15.125:0/1907088124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487c0a0e20 0x7f487c11acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 >> 172.21.15.125:0/1907088124 conn(0x7f487c0a2980 msgr2=0x7f487c12f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 shutdown_connections 2023-10-03T10:15:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:49.952+0000 7f4880f95700 1 -- 172.21.15.125:0/1907088124 wait complete. 2023-10-03T10:15:49.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:50.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:50.522 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 Processor -- start 2023-10-03T10:15:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 -- start start 2023-10-03T10:15:50.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95001307c0 0x7f95000993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950009a540 con 0x7f9500099920 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950009ad40 con 0x7f95001307c0 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f950809d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950009e640 con 0x7f950012feb0 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.611+0000 7f9505e39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95001307c0 0x7f95000993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505e39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50792/0 (socket says 172.21.15.125:50792) 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505e39700 1 -- 172.21.15.125:0/1936366537 learned_addr learned my addr 172.21.15.125:0/1936366537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 -- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 msgr2=0x7f9500130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 -- 172.21.15.125:0/1936366537 >> v1:172.21.15.125:6789/0 conn(0x7f9500099920 legacy=0x7f9500136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 -- 172.21.15.125:0/1936366537 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950009e3c0 con 0x7f95001307c0 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9504e37700 1 -- 172.21.15.125:0/1936366537 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171375213 0 0) 0x7f950009a540 con 0x7f9500099920 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505e39700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9505638700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95001307c0 0x7f95000993e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009840 tx=0x7f94f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c07b62fecabe56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9504e37700 1 -- 172.21.15.125:0/1936366537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011830 con 0x7f95001307c0 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9504e37700 1 -- 172.21.15.125:0/1936366537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0011990 con 0x7f95001307c0 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.612+0000 7f9504e37700 1 -- 172.21.15.125:0/1936366537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011d20 con 0x7f95001307c0 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 -- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95001307c0 msgr2=0x7f95000993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95001307c0 0x7f95000993e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009840 tx=0x7f94f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 -- 172.21.15.125:0/1936366537 shutdown_connections 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f9500130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 --2- 172.21.15.125:0/1936366537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95001307c0 0x7f95000993e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 -- 172.21.15.125:0/1936366537 >> 172.21.15.125:0/1936366537 conn(0x7f95000a2b30 msgr2=0x7f950009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 -- 172.21.15.125:0/1936366537 shutdown_connections 2023-10-03T10:15:50.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.613+0000 7f950809d700 1 -- 172.21.15.125:0/1936366537 wait complete. 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 Processor -- start 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 -- start start 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f95001b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95001307c0 0x7f95001b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950006efd0 con 0x7f9500099920 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95001ba260 con 0x7f950012feb0 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950809d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f950006ea90 con 0x7f95001307c0 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f9505e39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f9505e39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41208/0 (socket says 172.21.15.125:41208) 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f9505e39700 1 -- 172.21.15.125:0/546376190 learned_addr learned my addr 172.21.15.125:0/546376190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f9505638700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f95001b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.614+0000 7f950663a700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95001307c0 0x7f95001b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 -- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95001307c0 msgr2=0x7f95001b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95001307c0 0x7f95001b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 -- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 msgr2=0x7f95001b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f95001b9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 -- 172.21.15.125:0/546376190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009500 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505638700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f95001b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f9505e39700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00ebe0 tx=0x7f94fc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc005a20 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc005b80 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f00094a0 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00c7f0 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.615+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950006db90 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.616+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94fc00c950 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.616+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f94fc03f970 con 0x7f9500099920 2023-10-03T10:15:50.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.616+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95001ba950 con 0x7f9500099920 2023-10-03T10:15:50.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.621+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94fc020070 con 0x7f9500099920 2023-10-03T10:15:50.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.651+0000 7fca8d4ab700 1 Processor -- start 2023-10-03T10:15:50.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.651+0000 7fca8d4ab700 1 -- start start 2023-10-03T10:15:50.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca8d4ab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca8d4ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 0x7fca881343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca8d4ab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8809b110 con 0x7fca880a0a70 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca8d4ab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880a3b60 con 0x7fca88133f70 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca8d4ab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca881348e0 con 0x7fca8809ad40 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37396/0 (socket says 172.21.15.125:37396) 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 -- 172.21.15.125:0/1066851390 learned_addr learned my addr 172.21.15.125:0/1066851390 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca867fc700 1 --2- 172.21.15.125:0/1066851390 >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 0x7fca881343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 -- 172.21.15.125:0/1066851390 >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 msgr2=0x7fca881343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 --2- 172.21.15.125:0/1066851390 >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 0x7fca881343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 -- 172.21.15.125:0/1066851390 >> v1:172.21.15.125:6789/0 conn(0x7fca880a0a70 legacy=0x7fca880a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 -- 172.21.15.125:0/1066851390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880a2fa0 con 0x7fca8809ad40 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca85ffb700 1 -- 172.21.15.125:0/1066851390 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246420199 0 0) 0x7fca8809b110 con 0x7fca880a0a70 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca867fc700 1 --2- 172.21.15.125:0/1066851390 >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 0x7fca881343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.652+0000 7fca86ffd700 1 --2- 172.21.15.125:0/1066851390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fca78009920 tx=0x7fca78009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d18b985d015f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca85ffb700 1 -- 172.21.15.125:0/1066851390 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011830 con 0x7fca8809ad40 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca85ffb700 1 -- 172.21.15.125:0/1066851390 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78011990 con 0x7fca8809ad40 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca85ffb700 1 -- 172.21.15.125:0/1066851390 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011d20 con 0x7fca8809ad40 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 -- 172.21.15.125:0/1066851390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 msgr2=0x7fca88133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/1066851390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fca78009920 tx=0x7fca78009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 -- 172.21.15.125:0/1066851390 shutdown_connections 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/1066851390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca8809ad40 0x7fca88133a30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/1066851390 >> v2:172.21.15.125:3300/0 conn(0x7fca88133f70 0x7fca881343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 -- 172.21.15.125:0/1066851390 >> 172.21.15.125:0/1066851390 conn(0x7fca88099c40 msgr2=0x7fca8806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 -- 172.21.15.125:0/1066851390 shutdown_connections 2023-10-03T10:15:50.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.653+0000 7fca8d4ab700 1 -- 172.21.15.125:0/1066851390 wait complete. 2023-10-03T10:15:50.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.654+0000 7fca8d4ab700 1 Processor -- start 2023-10-03T10:15:50.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.654+0000 7fca8d4ab700 1 -- start start 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca88133f70 0x7fca881c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88122200 con 0x7fca88133f70 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca881205d0 con 0x7fca8809ad40 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca88120b50 con 0x7fca880a0a70 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca86ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37404/0 (socket says 172.21.15.125:37404) 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca88133f70 0x7fca881c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 -- 172.21.15.125:0/4264756060 learned_addr learned my addr 172.21.15.125:0/4264756060 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca86ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50800/0 (socket says 172.21.15.125:50800) 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 -- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 msgr2=0x7fca881c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 -- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca88133f70 msgr2=0x7fca881c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca88133f70 0x7fca881c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 -- 172.21.15.125:0/4264756060 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094a0 con 0x7fca880a0a70 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca86ffd700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca867fc700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00ebb0 tx=0x7fca7c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00c850 con 0x7fca880a0a70 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00c9b0 con 0x7fca880a0a70 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78009550 con 0x7fca880a0a70 2023-10-03T10:15:50.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00cd40 con 0x7fca880a0a70 2023-10-03T10:15:50.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.655+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88122c70 con 0x7fca880a0a70 2023-10-03T10:15:50.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.656+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8804f2a0 con 0x7fca880a0a70 2023-10-03T10:15:50.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.657+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca7c013470 con 0x7fca880a0a70 2023-10-03T10:15:50.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.657+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca7c03fff0 con 0x7fca880a0a70 2023-10-03T10:15:50.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.661+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca7c024760 con 0x7fca880a0a70 2023-10-03T10:15:50.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.826+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f950009aa50 con 0x7f9500099920 2023-10-03T10:15:50.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.826+0000 7f94f67fc700 1 -- 172.21.15.125:0/546376190 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94fc029090 con 0x7f9500099920 2023-10-03T10:15:50.827 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 msgr2=0x7f95001b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00ebe0 tx=0x7f94fc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 shutdown_connections 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95001307c0 0x7f95001b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9500099920 0x7f95001b8e20 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 --2- 172.21.15.125:0/546376190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f950012feb0 0x7f95001b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 >> 172.21.15.125:0/546376190 conn(0x7f95000a2b30 msgr2=0x7f9500126fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 shutdown_connections 2023-10-03T10:15:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.828+0000 7f950809d700 1 -- 172.21.15.125:0/546376190 wait complete. 2023-10-03T10:15:50.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:50.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.865+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca880729d0 con 0x7fca880a0a70 2023-10-03T10:15:50.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.865+0000 7fca6f7fe700 1 -- 172.21.15.125:0/4264756060 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca7c02a090 con 0x7fca880a0a70 2023-10-03T10:15:50.865 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 msgr2=0x7fca881c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00ebb0 tx=0x7fca7c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 shutdown_connections 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca88133f70 0x7fca881c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca8809ad40 0x7fca881c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 --2- 172.21.15.125:0/4264756060 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fca880a0a70 0x7fca881c86d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 >> 172.21.15.125:0/4264756060 conn(0x7fca88099c40 msgr2=0x7fca8809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 shutdown_connections 2023-10-03T10:15:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:50.867+0000 7fca8d4ab700 1 -- 172.21.15.125:0/4264756060 wait complete. 2023-10-03T10:15:50.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:50.928 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:50.965 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 Processor -- start 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 -- start start 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b50133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b501343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5009b110 con 0x7f2b500a0a70 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500a3b60 con 0x7f2b5009ad40 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b56422700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b501348e0 con 0x7f2b50133f70 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b501343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b549bf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2b500a0a70 0x7f2b500a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37522/0 (socket says 172.21.15.125:37522) 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b549bf700 1 -- 172.21.15.125:0/3843386071 learned_addr learned my addr 172.21.15.125:0/3843386071 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.052+0000 7f2b4ffff700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b50133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4f7fe700 1 -- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 msgr2=0x7f2b50133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4f7fe700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b50133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4f7fe700 1 -- 172.21.15.125:0/3843386071 >> v1:172.21.15.125:6789/0 conn(0x7f2b500a0a70 legacy=0x7f2b500a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4effd700 1 -- 172.21.15.125:0/3843386071 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785063406 0 0) 0x7f2b5009b110 con 0x7f2b500a0a70 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4f7fe700 1 -- 172.21.15.125:0/3843386071 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500a2fa0 con 0x7f2b50133f70 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4ffff700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4f7fe700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b501343a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eee456b666643b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4effd700 1 -- 172.21.15.125:0/3843386071 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44011830 con 0x7f2b50133f70 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4effd700 1 -- 172.21.15.125:0/3843386071 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44011990 con 0x7f2b50133f70 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.053+0000 7f2b4effd700 1 -- 172.21.15.125:0/3843386071 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44011d20 con 0x7f2b50133f70 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 -- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 msgr2=0x7f2b501343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b501343a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b44009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 -- 172.21.15.125:0/3843386071 shutdown_connections 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 --2- 172.21.15.125:0/3843386071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b501343a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 -- 172.21.15.125:0/3843386071 >> 172.21.15.125:0/3843386071 conn(0x7f2b50099c40 msgr2=0x7f2b5006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 -- 172.21.15.125:0/3843386071 shutdown_connections 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.054+0000 7f2b56422700 1 -- 172.21.15.125:0/3843386071 wait complete. 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 Processor -- start 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 -- start start 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b501213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b501327a0 con 0x7f2b500a0a70 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50122830 con 0x7f2b5009ad40 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b56422700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50123e70 con 0x7f2b50133f70 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b549bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41226/0 (socket says 172.21.15.125:41226) 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b4f7fe700 1 -- 172.21.15.125:0/199594366 learned_addr learned my addr 172.21.15.125:0/199594366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b549bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37432/0 (socket says 172.21.15.125:37432) 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.055+0000 7f2b4ffff700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b501213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 -- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 msgr2=0x7f2b501213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b501213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 -- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 msgr2=0x7f2b50121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 -- 172.21.15.125:0/199594366 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400094a0 con 0x7f2b50133f70 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b4ffff700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b501213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b4f7fe700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b549bf700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cbe0 tx=0x7f2b4800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800aa40 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800abc0 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440094a0 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480070d0 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.056+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b50124680 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.057+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b48007230 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.057+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5011e060 con 0x7f2b50133f70 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.057+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b4803f360 con 0x7f2b50133f70 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.065+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b480074e0 con 0x7f2b50133f70 2023-10-03T10:15:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 Processor -- start 2023-10-03T10:15:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 -- start start 2023-10-03T10:15:51.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da4133f70 0x7f8da41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 0x7f8da40a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da40a3b60 con 0x7f8da40a0a70 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41348e0 con 0x7f8da409ad40 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da9f7d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8da409b110 con 0x7f8da4133f70 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50830/0 (socket says 172.21.15.125:50830) 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da37fe700 1 -- 172.21.15.125:0/2486535244 learned_addr learned my addr 172.21.15.125:0/2486535244 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.098+0000 7f8da3fff700 1 --2- 172.21.15.125:0/2486535244 >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 0x7f8da40a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da2ffd700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da4133f70 0x7f8da41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 -- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da4133f70 msgr2=0x7f8da41343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da4133f70 0x7f8da41343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 -- 172.21.15.125:0/2486535244 >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 msgr2=0x7f8da40a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 --2- 172.21.15.125:0/2486535244 >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 0x7f8da40a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 -- 172.21.15.125:0/2486535244 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da40a2fa0 con 0x7f8da409ad40 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da3fff700 1 --2- 172.21.15.125:0/2486535244 >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 0x7f8da40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da37fe700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009920 tx=0x7f8d94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78718e42ecce8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da27fc700 1 -- 172.21.15.125:0/2486535244 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94011830 con 0x7f8da409ad40 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da27fc700 1 -- 172.21.15.125:0/2486535244 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94011990 con 0x7f8da409ad40 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.099+0000 7f8da27fc700 1 -- 172.21.15.125:0/2486535244 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94011d20 con 0x7f8da409ad40 2023-10-03T10:15:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 -- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 msgr2=0x7f8da4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009920 tx=0x7f8d94009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 -- 172.21.15.125:0/2486535244 shutdown_connections 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da409ad40 0x7f8da4133a30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/2486535244 >> v2:172.21.15.125:3300/0 conn(0x7f8da40a0a70 0x7f8da40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/2486535244 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da4133f70 0x7f8da41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 -- 172.21.15.125:0/2486535244 >> 172.21.15.125:0/2486535244 conn(0x7f8da4099c40 msgr2=0x7f8da406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 -- 172.21.15.125:0/2486535244 shutdown_connections 2023-10-03T10:15:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.100+0000 7f8da9f7d700 1 -- 172.21.15.125:0/2486535244 wait complete. 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.101+0000 7f8da9f7d700 1 Processor -- start 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.101+0000 7f8da9f7d700 1 -- start start 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da409ad40 0x7f8da411f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da40a0a70 0x7f8da411f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da409bee0 con 0x7f8da409ad40 2023-10-03T10:15:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da4120fb0 con 0x7f8da4133f70 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da9f7d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8da4122080 con 0x7f8da40a0a70 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50838/0 (socket says 172.21.15.125:50838) 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da3fff700 1 -- 172.21.15.125:0/3894320966 learned_addr learned my addr 172.21.15.125:0/3894320966 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.102+0000 7f8da37fe700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da409ad40 0x7f8da411f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 -- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da40a0a70 msgr2=0x7f8da411f7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da40a0a70 0x7f8da411f7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 -- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da409ad40 msgr2=0x7f8da411f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da409ad40 0x7f8da411f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 -- 172.21.15.125:0/3894320966 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c009a70 con 0x7f8da4133f70 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da3fff700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00ef00 tx=0x7f8d9c00b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c010040 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c00bb30 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d94009550 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c003a20 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.103+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da4122d40 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.104+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d9c01d410 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.104+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d9c03fce0 con 0x7f8da4133f70 2023-10-03T10:15:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.104+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da40a6fd0 con 0x7f8da4133f70 2023-10-03T10:15:51.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.109+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d9c007920 con 0x7f8da4133f70 2023-10-03T10:15:51.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.260+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b5009e810 con 0x7f2b50133f70 2023-10-03T10:15:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.261+0000 7f2b4cff9700 1 -- 172.21.15.125:0/199594366 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b48018030 con 0x7f2b50133f70 2023-10-03T10:15:51.261 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:51.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 msgr2=0x7f2b50121e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cbe0 tx=0x7f2b4800cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 shutdown_connections 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b50133f70 0x7f2b50121e50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b5009ad40 0x7f2b501213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 --2- 172.21.15.125:0/199594366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b500a0a70 0x7f2b50121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 >> 172.21.15.125:0/199594366 conn(0x7f2b50099c40 msgr2=0x7f2b501332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 shutdown_connections 2023-10-03T10:15:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.263+0000 7f2b56422700 1 -- 172.21.15.125:0/199594366 wait complete. 2023-10-03T10:15:51.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:51.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.301+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8da4122850 con 0x7f8da4133f70 2023-10-03T10:15:51.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.301+0000 7f8d8bfff700 1 -- 172.21.15.125:0/3894320966 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d9c013360 con 0x7f8da4133f70 2023-10-03T10:15:51.301 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:51.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 msgr2=0x7f8da411fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00ef00 tx=0x7f8d9c00b390 comp rx=0 tx=0).stop 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 shutdown_connections 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da4133f70 0x7f8da411fcf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da409ad40 0x7f8da411f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 --2- 172.21.15.125:0/3894320966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8da40a0a70 0x7f8da411f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 >> 172.21.15.125:0/3894320966 conn(0x7f8da4099c40 msgr2=0x7f8da40a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 shutdown_connections 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.303+0000 7f8da9f7d700 1 -- 172.21.15.125:0/3894320966 wait complete. 2023-10-03T10:15:51.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:51.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:51.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:51.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.974+0000 7fd21435d700 1 Processor -- start 2023-10-03T10:15:51.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.974+0000 7fd21435d700 1 -- start start 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd21435d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd21435d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd21435d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c09b110 con 0x7fd20c133f70 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd21435d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0a3b60 con 0x7fd20c1343a0 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd21435d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0a2fa0 con 0x7fd20c09ad40 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2128fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2128fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41250/0 (socket says 172.21.15.125:41250) 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2118f8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd20c133f70 0x7fd20c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37532/0 (socket says 172.21.15.125:37532) 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37444/0 (socket says 172.21.15.125:37444) 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2128fa700 1 -- 172.21.15.125:0/2876956652 learned_addr learned my addr 172.21.15.125:0/2876956652 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 -- 172.21.15.125:0/2876956652 >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 msgr2=0x7fd20c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 --2- 172.21.15.125:0/2876956652 >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 -- 172.21.15.125:0/2876956652 >> v1:172.21.15.125:6789/0 conn(0x7fd20c133f70 legacy=0x7fd20c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 -- 172.21.15.125:0/2876956652 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c09a280 con 0x7fd20c09ad40 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2128fa700 1 --2- 172.21.15.125:0/2876956652 >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2110f7700 1 -- 172.21.15.125:0/2876956652 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131743514 0 0) 0x7fd20c09b110 con 0x7fd20c133f70 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2120f9700 1 --2- 172.21.15.125:0/2876956652 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd208009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab80eb528bdedaf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.975+0000 7fd2110f7700 1 -- 172.21.15.125:0/2876956652 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011830 con 0x7fd20c09ad40 2023-10-03T10:15:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd2110f7700 1 -- 172.21.15.125:0/2876956652 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208011990 con 0x7fd20c09ad40 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd2110f7700 1 -- 172.21.15.125:0/2876956652 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011d20 con 0x7fd20c09ad40 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 -- 172.21.15.125:0/2876956652 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 msgr2=0x7fd20c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 --2- 172.21.15.125:0/2876956652 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd208009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 -- 172.21.15.125:0/2876956652 shutdown_connections 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 --2- 172.21.15.125:0/2876956652 >> v2:172.21.15.125:3300/0 conn(0x7fd20c1343a0 0x7fd20c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 --2- 172.21.15.125:0/2876956652 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c09ad40 0x7fd20c133a30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 -- 172.21.15.125:0/2876956652 >> 172.21.15.125:0/2876956652 conn(0x7fd20c099c40 msgr2=0x7fd20c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 -- 172.21.15.125:0/2876956652 shutdown_connections 2023-10-03T10:15:51.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.976+0000 7fd21435d700 1 -- 172.21.15.125:0/2876956652 wait complete. 2023-10-03T10:15:51.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.977+0000 7fd21435d700 1 Processor -- start 2023-10-03T10:15:51.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.977+0000 7fd21435d700 1 -- start start 2023-10-03T10:15:51.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd20c133f70 0x7fd20c11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 0x7fd20c11ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1216d0 con 0x7fd20c133f70 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c09c7e0 con 0x7fd20c09ad40 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd21435d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c11fff0 con 0x7fd20c1343a0 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2128fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 0x7fd20c11ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50842/0 (socket says 172.21.15.125:50842) 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2128fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 0x7fd20c11ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37448/0 (socket says 172.21.15.125:37448) 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 -- 172.21.15.125:0/3573295852 learned_addr learned my addr 172.21.15.125:0/3573295852 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2118f8700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd20c133f70 0x7fd20c11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 -- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 msgr2=0x7fd20c11ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 0x7fd20c11ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 -- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd20c133f70 msgr2=0x7fd20c11e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd20c133f70 0x7fd20c11e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 -- 172.21.15.125:0/3573295852 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009b30 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.978+0000 7fd2120f9700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd2080090b0 tx=0x7fd208004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080036a0 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20801e070 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2080094a0 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208003a00 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c121e60 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd208003b60 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.979+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd208020070 con 0x7fd20c09ad40 2023-10-03T10:15:51.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.980+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c04f2a0 con 0x7fd20c09ad40 2023-10-03T10:15:51.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:51.988+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd208015080 con 0x7fd20c09ad40 2023-10-03T10:15:52.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.016+0000 7fce3d015700 1 Processor -- start 2023-10-03T10:15:52.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.016+0000 7fce3d015700 1 -- start start 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 0x7fce381343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce380a0a70 0x7fce380a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce380a3b60 con 0x7fce380a0a70 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce381348e0 con 0x7fce38133f70 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3d015700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3809b110 con 0x7fce3809ad40 2023-10-03T10:15:52.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce36d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce380a0a70 0x7fce380a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce36d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37450/0 (socket says 172.21.15.125:37450) 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce380a0a70 0x7fce380a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41260/0 (socket says 172.21.15.125:41260) 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce36d9d700 1 -- 172.21.15.125:0/582144460 learned_addr learned my addr 172.21.15.125:0/582144460 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3659c700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 0x7fce381343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 -- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 msgr2=0x7fce38133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 -- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 msgr2=0x7fce381343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 0x7fce381343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 -- 172.21.15.125:0/582144460 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce380a2fa0 con 0x7fce380a0a70 2023-10-03T10:15:52.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce36d9d700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3659c700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 0x7fce381343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce3759e700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce380a0ef0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fce30009dc0 tx=0x7fce3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0f57ddaa687e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce35d9b700 1 -- 172.21.15.125:0/582144460 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000e070 con 0x7fce380a0a70 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce35d9b700 1 -- 172.21.15.125:0/582144460 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000bae0 con 0x7fce380a0a70 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.017+0000 7fce35d9b700 1 -- 172.21.15.125:0/582144460 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000be90 con 0x7fce380a0a70 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 -- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 msgr2=0x7fce380a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce380a0ef0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fce30009dc0 tx=0x7fce3000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 -- 172.21.15.125:0/582144460 shutdown_connections 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce380a0ef0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce3809ad40 0x7fce38133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 --2- 172.21.15.125:0/582144460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce38133f70 0x7fce381343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 -- 172.21.15.125:0/582144460 >> 172.21.15.125:0/582144460 conn(0x7fce38099c40 msgr2=0x7fce3806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 -- 172.21.15.125:0/582144460 shutdown_connections 2023-10-03T10:15:52.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.018+0000 7fce3d015700 1 -- 172.21.15.125:0/582144460 wait complete. 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 Processor -- start 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 -- start start 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 0x7fce381c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce38133f70 0x7fce381c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38120330 con 0x7fce380a0a70 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce381c5cf0 con 0x7fce3809ad40 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.020+0000 7fce3d015700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3809c7e0 con 0x7fce38133f70 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 0x7fce381c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41270/0 (socket says 172.21.15.125:41270) 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3659c700 1 -- 172.21.15.125:0/1040084360 learned_addr learned my addr 172.21.15.125:0/1040084360 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3759e700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce38133f70 0x7fce381c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 -- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce38133f70 msgr2=0x7fce381c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce38133f70 0x7fce381c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 -- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 msgr2=0x7fce381c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 -- 172.21.15.125:0/1040084360 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009550 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3659c700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce36d9d700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 0x7fce381c5270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e8e0 tx=0x7fce2800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28013680 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce280137e0 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c0094a0 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28013b70 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.021+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce30009a70 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.022+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce28013cd0 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.022+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce2803f5e0 con 0x7fce3809ad40 2023-10-03T10:15:52.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.022+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce38132a20 con 0x7fce3809ad40 2023-10-03T10:15:52.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.027+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce2801be10 con 0x7fce3809ad40 2023-10-03T10:15:52.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.185+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd20c133d50 con 0x7fd20c09ad40 2023-10-03T10:15:52.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.185+0000 7fd202ffd700 1 -- 172.21.15.125:0/3573295852 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd20802a020 con 0x7fd20c09ad40 2023-10-03T10:15:52.186 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 msgr2=0x7fd20c11e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd2080090b0 tx=0x7fd208004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 shutdown_connections 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd20c1343a0 0x7fd20c11ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd20c09ad40 0x7fd20c11e410 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 --2- 172.21.15.125:0/3573295852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd20c133f70 0x7fd20c11e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 >> 172.21.15.125:0/3573295852 conn(0x7fd20c099c40 msgr2=0x7fd20c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 shutdown_connections 2023-10-03T10:15:52.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.187+0000 7fd21435d700 1 -- 172.21.15.125:0/3573295852 wait complete. 2023-10-03T10:15:52.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:52.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.219+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fce3804f2a0 con 0x7fce3809ad40 2023-10-03T10:15:52.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.219+0000 7fce1f7fe700 1 -- 172.21.15.125:0/1040084360 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce28017020 con 0x7fce3809ad40 2023-10-03T10:15:52.220 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:52.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.221+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 msgr2=0x7fce381c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.221+0000 7fce3d015700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 0x7fce381c5270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e8e0 tx=0x7fce2800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 shutdown_connections 2023-10-03T10:15:52.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce38133f70 0x7fce381c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce3809ad40 0x7fce381c5270 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 --2- 172.21.15.125:0/1040084360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce380a0a70 0x7fce381c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 >> 172.21.15.125:0/1040084360 conn(0x7fce38099c40 msgr2=0x7fce38132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 shutdown_connections 2023-10-03T10:15:52.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.222+0000 7fce3d015700 1 -- 172.21.15.125:0/1040084360 wait complete. 2023-10-03T10:15:52.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:52.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:52.316 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 Processor -- start 2023-10-03T10:15:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 -- start start 2023-10-03T10:15:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c409fa00 con 0x7fa4c4134160 2023-10-03T10:15:52.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c40a0370 con 0x7fa4c409e870 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.403+0000 7fa4cb4ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c406bec0 con 0x7fa4c409f180 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c9249700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c9249700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41284/0 (socket says 172.21.15.125:41284) 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c9249700 1 -- 172.21.15.125:0/1741105023 learned_addr learned my addr 172.21.15.125:0/1741105023 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50878/0 (socket says 172.21.15.125:50878) 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c9a4a700 1 --1- 172.21.15.125:0/1741105023 >> v1:172.21.15.125:6789/0 conn(0x7fa4c4134160 0x7fa4c413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37538/0 (socket says 172.21.15.125:37538) 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 -- 172.21.15.125:0/1741105023 >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 msgr2=0x7fa4c409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 --2- 172.21.15.125:0/1741105023 >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 -- 172.21.15.125:0/1741105023 >> v1:172.21.15.125:6789/0 conn(0x7fa4c4134160 legacy=0x7fa4c413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 -- 172.21.15.125:0/1741105023 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c409ada0 con 0x7fa4c409f180 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4bbfff700 1 -- 172.21.15.125:0/1741105023 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324896562 0 0) 0x7fa4c409fa00 con 0x7fa4c4134160 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c9249700 1 --2- 172.21.15.125:0/1741105023 >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4c8a48700 1 --2- 172.21.15.125:0/1741105023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009840 tx=0x7fa4b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f10c0c88d8103cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4bbfff700 1 -- 172.21.15.125:0/1741105023 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011830 con 0x7fa4c409f180 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4bbfff700 1 -- 172.21.15.125:0/1741105023 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4011990 con 0x7fa4c409f180 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.404+0000 7fa4bbfff700 1 -- 172.21.15.125:0/1741105023 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011d20 con 0x7fa4c409f180 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1741105023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 msgr2=0x7fa4c4133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1741105023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009840 tx=0x7fa4b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1741105023 shutdown_connections 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1741105023 >> v2:172.21.15.125:3300/0 conn(0x7fa4c409e870 0x7fa4c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1741105023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4133c20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1741105023 >> 172.21.15.125:0/1741105023 conn(0x7fa4c40a4430 msgr2=0x7fa4c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1741105023 shutdown_connections 2023-10-03T10:15:52.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.405+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1741105023 wait complete. 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.406+0000 7fa4cb4ad700 1 Processor -- start 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.406+0000 7fa4cb4ad700 1 -- start start 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 0x7fa4c4123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4133510 con 0x7fa4c409e870 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4125b30 con 0x7fa4c409f180 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4cb4ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4124520 con 0x7fa4c4134160 2023-10-03T10:15:52.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9a4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 0x7fa4c4123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41288/0 (socket says 172.21.15.125:41288) 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9a4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 0x7fa4c4123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37474/0 (socket says 172.21.15.125:37474) 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 -- 172.21.15.125:0/1170863727 learned_addr learned my addr 172.21.15.125:0/1170863727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c8a48700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 -- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 msgr2=0x7fa4c4123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 0x7fa4c4123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 -- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 msgr2=0x7fa4c4122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 -- 172.21.15.125:0/1170863727 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0009550 con 0x7fa4c409e870 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c8a48700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.407+0000 7fa4c9249700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000ebe0 tx=0x7fa4c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000c850 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000c9b0 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b40094a0 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000cd40 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4125e90 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.408+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4c0013470 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.409+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4c003f860 con 0x7fa4c409e870 2023-10-03T10:15:52.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.409+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c404f2a0 con 0x7fa4c409e870 2023-10-03T10:15:52.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.413+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4c0017080 con 0x7fa4c409e870 2023-10-03T10:15:52.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.445+0000 7f714c2fb700 1 Processor -- start 2023-10-03T10:15:52.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.445+0000 7f714c2fb700 1 -- start start 2023-10-03T10:15:52.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714c2fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f714409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714c2fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 0x7f7144139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714c2fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714409c970 con 0x7f714409f180 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714c2fb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440a0920 con 0x7f7144131f40 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714c2fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714409f9c0 con 0x7f714409e870 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714a898700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 0x7f7144139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f714a097700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f714409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f7149896700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f714409f180 0x7f7144131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37540/0 (socket says 172.21.15.125:37540) 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.446+0000 7f7149896700 1 -- 172.21.15.125:0/1927948702 learned_addr learned my addr 172.21.15.125:0/1927948702 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a097700 1 -- 172.21.15.125:0/1927948702 >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 msgr2=0x7f7144139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a097700 1 --2- 172.21.15.125:0/1927948702 >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 0x7f7144139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a097700 1 -- 172.21.15.125:0/1927948702 >> v1:172.21.15.125:6789/0 conn(0x7f714409f180 legacy=0x7f7144131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a097700 1 -- 172.21.15.125:0/1927948702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714409bab0 con 0x7f714409e870 2023-10-03T10:15:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a898700 1 --2- 172.21.15.125:0/1927948702 >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 0x7f7144139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f714a097700 1 --2- 172.21.15.125:0/1927948702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f714409ec40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7140009840 tx=0x7f7140009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e580414cfbb55f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f7149095700 1 -- 172.21.15.125:0/1927948702 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011830 con 0x7f714409e870 2023-10-03T10:15:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f7149095700 1 -- 172.21.15.125:0/1927948702 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140011990 con 0x7f714409e870 2023-10-03T10:15:52.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.447+0000 7f7149095700 1 -- 172.21.15.125:0/1927948702 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011d20 con 0x7f714409e870 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 -- 172.21.15.125:0/1927948702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 msgr2=0x7f714409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 --2- 172.21.15.125:0/1927948702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f714409ec40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7140009840 tx=0x7f7140009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 -- 172.21.15.125:0/1927948702 shutdown_connections 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 --2- 172.21.15.125:0/1927948702 >> v2:172.21.15.125:3300/0 conn(0x7f7144131f40 0x7f7144139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 --2- 172.21.15.125:0/1927948702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f714409ec40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 -- 172.21.15.125:0/1927948702 >> 172.21.15.125:0/1927948702 conn(0x7f71440a4430 msgr2=0x7f71440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 -- 172.21.15.125:0/1927948702 shutdown_connections 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.448+0000 7f714c2fb700 1 -- 172.21.15.125:0/1927948702 wait complete. 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 Processor -- start 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 -- start start 2023-10-03T10:15:52.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f71441202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7144131f40 0x7f7144120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144123e10 con 0x7f7144131f40 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440a2f60 con 0x7f714409f180 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714c2fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714409dba0 con 0x7f714409e870 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f7149896700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f7149896700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50892/0 (socket says 172.21.15.125:50892) 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f7149896700 1 -- 172.21.15.125:0/4044549522 learned_addr learned my addr 172.21.15.125:0/4044549522 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a097700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f71441202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a898700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7144131f40 0x7f7144120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a097700 1 -- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 msgr2=0x7f7144120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a097700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a097700 1 -- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7144131f40 msgr2=0x7f7144120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.449+0000 7f714a097700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7144131f40 0x7f7144120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f714a097700 1 -- 172.21.15.125:0/4044549522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c009a70 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f7149896700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f714a097700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f71441202f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7140016000 tx=0x7f7140004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400045d0 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714001e070 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400038c0 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71400094a0 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.450+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7144122d20 con 0x7f714409e870 2023-10-03T10:15:52.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.451+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714411d580 con 0x7f714409e870 2023-10-03T10:15:52.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.451+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7140003a20 con 0x7f714409e870 2023-10-03T10:15:52.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.451+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71400405b0 con 0x7f714409e870 2023-10-03T10:15:52.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.456+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7140010970 con 0x7f714409e870 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.603+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4c406c9d0 con 0x7fa4c409e870 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.603+0000 7fa4b9ffb700 1 -- 172.21.15.125:0/1170863727 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4c0021020 con 0x7fa4c409e870 2023-10-03T10:15:52.604 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 msgr2=0x7fa4c4122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000ebe0 tx=0x7fa4c000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 shutdown_connections 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c4134160 0x7fa4c4123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c409e870 0x7fa4c4122910 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 --2- 172.21.15.125:0/1170863727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c409f180 0x7fa4c4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 >> 172.21.15.125:0/1170863727 conn(0x7fa4c40a4430 msgr2=0x7fa4c40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 shutdown_connections 2023-10-03T10:15:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.605+0000 7fa4cb4ad700 1 -- 172.21.15.125:0/1170863727 wait complete. 2023-10-03T10:15:52.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:52.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.643+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f714404f2a0 con 0x7f714409e870 2023-10-03T10:15:52.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.643+0000 7f713affd700 1 -- 172.21.15.125:0/4044549522 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7140015070 con 0x7f714409e870 2023-10-03T10:15:52.644 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 msgr2=0x7f71441202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f71441202f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7140016000 tx=0x7f7140004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 shutdown_connections 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7144131f40 0x7f7144120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f714409e870 0x7f71441202f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 --2- 172.21.15.125:0/4044549522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f714409f180 0x7f7144120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 >> 172.21.15.125:0/4044549522 conn(0x7f71440a4430 msgr2=0x7f714411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 shutdown_connections 2023-10-03T10:15:52.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:52.645+0000 7f714c2fb700 1 -- 172.21.15.125:0/4044549522 wait complete. 2023-10-03T10:15:52.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:53.200 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:53.235 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:53.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.330+0000 7f8331fb5700 1 Processor -- start 2023-10-03T10:15:53.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.330+0000 7f8331fb5700 1 -- start start 2023-10-03T10:15:53.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8331fb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c09ad40 0x7f832c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8331fb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8331fb5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c09b110 con 0x7f832c133f70 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8331fb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a3b60 con 0x7f832c09ad40 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8331fb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a2fa0 con 0x7f832c1343a0 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8322ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f832c133f70 0x7f832c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37542/0 (socket says 172.21.15.125:37542) 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f8322ffd700 1 -- 172.21.15.125:0/2882399618 learned_addr learned my addr 172.21.15.125:0/2882399618 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832b7fe700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c09ad40 0x7f832c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832affd700 1 -- 172.21.15.125:0/2882399618 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721764212 0 0) 0x7f832c09b110 con 0x7f832c133f70 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 -- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c09ad40 msgr2=0x7f832c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c09ad40 0x7f832c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 -- 172.21.15.125:0/2882399618 >> v1:172.21.15.125:6789/0 conn(0x7f832c133f70 legacy=0x7f832c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 -- 172.21.15.125:0/2882399618 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c09a280 con 0x7f832c1343a0 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832bfff700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c0a1180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8324009dc0 tx=0x7f832400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55602f45e5ffda68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.331+0000 7f832affd700 1 -- 172.21.15.125:0/2882399618 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400e070 con 0x7f832c1343a0 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f832affd700 1 -- 172.21.15.125:0/2882399618 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400bb20 con 0x7f832c1343a0 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f832affd700 1 -- 172.21.15.125:0/2882399618 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324012430 con 0x7f832c1343a0 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 -- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 msgr2=0x7f832c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c0a1180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8324009dc0 tx=0x7f832400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 -- 172.21.15.125:0/2882399618 shutdown_connections 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c0a1180 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2882399618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c09ad40 0x7f832c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 -- 172.21.15.125:0/2882399618 >> 172.21.15.125:0/2882399618 conn(0x7f832c099c40 msgr2=0x7f832c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 -- 172.21.15.125:0/2882399618 shutdown_connections 2023-10-03T10:15:53.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.332+0000 7f8331fb5700 1 -- 172.21.15.125:0/2882399618 wait complete. 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.333+0000 7f8331fb5700 1 Processor -- start 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 -- start start 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 0x7f832c1c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c1c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c122580 con 0x7f832c09ad40 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1208c0 con 0x7f832c133f70 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.334+0000 7f8331fb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09e7a0 con 0x7f832c1343a0 2023-10-03T10:15:53.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 0x7f832c1c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41304/0 (socket says 172.21.15.125:41304) 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832b7fe700 1 -- 172.21.15.125:0/2070272035 learned_addr learned my addr 172.21.15.125:0/2070272035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832bfff700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c1c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 -- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 msgr2=0x7f832c1c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c1c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 -- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 msgr2=0x7f832c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 -- 172.21.15.125:0/2070272035 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009a70 con 0x7f832c133f70 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832b7fe700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f832bfff700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c1c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8322ffd700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 0x7f832c1c8850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f832c06bec0 tx=0x7f831400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314004c80 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314004de0 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c09c7e0 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314007310 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.335+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c122f60 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.336+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8314007470 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.336+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c04f2a0 con 0x7f832c133f70 2023-10-03T10:15:53.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.336+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f831403f220 con 0x7f832c133f70 2023-10-03T10:15:53.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.341+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f831401bba0 con 0x7f832c133f70 2023-10-03T10:15:53.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.371+0000 7fa072222700 1 Processor -- start 2023-10-03T10:15:53.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.371+0000 7fa072222700 1 -- start start 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa072222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa072222700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa072222700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c09b110 con 0x7fa06c0a0a70 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa072222700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0a3b60 con 0x7fa06c133f70 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa072222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c1348e0 con 0x7fa06c09ad40 2023-10-03T10:15:53.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37536/0 (socket says 172.21.15.125:37536) 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06b7fe700 1 -- 172.21.15.125:0/136074623 learned_addr learned my addr 172.21.15.125:0/136074623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06affd700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06affd700 1 -- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 msgr2=0x7fa06c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06affd700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06affd700 1 -- 172.21.15.125:0/136074623 >> v1:172.21.15.125:6789/0 conn(0x7fa06c0a0a70 legacy=0x7fa06c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06a7fc700 1 -- 172.21.15.125:0/136074623 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105743122 0 0) 0x7fa06c09b110 con 0x7fa06c0a0a70 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06affd700 1 -- 172.21.15.125:0/136074623 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0a2fa0 con 0x7fa06c133f70 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.372+0000 7fa06b7fe700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa06affd700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1343a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa054009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04eb226bbebf4aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa06a7fc700 1 -- 172.21.15.125:0/136074623 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011830 con 0x7fa06c133f70 2023-10-03T10:15:53.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa06a7fc700 1 -- 172.21.15.125:0/136074623 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054011990 con 0x7fa06c133f70 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa06a7fc700 1 -- 172.21.15.125:0/136074623 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011d20 con 0x7fa06c133f70 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 -- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 msgr2=0x7fa06c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1343a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa054009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 -- 172.21.15.125:0/136074623 shutdown_connections 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 --2- 172.21.15.125:0/136074623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1343a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 -- 172.21.15.125:0/136074623 >> 172.21.15.125:0/136074623 conn(0x7fa06c099c40 msgr2=0x7fa06c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 -- 172.21.15.125:0/136074623 shutdown_connections 2023-10-03T10:15:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.373+0000 7fa072222700 1 -- 172.21.15.125:0/136074623 wait complete. 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.374+0000 7fa072222700 1 Processor -- start 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.374+0000 7fa072222700 1 -- start start 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c120be0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c09c850 con 0x7fa06c133f70 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa072222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c120740 con 0x7fa06c09ad40 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41318/0 (socket says 172.21.15.125:41318) 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50942/0 (socket says 172.21.15.125:50942) 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 -- 172.21.15.125:0/1141631287 learned_addr learned my addr 172.21.15.125:0/1141631287 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06b7fe700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 -- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 msgr2=0x7fa06c1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 -- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 msgr2=0x7fa06c1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 -- 172.21.15.125:0/1141631287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009b30 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06bfff700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.375+0000 7fa06affd700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa0540090b0 tx=0x7fa054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054004590 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540036a0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0540094a0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054003a50 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c1221f0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.376+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa054003bb0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.377+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0540409b0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.377+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c120e10 con 0x7fa06c0a0a70 2023-10-03T10:15:53.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.381+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa054015020 con 0x7fa06c0a0a70 2023-10-03T10:15:53.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.530+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f832c0a0330 con 0x7f832c133f70 2023-10-03T10:15:53.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.530+0000 7f8328ff9700 1 -- 172.21.15.125:0/2070272035 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f831401b7b0 con 0x7f832c133f70 2023-10-03T10:15:53.531 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:53.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 msgr2=0x7f832c1c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 0x7f832c1c8850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f832c06bec0 tx=0x7f831400c750 comp rx=0 tx=0).stop 2023-10-03T10:15:53.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 shutdown_connections 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f832c1343a0 0x7f832c1c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f832c09ad40 0x7f832c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 --2- 172.21.15.125:0/2070272035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832c133f70 0x7f832c1c8850 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 >> 172.21.15.125:0/2070272035 conn(0x7f832c099c40 msgr2=0x7f832c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 shutdown_connections 2023-10-03T10:15:53.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.533+0000 7f8331fb5700 1 -- 172.21.15.125:0/2070272035 wait complete. 2023-10-03T10:15:53.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:53.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.577+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa06c1223e0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.578+0000 7fa063fff700 1 -- 172.21.15.125:0/1141631287 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa054006bb0 con 0x7fa06c0a0a70 2023-10-03T10:15:53.578 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:53.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 msgr2=0x7fa06c1c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa0540090b0 tx=0x7fa054004750 comp rx=0 tx=0).stop 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 shutdown_connections 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa06c133f70 0x7fa06c1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa06c09ad40 0x7fa06c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 --2- 172.21.15.125:0/1141631287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa06c0a0a70 0x7fa06c1c86d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 >> 172.21.15.125:0/1141631287 conn(0x7fa06c099c40 msgr2=0x7fa06c1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 shutdown_connections 2023-10-03T10:15:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.580+0000 7fa072222700 1 -- 172.21.15.125:0/1141631287 wait complete. 2023-10-03T10:15:53.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:53.619 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:53.659 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:53.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.756+0000 7f3fcd7db700 1 Processor -- start 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 -- start start 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 0x7f3fc81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fc80a0a70 0x7f3fc80a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc80a3b60 con 0x7f3fc80a0a70 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81348e0 con 0x7f3fc809ad40 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fcd7db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc809b110 con 0x7f3fc8133f70 2023-10-03T10:15:53.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 0x7f3fc81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50958/0 (socket says 172.21.15.125:50958) 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fc80a0a70 0x7f3fc80a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc6ffd700 1 -- 172.21.15.125:0/4008415214 learned_addr learned my addr 172.21.15.125:0/4008415214 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 -- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 msgr2=0x7f3fc8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 -- 172.21.15.125:0/4008415214 >> v2:172.21.15.125:3300/0 conn(0x7f3fc80a0a70 msgr2=0x7f3fc80a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 --2- 172.21.15.125:0/4008415214 >> v2:172.21.15.125:3300/0 conn(0x7f3fc80a0a70 0x7f3fc80a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.757+0000 7f3fc67fc700 1 -- 172.21.15.125:0/4008415214 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80a2fa0 con 0x7f3fc8133f70 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fc6ffd700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fc67fc700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 0x7f3fc81343a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009840 tx=0x7f3fbc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f9811fdf330757 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fc5ffb700 1 -- 172.21.15.125:0/4008415214 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011830 con 0x7f3fc8133f70 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fc5ffb700 1 -- 172.21.15.125:0/4008415214 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc011990 con 0x7f3fc8133f70 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fc5ffb700 1 -- 172.21.15.125:0/4008415214 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011d20 con 0x7f3fc8133f70 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 msgr2=0x7f3fc81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 0x7f3fc81343a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009840 tx=0x7f3fbc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4008415214 shutdown_connections 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc809ad40 0x7f3fc8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4008415214 >> v2:172.21.15.125:3300/0 conn(0x7f3fc80a0a70 0x7f3fc80a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4008415214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc8133f70 0x7f3fc81343a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4008415214 >> 172.21.15.125:0/4008415214 conn(0x7f3fc8099c40 msgr2=0x7f3fc806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.758+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4008415214 shutdown_connections 2023-10-03T10:15:53.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.759+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4008415214 wait complete. 2023-10-03T10:15:53.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.760+0000 7f3fcd7db700 1 Processor -- start 2023-10-03T10:15:53.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.760+0000 7f3fcd7db700 1 -- start start 2023-10-03T10:15:53.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.760+0000 7f3fcd7db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc80a0a70 0x7f3fc811fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81223f0 con 0x7f3fc809ad40 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81225d0 con 0x7f3fc8133f70 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8133670 con 0x7f3fc80a0a70 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41340/0 (socket says 172.21.15.125:41340) 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50962/0 (socket says 172.21.15.125:50962) 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc6ffd700 1 -- 172.21.15.125:0/4244943413 learned_addr learned my addr 172.21.15.125:0/4244943413 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc67fc700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc80a0a70 0x7f3fc811fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 -- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc80a0a70 msgr2=0x7f3fc811fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc80a0a70 0x7f3fc811fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 -- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 msgr2=0x7f3fc811f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 -- 172.21.15.125:0/4244943413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009550 con 0x7f3fc8133f70 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc6ffd700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fc77fe700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000efc0 tx=0x7f3fc000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000cc90 con 0x7f3fc8133f70 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000f040 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0094a0 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00146c0 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.761+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc809c7e0 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.762+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fc0014820 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.762+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fc00401d0 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.762+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc804f2a0 con 0x7f3fc8133f70 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.767+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fc0018080 con 0x7f3fc8133f70 2023-10-03T10:15:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 Processor -- start 2023-10-03T10:15:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 -- start start 2023-10-03T10:15:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 0x7f11ac1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0a0920 con 0x7f11ac09e870 2023-10-03T10:15:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac09c970 con 0x7f11ac09f180 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.800+0000 7f11b0fd3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac09bab0 con 0x7f11ac131d70 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50966/0 (socket says 172.21.15.125:50966) 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41354/0 (socket says 172.21.15.125:41354) 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a9d9b700 1 -- 172.21.15.125:0/575722810 learned_addr learned my addr 172.21.15.125:0/575722810 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 0x7f11ac1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 -- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 msgr2=0x7f11ac131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 -- 172.21.15.125:0/575722810 >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 msgr2=0x7f11ac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 --2- 172.21.15.125:0/575722810 >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 -- 172.21.15.125:0/575722810 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac09f9c0 con 0x7f11ac131d70 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a9d9b700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aa59c700 1 --2- 172.21.15.125:0/575722810 >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11aad9d700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 0x7f11ac1321f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009d90 tx=0x7f11a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11dbd79da8e23fff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a959a700 1 -- 172.21.15.125:0/575722810 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400e070 con 0x7f11ac131d70 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a959a700 1 -- 172.21.15.125:0/575722810 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400bb20 con 0x7f11ac131d70 2023-10-03T10:15:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.801+0000 7f11a959a700 1 -- 172.21.15.125:0/575722810 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4012430 con 0x7f11ac131d70 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 -- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 msgr2=0x7f11ac1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 0x7f11ac1321f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009d90 tx=0x7f11a400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 -- 172.21.15.125:0/575722810 shutdown_connections 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac131d70 0x7f11ac1321f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/575722810 >> v2:172.21.15.125:3300/0 conn(0x7f11ac09e870 0x7f11ac09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/575722810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac09f180 0x7f11ac131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 -- 172.21.15.125:0/575722810 >> 172.21.15.125:0/575722810 conn(0x7f11ac0a4430 msgr2=0x7f11ac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 -- 172.21.15.125:0/575722810 shutdown_connections 2023-10-03T10:15:53.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.802+0000 7f11b0fd3700 1 -- 172.21.15.125:0/575722810 wait complete. 2023-10-03T10:15:53.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 Processor -- start 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 -- start start 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 0x7f11ac1c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 0x7f11ac1c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac11e540 con 0x7f11ac09f180 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac11fff0 con 0x7f11ac131d70 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11b0fd3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac11e970 con 0x7f11ac09e870 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.803+0000 7f11aa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aa59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37584/0 (socket says 172.21.15.125:37584) 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 0x7f11ac1c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aa59c700 1 -- 172.21.15.125:0/1790720599 learned_addr learned my addr 172.21.15.125:0/1790720599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11a9d9b700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 0x7f11ac1c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 -- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 msgr2=0x7f11ac1c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 -- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 msgr2=0x7f11ac1c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 0x7f11ac1c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 -- 172.21.15.125:0/1790720599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0094a0 con 0x7f11ac131d70 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11a9d9b700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 0x7f11ac1c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aa59c700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11aad9d700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 0x7f11ac1c6a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009d90 tx=0x7f11a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4004880 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4020070 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a0009550 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40276c0 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.804+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a4009a70 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.805+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11a4012430 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.805+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11a4022070 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.805+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac04f2a0 con 0x7f11ac131d70 2023-10-03T10:15:53.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.810+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11a401b400 con 0x7f11ac131d70 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.962+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fc8120eb0 con 0x7f3fc8133f70 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.963+0000 7f3faf7fe700 1 -- 172.21.15.125:0/4244943413 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fc0009e60 con 0x7f3fc8133f70 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 msgr2=0x7f3fc81c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000efc0 tx=0x7f3fc000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 shutdown_connections 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc8133f70 0x7f3fc81c8270 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc809ad40 0x7f3fc811f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 --2- 172.21.15.125:0/4244943413 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc80a0a70 0x7f3fc811fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 >> 172.21.15.125:0/4244943413 conn(0x7f3fc8099c40 msgr2=0x7f3fc81bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 shutdown_connections 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:53.965+0000 7f3fcd7db700 1 -- 172.21.15.125:0/4244943413 wait complete. 2023-10-03T10:15:53.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:54.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.004+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11ac06b2a0 con 0x7f11ac131d70 2023-10-03T10:15:54.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.004+0000 7f119affd700 1 -- 172.21.15.125:0/1790720599 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11a4011390 con 0x7f11ac131d70 2023-10-03T10:15:54.004 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 msgr2=0x7f11ac1c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 0x7f11ac1c6a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009d90 tx=0x7f11a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 shutdown_connections 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11ac131d70 0x7f11ac1c6a10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f11ac09e870 0x7f11ac1c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 --2- 172.21.15.125:0/1790720599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11ac09f180 0x7f11ac1c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 >> 172.21.15.125:0/1790720599 conn(0x7f11ac0a4430 msgr2=0x7f11ac1b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 shutdown_connections 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.006+0000 7f11b0fd3700 1 -- 172.21.15.125:0/1790720599 wait complete. 2023-10-03T10:15:54.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:54.551 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:54.593 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.682+0000 7f488ae43700 1 Processor -- start 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.682+0000 7f488ae43700 1 -- start start 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f488ae43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f48840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f488ae43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f488ae43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488409dc00 con 0x7f4884133f50 2023-10-03T10:15:54.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f488ae43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488409ea60 con 0x7f48840a1380 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f488ae43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f488409dec0 con 0x7f48840a0a70 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f48840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f48893e0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4884133f50 0x7f488413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37564/0 (socket says 172.21.15.125:37564) 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4883fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f48893e0700 1 -- 172.21.15.125:0/2575843261 learned_addr learned my addr 172.21.15.125:0/2575843261 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f48837fe700 1 -- 172.21.15.125:0/2575843261 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594915194 0 0) 0x7f488409dc00 con 0x7f4884133f50 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 -- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 msgr2=0x7f4884133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 -- 172.21.15.125:0/2575843261 >> v1:172.21.15.125:6789/0 conn(0x7f4884133f50 legacy=0x7f488413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 -- 172.21.15.125:0/2575843261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488409e6a0 con 0x7f48840a0a70 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4883fff700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.683+0000 7f4888bdf700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f48840a0e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4878009870 tx=0x7f4878009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee6270f3487ae1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f48837fe700 1 -- 172.21.15.125:0/2575843261 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878011830 con 0x7f48840a0a70 2023-10-03T10:15:54.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f48837fe700 1 -- 172.21.15.125:0/2575843261 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878011990 con 0x7f48840a0a70 2023-10-03T10:15:54.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f48837fe700 1 -- 172.21.15.125:0/2575843261 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878011d20 con 0x7f48840a0a70 2023-10-03T10:15:54.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 -- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 msgr2=0x7f48840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f48840a0e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4878009870 tx=0x7f4878009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 -- 172.21.15.125:0/2575843261 shutdown_connections 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f48840a0e40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 --2- 172.21.15.125:0/2575843261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 -- 172.21.15.125:0/2575843261 >> 172.21.15.125:0/2575843261 conn(0x7f48840a6610 msgr2=0x7f48840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 -- 172.21.15.125:0/2575843261 shutdown_connections 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.684+0000 7f488ae43700 1 -- 172.21.15.125:0/2575843261 wait complete. 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.685+0000 7f488ae43700 1 Processor -- start 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.685+0000 7f488ae43700 1 -- start start 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4884133f50 0x7f48841232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48841260b0 con 0x7f4884133f50 2023-10-03T10:15:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4884123cd0 con 0x7f48840a1380 2023-10-03T10:15:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f488ae43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4884133970 con 0x7f48840a0a70 2023-10-03T10:15:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4883fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37596/0 (socket says 172.21.15.125:37596) 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4883fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50990/0 (socket says 172.21.15.125:50990) 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 -- 172.21.15.125:0/1804211660 learned_addr learned my addr 172.21.15.125:0/1804211660 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f48893e0700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4884133f50 0x7f48841232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 -- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 msgr2=0x7f4884122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 -- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4884133f50 msgr2=0x7f48841232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4884133f50 0x7f48841232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 -- 172.21.15.125:0/1804211660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700094a0 con 0x7f48840a0a70 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4883fff700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.686+0000 7f4888bdf700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f488409e000 tx=0x7f4878004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.687+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878004510 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.687+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487801f070 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.687+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780094a0 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.687+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780038e0 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.687+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4884133300 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.688+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488404f2a0 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.688+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4878003a40 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.688+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4878021070 con 0x7f48840a0a70 2023-10-03T10:15:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.692+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48780253e0 con 0x7f48840a0a70 2023-10-03T10:15:54.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 Processor -- start 2023-10-03T10:15:54.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 -- start start 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 0x7feab813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab809dc00 con 0x7feab80a1380 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab809ea60 con 0x7feab8134120 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabe983700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab809dec0 con 0x7feab80a0a70 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feab7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feab7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51000/0 (socket says 172.21.15.125:51000) 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feab7fff700 1 -- 172.21.15.125:0/848265449 learned_addr learned my addr 172.21.15.125:0/848265449 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.723+0000 7feabcf20700 1 --2- 172.21.15.125:0/848265449 >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 0x7feab813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab7fff700 1 -- 172.21.15.125:0/848265449 >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 msgr2=0x7feab813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab7fff700 1 --2- 172.21.15.125:0/848265449 >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 0x7feab813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab7fff700 1 -- 172.21.15.125:0/848265449 >> v1:172.21.15.125:6789/0 conn(0x7feab80a1380 legacy=0x7feab8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab7fff700 1 -- 172.21.15.125:0/848265449 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab809e6a0 con 0x7feab80a0a70 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab6ffd700 1 -- 172.21.15.125:0/848265449 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24083963 0 0) 0x7feab809dc00 con 0x7feab80a1380 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feabcf20700 1 --2- 172.21.15.125:0/848265449 >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 0x7feab813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab7fff700 1 --2- 172.21.15.125:0/848265449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7feaa80098f0 tx=0x7feaa8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35417fa9e97872b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab6ffd700 1 -- 172.21.15.125:0/848265449 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011830 con 0x7feab80a0a70 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab6ffd700 1 -- 172.21.15.125:0/848265449 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8011990 con 0x7feab80a0a70 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.724+0000 7feab6ffd700 1 -- 172.21.15.125:0/848265449 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011d20 con 0x7feab80a0a70 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 -- 172.21.15.125:0/848265449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 msgr2=0x7feab80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 --2- 172.21.15.125:0/848265449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7feaa80098f0 tx=0x7feaa8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 -- 172.21.15.125:0/848265449 shutdown_connections 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 --2- 172.21.15.125:0/848265449 >> v2:172.21.15.125:3300/0 conn(0x7feab8134120 0x7feab813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 --2- 172.21.15.125:0/848265449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a0a70 0x7feab80a0e40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 -- 172.21.15.125:0/848265449 >> 172.21.15.125:0/848265449 conn(0x7feab80a6610 msgr2=0x7feab80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 -- 172.21.15.125:0/848265449 shutdown_connections 2023-10-03T10:15:54.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.725+0000 7feabe983700 1 -- 172.21.15.125:0/848265449 wait complete. 2023-10-03T10:15:54.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.726+0000 7feabe983700 1 Processor -- start 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.726+0000 7feabe983700 1 -- start start 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 0x7feab8122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8124390 con 0x7feab8134120 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8133310 con 0x7feab80a1380 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabe983700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab8125d00 con 0x7feab80a0a70 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabcf20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 0x7feab8122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51012/0 (socket says 172.21.15.125:51012) 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabcf20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41392/0 (socket says 172.21.15.125:41392) 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 0x7feab8122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37608/0 (socket says 172.21.15.125:37608) 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 -- 172.21.15.125:0/687377345 learned_addr learned my addr 172.21.15.125:0/687377345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 -- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 msgr2=0x7feab8122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 0x7feab8122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 -- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 msgr2=0x7feab8123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feab77fe700 1 -- 172.21.15.125:0/687377345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009a70 con 0x7feab80a1380 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.727+0000 7feabcf20700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feab77fe700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c550 tx=0x7feaac00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0054e0 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac003680 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa8009550 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac003a30 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab8133af0 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.728+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaac003b90 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.729+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feaac03ea80 con 0x7feab80a1380 2023-10-03T10:15:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.729+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab804f2a0 con 0x7feab80a1380 2023-10-03T10:15:54.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.733+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaac017080 con 0x7feab80a1380 2023-10-03T10:15:54.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.887+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4884072980 con 0x7f48840a0a70 2023-10-03T10:15:54.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.887+0000 7f48817fa700 1 -- 172.21.15.125:0/1804211660 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4878015070 con 0x7f48840a0a70 2023-10-03T10:15:54.888 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 msgr2=0x7f4884122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f488409e000 tx=0x7f4878004750 comp rx=0 tx=0).stop 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 shutdown_connections 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4884133f50 0x7f48841232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48840a0a70 0x7f4884122870 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 --2- 172.21.15.125:0/1804211660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48840a1380 0x7f4884122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 >> 172.21.15.125:0/1804211660 conn(0x7f48840a6610 msgr2=0x7f48840a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 shutdown_connections 2023-10-03T10:15:54.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.889+0000 7f488ae43700 1 -- 172.21.15.125:0/1804211660 wait complete. 2023-10-03T10:15:54.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:54.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.927+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feab8072980 con 0x7feab80a1380 2023-10-03T10:15:54.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.928+0000 7feab4ff9700 1 -- 172.21.15.125:0/687377345 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaac03ce60 con 0x7feab80a1380 2023-10-03T10:15:54.928 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:54.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 msgr2=0x7feab8122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c550 tx=0x7feaac00c860 comp rx=0 tx=0).stop 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 shutdown_connections 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feab8134120 0x7feab8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feab80a0a70 0x7feab8122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 --2- 172.21.15.125:0/687377345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feab80a1380 0x7feab8122cc0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 >> 172.21.15.125:0/687377345 conn(0x7feab80a6610 msgr2=0x7feab80a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 shutdown_connections 2023-10-03T10:15:54.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:54.930+0000 7feabe983700 1 -- 172.21.15.125:0/687377345 wait complete. 2023-10-03T10:15:54.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:54.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:55.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.112+0000 7f40f304a700 1 Processor -- start 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.112+0000 7f40f304a700 1 -- start start 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.112+0000 7f40f304a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 0x7f40ec09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.112+0000 7f40f304a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40f304a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec09aaa0 con 0x7f40ec130ce0 2023-10-03T10:15:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40f0de6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 0x7f40ec09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40f304a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec09f870 con 0x7f40ec09d860 2023-10-03T10:15:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40f304a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec09b360 con 0x7f40ec09e170 2023-10-03T10:15:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37622/0 (socket says 172.21.15.125:37622) 2023-10-03T10:15:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 -- 172.21.15.125:0/3364925484 learned_addr learned my addr 172.21.15.125:0/3364925484 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 -- 172.21.15.125:0/3364925484 >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 msgr2=0x7f40ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 --2- 172.21.15.125:0/3364925484 >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 0x7f40ec09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 -- 172.21.15.125:0/3364925484 >> v1:172.21.15.125:6789/0 conn(0x7f40ec130ce0 legacy=0x7f40ec1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 -- 172.21.15.125:0/3364925484 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec09b620 con 0x7f40ec09e170 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40f0de6700 1 --2- 172.21.15.125:0/3364925484 >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 0x7f40ec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40ebfff700 1 --2- 172.21.15.125:0/3364925484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f40d800bb90 tx=0x7f40d800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6fd462b002218ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40eb7fe700 1 -- 172.21.15.125:0/3364925484 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800dd30 con 0x7f40ec09e170 2023-10-03T10:15:55.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40eb7fe700 1 -- 172.21.15.125:0/3364925484 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800de90 con 0x7f40ec09e170 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.113+0000 7f40eb7fe700 1 -- 172.21.15.125:0/3364925484 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8010690 con 0x7f40ec09e170 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 -- 172.21.15.125:0/3364925484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 msgr2=0x7f40ec1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 --2- 172.21.15.125:0/3364925484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f40d800bb90 tx=0x7f40d800bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 -- 172.21.15.125:0/3364925484 shutdown_connections 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 --2- 172.21.15.125:0/3364925484 >> v2:172.21.15.125:3300/0 conn(0x7f40ec09d860 0x7f40ec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 --2- 172.21.15.125:0/3364925484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e170 0x7f40ec1307a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 -- 172.21.15.125:0/3364925484 >> 172.21.15.125:0/3364925484 conn(0x7f40ec099c40 msgr2=0x7f40ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 -- 172.21.15.125:0/3364925484 shutdown_connections 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.114+0000 7f40f304a700 1 -- 172.21.15.125:0/3364925484 wait complete. 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 Processor -- start 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 -- start start 2023-10-03T10:15:55.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 0x7f40ec11ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec130ce0 0x7f40ec11f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec120890 con 0x7f40ec130ce0 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1203f0 con 0x7f40ec09e170 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f304a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec130630 con 0x7f40ec09d860 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.115+0000 7f40f0de6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37632/0 (socket says 172.21.15.125:37632) 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 -- 172.21.15.125:0/2123619706 learned_addr learned my addr 172.21.15.125:0/2123619706 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f15e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec130ce0 0x7f40ec11f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40ebfff700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 0x7f40ec11ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 -- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 msgr2=0x7f40ec11ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 0x7f40ec11ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 -- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec130ce0 msgr2=0x7f40ec11f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec130ce0 0x7f40ec11f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 -- 172.21.15.125:0/2123619706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094a0 con 0x7f40ec09d860 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40ebfff700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 0x7f40ec11ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f0de6700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f40e000ec10 tx=0x7f40e000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000c850 con 0x7f40ec09d860 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e000c9b0 con 0x7f40ec09d860 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000cd20 con 0x7f40ec09d860 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d800b7f0 con 0x7f40ec09d860 2023-10-03T10:15:55.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.116+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec121f10 con 0x7f40ec09d860 2023-10-03T10:15:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.117+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40e0013470 con 0x7f40ec09d860 2023-10-03T10:15:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.117+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40e003fb30 con 0x7f40ec09d860 2023-10-03T10:15:55.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.117+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04f2a0 con 0x7f40ec09d860 2023-10-03T10:15:55.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.122+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40e0013720 con 0x7f40ec09d860 2023-10-03T10:15:55.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 Processor -- start 2023-10-03T10:15:55.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 -- start start 2023-10-03T10:15:55.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 0x7f5c3409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 0x7f5c34131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3409c970 con 0x7f5c34131d70 2023-10-03T10:15:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340a0920 con 0x7f5c3409e870 2023-10-03T10:15:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3bb80700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409f9c0 con 0x7f5c3409f180 2023-10-03T10:15:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3911b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 0x7f5c34131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3a11d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5c34131d70 0x7f5c34138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37592/0 (socket says 172.21.15.125:37592) 2023-10-03T10:15:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3991c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 0x7f5c3409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.154+0000 7f5c3a11d700 1 -- 172.21.15.125:0/1193739629 learned_addr learned my addr 172.21.15.125:0/1193739629 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3891a700 1 -- 172.21.15.125:0/1193739629 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593875671 0 0) 0x7f5c3409c970 con 0x7f5c34131d70 2023-10-03T10:15:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3991c700 1 -- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 msgr2=0x7f5c34131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3991c700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 0x7f5c34131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3991c700 1 -- 172.21.15.125:0/1193739629 >> v1:172.21.15.125:6789/0 conn(0x7f5c34131d70 legacy=0x7f5c34138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3991c700 1 -- 172.21.15.125:0/1193739629 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3409bab0 con 0x7f5c3409e870 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3911b700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 0x7f5c34131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3991c700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 0x7f5c3409ec40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000dc90 tx=0x7f5c3000f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22479ad60ceeea52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3891a700 1 -- 172.21.15.125:0/1193739629 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30012070 con 0x7f5c3409e870 2023-10-03T10:15:55.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3891a700 1 -- 172.21.15.125:0/1193739629 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000d2e0 con 0x7f5c3409e870 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.155+0000 7f5c3891a700 1 -- 172.21.15.125:0/1193739629 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000f8f0 con 0x7f5c3409e870 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 -- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 msgr2=0x7f5c3409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 0x7f5c3409ec40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000dc90 tx=0x7f5c3000f050 comp rx=0 tx=0).stop 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 -- 172.21.15.125:0/1193739629 shutdown_connections 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409e870 0x7f5c3409ec40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/1193739629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c3409f180 0x7f5c34131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 -- 172.21.15.125:0/1193739629 >> 172.21.15.125:0/1193739629 conn(0x7f5c340a4430 msgr2=0x7f5c340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 -- 172.21.15.125:0/1193739629 shutdown_connections 2023-10-03T10:15:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.156+0000 7f5c3bb80700 1 -- 172.21.15.125:0/1193739629 wait complete. 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 Processor -- start 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 -- start start 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 0x7f5c341c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 0x7f5c341c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3411db20 con 0x7f5c3409e870 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3411e870 con 0x7f5c3409f180 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3bb80700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341c4ca0 con 0x7f5c34131d70 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3911b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 0x7f5c341c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3991c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3911b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 0x7f5c341c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51042/0 (socket says 172.21.15.125:51042) 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 0x7f5c341c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3991c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41410/0 (socket says 172.21.15.125:41410) 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3911b700 1 -- 172.21.15.125:0/3581834402 learned_addr learned my addr 172.21.15.125:0/3581834402 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 -- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 msgr2=0x7f5c341c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 0x7f5c341c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 -- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 msgr2=0x7f5c341c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3a11d700 1 -- 172.21.15.125:0/3581834402 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240094a0 con 0x7f5c34131d70 2023-10-03T10:15:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.157+0000 7f5c3991c700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c3a11d700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 0x7f5c341c07f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00cc10 tx=0x7f5c2c00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00aa00 con 0x7f5c34131d70 2023-10-03T10:15:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00ab80 con 0x7f5c34131d70 2023-10-03T10:15:55.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3000d940 con 0x7f5c34131d70 2023-10-03T10:15:55.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0070d0 con 0x7f5c34131d70 2023-10-03T10:15:55.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3411d6d0 con 0x7f5c34131d70 2023-10-03T10:15:55.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.158+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c2c007230 con 0x7f5c34131d70 2023-10-03T10:15:55.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.159+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c2c03f000 con 0x7f5c34131d70 2023-10-03T10:15:55.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.159+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3411c9c0 con 0x7f5c34131d70 2023-10-03T10:15:55.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.164+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c2c018020 con 0x7f5c34131d70 2023-10-03T10:15:55.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.330+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40ec120ad0 con 0x7f40ec09d860 2023-10-03T10:15:55.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.330+0000 7f40e97fa700 1 -- 172.21.15.125:0/2123619706 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40e002b090 con 0x7f40ec09d860 2023-10-03T10:15:55.330 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 msgr2=0x7f40ec11e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f40e000ec10 tx=0x7f40e000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 shutdown_connections 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec130ce0 0x7f40ec11f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09d860 0x7f40ec11e6d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 --2- 172.21.15.125:0/2123619706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09e170 0x7f40ec11ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 >> 172.21.15.125:0/2123619706 conn(0x7f40ec099c40 msgr2=0x7f40ec0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 shutdown_connections 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.333+0000 7f40f304a700 1 -- 172.21.15.125:0/2123619706 wait complete. 2023-10-03T10:15:55.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:55.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.375+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c3404f2a0 con 0x7f5c34131d70 2023-10-03T10:15:55.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.376+0000 7f5c2a7fc700 1 -- 172.21.15.125:0/3581834402 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c2c0074e0 con 0x7f5c34131d70 2023-10-03T10:15:55.376 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:55.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 msgr2=0x7f5c341c07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 0x7f5c341c07f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00cc10 tx=0x7f5c2c00cf20 comp rx=0 tx=0).stop 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 shutdown_connections 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5c34131d70 0x7f5c341c07f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3409e870 0x7f5c341c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 --2- 172.21.15.125:0/3581834402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c3409f180 0x7f5c341c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 >> 172.21.15.125:0/3581834402 conn(0x7f5c340a4430 msgr2=0x7f5c3412ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 shutdown_connections 2023-10-03T10:15:55.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:55.378+0000 7f5c3bb80700 1 -- 172.21.15.125:0/3581834402 wait complete. 2023-10-03T10:15:55.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:55.903 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:55.943 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:56.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.029+0000 7f7b53cee700 1 Processor -- start 2023-10-03T10:15:56.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 -- start start 2023-10-03T10:15:56.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c09dc00 con 0x7f7b4c133f50 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c09ea60 con 0x7f7b4c0a1380 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b53cee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c09dec0 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51289700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b5228b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7b4c133f50 0x7f7b4c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38358/0 (socket says 172.21.15.125:38358) 2023-10-03T10:15:56.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56324/0 (socket says 172.21.15.125:56324) 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51289700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42182/0 (socket says 172.21.15.125:42182) 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b5228b700 1 -- 172.21.15.125:0/3407679026 learned_addr learned my addr 172.21.15.125:0/3407679026 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b50a88700 1 -- 172.21.15.125:0/3407679026 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632813144 0 0) 0x7f7b4c09dc00 con 0x7f7b4c133f50 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 -- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 msgr2=0x7f7b4c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 -- 172.21.15.125:0/3407679026 >> v1:172.21.15.125:6789/0 conn(0x7f7b4c133f50 legacy=0x7f7b4c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51a8a700 1 -- 172.21.15.125:0/3407679026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c09e6a0 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.030+0000 7f7b51289700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b51a8a700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=764a147c19e7216c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b50a88700 1 -- 172.21.15.125:0/3407679026 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011830 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b50a88700 1 -- 172.21.15.125:0/3407679026 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48011990 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b50a88700 1 -- 172.21.15.125:0/3407679026 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011d20 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 -- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 msgr2=0x7f7b4c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b48009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 -- 172.21.15.125:0/3407679026 shutdown_connections 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c0a0a70 0x7f7b4c0a0e40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 --2- 172.21.15.125:0/3407679026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.031+0000 7f7b53cee700 1 -- 172.21.15.125:0/3407679026 >> 172.21.15.125:0/3407679026 conn(0x7f7b4c0a6610 msgr2=0x7f7b4c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.032+0000 7f7b53cee700 1 -- 172.21.15.125:0/3407679026 shutdown_connections 2023-10-03T10:15:56.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.032+0000 7f7b53cee700 1 -- 172.21.15.125:0/3407679026 wait complete. 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 Processor -- start 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 -- start start 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b4c0a0a70 0x7f7b4c122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 0x7f7b4c1232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1260b0 con 0x7f7b4c0a0a70 2023-10-03T10:15:56.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c123cd0 con 0x7f7b4c0a1380 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.033+0000 7f7b53cee700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c133970 con 0x7f7b4c133f50 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b51289700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 0x7f7b4c1232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b51289700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42184/0 (socket says 172.21.15.125:42184) 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b51289700 1 -- 172.21.15.125:0/2386221655 learned_addr learned my addr 172.21.15.125:0/2386221655 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b51a8a700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b4c0a0a70 0x7f7b4c122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 -- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 msgr2=0x7f7b4c122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 -- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b4c0a0a70 msgr2=0x7f7b4c122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b4c0a0a70 0x7f7b4c122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 -- 172.21.15.125:0/2386221655 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0094a0 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b51289700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b5228b700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 0x7f7b4c1232f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cc10 tx=0x7f7b4400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400aa00 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400ab80 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440070d0 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b480094a0 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.034+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c133300 con 0x7f7b4c133f50 2023-10-03T10:15:56.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.035+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b44007230 con 0x7f7b4c133f50 2023-10-03T10:15:56.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.035+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b4403f050 con 0x7f7b4c133f50 2023-10-03T10:15:56.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.035+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c04f2a0 con 0x7f7b4c133f50 2023-10-03T10:15:56.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.040+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b44018020 con 0x7f7b4c133f50 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 Processor -- start 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 -- start start 2023-10-03T10:15:56.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a98133f50 0x7f5a981343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9809e9d0 con 0x7f5a98133f50 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9809dc00 con 0x7f5a980a0a70 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9ccad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9809dec0 con 0x7f5a980a1380 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.071+0000 7f5a95d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a96d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a98133f50 0x7f5a981343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42198/0 (socket says 172.21.15.125:42198) 2023-10-03T10:15:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a9659c700 1 -- 172.21.15.125:0/2636766489 learned_addr learned my addr 172.21.15.125:0/2636766489 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56340/0 (socket says 172.21.15.125:56340) 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 -- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 msgr2=0x7f5a980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 --2- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a980a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 -- 172.21.15.125:0/2636766489 >> v2:172.21.15.125:3300/0 conn(0x7f5a98133f50 msgr2=0x7f5a981343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 --2- 172.21.15.125:0/2636766489 >> v2:172.21.15.125:3300/0 conn(0x7f5a98133f50 0x7f5a981343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 -- 172.21.15.125:0/2636766489 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9809e6a0 con 0x7f5a980a1380 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a95d9b700 1 --2- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009840 tx=0x7f5a8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc70d6e15696e3e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a9559a700 1 -- 172.21.15.125:0/2636766489 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c011830 con 0x7f5a980a1380 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a9559a700 1 -- 172.21.15.125:0/2636766489 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c011990 con 0x7f5a980a1380 2023-10-03T10:15:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.072+0000 7f5a9559a700 1 -- 172.21.15.125:0/2636766489 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c011d20 con 0x7f5a980a1380 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 msgr2=0x7f5a98133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009840 tx=0x7f5a8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2636766489 shutdown_connections 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2636766489 >> v2:172.21.15.125:3300/0 conn(0x7f5a98133f50 0x7f5a981343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2636766489 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a980a1380 0x7f5a98133a10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2636766489 >> 172.21.15.125:0/2636766489 conn(0x7f5a980a6610 msgr2=0x7f5a980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2636766489 shutdown_connections 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.073+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2636766489 wait complete. 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 Processor -- start 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 -- start start 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 0x7f5a98122040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a981250e0 con 0x7f5a980a1380 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980a50e0 con 0x7f5a980a0a70 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9ccad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980a03e0 con 0x7f5a98133f50 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.074+0000 7f5a9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a95d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42204/0 (socket says 172.21.15.125:42204) 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 -- 172.21.15.125:0/2544068655 learned_addr learned my addr 172.21.15.125:0/2544068655 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a95d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39310/0 (socket says 172.21.15.125:39310) 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a96d9d700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 0x7f5a98122040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 -- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 msgr2=0x7f5a98122040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 0x7f5a98122040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 -- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 msgr2=0x7f5a98121b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 -- 172.21.15.125:0/2544068655 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0094a0 con 0x7f5a980a0a70 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a96d9d700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 0x7f5a98122040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a95d9b700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9659c700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e960 tx=0x7f5a8800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88013680 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880137e0 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88013b50 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a98124420 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.075+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98124870 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.076+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a88013cb0 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.076+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a8803f650 con 0x7f5a980a0a70 2023-10-03T10:15:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.076+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9811e040 con 0x7f5a980a0a70 2023-10-03T10:15:56.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.081+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a88021080 con 0x7f5a980a0a70 2023-10-03T10:15:56.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.236+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b4c072980 con 0x7f7b4c133f50 2023-10-03T10:15:56.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.236+0000 7f7b427fc700 1 -- 172.21.15.125:0/2386221655 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b440074e0 con 0x7f7b4c133f50 2023-10-03T10:15:56.237 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 msgr2=0x7f7b4c1232f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 0x7f7b4c1232f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cc10 tx=0x7f7b4400cf20 comp rx=0 tx=0).stop 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 shutdown_connections 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b4c133f50 0x7f7b4c1232f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b4c0a0a70 0x7f7b4c122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 --2- 172.21.15.125:0/2386221655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b4c0a1380 0x7f7b4c122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 >> 172.21.15.125:0/2386221655 conn(0x7f7b4c0a6610 msgr2=0x7f7b4c0a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 shutdown_connections 2023-10-03T10:15:56.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.238+0000 7f7b53cee700 1 -- 172.21.15.125:0/2386221655 wait complete. 2023-10-03T10:15:56.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:56.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.276+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a9809d100 con 0x7f5a980a0a70 2023-10-03T10:15:56.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.276+0000 7f5a86ffd700 1 -- 172.21.15.125:0/2544068655 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a88017020 con 0x7f5a980a0a70 2023-10-03T10:15:56.276 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 msgr2=0x7f5a981215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e960 tx=0x7f5a8800ec70 comp rx=0 tx=0).stop 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 shutdown_connections 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a98133f50 0x7f5a98122040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a980a0a70 0x7f5a981215c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 --2- 172.21.15.125:0/2544068655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a980a1380 0x7f5a98121b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 >> 172.21.15.125:0/2544068655 conn(0x7f5a980a6610 msgr2=0x7f5a98133240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 shutdown_connections 2023-10-03T10:15:56.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.278+0000 7f5a9ccad700 1 -- 172.21.15.125:0/2544068655 wait complete. 2023-10-03T10:15:56.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:56.350 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:56.391 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.475+0000 7f9679fe7700 1 Processor -- start 2023-10-03T10:15:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 -- start start 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409e870 0x7f967409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f967409f180 0x7f9674133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 0x7f9674134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967406ce60 con 0x7f967409f180 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967406bec0 con 0x7f967409e870 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9679fe7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967409fa00 con 0x7f96741341d0 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f967409f180 0x7f9674133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9673fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 0x7f9674134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f96737fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409e870 0x7f967409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f967409f180 0x7f9674133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39322/0 (socket says 172.21.15.125:39322) 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 -- 172.21.15.125:0/3529718 learned_addr learned my addr 172.21.15.125:0/3529718 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 -- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 msgr2=0x7f9674134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 0x7f9674134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 -- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409e870 msgr2=0x7f967409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409e870 0x7f967409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9672ffd700 1 -- 172.21.15.125:0/3529718 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967409ad80 con 0x7f967409f180 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.476+0000 7f9673fff700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 0x7f9674134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9672ffd700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967409f180 0x7f9674133c90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f965c009920 tx=0x7f965c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614c25a2174672e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f96727fc700 1 -- 172.21.15.125:0/3529718 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011830 con 0x7f967409f180 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f96727fc700 1 -- 172.21.15.125:0/3529718 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c011990 con 0x7f967409f180 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f96727fc700 1 -- 172.21.15.125:0/3529718 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011d20 con 0x7f967409f180 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 -- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967409f180 msgr2=0x7f9674133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967409f180 0x7f9674133c90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f965c009920 tx=0x7f965c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 -- 172.21.15.125:0/3529718 shutdown_connections 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409e870 0x7f967409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96741341d0 0x7f9674134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 --2- 172.21.15.125:0/3529718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967409f180 0x7f9674133c90 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 -- 172.21.15.125:0/3529718 >> 172.21.15.125:0/3529718 conn(0x7f96740a4430 msgr2=0x7f96740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 -- 172.21.15.125:0/3529718 shutdown_connections 2023-10-03T10:15:56.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.477+0000 7f9679fe7700 1 -- 172.21.15.125:0/3529718 wait complete. 2023-10-03T10:15:56.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.478+0000 7f9679fe7700 1 Processor -- start 2023-10-03T10:15:56.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 -- start start 2023-10-03T10:15:56.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 0x7f9674122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 0x7f96741230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674125df0 con 0x7f96741341d0 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740a1720 con 0x7f967409f180 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9679fe7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9674133a90 con 0x7f967409e870 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f96737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 0x7f9674122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42232/0 (socket says 172.21.15.125:42232) 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 -- 172.21.15.125:0/2422733281 learned_addr learned my addr 172.21.15.125:0/2422733281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9673fff700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 0x7f96741230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 -- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 msgr2=0x7f9674122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 0x7f9674122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 -- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 msgr2=0x7f96741230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 0x7f96741230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 -- 172.21.15.125:0/2422733281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0094a0 con 0x7f967409f180 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9673fff700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 0x7f96741230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f96737fe700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 0x7f9674122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.479+0000 7f9672ffd700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f965c009c70 tx=0x7f965c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c004240 con 0x7f967409f180 2023-10-03T10:15:56.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c01f070 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c009550 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0045e0 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9674123a60 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.480+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f965c021030 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.481+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f965c040600 con 0x7f967409f180 2023-10-03T10:15:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.481+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674125c50 con 0x7f967409f180 2023-10-03T10:15:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.485+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9674125c50 con 0x7f967409f180 2023-10-03T10:15:56.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 Processor -- start 2023-10-03T10:15:56.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 -- start start 2023-10-03T10:15:56.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 0x7f3798138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f379813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379809e9d0 con 0x7f37980a0a70 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379809dc00 con 0x7f37980a1550 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f379da95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379809dec0 con 0x7f3798139200 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3796ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 0x7f3798138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3797fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f379813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3796ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 0x7f3798138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39336/0 (socket says 172.21.15.125:39336) 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3796ffd700 1 -- 172.21.15.125:0/170193104 learned_addr learned my addr 172.21.15.125:0/170193104 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f37977fe700 1 --1- 172.21.15.125:0/170193104 >> v1:172.21.15.125:6789/0 conn(0x7f37980a0a70 0x7f37980a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38368/0 (socket says 172.21.15.125:38368) 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3797fff700 1 -- 172.21.15.125:0/170193104 >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 msgr2=0x7f3798138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.520+0000 7f3797fff700 1 --2- 172.21.15.125:0/170193104 >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 0x7f3798138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f3797fff700 1 -- 172.21.15.125:0/170193104 >> v1:172.21.15.125:6789/0 conn(0x7f37980a0a70 legacy=0x7f37980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f37967fc700 1 -- 172.21.15.125:0/170193104 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378316067 0 0) 0x7f379809e9d0 con 0x7f37980a0a70 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f3797fff700 1 -- 172.21.15.125:0/170193104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379809e6a0 con 0x7f3798139200 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f3797fff700 1 --2- 172.21.15.125:0/170193104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f379813b5e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3790009d90 tx=0x7f379000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ede61753855119 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f37967fc700 1 -- 172.21.15.125:0/170193104 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000e070 con 0x7f3798139200 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f37967fc700 1 -- 172.21.15.125:0/170193104 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000bb20 con 0x7f3798139200 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f37967fc700 1 -- 172.21.15.125:0/170193104 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790012430 con 0x7f3798139200 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 -- 172.21.15.125:0/170193104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 msgr2=0x7f379813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 --2- 172.21.15.125:0/170193104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f379813b5e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3790009d90 tx=0x7f379000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 -- 172.21.15.125:0/170193104 shutdown_connections 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 --2- 172.21.15.125:0/170193104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f379813b5e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 --2- 172.21.15.125:0/170193104 >> v2:172.21.15.125:3300/0 conn(0x7f37980a1550 0x7f3798138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 -- 172.21.15.125:0/170193104 >> 172.21.15.125:0/170193104 conn(0x7f37980a6610 msgr2=0x7f37980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 -- 172.21.15.125:0/170193104 shutdown_connections 2023-10-03T10:15:56.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.521+0000 7f379da95700 1 -- 172.21.15.125:0/170193104 wait complete. 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 Processor -- start 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 -- start start 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f37980a0a70 0x7f3798121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f37981221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3798124a50 con 0x7f37980a1550 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3798124f70 con 0x7f37980a0a70 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.523+0000 7f379da95700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379809cb10 con 0x7f3798139200 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3797fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f37981221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f37977fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f37980a0a70 0x7f3798121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39348/0 (socket says 172.21.15.125:39348) 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 -- 172.21.15.125:0/1395136094 learned_addr learned my addr 172.21.15.125:0/1395136094 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 -- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 msgr2=0x7f37981221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f37981221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 -- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f37980a0a70 msgr2=0x7f3798121730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f37980a0a70 0x7f3798121730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 -- 172.21.15.125:0/1395136094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790009a70 con 0x7f37980a1550 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3797fff700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f37981221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f3796ffd700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f378c00e910 tx=0x7f378c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0096a0 con 0x7f37980a1550 2023-10-03T10:15:56.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c013680 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37980a03e0 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c013a30 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.524+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37981259e0 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.525+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f378c013b90 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.525+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f378c03f9c0 con 0x7f37980a1550 2023-10-03T10:15:56.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.525+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379804f2a0 con 0x7f37980a1550 2023-10-03T10:15:56.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.530+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f378c017070 con 0x7f37980a1550 2023-10-03T10:15:56.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.679+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9674125c50 con 0x7f967409f180 2023-10-03T10:15:56.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.679+0000 7f966bfff700 1 -- 172.21.15.125:0/2422733281 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9674125c50 con 0x7f967409f180 2023-10-03T10:15:56.680 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 msgr2=0x7f9674122b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f965c009c70 tx=0x7f965c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 shutdown_connections 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96741341d0 0x7f96741230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f967409e870 0x7f9674122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 --2- 172.21.15.125:0/2422733281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f967409f180 0x7f9674122b80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 >> 172.21.15.125:0/2422733281 conn(0x7f96740a4430 msgr2=0x7f967409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 shutdown_connections 2023-10-03T10:15:56.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.681+0000 7f9679fe7700 1 -- 172.21.15.125:0/2422733281 wait complete. 2023-10-03T10:15:56.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:56.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.730+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3798072980 con 0x7f37980a1550 2023-10-03T10:15:56.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.730+0000 7f377ffff700 1 -- 172.21.15.125:0/1395136094 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f378c02a090 con 0x7f37980a1550 2023-10-03T10:15:56.731 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 msgr2=0x7f3798121c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f378c00e910 tx=0x7f378c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 shutdown_connections 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3798139200 0x7f37981221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f37980a0a70 0x7f3798121730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 --2- 172.21.15.125:0/1395136094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37980a1550 0x7f3798121c70 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.732+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 >> 172.21.15.125:0/1395136094 conn(0x7f37980a6610 msgr2=0x7f37980a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.733+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 shutdown_connections 2023-10-03T10:15:56.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:56.733+0000 7f379da95700 1 -- 172.21.15.125:0/1395136094 wait complete. 2023-10-03T10:15:56.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:57.252 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:57.291 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:57.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 Processor -- start 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 -- start start 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c009dc00 con 0x7fa4c0133f50 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c009ea60 con 0x7fa4c00a0a70 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.382+0000 7fa4c6019700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c009dec0 con 0x7fa4c00a1380 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4bf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56376/0 (socket says 172.21.15.125:56376) 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4bffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa4c0133f50 0x7fa4c013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38370/0 (socket says 172.21.15.125:38370) 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4bf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39360/0 (socket says 172.21.15.125:39360) 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 -- 172.21.15.125:0/2060793702 learned_addr learned my addr 172.21.15.125:0/2060793702 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 -- 172.21.15.125:0/2060793702 >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 msgr2=0x7fa4c00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 --2- 172.21.15.125:0/2060793702 >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 -- 172.21.15.125:0/2060793702 >> v1:172.21.15.125:6789/0 conn(0x7fa4c0133f50 legacy=0x7fa4c013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 -- 172.21.15.125:0/2060793702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c009e6a0 con 0x7fa4c00a1380 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4be7fc700 1 -- 172.21.15.125:0/2060793702 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496167509 0 0) 0x7fa4c009dc00 con 0x7fa4c0133f50 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4bf7fe700 1 --2- 172.21.15.125:0/2060793702 >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4beffd700 1 --2- 172.21.15.125:0/2060793702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40098f0 tx=0x7fa4b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8719d459c523847e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4be7fc700 1 -- 172.21.15.125:0/2060793702 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011830 con 0x7fa4c00a1380 2023-10-03T10:15:57.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4be7fc700 1 -- 172.21.15.125:0/2060793702 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4011990 con 0x7fa4c00a1380 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.383+0000 7fa4be7fc700 1 -- 172.21.15.125:0/2060793702 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011d20 con 0x7fa4c00a1380 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 -- 172.21.15.125:0/2060793702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 msgr2=0x7fa4c0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 --2- 172.21.15.125:0/2060793702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40098f0 tx=0x7fa4b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 -- 172.21.15.125:0/2060793702 shutdown_connections 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 --2- 172.21.15.125:0/2060793702 >> v2:172.21.15.125:3300/0 conn(0x7fa4c00a0a70 0x7fa4c00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 --2- 172.21.15.125:0/2060793702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a1380 0x7fa4c0133a10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 -- 172.21.15.125:0/2060793702 >> 172.21.15.125:0/2060793702 conn(0x7fa4c00a6610 msgr2=0x7fa4c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 -- 172.21.15.125:0/2060793702 shutdown_connections 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.384+0000 7fa4c6019700 1 -- 172.21.15.125:0/2060793702 wait complete. 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 Processor -- start 2023-10-03T10:15:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 -- start start 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 0x7fa4c01c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 0x7fa4c01c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0122320 con 0x7fa4c0133f50 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0120660 con 0x7fa4c00a1380 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4c6019700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00a17b0 con 0x7fa4c00a0a70 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.385+0000 7fa4bf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56388/0 (socket says 172.21.15.125:56388) 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 0x7fa4c01c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bf7fe700 1 -- 172.21.15.125:0/3529546911 learned_addr learned my addr 172.21.15.125:0/3529546911 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4beffd700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 0x7fa4c01c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 -- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 msgr2=0x7fa4c01c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 -- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 msgr2=0x7fa4c01c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 0x7fa4c01c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 -- 172.21.15.125:0/3529546911 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80094a0 con 0x7fa4c0133f50 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bf7fe700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4beffd700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 0x7fa4c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4bffff700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 0x7fa4c01c8ee0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000cbe0 tx=0x7fa4b000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000aa40 con 0x7fa4c0133f50 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000abc0 con 0x7fa4c0133f50 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00070d0 con 0x7fa4c0133f50 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b4009550 con 0x7fa4c0133f50 2023-10-03T10:15:57.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.386+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0120e50 con 0x7fa4c0133f50 2023-10-03T10:15:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.387+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4b0007230 con 0x7fa4c0133f50 2023-10-03T10:15:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.387+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4b003f040 con 0x7fa4c0133f50 2023-10-03T10:15:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.387+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c004f2a0 con 0x7fa4c0133f50 2023-10-03T10:15:57.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.396+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4b0018020 con 0x7fa4c0133f50 2023-10-03T10:15:57.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.424+0000 7fef8519b700 1 Processor -- start 2023-10-03T10:15:57.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.424+0000 7fef8519b700 1 -- start start 2023-10-03T10:15:57.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef8519b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 0x7fef80133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef8519b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef801343a0 0x7fef800a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef8519b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8009b110 con 0x7fef80133f70 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef8519b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800a3b60 con 0x7fef801343a0 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef8519b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef800a2fa0 con 0x7fef8009ad40 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef801343a0 0x7fef800a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 0x7fef80133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fef80133f70 0x7fef800a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38376/0 (socket says 172.21.15.125:38376) 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7e59c700 1 -- 172.21.15.125:0/1289799862 learned_addr learned my addr 172.21.15.125:0/1289799862 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 -- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 msgr2=0x7fef80133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 0x7fef80133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 -- 172.21.15.125:0/1289799862 >> v1:172.21.15.125:6789/0 conn(0x7fef80133f70 legacy=0x7fef800a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 -- 172.21.15.125:0/1289799862 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8009a280 con 0x7fef801343a0 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7dd9b700 1 -- 172.21.15.125:0/1289799862 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730665385 0 0) 0x7fef8009b110 con 0x7fef80133f70 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7ed9d700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 0x7fef80133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7f59e700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef801343a0 0x7fef800a1180 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829616b28d023897 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7dd9b700 1 -- 172.21.15.125:0/1289799862 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7800e070 con 0x7fef801343a0 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7dd9b700 1 -- 172.21.15.125:0/1289799862 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7800bb20 con 0x7fef801343a0 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.425+0000 7fef7dd9b700 1 -- 172.21.15.125:0/1289799862 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78012430 con 0x7fef801343a0 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 -- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef801343a0 msgr2=0x7fef800a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef801343a0 0x7fef800a1180 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef7800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 -- 172.21.15.125:0/1289799862 shutdown_connections 2023-10-03T10:15:57.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef801343a0 0x7fef800a1180 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 --2- 172.21.15.125:0/1289799862 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef8009ad40 0x7fef80133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 -- 172.21.15.125:0/1289799862 >> 172.21.15.125:0/1289799862 conn(0x7fef80099c40 msgr2=0x7fef8006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 -- 172.21.15.125:0/1289799862 shutdown_connections 2023-10-03T10:15:57.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.426+0000 7fef8519b700 1 -- 172.21.15.125:0/1289799862 wait complete. 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.427+0000 7fef8519b700 1 Processor -- start 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.427+0000 7fef8519b700 1 -- start start 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 0x7fef8011ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef801343a0 0x7fef8011f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80120810 con 0x7fef8009ad40 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef80120620 con 0x7fef801343a0 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef80122530 con 0x7fef80133f70 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 0x7fef8011ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39390/0 (socket says 172.21.15.125:39390) 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 -- 172.21.15.125:0/2060595517 learned_addr learned my addr 172.21.15.125:0/2060595517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 0x7fef8011ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56408/0 (socket says 172.21.15.125:56408) 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7f59e700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef801343a0 0x7fef8011f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 -- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 msgr2=0x7fef8011ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 0x7fef8011ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 -- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef801343a0 msgr2=0x7fef8011f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef801343a0 0x7fef8011f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 -- 172.21.15.125:0/2060595517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094a0 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef7ed9d700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ec10 tx=0x7fef7000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70009760 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000c850 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef78009a70 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000cbe0 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.428+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef80122250 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.429+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef7000cd40 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.429+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef7003f6f0 con 0x7fef8009ad40 2023-10-03T10:15:57.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.429+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8004f2a0 con 0x7fef8009ad40 2023-10-03T10:15:57.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.434+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef7001bba0 con 0x7fef8009ad40 2023-10-03T10:15:57.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.589+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4c00a5660 con 0x7fa4c0133f50 2023-10-03T10:15:57.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.590+0000 7fa4a7fff700 1 -- 172.21.15.125:0/3529546911 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4b00074e0 con 0x7fa4c0133f50 2023-10-03T10:15:57.590 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:57.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 msgr2=0x7fa4c01c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 0x7fa4c01c8ee0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000cbe0 tx=0x7fa4b000cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 shutdown_connections 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c0133f50 0x7fa4c01c8ee0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4c00a0a70 0x7fa4c01c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 --2- 172.21.15.125:0/3529546911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4c00a1380 0x7fa4c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.591+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 >> 172.21.15.125:0/3529546911 conn(0x7fa4c00a6610 msgr2=0x7fa4c00a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.592+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 shutdown_connections 2023-10-03T10:15:57.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.592+0000 7fa4c6019700 1 -- 172.21.15.125:0/3529546911 wait complete. 2023-10-03T10:15:57.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:57.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.623+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef80120e10 con 0x7fef8009ad40 2023-10-03T10:15:57.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.623+0000 7fef677fe700 1 -- 172.21.15.125:0/2060595517 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef70021030 con 0x7fef8009ad40 2023-10-03T10:15:57.624 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 msgr2=0x7fef8011ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ec10 tx=0x7fef7000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 shutdown_connections 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef801343a0 0x7fef8011f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8009ad40 0x7fef8011ea10 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 --2- 172.21.15.125:0/2060595517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef80133f70 0x7fef8011ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 >> 172.21.15.125:0/2060595517 conn(0x7fef80099c40 msgr2=0x7fef801bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 shutdown_connections 2023-10-03T10:15:57.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.625+0000 7fef8519b700 1 -- 172.21.15.125:0/2060595517 wait complete. 2023-10-03T10:15:57.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:57.698 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:57.746 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:57.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.823+0000 7fd6c5993700 1 Processor -- start 2023-10-03T10:15:57.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.823+0000 7fd6c5993700 1 -- start start 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6c5993700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6c5993700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6c5993700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c009dc00 con 0x7fd6c00a1380 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6c5993700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c009ea90 con 0x7fd6c00a0a70 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6c5993700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c009dec0 con 0x7fd6c0134120 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6be7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd6c00a1380 0x7fd6c0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38390/0 (socket says 172.21.15.125:38390) 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6be7fc700 1 -- 172.21.15.125:0/159955767 learned_addr learned my addr 172.21.15.125:0/159955767 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6bf7fe700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 -- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 msgr2=0x7fd6c013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 -- 172.21.15.125:0/159955767 >> v1:172.21.15.125:6789/0 conn(0x7fd6c00a1380 legacy=0x7fd6c0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6bdffb700 1 -- 172.21.15.125:0/159955767 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370607535 0 0) 0x7fd6c009dc00 con 0x7fd6c00a1380 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 -- 172.21.15.125:0/159955767 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c009e6a0 con 0x7fd6c00a0a70 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6beffd700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c00a0e40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009870 tx=0x7fd6b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91679381886e48a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6bdffb700 1 -- 172.21.15.125:0/159955767 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0011830 con 0x7fd6c00a0a70 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6bdffb700 1 -- 172.21.15.125:0/159955767 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0011990 con 0x7fd6c00a0a70 2023-10-03T10:15:57.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.824+0000 7fd6bdffb700 1 -- 172.21.15.125:0/159955767 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0011d20 con 0x7fd6c00a0a70 2023-10-03T10:15:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 -- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 msgr2=0x7fd6c00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c00a0e40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009870 tx=0x7fd6b0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 -- 172.21.15.125:0/159955767 shutdown_connections 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 --2- 172.21.15.125:0/159955767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c00a0e40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 -- 172.21.15.125:0/159955767 >> 172.21.15.125:0/159955767 conn(0x7fd6c00a6610 msgr2=0x7fd6c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 -- 172.21.15.125:0/159955767 shutdown_connections 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.825+0000 7fd6c5993700 1 -- 172.21.15.125:0/159955767 wait complete. 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.827+0000 7fd6c5993700 1 Processor -- start 2023-10-03T10:15:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.827+0000 7fd6c5993700 1 -- start start 2023-10-03T10:15:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.827+0000 7fd6c5993700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c00a1380 0x7fd6c0122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0133300 con 0x7fd6c00a1380 2023-10-03T10:15:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0125920 con 0x7fd6c00a0a70 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0124310 con 0x7fd6c0134120 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6beffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56416/0 (socket says 172.21.15.125:56416) 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6beffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42276/0 (socket says 172.21.15.125:42276) 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 -- 172.21.15.125:0/2754178177 learned_addr learned my addr 172.21.15.125:0/2754178177 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6be7fc700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c00a1380 0x7fd6c0122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 -- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 msgr2=0x7fd6c0122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 -- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c00a1380 msgr2=0x7fd6c0122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c00a1380 0x7fd6c0122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 -- 172.21.15.125:0/2754178177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b00094a0 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6beffd700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6bf7fe700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800efc0 tx=0x7fd6b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8009ea0 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800f040 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c0126220 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800ced0 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.828+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0125f40 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.829+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6b8014480 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.829+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6b803fe30 con 0x7fd6c0134120 2023-10-03T10:15:57.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.829+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c004f2a0 con 0x7fd6c0134120 2023-10-03T10:15:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.834+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6b8018020 con 0x7fd6c0134120 2023-10-03T10:15:57.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 Processor -- start 2023-10-03T10:15:57.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 -- start start 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 0x7f136c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 0x7f136c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c09b110 con 0x7f136c0a0a70 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0a3b60 con 0x7f136c133f70 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.871+0000 7f1373240700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1348e0 con 0x7f136c09ad40 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 0x7f136c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f1370fdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 0x7f136c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f13717dd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f136c0a0a70 0x7f136c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38392/0 (socket says 172.21.15.125:38392) 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f13717dd700 1 -- 172.21.15.125:0/883203206 learned_addr learned my addr 172.21.15.125:0/883203206 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:15:57.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 -- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 msgr2=0x7f136c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 0x7f136c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 -- 172.21.15.125:0/883203206 >> v1:172.21.15.125:6789/0 conn(0x7f136c0a0a70 legacy=0x7f136c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 -- 172.21.15.125:0/883203206 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0a2fa0 con 0x7f136c133f70 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136b7fe700 1 -- 172.21.15.125:0/883203206 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678644666 0 0) 0x7f136c09b110 con 0x7f136c0a0a70 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f1370fdc700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 0x7f136c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136bfff700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 0x7f136c1343a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1358009870 tx=0x7f1358009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6da09dd6e1701df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136b7fe700 1 -- 172.21.15.125:0/883203206 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011830 con 0x7f136c133f70 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136b7fe700 1 -- 172.21.15.125:0/883203206 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358011990 con 0x7f136c133f70 2023-10-03T10:15:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.872+0000 7f136b7fe700 1 -- 172.21.15.125:0/883203206 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011d20 con 0x7f136c133f70 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 -- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 msgr2=0x7f136c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 0x7f136c1343a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1358009870 tx=0x7f1358009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 -- 172.21.15.125:0/883203206 shutdown_connections 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c09ad40 0x7f136c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 --2- 172.21.15.125:0/883203206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c133f70 0x7f136c1343a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 -- 172.21.15.125:0/883203206 >> 172.21.15.125:0/883203206 conn(0x7f136c099c40 msgr2=0x7f136c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 -- 172.21.15.125:0/883203206 shutdown_connections 2023-10-03T10:15:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.873+0000 7f1373240700 1 -- 172.21.15.125:0/883203206 wait complete. 2023-10-03T10:15:57.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.874+0000 7f1373240700 1 Processor -- start 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.874+0000 7f1373240700 1 -- start start 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0a0a70 0x7f136c121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c133f70 0x7f136c121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c123e80 con 0x7f136c0a0a70 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c122f80 con 0x7f136c09ad40 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1373240700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c09c7e0 con 0x7f136c133f70 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42302/0 (socket says 172.21.15.125:42302) 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 -- 172.21.15.125:0/2647564751 learned_addr learned my addr 172.21.15.125:0/2647564751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f13717dd700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c133f70 0x7f136c121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f136bfff700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0a0a70 0x7f136c121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 -- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c133f70 msgr2=0x7f136c121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c133f70 0x7f136c121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 -- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0a0a70 msgr2=0x7f136c121980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0a0a70 0x7f136c121980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.875+0000 7f1370fdc700 1 -- 172.21.15.125:0/2647564751 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094a0 con 0x7f136c09ad40 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f1370fdc700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f136000ebe0 tx=0x7f136000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360009760 con 0x7f136c09ad40 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000c850 con 0x7f136c09ad40 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000cbe0 con 0x7f136c09ad40 2023-10-03T10:15:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13580094a0 con 0x7f136c09ad40 2023-10-03T10:15:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.876+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c124c10 con 0x7f136c09ad40 2023-10-03T10:15:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.877+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f136000cd40 con 0x7f136c09ad40 2023-10-03T10:15:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.877+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f136003f710 con 0x7f136c09ad40 2023-10-03T10:15:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.877+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c11e060 con 0x7f136c09ad40 2023-10-03T10:15:57.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:57.881+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13600232f0 con 0x7f136c09ad40 2023-10-03T10:15:58.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.028+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6c0072980 con 0x7fd6c0134120 2023-10-03T10:15:58.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.029+0000 7fd6a7fff700 1 -- 172.21.15.125:0/2754178177 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6b801a8b0 con 0x7fd6c0134120 2023-10-03T10:15:58.030 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 msgr2=0x7fd6c0123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800efc0 tx=0x7fd6b800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 shutdown_connections 2023-10-03T10:15:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd6c0134120 0x7fd6c0123180 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6c00a0a70 0x7fd6c0122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 --2- 172.21.15.125:0/2754178177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c00a1380 0x7fd6c0122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 >> 172.21.15.125:0/2754178177 conn(0x7fd6c00a6610 msgr2=0x7fd6c00a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 shutdown_connections 2023-10-03T10:15:58.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.032+0000 7fd6c5993700 1 -- 172.21.15.125:0/2754178177 wait complete. 2023-10-03T10:15:58.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:58.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.083+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f136c124240 con 0x7f136c09ad40 2023-10-03T10:15:58.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.083+0000 7f13697fa700 1 -- 172.21.15.125:0/2647564751 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1360021030 con 0x7f136c09ad40 2023-10-03T10:15:58.084 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:58.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 msgr2=0x7f136c121440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f136000ebe0 tx=0x7f136000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 shutdown_connections 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f136c133f70 0x7f136c121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136c09ad40 0x7f136c121440 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 --2- 172.21.15.125:0/2647564751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0a0a70 0x7f136c121980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 >> 172.21.15.125:0/2647564751 conn(0x7f136c099c40 msgr2=0x7f136c133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 shutdown_connections 2023-10-03T10:15:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.085+0000 7f1373240700 1 -- 172.21.15.125:0/2647564751 wait complete. 2023-10-03T10:15:58.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:58.605 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:58.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:58.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.732+0000 7ff36e8ef700 1 Processor -- start 2023-10-03T10:15:58.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 -- start start 2023-10-03T10:15:58.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff368134330 0x7ff36813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36809fa00 con 0x7ff36809f180 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680a0370 con 0x7ff368134330 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36e8ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36806bec0 con 0x7ff36809e870 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff367fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff367fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56428/0 (socket says 172.21.15.125:56428) 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff367fff700 1 -- 172.21.15.125:0/3998550367 learned_addr learned my addr 172.21.15.125:0/3998550367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36ce8c700 1 --2- 172.21.15.125:0/3998550367 >> v2:172.21.15.125:3300/0 conn(0x7ff368134330 0x7ff36813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36ce8c700 1 -- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 msgr2=0x7ff36809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36ce8c700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.733+0000 7ff36ce8c700 1 -- 172.21.15.125:0/3998550367 >> v1:172.21.15.125:6789/0 conn(0x7ff36809f180 legacy=0x7ff368133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36ce8c700 1 -- 172.21.15.125:0/3998550367 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36809ada0 con 0x7ff368134330 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff366ffd700 1 -- 172.21.15.125:0/3998550367 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938040173 0 0) 0x7ff36809fa00 con 0x7ff36809f180 2023-10-03T10:15:58.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff367fff700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36ce8c700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff368134330 0x7ff36813be80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a869056e6c25d761 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff366ffd700 1 -- 172.21.15.125:0/3998550367 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000e070 con 0x7ff368134330 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff366ffd700 1 -- 172.21.15.125:0/3998550367 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000bb20 con 0x7ff368134330 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff366ffd700 1 -- 172.21.15.125:0/3998550367 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360012430 con 0x7ff368134330 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 -- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff368134330 msgr2=0x7ff36813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff368134330 0x7ff36813be80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 -- 172.21.15.125:0/3998550367 shutdown_connections 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff368134330 0x7ff36813be80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/3998550367 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff36809e870 0x7ff36809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.734+0000 7ff36e8ef700 1 -- 172.21.15.125:0/3998550367 >> 172.21.15.125:0/3998550367 conn(0x7ff3680a4430 msgr2=0x7ff3680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.735+0000 7ff36e8ef700 1 -- 172.21.15.125:0/3998550367 shutdown_connections 2023-10-03T10:15:58.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.735+0000 7ff36e8ef700 1 -- 172.21.15.125:0/3998550367 wait complete. 2023-10-03T10:15:58.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.735+0000 7ff36e8ef700 1 Processor -- start 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 -- start start 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 0x7ff368122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 0x7ff368123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3681245d0 con 0x7ff36809f180 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3681264e0 con 0x7ff36809e870 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36e8ef700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff368133b50 con 0x7ff368134330 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff367fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff36ce8c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 0x7ff368123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 0x7ff368122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff367fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42312/0 (socket says 172.21.15.125:42312) 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff367fff700 1 -- 172.21.15.125:0/698492204 learned_addr learned my addr 172.21.15.125:0/698492204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.736+0000 7ff3677fe700 1 -- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 msgr2=0x7ff368123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff3677fe700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 0x7ff368123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff3677fe700 1 -- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 msgr2=0x7ff368122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff3677fe700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff3677fe700 1 -- 172.21.15.125:0/698492204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009550 con 0x7ff36809f180 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff36ce8c700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 0x7ff368123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff367fff700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff3677fe700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 0x7ff368122f40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff368067390 tx=0x7ff35c00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0054e0 con 0x7ff36809f180 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00ce10 con 0x7ff36809f180 2023-10-03T10:15:58.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360009a70 con 0x7ff36809f180 2023-10-03T10:15:58.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0038c0 con 0x7ff36809f180 2023-10-03T10:15:58.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.737+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff368125f40 con 0x7ff36809f180 2023-10-03T10:15:58.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.738+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff368126130 con 0x7ff36809f180 2023-10-03T10:15:58.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.738+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff35c003a20 con 0x7ff36809f180 2023-10-03T10:15:58.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.739+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff35c03ee40 con 0x7ff36809f180 2023-10-03T10:15:58.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.743+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff35c003cd0 con 0x7ff36809f180 2023-10-03T10:15:58.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 Processor -- start 2023-10-03T10:15:58.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 -- start start 2023-10-03T10:15:58.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6641343a0 0x7ff66413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66406bec0 con 0x7ff66409f180 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66406ce60 con 0x7ff6641343a0 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff669063700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66409fa00 con 0x7ff66409e870 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.774+0000 7ff662d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42320/0 (socket says 172.21.15.125:42320) 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 -- 172.21.15.125:0/1516402393 learned_addr learned my addr 172.21.15.125:0/1516402393 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff66359e700 1 --2- 172.21.15.125:0/1516402393 >> v2:172.21.15.125:3300/0 conn(0x7ff6641343a0 0x7ff66413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff661d9b700 1 -- 172.21.15.125:0/1516402393 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897420990 0 0) 0x7ff66406bec0 con 0x7ff66409f180 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 -- 172.21.15.125:0/1516402393 >> v2:172.21.15.125:3300/0 conn(0x7ff6641343a0 msgr2=0x7ff66413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 --2- 172.21.15.125:0/1516402393 >> v2:172.21.15.125:3300/0 conn(0x7ff6641343a0 0x7ff66413bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 -- 172.21.15.125:0/1516402393 >> v1:172.21.15.125:6789/0 conn(0x7ff66409f180 legacy=0x7ff664133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 -- 172.21.15.125:0/1516402393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66409ad80 con 0x7ff66409e870 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff662d9d700 1 --2- 172.21.15.125:0/1516402393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7744a162986f5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff661d9b700 1 -- 172.21.15.125:0/1516402393 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011830 con 0x7ff66409e870 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff661d9b700 1 -- 172.21.15.125:0/1516402393 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654011990 con 0x7ff66409e870 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.775+0000 7ff661d9b700 1 -- 172.21.15.125:0/1516402393 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011d20 con 0x7ff66409e870 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 -- 172.21.15.125:0/1516402393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 msgr2=0x7ff66409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 --2- 172.21.15.125:0/1516402393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 -- 172.21.15.125:0/1516402393 shutdown_connections 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 --2- 172.21.15.125:0/1516402393 >> v2:172.21.15.125:3300/0 conn(0x7ff6641343a0 0x7ff66413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 --2- 172.21.15.125:0/1516402393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff66409ec40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 -- 172.21.15.125:0/1516402393 >> 172.21.15.125:0/1516402393 conn(0x7ff6640a4430 msgr2=0x7ff6640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 -- 172.21.15.125:0/1516402393 shutdown_connections 2023-10-03T10:15:58.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.776+0000 7ff669063700 1 -- 172.21.15.125:0/1516402393 wait complete. 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.777+0000 7ff669063700 1 Processor -- start 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.777+0000 7ff669063700 1 -- start start 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff664122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 0x7ff6641233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641334a0 con 0x7ff66409f180 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff664125aa0 con 0x7ff66409e870 2023-10-03T10:15:58.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff669063700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641244b0 con 0x7ff6641343a0 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 0x7ff6641233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39452/0 (socket says 172.21.15.125:39452) 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 -- 172.21.15.125:0/347054604 learned_addr learned my addr 172.21.15.125:0/347054604 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff662d9d700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff664122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 -- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 msgr2=0x7ff6641233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 0x7ff6641233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 -- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 msgr2=0x7ff664122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff664122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66259c700 1 -- 172.21.15.125:0/347054604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009550 con 0x7ff66409f180 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.778+0000 7ff66359e700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 0x7ff6641233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff66259c700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c550 tx=0x7ff65800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580054e0 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658003680 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66406cfa0 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658003a30 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.779+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff664126420 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.780+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff658003b90 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.780+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff65803ebb0 con 0x7ff66409f180 2023-10-03T10:15:58.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.780+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66404f2a0 con 0x7ff66409f180 2023-10-03T10:15:58.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.784+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff658017030 con 0x7ff66409f180 2023-10-03T10:15:58.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.931+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff36806c9d0 con 0x7ff36809f180 2023-10-03T10:15:58.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.931+0000 7ff364ff9700 1 -- 172.21.15.125:0/698492204 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff35c017070 con 0x7ff36809f180 2023-10-03T10:15:58.932 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:15:58.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 msgr2=0x7ff368122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 0x7ff368122f40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff368067390 tx=0x7ff35c00c710 comp rx=0 tx=0).stop 2023-10-03T10:15:58.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 shutdown_connections 2023-10-03T10:15:58.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff368134330 0x7ff368123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff36809e870 0x7ff368122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 --2- 172.21.15.125:0/698492204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff36809f180 0x7ff368122f40 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 >> 172.21.15.125:0/698492204 conn(0x7ff3680a4430 msgr2=0x7ff3680a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 shutdown_connections 2023-10-03T10:15:58.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.933+0000 7ff36e8ef700 1 -- 172.21.15.125:0/698492204 wait complete. 2023-10-03T10:15:58.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:15:58.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.974+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff664072d60 con 0x7ff66409f180 2023-10-03T10:15:58.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.974+0000 7ff64b7fe700 1 -- 172.21.15.125:0/347054604 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff658003e40 con 0x7ff66409f180 2023-10-03T10:15:58.975 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 msgr2=0x7ff664122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c550 tx=0x7ff65800c860 comp rx=0 tx=0).stop 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 shutdown_connections 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6641343a0 0x7ff6641233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff66409e870 0x7ff664122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 --2- 172.21.15.125:0/347054604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff66409f180 0x7ff664122e70 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 >> 172.21.15.125:0/347054604 conn(0x7ff6640a4430 msgr2=0x7ff66409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 shutdown_connections 2023-10-03T10:15:58.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:58.976+0000 7ff669063700 1 -- 172.21.15.125:0/347054604 wait complete. 2023-10-03T10:15:58.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:59.049 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:59.098 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 Processor -- start 2023-10-03T10:15:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 -- start start 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082809dc00 con 0x7f0828133f50 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082809ea60 con 0x7f08280a0a70 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082f273700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082809dec0 con 0x7f08280a1380 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082d00f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082c80e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082d00f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42328/0 (socket says 172.21.15.125:42328) 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082c80e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56446/0 (socket says 172.21.15.125:56446) 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082d00f700 1 -- 172.21.15.125:0/582705961 learned_addr learned my addr 172.21.15.125:0/582705961 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.176+0000 7f082d810700 1 --1- 172.21.15.125:0/582705961 >> v1:172.21.15.125:6789/0 conn(0x7f0828133f50 0x7f082813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38418/0 (socket says 172.21.15.125:38418) 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082c80e700 1 -- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 msgr2=0x7f08280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082c80e700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082c80e700 1 -- 172.21.15.125:0/582705961 >> v1:172.21.15.125:6789/0 conn(0x7f0828133f50 legacy=0x7f082813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082c80e700 1 -- 172.21.15.125:0/582705961 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082809e6a0 con 0x7f08280a1380 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f081ffff700 1 -- 172.21.15.125:0/582705961 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133451276 0 0) 0x7f082809dc00 con 0x7f0828133f50 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082d00f700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f082c80e700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0818009870 tx=0x7f0818009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f718979102aed282 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f081ffff700 1 -- 172.21.15.125:0/582705961 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818011830 con 0x7f08280a1380 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f081ffff700 1 -- 172.21.15.125:0/582705961 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818011990 con 0x7f08280a1380 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.177+0000 7f081ffff700 1 -- 172.21.15.125:0/582705961 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818011d20 con 0x7f08280a1380 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 -- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 msgr2=0x7f0828133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0818009870 tx=0x7f0818009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 -- 172.21.15.125:0/582705961 shutdown_connections 2023-10-03T10:15:59.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f08280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 --2- 172.21.15.125:0/582705961 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08280a1380 0x7f0828133a10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 -- 172.21.15.125:0/582705961 >> 172.21.15.125:0/582705961 conn(0x7f08280a6610 msgr2=0x7f08280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 -- 172.21.15.125:0/582705961 shutdown_connections 2023-10-03T10:15:59.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.178+0000 7f082f273700 1 -- 172.21.15.125:0/582705961 wait complete. 2023-10-03T10:15:59.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 Processor -- start 2023-10-03T10:15:59.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 -- start start 2023-10-03T10:15:59.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f0828122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0828133f50 0x7f0828123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828126110 con 0x7f08280a1380 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0828123cf0 con 0x7f08280a0a70 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082f273700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0828126360 con 0x7f0828133f50 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082c80e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082d810700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0828133f50 0x7f0828123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082c80e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39460/0 (socket says 172.21.15.125:39460) 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082c80e700 1 -- 172.21.15.125:0/4021677538 learned_addr learned my addr 172.21.15.125:0/4021677538 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.179+0000 7f082d00f700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f0828122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 -- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0828133f50 msgr2=0x7f0828123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0828133f50 0x7f0828123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 -- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 msgr2=0x7f0828122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f0828122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 -- 172.21.15.125:0/4021677538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824009550 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082c80e700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f0818013000 tx=0x7f0818004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818004510 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081801f070 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08180094a0 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180038c0 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.180+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08280a03e0 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.181+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082804f2a0 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.182+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0818003a20 con 0x7f08280a1380 2023-10-03T10:15:59.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.182+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0818021070 con 0x7f08280a1380 2023-10-03T10:15:59.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.186+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08180253e0 con 0x7f08280a1380 2023-10-03T10:15:59.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 Processor -- start 2023-10-03T10:15:59.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 -- start start 2023-10-03T10:15:59.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 0x7f9928130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9928099a60 con 0x7f9928130890 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992809bf50 con 0x7f992809a730 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f992e5cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992809b230 con 0x7f9928099e20 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f9927fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.225+0000 7f99277fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 0x7f9928130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56462/0 (socket says 172.21.15.125:56462) 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f99277fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 0x7f9928130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39466/0 (socket says 172.21.15.125:39466) 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 -- 172.21.15.125:0/1467747438 learned_addr learned my addr 172.21.15.125:0/1467747438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 -- 172.21.15.125:0/1467747438 >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 msgr2=0x7f9928130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 --2- 172.21.15.125:0/1467747438 >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 0x7f9928130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 -- 172.21.15.125:0/1467747438 >> v1:172.21.15.125:6789/0 conn(0x7f9928130890 legacy=0x7f9928137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 -- 172.21.15.125:0/1467747438 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992809bb90 con 0x7f9928099e20 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9927fff700 1 --2- 172.21.15.125:0/1467747438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9918006fd0 tx=0x7f9918009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea6d27699ecd107 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9926ffd700 1 -- 172.21.15.125:0/1467747438 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918005e30 con 0x7f9928099e20 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9926ffd700 1 -- 172.21.15.125:0/1467747438 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918004030 con 0x7f9928099e20 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.226+0000 7f9926ffd700 1 -- 172.21.15.125:0/1467747438 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180043e0 con 0x7f9928099e20 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 -- 172.21.15.125:0/1467747438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 msgr2=0x7f992809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 --2- 172.21.15.125:0/1467747438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9918006fd0 tx=0x7f9918009bd0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 -- 172.21.15.125:0/1467747438 shutdown_connections 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 --2- 172.21.15.125:0/1467747438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992809a1f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 --2- 172.21.15.125:0/1467747438 >> v2:172.21.15.125:3300/0 conn(0x7f992809a730 0x7f9928130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 -- 172.21.15.125:0/1467747438 >> 172.21.15.125:0/1467747438 conn(0x7f99280a2980 msgr2=0x7f99280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 -- 172.21.15.125:0/1467747438 shutdown_connections 2023-10-03T10:15:59.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.227+0000 7f992e5cf700 1 -- 172.21.15.125:0/1467747438 wait complete. 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 Processor -- start 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 -- start start 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f992809a730 0x7f992811acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992811bc20 con 0x7f9928130890 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992811e240 con 0x7f992809a730 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992e5cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992811d5f0 con 0x7f9928099e20 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992cb6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f9927fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992cb6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39468/0 (socket says 172.21.15.125:39468) 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f9927fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56464/0 (socket says 172.21.15.125:56464) 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f992cb6c700 1 -- 172.21.15.125:0/2127032431 learned_addr learned my addr 172.21.15.125:0/2127032431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.228+0000 7f99277fe700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f992809a730 0x7f992811acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 -- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f992809a730 msgr2=0x7f992811acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f992809a730 0x7f992811acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 -- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 msgr2=0x7f992811b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 -- 172.21.15.125:0/2127032431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009500 con 0x7f9928099e20 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f992cb6c700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9927fff700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9918009fd0 tx=0x7f9918004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991801c420 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991801c5a0 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991801c950 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992811c430 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.229+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992811d130 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.230+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f991801cab0 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.230+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99180401a0 con 0x7f9928099e20 2023-10-03T10:15:59.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.230+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9928072480 con 0x7f9928099e20 2023-10-03T10:15:59.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.235+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9928072480 con 0x7f9928099e20 2023-10-03T10:15:59.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.378+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0828133360 con 0x7f08280a1380 2023-10-03T10:15:59.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.379+0000 7f081dffb700 1 -- 172.21.15.125:0/4021677538 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0818015030 con 0x7f08280a1380 2023-10-03T10:15:59.379 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:15:59.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 msgr2=0x7f0828122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f0818013000 tx=0x7f0818004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 shutdown_connections 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0828133f50 0x7f0828123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08280a0a70 0x7f0828122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 --2- 172.21.15.125:0/4021677538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08280a1380 0x7f0828122dd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 >> 172.21.15.125:0/4021677538 conn(0x7f08280a6610 msgr2=0x7f082809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 shutdown_connections 2023-10-03T10:15:59.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.381+0000 7f082f273700 1 -- 172.21.15.125:0/4021677538 wait complete. 2023-10-03T10:15:59.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:15:59.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.428+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9928072480 con 0x7f9928099e20 2023-10-03T10:15:59.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.428+0000 7f9924ff9700 1 -- 172.21.15.125:0/2127032431 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9928072480 con 0x7f9928099e20 2023-10-03T10:15:59.429 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 msgr2=0x7f992811a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9918009fd0 tx=0x7f9918004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 shutdown_connections 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9928130890 0x7f992811b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9928099e20 0x7f992811a770 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 --2- 172.21.15.125:0/2127032431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f992809a730 0x7f992811acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 >> 172.21.15.125:0/2127032431 conn(0x7f99280a2980 msgr2=0x7f99281b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 shutdown_connections 2023-10-03T10:15:59.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:15:59.430+0000 7f992e5cf700 1 -- 172.21.15.125:0/2127032431 wait complete. 2023-10-03T10:15:59.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:15:59.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:59.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:00.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.075+0000 7f4b9e954700 1 Processor -- start 2023-10-03T10:16:00.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.075+0000 7f4b9e954700 1 -- start start 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9e954700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9e954700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9e954700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9809dc00 con 0x7f4b98133f50 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9e954700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9809ea60 con 0x7f4b980a0a70 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9e954700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9809dec0 con 0x7f4b980a1380 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b97fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9cef1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b98133f50 0x7f4b9813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38436/0 (socket says 172.21.15.125:38436) 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b9cef1700 1 -- 172.21.15.125:0/2455712350 learned_addr learned my addr 172.21.15.125:0/2455712350 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56468/0 (socket says 172.21.15.125:56468) 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b97fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39480/0 (socket says 172.21.15.125:39480) 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 -- 172.21.15.125:0/2455712350 >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 msgr2=0x7f4b980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 --2- 172.21.15.125:0/2455712350 >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 -- 172.21.15.125:0/2455712350 >> v1:172.21.15.125:6789/0 conn(0x7f4b98133f50 legacy=0x7f4b9813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b977fe700 1 -- 172.21.15.125:0/2455712350 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9809e6a0 con 0x7f4b980a1380 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.076+0000 7f4b96ffd700 1 -- 172.21.15.125:0/2455712350 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984776154 0 0) 0x7f4b9809dc00 con 0x7f4b98133f50 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b97fff700 1 --2- 172.21.15.125:0/2455712350 >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b977fe700 1 --2- 172.21.15.125:0/2455712350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009840 tx=0x7f4b8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75ebcdc1c0a8896 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b96ffd700 1 -- 172.21.15.125:0/2455712350 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c011830 con 0x7f4b980a1380 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b96ffd700 1 -- 172.21.15.125:0/2455712350 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c011990 con 0x7f4b980a1380 2023-10-03T10:16:00.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b96ffd700 1 -- 172.21.15.125:0/2455712350 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c011d20 con 0x7f4b980a1380 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 -- 172.21.15.125:0/2455712350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 msgr2=0x7f4b98133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 --2- 172.21.15.125:0/2455712350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009840 tx=0x7f4b8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 -- 172.21.15.125:0/2455712350 shutdown_connections 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 --2- 172.21.15.125:0/2455712350 >> v2:172.21.15.125:3300/0 conn(0x7f4b980a0a70 0x7f4b980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 --2- 172.21.15.125:0/2455712350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a1380 0x7f4b98133a10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 -- 172.21.15.125:0/2455712350 >> 172.21.15.125:0/2455712350 conn(0x7f4b980a6610 msgr2=0x7f4b980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 -- 172.21.15.125:0/2455712350 shutdown_connections 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.077+0000 7f4b9e954700 1 -- 172.21.15.125:0/2455712350 wait complete. 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.079+0000 7f4b9e954700 1 Processor -- start 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.079+0000 7f4b9e954700 1 -- start start 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a0a70 0x7f4b98122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b980a1380 0x7f4b98122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98126180 con 0x7f4b98133f50 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98126360 con 0x7f4b980a1380 2023-10-03T10:16:00.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9e954700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98125dc0 con 0x7f4b980a0a70 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39496/0 (socket says 172.21.15.125:39496) 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 -- 172.21.15.125:0/275766238 learned_addr learned my addr 172.21.15.125:0/275766238 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 -- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a0a70 msgr2=0x7f4b98122840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a0a70 0x7f4b98122840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 -- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b980a1380 msgr2=0x7f4b98122d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b980a1380 0x7f4b98122d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 -- 172.21.15.125:0/275766238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880094a0 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.080+0000 7f4b9cef1700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4b90002230 tx=0x7f4b9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000ac20 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9000ada0 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c0094a0 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90007310 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b98124560 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b90007470 con 0x7f4b98133f50 2023-10-03T10:16:00.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.081+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b9003f620 con 0x7f4b98133f50 2023-10-03T10:16:00.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.082+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9804f2a0 con 0x7f4b98133f50 2023-10-03T10:16:00.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.087+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b9001c3b0 con 0x7f4b98133f50 2023-10-03T10:16:00.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.116+0000 7fb118fde700 1 Processor -- start 2023-10-03T10:16:00.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.116+0000 7fb118fde700 1 -- start start 2023-10-03T10:16:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb118fde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1140a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb118fde700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 0x7fb1141341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb118fde700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1140a1e60 con 0x7fb1140a2e10 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb118fde700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11409aa00 con 0x7fb1140a1460 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb118fde700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1140a2340 con 0x7fb1140a0b50 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb112d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 0x7fb1141341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb11259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1140a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb111d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1140a2e10 0x7fb114133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38444/0 (socket says 172.21.15.125:38444) 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.117+0000 7fb111d9b700 1 -- 172.21.15.125:0/3815435230 learned_addr learned my addr 172.21.15.125:0/3815435230 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11259c700 1 -- 172.21.15.125:0/3815435230 >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 msgr2=0x7fb1141341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11259c700 1 --2- 172.21.15.125:0/3815435230 >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 0x7fb1141341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11259c700 1 -- 172.21.15.125:0/3815435230 >> v1:172.21.15.125:6789/0 conn(0x7fb1140a2e10 legacy=0x7fb114133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11259c700 1 -- 172.21.15.125:0/3815435230 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11409a5b0 con 0x7fb1140a0b50 2023-10-03T10:16:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb112d9d700 1 --2- 172.21.15.125:0/3815435230 >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 0x7fb1141341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11259c700 1 --2- 172.21.15.125:0/3815435230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1140a0f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb104009840 tx=0x7fb104009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be10d6e90eda6c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11159a700 1 -- 172.21.15.125:0/3815435230 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104011830 con 0x7fb1140a0b50 2023-10-03T10:16:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11159a700 1 -- 172.21.15.125:0/3815435230 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104011990 con 0x7fb1140a0b50 2023-10-03T10:16:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.118+0000 7fb11159a700 1 -- 172.21.15.125:0/3815435230 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104011d20 con 0x7fb1140a0b50 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 -- 172.21.15.125:0/3815435230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 msgr2=0x7fb1140a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 --2- 172.21.15.125:0/3815435230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1140a0f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb104009840 tx=0x7fb104009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 -- 172.21.15.125:0/3815435230 shutdown_connections 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 --2- 172.21.15.125:0/3815435230 >> v2:172.21.15.125:3300/0 conn(0x7fb1140a1460 0x7fb1141341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 --2- 172.21.15.125:0/3815435230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1140a0f20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 -- 172.21.15.125:0/3815435230 >> 172.21.15.125:0/3815435230 conn(0x7fb11406c780 msgr2=0x7fb11406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 -- 172.21.15.125:0/3815435230 shutdown_connections 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.119+0000 7fb118fde700 1 -- 172.21.15.125:0/3815435230 wait complete. 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 Processor -- start 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 -- start start 2023-10-03T10:16:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1141c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1140a1460 0x7fb1141c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1140a5530 con 0x7fb1140a2e10 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb114124650 con 0x7fb1140a0b50 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb118fde700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb114124bf0 con 0x7fb1140a1460 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb112d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb11259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1141c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb112d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39528/0 (socket says 172.21.15.125:39528) 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.120+0000 7fb112d9d700 1 -- 172.21.15.125:0/2027978059 learned_addr learned my addr 172.21.15.125:0/2027978059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 -- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1140a1460 msgr2=0x7fb1141c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1140a1460 0x7fb1141c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 -- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 msgr2=0x7fb1141c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 -- 172.21.15.125:0/2027978059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c009a70 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb112d9d700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb11259c700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1141c53e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb104016000 tx=0x7fb104004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040036a0 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10401f070 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104003a60 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1040094a0 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.121+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb114123f30 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.122+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb104003bc0 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.122+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb104021070 con 0x7fb1140a0b50 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.122+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb114124870 con 0x7fb1140a0b50 2023-10-03T10:16:00.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.127+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb10402b020 con 0x7fb1140a0b50 2023-10-03T10:16:00.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.313+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b98133360 con 0x7f4b98133f50 2023-10-03T10:16:00.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.313+0000 7f4b94ff9700 1 -- 172.21.15.125:0/275766238 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b90018030 con 0x7f4b98133f50 2023-10-03T10:16:00.314 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:00.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 msgr2=0x7f4b981232c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4b90002230 tx=0x7f4b9000a060 comp rx=0 tx=0).stop 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 shutdown_connections 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b98133f50 0x7f4b981232c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b980a0a70 0x7f4b98122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 --2- 172.21.15.125:0/275766238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b980a1380 0x7f4b98122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 >> 172.21.15.125:0/275766238 conn(0x7f4b980a6610 msgr2=0x7f4b980a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 shutdown_connections 2023-10-03T10:16:00.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.316+0000 7f4b9e954700 1 -- 172.21.15.125:0/275766238 wait complete. 2023-10-03T10:16:00.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.352+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb11404f2a0 con 0x7fb1140a0b50 2023-10-03T10:16:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.352+0000 7fb102ffd700 1 -- 172.21.15.125:0/2027978059 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb104015070 con 0x7fb1140a0b50 2023-10-03T10:16:00.352 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:00.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 msgr2=0x7fb1141c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1141c53e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb104016000 tx=0x7fb104004750 comp rx=0 tx=0).stop 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 shutdown_connections 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1140a2e10 0x7fb1141c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1140a0b50 0x7fb1141c53e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 --2- 172.21.15.125:0/2027978059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1140a1460 0x7fb1141c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 >> 172.21.15.125:0/2027978059 conn(0x7fb11406c780 msgr2=0x7fb1141bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 shutdown_connections 2023-10-03T10:16:00.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.354+0000 7fb118fde700 1 -- 172.21.15.125:0/2027978059 wait complete. 2023-10-03T10:16:00.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:00.394 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:00.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.533+0000 7f1d9fb06700 1 Processor -- start 2023-10-03T10:16:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 -- start start 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 0x7f1d98139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9809c970 con 0x7f1d9809f180 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980a0920 con 0x7f1d9809e870 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9fb06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9809f9c0 con 0x7f1d98131f40 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9d8a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9e0a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 0x7f1d98139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9d8a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39536/0 (socket says 172.21.15.125:39536) 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9d8a2700 1 -- 172.21.15.125:0/3449411462 learned_addr learned my addr 172.21.15.125:0/3449411462 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9d0a1700 1 --1- 172.21.15.125:0/3449411462 >> v1:172.21.15.125:6789/0 conn(0x7f1d9809f180 0x7f1d98131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38460/0 (socket says 172.21.15.125:38460) 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9e0a3700 1 -- 172.21.15.125:0/3449411462 >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 msgr2=0x7f1d9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9e0a3700 1 --2- 172.21.15.125:0/3449411462 >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.534+0000 7f1d9e0a3700 1 -- 172.21.15.125:0/3449411462 >> v1:172.21.15.125:6789/0 conn(0x7f1d9809f180 legacy=0x7f1d98131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9e0a3700 1 -- 172.21.15.125:0/3449411462 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9809bab0 con 0x7f1d98131f40 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9c8a0700 1 -- 172.21.15.125:0/3449411462 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366789640 0 0) 0x7f1d9809c970 con 0x7f1d9809f180 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9d8a2700 1 --2- 172.21.15.125:0/3449411462 >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9e0a3700 1 --2- 172.21.15.125:0/3449411462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 0x7f1d98139ca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009d90 tx=0x7f1d9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7188a651bed0ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9c8a0700 1 -- 172.21.15.125:0/3449411462 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000e070 con 0x7f1d98131f40 2023-10-03T10:16:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9c8a0700 1 -- 172.21.15.125:0/3449411462 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000bb20 con 0x7f1d98131f40 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9c8a0700 1 -- 172.21.15.125:0/3449411462 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90012430 con 0x7f1d98131f40 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 -- 172.21.15.125:0/3449411462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 msgr2=0x7f1d98139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/3449411462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 0x7f1d98139ca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009d90 tx=0x7f1d9000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 -- 172.21.15.125:0/3449411462 shutdown_connections 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/3449411462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d98131f40 0x7f1d98139ca0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/3449411462 >> v2:172.21.15.125:3300/0 conn(0x7f1d9809e870 0x7f1d9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.535+0000 7f1d9fb06700 1 -- 172.21.15.125:0/3449411462 >> 172.21.15.125:0/3449411462 conn(0x7f1d980a4430 msgr2=0x7f1d980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.536+0000 7f1d9fb06700 1 -- 172.21.15.125:0/3449411462 shutdown_connections 2023-10-03T10:16:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.536+0000 7f1d9fb06700 1 -- 172.21.15.125:0/3449411462 wait complete. 2023-10-03T10:16:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.536+0000 7f1d9fb06700 1 Processor -- start 2023-10-03T10:16:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.536+0000 7f1d9fb06700 1 -- start start 2023-10-03T10:16:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 0x7f1d9806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98124510 con 0x7f1d9809f180 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98131830 con 0x7f1d9809e870 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9fb06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98130620 con 0x7f1d98131f40 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d0a1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9e0a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 0x7f1d9806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42372/0 (socket says 172.21.15.125:42372) 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 -- 172.21.15.125:0/2325527312 learned_addr learned my addr 172.21.15.125:0/2325527312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d0a1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39544/0 (socket says 172.21.15.125:39544) 2023-10-03T10:16:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 -- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 msgr2=0x7f1d9806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 0x7f1d9806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 -- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 msgr2=0x7f1d9806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 -- 172.21.15.125:0/2325527312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009550 con 0x7f1d9809e870 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9e0a3700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 0x7f1d9806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d0a1700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.537+0000 7f1d9d8a2700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e9b0 tx=0x7f1d9400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400ee50 con 0x7f1d9809e870 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400c850 con 0x7f1d9809e870 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90009a70 con 0x7f1d9809e870 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400cbc0 con 0x7f1d9809e870 2023-10-03T10:16:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98124750 con 0x7f1d9809e870 2023-10-03T10:16:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.538+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d9400cd20 con 0x7f1d9809e870 2023-10-03T10:16:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.539+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d9403f6b0 con 0x7f1d9809e870 2023-10-03T10:16:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.539+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9811be60 con 0x7f1d9809e870 2023-10-03T10:16:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.543+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d94017070 con 0x7f1d9809e870 2023-10-03T10:16:00.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 Processor -- start 2023-10-03T10:16:00.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 -- start start 2023-10-03T10:16:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f61281343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612809b110 con 0x7f61280a0a70 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280a3b60 con 0x7f6128133f70 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.576+0000 7f61304dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61281348e0 con 0x7f612809ad40 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612ea7a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f61280a0a70 0x7f61280a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38462/0 (socket says 172.21.15.125:38462) 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612e279700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612ea7a700 1 -- 172.21.15.125:0/2486486183 learned_addr learned my addr 172.21.15.125:0/2486486183 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f61281343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 -- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 msgr2=0x7f6128133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612d277700 1 -- 172.21.15.125:0/2486486183 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313451169 0 0) 0x7f612809b110 con 0x7f61280a0a70 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 -- 172.21.15.125:0/2486486183 >> v1:172.21.15.125:6789/0 conn(0x7f61280a0a70 legacy=0x7f61280a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 -- 172.21.15.125:0/2486486183 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280a2fa0 con 0x7f6128133f70 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612e279700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612da78700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f61281343a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6118009870 tx=0x7f6118009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f76259f1d678a5d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612d277700 1 -- 172.21.15.125:0/2486486183 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011830 con 0x7f6128133f70 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612d277700 1 -- 172.21.15.125:0/2486486183 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118011990 con 0x7f6128133f70 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.577+0000 7f612d277700 1 -- 172.21.15.125:0/2486486183 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011d20 con 0x7f6128133f70 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 -- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 msgr2=0x7f61281343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f61281343a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6118009870 tx=0x7f6118009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 -- 172.21.15.125:0/2486486183 shutdown_connections 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 --2- 172.21.15.125:0/2486486183 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f61281343a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 -- 172.21.15.125:0/2486486183 >> 172.21.15.125:0/2486486183 conn(0x7f6128099c40 msgr2=0x7f612806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 -- 172.21.15.125:0/2486486183 shutdown_connections 2023-10-03T10:16:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.578+0000 7f61304dd700 1 -- 172.21.15.125:0/2486486183 wait complete. 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.579+0000 7f61304dd700 1 Processor -- start 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.579+0000 7f61304dd700 1 -- start start 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 0x7f6128121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f6128121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128123e80 con 0x7f61280a0a70 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6128122f80 con 0x7f6128133f70 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f61304dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612809c7e0 con 0x7f612809ad40 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612ea7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f6128121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612e279700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 0x7f6128121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612ea7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f6128121ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42388/0 (socket says 172.21.15.125:42388) 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612ea7a700 1 -- 172.21.15.125:0/2373256171 learned_addr learned my addr 172.21.15.125:0/2373256171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 -- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 msgr2=0x7f6128121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 -- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 msgr2=0x7f6128121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f6128121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 -- 172.21.15.125:0/2373256171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240094a0 con 0x7f61280a0a70 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f612da78700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 0x7f6128121980 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6118016000 tx=0x7f6118004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.580+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118004510 con 0x7f61280a0a70 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.581+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61180036a0 con 0x7f61280a0a70 2023-10-03T10:16:00.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.581+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61180094a0 con 0x7f61280a0a70 2023-10-03T10:16:00.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.581+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118003a30 con 0x7f61280a0a70 2023-10-03T10:16:00.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.581+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128124c10 con 0x7f61280a0a70 2023-10-03T10:16:00.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.581+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6118003b90 con 0x7f61280a0a70 2023-10-03T10:16:00.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.582+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61180409e0 con 0x7f61280a0a70 2023-10-03T10:16:00.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.582+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612811e060 con 0x7f61280a0a70 2023-10-03T10:16:00.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.586+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6118003e40 con 0x7f61280a0a70 2023-10-03T10:16:00.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.734+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d9804f2a0 con 0x7f1d9809e870 2023-10-03T10:16:00.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.734+0000 7f1d8e7fc700 1 -- 172.21.15.125:0/2325527312 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d940232f0 con 0x7f1d9809e870 2023-10-03T10:16:00.735 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:00.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 msgr2=0x7f1d9806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e9b0 tx=0x7f1d9400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 shutdown_connections 2023-10-03T10:16:00.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d98131f40 0x7f1d9806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d9809e870 0x7f1d9806b8b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 --2- 172.21.15.125:0/2325527312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d9809f180 0x7f1d9806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 >> 172.21.15.125:0/2325527312 conn(0x7f1d980a4430 msgr2=0x7f1d98131090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 shutdown_connections 2023-10-03T10:16:00.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.736+0000 7f1d9fb06700 1 -- 172.21.15.125:0/2325527312 wait complete. 2023-10-03T10:16:00.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.772+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f612804f2a0 con 0x7f61280a0a70 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.773+0000 7f611effd700 1 -- 172.21.15.125:0/2373256171 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6118015030 con 0x7f61280a0a70 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:00.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 msgr2=0x7f6128121980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 0x7f6128121980 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6118016000 tx=0x7f6118004750 comp rx=0 tx=0).stop 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 shutdown_connections 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6128133f70 0x7f6128121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f612809ad40 0x7f6128121440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 --2- 172.21.15.125:0/2373256171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61280a0a70 0x7f6128121980 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 >> 172.21.15.125:0/2373256171 conn(0x7f6128099c40 msgr2=0x7f6128133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 shutdown_connections 2023-10-03T10:16:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:00.775+0000 7f61304dd700 1 -- 172.21.15.125:0/2373256171 wait complete. 2023-10-03T10:16:00.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:01.329 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:01.367 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:01.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 Processor -- start 2023-10-03T10:16:01.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 -- start start 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 0x7f99ac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 0x7f99ac133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac09e9d0 con 0x7f99ac0a0a70 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac09dc00 con 0x7f99ac0a1380 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.459+0000 7f99b13d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac09dec0 con 0x7f99ac133f50 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99aa7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 0x7f99ac133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56496/0 (socket says 172.21.15.125:56496) 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 -- 172.21.15.125:0/3879985578 learned_addr learned my addr 172.21.15.125:0/3879985578 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99aaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 0x7f99ac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 -- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 msgr2=0x7f99ac133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 0x7f99ac133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 -- 172.21.15.125:0/3879985578 >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 msgr2=0x7f99ac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 --2- 172.21.15.125:0/3879985578 >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 0x7f99ac0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 -- 172.21.15.125:0/3879985578 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac09e6a0 con 0x7f99ac133f50 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99aa7fc700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 0x7f99ac133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99aaffd700 1 --2- 172.21.15.125:0/3879985578 >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 0x7f99ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99ab7fe700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009e50 tx=0x7f99a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524067f6bbd2cd5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99a9ffb700 1 -- 172.21.15.125:0/3879985578 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400e070 con 0x7f99ac133f50 2023-10-03T10:16:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99a9ffb700 1 -- 172.21.15.125:0/3879985578 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400b910 con 0x7f99ac133f50 2023-10-03T10:16:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.460+0000 7f99a9ffb700 1 -- 172.21.15.125:0/3879985578 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400bcc0 con 0x7f99ac133f50 2023-10-03T10:16:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 -- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 msgr2=0x7f99ac1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009e50 tx=0x7f99a400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 -- 172.21.15.125:0/3879985578 shutdown_connections 2023-10-03T10:16:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac133f50 0x7f99ac1343b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 --2- 172.21.15.125:0/3879985578 >> v2:172.21.15.125:3300/0 conn(0x7f99ac0a0a70 0x7f99ac0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 --2- 172.21.15.125:0/3879985578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac0a1380 0x7f99ac133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 -- 172.21.15.125:0/3879985578 >> 172.21.15.125:0/3879985578 conn(0x7f99ac0a6610 msgr2=0x7f99ac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 -- 172.21.15.125:0/3879985578 shutdown_connections 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.461+0000 7f99b13d9700 1 -- 172.21.15.125:0/3879985578 wait complete. 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.462+0000 7f99b13d9700 1 Processor -- start 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.462+0000 7f99b13d9700 1 -- start start 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 0x7f99ac122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 0x7f99ac122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 0x7f99ac122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac125c00 con 0x7f99ac0a0a70 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac125de0 con 0x7f99ac133f50 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac1262e0 con 0x7f99ac0a1380 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 0x7f99ac122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 0x7f99ac122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 0x7f99ac122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39572/0 (socket says 172.21.15.125:39572) 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aaffd700 1 -- 172.21.15.125:0/1095122738 learned_addr learned my addr 172.21.15.125:0/1095122738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99ab7fe700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 0x7f99ac122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 -- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 msgr2=0x7f99ac122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 0x7f99ac122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 -- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 msgr2=0x7f99ac122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 0x7f99ac122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 -- 172.21.15.125:0/1095122738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0094a0 con 0x7f99ac0a1380 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99ab7fe700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 0x7f99ac122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99aa7fc700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 0x7f99ac122890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f99a000e9e0 tx=0x7f99a000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000ee80 con 0x7f99ac0a1380 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000c850 con 0x7f99ac0a1380 2023-10-03T10:16:01.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00094a0 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.463+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000cc00 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.464+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4009b30 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.464+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99a000cd60 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.464+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac04f2a0 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.465+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99a003f6b0 con 0x7f99ac0a1380 2023-10-03T10:16:01.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.469+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99a00232f0 con 0x7f99ac0a1380 2023-10-03T10:16:01.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.498+0000 7f5d0cda7700 1 Processor -- start 2023-10-03T10:16:01.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.498+0000 7f5d0cda7700 1 -- start start 2023-10-03T10:16:01.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0cda7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0cda7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0cda7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0809dc00 con 0x7f5d08133f50 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0cda7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0809ea60 con 0x7f5d080a1380 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0cda7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0809dec0 con 0x7f5d080a0a70 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d05d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42416/0 (socket says 172.21.15.125:42416) 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d0659c700 1 -- 172.21.15.125:0/2143222547 learned_addr learned my addr 172.21.15.125:0/2143222547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.499+0000 7f5d05d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39588/0 (socket says 172.21.15.125:39588) 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0659c700 1 -- 172.21.15.125:0/2143222547 >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 msgr2=0x7f5d08133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0659c700 1 --2- 172.21.15.125:0/2143222547 >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0659c700 1 -- 172.21.15.125:0/2143222547 >> v1:172.21.15.125:6789/0 conn(0x7f5d08133f50 legacy=0x7f5d0813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0659c700 1 -- 172.21.15.125:0/2143222547 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0809e6a0 con 0x7f5d080a0a70 2023-10-03T10:16:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d05d9b700 1 --2- 172.21.15.125:0/2143222547 >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0659c700 1 --2- 172.21.15.125:0/2143222547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80098f0 tx=0x7f5cf8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe7e5771b7487423 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0559a700 1 -- 172.21.15.125:0/2143222547 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011830 con 0x7f5d080a0a70 2023-10-03T10:16:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0559a700 1 -- 172.21.15.125:0/2143222547 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8011990 con 0x7f5d080a0a70 2023-10-03T10:16:01.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.500+0000 7f5d0559a700 1 -- 172.21.15.125:0/2143222547 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011d20 con 0x7f5d080a0a70 2023-10-03T10:16:01.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 -- 172.21.15.125:0/2143222547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 msgr2=0x7f5d080a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/2143222547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80098f0 tx=0x7f5cf8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 -- 172.21.15.125:0/2143222547 shutdown_connections 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/2143222547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d080a0a70 0x7f5d080a0e40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/2143222547 >> v2:172.21.15.125:3300/0 conn(0x7f5d080a1380 0x7f5d08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 -- 172.21.15.125:0/2143222547 >> 172.21.15.125:0/2143222547 conn(0x7f5d080a6610 msgr2=0x7f5d080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 -- 172.21.15.125:0/2143222547 shutdown_connections 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.501+0000 7f5d0cda7700 1 -- 172.21.15.125:0/2143222547 wait complete. 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.502+0000 7f5d0cda7700 1 Processor -- start 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 -- start start 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 0x7f5d0806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080a03e0 con 0x7f5d080a0a70 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080715e0 con 0x7f5d08133f50 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0cda7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08133a10 con 0x7f5d080a1380 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d05d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d05d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56522/0 (socket says 172.21.15.125:56522) 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42428/0 (socket says 172.21.15.125:42428) 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d05d9b700 1 -- 172.21.15.125:0/3399724823 learned_addr learned my addr 172.21.15.125:0/3399724823 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0659c700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 0x7f5d0806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 -- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 msgr2=0x7f5d0806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 -- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 msgr2=0x7f5d0806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 0x7f5d0806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d06d9d700 1 -- 172.21.15.125:0/3399724823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0094a0 con 0x7f5d08133f50 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d0659c700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 0x7f5d0806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.503+0000 7f5d05d9b700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5d06d9d700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000cb90 tx=0x7f5d0000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00003c00 con 0x7f5d08133f50 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d00003d60 con 0x7f5d08133f50 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf8009550 con 0x7f5d08133f50 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000aa80 con 0x7f5d08133f50 2023-10-03T10:16:01.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.504+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d08070080 con 0x7f5d08133f50 2023-10-03T10:16:01.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.505+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d0000abe0 con 0x7f5d08133f50 2023-10-03T10:16:01.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.505+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d0003f580 con 0x7f5d08133f50 2023-10-03T10:16:01.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.505+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0804f2a0 con 0x7f5d08133f50 2023-10-03T10:16:01.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.509+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d000050d0 con 0x7f5d08133f50 2023-10-03T10:16:01.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.658+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99ac125120 con 0x7f99ac0a1380 2023-10-03T10:16:01.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.659+0000 7f99937fe700 1 -- 172.21.15.125:0/1095122738 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99a0021020 con 0x7f99ac0a1380 2023-10-03T10:16:01.660 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 msgr2=0x7f99ac122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 0x7f99ac122890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f99a000e9e0 tx=0x7f99a000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 shutdown_connections 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99ac133f50 0x7f99ac122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac0a0a70 0x7f99ac122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 --2- 172.21.15.125:0/1095122738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99ac0a1380 0x7f99ac122890 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 >> 172.21.15.125:0/1095122738 conn(0x7f99ac0a6610 msgr2=0x7f99ac09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 shutdown_connections 2023-10-03T10:16:01.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.661+0000 7f99b13d9700 1 -- 172.21.15.125:0/1095122738 wait complete. 2023-10-03T10:16:01.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:01.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.699+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d08071260 con 0x7f5d08133f50 2023-10-03T10:16:01.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.699+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/3399724823 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d08071260 con 0x7f5d08133f50 2023-10-03T10:16:01.700 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 msgr2=0x7f5d0806e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000cb90 tx=0x7f5d0000cea0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 shutdown_connections 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d08133f50 0x7f5d0806e540 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d080a0a70 0x7f5d0806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 --2- 172.21.15.125:0/3399724823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d080a1380 0x7f5d0806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 >> 172.21.15.125:0/3399724823 conn(0x7f5d080a6610 msgr2=0x7f5d080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 shutdown_connections 2023-10-03T10:16:01.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.701+0000 7f5d0cda7700 1 -- 172.21.15.125:0/3399724823 wait complete. 2023-10-03T10:16:01.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:01.749 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:01.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 Processor -- start 2023-10-03T10:16:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 -- start start 2023-10-03T10:16:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e64134120 0x7f9e6413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6409dc00 con 0x7f9e640a1380 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6409ea60 con 0x7f9e64134120 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e6adc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6409dec0 con 0x7f9e640a0a70 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e68b60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e69361700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e64134120 0x7f9e6413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e68b60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42432/0 (socket says 172.21.15.125:42432) 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e63fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9e640a1380 0x7f9e64133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38480/0 (socket says 172.21.15.125:38480) 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e69361700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e64134120 0x7f9e6413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39602/0 (socket says 172.21.15.125:39602) 2023-10-03T10:16:01.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e68b60700 1 -- 172.21.15.125:0/3910952857 learned_addr learned my addr 172.21.15.125:0/3910952857 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.881+0000 7f9e69361700 1 -- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 msgr2=0x7f9e640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e69361700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e69361700 1 -- 172.21.15.125:0/3910952857 >> v1:172.21.15.125:6789/0 conn(0x7f9e640a1380 legacy=0x7f9e64133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e69361700 1 -- 172.21.15.125:0/3910952857 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6409e6a0 con 0x7f9e64134120 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e637fe700 1 -- 172.21.15.125:0/3910952857 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346321504 0 0) 0x7f9e6409dc00 con 0x7f9e640a1380 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e68b60700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e69361700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64134120 0x7f9e6413bce0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b0366430c8f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e637fe700 1 -- 172.21.15.125:0/3910952857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00e070 con 0x7f9e64134120 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e637fe700 1 -- 172.21.15.125:0/3910952857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00bb20 con 0x7f9e64134120 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e637fe700 1 -- 172.21.15.125:0/3910952857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c012430 con 0x7f9e64134120 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 -- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64134120 msgr2=0x7f9e6413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64134120 0x7f9e6413bce0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 -- 172.21.15.125:0/3910952857 shutdown_connections 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64134120 0x7f9e6413bce0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/3910952857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a0a70 0x7f9e640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 -- 172.21.15.125:0/3910952857 >> 172.21.15.125:0/3910952857 conn(0x7f9e640a6610 msgr2=0x7f9e640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 -- 172.21.15.125:0/3910952857 shutdown_connections 2023-10-03T10:16:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.882+0000 7f9e6adc4700 1 -- 172.21.15.125:0/3910952857 wait complete. 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.883+0000 7f9e6adc4700 1 Processor -- start 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.883+0000 7f9e6adc4700 1 -- start start 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641332b0 con 0x7f9e640a0a70 2023-10-03T10:16:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641258b0 con 0x7f9e640a1380 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e6adc4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641242c0 con 0x7f9e64134120 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e63fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e68b60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e63fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42440/0 (socket says 172.21.15.125:42440) 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e68b60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39610/0 (socket says 172.21.15.125:39610) 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56532/0 (socket says 172.21.15.125:56532) 2023-10-03T10:16:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e63fff700 1 -- 172.21.15.125:0/2752240687 learned_addr learned my addr 172.21.15.125:0/2752240687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 -- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 msgr2=0x7f9e64122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 -- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 msgr2=0x7f9e64122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e69361700 1 -- 172.21.15.125:0/2752240687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e58009550 con 0x7f9e64134120 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e68b60700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.884+0000 7f9e63fff700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e69361700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c016000 tx=0x7f9e5c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c012430 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c020070 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c009a70 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c004280 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.885+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e64125c30 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.886+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6404f2a0 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.886+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e5c0043e0 con 0x7f9e64134120 2023-10-03T10:16:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.886+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e5c022070 con 0x7f9e64134120 2023-10-03T10:16:01.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.894+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e5c011980 con 0x7f9e64134120 2023-10-03T10:16:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.926+0000 7f2d09dc4700 1 Processor -- start 2023-10-03T10:16:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.926+0000 7f2d09dc4700 1 -- start start 2023-10-03T10:16:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 0x7f2d040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0409e9d0 con 0x7f2d040a0a70 2023-10-03T10:16:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0409dc00 con 0x7f2d04133f50 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d09dc4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0409dec0 con 0x7f2d040a1380 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42448/0 (socket says 172.21.15.125:42448) 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d037fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 0x7f2d040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 -- 172.21.15.125:0/3786552074 learned_addr learned my addr 172.21.15.125:0/3786552074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d02ffd700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 -- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 msgr2=0x7f2d04133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 -- 172.21.15.125:0/3786552074 >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 msgr2=0x7f2d040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 --2- 172.21.15.125:0/3786552074 >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 0x7f2d040a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 -- 172.21.15.125:0/3786552074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0409e6a0 con 0x7f2d04133f50 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d037fe700 1 --2- 172.21.15.125:0/3786552074 >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 0x7f2d040a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d02ffd700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.927+0000 7f2d03fff700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0098f0 tx=0x7f2cfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb07a94f7bf16d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d027fc700 1 -- 172.21.15.125:0/3786552074 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011830 con 0x7f2d04133f50 2023-10-03T10:16:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d027fc700 1 -- 172.21.15.125:0/3786552074 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc011990 con 0x7f2d04133f50 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d027fc700 1 -- 172.21.15.125:0/3786552074 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011d20 con 0x7f2d04133f50 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 msgr2=0x7f2d041343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0098f0 tx=0x7f2cfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3786552074 shutdown_connections 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d041343b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3786552074 >> v2:172.21.15.125:3300/0 conn(0x7f2d040a0a70 0x7f2d040a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3786552074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3786552074 >> 172.21.15.125:0/3786552074 conn(0x7f2d040a6610 msgr2=0x7f2d040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3786552074 shutdown_connections 2023-10-03T10:16:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.928+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3786552074 wait complete. 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.929+0000 7f2d09dc4700 1 Processor -- start 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.929+0000 7f2d09dc4700 1 -- start start 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d04121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04124cd0 con 0x7f2d040a0a70 2023-10-03T10:16:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04124eb0 con 0x7f2d04133f50 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d09dc4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04122930 con 0x7f2d040a1380 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d02ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39626/0 (socket says 172.21.15.125:39626) 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 -- 172.21.15.125:0/3470817478 learned_addr learned my addr 172.21.15.125:0/3470817478 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d02ffd700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56544/0 (socket says 172.21.15.125:56544) 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d03fff700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d04121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 -- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 msgr2=0x7f2d04121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04121aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 -- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 msgr2=0x7f2d04121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d04121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 -- 172.21.15.125:0/3470817478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4009a70 con 0x7f2d040a0a70 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2d037fe700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400ef00 tx=0x7f2cf400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4010040 con 0x7f2d040a0a70 2023-10-03T10:16:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.930+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf400bd00 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4014620 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf80094a0 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc009550 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf4014780 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cf4040020 con 0x7f2d040a0a70 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.931+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d04124b10 con 0x7f2d040a0a70 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:01.938+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d04124b10 con 0x7f2d040a0a70 2023-10-03T10:16:02.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.089+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e64072980 con 0x7f9e64134120 2023-10-03T10:16:02.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.090+0000 7f9e617fa700 1 -- 172.21.15.125:0/2752240687 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e5c02c020 con 0x7f9e64134120 2023-10-03T10:16:02.090 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:02.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 msgr2=0x7f9e641231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c016000 tx=0x7f9e5c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 shutdown_connections 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e64134120 0x7f9e641231d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e640a0a70 0x7f9e64122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 --2- 172.21.15.125:0/2752240687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640a1380 0x7f9e64122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 >> 172.21.15.125:0/2752240687 conn(0x7f9e640a6610 msgr2=0x7f9e6411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 shutdown_connections 2023-10-03T10:16:02.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.092+0000 7f9e6adc4700 1 -- 172.21.15.125:0/2752240687 wait complete. 2023-10-03T10:16:02.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:02.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.131+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d04124b10 con 0x7f2d040a0a70 2023-10-03T10:16:02.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.132+0000 7f2cebfff700 1 -- 172.21.15.125:0/3470817478 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d04124b10 con 0x7f2d040a0a70 2023-10-03T10:16:02.132 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:02.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 msgr2=0x7f2d04121560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400ef00 tx=0x7f2cf400b390 comp rx=0 tx=0).stop 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 shutdown_connections 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d04133f50 0x7f2d04121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d040a0a70 0x7f2d04121560 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 --2- 172.21.15.125:0/3470817478 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d040a1380 0x7f2d04121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 >> 172.21.15.125:0/3470817478 conn(0x7f2d040a6610 msgr2=0x7f2d0409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 shutdown_connections 2023-10-03T10:16:02.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.134+0000 7f2d09dc4700 1 -- 172.21.15.125:0/3470817478 wait complete. 2023-10-03T10:16:02.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:02.674 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:02.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.803+0000 7f573281e700 1 Processor -- start 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.803+0000 7f573281e700 1 -- start start 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.803+0000 7f573281e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f573281e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f572c0a1380 0x7f572c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f573281e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c09dc00 con 0x7f572c133f50 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f573281e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c09ea60 con 0x7f572c0a1380 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f573281e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572c09dec0 con 0x7f572c0a0a70 2023-10-03T10:16:02.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f572c0a1380 0x7f572c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f5730dbb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f572c133f50 0x7f572c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38494/0 (socket says 172.21.15.125:38494) 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f5730dbb700 1 -- 172.21.15.125:0/2210384353 learned_addr learned my addr 172.21.15.125:0/2210384353 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 --2- 172.21.15.125:0/2210384353 >> v2:172.21.15.125:3300/0 conn(0x7f572c0a1380 0x7f572c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39640/0 (socket says 172.21.15.125:39640) 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572bfff700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56548/0 (socket says 172.21.15.125:56548) 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 -- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 msgr2=0x7f572c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 -- 172.21.15.125:0/2210384353 >> v1:172.21.15.125:6789/0 conn(0x7f572c133f50 legacy=0x7f572c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 -- 172.21.15.125:0/2210384353 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c09e6a0 con 0x7f572c0a1380 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572affd700 1 -- 172.21.15.125:0/2210384353 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194827035 0 0) 0x7f572c09dc00 con 0x7f572c133f50 2023-10-03T10:16:02.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572bfff700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572b7fe700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c0a1380 0x7f572c133a10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f5720009840 tx=0x7f5720009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307512f36a8ac9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572affd700 1 -- 172.21.15.125:0/2210384353 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720011830 con 0x7f572c0a1380 2023-10-03T10:16:02.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572affd700 1 -- 172.21.15.125:0/2210384353 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720011990 con 0x7f572c0a1380 2023-10-03T10:16:02.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.804+0000 7f572affd700 1 -- 172.21.15.125:0/2210384353 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720011d20 con 0x7f572c0a1380 2023-10-03T10:16:02.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 -- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c0a1380 msgr2=0x7f572c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c0a1380 0x7f572c133a10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f5720009840 tx=0x7f5720009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:02.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 -- 172.21.15.125:0/2210384353 shutdown_connections 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 --2- 172.21.15.125:0/2210384353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c0a1380 0x7f572c133a10 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 -- 172.21.15.125:0/2210384353 >> 172.21.15.125:0/2210384353 conn(0x7f572c0a6610 msgr2=0x7f572c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 -- 172.21.15.125:0/2210384353 shutdown_connections 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.805+0000 7f573281e700 1 -- 172.21.15.125:0/2210384353 wait complete. 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.806+0000 7f573281e700 1 Processor -- start 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 -- start start 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c126220 con 0x7f572c133f50 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c133960 con 0x7f572c0a1380 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f573281e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572c133420 con 0x7f572c0a0a70 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f572b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f5730dbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f572bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f5730dbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39648/0 (socket says 172.21.15.125:39648) 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f572b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42458/0 (socket says 172.21.15.125:42458) 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.807+0000 7f5730dbb700 1 -- 172.21.15.125:0/3798025288 learned_addr learned my addr 172.21.15.125:0/3798025288 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 -- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 msgr2=0x7f572c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 -- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 msgr2=0x7f572c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 -- 172.21.15.125:0/3798025288 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0094a0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f572bfff700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f572b7fe700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5730dbb700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f5724002230 tx=0x7f572400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400aac0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400ac40 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200094a0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57240070d0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.808+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c126bb0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.809+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5724007250 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.809+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f572403f4c0 con 0x7f572c133f50 2023-10-03T10:16:02.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.809+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c04f2a0 con 0x7f572c133f50 2023-10-03T10:16:02.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.813+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5724007500 con 0x7f572c133f50 2023-10-03T10:16:02.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.843+0000 7f966a493700 1 Processor -- start 2023-10-03T10:16:02.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.843+0000 7f966a493700 1 -- start start 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 0x7f9664134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966409e9d0 con 0x7f96640a1380 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966409dc00 con 0x7f9664133f50 2023-10-03T10:16:02.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f966a493700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f966409dec0 con 0x7f96640a0a70 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9663fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9663fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56566/0 (socket says 172.21.15.125:56566) 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39650/0 (socket says 172.21.15.125:39650) 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9663fff700 1 -- 172.21.15.125:0/2382284604 learned_addr learned my addr 172.21.15.125:0/2382284604 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9668a30700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 0x7f9664134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 -- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 msgr2=0x7f96640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 -- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 msgr2=0x7f9664134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 0x7f9664134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f96637fe700 1 -- 172.21.15.125:0/2382284604 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966409e6a0 con 0x7f96640a1380 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9663fff700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.844+0000 7f9668a30700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 0x7f9664134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f96637fe700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664133a10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f9658009840 tx=0x7f9658009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446c9033552d1486 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f9662ffd700 1 -- 172.21.15.125:0/2382284604 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011830 con 0x7f96640a1380 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f9662ffd700 1 -- 172.21.15.125:0/2382284604 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658011990 con 0x7f96640a1380 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f9662ffd700 1 -- 172.21.15.125:0/2382284604 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011d20 con 0x7f96640a1380 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 -- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 msgr2=0x7f9664133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664133a10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f9658009840 tx=0x7f9658009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 -- 172.21.15.125:0/2382284604 shutdown_connections 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9664133f50 0x7f9664134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f96640a0a70 0x7f96640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 --2- 172.21.15.125:0/2382284604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664133a10 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 -- 172.21.15.125:0/2382284604 >> 172.21.15.125:0/2382284604 conn(0x7f96640a6610 msgr2=0x7f96640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 -- 172.21.15.125:0/2382284604 shutdown_connections 2023-10-03T10:16:02.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.845+0000 7f966a493700 1 -- 172.21.15.125:0/2382284604 wait complete. 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.846+0000 7f966a493700 1 Processor -- start 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.846+0000 7f966a493700 1 -- start start 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f9664122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664125220 con 0x7f96640a1380 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664123820 con 0x7f96640a0a70 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f966a493700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9664124150 con 0x7f9664133f50 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f9663fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39654/0 (socket says 172.21.15.125:39654) 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f9663fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42482/0 (socket says 172.21.15.125:42482) 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 -- 172.21.15.125:0/3170651994 learned_addr learned my addr 172.21.15.125:0/3170651994 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f9668a30700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f9664122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 -- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 msgr2=0x7f9664122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f9664122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 -- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 msgr2=0x7f96641223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 -- 172.21.15.125:0/3170651994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9654009550 con 0x7f96640a1380 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f9663fff700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.847+0000 7f96637fe700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9658000c00 tx=0x7f9658004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580044d0 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965801f070 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580038e0 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c009a70 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96580094a0 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.848+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9658003a40 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.849+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9658021070 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.849+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966404f2a0 con 0x7f96640a1380 2023-10-03T10:16:02.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:02.853+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f965801a430 con 0x7f96640a1380 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.003+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f572c072980 con 0x7f572c133f50 2023-10-03T10:16:03.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.003+0000 7f5728ff9700 1 -- 172.21.15.125:0/3798025288 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5724018020 con 0x7f572c133f50 2023-10-03T10:16:03.004 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 msgr2=0x7f572c123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f5724002230 tx=0x7f572400cf50 comp rx=0 tx=0).stop 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 shutdown_connections 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f572c133f50 0x7f572c123380 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f572c0a0a70 0x7f572c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 --2- 172.21.15.125:0/3798025288 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f572c0a1380 0x7f572c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 >> 172.21.15.125:0/3798025288 conn(0x7f572c0a6610 msgr2=0x7f572c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 shutdown_connections 2023-10-03T10:16:03.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.005+0000 7f573281e700 1 -- 172.21.15.125:0/3798025288 wait complete. 2023-10-03T10:16:03.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:03.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.040+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9664072980 con 0x7f96640a1380 2023-10-03T10:16:03.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.041+0000 7f9660ff9700 1 -- 172.21.15.125:0/3170651994 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9658015020 con 0x7f96640a1380 2023-10-03T10:16:03.041 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:03.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 msgr2=0x7f9664122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9658000c00 tx=0x7f9658004750 comp rx=0 tx=0).stop 2023-10-03T10:16:03.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 shutdown_connections 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9664133f50 0x7f9664122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96640a0a70 0x7f96641223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 --2- 172.21.15.125:0/3170651994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96640a1380 0x7f9664122900 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 >> 172.21.15.125:0/3170651994 conn(0x7f96640a6610 msgr2=0x7f966409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 shutdown_connections 2023-10-03T10:16:03.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.043+0000 7f966a493700 1 -- 172.21.15.125:0/3170651994 wait complete. 2023-10-03T10:16:03.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:03.106 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:03.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:03.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 Processor -- start 2023-10-03T10:16:03.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 -- start start 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0d41343a0 0x7ff0d40a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d409b110 con 0x7ff0d4133f70 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40a3b60 con 0x7ff0d41343a0 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.232+0000 7ff0dbb3c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40a2fa0 con 0x7ff0d409ad40 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d98d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0d41343a0 0x7ff0d40a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d98d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56580/0 (socket says 172.21.15.125:56580) 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d98d8700 1 -- 172.21.15.125:0/3500256864 learned_addr learned my addr 172.21.15.125:0/3500256864 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 -- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 msgr2=0x7ff0d4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 -- 172.21.15.125:0/3500256864 >> v1:172.21.15.125:6789/0 conn(0x7ff0d4133f70 legacy=0x7ff0d40a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 -- 172.21.15.125:0/3500256864 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d409a280 con 0x7ff0d41343a0 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d88d6700 1 -- 172.21.15.125:0/3500256864 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959628053 0 0) 0x7ff0d409b110 con 0x7ff0d4133f70 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d98d8700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0da0d9700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d41343a0 0x7ff0d40a1180 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009d90 tx=0x7ff0cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e323c348f55fdf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d88d6700 1 -- 172.21.15.125:0/3500256864 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d41343a0 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d88d6700 1 -- 172.21.15.125:0/3500256864 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00bb20 con 0x7ff0d41343a0 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.233+0000 7ff0d88d6700 1 -- 172.21.15.125:0/3500256864 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc012430 con 0x7ff0d41343a0 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d41343a0 msgr2=0x7ff0d40a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d41343a0 0x7ff0d40a1180 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009d90 tx=0x7ff0cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:03.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/3500256864 shutdown_connections 2023-10-03T10:16:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d41343a0 0x7ff0d40a1180 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/3500256864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d409ad40 0x7ff0d4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/3500256864 >> 172.21.15.125:0/3500256864 conn(0x7ff0d4099c40 msgr2=0x7ff0d406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/3500256864 shutdown_connections 2023-10-03T10:16:03.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.234+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/3500256864 wait complete. 2023-10-03T10:16:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 Processor -- start 2023-10-03T10:16:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 -- start start 2023-10-03T10:16:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 0x7ff0d41c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 0x7ff0d41c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d411efd0 con 0x7ff0d409ad40 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4120730 con 0x7ff0d41343a0 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0dbb3c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4122740 con 0x7ff0d4133f70 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0d98d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0d90d7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 0x7ff0d41c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0d98d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39662/0 (socket says 172.21.15.125:39662) 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0da0d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 0x7ff0d41c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.235+0000 7ff0d98d8700 1 -- 172.21.15.125:0/2097846621 learned_addr learned my addr 172.21.15.125:0/2097846621 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 -- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 msgr2=0x7ff0d41c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 0x7ff0d41c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 -- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 msgr2=0x7ff0d41c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 0x7ff0d41c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 -- 172.21.15.125:0/2097846621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009550 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0da0d9700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 0x7ff0d41c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d90d7700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 0x7ff0d41c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0d98d8700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9e0 tx=0x7ff0d000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000ee80 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000c850 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000cbc0 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc009a70 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.236+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d4120f20 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.237+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d4122580 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.237+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d000cd20 con 0x7ff0d409ad40 2023-10-03T10:16:03.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.237+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0d003f700 con 0x7ff0d409ad40 2023-10-03T10:16:03.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.242+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0d4122580 con 0x7ff0d409ad40 2023-10-03T10:16:03.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.273+0000 7f1120de1700 1 Processor -- start 2023-10-03T10:16:03.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.273+0000 7f1120de1700 1 -- start start 2023-10-03T10:16:03.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f111c0a0a70 0x7f111c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c09e9d0 con 0x7f111c0a0a70 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c09dc00 con 0x7f111c133f50 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1120de1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f111c09dec0 con 0x7f111c0a1380 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f111c0a0a70 0x7f111c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56600/0 (socket says 172.21.15.125:56600) 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42488/0 (socket says 172.21.15.125:42488) 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 -- 172.21.15.125:0/1794798190 learned_addr learned my addr 172.21.15.125:0/1794798190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:03.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 -- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 msgr2=0x7f111c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 -- 172.21.15.125:0/1794798190 >> v2:172.21.15.125:3300/0 conn(0x7f111c0a0a70 msgr2=0x7f111c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 --2- 172.21.15.125:0/1794798190 >> v2:172.21.15.125:3300/0 conn(0x7f111c0a0a70 0x7f111c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 -- 172.21.15.125:0/1794798190 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c09e6a0 con 0x7f111c0a1380 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111ad9d700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f1119d9b700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f11100098f0 tx=0x7f1110009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4bfd64a6a30062 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111959a700 1 -- 172.21.15.125:0/1794798190 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110011830 con 0x7f111c0a1380 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111959a700 1 -- 172.21.15.125:0/1794798190 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110011990 con 0x7f111c0a1380 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.274+0000 7f111959a700 1 -- 172.21.15.125:0/1794798190 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110011d20 con 0x7f111c0a1380 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 -- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 msgr2=0x7f111c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f11100098f0 tx=0x7f1110009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:03.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 -- 172.21.15.125:0/1794798190 shutdown_connections 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c133f50 0x7f111c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 --2- 172.21.15.125:0/1794798190 >> v2:172.21.15.125:3300/0 conn(0x7f111c0a0a70 0x7f111c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 --2- 172.21.15.125:0/1794798190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c0a1380 0x7f111c133a10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 -- 172.21.15.125:0/1794798190 >> 172.21.15.125:0/1794798190 conn(0x7f111c0a6610 msgr2=0x7f111c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 -- 172.21.15.125:0/1794798190 shutdown_connections 2023-10-03T10:16:03.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.275+0000 7f1120de1700 1 -- 172.21.15.125:0/1794798190 wait complete. 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 Processor -- start 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 -- start start 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f111c0a0a70 0x7f111c1224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 0x7f111c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c1241a0 con 0x7f111c0a0a70 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c124eb0 con 0x7f111c0a1380 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1120de1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f111c125270 con 0x7f111c133f50 2023-10-03T10:16:03.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1119d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 0x7f111c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f111ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56612/0 (socket says 172.21.15.125:56612) 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f1119d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 0x7f111c1229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42498/0 (socket says 172.21.15.125:42498) 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f111ad9d700 1 -- 172.21.15.125:0/433916633 learned_addr learned my addr 172.21.15.125:0/433916633 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.277+0000 7f111a59c700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f111c0a0a70 0x7f111c1224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 -- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 msgr2=0x7f111c1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 0x7f111c1229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 -- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f111c0a0a70 msgr2=0x7f111c1224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f111c0a0a70 0x7f111c1224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 -- 172.21.15.125:0/433916633 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1114009a70 con 0x7f111c133f50 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f111ad9d700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1114009f00 tx=0x7f111400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114009d70 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400f040 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110009550 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400cd10 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.278+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c125990 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.279+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1114014480 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.279+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f111403fce0 con 0x7f111c133f50 2023-10-03T10:16:03.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.279+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c04f2a0 con 0x7f111c133f50 2023-10-03T10:16:03.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.284+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1114012930 con 0x7f111c133f50 2023-10-03T10:16:03.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.436+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0d4122360 con 0x7ff0d409ad40 2023-10-03T10:16:03.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.437+0000 7ff0ca7fc700 1 -- 172.21.15.125:0/2097846621 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0d0021020 con 0x7ff0d409ad40 2023-10-03T10:16:03.437 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 msgr2=0x7ff0d41c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9e0 tx=0x7ff0d000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 shutdown_connections 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0d41343a0 0x7ff0d41c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0d409ad40 0x7ff0d41c8120 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 --2- 172.21.15.125:0/2097846621 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0d4133f70 0x7ff0d41c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 >> 172.21.15.125:0/2097846621 conn(0x7ff0d4099c40 msgr2=0x7ff0d41bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 shutdown_connections 2023-10-03T10:16:03.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.439+0000 7ff0dbb3c700 1 -- 172.21.15.125:0/2097846621 wait complete. 2023-10-03T10:16:03.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:03.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.477+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f111c072980 con 0x7f111c133f50 2023-10-03T10:16:03.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.477+0000 7f110affd700 1 -- 172.21.15.125:0/433916633 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f111402b090 con 0x7f111c133f50 2023-10-03T10:16:03.478 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 msgr2=0x7f111c122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1114009f00 tx=0x7f111400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 shutdown_connections 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f111c133f50 0x7f111c122f30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f111c0a0a70 0x7f111c1224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 --2- 172.21.15.125:0/433916633 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f111c0a1380 0x7f111c1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 >> 172.21.15.125:0/433916633 conn(0x7f111c0a6610 msgr2=0x7f111c09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 shutdown_connections 2023-10-03T10:16:03.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:03.479+0000 7f1120de1700 1 -- 172.21.15.125:0/433916633 wait complete. 2023-10-03T10:16:03.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:04.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:04.056 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:04.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.150+0000 7f5af499c700 1 Processor -- start 2023-10-03T10:16:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.150+0000 7f5af499c700 1 -- start start 2023-10-03T10:16:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.150+0000 7f5af499c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 0x7f5af0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.150+0000 7f5af499c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.150+0000 7f5af499c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af009e9d0 con 0x7f5af00a0a70 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5af499c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009dc00 con 0x7f5af0139200 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5af499c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009dec0 con 0x7f5af00a1550 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aee59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5af00a0a70 0x7f5af00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38508/0 (socket says 172.21.15.125:38508) 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 0x7f5af0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aee59c700 1 -- 172.21.15.125:0/3141066188 learned_addr learned my addr 172.21.15.125:0/3141066188 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42512/0 (socket says 172.21.15.125:42512) 2023-10-03T10:16:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 -- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 msgr2=0x7f5af013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 -- 172.21.15.125:0/3141066188 >> v1:172.21.15.125:6789/0 conn(0x7f5af00a0a70 legacy=0x7f5af00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aed59a700 1 -- 172.21.15.125:0/3141066188 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391088247 0 0) 0x7f5af009e9d0 con 0x7f5af00a0a70 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 -- 172.21.15.125:0/3141066188 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af009e6a0 con 0x7f5af00a1550 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aeed9d700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aedd9b700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 0x7f5af0138cc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009870 tx=0x7f5ae4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3c8d0719acafdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aed59a700 1 -- 172.21.15.125:0/3141066188 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5af00a1550 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aed59a700 1 -- 172.21.15.125:0/3141066188 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5af00a1550 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.151+0000 7f5aed59a700 1 -- 172.21.15.125:0/3141066188 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d20 con 0x7f5af00a1550 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 -- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 msgr2=0x7f5af0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 0x7f5af0138cc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009870 tx=0x7f5ae4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 -- 172.21.15.125:0/3141066188 shutdown_connections 2023-10-03T10:16:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 --2- 172.21.15.125:0/3141066188 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a1550 0x7f5af0138cc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 -- 172.21.15.125:0/3141066188 >> 172.21.15.125:0/3141066188 conn(0x7f5af00a6610 msgr2=0x7f5af00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 -- 172.21.15.125:0/3141066188 shutdown_connections 2023-10-03T10:16:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.152+0000 7f5af499c700 1 -- 172.21.15.125:0/3141066188 wait complete. 2023-10-03T10:16:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.153+0000 7f5af499c700 1 Processor -- start 2023-10-03T10:16:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.153+0000 7f5af499c700 1 -- start start 2023-10-03T10:16:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 0x7f5af011ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af011f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0133fd0 con 0x7f5af00a1550 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af01345b0 con 0x7f5af0139200 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5af499c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00a5100 con 0x7f5af00a0a70 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56636/0 (socket says 172.21.15.125:56636) 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aee59c700 1 -- 172.21.15.125:0/4240898465 learned_addr learned my addr 172.21.15.125:0/4240898465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aedd9b700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 0x7f5af011ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aeed9d700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af011f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aee59c700 1 -- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 msgr2=0x7f5af011f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.154+0000 7f5aee59c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af011f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5aee59c700 1 -- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 msgr2=0x7f5af011ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5aee59c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 0x7f5af011ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5aee59c700 1 -- 172.21.15.125:0/4240898465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009a70 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5aedd9b700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 0x7f5af011ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5aee59c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c520 tx=0x7f5ae000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004c80 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0004e00 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae40094a0 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0007310 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af0120b30 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.155+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ae0007470 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.156+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ae003f300 con 0x7f5af00a0a70 2023-10-03T10:16:04.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.156+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af004f2a0 con 0x7f5af00a0a70 2023-10-03T10:16:04.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.161+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ae00123b0 con 0x7f5af00a0a70 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 Processor -- start 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 -- start start 2023-10-03T10:16:04.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 0x7f036012d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 0x7f03601387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036009ca80 con 0x7f036012dc70 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036012cf30 con 0x7f0360130bb0 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.191+0000 7f0366d27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036009abc0 con 0x7f036012d360 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 0x7f036012d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f036012dc70 0x7f03601304a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38522/0 (socket says 172.21.15.125:38522) 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035ffff700 1 -- 172.21.15.125:0/2294785574 learned_addr learned my addr 172.21.15.125:0/2294785574 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f03652c4700 1 --2- 172.21.15.125:0/2294785574 >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 0x7f03601387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035f7fe700 1 -- 172.21.15.125:0/2294785574 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667693148 0 0) 0x7f036009ca80 con 0x7f036012dc70 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 -- 172.21.15.125:0/2294785574 >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 msgr2=0x7f03601387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 --2- 172.21.15.125:0/2294785574 >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 0x7f03601387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 -- 172.21.15.125:0/2294785574 >> v1:172.21.15.125:6789/0 conn(0x7f036012dc70 legacy=0x7f03601304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 -- 172.21.15.125:0/2294785574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036009b390 con 0x7f036012d360 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f03652c4700 1 --2- 172.21.15.125:0/2294785574 >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 0x7f03601387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f0364ac3700 1 --2- 172.21.15.125:0/2294785574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 0x7f036012d730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f034800bae0 tx=0x7f034800bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49c13b5033366760 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035f7fe700 1 -- 172.21.15.125:0/2294785574 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800dc70 con 0x7f036012d360 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035f7fe700 1 -- 172.21.15.125:0/2294785574 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800ddd0 con 0x7f036012d360 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.192+0000 7f035f7fe700 1 -- 172.21.15.125:0/2294785574 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348010690 con 0x7f036012d360 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 -- 172.21.15.125:0/2294785574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 msgr2=0x7f036012d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 --2- 172.21.15.125:0/2294785574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 0x7f036012d730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f034800bae0 tx=0x7f034800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 -- 172.21.15.125:0/2294785574 shutdown_connections 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 --2- 172.21.15.125:0/2294785574 >> v2:172.21.15.125:3300/0 conn(0x7f0360130bb0 0x7f03601387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 --2- 172.21.15.125:0/2294785574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f036012d360 0x7f036012d730 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 -- 172.21.15.125:0/2294785574 >> 172.21.15.125:0/2294785574 conn(0x7f03600a2980 msgr2=0x7f03600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 -- 172.21.15.125:0/2294785574 shutdown_connections 2023-10-03T10:16:04.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.193+0000 7f0366d27700 1 -- 172.21.15.125:0/2294785574 wait complete. 2023-10-03T10:16:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 Processor -- start 2023-10-03T10:16:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 -- start start 2023-10-03T10:16:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 0x7f036011e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0360130bb0 0x7f036011ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036009a3b0 con 0x7f036012dc70 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0360122520 con 0x7f0360130bb0 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0366d27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0360121660 con 0x7f036012d360 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0364ac3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f035ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 0x7f036011e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0364ac3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56640/0 (socket says 172.21.15.125:56640) 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.194+0000 7f0364ac3700 1 -- 172.21.15.125:0/976527487 learned_addr learned my addr 172.21.15.125:0/976527487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f03652c4700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0360130bb0 0x7f036011ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 -- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0360130bb0 msgr2=0x7f036011ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0360130bb0 0x7f036011ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 -- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 msgr2=0x7f036011e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 0x7f036011e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 -- 172.21.15.125:0/976527487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358009a70 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f035ffff700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 0x7f036011e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0364ac3700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c00 tx=0x7f0348004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034801d070 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348010680 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348010a60 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034800b740 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.195+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03601213a0 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.196+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03480036a0 con 0x7f036012d360 2023-10-03T10:16:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.196+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03480407c0 con 0x7f036012d360 2023-10-03T10:16:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.196+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036009b610 con 0x7f036012d360 2023-10-03T10:16:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.201+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03480219c0 con 0x7f036012d360 2023-10-03T10:16:04.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.356+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5af0072980 con 0x7f5af00a0a70 2023-10-03T10:16:04.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.357+0000 7f5adeffd700 1 -- 172.21.15.125:0/4240898465 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ae0011360 con 0x7f5af00a0a70 2023-10-03T10:16:04.357 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:04.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 msgr2=0x7f5af011e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c520 tx=0x7f5ae000c830 comp rx=0 tx=0).stop 2023-10-03T10:16:04.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 shutdown_connections 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5af0139200 0x7f5af011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5af00a0a70 0x7f5af011e6c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 --2- 172.21.15.125:0/4240898465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5af00a1550 0x7f5af011ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 >> 172.21.15.125:0/4240898465 conn(0x7f5af00a6610 msgr2=0x7f5af00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 shutdown_connections 2023-10-03T10:16:04.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.359+0000 7f5af499c700 1 -- 172.21.15.125:0/4240898465 wait complete. 2023-10-03T10:16:04.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:04.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.394+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f036004f2a0 con 0x7f036012d360 2023-10-03T10:16:04.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.395+0000 7f035d7fa700 1 -- 172.21.15.125:0/976527487 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0348027020 con 0x7f036012d360 2023-10-03T10:16:04.395 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 msgr2=0x7f036011e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c00 tx=0x7f0348004750 comp rx=0 tx=0).stop 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 shutdown_connections 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0360130bb0 0x7f036011ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f036012d360 0x7f036011e250 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 --2- 172.21.15.125:0/976527487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036012dc70 0x7f036011e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 >> 172.21.15.125:0/976527487 conn(0x7f03600a2980 msgr2=0x7f036012e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 shutdown_connections 2023-10-03T10:16:04.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.397+0000 7f0366d27700 1 -- 172.21.15.125:0/976527487 wait complete. 2023-10-03T10:16:04.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:04.453 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:04.492 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 Processor -- start 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 -- start start 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 0x7f6b2c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c09dc00 con 0x7f6b2c0a1380 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c09ea90 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.580+0000 7f6b326e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c09dec0 con 0x7f6b2c134120 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b30c7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 0x7f6b2c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39708/0 (socket says 172.21.15.125:39708) 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3808154838 learned_addr learned my addr 172.21.15.125:0/3808154838 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2b7fe700 1 --1- 172.21.15.125:0/3808154838 >> v1:172.21.15.125:6789/0 conn(0x7f6b2c0a1380 0x7f6b2c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38530/0 (socket says 172.21.15.125:38530) 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 msgr2=0x7f6b2c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 0x7f6b2c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3808154838 >> v1:172.21.15.125:6789/0 conn(0x7f6b2c0a1380 legacy=0x7f6b2c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3808154838 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c09e6a0 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2affd700 1 -- 172.21.15.125:0/3808154838 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058198264 0 0) 0x7f6b2c09dc00 con 0x7f6b2c0a1380 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b30c7e700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 0x7f6b2c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2bfff700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0098f0 tx=0x7f6b1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e014217f478c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2affd700 1 -- 172.21.15.125:0/3808154838 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c011830 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2affd700 1 -- 172.21.15.125:0/3808154838 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c011990 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.581+0000 7f6b2affd700 1 -- 172.21.15.125:0/3808154838 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c011d20 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 -- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a0a70 msgr2=0x7f6b2c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0098f0 tx=0x7f6b1c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 -- 172.21.15.125:0/3808154838 shutdown_connections 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c134120 0x7f6b2c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3808154838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a0a70 0x7f6b2c0a0e40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 -- 172.21.15.125:0/3808154838 >> 172.21.15.125:0/3808154838 conn(0x7f6b2c0a6610 msgr2=0x7f6b2c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 -- 172.21.15.125:0/3808154838 shutdown_connections 2023-10-03T10:16:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.582+0000 7f6b326e1700 1 -- 172.21.15.125:0/3808154838 wait complete. 2023-10-03T10:16:04.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 Processor -- start 2023-10-03T10:16:04.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 -- start start 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2c134120 0x7f6b2c123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c133300 con 0x7f6b2c0a1380 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c125920 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.583+0000 7f6b326e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c124310 con 0x7f6b2c134120 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42540/0 (socket says 172.21.15.125:42540) 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39718/0 (socket says 172.21.15.125:39718) 2023-10-03T10:16:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3623960821 learned_addr learned my addr 172.21.15.125:0/3623960821 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b30c7e700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2c134120 0x7f6b2c123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2c134120 msgr2=0x7f6b2c123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2c134120 0x7f6b2c123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 msgr2=0x7f6b2c122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 -- 172.21.15.125:0/3623960821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24009a70 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2b7fe700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b2bfff700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009c40 tx=0x7f6b1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c004340 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c01f070 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c009550 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0036a0 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.584+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c125c80 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.585+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b1c021030 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.585+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b1c0409a0 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.585+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c04f2a0 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.590+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b1c015070 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.621+0000 7f0c1906a700 1 Processor -- start 2023-10-03T10:16:04.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 -- start start 2023-10-03T10:16:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 0x7f0c1413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1409e9d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1409dc00 con 0x7f0c14139200 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1906a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1409dec0 con 0x7f0c140a1550 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56658/0 (socket says 172.21.15.125:56658) 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 -- 172.21.15.125:0/3643609237 learned_addr learned my addr 172.21.15.125:0/3643609237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c12d9d700 1 --1- 172.21.15.125:0/3643609237 >> v1:172.21.15.125:6789/0 conn(0x7f0c140a0a70 0x7f0c140a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38540/0 (socket says 172.21.15.125:38540) 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1359e700 1 --2- 172.21.15.125:0/3643609237 >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 0x7f0c1413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 -- 172.21.15.125:0/3643609237 >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 msgr2=0x7f0c1413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 --2- 172.21.15.125:0/3643609237 >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 0x7f0c1413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.622+0000 7f0c1259c700 1 -- 172.21.15.125:0/3643609237 >> v1:172.21.15.125:6789/0 conn(0x7f0c140a0a70 legacy=0x7f0c140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1259c700 1 -- 172.21.15.125:0/3643609237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1409e6a0 con 0x7f0c140a1550 2023-10-03T10:16:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c11d9b700 1 -- 172.21.15.125:0/3643609237 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437513647 0 0) 0x7f0c1409e9d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1359e700 1 --2- 172.21.15.125:0/3643609237 >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 0x7f0c1413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1259c700 1 --2- 172.21.15.125:0/3643609237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0c080098f0 tx=0x7f0c08009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eba1497fa5619e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c11d9b700 1 -- 172.21.15.125:0/3643609237 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08011830 con 0x7f0c140a1550 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c11d9b700 1 -- 172.21.15.125:0/3643609237 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08011990 con 0x7f0c140a1550 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c11d9b700 1 -- 172.21.15.125:0/3643609237 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08011d20 con 0x7f0c140a1550 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 -- 172.21.15.125:0/3643609237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 msgr2=0x7f0c14138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 --2- 172.21.15.125:0/3643609237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0c080098f0 tx=0x7f0c08009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 -- 172.21.15.125:0/3643609237 shutdown_connections 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 --2- 172.21.15.125:0/3643609237 >> v2:172.21.15.125:3300/0 conn(0x7f0c14139200 0x7f0c1413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 --2- 172.21.15.125:0/3643609237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c140a1550 0x7f0c14138cc0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 -- 172.21.15.125:0/3643609237 >> 172.21.15.125:0/3643609237 conn(0x7f0c140a6610 msgr2=0x7f0c140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 -- 172.21.15.125:0/3643609237 shutdown_connections 2023-10-03T10:16:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.623+0000 7f0c1906a700 1 -- 172.21.15.125:0/3643609237 wait complete. 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 Processor -- start 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 -- start start 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 0x7f0c14121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 0x7f0c141224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14123680 con 0x7f0c140a0a70 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14123ca0 con 0x7f0c140a1550 2023-10-03T10:16:04.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1906a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140a03e0 con 0x7f0c14139200 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c12d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 0x7f0c141224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c12d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39744/0 (socket says 172.21.15.125:39744) 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c12d9d700 1 -- 172.21.15.125:0/2977483998 learned_addr learned my addr 172.21.15.125:0/2977483998 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.625+0000 7f0c1259c700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 0x7f0c14121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 -- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 msgr2=0x7f0c141224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 0x7f0c141224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 -- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 msgr2=0x7f0c14121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 0x7f0c14121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 -- 172.21.15.125:0/2977483998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c009a70 con 0x7f0c140a0a70 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c1359e700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 0x7f0c141224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c1259c700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 0x7f0c14121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c12d9d700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c520 tx=0x7f0c0400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04004c80 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04004e00 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04007310 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c08009550 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.626+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c140a5100 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.627+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c04007470 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.627+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c0403f300 con 0x7f0c140a0a70 2023-10-03T10:16:04.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.627+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c141257d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.632+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c141257d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.783+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b2c072980 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.783+0000 7f6b28ff9700 1 -- 172.21.15.125:0/3623960821 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b1c019770 con 0x7f6b2c0a0a70 2023-10-03T10:16:04.784 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 msgr2=0x7f6b2c122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009c40 tx=0x7f6b1c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 shutdown_connections 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2c134120 0x7f6b2c123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2c0a0a70 0x7f6b2c122700 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 --2- 172.21.15.125:0/3623960821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b2c0a1380 0x7f6b2c122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 >> 172.21.15.125:0/3623960821 conn(0x7f6b2c0a6610 msgr2=0x7f6b2c0a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 shutdown_connections 2023-10-03T10:16:04.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.785+0000 7f6b326e1700 1 -- 172.21.15.125:0/3623960821 wait complete. 2023-10-03T10:16:04.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:04.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.823+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c141257d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.823+0000 7f0bfb7fe700 1 -- 172.21.15.125:0/2977483998 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c141257d0 con 0x7f0c140a0a70 2023-10-03T10:16:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 msgr2=0x7f0c14121a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c520 tx=0x7f0c0400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 shutdown_connections 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0c14139200 0x7f0c141224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c140a0a70 0x7f0c14121a70 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 --2- 172.21.15.125:0/2977483998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c140a1550 0x7f0c14121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 >> 172.21.15.125:0/2977483998 conn(0x7f0c140a6610 msgr2=0x7f0c140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 shutdown_connections 2023-10-03T10:16:04.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:04.825+0000 7f0c1906a700 1 -- 172.21.15.125:0/2977483998 wait complete. 2023-10-03T10:16:04.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:05.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:05.410 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:05.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 Processor -- start 2023-10-03T10:16:05.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 -- start start 2023-10-03T10:16:05.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efea006b250 0x7efea0136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea009da80 con 0x7efea006a770 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea009f770 con 0x7efea006b250 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.501+0000 7efea7987700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efea009dce0 con 0x7efea0137140 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea5f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efea006b250 0x7efea0136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea5f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55786/0 (socket says 172.21.15.125:55786) 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea5723700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efea006a770 0x7efea006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57746/0 (socket says 172.21.15.125:57746) 2023-10-03T10:16:05.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea5f24700 1 -- 172.21.15.125:0/2709432308 learned_addr learned my addr 172.21.15.125:0/2709432308 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 -- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 msgr2=0x7efea0139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 -- 172.21.15.125:0/2709432308 >> v1:172.21.15.125:6789/0 conn(0x7efea006a770 legacy=0x7efea006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 -- 172.21.15.125:0/2709432308 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea009eb20 con 0x7efea006b250 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea5f24700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efea4f22700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea006b250 0x7efea0136c00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7efe90009840 tx=0x7efe90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a8f48345f751d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efe97fff700 1 -- 172.21.15.125:0/2709432308 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90011830 con 0x7efea006b250 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efe97fff700 1 -- 172.21.15.125:0/2709432308 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90011990 con 0x7efea006b250 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.502+0000 7efe97fff700 1 -- 172.21.15.125:0/2709432308 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90011d20 con 0x7efea006b250 2023-10-03T10:16:05.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 -- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea006b250 msgr2=0x7efea0136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea006b250 0x7efea0136c00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7efe90009840 tx=0x7efe90009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 -- 172.21.15.125:0/2709432308 shutdown_connections 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea0137140 0x7efea0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 --2- 172.21.15.125:0/2709432308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea006b250 0x7efea0136c00 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 -- 172.21.15.125:0/2709432308 >> 172.21.15.125:0/2709432308 conn(0x7efea0099c40 msgr2=0x7efea00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 -- 172.21.15.125:0/2709432308 shutdown_connections 2023-10-03T10:16:05.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.503+0000 7efea7987700 1 -- 172.21.15.125:0/2709432308 wait complete. 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 Processor -- start 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 -- start start 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 0x7efea0120640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 0x7efea0120b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea0123f60 con 0x7efea0137140 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea0124d40 con 0x7efea006b250 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea7987700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efea0136530 con 0x7efea006a770 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea5f24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea5f24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52904/0 (socket says 172.21.15.125:52904) 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea5723700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 0x7efea0120640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea4f22700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 0x7efea0120b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.504+0000 7efea5f24700 1 -- 172.21.15.125:0/3164312845 learned_addr learned my addr 172.21.15.125:0/3164312845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 -- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 msgr2=0x7efea0120b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 0x7efea0120b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 -- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 msgr2=0x7efea01210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 -- 172.21.15.125:0/3164312845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98009b30 con 0x7efea006a770 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5f24700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea4f22700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 0x7efea0120b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea5723700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 0x7efea0120640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c480 tx=0x7efe9c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c005cb0 con 0x7efea006a770 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c005e10 con 0x7efea006a770 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0072d0 con 0x7efea006a770 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900094a0 con 0x7efea006a770 2023-10-03T10:16:05.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.505+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea0122a40 con 0x7efea006a770 2023-10-03T10:16:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.506+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe9c007430 con 0x7efea006a770 2023-10-03T10:16:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.506+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea004f2a0 con 0x7efea006a770 2023-10-03T10:16:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.506+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe9c0409d0 con 0x7efea006a770 2023-10-03T10:16:05.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.511+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe9c044060 con 0x7efea006a770 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.541+0000 7f4fa4a73700 1 Processor -- start 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.541+0000 7f4fa4a73700 1 -- start start 2023-10-03T10:16:05.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4fa4a73700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 0x7f4fa0135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4fa4a73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 0x7f4fa0137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4fa4a73700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa009a540 con 0x7f4fa012feb0 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4fa4a73700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa009ad40 con 0x7f4fa0135790 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4fa4a73700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa009e640 con 0x7f4fa0132e70 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 0x7f4fa0137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4fa012feb0 0x7f4fa0130280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57760/0 (socket says 172.21.15.125:57760) 2023-10-03T10:16:05.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 0x7f4fa0135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9e59c700 1 -- 172.21.15.125:0/1768198423 learned_addr learned my addr 172.21.15.125:0/1768198423 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:05.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9d59a700 1 -- 172.21.15.125:0/1768198423 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903795084 0 0) 0x7f4fa009a540 con 0x7f4fa012feb0 2023-10-03T10:16:05.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 -- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 msgr2=0x7f4fa0135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 0x7f4fa0135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 -- 172.21.15.125:0/1768198423 >> v1:172.21.15.125:6789/0 conn(0x7f4fa012feb0 legacy=0x7f4fa0130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 -- 172.21.15.125:0/1768198423 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa009e3c0 con 0x7f4fa0135790 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9dd9b700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 0x7f4fa0135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9ed9d700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 0x7f4fa0137b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009dc0 tx=0x7f4f9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d870687415faa05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.542+0000 7f4f9d59a700 1 -- 172.21.15.125:0/1768198423 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800e070 con 0x7f4fa0135790 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4f9d59a700 1 -- 172.21.15.125:0/1768198423 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9800bb20 con 0x7f4fa0135790 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4f9d59a700 1 -- 172.21.15.125:0/1768198423 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98012430 con 0x7f4fa0135790 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 -- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 msgr2=0x7f4fa0137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 0x7f4fa0137b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009dc0 tx=0x7f4f9800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 -- 172.21.15.125:0/1768198423 shutdown_connections 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0135790 0x7f4fa0137b70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/1768198423 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0132e70 0x7f4fa0135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 -- 172.21.15.125:0/1768198423 >> 172.21.15.125:0/1768198423 conn(0x7f4fa00a2b30 msgr2=0x7f4fa009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 -- 172.21.15.125:0/1768198423 shutdown_connections 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.543+0000 7f4fa4a73700 1 -- 172.21.15.125:0/1768198423 wait complete. 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.544+0000 7f4fa4a73700 1 Processor -- start 2023-10-03T10:16:05.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.544+0000 7f4fa4a73700 1 -- start start 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 0x7f4fa0127860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0135790 0x7f4fa01c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa012a2f0 con 0x7f4fa012feb0 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa006db40 con 0x7f4fa0132e70 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0127430 con 0x7f4fa0135790 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 0x7f4fa0127860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53206/0 (socket says 172.21.15.125:53206) 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 -- 172.21.15.125:0/3349240042 learned_addr learned my addr 172.21.15.125:0/3349240042 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9ed9d700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0135790 0x7f4fa01c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 -- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0135790 msgr2=0x7f4fa01c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0135790 0x7f4fa01c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 -- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 msgr2=0x7f4fa0127860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 0x7f4fa0127860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 -- 172.21.15.125:0/3349240042 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9400a5b0 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9e59c700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 0x7f4fa0127860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f9dd9b700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f94010d00 tx=0x7f4f9400c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94005c20 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94005d80 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f98009a70 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.545+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400cb80 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.546+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa0129ea0 con 0x7f4fa0132e70 2023-10-03T10:16:05.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.546+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f9400cce0 con 0x7f4fa0132e70 2023-10-03T10:16:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.546+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f94041880 con 0x7f4fa0132e70 2023-10-03T10:16:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.546+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa00a1cd0 con 0x7f4fa0132e70 2023-10-03T10:16:05.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.551+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f94012450 con 0x7f4fa0132e70 2023-10-03T10:16:05.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.704+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efea01237e0 con 0x7efea006a770 2023-10-03T10:16:05.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.705+0000 7efe95ffb700 1 -- 172.21.15.125:0/3164312845 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe9c017070 con 0x7efea006a770 2023-10-03T10:16:05.705 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:05.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 msgr2=0x7efea0120640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 0x7efea0120640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c480 tx=0x7efe9c00c790 comp rx=0 tx=0).stop 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 shutdown_connections 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efea0137140 0x7efea01210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efea006a770 0x7efea0120640 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 --2- 172.21.15.125:0/3164312845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efea006b250 0x7efea0120b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 >> 172.21.15.125:0/3164312845 conn(0x7efea0099c40 msgr2=0x7efea006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 shutdown_connections 2023-10-03T10:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.707+0000 7efea7987700 1 -- 172.21.15.125:0/3164312845 wait complete. 2023-10-03T10:16:05.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.744+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4fa004f2a0 con 0x7f4fa0132e70 2023-10-03T10:16:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.745+0000 7f4f8effd700 1 -- 172.21.15.125:0/3349240042 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f940233a0 con 0x7f4fa0132e70 2023-10-03T10:16:05.745 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 msgr2=0x7f4fa0127da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f94010d00 tx=0x7f4f9400c420 comp rx=0 tx=0).stop 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 shutdown_connections 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4fa0135790 0x7f4fa01c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fa012feb0 0x7f4fa0127860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 --2- 172.21.15.125:0/3349240042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fa0132e70 0x7f4fa0127da0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 >> 172.21.15.125:0/3349240042 conn(0x7f4fa00a2b30 msgr2=0x7f4fa01344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 shutdown_connections 2023-10-03T10:16:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.747+0000 7f4fa4a73700 1 -- 172.21.15.125:0/3349240042 wait complete. 2023-10-03T10:16:05.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:05.799 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:05.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.923+0000 7f9c8a9df700 1 Processor -- start 2023-10-03T10:16:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 -- start start 2023-10-03T10:16:05.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c84139200 0x7f9c8413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8409e9d0 con 0x7f9c840a0a70 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8409dc00 con 0x7f9c84139200 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c8a9df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8409dec0 con 0x7f9c840a1550 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c84139200 0x7f9c8413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55828/0 (socket says 172.21.15.125:55828) 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c84139200 0x7f9c8413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52918/0 (socket says 172.21.15.125:52918) 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c83fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9c840a0a70 0x7f9c840a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57766/0 (socket says 172.21.15.125:57766) 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 -- 172.21.15.125:0/341112148 learned_addr learned my addr 172.21.15.125:0/341112148 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 -- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 msgr2=0x7f9c84138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c88f7c700 1 -- 172.21.15.125:0/341112148 >> v1:172.21.15.125:6789/0 conn(0x7f9c840a0a70 legacy=0x7f9c840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.924+0000 7f9c82ffd700 1 -- 172.21.15.125:0/341112148 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071220555 0 0) 0x7f9c8409e9d0 con 0x7f9c840a0a70 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c88f7c700 1 -- 172.21.15.125:0/341112148 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8409e6a0 con 0x7f9c84139200 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c837fe700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c88f7c700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c8413b5e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009e50 tx=0x7f9c7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967dd3c363bea6ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c82ffd700 1 -- 172.21.15.125:0/341112148 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00e070 con 0x7f9c84139200 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c82ffd700 1 -- 172.21.15.125:0/341112148 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00b910 con 0x7f9c84139200 2023-10-03T10:16:05.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c82ffd700 1 -- 172.21.15.125:0/341112148 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00bcc0 con 0x7f9c84139200 2023-10-03T10:16:05.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 -- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 msgr2=0x7f9c8413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c8413b5e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009e50 tx=0x7f9c7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 -- 172.21.15.125:0/341112148 shutdown_connections 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c8413b5e0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/341112148 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 -- 172.21.15.125:0/341112148 >> 172.21.15.125:0/341112148 conn(0x7f9c840a6610 msgr2=0x7f9c840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.925+0000 7f9c8a9df700 1 -- 172.21.15.125:0/341112148 shutdown_connections 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.926+0000 7f9c8a9df700 1 -- 172.21.15.125:0/341112148 wait complete. 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.926+0000 7f9c8a9df700 1 Processor -- start 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 -- start start 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 0x7f9c84121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c841221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84125280 con 0x7f9c84139200 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84123990 con 0x7f9c840a0a70 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c8a9df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840a03e0 con 0x7f9c840a1550 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 0x7f9c84121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55844/0 (socket says 172.21.15.125:55844) 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 -- 172.21.15.125:0/599039891 learned_addr learned my addr 172.21.15.125:0/599039891 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 0x7f9c84121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53216/0 (socket says 172.21.15.125:53216) 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c88f7c700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c841221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 -- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 msgr2=0x7f9c84121760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 0x7f9c84121760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 -- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 msgr2=0x7f9c841221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c841221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c837fe700 1 -- 172.21.15.125:0/599039891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780094a0 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.927+0000 7f9c88f7c700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c841221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c837fe700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800ebe0 tx=0x7f9c7800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800c850 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7800c9b0 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c009b30 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800cd40 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.928+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84124ce0 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.929+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c78013470 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.929+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c7803fae0 con 0x7f9c840a1550 2023-10-03T10:16:05.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.929+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8404f2a0 con 0x7f9c840a1550 2023-10-03T10:16:05.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.933+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c78021080 con 0x7f9c840a1550 2023-10-03T10:16:05.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.966+0000 7f9c485bd700 1 Processor -- start 2023-10-03T10:16:05.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.966+0000 7f9c485bd700 1 -- start start 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c485bd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c485bd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c40134120 0x7f9c4013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c485bd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4009dc00 con 0x7f9c400a1380 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c485bd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4009ea60 con 0x7f9c40134120 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c485bd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4009dec0 con 0x7f9c400a0a70 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46359700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c40134120 0x7f9c4013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46359700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55856/0 (socket says 172.21.15.125:55856) 2023-10-03T10:16:05.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46359700 1 -- 172.21.15.125:0/3943317775 learned_addr learned my addr 172.21.15.125:0/3943317775 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 -- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 msgr2=0x7f9c400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 -- 172.21.15.125:0/3943317775 >> v1:172.21.15.125:6789/0 conn(0x7f9c400a1380 legacy=0x7f9c40133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 -- 172.21.15.125:0/3943317775 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4009e6a0 con 0x7f9c40134120 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c45357700 1 -- 172.21.15.125:0/3943317775 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284113935 0 0) 0x7f9c4009dc00 con 0x7f9c400a1380 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46359700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c46b5a700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c40134120 0x7f9c4013bce0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009d90 tx=0x7f9c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aa687200b8561b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.967+0000 7f9c45357700 1 -- 172.21.15.125:0/3943317775 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800e070 con 0x7f9c40134120 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c45357700 1 -- 172.21.15.125:0/3943317775 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800bb20 con 0x7f9c40134120 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c45357700 1 -- 172.21.15.125:0/3943317775 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38012430 con 0x7f9c40134120 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 -- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c40134120 msgr2=0x7f9c4013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c40134120 0x7f9c4013bce0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009d90 tx=0x7f9c3800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 -- 172.21.15.125:0/3943317775 shutdown_connections 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c40134120 0x7f9c4013bce0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3943317775 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c400a0a70 0x7f9c400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 -- 172.21.15.125:0/3943317775 >> 172.21.15.125:0/3943317775 conn(0x7f9c400a6610 msgr2=0x7f9c400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 -- 172.21.15.125:0/3943317775 shutdown_connections 2023-10-03T10:16:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.968+0000 7f9c485bd700 1 -- 172.21.15.125:0/3943317775 wait complete. 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.969+0000 7f9c485bd700 1 Processor -- start 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.969+0000 7f9c485bd700 1 -- start start 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c400a1380 0x7f9c40122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c40134120 0x7f9c401231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401332b0 con 0x7f9c400a0a70 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401258b0 con 0x7f9c400a1380 2023-10-03T10:16:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401242c0 con 0x7f9c40134120 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52940/0 (socket says 172.21.15.125:52940) 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 -- 172.21.15.125:0/3354791897 learned_addr learned my addr 172.21.15.125:0/3354791897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c45b58700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c400a1380 0x7f9c40122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46b5a700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c40134120 0x7f9c401231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 -- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c40134120 msgr2=0x7f9c401231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c40134120 0x7f9c401231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 -- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c400a1380 msgr2=0x7f9c40122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c400a1380 0x7f9c40122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 -- 172.21.15.125:0/3354791897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009550 con 0x7f9c400a0a70 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c46359700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00ec10 tx=0x7f9c3c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00c850 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00c9b0 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c38009a70 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00cd40 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.970+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c40125c30 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.971+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4004f2a0 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.971+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c3c013470 con 0x7f9c400a0a70 2023-10-03T10:16:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.972+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c3c03f840 con 0x7f9c400a0a70 2023-10-03T10:16:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:05.976+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c3c013720 con 0x7f9c400a0a70 2023-10-03T10:16:06.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.129+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c84072980 con 0x7f9c840a1550 2023-10-03T10:16:06.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.130+0000 7f9c80ff9700 1 -- 172.21.15.125:0/599039891 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c78017020 con 0x7f9c840a1550 2023-10-03T10:16:06.130 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:06.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 msgr2=0x7f9c84121ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800ebe0 tx=0x7f9c7800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 shutdown_connections 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c84139200 0x7f9c841221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c840a0a70 0x7f9c84121760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 --2- 172.21.15.125:0/599039891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c840a1550 0x7f9c84121ca0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 >> 172.21.15.125:0/599039891 conn(0x7f9c840a6610 msgr2=0x7f9c840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 shutdown_connections 2023-10-03T10:16:06.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.132+0000 7f9c8a9df700 1 -- 172.21.15.125:0/599039891 wait complete. 2023-10-03T10:16:06.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.173+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c40072980 con 0x7f9c400a0a70 2023-10-03T10:16:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.174+0000 7f9c36ffd700 1 -- 172.21.15.125:0/3354791897 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c3c021070 con 0x7f9c400a0a70 2023-10-03T10:16:06.174 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 msgr2=0x7f9c40122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00ec10 tx=0x7f9c3c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 shutdown_connections 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c40134120 0x7f9c401231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c400a0a70 0x7f9c40122750 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 --2- 172.21.15.125:0/3354791897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c400a1380 0x7f9c40122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 >> 172.21.15.125:0/3354791897 conn(0x7f9c400a6610 msgr2=0x7f9c4011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 shutdown_connections 2023-10-03T10:16:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.176+0000 7f9c485bd700 1 -- 172.21.15.125:0/3354791897 wait complete. 2023-10-03T10:16:06.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:06.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:06.760 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.847+0000 7f8cf2ce1700 1 Processor -- start 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.847+0000 7f8cf2ce1700 1 -- start start 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a12f0 0x7f8cec133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 0x7f8cec1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec09de10 con 0x7f8cec133f40 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec09db90 con 0x7f8cec0a12f0 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf2ce1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0a2560 con 0x7f8cec0a09e0 2023-10-03T10:16:06.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a12f0 0x7f8cec133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf127e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 0x7f8cec1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55886/0 (socket says 172.21.15.125:55886) 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 -- 172.21.15.125:0/3823741320 learned_addr learned my addr 172.21.15.125:0/3823741320 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 -- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a12f0 msgr2=0x7f8cec133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 --2- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a12f0 0x7f8cec133a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 -- 172.21.15.125:0/3823741320 >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 msgr2=0x7f8cec1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 --2- 172.21.15.125:0/3823741320 >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 0x7f8cec1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 -- 172.21.15.125:0/3823741320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0a1f60 con 0x7f8cec0a09e0 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf127e700 1 --2- 172.21.15.125:0/3823741320 >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 0x7f8cec1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8cf0a7d700 1 --2- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00098f0 tx=0x7f8ce0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d29735524017d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.848+0000 7f8ceb7fe700 1 -- 172.21.15.125:0/3823741320 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0011830 con 0x7f8cec0a09e0 2023-10-03T10:16:06.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8ceb7fe700 1 -- 172.21.15.125:0/3823741320 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0011990 con 0x7f8cec0a09e0 2023-10-03T10:16:06.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8ceb7fe700 1 -- 172.21.15.125:0/3823741320 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0011d20 con 0x7f8cec0a09e0 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 msgr2=0x7f8cec0a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00098f0 tx=0x7f8ce0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/3823741320 shutdown_connections 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/3823741320 >> v2:172.21.15.125:3300/0 conn(0x7f8cec133f40 0x7f8cec1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a09e0 0x7f8cec0a0db0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/3823741320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a12f0 0x7f8cec133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/3823741320 >> 172.21.15.125:0/3823741320 conn(0x7f8cec0a3000 msgr2=0x7f8cec0a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/3823741320 shutdown_connections 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.849+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/3823741320 wait complete. 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.851+0000 7f8cf2ce1700 1 Processor -- start 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.851+0000 7f8cf2ce1700 1 -- start start 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 0x7f8cec123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec123cb0 con 0x7f8cec133f40 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec124ca0 con 0x7f8cec0a09e0 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec124570 con 0x7f8cec0a12f0 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf0a7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf127e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 0x7f8cec123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf127e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 0x7f8cec123260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52960/0 (socket says 172.21.15.125:52960) 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55900/0 (socket says 172.21.15.125:55900) 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf0a7d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53250/0 (socket says 172.21.15.125:53250) 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf127e700 1 -- 172.21.15.125:0/2242443395 learned_addr learned my addr 172.21.15.125:0/2242443395 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 -- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 msgr2=0x7f8cec1227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 -- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 msgr2=0x7f8cec123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 0x7f8cec123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 -- 172.21.15.125:0/2242443395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4009a70 con 0x7f8cec0a12f0 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf0a7d700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cebfff700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800e930 tx=0x7f8cd800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8013680 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd80137e0 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8013b50 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0009550 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.852+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec133360 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.853+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cd8013cb0 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.853+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec04f2a0 con 0x7f8cec0a12f0 2023-10-03T10:16:06.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.854+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8cd803f450 con 0x7f8cec0a12f0 2023-10-03T10:16:06.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.859+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cd800c450 con 0x7f8cec0a12f0 2023-10-03T10:16:06.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.889+0000 7f278d64c700 1 Processor -- start 2023-10-03T10:16:06.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 -- start start 2023-10-03T10:16:06.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 0x7f278813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278809b110 con 0x7f278809ad40 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27880a3b60 con 0x7f2788134570 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f278d64c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27880a1a80 con 0x7f2788134140 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f27867fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f27867fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55912/0 (socket says 172.21.15.125:55912) 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f27877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 0x7f278813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f2786ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f278809ad40 0x7f2788133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57786/0 (socket says 172.21.15.125:57786) 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.890+0000 7f27867fc700 1 -- 172.21.15.125:0/3425677839 learned_addr learned my addr 172.21.15.125:0/3425677839 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f2785ffb700 1 -- 172.21.15.125:0/3425677839 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141666249 0 0) 0x7f278809b110 con 0x7f278809ad40 2023-10-03T10:16:06.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27867fc700 1 -- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 msgr2=0x7f278813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27867fc700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 0x7f278813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27867fc700 1 -- 172.21.15.125:0/3425677839 >> v1:172.21.15.125:6789/0 conn(0x7f278809ad40 legacy=0x7f2788133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27867fc700 1 -- 172.21.15.125:0/3425677839 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27880a2fa0 con 0x7f2788134140 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27877fe700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 0x7f278813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f27867fc700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f277c009920 tx=0x7f277c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601587654a837cff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f2785ffb700 1 -- 172.21.15.125:0/3425677839 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c011830 con 0x7f2788134140 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f2785ffb700 1 -- 172.21.15.125:0/3425677839 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c011990 con 0x7f2788134140 2023-10-03T10:16:06.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.891+0000 7f2785ffb700 1 -- 172.21.15.125:0/3425677839 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c011d20 con 0x7f2788134140 2023-10-03T10:16:06.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 -- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 msgr2=0x7f2788138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f277c009920 tx=0x7f277c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 -- 172.21.15.125:0/3425677839 shutdown_connections 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134570 0x7f278813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 --2- 172.21.15.125:0/3425677839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2788134140 0x7f2788138e80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 -- 172.21.15.125:0/3425677839 >> 172.21.15.125:0/3425677839 conn(0x7f2788099c40 msgr2=0x7f278806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 -- 172.21.15.125:0/3425677839 shutdown_connections 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.892+0000 7f278d64c700 1 -- 172.21.15.125:0/3425677839 wait complete. 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 Processor -- start 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 -- start start 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 0x7f278811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 0x7f278811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 0x7f278811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278811ee60 con 0x7f2788134570 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278811f7d0 con 0x7f2788134140 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f278d64c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f278811e5f0 con 0x7f278809ad40 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f27877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 0x7f278811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f27867fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 0x7f278811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f27877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 0x7f278811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52968/0 (socket says 172.21.15.125:52968) 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f27877fe700 1 -- 172.21.15.125:0/2039718834 learned_addr learned my addr 172.21.15.125:0/2039718834 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.893+0000 7f2786ffd700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 0x7f278811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 -- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 msgr2=0x7f278811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 0x7f278811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 -- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 msgr2=0x7f278811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 0x7f278811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 -- 172.21.15.125:0/2039718834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780009a70 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f27867fc700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 0x7f278811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f2786ffd700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 0x7f278811c8c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f277800c3f0 tx=0x7f277800c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778004a70 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778004c10 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c009550 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780070d0 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.894+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278809e3b0 con 0x7f278809ad40 2023-10-03T10:16:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.895+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278809c7e0 con 0x7f278809ad40 2023-10-03T10:16:06.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.896+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2778007230 con 0x7f278809ad40 2023-10-03T10:16:06.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.896+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f277803f7f0 con 0x7f278809ad40 2023-10-03T10:16:06.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:06.900+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27780010e0 con 0x7f278809ad40 2023-10-03T10:16:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.051+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8cec133340 con 0x7f8cec0a12f0 2023-10-03T10:16:07.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.051+0000 7f8ce97fa700 1 -- 172.21.15.125:0/2242443395 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cd8021070 con 0x7f8cec0a12f0 2023-10-03T10:16:07.052 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 msgr2=0x7f8cec122d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800e930 tx=0x7f8cd800ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 shutdown_connections 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cec133f40 0x7f8cec123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8cec0a09e0 0x7f8cec1227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 --2- 172.21.15.125:0/2242443395 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8cec0a12f0 0x7f8cec122d20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 >> 172.21.15.125:0/2242443395 conn(0x7f8cec0a3000 msgr2=0x7f8cec09c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 shutdown_connections 2023-10-03T10:16:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.053+0000 7f8cf2ce1700 1 -- 172.21.15.125:0/2242443395 wait complete. 2023-10-03T10:16:07.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:07.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.092+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f278804f2a0 con 0x7f278809ad40 2023-10-03T10:16:07.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.092+0000 7f276f7fe700 1 -- 172.21.15.125:0/2039718834 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f277801b340 con 0x7f278809ad40 2023-10-03T10:16:07.093 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:07.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 msgr2=0x7f278811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 0x7f278811c8c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f277800c3f0 tx=0x7f277800c700 comp rx=0 tx=0).stop 2023-10-03T10:16:07.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 shutdown_connections 2023-10-03T10:16:07.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2788134570 0x7f278811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f278809ad40 0x7f278811c8c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 --2- 172.21.15.125:0/2039718834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2788134140 0x7f278811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 >> 172.21.15.125:0/2039718834 conn(0x7f2788099c40 msgr2=0x7f278809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 shutdown_connections 2023-10-03T10:16:07.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.094+0000 7f278d64c700 1 -- 172.21.15.125:0/2039718834 wait complete. 2023-10-03T10:16:07.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:07.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:07.189 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.272+0000 7f3f320b3700 1 Processor -- start 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.272+0000 7f3f320b3700 1 -- start start 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f320b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 0x7f3f2c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f320b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f320b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c09dc00 con 0x7f3f2c133f50 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f320b3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c09ea60 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f320b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c09dec0 con 0x7f3f2c0a1380 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 0x7f3f2c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55924/0 (socket says 172.21.15.125:55924) 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 -- 172.21.15.125:0/3148095017 learned_addr learned my addr 172.21.15.125:0/3148095017 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 -- 172.21.15.125:0/3148095017 >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 msgr2=0x7f3f2c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 --2- 172.21.15.125:0/3148095017 >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 0x7f3f2c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 -- 172.21.15.125:0/3148095017 >> v1:172.21.15.125:6789/0 conn(0x7f3f2c133f50 legacy=0x7f3f2c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2a7fc700 1 -- 172.21.15.125:0/3148095017 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038025987 0 0) 0x7f3f2c09dc00 con 0x7f3f2c133f50 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 -- 172.21.15.125:0/3148095017 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c09e6a0 con 0x7f3f2c0a1380 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2b7fe700 1 --2- 172.21.15.125:0/3148095017 >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 0x7f3f2c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2affd700 1 --2- 172.21.15.125:0/3148095017 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=720c9af1eaf05d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2a7fc700 1 -- 172.21.15.125:0/3148095017 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011830 con 0x7f3f2c0a1380 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2a7fc700 1 -- 172.21.15.125:0/3148095017 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14011990 con 0x7f3f2c0a1380 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.273+0000 7f3f2a7fc700 1 -- 172.21.15.125:0/3148095017 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011d20 con 0x7f3f2c0a1380 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 -- 172.21.15.125:0/3148095017 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 msgr2=0x7f3f2c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 --2- 172.21.15.125:0/3148095017 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 -- 172.21.15.125:0/3148095017 shutdown_connections 2023-10-03T10:16:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 --2- 172.21.15.125:0/3148095017 >> v2:172.21.15.125:3300/0 conn(0x7f3f2c0a0a70 0x7f3f2c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 --2- 172.21.15.125:0/3148095017 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a1380 0x7f3f2c133a10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 -- 172.21.15.125:0/3148095017 >> 172.21.15.125:0/3148095017 conn(0x7f3f2c0a6610 msgr2=0x7f3f2c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 -- 172.21.15.125:0/3148095017 shutdown_connections 2023-10-03T10:16:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.275+0000 7f3f320b3700 1 -- 172.21.15.125:0/3148095017 wait complete. 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.276+0000 7f3f320b3700 1 Processor -- start 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.276+0000 7f3f320b3700 1 -- start start 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.276+0000 7f3f320b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 0x7f3f2c1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.276+0000 7f3f320b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f2c0a1380 0x7f3f2c1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c122320 con 0x7f3f2c0a1380 2023-10-03T10:16:07.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c120660 con 0x7f3f2c133f50 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0a17b0 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f2c0a1380 0x7f3f2c1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53268/0 (socket says 172.21.15.125:53268) 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2bfff700 1 -- 172.21.15.125:0/1236995750 learned_addr learned my addr 172.21.15.125:0/1236995750 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 0x7f3f2c1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 -- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 msgr2=0x7f3f2c1c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 -- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f2c0a1380 msgr2=0x7f3f2c1c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f2c0a1380 0x7f3f2c1c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 -- 172.21.15.125:0/1236995750 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c009a70 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2bfff700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f2b7fe700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 0x7f3f2c1c8460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00efc0 tx=0x7f3f1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00cd10 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c00f040 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14009550 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0146a0 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.277+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c120e50 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.278+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f1c014800 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.278+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f1c040270 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.278+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c04f2a0 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.283+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f1c01d400 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.316+0000 7f257985e700 1 Processor -- start 2023-10-03T10:16:07.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.316+0000 7f257985e700 1 -- start start 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f257985e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f2574138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f257985e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2574134570 0x7f257413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f257985e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257409b110 con 0x7f257409ad40 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f257985e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740a3b60 con 0x7f2574134570 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f257985e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740a1a80 con 0x7f2574134140 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f2572ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f257409ad40 0x7f2574133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57794/0 (socket says 172.21.15.125:57794) 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f2572ffd700 1 -- 172.21.15.125:0/3068627051 learned_addr learned my addr 172.21.15.125:0/3068627051 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 --2- 172.21.15.125:0/3068627051 >> v2:172.21.15.125:3300/0 conn(0x7f2574134570 0x7f257413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25727fc700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f2574138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 -- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 msgr2=0x7f2574138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f2574138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 -- 172.21.15.125:0/3068627051 >> v1:172.21.15.125:6789/0 conn(0x7f257409ad40 legacy=0x7f2574133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 -- 172.21.15.125:0/3068627051 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740a2fa0 con 0x7f2574134570 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f2571ffb700 1 -- 172.21.15.125:0/3068627051 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186613915 0 0) 0x7f257409b110 con 0x7f257409ad40 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.317+0000 7f25737fe700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2574134570 0x7f257413b3d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f256c009d90 tx=0x7f256c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33818b602dc521e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f2571ffb700 1 -- 172.21.15.125:0/3068627051 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00e070 con 0x7f2574134570 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f2571ffb700 1 -- 172.21.15.125:0/3068627051 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00bb20 con 0x7f2574134570 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f2571ffb700 1 -- 172.21.15.125:0/3068627051 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c012430 con 0x7f2574134570 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 -- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2574134570 msgr2=0x7f257413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2574134570 0x7f257413b3d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f256c009d90 tx=0x7f256c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 -- 172.21.15.125:0/3068627051 shutdown_connections 2023-10-03T10:16:07.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2574134570 0x7f257413b3d0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 --2- 172.21.15.125:0/3068627051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f2574138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 -- 172.21.15.125:0/3068627051 >> 172.21.15.125:0/3068627051 conn(0x7f2574099c40 msgr2=0x7f257406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 -- 172.21.15.125:0/3068627051 shutdown_connections 2023-10-03T10:16:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.318+0000 7f257985e700 1 -- 172.21.15.125:0/3068627051 wait complete. 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.319+0000 7f257985e700 1 Processor -- start 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.319+0000 7f257985e700 1 -- start start 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f257411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2574134570 0x7f257411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257411f7d0 con 0x7f257409ad40 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740a4330 con 0x7f2574134140 2023-10-03T10:16:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f257985e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f257413a1e0 con 0x7f2574134570 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f25737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2574134570 0x7f257411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53006/0 (socket says 172.21.15.125:53006) 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 -- 172.21.15.125:0/3819410258 learned_addr learned my addr 172.21.15.125:0/3819410258 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f25727fc700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f257411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 -- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2574134570 msgr2=0x7f257411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2574134570 0x7f257411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 -- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 msgr2=0x7f257411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f257411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 -- 172.21.15.125:0/3819410258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c009a70 con 0x7f257409ad40 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f2572ffd700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f256400c520 tx=0x7f256400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.320+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564004c80 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564004de0 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257409c7e0 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564007310 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257411eb80 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2564007470 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.321+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f256403f3c0 con 0x7f257409ad40 2023-10-03T10:16:07.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.322+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25741361e0 con 0x7f257409ad40 2023-10-03T10:16:07.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.326+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25640123b0 con 0x7f257409ad40 2023-10-03T10:16:07.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.476+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f2c0a5660 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.476+0000 7f3f23fff700 1 -- 172.21.15.125:0/1236995750 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f1c02a030 con 0x7f3f2c0a0a70 2023-10-03T10:16:07.476 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 msgr2=0x7f3f2c1c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 0x7f3f2c1c8460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00efc0 tx=0x7f3f1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 shutdown_connections 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f2c133f50 0x7f3f2c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3f2c0a0a70 0x7f3f2c1c8460 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 --2- 172.21.15.125:0/1236995750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f2c0a1380 0x7f3f2c1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 >> 172.21.15.125:0/1236995750 conn(0x7f3f2c0a6610 msgr2=0x7f3f2c0a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 shutdown_connections 2023-10-03T10:16:07.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.479+0000 7f3f320b3700 1 -- 172.21.15.125:0/1236995750 wait complete. 2023-10-03T10:16:07.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:07.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.514+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f257404f2a0 con 0x7f257409ad40 2023-10-03T10:16:07.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.515+0000 7f255bfff700 1 -- 172.21.15.125:0/3819410258 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2564011360 con 0x7f257409ad40 2023-10-03T10:16:07.514 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:07.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 msgr2=0x7f257411c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f256400c520 tx=0x7f256400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 shutdown_connections 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2574134570 0x7f257411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257409ad40 0x7f257411c8c0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 --2- 172.21.15.125:0/3819410258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2574134140 0x7f257411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 >> 172.21.15.125:0/3819410258 conn(0x7f2574099c40 msgr2=0x7f257413b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 shutdown_connections 2023-10-03T10:16:07.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:07.517+0000 7f257985e700 1 -- 172.21.15.125:0/3819410258 wait complete. 2023-10-03T10:16:07.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:08.066 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:08.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:08.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 Processor -- start 2023-10-03T10:16:08.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 -- start start 2023-10-03T10:16:08.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9bb009ad40 0x7f9bb0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb009b110 con 0x7f9bb0133f70 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb00a3b60 con 0x7f9bb009ad40 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9bb561c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0134850 con 0x7f9bb01343d0 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.199+0000 7f9baeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9bb009ad40 0x7f9bb0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9bb009ad40 0x7f9bb0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53018/0 (socket says 172.21.15.125:53018) 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 -- 172.21.15.125:0/4237154438 learned_addr learned my addr 172.21.15.125:0/4237154438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baf7fe700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 -- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 msgr2=0x7f9bb00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 -- 172.21.15.125:0/4237154438 >> v1:172.21.15.125:6789/0 conn(0x7f9bb0133f70 legacy=0x7f9bb00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 -- 172.21.15.125:0/4237154438 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00a2fa0 con 0x7f9bb009ad40 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9badffb700 1 -- 172.21.15.125:0/4237154438 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788515396 0 0) 0x7f9bb009b110 con 0x7f9bb0133f70 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baf7fe700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9baeffd700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb0133a30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00098f0 tx=0x7f9ba0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9c435bd1a4e0c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9badffb700 1 -- 172.21.15.125:0/4237154438 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0011830 con 0x7f9bb009ad40 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9badffb700 1 -- 172.21.15.125:0/4237154438 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0011990 con 0x7f9bb009ad40 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.200+0000 7f9badffb700 1 -- 172.21.15.125:0/4237154438 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0011d20 con 0x7f9bb009ad40 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 -- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 msgr2=0x7f9bb0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb0133a30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00098f0 tx=0x7f9ba0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 -- 172.21.15.125:0/4237154438 shutdown_connections 2023-10-03T10:16:08.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 --2- 172.21.15.125:0/4237154438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb0133a30 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 -- 172.21.15.125:0/4237154438 >> 172.21.15.125:0/4237154438 conn(0x7f9bb0099c40 msgr2=0x7f9bb006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 -- 172.21.15.125:0/4237154438 shutdown_connections 2023-10-03T10:16:08.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.201+0000 7f9bb561c700 1 -- 172.21.15.125:0/4237154438 wait complete. 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 Processor -- start 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 -- start start 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb011f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0120780 con 0x7f9bb009ad40 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0120590 con 0x7f9bb0133f70 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bb561c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb01224a0 con 0x7f9bb01343d0 2023-10-03T10:16:08.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9baf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb011f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bae7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9baf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb011f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55952/0 (socket says 172.21.15.125:55952) 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9bae7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53298/0 (socket says 172.21.15.125:53298) 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.202+0000 7f9baf7fe700 1 -- 172.21.15.125:0/55550435 learned_addr learned my addr 172.21.15.125:0/55550435 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 -- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 msgr2=0x7f9bb011f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb011f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 -- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 msgr2=0x7f9bb011ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 -- 172.21.15.125:0/55550435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8009a70 con 0x7f9bb009ad40 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9bae7fc700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9baeffd700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb011ea20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00a31c0 tx=0x7f9ba0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0004510 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba001e070 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00038e0 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba0009550 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.203+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb01221c0 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.204+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ba0003a40 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.204+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ba0040500 con 0x7f9bb009ad40 2023-10-03T10:16:08.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.204+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb004f2a0 con 0x7f9bb009ad40 2023-10-03T10:16:08.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.209+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ba0015070 con 0x7f9bb009ad40 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 Processor -- start 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 -- start start 2023-10-03T10:16:08.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d0406a770 0x7f6d0406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0409da80 con 0x7f6d0406b080 2023-10-03T10:16:08.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0409dce0 con 0x7f6d0406a770 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.238+0000 7f6d0a3ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0409eb20 con 0x7f6d04131ec0 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d0898a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d0406a770 0x7f6d0406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d0898a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53304/0 (socket says 172.21.15.125:53304) 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d0898a700 1 -- 172.21.15.125:0/2622597955 learned_addr learned my addr 172.21.15.125:0/2622597955 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 -- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 msgr2=0x7f6d04139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 -- 172.21.15.125:0/2622597955 >> v1:172.21.15.125:6789/0 conn(0x7f6d0406b080 legacy=0x7f6d041317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 -- 172.21.15.125:0/2622597955 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0409d860 con 0x7f6d0406a770 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d0898a700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d02ffd700 1 -- 172.21.15.125:0/2622597955 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216952611 0 0) 0x7f6d0409da80 con 0x7f6d0406b080 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d03fff700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0406ab40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009840 tx=0x7f6cf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4500a344c5bc8cad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d02ffd700 1 -- 172.21.15.125:0/2622597955 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011830 con 0x7f6d0406a770 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d02ffd700 1 -- 172.21.15.125:0/2622597955 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4011990 con 0x7f6d0406a770 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.239+0000 7f6d02ffd700 1 -- 172.21.15.125:0/2622597955 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011d20 con 0x7f6d0406a770 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 msgr2=0x7f6d0406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0406ab40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009840 tx=0x7f6cf4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/2622597955 shutdown_connections 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d04139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/2622597955 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0406ab40 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/2622597955 >> 172.21.15.125:0/2622597955 conn(0x7f6d04099c40 msgr2=0x7f6d040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/2622597955 shutdown_connections 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.240+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/2622597955 wait complete. 2023-10-03T10:16:08.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 Processor -- start 2023-10-03T10:16:08.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 -- start start 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0409ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d0406b080 0x7f6d0409b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041314c0 con 0x7f6d0406a770 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0409b8c0 con 0x7f6d04131ec0 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0a3ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041220d0 con 0x7f6d0406b080 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0898a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0409ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0898a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53308/0 (socket says 172.21.15.125:53308) 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d0898a700 1 -- 172.21.15.125:0/3096092515 learned_addr learned my addr 172.21.15.125:0/3096092515 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.241+0000 7f6d037fe700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d0406b080 0x7f6d0409b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 -- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d0406b080 msgr2=0x7f6d0409b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d0406b080 0x7f6d0409b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 -- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 msgr2=0x7f6d0409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0409ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 -- 172.21.15.125:0/3096092515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc009b30 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0898a700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00efc0 tx=0x7f6cfc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc018070 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc00f040 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf40094a0 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc003c20 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.242+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d041217b0 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.243+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cfc00c880 con 0x7f6d04131ec0 2023-10-03T10:16:08.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.243+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6cfc03f7f0 con 0x7f6d04131ec0 2023-10-03T10:16:08.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.243+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0409d2f0 con 0x7f6d04131ec0 2023-10-03T10:16:08.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.248+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cfc014480 con 0x7f6d04131ec0 2023-10-03T10:16:08.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.402+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9bb0120d80 con 0x7f9bb009ad40 2023-10-03T10:16:08.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.402+0000 7f9b977fe700 1 -- 172.21.15.125:0/55550435 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ba0035070 con 0x7f9bb009ad40 2023-10-03T10:16:08.401 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 msgr2=0x7f9bb011ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb011ea20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00a31c0 tx=0x7f9ba0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 shutdown_connections 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9bb01343d0 0x7f9bb011f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bb009ad40 0x7f9bb011ea20 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 --2- 172.21.15.125:0/55550435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9bb0133f70 0x7f9bb011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 >> 172.21.15.125:0/55550435 conn(0x7f9bb0099c40 msgr2=0x7f9bb01bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 shutdown_connections 2023-10-03T10:16:08.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.404+0000 7f9bb561c700 1 -- 172.21.15.125:0/55550435 wait complete. 2023-10-03T10:16:08.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.440+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6d0409cb20 con 0x7f6d04131ec0 2023-10-03T10:16:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.441+0000 7f6d00ff9700 1 -- 172.21.15.125:0/3096092515 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cfc01cbb0 con 0x7f6d04131ec0 2023-10-03T10:16:08.440 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:08.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 msgr2=0x7f6d041c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00efc0 tx=0x7f6cfc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 shutdown_connections 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d04131ec0 0x7f6d041c81b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0406a770 0x7f6d0409ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 --2- 172.21.15.125:0/3096092515 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6d0406b080 0x7f6d0409b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 >> 172.21.15.125:0/3096092515 conn(0x7f6d04099c40 msgr2=0x7f6d041b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 shutdown_connections 2023-10-03T10:16:08.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.443+0000 7f6d0a3ed700 1 -- 172.21.15.125:0/3096092515 wait complete. 2023-10-03T10:16:08.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:08.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:08.529 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 Processor -- start 2023-10-03T10:16:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 -- start start 2023-10-03T10:16:08.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 0x7fc6e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 0x7fc6e813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e809dc00 con 0x7fc6e80a1380 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e809ea90 con 0x7fc6e80a0a70 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6ee1b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e809dec0 con 0x7fc6e8134120 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6e77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 0x7fc6e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6dffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc6e80a1380 0x7fc6e8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57836/0 (socket says 172.21.15.125:57836) 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6dffff700 1 -- 172.21.15.125:0/1862352094 learned_addr learned my addr 172.21.15.125:0/1862352094 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.620+0000 7fc6e7fff700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 0x7fc6e813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e6ffd700 1 -- 172.21.15.125:0/1862352094 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082726033 0 0) 0x7fc6e809dc00 con 0x7fc6e80a1380 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e7fff700 1 -- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 msgr2=0x7fc6e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e7fff700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 0x7fc6e80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e7fff700 1 -- 172.21.15.125:0/1862352094 >> v1:172.21.15.125:6789/0 conn(0x7fc6e80a1380 legacy=0x7fc6e8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e7fff700 1 -- 172.21.15.125:0/1862352094 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e809e6a0 con 0x7fc6e8134120 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e77fe700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 0x7fc6e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e7fff700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 0x7fc6e813bce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009dc0 tx=0x7fc6e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fef6cdbbfeb7499 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e6ffd700 1 -- 172.21.15.125:0/1862352094 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000e070 con 0x7fc6e8134120 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e6ffd700 1 -- 172.21.15.125:0/1862352094 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000bb20 con 0x7fc6e8134120 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.621+0000 7fc6e6ffd700 1 -- 172.21.15.125:0/1862352094 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012430 con 0x7fc6e8134120 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 msgr2=0x7fc6e813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 0x7fc6e813bce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009dc0 tx=0x7fc6e000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/1862352094 shutdown_connections 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e8134120 0x7fc6e813bce0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/1862352094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e80a0a70 0x7fc6e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/1862352094 >> 172.21.15.125:0/1862352094 conn(0x7fc6e80a6610 msgr2=0x7fc6e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/1862352094 shutdown_connections 2023-10-03T10:16:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.622+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/1862352094 wait complete. 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 Processor -- start 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 -- start start 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e80a1380 0x7fc6e8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81258f0 con 0x7fc6e80a0a70 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8133640 con 0x7fc6e8134120 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6ee1b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81262f0 con 0x7fc6e80a1380 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53046/0 (socket says 172.21.15.125:53046) 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53322/0 (socket says 172.21.15.125:53322) 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 -- 172.21.15.125:0/3159832319 learned_addr learned my addr 172.21.15.125:0/3159832319 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6dffff700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e80a1380 0x7fc6e8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 -- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e80a1380 msgr2=0x7fc6e8122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e80a1380 0x7fc6e8122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 -- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 msgr2=0x7fc6e8123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.623+0000 7fc6e77fe700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e77fe700 1 -- 172.21.15.125:0/3159832319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80094a0 con 0x7fc6e80a0a70 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e7fff700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e77fe700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800ebe0 tx=0x7fc6d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800c850 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800c9b0 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009a70 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800cd40 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.624+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80a0430 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.625+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6d8013470 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.625+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8126a60 con 0x7fc6e80a0a70 2023-10-03T10:16:08.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.625+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6d803f770 con 0x7fc6e80a0a70 2023-10-03T10:16:08.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.630+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6d8013720 con 0x7fc6e80a0a70 2023-10-03T10:16:08.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.663+0000 7f359ec32700 1 Processor -- start 2023-10-03T10:16:08.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.663+0000 7f359ec32700 1 -- start start 2023-10-03T10:16:08.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.663+0000 7f359ec32700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 0x7f35980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359ec32700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 0x7f359813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359ec32700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359809dc00 con 0x7f35980a1380 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359ec32700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359809ea90 con 0x7f35980a0a70 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359ec32700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f359809dec0 con 0x7f3598134120 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359d1cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 0x7f359813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 0x7f35980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f3597fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f35980a1380 0x7f3598133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57848/0 (socket says 172.21.15.125:57848) 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f3597fff700 1 -- 172.21.15.125:0/2156690865 learned_addr learned my addr 172.21.15.125:0/2156690865 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 -- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 msgr2=0x7f359813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 0x7f359813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f35977fe700 1 -- 172.21.15.125:0/2156690865 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909661181 0 0) 0x7f359809dc00 con 0x7f35980a1380 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 -- 172.21.15.125:0/2156690865 >> v1:172.21.15.125:6789/0 conn(0x7f35980a1380 legacy=0x7f3598133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 -- 172.21.15.125:0/2156690865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359809e6a0 con 0x7f35980a0a70 2023-10-03T10:16:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359d1cf700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 0x7f359813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f359c9ce700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 0x7f35980a0e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f358c009870 tx=0x7f358c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c41bbff0e3495d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f35977fe700 1 -- 172.21.15.125:0/2156690865 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011830 con 0x7f35980a0a70 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f35977fe700 1 -- 172.21.15.125:0/2156690865 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c011990 con 0x7f35980a0a70 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.664+0000 7f35977fe700 1 -- 172.21.15.125:0/2156690865 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011d20 con 0x7f35980a0a70 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 -- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 msgr2=0x7f35980a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 0x7f35980a0e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f358c009870 tx=0x7f358c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 -- 172.21.15.125:0/2156690865 shutdown_connections 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3598134120 0x7f359813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 --2- 172.21.15.125:0/2156690865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35980a0a70 0x7f35980a0e40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 -- 172.21.15.125:0/2156690865 >> 172.21.15.125:0/2156690865 conn(0x7f35980a6610 msgr2=0x7f35980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 -- 172.21.15.125:0/2156690865 shutdown_connections 2023-10-03T10:16:08.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.665+0000 7f359ec32700 1 -- 172.21.15.125:0/2156690865 wait complete. 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.666+0000 7f359ec32700 1 Processor -- start 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.666+0000 7f359ec32700 1 -- start start 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.666+0000 7f359ec32700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.666+0000 7f359ec32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.666+0000 7f359ec32700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 0x7f35981c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359ec32700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3598126460 con 0x7f35980a1380 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359ec32700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3598124d80 con 0x7f3598134120 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359ec32700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3598126640 con 0x7f35980a0a70 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f3597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f3597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53050/0 (socket says 172.21.15.125:53050) 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56020/0 (socket says 172.21.15.125:56020) 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f3597fff700 1 -- 172.21.15.125:0/1935974074 learned_addr learned my addr 172.21.15.125:0/1935974074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359d1cf700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 0x7f35981c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 -- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 msgr2=0x7f35981c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 0x7f35981c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 -- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 msgr2=0x7f3598123b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 -- 172.21.15.125:0/1935974074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590009a70 con 0x7f35980a0a70 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f3597fff700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359d1cf700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 0x7f35981c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359c9ce700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f35980672b0 tx=0x7f358c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0044d0 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c01f070 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c0094a0 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0038c0 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.667+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35980a03e0 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.668+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f358c003a20 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.668+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3598125ea0 con 0x7f35980a0a70 2023-10-03T10:16:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.668+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f358c021070 con 0x7f35980a0a70 2023-10-03T10:16:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.673+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f358c003cd0 con 0x7f35980a0a70 2023-10-03T10:16:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.823+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6e804f2a0 con 0x7fc6e80a0a70 2023-10-03T10:16:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.823+0000 7fc6e4ff9700 1 -- 172.21.15.125:0/3159832319 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6d8021070 con 0x7fc6e80a0a70 2023-10-03T10:16:08.823 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:08.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 msgr2=0x7fc6e8122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800ebe0 tx=0x7fc6d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 shutdown_connections 2023-10-03T10:16:08.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6e8134120 0x7fc6e8123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6e80a0a70 0x7fc6e8122890 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 --2- 172.21.15.125:0/3159832319 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6e80a1380 0x7fc6e8122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 >> 172.21.15.125:0/3159832319 conn(0x7fc6e80a6610 msgr2=0x7fc6e809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 shutdown_connections 2023-10-03T10:16:08.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.825+0000 7fc6ee1b2700 1 -- 172.21.15.125:0/3159832319 wait complete. 2023-10-03T10:16:08.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:08.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.867+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f359804f2a0 con 0x7f35980a0a70 2023-10-03T10:16:08.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.868+0000 7f35957fa700 1 -- 172.21.15.125:0/1935974074 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f358c024b70 con 0x7f35980a0a70 2023-10-03T10:16:08.867 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:08.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 msgr2=0x7f3598123610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f35980672b0 tx=0x7f358c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 shutdown_connections 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3598134120 0x7f35981c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f35980a0a70 0x7f3598123610 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 --2- 172.21.15.125:0/1935974074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980a1380 0x7f3598123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 >> 172.21.15.125:0/1935974074 conn(0x7f35980a6610 msgr2=0x7f359809abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 shutdown_connections 2023-10-03T10:16:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:08.870+0000 7f359ec32700 1 -- 172.21.15.125:0/1935974074 wait complete. 2023-10-03T10:16:08.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:09.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:09.455 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.548+0000 7f6435d6c700 1 Processor -- start 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.548+0000 7f6435d6c700 1 -- start start 2023-10-03T10:16:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f6435d6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f6435d6c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6430133f70 0x7f64301343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f6435d6c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643009b110 con 0x7f64300a0a70 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f6435d6c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300a3b60 con 0x7f6430133f70 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f6435d6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64301348e0 con 0x7f643009ad40 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6430133f70 0x7f64301343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f64300a0a70 0x7f64300a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57862/0 (socket says 172.21.15.125:57862) 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53350/0 (socket says 172.21.15.125:53350) 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6430133f70 0x7f64301343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53066/0 (socket says 172.21.15.125:53066) 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642ffff700 1 -- 172.21.15.125:0/822343596 learned_addr learned my addr 172.21.15.125:0/822343596 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:09.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 -- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 msgr2=0x7f6430133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 -- 172.21.15.125:0/822343596 >> v1:172.21.15.125:6789/0 conn(0x7f64300a0a70 legacy=0x7f64300a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642effd700 1 -- 172.21.15.125:0/822343596 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64300a2fa0 con 0x7f6430133f70 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642e7fc700 1 -- 172.21.15.125:0/822343596 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788085839 0 0) 0x7f643009b110 con 0x7f64300a0a70 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.549+0000 7f642f7fe700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.550+0000 7f642effd700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6430133f70 0x7f64301343a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6418009840 tx=0x7f6418009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99065ebc7e8a9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.550+0000 7f642e7fc700 1 -- 172.21.15.125:0/822343596 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418011830 con 0x7f6430133f70 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.550+0000 7f642e7fc700 1 -- 172.21.15.125:0/822343596 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418011990 con 0x7f6430133f70 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.550+0000 7f642e7fc700 1 -- 172.21.15.125:0/822343596 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418011d20 con 0x7f6430133f70 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 -- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6430133f70 msgr2=0x7f64301343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6430133f70 0x7f64301343a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6418009840 tx=0x7f6418009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 -- 172.21.15.125:0/822343596 shutdown_connections 2023-10-03T10:16:09.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f6430133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 --2- 172.21.15.125:0/822343596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6430133f70 0x7f64301343a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 -- 172.21.15.125:0/822343596 >> 172.21.15.125:0/822343596 conn(0x7f6430099c40 msgr2=0x7f643006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 -- 172.21.15.125:0/822343596 shutdown_connections 2023-10-03T10:16:09.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.551+0000 7f6435d6c700 1 -- 172.21.15.125:0/822343596 wait complete. 2023-10-03T10:16:09.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 Processor -- start 2023-10-03T10:16:09.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 -- start start 2023-10-03T10:16:09.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 0x7f64301c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 0x7f64301c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430120be0 con 0x7f64300a0a70 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643009c850 con 0x7f643009ad40 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f6435d6c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6430120740 con 0x7f6430133f70 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f642f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f642ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 0x7f64301c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f642f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53362/0 (socket says 172.21.15.125:53362) 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f642f7fe700 1 -- 172.21.15.125:0/3218957072 learned_addr learned my addr 172.21.15.125:0/3218957072 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.552+0000 7f642effd700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 0x7f64301c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 -- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 msgr2=0x7f64301c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 -- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 msgr2=0x7f64301c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 0x7f64301c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 -- 172.21.15.125:0/3218957072 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280094a0 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642f7fe700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642effd700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 0x7f64301c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f642ffff700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 0x7f64301c8ba0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f642000cbe0 tx=0x7f642000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000aa40 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642000abc0 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180094a0 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200070d0 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.553+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64301221f0 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.554+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6420007230 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.554+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f642003f390 con 0x7f6430133f70 2023-10-03T10:16:09.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.554+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64301223e0 con 0x7f6430133f70 2023-10-03T10:16:09.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.559+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f642001a8b0 con 0x7f6430133f70 2023-10-03T10:16:09.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.587+0000 7f70ae753700 1 Processor -- start 2023-10-03T10:16:09.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 -- start start 2023-10-03T10:16:09.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 0x7f70a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 0x7f70a813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a809dc00 con 0x7f70a80a1380 2023-10-03T10:16:09.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a809ea90 con 0x7f70a8134120 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70ae753700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a809dec0 con 0x7f70a80a0a70 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 0x7f70a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f70a80a1380 0x7f70a8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57872/0 (socket says 172.21.15.125:57872) 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a77fe700 1 -- 172.21.15.125:0/1381216099 learned_addr learned my addr 172.21.15.125:0/1381216099 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70accf0700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 0x7f70a813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a6ffd700 1 -- 172.21.15.125:0/1381216099 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254068034 0 0) 0x7f70a809dc00 con 0x7f70a80a1380 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a6ffd700 1 -- 172.21.15.125:0/1381216099 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70900035b0 con 0x7f70a80a1380 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a7fff700 1 -- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 msgr2=0x7f70a813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a7fff700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 0x7f70a813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.588+0000 7f70a7fff700 1 -- 172.21.15.125:0/1381216099 >> v1:172.21.15.125:6789/0 conn(0x7f70a80a1380 legacy=0x7f70a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70a7fff700 1 -- 172.21.15.125:0/1381216099 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a809e6a0 con 0x7f70a80a0a70 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70accf0700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 0x7f70a813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70a7fff700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 0x7f70a80a0e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7098009870 tx=0x7f7098009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30eaf5525f9e204 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70a6ffd700 1 -- 172.21.15.125:0/1381216099 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098011830 con 0x7f70a80a0a70 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70a6ffd700 1 -- 172.21.15.125:0/1381216099 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098011990 con 0x7f70a80a0a70 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70a6ffd700 1 -- 172.21.15.125:0/1381216099 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098011d20 con 0x7f70a80a0a70 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 -- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 msgr2=0x7f70a80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 0x7f70a80a0e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7098009870 tx=0x7f7098009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 -- 172.21.15.125:0/1381216099 shutdown_connections 2023-10-03T10:16:09.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a8134120 0x7f70a813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 --2- 172.21.15.125:0/1381216099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a0a70 0x7f70a80a0e40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 -- 172.21.15.125:0/1381216099 >> 172.21.15.125:0/1381216099 conn(0x7f70a80a6610 msgr2=0x7f70a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.589+0000 7f70ae753700 1 -- 172.21.15.125:0/1381216099 shutdown_connections 2023-10-03T10:16:09.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.590+0000 7f70ae753700 1 -- 172.21.15.125:0/1381216099 wait complete. 2023-10-03T10:16:09.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 Processor -- start 2023-10-03T10:16:09.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 -- start start 2023-10-03T10:16:09.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a1380 0x7f70a8122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 0x7f70a81231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8126290 con 0x7f70a8134120 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8125900 con 0x7f70a80a0a70 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.591+0000 7f70ae753700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81242f0 con 0x7f70a80a1380 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53378/0 (socket says 172.21.15.125:53378) 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70accf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 0x7f70a81231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 -- 172.21.15.125:0/1015767538 learned_addr learned my addr 172.21.15.125:0/1015767538 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a77fe700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a1380 0x7f70a8122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 -- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a1380 msgr2=0x7f70a8122c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a1380 0x7f70a8122c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 -- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 msgr2=0x7f70a81231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 0x7f70a81231b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 -- 172.21.15.125:0/1015767538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0009a70 con 0x7f70a80a0a70 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70accf0700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 0x7f70a81231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a7fff700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098004450 con 0x7f70a80a0a70 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709801f070 con 0x7f70a80a0a70 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70980094a0 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980038e0 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.592+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a8133630 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.593+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7098003a40 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.593+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7098021070 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.593+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a804f2a0 con 0x7f70a80a0a70 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.598+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f709801a430 con 0x7f70a80a0a70 2023-10-03T10:16:09.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.750+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f643004f2a0 con 0x7f6430133f70 2023-10-03T10:16:09.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.750+0000 7f6427fff700 1 -- 172.21.15.125:0/3218957072 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6420018020 con 0x7f6430133f70 2023-10-03T10:16:09.750 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 msgr2=0x7f64301c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 0x7f64301c8ba0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f642000cbe0 tx=0x7f642000cef0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 shutdown_connections 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6430133f70 0x7f64301c8ba0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f643009ad40 0x7f64301c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 --2- 172.21.15.125:0/3218957072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64300a0a70 0x7f64301c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 >> 172.21.15.125:0/3218957072 conn(0x7f6430099c40 msgr2=0x7f64301bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 shutdown_connections 2023-10-03T10:16:09.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.752+0000 7f6435d6c700 1 -- 172.21.15.125:0/3218957072 wait complete. 2023-10-03T10:16:09.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:09.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.785+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70a81260d0 con 0x7f70a80a0a70 2023-10-03T10:16:09.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.785+0000 7f70a4ff9700 1 -- 172.21.15.125:0/1015767538 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70a81260d0 con 0x7f70a80a0a70 2023-10-03T10:16:09.785 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:09.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.787+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 msgr2=0x7f70a8122730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.787+0000 7f70ae753700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7098000c00 tx=0x7f7098004750 comp rx=0 tx=0).stop 2023-10-03T10:16:09.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 shutdown_connections 2023-10-03T10:16:09.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70a8134120 0x7f70a81231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70a80a0a70 0x7f70a8122730 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 --2- 172.21.15.125:0/1015767538 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70a80a1380 0x7f70a8122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 >> 172.21.15.125:0/1015767538 conn(0x7f70a80a6610 msgr2=0x7f70a811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 shutdown_connections 2023-10-03T10:16:09.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.788+0000 7f70ae753700 1 -- 172.21.15.125:0/1015767538 wait complete. 2023-10-03T10:16:09.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:09.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:09.882 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 Processor -- start 2023-10-03T10:16:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 -- start start 2023-10-03T10:16:09.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 0x7fee8413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8406bec0 con 0x7fee8409f180 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8406ce60 con 0x7fee8409e870 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.966+0000 7fee89fbc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee8409fa00 con 0x7fee841343a0 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53090/0 (socket says 172.21.15.125:53090) 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee837fe700 1 -- 172.21.15.125:0/1448380374 learned_addr learned my addr 172.21.15.125:0/1448380374 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 --2- 172.21.15.125:0/1448380374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 0x7fee8413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 -- 172.21.15.125:0/1448380374 >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 msgr2=0x7fee8409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 --2- 172.21.15.125:0/1448380374 >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 -- 172.21.15.125:0/1448380374 >> v1:172.21.15.125:6789/0 conn(0x7fee8409f180 legacy=0x7fee84133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 -- 172.21.15.125:0/1448380374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8409ad80 con 0x7fee841343a0 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee837fe700 1 --2- 172.21.15.125:0/1448380374 >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee827fc700 1 -- 172.21.15.125:0/1448380374 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218452792 0 0) 0x7fee8406bec0 con 0x7fee8409f180 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee83fff700 1 --2- 172.21.15.125:0/1448380374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 0x7fee8413bf60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009840 tx=0x7fee7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df6ba3bd29eac2f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee827fc700 1 -- 172.21.15.125:0/1448380374 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c011830 con 0x7fee841343a0 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee827fc700 1 -- 172.21.15.125:0/1448380374 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c011990 con 0x7fee841343a0 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.967+0000 7fee827fc700 1 -- 172.21.15.125:0/1448380374 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c011d20 con 0x7fee841343a0 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 -- 172.21.15.125:0/1448380374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 msgr2=0x7fee8413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 --2- 172.21.15.125:0/1448380374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 0x7fee8413bf60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009840 tx=0x7fee7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 -- 172.21.15.125:0/1448380374 shutdown_connections 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 --2- 172.21.15.125:0/1448380374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee841343a0 0x7fee8413bf60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 --2- 172.21.15.125:0/1448380374 >> v2:172.21.15.125:3300/0 conn(0x7fee8409e870 0x7fee8409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 -- 172.21.15.125:0/1448380374 >> 172.21.15.125:0/1448380374 conn(0x7fee840a4430 msgr2=0x7fee840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 -- 172.21.15.125:0/1448380374 shutdown_connections 2023-10-03T10:16:09.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.968+0000 7fee89fbc700 1 -- 172.21.15.125:0/1448380374 wait complete. 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 Processor -- start 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 -- start start 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 0x7fee84122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 0x7fee841233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee841261d0 con 0x7fee841343a0 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee841263b0 con 0x7fee8409e870 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee89fbc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee84126f90 con 0x7fee8409f180 2023-10-03T10:16:09.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee82ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.969+0000 7fee82ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56062/0 (socket says 172.21.15.125:56062) 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 -- 172.21.15.125:0/718040236 learned_addr learned my addr 172.21.15.125:0/718040236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee837fe700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 0x7fee84122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee83fff700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 0x7fee841233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 -- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 msgr2=0x7fee84122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 0x7fee84122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 -- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 msgr2=0x7fee841233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 0x7fee841233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 -- 172.21.15.125:0/718040236 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009b30 con 0x7fee8409f180 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee837fe700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 0x7fee84122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee83fff700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 0x7fee841233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee82ffd700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee6c001eb0 tx=0x7fee6c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0054e0 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c003680 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0039f0 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c0094a0 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.970+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84124980 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.971+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee6c003b50 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.971+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8406c660 con 0x7fee8409f180 2023-10-03T10:16:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.971+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee6c03eb40 con 0x7fee8409f180 2023-10-03T10:16:09.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:09.976+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee6c017080 con 0x7fee8409f180 2023-10-03T10:16:10.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.008+0000 7f7470937700 1 Processor -- start 2023-10-03T10:16:10.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.008+0000 7f7470937700 1 -- start start 2023-10-03T10:16:10.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7470937700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7470937700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 0x7f746c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7470937700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c09c970 con 0x7f746c09e870 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7470937700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c0a0920 con 0x7f746c1371c0 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7470937700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c09f9c0 con 0x7f746c09f350 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53402/0 (socket says 172.21.15.125:53402) 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 -- 172.21.15.125:0/2689181632 learned_addr learned my addr 172.21.15.125:0/2689181632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746ad9d700 1 --2- 172.21.15.125:0/2689181632 >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 0x7f746c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746959a700 1 -- 172.21.15.125:0/2689181632 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974966946 0 0) 0x7f746c09c970 con 0x7f746c09e870 2023-10-03T10:16:10.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 -- 172.21.15.125:0/2689181632 >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 msgr2=0x7f746c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 --2- 172.21.15.125:0/2689181632 >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 0x7f746c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 -- 172.21.15.125:0/2689181632 >> v1:172.21.15.125:6789/0 conn(0x7f746c09e870 legacy=0x7f746c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 -- 172.21.15.125:0/2689181632 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c09bab0 con 0x7f746c09f350 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746ad9d700 1 --2- 172.21.15.125:0/2689181632 >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 0x7f746c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f7469d9b700 1 --2- 172.21.15.125:0/2689181632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f74600098f0 tx=0x7f7460009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893d42148487efbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746959a700 1 -- 172.21.15.125:0/2689181632 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011830 con 0x7f746c09f350 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746959a700 1 -- 172.21.15.125:0/2689181632 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460011990 con 0x7f746c09f350 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.009+0000 7f746959a700 1 -- 172.21.15.125:0/2689181632 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011d20 con 0x7f746c09f350 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 -- 172.21.15.125:0/2689181632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 msgr2=0x7f746c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 --2- 172.21.15.125:0/2689181632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f74600098f0 tx=0x7f7460009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 -- 172.21.15.125:0/2689181632 shutdown_connections 2023-10-03T10:16:10.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 --2- 172.21.15.125:0/2689181632 >> v2:172.21.15.125:3300/0 conn(0x7f746c1371c0 0x7f746c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 --2- 172.21.15.125:0/2689181632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c136c80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 -- 172.21.15.125:0/2689181632 >> 172.21.15.125:0/2689181632 conn(0x7f746c0a4430 msgr2=0x7f746c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 -- 172.21.15.125:0/2689181632 shutdown_connections 2023-10-03T10:16:10.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.010+0000 7f7470937700 1 -- 172.21.15.125:0/2689181632 wait complete. 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.011+0000 7f7470937700 1 Processor -- start 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.011+0000 7f7470937700 1 -- start start 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f746c1371c0 0x7f746c121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c123af0 con 0x7f746c09e870 2023-10-03T10:16:10.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c122c60 con 0x7f746c09f350 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7470937700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746c072250 con 0x7f746c1371c0 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f746a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7469d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f746a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53098/0 (socket says 172.21.15.125:53098) 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f746a59c700 1 -- 172.21.15.125:0/379388932 learned_addr learned my addr 172.21.15.125:0/379388932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f746ad9d700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f746c1371c0 0x7f746c121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7469d9b700 1 -- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f746c1371c0 msgr2=0x7f746c121360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7469d9b700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f746c1371c0 0x7f746c121360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7469d9b700 1 -- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 msgr2=0x7f746c1208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.012+0000 7f7469d9b700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f7469d9b700 1 -- 172.21.15.125:0/379388932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464009a70 con 0x7f746c09f350 2023-10-03T10:16:10.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f746a59c700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f7469d9b700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c120e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7460016000 tx=0x7f7460004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460004300 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746001f070 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7460009550 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600036a0 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.013+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c09dc00 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.014+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7460021030 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.014+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7460040880 con 0x7f746c09f350 2023-10-03T10:16:10.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.014+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c06ad00 con 0x7f746c09f350 2023-10-03T10:16:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.023+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7460015080 con 0x7f746c09f350 2023-10-03T10:16:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.172+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee84125ff0 con 0x7fee8409f180 2023-10-03T10:16:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.172+0000 7fee7bfff700 1 -- 172.21.15.125:0/718040236 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee6c01b3b0 con 0x7fee8409f180 2023-10-03T10:16:10.172 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 msgr2=0x7fee84122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee6c001eb0 tx=0x7fee6c00c800 comp rx=0 tx=0).stop 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 shutdown_connections 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee841343a0 0x7fee841233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee8409e870 0x7fee84122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 --2- 172.21.15.125:0/718040236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee8409f180 0x7fee84122ea0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 >> 172.21.15.125:0/718040236 conn(0x7fee840a4430 msgr2=0x7fee84070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 shutdown_connections 2023-10-03T10:16:10.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.174+0000 7fee89fbc700 1 -- 172.21.15.125:0/718040236 wait complete. 2023-10-03T10:16:10.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:10.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.215+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f746c04f2a0 con 0x7f746c09f350 2023-10-03T10:16:10.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.215+0000 7f745affd700 1 -- 172.21.15.125:0/379388932 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74600239c0 con 0x7f746c09f350 2023-10-03T10:16:10.214 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 msgr2=0x7f746c120e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c120e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7460016000 tx=0x7f7460004750 comp rx=0 tx=0).stop 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 shutdown_connections 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f746c1371c0 0x7f746c121360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f746c09e870 0x7f746c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 --2- 172.21.15.125:0/379388932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f746c09f350 0x7f746c120e20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 >> 172.21.15.125:0/379388932 conn(0x7f746c0a4430 msgr2=0x7f746c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 shutdown_connections 2023-10-03T10:16:10.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.217+0000 7f7470937700 1 -- 172.21.15.125:0/379388932 wait complete. 2023-10-03T10:16:10.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:10.764 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:10.800 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.892+0000 7f2c1190f700 1 Processor -- start 2023-10-03T10:16:10.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.892+0000 7f2c1190f700 1 -- start start 2023-10-03T10:16:10.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c1190f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c1190f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 0x7f2c0c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c1190f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c09aaa0 con 0x7f2c0c09d860 2023-10-03T10:16:10.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c1190f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c09e730 con 0x7f2c0c09e340 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c1190f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c09f870 con 0x7f2c0c135f20 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 0x7f2c0c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53428/0 (socket says 172.21.15.125:53428) 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2c0c09d860 0x7f2c0c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57908/0 (socket says 172.21.15.125:57908) 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0a7fc700 1 -- 172.21.15.125:0/1499345098 learned_addr learned my addr 172.21.15.125:0/1499345098 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0b7fe700 1 -- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 msgr2=0x7f2c0c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0b7fe700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c09ffb700 1 -- 172.21.15.125:0/1499345098 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162143345 0 0) 0x7f2c0c09aaa0 con 0x7f2c0c09d860 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0b7fe700 1 -- 172.21.15.125:0/1499345098 >> v1:172.21.15.125:6789/0 conn(0x7f2c0c09d860 legacy=0x7f2c0c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0b7fe700 1 -- 172.21.15.125:0/1499345098 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c09b360 con 0x7f2c0c135f20 2023-10-03T10:16:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.893+0000 7f2c0a7fc700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c0b7fe700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 0x7f2c0c138300 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d050 tx=0x7f2c0400d360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a1e1d4595b6a1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c09ffb700 1 -- 172.21.15.125:0/1499345098 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04010070 con 0x7f2c0c135f20 2023-10-03T10:16:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c09ffb700 1 -- 172.21.15.125:0/1499345098 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0400b2e0 con 0x7f2c0c135f20 2023-10-03T10:16:10.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c09ffb700 1 -- 172.21.15.125:0/1499345098 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400dc60 con 0x7f2c0c135f20 2023-10-03T10:16:10.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 -- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 msgr2=0x7f2c0c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 0x7f2c0c138300 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d050 tx=0x7f2c0400d360 comp rx=0 tx=0).stop 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 -- 172.21.15.125:0/1499345098 shutdown_connections 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c135f20 0x7f2c0c138300 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1499345098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09e340 0x7f2c0c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 -- 172.21.15.125:0/1499345098 >> 172.21.15.125:0/1499345098 conn(0x7f2c0c099c40 msgr2=0x7f2c0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 -- 172.21.15.125:0/1499345098 shutdown_connections 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.894+0000 7f2c1190f700 1 -- 172.21.15.125:0/1499345098 wait complete. 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.895+0000 7f2c1190f700 1 Processor -- start 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 -- start start 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 0x7f2c0c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 0x7f2c0c1207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c1225c0 con 0x7f2c0c135f20 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c1223d0 con 0x7f2c0c09d860 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c1190f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c133150 con 0x7f2c0c09e340 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 0x7f2c0c1207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56088/0 (socket says 172.21.15.125:56088) 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 -- 172.21.15.125:0/1216756535 learned_addr learned my addr 172.21.15.125:0/1216756535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0affd700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 0x7f2c0c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 -- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 msgr2=0x7f2c0c1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 0x7f2c0c1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 -- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 msgr2=0x7f2c0c1207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 0x7f2c0c1207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0a7fc700 1 -- 172.21.15.125:0/1216756535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009550 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0affd700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 0x7f2c0c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.896+0000 7f2c0b7fe700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 0x7f2c0c1207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2c0a7fc700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000ebe0 tx=0x7f2c0000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000c850 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000c9b0 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000cd40 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0400bc80 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.897+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0c122980 con 0x7f2c0c09e340 2023-10-03T10:16:10.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.898+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c00013470 con 0x7f2c0c09e340 2023-10-03T10:16:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.898+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c0003f850 con 0x7f2c0c09e340 2023-10-03T10:16:10.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.898+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0c09c8b0 con 0x7f2c0c09e340 2023-10-03T10:16:10.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.906+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c000232f0 con 0x7f2c0c09e340 2023-10-03T10:16:10.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.937+0000 7fde81d6f700 1 Processor -- start 2023-10-03T10:16:10.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.937+0000 7fde81d6f700 1 -- start start 2023-10-03T10:16:10.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde81d6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde81d6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 0x7fde7c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde81d6f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c06b2d0 con 0x7fde7c133ad0 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde81d6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1345b0 con 0x7fde7c136960 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde81d6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c133610 con 0x7fde7c139280 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53444/0 (socket says 172.21.15.125:53444) 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 -- 172.21.15.125:0/1468641252 learned_addr learned my addr 172.21.15.125:0/1468641252 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7bfff700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 0x7fde7c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 -- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 msgr2=0x7fde7c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7a7fc700 1 -- 172.21.15.125:0/1468641252 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995147382 0 0) 0x7fde7c06b2d0 con 0x7fde7c133ad0 2023-10-03T10:16:10.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 0x7fde7c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 -- 172.21.15.125:0/1468641252 >> v1:172.21.15.125:6789/0 conn(0x7fde7c133ad0 legacy=0x7fde7c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 -- 172.21.15.125:0/1468641252 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c09a500 con 0x7fde7c136960 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7bfff700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 0x7fde7c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7affd700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fde70009920 tx=0x7fde70009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d93ac6aadeaa5dbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.938+0000 7fde7a7fc700 1 -- 172.21.15.125:0/1468641252 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70011830 con 0x7fde7c136960 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde7a7fc700 1 -- 172.21.15.125:0/1468641252 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70011990 con 0x7fde7c136960 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde7a7fc700 1 -- 172.21.15.125:0/1468641252 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70011d20 con 0x7fde7c136960 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 -- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 msgr2=0x7fde7c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fde70009920 tx=0x7fde70009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 -- 172.21.15.125:0/1468641252 shutdown_connections 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c139280 0x7fde7c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 --2- 172.21.15.125:0/1468641252 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c138d40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 -- 172.21.15.125:0/1468641252 >> 172.21.15.125:0/1468641252 conn(0x7fde7c099c40 msgr2=0x7fde7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 -- 172.21.15.125:0/1468641252 shutdown_connections 2023-10-03T10:16:10.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.939+0000 7fde81d6f700 1 -- 172.21.15.125:0/1468641252 wait complete. 2023-10-03T10:16:10.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.940+0000 7fde81d6f700 1 Processor -- start 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.940+0000 7fde81d6f700 1 -- start start 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 0x7fde7c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1302f0 con 0x7fde7c139280 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c072600 con 0x7fde7c136960 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c12dd00 con 0x7fde7c133ad0 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56102/0 (socket says 172.21.15.125:56102) 2023-10-03T10:16:10.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 -- 172.21.15.125:0/2103004404 learned_addr learned my addr 172.21.15.125:0/2103004404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7bfff700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 0x7fde7c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 -- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 msgr2=0x7fde7c12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 -- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 msgr2=0x7fde7c12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 0x7fde7c12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 -- 172.21.15.125:0/2103004404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009a70 con 0x7fde7c133ad0 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7affd700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7bfff700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 0x7fde7c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde7b7fe700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00c450 tx=0x7fde6c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0054e0 con 0x7fde7c133ad0 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ce50 con 0x7fde7c133ad0 2023-10-03T10:16:10.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde70009550 con 0x7fde7c133ad0 2023-10-03T10:16:10.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0038c0 con 0x7fde7c133ad0 2023-10-03T10:16:10.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.941+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c06fa10 con 0x7fde7c133ad0 2023-10-03T10:16:10.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.942+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde6c003a20 con 0x7fde7c133ad0 2023-10-03T10:16:10.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.942+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde6c03eb40 con 0x7fde7c133ad0 2023-10-03T10:16:10.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.942+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c04f2a0 con 0x7fde7c133ad0 2023-10-03T10:16:10.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:10.947+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde6c017020 con 0x7fde7c133ad0 2023-10-03T10:16:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.100+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c0c04f2a0 con 0x7f2c0c09e340 2023-10-03T10:16:11.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.100+0000 7f2bf3fff700 1 -- 172.21.15.125:0/1216756535 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c00017020 con 0x7f2c0c09e340 2023-10-03T10:16:11.100 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.102+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 msgr2=0x7f2c0c1c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.102+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000ebe0 tx=0x7f2c0000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 shutdown_connections 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c0c135f20 0x7f2c0c1207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c0c09d860 0x7f2c0c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 --2- 172.21.15.125:0/1216756535 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2c0c09e340 0x7f2c0c1c8a20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 >> 172.21.15.125:0/1216756535 conn(0x7f2c0c099c40 msgr2=0x7f2c0c0a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 shutdown_connections 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.103+0000 7f2c1190f700 1 -- 172.21.15.125:0/1216756535 wait complete. 2023-10-03T10:16:11.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:11.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.141+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde7c06c3b0 con 0x7fde7c133ad0 2023-10-03T10:16:11.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.142+0000 7fde63fff700 1 -- 172.21.15.125:0/2103004404 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde6c019b20 con 0x7fde7c133ad0 2023-10-03T10:16:11.141 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 msgr2=0x7fde7c12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00c450 tx=0x7fde6c00c760 comp rx=0 tx=0).stop 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 shutdown_connections 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7c139280 0x7fde7c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde7c133ad0 0x7fde7c12cb30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 --2- 172.21.15.125:0/2103004404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde7c136960 0x7fde7c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 >> 172.21.15.125:0/2103004404 conn(0x7fde7c099c40 msgr2=0x7fde7c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 shutdown_connections 2023-10-03T10:16:11.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.144+0000 7fde81d6f700 1 -- 172.21.15.125:0/2103004404 wait complete. 2023-10-03T10:16:11.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:11.186 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:11.229 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:11.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 Processor -- start 2023-10-03T10:16:11.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 -- start start 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbf6c0a0a70 0x7fbf6c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c09dc00 con 0x7fbf6c133f50 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c09ea60 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf7203e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c09dec0 con 0x7fbf6c0a1380 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf6affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf6affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56116/0 (socket says 172.21.15.125:56116) 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf6bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbf6c133f50 0x7fbf6c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57930/0 (socket says 172.21.15.125:57930) 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf6affd700 1 -- 172.21.15.125:0/1557679170 learned_addr learned my addr 172.21.15.125:0/1557679170 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:11.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.322+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/1557679170 >> v2:172.21.15.125:3300/0 conn(0x7fbf6c0a0a70 0x7fbf6c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 msgr2=0x7fbf6c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/1557679170 >> v1:172.21.15.125:6789/0 conn(0x7fbf6c133f50 legacy=0x7fbf6c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/1557679170 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c09e6a0 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6a7fc700 1 -- 172.21.15.125:0/1557679170 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189242284 0 0) 0x7fbf6c09dc00 con 0x7fbf6c133f50 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6affd700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c0a0e40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009840 tx=0x7fbf5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b89077a7483207 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6a7fc700 1 -- 172.21.15.125:0/1557679170 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011830 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6a7fc700 1 -- 172.21.15.125:0/1557679170 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c011990 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.323+0000 7fbf6a7fc700 1 -- 172.21.15.125:0/1557679170 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c011d20 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 -- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 msgr2=0x7fbf6c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c0a0e40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009840 tx=0x7fbf5c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:11.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 -- 172.21.15.125:0/1557679170 shutdown_connections 2023-10-03T10:16:11.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c0a0e40 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 --2- 172.21.15.125:0/1557679170 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c0a1380 0x7fbf6c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 -- 172.21.15.125:0/1557679170 >> 172.21.15.125:0/1557679170 conn(0x7fbf6c0a6610 msgr2=0x7fbf6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 -- 172.21.15.125:0/1557679170 shutdown_connections 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.324+0000 7fbf7203e700 1 -- 172.21.15.125:0/1557679170 wait complete. 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 Processor -- start 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 -- start start 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf6c0a1380 0x7fbf6c11eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 0x7fbf6c11f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0a03e0 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c121bf0 con 0x7fbf6c0a1380 2023-10-03T10:16:11.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf7203e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c121eb0 con 0x7fbf6c133f50 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf6b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.325+0000 7fbf6b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53148/0 (socket says 172.21.15.125:53148) 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/2843040803 learned_addr learned my addr 172.21.15.125:0/2843040803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6bfff700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 0x7fbf6c11f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6affd700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf6c0a1380 0x7fbf6c11eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 msgr2=0x7fbf6c11f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 0x7fbf6c11f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf6c0a1380 msgr2=0x7fbf6c11eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf6c0a1380 0x7fbf6c11eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 -- 172.21.15.125:0/2843040803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009550 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6bfff700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 0x7fbf6c11f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf6b7fe700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fd0 tx=0x7fbf5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004550 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c01f070 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c0094a0 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0038e0 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.326+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c122920 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.327+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf5c003a40 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.327+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf5c021070 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.327+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c04f2a0 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.336+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf5c01a950 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 Processor -- start 2023-10-03T10:16:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 -- start start 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 0x7f12f809dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80720a0 con 0x7f12f809e240 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.368+0000 7f12ffdac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f806f970 con 0x7f12f809d8f0 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12ffdac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f809e6e0 con 0x7f12f8098410 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fe349700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fdb48700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 0x7f12f809dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fe349700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53160/0 (socket says 172.21.15.125:53160) 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fdb48700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56122/0 (socket says 172.21.15.125:56122) 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fe349700 1 -- 172.21.15.125:0/3854474658 learned_addr learned my addr 172.21.15.125:0/3854474658 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 -- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 msgr2=0x7f12f80987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 -- 172.21.15.125:0/3854474658 >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 msgr2=0x7f12f81387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 --2- 172.21.15.125:0/3854474658 >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 -- 172.21.15.125:0/3854474658 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8072290 con 0x7f12f809d8f0 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fdb48700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fe349700 1 --2- 172.21.15.125:0/3854474658 >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fd347700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 0x7f12f809dd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d2645cfa2e686 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fcb46700 1 -- 172.21.15.125:0/3854474658 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011830 con 0x7f12f809d8f0 2023-10-03T10:16:11.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fcb46700 1 -- 172.21.15.125:0/3854474658 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8011990 con 0x7f12f809d8f0 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.369+0000 7f12fcb46700 1 -- 172.21.15.125:0/3854474658 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011d20 con 0x7f12f809d8f0 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 -- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 msgr2=0x7f12f809dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 0x7f12f809dd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 -- 172.21.15.125:0/3854474658 shutdown_connections 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3854474658 >> v2:172.21.15.125:3300/0 conn(0x7f12f809e240 0x7f12f81387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f8098410 0x7f12f80987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3854474658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f809d8f0 0x7f12f809dd00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 -- 172.21.15.125:0/3854474658 >> 172.21.15.125:0/3854474658 conn(0x7f12f80a2b30 msgr2=0x7f12f809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 -- 172.21.15.125:0/3854474658 shutdown_connections 2023-10-03T10:16:11.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.370+0000 7f12ffdac700 1 -- 172.21.15.125:0/3854474658 wait complete. 2023-10-03T10:16:11.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.371+0000 7f12ffdac700 1 Processor -- start 2023-10-03T10:16:11.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.371+0000 7f12ffdac700 1 -- start start 2023-10-03T10:16:11.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f8098410 0x7f12f812cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12f809d8f0 0x7f12f812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80a1850 con 0x7f12f809d8f0 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8070880 con 0x7f12f8098410 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ffdac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f812b750 con 0x7f12f809e240 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fdb48700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f8098410 0x7f12f812cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56124/0 (socket says 172.21.15.125:56124) 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 -- 172.21.15.125:0/3829858076 learned_addr learned my addr 172.21.15.125:0/3829858076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fd347700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12f809d8f0 0x7f12f812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 -- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f8098410 msgr2=0x7f12f812cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f8098410 0x7f12f812cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 -- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12f809d8f0 msgr2=0x7f12f812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12f809d8f0 0x7f12f812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 -- 172.21.15.125:0/3829858076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009430 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12fe349700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f12f000f500 tx=0x7f12f000f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0012050 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.372+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0013040 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f000f050 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000bea0 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80094a0 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f0004030 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12f0044070 con 0x7f12f809e240 2023-10-03T10:16:11.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.373+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f804f2a0 con 0x7f12f809e240 2023-10-03T10:16:11.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.378+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f00042e0 con 0x7f12f809e240 2023-10-03T10:16:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.531+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf6c072980 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.532+0000 7fbf53fff700 1 -- 172.21.15.125:0/2843040803 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf5c010b70 con 0x7fbf6c0a0a70 2023-10-03T10:16:11.531 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 msgr2=0x7fbf6c11e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fd0 tx=0x7fbf5c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 shutdown_connections 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf6c133f50 0x7fbf6c11f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf6c0a0a70 0x7fbf6c11e860 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 --2- 172.21.15.125:0/2843040803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf6c0a1380 0x7fbf6c11eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.533+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 >> 172.21.15.125:0/2843040803 conn(0x7fbf6c0a6610 msgr2=0x7fbf6c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.534+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 shutdown_connections 2023-10-03T10:16:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.534+0000 7fbf7203e700 1 -- 172.21.15.125:0/2843040803 wait complete. 2023-10-03T10:16:11.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:11.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.571+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12f812c4b0 con 0x7f12f809e240 2023-10-03T10:16:11.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.572+0000 7f12ee7fc700 1 -- 172.21.15.125:0/3829858076 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12f00173c0 con 0x7f12f809e240 2023-10-03T10:16:11.571 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:11.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.573+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 msgr2=0x7f12f812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.573+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f12f000f500 tx=0x7f12f000f810 comp rx=0 tx=0).stop 2023-10-03T10:16:11.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 shutdown_connections 2023-10-03T10:16:11.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f12f809e240 0x7f12f812da70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12f8098410 0x7f12f812cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 --2- 172.21.15.125:0/3829858076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12f809d8f0 0x7f12f812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 >> 172.21.15.125:0/3829858076 conn(0x7f12f80a2b30 msgr2=0x7f12f809fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 shutdown_connections 2023-10-03T10:16:11.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:11.574+0000 7f12ffdac700 1 -- 172.21.15.125:0/3829858076 wait complete. 2023-10-03T10:16:11.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:12.115 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:12.156 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:12.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 Processor -- start 2023-10-03T10:16:12.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 -- start start 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a940a0a70 0x7f6a940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 0x7f6a94133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9409dc00 con 0x7f6a94133f50 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9409ea60 con 0x7f6a940a0a70 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.252+0000 7f6a9c1a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9409dec0 con 0x7f6a940a1380 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a940a0a70 0x7f6a940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99741700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 0x7f6a94133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a9a743700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6a94133f50 0x7f6a9413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57940/0 (socket says 172.21.15.125:57940) 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a9a743700 1 -- 172.21.15.125:0/2893686007 learned_addr learned my addr 172.21.15.125:0/2893686007 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 -- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 msgr2=0x7f6a94133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 0x7f6a94133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 -- 172.21.15.125:0/2893686007 >> v1:172.21.15.125:6789/0 conn(0x7f6a94133f50 legacy=0x7f6a9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a98f40700 1 -- 172.21.15.125:0/2893686007 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237435700 0 0) 0x7f6a9409dc00 con 0x7f6a94133f50 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 -- 172.21.15.125:0/2893686007 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9409e6a0 con 0x7f6a940a0a70 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99741700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 0x7f6a94133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a99f42700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a940a0e40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009840 tx=0x7f6a90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6007056259ca5f12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a98f40700 1 -- 172.21.15.125:0/2893686007 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90011830 con 0x7f6a940a0a70 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a98f40700 1 -- 172.21.15.125:0/2893686007 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90011990 con 0x7f6a940a0a70 2023-10-03T10:16:12.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.253+0000 7f6a98f40700 1 -- 172.21.15.125:0/2893686007 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90011d20 con 0x7f6a940a0a70 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 msgr2=0x7f6a940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a940a0e40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009840 tx=0x7f6a90009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2893686007 shutdown_connections 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a940a0e40 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2893686007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a940a1380 0x7f6a94133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2893686007 >> 172.21.15.125:0/2893686007 conn(0x7f6a940a6610 msgr2=0x7f6a940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2893686007 shutdown_connections 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.254+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2893686007 wait complete. 2023-10-03T10:16:12.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.255+0000 7f6a9c1a6700 1 Processor -- start 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.255+0000 7f6a9c1a6700 1 -- start start 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 0x7f6a94122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 0x7f6a94123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941261d0 con 0x7f6a940a0a70 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94133910 con 0x7f6a94133f50 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9c1a6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941333d0 con 0x7f6a940a1380 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99f42700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 0x7f6a94123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99f42700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53182/0 (socket says 172.21.15.125:53182) 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99f42700 1 -- 172.21.15.125:0/2350294059 learned_addr learned my addr 172.21.15.125:0/2350294059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99741700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 0x7f6a94122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 -- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 msgr2=0x7f6a94122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 0x7f6a94122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 -- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 msgr2=0x7f6a941228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a9a743700 1 -- 172.21.15.125:0/2350294059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840094a0 con 0x7f6a94133f50 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99f42700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.256+0000 7f6a99741700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 0x7f6a94122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a9a743700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 0x7f6a94123330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00cc10 tx=0x7f6a8c00cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00aa00 con 0x7f6a94133f50 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00ab80 con 0x7f6a94133f50 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900094a0 con 0x7f6a94133f50 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0070d0 con 0x7f6a94133f50 2023-10-03T10:16:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.257+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a940a0440 con 0x7f6a94133f50 2023-10-03T10:16:12.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.258+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a8c007230 con 0x7f6a94133f50 2023-10-03T10:16:12.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.258+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a8c03f3c0 con 0x7f6a94133f50 2023-10-03T10:16:12.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.258+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94126c20 con 0x7f6a94133f50 2023-10-03T10:16:12.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.263+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a8c018080 con 0x7f6a94133f50 2023-10-03T10:16:12.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.289+0000 7fb43d3e9700 1 Processor -- start 2023-10-03T10:16:12.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.289+0000 7fb43d3e9700 1 -- start start 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb4380a1380 0x7fb438133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43809e9d0 con 0x7fb4380a1380 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43809dc00 con 0x7fb438133f50 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb43d3e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43809dec0 con 0x7fb4380a0a70 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb436ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb436ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56152/0 (socket says 172.21.15.125:56152) 2023-10-03T10:16:12.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53508/0 (socket says 172.21.15.125:53508) 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb436ffd700 1 -- 172.21.15.125:0/23811518 learned_addr learned my addr 172.21.15.125:0/23811518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4367fc700 1 --2- 172.21.15.125:0/23811518 >> v2:172.21.15.125:3300/0 conn(0x7fb4380a1380 0x7fb438133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 -- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 msgr2=0x7fb4380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 -- 172.21.15.125:0/23811518 >> v2:172.21.15.125:3300/0 conn(0x7fb4380a1380 msgr2=0x7fb438133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 --2- 172.21.15.125:0/23811518 >> v2:172.21.15.125:3300/0 conn(0x7fb4380a1380 0x7fb438133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 -- 172.21.15.125:0/23811518 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43809e6a0 con 0x7fb438133f50 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb436ffd700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.290+0000 7fb4377fe700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb430009d90 tx=0x7fb43000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0b4d792fecafb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb435ffb700 1 -- 172.21.15.125:0/23811518 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000e070 con 0x7fb438133f50 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb435ffb700 1 -- 172.21.15.125:0/23811518 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000bb20 con 0x7fb438133f50 2023-10-03T10:16:12.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb435ffb700 1 -- 172.21.15.125:0/23811518 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430012430 con 0x7fb438133f50 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 -- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 msgr2=0x7fb438134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb430009d90 tx=0x7fb43000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 -- 172.21.15.125:0/23811518 shutdown_connections 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb438133f50 0x7fb438134380 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/23811518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb4380a0a70 0x7fb4380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/23811518 >> v2:172.21.15.125:3300/0 conn(0x7fb4380a1380 0x7fb438133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 -- 172.21.15.125:0/23811518 >> 172.21.15.125:0/23811518 conn(0x7fb4380a6610 msgr2=0x7fb4380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 -- 172.21.15.125:0/23811518 shutdown_connections 2023-10-03T10:16:12.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.291+0000 7fb43d3e9700 1 -- 172.21.15.125:0/23811518 wait complete. 2023-10-03T10:16:12.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.292+0000 7fb43d3e9700 1 Processor -- start 2023-10-03T10:16:12.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.292+0000 7fb43d3e9700 1 -- start start 2023-10-03T10:16:12.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4380a0a70 0x7fb4381c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb438122770 con 0x7fb4380a0a70 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb438120950 con 0x7fb4380a1380 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380a03e0 con 0x7fb438133f50 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4377fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4377fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56162/0 (socket says 172.21.15.125:56162) 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53516/0 (socket says 172.21.15.125:53516) 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4377fe700 1 -- 172.21.15.125:0/2521767744 learned_addr learned my addr 172.21.15.125:0/2521767744 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb436ffd700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4380a0a70 0x7fb4381c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 -- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 msgr2=0x7fb4381c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 -- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4380a0a70 msgr2=0x7fb4381c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4380a0a70 0x7fb4381c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 -- 172.21.15.125:0/2521767744 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009550 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4377fe700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb4367fc700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00e900 tx=0x7fb42c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00c640 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00c7a0 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb430009a70 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.293+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00cb10 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.294+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb438122e70 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.294+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb42c00cc70 con 0x7fb4380a1380 2023-10-03T10:16:12.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.294+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43804f2a0 con 0x7fb4380a1380 2023-10-03T10:16:12.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.294+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb42c03f980 con 0x7fb4380a1380 2023-10-03T10:16:12.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.299+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb42c017070 con 0x7fb4380a1380 2023-10-03T10:16:12.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.455+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a9404f2a0 con 0x7f6a94133f50 2023-10-03T10:16:12.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.455+0000 7f6a8a7fc700 1 -- 172.21.15.125:0/2350294059 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a8c0074e0 con 0x7f6a94133f50 2023-10-03T10:16:12.455 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 msgr2=0x7f6a94123330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 0x7f6a94123330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00cc10 tx=0x7f6a8c00cf20 comp rx=0 tx=0).stop 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 shutdown_connections 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a94133f50 0x7f6a94123330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a940a0a70 0x7f6a941228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 --2- 172.21.15.125:0/2350294059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a940a1380 0x7f6a94122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 >> 172.21.15.125:0/2350294059 conn(0x7f6a940a6610 msgr2=0x7f6a9409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 shutdown_connections 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.458+0000 7f6a9c1a6700 1 -- 172.21.15.125:0/2350294059 wait complete. 2023-10-03T10:16:12.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:12.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.488+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb438122340 con 0x7fb4380a1380 2023-10-03T10:16:12.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.489+0000 7fb41f7fe700 1 -- 172.21.15.125:0/2521767744 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb42c01abb0 con 0x7fb4380a1380 2023-10-03T10:16:12.488 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:12.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 msgr2=0x7fb4381c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00e900 tx=0x7fb42c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 shutdown_connections 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb438133f50 0x7fb4381c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4380a0a70 0x7fb4381c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 --2- 172.21.15.125:0/2521767744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4380a1380 0x7fb4381c8720 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 >> 172.21.15.125:0/2521767744 conn(0x7fb4380a6610 msgr2=0x7fb43809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 shutdown_connections 2023-10-03T10:16:12.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.491+0000 7fb43d3e9700 1 -- 172.21.15.125:0/2521767744 wait complete. 2023-10-03T10:16:12.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:12.546 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:12.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:12.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 Processor -- start 2023-10-03T10:16:12.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 -- start start 2023-10-03T10:16:12.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5809c970 con 0x7fbe58131d70 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe580a0920 con 0x7fbe5809e870 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5f916700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5809f9c0 con 0x7fbe5809f180 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5d6b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5ceb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5ceb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53520/0 (socket says 172.21.15.125:53520) 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5d6b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53228/0 (socket says 172.21.15.125:53228) 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5deb3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbe58131d70 0x7fbe58138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57948/0 (socket says 172.21.15.125:57948) 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.673+0000 7fbe5ceb1700 1 -- 172.21.15.125:0/798619221 learned_addr learned my addr 172.21.15.125:0/798619221 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5ceb1700 1 -- 172.21.15.125:0/798619221 >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 msgr2=0x7fbe5809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5ceb1700 1 --2- 172.21.15.125:0/798619221 >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5ceb1700 1 -- 172.21.15.125:0/798619221 >> v1:172.21.15.125:6789/0 conn(0x7fbe58131d70 legacy=0x7fbe58138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe4ffff700 1 -- 172.21.15.125:0/798619221 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012917875 0 0) 0x7fbe5809c970 con 0x7fbe58131d70 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5ceb1700 1 -- 172.21.15.125:0/798619221 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5809bab0 con 0x7fbe5809f180 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5d6b2700 1 --2- 172.21.15.125:0/798619221 >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe5ceb1700 1 --2- 172.21.15.125:0/798619221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbe480098f0 tx=0x7fbe48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d280b6fc36db82e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe4ffff700 1 -- 172.21.15.125:0/798619221 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48011830 con 0x7fbe5809f180 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe4ffff700 1 -- 172.21.15.125:0/798619221 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48011990 con 0x7fbe5809f180 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.674+0000 7fbe4ffff700 1 -- 172.21.15.125:0/798619221 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48011d20 con 0x7fbe5809f180 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 -- 172.21.15.125:0/798619221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 msgr2=0x7fbe58131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 --2- 172.21.15.125:0/798619221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbe480098f0 tx=0x7fbe48009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:12.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 -- 172.21.15.125:0/798619221 shutdown_connections 2023-10-03T10:16:12.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 --2- 172.21.15.125:0/798619221 >> v2:172.21.15.125:3300/0 conn(0x7fbe5809e870 0x7fbe5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 --2- 172.21.15.125:0/798619221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809f180 0x7fbe58131830 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 -- 172.21.15.125:0/798619221 >> 172.21.15.125:0/798619221 conn(0x7fbe580a4430 msgr2=0x7fbe580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 -- 172.21.15.125:0/798619221 shutdown_connections 2023-10-03T10:16:12.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.675+0000 7fbe5f916700 1 -- 172.21.15.125:0/798619221 wait complete. 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 Processor -- start 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 -- start start 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58121da0 con 0x7fbe58131d70 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58122db0 con 0x7fbe5809e870 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5f916700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe581228a0 con 0x7fbe5809f180 2023-10-03T10:16:12.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5deb3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5ceb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5d6b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5deb3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53242/0 (socket says 172.21.15.125:53242) 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5ceb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56178/0 (socket says 172.21.15.125:56178) 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5d6b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53526/0 (socket says 172.21.15.125:53526) 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.676+0000 7fbe5deb3700 1 -- 172.21.15.125:0/560964641 learned_addr learned my addr 172.21.15.125:0/560964641 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 -- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 msgr2=0x7fbe5811f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 -- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 msgr2=0x7fbe5811fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 -- 172.21.15.125:0/560964641 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540094a0 con 0x7fbe5809e870 2023-10-03T10:16:12.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5deb3700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5ceb1700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5d6b2700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400e900 tx=0x7fbe5400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54013680 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540137e0 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54013b70 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48009550 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.677+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe58130660 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.678+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5811be60 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.678+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe54013cd0 con 0x7fbe5809e870 2023-10-03T10:16:12.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.678+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe5403f620 con 0x7fbe5809e870 2023-10-03T10:16:12.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.687+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe5401bbe0 con 0x7fbe5809e870 2023-10-03T10:16:12.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.718+0000 7f37243d5700 1 Processor -- start 2023-10-03T10:16:12.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.718+0000 7f37243d5700 1 -- start start 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f37243d5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 0x7f371c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f37243d5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 0x7f371c13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f37243d5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c06bec0 con 0x7f371c09f180 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f37243d5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c06b990 con 0x7f371c134330 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f37243d5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0a0870 con 0x7f371c09e870 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722972700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 0x7f371c13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3721970700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f371c09f180 0x7f371c133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57964/0 (socket says 172.21.15.125:57964) 2023-10-03T10:16:12.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3721970700 1 -- 172.21.15.125:0/1741774185 learned_addr learned my addr 172.21.15.125:0/1741774185 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722171700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 0x7f371c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722171700 1 -- 172.21.15.125:0/1741774185 >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 msgr2=0x7f371c13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722171700 1 --2- 172.21.15.125:0/1741774185 >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 0x7f371c13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722171700 1 -- 172.21.15.125:0/1741774185 >> v1:172.21.15.125:6789/0 conn(0x7f371c09f180 legacy=0x7f371c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722171700 1 -- 172.21.15.125:0/1741774185 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c09af50 con 0x7f371c09e870 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f3722972700 1 --2- 172.21.15.125:0/1741774185 >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 0x7f371c13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.719+0000 7f372116f700 1 -- 172.21.15.125:0/1741774185 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129374146 0 0) 0x7f371c06bec0 con 0x7f371c09f180 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f3722171700 1 --2- 172.21.15.125:0/1741774185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 0x7f371c09ec40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3718009840 tx=0x7f3718009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a50769d67f590bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f372116f700 1 -- 172.21.15.125:0/1741774185 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718011830 con 0x7f371c09e870 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f372116f700 1 -- 172.21.15.125:0/1741774185 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718011990 con 0x7f371c09e870 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f372116f700 1 -- 172.21.15.125:0/1741774185 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718011d20 con 0x7f371c09e870 2023-10-03T10:16:12.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 -- 172.21.15.125:0/1741774185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 msgr2=0x7f371c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 --2- 172.21.15.125:0/1741774185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 0x7f371c09ec40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3718009840 tx=0x7f3718009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 -- 172.21.15.125:0/1741774185 shutdown_connections 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 --2- 172.21.15.125:0/1741774185 >> v2:172.21.15.125:3300/0 conn(0x7f371c134330 0x7f371c13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 --2- 172.21.15.125:0/1741774185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c09e870 0x7f371c09ec40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 -- 172.21.15.125:0/1741774185 >> 172.21.15.125:0/1741774185 conn(0x7f371c0a4430 msgr2=0x7f371c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 -- 172.21.15.125:0/1741774185 shutdown_connections 2023-10-03T10:16:12.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.720+0000 7f37243d5700 1 -- 172.21.15.125:0/1741774185 wait complete. 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.721+0000 7f37243d5700 1 Processor -- start 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.721+0000 7f37243d5700 1 -- start start 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 0x7f371c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 0x7f371c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c124d70 con 0x7f371c09e870 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1245b0 con 0x7f371c134330 2023-10-03T10:16:12.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f37243d5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1260d0 con 0x7f371c09f180 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722171700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 0x7f371c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722972700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 0x7f371c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722171700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53260/0 (socket says 172.21.15.125:53260) 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722171700 1 -- 172.21.15.125:0/2010598459 learned_addr learned my addr 172.21.15.125:0/2010598459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 -- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 msgr2=0x7f371c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 0x7f371c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 -- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 msgr2=0x7f371c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 -- 172.21.15.125:0/2010598459 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009a70 con 0x7f371c09f180 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722171700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3722972700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 0x7f371c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3721970700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 0x7f371c122dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f371c0a5080 tx=0x7f370c00c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.722+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c004c80 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c004de0 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c007310 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180094a0 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c1333b0 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f370c007470 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f370c03f220 con 0x7f371c09f180 2023-10-03T10:16:12.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.723+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c04f2a0 con 0x7f371c09f180 2023-10-03T10:16:12.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.728+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f370c007720 con 0x7f371c09f180 2023-10-03T10:16:12.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.879+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe5804f2a0 con 0x7fbe5809e870 2023-10-03T10:16:12.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.879+0000 7fbe4dffb700 1 -- 172.21.15.125:0/560964641 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe54017030 con 0x7fbe5809e870 2023-10-03T10:16:12.879 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 msgr2=0x7fbe5811f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400e900 tx=0x7fbe5400ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 shutdown_connections 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe58131d70 0x7fbe5811fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe5809e870 0x7fbe5811f2e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 --2- 172.21.15.125:0/560964641 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe5809f180 0x7fbe5811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 >> 172.21.15.125:0/560964641 conn(0x7fbe580a4430 msgr2=0x7fbe58131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 shutdown_connections 2023-10-03T10:16:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.881+0000 7fbe5f916700 1 -- 172.21.15.125:0/560964641 wait complete. 2023-10-03T10:16:12.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:12.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.922+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f371c072d60 con 0x7f371c09f180 2023-10-03T10:16:12.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.922+0000 7f3712ffd700 1 -- 172.21.15.125:0/2010598459 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f370c01ce90 con 0x7f371c09f180 2023-10-03T10:16:12.922 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:12.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 msgr2=0x7f371c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 0x7f371c122dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f371c0a5080 tx=0x7f370c00c750 comp rx=0 tx=0).stop 2023-10-03T10:16:12.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 shutdown_connections 2023-10-03T10:16:12.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f371c134330 0x7f371c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f371c09e870 0x7f371c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 --2- 172.21.15.125:0/2010598459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f371c09f180 0x7f371c122dd0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.924+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 >> 172.21.15.125:0/2010598459 conn(0x7f371c0a4430 msgr2=0x7f371c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.925+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 shutdown_connections 2023-10-03T10:16:12.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:12.925+0000 7f37243d5700 1 -- 172.21.15.125:0/2010598459 wait complete. 2023-10-03T10:16:12.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:13.470 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:13.504 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.604+0000 7f82d967d700 1 Processor -- start 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.604+0000 7f82d967d700 1 -- start start 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d967d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82d40a1550 0x7f82d4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d967d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d967d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d409e9d0 con 0x7f82d40a0a70 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d967d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d409dc00 con 0x7f82d40a1550 2023-10-03T10:16:13.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d967d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d409dec0 con 0x7f82d4139200 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82d40a1550 0x7f82d4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53542/0 (socket says 172.21.15.125:53542) 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f82d40a0a70 0x7f82d40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57974/0 (socket says 172.21.15.125:57974) 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d37fe700 1 -- 172.21.15.125:0/3839488431 learned_addr learned my addr 172.21.15.125:0/3839488431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 -- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 msgr2=0x7f82d413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 -- 172.21.15.125:0/3839488431 >> v1:172.21.15.125:6789/0 conn(0x7f82d40a0a70 legacy=0x7f82d40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 -- 172.21.15.125:0/3839488431 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d409e6a0 con 0x7f82d40a1550 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d1ffb700 1 -- 172.21.15.125:0/3839488431 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071924828 0 0) 0x7f82d409e9d0 con 0x7f82d40a0a70 2023-10-03T10:16:13.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d37fe700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a1550 0x7f82d4138cc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009840 tx=0x7f82c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640594e3c4cf231a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d1ffb700 1 -- 172.21.15.125:0/3839488431 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011830 con 0x7f82d40a1550 2023-10-03T10:16:13.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d1ffb700 1 -- 172.21.15.125:0/3839488431 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8011990 con 0x7f82d40a1550 2023-10-03T10:16:13.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.605+0000 7f82d1ffb700 1 -- 172.21.15.125:0/3839488431 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011d20 con 0x7f82d40a1550 2023-10-03T10:16:13.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 -- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a1550 msgr2=0x7f82d4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a1550 0x7f82d4138cc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009840 tx=0x7f82c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:13.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 -- 172.21.15.125:0/3839488431 shutdown_connections 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 --2- 172.21.15.125:0/3839488431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a1550 0x7f82d4138cc0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 -- 172.21.15.125:0/3839488431 >> 172.21.15.125:0/3839488431 conn(0x7f82d40a6610 msgr2=0x7f82d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 -- 172.21.15.125:0/3839488431 shutdown_connections 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.606+0000 7f82d967d700 1 -- 172.21.15.125:0/3839488431 wait complete. 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.607+0000 7f82d967d700 1 Processor -- start 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.607+0000 7f82d967d700 1 -- start start 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.607+0000 7f82d967d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.607+0000 7f82d967d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 0x7f82d4120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.607+0000 7f82d967d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d4121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d967d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4124420 con 0x7f82d40a0a70 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d967d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40a5100 con 0x7f82d4139200 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d967d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4123ac0 con 0x7f82d40a1550 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d4121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53266/0 (socket says 172.21.15.125:53266) 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d2ffd700 1 -- 172.21.15.125:0/3512806023 learned_addr learned my addr 172.21.15.125:0/3512806023 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 0x7f82d4120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 -- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 msgr2=0x7f82d4121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d4121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 -- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 msgr2=0x7f82d41207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 -- 172.21.15.125:0/3512806023 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009b30 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d37fe700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d4121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d2ffd700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d27fc700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 0x7f82d4120d30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82c8016000 tx=0x7f82c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80036a0 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c801f070 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c80094a0 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8003a20 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.608+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d4124030 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.609+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82c8003b80 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.609+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82c8021070 con 0x7f82d40a1550 2023-10-03T10:16:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.609+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d404f2a0 con 0x7f82d40a1550 2023-10-03T10:16:13.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.618+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82c802b020 con 0x7f82d40a1550 2023-10-03T10:16:13.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.645+0000 7f51d9e93700 1 Processor -- start 2023-10-03T10:16:13.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.645+0000 7f51d9e93700 1 -- start start 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d9e93700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 0x7f51d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d9e93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 0x7f51d413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d9e93700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d409dc00 con 0x7f51d40a1380 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d9e93700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d409ea90 con 0x7f51d40a0a70 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d9e93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d409dec0 con 0x7f51d4134120 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 0x7f51d413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 0x7f51d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51d40a1380 0x7f51d4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57988/0 (socket says 172.21.15.125:57988) 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d2ffd700 1 -- 172.21.15.125:0/3765025213 learned_addr learned my addr 172.21.15.125:0/3765025213 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 -- 172.21.15.125:0/3765025213 >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 msgr2=0x7f51d40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 --2- 172.21.15.125:0/3765025213 >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 0x7f51d40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 -- 172.21.15.125:0/3765025213 >> v1:172.21.15.125:6789/0 conn(0x7f51d40a1380 legacy=0x7f51d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 -- 172.21.15.125:0/3765025213 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d409e6a0 con 0x7f51d4134120 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d27fc700 1 -- 172.21.15.125:0/3765025213 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428790558 0 0) 0x7f51d409dc00 con 0x7f51d40a1380 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d37fe700 1 --2- 172.21.15.125:0/3765025213 >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 0x7f51d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d3fff700 1 --2- 172.21.15.125:0/3765025213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 0x7f51d413bce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009d90 tx=0x7f51cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d552e9d717a615b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d27fc700 1 -- 172.21.15.125:0/3765025213 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00e070 con 0x7f51d4134120 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d27fc700 1 -- 172.21.15.125:0/3765025213 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc00bb20 con 0x7f51d4134120 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.646+0000 7f51d27fc700 1 -- 172.21.15.125:0/3765025213 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc012430 con 0x7f51d4134120 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 -- 172.21.15.125:0/3765025213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 msgr2=0x7f51d413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3765025213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 0x7f51d413bce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009d90 tx=0x7f51cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 -- 172.21.15.125:0/3765025213 shutdown_connections 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3765025213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d4134120 0x7f51d413bce0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3765025213 >> v2:172.21.15.125:3300/0 conn(0x7f51d40a0a70 0x7f51d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 -- 172.21.15.125:0/3765025213 >> 172.21.15.125:0/3765025213 conn(0x7f51d40a6610 msgr2=0x7f51d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 -- 172.21.15.125:0/3765025213 shutdown_connections 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.647+0000 7f51d9e93700 1 -- 172.21.15.125:0/3765025213 wait complete. 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.648+0000 7f51d9e93700 1 Processor -- start 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.648+0000 7f51d9e93700 1 -- start start 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 0x7f51d4122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51d4134120 0x7f51d41231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4124360 con 0x7f51d40a0a70 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d41336a0 con 0x7f51d40a1380 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51d41332e0 con 0x7f51d4134120 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53278/0 (socket says 172.21.15.125:53278) 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 -- 172.21.15.125:0/3977249999 learned_addr learned my addr 172.21.15.125:0/3977249999 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d2ffd700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 0x7f51d4122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d3fff700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51d4134120 0x7f51d41231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 -- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51d4134120 msgr2=0x7f51d41231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51d4134120 0x7f51d41231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 -- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 msgr2=0x7f51d4122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 0x7f51d4122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 -- 172.21.15.125:0/3977249999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40094a0 con 0x7f51d40a0a70 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d2ffd700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 0x7f51d4122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d37fe700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f51c400ec10 tx=0x7f51c400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400c850 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c400c9b0 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400cd20 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc009a70 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.649+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d4125cd0 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.650+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51c4013470 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.650+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d4126ac0 con 0x7f51d40a0a70 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.651+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51c403f7f0 con 0x7f51d40a0a70 2023-10-03T10:16:13.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.655+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51c4013720 con 0x7f51d40a0a70 2023-10-03T10:16:13.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.807+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82d4122bf0 con 0x7f82d40a1550 2023-10-03T10:16:13.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.807+0000 7f82bb7fe700 1 -- 172.21.15.125:0/3512806023 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82c8015070 con 0x7f82d40a1550 2023-10-03T10:16:13.807 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 msgr2=0x7f82d4120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 0x7f82d4120d30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82c8016000 tx=0x7f82c8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 shutdown_connections 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82d4139200 0x7f82d4121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82d40a0a70 0x7f82d41207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 --2- 172.21.15.125:0/3512806023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f82d40a1550 0x7f82d4120d30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 >> 172.21.15.125:0/3512806023 conn(0x7f82d40a6610 msgr2=0x7f82d40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 shutdown_connections 2023-10-03T10:16:13.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.809+0000 7f82d967d700 1 -- 172.21.15.125:0/3512806023 wait complete. 2023-10-03T10:16:13.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:13.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.842+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51d404f2a0 con 0x7f51d40a0a70 2023-10-03T10:16:13.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.842+0000 7f51bbfff700 1 -- 172.21.15.125:0/3977249999 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51c401bb60 con 0x7f51d40a0a70 2023-10-03T10:16:13.841 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 msgr2=0x7f51d4122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f51c400ec10 tx=0x7f51c400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 shutdown_connections 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51d4134120 0x7f51d41231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d40a0a70 0x7f51d4122750 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 --2- 172.21.15.125:0/3977249999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51d40a1380 0x7f51d4122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 >> 172.21.15.125:0/3977249999 conn(0x7f51d40a6610 msgr2=0x7f51d40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 shutdown_connections 2023-10-03T10:16:13.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:13.844+0000 7f51d9e93700 1 -- 172.21.15.125:0/3977249999 wait complete. 2023-10-03T10:16:13.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:13.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:13.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:14.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 Processor -- start 2023-10-03T10:16:14.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 -- start start 2023-10-03T10:16:14.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a1380 0x7fa458133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa4581343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45809e9d0 con 0x7fa4580a0a70 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45809dc00 con 0x7fa458133f50 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa45e442700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa45809dec0 con 0x7fa4580a1380 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.024+0000 7fa457fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa457fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53288/0 (socket says 172.21.15.125:53288) 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa457fff700 1 -- 172.21.15.125:0/4021425654 learned_addr learned my addr 172.21.15.125:0/4021425654 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa4581343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa4577fe700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a1380 0x7fa458133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 -- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a1380 msgr2=0x7fa458133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a1380 0x7fa458133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 -- 172.21.15.125:0/4021425654 >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 msgr2=0x7fa4580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 --2- 172.21.15.125:0/4021425654 >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 -- 172.21.15.125:0/4021425654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45809e6a0 con 0x7fa458133f50 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa457fff700 1 --2- 172.21.15.125:0/4021425654 >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa45c9df700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa4581343b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa450009d90 tx=0x7fa45000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf8dd2def1fde3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa456ffd700 1 -- 172.21.15.125:0/4021425654 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000e070 con 0x7fa458133f50 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa456ffd700 1 -- 172.21.15.125:0/4021425654 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000bb20 con 0x7fa458133f50 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.025+0000 7fa456ffd700 1 -- 172.21.15.125:0/4021425654 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450012430 con 0x7fa458133f50 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 -- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 msgr2=0x7fa4581343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa4581343b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa450009d90 tx=0x7fa45000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 -- 172.21.15.125:0/4021425654 shutdown_connections 2023-10-03T10:16:14.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa4581343b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 --2- 172.21.15.125:0/4021425654 >> v2:172.21.15.125:3300/0 conn(0x7fa4580a0a70 0x7fa4580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 --2- 172.21.15.125:0/4021425654 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a1380 0x7fa458133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 -- 172.21.15.125:0/4021425654 >> 172.21.15.125:0/4021425654 conn(0x7fa4580a6610 msgr2=0x7fa4580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 -- 172.21.15.125:0/4021425654 shutdown_connections 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.026+0000 7fa45e442700 1 -- 172.21.15.125:0/4021425654 wait complete. 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 Processor -- start 2023-10-03T10:16:14.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 -- start start 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 0x7fa458121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa458121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458124cd0 con 0x7fa4580a1380 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa458124eb0 con 0x7fa458133f50 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45e442700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa458122930 con 0x7fa4580a0a70 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa457fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.027+0000 7fa45c9df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa458121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa457fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56236/0 (socket says 172.21.15.125:56236) 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa457fff700 1 -- 172.21.15.125:0/3521792396 learned_addr learned my addr 172.21.15.125:0/3521792396 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa4577fe700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 0x7fa458121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 -- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 msgr2=0x7fa458121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 -- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 msgr2=0x7fa458121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 0x7fa458121aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 -- 172.21.15.125:0/3521792396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009550 con 0x7fa458133f50 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa457fff700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa4577fe700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 0x7fa458121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45c9df700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa458121fe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa450016000 tx=0x7fa450004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450004800 con 0x7fa458133f50 2023-10-03T10:16:14.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450020070 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa450009a70 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500276c0 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.028+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4580a03e0 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.029+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa450012430 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.029+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa450022070 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.029+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa458124b10 con 0x7fa458133f50 2023-10-03T10:16:14.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.034+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa458124b10 con 0x7fa458133f50 2023-10-03T10:16:14.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.065+0000 7f59efe31700 1 Processor -- start 2023-10-03T10:16:14.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 -- start start 2023-10-03T10:16:14.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e80a1550 0x7f59e8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e809e9d0 con 0x7f59e80a0a70 2023-10-03T10:16:14.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e809dc00 con 0x7f59e80a1550 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59efe31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e809dec0 con 0x7f59e8139200 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59ed3cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e80a1550 0x7f59e8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59ed3cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e80a1550 0x7f59e8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53310/0 (socket says 172.21.15.125:53310) 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59ed3cc700 1 -- 172.21.15.125:0/1890891490 learned_addr learned my addr 172.21.15.125:0/1890891490 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59edbcd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f59e80a0a70 0x7f59e80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57992/0 (socket says 172.21.15.125:57992) 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.066+0000 7f59ee3ce700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ed3cc700 1 -- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 msgr2=0x7f59e813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ed3cc700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ed3cc700 1 -- 172.21.15.125:0/1890891490 >> v1:172.21.15.125:6789/0 conn(0x7f59e80a0a70 legacy=0x7f59e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ecbcb700 1 -- 172.21.15.125:0/1890891490 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235992619 0 0) 0x7f59e809e9d0 con 0x7f59e80a0a70 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ed3cc700 1 -- 172.21.15.125:0/1890891490 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e809e6a0 con 0x7f59e80a1550 2023-10-03T10:16:14.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ee3ce700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ed3cc700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a1550 0x7f59e8138cc0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59d80098f0 tx=0x7f59d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8811cd417130308d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ecbcb700 1 -- 172.21.15.125:0/1890891490 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8011830 con 0x7f59e80a1550 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ecbcb700 1 -- 172.21.15.125:0/1890891490 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8011990 con 0x7f59e80a1550 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59ecbcb700 1 -- 172.21.15.125:0/1890891490 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8011d20 con 0x7f59e80a1550 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59efe31700 1 -- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a1550 msgr2=0x7f59e8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.067+0000 7f59efe31700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a1550 0x7f59e8138cc0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59d80098f0 tx=0x7f59d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 -- 172.21.15.125:0/1890891490 shutdown_connections 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 --2- 172.21.15.125:0/1890891490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a1550 0x7f59e8138cc0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 -- 172.21.15.125:0/1890891490 >> 172.21.15.125:0/1890891490 conn(0x7f59e80a6610 msgr2=0x7f59e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 -- 172.21.15.125:0/1890891490 shutdown_connections 2023-10-03T10:16:14.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 -- 172.21.15.125:0/1890891490 wait complete. 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.068+0000 7f59efe31700 1 Processor -- start 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 -- start start 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e80a1550 0x7f59e8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e8121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8124420 con 0x7f59e80a0a70 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80a5100 con 0x7f59e80a1550 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59efe31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8123ac0 con 0x7f59e8139200 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59ee3ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e8121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53318/0 (socket says 172.21.15.125:53318) 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59ee3ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e8121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56254/0 (socket says 172.21.15.125:56254) 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 -- 172.21.15.125:0/56018846 learned_addr learned my addr 172.21.15.125:0/56018846 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59ed3cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e80a1550 0x7f59e8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 -- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 msgr2=0x7f59e8121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e8121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 -- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e80a1550 msgr2=0x7f59e8120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e80a1550 0x7f59e8120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.069+0000 7f59edbcd700 1 -- 172.21.15.125:0/56018846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009a70 con 0x7f59e80a0a70 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59edbcd700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c520 tx=0x7f59e400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004c80 con 0x7f59e80a0a70 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4004de0 con 0x7f59e80a0a70 2023-10-03T10:16:14.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8009550 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4007310 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.070+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e8124030 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.071+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e804f2a0 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.071+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59e4007470 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.071+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59e403f920 con 0x7f59e80a0a70 2023-10-03T10:16:14.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.075+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59e40133c0 con 0x7f59e80a0a70 2023-10-03T10:16:14.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.227+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa458124b10 con 0x7fa458133f50 2023-10-03T10:16:14.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.227+0000 7fa454ff9700 1 -- 172.21.15.125:0/3521792396 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa458124b10 con 0x7fa458133f50 2023-10-03T10:16:14.227 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:14.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 msgr2=0x7fa458121fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa458121fe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa450016000 tx=0x7fa450004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 shutdown_connections 2023-10-03T10:16:14.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa458133f50 0x7fa458121fe0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4580a0a70 0x7fa458121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 --2- 172.21.15.125:0/3521792396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4580a1380 0x7fa458121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 >> 172.21.15.125:0/3521792396 conn(0x7fa4580a6610 msgr2=0x7fa45809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 shutdown_connections 2023-10-03T10:16:14.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.229+0000 7fa45e442700 1 -- 172.21.15.125:0/3521792396 wait complete. 2023-10-03T10:16:14.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:14.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.270+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59e8122bf0 con 0x7f59e80a0a70 2023-10-03T10:16:14.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.270+0000 7f59de7fc700 1 -- 172.21.15.125:0/56018846 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59e4011360 con 0x7f59e80a0a70 2023-10-03T10:16:14.270 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:14.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 msgr2=0x7f59e81207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c520 tx=0x7f59e400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:14.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 shutdown_connections 2023-10-03T10:16:14.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e8139200 0x7f59e8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e80a0a70 0x7f59e81207f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 --2- 172.21.15.125:0/56018846 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e80a1550 0x7f59e8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 >> 172.21.15.125:0/56018846 conn(0x7f59e80a6610 msgr2=0x7f59e80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 shutdown_connections 2023-10-03T10:16:14.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.273+0000 7f59efe31700 1 -- 172.21.15.125:0/56018846 wait complete. 2023-10-03T10:16:14.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:14.821 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:14.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.953+0000 7f3260c19700 1 Processor -- start 2023-10-03T10:16:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.953+0000 7f3260c19700 1 -- start start 2023-10-03T10:16:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3260c19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3260c19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3260c19700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c09dc00 con 0x7f325c133f50 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3260c19700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09ea60 con 0x7f325c0a1380 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3260c19700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09dec0 con 0x7f325c0a0a70 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f325a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f325a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56260/0 (socket says 172.21.15.125:56260) 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53606/0 (socket says 172.21.15.125:53606) 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f325a59c700 1 -- 172.21.15.125:0/3993574394 learned_addr learned my addr 172.21.15.125:0/3993574394 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f325959a700 1 -- 172.21.15.125:0/3993574394 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405954920 0 0) 0x7f325c09dc00 con 0x7f325c133f50 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 -- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 msgr2=0x7f325c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 -- 172.21.15.125:0/3993574394 >> v1:172.21.15.125:6789/0 conn(0x7f325c133f50 legacy=0x7f325c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f3259d9b700 1 -- 172.21.15.125:0/3993574394 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c09e6a0 con 0x7f325c0a1380 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.954+0000 7f325a59c700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3259d9b700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3250009870 tx=0x7f3250009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=579b7572600aeb0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f325959a700 1 -- 172.21.15.125:0/3993574394 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011830 con 0x7f325c0a1380 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f325959a700 1 -- 172.21.15.125:0/3993574394 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011990 con 0x7f325c0a1380 2023-10-03T10:16:14.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f325959a700 1 -- 172.21.15.125:0/3993574394 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011d20 con 0x7f325c0a1380 2023-10-03T10:16:14.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3260c19700 1 -- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 msgr2=0x7f325c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3260c19700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3250009870 tx=0x7f3250009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3260c19700 1 -- 172.21.15.125:0/3993574394 shutdown_connections 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3260c19700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.955+0000 7f3260c19700 1 --2- 172.21.15.125:0/3993574394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c133a10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.956+0000 7f3260c19700 1 -- 172.21.15.125:0/3993574394 >> 172.21.15.125:0/3993574394 conn(0x7f325c0a6610 msgr2=0x7f325c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.956+0000 7f3260c19700 1 -- 172.21.15.125:0/3993574394 shutdown_connections 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.956+0000 7f3260c19700 1 -- 172.21.15.125:0/3993574394 wait complete. 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 Processor -- start 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 -- start start 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c133f50 0x7f325c1c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c124fa0 con 0x7f325c133f50 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c126370 con 0x7f325c0a1380 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3260c19700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c1246b0 con 0x7f325c0a0a70 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3259d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f325a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3259d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53618/0 (socket says 172.21.15.125:53618) 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f3259d9b700 1 -- 172.21.15.125:0/3432794314 learned_addr learned my addr 172.21.15.125:0/3432794314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f325ad9d700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c133f50 0x7f325c1c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f325a59c700 1 -- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 msgr2=0x7f325c1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.957+0000 7f325a59c700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f325a59c700 1 -- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c133f50 msgr2=0x7f325c1c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f325a59c700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c133f50 0x7f325c1c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f325a59c700 1 -- 172.21.15.125:0/3432794314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c009550 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f3259d9b700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f325a59c700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c1c82d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e9d0 tx=0x7f324c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00ee70 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c004030 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32500094a0 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0043c0 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.958+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c0a03e0 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.959+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f324c00c850 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.959+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f324c03f9a0 con 0x7f325c0a0a70 2023-10-03T10:16:14.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.959+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c1253e0 con 0x7f325c0a0a70 2023-10-03T10:16:14.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.963+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f324c020070 con 0x7f325c0a0a70 2023-10-03T10:16:14.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.992+0000 7f9e96c79700 1 Processor -- start 2023-10-03T10:16:14.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.992+0000 7f9e96c79700 1 -- start start 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e96c79700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9009ad40 0x7f9e90133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e96c79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e96c79700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9009b110 con 0x7f9e900a0a70 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e96c79700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900a3b60 con 0x7f9e9009ad40 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e96c79700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e901348e0 con 0x7f9e90133f70 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9009ad40 0x7f9e90133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e95216700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9e900a0a70 0x7f9e900a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58004/0 (socket says 172.21.15.125:58004) 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e95216700 1 -- 172.21.15.125:0/2796112544 learned_addr learned my addr 172.21.15.125:0/2796112544 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53626/0 (socket says 172.21.15.125:53626) 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9009ad40 0x7f9e90133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53340/0 (socket says 172.21.15.125:53340) 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 -- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 msgr2=0x7f9e901343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 -- 172.21.15.125:0/2796112544 >> v1:172.21.15.125:6789/0 conn(0x7f9e900a0a70 legacy=0x7f9e900a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 -- 172.21.15.125:0/2796112544 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900a2fa0 con 0x7f9e9009ad40 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e8f7fe700 1 -- 172.21.15.125:0/2796112544 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041304949 0 0) 0x7f9e9009b110 con 0x7f9e900a0a70 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e8ffff700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.993+0000 7f9e94a15700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9009ad40 0x7f9e90133a30 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009840 tx=0x7f9e84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78016ec36c1ad90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e8f7fe700 1 -- 172.21.15.125:0/2796112544 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84011830 con 0x7f9e9009ad40 2023-10-03T10:16:14.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e8f7fe700 1 -- 172.21.15.125:0/2796112544 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84011990 con 0x7f9e9009ad40 2023-10-03T10:16:14.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e8f7fe700 1 -- 172.21.15.125:0/2796112544 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84011d20 con 0x7f9e9009ad40 2023-10-03T10:16:14.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 -- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9009ad40 msgr2=0x7f9e90133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9009ad40 0x7f9e90133a30 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009840 tx=0x7f9e84009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:14.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 -- 172.21.15.125:0/2796112544 shutdown_connections 2023-10-03T10:16:14.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9009ad40 0x7f9e90133a30 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2796112544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e90133f70 0x7f9e901343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 -- 172.21.15.125:0/2796112544 >> 172.21.15.125:0/2796112544 conn(0x7f9e90099c40 msgr2=0x7f9e9006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 -- 172.21.15.125:0/2796112544 shutdown_connections 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.994+0000 7f9e96c79700 1 -- 172.21.15.125:0/2796112544 wait complete. 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.995+0000 7f9e96c79700 1 Processor -- start 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.995+0000 7f9e96c79700 1 -- start start 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 0x7f9e9011f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 0x7f9e9011fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90122440 con 0x7f9e90133f70 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90121000 con 0x7f9e9009ad40 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e96c79700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90122620 con 0x7f9e900a0a70 2023-10-03T10:16:14.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e8ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 0x7f9e9011fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53344/0 (socket says 172.21.15.125:53344) 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 -- 172.21.15.125:0/2462392380 learned_addr learned my addr 172.21.15.125:0/2462392380 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e94a15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 0x7f9e9011f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 -- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 msgr2=0x7f9e9011fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 0x7f9e9011fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 -- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 msgr2=0x7f9e9011f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 0x7f9e9011f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 -- 172.21.15.125:0/2462392380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0094a0 con 0x7f9e90133f70 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e94a15700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 0x7f9e9011f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e8ffff700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 0x7f9e9011fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e95216700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800cc70 tx=0x7f9e8800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800aac0 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.996+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8800ac40 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.997+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840094a0 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.997+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880070d0 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.997+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9011efd0 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.997+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e88007250 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.997+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e8803f110 con 0x7f9e90133f70 2023-10-03T10:16:15.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:14.998+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9009c7e0 con 0x7f9e90133f70 2023-10-03T10:16:15.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.003+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e88018080 con 0x7f9e90133f70 2023-10-03T10:16:15.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.156+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f325c04f2a0 con 0x7f325c0a0a70 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.156+0000 7f324affd700 1 -- 172.21.15.125:0/3432794314 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f324c029090 con 0x7f325c0a0a70 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 msgr2=0x7f325c1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c1c82d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e9d0 tx=0x7f324c00ece0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 shutdown_connections 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f325c133f50 0x7f325c1c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f325c0a0a70 0x7f325c1c82d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 --2- 172.21.15.125:0/3432794314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f325c0a1380 0x7f325c1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 >> 172.21.15.125:0/3432794314 conn(0x7f325c0a6610 msgr2=0x7f325c0a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.158+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 shutdown_connections 2023-10-03T10:16:15.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.159+0000 7f3260c19700 1 -- 172.21.15.125:0/3432794314 wait complete. 2023-10-03T10:16:15.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:15.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.195+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e9004f2a0 con 0x7f9e90133f70 2023-10-03T10:16:15.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.195+0000 7f9e8d7fa700 1 -- 172.21.15.125:0/2462392380 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e88019860 con 0x7f9e90133f70 2023-10-03T10:16:15.194 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:15.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 msgr2=0x7f9e901c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800cc70 tx=0x7f9e8800cf80 comp rx=0 tx=0).stop 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 shutdown_connections 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e90133f70 0x7f9e901c8120 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9009ad40 0x7f9e9011f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 --2- 172.21.15.125:0/2462392380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e900a0a70 0x7f9e9011fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 >> 172.21.15.125:0/2462392380 conn(0x7f9e90099c40 msgr2=0x7f9e901bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 shutdown_connections 2023-10-03T10:16:15.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.197+0000 7f9e96c79700 1 -- 172.21.15.125:0/2462392380 wait complete. 2023-10-03T10:16:15.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:15.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:15.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.376+0000 7fdb47105700 1 Processor -- start 2023-10-03T10:16:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.376+0000 7fdb47105700 1 -- start start 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb47105700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb47105700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb401371c0 0x7fdb401395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb47105700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4009c970 con 0x7fdb4009e870 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb47105700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400a0920 con 0x7fdb401371c0 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb47105700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4009f9c0 con 0x7fdb4009f350 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb44ea1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdb4009e870 0x7fdb4009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37136/0 (socket says 172.21.15.125:37136) 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb44ea1700 1 -- 172.21.15.125:0/3857368897 learned_addr learned my addr 172.21.15.125:0/3857368897 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb456a2700 1 --2- 172.21.15.125:0/3857368897 >> v2:172.21.15.125:3300/0 conn(0x7fdb401371c0 0x7fdb401395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3ffff700 1 -- 172.21.15.125:0/3857368897 >> v2:172.21.15.125:3300/0 conn(0x7fdb401371c0 msgr2=0x7fdb401395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3f7fe700 1 -- 172.21.15.125:0/3857368897 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796036514 0 0) 0x7fdb4009c970 con 0x7fdb4009e870 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3ffff700 1 --2- 172.21.15.125:0/3857368897 >> v2:172.21.15.125:3300/0 conn(0x7fdb401371c0 0x7fdb401395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3ffff700 1 -- 172.21.15.125:0/3857368897 >> v1:172.21.15.125:6789/0 conn(0x7fdb4009e870 legacy=0x7fdb4009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.377+0000 7fdb3ffff700 1 -- 172.21.15.125:0/3857368897 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4009bab0 con 0x7fdb4009f350 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb3ffff700 1 --2- 172.21.15.125:0/3857368897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40136c80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1c863a6cf282ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb3f7fe700 1 -- 172.21.15.125:0/3857368897 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011830 con 0x7fdb4009f350 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb3f7fe700 1 -- 172.21.15.125:0/3857368897 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c011990 con 0x7fdb4009f350 2023-10-03T10:16:15.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb3f7fe700 1 -- 172.21.15.125:0/3857368897 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011d20 con 0x7fdb4009f350 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 -- 172.21.15.125:0/3857368897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 msgr2=0x7fdb40136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 --2- 172.21.15.125:0/3857368897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40136c80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 -- 172.21.15.125:0/3857368897 shutdown_connections 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 --2- 172.21.15.125:0/3857368897 >> v2:172.21.15.125:3300/0 conn(0x7fdb401371c0 0x7fdb401395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 --2- 172.21.15.125:0/3857368897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40136c80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 -- 172.21.15.125:0/3857368897 >> 172.21.15.125:0/3857368897 conn(0x7fdb400a4430 msgr2=0x7fdb400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 -- 172.21.15.125:0/3857368897 shutdown_connections 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.378+0000 7fdb47105700 1 -- 172.21.15.125:0/3857368897 wait complete. 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.379+0000 7fdb47105700 1 Processor -- start 2023-10-03T10:16:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.379+0000 7fdb47105700 1 -- start start 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 0x7fdb40120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb401371c0 0x7fdb401212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4009dba0 con 0x7fdb401371c0 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40124070 con 0x7fdb4009e870 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb47105700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40123b30 con 0x7fdb4009f350 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 0x7fdb40120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55856/0 (socket says 172.21.15.125:55856) 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb3ffff700 1 -- 172.21.15.125:0/425077988 learned_addr learned my addr 172.21.15.125:0/425077988 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb456a2700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb401371c0 0x7fdb401212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 -- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 msgr2=0x7fdb40120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 -- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb401371c0 msgr2=0x7fdb401212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb401371c0 0x7fdb401212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 -- 172.21.15.125:0/425077988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0094a0 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb3ffff700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.380+0000 7fdb44ea1700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 0x7fdb40120830 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c4a0 tx=0x7fdb3400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34004c80 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34004de0 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400722e0 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34007310 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb40122c10 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.381+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb34007470 con 0x7fdb4009e870 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.382+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb3403f2a0 con 0x7fdb4009e870 2023-10-03T10:16:15.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.382+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb401241b0 con 0x7fdb4009e870 2023-10-03T10:16:15.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.386+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb401241b0 con 0x7fdb4009e870 2023-10-03T10:16:15.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 Processor -- start 2023-10-03T10:16:15.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 -- start start 2023-10-03T10:16:15.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 0x7f669c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c09e9d0 con 0x7f669c0a0a70 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c09dc00 con 0x7f669c0a1550 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.419+0000 7f66a43d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c09dec0 con 0x7f669c139200 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a1973700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 0x7f669c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2174700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f669c0a0a70 0x7f669c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37150/0 (socket says 172.21.15.125:37150) 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35002/0 (socket says 172.21.15.125:35002) 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2174700 1 -- 172.21.15.125:0/2929638192 learned_addr learned my addr 172.21.15.125:0/2929638192 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 -- 172.21.15.125:0/2929638192 >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 msgr2=0x7f669c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 --2- 172.21.15.125:0/2929638192 >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 0x7f669c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 -- 172.21.15.125:0/2929638192 >> v1:172.21.15.125:6789/0 conn(0x7f669c0a0a70 legacy=0x7f669c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 -- 172.21.15.125:0/2929638192 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c09e6a0 con 0x7f669c139200 2023-10-03T10:16:15.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a1973700 1 --2- 172.21.15.125:0/2929638192 >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 0x7f669c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a2975700 1 --2- 172.21.15.125:0/2929638192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6694009d90 tx=0x7f669400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13389a5b8559c651 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a1172700 1 -- 172.21.15.125:0/2929638192 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400e070 con 0x7f669c139200 2023-10-03T10:16:15.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a1172700 1 -- 172.21.15.125:0/2929638192 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400bb20 con 0x7f669c139200 2023-10-03T10:16:15.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.420+0000 7f66a1172700 1 -- 172.21.15.125:0/2929638192 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694012430 con 0x7f669c139200 2023-10-03T10:16:15.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 -- 172.21.15.125:0/2929638192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 msgr2=0x7f669c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 --2- 172.21.15.125:0/2929638192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6694009d90 tx=0x7f669400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 -- 172.21.15.125:0/2929638192 shutdown_connections 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 --2- 172.21.15.125:0/2929638192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c13b5e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 --2- 172.21.15.125:0/2929638192 >> v2:172.21.15.125:3300/0 conn(0x7f669c0a1550 0x7f669c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 -- 172.21.15.125:0/2929638192 >> 172.21.15.125:0/2929638192 conn(0x7f669c0a6610 msgr2=0x7f669c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 -- 172.21.15.125:0/2929638192 shutdown_connections 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.421+0000 7f66a43d8700 1 -- 172.21.15.125:0/2929638192 wait complete. 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 Processor -- start 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 -- start start 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 0x7f669c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0a0470 con 0x7f669c0a1550 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c122050 con 0x7f669c139200 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a43d8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669c121aa0 con 0x7f669c0a0a70 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a1973700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a2174700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 0x7f669c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a2975700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a1973700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49090/0 (socket says 172.21.15.125:49090) 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.422+0000 7f66a1973700 1 -- 172.21.15.125:0/3156422957 learned_addr learned my addr 172.21.15.125:0/3156422957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 -- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 msgr2=0x7f669c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 0x7f669c11e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 -- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 msgr2=0x7f669c11f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c11f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 -- 172.21.15.125:0/3156422957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0094a0 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a2975700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c11f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a2174700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 0x7f669c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a1973700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f668c00ebe0 tx=0x7f668c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00c850 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00c9b0 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694009a70 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00cd40 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.423+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c120530 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.424+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f668c013470 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.424+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f668c03f7a0 con 0x7f669c0a1550 2023-10-03T10:16:15.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.424+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c04f2a0 con 0x7f669c0a1550 2023-10-03T10:16:15.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.429+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f668c013720 con 0x7f669c0a1550 2023-10-03T10:16:15.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.581+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb401241b0 con 0x7fdb4009e870 2023-10-03T10:16:15.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.581+0000 7fdb3d7fa700 1 -- 172.21.15.125:0/425077988 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb401241b0 con 0x7fdb4009e870 2023-10-03T10:16:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 msgr2=0x7fdb40120830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 0x7fdb40120830 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c4a0 tx=0x7fdb3400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 shutdown_connections 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb401371c0 0x7fdb401212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb4009e870 0x7fdb40120830 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 --2- 172.21.15.125:0/425077988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb4009f350 0x7fdb40120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 >> 172.21.15.125:0/425077988 conn(0x7fdb400a4430 msgr2=0x7fdb400a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 shutdown_connections 2023-10-03T10:16:15.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.583+0000 7fdb47105700 1 -- 172.21.15.125:0/425077988 wait complete. 2023-10-03T10:16:15.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:15.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.621+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f669c120c10 con 0x7f669c0a1550 2023-10-03T10:16:15.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.621+0000 7f6692ffd700 1 -- 172.21.15.125:0/3156422957 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f668c01b3b0 con 0x7f669c0a1550 2023-10-03T10:16:15.621 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 msgr2=0x7f669c11ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f668c00ebe0 tx=0x7f668c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 shutdown_connections 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f669c139200 0x7f669c11f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f669c0a0a70 0x7f669c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 --2- 172.21.15.125:0/3156422957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f669c0a1550 0x7f669c11ede0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 >> 172.21.15.125:0/3156422957 conn(0x7f669c0a6610 msgr2=0x7f669c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 shutdown_connections 2023-10-03T10:16:15.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:15.623+0000 7f66a43d8700 1 -- 172.21.15.125:0/3156422957 wait complete. 2023-10-03T10:16:15.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:16.171 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:16.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 Processor -- start 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 -- start start 2023-10-03T10:16:16.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f717409e870 0x7f717409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717409fa00 con 0x7f717409f180 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740a0370 con 0x7f717409e870 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7179e6e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f717406bec0 con 0x7f7174134330 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7173fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f71737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f717409e870 0x7f717409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7173fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55868/0 (socket says 172.21.15.125:55868) 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f71737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f717409e870 0x7f717409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49104/0 (socket says 172.21.15.125:49104) 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.301+0000 7f7173fff700 1 -- 172.21.15.125:0/689057944 learned_addr learned my addr 172.21.15.125:0/689057944 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f71737fe700 1 -- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 msgr2=0x7f717413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f71737fe700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f71737fe700 1 -- 172.21.15.125:0/689057944 >> v1:172.21.15.125:6789/0 conn(0x7f717409f180 legacy=0x7f7174133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f71737fe700 1 -- 172.21.15.125:0/689057944 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717409ada0 con 0x7f717409e870 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f7173fff700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f7172ffd700 1 -- 172.21.15.125:0/689057944 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683743047 0 0) 0x7f717409fa00 con 0x7f717409f180 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f71737fe700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f717409ec40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7164009840 tx=0x7f7164009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db3884a74a4ebbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f7172ffd700 1 -- 172.21.15.125:0/689057944 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011830 con 0x7f717409e870 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f7172ffd700 1 -- 172.21.15.125:0/689057944 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164011990 con 0x7f717409e870 2023-10-03T10:16:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.302+0000 7f7172ffd700 1 -- 172.21.15.125:0/689057944 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011d20 con 0x7f717409e870 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 -- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 msgr2=0x7f717409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f717409ec40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7164009840 tx=0x7f7164009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 -- 172.21.15.125:0/689057944 shutdown_connections 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f717413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 --2- 172.21.15.125:0/689057944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f717409ec40 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 -- 172.21.15.125:0/689057944 >> 172.21.15.125:0/689057944 conn(0x7f71740a4430 msgr2=0x7f71740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 -- 172.21.15.125:0/689057944 shutdown_connections 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.303+0000 7f7179e6e700 1 -- 172.21.15.125:0/689057944 wait complete. 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 Processor -- start 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 -- start start 2023-10-03T10:16:16.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f71741228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 0x7f7174122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174126040 con 0x7f717409e870 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717406cfa0 con 0x7f717409f180 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7179e6e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7174124520 con 0x7f7174134330 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7173fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f71737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f71741228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7173fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55870/0 (socket says 172.21.15.125:55870) 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f7173fff700 1 -- 172.21.15.125:0/2740095773 learned_addr learned my addr 172.21.15.125:0/2740095773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.304+0000 7f716affd700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 0x7f7174122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 -- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 msgr2=0x7f7174122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 0x7f7174122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 -- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 msgr2=0x7f71741228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f71741228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 -- 172.21.15.125:0/2740095773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009b30 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f71737fe700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f71741228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f716affd700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 0x7f7174122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7173fff700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f716c00efc0 tx=0x7f716c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c018070 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00f040 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c003c20 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71640094a0 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.305+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7174133320 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.306+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f716c00c880 con 0x7f7174134330 2023-10-03T10:16:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.306+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7174125de0 con 0x7f7174134330 2023-10-03T10:16:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.306+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f716c03f7f0 con 0x7f7174134330 2023-10-03T10:16:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.311+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7174125de0 con 0x7f7174134330 2023-10-03T10:16:16.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.341+0000 7f49877be700 1 Processor -- start 2023-10-03T10:16:16.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.341+0000 7f49877be700 1 -- start start 2023-10-03T10:16:16.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f49877be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49800a0a70 0x7f49800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f49877be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49800a1380 0x7f4980133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f49877be700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498009dc00 con 0x7f4980133f50 2023-10-03T10:16:16.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f49877be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498009ea60 con 0x7f49800a0a70 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f49877be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f498009dec0 con 0x7f49800a1380 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49800a0a70 0x7f49800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f4985d5b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4980133f50 0x7f498013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37164/0 (socket says 172.21.15.125:37164) 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49800a0a70 0x7f49800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49130/0 (socket says 172.21.15.125:49130) 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f4985d5b700 1 -- 172.21.15.125:0/2973691373 learned_addr learned my addr 172.21.15.125:0/2973691373 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f4984d59700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49800a1380 0x7f4980133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 -- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49800a1380 msgr2=0x7f4980133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49800a1380 0x7f4980133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 -- 172.21.15.125:0/2973691373 >> v1:172.21.15.125:6789/0 conn(0x7f4980133f50 legacy=0x7f498013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f498555a700 1 -- 172.21.15.125:0/2973691373 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498009e6a0 con 0x7f49800a0a70 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.342+0000 7f4977fff700 1 -- 172.21.15.125:0/2973691373 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214053319 0 0) 0x7f498009dc00 con 0x7f4980133f50 2023-10-03T10:16:16.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f498555a700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a0a70 0x7f49800a0e40 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f497c009840 tx=0x7f497c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b11e8cdbd507c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f4977fff700 1 -- 172.21.15.125:0/2973691373 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011830 con 0x7f49800a0a70 2023-10-03T10:16:16.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f4977fff700 1 -- 172.21.15.125:0/2973691373 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c011990 con 0x7f49800a0a70 2023-10-03T10:16:16.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f4977fff700 1 -- 172.21.15.125:0/2973691373 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011d20 con 0x7f49800a0a70 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 -- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a0a70 msgr2=0x7f49800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a0a70 0x7f49800a0e40 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f497c009840 tx=0x7f497c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 -- 172.21.15.125:0/2973691373 shutdown_connections 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a0a70 0x7f49800a0e40 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 --2- 172.21.15.125:0/2973691373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f49800a1380 0x7f4980133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 -- 172.21.15.125:0/2973691373 >> 172.21.15.125:0/2973691373 conn(0x7f49800a6610 msgr2=0x7f49800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 -- 172.21.15.125:0/2973691373 shutdown_connections 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.343+0000 7f49877be700 1 -- 172.21.15.125:0/2973691373 wait complete. 2023-10-03T10:16:16.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 Processor -- start 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 -- start start 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 0x7f4980122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 0x7f49801232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980133ad0 con 0x7f49800a1380 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4980125de0 con 0x7f49800a0a70 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f49877be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4980124510 con 0x7f4980133f50 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f4984d59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f498555a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 0x7f4980122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f4985d5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 0x7f49801232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f4984d59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49144/0 (socket says 172.21.15.125:49144) 2023-10-03T10:16:16.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f4984d59700 1 -- 172.21.15.125:0/1959937786 learned_addr learned my addr 172.21.15.125:0/1959937786 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f4985d5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 0x7f49801232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55878/0 (socket says 172.21.15.125:55878) 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.345+0000 7f498555a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 0x7f4980122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35022/0 (socket says 172.21.15.125:35022) 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 -- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 msgr2=0x7f49801232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 0x7f49801232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 -- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 msgr2=0x7f4980122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 0x7f4980122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 -- 172.21.15.125:0/1959937786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0094a0 con 0x7f49800a1380 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4984d59700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f497000e9b0 tx=0x7f497000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970009710 con 0x7f49800a1380 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000ee50 con 0x7f49800a1380 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4980126100 con 0x7f49800a1380 2023-10-03T10:16:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000ca50 con 0x7f49800a1380 2023-10-03T10:16:16.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.346+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4980126380 con 0x7f49800a1380 2023-10-03T10:16:16.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.347+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498004f2a0 con 0x7f49800a1380 2023-10-03T10:16:16.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.348+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f497000cbb0 con 0x7f49800a1380 2023-10-03T10:16:16.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.348+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f497003fef0 con 0x7f49800a1380 2023-10-03T10:16:16.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.356+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f497001a360 con 0x7f49800a1380 2023-10-03T10:16:16.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.511+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7174125de0 con 0x7f7174134330 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.511+0000 7f7170ff9700 1 -- 172.21.15.125:0/2740095773 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f716c00ce10 con 0x7f7174134330 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.513+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 msgr2=0x7f7174123320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.513+0000 7f7179e6e700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f716c00efc0 tx=0x7f716c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 shutdown_connections 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7174134330 0x7f7174123320 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f717409e870 0x7f71741228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 --2- 172.21.15.125:0/2740095773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f717409f180 0x7f7174122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 >> 172.21.15.125:0/2740095773 conn(0x7f71740a4430 msgr2=0x7f7174070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 shutdown_connections 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.514+0000 7f7179e6e700 1 -- 172.21.15.125:0/2740095773 wait complete. 2023-10-03T10:16:16.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:16.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.549+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49801337b0 con 0x7f49800a1380 2023-10-03T10:16:16.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.550+0000 7f4975ffb700 1 -- 172.21.15.125:0/1959937786 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4970021070 con 0x7f49800a1380 2023-10-03T10:16:16.549 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:16.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 msgr2=0x7f4980122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f497000e9b0 tx=0x7f497000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 shutdown_connections 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4980133f50 0x7f49801232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49800a0a70 0x7f4980122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 --2- 172.21.15.125:0/1959937786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49800a1380 0x7f4980122da0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 >> 172.21.15.125:0/1959937786 conn(0x7f49800a6610 msgr2=0x7f498009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 shutdown_connections 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.552+0000 7f49877be700 1 -- 172.21.15.125:0/1959937786 wait complete. 2023-10-03T10:16:16.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:16.596 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:16.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.730+0000 7f698806b700 1 Processor -- start 2023-10-03T10:16:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.730+0000 7f698806b700 1 -- start start 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f698806b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f698806b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 0x7f698013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f698806b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698009b110 con 0x7f698009ad40 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f698806b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a3b60 con 0x7f6980134570 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f698806b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a1a80 con 0x7f6980134140 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6985606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 0x7f698013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6985606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55890/0 (socket says 172.21.15.125:55890) 2023-10-03T10:16:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6985e07700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f698009ad40 0x7f6980133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37180/0 (socket says 172.21.15.125:37180) 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6985606700 1 -- 172.21.15.125:0/150856694 learned_addr learned my addr 172.21.15.125:0/150856694 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 -- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 msgr2=0x7f6980138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 -- 172.21.15.125:0/150856694 >> v1:172.21.15.125:6789/0 conn(0x7f698009ad40 legacy=0x7f6980133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6984e05700 1 -- 172.21.15.125:0/150856694 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198029379 0 0) 0x7f698009b110 con 0x7f698009ad40 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 -- 172.21.15.125:0/150856694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800a2fa0 con 0x7f6980134570 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6985606700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6986608700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 0x7f698013b3d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6978009df0 tx=0x7f697800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e9fab670ef2a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6984e05700 1 -- 172.21.15.125:0/150856694 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800e070 con 0x7f6980134570 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6984e05700 1 -- 172.21.15.125:0/150856694 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800bae0 con 0x7f6980134570 2023-10-03T10:16:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.731+0000 7f6984e05700 1 -- 172.21.15.125:0/150856694 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800be90 con 0x7f6980134570 2023-10-03T10:16:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 -- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 msgr2=0x7f698013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 0x7f698013b3d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6978009df0 tx=0x7f697800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 -- 172.21.15.125:0/150856694 shutdown_connections 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6980134570 0x7f698013b3d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 --2- 172.21.15.125:0/150856694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f6980138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 -- 172.21.15.125:0/150856694 >> 172.21.15.125:0/150856694 conn(0x7f6980099c40 msgr2=0x7f698006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 -- 172.21.15.125:0/150856694 shutdown_connections 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.732+0000 7f698806b700 1 -- 172.21.15.125:0/150856694 wait complete. 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.733+0000 7f698806b700 1 Processor -- start 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.733+0000 7f698806b700 1 -- start start 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 0x7f698011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698011edf0 con 0x7f6980134570 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698013a910 con 0x7f698009ad40 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f698806b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f698011e1c0 con 0x7f6980134140 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985e07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55898/0 (socket says 172.21.15.125:55898) 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985e07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35040/0 (socket says 172.21.15.125:35040) 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 -- 172.21.15.125:0/2832733483 learned_addr learned my addr 172.21.15.125:0/2832733483 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6986608700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 0x7f698011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 -- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 msgr2=0x7f698011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 -- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 msgr2=0x7f698011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 0x7f698011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985606700 1 -- 172.21.15.125:0/2832733483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009550 con 0x7f6980134140 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6985e07700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.734+0000 7f6986608700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 0x7f698011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f6985606700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f697000e9e0 tx=0x7f697000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000ee80 con 0x7f6980134140 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000c850 con 0x7f6980134140 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6978009a70 con 0x7f6980134140 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000cbc0 con 0x7f6980134140 2023-10-03T10:16:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.735+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6980133710 con 0x7f6980134140 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.736+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f697000cd20 con 0x7f6980134140 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.736+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f697003f700 con 0x7f6980134140 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.736+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698011e7b0 con 0x7f6980134140 2023-10-03T10:16:16.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.741+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f698011e7b0 con 0x7f6980134140 2023-10-03T10:16:16.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.773+0000 7f72fd412700 1 Processor -- start 2023-10-03T10:16:16.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.773+0000 7f72fd412700 1 -- start start 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72fd412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72fd412700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72fd412700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f809e9d0 con 0x7f72f80a0a70 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72fd412700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f809dc00 con 0x7f72f8139200 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72fd412700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f809dec0 con 0x7f72f80a1550 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55906/0 (socket says 172.21.15.125:55906) 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35054/0 (socket says 172.21.15.125:35054) 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f72f80a0a70 0x7f72f80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37196/0 (socket says 172.21.15.125:37196) 2023-10-03T10:16:16.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f67fc700 1 -- 172.21.15.125:0/1678252240 learned_addr learned my addr 172.21.15.125:0/1678252240 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f5ffb700 1 -- 172.21.15.125:0/1678252240 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088987551 0 0) 0x7f72f809e9d0 con 0x7f72f80a0a70 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 -- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 msgr2=0x7f72f8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 -- 172.21.15.125:0/1678252240 >> v1:172.21.15.125:6789/0 conn(0x7f72f80a0a70 legacy=0x7f72f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 -- 172.21.15.125:0/1678252240 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f809e6a0 con 0x7f72f8139200 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f67fc700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f77fe700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009dc0 tx=0x7f72f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89cccbeca18f50c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f5ffb700 1 -- 172.21.15.125:0/1678252240 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000e070 con 0x7f72f8139200 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f5ffb700 1 -- 172.21.15.125:0/1678252240 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000bb20 con 0x7f72f8139200 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.774+0000 7f72f5ffb700 1 -- 172.21.15.125:0/1678252240 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0012430 con 0x7f72f8139200 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 -- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 msgr2=0x7f72f813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009dc0 tx=0x7f72f000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:16.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 -- 172.21.15.125:0/1678252240 shutdown_connections 2023-10-03T10:16:16.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f813b5e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 --2- 172.21.15.125:0/1678252240 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a1550 0x7f72f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 -- 172.21.15.125:0/1678252240 >> 172.21.15.125:0/1678252240 conn(0x7f72f80a6610 msgr2=0x7f72f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 -- 172.21.15.125:0/1678252240 shutdown_connections 2023-10-03T10:16:16.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.775+0000 7f72fd412700 1 -- 172.21.15.125:0/1678252240 wait complete. 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.776+0000 7f72fd412700 1 Processor -- start 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.776+0000 7f72fd412700 1 -- start start 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f811f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80a03e0 con 0x7f72f80a1550 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81220d0 con 0x7f72f8139200 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81205b0 con 0x7f72f80a0a70 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f811f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49162/0 (socket says 172.21.15.125:49162) 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55914/0 (socket says 172.21.15.125:55914) 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f67fc700 1 -- 172.21.15.125:0/3809917117 learned_addr learned my addr 172.21.15.125:0/3809917117 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 -- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 msgr2=0x7f72f811e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 -- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 msgr2=0x7f72f811edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 -- 172.21.15.125:0/3809917117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009550 con 0x7f72f8139200 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f6ffd700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f67fc700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72f77fe700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f811f310 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f72f0016000 tx=0x7f72f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0004880 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0020070 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f0009a70 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f00276c0 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.777+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f8120e90 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.778+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72f0012430 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.778+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72f0022070 con 0x7f72f8139200 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.778+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f804f2a0 con 0x7f72f8139200 2023-10-03T10:16:16.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.787+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72f0011980 con 0x7f72f8139200 2023-10-03T10:16:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.939+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f698011e7b0 con 0x7f6980134140 2023-10-03T10:16:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.939+0000 7f69767fc700 1 -- 172.21.15.125:0/2832733483 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f698011e7b0 con 0x7f6980134140 2023-10-03T10:16:16.939 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 msgr2=0x7f698011ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f697000e9e0 tx=0x7f697000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 shutdown_connections 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6980134570 0x7f698011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f698009ad40 0x7f698011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 --2- 172.21.15.125:0/2832733483 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6980134140 0x7f698011ce00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 >> 172.21.15.125:0/2832733483 conn(0x7f6980099c40 msgr2=0x7f698013b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 shutdown_connections 2023-10-03T10:16:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.941+0000 7f698806b700 1 -- 172.21.15.125:0/2832733483 wait complete. 2023-10-03T10:16:16.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.981+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72f80a56d0 con 0x7f72f8139200 2023-10-03T10:16:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.981+0000 7f72df7fe700 1 -- 172.21.15.125:0/3809917117 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72f00303e0 con 0x7f72f8139200 2023-10-03T10:16:16.981 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 msgr2=0x7f72f811f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f811f310 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f72f0016000 tx=0x7f72f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 shutdown_connections 2023-10-03T10:16:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72f8139200 0x7f72f811f310 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72f80a0a70 0x7f72f811e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 --2- 172.21.15.125:0/3809917117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72f80a1550 0x7f72f811edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.983+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 >> 172.21.15.125:0/3809917117 conn(0x7f72f80a6610 msgr2=0x7f72f8136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.984+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 shutdown_connections 2023-10-03T10:16:16.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:16.984+0000 7f72fd412700 1 -- 172.21.15.125:0/3809917117 wait complete. 2023-10-03T10:16:16.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:17.526 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:17.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:17.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 Processor -- start 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 -- start start 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e740a1380 0x7f4e74133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 0x7f4e74134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7409e9d0 con 0x7f4e740a1380 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7409dc00 con 0x7f4e740a0a70 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.655+0000 7f4e798f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7409dec0 con 0x7f4e74133f50 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e740a1380 0x7f4e74133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 0x7f4e74134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e740a1380 0x7f4e74133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49166/0 (socket says 172.21.15.125:49166) 2023-10-03T10:16:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 0x7f4e74134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55920/0 (socket says 172.21.15.125:55920) 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35084/0 (socket says 172.21.15.125:35084) 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 -- 172.21.15.125:0/964589626 learned_addr learned my addr 172.21.15.125:0/964589626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 -- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 msgr2=0x7f4e74134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 0x7f4e74134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 -- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 msgr2=0x7f4e740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 -- 172.21.15.125:0/964589626 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7409e6a0 con 0x7f4e740a1380 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e72ffd700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e727fc700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e740a1380 0x7f4e74133a10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4e680098f0 tx=0x7f4e68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75851483123684f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e71ffb700 1 -- 172.21.15.125:0/964589626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68011830 con 0x7f4e740a1380 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e71ffb700 1 -- 172.21.15.125:0/964589626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e68011990 con 0x7f4e740a1380 2023-10-03T10:16:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.656+0000 7f4e71ffb700 1 -- 172.21.15.125:0/964589626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68011d20 con 0x7f4e740a1380 2023-10-03T10:16:17.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 -- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e740a1380 msgr2=0x7f4e74133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e740a1380 0x7f4e74133a10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4e680098f0 tx=0x7f4e68009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:17.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 -- 172.21.15.125:0/964589626 shutdown_connections 2023-10-03T10:16:17.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a0a70 0x7f4e740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e74133f50 0x7f4e74134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 --2- 172.21.15.125:0/964589626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e740a1380 0x7f4e74133a10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 -- 172.21.15.125:0/964589626 >> 172.21.15.125:0/964589626 conn(0x7f4e740a6610 msgr2=0x7f4e740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 -- 172.21.15.125:0/964589626 shutdown_connections 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.657+0000 7f4e798f9700 1 -- 172.21.15.125:0/964589626 wait complete. 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.658+0000 7f4e798f9700 1 Processor -- start 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.658+0000 7f4e798f9700 1 -- start start 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a1380 0x7f4e7411f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74130770 con 0x7f4e74133f50 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74121e40 con 0x7f4e740a1380 2023-10-03T10:16:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e798f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74122920 con 0x7f4e740a0a70 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49180/0 (socket says 172.21.15.125:49180) 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55922/0 (socket says 172.21.15.125:55922) 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 -- 172.21.15.125:0/461543726 learned_addr learned my addr 172.21.15.125:0/461543726 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e727fc700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a1380 0x7f4e7411f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 -- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 msgr2=0x7f4e7411f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 -- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a1380 msgr2=0x7f4e7411f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.659+0000 7f4e737fe700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a1380 0x7f4e7411f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e737fe700 1 -- 172.21.15.125:0/461543726 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640094a0 con 0x7f4e74133f50 2023-10-03T10:16:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e72ffd700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e737fe700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009dd0 tx=0x7f4e6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c009c40 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c00f040 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c00ceb0 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68009550 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.660+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e74122650 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.661+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e6c014480 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.661+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e6c0401b0 con 0x7f4e74133f50 2023-10-03T10:16:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.661+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7409b5b0 con 0x7f4e74133f50 2023-10-03T10:16:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.666+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e6c007920 con 0x7f4e74133f50 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.695+0000 7f81d317f700 1 Processor -- start 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.695+0000 7f81d317f700 1 -- start start 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d317f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 0x7f81cc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d317f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 0x7f81cc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d317f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc09aaa0 con 0x7f81cc09d860 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d317f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc09e730 con 0x7f81cc09e340 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d317f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc09f870 con 0x7f81cc135f20 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d171c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 0x7f81cc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81cbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 0x7f81cc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d0f1b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f81cc09d860 0x7f81cc09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37204/0 (socket says 172.21.15.125:37204) 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.696+0000 7f81d0f1b700 1 -- 172.21.15.125:0/2175402758 learned_addr learned my addr 172.21.15.125:0/2175402758 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d171c700 1 -- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 msgr2=0x7f81cc1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d171c700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 0x7f81cc1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d171c700 1 -- 172.21.15.125:0/2175402758 >> v1:172.21.15.125:6789/0 conn(0x7f81cc09d860 legacy=0x7f81cc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81cb7fe700 1 -- 172.21.15.125:0/2175402758 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675241979 0 0) 0x7f81cc09aaa0 con 0x7f81cc09d860 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d171c700 1 -- 172.21.15.125:0/2175402758 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc09b360 con 0x7f81cc135f20 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81cbfff700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 0x7f81cc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d171c700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 0x7f81cc138300 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009df0 tx=0x7f81c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af2d6f1ee325206 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81cb7fe700 1 -- 172.21.15.125:0/2175402758 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400e070 con 0x7f81cc135f20 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81cb7fe700 1 -- 172.21.15.125:0/2175402758 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400bae0 con 0x7f81cc135f20 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81cb7fe700 1 -- 172.21.15.125:0/2175402758 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400be90 con 0x7f81cc135f20 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d317f700 1 -- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 msgr2=0x7f81cc138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.697+0000 7f81d317f700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 0x7f81cc138300 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009df0 tx=0x7f81c400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 -- 172.21.15.125:0/2175402758 shutdown_connections 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc135f20 0x7f81cc138300 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 --2- 172.21.15.125:0/2175402758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc09e340 0x7f81cc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 -- 172.21.15.125:0/2175402758 >> 172.21.15.125:0/2175402758 conn(0x7f81cc099c40 msgr2=0x7f81cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 -- 172.21.15.125:0/2175402758 shutdown_connections 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 -- 172.21.15.125:0/2175402758 wait complete. 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 Processor -- start 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.698+0000 7f81d317f700 1 -- start start 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81cc09d860 0x7f81cc1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 0x7f81cc1c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 0x7f81cc1207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1225c0 con 0x7f81cc09d860 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1223d0 con 0x7f81cc135f20 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d317f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc133150 con 0x7f81cc09e340 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81cbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 0x7f81cc1c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81cbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 0x7f81cc1c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55940/0 (socket says 172.21.15.125:55940) 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d171c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 0x7f81cc1207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81cbfff700 1 -- 172.21.15.125:0/3330522418 learned_addr learned my addr 172.21.15.125:0/3330522418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d0f1b700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81cc09d860 0x7f81cc1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d171c700 1 -- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 msgr2=0x7f81cc1c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.699+0000 7f81d171c700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 0x7f81cc1c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d171c700 1 -- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81cc09d860 msgr2=0x7f81cc1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d171c700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81cc09d860 0x7f81cc1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d171c700 1 -- 172.21.15.125:0/3330522418 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80094a0 con 0x7f81cc135f20 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d171c700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 0x7f81cc1207c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f81c4016000 tx=0x7f81c4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004610 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4020070 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4027480 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c4009a70 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.700+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc122980 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.701+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c4012430 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.701+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc072040 con 0x7f81cc135f20 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.701+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81c4022070 con 0x7f81cc135f20 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.705+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c402c070 con 0x7f81cc135f20 2023-10-03T10:16:17.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.855+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e740a03e0 con 0x7f4e74133f50 2023-10-03T10:16:17.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.855+0000 7f4e5bfff700 1 -- 172.21.15.125:0/461543726 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e6c02c090 con 0x7f4e74133f50 2023-10-03T10:16:17.854 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:17.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 msgr2=0x7f4e7411fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009dd0 tx=0x7f4e6c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 shutdown_connections 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e74133f50 0x7f4e7411fe20 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e740a0a70 0x7f4e7411f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 --2- 172.21.15.125:0/461543726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e740a1380 0x7f4e7411f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 >> 172.21.15.125:0/461543726 conn(0x7f4e740a6610 msgr2=0x7f4e740a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 shutdown_connections 2023-10-03T10:16:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.857+0000 7f4e798f9700 1 -- 172.21.15.125:0/461543726 wait complete. 2023-10-03T10:16:17.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:17.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.894+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81cc09c8b0 con 0x7f81cc135f20 2023-10-03T10:16:17.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.894+0000 7f81c97fa700 1 -- 172.21.15.125:0/3330522418 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81c4036090 con 0x7f81cc135f20 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 msgr2=0x7f81cc1207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 0x7f81cc1207c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f81c4016000 tx=0x7f81c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 shutdown_connections 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81cc135f20 0x7f81cc1207c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81cc09d860 0x7f81cc1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 --2- 172.21.15.125:0/3330522418 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81cc09e340 0x7f81cc1c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 >> 172.21.15.125:0/3330522418 conn(0x7f81cc099c40 msgr2=0x7f81cc0a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 shutdown_connections 2023-10-03T10:16:17.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:17.896+0000 7f81d317f700 1 -- 172.21.15.125:0/3330522418 wait complete. 2023-10-03T10:16:17.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:17.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:17.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:18.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 Processor -- start 2023-10-03T10:16:18.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 -- start start 2023-10-03T10:16:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 0x7fb07809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb078131f40 0x7fb078139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07809c970 con 0x7fb07809f180 2023-10-03T10:16:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780a0920 con 0x7fb078131f40 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.080+0000 7fb07d6fa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07809f9c0 con 0x7fb07809e870 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb078131f40 0x7fb078139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 0x7fb07809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb078131f40 0x7fb078139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49198/0 (socket says 172.21.15.125:49198) 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0767fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb07809f180 0x7fb078131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37212/0 (socket says 172.21.15.125:37212) 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 -- 172.21.15.125:0/3187987186 learned_addr learned my addr 172.21.15.125:0/3187987186 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 -- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 msgr2=0x7fb07809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 0x7fb07809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 -- 172.21.15.125:0/3187987186 >> v1:172.21.15.125:6789/0 conn(0x7fb07809f180 legacy=0x7fb078131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb075ffb700 1 -- 172.21.15.125:0/3187987186 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179020484 0 0) 0x7fb07809c970 con 0x7fb07809f180 2023-10-03T10:16:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 -- 172.21.15.125:0/3187987186 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07809bab0 con 0x7fb078131f40 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb076ffd700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 0x7fb07809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb0777fe700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb078131f40 0x7fb078139ca0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb070009e50 tx=0x7fb07000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd75ceca0d14371 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb075ffb700 1 -- 172.21.15.125:0/3187987186 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000e070 con 0x7fb078131f40 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb075ffb700 1 -- 172.21.15.125:0/3187987186 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000b910 con 0x7fb078131f40 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.081+0000 7fb075ffb700 1 -- 172.21.15.125:0/3187987186 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000bcc0 con 0x7fb078131f40 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb078131f40 msgr2=0x7fb078139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb078131f40 0x7fb078139ca0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb070009e50 tx=0x7fb07000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3187987186 shutdown_connections 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb078131f40 0x7fb078139ca0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3187987186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb07809e870 0x7fb07809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3187987186 >> 172.21.15.125:0/3187987186 conn(0x7fb0780a4430 msgr2=0x7fb0780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3187987186 shutdown_connections 2023-10-03T10:16:18.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.082+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3187987186 wait complete. 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 Processor -- start 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 -- start start 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 0x7fb0781205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb078131f40 0x7fb078120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078122b20 con 0x7fb07809e870 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb078121c20 con 0x7fb078131f40 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.083+0000 7fb07d6fa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07809dba0 con 0x7fb07809f180 2023-10-03T10:16:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49200/0 (socket says 172.21.15.125:49200) 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb076ffd700 1 -- 172.21.15.125:0/3289674275 learned_addr learned my addr 172.21.15.125:0/3289674275 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 0x7fb0781205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0777fe700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb078131f40 0x7fb078120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 -- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb078131f40 msgr2=0x7fb078120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb078131f40 0x7fb078120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 -- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 msgr2=0x7fb0781200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 -- 172.21.15.125:0/3289674275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680094a0 con 0x7fb07809f180 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb076ffd700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb0767fc700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 0x7fb0781205e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0780a1a80 tx=0x7fb06c00c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c004c80 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c004de0 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c007310 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb070009b30 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.084+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0781238a0 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.085+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb06c007470 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.085+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07811ce70 con 0x7fb07809f180 2023-10-03T10:16:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.085+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb06c03f140 con 0x7fb07809f180 2023-10-03T10:16:18.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.094+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb06c007720 con 0x7fb07809f180 2023-10-03T10:16:18.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 Processor -- start 2023-10-03T10:16:18.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 -- start start 2023-10-03T10:16:18.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2af40a0a70 0x7f2af40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af409dc00 con 0x7f2af40a1380 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af409ea90 con 0x7f2af40a0a70 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2afa30a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af409dec0 con 0x7f2af4134120 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2af3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2af40a0a70 0x7f2af40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2af3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2af40a0a70 0x7f2af40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49212/0 (socket says 172.21.15.125:49212) 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2af37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2af40a1380 0x7f2af4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37216/0 (socket says 172.21.15.125:37216) 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2af3fff700 1 -- 172.21.15.125:0/3795824071 learned_addr learned my addr 172.21.15.125:0/3795824071 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.125+0000 7f2af88a7700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af3fff700 1 -- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 msgr2=0x7f2af413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af3fff700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af3fff700 1 -- 172.21.15.125:0/3795824071 >> v1:172.21.15.125:6789/0 conn(0x7f2af40a1380 legacy=0x7f2af4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af3fff700 1 -- 172.21.15.125:0/3795824071 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af409e6a0 con 0x7f2af40a0a70 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af2ffd700 1 -- 172.21.15.125:0/3795824071 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920279960 0 0) 0x7f2af409dc00 con 0x7f2af40a1380 2023-10-03T10:16:18.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af88a7700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af3fff700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a0a70 0x7f2af40a0e40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40098f0 tx=0x7f2ae4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3db17bc7ab429b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af2ffd700 1 -- 172.21.15.125:0/3795824071 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4011830 con 0x7f2af40a0a70 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af2ffd700 1 -- 172.21.15.125:0/3795824071 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4011990 con 0x7f2af40a0a70 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.126+0000 7f2af2ffd700 1 -- 172.21.15.125:0/3795824071 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4011d20 con 0x7f2af40a0a70 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 -- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a0a70 msgr2=0x7f2af40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a0a70 0x7f2af40a0e40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40098f0 tx=0x7f2ae4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 -- 172.21.15.125:0/3795824071 shutdown_connections 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 --2- 172.21.15.125:0/3795824071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a0a70 0x7f2af40a0e40 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 -- 172.21.15.125:0/3795824071 >> 172.21.15.125:0/3795824071 conn(0x7f2af40a6610 msgr2=0x7f2af40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 -- 172.21.15.125:0/3795824071 shutdown_connections 2023-10-03T10:16:18.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.127+0000 7f2afa30a700 1 -- 172.21.15.125:0/3795824071 wait complete. 2023-10-03T10:16:18.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 Processor -- start 2023-10-03T10:16:18.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 -- start start 2023-10-03T10:16:18.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 0x7f2af4122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 0x7f2af4122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4133300 con 0x7f2af40a1380 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4125920 con 0x7f2af40a0a70 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2afa30a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4124310 con 0x7f2af4134120 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2af88a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 0x7f2af4122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2af37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 0x7f2af4122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2af88a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55966/0 (socket says 172.21.15.125:55966) 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.128+0000 7f2af88a7700 1 -- 172.21.15.125:0/1304734745 learned_addr learned my addr 172.21.15.125:0/1304734745 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 -- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 msgr2=0x7f2af4123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 -- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 msgr2=0x7f2af4122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 0x7f2af4122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 -- 172.21.15.125:0/1304734745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009a70 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af88a7700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af37fe700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 0x7f2af4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af3fff700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 0x7f2af4122700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4016000 tx=0x7f2ae4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4004300 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae401f070 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40036a0 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2afa30a700 1 -- 172.21.15.125:0/1304734745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae4009550 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.129+0000 7f2afa30a700 1 -- 172.21.15.125:0/1304734745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af4125c80 con 0x7f2af40a0a70 2023-10-03T10:16:18.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.130+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ae4021030 con 0x7f2af40a0a70 2023-10-03T10:16:18.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.130+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ae4040990 con 0x7f2af40a0a70 2023-10-03T10:16:18.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.130+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc0052e0 con 0x7f2af40a0a70 2023-10-03T10:16:18.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.135+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ae40239c0 con 0x7f2af40a0a70 2023-10-03T10:16:18.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.288+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0781238a0 con 0x7fb07809f180 2023-10-03T10:16:18.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.288+0000 7fb05f7fe700 1 -- 172.21.15.125:0/3289674275 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0781238a0 con 0x7fb07809f180 2023-10-03T10:16:18.288 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:18.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.290+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 msgr2=0x7fb0781205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.290+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 0x7fb0781205e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0780a1a80 tx=0x7fb06c00c750 comp rx=0 tx=0).stop 2023-10-03T10:16:18.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 shutdown_connections 2023-10-03T10:16:18.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb078131f40 0x7fb078120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb07809e870 0x7fb0781200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 --2- 172.21.15.125:0/3289674275 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb07809f180 0x7fb0781205e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 >> 172.21.15.125:0/3289674275 conn(0x7fb0780a4430 msgr2=0x7fb078072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 shutdown_connections 2023-10-03T10:16:18.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.291+0000 7fb07d6fa700 1 -- 172.21.15.125:0/3289674275 wait complete. 2023-10-03T10:16:18.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:18.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.328+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2acc005590 con 0x7f2af40a0a70 2023-10-03T10:16:18.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.328+0000 7f2af0ff9700 1 -- 172.21.15.125:0/1304734745 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ae401b430 con 0x7f2af40a0a70 2023-10-03T10:16:18.327 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:18.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 msgr2=0x7f2af4122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 0x7f2af4122700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4016000 tx=0x7f2ae4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 shutdown_connections 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2af4134120 0x7f2af4123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2af40a0a70 0x7f2af4122700 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 --2- 172.21.15.125:0/1304734745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2af40a1380 0x7f2af4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 >> 172.21.15.125:0/1304734745 conn(0x7f2af40a6610 msgr2=0x7f2af40a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 shutdown_connections 2023-10-03T10:16:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.330+0000 7f2ada7fc700 1 -- 172.21.15.125:0/1304734745 wait complete. 2023-10-03T10:16:18.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:18.870 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:18.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:18.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 Processor -- start 2023-10-03T10:16:18.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 -- start start 2023-10-03T10:16:19.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc06ce60 con 0x7f3efc09e870 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06bec0 con 0x7f3efc09f180 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f04089700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc09fa00 con 0x7f3efc1341d0 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f01624700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f02626700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:18.999+0000 7f3f01e25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35152/0 (socket says 172.21.15.125:35152) 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01e25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49216/0 (socket says 172.21.15.125:49216) 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f02626700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55976/0 (socket says 172.21.15.125:55976) 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 -- 172.21.15.125:0/2817263021 learned_addr learned my addr 172.21.15.125:0/2817263021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 -- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 msgr2=0x7f3efc134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 -- 172.21.15.125:0/2817263021 >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 msgr2=0x7f3efc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 --2- 172.21.15.125:0/2817263021 >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 -- 172.21.15.125:0/2817263021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc09ad80 con 0x7f3efc09f180 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01e25700 1 --2- 172.21.15.125:0/2817263021 >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f02626700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f01624700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098f0 tx=0x7f3eec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d522241a14723d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f00e23700 1 -- 172.21.15.125:0/2817263021 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec011830 con 0x7f3efc09f180 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f00e23700 1 -- 172.21.15.125:0/2817263021 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec011990 con 0x7f3efc09f180 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.000+0000 7f3f00e23700 1 -- 172.21.15.125:0/2817263021 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec011d20 con 0x7f3efc09f180 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 -- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 msgr2=0x7f3efc133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098f0 tx=0x7f3eec009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 -- 172.21.15.125:0/2817263021 shutdown_connections 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc1341d0 0x7f3efc134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 --2- 172.21.15.125:0/2817263021 >> v2:172.21.15.125:3300/0 conn(0x7f3efc09e870 0x7f3efc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 --2- 172.21.15.125:0/2817263021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc09f180 0x7f3efc133c90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 -- 172.21.15.125:0/2817263021 >> 172.21.15.125:0/2817263021 conn(0x7f3efc0a4430 msgr2=0x7f3efc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 -- 172.21.15.125:0/2817263021 shutdown_connections 2023-10-03T10:16:19.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.001+0000 7f3f04089700 1 -- 172.21.15.125:0/2817263021 wait complete. 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 Processor -- start 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 -- start start 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 0x7f3efc1229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 0x7f3efc122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1238f0 con 0x7f3efc09f180 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc125c90 con 0x7f3efc1341d0 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f04089700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0a1600 con 0x7f3efc09e870 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f01e25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f01e25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:55992/0 (socket says 172.21.15.125:55992) 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f02626700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 0x7f3efc122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f01e25700 1 -- 172.21.15.125:0/1291008135 learned_addr learned my addr 172.21.15.125:0/1291008135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.002+0000 7f3f01624700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 0x7f3efc1229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 -- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 msgr2=0x7f3efc122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 -- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 msgr2=0x7f3efc122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 0x7f3efc122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 -- 172.21.15.125:0/1291008135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80094a0 con 0x7f3efc09f180 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01e25700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f02626700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 0x7f3efc122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f01624700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 0x7f3efc1229d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f3eec016000 tx=0x7f3eec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec004240 con 0x7f3efc09f180 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec01f070 con 0x7f3efc09f180 2023-10-03T10:16:19.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef4009a70 con 0x7f3efc09f180 2023-10-03T10:16:19.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0045c0 con 0x7f3efc09f180 2023-10-03T10:16:19.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.003+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec009550 con 0x7f3efc09f180 2023-10-03T10:16:19.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.004+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eec021030 con 0x7f3efc09f180 2023-10-03T10:16:19.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.004+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3eec040740 con 0x7f3efc09f180 2023-10-03T10:16:19.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.004+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc04f2a0 con 0x7f3efc09f180 2023-10-03T10:16:19.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.013+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eec015020 con 0x7f3efc09f180 2023-10-03T10:16:19.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.042+0000 7fee18c4f700 1 Processor -- start 2023-10-03T10:16:19.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.042+0000 7fee18c4f700 1 -- start start 2023-10-03T10:16:19.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1409e9d0 con 0x7fee140a0a70 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1409dc00 con 0x7fee140a1380 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee18c4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee1409dec0 con 0x7fee14133f50 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee12d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49244/0 (socket says 172.21.15.125:49244) 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee12d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56002/0 (socket says 172.21.15.125:56002) 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35180/0 (socket says 172.21.15.125:35180) 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1259c700 1 -- 172.21.15.125:0/1968546168 learned_addr learned my addr 172.21.15.125:0/1968546168 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 -- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 msgr2=0x7fee141343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 -- 172.21.15.125:0/1968546168 >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 msgr2=0x7fee140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 --2- 172.21.15.125:0/1968546168 >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 -- 172.21.15.125:0/1968546168 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1409e6a0 con 0x7fee140a1380 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1259c700 1 --2- 172.21.15.125:0/1968546168 >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee12d9d700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee11d9b700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fee08009840 tx=0x7fee08009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b269e686c3967c39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1159a700 1 -- 172.21.15.125:0/1968546168 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011830 con 0x7fee140a1380 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1159a700 1 -- 172.21.15.125:0/1968546168 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011990 con 0x7fee140a1380 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.043+0000 7fee1159a700 1 -- 172.21.15.125:0/1968546168 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011d20 con 0x7fee140a1380 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 -- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 msgr2=0x7fee14133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fee08009840 tx=0x7fee08009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 -- 172.21.15.125:0/1968546168 shutdown_connections 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee14133f50 0x7fee141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 --2- 172.21.15.125:0/1968546168 >> v2:172.21.15.125:3300/0 conn(0x7fee140a0a70 0x7fee140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 --2- 172.21.15.125:0/1968546168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee140a1380 0x7fee14133a10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 -- 172.21.15.125:0/1968546168 >> 172.21.15.125:0/1968546168 conn(0x7fee140a6610 msgr2=0x7fee140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 -- 172.21.15.125:0/1968546168 shutdown_connections 2023-10-03T10:16:19.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.044+0000 7fee18c4f700 1 -- 172.21.15.125:0/1968546168 wait complete. 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.045+0000 7fee18c4f700 1 Processor -- start 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 -- start start 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 0x7fee14122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee141241a0 con 0x7fee140a1380 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee14124eb0 con 0x7fee14133f50 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee18c4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee14125270 con 0x7fee140a0a70 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee1259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee11d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee1259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56016/0 (socket says 172.21.15.125:56016) 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee1259c700 1 -- 172.21.15.125:0/397135522 learned_addr learned my addr 172.21.15.125:0/397135522 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee11d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49246/0 (socket says 172.21.15.125:49246) 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.046+0000 7fee12d9d700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 0x7fee14122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 -- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 msgr2=0x7fee14122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 0x7fee14122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 -- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 msgr2=0x7fee141229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 -- 172.21.15.125:0/397135522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04009550 con 0x7fee140a0a70 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee12d9d700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 0x7fee14122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee11d9b700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee1259c700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ebe0 tx=0x7fee0400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04004030 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04004190 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c009a70 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04004520 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.047+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee080094a0 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.048+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee0400c7f0 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.048+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1404f2a0 con 0x7fee140a0a70 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.048+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee0403f570 con 0x7fee140a0a70 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.052+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee040036a0 con 0x7fee140a0a70 2023-10-03T10:16:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.202+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3efc072d60 con 0x7f3efc09f180 2023-10-03T10:16:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.203+0000 7f3ef27fc700 1 -- 172.21.15.125:0/1291008135 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eec01a450 con 0x7f3efc09f180 2023-10-03T10:16:19.202 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 msgr2=0x7f3efc1229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 0x7f3efc1229d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f3eec016000 tx=0x7f3eec004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 shutdown_connections 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc1341d0 0x7f3efc122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3efc09e870 0x7f3efc122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 --2- 172.21.15.125:0/1291008135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc09f180 0x7f3efc1229d0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 >> 172.21.15.125:0/1291008135 conn(0x7f3efc0a4430 msgr2=0x7f3efc072170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 shutdown_connections 2023-10-03T10:16:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.205+0000 7f3f04089700 1 -- 172.21.15.125:0/1291008135 wait complete. 2023-10-03T10:16:19.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:19.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.239+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee14072980 con 0x7fee140a0a70 2023-10-03T10:16:19.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.240+0000 7fee02ffd700 1 -- 172.21.15.125:0/397135522 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee04019ab0 con 0x7fee140a0a70 2023-10-03T10:16:19.239 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:19.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 msgr2=0x7fee141224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ebe0 tx=0x7fee0400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 shutdown_connections 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee14133f50 0x7fee14122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee140a0a70 0x7fee141224b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 --2- 172.21.15.125:0/397135522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee140a1380 0x7fee141229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 >> 172.21.15.125:0/397135522 conn(0x7fee140a6610 msgr2=0x7fee1409b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 shutdown_connections 2023-10-03T10:16:19.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.242+0000 7fee18c4f700 1 -- 172.21.15.125:0/397135522 wait complete. 2023-10-03T10:16:19.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:19.304 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:19.342 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.434+0000 7f1548172700 1 Processor -- start 2023-10-03T10:16:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.434+0000 7f1548172700 1 -- start start 2023-10-03T10:16:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1548172700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f154009d860 0x7f154009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1548172700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1548172700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154009aaa0 con 0x7f154009e170 2023-10-03T10:16:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1548172700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154009f870 con 0x7f154009d860 2023-10-03T10:16:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1548172700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154009b360 con 0x7f1540130eb0 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f154670f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f154009d860 0x7f154009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f154670f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56024/0 (socket says 172.21.15.125:56024) 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f154670f700 1 -- 172.21.15.125:0/2573929062 learned_addr learned my addr 172.21.15.125:0/2573929062 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 -- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 msgr2=0x7f1540138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 -- 172.21.15.125:0/2573929062 >> v1:172.21.15.125:6789/0 conn(0x7f154009e170 legacy=0x7f15401307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1544f0c700 1 -- 172.21.15.125:0/2573929062 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299728821 0 0) 0x7f154009aaa0 con 0x7f154009e170 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 -- 172.21.15.125:0/2573929062 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154009b620 con 0x7f154009d860 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f154670f700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.435+0000 7f1545f0e700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009d860 0x7f154009dc30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f153c009840 tx=0x7f153c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76366a86046af82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1544f0c700 1 -- 172.21.15.125:0/2573929062 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011830 con 0x7f154009d860 2023-10-03T10:16:19.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1544f0c700 1 -- 172.21.15.125:0/2573929062 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c011990 con 0x7f154009d860 2023-10-03T10:16:19.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1544f0c700 1 -- 172.21.15.125:0/2573929062 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011d20 con 0x7f154009d860 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 -- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009d860 msgr2=0x7f154009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009d860 0x7f154009dc30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f153c009840 tx=0x7f153c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 -- 172.21.15.125:0/2573929062 shutdown_connections 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 --2- 172.21.15.125:0/2573929062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009d860 0x7f154009dc30 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 -- 172.21.15.125:0/2573929062 >> 172.21.15.125:0/2573929062 conn(0x7f1540099c40 msgr2=0x7f15400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 -- 172.21.15.125:0/2573929062 shutdown_connections 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.436+0000 7f1548172700 1 -- 172.21.15.125:0/2573929062 wait complete. 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.437+0000 7f1548172700 1 Processor -- start 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.437+0000 7f1548172700 1 -- start start 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 0x7f15401214f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540121f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540130410 con 0x7f154009e170 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1540123760 con 0x7f154009d860 2023-10-03T10:16:19.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1548172700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154009c8b0 con 0x7f1540130eb0 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154570d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1545f0e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 0x7f15401214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154570d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49274/0 (socket says 172.21.15.125:49274) 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154570d700 1 -- 172.21.15.125:0/4150771697 learned_addr learned my addr 172.21.15.125:0/4150771697 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540121f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 -- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 msgr2=0x7f15401214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 0x7f15401214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 -- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 msgr2=0x7f1540121a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 -- 172.21.15.125:0/4150771697 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009b30 con 0x7f1540130eb0 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154570d700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f1545f0e700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 0x7f15401214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f154670f700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540121f70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f153800efc0 tx=0x7f153800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.438+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538018070 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800f040 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0094a0 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538003c60 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15401228e0 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f153800c880 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f153803f790 con 0x7f1540130eb0 2023-10-03T10:16:19.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.439+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154004f2a0 con 0x7f1540130eb0 2023-10-03T10:16:19.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.448+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1538003dc0 con 0x7f1540130eb0 2023-10-03T10:16:19.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 Processor -- start 2023-10-03T10:16:19.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 -- start start 2023-10-03T10:16:19.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 0x7fe2d806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 0x7fe2d8132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d809f770 con 0x7fe2d8131cf0 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d809dce0 con 0x7fe2d806b080 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2dde85700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d809da80 con 0x7fe2d806a770 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35222/0 (socket says 172.21.15.125:35222) 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 0x7fe2d806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2d6ffd700 1 -- 172.21.15.125:0/3396443408 learned_addr learned my addr 172.21.15.125:0/3396443408 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.477+0000 7fe2d7fff700 1 --2- 172.21.15.125:0/3396443408 >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 0x7fe2d8132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 -- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 msgr2=0x7fe2d81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 -- 172.21.15.125:0/3396443408 >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 msgr2=0x7fe2d8132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/3396443408 >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 0x7fe2d8132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 -- 172.21.15.125:0/3396443408 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d809eb20 con 0x7fe2d806a770 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d6ffd700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d7fff700 1 --2- 172.21.15.125:0/3396443408 >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 0x7fe2d8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 0x7fe2d806ab40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88afd7417dfe9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d67fc700 1 -- 172.21.15.125:0/3396443408 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011830 con 0x7fe2d806a770 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d67fc700 1 -- 172.21.15.125:0/3396443408 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc011990 con 0x7fe2d806a770 2023-10-03T10:16:19.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.478+0000 7fe2d67fc700 1 -- 172.21.15.125:0/3396443408 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011d20 con 0x7fe2d806a770 2023-10-03T10:16:19.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 -- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 msgr2=0x7fe2d806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 0x7fe2d806ab40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 -- 172.21.15.125:0/3396443408 shutdown_connections 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 --2- 172.21.15.125:0/3396443408 >> v2:172.21.15.125:3300/0 conn(0x7fe2d8131cf0 0x7fe2d8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d806a770 0x7fe2d806ab40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 --2- 172.21.15.125:0/3396443408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 -- 172.21.15.125:0/3396443408 >> 172.21.15.125:0/3396443408 conn(0x7fe2d8099c40 msgr2=0x7fe2d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 -- 172.21.15.125:0/3396443408 shutdown_connections 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.479+0000 7fe2dde85700 1 -- 172.21.15.125:0/3396443408 wait complete. 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 Processor -- start 2023-10-03T10:16:19.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 -- start start 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 0x7fe2d811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8120a00 con 0x7fe2d806a770 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81223d0 con 0x7fe2d806b080 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2dde85700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8121a10 con 0x7fe2d8131cf0 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35236/0 (socket says 172.21.15.125:35236) 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49292/0 (socket says 172.21.15.125:49292) 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d6ffd700 1 -- 172.21.15.125:0/1136773789 learned_addr learned my addr 172.21.15.125:0/1136773789 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:19.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.480+0000 7fe2d7fff700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 0x7fe2d811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 -- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 msgr2=0x7fe2d811ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 0x7fe2d811ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 -- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 msgr2=0x7fe2d811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 -- 172.21.15.125:0/1136773789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009550 con 0x7fe2d806a770 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d7fff700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 0x7fe2d811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d6ffd700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2d77fe700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009840 tx=0x7fe2cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc004450 con 0x7fe2d806a770 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc01f070 con 0x7fe2d806a770 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0009a70 con 0x7fe2d806a770 2023-10-03T10:16:19.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0038c0 con 0x7fe2d806a770 2023-10-03T10:16:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.481+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc0094a0 con 0x7fe2d806a770 2023-10-03T10:16:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.482+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2cc003a20 con 0x7fe2d806a770 2023-10-03T10:16:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.482+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2cc021070 con 0x7fe2d806a770 2023-10-03T10:16:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.482+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d811add0 con 0x7fe2d806a770 2023-10-03T10:16:19.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.487+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2cc015080 con 0x7fe2d806a770 2023-10-03T10:16:19.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.644+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1540123c30 con 0x7f1540130eb0 2023-10-03T10:16:19.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.644+0000 7f15367fc700 1 -- 172.21.15.125:0/4150771697 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f153801de00 con 0x7f1540130eb0 2023-10-03T10:16:19.644 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 msgr2=0x7f1540121f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540121f70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f153800efc0 tx=0x7f153800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 shutdown_connections 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1540130eb0 0x7f1540121f70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f154009d860 0x7f15401214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 --2- 172.21.15.125:0/4150771697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f154009e170 0x7f1540121a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 >> 172.21.15.125:0/4150771697 conn(0x7f1540099c40 msgr2=0x7f1540119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 shutdown_connections 2023-10-03T10:16:19.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.646+0000 7f1548172700 1 -- 172.21.15.125:0/4150771697 wait complete. 2023-10-03T10:16:19.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:19.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.679+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2d8121560 con 0x7fe2d806a770 2023-10-03T10:16:19.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.679+0000 7fe2bffff700 1 -- 172.21.15.125:0/1136773789 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2cc02b020 con 0x7fe2d806a770 2023-10-03T10:16:19.680 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 msgr2=0x7fe2d811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009840 tx=0x7fe2cc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 shutdown_connections 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2d8131cf0 0x7fe2d811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2d806a770 0x7fe2d811df80 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 --2- 172.21.15.125:0/1136773789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2d806b080 0x7fe2d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 >> 172.21.15.125:0/1136773789 conn(0x7fe2d8099c40 msgr2=0x7fe2d8130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 shutdown_connections 2023-10-03T10:16:19.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:19.681+0000 7fe2dde85700 1 -- 172.21.15.125:0/1136773789 wait complete. 2023-10-03T10:16:19.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:20.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:20.253 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:20.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.345+0000 7f622a06c700 1 Processor -- start 2023-10-03T10:16:20.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.345+0000 7f622a06c700 1 -- start start 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6224133ad0 0x7f6224133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f62241304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 0x7f622413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622406b2d0 con 0x7f6224133ad0 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6224133610 con 0x7f62241300a0 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f622a06c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f622409a500 con 0x7f62241309f0 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6224133ad0 0x7f6224133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6224133ad0 0x7f6224133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49300/0 (socket says 172.21.15.125:49300) 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 -- 172.21.15.125:0/4191202203 learned_addr learned my addr 172.21.15.125:0/4191202203 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f6222ffd700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f62241304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f6223fff700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 0x7f622413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 -- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 msgr2=0x7f622413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 0x7f622413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 -- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 msgr2=0x7f62241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f62241304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 -- 172.21.15.125:0/4191202203 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62241338b0 con 0x7f6224133ad0 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f6222ffd700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f62241304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f6223fff700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 0x7f622413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62237fe700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6224133ad0 0x7f6224133ea0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6214009e50 tx=0x7f621400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6aea530ad069bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.346+0000 7f62227fc700 1 -- 172.21.15.125:0/4191202203 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400e070 con 0x7f6224133ad0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f62227fc700 1 -- 172.21.15.125:0/4191202203 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621400b910 con 0x7f6224133ad0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f62227fc700 1 -- 172.21.15.125:0/4191202203 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400bcc0 con 0x7f6224133ad0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 -- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6224133ad0 msgr2=0x7f6224133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6224133ad0 0x7f6224133ea0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6214009e50 tx=0x7f621400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 -- 172.21.15.125:0/4191202203 shutdown_connections 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62241309f0 0x7f622413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6224133ad0 0x7f6224133ea0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 --2- 172.21.15.125:0/4191202203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f62241304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 -- 172.21.15.125:0/4191202203 >> 172.21.15.125:0/4191202203 conn(0x7f6224099c40 msgr2=0x7f62240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 -- 172.21.15.125:0/4191202203 shutdown_connections 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.347+0000 7f622a06c700 1 -- 172.21.15.125:0/4191202203 wait complete. 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.348+0000 7f622a06c700 1 Processor -- start 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.348+0000 7f622a06c700 1 -- start start 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f622411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 0x7f622411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622411fd00 con 0x7f62241309f0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622412dd00 con 0x7f62241300a0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f622a06c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6224120950 con 0x7f6224133ad0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6222ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6222ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49308/0 (socket says 172.21.15.125:49308) 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6223fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 0x7f622411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6222ffd700 1 -- 172.21.15.125:0/4064462639 learned_addr learned my addr 172.21.15.125:0/4064462639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f622411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 -- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 msgr2=0x7f622411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 0x7f622411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 -- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 msgr2=0x7f622411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 -- 172.21.15.125:0/4064462639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180094a0 con 0x7f62241300a0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6223fff700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 0x7f622411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f6222ffd700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.349+0000 7f62237fe700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f622411da40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f622406e5d0 tx=0x7f6214004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400cea0 con 0x7f62241300a0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214004250 con 0x7f62241300a0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140045e0 con 0x7f62241300a0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0094a0 con 0x7f62241300a0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6214009b30 con 0x7f62241300a0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.350+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6214004740 con 0x7f62241300a0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.351+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6214040860 con 0x7f62241300a0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.351+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622404f2a0 con 0x7f62241300a0 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.359+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f621401a740 con 0x7f62241300a0 2023-10-03T10:16:20.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.388+0000 7f08f63d0700 1 Processor -- start 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.388+0000 7f08f63d0700 1 -- start start 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f63d0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f63d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f63d0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f006f970 con 0x7f08f009e240 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f63d0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00720a0 con 0x7f08f0098410 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f63d0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0072290 con 0x7f08f009d8f0 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49310/0 (socket says 172.21.15.125:49310) 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35252/0 (socket says 172.21.15.125:35252) 2023-10-03T10:16:20.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08effff700 1 -- 172.21.15.125:0/2757637871 learned_addr learned my addr 172.21.15.125:0/2757637871 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08f496d700 1 --1- 172.21.15.125:0/2757637871 >> v1:172.21.15.125:6789/0 conn(0x7f08f009e240 0x7f08f01387d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37234/0 (socket says 172.21.15.125:37234) 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 -- 172.21.15.125:0/2757637871 >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 msgr2=0x7f08f00987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 --2- 172.21.15.125:0/2757637871 >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 -- 172.21.15.125:0/2757637871 >> v1:172.21.15.125:6789/0 conn(0x7f08f009e240 legacy=0x7f08f01387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08eeffd700 1 -- 172.21.15.125:0/2757637871 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311750656 0 0) 0x7f08f006f970 con 0x7f08f009e240 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 -- 172.21.15.125:0/2757637871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0071530 con 0x7f08f009d8f0 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08effff700 1 --2- 172.21.15.125:0/2757637871 >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.389+0000 7f08ef7fe700 1 --2- 172.21.15.125:0/2757637871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009840 tx=0x7f08e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9126caddcf089e9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08eeffd700 1 -- 172.21.15.125:0/2757637871 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0011830 con 0x7f08f009d8f0 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08eeffd700 1 -- 172.21.15.125:0/2757637871 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0011990 con 0x7f08f009d8f0 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08eeffd700 1 -- 172.21.15.125:0/2757637871 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0011d20 con 0x7f08f009d8f0 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 -- 172.21.15.125:0/2757637871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 msgr2=0x7f08f009dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 --2- 172.21.15.125:0/2757637871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009840 tx=0x7f08e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 -- 172.21.15.125:0/2757637871 shutdown_connections 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 --2- 172.21.15.125:0/2757637871 >> v2:172.21.15.125:3300/0 conn(0x7f08f0098410 0x7f08f00987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 --2- 172.21.15.125:0/2757637871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009d8f0 0x7f08f009dd00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 -- 172.21.15.125:0/2757637871 >> 172.21.15.125:0/2757637871 conn(0x7f08f00a2b30 msgr2=0x7f08f009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 -- 172.21.15.125:0/2757637871 shutdown_connections 2023-10-03T10:16:20.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.390+0000 7f08f63d0700 1 -- 172.21.15.125:0/2757637871 wait complete. 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.391+0000 7f08f63d0700 1 Processor -- start 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.391+0000 7f08f63d0700 1 -- start start 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08f009d8f0 0x7f08f0128330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009e240 0x7f08f01c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0128870 con 0x7f08f0098410 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0128f20 con 0x7f08f009e240 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0070910 con 0x7f08f009d8f0 2023-10-03T10:16:20.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49312/0 (socket says 172.21.15.125:49312) 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 -- 172.21.15.125:0/1604953074 learned_addr learned my addr 172.21.15.125:0/1604953074 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08ef7fe700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08f009d8f0 0x7f08f0128330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f496d700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009e240 0x7f08f01c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 -- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08f009d8f0 msgr2=0x7f08f0128330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08f009d8f0 0x7f08f0128330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 -- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009e240 msgr2=0x7f08f01c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009e240 0x7f08f01c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 -- 172.21.15.125:0/1604953074 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009500 con 0x7f08f0098410 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08effff700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8005a20 con 0x7f08f0098410 2023-10-03T10:16:20.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8005b80 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.392+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00094a0 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.393+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800c7f0 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.393+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00a1470 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.393+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08d800c950 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.393+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08d803f970 con 0x7f08f0098410 2023-10-03T10:16:20.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.394+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f01294d0 con 0x7f08f0098410 2023-10-03T10:16:20.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.398+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08d8020080 con 0x7f08f0098410 2023-10-03T10:16:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.550+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f622411ee40 con 0x7f62241300a0 2023-10-03T10:16:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.551+0000 7f620bfff700 1 -- 172.21.15.125:0/4064462639 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f621401b3a0 con 0x7f62241300a0 2023-10-03T10:16:20.551 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 msgr2=0x7f622411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f622411da40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f622406e5d0 tx=0x7f6214004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 shutdown_connections 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6224133ad0 0x7f622411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62241300a0 0x7f622411da40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 --2- 172.21.15.125:0/4064462639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62241309f0 0x7f622411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 >> 172.21.15.125:0/4064462639 conn(0x7f6224099c40 msgr2=0x7f622412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 shutdown_connections 2023-10-03T10:16:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.553+0000 7f622a06c700 1 -- 172.21.15.125:0/4064462639 wait complete. 2023-10-03T10:16:20.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:20.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.587+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08f004f2a0 con 0x7f08f0098410 2023-10-03T10:16:20.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.588+0000 7f08ecff9700 1 -- 172.21.15.125:0/1604953074 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08d8006030 con 0x7f08f0098410 2023-10-03T10:16:20.588 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:20.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 msgr2=0x7f08f0127df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 shutdown_connections 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f009e240 0x7f08f01c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f0098410 0x7f08f0127df0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 --2- 172.21.15.125:0/1604953074 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08f009d8f0 0x7f08f0128330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 >> 172.21.15.125:0/1604953074 conn(0x7f08f00a2b30 msgr2=0x7f08f01b9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 shutdown_connections 2023-10-03T10:16:20.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.590+0000 7f08f63d0700 1 -- 172.21.15.125:0/1604953074 wait complete. 2023-10-03T10:16:20.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:20.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:20.694 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:20.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 Processor -- start 2023-10-03T10:16:20.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 -- start start 2023-10-03T10:16:20.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b809c970 con 0x7fb3b809e870 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a0920 con 0x7fb3b81371c0 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3c00e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b809f9c0 con 0x7fb3b809f350 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3bd681700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3be683700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3bde82700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb3b809e870 0x7fb3b809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37242/0 (socket says 172.21.15.125:37242) 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.785+0000 7fb3bde82700 1 -- 172.21.15.125:0/608045223 learned_addr learned my addr 172.21.15.125:0/608045223 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3be683700 1 -- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 msgr2=0x7fb3b8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3bce80700 1 -- 172.21.15.125:0/608045223 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549472390 0 0) 0x7fb3b809c970 con 0x7fb3b809e870 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3be683700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3be683700 1 -- 172.21.15.125:0/608045223 >> v1:172.21.15.125:6789/0 conn(0x7fb3b809e870 legacy=0x7fb3b809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3be683700 1 -- 172.21.15.125:0/608045223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b809bab0 con 0x7fb3b81371c0 2023-10-03T10:16:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3bd681700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3be683700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b81395a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009dc0 tx=0x7fb3b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6621e5f85e7c12b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3bce80700 1 -- 172.21.15.125:0/608045223 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000e070 con 0x7fb3b81371c0 2023-10-03T10:16:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3bce80700 1 -- 172.21.15.125:0/608045223 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000bb20 con 0x7fb3b81371c0 2023-10-03T10:16:20.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.786+0000 7fb3bce80700 1 -- 172.21.15.125:0/608045223 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0012430 con 0x7fb3b81371c0 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 -- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 msgr2=0x7fb3b81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b81395a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009dc0 tx=0x7fb3b000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 -- 172.21.15.125:0/608045223 shutdown_connections 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b81395a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/608045223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 -- 172.21.15.125:0/608045223 >> 172.21.15.125:0/608045223 conn(0x7fb3b80a4430 msgr2=0x7fb3b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 -- 172.21.15.125:0/608045223 shutdown_connections 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.787+0000 7fb3c00e6700 1 -- 172.21.15.125:0/608045223 wait complete. 2023-10-03T10:16:20.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 Processor -- start 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 -- start start 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3b809e870 0x7fb3b811b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b811bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b811ed60 con 0x7fb3b809e870 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b811d470 con 0x7fb3b81371c0 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3c00e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b809dc10 con 0x7fb3b809f350 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56104/0 (socket says 172.21.15.125:56104) 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 -- 172.21.15.125:0/3184230677 learned_addr learned my addr 172.21.15.125:0/3184230677 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bde82700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3b809e870 0x7fb3b811b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3be683700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b811bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 -- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 msgr2=0x7fb3b811bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b811bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.788+0000 7fb3bd681700 1 -- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3b809e870 msgr2=0x7fb3b811b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3bd681700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3b809e870 0x7fb3b811b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3bd681700 1 -- 172.21.15.125:0/3184230677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a800d940 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3bd681700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8012fc0 tx=0x7fb3a80103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8010b00 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a8013040 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b0009a70 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8010e80 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.789+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b811e4f0 con 0x7fb3b809f350 2023-10-03T10:16:20.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.790+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b804f2a0 con 0x7fb3b809f350 2023-10-03T10:16:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.790+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3a8018480 con 0x7fb3b809f350 2023-10-03T10:16:20.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.790+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3a80441b0 con 0x7fb3b809f350 2023-10-03T10:16:20.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.798+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3a8020550 con 0x7fb3b809f350 2023-10-03T10:16:20.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.830+0000 7f17c6dc6700 1 Processor -- start 2023-10-03T10:16:20.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.830+0000 7f17c6dc6700 1 -- start start 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c6dc6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c6dc6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 0x7f17c013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c6dc6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c009af80 con 0x7f17c009a150 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c6dc6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009a520 con 0x7f17c009ef80 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c6dc6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009fe00 con 0x7f17c009f370 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17bffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17bffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35278/0 (socket says 172.21.15.125:35278) 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17bffff700 1 -- 172.21.15.125:0/4254353432 learned_addr learned my addr 172.21.15.125:0/4254353432 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c5363700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 0x7f17c013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c5363700 1 -- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 msgr2=0x7f17c0138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c5363700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c5363700 1 -- 172.21.15.125:0/4254353432 >> v1:172.21.15.125:6789/0 conn(0x7f17c009a150 legacy=0x7f17c009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17bf7fe700 1 -- 172.21.15.125:0/4254353432 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532600380 0 0) 0x7f17c009af80 con 0x7f17c009a150 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17c5363700 1 -- 172.21.15.125:0/4254353432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c006bc20 con 0x7f17c009f370 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.831+0000 7f17bffff700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c5363700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 0x7f17c013b3b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009df0 tx=0x7f17b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677a4bd0fe278fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17bf7fe700 1 -- 172.21.15.125:0/4254353432 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800e070 con 0x7f17c009f370 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17bf7fe700 1 -- 172.21.15.125:0/4254353432 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b800bae0 con 0x7f17c009f370 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17bf7fe700 1 -- 172.21.15.125:0/4254353432 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800be90 con 0x7f17c009f370 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 -- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 msgr2=0x7f17c013b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 0x7f17c013b3b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009df0 tx=0x7f17b800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:20.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 -- 172.21.15.125:0/4254353432 shutdown_connections 2023-10-03T10:16:20.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009f370 0x7f17c013b3b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/4254353432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009ef80 0x7f17c0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 -- 172.21.15.125:0/4254353432 >> 172.21.15.125:0/4254353432 conn(0x7f17c00a4430 msgr2=0x7f17c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 -- 172.21.15.125:0/4254353432 shutdown_connections 2023-10-03T10:16:20.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.832+0000 7f17c6dc6700 1 -- 172.21.15.125:0/4254353432 wait complete. 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.833+0000 7f17c6dc6700 1 Processor -- start 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.833+0000 7f17c6dc6700 1 -- start start 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c009a150 0x7f17c01395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c011fd30 con 0x7f17c009a150 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009b840 con 0x7f17c009f370 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c6dc6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c013b690 con 0x7f17c009ef80 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17bffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17bffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56122/0 (socket says 172.21.15.125:56122) 2023-10-03T10:16:20.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17bffff700 1 -- 172.21.15.125:0/2971742756 learned_addr learned my addr 172.21.15.125:0/2971742756 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35288/0 (socket says 172.21.15.125:35288) 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c4b62700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c009a150 0x7f17c01395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 -- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 msgr2=0x7f17c0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 -- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c009a150 msgr2=0x7f17c01395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c009a150 0x7f17c01395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 -- 172.21.15.125:0/2971742756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac009550 con 0x7f17c009f370 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17bffff700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.834+0000 7f17c5363700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f17b8016000 tx=0x7f17b8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8027480 con 0x7f17c009f370 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8020070 con 0x7f17c009f370 2023-10-03T10:16:20.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8027840 con 0x7f17c009f370 2023-10-03T10:16:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8009a70 con 0x7f17c009f370 2023-10-03T10:16:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c00a04a0 con 0x7f17c009f370 2023-10-03T10:16:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17b801b400 con 0x7f17c009f370 2023-10-03T10:16:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.835+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c009fa30 con 0x7f17c009f370 2023-10-03T10:16:20.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.836+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17b8022070 con 0x7f17c009f370 2023-10-03T10:16:20.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.840+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17b802c070 con 0x7f17c009f370 2023-10-03T10:16:20.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.993+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3b811d640 con 0x7fb3b809f350 2023-10-03T10:16:20.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.993+0000 7fb3ae7fc700 1 -- 172.21.15.125:0/3184230677 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3a8020370 con 0x7fb3b809f350 2023-10-03T10:16:20.994 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 msgr2=0x7fb3b811b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8012fc0 tx=0x7fb3a80103a0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 shutdown_connections 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3b81371c0 0x7fb3b811bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3b809e870 0x7fb3b811b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 --2- 172.21.15.125:0/3184230677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb3b809f350 0x7fb3b811b780 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 >> 172.21.15.125:0/3184230677 conn(0x7fb3b80a4430 msgr2=0x7fb3b8071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 shutdown_connections 2023-10-03T10:16:20.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:20.995+0000 7fb3c00e6700 1 -- 172.21.15.125:0/3184230677 wait complete. 2023-10-03T10:16:21.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:21.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.031+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17c011fb60 con 0x7f17c009f370 2023-10-03T10:16:21.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.031+0000 7f17bd7fa700 1 -- 172.21.15.125:0/2971742756 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17b8035090 con 0x7f17c009f370 2023-10-03T10:16:21.032 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:21.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 msgr2=0x7f17c013a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f17b8016000 tx=0x7f17b8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 shutdown_connections 2023-10-03T10:16:21.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17c009f370 0x7f17c013a070 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c009a150 0x7f17c01395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 --2- 172.21.15.125:0/2971742756 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17c009ef80 0x7f17c0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.033+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 >> 172.21.15.125:0/2971742756 conn(0x7f17c00a4430 msgr2=0x7f17c0136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.034+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 shutdown_connections 2023-10-03T10:16:21.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.034+0000 7f17c6dc6700 1 -- 172.21.15.125:0/2971742756 wait complete. 2023-10-03T10:16:21.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:21.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:21.603 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:21.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.692+0000 7f16c6d07700 1 Processor -- start 2023-10-03T10:16:21.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 -- start start 2023-10-03T10:16:21.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 0x7f16c0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c009e9d0 con 0x7f16c00a1380 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c009dc00 con 0x7f16c0133f50 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c6d07700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c009dec0 con 0x7f16c00a0a70 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16bffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16bffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49334/0 (socket says 172.21.15.125:49334) 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56128/0 (socket says 172.21.15.125:56128) 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16bffff700 1 -- 172.21.15.125:0/815800021 learned_addr learned my addr 172.21.15.125:0/815800021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c52a4700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 0x7f16c0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 -- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 msgr2=0x7f16c0134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 0x7f16c0134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 -- 172.21.15.125:0/815800021 >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 msgr2=0x7f16c0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/815800021 >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c4aa3700 1 -- 172.21.15.125:0/815800021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c009e6a0 con 0x7f16c00a0a70 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16bffff700 1 --2- 172.21.15.125:0/815800021 >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.693+0000 7f16c52a4700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 0x7f16c0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009840 tx=0x7f16b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf558eb2b700c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16bf7fe700 1 -- 172.21.15.125:0/815800021 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4011830 con 0x7f16c00a0a70 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16bf7fe700 1 -- 172.21.15.125:0/815800021 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b4011990 con 0x7f16c00a0a70 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16bf7fe700 1 -- 172.21.15.125:0/815800021 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4011d20 con 0x7f16c00a0a70 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 -- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 msgr2=0x7f16c00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009840 tx=0x7f16b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 -- 172.21.15.125:0/815800021 shutdown_connections 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c0133f50 0x7f16c0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 --2- 172.21.15.125:0/815800021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a0a70 0x7f16c00a0e40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 --2- 172.21.15.125:0/815800021 >> v2:172.21.15.125:3300/0 conn(0x7f16c00a1380 0x7f16c0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.694+0000 7f16c6d07700 1 -- 172.21.15.125:0/815800021 >> 172.21.15.125:0/815800021 conn(0x7f16c00a6610 msgr2=0x7f16c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.695+0000 7f16c6d07700 1 -- 172.21.15.125:0/815800021 shutdown_connections 2023-10-03T10:16:21.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.695+0000 7f16c6d07700 1 -- 172.21.15.125:0/815800021 wait complete. 2023-10-03T10:16:21.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.696+0000 7f16c6d07700 1 Processor -- start 2023-10-03T10:16:21.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.696+0000 7f16c6d07700 1 -- start start 2023-10-03T10:16:21.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 0x7f16c0122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 0x7f16c0123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0126300 con 0x7f16c0133f50 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01243f0 con 0x7f16c00a0a70 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c009d340 con 0x7f16c00a1380 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16bffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 0x7f16c0122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35306/0 (socket says 172.21.15.125:35306) 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c52a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 0x7f16c0123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 -- 172.21.15.125:0/2010889223 learned_addr learned my addr 172.21.15.125:0/2010889223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 -- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 msgr2=0x7f16c0122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 0x7f16c0122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 -- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 msgr2=0x7f16c0123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 0x7f16c0123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 -- 172.21.15.125:0/2010889223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac009550 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c52a4700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 0x7f16c0123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16bffff700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 0x7f16c0122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c4aa3700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009fd0 tx=0x7f16b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4004450 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b401e070 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40038e0 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.697+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b8009a70 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.698+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b40094a0 con 0x7f16c00a0a70 2023-10-03T10:16:21.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.698+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16b4003a40 con 0x7f16c00a0a70 2023-10-03T10:16:21.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.698+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16b40402e0 con 0x7f16c00a0a70 2023-10-03T10:16:21.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.698+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c004f2a0 con 0x7f16c00a0a70 2023-10-03T10:16:21.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.703+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16b4015080 con 0x7f16c00a0a70 2023-10-03T10:16:21.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.735+0000 7fcdbace2700 1 Processor -- start 2023-10-03T10:16:21.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.735+0000 7fcdbace2700 1 -- start start 2023-10-03T10:16:21.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.735+0000 7fcdbace2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 0x7fcdb4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdbace2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdb4139200 0x7fcdb413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdbace2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb409e9d0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdbace2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb409dc00 con 0x7fcdb4139200 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdbace2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb409dec0 con 0x7fcdb40a1550 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb8a7e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcdb40a0a70 0x7fcdb40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37262/0 (socket says 172.21.15.125:37262) 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 0x7fcdb4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb8a7e700 1 -- 172.21.15.125:0/3676842853 learned_addr learned my addr 172.21.15.125:0/3676842853 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb927f700 1 --2- 172.21.15.125:0/3676842853 >> v2:172.21.15.125:3300/0 conn(0x7fcdb4139200 0x7fcdb413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb37fe700 1 -- 172.21.15.125:0/3676842853 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171439855 0 0) 0x7fcdb409e9d0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb37fe700 1 -- 172.21.15.125:0/3676842853 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda40035b0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 -- 172.21.15.125:0/3676842853 >> v2:172.21.15.125:3300/0 conn(0x7fcdb4139200 msgr2=0x7fcdb413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 --2- 172.21.15.125:0/3676842853 >> v2:172.21.15.125:3300/0 conn(0x7fcdb4139200 0x7fcdb413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 -- 172.21.15.125:0/3676842853 >> v1:172.21.15.125:6789/0 conn(0x7fcdb40a0a70 legacy=0x7fcdb40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 -- 172.21.15.125:0/3676842853 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb409e6a0 con 0x7fcdb40a1550 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb3fff700 1 --2- 172.21.15.125:0/3676842853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 0x7fcdb4138cc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009840 tx=0x7fcda0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dc59dd57ae4a2e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb37fe700 1 -- 172.21.15.125:0/3676842853 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011830 con 0x7fcdb40a1550 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb37fe700 1 -- 172.21.15.125:0/3676842853 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0011990 con 0x7fcdb40a1550 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.736+0000 7fcdb37fe700 1 -- 172.21.15.125:0/3676842853 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011d20 con 0x7fcdb40a1550 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 -- 172.21.15.125:0/3676842853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 msgr2=0x7fcdb4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 --2- 172.21.15.125:0/3676842853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 0x7fcdb4138cc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009840 tx=0x7fcda0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 -- 172.21.15.125:0/3676842853 shutdown_connections 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 --2- 172.21.15.125:0/3676842853 >> v2:172.21.15.125:3300/0 conn(0x7fcdb4139200 0x7fcdb413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 --2- 172.21.15.125:0/3676842853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb40a1550 0x7fcdb4138cc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 -- 172.21.15.125:0/3676842853 >> 172.21.15.125:0/3676842853 conn(0x7fcdb40a6610 msgr2=0x7fcdb40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 -- 172.21.15.125:0/3676842853 shutdown_connections 2023-10-03T10:16:21.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.737+0000 7fcdbace2700 1 -- 172.21.15.125:0/3676842853 wait complete. 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.738+0000 7fcdbace2700 1 Processor -- start 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.738+0000 7fcdbace2700 1 -- start start 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.738+0000 7fcdbace2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.738+0000 7fcdbace2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb40a1550 0x7fcdb4120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 0x7fcdb41211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4123a10 con 0x7fcdb40a1550 2023-10-03T10:16:21.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4123f30 con 0x7fcdb40a0a70 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a5100 con 0x7fcdb4139200 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb927f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 0x7fcdb41211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35310/0 (socket says 172.21.15.125:35310) 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb927f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 0x7fcdb41211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56156/0 (socket says 172.21.15.125:56156) 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 -- 172.21.15.125:0/2770064180 learned_addr learned my addr 172.21.15.125:0/2770064180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb3fff700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb40a1550 0x7fcdb4120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 -- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 msgr2=0x7fcdb41211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 0x7fcdb41211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 -- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb40a1550 msgr2=0x7fcdb4120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb40a1550 0x7fcdb4120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 -- 172.21.15.125:0/2770064180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00094a0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb8a7e700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c700 tx=0x7fcda800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8005d70 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda80070d0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb40a03e0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8007460 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.739+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb41249a0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.740+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcda80075c0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.740+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcda803eba0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.740+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb404f2a0 con 0x7fcdb40a0a70 2023-10-03T10:16:21.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.749+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcda8018260 con 0x7fcdb40a0a70 2023-10-03T10:16:21.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.899+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16c00a2710 con 0x7f16c00a0a70 2023-10-03T10:16:21.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.900+0000 7f16bd7fa700 1 -- 172.21.15.125:0/2010889223 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16b4003cf0 con 0x7f16c00a0a70 2023-10-03T10:16:21.900 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 msgr2=0x7f16c01227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009fd0 tx=0x7f16b4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 shutdown_connections 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c0133f50 0x7f16c0123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c00a0a70 0x7f16c01227e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 --2- 172.21.15.125:0/2010889223 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16c00a1380 0x7f16c0122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 >> 172.21.15.125:0/2010889223 conn(0x7f16c00a6610 msgr2=0x7f16c009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 shutdown_connections 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.903+0000 7f16c6d07700 1 -- 172.21.15.125:0/2010889223 wait complete. 2023-10-03T10:16:21.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.950+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcdb4072980 con 0x7fcdb40a0a70 2023-10-03T10:16:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.950+0000 7fcdb17fa700 1 -- 172.21.15.125:0/2770064180 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcda8017020 con 0x7fcdb40a0a70 2023-10-03T10:16:21.950 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 msgr2=0x7fcdb4120740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c700 tx=0x7fcda800ca10 comp rx=0 tx=0).stop 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 shutdown_connections 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcdb4139200 0x7fcdb41211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdb40a0a70 0x7fcdb4120740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 --2- 172.21.15.125:0/2770064180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb40a1550 0x7fcdb4120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 >> 172.21.15.125:0/2770064180 conn(0x7fcdb40a6610 msgr2=0x7fcdb40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 shutdown_connections 2023-10-03T10:16:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:21.952+0000 7fcdbace2700 1 -- 172.21.15.125:0/2770064180 wait complete. 2023-10-03T10:16:21.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:22.009 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:22.046 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 Processor -- start 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 -- start start 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92a00a0a70 0x7f92a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a009dc00 con 0x7f92a00a1380 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a009ea90 con 0x7f92a00a0a70 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a6d69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009dec0 con 0x7f92a0134120 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a4b05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92a00a0a70 0x7f92a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a5306700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a5306700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56172/0 (socket says 172.21.15.125:56172) 2023-10-03T10:16:22.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a4b05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92a00a0a70 0x7f92a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49372/0 (socket says 172.21.15.125:49372) 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f92a5306700 1 -- 172.21.15.125:0/2746560247 learned_addr learned my addr 172.21.15.125:0/2746560247 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.135+0000 7f929ffff700 1 --1- 172.21.15.125:0/2746560247 >> v1:172.21.15.125:6789/0 conn(0x7f92a00a1380 0x7f92a0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37264/0 (socket says 172.21.15.125:37264) 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a4b05700 1 -- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 msgr2=0x7f92a013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a4b05700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a4b05700 1 -- 172.21.15.125:0/2746560247 >> v1:172.21.15.125:6789/0 conn(0x7f92a00a1380 legacy=0x7f92a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a4b05700 1 -- 172.21.15.125:0/2746560247 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a009e6a0 con 0x7f92a00a0a70 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f929f7fe700 1 -- 172.21.15.125:0/2746560247 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932652230 0 0) 0x7f92a009dc00 con 0x7f92a00a1380 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a5306700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f92a4b05700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a0a70 0x7f92a00a0e40 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9294009840 tx=0x7f9294009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be04127302c254b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f929f7fe700 1 -- 172.21.15.125:0/2746560247 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011830 con 0x7f92a00a0a70 2023-10-03T10:16:22.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f929f7fe700 1 -- 172.21.15.125:0/2746560247 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294011990 con 0x7f92a00a0a70 2023-10-03T10:16:22.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.136+0000 7f929f7fe700 1 -- 172.21.15.125:0/2746560247 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011d20 con 0x7f92a00a0a70 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 -- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a0a70 msgr2=0x7f92a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a0a70 0x7f92a00a0e40 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9294009840 tx=0x7f9294009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 -- 172.21.15.125:0/2746560247 shutdown_connections 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a0134120 0x7f92a013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 --2- 172.21.15.125:0/2746560247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a0a70 0x7f92a00a0e40 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 -- 172.21.15.125:0/2746560247 >> 172.21.15.125:0/2746560247 conn(0x7f92a00a6610 msgr2=0x7f92a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 -- 172.21.15.125:0/2746560247 shutdown_connections 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.137+0000 7f92a6d69700 1 -- 172.21.15.125:0/2746560247 wait complete. 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 Processor -- start 2023-10-03T10:16:22.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 -- start start 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a1380 0x7f92a0122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92a0134120 0x7f92a0123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0133300 con 0x7f92a00a1380 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0125920 con 0x7f92a0134120 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a6d69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0124310 con 0x7f92a00a0a70 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a4b05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a4b05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56178/0 (socket says 172.21.15.125:56178) 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a4b05700 1 -- 172.21.15.125:0/3975624450 learned_addr learned my addr 172.21.15.125:0/3975624450 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f92a5306700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92a0134120 0x7f92a0123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.138+0000 7f929ffff700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a1380 0x7f92a0122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 -- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92a0134120 msgr2=0x7f92a0123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92a0134120 0x7f92a0123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 -- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a1380 msgr2=0x7f92a0122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a1380 0x7f92a0122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 -- 172.21.15.125:0/3975624450 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009b30 con 0x7f92a00a0a70 2023-10-03T10:16:22.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.139+0000 7f92a4b05700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9294009fd0 tx=0x7f9294004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.141+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940036a0 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.141+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929401f070 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.141+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92940094a0 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.141+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294003a60 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.142+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0125c80 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.142+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9294003bc0 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.142+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a004f2a0 con 0x7f92a00a0a70 2023-10-03T10:16:22.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.143+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9294021070 con 0x7f92a00a0a70 2023-10-03T10:16:22.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.147+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9294015080 con 0x7f92a00a0a70 2023-10-03T10:16:22.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.177+0000 7f7787891700 1 Processor -- start 2023-10-03T10:16:22.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.177+0000 7f7787891700 1 -- start start 2023-10-03T10:16:22.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7787891700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 0x7f77800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7787891700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 0x7f778013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7787891700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778009dc00 con 0x7f77800a1380 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7787891700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778009ea90 con 0x7f7780134120 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7787891700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f778009dec0 con 0x7f77800a0a70 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 0x7f77800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7785e2e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 0x7f778013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7784e2c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77800a1380 0x7f7780133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37268/0 (socket says 172.21.15.125:37268) 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7784e2c700 1 -- 172.21.15.125:0/569436550 learned_addr learned my addr 172.21.15.125:0/569436550 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 -- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 msgr2=0x7f778013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 0x7f778013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 -- 172.21.15.125:0/569436550 >> v1:172.21.15.125:6789/0 conn(0x7f77800a1380 legacy=0x7f7780133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7777fff700 1 -- 172.21.15.125:0/569436550 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398285594 0 0) 0x7f778009dc00 con 0x7f77800a1380 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 -- 172.21.15.125:0/569436550 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778009e6a0 con 0x7f77800a0a70 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7785e2e700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 0x7f778013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f778562d700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 0x7f77800a0e40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f777c009870 tx=0x7f777c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d35bf20f2598f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.178+0000 7f7777fff700 1 -- 172.21.15.125:0/569436550 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c011830 con 0x7f77800a0a70 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7777fff700 1 -- 172.21.15.125:0/569436550 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c011990 con 0x7f77800a0a70 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7777fff700 1 -- 172.21.15.125:0/569436550 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c011d20 con 0x7f77800a0a70 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 -- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 msgr2=0x7f77800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 0x7f77800a0e40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f777c009870 tx=0x7f777c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:22.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 -- 172.21.15.125:0/569436550 shutdown_connections 2023-10-03T10:16:22.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7780134120 0x7f778013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 --2- 172.21.15.125:0/569436550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f77800a0a70 0x7f77800a0e40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 -- 172.21.15.125:0/569436550 >> 172.21.15.125:0/569436550 conn(0x7f77800a6610 msgr2=0x7f77800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 -- 172.21.15.125:0/569436550 shutdown_connections 2023-10-03T10:16:22.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.179+0000 7f7787891700 1 -- 172.21.15.125:0/569436550 wait complete. 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.180+0000 7f7787891700 1 Processor -- start 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.180+0000 7f7787891700 1 -- start start 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 0x7f7780122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77800a1380 0x7f7780122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780125920 con 0x7f77800a0a70 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7780124310 con 0x7f77800a1380 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77801332d0 con 0x7f7780134120 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f778562d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 0x7f7780122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56192/0 (socket says 172.21.15.125:56192) 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f778562d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 0x7f7780122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49386/0 (socket says 172.21.15.125:49386) 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 -- 172.21.15.125:0/2740886914 learned_addr learned my addr 172.21.15.125:0/2740886914 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7784e2c700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77800a1380 0x7f7780122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 -- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77800a1380 msgr2=0x7f7780122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77800a1380 0x7f7780122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 -- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 msgr2=0x7f7780122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 0x7f7780122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 -- 172.21.15.125:0/2740886914 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778009a70 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7785e2e700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7778009f00 tx=0x7f777800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778009d70 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777800f040 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777800cd70 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.181+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c0094a0 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.182+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77800a03e0 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.182+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7778014480 con 0x7f7780134120 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.182+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f777803fc90 con 0x7f7780134120 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.183+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778004f2a0 con 0x7f7780134120 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.187+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7778012930 con 0x7f7780134120 2023-10-03T10:16:22.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.341+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92a0072980 con 0x7f92a00a0a70 2023-10-03T10:16:22.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.342+0000 7f929d7fa700 1 -- 172.21.15.125:0/3975624450 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92940253e0 con 0x7f92a00a0a70 2023-10-03T10:16:22.342 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.343+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 msgr2=0x7f92a0122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.343+0000 7f92a6d69700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9294009fd0 tx=0x7f9294004750 comp rx=0 tx=0).stop 2023-10-03T10:16:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 shutdown_connections 2023-10-03T10:16:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92a0134120 0x7f92a0123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92a00a0a70 0x7f92a0122700 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 --2- 172.21.15.125:0/3975624450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92a00a1380 0x7f92a0122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 >> 172.21.15.125:0/3975624450 conn(0x7f92a00a6610 msgr2=0x7f92a00a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 shutdown_connections 2023-10-03T10:16:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.344+0000 7f92a6d69700 1 -- 172.21.15.125:0/3975624450 wait complete. 2023-10-03T10:16:22.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:22.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.380+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7780072980 con 0x7f7780134120 2023-10-03T10:16:22.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.381+0000 7f7775ffb700 1 -- 172.21.15.125:0/2740886914 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f777802a090 con 0x7f7780134120 2023-10-03T10:16:22.381 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 msgr2=0x7f7780123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7778009f00 tx=0x7f777800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 shutdown_connections 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7780134120 0x7f7780123180 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77800a0a70 0x7f7780122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 --2- 172.21.15.125:0/2740886914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77800a1380 0x7f7780122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 >> 172.21.15.125:0/2740886914 conn(0x7f77800a6610 msgr2=0x7f778009aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 shutdown_connections 2023-10-03T10:16:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:22.383+0000 7f7787891700 1 -- 172.21.15.125:0/2740886914 wait complete. 2023-10-03T10:16:22.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:22.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:22.965 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.047+0000 7f0eac471700 1 Processor -- start 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.047+0000 7f0eac471700 1 -- start start 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eac471700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eac471700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eac471700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea409b110 con 0x7f0ea409ad40 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eac471700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40a3b60 con 0x7f0ea4134570 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eac471700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a1a80 con 0x7f0ea4134140 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eaaa0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eaaa0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49394/0 (socket says 172.21.15.125:49394) 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35338/0 (socket says 172.21.15.125:35338) 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eaaa0e700 1 -- 172.21.15.125:0/3553996131 learned_addr learned my addr 172.21.15.125:0/3553996131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 -- 172.21.15.125:0/3553996131 >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 msgr2=0x7f0ea413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 --2- 172.21.15.125:0/3553996131 >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 -- 172.21.15.125:0/3553996131 >> v1:172.21.15.125:6789/0 conn(0x7f0ea409ad40 legacy=0x7f0ea4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 -- 172.21.15.125:0/3553996131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40a2fa0 con 0x7f0ea4134140 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea920b700 1 -- 172.21.15.125:0/3553996131 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309868000 0 0) 0x7f0ea409b110 con 0x7f0ea409ad40 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0eaaa0e700 1 --2- 172.21.15.125:0/3553996131 >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea9a0c700 1 --2- 172.21.15.125:0/3553996131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009840 tx=0x7f0e94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fde6047e18e0556 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea920b700 1 -- 172.21.15.125:0/3553996131 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94011830 con 0x7f0ea4134140 2023-10-03T10:16:23.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea920b700 1 -- 172.21.15.125:0/3553996131 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94011990 con 0x7f0ea4134140 2023-10-03T10:16:23.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.048+0000 7f0ea920b700 1 -- 172.21.15.125:0/3553996131 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94011d20 con 0x7f0ea4134140 2023-10-03T10:16:23.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 -- 172.21.15.125:0/3553996131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 msgr2=0x7f0ea4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 --2- 172.21.15.125:0/3553996131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009840 tx=0x7f0e94009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 -- 172.21.15.125:0/3553996131 shutdown_connections 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 --2- 172.21.15.125:0/3553996131 >> v2:172.21.15.125:3300/0 conn(0x7f0ea4134570 0x7f0ea413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 --2- 172.21.15.125:0/3553996131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea4134140 0x7f0ea4138e80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 -- 172.21.15.125:0/3553996131 >> 172.21.15.125:0/3553996131 conn(0x7f0ea4099c40 msgr2=0x7f0ea406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 -- 172.21.15.125:0/3553996131 shutdown_connections 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.049+0000 7f0eac471700 1 -- 172.21.15.125:0/3553996131 wait complete. 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.050+0000 7f0eac471700 1 Processor -- start 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.050+0000 7f0eac471700 1 -- start start 2023-10-03T10:16:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 0x7f0ea41394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 0x7f0ea4139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea41336f0 con 0x7f0ea4134140 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea411e110 con 0x7f0ea409ad40 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea411d720 con 0x7f0ea4134570 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaa20d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 0x7f0ea41394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56206/0 (socket says 172.21.15.125:56206) 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaa20d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 0x7f0ea41394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35354/0 (socket says 172.21.15.125:35354) 2023-10-03T10:16:23.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 -- 172.21.15.125:0/481616079 learned_addr learned my addr 172.21.15.125:0/481616079 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0ea9a0c700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 0x7f0ea4139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 -- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 msgr2=0x7f0ea41394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 0x7f0ea41394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 -- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 msgr2=0x7f0ea4139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 0x7f0ea4139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 -- 172.21.15.125:0/481616079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c009b30 con 0x7f0ea4134570 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0ea9a0c700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 0x7f0ea4139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eaaa0e700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00efc0 tx=0x7f0e9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c018070 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00f040 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e940094a0 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c003c20 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.051+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea40a4380 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.052+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e9c00c880 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.052+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e9c03f7d0 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.052+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea409c7e0 con 0x7f0ea4134570 2023-10-03T10:16:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.057+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e9c014480 con 0x7f0ea4134570 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.090+0000 7f51833e4700 1 Processor -- start 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.090+0000 7f51833e4700 1 -- start start 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f51833e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f51833e4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f517c139200 0x7f517c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f51833e4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c09e9d0 con 0x7f517c0a0a70 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f51833e4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c09dc00 con 0x7f517c139200 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f51833e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c09dec0 con 0x7f517c0a1550 2023-10-03T10:16:23.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f517c139200 0x7f517c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181180700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f517c0a0a70 0x7f517c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37278/0 (socket says 172.21.15.125:37278) 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f518097f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181180700 1 -- 172.21.15.125:0/1505983263 learned_addr learned my addr 172.21.15.125:0/1505983263 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 -- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 msgr2=0x7f517c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 -- 172.21.15.125:0/1505983263 >> v1:172.21.15.125:6789/0 conn(0x7f517c0a0a70 legacy=0x7f517c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 -- 172.21.15.125:0/1505983263 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c09e6a0 con 0x7f517c139200 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5173fff700 1 -- 172.21.15.125:0/1505983263 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202237446 0 0) 0x7f517c09e9d0 con 0x7f517c0a0a70 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f518097f700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.091+0000 7f5181981700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c13b5e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5174009d90 tx=0x7f517400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2dfce5c3b5de8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f5173fff700 1 -- 172.21.15.125:0/1505983263 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517400e070 con 0x7f517c139200 2023-10-03T10:16:23.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f5173fff700 1 -- 172.21.15.125:0/1505983263 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517400bb20 con 0x7f517c139200 2023-10-03T10:16:23.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f5173fff700 1 -- 172.21.15.125:0/1505983263 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174012430 con 0x7f517c139200 2023-10-03T10:16:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 -- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 msgr2=0x7f517c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c13b5e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5174009d90 tx=0x7f517400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 -- 172.21.15.125:0/1505983263 shutdown_connections 2023-10-03T10:16:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c13b5e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 --2- 172.21.15.125:0/1505983263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 -- 172.21.15.125:0/1505983263 >> 172.21.15.125:0/1505983263 conn(0x7f517c0a6610 msgr2=0x7f517c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 -- 172.21.15.125:0/1505983263 shutdown_connections 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.092+0000 7f51833e4700 1 -- 172.21.15.125:0/1505983263 wait complete. 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.093+0000 7f51833e4700 1 Processor -- start 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.093+0000 7f51833e4700 1 -- start start 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f517c0a0a70 0x7f517c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0a5600 con 0x7f517c139200 2023-10-03T10:16:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c071300 con 0x7f517c0a0a70 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c06f6d0 con 0x7f517c0a1550 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5181981700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5181981700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49416/0 (socket says 172.21.15.125:49416) 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5181981700 1 -- 172.21.15.125:0/843158989 learned_addr learned my addr 172.21.15.125:0/843158989 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5181180700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f517c0a0a70 0x7f517c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 -- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f517c0a0a70 msgr2=0x7f517c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f517c0a0a70 0x7f517c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 -- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 msgr2=0x7f517c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 -- 172.21.15.125:0/843158989 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0094a0 con 0x7f517c0a1550 2023-10-03T10:16:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5181981700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f518097f700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c06e000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f516c00e9b0 tx=0x7f516c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00ee50 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00c850 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5174009a70 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.094+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00cc00 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.095+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c06fec0 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.095+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c04f2a0 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.096+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f516c013470 con 0x7f517c0a1550 2023-10-03T10:16:23.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.096+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f516c03ff00 con 0x7f517c0a1550 2023-10-03T10:16:23.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.100+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f516c013720 con 0x7f517c0a1550 2023-10-03T10:16:23.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.250+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ea404f2a0 con 0x7f0ea4134570 2023-10-03T10:16:23.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.251+0000 7f0e9affd700 1 -- 172.21.15.125:0/481616079 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e9c01cbb0 con 0x7f0ea4134570 2023-10-03T10:16:23.251 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.252+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 msgr2=0x7f0ea4139f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.252+0000 7f0eac471700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00efc0 tx=0x7f0e9c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 shutdown_connections 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0ea4134570 0x7f0ea4139f70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ea409ad40 0x7f0ea41394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 --2- 172.21.15.125:0/481616079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea4134140 0x7f0ea4139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 >> 172.21.15.125:0/481616079 conn(0x7f0ea4099c40 msgr2=0x7f0ea409f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 shutdown_connections 2023-10-03T10:16:23.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.253+0000 7f0eac471700 1 -- 172.21.15.125:0/481616079 wait complete. 2023-10-03T10:16:23.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.294+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f517c070fa0 con 0x7f517c0a1550 2023-10-03T10:16:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.295+0000 7f5171ffb700 1 -- 172.21.15.125:0/843158989 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f517c070fa0 con 0x7f517c0a1550 2023-10-03T10:16:23.295 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 msgr2=0x7f517c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c06e000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f516c00e9b0 tx=0x7f516c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 shutdown_connections 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517c139200 0x7f517c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f517c0a0a70 0x7f517c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 --2- 172.21.15.125:0/843158989 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f517c0a1550 0x7f517c06e000 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 >> 172.21.15.125:0/843158989 conn(0x7f517c0a6610 msgr2=0x7f517c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 shutdown_connections 2023-10-03T10:16:23.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.297+0000 7f51833e4700 1 -- 172.21.15.125:0/843158989 wait complete. 2023-10-03T10:16:23.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:23.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:23.396 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.483+0000 7f25f79b0700 1 Processor -- start 2023-10-03T10:16:23.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 -- start start 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25f00a1380 0x7f25f0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f009dc00 con 0x7f25f0133f50 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f009ea60 con 0x7f25f00a1380 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f79b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f009dec0 con 0x7f25f00a0a70 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f574c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f4f4b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25f00a1380 0x7f25f0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f5f4d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f25f0133f50 0x7f25f013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37284/0 (socket says 172.21.15.125:37284) 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f574c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35376/0 (socket says 172.21.15.125:35376) 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f5f4d700 1 -- 172.21.15.125:0/2154697165 learned_addr learned my addr 172.21.15.125:0/2154697165 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f4f4b700 1 -- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 msgr2=0x7f25f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f4f4b700 1 -- 172.21.15.125:0/2154697165 >> v1:172.21.15.125:6789/0 conn(0x7f25f0133f50 legacy=0x7f25f013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25e7fff700 1 -- 172.21.15.125:0/2154697165 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929851473 0 0) 0x7f25f009dc00 con 0x7f25f0133f50 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f4f4b700 1 -- 172.21.15.125:0/2154697165 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f009e6a0 con 0x7f25f00a1380 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.484+0000 7f25f574c700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a1380 0x7f25f0133a10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009840 tx=0x7f25e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5025d0ba84bf1e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25e7fff700 1 -- 172.21.15.125:0/2154697165 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011830 con 0x7f25f00a1380 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25e7fff700 1 -- 172.21.15.125:0/2154697165 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0011990 con 0x7f25f00a1380 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25e7fff700 1 -- 172.21.15.125:0/2154697165 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011d20 con 0x7f25f00a1380 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 -- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a1380 msgr2=0x7f25f0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a1380 0x7f25f0133a10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009840 tx=0x7f25e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 -- 172.21.15.125:0/2154697165 shutdown_connections 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a0a70 0x7f25f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 --2- 172.21.15.125:0/2154697165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a1380 0x7f25f0133a10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.485+0000 7f25f79b0700 1 -- 172.21.15.125:0/2154697165 >> 172.21.15.125:0/2154697165 conn(0x7f25f00a6610 msgr2=0x7f25f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.486+0000 7f25f79b0700 1 -- 172.21.15.125:0/2154697165 shutdown_connections 2023-10-03T10:16:23.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.486+0000 7f25f79b0700 1 -- 172.21.15.125:0/2154697165 wait complete. 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 Processor -- start 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 -- start start 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f0133f50 0x7f25f0123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0126360 con 0x7f25f00a0a70 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0123d10 con 0x7f25f00a1380 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.487+0000 7f25f79b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f01244c0 con 0x7f25f0133f50 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f574c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f574c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49432/0 (socket says 172.21.15.125:49432) 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f574c700 1 -- 172.21.15.125:0/603209109 learned_addr learned my addr 172.21.15.125:0/603209109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35392/0 (socket says 172.21.15.125:35392) 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f5f4d700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f0133f50 0x7f25f0123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 -- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f0133f50 msgr2=0x7f25f0123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f0133f50 0x7f25f0123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 -- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 msgr2=0x7f25f01228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 -- 172.21.15.125:0/603209109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec0094a0 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f574c700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f4f4b700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f25e0016000 tx=0x7f25e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00045d0 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e001f070 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00094a0 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00038c0 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.488+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f0133790 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.489+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e0003a20 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.489+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f01333c0 con 0x7f25f00a1380 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.489+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25e0021070 con 0x7f25f00a1380 2023-10-03T10:16:23.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.494+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e002f3a0 con 0x7f25f00a1380 2023-10-03T10:16:23.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.526+0000 7f2d4b26d700 1 Processor -- start 2023-10-03T10:16:23.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 -- start start 2023-10-03T10:16:23.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d440a1380 0x7f2d44133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4409dc00 con 0x7f2d44133f50 2023-10-03T10:16:23.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4409ea60 con 0x7f2d440a1380 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4b26d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4409dec0 con 0x7f2d440a0a70 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d49009700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d48808700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d440a1380 0x7f2d44133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4980a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2d44133f50 0x7f2d4413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37292/0 (socket says 172.21.15.125:37292) 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d4980a700 1 -- 172.21.15.125:0/3933204958 learned_addr learned my addr 172.21.15.125:0/3933204958 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d49009700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35404/0 (socket says 172.21.15.125:35404) 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d49009700 1 -- 172.21.15.125:0/3933204958 >> v2:172.21.15.125:3300/0 conn(0x7f2d440a1380 msgr2=0x7f2d44133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.527+0000 7f2d49009700 1 --2- 172.21.15.125:0/3933204958 >> v2:172.21.15.125:3300/0 conn(0x7f2d440a1380 0x7f2d44133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d49009700 1 -- 172.21.15.125:0/3933204958 >> v1:172.21.15.125:6789/0 conn(0x7f2d44133f50 legacy=0x7f2d4413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d49009700 1 -- 172.21.15.125:0/3933204958 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4409e6a0 con 0x7f2d440a0a70 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d49009700 1 --2- 172.21.15.125:0/3933204958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009840 tx=0x7f2d40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e52128a433656892 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d3bfff700 1 -- 172.21.15.125:0/3933204958 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011830 con 0x7f2d440a0a70 2023-10-03T10:16:23.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d3bfff700 1 -- 172.21.15.125:0/3933204958 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40011990 con 0x7f2d440a0a70 2023-10-03T10:16:23.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d3bfff700 1 -- 172.21.15.125:0/3933204958 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011d20 con 0x7f2d440a0a70 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 -- 172.21.15.125:0/3933204958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 msgr2=0x7f2d440a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/3933204958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009840 tx=0x7f2d40009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 -- 172.21.15.125:0/3933204958 shutdown_connections 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/3933204958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d440a0a70 0x7f2d440a0e40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/3933204958 >> v2:172.21.15.125:3300/0 conn(0x7f2d440a1380 0x7f2d44133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.528+0000 7f2d4b26d700 1 -- 172.21.15.125:0/3933204958 >> 172.21.15.125:0/3933204958 conn(0x7f2d440a6610 msgr2=0x7f2d440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.529+0000 7f2d4b26d700 1 -- 172.21.15.125:0/3933204958 shutdown_connections 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.529+0000 7f2d4b26d700 1 -- 172.21.15.125:0/3933204958 wait complete. 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.529+0000 7f2d4b26d700 1 Processor -- start 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.529+0000 7f2d4b26d700 1 -- start start 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 0x7f2d441230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44126250 con 0x7f2d440a1380 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44133a60 con 0x7f2d44133f50 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4b26d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440a03e0 con 0x7f2d440a0a70 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4980a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d49009700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 0x7f2d441230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4980a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35412/0 (socket says 172.21.15.125:35412) 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d49009700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56246/0 (socket says 172.21.15.125:56246) 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4980a700 1 -- 172.21.15.125:0/32341541 learned_addr learned my addr 172.21.15.125:0/32341541 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 -- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 msgr2=0x7f2d44122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 -- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 msgr2=0x7f2d44123610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 -- 172.21.15.125:0/32341541 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400094a0 con 0x7f2d440a1380 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d4980a700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d49009700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.530+0000 7f2d48808700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 0x7f2d441230d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e8d0 tx=0x7f2d3400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.531+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34013680 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.531+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d340137e0 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.531+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34013b50 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.531+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d44127220 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.531+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d44125ff0 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.532+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d34013cb0 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.532+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d3403f630 con 0x7f2d440a1380 2023-10-03T10:16:23.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.532+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404f2a0 con 0x7f2d440a1380 2023-10-03T10:16:23.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.537+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d3401bde0 con 0x7f2d440a1380 2023-10-03T10:16:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.688+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25f004f2a0 con 0x7f25f00a1380 2023-10-03T10:16:23.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.689+0000 7f25e5ffb700 1 -- 172.21.15.125:0/603209109 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e002b070 con 0x7f25f00a1380 2023-10-03T10:16:23.689 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 msgr2=0x7f25f0122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f25e0016000 tx=0x7f25e0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 shutdown_connections 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f0133f50 0x7f25f0123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f00a0a70 0x7f25f01228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 --2- 172.21.15.125:0/603209109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f00a1380 0x7f25f0122df0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 >> 172.21.15.125:0/603209109 conn(0x7f25f00a6610 msgr2=0x7f25f009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 shutdown_connections 2023-10-03T10:16:23.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.691+0000 7f25f79b0700 1 -- 172.21.15.125:0/603209109 wait complete. 2023-10-03T10:16:23.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:23.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.728+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d44126660 con 0x7f2d440a1380 2023-10-03T10:16:23.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.728+0000 7f2d39ffb700 1 -- 172.21.15.125:0/32341541 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d34021020 con 0x7f2d440a1380 2023-10-03T10:16:23.728 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 msgr2=0x7f2d441230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 0x7f2d441230d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e8d0 tx=0x7f2d3400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 shutdown_connections 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d44133f50 0x7f2d44123610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d440a0a70 0x7f2d44122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 --2- 172.21.15.125:0/32341541 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d440a1380 0x7f2d441230d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 >> 172.21.15.125:0/32341541 conn(0x7f2d440a6610 msgr2=0x7f2d440a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 shutdown_connections 2023-10-03T10:16:23.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:23.730+0000 7f2d4b26d700 1 -- 172.21.15.125:0/32341541 wait complete. 2023-10-03T10:16:23.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:24.265 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:24.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:24.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.395+0000 7f13acd81700 1 Processor -- start 2023-10-03T10:16:24.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.395+0000 7f13acd81700 1 -- start start 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13acd81700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13acd81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 0x7f13a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13acd81700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a809dc00 con 0x7f13a8133f50 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13acd81700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a809ea60 con 0x7f13a80a0a70 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13acd81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a809dec0 con 0x7f13a80a1380 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 0x7f13a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49458/0 (socket says 172.21.15.125:49458) 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a659c700 1 -- 172.21.15.125:0/120509324 learned_addr learned my addr 172.21.15.125:0/120509324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a6d9d700 1 --1- 172.21.15.125:0/120509324 >> v1:172.21.15.125:6789/0 conn(0x7f13a8133f50 0x7f13a813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37294/0 (socket says 172.21.15.125:37294) 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a5d9b700 1 -- 172.21.15.125:0/120509324 >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 msgr2=0x7f13a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a5d9b700 1 --2- 172.21.15.125:0/120509324 >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.396+0000 7f13a5d9b700 1 -- 172.21.15.125:0/120509324 >> v1:172.21.15.125:6789/0 conn(0x7f13a8133f50 legacy=0x7f13a813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a5d9b700 1 -- 172.21.15.125:0/120509324 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a809e6a0 con 0x7f13a80a1380 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a559a700 1 -- 172.21.15.125:0/120509324 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357090716 0 0) 0x7f13a809dc00 con 0x7f13a8133f50 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a659c700 1 --2- 172.21.15.125:0/120509324 >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a5d9b700 1 --2- 172.21.15.125:0/120509324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 0x7f13a8133a10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f139c009840 tx=0x7f139c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f6d9a4d0ba65fec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a559a700 1 -- 172.21.15.125:0/120509324 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c011830 con 0x7f13a80a1380 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a559a700 1 -- 172.21.15.125:0/120509324 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c011990 con 0x7f13a80a1380 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13a559a700 1 -- 172.21.15.125:0/120509324 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c011d20 con 0x7f13a80a1380 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 -- 172.21.15.125:0/120509324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 msgr2=0x7f13a8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 --2- 172.21.15.125:0/120509324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 0x7f13a8133a10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f139c009840 tx=0x7f139c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 -- 172.21.15.125:0/120509324 shutdown_connections 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 --2- 172.21.15.125:0/120509324 >> v2:172.21.15.125:3300/0 conn(0x7f13a80a0a70 0x7f13a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 --2- 172.21.15.125:0/120509324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a80a1380 0x7f13a8133a10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.397+0000 7f13acd81700 1 -- 172.21.15.125:0/120509324 >> 172.21.15.125:0/120509324 conn(0x7f13a80a6610 msgr2=0x7f13a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.398+0000 7f13acd81700 1 -- 172.21.15.125:0/120509324 shutdown_connections 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.398+0000 7f13acd81700 1 -- 172.21.15.125:0/120509324 wait complete. 2023-10-03T10:16:24.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 Processor -- start 2023-10-03T10:16:24.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 -- start start 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 0x7f13a8122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 0x7f13a8122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8126180 con 0x7f13a80a1380 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8126360 con 0x7f13a8133f50 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13acd81700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8125dc0 con 0x7f13a80a0a70 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 0x7f13a8122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35432/0 (socket says 172.21.15.125:35432) 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a6d9d700 1 -- 172.21.15.125:0/3077955239 learned_addr learned my addr 172.21.15.125:0/3077955239 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a5d9b700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 0x7f13a8122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a659c700 1 -- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 msgr2=0x7f13a81232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a659c700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a659c700 1 -- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 msgr2=0x7f13a8122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.399+0000 7f13a659c700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 0x7f13a8122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13a659c700 1 -- 172.21.15.125:0/3077955239 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398009550 con 0x7f13a80a0a70 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13a6d9d700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13a5d9b700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 0x7f13a8122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13a659c700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 0x7f13a8122840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f139800e9a0 tx=0x7f139800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398004030 con 0x7f13a80a0a70 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398004190 con 0x7f13a80a0a70 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0094a0 con 0x7f13a80a0a70 2023-10-03T10:16:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398004520 con 0x7f13a80a0a70 2023-10-03T10:16:24.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.400+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a8124560 con 0x7f13a80a0a70 2023-10-03T10:16:24.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.401+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13980036a0 con 0x7f13a80a0a70 2023-10-03T10:16:24.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.401+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f139803f8f0 con 0x7f13a80a0a70 2023-10-03T10:16:24.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.401+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a804f2a0 con 0x7f13a80a0a70 2023-10-03T10:16:24.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.405+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1398011db0 con 0x7f13a80a0a70 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.437+0000 7efce215d700 1 Processor -- start 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.437+0000 7efce215d700 1 -- start start 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efce215d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc09ad40 0x7efcdc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efce215d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcdc1343a0 0x7efcdc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efce215d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc09b110 con 0x7efcdc133f70 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efce215d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0a3b60 con 0x7efcdc1343a0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efce215d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0a2fa0 con 0x7efcdc09ad40 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcdc1343a0 0x7efcdc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc09ad40 0x7efcdc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcdc1343a0 0x7efcdc0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49466/0 (socket says 172.21.15.125:49466) 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 -- 172.21.15.125:0/2610332411 learned_addr learned my addr 172.21.15.125:0/2610332411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 -- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc09ad40 msgr2=0x7efcdc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 --2- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc09ad40 0x7efcdc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 -- 172.21.15.125:0/2610332411 >> v1:172.21.15.125:6789/0 conn(0x7efcdc133f70 legacy=0x7efcdc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 -- 172.21.15.125:0/2610332411 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc09a280 con 0x7efcdc1343a0 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcda7fc700 1 -- 172.21.15.125:0/2610332411 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374895773 0 0) 0x7efcdc09b110 con 0x7efcdc133f70 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.438+0000 7efcdbfff700 1 --2- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1343a0 0x7efcdc0a1180 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7efccc009e50 tx=0x7efccc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719f9c1b8534116 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efcda7fc700 1 -- 172.21.15.125:0/2610332411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00e070 con 0x7efcdc1343a0 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efcda7fc700 1 -- 172.21.15.125:0/2610332411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00b910 con 0x7efcdc1343a0 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efcda7fc700 1 -- 172.21.15.125:0/2610332411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00bcc0 con 0x7efcdc1343a0 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 -- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1343a0 msgr2=0x7efcdc0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 --2- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1343a0 0x7efcdc0a1180 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7efccc009e50 tx=0x7efccc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 -- 172.21.15.125:0/2610332411 shutdown_connections 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 --2- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1343a0 0x7efcdc0a1180 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 --2- 172.21.15.125:0/2610332411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc09ad40 0x7efcdc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 -- 172.21.15.125:0/2610332411 >> 172.21.15.125:0/2610332411 conn(0x7efcdc099c40 msgr2=0x7efcdc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 -- 172.21.15.125:0/2610332411 shutdown_connections 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.439+0000 7efce215d700 1 -- 172.21.15.125:0/2610332411 wait complete. 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.441+0000 7efce215d700 1 Processor -- start 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.441+0000 7efce215d700 1 -- start start 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 0x7efcdc1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc11efd0 con 0x7efcdc09ad40 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc120730 con 0x7efcdc133f70 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efce215d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc122740 con 0x7efcdc1343a0 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56268/0 (socket says 172.21.15.125:56268) 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49472/0 (socket says 172.21.15.125:49472) 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 -- 172.21.15.125:0/4163073691 learned_addr learned my addr 172.21.15.125:0/4163073691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdaffd700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 0x7efcdc1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 -- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 msgr2=0x7efcdc1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 0x7efcdc1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 -- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 msgr2=0x7efcdc1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 -- 172.21.15.125:0/4163073691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009b30 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdb7fe700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdaffd700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 0x7efcdc1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcdbfff700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efccc008dd0 tx=0x7efccc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.442+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc01c640 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc01c7a0 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc01cb50 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0a4110 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc122dd0 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efccc01ccb0 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efccc0412f0 con 0x7efcdc1343a0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.443+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc04f2a0 con 0x7efcdc1343a0 2023-10-03T10:16:24.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.448+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efccc027970 con 0x7efcdc1343a0 2023-10-03T10:16:24.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.601+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13a8133360 con 0x7f13a80a0a70 2023-10-03T10:16:24.602 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:24.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.601+0000 7f1396ffd700 1 -- 172.21.15.125:0/3077955239 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1398020020 con 0x7f13a80a0a70 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 msgr2=0x7f13a8122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 0x7f13a8122840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f139800e9a0 tx=0x7f139800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 shutdown_connections 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13a8133f50 0x7f13a81232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13a80a0a70 0x7f13a8122840 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 --2- 172.21.15.125:0/3077955239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13a80a1380 0x7f13a8122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 >> 172.21.15.125:0/3077955239 conn(0x7f13a80a6610 msgr2=0x7f13a80a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 shutdown_connections 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.603+0000 7f13acd81700 1 -- 172.21.15.125:0/3077955239 wait complete. 2023-10-03T10:16:24.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.641+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efcdc122150 con 0x7efcdc1343a0 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.641+0000 7efcc3fff700 1 -- 172.21.15.125:0/4163073691 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efccc036090 con 0x7efcdc1343a0 2023-10-03T10:16:24.642 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:24.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 msgr2=0x7efcdc1c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efccc008dd0 tx=0x7efccc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 shutdown_connections 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efcdc1343a0 0x7efcdc1c8ba0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc09ad40 0x7efcdc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 --2- 172.21.15.125:0/4163073691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc133f70 0x7efcdc1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 >> 172.21.15.125:0/4163073691 conn(0x7efcdc099c40 msgr2=0x7efcdc1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 shutdown_connections 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.643+0000 7efce215d700 1 -- 172.21.15.125:0/4163073691 wait complete. 2023-10-03T10:16:24.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:24.705 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:24.743 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.829+0000 7fc424831700 1 Processor -- start 2023-10-03T10:16:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.829+0000 7fc424831700 1 -- start start 2023-10-03T10:16:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc424831700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 0x7fc42009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc424831700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc42009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc424831700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42009af80 con 0x7fc420133c20 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc424831700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42009a520 con 0x7fc42009edb0 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc424831700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42009fe00 con 0x7fc42009a150 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 0x7fc42009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc420133c20 0x7fc4201340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37312/0 (socket says 172.21.15.125:37312) 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41ed9d700 1 -- 172.21.15.125:0/352144713 learned_addr learned my addr 172.21.15.125:0/352144713 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41dd9b700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc42009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41e59c700 1 -- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 msgr2=0x7fc42009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41e59c700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc42009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41e59c700 1 -- 172.21.15.125:0/352144713 >> v1:172.21.15.125:6789/0 conn(0x7fc420133c20 legacy=0x7fc4201340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41e59c700 1 -- 172.21.15.125:0/352144713 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42009f6e0 con 0x7fc42009a150 2023-10-03T10:16:24.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.830+0000 7fc41d59a700 1 -- 172.21.15.125:0/352144713 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119914593 0 0) 0x7fc42009af80 con 0x7fc420133c20 2023-10-03T10:16:24.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc41e59c700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 0x7fc42009e870 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc410009870 tx=0x7fc410009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23004feb47304be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc41d59a700 1 -- 172.21.15.125:0/352144713 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410011830 con 0x7fc42009a150 2023-10-03T10:16:24.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc41d59a700 1 -- 172.21.15.125:0/352144713 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410011990 con 0x7fc42009a150 2023-10-03T10:16:24.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc41d59a700 1 -- 172.21.15.125:0/352144713 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410011d20 con 0x7fc42009a150 2023-10-03T10:16:24.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 -- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 msgr2=0x7fc42009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 0x7fc42009e870 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc410009870 tx=0x7fc410009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 -- 172.21.15.125:0/352144713 shutdown_connections 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc42009a150 0x7fc42009e870 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 --2- 172.21.15.125:0/352144713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc42009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.831+0000 7fc424831700 1 -- 172.21.15.125:0/352144713 >> 172.21.15.125:0/352144713 conn(0x7fc4200a4430 msgr2=0x7fc4200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.832+0000 7fc424831700 1 -- 172.21.15.125:0/352144713 shutdown_connections 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.832+0000 7fc424831700 1 -- 172.21.15.125:0/352144713 wait complete. 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 Processor -- start 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 -- start start 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc420122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 0x7fc4201230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420125030 con 0x7fc42009a150 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420133950 con 0x7fc42009edb0 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc424831700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc420124730 con 0x7fc420133c20 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49474/0 (socket says 172.21.15.125:49474) 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 -- 172.21.15.125:0/3227181138 learned_addr learned my addr 172.21.15.125:0/3227181138 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc420122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41ed9d700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 0x7fc4201230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 -- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 msgr2=0x7fc4201230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 0x7fc4201230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 -- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 msgr2=0x7fc420122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc420122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41e59c700 1 -- 172.21.15.125:0/3227181138 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100094a0 con 0x7fc42009a150 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41dd9b700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc420122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.833+0000 7fc41ed9d700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 0x7fc4201230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc41e59c700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fc410014040 tx=0x7fc410004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41001a830 con 0x7fc42009a150 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41001a990 con 0x7fc42009a150 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4200a39b0 con 0x7fc42009a150 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41001ad00 con 0x7fc42009a150 2023-10-03T10:16:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc420126600 con 0x7fc42009a150 2023-10-03T10:16:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.834+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4100243f0 con 0x7fc42009a150 2023-10-03T10:16:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.835+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc4100407b0 con 0x7fc42009a150 2023-10-03T10:16:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.835+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42009fa30 con 0x7fc42009a150 2023-10-03T10:16:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.839+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc41001ae60 con 0x7fc42009a150 2023-10-03T10:16:24.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.872+0000 7fb998198700 1 Processor -- start 2023-10-03T10:16:24.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.872+0000 7fb998198700 1 -- start start 2023-10-03T10:16:24.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb998198700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb990138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb998198700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 0x7fb99013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb998198700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99009e9d0 con 0x7fb9900a0a70 2023-10-03T10:16:24.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb998198700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99009dc00 con 0x7fb9900a1550 2023-10-03T10:16:24.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb998198700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb99009dec0 con 0x7fb990139200 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb995f34700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb9900a0a70 0x7fb9900a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37316/0 (socket says 172.21.15.125:37316) 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb995f34700 1 -- 172.21.15.125:0/376481295 learned_addr learned my addr 172.21.15.125:0/376481295 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb996735700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 0x7fb99013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb995733700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb990138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.873+0000 7fb994f32700 1 -- 172.21.15.125:0/376481295 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145904124 0 0) 0x7fb99009e9d0 con 0x7fb9900a0a70 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb994f32700 1 -- 172.21.15.125:0/376481295 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb97c0035b0 con 0x7fb9900a0a70 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb995733700 1 -- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 msgr2=0x7fb99013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb995733700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 0x7fb99013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb995733700 1 -- 172.21.15.125:0/376481295 >> v1:172.21.15.125:6789/0 conn(0x7fb9900a0a70 legacy=0x7fb9900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb995733700 1 -- 172.21.15.125:0/376481295 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99009e6a0 con 0x7fb9900a1550 2023-10-03T10:16:24.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb996735700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 0x7fb99013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb995733700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb990138cc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb980009870 tx=0x7fb980009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b8bb87975f46f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb994f32700 1 -- 172.21.15.125:0/376481295 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011830 con 0x7fb9900a1550 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb994f32700 1 -- 172.21.15.125:0/376481295 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980011990 con 0x7fb9900a1550 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb994f32700 1 -- 172.21.15.125:0/376481295 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011d20 con 0x7fb9900a1550 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb998198700 1 -- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 msgr2=0x7fb990138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.874+0000 7fb998198700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb990138cc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb980009870 tx=0x7fb980009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 -- 172.21.15.125:0/376481295 shutdown_connections 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb990139200 0x7fb99013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 --2- 172.21.15.125:0/376481295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb990138cc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 -- 172.21.15.125:0/376481295 >> 172.21.15.125:0/376481295 conn(0x7fb9900a6610 msgr2=0x7fb9900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 -- 172.21.15.125:0/376481295 shutdown_connections 2023-10-03T10:16:24.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 -- 172.21.15.125:0/376481295 wait complete. 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.875+0000 7fb998198700 1 Processor -- start 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 -- start start 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb99011eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900a5100 con 0x7fb990139200 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990122120 con 0x7fb9900a1550 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb998198700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901347d0 con 0x7fb9900a0a70 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb996735700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56326/0 (socket says 172.21.15.125:56326) 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 -- 172.21.15.125:0/1353781946 learned_addr learned my addr 172.21.15.125:0/1353781946 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb996735700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49488/0 (socket says 172.21.15.125:49488) 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995733700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb99011eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 -- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 msgr2=0x7fb99011eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb99011eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 -- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 msgr2=0x7fb99011f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb995f34700 1 -- 172.21.15.125:0/1353781946 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988009a70 con 0x7fb9900a0a70 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.876+0000 7fb996735700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb995f34700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c700 tx=0x7fb98c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c005d70 con 0x7fb9900a0a70 2023-10-03T10:16:24.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0070d0 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9800094a0 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c007460 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb990120ce0 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.877+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb98c0075c0 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.878+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb98c03eb30 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.878+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb990121da0 con 0x7fb9900a0a70 2023-10-03T10:16:24.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:24.882+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb990121da0 con 0x7fb9900a0a70 2023-10-03T10:16:25.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.032+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc42009f6e0 con 0x7fc42009a150 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.033+0000 7fc40effd700 1 -- 172.21.15.125:0/3227181138 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc42009f6e0 con 0x7fc42009a150 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 msgr2=0x7fc420122660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fc410014040 tx=0x7fc410004750 comp rx=0 tx=0).stop 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 shutdown_connections 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc420133c20 0x7fc4201230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc42009a150 0x7fc420122660 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 --2- 172.21.15.125:0/3227181138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc42009edb0 0x7fc420122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 >> 172.21.15.125:0/3227181138 conn(0x7fc4200a4430 msgr2=0x7fc420071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 shutdown_connections 2023-10-03T10:16:25.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.035+0000 7fc424831700 1 -- 172.21.15.125:0/3227181138 wait complete. 2023-10-03T10:16:25.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.074+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb990122260 con 0x7fb9900a0a70 2023-10-03T10:16:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.075+0000 7fb9867fc700 1 -- 172.21.15.125:0/1353781946 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb990122260 con 0x7fb9900a0a70 2023-10-03T10:16:25.075 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 msgr2=0x7fb99011e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c700 tx=0x7fb98c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 shutdown_connections 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb990139200 0x7fb99011f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb9900a0a70 0x7fb99011e980 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 --2- 172.21.15.125:0/1353781946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9900a1550 0x7fb99011eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 >> 172.21.15.125:0/1353781946 conn(0x7fb9900a6610 msgr2=0x7fb9900a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 shutdown_connections 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.077+0000 7fb998198700 1 -- 172.21.15.125:0/1353781946 wait complete. 2023-10-03T10:16:25.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:25.617 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:25.656 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 Processor -- start 2023-10-03T10:16:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 -- start start 2023-10-03T10:16:25.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 0x7f54c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c80a1380 0x7f54c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c809e9d0 con 0x7f54c80a1380 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c809dc00 con 0x7f54c8133f50 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54ccf2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54c809dec0 con 0x7f54c80a0a70 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c80a1380 0x7f54c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 0x7f54c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47002/0 (socket says 172.21.15.125:47002) 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c80a1380 0x7f54c8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51494/0 (socket says 172.21.15.125:51494) 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 0x7f54c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51340/0 (socket says 172.21.15.125:51340) 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.747+0000 7f54c6d9d700 1 -- 172.21.15.125:0/425884258 learned_addr learned my addr 172.21.15.125:0/425884258 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 -- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 msgr2=0x7f54c80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 0x7f54c80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 -- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 msgr2=0x7f54c8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 -- 172.21.15.125:0/425884258 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c809e6a0 con 0x7f54c80a1380 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c6d9d700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c5d9b700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80a1380 0x7f54c8133a10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009840 tx=0x7f54bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ddd47197d6245f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c559a700 1 -- 172.21.15.125:0/425884258 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011830 con 0x7f54c80a1380 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c559a700 1 -- 172.21.15.125:0/425884258 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc011990 con 0x7f54c80a1380 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.748+0000 7f54c559a700 1 -- 172.21.15.125:0/425884258 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011d20 con 0x7f54c80a1380 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 -- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80a1380 msgr2=0x7f54c8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80a1380 0x7f54c8133a10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009840 tx=0x7f54bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 -- 172.21.15.125:0/425884258 shutdown_connections 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c8133f50 0x7f54c8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a0a70 0x7f54c80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/425884258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80a1380 0x7f54c8133a10 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 -- 172.21.15.125:0/425884258 >> 172.21.15.125:0/425884258 conn(0x7f54c80a6610 msgr2=0x7f54c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 -- 172.21.15.125:0/425884258 shutdown_connections 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.749+0000 7f54ccf2c700 1 -- 172.21.15.125:0/425884258 wait complete. 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 Processor -- start 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 -- start start 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 0x7f54c81228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c8133f50 0x7f54c8122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8133760 con 0x7f54c8133f50 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c81237f0 con 0x7f54c80a0a70 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.750+0000 7f54ccf2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8124e30 con 0x7f54c80a1380 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 0x7f54c81228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47010/0 (socket says 172.21.15.125:47010) 2023-10-03T10:16:25.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c5d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 0x7f54c81228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51342/0 (socket says 172.21.15.125:51342) 2023-10-03T10:16:25.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c8133f50 0x7f54c8122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 -- 172.21.15.125:0/3542924597 learned_addr learned my addr 172.21.15.125:0/3542924597 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 -- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 msgr2=0x7f54c81228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 0x7f54c81228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 -- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c8133f50 msgr2=0x7f54c8122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c8133f50 0x7f54c8122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 -- 172.21.15.125:0/3542924597 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009b30 con 0x7f54c80a0a70 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54c659c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e8d0 tx=0x7f54b800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8013680 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80137e0 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc0094a0 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8013b90 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.751+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c80a5180 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.752+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54b8013cf0 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.752+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80a0440 con 0x7f54c80a0a70 2023-10-03T10:16:25.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.752+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54b803f570 con 0x7f54c80a0a70 2023-10-03T10:16:25.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.761+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54b801be10 con 0x7f54c80a0a70 2023-10-03T10:16:25.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 Processor -- start 2023-10-03T10:16:25.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 -- start start 2023-10-03T10:16:25.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d009dc00 con 0x7f90d00a1380 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d009ea60 con 0x7f90d0134120 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.789+0000 7f90d4d54700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d009dec0 con 0x7f90d00a0a70 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ced9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cdd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90d00a1380 0x7f90d0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41876/0 (socket says 172.21.15.125:41876) 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47012/0 (socket says 172.21.15.125:47012) 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ced9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51516/0 (socket says 172.21.15.125:51516) 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cdd9b700 1 -- 172.21.15.125:0/3111205969 learned_addr learned my addr 172.21.15.125:0/3111205969 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 -- 172.21.15.125:0/3111205969 >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 msgr2=0x7f90d013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 --2- 172.21.15.125:0/3111205969 >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 -- 172.21.15.125:0/3111205969 >> v1:172.21.15.125:6789/0 conn(0x7f90d00a1380 legacy=0x7f90d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 -- 172.21.15.125:0/3111205969 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d009e6a0 con 0x7f90d00a0a70 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cd59a700 1 -- 172.21.15.125:0/3111205969 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982942713 0 0) 0x7f90d009dc00 con 0x7f90d00a1380 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ced9d700 1 --2- 172.21.15.125:0/3111205969 >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90ce59c700 1 --2- 172.21.15.125:0/3111205969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009840 tx=0x7f90c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1f151cbccc6f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cd59a700 1 -- 172.21.15.125:0/3111205969 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0011830 con 0x7f90d00a0a70 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cd59a700 1 -- 172.21.15.125:0/3111205969 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0011990 con 0x7f90d00a0a70 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.790+0000 7f90cd59a700 1 -- 172.21.15.125:0/3111205969 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0011d20 con 0x7f90d00a0a70 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 -- 172.21.15.125:0/3111205969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 msgr2=0x7f90d00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 --2- 172.21.15.125:0/3111205969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009840 tx=0x7f90c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 -- 172.21.15.125:0/3111205969 shutdown_connections 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 --2- 172.21.15.125:0/3111205969 >> v2:172.21.15.125:3300/0 conn(0x7f90d0134120 0x7f90d013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 --2- 172.21.15.125:0/3111205969 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d00a0a70 0x7f90d00a0e40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 -- 172.21.15.125:0/3111205969 >> 172.21.15.125:0/3111205969 conn(0x7f90d00a6610 msgr2=0x7f90d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 -- 172.21.15.125:0/3111205969 shutdown_connections 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.791+0000 7f90d4d54700 1 -- 172.21.15.125:0/3111205969 wait complete. 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.792+0000 7f90d4d54700 1 Processor -- start 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.792+0000 7f90d4d54700 1 -- start start 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90d00a1380 0x7f90d0122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0124390 con 0x7f90d00a0a70 2023-10-03T10:16:25.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0133310 con 0x7f90d0134120 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90d4d54700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0125d00 con 0x7f90d00a1380 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ced9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51530/0 (socket says 172.21.15.125:51530) 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 -- 172.21.15.125:0/2812552936 learned_addr learned my addr 172.21.15.125:0/2812552936 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ced9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47024/0 (socket says 172.21.15.125:47024) 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90cdd9b700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90d00a1380 0x7f90d0122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 -- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90d00a1380 msgr2=0x7f90d0122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90d00a1380 0x7f90d0122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 -- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 msgr2=0x7f90d0123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ce59c700 1 -- 172.21.15.125:0/2812552936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8009a70 con 0x7f90d00a0a70 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.793+0000 7f90ced9d700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90ce59c700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f90c00090b0 tx=0x7f90c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00045d0 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c001f070 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00038e0 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c00094a0 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.794+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d00a03e0 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.795+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d004f2a0 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.795+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90c0003a40 con 0x7f90d00a0a70 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.796+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90c0021070 con 0x7f90d00a0a70 2023-10-03T10:16:25.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.800+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90c001a430 con 0x7f90d00a0a70 2023-10-03T10:16:25.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.957+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f54c811f760 con 0x7f54c80a0a70 2023-10-03T10:16:25.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.957+0000 7f54b6ffd700 1 -- 172.21.15.125:0/3542924597 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54b8021070 con 0x7f54c80a0a70 2023-10-03T10:16:25.958 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.959+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 msgr2=0x7f54c8122390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.959+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e8d0 tx=0x7f54b800ebe0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 shutdown_connections 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c8133f50 0x7f54c8122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c80a0a70 0x7f54c8122390 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 --2- 172.21.15.125:0/3542924597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54c80a1380 0x7f54c81228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 >> 172.21.15.125:0/3542924597 conn(0x7f54c80a6610 msgr2=0x7f54c811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 shutdown_connections 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.960+0000 7f54ccf2c700 1 -- 172.21.15.125:0/3542924597 wait complete. 2023-10-03T10:16:25.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.992+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f90d0072980 con 0x7f90d00a0a70 2023-10-03T10:16:25.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.993+0000 7f90beffd700 1 -- 172.21.15.125:0/2812552936 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90c0034090 con 0x7f90d00a0a70 2023-10-03T10:16:25.993 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:25.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 msgr2=0x7f90d0122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f90c00090b0 tx=0x7f90c0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:25.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 shutdown_connections 2023-10-03T10:16:25.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90d0134120 0x7f90d0123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90d00a0a70 0x7f90d0122780 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 --2- 172.21.15.125:0/2812552936 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90d00a1380 0x7f90d0122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 >> 172.21.15.125:0/2812552936 conn(0x7f90d00a6610 msgr2=0x7f90d00a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 shutdown_connections 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:25.995+0000 7f90d4d54700 1 -- 172.21.15.125:0/2812552936 wait complete. 2023-10-03T10:16:26.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:26.047 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:26.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:26.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.173+0000 7fa35b7b6700 1 Processor -- start 2023-10-03T10:16:26.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 -- start start 2023-10-03T10:16:26.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 0x7fa35406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 0x7fa3541317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35409da80 con 0x7fa354131cf0 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35409dce0 con 0x7fa35406a770 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa35b7b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa35409eb20 con 0x7fa35406b080 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa359552700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 0x7fa35406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa359d53700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa354131cf0 0x7fa354138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41880/0 (socket says 172.21.15.125:41880) 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa359d53700 1 -- 172.21.15.125:0/519309469 learned_addr learned my addr 172.21.15.125:0/519309469 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.174+0000 7fa358d51700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 0x7fa3541317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa359552700 1 -- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 msgr2=0x7fa3541317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa359552700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 0x7fa3541317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa34bfff700 1 -- 172.21.15.125:0/519309469 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025108059 0 0) 0x7fa35409da80 con 0x7fa354131cf0 2023-10-03T10:16:26.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa359552700 1 -- 172.21.15.125:0/519309469 >> v1:172.21.15.125:6789/0 conn(0x7fa354131cf0 legacy=0x7fa354138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa359552700 1 -- 172.21.15.125:0/519309469 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35409d860 con 0x7fa35406a770 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa358d51700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 0x7fa3541317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa359552700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 0x7fa35406ab40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa3500098a0 tx=0x7fa350009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=846ea8b16851a98c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa34bfff700 1 -- 172.21.15.125:0/519309469 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350011830 con 0x7fa35406a770 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa34bfff700 1 -- 172.21.15.125:0/519309469 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa350011990 con 0x7fa35406a770 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.175+0000 7fa34bfff700 1 -- 172.21.15.125:0/519309469 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350011d20 con 0x7fa35406a770 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 -- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 msgr2=0x7fa35406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 0x7fa35406ab40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa3500098a0 tx=0x7fa350009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 -- 172.21.15.125:0/519309469 shutdown_connections 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa35406a770 0x7fa35406ab40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/519309469 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406b080 0x7fa3541317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 -- 172.21.15.125:0/519309469 >> 172.21.15.125:0/519309469 conn(0x7fa354099c40 msgr2=0x7fa3540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 -- 172.21.15.125:0/519309469 shutdown_connections 2023-10-03T10:16:26.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.176+0000 7fa35b7b6700 1 -- 172.21.15.125:0/519309469 wait complete. 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 Processor -- start 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 -- start start 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 0x7fa35409b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 0x7fa3541c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354122220 con 0x7fa35406b080 2023-10-03T10:16:26.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35409a970 con 0x7fa354131cf0 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa35b7b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa354122420 con 0x7fa35406a770 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359d53700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 0x7fa3541c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51376/0 (socket says 172.21.15.125:51376) 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 -- 172.21.15.125:0/2333505991 learned_addr learned my addr 172.21.15.125:0/2333505991 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa358d51700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 0x7fa35409b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 -- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 msgr2=0x7fa3541c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 0x7fa3541c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 -- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 msgr2=0x7fa35409b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 0x7fa35409b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359552700 1 -- 172.21.15.125:0/2333505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440094a0 con 0x7fa35406a770 2023-10-03T10:16:26.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.177+0000 7fa359d53700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 0x7fa3541c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa358d51700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 0x7fa35409b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa359552700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa3500090b0 tx=0x7fa350004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350004240 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35001f070 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3500094a0 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500045a0 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.178+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa354071e10 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.179+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35404f2a0 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.179+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa350021030 con 0x7fa35406a770 2023-10-03T10:16:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.180+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa350040c70 con 0x7fa35406a770 2023-10-03T10:16:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.188+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3500036a0 con 0x7fa35406a770 2023-10-03T10:16:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.219+0000 7f4d8c588700 1 Processor -- start 2023-10-03T10:16:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.219+0000 7f4d8c588700 1 -- start start 2023-10-03T10:16:26.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8c588700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d840a1550 0x7f4d84138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8c588700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8c588700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8409e9d0 con 0x7f4d840a0a70 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8c588700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8409dc00 con 0x7f4d840a1550 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8c588700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8409dec0 con 0x7f4d84139200 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d840a1550 0x7f4d84138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8ab25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8a324700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4d840a0a70 0x7f4d840a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41896/0 (socket says 172.21.15.125:41896) 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8ab25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51382/0 (socket says 172.21.15.125:51382) 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8a324700 1 -- 172.21.15.125:0/4049611537 learned_addr learned my addr 172.21.15.125:0/4049611537 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d840a1550 0x7f4d84138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51554/0 (socket says 172.21.15.125:51554) 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 -- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 msgr2=0x7f4d8413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 -- 172.21.15.125:0/4049611537 >> v1:172.21.15.125:6789/0 conn(0x7f4d840a0a70 legacy=0x7f4d840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 -- 172.21.15.125:0/4049611537 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8409e6a0 con 0x7f4d840a1550 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89322700 1 -- 172.21.15.125:0/4049611537 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132901707 0 0) 0x7f4d8409e9d0 con 0x7f4d840a0a70 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d8ab25700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89b23700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d84138cc0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009840 tx=0x7f4d74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f55c699136c6714 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89322700 1 -- 172.21.15.125:0/4049611537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74011830 con 0x7f4d840a1550 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89322700 1 -- 172.21.15.125:0/4049611537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74011990 con 0x7f4d840a1550 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.220+0000 7f4d89322700 1 -- 172.21.15.125:0/4049611537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74011d20 con 0x7f4d840a1550 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 -- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 msgr2=0x7f4d84138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d84138cc0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009840 tx=0x7f4d74009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 -- 172.21.15.125:0/4049611537 shutdown_connections 2023-10-03T10:16:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4049611537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d84138cc0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 -- 172.21.15.125:0/4049611537 >> 172.21.15.125:0/4049611537 conn(0x7f4d840a6610 msgr2=0x7f4d840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 -- 172.21.15.125:0/4049611537 shutdown_connections 2023-10-03T10:16:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.221+0000 7f4d8c588700 1 -- 172.21.15.125:0/4049611537 wait complete. 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 Processor -- start 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 -- start start 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 0x7f4d8411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d8411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841219d0 con 0x7f4d840a1550 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840a5100 con 0x7f4d840a0a70 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.222+0000 7f4d8c588700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840a03e0 con 0x7f4d84139200 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8ab25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d8411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8a324700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 0x7f4d8411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8ab25700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8411f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51394/0 (socket says 172.21.15.125:51394) 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8ab25700 1 -- 172.21.15.125:0/4011392468 learned_addr learned my addr 172.21.15.125:0/4011392468 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 -- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 msgr2=0x7f4d8411f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8411f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 -- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 msgr2=0x7f4d8411e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 0x7f4d8411e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 -- 172.21.15.125:0/4011392468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c009a70 con 0x7f4d840a1550 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8a324700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 0x7f4d8411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d89b23700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d8411ecb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f4d74016000 tx=0x7f4d74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74004550 con 0x7f4d840a1550 2023-10-03T10:16:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7401f070 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d740094a0 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740038e0 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.223+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d84120ae0 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.224+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d74003a40 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.224+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d74021070 con 0x7f4d840a1550 2023-10-03T10:16:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.224+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d84134660 con 0x7f4d840a1550 2023-10-03T10:16:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.229+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d74015070 con 0x7f4d840a1550 2023-10-03T10:16:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.383+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3541314b0 con 0x7fa35406a770 2023-10-03T10:16:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.383+0000 7fa349ffb700 1 -- 172.21.15.125:0/2333505991 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa350015070 con 0x7fa35406a770 2023-10-03T10:16:26.383 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 msgr2=0x7fa35409abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa3500090b0 tx=0x7fa350004750 comp rx=0 tx=0).stop 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 shutdown_connections 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa354131cf0 0x7fa3541c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa35406a770 0x7fa35409abc0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 --2- 172.21.15.125:0/2333505991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa35406b080 0x7fa35409b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 >> 172.21.15.125:0/2333505991 conn(0x7fa354099c40 msgr2=0x7fa3541b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 shutdown_connections 2023-10-03T10:16:26.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.385+0000 7fa35b7b6700 1 -- 172.21.15.125:0/2333505991 wait complete. 2023-10-03T10:16:26.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:26.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.423+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d8404f2a0 con 0x7f4d840a1550 2023-10-03T10:16:26.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.424+0000 7f4d7affd700 1 -- 172.21.15.125:0/4011392468 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d74040030 con 0x7f4d840a1550 2023-10-03T10:16:26.424 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 msgr2=0x7f4d8411ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d8411ecb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f4d74016000 tx=0x7f4d74004750 comp rx=0 tx=0).stop 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 shutdown_connections 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4d84139200 0x7f4d8411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d840a0a70 0x7f4d8411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 --2- 172.21.15.125:0/4011392468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d840a1550 0x7f4d8411ecb0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 >> 172.21.15.125:0/4011392468 conn(0x7f4d840a6610 msgr2=0x7f4d840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 shutdown_connections 2023-10-03T10:16:26.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:26.426+0000 7f4d8c588700 1 -- 172.21.15.125:0/4011392468 wait complete. 2023-10-03T10:16:26.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:26.973 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:27.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.103+0000 7fb758220700 1 Processor -- start 2023-10-03T10:16:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.103+0000 7fb758220700 1 -- start start 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb758220700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb758220700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb758220700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75009dc00 con 0x7fb7500a1380 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb758220700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75009ea90 con 0x7fb7500a0a70 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb758220700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75009dec0 con 0x7fb750134120 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb755fbc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47062/0 (socket says 172.21.15.125:47062) 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb755fbc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51578/0 (socket says 172.21.15.125:51578) 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7557bb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb7500a1380 0x7fb750133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41906/0 (socket says 172.21.15.125:41906) 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 -- 172.21.15.125:0/2451666621 learned_addr learned my addr 172.21.15.125:0/2451666621 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 -- 172.21.15.125:0/2451666621 >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 msgr2=0x7fb7500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 --2- 172.21.15.125:0/2451666621 >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 -- 172.21.15.125:0/2451666621 >> v1:172.21.15.125:6789/0 conn(0x7fb7500a1380 legacy=0x7fb750133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 -- 172.21.15.125:0/2451666621 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75009e6a0 con 0x7fb750134120 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb755fbc700 1 --2- 172.21.15.125:0/2451666621 >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb7567bd700 1 --2- 172.21.15.125:0/2451666621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb748009e50 tx=0x7fb74800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=464323302a6b0a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb754fba700 1 -- 172.21.15.125:0/2451666621 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800e070 con 0x7fb750134120 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb754fba700 1 -- 172.21.15.125:0/2451666621 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74800b910 con 0x7fb750134120 2023-10-03T10:16:27.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.104+0000 7fb754fba700 1 -- 172.21.15.125:0/2451666621 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800bcc0 con 0x7fb750134120 2023-10-03T10:16:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 -- 172.21.15.125:0/2451666621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 msgr2=0x7fb75013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 --2- 172.21.15.125:0/2451666621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb748009e50 tx=0x7fb74800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 -- 172.21.15.125:0/2451666621 shutdown_connections 2023-10-03T10:16:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 --2- 172.21.15.125:0/2451666621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb750134120 0x7fb75013bce0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 --2- 172.21.15.125:0/2451666621 >> v2:172.21.15.125:3300/0 conn(0x7fb7500a0a70 0x7fb7500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 -- 172.21.15.125:0/2451666621 >> 172.21.15.125:0/2451666621 conn(0x7fb7500a6610 msgr2=0x7fb7500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 -- 172.21.15.125:0/2451666621 shutdown_connections 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.105+0000 7fb758220700 1 -- 172.21.15.125:0/2451666621 wait complete. 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.106+0000 7fb758220700 1 Processor -- start 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.106+0000 7fb758220700 1 -- start start 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 0x7fb7501c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb750134120 0x7fb7501c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750124a90 con 0x7fb7500a1380 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501248a0 con 0x7fb7500a0a70 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb758220700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501267b0 con 0x7fb750134120 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb7557bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 0x7fb7501c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb7567bd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb750134120 0x7fb7501c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47068/0 (socket says 172.21.15.125:47068) 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 -- 172.21.15.125:0/1211830979 learned_addr learned my addr 172.21.15.125:0/1211830979 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 -- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb750134120 msgr2=0x7fb7501c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb750134120 0x7fb7501c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 -- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 msgr2=0x7fb7501c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 0x7fb7501c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb755fbc700 1 -- 172.21.15.125:0/1211830979 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0094a0 con 0x7fb7500a0a70 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.107+0000 7fb7557bb700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 0x7fb7501c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb755fbc700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00ebe0 tx=0x7fb74c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00c850 con 0x7fb7500a0a70 2023-10-03T10:16:27.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c00c9b0 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb748009b30 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00cd40 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7500a03e0 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.108+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb74c013470 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.109+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb74c03fb30 con 0x7fb7500a0a70 2023-10-03T10:16:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.109+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75009fd80 con 0x7fb7500a0a70 2023-10-03T10:16:27.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.117+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb74c013720 con 0x7fb7500a0a70 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.146+0000 7f759f0b1700 1 Processor -- start 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.146+0000 7f759f0b1700 1 -- start start 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759f0b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759f0b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 0x7f759809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759f0b1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7598072b30 con 0x7f759813c410 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759f0b1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759809a500 con 0x7f759809edb0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759f0b1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759809f720 con 0x7f759809a130 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f7597fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 0x7f759809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47076/0 (socket says 172.21.15.125:47076) 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 -- 172.21.15.125:0/3711037215 learned_addr learned my addr 172.21.15.125:0/3711037215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 -- 172.21.15.125:0/3711037215 >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 msgr2=0x7f759809f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 --2- 172.21.15.125:0/3711037215 >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 0x7f759809f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 -- 172.21.15.125:0/3711037215 >> v1:172.21.15.125:6789/0 conn(0x7f759813c410 legacy=0x7f759813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f759ce4d700 1 -- 172.21.15.125:0/3711037215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759809fe00 con 0x7f759809a130 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.147+0000 7f7597fff700 1 --2- 172.21.15.125:0/3711037215 >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 0x7f759809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.148+0000 7f759ce4d700 1 --2- 172.21.15.125:0/3711037215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f758c009920 tx=0x7f758c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105856286d9ff3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.151+0000 7f75977fe700 1 -- 172.21.15.125:0/3711037215 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011830 con 0x7f759809a130 2023-10-03T10:16:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.151+0000 7f75977fe700 1 -- 172.21.15.125:0/3711037215 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c011990 con 0x7f759809a130 2023-10-03T10:16:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.151+0000 7f75977fe700 1 -- 172.21.15.125:0/3711037215 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011d20 con 0x7f759809a130 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 -- 172.21.15.125:0/3711037215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 msgr2=0x7f759809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 --2- 172.21.15.125:0/3711037215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f758c009920 tx=0x7f758c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 -- 172.21.15.125:0/3711037215 shutdown_connections 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 --2- 172.21.15.125:0/3711037215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759809e870 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 --2- 172.21.15.125:0/3711037215 >> v2:172.21.15.125:3300/0 conn(0x7f759809edb0 0x7f759809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 -- 172.21.15.125:0/3711037215 >> 172.21.15.125:0/3711037215 conn(0x7f75980a4430 msgr2=0x7f75980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 -- 172.21.15.125:0/3711037215 shutdown_connections 2023-10-03T10:16:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.152+0000 7f759f0b1700 1 -- 172.21.15.125:0/3711037215 wait complete. 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.153+0000 7f759f0b1700 1 Processor -- start 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.153+0000 7f759f0b1700 1 -- start start 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.153+0000 7f759f0b1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759811b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.153+0000 7f759f0b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.153+0000 7f759f0b1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759f0b1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759811db70 con 0x7f759809edb0 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759f0b1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75980a0160 con 0x7f759809a130 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759f0b1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759811de00 con 0x7f759813c410 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f7597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759d64e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759d64e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51420/0 (socket says 172.21.15.125:51420) 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f7597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51612/0 (socket says 172.21.15.125:51612) 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759d64e700 1 -- 172.21.15.125:0/4164742359 learned_addr learned my addr 172.21.15.125:0/4164742359 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759811b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 -- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 msgr2=0x7f759811bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 -- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 msgr2=0x7f759811b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 -- 172.21.15.125:0/4164742359 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840094a0 con 0x7f759809a130 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759d64e700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f7597fff700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759ce4d700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759811b2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f758c016000 tx=0x7f758c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c004450 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c01f070 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c009550 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0045f0 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.154+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598127640 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.155+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f758c0038e0 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.155+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f758c021070 con 0x7f759809a130 2023-10-03T10:16:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.155+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759804f2a0 con 0x7f759809a130 2023-10-03T10:16:27.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.160+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f758c02b080 con 0x7f759809a130 2023-10-03T10:16:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.314+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb75004f2a0 con 0x7fb7500a0a70 2023-10-03T10:16:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.315+0000 7fb7467fc700 1 -- 172.21.15.125:0/1211830979 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb74c021030 con 0x7fb7500a0a70 2023-10-03T10:16:27.315 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 msgr2=0x7fb7501c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00ebe0 tx=0x7fb74c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 shutdown_connections 2023-10-03T10:16:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb750134120 0x7fb7501c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7500a0a70 0x7fb7501c85e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 --2- 172.21.15.125:0/1211830979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7500a1380 0x7fb7501c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 >> 172.21.15.125:0/1211830979 conn(0x7fb7500a6610 msgr2=0x7fb7500a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 shutdown_connections 2023-10-03T10:16:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.317+0000 7fb758220700 1 -- 172.21.15.125:0/1211830979 wait complete. 2023-10-03T10:16:27.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:27.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.351+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f759806be20 con 0x7f759809a130 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.351+0000 7f75957fa700 1 -- 172.21.15.125:0/4164742359 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f758c015020 con 0x7f759809a130 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 msgr2=0x7f759811b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759811b2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f758c016000 tx=0x7f758c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 shutdown_connections 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f759813c410 0x7f759811bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f759809a130 0x7f759811b2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 --2- 172.21.15.125:0/4164742359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f759809edb0 0x7f759811b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 >> 172.21.15.125:0/4164742359 conn(0x7f75980a4430 msgr2=0x7f759809c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 shutdown_connections 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.353+0000 7f759f0b1700 1 -- 172.21.15.125:0/4164742359 wait complete. 2023-10-03T10:16:27.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:27.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:27.439 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.533+0000 7fad56efe700 1 Processor -- start 2023-10-03T10:16:27.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.533+0000 7fad56efe700 1 -- start start 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad56efe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad56efe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 0x7fad5013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad56efe700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5009dc00 con 0x7fad500a1380 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad56efe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5009ea90 con 0x7fad500a0a70 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad56efe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad5009dec0 con 0x7fad50134120 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad54c9a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 0x7fad5013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad54c9a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51622/0 (socket says 172.21.15.125:51622) 2023-10-03T10:16:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad54c9a700 1 -- 172.21.15.125:0/1855501462 learned_addr learned my addr 172.21.15.125:0/1855501462 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 -- 172.21.15.125:0/1855501462 >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 msgr2=0x7fad500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 --2- 172.21.15.125:0/1855501462 >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 -- 172.21.15.125:0/1855501462 >> v1:172.21.15.125:6789/0 conn(0x7fad500a1380 legacy=0x7fad50133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 -- 172.21.15.125:0/1855501462 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5009e6a0 con 0x7fad50134120 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad4f7fe700 1 -- 172.21.15.125:0/1855501462 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162509235 0 0) 0x7fad5009dc00 con 0x7fad500a1380 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad54c9a700 1 --2- 172.21.15.125:0/1855501462 >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad5549b700 1 --2- 172.21.15.125:0/1855501462 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 0x7fad5013bce0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fad48009d90 tx=0x7fad4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=269c65d8b153e4fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.534+0000 7fad4f7fe700 1 -- 172.21.15.125:0/1855501462 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800e070 con 0x7fad50134120 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad4f7fe700 1 -- 172.21.15.125:0/1855501462 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4800bb20 con 0x7fad50134120 2023-10-03T10:16:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad4f7fe700 1 -- 172.21.15.125:0/1855501462 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48012430 con 0x7fad50134120 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 -- 172.21.15.125:0/1855501462 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 msgr2=0x7fad5013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 --2- 172.21.15.125:0/1855501462 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 0x7fad5013bce0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fad48009d90 tx=0x7fad4800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 -- 172.21.15.125:0/1855501462 shutdown_connections 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 --2- 172.21.15.125:0/1855501462 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad50134120 0x7fad5013bce0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 --2- 172.21.15.125:0/1855501462 >> v2:172.21.15.125:3300/0 conn(0x7fad500a0a70 0x7fad500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 -- 172.21.15.125:0/1855501462 >> 172.21.15.125:0/1855501462 conn(0x7fad500a6610 msgr2=0x7fad500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 -- 172.21.15.125:0/1855501462 shutdown_connections 2023-10-03T10:16:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.535+0000 7fad56efe700 1 -- 172.21.15.125:0/1855501462 wait complete. 2023-10-03T10:16:27.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.536+0000 7fad56efe700 1 Processor -- start 2023-10-03T10:16:27.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.536+0000 7fad56efe700 1 -- start start 2023-10-03T10:16:27.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 0x7fad50122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 0x7fad501231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50124360 con 0x7fad500a0a70 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad501336a0 con 0x7fad50134120 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad501332e0 con 0x7fad500a1380 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51442/0 (socket says 172.21.15.125:51442) 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 -- 172.21.15.125:0/3685525745 learned_addr learned my addr 172.21.15.125:0/3685525745 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad5549b700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 0x7fad501231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad54c9a700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 0x7fad50122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 -- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 msgr2=0x7fad501231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 0x7fad501231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 -- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 msgr2=0x7fad50122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 0x7fad50122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 -- 172.21.15.125:0/3685525745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009550 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad5549b700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 0x7fad501231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad54c9a700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 0x7fad50122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4ffff700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001eb0 tx=0x7fad3c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0054e0 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c003680 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad48009a70 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0039f0 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.537+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad500a0430 con 0x7fad500a1380 2023-10-03T10:16:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.538+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad3c003b50 con 0x7fad500a1380 2023-10-03T10:16:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.538+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad3c03ea30 con 0x7fad500a1380 2023-10-03T10:16:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.539+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad50126ac0 con 0x7fad500a1380 2023-10-03T10:16:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.543+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad3c01b3b0 con 0x7fad500a1380 2023-10-03T10:16:27.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.576+0000 7fccc114e700 1 Processor -- start 2023-10-03T10:16:27.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.576+0000 7fccc114e700 1 -- start start 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccc114e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccc114e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc1371c0 0x7fccbc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccc114e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccbc09c970 con 0x7fccbc09e870 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccc114e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc0a0920 con 0x7fccbc09f350 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccc114e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc09f9c0 con 0x7fccbc1371c0 2023-10-03T10:16:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccbad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fccbc09e870 0x7fccbc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41930/0 (socket says 172.21.15.125:41930) 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccbad9d700 1 -- 172.21.15.125:0/3366691109 learned_addr learned my addr 172.21.15.125:0/3366691109 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccba59c700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccbb59e700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc1371c0 0x7fccbc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccba59c700 1 -- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc1371c0 msgr2=0x7fccbc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccba59c700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc1371c0 0x7fccbc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccba59c700 1 -- 172.21.15.125:0/3366691109 >> v1:172.21.15.125:6789/0 conn(0x7fccbc09e870 legacy=0x7fccbc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccb9d9b700 1 -- 172.21.15.125:0/3366691109 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151453076 0 0) 0x7fccbc09c970 con 0x7fccbc09e870 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.577+0000 7fccba59c700 1 -- 172.21.15.125:0/3366691109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc09bab0 con 0x7fccbc09f350 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccba59c700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc136c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fda3c2741def26d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccb9d9b700 1 -- 172.21.15.125:0/3366691109 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011830 con 0x7fccbc09f350 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccb9d9b700 1 -- 172.21.15.125:0/3366691109 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011990 con 0x7fccbc09f350 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccb9d9b700 1 -- 172.21.15.125:0/3366691109 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011d20 con 0x7fccbc09f350 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 -- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 msgr2=0x7fccbc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc136c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 -- 172.21.15.125:0/3366691109 shutdown_connections 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc1371c0 0x7fccbc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 --2- 172.21.15.125:0/3366691109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc136c80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 -- 172.21.15.125:0/3366691109 >> 172.21.15.125:0/3366691109 conn(0x7fccbc0a4430 msgr2=0x7fccbc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 -- 172.21.15.125:0/3366691109 shutdown_connections 2023-10-03T10:16:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.578+0000 7fccc114e700 1 -- 172.21.15.125:0/3366691109 wait complete. 2023-10-03T10:16:27.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.579+0000 7fccc114e700 1 Processor -- start 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.579+0000 7fccc114e700 1 -- start start 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 0x7fccbc120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc09dba0 con 0x7fccbc1371c0 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc123a60 con 0x7fccbc09f350 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccc114e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc123f80 con 0x7fccbc09e870 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccba59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51648/0 (socket says 172.21.15.125:51648) 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 -- 172.21.15.125:0/2367077068 learned_addr learned my addr 172.21.15.125:0/2367077068 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbad9d700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 0x7fccbc120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 -- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 msgr2=0x7fccbc120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 0x7fccbc120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 -- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 msgr2=0x7fccbc120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbb59e700 1 -- 172.21.15.125:0/2367077068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00094a0 con 0x7fccbc1371c0 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccbad9d700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 0x7fccbc120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.580+0000 7fccba59c700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fccbb59e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fccb400ef90 tx=0x7fccb400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400cc90 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400f040 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc0721c0 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4014480 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc1249f0 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.581+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccb40145e0 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.582+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccb4040280 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.582+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc04f2a0 con 0x7fccbc1371c0 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.586+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccb4018020 con 0x7fccbc1371c0 2023-10-03T10:16:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.737+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad5004f2a0 con 0x7fad500a1380 2023-10-03T10:16:27.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.737+0000 7fad4d7fa700 1 -- 172.21.15.125:0/3685525745 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad3c017020 con 0x7fad500a1380 2023-10-03T10:16:27.738 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 msgr2=0x7fad50122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001eb0 tx=0x7fad3c00c800 comp rx=0 tx=0).stop 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 shutdown_connections 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad50134120 0x7fad501231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad500a0a70 0x7fad50122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 --2- 172.21.15.125:0/3685525745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad500a1380 0x7fad50122c90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 >> 172.21.15.125:0/3685525745 conn(0x7fad500a6610 msgr2=0x7fad500a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 shutdown_connections 2023-10-03T10:16:27.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.739+0000 7fad56efe700 1 -- 172.21.15.125:0/3685525745 wait complete. 2023-10-03T10:16:27.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.780+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fccbc123c20 con 0x7fccbc1371c0 2023-10-03T10:16:27.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.781+0000 7fcca37fe700 1 -- 172.21.15.125:0/2367077068 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccbc123c20 con 0x7fccbc1371c0 2023-10-03T10:16:27.781 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:27.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 msgr2=0x7fccbc1211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fccb400ef90 tx=0x7fccb400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 shutdown_connections 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc1371c0 0x7fccbc1211c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fccbc09e870 0x7fccbc120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 --2- 172.21.15.125:0/2367077068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc09f350 0x7fccbc120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 >> 172.21.15.125:0/2367077068 conn(0x7fccbc0a4430 msgr2=0x7fccbc0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 shutdown_connections 2023-10-03T10:16:27.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:27.783+0000 7fccc114e700 1 -- 172.21.15.125:0/2367077068 wait complete. 2023-10-03T10:16:27.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:28.330 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:28.366 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:28.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.462+0000 7f991bfba700 1 Processor -- start 2023-10-03T10:16:28.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 -- start start 2023-10-03T10:16:28.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99140a1380 0x7f9914133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991409dc00 con 0x7f9914133f50 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991409ea60 con 0x7f99140a1380 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991bfba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f991409dec0 con 0x7f99140a0a70 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99140a1380 0x7f9914133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919d56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99140a1380 0x7f9914133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51650/0 (socket says 172.21.15.125:51650) 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919d56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51462/0 (socket says 172.21.15.125:51462) 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f991a557700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9914133f50 0x7f991413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41932/0 (socket says 172.21.15.125:41932) 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 -- 172.21.15.125:0/2913651549 learned_addr learned my addr 172.21.15.125:0/2913651549 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 -- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 msgr2=0x7f99140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 -- 172.21.15.125:0/2913651549 >> v1:172.21.15.125:6789/0 conn(0x7f9914133f50 legacy=0x7f991413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9919555700 1 -- 172.21.15.125:0/2913651549 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991409e6a0 con 0x7f99140a1380 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.463+0000 7f9918d54700 1 -- 172.21.15.125:0/2913651549 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275694042 0 0) 0x7f991409dc00 con 0x7f9914133f50 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f9919d56700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f9919555700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a1380 0x7f9914133a10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f99040098f0 tx=0x7f9904009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a22fd9a75f216f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f9918d54700 1 -- 172.21.15.125:0/2913651549 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011830 con 0x7f99140a1380 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f9918d54700 1 -- 172.21.15.125:0/2913651549 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904011990 con 0x7f99140a1380 2023-10-03T10:16:28.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f9918d54700 1 -- 172.21.15.125:0/2913651549 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011d20 con 0x7f99140a1380 2023-10-03T10:16:28.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f991bfba700 1 -- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a1380 msgr2=0x7f9914133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.464+0000 7f991bfba700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a1380 0x7f9914133a10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f99040098f0 tx=0x7f9904009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 -- 172.21.15.125:0/2913651549 shutdown_connections 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99140a0a70 0x7f99140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 --2- 172.21.15.125:0/2913651549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a1380 0x7f9914133a10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 -- 172.21.15.125:0/2913651549 >> 172.21.15.125:0/2913651549 conn(0x7f99140a6610 msgr2=0x7f99140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 -- 172.21.15.125:0/2913651549 shutdown_connections 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 -- 172.21.15.125:0/2913651549 wait complete. 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.465+0000 7f991bfba700 1 Processor -- start 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 -- start start 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 0x7f9914122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 0x7f9914123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9914126220 con 0x7f99140a0a70 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9914133960 con 0x7f99140a1380 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991bfba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9914133420 con 0x7f9914133f50 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51658/0 (socket says 172.21.15.125:51658) 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 -- 172.21.15.125:0/2388265562 learned_addr learned my addr 172.21.15.125:0/2388265562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919555700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 0x7f9914122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991a557700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 0x7f9914123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 -- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 msgr2=0x7f9914123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 0x7f9914123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 -- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 msgr2=0x7f9914122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 0x7f9914122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919d56700 1 -- 172.21.15.125:0/2388265562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100094a0 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f9919555700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 0x7f9914122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.466+0000 7f991a557700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 0x7f9914123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f9919d56700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f991000ebe0 tx=0x7f991000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000c850 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000c9b0 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000cd40 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904009550 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.467+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9914126bb0 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.468+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991404f2a0 con 0x7f99140a0a70 2023-10-03T10:16:28.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.468+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9910013470 con 0x7f99140a0a70 2023-10-03T10:16:28.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.469+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f991003fbf0 con 0x7f99140a0a70 2023-10-03T10:16:28.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.473+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9910013720 con 0x7f99140a0a70 2023-10-03T10:16:28.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 Processor -- start 2023-10-03T10:16:28.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 -- start start 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 0x7fa25009eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 0x7fa250131620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25009b6a0 con 0x7fa250131b60 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500a0480 con 0x7fa25009e720 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.503+0000 7fa254f9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25009fee0 con 0x7fa25009f030 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 0x7fa250131620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa250131b60 0x7fa250138870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41936/0 (socket says 172.21.15.125:41936) 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24ffff700 1 -- 172.21.15.125:0/2138951320 learned_addr learned my addr 172.21.15.125:0/2138951320 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24f7fe700 1 --2- 172.21.15.125:0/2138951320 >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 0x7fa25009eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 -- 172.21.15.125:0/2138951320 >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 msgr2=0x7fa25009eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 --2- 172.21.15.125:0/2138951320 >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 0x7fa25009eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 -- 172.21.15.125:0/2138951320 >> v1:172.21.15.125:6789/0 conn(0x7fa250131b60 legacy=0x7fa250138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 -- 172.21.15.125:0/2138951320 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25009a4d0 con 0x7fa25009f030 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24f7fe700 1 --2- 172.21.15.125:0/2138951320 >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 0x7fa25009eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24effd700 1 --2- 172.21.15.125:0/2138951320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 0x7fa250131620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa244009840 tx=0x7fa244009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0bf521c7e561ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24e7fc700 1 -- 172.21.15.125:0/2138951320 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011830 con 0x7fa25009f030 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24e7fc700 1 -- 172.21.15.125:0/2138951320 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244011990 con 0x7fa25009f030 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.504+0000 7fa24e7fc700 1 -- 172.21.15.125:0/2138951320 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011d20 con 0x7fa25009f030 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 -- 172.21.15.125:0/2138951320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 msgr2=0x7fa250131620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2138951320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 0x7fa250131620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa244009840 tx=0x7fa244009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 -- 172.21.15.125:0/2138951320 shutdown_connections 2023-10-03T10:16:28.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2138951320 >> v2:172.21.15.125:3300/0 conn(0x7fa25009e720 0x7fa25009eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2138951320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009f030 0x7fa250131620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 -- 172.21.15.125:0/2138951320 >> 172.21.15.125:0/2138951320 conn(0x7fa2500a0d40 msgr2=0x7fa2500a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 -- 172.21.15.125:0/2138951320 shutdown_connections 2023-10-03T10:16:28.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.505+0000 7fa254f9d700 1 -- 172.21.15.125:0/2138951320 wait complete. 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.506+0000 7fa254f9d700 1 Processor -- start 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.506+0000 7fa254f9d700 1 -- start start 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 0x7fa25006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 0x7fa2501c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501220d0 con 0x7fa250131b60 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa250131200 con 0x7fa25009e720 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa25006bd90 con 0x7fa25009f030 2023-10-03T10:16:28.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 0x7fa2501c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47136/0 (socket says 172.21.15.125:47136) 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24f7fe700 1 -- 172.21.15.125:0/2187973094 learned_addr learned my addr 172.21.15.125:0/2187973094 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24effd700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 0x7fa25006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 -- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 msgr2=0x7fa25006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 0x7fa25006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 -- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 msgr2=0x7fa25006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 -- 172.21.15.125:0/2187973094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400094a0 con 0x7fa250131b60 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24effd700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 0x7fa25006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24f7fe700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa24ffff700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 0x7fa2501c8090 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa24800caa0 tx=0x7fa24800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800a9a0 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800ab00 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2440094a0 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800ae70 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.507+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25009ae00 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.508+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25004f2a0 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.509+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa24801b3b0 con 0x7fa250131b60 2023-10-03T10:16:28.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.509+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa24803f7a0 con 0x7fa250131b60 2023-10-03T10:16:28.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.513+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2480192c0 con 0x7fa250131b60 2023-10-03T10:16:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.668+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9914126010 con 0x7f99140a0a70 2023-10-03T10:16:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.668+0000 7f990a7fc700 1 -- 172.21.15.125:0/2388265562 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9910021020 con 0x7f99140a0a70 2023-10-03T10:16:28.669 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:28.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 msgr2=0x7f9914122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f991000ebe0 tx=0x7f991000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 shutdown_connections 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9914133f50 0x7f9914123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99140a0a70 0x7f9914122900 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 --2- 172.21.15.125:0/2388265562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99140a1380 0x7f9914122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 >> 172.21.15.125:0/2388265562 conn(0x7f99140a6610 msgr2=0x7f99140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 shutdown_connections 2023-10-03T10:16:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.670+0000 7f991bfba700 1 -- 172.21.15.125:0/2388265562 wait complete. 2023-10-03T10:16:28.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:28.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.705+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa250122210 con 0x7fa250131b60 2023-10-03T10:16:28.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.705+0000 7fa237fff700 1 -- 172.21.15.125:0/2187973094 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa250122210 con 0x7fa250131b60 2023-10-03T10:16:28.706 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.707+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 msgr2=0x7fa2501c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.707+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 0x7fa2501c8090 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa24800caa0 tx=0x7fa24800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 shutdown_connections 2023-10-03T10:16:28.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa250131b60 0x7fa2501c8090 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa25009e720 0x7fa25006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 --2- 172.21.15.125:0/2187973094 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa25009f030 0x7fa25006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 >> 172.21.15.125:0/2187973094 conn(0x7fa2500a0d40 msgr2=0x7fa2501b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 shutdown_connections 2023-10-03T10:16:28.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.708+0000 7fa254f9d700 1 -- 172.21.15.125:0/2187973094 wait complete. 2023-10-03T10:16:28.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:28.753 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:28.798 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:28.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.885+0000 7f5b1fa38700 1 Processor -- start 2023-10-03T10:16:28.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.885+0000 7f5b1fa38700 1 -- start start 2023-10-03T10:16:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b1809f180 0x7f5b18131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180a0920 con 0x7f5b1809f180 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1809c970 con 0x7f5b18131d70 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1fa38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1809bab0 con 0x7f5b1809e870 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b1809f180 0x7f5b18131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1d7d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1dfd5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1dfd5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47152/0 (socket says 172.21.15.125:47152) 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1d7d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51480/0 (socket says 172.21.15.125:51480) 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b1809f180 0x7f5b18131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51690/0 (socket says 172.21.15.125:51690) 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1dfd5700 1 -- 172.21.15.125:0/2021321364 learned_addr learned my addr 172.21.15.125:0/2021321364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 -- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 msgr2=0x7f5b1809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 -- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 msgr2=0x7f5b18132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1cfd3700 1 -- 172.21.15.125:0/2021321364 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1809f9c0 con 0x7f5b1809f180 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1d7d4700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.886+0000 7f5b1dfd5700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b1cfd3700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b18131830 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b08009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8e0830033f4ede server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b0ffff700 1 -- 172.21.15.125:0/2021321364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011830 con 0x7f5b1809f180 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b0ffff700 1 -- 172.21.15.125:0/2021321364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08011990 con 0x7f5b1809f180 2023-10-03T10:16:28.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b0ffff700 1 -- 172.21.15.125:0/2021321364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011d20 con 0x7f5b1809f180 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b1fa38700 1 -- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 msgr2=0x7f5b18131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b18131830 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b08009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.887+0000 7f5b1fa38700 1 -- 172.21.15.125:0/2021321364 shutdown_connections 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b18131d70 0x7f5b18132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b1809e870 0x7f5b1809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/2021321364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b18131830 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 -- 172.21.15.125:0/2021321364 >> 172.21.15.125:0/2021321364 conn(0x7f5b180a4430 msgr2=0x7f5b180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 -- 172.21.15.125:0/2021321364 shutdown_connections 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 -- 172.21.15.125:0/2021321364 wait complete. 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.888+0000 7f5b1fa38700 1 Processor -- start 2023-10-03T10:16:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 -- start start 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b1806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18125d50 con 0x7f5b1809f180 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181239d0 con 0x7f5b1809e870 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1fa38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180a0210 con 0x7f5b18131d70 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1d7d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1d7d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47166/0 (socket says 172.21.15.125:47166) 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51490/0 (socket says 172.21.15.125:51490) 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1d7d4700 1 -- 172.21.15.125:0/511333200 learned_addr learned my addr 172.21.15.125:0/511333200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1cfd3700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b1806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 -- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 msgr2=0x7f5b1806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 -- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 msgr2=0x7f5b1806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b1806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1dfd5700 1 -- 172.21.15.125:0/511333200 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140094a0 con 0x7f5b18131d70 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1d7d4700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.889+0000 7f5b1cfd3700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b1806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b1dfd5700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000efc0 tx=0x7f5b1000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10018070 con 0x7f5b18131d70 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000f040 con 0x7f5b18131d70 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10009b30 con 0x7f5b18131d70 2023-10-03T10:16:28.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10003c60 con 0x7f5b18131d70 2023-10-03T10:16:28.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.890+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b080094a0 con 0x7f5b18131d70 2023-10-03T10:16:28.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.891+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b1000c880 con 0x7f5b18131d70 2023-10-03T10:16:28.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.891+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180a2790 con 0x7f5b18131d70 2023-10-03T10:16:28.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.891+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b1003f730 con 0x7f5b18131d70 2023-10-03T10:16:28.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.896+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b1001cd90 con 0x7f5b18131d70 2023-10-03T10:16:28.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 Processor -- start 2023-10-03T10:16:28.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 -- start start 2023-10-03T10:16:28.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9d8133ad0 0x7fd9d8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d806b2d0 con 0x7fd9d81309f0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d8133610 con 0x7fd9d8133ad0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9dd39e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809a500 con 0x7fd9d81300a0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9d8133ad0 0x7fd9d8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd9d81309f0 0x7fd9d813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41952/0 (socket says 172.21.15.125:41952) 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d77fe700 1 -- 172.21.15.125:0/1227570581 learned_addr learned my addr 172.21.15.125:0/1227570581 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d6ffd700 1 -- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 msgr2=0x7fd9d81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d6ffd700 1 --2- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.929+0000 7fd9d6ffd700 1 -- 172.21.15.125:0/1227570581 >> v1:172.21.15.125:6789/0 conn(0x7fd9d81309f0 legacy=0x7fd9d813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d5ffb700 1 -- 172.21.15.125:0/1227570581 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040803139 0 0) 0x7fd9d806b2d0 con 0x7fd9d81309f0 2023-10-03T10:16:28.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d6ffd700 1 -- 172.21.15.125:0/1227570581 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d81338b0 con 0x7fd9d8133ad0 2023-10-03T10:16:28.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d6ffd700 1 --2- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d8133ea0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009840 tx=0x7fd9c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371b3622da924af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d5ffb700 1 -- 172.21.15.125:0/1227570581 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8011830 con 0x7fd9d8133ad0 2023-10-03T10:16:28.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d5ffb700 1 -- 172.21.15.125:0/1227570581 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8011990 con 0x7fd9d8133ad0 2023-10-03T10:16:28.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9d5ffb700 1 -- 172.21.15.125:0/1227570581 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8011d20 con 0x7fd9d8133ad0 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 -- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 msgr2=0x7fd9d8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d8133ea0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009840 tx=0x7fd9c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 -- 172.21.15.125:0/1227570581 shutdown_connections 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d8133ea0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/1227570581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.930+0000 7fd9dd39e700 1 -- 172.21.15.125:0/1227570581 >> 172.21.15.125:0/1227570581 conn(0x7fd9d8099c40 msgr2=0x7fd9d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.931+0000 7fd9dd39e700 1 -- 172.21.15.125:0/1227570581 shutdown_connections 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.931+0000 7fd9dd39e700 1 -- 172.21.15.125:0/1227570581 wait complete. 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 Processor -- start 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 -- start start 2023-10-03T10:16:28.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 0x7fd9d811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8120b10 con 0x7fd9d8133ad0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d811f530 con 0x7fd9d81309f0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9dd39e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80a3350 con 0x7fd9d81300a0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51500/0 (socket says 172.21.15.125:51500) 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 0x7fd9d811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d6ffd700 1 -- 172.21.15.125:0/133123792 learned_addr learned my addr 172.21.15.125:0/133123792 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d77fe700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 -- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 msgr2=0x7fd9d811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 -- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 msgr2=0x7fd9d811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d67fc700 1 -- 172.21.15.125:0/133123792 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80094a0 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d6ffd700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.932+0000 7fd9d77fe700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9d67fc700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 0x7fd9d811df80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00e870 tx=0x7fd9cc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc013680 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0137e0 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d812dd00 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc013b90 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.933+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d811f8a0 con 0x7fd9d81309f0 2023-10-03T10:16:28.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.934+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9cc013cf0 con 0x7fd9d81309f0 2023-10-03T10:16:28.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.934+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9cc03f490 con 0x7fd9d81309f0 2023-10-03T10:16:28.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.934+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d804f2a0 con 0x7fd9d81309f0 2023-10-03T10:16:28.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:28.938+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9cc01be10 con 0x7fd9d81309f0 2023-10-03T10:16:29.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.085+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b1804f2a0 con 0x7f5b18131d70 2023-10-03T10:16:29.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.086+0000 7f5b0dffb700 1 -- 172.21.15.125:0/511333200 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b1001cbb0 con 0x7f5b18131d70 2023-10-03T10:16:29.086 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:29.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 msgr2=0x7f5b1806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000efc0 tx=0x7f5b1000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 shutdown_connections 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b18131d70 0x7f5b1806c330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b1809e870 0x7f5b1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 --2- 172.21.15.125:0/511333200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b1809f180 0x7f5b1806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 >> 172.21.15.125:0/511333200 conn(0x7f5b180a4430 msgr2=0x7f5b18131060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 shutdown_connections 2023-10-03T10:16:29.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.088+0000 7f5b1fa38700 1 -- 172.21.15.125:0/511333200 wait complete. 2023-10-03T10:16:29.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:29.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.125+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9d806c3b0 con 0x7fd9d81309f0 2023-10-03T10:16:29.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.125+0000 7fd9bf7fe700 1 -- 172.21.15.125:0/133123792 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9cc021020 con 0x7fd9d81309f0 2023-10-03T10:16:29.125 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:29.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 msgr2=0x7fd9d811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 0x7fd9d811df80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00e870 tx=0x7fd9cc00eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 shutdown_connections 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9d8133ad0 0x7fd9d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9d81300a0 0x7fd9d811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 --2- 172.21.15.125:0/133123792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9d81309f0 0x7fd9d811df80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 >> 172.21.15.125:0/133123792 conn(0x7fd9d8099c40 msgr2=0x7fd9d812e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 shutdown_connections 2023-10-03T10:16:29.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.127+0000 7fd9dd39e700 1 -- 172.21.15.125:0/133123792 wait complete. 2023-10-03T10:16:29.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:29.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:29.721 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.814+0000 7f69828c1700 1 Processor -- start 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.814+0000 7f69828c1700 1 -- start start 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f69828c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c0a0a70 0x7f697c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f69828c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f69828c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c09dc00 con 0x7f697c133f50 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f69828c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c09ea60 con 0x7f697c0a0a70 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f69828c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c09dec0 con 0x7f697c0a1380 2023-10-03T10:16:29.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c0a0a70 0x7f697c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47178/0 (socket says 172.21.15.125:47178) 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f6980e5e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f697c133f50 0x7f697c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41966/0 (socket says 172.21.15.125:41966) 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c0a0a70 0x7f697c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51732/0 (socket says 172.21.15.125:51732) 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697b7fe700 1 -- 172.21.15.125:0/827775859 learned_addr learned my addr 172.21.15.125:0/827775859 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 -- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 msgr2=0x7f697c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 -- 172.21.15.125:0/827775859 >> v1:172.21.15.125:6789/0 conn(0x7f697c133f50 legacy=0x7f697c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 -- 172.21.15.125:0/827775859 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c09e6a0 con 0x7f697c0a0a70 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697affd700 1 -- 172.21.15.125:0/827775859 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44817368 0 0) 0x7f697c09dc00 con 0x7f697c133f50 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697b7fe700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.815+0000 7f697bfff700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c0a0a70 0x7f697c0a0e40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f696c009840 tx=0x7f696c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46783f52672ad43b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f697affd700 1 -- 172.21.15.125:0/827775859 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011830 con 0x7f697c0a0a70 2023-10-03T10:16:29.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f697affd700 1 -- 172.21.15.125:0/827775859 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c011990 con 0x7f697c0a0a70 2023-10-03T10:16:29.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f697affd700 1 -- 172.21.15.125:0/827775859 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011d20 con 0x7f697c0a0a70 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 -- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c0a0a70 msgr2=0x7f697c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c0a0a70 0x7f697c0a0e40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f696c009840 tx=0x7f696c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 -- 172.21.15.125:0/827775859 shutdown_connections 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c0a0a70 0x7f697c0a0e40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 --2- 172.21.15.125:0/827775859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a1380 0x7f697c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 -- 172.21.15.125:0/827775859 >> 172.21.15.125:0/827775859 conn(0x7f697c0a6610 msgr2=0x7f697c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 -- 172.21.15.125:0/827775859 shutdown_connections 2023-10-03T10:16:29.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.816+0000 7f69828c1700 1 -- 172.21.15.125:0/827775859 wait complete. 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.817+0000 7f69828c1700 1 Processor -- start 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.817+0000 7f69828c1700 1 -- start start 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c133f50 0x7f697c1233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c133aa0 con 0x7f697c133f50 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c124560 con 0x7f697c0a0a70 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f69828c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f697c124c90 con 0x7f697c0a1380 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47190/0 (socket says 172.21.15.125:47190) 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 -- 172.21.15.125:0/715771021 learned_addr learned my addr 172.21.15.125:0/715771021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:29.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51512/0 (socket says 172.21.15.125:51512) 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f6980e5e700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c133f50 0x7f697c1233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 -- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 msgr2=0x7f697c122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 -- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c133f50 msgr2=0x7f697c1233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c133f50 0x7f697c1233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 -- 172.21.15.125:0/715771021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009550 con 0x7f697c0a0a70 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697b7fe700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.818+0000 7f697bfff700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f696c009fd0 tx=0x7f696c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c004550 con 0x7f697c0a0a70 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c01f070 con 0x7f697c0a0a70 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c0094a0 con 0x7f697c0a0a70 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0038e0 con 0x7f697c0a0a70 2023-10-03T10:16:29.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c133360 con 0x7f697c0a0a70 2023-10-03T10:16:29.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.819+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f696c003a40 con 0x7f697c0a0a70 2023-10-03T10:16:29.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.820+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c04f2a0 con 0x7f697c0a0a70 2023-10-03T10:16:29.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.820+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f696c021070 con 0x7f697c0a0a70 2023-10-03T10:16:29.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.824+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f696c010380 con 0x7f697c0a0a70 2023-10-03T10:16:29.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 Processor -- start 2023-10-03T10:16:29.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 -- start start 2023-10-03T10:16:29.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f240a1380 0x7f9f24133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2409e9d0 con 0x7f9f240a1380 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2409dc00 con 0x7f9f24133f50 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.853+0000 7f9f29351700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2409dec0 con 0x7f9f240a0a70 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f240a1380 0x7f9f24133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f237fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51526/0 (socket says 172.21.15.125:51526) 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f240a1380 0x7f9f24133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51754/0 (socket says 172.21.15.125:51754) 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f237fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47194/0 (socket says 172.21.15.125:47194) 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f22ffd700 1 -- 172.21.15.125:0/1900817522 learned_addr learned my addr 172.21.15.125:0/1900817522 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 -- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 msgr2=0x7f9f240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 -- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 msgr2=0x7f9f24134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 -- 172.21.15.125:0/1900817522 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2409e6a0 con 0x7f9f240a1380 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f237fe700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f227fc700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a1380 0x7f9f24133a10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009840 tx=0x7f9f18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd24bf377a7b7bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f21ffb700 1 -- 172.21.15.125:0/1900817522 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18011830 con 0x7f9f240a1380 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f21ffb700 1 -- 172.21.15.125:0/1900817522 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18011990 con 0x7f9f240a1380 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.854+0000 7f9f21ffb700 1 -- 172.21.15.125:0/1900817522 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18011d20 con 0x7f9f240a1380 2023-10-03T10:16:29.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 -- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a1380 msgr2=0x7f9f24133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a1380 0x7f9f24133a10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009840 tx=0x7f9f18009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 -- 172.21.15.125:0/1900817522 shutdown_connections 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f24133f50 0x7f9f24134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f240a0a70 0x7f9f240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 --2- 172.21.15.125:0/1900817522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a1380 0x7f9f24133a10 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 -- 172.21.15.125:0/1900817522 >> 172.21.15.125:0/1900817522 conn(0x7f9f240a6610 msgr2=0x7f9f240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 -- 172.21.15.125:0/1900817522 shutdown_connections 2023-10-03T10:16:29.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.855+0000 7f9f29351700 1 -- 172.21.15.125:0/1900817522 wait complete. 2023-10-03T10:16:29.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 Processor -- start 2023-10-03T10:16:29.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 -- start start 2023-10-03T10:16:29.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 0x7f9f241223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 0x7f9f24122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 0x7f9f24122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24125200 con 0x7f9f240a0a70 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24123850 con 0x7f9f240a1380 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f29351700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24124130 con 0x7f9f24133f50 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f227fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 0x7f9f24122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 0x7f9f241223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f237fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 0x7f9f24122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f227fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 0x7f9f24122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47210/0 (socket says 172.21.15.125:47210) 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.856+0000 7f9f227fc700 1 -- 172.21.15.125:0/1740953890 learned_addr learned my addr 172.21.15.125:0/1740953890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 -- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 msgr2=0x7f9f24122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 0x7f9f24122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 -- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 msgr2=0x7f9f241223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 0x7f9f241223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 -- 172.21.15.125:0/1740953890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009550 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 0x7f9f241223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f237fe700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 0x7f9f24122e70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00efc0 tx=0x7f9f1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c009e60 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c00f040 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c009a70 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00cd60 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.857+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f180094a0 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.858+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f1c014480 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.858+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f1c03fc20 con 0x7f9f24133f50 2023-10-03T10:16:29.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.858+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24125650 con 0x7f9f24133f50 2023-10-03T10:16:29.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:29.863+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f1c012910 con 0x7f9f24133f50 2023-10-03T10:16:30.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.017+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f697c072980 con 0x7f697c0a0a70 2023-10-03T10:16:30.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.018+0000 7f6978ff9700 1 -- 172.21.15.125:0/715771021 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f696c02b030 con 0x7f697c0a0a70 2023-10-03T10:16:30.018 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:30.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.019+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 msgr2=0x7f697c122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.019+0000 7f69828c1700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f696c009fd0 tx=0x7f696c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:30.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 shutdown_connections 2023-10-03T10:16:30.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c133f50 0x7f697c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c0a0a70 0x7f697c122920 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 --2- 172.21.15.125:0/715771021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c0a1380 0x7f697c122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 >> 172.21.15.125:0/715771021 conn(0x7f697c0a6610 msgr2=0x7f697c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 shutdown_connections 2023-10-03T10:16:30.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.020+0000 7f69828c1700 1 -- 172.21.15.125:0/715771021 wait complete. 2023-10-03T10:16:30.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:30.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.056+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f2404f2a0 con 0x7f9f24133f50 2023-10-03T10:16:30.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.056+0000 7f9f0b7fe700 1 -- 172.21.15.125:0/1740953890 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f1c012340 con 0x7f9f24133f50 2023-10-03T10:16:30.057 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 msgr2=0x7f9f24122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 0x7f9f24122e70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00efc0 tx=0x7f9f1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 shutdown_connections 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24133f50 0x7f9f24122e70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f240a0a70 0x7f9f241223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 --2- 172.21.15.125:0/1740953890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f240a1380 0x7f9f24122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 >> 172.21.15.125:0/1740953890 conn(0x7f9f240a6610 msgr2=0x7f9f2409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.058+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 shutdown_connections 2023-10-03T10:16:30.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.059+0000 7f9f29351700 1 -- 172.21.15.125:0/1740953890 wait complete. 2023-10-03T10:16:30.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:30.101 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:30.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:30.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.240+0000 7f2f20d7f700 1 Processor -- start 2023-10-03T10:16:30.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.240+0000 7f2f20d7f700 1 -- start start 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f20d7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f20d7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 0x7f2f1c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f20d7f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c09aaa0 con 0x7f2f1c09e170 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f20d7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c09f870 con 0x7f2f1c09d860 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f20d7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c09b360 con 0x7f2f1c130eb0 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 0x7f2f1c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f19d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2f1c09e170 0x7f2f1c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41978/0 (socket says 172.21.15.125:41978) 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47214/0 (socket says 172.21.15.125:47214) 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f19d9b700 1 -- 172.21.15.125:0/644592115 learned_addr learned my addr 172.21.15.125:0/644592115 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1ad9d700 1 -- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 msgr2=0x7f2f1c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1959a700 1 -- 172.21.15.125:0/644592115 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405174296 0 0) 0x7f2f1c09aaa0 con 0x7f2f1c09e170 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1ad9d700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1ad9d700 1 -- 172.21.15.125:0/644592115 >> v1:172.21.15.125:6789/0 conn(0x7f2f1c09e170 legacy=0x7f2f1c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1ad9d700 1 -- 172.21.15.125:0/644592115 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c09b620 con 0x7f2f1c130eb0 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.241+0000 7f2f1a59c700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f1ad9d700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 0x7f2f1c138a00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009dc0 tx=0x7f2f1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5720060c9288659 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f1959a700 1 -- 172.21.15.125:0/644592115 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400bd20 con 0x7f2f1c130eb0 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f1959a700 1 -- 172.21.15.125:0/644592115 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400be80 con 0x7f2f1c130eb0 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f1959a700 1 -- 172.21.15.125:0/644592115 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140116a0 con 0x7f2f1c130eb0 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 -- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 msgr2=0x7f2f1c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 0x7f2f1c138a00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009dc0 tx=0x7f2f1400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 -- 172.21.15.125:0/644592115 shutdown_connections 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c130eb0 0x7f2f1c138a00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/644592115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 -- 172.21.15.125:0/644592115 >> 172.21.15.125:0/644592115 conn(0x7f2f1c099c40 msgr2=0x7f2f1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 -- 172.21.15.125:0/644592115 shutdown_connections 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.242+0000 7f2f20d7f700 1 -- 172.21.15.125:0/644592115 wait complete. 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.244+0000 7f2f20d7f700 1 Processor -- start 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.244+0000 7f2f20d7f700 1 -- start start 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.244+0000 7f2f20d7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c11e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.244+0000 7f2f20d7f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.244+0000 7f2f20d7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 0x7f2f1c11ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f20d7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1216a0 con 0x7f2f1c130eb0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f20d7f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c121fc0 con 0x7f2f1c09d860 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f20d7f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c130400 con 0x7f2f1c09e170 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f19d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c11e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f19d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51544/0 (socket says 172.21.15.125:51544) 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f19d9b700 1 -- 172.21.15.125:0/3092898727 learned_addr learned my addr 172.21.15.125:0/3092898727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1ad9d700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 0x7f2f1c11ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 -- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 msgr2=0x7f2f1c11e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 -- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 msgr2=0x7f2f1c11ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 0x7f2f1c11ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 -- 172.21.15.125:0/3092898727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0094a0 con 0x7f2f1c09d860 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f19d9b700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1ad9d700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 0x7f2f1c11ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f1a59c700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c11e4a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00e9b0 tx=0x7f2f0c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00ee50 con 0x7f2f1c09d860 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00c850 con 0x7f2f1c09d860 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00cc00 con 0x7f2f1c09d860 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f14009a70 con 0x7f2f1c09d860 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.245+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c09c8b0 con 0x7f2f1c09d860 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.246+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f0c013470 con 0x7f2f1c09d860 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.246+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f0c03fac0 con 0x7f2f1c09d860 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.246+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c04f2a0 con 0x7f2f1c09d860 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.251+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f0c013720 con 0x7f2f1c09d860 2023-10-03T10:16:30.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.280+0000 7fd425a4e700 1 Processor -- start 2023-10-03T10:16:30.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.280+0000 7fd425a4e700 1 -- start start 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.280+0000 7fd425a4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 0x7fd4200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.280+0000 7fd425a4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd42013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd425a4e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42009dc00 con 0x7fd4200a1380 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd425a4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42009ea90 con 0x7fd420134120 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd425a4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd42009dec0 con 0x7fd4200a0a70 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd4200a1380 0x7fd420133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41984/0 (socket says 172.21.15.125:41984) 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd42013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41e7fc700 1 -- 172.21.15.125:0/3371322409 learned_addr learned my addr 172.21.15.125:0/3371322409 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 0x7fd4200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41dffb700 1 -- 172.21.15.125:0/3371322409 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617388489 0 0) 0x7fd42009dc00 con 0x7fd4200a1380 2023-10-03T10:16:30.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 -- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 msgr2=0x7fd42013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd42013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 -- 172.21.15.125:0/3371322409 >> v1:172.21.15.125:6789/0 conn(0x7fd4200a1380 legacy=0x7fd420133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 -- 172.21.15.125:0/3371322409 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42009e6a0 con 0x7fd4200a0a70 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41f7fe700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd42013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41effd700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 0x7fd4200a0e40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd410009870 tx=0x7fd410009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a251ac9636ef590c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41dffb700 1 -- 172.21.15.125:0/3371322409 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410011830 con 0x7fd4200a0a70 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41dffb700 1 -- 172.21.15.125:0/3371322409 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410011990 con 0x7fd4200a0a70 2023-10-03T10:16:30.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.281+0000 7fd41dffb700 1 -- 172.21.15.125:0/3371322409 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410011d20 con 0x7fd4200a0a70 2023-10-03T10:16:30.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 -- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 msgr2=0x7fd4200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 0x7fd4200a0e40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd410009870 tx=0x7fd410009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 -- 172.21.15.125:0/3371322409 shutdown_connections 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd42013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 --2- 172.21.15.125:0/3371322409 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a0a70 0x7fd4200a0e40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 -- 172.21.15.125:0/3371322409 >> 172.21.15.125:0/3371322409 conn(0x7fd4200a6610 msgr2=0x7fd4200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 -- 172.21.15.125:0/3371322409 shutdown_connections 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.282+0000 7fd425a4e700 1 -- 172.21.15.125:0/3371322409 wait complete. 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.283+0000 7fd425a4e700 1 Processor -- start 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.283+0000 7fd425a4e700 1 -- start start 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.283+0000 7fd425a4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 0x7fd420122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.283+0000 7fd425a4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 0x7fd420122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd420123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420125920 con 0x7fd4200a0a70 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd420124310 con 0x7fd420134120 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201332d0 con 0x7fd4200a1380 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 0x7fd420122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 0x7fd420122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 0x7fd420122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51780/0 (socket says 172.21.15.125:51780) 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41effd700 1 -- 172.21.15.125:0/4265107477 learned_addr learned my addr 172.21.15.125:0/4265107477 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41f7fe700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd420123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 -- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 msgr2=0x7fd420123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd420123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 -- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 msgr2=0x7fd420122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 0x7fd420122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 -- 172.21.15.125:0/4265107477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009a70 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd41e7fc700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 0x7fd420122c40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c470 tx=0x7fd41400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414004a70 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414004bd0 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4100094a0 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140070d0 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.284+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4200a03e0 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.285+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd414007230 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.285+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42004f2a0 con 0x7fd4200a1380 2023-10-03T10:16:30.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.285+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd41403f120 con 0x7fd4200a1380 2023-10-03T10:16:30.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.294+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd41401bda0 con 0x7fd4200a1380 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.449+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f1c06c3b0 con 0x7f2f1c09d860 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.450+0000 7f2f0affd700 1 -- 172.21.15.125:0/3092898727 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f0c021020 con 0x7f2f1c09d860 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:30.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 msgr2=0x7f2f1c11e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c11e4a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00e9b0 tx=0x7f2f0c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 shutdown_connections 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f1c130eb0 0x7f2f1c11ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1c09d860 0x7f2f1c11e4a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 --2- 172.21.15.125:0/3092898727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1c09e170 0x7f2f1c11e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 >> 172.21.15.125:0/3092898727 conn(0x7f2f1c099c40 msgr2=0x7f2f1c070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 shutdown_connections 2023-10-03T10:16:30.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.452+0000 7f2f20d7f700 1 -- 172.21.15.125:0/3092898727 wait complete. 2023-10-03T10:16:30.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:30.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.493+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd420072980 con 0x7fd4200a1380 2023-10-03T10:16:30.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.493+0000 7fd407fff700 1 -- 172.21.15.125:0/4265107477 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd41401b340 con 0x7fd4200a1380 2023-10-03T10:16:30.494 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 msgr2=0x7fd420122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 0x7fd420122c40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c470 tx=0x7fd41400c780 comp rx=0 tx=0).stop 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 shutdown_connections 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd420134120 0x7fd420123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4200a0a70 0x7fd420122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 --2- 172.21.15.125:0/4265107477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd4200a1380 0x7fd420122c40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 >> 172.21.15.125:0/4265107477 conn(0x7fd4200a6610 msgr2=0x7fd42009aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 shutdown_connections 2023-10-03T10:16:30.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:30.495+0000 7fd425a4e700 1 -- 172.21.15.125:0/4265107477 wait complete. 2023-10-03T10:16:30.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:31.033 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:31.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:31.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.161+0000 7f7d8913d700 1 Processor -- start 2023-10-03T10:16:31.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.161+0000 7f7d8913d700 1 -- start start 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8913d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 0x7f7d841359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8913d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 0x7f7d84138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8913d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8409aaa0 con 0x7f7d8409d860 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8913d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8409e730 con 0x7f7d84135f20 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8913d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8409f870 con 0x7f7d8409e340 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 0x7f7d84138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d82d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7d8409d860 0x7f7d8409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41996/0 (socket says 172.21.15.125:41996) 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d82d9d700 1 -- 172.21.15.125:0/1438320195 learned_addr learned my addr 172.21.15.125:0/1438320195 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.162+0000 7f7d8259c700 1 --2- 172.21.15.125:0/1438320195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 0x7f7d841359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8259c700 1 -- 172.21.15.125:0/1438320195 >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 msgr2=0x7f7d84138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8259c700 1 --2- 172.21.15.125:0/1438320195 >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 0x7f7d84138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8259c700 1 -- 172.21.15.125:0/1438320195 >> v1:172.21.15.125:6789/0 conn(0x7f7d8409d860 legacy=0x7f7d8409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8259c700 1 -- 172.21.15.125:0/1438320195 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8409b360 con 0x7f7d8409e340 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8359e700 1 --2- 172.21.15.125:0/1438320195 >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 0x7f7d84138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8259c700 1 --2- 172.21.15.125:0/1438320195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 0x7f7d841359e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009840 tx=0x7f7d78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6e1e0aef36bf42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d81d9b700 1 -- 172.21.15.125:0/1438320195 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78011830 con 0x7f7d8409e340 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d81d9b700 1 -- 172.21.15.125:0/1438320195 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78011990 con 0x7f7d8409e340 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d81d9b700 1 -- 172.21.15.125:0/1438320195 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78011d20 con 0x7f7d8409e340 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 -- 172.21.15.125:0/1438320195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 msgr2=0x7f7d841359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 --2- 172.21.15.125:0/1438320195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 0x7f7d841359e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009840 tx=0x7f7d78009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 -- 172.21.15.125:0/1438320195 shutdown_connections 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 --2- 172.21.15.125:0/1438320195 >> v2:172.21.15.125:3300/0 conn(0x7f7d84135f20 0x7f7d84138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 --2- 172.21.15.125:0/1438320195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409e340 0x7f7d841359e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.163+0000 7f7d8913d700 1 -- 172.21.15.125:0/1438320195 >> 172.21.15.125:0/1438320195 conn(0x7f7d84099c40 msgr2=0x7f7d840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.164+0000 7f7d8913d700 1 -- 172.21.15.125:0/1438320195 shutdown_connections 2023-10-03T10:16:31.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.164+0000 7f7d8913d700 1 -- 172.21.15.125:0/1438320195 wait complete. 2023-10-03T10:16:31.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 Processor -- start 2023-10-03T10:16:31.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 -- start start 2023-10-03T10:16:31.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 0x7f7d841c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 0x7f7d841c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840a2230 con 0x7f7d84135f20 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84122da0 con 0x7f7d8409d860 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8913d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841220a0 con 0x7f7d8409e340 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d82d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 0x7f7d841c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51796/0 (socket says 172.21.15.125:51796) 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8359e700 1 -- 172.21.15.125:0/3879525417 learned_addr learned my addr 172.21.15.125:0/3879525417 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.165+0000 7f7d8259c700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 0x7f7d841c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 -- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 msgr2=0x7f7d841c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 0x7f7d841c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 -- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 msgr2=0x7f7d841c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 0x7f7d841c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 -- 172.21.15.125:0/3879525417 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009a70 con 0x7f7d84135f20 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8259c700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 0x7f7d841c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d82d9d700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 0x7f7d841c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8359e700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00efc0 tx=0x7f7d7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ca90 con 0x7f7d84135f20 2023-10-03T10:16:31.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00f040 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780094a0 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ce10 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.166+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d84070540 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.167+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d7c014480 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.167+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d7c03fcc0 con 0x7f7d84135f20 2023-10-03T10:16:31.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.167+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8404f2a0 con 0x7f7d84135f20 2023-10-03T10:16:31.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.175+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d7c012930 con 0x7f7d84135f20 2023-10-03T10:16:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.206+0000 7f20b4a15700 1 Processor -- start 2023-10-03T10:16:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.206+0000 7f20b4a15700 1 -- start start 2023-10-03T10:16:31.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20b4a15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 0x7f20b0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20b4a15700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 0x7f20b013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20b4a15700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b009e9d0 con 0x7f20b00a0a70 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20b4a15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b009dc00 con 0x7f20b00a1550 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20b4a15700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b009dec0 con 0x7f20b0139200 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 0x7f20b013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20ae59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f20b00a0a70 0x7f20b00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42000/0 (socket says 172.21.15.125:42000) 2023-10-03T10:16:31.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20ae59c700 1 -- 172.21.15.125:0/1203841803 learned_addr learned my addr 172.21.15.125:0/1203841803 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20add9b700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 0x7f20b0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20ad59a700 1 -- 172.21.15.125:0/1203841803 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663658274 0 0) 0x7f20b009e9d0 con 0x7f20b00a0a70 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 -- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 msgr2=0x7f20b0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 0x7f20b0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 -- 172.21.15.125:0/1203841803 >> v1:172.21.15.125:6789/0 conn(0x7f20b00a0a70 legacy=0x7f20b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 -- 172.21.15.125:0/1203841803 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b009e6a0 con 0x7f20b0139200 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20add9b700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 0x7f20b0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.207+0000 7f20aed9d700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 0x7f20b013b5e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009dc0 tx=0x7f20a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f8d45fba9f466 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20ad59a700 1 -- 172.21.15.125:0/1203841803 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800e070 con 0x7f20b0139200 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20ad59a700 1 -- 172.21.15.125:0/1203841803 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800bb20 con 0x7f20b0139200 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20ad59a700 1 -- 172.21.15.125:0/1203841803 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8012430 con 0x7f20b0139200 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 -- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 msgr2=0x7f20b013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 0x7f20b013b5e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009dc0 tx=0x7f20a800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 -- 172.21.15.125:0/1203841803 shutdown_connections 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b0139200 0x7f20b013b5e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 --2- 172.21.15.125:0/1203841803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a1550 0x7f20b0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 -- 172.21.15.125:0/1203841803 >> 172.21.15.125:0/1203841803 conn(0x7f20b00a6610 msgr2=0x7f20b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 -- 172.21.15.125:0/1203841803 shutdown_connections 2023-10-03T10:16:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.208+0000 7f20b4a15700 1 -- 172.21.15.125:0/1203841803 wait complete. 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.209+0000 7f20b4a15700 1 Processor -- start 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.209+0000 7f20b4a15700 1 -- start start 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a0a70 0x7f20b011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 0x7f20b011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0122080 con 0x7f20b0139200 2023-10-03T10:16:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0120560 con 0x7f20b00a0a70 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b009d340 con 0x7f20b00a1550 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20add9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 0x7f20b011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51812/0 (socket says 172.21.15.125:51812) 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 -- 172.21.15.125:0/4115553790 learned_addr learned my addr 172.21.15.125:0/4115553790 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20ae59c700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a0a70 0x7f20b011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 -- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 msgr2=0x7f20b011ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 0x7f20b011ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 -- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a0a70 msgr2=0x7f20b011e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a0a70 0x7f20b011e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 -- 172.21.15.125:0/4115553790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40094a0 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20add9b700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 0x7f20b011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20aed9d700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f20a8014040 tx=0x7f20a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8004880 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8020070 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a8009a70 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a80276c0 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.210+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b0134730 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.211+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20a8012430 con 0x7f20b0139200 2023-10-03T10:16:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.211+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20a8022070 con 0x7f20b0139200 2023-10-03T10:16:31.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.212+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0122bb0 con 0x7f20b0139200 2023-10-03T10:16:31.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.216+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20a802c080 con 0x7f20b0139200 2023-10-03T10:16:31.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.378+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d8406c3b0 con 0x7f7d84135f20 2023-10-03T10:16:31.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.379+0000 7f7d6b7fe700 1 -- 172.21.15.125:0/3879525417 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d7c02a090 con 0x7f7d84135f20 2023-10-03T10:16:31.379 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:31.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.380+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 msgr2=0x7f7d841c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.380+0000 7f7d8913d700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00efc0 tx=0x7f7d7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 shutdown_connections 2023-10-03T10:16:31.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d84135f20 0x7f7d841c8c30 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8409d860 0x7f7d841c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 --2- 172.21.15.125:0/3879525417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8409e340 0x7f7d841c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 >> 172.21.15.125:0/3879525417 conn(0x7f7d84099c40 msgr2=0x7f7d8406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 shutdown_connections 2023-10-03T10:16:31.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.381+0000 7f7d8913d700 1 -- 172.21.15.125:0/3879525417 wait complete. 2023-10-03T10:16:31.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:31.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.417+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20b004f2a0 con 0x7f20b0139200 2023-10-03T10:16:31.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.417+0000 7f209effd700 1 -- 172.21.15.125:0/4115553790 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20a8036090 con 0x7f20b0139200 2023-10-03T10:16:31.418 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 msgr2=0x7f20b011f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f20a8014040 tx=0x7f20a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 shutdown_connections 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b0139200 0x7f20b011f220 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00a0a70 0x7f20b011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 --2- 172.21.15.125:0/4115553790 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20b00a1550 0x7f20b011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 >> 172.21.15.125:0/4115553790 conn(0x7f20b00a6610 msgr2=0x7f20b00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 shutdown_connections 2023-10-03T10:16:31.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.419+0000 7f20b4a15700 1 -- 172.21.15.125:0/4115553790 wait complete. 2023-10-03T10:16:31.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:31.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:31.508 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.597+0000 7fe7c4a4a700 1 Processor -- start 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.597+0000 7fe7c4a4a700 1 -- start start 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7c009ad40 0x7fe7c0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00a3b60 con 0x7fe7c009ad40 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01348e0 con 0x7fe7c00a0a70 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7c4a4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c009b110 con 0x7fe7c0133f70 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7c009ad40 0x7fe7c0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bdd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7c009ad40 0x7fe7c0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51822/0 (socket says 172.21.15.125:51822) 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47304/0 (socket says 172.21.15.125:47304) 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bdd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51606/0 (socket says 172.21.15.125:51606) 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 -- 172.21.15.125:0/1005950312 learned_addr learned my addr 172.21.15.125:0/1005950312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 -- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 msgr2=0x7fe7c01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 -- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 msgr2=0x7fe7c00a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 -- 172.21.15.125:0/1005950312 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00a2fa0 con 0x7fe7c009ad40 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bdd9b700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bed9d700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7be59c700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c009ad40 0x7fe7c0133a30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009920 tx=0x7fe7b0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6289510cc053fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.598+0000 7fe7bd59a700 1 -- 172.21.15.125:0/1005950312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0011830 con 0x7fe7c009ad40 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7bd59a700 1 -- 172.21.15.125:0/1005950312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0011990 con 0x7fe7c009ad40 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7bd59a700 1 -- 172.21.15.125:0/1005950312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0011d20 con 0x7fe7c009ad40 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c009ad40 msgr2=0x7fe7c0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c009ad40 0x7fe7c0133a30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009920 tx=0x7fe7b0009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/1005950312 shutdown_connections 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c00a0a70 0x7fe7c00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c009ad40 0x7fe7c0133a30 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/1005950312 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/1005950312 >> 172.21.15.125:0/1005950312 conn(0x7fe7c0099c40 msgr2=0x7fe7c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/1005950312 shutdown_connections 2023-10-03T10:16:31.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.599+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/1005950312 wait complete. 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.600+0000 7fe7c4a4a700 1 Processor -- start 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.600+0000 7fe7c4a4a700 1 -- start start 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c00a0a70 0x7fe7c01219b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c0121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0123f00 con 0x7fe7c00a0a70 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0124cd0 con 0x7fe7c009ad40 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7c4a4a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01327c0 con 0x7fe7c0133f70 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c0121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47318/0 (socket says 172.21.15.125:47318) 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7be59c700 1 -- 172.21.15.125:0/2886514891 learned_addr learned my addr 172.21.15.125:0/2886514891 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bdd9b700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c00a0a70 0x7fe7c01219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 -- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 msgr2=0x7fe7c0121470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 -- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c00a0a70 msgr2=0x7fe7c01219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c00a0a70 0x7fe7c01219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 -- 172.21.15.125:0/2886514891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8009a70 con 0x7fe7c0133f70 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7be59c700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7bed9d700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c0121ef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800ef00 tx=0x7fe7b800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.601+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8010040 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.602+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800ba80 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.602+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40094a0 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.602+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800be10 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.602+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b0009550 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.602+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c011e060 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.603+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7b8003a20 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.603+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7b8040350 con 0x7fe7c0133f70 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.607+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7b8008390 con 0x7fe7c0133f70 2023-10-03T10:16:31.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 Processor -- start 2023-10-03T10:16:31.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 -- start start 2023-10-03T10:16:31.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc09b110 con 0x7f6cbc133f70 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc0a3b60 con 0x7f6cbc1343a0 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.640+0000 7f6cc30bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0a2fa0 con 0x7f6cbc09ad40 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc1658700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc1658700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51842/0 (socket says 172.21.15.125:51842) 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47322/0 (socket says 172.21.15.125:47322) 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cbbfff700 1 --1- 172.21.15.125:0/2606678295 >> v1:172.21.15.125:6789/0 conn(0x7f6cbc133f70 0x7f6cbc0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42012/0 (socket says 172.21.15.125:42012) 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc1658700 1 -- 172.21.15.125:0/2606678295 learned_addr learned my addr 172.21.15.125:0/2606678295 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 -- 172.21.15.125:0/2606678295 >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 msgr2=0x7f6cbc0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 --2- 172.21.15.125:0/2606678295 >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 -- 172.21.15.125:0/2606678295 >> v1:172.21.15.125:6789/0 conn(0x7f6cbc133f70 legacy=0x7f6cbc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 -- 172.21.15.125:0/2606678295 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc09a280 con 0x7f6cbc09ad40 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cbb7fe700 1 -- 172.21.15.125:0/2606678295 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248917514 0 0) 0x7f6cbc09b110 con 0x7f6cbc133f70 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc1658700 1 --2- 172.21.15.125:0/2606678295 >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cc0e57700 1 --2- 172.21.15.125:0/2606678295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009870 tx=0x7f6cb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ad85ed85b2ff14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cbb7fe700 1 -- 172.21.15.125:0/2606678295 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011830 con 0x7f6cbc09ad40 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cbb7fe700 1 -- 172.21.15.125:0/2606678295 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0011990 con 0x7f6cbc09ad40 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.641+0000 7f6cbb7fe700 1 -- 172.21.15.125:0/2606678295 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011d20 con 0x7f6cbc09ad40 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 -- 172.21.15.125:0/2606678295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 msgr2=0x7f6cbc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/2606678295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009870 tx=0x7f6cb0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 -- 172.21.15.125:0/2606678295 shutdown_connections 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/2606678295 >> v2:172.21.15.125:3300/0 conn(0x7f6cbc1343a0 0x7f6cbc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/2606678295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc09ad40 0x7f6cbc133a30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 -- 172.21.15.125:0/2606678295 >> 172.21.15.125:0/2606678295 conn(0x7f6cbc099c40 msgr2=0x7f6cbc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 -- 172.21.15.125:0/2606678295 shutdown_connections 2023-10-03T10:16:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.642+0000 7f6cc30bb700 1 -- 172.21.15.125:0/2606678295 wait complete. 2023-10-03T10:16:31.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 Processor -- start 2023-10-03T10:16:31.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 -- start start 2023-10-03T10:16:31.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 0x7f6cbc11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc1343a0 0x7f6cbc11ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1216d0 con 0x7f6cbc09ad40 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc09c7e0 con 0x7f6cbc1343a0 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc30bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc11fff0 con 0x7f6cbc133f70 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc0e57700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 0x7f6cbc11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cbbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc0e57700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 0x7f6cbc11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51846/0 (socket says 172.21.15.125:51846) 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc0e57700 1 -- 172.21.15.125:0/3999880962 learned_addr learned my addr 172.21.15.125:0/3999880962 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:31.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cc1658700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc1343a0 0x7f6cbc11ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.643+0000 7f6cbbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51614/0 (socket says 172.21.15.125:51614) 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 -- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc1343a0 msgr2=0x7f6cbc11ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc1343a0 0x7f6cbc11ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 -- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 msgr2=0x7f6cbc11e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 0x7f6cbc11e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 -- 172.21.15.125:0/3999880962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4009b30 con 0x7f6cbc133f70 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cbbfff700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800c470 tx=0x7f6ca800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004c80 con 0x7f6cbc133f70 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8004de0 con 0x7f6cbc133f70 2023-10-03T10:16:31.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb00094a0 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8007310 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.644+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc121e60 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.645+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ca8007470 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.645+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ca803f220 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.645+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc04f2a0 con 0x7f6cbc133f70 2023-10-03T10:16:31.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.650+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ca800ce40 con 0x7f6cbc133f70 2023-10-03T10:16:31.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.801+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7c0124250 con 0x7fe7c0133f70 2023-10-03T10:16:31.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.802+0000 7fe7aeffd700 1 -- 172.21.15.125:0/2886514891 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7b8014e60 con 0x7fe7c0133f70 2023-10-03T10:16:31.803 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:31.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 msgr2=0x7fe7c0121ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c0121ef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800ef00 tx=0x7fe7b800b390 comp rx=0 tx=0).stop 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 shutdown_connections 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe7c0133f70 0x7fe7c0121ef0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7c009ad40 0x7fe7c0121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 --2- 172.21.15.125:0/2886514891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7c00a0a70 0x7fe7c01219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 >> 172.21.15.125:0/2886514891 conn(0x7fe7c0099c40 msgr2=0x7fe7c01332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 shutdown_connections 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.804+0000 7fe7c4a4a700 1 -- 172.21.15.125:0/2886514891 wait complete. 2023-10-03T10:16:31.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:31.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.843+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6cbc133d50 con 0x7f6cbc133f70 2023-10-03T10:16:31.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.843+0000 7f6cb97fa700 1 -- 172.21.15.125:0/3999880962 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ca801b7b0 con 0x7f6cbc133f70 2023-10-03T10:16:31.843 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 msgr2=0x7f6cbc11e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800c470 tx=0x7f6ca800c780 comp rx=0 tx=0).stop 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 shutdown_connections 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cbc1343a0 0x7f6cbc11ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cbc09ad40 0x7f6cbc11e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 --2- 172.21.15.125:0/3999880962 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6cbc133f70 0x7f6cbc11e950 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 >> 172.21.15.125:0/3999880962 conn(0x7f6cbc099c40 msgr2=0x7f6cbc09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 shutdown_connections 2023-10-03T10:16:31.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:31.845+0000 7f6cc30bb700 1 -- 172.21.15.125:0/3999880962 wait complete. 2023-10-03T10:16:31.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:32.394 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:32.432 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:32.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.523+0000 7fbee9de0700 1 Processor -- start 2023-10-03T10:16:32.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.523+0000 7fbee9de0700 1 -- start start 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee9de0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee9de0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbee4134120 0x7fbee413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee9de0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee409dc00 con 0x7fbee40a1380 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee9de0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee409ea60 con 0x7fbee4134120 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee9de0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbee409dec0 con 0x7fbee40a0a70 2023-10-03T10:16:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbee4134120 0x7fbee413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51624/0 (socket says 172.21.15.125:51624) 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee37fe700 1 -- 172.21.15.125:0/613615609 learned_addr learned my addr 172.21.15.125:0/613615609 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee3fff700 1 -- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 msgr2=0x7fbee40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee3fff700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee3fff700 1 -- 172.21.15.125:0/613615609 >> v1:172.21.15.125:6789/0 conn(0x7fbee40a1380 legacy=0x7fbee4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee3fff700 1 -- 172.21.15.125:0/613615609 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee409e6a0 con 0x7fbee4134120 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.524+0000 7fbee2ffd700 1 -- 172.21.15.125:0/613615609 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214904415 0 0) 0x7fbee409dc00 con 0x7fbee40a1380 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee37fe700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee3fff700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee4134120 0x7fbee413bce0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009d90 tx=0x7fbedc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5a84d650253ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee2ffd700 1 -- 172.21.15.125:0/613615609 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00e070 con 0x7fbee4134120 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee2ffd700 1 -- 172.21.15.125:0/613615609 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00bb20 con 0x7fbee4134120 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee2ffd700 1 -- 172.21.15.125:0/613615609 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc012430 con 0x7fbee4134120 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 -- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee4134120 msgr2=0x7fbee413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee4134120 0x7fbee413bce0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009d90 tx=0x7fbedc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 -- 172.21.15.125:0/613615609 shutdown_connections 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee4134120 0x7fbee413bce0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 --2- 172.21.15.125:0/613615609 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee40a0a70 0x7fbee40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.525+0000 7fbee9de0700 1 -- 172.21.15.125:0/613615609 >> 172.21.15.125:0/613615609 conn(0x7fbee40a6610 msgr2=0x7fbee40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.526+0000 7fbee9de0700 1 -- 172.21.15.125:0/613615609 shutdown_connections 2023-10-03T10:16:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.526+0000 7fbee9de0700 1 -- 172.21.15.125:0/613615609 wait complete. 2023-10-03T10:16:32.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.526+0000 7fbee9de0700 1 Processor -- start 2023-10-03T10:16:32.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 -- start start 2023-10-03T10:16:32.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 0x7fbee4122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 0x7fbee41231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41332b0 con 0x7fbee40a1380 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41258b0 con 0x7fbee40a0a70 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee9de0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41242c0 con 0x7fbee4134120 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbedaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 0x7fbee4122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47346/0 (socket says 172.21.15.125:47346) 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 0x7fbee41231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbee37fe700 1 -- 172.21.15.125:0/3073340923 learned_addr learned my addr 172.21.15.125:0/3073340923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.527+0000 7fbedaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 0x7fbee4122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51876/0 (socket says 172.21.15.125:51876) 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 -- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 msgr2=0x7fbee4122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 -- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 msgr2=0x7fbee4122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 0x7fbee4122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 -- 172.21.15.125:0/3073340923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009550 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee37fe700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee3fff700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 0x7fbee41231d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbedc016000 tx=0x7fbedc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc012430 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc020070 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc009a70 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc004280 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.528+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee4125c30 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.529+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbedc0043e0 con 0x7fbee4134120 2023-10-03T10:16:32.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.529+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbedc022070 con 0x7fbee4134120 2023-10-03T10:16:32.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.529+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee404f2a0 con 0x7fbee4134120 2023-10-03T10:16:32.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.534+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbedc0269d0 con 0x7fbee4134120 2023-10-03T10:16:32.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.564+0000 7f8321f7e700 1 Processor -- start 2023-10-03T10:16:32.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.564+0000 7f8321f7e700 1 -- start start 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f8321f7e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f8321f7e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f831c139200 0x7f831c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f8321f7e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c09e9d0 con 0x7f831c0a0a70 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f8321f7e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c09dc00 con 0x7f831c139200 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f8321f7e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c09dec0 con 0x7f831c0a1550 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f831c139200 0x7f831c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f831c0a0a70 0x7f831c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42038/0 (socket says 172.21.15.125:42038) 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831b7fe700 1 -- 172.21.15.125:0/3492132335 learned_addr learned my addr 172.21.15.125:0/3492132335 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831bfff700 1 -- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 msgr2=0x7f831c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831bfff700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831bfff700 1 -- 172.21.15.125:0/3492132335 >> v1:172.21.15.125:6789/0 conn(0x7f831c0a0a70 legacy=0x7f831c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831bfff700 1 -- 172.21.15.125:0/3492132335 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c09e6a0 con 0x7f831c139200 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831a7fc700 1 -- 172.21.15.125:0/3492132335 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267591796 0 0) 0x7f831c09e9d0 con 0x7f831c0a0a70 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.565+0000 7f831affd700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f831bfff700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c139200 0x7f831c13b5e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d90 tx=0x7f831400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74dac973bc93a1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f831a7fc700 1 -- 172.21.15.125:0/3492132335 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400e070 con 0x7f831c139200 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f831a7fc700 1 -- 172.21.15.125:0/3492132335 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400bb20 con 0x7f831c139200 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f831a7fc700 1 -- 172.21.15.125:0/3492132335 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314012430 con 0x7f831c139200 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 -- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c139200 msgr2=0x7f831c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c139200 0x7f831c13b5e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d90 tx=0x7f831400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 -- 172.21.15.125:0/3492132335 shutdown_connections 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c139200 0x7f831c13b5e0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 --2- 172.21.15.125:0/3492132335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 -- 172.21.15.125:0/3492132335 >> 172.21.15.125:0/3492132335 conn(0x7f831c0a6610 msgr2=0x7f831c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 -- 172.21.15.125:0/3492132335 shutdown_connections 2023-10-03T10:16:32.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.566+0000 7f8321f7e700 1 -- 172.21.15.125:0/3492132335 wait complete. 2023-10-03T10:16:32.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.567+0000 7f8321f7e700 1 Processor -- start 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.567+0000 7f8321f7e700 1 -- start start 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 0x7f831c1221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c125280 con 0x7f831c0a0a70 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c123990 con 0x7f831c139200 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f8321f7e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0a03e0 con 0x7f831c0a1550 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51900/0 (socket says 172.21.15.125:51900) 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 -- 172.21.15.125:0/4012686465 learned_addr learned my addr 172.21.15.125:0/4012686465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831bfff700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 0x7f831c1221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831affd700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 -- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 msgr2=0x7f831c121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 -- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 msgr2=0x7f831c1221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 0x7f831c1221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 -- 172.21.15.125:0/4012686465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094a0 con 0x7f831c0a0a70 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831bfff700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 0x7f831c1221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.568+0000 7f831b7fe700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f830c00c550 tx=0x7f830c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c004c80 con 0x7f831c0a0a70 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c004e00 con 0x7f831c0a0a70 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c007310 con 0x7f831c0a0a70 2023-10-03T10:16:32.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314009a70 con 0x7f831c0a0a70 2023-10-03T10:16:32.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c124ce0 con 0x7f831c0a0a70 2023-10-03T10:16:32.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.569+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f830c007470 con 0x7f831c0a0a70 2023-10-03T10:16:32.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.570+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f830c03f370 con 0x7f831c0a0a70 2023-10-03T10:16:32.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.570+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c123bc0 con 0x7f831c0a0a70 2023-10-03T10:16:32.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.574+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f830c0123b0 con 0x7f831c0a0a70 2023-10-03T10:16:32.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.726+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbee4072980 con 0x7fbee4134120 2023-10-03T10:16:32.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.727+0000 7fbee0ff9700 1 -- 172.21.15.125:0/3073340923 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbedc0263e0 con 0x7fbee4134120 2023-10-03T10:16:32.727 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:32.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 msgr2=0x7fbee41231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 0x7fbee41231d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbedc016000 tx=0x7fbedc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 shutdown_connections 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbee4134120 0x7fbee41231d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbee40a0a70 0x7fbee4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 --2- 172.21.15.125:0/3073340923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee40a1380 0x7fbee4122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 >> 172.21.15.125:0/3073340923 conn(0x7fbee40a6610 msgr2=0x7fbee411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 shutdown_connections 2023-10-03T10:16:32.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.729+0000 7fbee9de0700 1 -- 172.21.15.125:0/3073340923 wait complete. 2023-10-03T10:16:32.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.764+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f831c04f2a0 con 0x7f831c0a0a70 2023-10-03T10:16:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.764+0000 7f8303fff700 1 -- 172.21.15.125:0/4012686465 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f830c011360 con 0x7f831c0a0a70 2023-10-03T10:16:32.765 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 msgr2=0x7f831c121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f830c00c550 tx=0x7f830c00c860 comp rx=0 tx=0).stop 2023-10-03T10:16:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 shutdown_connections 2023-10-03T10:16:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c139200 0x7f831c1221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c0a0a70 0x7f831c121760 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 --2- 172.21.15.125:0/4012686465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f831c0a1550 0x7f831c121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.766+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 >> 172.21.15.125:0/4012686465 conn(0x7f831c0a6610 msgr2=0x7f831c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.767+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 shutdown_connections 2023-10-03T10:16:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.767+0000 7f8321f7e700 1 -- 172.21.15.125:0/4012686465 wait complete. 2023-10-03T10:16:32.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:32.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:32.858 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:32.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.944+0000 7f60849e1700 1 Processor -- start 2023-10-03T10:16:32.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.944+0000 7f60849e1700 1 -- start start 2023-10-03T10:16:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f60849e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 0x7f60800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f60849e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f60849e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608009dc00 con 0x7f6080133f50 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f60849e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608009ea60 con 0x7f60800a1380 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f60849e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608009dec0 con 0x7f60800a0a70 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 0x7f60800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:47366/0 (socket says 172.21.15.125:47366) 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607dd9b700 1 -- 172.21.15.125:0/1632679327 learned_addr learned my addr 172.21.15.125:0/1632679327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6080133f50 0x7f608013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42044/0 (socket says 172.21.15.125:42044) 2023-10-03T10:16:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 -- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 msgr2=0x7f6080133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 -- 172.21.15.125:0/1632679327 >> v1:172.21.15.125:6789/0 conn(0x7f6080133f50 legacy=0x7f608013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607d59a700 1 -- 172.21.15.125:0/1632679327 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818747616 0 0) 0x7f608009dc00 con 0x7f6080133f50 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 -- 172.21.15.125:0/1632679327 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608009e6a0 con 0x7f60800a0a70 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607dd9b700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607e59c700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 0x7f60800a0e40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f6070009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa6873bc556ebcfb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.945+0000 7f607d59a700 1 -- 172.21.15.125:0/1632679327 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070011830 con 0x7f60800a0a70 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f607d59a700 1 -- 172.21.15.125:0/1632679327 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070011990 con 0x7f60800a0a70 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f607d59a700 1 -- 172.21.15.125:0/1632679327 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070011d20 con 0x7f60800a0a70 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 -- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 msgr2=0x7f60800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 0x7f60800a0e40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f6070009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:32.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 -- 172.21.15.125:0/1632679327 shutdown_connections 2023-10-03T10:16:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60800a0a70 0x7f60800a0e40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 --2- 172.21.15.125:0/1632679327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a1380 0x7f6080133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 -- 172.21.15.125:0/1632679327 >> 172.21.15.125:0/1632679327 conn(0x7f60800a6610 msgr2=0x7f60800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 -- 172.21.15.125:0/1632679327 shutdown_connections 2023-10-03T10:16:32.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.946+0000 7f60849e1700 1 -- 172.21.15.125:0/1632679327 wait complete. 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.947+0000 7f60849e1700 1 Processor -- start 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.947+0000 7f60849e1700 1 -- start start 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 0x7f6080122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6080133f50 0x7f60801232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60801260b0 con 0x7f60800a1380 2023-10-03T10:16:32.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6080123cd0 con 0x7f60800a0a70 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f60849e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6080133970 con 0x7f6080133f50 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 0x7f6080122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51910/0 (socket says 172.21.15.125:51910) 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607dd9b700 1 -- 172.21.15.125:0/2926916688 learned_addr learned my addr 172.21.15.125:0/2926916688 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607ed9d700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6080133f50 0x7f60801232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 -- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6080133f50 msgr2=0x7f60801232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6080133f50 0x7f60801232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 -- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 msgr2=0x7f6080122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 -- 172.21.15.125:0/2926916688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074009550 con 0x7f60800a0a70 2023-10-03T10:16:32.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607dd9b700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.948+0000 7f607e59c700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 0x7f6080122870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f608009e5c0 tx=0x7f6070004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070004510 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607001f070 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60700094a0 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700038e0 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6080133300 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6070003a40 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.949+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6070021070 con 0x7f60800a0a70 2023-10-03T10:16:32.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.950+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608004f2a0 con 0x7f60800a0a70 2023-10-03T10:16:32.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.954+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f607002b020 con 0x7f60800a0a70 2023-10-03T10:16:32.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 Processor -- start 2023-10-03T10:16:32.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 -- start start 2023-10-03T10:16:32.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a58134330 0x7f5a5813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5809fa00 con 0x7f5a5809f180 2023-10-03T10:16:32.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a580a0370 con 0x7f5a58134330 2023-10-03T10:16:32.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a5d58f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5806bec0 con 0x7f5a5809e870 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a58134330 0x7f5a5813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a56ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a58134330 0x7f5a5813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51918/0 (socket says 172.21.15.125:51918) 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a577fe700 1 -- 172.21.15.125:0/601070595 learned_addr learned my addr 172.21.15.125:0/601070595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a56ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51682/0 (socket says 172.21.15.125:51682) 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.988+0000 7f5a567fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5a5809f180 0x7f5a58133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42060/0 (socket says 172.21.15.125:42060) 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a577fe700 1 -- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 msgr2=0x7f5a5809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a577fe700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a577fe700 1 -- 172.21.15.125:0/601070595 >> v1:172.21.15.125:6789/0 conn(0x7f5a5809f180 legacy=0x7f5a58133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a577fe700 1 -- 172.21.15.125:0/601070595 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5809ada0 con 0x7f5a58134330 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a55ffb700 1 -- 172.21.15.125:0/601070595 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492127542 0 0) 0x7f5a5809fa00 con 0x7f5a5809f180 2023-10-03T10:16:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a56ffd700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a577fe700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a5813be80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009e50 tx=0x7f5a5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c61ceb0c10bb786 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a55ffb700 1 -- 172.21.15.125:0/601070595 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000e070 con 0x7f5a58134330 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a55ffb700 1 -- 172.21.15.125:0/601070595 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000b910 con 0x7f5a58134330 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a55ffb700 1 -- 172.21.15.125:0/601070595 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000bcc0 con 0x7f5a58134330 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a5d58f700 1 -- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 msgr2=0x7f5a5813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.989+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a5813be80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009e50 tx=0x7f5a5000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 -- 172.21.15.125:0/601070595 shutdown_connections 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a5813be80 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/601070595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 -- 172.21.15.125:0/601070595 >> 172.21.15.125:0/601070595 conn(0x7f5a580a4430 msgr2=0x7f5a580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 -- 172.21.15.125:0/601070595 shutdown_connections 2023-10-03T10:16:32.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.990+0000 7f5a5d58f700 1 -- 172.21.15.125:0/601070595 wait complete. 2023-10-03T10:16:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 Processor -- start 2023-10-03T10:16:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 -- start start 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a5809f180 0x7f5a58122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a58123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a581245d0 con 0x7f5a58134330 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a581264e0 con 0x7f5a5809f180 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a5d58f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58133b50 con 0x7f5a5809e870 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a56ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a56ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51698/0 (socket says 172.21.15.125:51698) 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a56ffd700 1 -- 172.21.15.125:0/1662294390 learned_addr learned my addr 172.21.15.125:0/1662294390 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a577fe700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a58123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.991+0000 7f5a567fc700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a5809f180 0x7f5a58122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 -- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a5809f180 msgr2=0x7f5a58122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a5809f180 0x7f5a58122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 -- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 msgr2=0x7f5a58123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a58123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 -- 172.21.15.125:0/1662294390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480094a0 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a56ffd700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800ebe0 tx=0x7f5a4800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800c850 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4800c9b0 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a50009b30 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800cd40 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.992+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a58125f40 con 0x7f5a5809e870 2023-10-03T10:16:32.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.993+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a48013470 con 0x7f5a5809e870 2023-10-03T10:16:32.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.993+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a4803fb30 con 0x7f5a5809e870 2023-10-03T10:16:32.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.993+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5804f2a0 con 0x7f5a5809e870 2023-10-03T10:16:32.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:32.998+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a48013720 con 0x7f5a5809e870 2023-10-03T10:16:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.151+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6080072980 con 0x7f60800a0a70 2023-10-03T10:16:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.152+0000 7f606effd700 1 -- 172.21.15.125:0/2926916688 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6070015070 con 0x7f60800a0a70 2023-10-03T10:16:33.152 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 msgr2=0x7f6080122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 0x7f6080122870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f608009e5c0 tx=0x7f6070004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 shutdown_connections 2023-10-03T10:16:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6080133f50 0x7f60801232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60800a0a70 0x7f6080122870 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 --2- 172.21.15.125:0/2926916688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60800a1380 0x7f6080122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 >> 172.21.15.125:0/2926916688 conn(0x7f60800a6610 msgr2=0x7f60800a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 shutdown_connections 2023-10-03T10:16:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.154+0000 7f60849e1700 1 -- 172.21.15.125:0/2926916688 wait complete. 2023-10-03T10:16:33.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:33.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.196+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a5806c9d0 con 0x7f5a5809e870 2023-10-03T10:16:33.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.197+0000 7f5a3f7fe700 1 -- 172.21.15.125:0/1662294390 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a48021030 con 0x7f5a5809e870 2023-10-03T10:16:33.197 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:33.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 msgr2=0x7f5a58122a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800ebe0 tx=0x7f5a4800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 shutdown_connections 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a58134330 0x7f5a58123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5a5809e870 0x7f5a58122a00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 --2- 172.21.15.125:0/1662294390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a5809f180 0x7f5a58122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 >> 172.21.15.125:0/1662294390 conn(0x7f5a580a4430 msgr2=0x7f5a580a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 shutdown_connections 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.199+0000 7f5a5d58f700 1 -- 172.21.15.125:0/1662294390 wait complete. 2023-10-03T10:16:33.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:33.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:33.779 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:33.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.871+0000 7f7eade8a700 1 Processor -- start 2023-10-03T10:16:33.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.871+0000 7f7eade8a700 1 -- start start 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea809e9d0 con 0x7f7ea8133f50 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea809dc00 con 0x7f7ea80a0a70 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7eade8a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea809dec0 con 0x7f7ea80a1380 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51706/0 (socket says 172.21.15.125:51706) 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51940/0 (socket says 172.21.15.125:51940) 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 -- 172.21.15.125:0/3692379827 learned_addr learned my addr 172.21.15.125:0/3692379827 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea77fe700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 -- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 msgr2=0x7f7ea80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 -- 172.21.15.125:0/3692379827 >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 msgr2=0x7f7ea81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 --2- 172.21.15.125:0/3692379827 >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 -- 172.21.15.125:0/3692379827 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea809e6a0 con 0x7f7ea80a1380 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea7fff700 1 --2- 172.21.15.125:0/3692379827 >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.872+0000 7f7ea6ffd700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098f0 tx=0x7f7e9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bcd86e8d606b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7ea67fc700 1 -- 172.21.15.125:0/3692379827 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011830 con 0x7f7ea80a1380 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7ea67fc700 1 -- 172.21.15.125:0/3692379827 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c011990 con 0x7f7ea80a1380 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7ea67fc700 1 -- 172.21.15.125:0/3692379827 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011d20 con 0x7f7ea80a1380 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 -- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 msgr2=0x7f7ea8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098f0 tx=0x7f7e9c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 -- 172.21.15.125:0/3692379827 shutdown_connections 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3692379827 >> v2:172.21.15.125:3300/0 conn(0x7f7ea8133f50 0x7f7ea81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3692379827 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea80a1380 0x7f7ea8133a10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 -- 172.21.15.125:0/3692379827 >> 172.21.15.125:0/3692379827 conn(0x7f7ea80a6610 msgr2=0x7f7ea80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 -- 172.21.15.125:0/3692379827 shutdown_connections 2023-10-03T10:16:33.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.873+0000 7f7eade8a700 1 -- 172.21.15.125:0/3692379827 wait complete. 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.874+0000 7f7eade8a700 1 Processor -- start 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.874+0000 7f7eade8a700 1 -- start start 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea811f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80a5080 con 0x7f7ea80a1380 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea81223c0 con 0x7f7ea80a0a70 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7eade8a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea81228e0 con 0x7f7ea8133f50 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51716/0 (socket says 172.21.15.125:51716) 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51954/0 (socket says 172.21.15.125:51954) 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 -- 172.21.15.125:0/3392938440 learned_addr learned my addr 172.21.15.125:0/3392938440 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 -- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 msgr2=0x7f7ea811f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea811f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 -- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 msgr2=0x7f7ea811fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea7fff700 1 -- 172.21.15.125:0/3392938440 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0009a70 con 0x7f7ea8133f50 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea6ffd700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.875+0000 7f7ea77fe700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea811f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7ea7fff700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009f00 tx=0x7f7ea000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0009d70 con 0x7f7ea8133f50 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea000f040 con 0x7f7ea8133f50 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c009550 con 0x7f7ea8133f50 2023-10-03T10:16:33.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea000cd70 con 0x7f7ea8133f50 2023-10-03T10:16:33.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea8120f80 con 0x7f7ea8133f50 2023-10-03T10:16:33.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.876+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ea0014480 con 0x7f7ea8133f50 2023-10-03T10:16:33.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.877+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ea003fd00 con 0x7f7ea8133f50 2023-10-03T10:16:33.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.877+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8122500 con 0x7f7ea8133f50 2023-10-03T10:16:33.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.885+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ea8122500 con 0x7f7ea8133f50 2023-10-03T10:16:33.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 Processor -- start 2023-10-03T10:16:33.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 -- start start 2023-10-03T10:16:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0809dc00 con 0x7fdf08133f50 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809ea60 con 0x7fdf080a0a70 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0ff56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809dec0 con 0x7fdf080a1380 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0e4f3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdf08133f50 0x7fdf0813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42074/0 (socket says 172.21.15.125:42074) 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0e4f3700 1 -- 172.21.15.125:0/250746891 learned_addr learned my addr 172.21.15.125:0/250746891 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0d4f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.914+0000 7fdf0dcf2700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0ccf0700 1 -- 172.21.15.125:0/250746891 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322156418 0 0) 0x7fdf0809dc00 con 0x7fdf08133f50 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0dcf2700 1 -- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 msgr2=0x7fdf08133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0dcf2700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0dcf2700 1 -- 172.21.15.125:0/250746891 >> v1:172.21.15.125:6789/0 conn(0x7fdf08133f50 legacy=0x7fdf0813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0dcf2700 1 -- 172.21.15.125:0/250746891 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0809e6a0 con 0x7fdf080a0a70 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0d4f1700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0dcf2700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf080a0e40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009870 tx=0x7fdf04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca5ad17c7776a38b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0ccf0700 1 -- 172.21.15.125:0/250746891 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011830 con 0x7fdf080a0a70 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0ccf0700 1 -- 172.21.15.125:0/250746891 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04011990 con 0x7fdf080a0a70 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.915+0000 7fdf0ccf0700 1 -- 172.21.15.125:0/250746891 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011d20 con 0x7fdf080a0a70 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 -- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 msgr2=0x7fdf080a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf080a0e40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009870 tx=0x7fdf04009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 -- 172.21.15.125:0/250746891 shutdown_connections 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf080a0e40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/250746891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 -- 172.21.15.125:0/250746891 >> 172.21.15.125:0/250746891 conn(0x7fdf080a6610 msgr2=0x7fdf080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 -- 172.21.15.125:0/250746891 shutdown_connections 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.916+0000 7fdf0ff56700 1 -- 172.21.15.125:0/250746891 wait complete. 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 Processor -- start 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 -- start start 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf081228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf08133f50 0x7fdf08123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08126170 con 0x7fdf08133f50 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08126350 con 0x7fdf080a0a70 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0ff56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08125db0 con 0x7fdf080a1380 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0d4f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0dcf2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf081228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0d4f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51734/0 (socket says 172.21.15.125:51734) 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0d4f1700 1 -- 172.21.15.125:0/3308389018 learned_addr learned my addr 172.21.15.125:0/3308389018 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.917+0000 7fdf0e4f3700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf08133f50 0x7fdf08123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 -- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 msgr2=0x7fdf081228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf081228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 -- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf08133f50 msgr2=0x7fdf08123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf08133f50 0x7fdf08123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 -- 172.21.15.125:0/3308389018 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80094a0 con 0x7fdf080a1380 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0dcf2700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf081228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0d4f1700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdef800ebe0 tx=0x7fdef800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800c850 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800c9b0 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf040094a0 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800cd40 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.918+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf08133350 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.919+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef8013470 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.919+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0804f2a0 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.919+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdef803f7c0 con 0x7fdf080a1380 2023-10-03T10:16:33.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:33.923+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef8021070 con 0x7fdf080a1380 2023-10-03T10:16:34.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.075+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ea8122500 con 0x7f7ea8133f50 2023-10-03T10:16:34.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.076+0000 7f7e8ffff700 1 -- 172.21.15.125:0/3392938440 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ea8122500 con 0x7f7ea8133f50 2023-10-03T10:16:34.076 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:34.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 msgr2=0x7f7ea81c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009f00 tx=0x7f7ea000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 shutdown_connections 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ea8133f50 0x7f7ea81c8140 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea80a0a70 0x7f7ea811f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 --2- 172.21.15.125:0/3392938440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea80a1380 0x7f7ea811fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 >> 172.21.15.125:0/3392938440 conn(0x7f7ea80a6610 msgr2=0x7f7ea81bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 shutdown_connections 2023-10-03T10:16:34.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.078+0000 7f7eade8a700 1 -- 172.21.15.125:0/3392938440 wait complete. 2023-10-03T10:16:34.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:34.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.110+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf08125fd0 con 0x7fdf080a1380 2023-10-03T10:16:34.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.111+0000 7fdefe7fc700 1 -- 172.21.15.125:0/3308389018 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf08125fd0 con 0x7fdf080a1380 2023-10-03T10:16:34.111 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:34.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 msgr2=0x7fdf08122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdef800ebe0 tx=0x7fdef800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 shutdown_connections 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf08133f50 0x7fdf08123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf080a0a70 0x7fdf081228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 --2- 172.21.15.125:0/3308389018 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf080a1380 0x7fdf08122e10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 >> 172.21.15.125:0/3308389018 conn(0x7fdf080a6610 msgr2=0x7fdf080a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 shutdown_connections 2023-10-03T10:16:34.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.113+0000 7fdf0ff56700 1 -- 172.21.15.125:0/3308389018 wait complete. 2023-10-03T10:16:34.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:34.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:34.212 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:34.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.299+0000 7ff3458d3700 1 Processor -- start 2023-10-03T10:16:34.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.299+0000 7ff3458d3700 1 -- start start 2023-10-03T10:16:34.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff3458d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3400a0a70 0x7ff3400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff3458d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 0x7ff34013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff3458d3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34009dc00 con 0x7ff3400a1380 2023-10-03T10:16:34.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff3458d3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34009ea90 con 0x7ff3400a0a70 2023-10-03T10:16:34.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff3458d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34009dec0 con 0x7ff340134120 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3400a0a70 0x7ff3400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 0x7ff34013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3400a1380 0x7ff340133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42078/0 (socket says 172.21.15.125:42078) 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33e7fc700 1 -- 172.21.15.125:0/2181963425 learned_addr learned my addr 172.21.15.125:0/2181963425 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 -- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 msgr2=0x7ff34013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 0x7ff34013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 -- 172.21.15.125:0/2181963425 >> v1:172.21.15.125:6789/0 conn(0x7ff3400a1380 legacy=0x7ff340133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33dffb700 1 -- 172.21.15.125:0/2181963425 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756627589 0 0) 0x7ff34009dc00 con 0x7ff3400a1380 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 -- 172.21.15.125:0/2181963425 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34009e6a0 con 0x7ff3400a0a70 2023-10-03T10:16:34.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33f7fe700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 0x7ff34013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.300+0000 7ff33effd700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3400a0a70 0x7ff3400a0e40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff330009840 tx=0x7ff330009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4bd4856fedf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff33dffb700 1 -- 172.21.15.125:0/2181963425 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330011830 con 0x7ff3400a0a70 2023-10-03T10:16:34.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff33dffb700 1 -- 172.21.15.125:0/2181963425 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330011990 con 0x7ff3400a0a70 2023-10-03T10:16:34.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff33dffb700 1 -- 172.21.15.125:0/2181963425 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330011d20 con 0x7ff3400a0a70 2023-10-03T10:16:34.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 -- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3400a0a70 msgr2=0x7ff3400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3400a0a70 0x7ff3400a0e40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff330009840 tx=0x7ff330009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 -- 172.21.15.125:0/2181963425 shutdown_connections 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff340134120 0x7ff34013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2181963425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3400a0a70 0x7ff3400a0e40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 -- 172.21.15.125:0/2181963425 >> 172.21.15.125:0/2181963425 conn(0x7ff3400a6610 msgr2=0x7ff3400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 -- 172.21.15.125:0/2181963425 shutdown_connections 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.301+0000 7ff3458d3700 1 -- 172.21.15.125:0/2181963425 wait complete. 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.302+0000 7ff3458d3700 1 Processor -- start 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 -- start start 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3400a1380 0x7ff340122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340133300 con 0x7ff340134120 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff340125920 con 0x7ff3400a1380 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff3458d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff340124310 con 0x7ff3400a0a70 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff33f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff33effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff33f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51974/0 (socket says 172.21.15.125:51974) 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff33f7fe700 1 -- 172.21.15.125:0/2319575103 learned_addr learned my addr 172.21.15.125:0/2319575103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.303+0000 7ff33effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51742/0 (socket says 172.21.15.125:51742) 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33e7fc700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3400a1380 0x7ff340122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 -- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 msgr2=0x7ff340122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 -- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3400a1380 msgr2=0x7ff340122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3400a1380 0x7ff340122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 -- 172.21.15.125:0/2319575103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009a70 con 0x7ff340134120 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33effd700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff33f7fe700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff33800efc0 tx=0x7ff33800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800ca90 con 0x7ff340134120 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800f040 con 0x7ff340134120 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3300094a0 con 0x7ff340134120 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800ce10 con 0x7ff340134120 2023-10-03T10:16:34.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.304+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340125c80 con 0x7ff340134120 2023-10-03T10:16:34.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.305+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff338014480 con 0x7ff340134120 2023-10-03T10:16:34.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.305+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34004f2a0 con 0x7ff340134120 2023-10-03T10:16:34.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.305+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff33803fd40 con 0x7ff340134120 2023-10-03T10:16:34.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.310+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff338012930 con 0x7ff340134120 2023-10-03T10:16:34.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.341+0000 7f1ad3716700 1 Processor -- start 2023-10-03T10:16:34.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.341+0000 7f1ad3716700 1 -- start start 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad3716700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad3716700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1acc133f70 0x7f1acc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad3716700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc09b110 con 0x7f1acc0a0a70 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad3716700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0a3b60 con 0x7f1acc133f70 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad3716700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1348e0 con 0x7f1acc09ad40 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1acc133f70 0x7f1acc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad1cb3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1acc0a0a70 0x7f1acc0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42080/0 (socket says 172.21.15.125:42080) 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad1cb3700 1 -- 172.21.15.125:0/2733894622 learned_addr learned my addr 172.21.15.125:0/2733894622 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad14b2700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 msgr2=0x7f1acc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/2733894622 >> v1:172.21.15.125:6789/0 conn(0x7f1acc0a0a70 legacy=0x7f1acc0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/2733894622 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0a2fa0 con 0x7f1acc133f70 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ad0cb1700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc1343a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009840 tx=0x7f1abc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73df3d8a3b0768a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.342+0000 7f1ac3fff700 1 -- 172.21.15.125:0/2733894622 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004230 con 0x7f1acc133f70 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ac3fff700 1 -- 172.21.15.125:0/2733894622 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc004390 con 0x7f1acc133f70 2023-10-03T10:16:34.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ac3fff700 1 -- 172.21.15.125:0/2733894622 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0036a0 con 0x7f1acc133f70 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 -- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 msgr2=0x7f1acc1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc1343a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009840 tx=0x7f1abc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 -- 172.21.15.125:0/2733894622 shutdown_connections 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 --2- 172.21.15.125:0/2733894622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc1343a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 -- 172.21.15.125:0/2733894622 >> 172.21.15.125:0/2733894622 conn(0x7f1acc099c40 msgr2=0x7f1acc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 -- 172.21.15.125:0/2733894622 shutdown_connections 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.343+0000 7f1ad3716700 1 -- 172.21.15.125:0/2733894622 wait complete. 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.344+0000 7f1ad3716700 1 Processor -- start 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.344+0000 7f1ad3716700 1 -- start start 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.344+0000 7f1ad3716700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc11e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc11eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1225a0 con 0x7f1acc133f70 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc11fcd0 con 0x7f1acc09ad40 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1202f0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad1cb3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc11eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51758/0 (socket says 172.21.15.125:51758) 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/3037274861 learned_addr learned my addr 172.21.15.125:0/3037274861 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad14b2700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc11e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 msgr2=0x7f1acc11e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc11e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 msgr2=0x7f1acc11eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc11eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 -- 172.21.15.125:0/3037274861 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0094a0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad1cb3700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc11eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad0cb1700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1abc004000 tx=0x7f1abc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc003d80 con 0x7f1acc0a0a70 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc01f070 con 0x7f1acc0a0a70 2023-10-03T10:16:34.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc120f20 con 0x7f1acc0a0a70 2023-10-03T10:16:34.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011870 con 0x7f1acc0a0a70 2023-10-03T10:16:34.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.345+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc09c7e0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.346+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1abc021030 con 0x7f1acc0a0a70 2023-10-03T10:16:34.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.346+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1abc0408b0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.346+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc04f2a0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.351+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1abc02d440 con 0x7f1acc0a0a70 2023-10-03T10:16:34.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.506+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff340125fa0 con 0x7ff340134120 2023-10-03T10:16:34.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.506+0000 7ff327fff700 1 -- 172.21.15.125:0/2319575103 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff33801c3b0 con 0x7ff340134120 2023-10-03T10:16:34.507 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 msgr2=0x7ff340123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff33800efc0 tx=0x7ff33800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 shutdown_connections 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff340134120 0x7ff340123180 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff3400a0a70 0x7ff340122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 --2- 172.21.15.125:0/2319575103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3400a1380 0x7ff340122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 >> 172.21.15.125:0/2319575103 conn(0x7ff3400a6610 msgr2=0x7ff3400a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 shutdown_connections 2023-10-03T10:16:34.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.508+0000 7ff3458d3700 1 -- 172.21.15.125:0/2319575103 wait complete. 2023-10-03T10:16:34.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.543+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1acc04f2a0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.543+0000 7f1ac1ffb700 1 -- 172.21.15.125:0/3037274861 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1abc019bb0 con 0x7f1acc0a0a70 2023-10-03T10:16:34.544 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 msgr2=0x7f1acc11e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1abc004000 tx=0x7f1abc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 shutdown_connections 2023-10-03T10:16:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1acc133f70 0x7f1acc11eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1acc09ad40 0x7f1acc11e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 --2- 172.21.15.125:0/3037274861 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1acc0a0a70 0x7f1acc11e600 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 >> 172.21.15.125:0/3037274861 conn(0x7f1acc099c40 msgr2=0x7f1acc133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 shutdown_connections 2023-10-03T10:16:34.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:34.545+0000 7f1ad3716700 1 -- 172.21.15.125:0/3037274861 wait complete. 2023-10-03T10:16:34.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:35.092 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:35.125 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.223+0000 7f9684f5f700 1 Processor -- start 2023-10-03T10:16:35.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.223+0000 7f9684f5f700 1 -- start start 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f9684f5f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f9684f5f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96801343a0 0x7f96800a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f9684f5f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968009b110 con 0x7f9680133f70 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f9684f5f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800a3b60 con 0x7f96801343a0 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f9684f5f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96800a2fa0 con 0x7f968009ad40 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96801343a0 0x7f96800a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51760/0 (socket says 172.21.15.125:51760) 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967e59c700 1 -- 172.21.15.125:0/1336852731 learned_addr learned my addr 172.21.15.125:0/1336852731 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96801343a0 0x7f96800a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51998/0 (socket says 172.21.15.125:51998) 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.224+0000 7f967dd9b700 1 --1- 172.21.15.125:0/1336852731 >> v1:172.21.15.125:6789/0 conn(0x7f9680133f70 0x7f96800a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42082/0 (socket says 172.21.15.125:42082) 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967ed9d700 1 -- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 msgr2=0x7f9680133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967ed9d700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967ed9d700 1 -- 172.21.15.125:0/1336852731 >> v1:172.21.15.125:6789/0 conn(0x7f9680133f70 legacy=0x7f96800a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967ed9d700 1 -- 172.21.15.125:0/1336852731 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968009a280 con 0x7f96801343a0 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967d59a700 1 -- 172.21.15.125:0/1336852731 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61905114 0 0) 0x7f968009b110 con 0x7f9680133f70 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967e59c700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967ed9d700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f96800a1180 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9678009d90 tx=0x7f967800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39828694ea99e45c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967d59a700 1 -- 172.21.15.125:0/1336852731 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800e070 con 0x7f96801343a0 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967d59a700 1 -- 172.21.15.125:0/1336852731 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967800bb20 con 0x7f96801343a0 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.225+0000 7f967d59a700 1 -- 172.21.15.125:0/1336852731 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678012430 con 0x7f96801343a0 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 -- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 msgr2=0x7f96800a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f96800a1180 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9678009d90 tx=0x7f967800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 -- 172.21.15.125:0/1336852731 shutdown_connections 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f96800a1180 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 --2- 172.21.15.125:0/1336852731 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f9680133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 -- 172.21.15.125:0/1336852731 >> 172.21.15.125:0/1336852731 conn(0x7f9680099c40 msgr2=0x7f968006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 -- 172.21.15.125:0/1336852731 shutdown_connections 2023-10-03T10:16:35.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.226+0000 7f9684f5f700 1 -- 172.21.15.125:0/1336852731 wait complete. 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 Processor -- start 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 -- start start 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 0x7f968011ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680120810 con 0x7f96801343a0 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9680120620 con 0x7f9680133f70 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f9684f5f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9680122530 con 0x7f968009ad40 2023-10-03T10:16:35.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51762/0 (socket says 172.21.15.125:51762) 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52000/0 (socket says 172.21.15.125:52000) 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 0x7f968011ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.227+0000 7f967e59c700 1 -- 172.21.15.125:0/2003941 learned_addr learned my addr 172.21.15.125:0/2003941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 -- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 msgr2=0x7f968011ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 -- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 msgr2=0x7f968011ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 0x7f968011ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 -- 172.21.15.125:0/2003941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009550 con 0x7f96801343a0 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967e59c700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967dd9b700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 0x7f968011ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f967ed9d700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9678016000 tx=0x7f9678004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678012430 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678020070 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678004280 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9678009a70 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.228+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9680122250 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.229+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96780043e0 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.229+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9678022070 con 0x7f96801343a0 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.229+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968004f2a0 con 0x7f96801343a0 2023-10-03T10:16:35.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.234+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f967802c080 con 0x7f96801343a0 2023-10-03T10:16:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.262+0000 7f894f265700 1 Processor -- start 2023-10-03T10:16:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.262+0000 7f894f265700 1 -- start start 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894f265700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f89480a0a70 0x7f89480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894f265700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894f265700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894809dc00 con 0x7f8948133f50 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894f265700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894809ea60 con 0x7f89480a0a70 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894f265700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894809dec0 con 0x7f89480a1380 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44246/0 (socket says 172.21.15.125:44246) 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 -- 172.21.15.125:0/1995508528 learned_addr learned my addr 172.21.15.125:0/1995508528 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894d001700 1 --2- 172.21.15.125:0/1995508528 >> v2:172.21.15.125:3300/0 conn(0x7f89480a0a70 0x7f89480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 -- 172.21.15.125:0/1995508528 >> v2:172.21.15.125:3300/0 conn(0x7f89480a0a70 msgr2=0x7f89480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 --2- 172.21.15.125:0/1995508528 >> v2:172.21.15.125:3300/0 conn(0x7f89480a0a70 0x7f89480a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 -- 172.21.15.125:0/1995508528 >> v1:172.21.15.125:6789/0 conn(0x7f8948133f50 legacy=0x7f894813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 -- 172.21.15.125:0/1995508528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894809e6a0 con 0x7f89480a1380 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.263+0000 7f894c800700 1 --2- 172.21.15.125:0/1995508528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f89380098f0 tx=0x7f8938009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9daae0cf847197c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f893ffff700 1 -- 172.21.15.125:0/1995508528 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938011830 con 0x7f89480a1380 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f893ffff700 1 -- 172.21.15.125:0/1995508528 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938011990 con 0x7f89480a1380 2023-10-03T10:16:35.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f893ffff700 1 -- 172.21.15.125:0/1995508528 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938011d20 con 0x7f89480a1380 2023-10-03T10:16:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 -- 172.21.15.125:0/1995508528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 msgr2=0x7f8948133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 --2- 172.21.15.125:0/1995508528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f89380098f0 tx=0x7f8938009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 -- 172.21.15.125:0/1995508528 shutdown_connections 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 --2- 172.21.15.125:0/1995508528 >> v2:172.21.15.125:3300/0 conn(0x7f89480a0a70 0x7f89480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 --2- 172.21.15.125:0/1995508528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f8948133a10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 -- 172.21.15.125:0/1995508528 >> 172.21.15.125:0/1995508528 conn(0x7f89480a6610 msgr2=0x7f89480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 -- 172.21.15.125:0/1995508528 shutdown_connections 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.264+0000 7f894f265700 1 -- 172.21.15.125:0/1995508528 wait complete. 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.265+0000 7f894f265700 1 Processor -- start 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.265+0000 7f894f265700 1 -- start start 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f89480a0a70 0x7f89481c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 0x7f89481c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948124870 con 0x7f8948133f50 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8948124680 con 0x7f89480a1380 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894f265700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8948133a50 con 0x7f89480a0a70 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44254/0 (socket says 172.21.15.125:44254) 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 -- 172.21.15.125:0/207624351 learned_addr learned my addr 172.21.15.125:0/207624351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894d802700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 0x7f89481c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894d001700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f89480a0a70 0x7f89481c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 -- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f89480a0a70 msgr2=0x7f89481c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f89480a0a70 0x7f89481c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 -- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 msgr2=0x7f89481c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 0x7f89481c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 -- 172.21.15.125:0/207624351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009550 con 0x7f89480a1380 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894d802700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 0x7f89481c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.266+0000 7f894c800700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8938009c40 tx=0x7f8938004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.267+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938004400 con 0x7f89480a1380 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.267+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893801f070 con 0x7f89480a1380 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.267+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380038e0 con 0x7f89480a1380 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.267+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948125ff0 con 0x7f89480a1380 2023-10-03T10:16:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.267+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89480a0440 con 0x7f89480a1380 2023-10-03T10:16:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.268+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8948125350 con 0x7f89480a1380 2023-10-03T10:16:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.268+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8938021030 con 0x7f89480a1380 2023-10-03T10:16:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.268+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8938040dc0 con 0x7f89480a1380 2023-10-03T10:16:35.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.273+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89380199a0 con 0x7f89480a1380 2023-10-03T10:16:35.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.430+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9680120e10 con 0x7f96801343a0 2023-10-03T10:16:35.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.430+0000 7f966effd700 1 -- 172.21.15.125:0/2003941 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f967801b400 con 0x7f96801343a0 2023-10-03T10:16:35.431 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 msgr2=0x7f968011f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9678016000 tx=0x7f9678004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 shutdown_connections 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96801343a0 0x7f968011f490 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f968009ad40 0x7f968011ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 --2- 172.21.15.125:0/2003941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9680133f70 0x7f968011ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 >> 172.21.15.125:0/2003941 conn(0x7f9680099c40 msgr2=0x7f96801bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 shutdown_connections 2023-10-03T10:16:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.432+0000 7f9684f5f700 1 -- 172.21.15.125:0/2003941 wait complete. 2023-10-03T10:16:35.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:35.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.464+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f894804f2a0 con 0x7f89480a1380 2023-10-03T10:16:35.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.465+0000 7f893dffb700 1 -- 172.21.15.125:0/207624351 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8938015070 con 0x7f89480a1380 2023-10-03T10:16:35.465 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:35.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 msgr2=0x7f89481c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8938009c40 tx=0x7f8938004750 comp rx=0 tx=0).stop 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 shutdown_connections 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8948133f50 0x7f89481c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f89480a0a70 0x7f89481c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 --2- 172.21.15.125:0/207624351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f89480a1380 0x7f89481c8770 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 >> 172.21.15.125:0/207624351 conn(0x7f89480a6610 msgr2=0x7f89480a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 shutdown_connections 2023-10-03T10:16:35.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.467+0000 7f894f265700 1 -- 172.21.15.125:0/207624351 wait complete. 2023-10-03T10:16:35.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:35.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:35.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:35.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.646+0000 7f5e2cd9b700 1 Processor -- start 2023-10-03T10:16:35.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.646+0000 7f5e2cd9b700 1 -- start start 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e281343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 0x7f5e280a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e280a3b60 con 0x7f5e280a0a70 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281348e0 con 0x7f5e28133f70 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2cd9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2809b110 con 0x7f5e2809ad40 2023-10-03T10:16:35.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e281343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e26d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 0x7f5e280a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46090/0 (socket says 172.21.15.125:46090) 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e2659c700 1 -- 172.21.15.125:0/218482464 learned_addr learned my addr 172.21.15.125:0/218482464 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.647+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e281343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44266/0 (socket says 172.21.15.125:44266) 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 -- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 msgr2=0x7f5e281343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 --2- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e281343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 -- 172.21.15.125:0/218482464 >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 msgr2=0x7f5e280a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 --2- 172.21.15.125:0/218482464 >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 0x7f5e280a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 -- 172.21.15.125:0/218482464 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280a2fa0 con 0x7f5e2809ad40 2023-10-03T10:16:35.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e26d9d700 1 --2- 172.21.15.125:0/218482464 >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 0x7f5e280a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2659c700 1 --2- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098f0 tx=0x7f5e18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd95e5f50228534 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2559a700 1 -- 172.21.15.125:0/218482464 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011830 con 0x7f5e2809ad40 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2559a700 1 -- 172.21.15.125:0/218482464 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18011990 con 0x7f5e2809ad40 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2559a700 1 -- 172.21.15.125:0/218482464 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011d20 con 0x7f5e2809ad40 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 msgr2=0x7f5e28133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.648+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098f0 tx=0x7f5e18009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/218482464 shutdown_connections 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/218482464 >> v2:172.21.15.125:3300/0 conn(0x7f5e280a0a70 0x7f5e280a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e28133a30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/218482464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e281343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/218482464 >> 172.21.15.125:0/218482464 conn(0x7f5e28099c40 msgr2=0x7f5e2806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/218482464 shutdown_connections 2023-10-03T10:16:35.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.649+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/218482464 wait complete. 2023-10-03T10:16:35.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 Processor -- start 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 -- start start 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e28121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281327d0 con 0x7f5e280a0a70 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28124ca0 con 0x7f5e28133f70 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2cd9b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2809d360 con 0x7f5e2809ad40 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46096/0 (socket says 172.21.15.125:46096) 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e2659c700 1 -- 172.21.15.125:0/3826419792 learned_addr learned my addr 172.21.15.125:0/3826419792 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37636/0 (socket says 172.21.15.125:37636) 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.650+0000 7f5e26d9d700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e28121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 -- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 msgr2=0x7f5e281214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 -- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 msgr2=0x7f5e28121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e28121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 -- 172.21.15.125:0/3826419792 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009a70 con 0x7f5e280a0a70 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e2659c700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e26d9d700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e28121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e25d9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00e8d0 tx=0x7f5e1c00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c013680 con 0x7f5e280a0a70 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0137e0 con 0x7f5e280a0a70 2023-10-03T10:16:35.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c013b50 con 0x7f5e280a0a70 2023-10-03T10:16:35.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e18009550 con 0x7f5e280a0a70 2023-10-03T10:16:35.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.651+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e28125710 con 0x7f5e280a0a70 2023-10-03T10:16:35.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.652+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e1c013cb0 con 0x7f5e280a0a70 2023-10-03T10:16:35.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.652+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2804f2a0 con 0x7f5e280a0a70 2023-10-03T10:16:35.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.652+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e1c03f990 con 0x7f5e280a0a70 2023-10-03T10:16:35.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.660+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e1c01abc0 con 0x7f5e280a0a70 2023-10-03T10:16:35.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 Processor -- start 2023-10-03T10:16:35.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 -- start start 2023-10-03T10:16:35.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 0x7fbcd0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd009b110 con 0x7fbcd0133f70 2023-10-03T10:16:35.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd00a3b60 con 0x7fbcd009ad40 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd81bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0134850 con 0x7fbcd01343d0 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd6758700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd5f57700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 0x7fbcd0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd5756700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbcd0133f70 0x7fbcd00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47480/0 (socket says 172.21.15.125:47480) 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd6758700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46100/0 (socket says 172.21.15.125:46100) 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd5f57700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 0x7fbcd0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37652/0 (socket says 172.21.15.125:37652) 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.692+0000 7fbcd5756700 1 -- 172.21.15.125:0/2223424431 learned_addr learned my addr 172.21.15.125:0/2223424431 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd6758700 1 -- 172.21.15.125:0/2223424431 >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 msgr2=0x7fbcd0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd6758700 1 --2- 172.21.15.125:0/2223424431 >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 0x7fbcd0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd6758700 1 -- 172.21.15.125:0/2223424431 >> v1:172.21.15.125:6789/0 conn(0x7fbcd0133f70 legacy=0x7fbcd00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd6758700 1 -- 172.21.15.125:0/2223424431 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00a2fa0 con 0x7fbcd01343d0 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd6758700 1 --2- 172.21.15.125:0/2223424431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009d90 tx=0x7fbcc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ca9ae2a7d55f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd4f55700 1 -- 172.21.15.125:0/2223424431 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800e070 con 0x7fbcd01343d0 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd4f55700 1 -- 172.21.15.125:0/2223424431 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc800bb20 con 0x7fbcd01343d0 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.693+0000 7fbcd4f55700 1 -- 172.21.15.125:0/2223424431 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8012430 con 0x7fbcd01343d0 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 -- 172.21.15.125:0/2223424431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 msgr2=0x7fbcd00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/2223424431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009d90 tx=0x7fbcc800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 -- 172.21.15.125:0/2223424431 shutdown_connections 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/2223424431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd01343d0 0x7fbcd00a1180 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/2223424431 >> v2:172.21.15.125:3300/0 conn(0x7fbcd009ad40 0x7fbcd0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 -- 172.21.15.125:0/2223424431 >> 172.21.15.125:0/2223424431 conn(0x7fbcd0099c40 msgr2=0x7fbcd006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 -- 172.21.15.125:0/2223424431 shutdown_connections 2023-10-03T10:16:35.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.694+0000 7fbcd81bb700 1 -- 172.21.15.125:0/2223424431 wait complete. 2023-10-03T10:16:35.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 Processor -- start 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 -- start start 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd0133f70 0x7fbcd01c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd01343d0 0x7fbcd01c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0120b00 con 0x7fbcd01343d0 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0120910 con 0x7fbcd0133f70 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd81bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd01211e0 con 0x7fbcd009ad40 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd5f57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd5756700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd0133f70 0x7fbcd01c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd5f57700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46110/0 (socket says 172.21.15.125:46110) 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd5f57700 1 -- 172.21.15.125:0/537740387 learned_addr learned my addr 172.21.15.125:0/537740387 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.695+0000 7fbcd6758700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd01343d0 0x7fbcd01c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 -- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd0133f70 msgr2=0x7fbcd01c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd0133f70 0x7fbcd01c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 -- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd01343d0 msgr2=0x7fbcd01c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd01343d0 0x7fbcd01c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 -- 172.21.15.125:0/537740387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8009a70 con 0x7fbcd009ad40 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd5f57700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e870 tx=0x7fbccc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc009590 con 0x7fbcd009ad40 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc013680 con 0x7fbcd009ad40 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0139f0 con 0x7fbcd009ad40 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd00a43a0 con 0x7fbcd009ad40 2023-10-03T10:16:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd0122540 con 0x7fbcd009ad40 2023-10-03T10:16:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.696+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbccc013b50 con 0x7fbcd009ad40 2023-10-03T10:16:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.697+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbccc03f580 con 0x7fbcd009ad40 2023-10-03T10:16:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.697+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd004f2a0 con 0x7fbcd009ad40 2023-10-03T10:16:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.702+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbccc017080 con 0x7fbcd009ad40 2023-10-03T10:16:35.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.854+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e28133d50 con 0x7f5e280a0a70 2023-10-03T10:16:35.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.854+0000 7f5e16ffd700 1 -- 172.21.15.125:0/3826419792 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e1c017070 con 0x7f5e280a0a70 2023-10-03T10:16:35.855 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 msgr2=0x7f5e28121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00e8d0 tx=0x7f5e1c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 shutdown_connections 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e28133f70 0x7f5e28121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e2809ad40 0x7f5e281214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 --2- 172.21.15.125:0/3826419792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e280a0a70 0x7f5e28121a20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 >> 172.21.15.125:0/3826419792 conn(0x7f5e28099c40 msgr2=0x7f5e2809e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 shutdown_connections 2023-10-03T10:16:35.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.856+0000 7f5e2cd9b700 1 -- 172.21.15.125:0/3826419792 wait complete. 2023-10-03T10:16:35.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:35.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.895+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcd01223a0 con 0x7fbcd009ad40 2023-10-03T10:16:35.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.895+0000 7fbcc67fc700 1 -- 172.21.15.125:0/537740387 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcd01223a0 con 0x7fbcd009ad40 2023-10-03T10:16:35.895 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 msgr2=0x7fbcd01c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e870 tx=0x7fbccc00eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 shutdown_connections 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd01343d0 0x7fbcd01c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbcd009ad40 0x7fbcd01c8510 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 --2- 172.21.15.125:0/537740387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbcd0133f70 0x7fbcd01c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 >> 172.21.15.125:0/537740387 conn(0x7fbcd0099c40 msgr2=0x7fbcd01bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 shutdown_connections 2023-10-03T10:16:35.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:35.897+0000 7fbcd81bb700 1 -- 172.21.15.125:0/537740387 wait complete. 2023-10-03T10:16:35.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:36.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:36.479 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.576+0000 7fe26b84d700 1 Processor -- start 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.576+0000 7fe26b84d700 1 -- start start 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe26b84d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a0a70 0x7fe2640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe26b84d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 0x7fe264133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe26b84d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26409dc00 con 0x7fe264133f50 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe26b84d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26409ea60 con 0x7fe2640a0a70 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe26b84d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe26409dec0 con 0x7fe2640a1380 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe269dea700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe264133f50 0x7fe26413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47482/0 (socket says 172.21.15.125:47482) 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 0x7fe264133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe269dea700 1 -- 172.21.15.125:0/2749817587 learned_addr learned my addr 172.21.15.125:0/2749817587 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe2695e9700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a0a70 0x7fe2640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe25bfff700 1 -- 172.21.15.125:0/2749817587 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359814068 0 0) 0x7fe26409dc00 con 0x7fe264133f50 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 -- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a0a70 msgr2=0x7fe2640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a0a70 0x7fe2640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 -- 172.21.15.125:0/2749817587 >> v1:172.21.15.125:6789/0 conn(0x7fe264133f50 legacy=0x7fe26413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 -- 172.21.15.125:0/2749817587 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26409e6a0 con 0x7fe2640a1380 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe268de8700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 0x7fe264133a10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe254009870 tx=0x7fe254009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdbde927073830af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe25bfff700 1 -- 172.21.15.125:0/2749817587 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011830 con 0x7fe2640a1380 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe25bfff700 1 -- 172.21.15.125:0/2749817587 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011990 con 0x7fe2640a1380 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.577+0000 7fe25bfff700 1 -- 172.21.15.125:0/2749817587 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011d20 con 0x7fe2640a1380 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 -- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 msgr2=0x7fe264133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 0x7fe264133a10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe254009870 tx=0x7fe254009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 -- 172.21.15.125:0/2749817587 shutdown_connections 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a0a70 0x7fe2640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 --2- 172.21.15.125:0/2749817587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe2640a1380 0x7fe264133a10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 -- 172.21.15.125:0/2749817587 >> 172.21.15.125:0/2749817587 conn(0x7fe2640a6610 msgr2=0x7fe2640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 -- 172.21.15.125:0/2749817587 shutdown_connections 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.578+0000 7fe26b84d700 1 -- 172.21.15.125:0/2749817587 wait complete. 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.579+0000 7fe26b84d700 1 Processor -- start 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.579+0000 7fe26b84d700 1 -- start start 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.579+0000 7fe26b84d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 0x7fe264122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 0x7fe264122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 0x7fe264123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264126110 con 0x7fe2640a0a70 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264123cf0 con 0x7fe2640a1380 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe264126360 con 0x7fe264133f50 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe268de8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 0x7fe264122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 0x7fe264123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe268de8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 0x7fe264122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44304/0 (socket says 172.21.15.125:44304) 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe268de8700 1 -- 172.21.15.125:0/3250144689 learned_addr learned my addr 172.21.15.125:0/3250144689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe2695e9700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 0x7fe264122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 -- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 msgr2=0x7fe264122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 0x7fe264122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 -- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 msgr2=0x7fe264122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 0x7fe264122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 -- 172.21.15.125:0/3250144689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540094a0 con 0x7fe264133f50 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe2695e9700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 0x7fe264122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe269dea700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 0x7fe264123310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00cc10 tx=0x7fe25c00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00aa00 con 0x7fe264133f50 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00ab80 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0070d0 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.580+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2641244f0 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.581+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640a0430 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.581+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe25c007230 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.581+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe25c03f000 con 0x7fe264133f50 2023-10-03T10:16:36.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.581+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2641339d0 con 0x7fe264133f50 2023-10-03T10:16:36.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.586+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe25c018020 con 0x7fe264133f50 2023-10-03T10:16:36.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.615+0000 7f6b2c574700 1 Processor -- start 2023-10-03T10:16:36.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.615+0000 7f6b2c574700 1 -- start start 2023-10-03T10:16:36.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2c574700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 0x7f6b2409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2c574700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 0x7f6b24131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2c574700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2409c970 con 0x7f6b24131d70 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2c574700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240a0920 con 0x7f6b2409f180 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2c574700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2409f9c0 con 0x7f6b2409e870 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b29b0f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 0x7f6b24131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2ab11700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6b24131d70 0x7f6b24138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47494/0 (socket says 172.21.15.125:47494) 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2ab11700 1 -- 172.21.15.125:0/3653596003 learned_addr learned my addr 172.21.15.125:0/3653596003 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.616+0000 7f6b2a310700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 0x7f6b2409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2930e700 1 -- 172.21.15.125:0/3653596003 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257386551 0 0) 0x7f6b2409c970 con 0x7f6b24131d70 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b29b0f700 1 -- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 msgr2=0x7f6b2409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b29b0f700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 0x7f6b2409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b29b0f700 1 -- 172.21.15.125:0/3653596003 >> v1:172.21.15.125:6789/0 conn(0x7f6b24131d70 legacy=0x7f6b24138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b29b0f700 1 -- 172.21.15.125:0/3653596003 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2409bab0 con 0x7f6b2409f180 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2a310700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 0x7f6b2409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b29b0f700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 0x7f6b24131830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009870 tx=0x7f6b14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7d082bd75391a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2930e700 1 -- 172.21.15.125:0/3653596003 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14011830 con 0x7f6b2409f180 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2930e700 1 -- 172.21.15.125:0/3653596003 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b14011990 con 0x7f6b2409f180 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2930e700 1 -- 172.21.15.125:0/3653596003 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14011d20 con 0x7f6b2409f180 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2c574700 1 -- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 msgr2=0x7f6b24131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.617+0000 7f6b2c574700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 0x7f6b24131830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009870 tx=0x7f6b14009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 -- 172.21.15.125:0/3653596003 shutdown_connections 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409e870 0x7f6b2409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 --2- 172.21.15.125:0/3653596003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409f180 0x7f6b24131830 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 -- 172.21.15.125:0/3653596003 >> 172.21.15.125:0/3653596003 conn(0x7f6b240a4430 msgr2=0x7f6b240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 -- 172.21.15.125:0/3653596003 shutdown_connections 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.618+0000 7f6b2c574700 1 -- 172.21.15.125:0/3653596003 wait complete. 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 Processor -- start 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 -- start start 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b24131d70 0x7f6b2411fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24120cf0 con 0x7f6b24131d70 2023-10-03T10:16:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24121b80 con 0x7f6b2409e870 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2c574700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24122660 con 0x7f6b2409f180 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2a310700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46154/0 (socket says 172.21.15.125:46154) 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2ab11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b24131d70 0x7f6b2411fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 -- 172.21.15.125:0/1467205407 learned_addr learned my addr 172.21.15.125:0/1467205407 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2a310700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44318/0 (socket says 172.21.15.125:44318) 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 -- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 msgr2=0x7f6b2411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 -- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b24131d70 msgr2=0x7f6b2411fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b24131d70 0x7f6b2411fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b29b0f700 1 -- 172.21.15.125:0/1467205407 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200094a0 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.619+0000 7f6b2a310700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b29b0f700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b140090b0 tx=0x7f6b14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14004510 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1401f070 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140038e0 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b140094a0 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2409dba0 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.620+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b14003a40 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.621+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b14021070 con 0x7f6b2409f180 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.621+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b24121f40 con 0x7f6b2409f180 2023-10-03T10:16:36.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.625+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b1401a430 con 0x7f6b2409f180 2023-10-03T10:16:36.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.779+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe26404f2a0 con 0x7fe264133f50 2023-10-03T10:16:36.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.779+0000 7fe259ffb700 1 -- 172.21.15.125:0/3250144689 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe25c0074e0 con 0x7fe264133f50 2023-10-03T10:16:36.788 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 msgr2=0x7fe264123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 0x7fe264123310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00cc10 tx=0x7fe25c00cf20 comp rx=0 tx=0).stop 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 shutdown_connections 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe264133f50 0x7fe264123310 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2640a0a70 0x7fe264122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 --2- 172.21.15.125:0/3250144689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2640a1380 0x7fe264122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 >> 172.21.15.125:0/3250144689 conn(0x7fe2640a6610 msgr2=0x7fe26409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 shutdown_connections 2023-10-03T10:16:36.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.781+0000 7fe26b84d700 1 -- 172.21.15.125:0/3250144689 wait complete. 2023-10-03T10:16:36.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:36.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.821+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b2411be60 con 0x7f6b2409f180 2023-10-03T10:16:36.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.821+0000 7f6b1affd700 1 -- 172.21.15.125:0/1467205407 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b1402b020 con 0x7f6b2409f180 2023-10-03T10:16:36.822 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 msgr2=0x7f6b2411f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b140090b0 tx=0x7f6b14004750 comp rx=0 tx=0).stop 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 shutdown_connections 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b24131d70 0x7f6b2411fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6b2409e870 0x7f6b2411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 --2- 172.21.15.125:0/1467205407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6b2409f180 0x7f6b2411f620 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 >> 172.21.15.125:0/1467205407 conn(0x7f6b240a4430 msgr2=0x7f6b24131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.823+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 shutdown_connections 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:36.824+0000 7f6b2c574700 1 -- 172.21.15.125:0/1467205407 wait complete. 2023-10-03T10:16:36.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:36.869 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:36.910 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:37.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.001+0000 7f16ec122700 1 Processor -- start 2023-10-03T10:16:37.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 -- start start 2023-10-03T10:16:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16e4134570 0x7f16e413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e409b110 con 0x7f16e409ad40 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e40a3b60 con 0x7f16e4134570 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ec122700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40a1a80 con 0x7f16e4134140 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16e96bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16e4134570 0x7f16e413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16e4134570 0x7f16e413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37700/0 (socket says 172.21.15.125:37700) 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16e96bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44324/0 (socket says 172.21.15.125:44324) 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16e9ebe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f16e409ad40 0x7f16e4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47498/0 (socket says 172.21.15.125:47498) 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 -- 172.21.15.125:0/3894030116 learned_addr learned my addr 172.21.15.125:0/3894030116 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 -- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 msgr2=0x7f16e4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 -- 172.21.15.125:0/3894030116 >> v1:172.21.15.125:6789/0 conn(0x7f16e409ad40 legacy=0x7f16e4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.002+0000 7f16ea6bf700 1 -- 172.21.15.125:0/3894030116 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40a2fa0 con 0x7f16e4134570 2023-10-03T10:16:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16e96bd700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ea6bf700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e4134570 0x7f16e413b3d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009e50 tx=0x7f16dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861137699058e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16e8ebc700 1 -- 172.21.15.125:0/3894030116 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00e070 con 0x7f16e4134570 2023-10-03T10:16:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16e8ebc700 1 -- 172.21.15.125:0/3894030116 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00b910 con 0x7f16e4134570 2023-10-03T10:16:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16e8ebc700 1 -- 172.21.15.125:0/3894030116 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00bcc0 con 0x7f16e4134570 2023-10-03T10:16:37.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 -- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e4134570 msgr2=0x7f16e413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e4134570 0x7f16e413b3d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009e50 tx=0x7f16dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 -- 172.21.15.125:0/3894030116 shutdown_connections 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e4134570 0x7f16e413b3d0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 --2- 172.21.15.125:0/3894030116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.003+0000 7f16ec122700 1 -- 172.21.15.125:0/3894030116 >> 172.21.15.125:0/3894030116 conn(0x7f16e4099c40 msgr2=0x7f16e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.004+0000 7f16ec122700 1 -- 172.21.15.125:0/3894030116 shutdown_connections 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.004+0000 7f16ec122700 1 -- 172.21.15.125:0/3894030116 wait complete. 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.004+0000 7f16ec122700 1 Processor -- start 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.004+0000 7f16ec122700 1 -- start start 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 0x7f16e411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e411ebb0 con 0x7f16e409ad40 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e409c7e0 con 0x7f16e4134140 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ec122700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16e411d9e0 con 0x7f16e4134570 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e9ebe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ea6bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 0x7f16e411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44340/0 (socket says 172.21.15.125:44340) 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e9ebe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37712/0 (socket says 172.21.15.125:37712) 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 -- 172.21.15.125:0/2942221709 learned_addr learned my addr 172.21.15.125:0/2942221709 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 -- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 msgr2=0x7f16e411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 0x7f16e411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 -- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 msgr2=0x7f16e411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 -- 172.21.15.125:0/2942221709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d40094a0 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e9ebe700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16ea6bf700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 0x7f16e411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.005+0000 7f16e96bd700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f16d400ec10 tx=0x7f16d400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4009760 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400c850 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cbe0 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc009b30 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e411e260 con 0x7f16e4134140 2023-10-03T10:16:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.006+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16d400cd40 con 0x7f16e4134140 2023-10-03T10:16:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.007+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16d403fac0 con 0x7f16e4134140 2023-10-03T10:16:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.007+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e411e800 con 0x7f16e4134140 2023-10-03T10:16:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.011+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16d401b3b0 con 0x7f16e4134140 2023-10-03T10:16:37.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 Processor -- start 2023-10-03T10:16:37.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 -- start start 2023-10-03T10:16:37.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc09e870 0x7faedc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 0x7faedc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 0x7faedc134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc06ce60 con 0x7faedc09e870 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc06bec0 con 0x7faedc09f180 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.045+0000 7faee0f28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faedc09fa00 con 0x7faedc1341d0 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc09e870 0x7faedc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faed9d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 0x7faedc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faedad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 0x7faedc134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faedc09e870 0x7faedc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37716/0 (socket says 172.21.15.125:37716) 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 -- 172.21.15.125:0/106558952 learned_addr learned my addr 172.21.15.125:0/106558952 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 -- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 msgr2=0x7faedc134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 0x7faedc134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 -- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 msgr2=0x7faedc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 0x7faedc133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 -- 172.21.15.125:0/106558952 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc09ad80 con 0x7faedc09e870 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faed9d9b700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 0x7faedc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faedad9d700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 0x7faedc134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faeda59c700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc09ec40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7faecc009920 tx=0x7faecc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ac63eb08f675af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faed959a700 1 -- 172.21.15.125:0/106558952 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc011830 con 0x7faedc09e870 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faed959a700 1 -- 172.21.15.125:0/106558952 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc011990 con 0x7faedc09e870 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.046+0000 7faed959a700 1 -- 172.21.15.125:0/106558952 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc011d20 con 0x7faedc09e870 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 -- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 msgr2=0x7faedc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc09ec40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7faecc009920 tx=0x7faecc009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 -- 172.21.15.125:0/106558952 shutdown_connections 2023-10-03T10:16:37.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc1341d0 0x7faedc134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc09ec40 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 --2- 172.21.15.125:0/106558952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc09f180 0x7faedc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 -- 172.21.15.125:0/106558952 >> 172.21.15.125:0/106558952 conn(0x7faedc0a4430 msgr2=0x7faedc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 -- 172.21.15.125:0/106558952 shutdown_connections 2023-10-03T10:16:37.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.047+0000 7faee0f28700 1 -- 172.21.15.125:0/106558952 wait complete. 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.048+0000 7faee0f28700 1 Processor -- start 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.048+0000 7faee0f28700 1 -- start start 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc09f180 0x7faedc122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 0x7faedc1230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc133950 con 0x7faedc09e870 2023-10-03T10:16:37.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc123ac0 con 0x7faedc1341d0 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faee0f28700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faedc125020 con 0x7faedc09f180 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37722/0 (socket says 172.21.15.125:37722) 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 -- 172.21.15.125:0/3034483459 learned_addr learned my addr 172.21.15.125:0/3034483459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faedad9d700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 0x7faedc1230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faed9d9b700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc09f180 0x7faedc122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 -- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc09f180 msgr2=0x7faedc122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc09f180 0x7faedc122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 -- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 msgr2=0x7faedc1230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 0x7faedc1230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faeda59c700 1 -- 172.21.15.125:0/3034483459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00094a0 con 0x7faedc09e870 2023-10-03T10:16:37.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.049+0000 7faedad9d700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 0x7faedc1230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faeda59c700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098f0 tx=0x7faecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc004240 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc01f070 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4009a70 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0036a0 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.050+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc009550 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.051+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faecc021030 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.051+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc06cfa0 con 0x7faedc09e870 2023-10-03T10:16:37.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.051+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faecc0406b0 con 0x7faedc09e870 2023-10-03T10:16:37.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.055+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faecc0199a0 con 0x7faedc09e870 2023-10-03T10:16:37.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.204+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16e404f2a0 con 0x7f16e4134140 2023-10-03T10:16:37.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.205+0000 7f16da7fc700 1 -- 172.21.15.125:0/2942221709 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16d4011b40 con 0x7f16e4134140 2023-10-03T10:16:37.205 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 msgr2=0x7f16e411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f16d400ec10 tx=0x7f16d400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 shutdown_connections 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16e4134570 0x7f16e411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e409ad40 0x7f16e411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 --2- 172.21.15.125:0/2942221709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16e4134140 0x7f16e411ce00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 >> 172.21.15.125:0/2942221709 conn(0x7f16e4099c40 msgr2=0x7f16e40a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 shutdown_connections 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.207+0000 7f16ec122700 1 -- 172.21.15.125:0/2942221709 wait complete. 2023-10-03T10:16:37.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:37.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.244+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faedc04f2a0 con 0x7faedc09e870 2023-10-03T10:16:37.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.244+0000 7faecaffd700 1 -- 172.21.15.125:0/3034483459 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faecc015030 con 0x7faedc09e870 2023-10-03T10:16:37.245 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 msgr2=0x7faedc122660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098f0 tx=0x7faecc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 shutdown_connections 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faedc1341d0 0x7faedc1230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faedc09e870 0x7faedc122660 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 --2- 172.21.15.125:0/3034483459 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faedc09f180 0x7faedc122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.246+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 >> 172.21.15.125:0/3034483459 conn(0x7faedc0a4430 msgr2=0x7faedc09d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.247+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 shutdown_connections 2023-10-03T10:16:37.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.247+0000 7faee0f28700 1 -- 172.21.15.125:0/3034483459 wait complete. 2023-10-03T10:16:37.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:37.795 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:37.837 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:37.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 Processor -- start 2023-10-03T10:16:37.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 -- start start 2023-10-03T10:16:37.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c09dc00 con 0x7fa04c0a1380 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c09ea60 con 0x7fa04c134120 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.922+0000 7fa05317c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c09dec0 con 0x7fa04c0a0a70 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44368/0 (socket says 172.21.15.125:44368) 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 -- 172.21.15.125:0/3306650732 learned_addr learned my addr 172.21.15.125:0/3306650732 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa051719700 1 --2- 172.21.15.125:0/3306650732 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa04b7fe700 1 -- 172.21.15.125:0/3306650732 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275851754 0 0) 0x7fa04c09dc00 con 0x7fa04c0a1380 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa04b7fe700 1 -- 172.21.15.125:0/3306650732 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c0035b0 con 0x7fa04c0a1380 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 -- 172.21.15.125:0/3306650732 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 msgr2=0x7fa04c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 --2- 172.21.15.125:0/3306650732 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 -- 172.21.15.125:0/3306650732 >> v1:172.21.15.125:6789/0 conn(0x7fa04c0a1380 legacy=0x7fa04c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 -- 172.21.15.125:0/3306650732 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c09e6a0 con 0x7fa04c0a0a70 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa051719700 1 --2- 172.21.15.125:0/3306650732 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa050f18700 1 --2- 172.21.15.125:0/3306650732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098f0 tx=0x7fa040009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a08a6c123d532511 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa04b7fe700 1 -- 172.21.15.125:0/3306650732 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011830 con 0x7fa04c0a0a70 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa04b7fe700 1 -- 172.21.15.125:0/3306650732 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040011990 con 0x7fa04c0a0a70 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.923+0000 7fa04b7fe700 1 -- 172.21.15.125:0/3306650732 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011d20 con 0x7fa04c0a0a70 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 -- 172.21.15.125:0/3306650732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 msgr2=0x7fa04c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 --2- 172.21.15.125:0/3306650732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098f0 tx=0x7fa040009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:37.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 -- 172.21.15.125:0/3306650732 shutdown_connections 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 --2- 172.21.15.125:0/3306650732 >> v2:172.21.15.125:3300/0 conn(0x7fa04c134120 0x7fa04c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 --2- 172.21.15.125:0/3306650732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c0a0e40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 -- 172.21.15.125:0/3306650732 >> 172.21.15.125:0/3306650732 conn(0x7fa04c0a6610 msgr2=0x7fa04c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 -- 172.21.15.125:0/3306650732 shutdown_connections 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.924+0000 7fa05317c700 1 -- 172.21.15.125:0/3306650732 wait complete. 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.925+0000 7fa05317c700 1 Processor -- start 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.925+0000 7fa05317c700 1 -- start start 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 0x7fa04c1231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c123ba0 con 0x7fa04c0a1380 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c125c70 con 0x7fa04c0a0a70 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa05317c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c133640 con 0x7fa04c134120 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa051719700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 0x7fa04c1231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37744/0 (socket says 172.21.15.125:37744) 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 -- 172.21.15.125:0/3324735012 learned_addr learned my addr 172.21.15.125:0/3324735012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa050f18700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 -- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 msgr2=0x7fa04c1231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 0x7fa04c1231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 -- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 msgr2=0x7fa04c122740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.926+0000 7fa04bfff700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c122740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa04bfff700 1 -- 172.21.15.125:0/3324735012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009a70 con 0x7fa04c0a1380 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa050f18700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa051719700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 0x7fa04c1231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa04bfff700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c4f0 tx=0x7fa03800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380052d0 con 0x7fa04c0a1380 2023-10-03T10:16:37.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038005430 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa040009550 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038003880 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.927+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0a0430 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.928+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c126a60 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.928+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0380039e0 con 0x7fa04c0a1380 2023-10-03T10:16:37.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.928+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa03803ef60 con 0x7fa04c0a1380 2023-10-03T10:16:37.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.932+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa03806a750 con 0x7fa04c0a1380 2023-10-03T10:16:37.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.962+0000 7fb6ddfa3700 1 Processor -- start 2023-10-03T10:16:37.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.962+0000 7fb6ddfa3700 1 -- start start 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 0x7fb6d8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80a0920 con 0x7fb6d8131d70 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d809c970 con 0x7fb6d809f180 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ddfa3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d809bab0 con 0x7fb6d809e870 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 0x7fb6d8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46202/0 (socket says 172.21.15.125:46202) 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 -- 172.21.15.125:0/3839303488 learned_addr learned my addr 172.21.15.125:0/3839303488 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37758/0 (socket says 172.21.15.125:37758) 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 -- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 msgr2=0x7fb6d8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 0x7fb6d8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 -- 172.21.15.125:0/3839303488 >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 msgr2=0x7fb6d8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 --2- 172.21.15.125:0/3839303488 >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d77fe700 1 -- 172.21.15.125:0/3839303488 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d809f9c0 con 0x7fb6d809e870 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6d7fff700 1 --2- 172.21.15.125:0/3839303488 >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.963+0000 7fb6ceffd700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 0x7fb6d8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6d77fe700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098f0 tx=0x7fb6c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4462af0f441c9414 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6d6ffd700 1 -- 172.21.15.125:0/3839303488 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011830 con 0x7fb6d809e870 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6d6ffd700 1 -- 172.21.15.125:0/3839303488 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8011990 con 0x7fb6d809e870 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6d6ffd700 1 -- 172.21.15.125:0/3839303488 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011d20 con 0x7fb6d809e870 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 msgr2=0x7fb6d809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098f0 tx=0x7fb6c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/3839303488 shutdown_connections 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/3839303488 >> v2:172.21.15.125:3300/0 conn(0x7fb6d8131d70 0x7fb6d8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809e870 0x7fb6d809ec40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/3839303488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d809f180 0x7fb6d8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/3839303488 >> 172.21.15.125:0/3839303488 conn(0x7fb6d80a4430 msgr2=0x7fb6d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/3839303488 shutdown_connections 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.964+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/3839303488 wait complete. 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.965+0000 7fb6ddfa3700 1 Processor -- start 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.965+0000 7fb6ddfa3700 1 -- start start 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 0x7fb6d806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d8131d70 0x7fb6d806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81306e0 con 0x7fb6d809e870 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8124ad0 con 0x7fb6d8131d70 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ddfa3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80a2bf0 con 0x7fb6d809f180 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 0x7fb6d806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37774/0 (socket says 172.21.15.125:37774) 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6d77fe700 1 -- 172.21.15.125:0/21286529 learned_addr learned my addr 172.21.15.125:0/21286529 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6d7fff700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d8131d70 0x7fb6d806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 -- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d8131d70 msgr2=0x7fb6d806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d8131d70 0x7fb6d806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 -- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 msgr2=0x7fb6d806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 -- 172.21.15.125:0/21286529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00094a0 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6d77fe700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.966+0000 7fb6ceffd700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 0x7fb6d806bdc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80a1a80 tx=0x7fb6c000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0004030 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0004190 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d0009a70 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0004540 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c8009550 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.967+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6c00036a0 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.968+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6c003fb90 con 0x7fb6d809f180 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.968+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d811be60 con 0x7fb6d809f180 2023-10-03T10:16:37.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:37.972+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6c0024350 con 0x7fb6d809f180 2023-10-03T10:16:38.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.128+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa04c125e90 con 0x7fa04c0a1380 2023-10-03T10:16:38.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.129+0000 7fa0497fa700 1 -- 172.21.15.125:0/3324735012 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa038017020 con 0x7fa04c0a1380 2023-10-03T10:16:38.129 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:38.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 msgr2=0x7fa04c122c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c4f0 tx=0x7fa03800c800 comp rx=0 tx=0).stop 2023-10-03T10:16:38.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 shutdown_connections 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa04c134120 0x7fa04c1231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa04c0a0a70 0x7fa04c122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 --2- 172.21.15.125:0/3324735012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa04c0a1380 0x7fa04c122c80 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 >> 172.21.15.125:0/3324735012 conn(0x7fa04c0a6610 msgr2=0x7fa04c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 shutdown_connections 2023-10-03T10:16:38.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.131+0000 7fa05317c700 1 -- 172.21.15.125:0/3324735012 wait complete. 2023-10-03T10:16:38.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.167+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6d804f2a0 con 0x7fb6d809f180 2023-10-03T10:16:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.167+0000 7fb6d4ff9700 1 -- 172.21.15.125:0/21286529 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6c001bba0 con 0x7fb6d809f180 2023-10-03T10:16:38.168 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 msgr2=0x7fb6d806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 0x7fb6d806bdc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80a1a80 tx=0x7fb6c000ec60 comp rx=0 tx=0).stop 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 shutdown_connections 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6d8131d70 0x7fb6d806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6d809e870 0x7fb6d806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 --2- 172.21.15.125:0/21286529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb6d809f180 0x7fb6d806bdc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 >> 172.21.15.125:0/21286529 conn(0x7fb6d80a4430 msgr2=0x7fb6d81310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 shutdown_connections 2023-10-03T10:16:38.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.169+0000 7fb6ddfa3700 1 -- 172.21.15.125:0/21286529 wait complete. 2023-10-03T10:16:38.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:38.220 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:38.260 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:38.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.347+0000 7f7fdfa7b700 1 Processor -- start 2023-10-03T10:16:38.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.347+0000 7f7fdfa7b700 1 -- start start 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdfa7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd81335f0 0x7f7fd81359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdfa7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd81382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdfa7b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd809bb90 con 0x7f7fd812d380 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdfa7b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd809c210 con 0x7f7fd81335f0 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdfa7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd809ced0 con 0x7f7fd8135f10 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd81335f0 0x7f7fd81359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fde018700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd81382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd81335f0 0x7f7fd81359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37778/0 (socket says 172.21.15.125:37778) 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd817700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7fd812d380 0x7f7fd812d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47526/0 (socket says 172.21.15.125:47526) 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 -- 172.21.15.125:0/1542251595 learned_addr learned my addr 172.21.15.125:0/1542251595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 -- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 msgr2=0x7f7fd81382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd81382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 -- 172.21.15.125:0/1542251595 >> v1:172.21.15.125:6789/0 conn(0x7f7fd812d380 legacy=0x7f7fd812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 -- 172.21.15.125:0/1542251595 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd809ac30 con 0x7f7fd81335f0 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdc815700 1 -- 172.21.15.125:0/1542251595 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222819622 0 0) 0x7f7fd809bb90 con 0x7f7fd812d380 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fde018700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd81382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdd016700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd81335f0 0x7f7fd81359d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800bb90 tx=0x7f7fc800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb797a75daca959a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdc815700 1 -- 172.21.15.125:0/1542251595 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800dd30 con 0x7f7fd81335f0 2023-10-03T10:16:38.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.348+0000 7f7fdc815700 1 -- 172.21.15.125:0/1542251595 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc800de90 con 0x7f7fd81335f0 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdc815700 1 -- 172.21.15.125:0/1542251595 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8010690 con 0x7f7fd81335f0 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd81335f0 msgr2=0x7f7fd81359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd81335f0 0x7f7fd81359d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800bb90 tx=0x7f7fc800bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/1542251595 shutdown_connections 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd81382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/1542251595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd81335f0 0x7f7fd81359d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/1542251595 >> 172.21.15.125:0/1542251595 conn(0x7f7fd80a2980 msgr2=0x7f7fd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/1542251595 shutdown_connections 2023-10-03T10:16:38.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.349+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/1542251595 wait complete. 2023-10-03T10:16:38.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.350+0000 7f7fdfa7b700 1 Processor -- start 2023-10-03T10:16:38.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.350+0000 7f7fdfa7b700 1 -- start start 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.350+0000 7f7fdfa7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 0x7f7fd806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.350+0000 7f7fdfa7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.350+0000 7f7fdfa7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdfa7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd81194a0 con 0x7f7fd812d380 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdfa7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd8070c60 con 0x7f7fd81335f0 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdfa7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd8071170 con 0x7f7fd8135f10 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd817700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 0x7f7fd806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fde018700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44404/0 (socket says 172.21.15.125:44404) 2023-10-03T10:16:38.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 -- 172.21.15.125:0/73272906 learned_addr learned my addr 172.21.15.125:0/73272906 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 -- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 msgr2=0x7f7fd806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 -- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 msgr2=0x7f7fd806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 0x7f7fd806efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 -- 172.21.15.125:0/73272906 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009a70 con 0x7f7fd81335f0 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd817700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 0x7f7fd806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fde018700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdd016700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8000c00 tx=0x7f7fc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc801f070 con 0x7f7fd81335f0 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80038b0 con 0x7f7fd81335f0 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003c20 con 0x7f7fd81335f0 2023-10-03T10:16:38.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc800b7f0 con 0x7f7fd81335f0 2023-10-03T10:16:38.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.351+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd8119930 con 0x7f7fd81335f0 2023-10-03T10:16:38.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.352+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fc8019400 con 0x7f7fd81335f0 2023-10-03T10:16:38.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.352+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fc8042ab0 con 0x7f7fd81335f0 2023-10-03T10:16:38.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.352+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd804f2a0 con 0x7f7fd81335f0 2023-10-03T10:16:38.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.357+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fc8029080 con 0x7f7fd81335f0 2023-10-03T10:16:38.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 Processor -- start 2023-10-03T10:16:38.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 -- start start 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01409da80 con 0x7fd01406b080 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01409dce0 con 0x7fd014131ec0 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.392+0000 7fd01c7c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01409eb20 con 0x7fd01406a770 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01ad65700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01ad65700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37794/0 (socket says 172.21.15.125:37794) 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44414/0 (socket says 172.21.15.125:44414) 2023-10-03T10:16:38.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01ad65700 1 -- 172.21.15.125:0/3344088917 learned_addr learned my addr 172.21.15.125:0/3344088917 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd019d63700 1 --1- 172.21.15.125:0/3344088917 >> v1:172.21.15.125:6789/0 conn(0x7fd01406b080 0x7fd0141317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47528/0 (socket says 172.21.15.125:47528) 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 -- 172.21.15.125:0/3344088917 >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 msgr2=0x7fd014139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 --2- 172.21.15.125:0/3344088917 >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 -- 172.21.15.125:0/3344088917 >> v1:172.21.15.125:6789/0 conn(0x7fd01406b080 legacy=0x7fd0141317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 -- 172.21.15.125:0/3344088917 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01409d860 con 0x7fd01406a770 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01ad65700 1 --2- 172.21.15.125:0/3344088917 >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd01a564700 1 --2- 172.21.15.125:0/3344088917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd010009840 tx=0x7fd010009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686f7f183e45b84e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd019562700 1 -- 172.21.15.125:0/3344088917 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010011830 con 0x7fd01406a770 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd019562700 1 -- 172.21.15.125:0/3344088917 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010011990 con 0x7fd01406a770 2023-10-03T10:16:38.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.393+0000 7fd019562700 1 -- 172.21.15.125:0/3344088917 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010011d20 con 0x7fd01406a770 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 -- 172.21.15.125:0/3344088917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 msgr2=0x7fd01406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/3344088917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd010009840 tx=0x7fd010009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 -- 172.21.15.125:0/3344088917 shutdown_connections 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/3344088917 >> v2:172.21.15.125:3300/0 conn(0x7fd014131ec0 0x7fd014139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/3344088917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406a770 0x7fd01406ab40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 -- 172.21.15.125:0/3344088917 >> 172.21.15.125:0/3344088917 conn(0x7fd014099c40 msgr2=0x7fd0140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 -- 172.21.15.125:0/3344088917 shutdown_connections 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.394+0000 7fd01c7c8700 1 -- 172.21.15.125:0/3344088917 wait complete. 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 Processor -- start 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 -- start start 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406b080 0x7fd01411f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd014131ec0 0x7fd01411fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd014122bc0 con 0x7fd01406a770 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd014121b40 con 0x7fd01406b080 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01c7c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd014071e10 con 0x7fd014131ec0 2023-10-03T10:16:38.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01a564700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01ad65700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd014131ec0 0x7fd01411fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd019d63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406b080 0x7fd01411f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01a564700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37800/0 (socket says 172.21.15.125:37800) 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.395+0000 7fd01a564700 1 -- 172.21.15.125:0/2817087872 learned_addr learned my addr 172.21.15.125:0/2817087872 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 -- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd014131ec0 msgr2=0x7fd01411fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd014131ec0 0x7fd01411fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 -- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406b080 msgr2=0x7fd01411f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406b080 0x7fd01411f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 -- 172.21.15.125:0/2817087872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c009b30 con 0x7fd01406a770 2023-10-03T10:16:38.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01a564700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd0100090b0 tx=0x7fd010004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100036a0 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01001f070 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0100094a0 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010003a60 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.396+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd014120cb0 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.397+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd010003bc0 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.397+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd010021070 con 0x7fd01406a770 2023-10-03T10:16:38.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.397+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01411bde0 con 0x7fd01406a770 2023-10-03T10:16:38.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.401+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd010040e60 con 0x7fd01406a770 2023-10-03T10:16:38.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.553+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fd80713b0 con 0x7f7fd81335f0 2023-10-03T10:16:38.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.554+0000 7f7fce7fc700 1 -- 172.21.15.125:0/73272906 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fc800e360 con 0x7f7fd81335f0 2023-10-03T10:16:38.554 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:38.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 msgr2=0x7f7fd806f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8000c00 tx=0x7f7fc8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 shutdown_connections 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7fd8135f10 0x7f7fd806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fd812d380 0x7f7fd806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 --2- 172.21.15.125:0/73272906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fd81335f0 0x7f7fd806f520 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 >> 172.21.15.125:0/73272906 conn(0x7f7fd80a2980 msgr2=0x7f7fd809f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 shutdown_connections 2023-10-03T10:16:38.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.556+0000 7f7fdfa7b700 1 -- 172.21.15.125:0/73272906 wait complete. 2023-10-03T10:16:38.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:38.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.596+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd01404f2a0 con 0x7fd01406a770 2023-10-03T10:16:38.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.596+0000 7fd00affd700 1 -- 172.21.15.125:0/2817087872 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd010015020 con 0x7fd01406a770 2023-10-03T10:16:38.597 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:38.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.598+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 msgr2=0x7fd01411f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.598+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd0100090b0 tx=0x7fd010004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 shutdown_connections 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd014131ec0 0x7fd01411fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406a770 0x7fd01411f0f0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 --2- 172.21.15.125:0/2817087872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd01406b080 0x7fd01411f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 >> 172.21.15.125:0/2817087872 conn(0x7fd014099c40 msgr2=0x7fd014130fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 shutdown_connections 2023-10-03T10:16:38.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:38.599+0000 7fd01c7c8700 1 -- 172.21.15.125:0/2817087872 wait complete. 2023-10-03T10:16:38.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:39.144 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:39.183 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.270+0000 7f7f89675700 1 Processor -- start 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.270+0000 7f7f89675700 1 -- start start 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f89675700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f8409f350 0x7f7f84136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f89675700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 0x7f7f841395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f89675700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8409c970 con 0x7f7f8409e870 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f89675700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840a0920 con 0x7f7f8409f350 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f89675700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409f9c0 con 0x7f7f841371c0 2023-10-03T10:16:39.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f8409f350 0x7f7f84136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f8409f350 0x7f7f84136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37802/0 (socket says 172.21.15.125:37802) 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 -- 172.21.15.125:0/714569857 learned_addr learned my addr 172.21.15.125:0/714569857 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f837fe700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 0x7f7f841395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f82ffd700 1 --1- 172.21.15.125:0/714569857 >> v1:172.21.15.125:6789/0 conn(0x7f7f8409e870 0x7f7f8409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47534/0 (socket says 172.21.15.125:47534) 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 -- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 msgr2=0x7f7f841395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 0x7f7f841395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 -- 172.21.15.125:0/714569857 >> v1:172.21.15.125:6789/0 conn(0x7f7f8409e870 legacy=0x7f7f8409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 -- 172.21.15.125:0/714569857 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8409bab0 con 0x7f7f8409f350 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f81ffb700 1 -- 172.21.15.125:0/714569857 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150861533 0 0) 0x7f7f8409c970 con 0x7f7f8409e870 2023-10-03T10:16:39.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f837fe700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 0x7f7f841395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f827fc700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f8409f350 0x7f7f84136c80 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7f780098f0 tx=0x7f7f78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04e93f06ca6e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f81ffb700 1 -- 172.21.15.125:0/714569857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78011830 con 0x7f7f8409f350 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f81ffb700 1 -- 172.21.15.125:0/714569857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f78011990 con 0x7f7f8409f350 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.271+0000 7f7f81ffb700 1 -- 172.21.15.125:0/714569857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78011d20 con 0x7f7f8409f350 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 -- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f8409f350 msgr2=0x7f7f84136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f8409f350 0x7f7f84136c80 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7f780098f0 tx=0x7f7f78009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 -- 172.21.15.125:0/714569857 shutdown_connections 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f841371c0 0x7f7f841395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 --2- 172.21.15.125:0/714569857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f8409f350 0x7f7f84136c80 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 -- 172.21.15.125:0/714569857 >> 172.21.15.125:0/714569857 conn(0x7f7f840a4430 msgr2=0x7f7f840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 -- 172.21.15.125:0/714569857 shutdown_connections 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.272+0000 7f7f89675700 1 -- 172.21.15.125:0/714569857 wait complete. 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.273+0000 7f7f89675700 1 Processor -- start 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.273+0000 7f7f89675700 1 -- start start 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.273+0000 7f7f89675700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f8409f350 0x7f7f84120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84122310 con 0x7f7f841371c0 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409dba0 con 0x7f7f8409e870 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84123fb0 con 0x7f7f8409f350 2023-10-03T10:16:39.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44442/0 (socket says 172.21.15.125:44442) 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37810/0 (socket says 172.21.15.125:37810) 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 -- 172.21.15.125:0/968234473 learned_addr learned my addr 172.21.15.125:0/968234473 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f827fc700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f8409f350 0x7f7f84120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 -- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f8409f350 msgr2=0x7f7f84120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f8409f350 0x7f7f84120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 -- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 msgr2=0x7f7f84121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 -- 172.21.15.125:0/968234473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009a70 con 0x7f7f8409e870 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f837fe700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f82ffd700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c520 tx=0x7f7f7400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74004c80 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74004e00 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74007310 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f78009550 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.274+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f841365f0 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.275+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f74007470 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.275+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f7403f210 con 0x7f7f8409e870 2023-10-03T10:16:39.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.275+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8404f2a0 con 0x7f7f8409e870 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.284+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f740123b0 con 0x7f7f8409e870 2023-10-03T10:16:39.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.315+0000 7ff4611b4700 1 Processor -- start 2023-10-03T10:16:39.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.315+0000 7ff4611b4700 1 -- start start 2023-10-03T10:16:39.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff4611b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 0x7ff45c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff4611b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 0x7ff45c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff4611b4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c09dc00 con 0x7ff45c133f50 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff4611b4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c09ea60 con 0x7ff45c0a0a70 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff4611b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c09dec0 con 0x7ff45c0a1380 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 0x7ff45c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 0x7ff45c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff45c133f50 0x7ff45c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47550/0 (socket says 172.21.15.125:47550) 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45b59e700 1 -- 172.21.15.125:0/321362502 learned_addr learned my addr 172.21.15.125:0/321362502 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45a59c700 1 -- 172.21.15.125:0/321362502 >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 msgr2=0x7ff45c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45a59c700 1 --2- 172.21.15.125:0/321362502 >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 0x7ff45c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45a59c700 1 -- 172.21.15.125:0/321362502 >> v1:172.21.15.125:6789/0 conn(0x7ff45c133f50 legacy=0x7ff45c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45a59c700 1 -- 172.21.15.125:0/321362502 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c09e6a0 con 0x7ff45c0a1380 2023-10-03T10:16:39.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.316+0000 7ff45ad9d700 1 --2- 172.21.15.125:0/321362502 >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 0x7ff45c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.317+0000 7ff45a59c700 1 --2- 172.21.15.125:0/321362502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 0x7ff45c133a10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff450009840 tx=0x7ff450009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd7282d6fc24b7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.317+0000 7ff459d9b700 1 -- 172.21.15.125:0/321362502 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011830 con 0x7ff45c0a1380 2023-10-03T10:16:39.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.317+0000 7ff459d9b700 1 -- 172.21.15.125:0/321362502 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450011990 con 0x7ff45c0a1380 2023-10-03T10:16:39.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.317+0000 7ff459d9b700 1 -- 172.21.15.125:0/321362502 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011d20 con 0x7ff45c0a1380 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 -- 172.21.15.125:0/321362502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 msgr2=0x7ff45c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 --2- 172.21.15.125:0/321362502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 0x7ff45c133a10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff450009840 tx=0x7ff450009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 -- 172.21.15.125:0/321362502 shutdown_connections 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 --2- 172.21.15.125:0/321362502 >> v2:172.21.15.125:3300/0 conn(0x7ff45c0a0a70 0x7ff45c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 --2- 172.21.15.125:0/321362502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c0a1380 0x7ff45c133a10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 -- 172.21.15.125:0/321362502 >> 172.21.15.125:0/321362502 conn(0x7ff45c0a6610 msgr2=0x7ff45c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 -- 172.21.15.125:0/321362502 shutdown_connections 2023-10-03T10:16:39.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.318+0000 7ff4611b4700 1 -- 172.21.15.125:0/321362502 wait complete. 2023-10-03T10:16:39.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.319+0000 7ff4611b4700 1 Processor -- start 2023-10-03T10:16:39.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.319+0000 7ff4611b4700 1 -- start start 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 0x7ff45c1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 0x7ff45c1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c122e90 con 0x7ff45c0a0a70 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c133a10 con 0x7ff45c0a1380 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff4611b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0a03e0 con 0x7ff45c133f50 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff45ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 0x7ff45c1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff45b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46250/0 (socket says 172.21.15.125:46250) 2023-10-03T10:16:39.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 0x7ff45c1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.320+0000 7ff45b59e700 1 -- 172.21.15.125:0/723903757 learned_addr learned my addr 172.21.15.125:0/723903757 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 -- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 msgr2=0x7ff45c1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 0x7ff45c1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 -- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 msgr2=0x7ff45c1c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 0x7ff45c1c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 -- 172.21.15.125:0/723903757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0094a0 con 0x7ff45c133f50 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45a59c700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 0x7ff45c1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45ad9d700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 0x7ff45c1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff45b59e700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff45400cbc0 tx=0x7ff45400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45400a9e0 con 0x7ff45c133f50 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400ab40 con 0x7ff45c133f50 2023-10-03T10:16:39.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454012400 con 0x7ff45c133f50 2023-10-03T10:16:39.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4500094a0 con 0x7ff45c133f50 2023-10-03T10:16:39.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.321+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c126030 con 0x7ff45c133f50 2023-10-03T10:16:39.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.322+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff45401b3b0 con 0x7ff45c133f50 2023-10-03T10:16:39.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.322+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c126dd0 con 0x7ff45c133f50 2023-10-03T10:16:39.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.322+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff45403f290 con 0x7ff45c133f50 2023-10-03T10:16:39.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.326+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff454017020 con 0x7ff45c133f50 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.476+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f841238a0 con 0x7f7f8409e870 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.476+0000 7f7f6b7fe700 1 -- 172.21.15.125:0/968234473 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f74011360 con 0x7f7f8409e870 2023-10-03T10:16:39.477 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 msgr2=0x7f7f84120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c520 tx=0x7f7f7400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 shutdown_connections 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f841371c0 0x7f7f84121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f8409e870 0x7f7f84120700 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 --2- 172.21.15.125:0/968234473 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f8409f350 0x7f7f84120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 >> 172.21.15.125:0/968234473 conn(0x7f7f840a4430 msgr2=0x7f7f840a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 shutdown_connections 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.478+0000 7f7f89675700 1 -- 172.21.15.125:0/968234473 wait complete. 2023-10-03T10:16:39.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.516+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff45c1261c0 con 0x7ff45c133f50 2023-10-03T10:16:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.516+0000 7ff4437fe700 1 -- 172.21.15.125:0/723903757 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4540192c0 con 0x7ff45c133f50 2023-10-03T10:16:39.516 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:39.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 msgr2=0x7ff45c1c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff45400cbc0 tx=0x7ff45400ced0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 shutdown_connections 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff45c133f50 0x7ff45c1c8cd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff45c0a0a70 0x7ff45c1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 --2- 172.21.15.125:0/723903757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff45c0a1380 0x7ff45c1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 >> 172.21.15.125:0/723903757 conn(0x7ff45c0a6610 msgr2=0x7ff45c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 shutdown_connections 2023-10-03T10:16:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.518+0000 7ff4611b4700 1 -- 172.21.15.125:0/723903757 wait complete. 2023-10-03T10:16:39.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:39.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:39.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:39.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.695+0000 7f9276c6a700 1 Processor -- start 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 -- start start 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 0x7f92701343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927009e9d0 con 0x7f92700a0a70 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927009dc00 con 0x7f92700a1380 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9276c6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927009dec0 con 0x7f9270133f50 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f926ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9274a06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9274a06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37854/0 (socket says 172.21.15.125:37854) 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f926ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44458/0 (socket says 172.21.15.125:44458) 2023-10-03T10:16:39.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9274a06700 1 -- 172.21.15.125:0/2044443751 learned_addr learned my addr 172.21.15.125:0/2044443751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.696+0000 7f9275207700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 0x7f92701343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 -- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 msgr2=0x7f9270133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 -- 172.21.15.125:0/2044443751 >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 msgr2=0x7f92700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 --2- 172.21.15.125:0/2044443751 >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 -- 172.21.15.125:0/2044443751 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927009e6a0 con 0x7f9270133f50 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9274a06700 1 --2- 172.21.15.125:0/2044443751 >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f926ffff700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9275207700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 0x7f92701343b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f926800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3054380111047c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f926f7fe700 1 -- 172.21.15.125:0/2044443751 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800e070 con 0x7f9270133f50 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f926f7fe700 1 -- 172.21.15.125:0/2044443751 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800bb20 con 0x7f9270133f50 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f926f7fe700 1 -- 172.21.15.125:0/2044443751 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268012430 con 0x7f9270133f50 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 -- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 msgr2=0x7f92701343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 0x7f92701343b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f926800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:39.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 -- 172.21.15.125:0/2044443751 shutdown_connections 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9270133f50 0x7f92701343b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 --2- 172.21.15.125:0/2044443751 >> v2:172.21.15.125:3300/0 conn(0x7f92700a0a70 0x7f92700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 --2- 172.21.15.125:0/2044443751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a1380 0x7f9270133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.697+0000 7f9276c6a700 1 -- 172.21.15.125:0/2044443751 >> 172.21.15.125:0/2044443751 conn(0x7f92700a6610 msgr2=0x7f92700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.698+0000 7f9276c6a700 1 -- 172.21.15.125:0/2044443751 shutdown_connections 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.698+0000 7f9276c6a700 1 -- 172.21.15.125:0/2044443751 wait complete. 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.698+0000 7f9276c6a700 1 Processor -- start 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.698+0000 7f9276c6a700 1 -- start start 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 0x7f92701218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9270133f50 0x7f9270121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270124960 con 0x7f9270133f50 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9270124c50 con 0x7f92700a0a70 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9276c6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9270122f80 con 0x7f92700a1380 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44466/0 (socket says 172.21.15.125:44466) 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 -- 172.21.15.125:0/3447790967 learned_addr learned my addr 172.21.15.125:0/3447790967 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f926ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 0x7f92701218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9275207700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9270133f50 0x7f9270121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 -- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 msgr2=0x7f92701218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 0x7f92701218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.699+0000 7f9274a06700 1 -- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9270133f50 msgr2=0x7f9270121df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f9274a06700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9270133f50 0x7f9270121df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f9274a06700 1 -- 172.21.15.125:0/3447790967 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009550 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f926ffff700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 0x7f92701218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f9274a06700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f926400ebe0 tx=0x7f926400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264004030 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264004190 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c0094a0 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264004520 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.700+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9268009a70 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.701+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f926400c850 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.701+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f926403f500 con 0x7f92700a0a70 2023-10-03T10:16:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.701+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927011e040 con 0x7f92700a0a70 2023-10-03T10:16:39.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.706+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92640036a0 con 0x7f92700a0a70 2023-10-03T10:16:39.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.745+0000 7ff18dad2700 1 Processor -- start 2023-10-03T10:16:39.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.745+0000 7ff18dad2700 1 -- start start 2023-10-03T10:16:39.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff18dad2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 0x7ff188130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff18dad2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 0x7ff18809dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff18dad2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18809c1f0 con 0x7ff18809e280 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff18dad2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18806dc20 con 0x7ff1881309f0 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff18dad2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff18809b1f0 con 0x7ff18809d8f0 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff17effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 0x7ff18809dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff187fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff18809e280 0x7ff188137750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47554/0 (socket says 172.21.15.125:47554) 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff1877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 0x7ff188130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff187fff700 1 -- 172.21.15.125:0/2212126785 learned_addr learned my addr 172.21.15.125:0/2212126785 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff186ffd700 1 -- 172.21.15.125:0/2212126785 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454800651 0 0) 0x7ff18809c1f0 con 0x7ff18809e280 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff186ffd700 1 -- 172.21.15.125:0/2212126785 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1740035b0 con 0x7ff18809e280 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff1877fe700 1 -- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 msgr2=0x7ff18809dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff1877fe700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 0x7ff18809dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff1877fe700 1 -- 172.21.15.125:0/2212126785 >> v1:172.21.15.125:6789/0 conn(0x7ff18809e280 legacy=0x7ff188137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff1877fe700 1 -- 172.21.15.125:0/2212126785 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188131300 con 0x7ff1881309f0 2023-10-03T10:16:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.746+0000 7ff17effd700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 0x7ff18809dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff1877fe700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 0x7ff188130dc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff178009850 tx=0x7ff178009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e00e79e22e6286 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff186ffd700 1 -- 172.21.15.125:0/2212126785 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178005e30 con 0x7ff1881309f0 2023-10-03T10:16:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff186ffd700 1 -- 172.21.15.125:0/2212126785 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178006030 con 0x7ff1881309f0 2023-10-03T10:16:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff186ffd700 1 -- 172.21.15.125:0/2212126785 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780063a0 con 0x7ff1881309f0 2023-10-03T10:16:39.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff18dad2700 1 -- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 msgr2=0x7ff188130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.747+0000 7ff18dad2700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 0x7ff188130dc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff178009850 tx=0x7ff178009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 -- 172.21.15.125:0/2212126785 shutdown_connections 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1881309f0 0x7ff188130dc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 --2- 172.21.15.125:0/2212126785 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff18809d8f0 0x7ff18809dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 -- 172.21.15.125:0/2212126785 >> 172.21.15.125:0/2212126785 conn(0x7ff1880a2b30 msgr2=0x7ff18809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 -- 172.21.15.125:0/2212126785 shutdown_connections 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.748+0000 7ff18dad2700 1 -- 172.21.15.125:0/2212126785 wait complete. 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.749+0000 7ff18dad2700 1 Processor -- start 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.749+0000 7ff18dad2700 1 -- start start 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 0x7ff18812c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1881309f0 0x7ff18812cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18809d270 con 0x7ff18809d8f0 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18809b430 con 0x7ff18809e280 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff18dad2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff18806efc0 con 0x7ff1881309f0 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37874/0 (socket says 172.21.15.125:37874) 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff17effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 0x7ff18812c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 -- 172.21.15.125:0/3446662623 learned_addr learned my addr 172.21.15.125:0/3446662623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff187fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1881309f0 0x7ff18812cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 -- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1881309f0 msgr2=0x7ff18812cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1881309f0 0x7ff18812cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 -- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 msgr2=0x7ff18812c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 0x7ff18812c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 -- 172.21.15.125:0/3446662623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700094a0 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff17effd700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 0x7ff18812c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.750+0000 7ff1877fe700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff178000c00 tx=0x7ff178004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178006a80 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178004040 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff178009430 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780043d0 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18806fcf0 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff178022070 con 0x7ff18809d8f0 2023-10-03T10:16:39.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.751+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff178040c10 con 0x7ff18809d8f0 2023-10-03T10:16:39.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.753+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18804f2a0 con 0x7ff18809d8f0 2023-10-03T10:16:39.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.757+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff178025470 con 0x7ff18809d8f0 2023-10-03T10:16:39.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.927+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92700a03e0 con 0x7f92700a0a70 2023-10-03T10:16:39.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.928+0000 7f926d7fa700 1 -- 172.21.15.125:0/3447790967 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9264019ab0 con 0x7f92700a0a70 2023-10-03T10:16:39.928 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 msgr2=0x7f9270121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f926400ebe0 tx=0x7f926400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 shutdown_connections 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9270133f50 0x7f9270121df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92700a0a70 0x7f9270121370 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 --2- 172.21.15.125:0/3447790967 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92700a1380 0x7f92701218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 >> 172.21.15.125:0/3447790967 conn(0x7f92700a6610 msgr2=0x7f9270133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 shutdown_connections 2023-10-03T10:16:39.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.930+0000 7f9276c6a700 1 -- 172.21.15.125:0/3447790967 wait complete. 2023-10-03T10:16:39.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.970+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff18806b2a0 con 0x7ff18809d8f0 2023-10-03T10:16:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.970+0000 7ff184ff9700 1 -- 172.21.15.125:0/3446662623 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff17802e3f0 con 0x7ff18809d8f0 2023-10-03T10:16:39.971 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 msgr2=0x7ff18812c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff178000c00 tx=0x7ff178004750 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 shutdown_connections 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff1881309f0 0x7ff18812cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff18809d8f0 0x7ff18812c060 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 --2- 172.21.15.125:0/3446662623 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff18809e280 0x7ff18812c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 >> 172.21.15.125:0/3446662623 conn(0x7ff1880a2b30 msgr2=0x7ff1880993e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 shutdown_connections 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:39.972+0000 7ff18dad2700 1 -- 172.21.15.125:0/3446662623 wait complete. 2023-10-03T10:16:39.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:40.492 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:40.531 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 Processor -- start 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 -- start start 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 0x7f62800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f62801343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628009e9d0 con 0x7f62800a0a70 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628009dc00 con 0x7f62800a1380 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.623+0000 7f6284991700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628009dec0 con 0x7f6280133f50 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f62801343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 0x7f62800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44510/0 (socket says 172.21.15.125:44510) 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627dd9b700 1 -- 172.21.15.125:0/1821546495 learned_addr learned my addr 172.21.15.125:0/1821546495 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 -- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 msgr2=0x7f6280133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 -- 172.21.15.125:0/1821546495 >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 msgr2=0x7f62800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 --2- 172.21.15.125:0/1821546495 >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 0x7f62800a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 -- 172.21.15.125:0/1821546495 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628009e6a0 con 0x7f6280133f50 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627e59c700 1 --2- 172.21.15.125:0/1821546495 >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 0x7f62800a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627dd9b700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627ed9d700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f62801343b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6278009d90 tx=0x7f627800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461a653f4571cfb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627d59a700 1 -- 172.21.15.125:0/1821546495 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800e070 con 0x7f6280133f50 2023-10-03T10:16:40.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627d59a700 1 -- 172.21.15.125:0/1821546495 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800bb20 con 0x7f6280133f50 2023-10-03T10:16:40.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.624+0000 7f627d59a700 1 -- 172.21.15.125:0/1821546495 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278012430 con 0x7f6280133f50 2023-10-03T10:16:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 -- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 msgr2=0x7f62801343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f62801343b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6278009d90 tx=0x7f627800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:40.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 -- 172.21.15.125:0/1821546495 shutdown_connections 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f62801343b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 --2- 172.21.15.125:0/1821546495 >> v2:172.21.15.125:3300/0 conn(0x7f62800a0a70 0x7f62800a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 --2- 172.21.15.125:0/1821546495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 -- 172.21.15.125:0/1821546495 >> 172.21.15.125:0/1821546495 conn(0x7f62800a6610 msgr2=0x7f62800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 -- 172.21.15.125:0/1821546495 shutdown_connections 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.625+0000 7f6284991700 1 -- 172.21.15.125:0/1821546495 wait complete. 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 Processor -- start 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 -- start start 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6280124e50 con 0x7f62800a0a70 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6280123dd0 con 0x7f62800a1380 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.626+0000 7f6284991700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62800a03e0 con 0x7f6280133f50 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46298/0 (socket says 172.21.15.125:46298) 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37892/0 (socket says 172.21.15.125:37892) 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627ed9d700 1 -- 172.21.15.125:0/3680951373 learned_addr learned my addr 172.21.15.125:0/3680951373 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627dd9b700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 -- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 msgr2=0x7f6280121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 -- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 msgr2=0x7f6280121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 -- 172.21.15.125:0/3680951373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094a0 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627ed9d700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f627e59c700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f627000e9b0 tx=0x7f627000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000ee50 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270004030 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6274009550 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700043c0 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.627+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278009a70 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.628+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f627000c7f0 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.628+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f627003f4b0 con 0x7f62800a0a70 2023-10-03T10:16:40.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.628+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628011e040 con 0x7f62800a0a70 2023-10-03T10:16:40.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.633+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6270019d60 con 0x7f62800a0a70 2023-10-03T10:16:40.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 Processor -- start 2023-10-03T10:16:40.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 -- start start 2023-10-03T10:16:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 0x7f7ec40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 0x7f7ec4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec409dc00 con 0x7f7ec4133f50 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec409ea60 con 0x7f7ec40a0a70 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecc5e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec409dec0 con 0x7f7ec40a1380 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.663+0000 7f7ecab81700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7ec4133f50 0x7f7ec413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47568/0 (socket says 172.21.15.125:47568) 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ecab81700 1 -- 172.21.15.125:0/3392793547 learned_addr learned my addr 172.21.15.125:0/3392793547 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 0x7f7ec4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7eca380700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 0x7f7ec40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec937e700 1 -- 172.21.15.125:0/3392793547 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722866006 0 0) 0x7f7ec409dc00 con 0x7f7ec4133f50 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 -- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 msgr2=0x7f7ec40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 0x7f7ec40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 -- 172.21.15.125:0/3392793547 >> v1:172.21.15.125:6789/0 conn(0x7f7ec4133f50 legacy=0x7f7ec413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 -- 172.21.15.125:0/3392793547 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec409e6a0 con 0x7f7ec40a1380 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7eca380700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 0x7f7ec40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec9b7f700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 0x7f7ec4133a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009870 tx=0x7f7eb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebed03be7b7154b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec937e700 1 -- 172.21.15.125:0/3392793547 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011830 con 0x7f7ec40a1380 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec937e700 1 -- 172.21.15.125:0/3392793547 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4011990 con 0x7f7ec40a1380 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.664+0000 7f7ec937e700 1 -- 172.21.15.125:0/3392793547 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011d20 con 0x7f7ec40a1380 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 msgr2=0x7f7ec4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 0x7f7ec4133a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009870 tx=0x7f7eb4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/3392793547 shutdown_connections 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a0a70 0x7f7ec40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/3392793547 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec40a1380 0x7f7ec4133a10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/3392793547 >> 172.21.15.125:0/3392793547 conn(0x7f7ec40a6610 msgr2=0x7f7ec40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/3392793547 shutdown_connections 2023-10-03T10:16:40.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.665+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/3392793547 wait complete. 2023-10-03T10:16:40.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 Processor -- start 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 -- start start 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 0x7f7ec4122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec4133f50 0x7f7ec4123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41245b0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41249a0 con 0x7f7ec40a1380 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecc5e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40a03e0 con 0x7f7ec4133f50 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ec9b7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 0x7f7ec4122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7eca380700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7eca380700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37908/0 (socket says 172.21.15.125:37908) 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7eca380700 1 -- 172.21.15.125:0/2528279820 learned_addr learned my addr 172.21.15.125:0/2528279820 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ec9b7f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 0x7f7ec4122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44526/0 (socket says 172.21.15.125:44526) 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.666+0000 7f7ecab81700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec4133f50 0x7f7ec4123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 -- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec4133f50 msgr2=0x7f7ec4123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec4133f50 0x7f7ec4123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 -- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 msgr2=0x7f7ec4122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 0x7f7ec4122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 -- 172.21.15.125:0/2528279820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00094a0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7eca380700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000ebe0 tx=0x7f7ec000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000c850 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000c9b0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000cd40 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40094a0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.667+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec41339c0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.668+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ec0013470 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.668+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec4125d30 con 0x7f7ec40a0a70 2023-10-03T10:16:40.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.668+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ec003fae0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.673+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ec0013720 con 0x7f7ec40a0a70 2023-10-03T10:16:40.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.827+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f628004f2a0 con 0x7f62800a0a70 2023-10-03T10:16:40.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.827+0000 7f626effd700 1 -- 172.21.15.125:0/3680951373 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6270019300 con 0x7f62800a0a70 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 msgr2=0x7f6280121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f627000e9b0 tx=0x7f627000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 shutdown_connections 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6280133f50 0x7f6280121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62800a0a70 0x7f6280121330 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 --2- 172.21.15.125:0/3680951373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62800a1380 0x7f6280121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 >> 172.21.15.125:0/3680951373 conn(0x7f62800a6610 msgr2=0x7f6280133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 shutdown_connections 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.829+0000 7f6284991700 1 -- 172.21.15.125:0/3680951373 wait complete. 2023-10-03T10:16:40.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:40.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.866+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ec404f2a0 con 0x7f7ec40a0a70 2023-10-03T10:16:40.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.866+0000 7f7ebaffd700 1 -- 172.21.15.125:0/2528279820 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ec0021020 con 0x7f7ec40a0a70 2023-10-03T10:16:40.867 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 msgr2=0x7f7ec41228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000ebe0 tx=0x7f7ec000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 shutdown_connections 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7ec4133f50 0x7f7ec4123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40a0a70 0x7f7ec41228d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 --2- 172.21.15.125:0/2528279820 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec40a1380 0x7f7ec4122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 >> 172.21.15.125:0/2528279820 conn(0x7f7ec40a6610 msgr2=0x7f7ec40a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 shutdown_connections 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:40.868+0000 7f7ecc5e4700 1 -- 172.21.15.125:0/2528279820 wait complete. 2023-10-03T10:16:40.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:40.944 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:40.985 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.069+0000 7fe02c6a3700 1 Processor -- start 2023-10-03T10:16:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.069+0000 7fe02c6a3700 1 -- start start 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02c6a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02c6a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02c6a3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02409dc00 con 0x7fe0240a1380 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02c6a3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02409ea90 con 0x7fe0240a0a70 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02c6a3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02409dec0 con 0x7fe024134120 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02ac40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe029c3e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe0240a1380 0x7fe024133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47576/0 (socket says 172.21.15.125:47576) 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe029c3e700 1 -- 172.21.15.125:0/2025843337 learned_addr learned my addr 172.21.15.125:0/2025843337 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02ac40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46320/0 (socket says 172.21.15.125:46320) 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02943d700 1 -- 172.21.15.125:0/2025843337 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423585839 0 0) 0x7fe02409dc00 con 0x7fe0240a1380 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 -- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 msgr2=0x7fe02413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 -- 172.21.15.125:0/2025843337 >> v1:172.21.15.125:6789/0 conn(0x7fe0240a1380 legacy=0x7fe024133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 -- 172.21.15.125:0/2025843337 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02409e6a0 con 0x7fe0240a0a70 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02ac40700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0240a0e40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe020009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76eaca690573ff93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02943d700 1 -- 172.21.15.125:0/2025843337 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011830 con 0x7fe0240a0a70 2023-10-03T10:16:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02943d700 1 -- 172.21.15.125:0/2025843337 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe020011990 con 0x7fe0240a0a70 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.070+0000 7fe02943d700 1 -- 172.21.15.125:0/2025843337 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011d20 con 0x7fe0240a0a70 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 msgr2=0x7fe0240a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0240a0e40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe020009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2025843337 shutdown_connections 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe02413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2025843337 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0240a0e40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2025843337 >> 172.21.15.125:0/2025843337 conn(0x7fe0240a6610 msgr2=0x7fe0240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2025843337 shutdown_connections 2023-10-03T10:16:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.071+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2025843337 wait complete. 2023-10-03T10:16:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.072+0000 7fe02c6a3700 1 Processor -- start 2023-10-03T10:16:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.072+0000 7fe02c6a3700 1 -- start start 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0241c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 0x7fe0241c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241264b0 con 0x7fe0240a1380 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241247a0 con 0x7fe0240a0a70 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe024124d50 con 0x7fe024134120 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02ac40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02ac40700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46330/0 (socket says 172.21.15.125:46330) 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02ac40700 1 -- 172.21.15.125:0/2370242801 learned_addr learned my addr 172.21.15.125:0/2370242801 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0241c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe029c3e700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 0x7fe0241c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 -- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 msgr2=0x7fe0241c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 -- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 msgr2=0x7fe0241c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 0x7fe0241c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 -- 172.21.15.125:0/2370242801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c009a70 con 0x7fe0240a0a70 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe029c3e700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 0x7fe0241c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02ac40700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02a43f700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0241c8530 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe020016000 tx=0x7fe020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020004510 con 0x7fe0240a0a70 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02001f070 con 0x7fe0240a0a70 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200094a0 con 0x7fe0240a0a70 2023-10-03T10:16:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200038c0 con 0x7fe0240a0a70 2023-10-03T10:16:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.073+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02409d390 con 0x7fe0240a0a70 2023-10-03T10:16:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.074+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe020003a20 con 0x7fe0240a0a70 2023-10-03T10:16:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.074+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe024126f00 con 0x7fe0240a0a70 2023-10-03T10:16:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.074+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe020021070 con 0x7fe0240a0a70 2023-10-03T10:16:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.079+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0200253e0 con 0x7fe0240a0a70 2023-10-03T10:16:41.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.111+0000 7effdcb87700 1 Processor -- start 2023-10-03T10:16:41.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.111+0000 7effdcb87700 1 -- start start 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effdcb87700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd8130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effdcb87700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effdcb87700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd809c1f0 con 0x7effd809d8f0 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effdcb87700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd809b1f0 con 0x7effd809e450 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effdcb87700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd8131300 con 0x7effd81309f0 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd5d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7effd809d8f0 0x7effd809dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47578/0 (socket says 172.21.15.125:47578) 2023-10-03T10:16:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44562/0 (socket says 172.21.15.125:44562) 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd8130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd5d9b700 1 -- 172.21.15.125:0/2795251968 learned_addr learned my addr 172.21.15.125:0/2795251968 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 -- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 msgr2=0x7effd8138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 -- 172.21.15.125:0/2795251968 >> v1:172.21.15.125:6789/0 conn(0x7effd809d8f0 legacy=0x7effd809dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd559a700 1 -- 172.21.15.125:0/2795251968 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220596882 0 0) 0x7effd809c1f0 con 0x7effd809d8f0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 -- 172.21.15.125:0/2795251968 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd81305a0 con 0x7effd81309f0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd6d9d700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.112+0000 7effd659c700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd8130dc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7effc8009850 tx=0x7effc8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faff5d983ab9eb2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effd559a700 1 -- 172.21.15.125:0/2795251968 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8005e30 con 0x7effd81309f0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effd559a700 1 -- 172.21.15.125:0/2795251968 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8006030 con 0x7effd81309f0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effd559a700 1 -- 172.21.15.125:0/2795251968 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80063e0 con 0x7effd81309f0 2023-10-03T10:16:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 -- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 msgr2=0x7effd8130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd8130dc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7effc8009850 tx=0x7effc8009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 -- 172.21.15.125:0/2795251968 shutdown_connections 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd8138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 --2- 172.21.15.125:0/2795251968 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd8130dc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 -- 172.21.15.125:0/2795251968 >> 172.21.15.125:0/2795251968 conn(0x7effd80a2b30 msgr2=0x7effd809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 -- 172.21.15.125:0/2795251968 shutdown_connections 2023-10-03T10:16:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.113+0000 7effdcb87700 1 -- 172.21.15.125:0/2795251968 wait complete. 2023-10-03T10:16:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.114+0000 7effdcb87700 1 Processor -- start 2023-10-03T10:16:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.114+0000 7effdcb87700 1 -- start start 2023-10-03T10:16:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd81c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd81c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd808cb40 con 0x7effd809d8f0 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd808ceb0 con 0x7effd809e450 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effdcb87700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd809d1c0 con 0x7effd81309f0 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd81c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd5d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd81c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37930/0 (socket says 172.21.15.125:37930) 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd659c700 1 -- 172.21.15.125:0/1256883877 learned_addr learned my addr 172.21.15.125:0/1256883877 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 -- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 msgr2=0x7effd81c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd81c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 -- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 msgr2=0x7effd81c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 -- 172.21.15.125:0/1256883877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0009a70 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd5d9b700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd81c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd659c700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effd6d9d700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd81c9250 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7effd0009db0 tx=0x7effd000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.115+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0009c20 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000f040 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000ccb0 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc8009430 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd808d440 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effd0014480 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effd003fb10 con 0x7effd81309f0 2023-10-03T10:16:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.116+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd804f2a0 con 0x7effd81309f0 2023-10-03T10:16:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.121+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effd001d410 con 0x7effd81309f0 2023-10-03T10:16:41.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.274+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe02404f2a0 con 0x7fe0240a0a70 2023-10-03T10:16:41.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.275+0000 7fe01affd700 1 -- 172.21.15.125:0/2370242801 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe020010b70 con 0x7fe0240a0a70 2023-10-03T10:16:41.275 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 msgr2=0x7fe0241c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0241c8530 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe020016000 tx=0x7fe020004750 comp rx=0 tx=0).stop 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 shutdown_connections 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe024134120 0x7fe0241c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0240a0a70 0x7fe0241c8530 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 --2- 172.21.15.125:0/2370242801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0240a1380 0x7fe0241c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 >> 172.21.15.125:0/2370242801 conn(0x7fe0240a6610 msgr2=0x7fe02409abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 shutdown_connections 2023-10-03T10:16:41.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.277+0000 7fe02c6a3700 1 -- 172.21.15.125:0/2370242801 wait complete. 2023-10-03T10:16:41.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.318+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effd808d0e0 con 0x7effd81309f0 2023-10-03T10:16:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.318+0000 7effc6ffd700 1 -- 172.21.15.125:0/1256883877 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effd001c3b0 con 0x7effd81309f0 2023-10-03T10:16:41.319 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 msgr2=0x7effd81c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd81c9250 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7effd0009db0 tx=0x7effd000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 shutdown_connections 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7effd81309f0 0x7effd81c9250 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effd809d8f0 0x7effd81c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 --2- 172.21.15.125:0/1256883877 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effd809e450 0x7effd81c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 >> 172.21.15.125:0/1256883877 conn(0x7effd80a2b30 msgr2=0x7effd812fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 shutdown_connections 2023-10-03T10:16:41.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.320+0000 7effdcb87700 1 -- 172.21.15.125:0/1256883877 wait complete. 2023-10-03T10:16:41.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:41.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:41.881 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:41.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.971+0000 7fc7bde15700 1 Processor -- start 2023-10-03T10:16:41.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.971+0000 7fc7bde15700 1 -- start start 2023-10-03T10:16:41.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7bde15700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7bde15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7bde15700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b809e9d0 con 0x7fc7b80a0a70 2023-10-03T10:16:41.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7bde15700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b809dc00 con 0x7fc7b80a1550 2023-10-03T10:16:41.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7bde15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b809dec0 con 0x7fc7b8139200 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7aeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc7b80a0a70 0x7fc7b80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47588/0 (socket says 172.21.15.125:47588) 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44584/0 (socket says 172.21.15.125:44584) 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b77fe700 1 -- 172.21.15.125:0/1448056313 learned_addr learned my addr 172.21.15.125:0/1448056313 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7aeffd700 1 -- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 msgr2=0x7fc7b813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7aeffd700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7aeffd700 1 -- 172.21.15.125:0/1448056313 >> v1:172.21.15.125:6789/0 conn(0x7fc7b80a0a70 legacy=0x7fc7b80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7aeffd700 1 -- 172.21.15.125:0/1448056313 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b809e6a0 con 0x7fc7b80a1550 2023-10-03T10:16:41.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b6ffd700 1 -- 172.21.15.125:0/1448056313 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953291921 0 0) 0x7fc7b809e9d0 con 0x7fc7b80a0a70 2023-10-03T10:16:41.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.972+0000 7fc7b7fff700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7aeffd700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009840 tx=0x7fc7a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a4650ee13e4860 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7b6ffd700 1 -- 172.21.15.125:0/1448056313 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0011830 con 0x7fc7b80a1550 2023-10-03T10:16:41.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7b6ffd700 1 -- 172.21.15.125:0/1448056313 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0011990 con 0x7fc7b80a1550 2023-10-03T10:16:41.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7b6ffd700 1 -- 172.21.15.125:0/1448056313 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0011d20 con 0x7fc7b80a1550 2023-10-03T10:16:41.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 -- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b80a1550 msgr2=0x7fc7b8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009840 tx=0x7fc7a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 -- 172.21.15.125:0/1448056313 shutdown_connections 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 --2- 172.21.15.125:0/1448056313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 -- 172.21.15.125:0/1448056313 >> 172.21.15.125:0/1448056313 conn(0x7fc7b80a6610 msgr2=0x7fc7b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 -- 172.21.15.125:0/1448056313 shutdown_connections 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.973+0000 7fc7bde15700 1 -- 172.21.15.125:0/1448056313 wait complete. 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 Processor -- start 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 -- start start 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 0x7fc7b8121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8124420 con 0x7fc7b8139200 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80a5100 con 0x7fc7b80a0a70 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.975+0000 7fc7bde15700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8123ac0 con 0x7fc7b80a1550 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7aeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44592/0 (socket says 172.21.15.125:44592) 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7aeffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46356/0 (socket says 172.21.15.125:46356) 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 -- 172.21.15.125:0/3498805640 learned_addr learned my addr 172.21.15.125:0/3498805640 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 0x7fc7b8121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 -- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 msgr2=0x7fc7b8120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 -- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 msgr2=0x7fc7b8121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 0x7fc7b8121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 -- 172.21.15.125:0/3498805640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009a70 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7aeffd700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b7fff700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 0x7fc7b8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b77fe700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c520 tx=0x7fc7a800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004c80 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8004e00 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a00094a0 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8007310 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.976+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8124030 con 0x7fc7b80a0a70 2023-10-03T10:16:41.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.977+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7a8007470 con 0x7fc7b80a0a70 2023-10-03T10:16:41.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.977+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7a803f300 con 0x7fc7b80a0a70 2023-10-03T10:16:41.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.977+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b804f2a0 con 0x7fc7b80a0a70 2023-10-03T10:16:41.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:41.982+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7a80123b0 con 0x7fc7b80a0a70 2023-10-03T10:16:42.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 Processor -- start 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 -- start start 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 0x7f3e30133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3009dc00 con 0x7f3e30133f50 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3009ea60 con 0x7f3e300a0a70 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e355b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3009dec0 con 0x7f3e300a1380 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e2e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 0x7f3e30133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e2f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3e30133f50 0x7f3e3013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47602/0 (socket says 172.21.15.125:47602) 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44596/0 (socket says 172.21.15.125:44596) 2023-10-03T10:16:42.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.012+0000 7f3e2f7fe700 1 -- 172.21.15.125:0/809717175 learned_addr learned my addr 172.21.15.125:0/809717175 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2dffb700 1 -- 172.21.15.125:0/809717175 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736614439 0 0) 0x7f3e3009dc00 con 0x7f3e30133f50 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2effd700 1 -- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 msgr2=0x7f3e30133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2effd700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 0x7f3e30133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2effd700 1 -- 172.21.15.125:0/809717175 >> v1:172.21.15.125:6789/0 conn(0x7f3e30133f50 legacy=0x7f3e3013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2effd700 1 -- 172.21.15.125:0/809717175 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3009e6a0 con 0x7f3e300a0a70 2023-10-03T10:16:42.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2e7fc700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 0x7f3e30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2effd700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cea1c09080711b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2dffb700 1 -- 172.21.15.125:0/809717175 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20011830 con 0x7f3e300a0a70 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2dffb700 1 -- 172.21.15.125:0/809717175 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20011990 con 0x7f3e300a0a70 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.013+0000 7f3e2dffb700 1 -- 172.21.15.125:0/809717175 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20011d20 con 0x7f3e300a0a70 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 -- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 msgr2=0x7f3e300a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e20009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 -- 172.21.15.125:0/809717175 shutdown_connections 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a0a70 0x7f3e300a0e40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 --2- 172.21.15.125:0/809717175 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e300a1380 0x7f3e30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 -- 172.21.15.125:0/809717175 >> 172.21.15.125:0/809717175 conn(0x7f3e300a6610 msgr2=0x7f3e300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 -- 172.21.15.125:0/809717175 shutdown_connections 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.014+0000 7f3e355b4700 1 -- 172.21.15.125:0/809717175 wait complete. 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 Processor -- start 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 -- start start 2023-10-03T10:16:42.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e300a0a70 0x7f3e301227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e30133f50 0x7f3e30123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301339e0 con 0x7f3e300a0a70 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300a03e0 con 0x7f3e300a1380 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e355b4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30124360 con 0x7f3e30133f50 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e2e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e2f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e30133f50 0x7f3e30123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e2e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44600/0 (socket says 172.21.15.125:44600) 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e2e7fc700 1 -- 172.21.15.125:0/3046049677 learned_addr learned my addr 172.21.15.125:0/3046049677 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.015+0000 7f3e2effd700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e300a0a70 0x7f3e301227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 -- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e30133f50 msgr2=0x7f3e30123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e30133f50 0x7f3e30123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 -- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e300a0a70 msgr2=0x7f3e301227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e300a0a70 0x7f3e301227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 -- 172.21.15.125:0/3046049677 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240094a0 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e2e7fc700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400ebb0 tx=0x7f3e2400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400c850 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400c9b0 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400cd40 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e200094a0 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.016+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30125d20 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.017+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e24013470 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.017+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30126020 con 0x7f3e300a1380 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.017+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e2403f760 con 0x7f3e300a1380 2023-10-03T10:16:42.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.021+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e24021080 con 0x7f3e300a1380 2023-10-03T10:16:42.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.178+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc7b8122bf0 con 0x7fc7b80a0a70 2023-10-03T10:16:42.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.178+0000 7fc7b4ff9700 1 -- 172.21.15.125:0/3498805640 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7a800ce60 con 0x7fc7b80a0a70 2023-10-03T10:16:42.179 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 msgr2=0x7fc7b81207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c520 tx=0x7fc7a800c830 comp rx=0 tx=0).stop 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 shutdown_connections 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7b8139200 0x7fc7b8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7b80a0a70 0x7fc7b81207f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 --2- 172.21.15.125:0/3498805640 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7b80a1550 0x7fc7b8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 >> 172.21.15.125:0/3498805640 conn(0x7fc7b80a6610 msgr2=0x7fc7b80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 shutdown_connections 2023-10-03T10:16:42.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.180+0000 7fc7bde15700 1 -- 172.21.15.125:0/3498805640 wait complete. 2023-10-03T10:16:42.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.215+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e30126b20 con 0x7f3e300a1380 2023-10-03T10:16:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.216+0000 7f3e177fe700 1 -- 172.21.15.125:0/3046049677 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e24017020 con 0x7f3e300a1380 2023-10-03T10:16:42.216 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:42.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 msgr2=0x7f3e30122ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400ebb0 tx=0x7f3e2400eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 shutdown_connections 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3e30133f50 0x7f3e30123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e300a0a70 0x7f3e301227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 --2- 172.21.15.125:0/3046049677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3e300a1380 0x7f3e30122ce0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 >> 172.21.15.125:0/3046049677 conn(0x7f3e300a6610 msgr2=0x7f3e300a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 shutdown_connections 2023-10-03T10:16:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.218+0000 7f3e355b4700 1 -- 172.21.15.125:0/3046049677 wait complete. 2023-10-03T10:16:42.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:42.290 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:42.333 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:42.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 Processor -- start 2023-10-03T10:16:42.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 -- start start 2023-10-03T10:16:42.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 0x7f1a50131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500a0920 con 0x7f1a50131d70 2023-10-03T10:16:42.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5009c970 con 0x7f1a5009f180 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a57108700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5009bab0 con 0x7f1a5009e870 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a54ea4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a556a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a54ea4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46390/0 (socket says 172.21.15.125:46390) 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 0x7f1a50131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a556a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37980/0 (socket says 172.21.15.125:37980) 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a54ea4700 1 -- 172.21.15.125:0/2154381625 learned_addr learned my addr 172.21.15.125:0/2154381625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.416+0000 7f1a54ea4700 1 -- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 msgr2=0x7f1a50131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 0x7f1a50131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a54ea4700 1 -- 172.21.15.125:0/2154381625 >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 msgr2=0x7f1a50132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/2154381625 >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a54ea4700 1 -- 172.21.15.125:0/2154381625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5009f9c0 con 0x7f1a5009e870 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a556a5700 1 --2- 172.21.15.125:0/2154381625 >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a4ffff700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 0x7f1a50131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098f0 tx=0x7f1a44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=885266cb126def0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a4f7fe700 1 -- 172.21.15.125:0/2154381625 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44011830 con 0x7f1a5009e870 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a4f7fe700 1 -- 172.21.15.125:0/2154381625 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44011990 con 0x7f1a5009e870 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a4f7fe700 1 -- 172.21.15.125:0/2154381625 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44011d20 con 0x7f1a5009e870 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 -- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 msgr2=0x7f1a5009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098f0 tx=0x7f1a44009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 -- 172.21.15.125:0/2154381625 shutdown_connections 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 --2- 172.21.15.125:0/2154381625 >> v2:172.21.15.125:3300/0 conn(0x7f1a50131d70 0x7f1a50132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009e870 0x7f1a5009ec40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 --2- 172.21.15.125:0/2154381625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a5009f180 0x7f1a50131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 -- 172.21.15.125:0/2154381625 >> 172.21.15.125:0/2154381625 conn(0x7f1a500a4430 msgr2=0x7f1a500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.417+0000 7f1a57108700 1 -- 172.21.15.125:0/2154381625 shutdown_connections 2023-10-03T10:16:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.418+0000 7f1a57108700 1 -- 172.21.15.125:0/2154381625 wait complete. 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.418+0000 7f1a57108700 1 Processor -- start 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.418+0000 7f1a57108700 1 -- start start 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a50131d70 0x7f1a5011ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50122cc0 con 0x7f1a5009e870 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500a2bf0 con 0x7f1a50131d70 2023-10-03T10:16:42.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a57108700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50122f10 con 0x7f1a5009f180 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37990/0 (socket says 172.21.15.125:37990) 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46406/0 (socket says 172.21.15.125:46406) 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 -- 172.21.15.125:0/1336525723 learned_addr learned my addr 172.21.15.125:0/1336525723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a556a5700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a50131d70 0x7f1a5011ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 -- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 msgr2=0x7f1a5011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 -- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a50131d70 msgr2=0x7f1a5011ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a50131d70 0x7f1a5011ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a54ea4700 1 -- 172.21.15.125:0/1336525723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0094a0 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.419+0000 7f1a4ffff700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a54ea4700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f1a44000c00 tx=0x7f1a44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44004240 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4401f070 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a48009a70 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440045c0 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a44009550 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.420+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a44021030 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.421+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a44040820 con 0x7f1a5009e870 2023-10-03T10:16:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.421+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5011be60 con 0x7f1a5009e870 2023-10-03T10:16:42.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.426+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a4401a450 con 0x7f1a5009e870 2023-10-03T10:16:42.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.458+0000 7f65081cd700 1 Processor -- start 2023-10-03T10:16:42.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.458+0000 7f65081cd700 1 -- start start 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6500131a00 0x7f6500131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650006b5c0 con 0x7f6500131a00 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650006e900 con 0x7f650009dec0 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f65081cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f650009d180 con 0x7f650006a770 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505f69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505768700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6500131a00 0x7f6500131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505768700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44622/0 (socket says 172.21.15.125:44622) 2023-10-03T10:16:42.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505f69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46416/0 (socket says 172.21.15.125:46416) 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505768700 1 -- 172.21.15.125:0/3763330231 learned_addr learned my addr 172.21.15.125:0/3763330231 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 -- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 msgr2=0x7f650006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 -- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 msgr2=0x7f650006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 -- 172.21.15.125:0/3763330231 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650009e780 con 0x7f6500131a00 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505768700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6505f69700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f650676a700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6500131a00 0x7f6500131e80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009d90 tx=0x7f64f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546597e6e21a7af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.459+0000 7f6504f67700 1 -- 172.21.15.125:0/3763330231 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f800e070 con 0x7f6500131a00 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f6504f67700 1 -- 172.21.15.125:0/3763330231 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f800bb20 con 0x7f6500131a00 2023-10-03T10:16:42.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f6504f67700 1 -- 172.21.15.125:0/3763330231 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8012430 con 0x7f6500131a00 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 -- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6500131a00 msgr2=0x7f6500131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6500131a00 0x7f6500131e80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009d90 tx=0x7f64f800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 -- 172.21.15.125:0/3763330231 shutdown_connections 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6500131a00 0x7f6500131e80 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f650006a770 0x7f650006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 --2- 172.21.15.125:0/3763330231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650009dec0 0x7f650006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 -- 172.21.15.125:0/3763330231 >> 172.21.15.125:0/3763330231 conn(0x7f6500099c40 msgr2=0x7f65000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 -- 172.21.15.125:0/3763330231 shutdown_connections 2023-10-03T10:16:42.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.460+0000 7f65081cd700 1 -- 172.21.15.125:0/3763330231 wait complete. 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.461+0000 7f65081cd700 1 Processor -- start 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.461+0000 7f65081cd700 1 -- start start 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650006a770 0x7f650009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 0x7f650009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650011fbf0 con 0x7f650009dec0 2023-10-03T10:16:42.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650011e950 con 0x7f650006a770 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f65081cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f650011ec00 con 0x7f6500131a00 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f650676a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f6505768700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 0x7f650009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f650676a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46430/0 (socket says 172.21.15.125:46430) 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f650676a700 1 -- 172.21.15.125:0/1452174079 learned_addr learned my addr 172.21.15.125:0/1452174079 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.462+0000 7f6505f69700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650006a770 0x7f650009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 -- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 msgr2=0x7f650009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 -- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650006a770 msgr2=0x7f650009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650006a770 0x7f650009a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 -- 172.21.15.125:0/1452174079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094a0 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f650676a700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f6505768700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 0x7f650009a9d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f64f000e9a0 tx=0x7f64f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0004030 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0004190 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0009550 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0004520 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.463+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f8009a70 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.464+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64f00036a0 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.464+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64f003f870 con 0x7f650009dec0 2023-10-03T10:16:42.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.464+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6500071ce0 con 0x7f650009dec0 2023-10-03T10:16:42.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.468+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64f0011db0 con 0x7f650009dec0 2023-10-03T10:16:42.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.619+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a5004f2a0 con 0x7f1a5009e870 2023-10-03T10:16:42.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.619+0000 7f1a4d7fa700 1 -- 172.21.15.125:0/1336525723 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a440233d0 con 0x7f1a5009e870 2023-10-03T10:16:42.620 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 msgr2=0x7f1a5011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f1a44000c00 tx=0x7f1a44004750 comp rx=0 tx=0).stop 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 shutdown_connections 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a50131d70 0x7f1a5011ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a5009e870 0x7f1a5011f500 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 --2- 172.21.15.125:0/1336525723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a5009f180 0x7f1a5011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 >> 172.21.15.125:0/1336525723 conn(0x7f1a500a4430 msgr2=0x7f1a501310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 shutdown_connections 2023-10-03T10:16:42.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.621+0000 7f1a57108700 1 -- 172.21.15.125:0/1336525723 wait complete. 2023-10-03T10:16:42.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:42.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.660+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f650004f2a0 con 0x7f650009dec0 2023-10-03T10:16:42.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.660+0000 7f64f67fc700 1 -- 172.21.15.125:0/1452174079 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64f0011350 con 0x7f650009dec0 2023-10-03T10:16:42.660 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 msgr2=0x7f650009a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 0x7f650009a9d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f64f000e9a0 tx=0x7f64f000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 shutdown_connections 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6500131a00 0x7f650009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f650006a770 0x7f650009a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 --2- 172.21.15.125:0/1452174079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f650009dec0 0x7f650009a9d0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 >> 172.21.15.125:0/1452174079 conn(0x7f6500099c40 msgr2=0x7f650012ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 shutdown_connections 2023-10-03T10:16:42.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:42.662+0000 7f65081cd700 1 -- 172.21.15.125:0/1452174079 wait complete. 2023-10-03T10:16:42.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:43.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:43.230 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:43.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 Processor -- start 2023-10-03T10:16:43.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 -- start start 2023-10-03T10:16:43.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef809e9d0 con 0x7f8ef80a0a70 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef809dc00 con 0x7f8ef80a1550 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.323+0000 7f8efd714700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef809dec0 con 0x7f8ef8139200 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44644/0 (socket says 172.21.15.125:44644) 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8ef80a0a70 0x7f8ef80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47618/0 (socket says 172.21.15.125:47618) 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38002/0 (socket says 172.21.15.125:38002) 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 -- 172.21.15.125:0/2581768472 learned_addr learned my addr 172.21.15.125:0/2581768472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 -- 172.21.15.125:0/2581768472 >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 msgr2=0x7f8ef8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/2581768472 >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 -- 172.21.15.125:0/2581768472 >> v1:172.21.15.125:6789/0 conn(0x7f8ef80a0a70 legacy=0x7f8ef80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 -- 172.21.15.125:0/2581768472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef809e6a0 con 0x7f8ef8139200 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef5ffb700 1 -- 172.21.15.125:0/2581768472 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455611096 0 0) 0x7f8ef809e9d0 con 0x7f8ef80a0a70 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef67fc700 1 --2- 172.21.15.125:0/2581768472 >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/2581768472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009e50 tx=0x7f8ef000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2be8156c740eaf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef5ffb700 1 -- 172.21.15.125:0/2581768472 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000e070 con 0x7f8ef8139200 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef5ffb700 1 -- 172.21.15.125:0/2581768472 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000b910 con 0x7f8ef8139200 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.324+0000 7f8ef5ffb700 1 -- 172.21.15.125:0/2581768472 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000bcc0 con 0x7f8ef8139200 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 -- 172.21.15.125:0/2581768472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 msgr2=0x7f8ef813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 --2- 172.21.15.125:0/2581768472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009e50 tx=0x7f8ef000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 -- 172.21.15.125:0/2581768472 shutdown_connections 2023-10-03T10:16:43.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 --2- 172.21.15.125:0/2581768472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef813b5e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 --2- 172.21.15.125:0/2581768472 >> v2:172.21.15.125:3300/0 conn(0x7f8ef80a1550 0x7f8ef8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 -- 172.21.15.125:0/2581768472 >> 172.21.15.125:0/2581768472 conn(0x7f8ef80a6610 msgr2=0x7f8ef80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 -- 172.21.15.125:0/2581768472 shutdown_connections 2023-10-03T10:16:43.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.325+0000 7f8efd714700 1 -- 172.21.15.125:0/2581768472 wait complete. 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.326+0000 7f8efd714700 1 Processor -- start 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.326+0000 7f8efd714700 1 -- start start 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 0x7f8ef811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80a03e0 con 0x7f8ef80a0a70 2023-10-03T10:16:43.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8121990 con 0x7f8ef8139200 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8efd714700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8121eb0 con 0x7f8ef80a1550 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 0x7f8ef811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46444/0 (socket says 172.21.15.125:46444) 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef67fc700 1 -- 172.21.15.125:0/3164894417 learned_addr learned my addr 172.21.15.125:0/3164894417 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 -- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 msgr2=0x7f8ef811ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 -- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 msgr2=0x7f8ef811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 0x7f8ef811e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef77fe700 1 -- 172.21.15.125:0/3164894417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0094a0 con 0x7f8ef8139200 2023-10-03T10:16:43.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef67fc700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.327+0000 7f8ef6ffd700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 0x7f8ef811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8ef77fe700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef811f0f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0015000 tx=0x7f8ef0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0004880 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef00099b0 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef0009b30 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef001c680 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.328+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef8122920 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.329+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ef001c7e0 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.329+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ef0040e90 con 0x7f8ef8139200 2023-10-03T10:16:43.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.329+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef8121cf0 con 0x7f8ef8139200 2023-10-03T10:16:43.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.333+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ef006c750 con 0x7f8ef8139200 2023-10-03T10:16:43.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.362+0000 7f6df8894700 1 Processor -- start 2023-10-03T10:16:43.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.362+0000 7f6df8894700 1 -- start start 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df8894700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6df409e870 0x7f6df409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df8894700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df8894700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df409fa00 con 0x7f6df4134160 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df8894700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40a0370 con 0x7f6df409e870 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df8894700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df406bec0 con 0x7f6df409f180 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6df409e870 0x7f6df409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df2d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6df4134160 0x7f6df413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47620/0 (socket says 172.21.15.125:47620) 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df1d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46454/0 (socket says 172.21.15.125:46454) 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df2d9d700 1 -- 172.21.15.125:0/322773405 learned_addr learned my addr 172.21.15.125:0/322773405 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df259c700 1 -- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 msgr2=0x7f6df4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df259c700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df259c700 1 -- 172.21.15.125:0/322773405 >> v1:172.21.15.125:6789/0 conn(0x7f6df4134160 legacy=0x7f6df413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df259c700 1 -- 172.21.15.125:0/322773405 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df409ada0 con 0x7f6df409e870 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df159a700 1 -- 172.21.15.125:0/322773405 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855179254 0 0) 0x7f6df409fa00 con 0x7f6df4134160 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.363+0000 7f6df1d9b700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df259c700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df409ec40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009d90 tx=0x7f6de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ffffc165e3c1ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df159a700 1 -- 172.21.15.125:0/322773405 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400e070 con 0x7f6df409e870 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df159a700 1 -- 172.21.15.125:0/322773405 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400bb20 con 0x7f6df409e870 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df159a700 1 -- 172.21.15.125:0/322773405 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4012430 con 0x7f6df409e870 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 -- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 msgr2=0x7f6df409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df409ec40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009d90 tx=0x7f6de400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 -- 172.21.15.125:0/322773405 shutdown_connections 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df409ec40 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 --2- 172.21.15.125:0/322773405 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df409f180 0x7f6df4133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 -- 172.21.15.125:0/322773405 >> 172.21.15.125:0/322773405 conn(0x7f6df40a4430 msgr2=0x7f6df40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 -- 172.21.15.125:0/322773405 shutdown_connections 2023-10-03T10:16:43.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.364+0000 7f6df8894700 1 -- 172.21.15.125:0/322773405 wait complete. 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.365+0000 7f6df8894700 1 Processor -- start 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.365+0000 7f6df8894700 1 -- start start 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6df409f180 0x7f6df4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df4134160 0x7f6df4123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4133500 con 0x7f6df409e870 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4125b00 con 0x7f6df409f180 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df8894700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4124510 con 0x7f6df4134160 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6df409f180 0x7f6df4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38032/0 (socket says 172.21.15.125:38032) 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 -- 172.21.15.125:0/4086632044 learned_addr learned my addr 172.21.15.125:0/4086632044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df2d9d700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df4134160 0x7f6df4123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 -- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df4134160 msgr2=0x7f6df4123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df4134160 0x7f6df4123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 -- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6df409f180 msgr2=0x7f6df4122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6df409f180 0x7f6df4122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 -- 172.21.15.125:0/4086632044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0094a0 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.366+0000 7f6df259c700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f6de4014040 tx=0x7f6de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4012430 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4020070 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004280 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de4009a70 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df4125e80 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.367+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6de40043e0 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.368+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df406d000 con 0x7f6df409e870 2023-10-03T10:16:43.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.368+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6de4022070 con 0x7f6df409e870 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.372+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6de401b400 con 0x7f6df409e870 2023-10-03T10:16:43.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.527+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ef804f2a0 con 0x7f8ef8139200 2023-10-03T10:16:43.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.527+0000 7f8edf7fe700 1 -- 172.21.15.125:0/3164894417 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ef0034090 con 0x7f8ef8139200 2023-10-03T10:16:43.528 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:43.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 msgr2=0x7f8ef811f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef811f0f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0015000 tx=0x7f8ef0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 shutdown_connections 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ef8139200 0x7f8ef811f0f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ef80a0a70 0x7f8ef811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 --2- 172.21.15.125:0/3164894417 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8ef80a1550 0x7f8ef811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 >> 172.21.15.125:0/3164894417 conn(0x7f8ef80a6610 msgr2=0x7f8ef8136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 shutdown_connections 2023-10-03T10:16:43.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.530+0000 7f8efd714700 1 -- 172.21.15.125:0/3164894417 wait complete. 2023-10-03T10:16:43.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.565+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6df406c9d0 con 0x7f6df409e870 2023-10-03T10:16:43.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.565+0000 7f6deaffd700 1 -- 172.21.15.125:0/4086632044 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6de401a380 con 0x7f6df409e870 2023-10-03T10:16:43.565 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 msgr2=0x7f6df4122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f6de4014040 tx=0x7f6de4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 shutdown_connections 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6df4134160 0x7f6df4123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6df409e870 0x7f6df4122900 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 --2- 172.21.15.125:0/4086632044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6df409f180 0x7f6df4122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 >> 172.21.15.125:0/4086632044 conn(0x7f6df40a4430 msgr2=0x7f6df409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 shutdown_connections 2023-10-03T10:16:43.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.567+0000 7f6df8894700 1 -- 172.21.15.125:0/4086632044 wait complete. 2023-10-03T10:16:43.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:43.634 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:43.676 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 Processor -- start 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 -- start start 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6e80a0a70 0x7fe6e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 0x7fe6e813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e809dc00 con 0x7fe6e80a1380 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e809ea90 con 0x7fe6e80a0a70 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ee66e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e809dec0 con 0x7fe6e8134120 2023-10-03T10:16:43.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6e80a0a70 0x7fe6e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6e80a0a70 0x7fe6e80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38044/0 (socket says 172.21.15.125:38044) 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 -- 172.21.15.125:0/3296820601 learned_addr learned my addr 172.21.15.125:0/3296820601 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6ecc0b700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 0x7fe6e813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 -- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 msgr2=0x7fe6e813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 0x7fe6e813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e7fff700 1 -- 172.21.15.125:0/3296820601 >> v1:172.21.15.125:6789/0 conn(0x7fe6e80a1380 legacy=0x7fe6e8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6e7fff700 1 -- 172.21.15.125:0/3296820601 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e809e6a0 con 0x7fe6e80a0a70 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.760+0000 7fe6e6ffd700 1 -- 172.21.15.125:0/3296820601 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093303035 0 0) 0x7fe6e809dc00 con 0x7fe6e80a1380 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ecc0b700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 0x7fe6e813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6e7fff700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e80a0a70 0x7fe6e80a0e40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098f0 tx=0x7fe6d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826f7a603fdad116 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6e6ffd700 1 -- 172.21.15.125:0/3296820601 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8011830 con 0x7fe6e80a0a70 2023-10-03T10:16:43.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6e6ffd700 1 -- 172.21.15.125:0/3296820601 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8011990 con 0x7fe6e80a0a70 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6e6ffd700 1 -- 172.21.15.125:0/3296820601 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8011d20 con 0x7fe6e80a0a70 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 -- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e80a0a70 msgr2=0x7fe6e80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e80a0a70 0x7fe6e80a0e40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098f0 tx=0x7fe6d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 -- 172.21.15.125:0/3296820601 shutdown_connections 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e8134120 0x7fe6e813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/3296820601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e80a0a70 0x7fe6e80a0e40 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 -- 172.21.15.125:0/3296820601 >> 172.21.15.125:0/3296820601 conn(0x7fe6e80a6610 msgr2=0x7fe6e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 -- 172.21.15.125:0/3296820601 shutdown_connections 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.761+0000 7fe6ee66e700 1 -- 172.21.15.125:0/3296820601 wait complete. 2023-10-03T10:16:43.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 Processor -- start 2023-10-03T10:16:43.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 -- start start 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 0x7fe6e81c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8125f80 con 0x7fe6e8134120 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8127070 con 0x7fe6e80a0a70 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.763+0000 7fe6ee66e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8133aa0 con 0x7fe6e80a1380 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38056/0 (socket says 172.21.15.125:38056) 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44686/0 (socket says 172.21.15.125:44686) 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 -- 172.21.15.125:0/222797677 learned_addr learned my addr 172.21.15.125:0/222797677 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e77fe700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 0x7fe6e81c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 -- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 msgr2=0x7fe6e81c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 0x7fe6e81c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 -- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 msgr2=0x7fe6e81c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 -- 172.21.15.125:0/222797677 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009a70 con 0x7fe6e8134120 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e7fff700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e77fe700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 0x7fe6e81c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ecc0b700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009f00 tx=0x7fe6e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0009d70 con 0x7fe6e8134120 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e000f040 con 0x7fe6e8134120 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d8009550 con 0x7fe6e8134120 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000cd70 con 0x7fe6e8134120 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.764+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8126200 con 0x7fe6e8134120 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.765+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6e0014480 con 0x7fe6e8134120 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.765+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e804f2a0 con 0x7fe6e8134120 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.765+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6e003fba0 con 0x7fe6e8134120 2023-10-03T10:16:43.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.770+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6e0012520 con 0x7fe6e8134120 2023-10-03T10:16:43.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.802+0000 7f8787462700 1 Processor -- start 2023-10-03T10:16:43.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 -- start start 2023-10-03T10:16:43.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f878009ad40 0x7f8780133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87800a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878009b110 con 0x7f8780133f70 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800a3b60 con 0x7f87801343a0 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f8787462700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87800a2fa0 con 0x7f878009ad40 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f87851fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f878009ad40 0x7f8780133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f87859ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87800a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f87849fd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8780133f70 0x7f87800a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47638/0 (socket says 172.21.15.125:47638) 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.803+0000 7f87849fd700 1 -- 172.21.15.125:0/3189251166 learned_addr learned my addr 172.21.15.125:0/3189251166 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f8777fff700 1 -- 172.21.15.125:0/3189251166 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276769600 0 0) 0x7f878009b110 con 0x7f8780133f70 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f87859ff700 1 -- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f878009ad40 msgr2=0x7f8780133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f87859ff700 1 --2- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f878009ad40 0x7f8780133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f87859ff700 1 -- 172.21.15.125:0/3189251166 >> v1:172.21.15.125:6789/0 conn(0x7f8780133f70 legacy=0x7f87800a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f87859ff700 1 -- 172.21.15.125:0/3189251166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878009a280 con 0x7f87801343a0 2023-10-03T10:16:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f87859ff700 1 --2- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87800a1180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8778009dc0 tx=0x7f877800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a0cf0f94739180 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f8777fff700 1 -- 172.21.15.125:0/3189251166 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800e070 con 0x7f87801343a0 2023-10-03T10:16:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f8777fff700 1 -- 172.21.15.125:0/3189251166 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800bb20 con 0x7f87801343a0 2023-10-03T10:16:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.804+0000 7f8777fff700 1 -- 172.21.15.125:0/3189251166 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012430 con 0x7f87801343a0 2023-10-03T10:16:43.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 -- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 msgr2=0x7f87800a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 --2- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87800a1180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8778009dc0 tx=0x7f877800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 -- 172.21.15.125:0/3189251166 shutdown_connections 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 --2- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87800a1180 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 --2- 172.21.15.125:0/3189251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f878009ad40 0x7f8780133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 -- 172.21.15.125:0/3189251166 >> 172.21.15.125:0/3189251166 conn(0x7f8780099c40 msgr2=0x7f878006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 -- 172.21.15.125:0/3189251166 shutdown_connections 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.805+0000 7f8787462700 1 -- 172.21.15.125:0/3189251166 wait complete. 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 Processor -- start 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 -- start start 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87801c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8780122010 con 0x7f878009ad40 2023-10-03T10:16:43.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8780133390 con 0x7f87801343a0 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f8787462700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8780122640 con 0x7f8780133f70 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87849fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87851fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87851fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38064/0 (socket says 172.21.15.125:38064) 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87849fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46494/0 (socket says 172.21.15.125:46494) 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87851fe700 1 -- 172.21.15.125:0/3868633435 learned_addr learned my addr 172.21.15.125:0/3868633435 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.806+0000 7f87859ff700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87801c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 -- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 msgr2=0x7f878011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 -- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 msgr2=0x7f878011f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 -- 172.21.15.125:0/3868633435 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a70 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87851fe700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87849fd700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f87859ff700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87801c8190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8778016000 tx=0x7f8778004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012430 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778020070 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778004280 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87801222a0 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.807+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878009e810 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.808+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87780043e0 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.808+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8780120be0 con 0x7f87801343a0 2023-10-03T10:16:43.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.808+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8778022070 con 0x7f87801343a0 2023-10-03T10:16:43.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.817+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8778011750 con 0x7f87801343a0 2023-10-03T10:16:43.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.968+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6e8126200 con 0x7fe6e8134120 2023-10-03T10:16:43.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.968+0000 7fe6e4ff9700 1 -- 172.21.15.125:0/222797677 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6e8126200 con 0x7fe6e8134120 2023-10-03T10:16:43.969 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:43.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 msgr2=0x7fe6e8122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009f00 tx=0x7fe6e000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 shutdown_connections 2023-10-03T10:16:43.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e8134120 0x7fe6e8122970 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e80a0a70 0x7fe6e81c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 --2- 172.21.15.125:0/222797677 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6e80a1380 0x7fe6e81c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 >> 172.21.15.125:0/222797677 conn(0x7fe6e80a6610 msgr2=0x7fe6e80a5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 shutdown_connections 2023-10-03T10:16:43.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:43.970+0000 7fe6ee66e700 1 -- 172.21.15.125:0/222797677 wait complete. 2023-10-03T10:16:43.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:44.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.009+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f878004f2a0 con 0x7f87801343a0 2023-10-03T10:16:44.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.010+0000 7f8775ffb700 1 -- 172.21.15.125:0/3868633435 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f877800f0c0 con 0x7f87801343a0 2023-10-03T10:16:44.010 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.011+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 msgr2=0x7f87801c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.011+0000 7f8787462700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87801c8190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8778016000 tx=0x7f8778004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 shutdown_connections 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87801343a0 0x7f87801c8190 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f878009ad40 0x7f878011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 --2- 172.21.15.125:0/3868633435 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8780133f70 0x7f878011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 >> 172.21.15.125:0/3868633435 conn(0x7f8780099c40 msgr2=0x7f87801bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 shutdown_connections 2023-10-03T10:16:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.012+0000 7f8787462700 1 -- 172.21.15.125:0/3868633435 wait complete. 2023-10-03T10:16:44.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:44.543 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:44.580 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:44.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.673+0000 7f2b88be8700 1 Processor -- start 2023-10-03T10:16:44.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.673+0000 7f2b88be8700 1 -- start start 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b88be8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b8409e870 0x7f2b8409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b88be8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b88be8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8409c970 con 0x7f2b8409f180 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b88be8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840a0920 con 0x7f2b8409e870 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b88be8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8409f9c0 con 0x7f2b84131f40 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b8409e870 0x7f2b8409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b82d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b82d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44712/0 (socket says 172.21.15.125:44712) 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b8409e870 0x7f2b8409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38068/0 (socket says 172.21.15.125:38068) 2023-10-03T10:16:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b82d9d700 1 -- 172.21.15.125:0/1862928206 learned_addr learned my addr 172.21.15.125:0/1862928206 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b81d9b700 1 --1- 172.21.15.125:0/1862928206 >> v1:172.21.15.125:6789/0 conn(0x7f2b8409f180 0x7f2b84131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47648/0 (socket says 172.21.15.125:47648) 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8159a700 1 -- 172.21.15.125:0/1862928206 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485544267 0 0) 0x7f2b8409c970 con 0x7f2b8409f180 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8159a700 1 -- 172.21.15.125:0/1862928206 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b6c0035b0 con 0x7f2b8409f180 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 -- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 msgr2=0x7f2b84139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 -- 172.21.15.125:0/1862928206 >> v1:172.21.15.125:6789/0 conn(0x7f2b8409f180 legacy=0x7f2b84131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 -- 172.21.15.125:0/1862928206 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8409bab0 con 0x7f2b8409e870 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b82d9d700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8259c700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8409ec40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009840 tx=0x7f2b74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7720300de9880b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8159a700 1 -- 172.21.15.125:0/1862928206 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011830 con 0x7f2b8409e870 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8159a700 1 -- 172.21.15.125:0/1862928206 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74011990 con 0x7f2b8409e870 2023-10-03T10:16:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.674+0000 7f2b8159a700 1 -- 172.21.15.125:0/1862928206 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011d20 con 0x7f2b8409e870 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 -- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 msgr2=0x7f2b8409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8409ec40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009840 tx=0x7f2b74009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 -- 172.21.15.125:0/1862928206 shutdown_connections 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b84139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1862928206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8409ec40 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 -- 172.21.15.125:0/1862928206 >> 172.21.15.125:0/1862928206 conn(0x7f2b840a4430 msgr2=0x7f2b840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 -- 172.21.15.125:0/1862928206 shutdown_connections 2023-10-03T10:16:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.675+0000 7f2b88be8700 1 -- 172.21.15.125:0/1862928206 wait complete. 2023-10-03T10:16:44.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.676+0000 7f2b88be8700 1 Processor -- start 2023-10-03T10:16:44.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.676+0000 7f2b88be8700 1 -- start start 2023-10-03T10:16:44.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b8409f180 0x7f2b8411f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b8411fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84120cd0 con 0x7f2b8409e870 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84121b60 con 0x7f2b84131f40 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b88be8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84122640 con 0x7f2b8409f180 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38080/0 (socket says 172.21.15.125:38080) 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 -- 172.21.15.125:0/1031127415 learned_addr learned my addr 172.21.15.125:0/1031127415 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b82d9d700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b8411fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b81d9b700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b8409f180 0x7f2b8411f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 -- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b8409f180 msgr2=0x7f2b8411f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b8409f180 0x7f2b8411f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 -- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 msgr2=0x7f2b8411fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b8411fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 -- 172.21.15.125:0/1031127415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c009b30 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b82d9d700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b8411fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.677+0000 7f2b8259c700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f2b740090b0 tx=0x7f2b74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74004590 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7401e070 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740038e0 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b740094a0 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8409dba0 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b74003a40 con 0x7f2b8409e870 2023-10-03T10:16:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.678+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b74040470 con 0x7f2b8409e870 2023-10-03T10:16:44.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.679+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8411be60 con 0x7f2b8409e870 2023-10-03T10:16:44.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.683+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b74015020 con 0x7f2b8409e870 2023-10-03T10:16:44.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.712+0000 7f45ab5b2700 1 Processor -- start 2023-10-03T10:16:44.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 -- start start 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45a40a1550 0x7f45a4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 0x7f45a413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a409e9d0 con 0x7f45a40a0a70 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a409dc00 con 0x7f45a40a1550 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45ab5b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a409dec0 con 0x7f45a4139200 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45a8b4d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45a40a1550 0x7f45a4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45a934e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f45a40a0a70 0x7f45a40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47664/0 (socket says 172.21.15.125:47664) 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45a934e700 1 -- 172.21.15.125:0/1812177519 learned_addr learned my addr 172.21.15.125:0/1812177519 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.713+0000 7f45a9b4f700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 0x7f45a413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a8b4d700 1 -- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 msgr2=0x7f45a413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a8b4d700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 0x7f45a413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a8b4d700 1 -- 172.21.15.125:0/1812177519 >> v1:172.21.15.125:6789/0 conn(0x7f45a40a0a70 legacy=0x7f45a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a8b4d700 1 -- 172.21.15.125:0/1812177519 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a409e6a0 con 0x7f45a40a1550 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f459bfff700 1 -- 172.21.15.125:0/1812177519 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984787972 0 0) 0x7f45a409e9d0 con 0x7f45a40a0a70 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a9b4f700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 0x7f45a413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45a8b4d700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a40a1550 0x7f45a4138cc0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f4594009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db6e4b1adfa158 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f459bfff700 1 -- 172.21.15.125:0/1812177519 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594011830 con 0x7f45a40a1550 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f459bfff700 1 -- 172.21.15.125:0/1812177519 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594011990 con 0x7f45a40a1550 2023-10-03T10:16:44.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f459bfff700 1 -- 172.21.15.125:0/1812177519 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594011d20 con 0x7f45a40a1550 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 -- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a40a1550 msgr2=0x7f45a4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a40a1550 0x7f45a4138cc0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f4594009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 -- 172.21.15.125:0/1812177519 shutdown_connections 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a4139200 0x7f45a413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/1812177519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a40a1550 0x7f45a4138cc0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.714+0000 7f45ab5b2700 1 -- 172.21.15.125:0/1812177519 >> 172.21.15.125:0/1812177519 conn(0x7f45a40a6610 msgr2=0x7f45a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.715+0000 7f45ab5b2700 1 -- 172.21.15.125:0/1812177519 shutdown_connections 2023-10-03T10:16:44.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.715+0000 7f45ab5b2700 1 -- 172.21.15.125:0/1812177519 wait complete. 2023-10-03T10:16:44.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.715+0000 7f45ab5b2700 1 Processor -- start 2023-10-03T10:16:44.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.715+0000 7f45ab5b2700 1 -- start start 2023-10-03T10:16:44.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 0x7f45a41207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45a40a1550 0x7f45a4120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4124420 con 0x7f45a4139200 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40a5100 con 0x7f45a40a1550 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45ab5b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4123ac0 con 0x7f45a40a0a70 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a934e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 0x7f45a41207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38104/0 (socket says 172.21.15.125:38104) 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a934e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 0x7f45a41207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46530/0 (socket says 172.21.15.125:46530) 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 -- 172.21.15.125:0/3451822926 learned_addr learned my addr 172.21.15.125:0/3451822926 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a8b4d700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45a40a1550 0x7f45a4120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 -- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 msgr2=0x7f45a41207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 0x7f45a41207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 -- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45a40a1550 msgr2=0x7f45a4120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45a40a1550 0x7f45a4120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.716+0000 7f45a9b4f700 1 -- 172.21.15.125:0/3451822926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009a70 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f45a9b4f700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f459c00efb0 tx=0x7f459c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00cc90 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00f040 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c014480 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940094a0 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.717+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a4124030 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.718+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f459c0145e0 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.718+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f459c040310 con 0x7f45a4139200 2023-10-03T10:16:44.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.718+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a404f2a0 con 0x7f45a4139200 2023-10-03T10:16:44.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.722+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f459c0076f0 con 0x7f45a4139200 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.875+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b8404f2a0 con 0x7f2b8409e870 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.875+0000 7f2b72ffd700 1 -- 172.21.15.125:0/1031127415 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b7402d7d0 con 0x7f2b8409e870 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 msgr2=0x7f2b8411f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f2b740090b0 tx=0x7f2b74004750 comp rx=0 tx=0).stop 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 shutdown_connections 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b84131f40 0x7f2b8411fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8409e870 0x7f2b8411f110 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 --2- 172.21.15.125:0/1031127415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2b8409f180 0x7f2b8411f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 >> 172.21.15.125:0/1031127415 conn(0x7f2b840a4430 msgr2=0x7f2b841310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 shutdown_connections 2023-10-03T10:16:44.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.877+0000 7f2b88be8700 1 -- 172.21.15.125:0/1031127415 wait complete. 2023-10-03T10:16:44.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.922+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45a40a03e0 con 0x7f45a4139200 2023-10-03T10:16:44.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.923+0000 7f4599ffb700 1 -- 172.21.15.125:0/3451822926 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f459c02c090 con 0x7f45a4139200 2023-10-03T10:16:44.923 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 msgr2=0x7f45a4121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f459c00efb0 tx=0x7f459c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 shutdown_connections 2023-10-03T10:16:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45a4139200 0x7f45a4121270 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45a40a0a70 0x7f45a41207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 --2- 172.21.15.125:0/3451822926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45a40a1550 0x7f45a4120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 >> 172.21.15.125:0/3451822926 conn(0x7f45a40a6610 msgr2=0x7f45a40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 shutdown_connections 2023-10-03T10:16:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:44.925+0000 7f45ab5b2700 1 -- 172.21.15.125:0/3451822926 wait complete. 2023-10-03T10:16:44.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:44.984 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:45.025 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:45.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.109+0000 7f9c1ddb5700 1 Processor -- start 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.109+0000 7f9c1ddb5700 1 -- start start 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.109+0000 7f9c1ddb5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.109+0000 7f9c1ddb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.109+0000 7f9c1ddb5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1809dc00 con 0x7f9c180a1380 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c1ddb5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1809ea90 con 0x7f9c180a0a70 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c1ddb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1809dec0 con 0x7f9c18134120 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c177fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c16ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9c180a1380 0x7f9c18133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47670/0 (socket says 172.21.15.125:47670) 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46546/0 (socket says 172.21.15.125:46546) 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c177fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38108/0 (socket says 172.21.15.125:38108) 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c16ffd700 1 -- 172.21.15.125:0/655916227 learned_addr learned my addr 172.21.15.125:0/655916227 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 -- 172.21.15.125:0/655916227 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 msgr2=0x7f9c180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 --2- 172.21.15.125:0/655916227 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 -- 172.21.15.125:0/655916227 >> v1:172.21.15.125:6789/0 conn(0x7f9c180a1380 legacy=0x7f9c18133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 -- 172.21.15.125:0/655916227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1809e6a0 con 0x7f9c18134120 2023-10-03T10:16:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c177fe700 1 --2- 172.21.15.125:0/655916227 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c17fff700 1 --2- 172.21.15.125:0/655916227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2558664187e1bd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c167fc700 1 -- 172.21.15.125:0/655916227 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800e070 con 0x7f9c18134120 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c167fc700 1 -- 172.21.15.125:0/655916227 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800bb20 con 0x7f9c18134120 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.110+0000 7f9c167fc700 1 -- 172.21.15.125:0/655916227 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08012430 con 0x7f9c18134120 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/655916227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 msgr2=0x7f9c1813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/655916227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/655916227 shutdown_connections 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/655916227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c1813bce0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/655916227 >> v2:172.21.15.125:3300/0 conn(0x7f9c180a0a70 0x7f9c180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/655916227 >> 172.21.15.125:0/655916227 conn(0x7f9c180a6610 msgr2=0x7f9c180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/655916227 shutdown_connections 2023-10-03T10:16:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.111+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/655916227 wait complete. 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 Processor -- start 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 -- start start 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c18122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18133850 con 0x7f9c180a1380 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18133a80 con 0x7f9c180a0a70 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.112+0000 7f9c1ddb5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181260d0 con 0x7f9c18134120 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:38118/0 (socket says 172.21.15.125:38118) 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c16ffd700 1 -- 172.21.15.125:0/2748092371 learned_addr learned my addr 172.21.15.125:0/2748092371 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:46554/0 (socket says 172.21.15.125:46554) 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c177fe700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c18122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 -- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 msgr2=0x7f9c18122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c18122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 -- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 msgr2=0x7f9c18122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 -- 172.21.15.125:0/2748092371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100094a0 con 0x7f9c18134120 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c16ffd700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c17fff700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c08016000 tx=0x7f9c08004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08012430 con 0x7f9c18134120 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08020070 con 0x7f9c18134120 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080098f0 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009a70 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.113+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c18125e10 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.114+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c08004040 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.114+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804f2a0 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.114+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c08022070 con 0x7f9c18134120 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.119+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c0801a970 con 0x7f9c18134120 2023-10-03T10:16:45.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 Processor -- start 2023-10-03T10:16:45.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 -- start start 2023-10-03T10:16:45.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0a809f180 0x7fd0a8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a8131d70 0x7fd0a8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80a0920 con 0x7fd0a809f180 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a809c970 con 0x7fd0a809e870 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0adfa5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a809bab0 con 0x7fd0a8131d70 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0a77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0a6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0a809f180 0x7fd0a8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0a77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44760/0 (socket says 172.21.15.125:44760) 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a8131d70 0x7fd0a8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.152+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3286582143 learned_addr learned my addr 172.21.15.125:0/3286582143 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a8131d70 msgr2=0x7fd0a8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a8131d70 0x7fd0a8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3286582143 >> v2:172.21.15.125:3300/0 conn(0x7fd0a809f180 msgr2=0x7fd0a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3286582143 >> v2:172.21.15.125:3300/0 conn(0x7fd0a809f180 0x7fd0a8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3286582143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a809f9c0 con 0x7fd0a809e870 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd0980086f0 tx=0x7fd098008a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360774bbeee4ad10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a67fc700 1 -- 172.21.15.125:0/3286582143 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800b480 con 0x7fd0a809e870 2023-10-03T10:16:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a67fc700 1 -- 172.21.15.125:0/3286582143 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800d0d0 con 0x7fd0a809e870 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.153+0000 7fd0a67fc700 1 -- 172.21.15.125:0/3286582143 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800d460 con 0x7fd0a809e870 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 msgr2=0x7fd0a809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd0980086f0 tx=0x7fd098008a00 comp rx=0 tx=0).stop 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3286582143 shutdown_connections 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809e870 0x7fd0a809ec40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3286582143 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a8131d70 0x7fd0a8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3286582143 >> v2:172.21.15.125:3300/0 conn(0x7fd0a809f180 0x7fd0a8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3286582143 >> 172.21.15.125:0/3286582143 conn(0x7fd0a80a4430 msgr2=0x7fd0a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3286582143 shutdown_connections 2023-10-03T10:16:45.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.154+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3286582143 wait complete. 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 Processor -- start 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 -- start start 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 0x7fd0a81c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 0x7fd0a81c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 0x7fd0a81c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a811e6f0 con 0x7fd0a8131d70 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a811eb00 con 0x7fd0a809f180 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0adfa5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a811f2f0 con 0x7fd0a809e870 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 0x7fd0a81c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0a77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 0x7fd0a81c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 0x7fd0a81c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:44774/0 (socket says 172.21.15.125:44774) 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0a6ffd700 1 -- 172.21.15.125:0/3897987351 learned_addr learned my addr 172.21.15.125:0/3897987351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.155+0000 7fd0a7fff700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 0x7fd0a81c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 msgr2=0x7fd0a81c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 0x7fd0a81c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 msgr2=0x7fd0a81c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 0x7fd0a81c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 -- 172.21.15.125:0/3897987351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098008320 con 0x7fd0a809e870 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a7fff700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 0x7fd0a81c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0a77fe700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 0x7fd0a81c4380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80673f0 tx=0x7fd098004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800bc10 con 0x7fd0a809e870 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09801a070 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a811f5b0 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09801f410 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.156+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a811db60 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.157+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd09801f570 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.157+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd098041070 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.157+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a811db60 con 0x7fd0a809e870 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.162+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0a811db60 con 0x7fd0a809e870 2023-10-03T10:16:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.313+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c18072980 con 0x7f9c18134120 2023-10-03T10:16:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.314+0000 7f9c0ffff700 1 -- 172.21.15.125:0/2748092371 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c0801a380 con 0x7f9c18134120 2023-10-03T10:16:45.314 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 msgr2=0x7f9c18123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c08016000 tx=0x7f9c08004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 shutdown_connections 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c18134120 0x7f9c18123390 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c180a0a70 0x7f9c18122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 --2- 172.21.15.125:0/2748092371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c180a1380 0x7f9c18122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 >> 172.21.15.125:0/2748092371 conn(0x7f9c180a6610 msgr2=0x7f9c1809ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 shutdown_connections 2023-10-03T10:16:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.316+0000 7f9c1ddb5700 1 -- 172.21.15.125:0/2748092371 wait complete. 2023-10-03T10:16:45.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.358+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0a811db60 con 0x7fd0a809e870 2023-10-03T10:16:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.358+0000 7fd08ffff700 1 -- 172.21.15.125:0/3897987351 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0a811db60 con 0x7fd0a809e870 2023-10-03T10:16:45.359 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 msgr2=0x7fd0a81c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 0x7fd0a81c4380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80673f0 tx=0x7fd098004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 shutdown_connections 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8131d70 0x7fd0a81c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd0a809e870 0x7fd0a81c4380 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 --2- 172.21.15.125:0/3897987351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a809f180 0x7fd0a81c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 >> 172.21.15.125:0/3897987351 conn(0x7fd0a80a4430 msgr2=0x7fd0a8130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 shutdown_connections 2023-10-03T10:16:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:45.360+0000 7fd0adfa5700 1 -- 172.21.15.125:0/3897987351 wait complete. 2023-10-03T10:16:45.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:45.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:45.938 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:46.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.026+0000 7f2bcd5ed700 1 Processor -- start 2023-10-03T10:16:46.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.026+0000 7f2bcd5ed700 1 -- start start 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bcd5ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc809ad40 0x7f2bc8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bcd5ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bcd5ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc809b110 con 0x7f2bc80a0a70 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bcd5ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc80a3b60 con 0x7f2bc809ad40 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bcd5ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc81348e0 con 0x7f2bc8133f70 2023-10-03T10:16:46.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc809ad40 0x7f2bc8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2bc80a0a70 0x7f2bc80a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41934/0 (socket says 172.21.15.125:41934) 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54310/0 (socket says 172.21.15.125:54310) 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc809ad40 0x7f2bc8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48116/0 (socket says 172.21.15.125:48116) 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc77fe700 1 -- 172.21.15.125:0/1894700380 learned_addr learned my addr 172.21.15.125:0/1894700380 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 msgr2=0x7f2bc81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1894700380 >> v1:172.21.15.125:6789/0 conn(0x7f2bc80a0a70 legacy=0x7f2bc80a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1894700380 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80a2fa0 con 0x7f2bc809ad40 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1894700380 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877462295 0 0) 0x7f2bc809b110 con 0x7f2bc80a0a70 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.027+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc8133a30 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009840 tx=0x7f2bb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ef781523ae2964 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1894700380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8011830 con 0x7f2bc809ad40 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1894700380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb8011990 con 0x7f2bc809ad40 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1894700380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8011d20 con 0x7f2bc809ad40 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 msgr2=0x7f2bc8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc8133a30 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009840 tx=0x7f2bb8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1894700380 shutdown_connections 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc8133a30 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1894700380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1894700380 >> 172.21.15.125:0/1894700380 conn(0x7f2bc8099c40 msgr2=0x7f2bc806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1894700380 shutdown_connections 2023-10-03T10:16:46.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.028+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1894700380 wait complete. 2023-10-03T10:16:46.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.029+0000 7f2bcd5ed700 1 Processor -- start 2023-10-03T10:16:46.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.029+0000 7f2bcd5ed700 1 -- start start 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc811f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc8122440 con 0x7f2bc809ad40 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc8121000 con 0x7f2bc8133f70 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bcd5ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc8122620 con 0x7f2bc80a0a70 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50874/0 (socket says 172.21.15.125:50874) 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1201130475 learned_addr learned my addr 172.21.15.125:0/1201130475 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54324/0 (socket says 172.21.15.125:54324) 2023-10-03T10:16:46.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc811f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 msgr2=0x7f2bc81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 msgr2=0x7f2bc811f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc811f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1201130475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0094a0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc77fe700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.030+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00ec10 tx=0x7f2bbc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00c850 con 0x7f2bc80a0a70 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc00c9b0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00cd20 con 0x7f2bc80a0a70 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb80094a0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc811efd0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.031+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bbc013470 con 0x7f2bc80a0a70 2023-10-03T10:16:46.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.032+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bbc03f760 con 0x7f2bc80a0a70 2023-10-03T10:16:46.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.032+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc809c7e0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.037+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bbc013720 con 0x7f2bc80a0a70 2023-10-03T10:16:46.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.067+0000 7f996429e700 1 Processor -- start 2023-10-03T10:16:46.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.067+0000 7f996429e700 1 -- start start 2023-10-03T10:16:46.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996429e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996429e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996429e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c09c970 con 0x7f995c09e870 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996429e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0a0920 con 0x7f995c09f350 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996429e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c09f9c0 con 0x7f995c1371c0 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f9961839700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54342/0 (socket says 172.21.15.125:54342) 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f9961839700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48148/0 (socket says 172.21.15.125:48148) 2023-10-03T10:16:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 -- 172.21.15.125:0/287436860 learned_addr learned my addr 172.21.15.125:0/287436860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996203a700 1 --1- 172.21.15.125:0/287436860 >> v1:172.21.15.125:6789/0 conn(0x7f995c09e870 0x7f995c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41944/0 (socket says 172.21.15.125:41944) 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 -- 172.21.15.125:0/287436860 >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 msgr2=0x7f995c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 --2- 172.21.15.125:0/287436860 >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 -- 172.21.15.125:0/287436860 >> v1:172.21.15.125:6789/0 conn(0x7f995c09e870 legacy=0x7f995c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f9961038700 1 -- 172.21.15.125:0/287436860 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431387648 0 0) 0x7f995c09c970 con 0x7f995c09e870 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f996283b700 1 -- 172.21.15.125:0/287436860 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c09bab0 con 0x7f995c1371c0 2023-10-03T10:16:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.068+0000 7f9961839700 1 --2- 172.21.15.125:0/287436860 >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996283b700 1 --2- 172.21.15.125:0/287436860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9954009e50 tx=0x7f995400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a507d384b58787a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f9961038700 1 -- 172.21.15.125:0/287436860 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400e070 con 0x7f995c1371c0 2023-10-03T10:16:46.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f9961038700 1 -- 172.21.15.125:0/287436860 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995400b910 con 0x7f995c1371c0 2023-10-03T10:16:46.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f9961038700 1 -- 172.21.15.125:0/287436860 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400bcc0 con 0x7f995c1371c0 2023-10-03T10:16:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 -- 172.21.15.125:0/287436860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 msgr2=0x7f995c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 --2- 172.21.15.125:0/287436860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9954009e50 tx=0x7f995400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 -- 172.21.15.125:0/287436860 shutdown_connections 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 --2- 172.21.15.125:0/287436860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c1371c0 0x7f995c1395a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 --2- 172.21.15.125:0/287436860 >> v2:172.21.15.125:3300/0 conn(0x7f995c09f350 0x7f995c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 -- 172.21.15.125:0/287436860 >> 172.21.15.125:0/287436860 conn(0x7f995c0a4430 msgr2=0x7f995c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.069+0000 7f996429e700 1 -- 172.21.15.125:0/287436860 shutdown_connections 2023-10-03T10:16:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.070+0000 7f996429e700 1 -- 172.21.15.125:0/287436860 wait complete. 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.070+0000 7f996429e700 1 Processor -- start 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.070+0000 7f996429e700 1 -- start start 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f995c1371c0 0x7f995c121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c124230 con 0x7f995c09f350 2023-10-03T10:16:46.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c122940 con 0x7f995c09e870 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996429e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f995c09dba0 con 0x7f995c1371c0 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996203a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996203a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54348/0 (socket says 172.21.15.125:54348) 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48156/0 (socket says 172.21.15.125:48156) 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996203a700 1 -- 172.21.15.125:0/3231868565 learned_addr learned my addr 172.21.15.125:0/3231868565 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996283b700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f995c1371c0 0x7f995c121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 -- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f995c1371c0 msgr2=0x7f995c121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f995c1371c0 0x7f995c121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 -- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 msgr2=0x7f995c1207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 -- 172.21.15.125:0/3231868565 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0094a0 con 0x7f995c09f350 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f996203a700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.071+0000 7f9961839700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e9e0 tx=0x7f994c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00ee80 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00c850 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00cc00 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9954009b30 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c123c90 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.072+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f994c00cd60 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.073+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f994c03fa90 con 0x7f995c09f350 2023-10-03T10:16:46.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.073+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c122b70 con 0x7f995c09f350 2023-10-03T10:16:46.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.077+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f994c021070 con 0x7f995c09f350 2023-10-03T10:16:46.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.232+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2bc804f2a0 con 0x7f2bc80a0a70 2023-10-03T10:16:46.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.232+0000 7f2baf7fe700 1 -- 172.21.15.125:0/1201130475 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bbc021020 con 0x7f2bc80a0a70 2023-10-03T10:16:46.233 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 msgr2=0x7f2bc811fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00ec10 tx=0x7f2bbc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 shutdown_connections 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc8133f70 0x7f2bc81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc809ad40 0x7f2bc811f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 --2- 172.21.15.125:0/1201130475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc80a0a70 0x7f2bc811fb30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 >> 172.21.15.125:0/1201130475 conn(0x7f2bc8099c40 msgr2=0x7f2bc81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 shutdown_connections 2023-10-03T10:16:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.234+0000 7f2bcd5ed700 1 -- 172.21.15.125:0/1201130475 wait complete. 2023-10-03T10:16:46.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:46.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.270+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f995c04f2a0 con 0x7f995c09f350 2023-10-03T10:16:46.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.270+0000 7f9952ffd700 1 -- 172.21.15.125:0/3231868565 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f994c02a090 con 0x7f995c09f350 2023-10-03T10:16:46.270 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 msgr2=0x7f995c120ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e9e0 tx=0x7f994c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 shutdown_connections 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f995c1371c0 0x7f995c121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c09e870 0x7f995c1207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 --2- 172.21.15.125:0/3231868565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c09f350 0x7f995c120ce0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 >> 172.21.15.125:0/3231868565 conn(0x7f995c0a4430 msgr2=0x7f995c070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 shutdown_connections 2023-10-03T10:16:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.272+0000 7f996429e700 1 -- 172.21.15.125:0/3231868565 wait complete. 2023-10-03T10:16:46.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:46.329 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:46.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:46.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.455+0000 7f0dc449e700 1 Processor -- start 2023-10-03T10:16:46.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.455+0000 7f0dc449e700 1 -- start start 2023-10-03T10:16:46.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0dbc0a1380 0x7f0dbc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc09e9d0 con 0x7f0dbc0a1380 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc09dc00 con 0x7f0dbc133f50 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc449e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc09dec0 con 0x7f0dbc0a0a70 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc2a3b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc223a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0dbc0a1380 0x7f0dbc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc223a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50892/0 (socket says 172.21.15.125:50892) 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc2a3b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54364/0 (socket says 172.21.15.125:54364) 2023-10-03T10:16:46.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc223a700 1 -- 172.21.15.125:0/1599462190 learned_addr learned my addr 172.21.15.125:0/1599462190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/1599462190 >> v2:172.21.15.125:3300/0 conn(0x7f0dbc0a1380 0x7f0dbc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48172/0 (socket says 172.21.15.125:48172) 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 -- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 msgr2=0x7f0dbc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 -- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 msgr2=0x7f0dbc134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 -- 172.21.15.125:0/1599462190 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc09e6a0 con 0x7f0dbc0a1380 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc2a3b700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc223a700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc0a1380 0x7f0dbc133a10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009840 tx=0x7f0dac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b8bce97c15e421 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1238700 1 -- 172.21.15.125:0/1599462190 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011830 con 0x7f0dbc0a1380 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1238700 1 -- 172.21.15.125:0/1599462190 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac011990 con 0x7f0dbc0a1380 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.456+0000 7f0dc1238700 1 -- 172.21.15.125:0/1599462190 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011d20 con 0x7f0dbc0a1380 2023-10-03T10:16:46.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 -- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc0a1380 msgr2=0x7f0dbc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc0a1380 0x7f0dbc133a10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009840 tx=0x7f0dac009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 -- 172.21.15.125:0/1599462190 shutdown_connections 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc133f50 0x7f0dbc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a0a70 0x7f0dbc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 --2- 172.21.15.125:0/1599462190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc0a1380 0x7f0dbc133a10 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 -- 172.21.15.125:0/1599462190 >> 172.21.15.125:0/1599462190 conn(0x7f0dbc0a6610 msgr2=0x7f0dbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 -- 172.21.15.125:0/1599462190 shutdown_connections 2023-10-03T10:16:46.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.457+0000 7f0dc449e700 1 -- 172.21.15.125:0/1599462190 wait complete. 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 Processor -- start 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 -- start start 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 0x7f0dbc122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc133f50 0x7f0dbc122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc125200 con 0x7f0dbc133f50 2023-10-03T10:16:46.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc123850 con 0x7f0dbc0a0a70 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.458+0000 7f0dc449e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc124130 con 0x7f0dbc0a1380 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc223a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 0x7f0dbc122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc223a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54372/0 (socket says 172.21.15.125:54372) 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc223a700 1 -- 172.21.15.125:0/2318517021 learned_addr learned my addr 172.21.15.125:0/2318517021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc2a3b700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc133f50 0x7f0dbc122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 -- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 msgr2=0x7f0dbc1223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 -- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc133f50 msgr2=0x7f0dbc122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc133f50 0x7f0dbc122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 -- 172.21.15.125:0/2318517021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009550 con 0x7f0dbc0a1380 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc223a700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc1a39700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 0x7f0dbc122930 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0dac016000 tx=0x7f0dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac004510 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac01f070 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4009a70 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0038e0 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.459+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac0094a0 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.460+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dac003a40 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.460+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0dac021070 con 0x7f0dbc0a1380 2023-10-03T10:16:46.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.460+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc04f2a0 con 0x7f0dbc0a1380 2023-10-03T10:16:46.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.465+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dac01a430 con 0x7f0dbc0a1380 2023-10-03T10:16:46.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.500+0000 7faa8123e700 1 Processor -- start 2023-10-03T10:16:46.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.500+0000 7faa8123e700 1 -- start start 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 0x7faa7c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c09e9d0 con 0x7faa7c0a1380 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c09dc00 con 0x7faa7c0a0a70 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa8123e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c09dec0 con 0x7faa7c133f50 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48194/0 (socket says 172.21.15.125:48194) 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 0x7faa7c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7a59c700 1 -- 172.21.15.125:0/2284211965 learned_addr learned my addr 172.21.15.125:0/2284211965 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7b59e700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 -- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 msgr2=0x7faa7c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 -- 172.21.15.125:0/2284211965 >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 msgr2=0x7faa7c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 --2- 172.21.15.125:0/2284211965 >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 -- 172.21.15.125:0/2284211965 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c09e6a0 con 0x7faa7c0a0a70 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7a59c700 1 --2- 172.21.15.125:0/2284211965 >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7b59e700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa7ad9d700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 0x7faa7c0a0e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009840 tx=0x7faa6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955ab455968245f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa79d9b700 1 -- 172.21.15.125:0/2284211965 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c011830 con 0x7faa7c0a0a70 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.501+0000 7faa79d9b700 1 -- 172.21.15.125:0/2284211965 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c011990 con 0x7faa7c0a0a70 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa79d9b700 1 -- 172.21.15.125:0/2284211965 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c011d20 con 0x7faa7c0a0a70 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 -- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 msgr2=0x7faa7c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 0x7faa7c0a0e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009840 tx=0x7faa6c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 -- 172.21.15.125:0/2284211965 shutdown_connections 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a0a70 0x7faa7c0a0e40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 --2- 172.21.15.125:0/2284211965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 --2- 172.21.15.125:0/2284211965 >> v2:172.21.15.125:3300/0 conn(0x7faa7c0a1380 0x7faa7c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 -- 172.21.15.125:0/2284211965 >> 172.21.15.125:0/2284211965 conn(0x7faa7c0a6610 msgr2=0x7faa7c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 -- 172.21.15.125:0/2284211965 shutdown_connections 2023-10-03T10:16:46.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.502+0000 7faa8123e700 1 -- 172.21.15.125:0/2284211965 wait complete. 2023-10-03T10:16:46.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 Processor -- start 2023-10-03T10:16:46.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 -- start start 2023-10-03T10:16:46.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 0x7faa7c122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a1380 0x7faa7c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c125e70 con 0x7faa7c0a0a70 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c125960 con 0x7faa7c0a1380 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa8123e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c124df0 con 0x7faa7c133f50 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa7b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa7b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50930/0 (socket says 172.21.15.125:50930) 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa7b59e700 1 -- 172.21.15.125:0/3861457451 learned_addr learned my addr 172.21.15.125:0/3861457451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa7ad9d700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 0x7faa7c122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.504+0000 7faa7a59c700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a1380 0x7faa7c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 -- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a1380 msgr2=0x7faa7c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a1380 0x7faa7c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 -- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 msgr2=0x7faa7c122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 0x7faa7c122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 -- 172.21.15.125:0/3861457451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009550 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7ad9d700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 0x7faa7c122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa7b59e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7faa7400efc0 tx=0x7faa7400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400ca90 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400f040 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400ce10 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa74009a70 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.505+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c0094a0 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.506+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa74014480 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.506+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa7403fd30 con 0x7faa7c133f50 2023-10-03T10:16:46.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.506+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c11f760 con 0x7faa7c133f50 2023-10-03T10:16:46.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.511+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa74012930 con 0x7faa7c133f50 2023-10-03T10:16:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.661+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0dbc072980 con 0x7f0dbc0a1380 2023-10-03T10:16:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.662+0000 7f0db2ffd700 1 -- 172.21.15.125:0/2318517021 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dac02b070 con 0x7f0dbc0a1380 2023-10-03T10:16:46.662 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 msgr2=0x7f0dbc122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 0x7f0dbc122930 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0dac016000 tx=0x7f0dac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 shutdown_connections 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0dbc133f50 0x7f0dbc122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0dbc0a0a70 0x7f0dbc1223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 --2- 172.21.15.125:0/2318517021 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0dbc0a1380 0x7f0dbc122930 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 >> 172.21.15.125:0/2318517021 conn(0x7f0dbc0a6610 msgr2=0x7f0dbc09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 shutdown_connections 2023-10-03T10:16:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.665+0000 7f0dc449e700 1 -- 172.21.15.125:0/2318517021 wait complete. 2023-10-03T10:16:46.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.713+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa7c0a51f0 con 0x7faa7c133f50 2023-10-03T10:16:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.713+0000 7faa637fe700 1 -- 172.21.15.125:0/3861457451 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa7401c3b0 con 0x7faa7c133f50 2023-10-03T10:16:46.714 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 msgr2=0x7faa7c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7faa7400efc0 tx=0x7faa7400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 shutdown_connections 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa7c133f50 0x7faa7c122dd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa7c0a0a70 0x7faa7c122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 --2- 172.21.15.125:0/3861457451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa7c0a1380 0x7faa7c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 >> 172.21.15.125:0/3861457451 conn(0x7faa7c0a6610 msgr2=0x7faa7c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 shutdown_connections 2023-10-03T10:16:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:46.716+0000 7faa8123e700 1 -- 172.21.15.125:0/3861457451 wait complete. 2023-10-03T10:16:46.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:47.248 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:47.285 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:47.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.382+0000 7f099fdf0700 1 Processor -- start 2023-10-03T10:16:47.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 -- start start 2023-10-03T10:16:47.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099809dc00 con 0x7f09980a1380 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099809ea60 con 0x7f0998134120 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099fdf0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099809dec0 con 0x7f09980a0a70 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099db8c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099e38d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.383+0000 7f099d38b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f09980a1380 0x7f0998133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41954/0 (socket says 172.21.15.125:41954) 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099e38d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48198/0 (socket says 172.21.15.125:48198) 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099d38b700 1 -- 172.21.15.125:0/1827906714 learned_addr learned my addr 172.21.15.125:0/1827906714 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54392/0 (socket says 172.21.15.125:54392) 2023-10-03T10:16:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 -- 172.21.15.125:0/1827906714 >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 msgr2=0x7f099813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 --2- 172.21.15.125:0/1827906714 >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 -- 172.21.15.125:0/1827906714 >> v1:172.21.15.125:6789/0 conn(0x7f09980a1380 legacy=0x7f0998133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 -- 172.21.15.125:0/1827906714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099809e6a0 con 0x7f09980a0a70 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099e38d700 1 --2- 172.21.15.125:0/1827906714 >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099db8c700 1 --2- 172.21.15.125:0/1827906714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0994009840 tx=0x7f0994009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804c3aa9981000a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099cb8a700 1 -- 172.21.15.125:0/1827906714 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011830 con 0x7f09980a0a70 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099cb8a700 1 -- 172.21.15.125:0/1827906714 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994011990 con 0x7f09980a0a70 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.384+0000 7f099cb8a700 1 -- 172.21.15.125:0/1827906714 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011d20 con 0x7f09980a0a70 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 -- 172.21.15.125:0/1827906714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 msgr2=0x7f09980a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1827906714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0994009840 tx=0x7f0994009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 -- 172.21.15.125:0/1827906714 shutdown_connections 2023-10-03T10:16:47.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1827906714 >> v2:172.21.15.125:3300/0 conn(0x7f0998134120 0x7f099813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1827906714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f09980a0e40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 -- 172.21.15.125:0/1827906714 >> 172.21.15.125:0/1827906714 conn(0x7f09980a6610 msgr2=0x7f09980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 -- 172.21.15.125:0/1827906714 shutdown_connections 2023-10-03T10:16:47.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.385+0000 7f099fdf0700 1 -- 172.21.15.125:0/1827906714 wait complete. 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.386+0000 7f099fdf0700 1 Processor -- start 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.386+0000 7f099fdf0700 1 -- start start 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f0998122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 0x7f0998122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998133a90 con 0x7f0998134120 2023-10-03T10:16:47.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980a03e0 con 0x7f09980a0a70 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099fdf0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09981337f0 con 0x7f09980a1380 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099d38b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 0x7f0998122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48212/0 (socket says 172.21.15.125:48212) 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099d38b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 0x7f0998122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50938/0 (socket says 172.21.15.125:50938) 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 -- 172.21.15.125:0/1088130279 learned_addr learned my addr 172.21.15.125:0/1088130279 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099db8c700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f0998122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 -- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 msgr2=0x7f0998122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 0x7f0998122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 -- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 msgr2=0x7f0998122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f0998122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 -- 172.21.15.125:0/1088130279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990009a70 con 0x7f0998134120 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f099e38d700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f099000efc0 tx=0x7f099000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.387+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000ca90 con 0x7f0998134120 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.388+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000f040 con 0x7f0998134120 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.388+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940094a0 con 0x7f0998134120 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.388+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000ce10 con 0x7f0998134120 2023-10-03T10:16:47.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.388+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0998125e80 con 0x7f0998134120 2023-10-03T10:16:47.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.388+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0990014480 con 0x7f0998134120 2023-10-03T10:16:47.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.389+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099804f2a0 con 0x7f0998134120 2023-10-03T10:16:47.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.389+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f099003fd70 con 0x7f0998134120 2023-10-03T10:16:47.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.397+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0990012930 con 0x7f0998134120 2023-10-03T10:16:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.424+0000 7f640b606700 1 Processor -- start 2023-10-03T10:16:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.424+0000 7f640b606700 1 -- start start 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 0x7f6404134050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64040a1290 0x7f640413aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040a1710 con 0x7f64040a1290 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6404133a60 con 0x7f64040a08e0 2023-10-03T10:16:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f640b606700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640409a360 con 0x7f6404133c80 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f6408ba1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 0x7f6404134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f6408ba1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54404/0 (socket says 172.21.15.125:54404) 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f6408ba1700 1 -- 172.21.15.125:0/2030502265 learned_addr learned my addr 172.21.15.125:0/2030502265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f6409ba3700 1 --2- 172.21.15.125:0/2030502265 >> v2:172.21.15.125:3300/0 conn(0x7f64040a1290 0x7f640413aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 -- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 msgr2=0x7f64040a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 -- 172.21.15.125:0/2030502265 >> v2:172.21.15.125:3300/0 conn(0x7f64040a1290 msgr2=0x7f640413aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 --2- 172.21.15.125:0/2030502265 >> v2:172.21.15.125:3300/0 conn(0x7f64040a1290 0x7f640413aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f64093a2700 1 -- 172.21.15.125:0/2030502265 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640409a880 con 0x7f6404133c80 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.425+0000 7f6408ba1700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f64093a2700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 0x7f6404134050 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6400009840 tx=0x7f6400009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1502215629adc11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f63fbfff700 1 -- 172.21.15.125:0/2030502265 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400011830 con 0x7f6404133c80 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f63fbfff700 1 -- 172.21.15.125:0/2030502265 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400011990 con 0x7f6404133c80 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f63fbfff700 1 -- 172.21.15.125:0/2030502265 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400011d20 con 0x7f6404133c80 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 -- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 msgr2=0x7f6404134050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 0x7f6404134050 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6400009840 tx=0x7f6400009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 -- 172.21.15.125:0/2030502265 shutdown_connections 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 --2- 172.21.15.125:0/2030502265 >> v2:172.21.15.125:3300/0 conn(0x7f64040a1290 0x7f640413aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6404133c80 0x7f6404134050 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 --2- 172.21.15.125:0/2030502265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64040a08e0 0x7f64040a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 -- 172.21.15.125:0/2030502265 >> 172.21.15.125:0/2030502265 conn(0x7f64040a2980 msgr2=0x7f64040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 -- 172.21.15.125:0/2030502265 shutdown_connections 2023-10-03T10:16:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.426+0000 7f640b606700 1 -- 172.21.15.125:0/2030502265 wait complete. 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.427+0000 7f640b606700 1 Processor -- start 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.427+0000 7f640b606700 1 -- start start 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64040a1290 0x7f640411ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 0x7f640411b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640412dff0 con 0x7f64040a1290 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640411c890 con 0x7f6404133c80 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f640b606700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640411dbe0 con 0x7f64040a08e0 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50958/0 (socket says 172.21.15.125:50958) 2023-10-03T10:16:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 -- 172.21.15.125:0/3927725922 learned_addr learned my addr 172.21.15.125:0/3927725922 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f6409ba3700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 0x7f640411b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f6408ba1700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64040a1290 0x7f640411ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 -- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 msgr2=0x7f640411b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 0x7f640411b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 -- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64040a1290 msgr2=0x7f640411ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64040a1290 0x7f640411ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f64093a2700 1 -- 172.21.15.125:0/3927725922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4009550 con 0x7f64040a08e0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.428+0000 7f6409ba3700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 0x7f640411b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f64093a2700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64000090b0 tx=0x7f6400004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400004450 con 0x7f64040a08e0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000045b0 con 0x7f64040a08e0 2023-10-03T10:16:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000038e0 con 0x7f64040a08e0 2023-10-03T10:16:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000094a0 con 0x7f64040a08e0 2023-10-03T10:16:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.429+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640409c1e0 con 0x7f64040a08e0 2023-10-03T10:16:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.430+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6400003a40 con 0x7f64040a08e0 2023-10-03T10:16:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.430+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640409e790 con 0x7f64040a08e0 2023-10-03T10:16:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.430+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64000408e0 con 0x7f64040a08e0 2023-10-03T10:16:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.434+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f640006e750 con 0x7f64040a08e0 2023-10-03T10:16:47.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.585+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0998126c10 con 0x7f0998134120 2023-10-03T10:16:47.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.585+0000 7f098e7fc700 1 -- 172.21.15.125:0/1088130279 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0990012340 con 0x7f0998134120 2023-10-03T10:16:47.586 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 msgr2=0x7f09981233f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f099000efc0 tx=0x7f099000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 shutdown_connections 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0998134120 0x7f09981233f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09980a0a70 0x7f0998122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 --2- 172.21.15.125:0/1088130279 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09980a1380 0x7f0998122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 >> 172.21.15.125:0/1088130279 conn(0x7f09980a6610 msgr2=0x7f09980a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 shutdown_connections 2023-10-03T10:16:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.587+0000 7f099fdf0700 1 -- 172.21.15.125:0/1088130279 wait complete. 2023-10-03T10:16:47.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:47.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.622+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f640404f2a0 con 0x7f64040a08e0 2023-10-03T10:16:47.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.622+0000 7f63f9ffb700 1 -- 172.21.15.125:0/3927725922 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6400015030 con 0x7f64040a08e0 2023-10-03T10:16:47.623 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 msgr2=0x7f640411a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64000090b0 tx=0x7f6400004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 shutdown_connections 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6404133c80 0x7f640411b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64040a08e0 0x7f640411a6f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 --2- 172.21.15.125:0/3927725922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64040a1290 0x7f640411ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 >> 172.21.15.125:0/3927725922 conn(0x7f64040a2980 msgr2=0x7f64041badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 shutdown_connections 2023-10-03T10:16:47.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.624+0000 7f640b606700 1 -- 172.21.15.125:0/3927725922 wait complete. 2023-10-03T10:16:47.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:47.682 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:47.729 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:47.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 Processor -- start 2023-10-03T10:16:47.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 -- start start 2023-10-03T10:16:47.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe63809dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 0x7fe638137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63806dc00 con 0x7fe63809e260 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809be40 con 0x7fe6381308e0 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.808+0000 7fe63cfba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809b290 con 0x7fe63809d8f0 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe635d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe63809dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe636d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 0x7fe638137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54424/0 (socket says 172.21.15.125:54424) 2023-10-03T10:16:47.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 -- 172.21.15.125:0/2882145241 learned_addr learned my addr 172.21.15.125:0/2882145241 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 -- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 msgr2=0x7fe63809dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe63809dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 -- 172.21.15.125:0/2882145241 >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 msgr2=0x7fe638137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 --2- 172.21.15.125:0/2882145241 >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 0x7fe638137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 -- 172.21.15.125:0/2882145241 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638130420 con 0x7fe6381308e0 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe635d9b700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe63809dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe636d9d700 1 --2- 172.21.15.125:0/2882145241 >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 0x7fe638137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63659c700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe6280098f0 tx=0x7fe628009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5024ceb7806d0059 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63559a700 1 -- 172.21.15.125:0/2882145241 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628005e30 con 0x7fe6381308e0 2023-10-03T10:16:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63559a700 1 -- 172.21.15.125:0/2882145241 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628004030 con 0x7fe6381308e0 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.809+0000 7fe63559a700 1 -- 172.21.15.125:0/2882145241 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280043e0 con 0x7fe6381308e0 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 -- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 msgr2=0x7fe638130cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe6280098f0 tx=0x7fe628009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 -- 172.21.15.125:0/2882145241 shutdown_connections 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6381308e0 0x7fe638130cb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2882145241 >> v2:172.21.15.125:3300/0 conn(0x7fe63809e260 0x7fe638137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2882145241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe63809dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 -- 172.21.15.125:0/2882145241 >> 172.21.15.125:0/2882145241 conn(0x7fe6380a2b30 msgr2=0x7fe63809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 -- 172.21.15.125:0/2882145241 shutdown_connections 2023-10-03T10:16:47.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.810+0000 7fe63cfba700 1 -- 172.21.15.125:0/2882145241 wait complete. 2023-10-03T10:16:47.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 Processor -- start 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 -- start start 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 0x7fe638128ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 0x7fe638129420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63812c080 con 0x7fe6381308e0 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63812b730 con 0x7fe63809e260 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.811+0000 7fe63cfba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380a1890 con 0x7fe63809d8f0 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:50988/0 (socket says 172.21.15.125:50988) 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 0x7fe638128ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63659c700 1 -- 172.21.15.125:0/2445618832 learned_addr learned my addr 172.21.15.125:0/2445618832 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe636d9d700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 0x7fe638129420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 -- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 msgr2=0x7fe6381289a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 -- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 msgr2=0x7fe638129420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 0x7fe638129420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 -- 172.21.15.125:0/2445618832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0094a0 con 0x7fe63809e260 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63659c700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe636d9d700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 0x7fe638129420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe635d9b700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 0x7fe638128ee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe63806c8a0 tx=0x7fe62c010ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c015070 con 0x7fe63809e260 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c004240 con 0x7fe63809e260 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe630009a70 con 0x7fe63809e260 2023-10-03T10:16:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0036a0 con 0x7fe63809e260 2023-10-03T10:16:47.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.812+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe628009500 con 0x7fe63809e260 2023-10-03T10:16:47.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.813+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe62c003800 con 0x7fe63809e260 2023-10-03T10:16:47.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.813+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe62c042eb0 con 0x7fe63809e260 2023-10-03T10:16:47.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.813+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63806acc0 con 0x7fe63809e260 2023-10-03T10:16:47.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.818+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe62c01e030 con 0x7fe63809e260 2023-10-03T10:16:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.854+0000 7facba0dc700 1 Processor -- start 2023-10-03T10:16:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.854+0000 7facba0dc700 1 -- start start 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facba0dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 0x7facb409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facba0dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facba0dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb409c970 con 0x7facb4131d70 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facba0dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb40a0920 con 0x7facb409f180 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facba0dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb409f9c0 con 0x7facb409e870 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 0x7facb409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48250/0 (socket says 172.21.15.125:48250) 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb2ffd700 1 -- 172.21.15.125:0/1110586432 learned_addr learned my addr 172.21.15.125:0/1110586432 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 -- 172.21.15.125:0/1110586432 >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 msgr2=0x7facb4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 --2- 172.21.15.125:0/1110586432 >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 -- 172.21.15.125:0/1110586432 >> v1:172.21.15.125:6789/0 conn(0x7facb4131d70 legacy=0x7facb4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 -- 172.21.15.125:0/1110586432 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb409bab0 con 0x7facb409e870 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb27fc700 1 -- 172.21.15.125:0/1110586432 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849784797 0 0) 0x7facb409c970 con 0x7facb4131d70 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb2ffd700 1 --2- 172.21.15.125:0/1110586432 >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.855+0000 7facb37fe700 1 --2- 172.21.15.125:0/1110586432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 0x7facb409ec40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faca400f370 tx=0x7faca400f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ee4136623e25d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facb27fc700 1 -- 172.21.15.125:0/1110586432 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4012070 con 0x7facb409e870 2023-10-03T10:16:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facb27fc700 1 -- 172.21.15.125:0/1110586432 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400fe70 con 0x7facb409e870 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facb27fc700 1 -- 172.21.15.125:0/1110586432 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400d2f0 con 0x7facb409e870 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 -- 172.21.15.125:0/1110586432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 msgr2=0x7facb409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 --2- 172.21.15.125:0/1110586432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 0x7facb409ec40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faca400f370 tx=0x7faca400f680 comp rx=0 tx=0).stop 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 -- 172.21.15.125:0/1110586432 shutdown_connections 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 --2- 172.21.15.125:0/1110586432 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb409e870 0x7facb409ec40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 --2- 172.21.15.125:0/1110586432 >> v2:172.21.15.125:3300/0 conn(0x7facb409f180 0x7facb4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 -- 172.21.15.125:0/1110586432 >> 172.21.15.125:0/1110586432 conn(0x7facb40a4430 msgr2=0x7facb40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 -- 172.21.15.125:0/1110586432 shutdown_connections 2023-10-03T10:16:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.856+0000 7facba0dc700 1 -- 172.21.15.125:0/1110586432 wait complete. 2023-10-03T10:16:47.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.857+0000 7facba0dc700 1 Processor -- start 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 -- start start 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 0x7facb41c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 0x7facb41c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb411d6e0 con 0x7facb409e870 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb411daf0 con 0x7facb409f180 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facba0dc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb411e2e0 con 0x7facb4131d70 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facb37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 0x7facb41c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facb37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48260/0 (socket says 172.21.15.125:48260) 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facb37fe700 1 -- 172.21.15.125:0/909756372 learned_addr learned my addr 172.21.15.125:0/909756372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.858+0000 7facb3fff700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 0x7facb41c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 -- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 msgr2=0x7facb41c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 0x7facb41c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 -- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 msgr2=0x7facb41c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 0x7facb41c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 -- 172.21.15.125:0/909756372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009550 con 0x7facb409e870 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb2ffd700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 0x7facb41c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb3fff700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 0x7facb41c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facb37fe700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7facb409fb00 tx=0x7faca4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400b950 con 0x7facb409e870 2023-10-03T10:16:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400bab0 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca400f050 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400be60 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.859+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb411c970 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.860+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb411cb00 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.860+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faca4004040 con 0x7facb409e870 2023-10-03T10:16:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.860+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faca40450c0 con 0x7facb409e870 2023-10-03T10:16:47.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:47.865+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faca401e750 con 0x7facb409e870 2023-10-03T10:16:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.008+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe63812cf40 con 0x7fe63809e260 2023-10-03T10:16:48.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.008+0000 7fe626ffd700 1 -- 172.21.15.125:0/2445618832 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe62c017b90 con 0x7fe63809e260 2023-10-03T10:16:48.009 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.010+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 msgr2=0x7fe638128ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.010+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 0x7fe638128ee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe63806c8a0 tx=0x7fe62c010ea0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 shutdown_connections 2023-10-03T10:16:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6381308e0 0x7fe638129420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe63809d8f0 0x7fe6381289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 --2- 172.21.15.125:0/2445618832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe63809e260 0x7fe638128ee0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 >> 172.21.15.125:0/2445618832 conn(0x7fe6380a2b30 msgr2=0x7fe6381b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 shutdown_connections 2023-10-03T10:16:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.011+0000 7fe63cfba700 1 -- 172.21.15.125:0/2445618832 wait complete. 2023-10-03T10:16:48.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:48.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.053+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facb404f2a0 con 0x7facb409e870 2023-10-03T10:16:48.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.053+0000 7facabfff700 1 -- 172.21.15.125:0/909756372 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faca40163f0 con 0x7facb409e870 2023-10-03T10:16:48.054 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 msgr2=0x7facb41c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7facb409fb00 tx=0x7faca4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 shutdown_connections 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7facb4131d70 0x7facb41c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb409e870 0x7facb41c4380 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 --2- 172.21.15.125:0/909756372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facb409f180 0x7facb41c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 >> 172.21.15.125:0/909756372 conn(0x7facb40a4430 msgr2=0x7facb412fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 shutdown_connections 2023-10-03T10:16:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.055+0000 7facba0dc700 1 -- 172.21.15.125:0/909756372 wait complete. 2023-10-03T10:16:48.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:48.601 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:48.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 Processor -- start 2023-10-03T10:16:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 -- start start 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 0x7f97d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40a0920 con 0x7f97d4131d70 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d409c970 con 0x7f97d409f180 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.732+0000 7f97d89b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97d409bab0 con 0x7f97d409e870 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54448/0 (socket says 172.21.15.125:54448) 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51014/0 (socket says 172.21.15.125:51014) 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 -- 172.21.15.125:0/4137499662 learned_addr learned my addr 172.21.15.125:0/4137499662 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d2d9d700 1 --2- 172.21.15.125:0/4137499662 >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 0x7f97d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 -- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 msgr2=0x7f97d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 -- 172.21.15.125:0/4137499662 >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 msgr2=0x7f97d4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 --2- 172.21.15.125:0/4137499662 >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 0x7f97d4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 -- 172.21.15.125:0/4137499662 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d409f9c0 con 0x7f97d409f180 2023-10-03T10:16:48.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d259c700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d2d9d700 1 --2- 172.21.15.125:0/4137499662 >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 0x7f97d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d1d9b700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f97c80098f0 tx=0x7f97c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1187499c4bc6b05f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d159a700 1 -- 172.21.15.125:0/4137499662 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8011830 con 0x7f97d409f180 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d159a700 1 -- 172.21.15.125:0/4137499662 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c8011990 con 0x7f97d409f180 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.733+0000 7f97d159a700 1 -- 172.21.15.125:0/4137499662 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8011d20 con 0x7f97d409f180 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 -- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 msgr2=0x7f97d4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f97c80098f0 tx=0x7f97c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 -- 172.21.15.125:0/4137499662 shutdown_connections 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 --2- 172.21.15.125:0/4137499662 >> v2:172.21.15.125:3300/0 conn(0x7f97d4131d70 0x7f97d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 --2- 172.21.15.125:0/4137499662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d409f180 0x7f97d4131830 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 -- 172.21.15.125:0/4137499662 >> 172.21.15.125:0/4137499662 conn(0x7f97d40a4430 msgr2=0x7f97d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 -- 172.21.15.125:0/4137499662 shutdown_connections 2023-10-03T10:16:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.734+0000 7f97d89b0700 1 -- 172.21.15.125:0/4137499662 wait complete. 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.735+0000 7f97d89b0700 1 Processor -- start 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.735+0000 7f97d89b0700 1 -- start start 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d41203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97d409f180 0x7f97d4120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 0x7f97d4120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41235f0 con 0x7f97d409f180 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40a2c40 con 0x7f97d4131d70 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4122d70 con 0x7f97d409e870 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d41203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 0x7f97d4120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d41203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51026/0 (socket says 172.21.15.125:51026) 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d259c700 1 -- 172.21.15.125:0/1832386054 learned_addr learned my addr 172.21.15.125:0/1832386054 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97d409f180 0x7f97d4120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 -- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 msgr2=0x7f97d41203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d41203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 -- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97d409f180 msgr2=0x7f97d4120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97d409f180 0x7f97d4120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 -- 172.21.15.125:0/1832386054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40094a0 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d2d9d700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 0x7f97d4120e60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f97cc007e60 tx=0x7f97cc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00dd20 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00f040 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c8009550 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc003c60 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.736+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4124360 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.737+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97cc004030 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.737+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d409ac40 con 0x7f97d4131d70 2023-10-03T10:16:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.738+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97cc03f750 con 0x7f97d4131d70 2023-10-03T10:16:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.746+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97cc01e3b0 con 0x7f97d4131d70 2023-10-03T10:16:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.776+0000 7f14eee91700 1 Processor -- start 2023-10-03T10:16:48.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.776+0000 7f14eee91700 1 -- start start 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14eee91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14eee91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14eee91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e806b2d0 con 0x7f14e81300a0 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14eee91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8133610 con 0x7f14e8133ad0 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14eee91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14e809a500 con 0x7f14e8130bc0 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14e7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f14e81300a0 0x7f14e81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41962/0 (socket says 172.21.15.125:41962) 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14e7fff700 1 -- 172.21.15.125:0/1070251166 learned_addr learned my addr 172.21.15.125:0/1070251166 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ed42e700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14e77fe700 1 -- 172.21.15.125:0/1070251166 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132389770 0 0) 0x7f14e806b2d0 con 0x7f14e81300a0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 -- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 msgr2=0x7f14e813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 -- 172.21.15.125:0/1070251166 >> v1:172.21.15.125:6789/0 conn(0x7f14e81300a0 legacy=0x7f14e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 -- 172.21.15.125:0/1070251166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e81338b0 con 0x7f14e8133ad0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ed42e700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.777+0000 7f14ecc2d700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e8133ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009870 tx=0x7f14dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946fd37c218df9a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14e77fe700 1 -- 172.21.15.125:0/1070251166 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011830 con 0x7f14e8133ad0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14e77fe700 1 -- 172.21.15.125:0/1070251166 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc011990 con 0x7f14e8133ad0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14e77fe700 1 -- 172.21.15.125:0/1070251166 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011d20 con 0x7f14e8133ad0 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 -- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 msgr2=0x7f14e8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e8133ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009870 tx=0x7f14dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 -- 172.21.15.125:0/1070251166 shutdown_connections 2023-10-03T10:16:48.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 --2- 172.21.15.125:0/1070251166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e8133ea0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 -- 172.21.15.125:0/1070251166 >> 172.21.15.125:0/1070251166 conn(0x7f14e8099c40 msgr2=0x7f14e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 -- 172.21.15.125:0/1070251166 shutdown_connections 2023-10-03T10:16:48.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.778+0000 7f14eee91700 1 -- 172.21.15.125:0/1070251166 wait complete. 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 Processor -- start 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 -- start start 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14e81300a0 0x7f14e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80a33c0 con 0x7f14e81300a0 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e812dd00 con 0x7f14e8133ad0 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.780+0000 7f14eee91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80722e0 con 0x7f14e8130bc0 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14e7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54464/0 (socket says 172.21.15.125:54464) 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14e7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51050/0 (socket says 172.21.15.125:51050) 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 -- 172.21.15.125:0/723730725 learned_addr learned my addr 172.21.15.125:0/723730725 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ecc2d700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14e81300a0 0x7f14e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 -- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 msgr2=0x7f14e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 -- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14e81300a0 msgr2=0x7f14e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14e81300a0 0x7f14e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 -- 172.21.15.125:0/723730725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009a70 con 0x7f14e8133ad0 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14ed42e700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f14e000efc0 tx=0x7f14e000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000ca90 con 0x7f14e8133ad0 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000f040 con 0x7f14e8133ad0 2023-10-03T10:16:48.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc0094a0 con 0x7f14e8133ad0 2023-10-03T10:16:48.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000ce10 con 0x7f14e8133ad0 2023-10-03T10:16:48.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.781+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e811ed00 con 0x7f14e8133ad0 2023-10-03T10:16:48.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.782+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e804f2a0 con 0x7f14e8133ad0 2023-10-03T10:16:48.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.782+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14e0014480 con 0x7f14e8133ad0 2023-10-03T10:16:48.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.783+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14e003fd60 con 0x7f14e8133ad0 2023-10-03T10:16:48.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.787+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14e0012930 con 0x7f14e8133ad0 2023-10-03T10:16:48.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.944+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97d404f2a0 con 0x7f97d4131d70 2023-10-03T10:16:48.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.945+0000 7f97c2ffd700 1 -- 172.21.15.125:0/1832386054 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97cc01a070 con 0x7f97d4131d70 2023-10-03T10:16:48.945 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 msgr2=0x7f97d4120e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 0x7f97d4120e60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f97cc007e60 tx=0x7f97cc00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 shutdown_connections 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97d4131d70 0x7f97d4120e60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97d409e870 0x7f97d41203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 --2- 172.21.15.125:0/1832386054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97d409f180 0x7f97d4120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 >> 172.21.15.125:0/1832386054 conn(0x7f97d40a4430 msgr2=0x7f97d409d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 shutdown_connections 2023-10-03T10:16:48.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.947+0000 7f97d89b0700 1 -- 172.21.15.125:0/1832386054 wait complete. 2023-10-03T10:16:48.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.980+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14e80a2ea0 con 0x7f14e8133ad0 2023-10-03T10:16:48.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.980+0000 7f14e57fa700 1 -- 172.21.15.125:0/723730725 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14e001c3b0 con 0x7f14e8133ad0 2023-10-03T10:16:48.980 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 msgr2=0x7f14e811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f14e000efc0 tx=0x7f14e000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 shutdown_connections 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14e8133ad0 0x7f14e811e4c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14e81300a0 0x7f14e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 --2- 172.21.15.125:0/723730725 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14e8130bc0 0x7f14e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 >> 172.21.15.125:0/723730725 conn(0x7f14e8099c40 msgr2=0x7f14e8132c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 shutdown_connections 2023-10-03T10:16:48.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:48.982+0000 7f14eee91700 1 -- 172.21.15.125:0/723730725 wait complete. 2023-10-03T10:16:48.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:49.025 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:49.068 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:49.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.159+0000 7fec554a2700 1 Processor -- start 2023-10-03T10:16:49.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.159+0000 7fec554a2700 1 -- start start 2023-10-03T10:16:49.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec554a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec554a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec50134120 0x7fec5013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec554a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5009dc00 con 0x7fec500a1380 2023-10-03T10:16:49.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec554a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5009ea60 con 0x7fec50134120 2023-10-03T10:16:49.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec554a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5009dec0 con 0x7fec500a0a70 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec50134120 0x7fec5013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54480/0 (socket says 172.21.15.125:54480) 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec50134120 0x7fec5013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48296/0 (socket says 172.21.15.125:48296) 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4effd700 1 -- 172.21.15.125:0/4171794540 learned_addr learned my addr 172.21.15.125:0/4171794540 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 -- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 msgr2=0x7fec500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 -- 172.21.15.125:0/4171794540 >> v1:172.21.15.125:6789/0 conn(0x7fec500a1380 legacy=0x7fec50133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4dffb700 1 -- 172.21.15.125:0/4171794540 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505970161 0 0) 0x7fec5009dc00 con 0x7fec500a1380 2023-10-03T10:16:49.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 -- 172.21.15.125:0/4171794540 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5009e6a0 con 0x7fec50134120 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4effd700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.160+0000 7fec4f7fe700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec5013bce0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fec48009d90 tx=0x7fec4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f08e55fc62e2ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec4dffb700 1 -- 172.21.15.125:0/4171794540 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800e070 con 0x7fec50134120 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec4dffb700 1 -- 172.21.15.125:0/4171794540 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800bb20 con 0x7fec50134120 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec4dffb700 1 -- 172.21.15.125:0/4171794540 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48012430 con 0x7fec50134120 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 -- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 msgr2=0x7fec5013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec5013bce0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fec48009d90 tx=0x7fec4800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 -- 172.21.15.125:0/4171794540 shutdown_connections 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec5013bce0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 --2- 172.21.15.125:0/4171794540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 -- 172.21.15.125:0/4171794540 >> 172.21.15.125:0/4171794540 conn(0x7fec500a6610 msgr2=0x7fec500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 -- 172.21.15.125:0/4171794540 shutdown_connections 2023-10-03T10:16:49.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.161+0000 7fec554a2700 1 -- 172.21.15.125:0/4171794540 wait complete. 2023-10-03T10:16:49.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 Processor -- start 2023-10-03T10:16:49.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 -- start start 2023-10-03T10:16:49.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec50122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fec500a1380 0x7fec50122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec501332b0 con 0x7fec50134120 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec501258b0 con 0x7fec500a0a70 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec554a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec501242c0 con 0x7fec500a1380 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.163+0000 7fec4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48298/0 (socket says 172.21.15.125:48298) 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 -- 172.21.15.125:0/3940684828 learned_addr learned my addr 172.21.15.125:0/3940684828 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4effd700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec50122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4e7fc700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fec500a1380 0x7fec50122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 -- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fec500a1380 msgr2=0x7fec50122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fec500a1380 0x7fec50122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 -- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 msgr2=0x7fec50122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec50122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 -- 172.21.15.125:0/3940684828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009550 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4effd700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec50122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec4f7fe700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b680 tx=0x7fec48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48012430 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48020070 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48004280 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48009a70 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.164+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec50125c30 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.165+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec480043e0 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.165+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5004f2a0 con 0x7fec50134120 2023-10-03T10:16:49.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.165+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec48022070 con 0x7fec50134120 2023-10-03T10:16:49.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.170+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec48012e10 con 0x7fec50134120 2023-10-03T10:16:49.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 Processor -- start 2023-10-03T10:16:49.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 -- start start 2023-10-03T10:16:49.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 0x7f1714133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171409e9d0 con 0x7f17140a0a70 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171409dc00 con 0x7f17140a1380 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f171aaca700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f171409dec0 con 0x7f1714133f50 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1719067700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1718866700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1718866700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48304/0 (socket says 172.21.15.125:48304) 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1719067700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51072/0 (socket says 172.21.15.125:51072) 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1718866700 1 -- 172.21.15.125:0/1952128225 learned_addr learned my addr 172.21.15.125:0/1952128225 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.203+0000 7f1713fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 0x7f1714133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 -- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 msgr2=0x7f1714133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 0x7f1714133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 -- 172.21.15.125:0/1952128225 >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 msgr2=0x7f17140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 --2- 172.21.15.125:0/1952128225 >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 -- 172.21.15.125:0/1952128225 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171409e6a0 con 0x7f1714133f50 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1718866700 1 --2- 172.21.15.125:0/1952128225 >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1713fff700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 0x7f1714133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f1719067700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f170c009d90 tx=0x7f170c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90510061aa9e6042 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f17137fe700 1 -- 172.21.15.125:0/1952128225 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00e070 con 0x7f1714133f50 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f17137fe700 1 -- 172.21.15.125:0/1952128225 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00bb20 con 0x7f1714133f50 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f17137fe700 1 -- 172.21.15.125:0/1952128225 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c012430 con 0x7f1714133f50 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 -- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 msgr2=0x7f17141343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f170c009d90 tx=0x7f170c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 -- 172.21.15.125:0/1952128225 shutdown_connections 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1714133f50 0x7f17141343b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 --2- 172.21.15.125:0/1952128225 >> v2:172.21.15.125:3300/0 conn(0x7f17140a0a70 0x7f17140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 --2- 172.21.15.125:0/1952128225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17140a1380 0x7f1714133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.204+0000 7f171aaca700 1 -- 172.21.15.125:0/1952128225 >> 172.21.15.125:0/1952128225 conn(0x7f17140a6610 msgr2=0x7f17140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.205+0000 7f171aaca700 1 -- 172.21.15.125:0/1952128225 shutdown_connections 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.205+0000 7f171aaca700 1 -- 172.21.15.125:0/1952128225 wait complete. 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.205+0000 7f171aaca700 1 Processor -- start 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.205+0000 7f171aaca700 1 -- start start 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17140a0a70 0x7f1714121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 0x7f1714121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714124e50 con 0x7f17140a1380 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714123dd0 con 0x7f1714133f50 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f171aaca700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17140a03e0 con 0x7f17140a0a70 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48312/0 (socket says 172.21.15.125:48312) 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 -- 172.21.15.125:0/322825533 learned_addr learned my addr 172.21.15.125:0/322825533 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1718866700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17140a0a70 0x7f1714121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1719067700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 0x7f1714121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 -- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17140a0a70 msgr2=0x7f1714121330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17140a0a70 0x7f1714121330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 -- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 msgr2=0x7f1714121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 0x7f1714121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1713fff700 1 -- 172.21.15.125:0/322825533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009550 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.206+0000 7f1719067700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 0x7f1714121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f1713fff700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f170000ec10 tx=0x7f1700009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000c880 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170000c9e0 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000cd50 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000094a0 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.207+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c009a70 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.208+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1700013470 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.208+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f170003f890 con 0x7f17140a1380 2023-10-03T10:16:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.208+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171411e040 con 0x7f17140a1380 2023-10-03T10:16:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.217+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17000232f0 con 0x7f17140a1380 2023-10-03T10:16:49.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.365+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec50072980 con 0x7fec50134120 2023-10-03T10:16:49.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.365+0000 7fec377fe700 1 -- 172.21.15.125:0/3940684828 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec4801a380 con 0x7fec50134120 2023-10-03T10:16:49.366 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:49.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 msgr2=0x7fec501231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b680 tx=0x7fec48004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 shutdown_connections 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec50134120 0x7fec501231d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fec500a0a70 0x7fec50122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 --2- 172.21.15.125:0/3940684828 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fec500a1380 0x7fec50122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 >> 172.21.15.125:0/3940684828 conn(0x7fec500a6610 msgr2=0x7fec5011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 shutdown_connections 2023-10-03T10:16:49.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.368+0000 7fec554a2700 1 -- 172.21.15.125:0/3940684828 wait complete. 2023-10-03T10:16:49.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.417+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f171404f2a0 con 0x7f17140a1380 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.417+0000 7f17117fa700 1 -- 172.21.15.125:0/322825533 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1700017020 con 0x7f17140a1380 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 msgr2=0x7f1714121870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f170000ec10 tx=0x7f1700009ec0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 shutdown_connections 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1714133f50 0x7f1714121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f17140a0a70 0x7f1714121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 --2- 172.21.15.125:0/322825533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17140a1380 0x7f1714121870 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 >> 172.21.15.125:0/322825533 conn(0x7f17140a6610 msgr2=0x7f1714133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 shutdown_connections 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:49.419+0000 7f171aaca700 1 -- 172.21.15.125:0/322825533 wait complete. 2023-10-03T10:16:49.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:49.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:49.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:50.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.090+0000 7fe9cfd8b700 1 Processor -- start 2023-10-03T10:16:50.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 -- start start 2023-10-03T10:16:50.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9c80a1550 0x7fe9c8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c809e9d0 con 0x7fe9c80a0a70 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c809dc00 con 0x7fe9c80a1550 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cfd8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809dec0 con 0x7fe9c8139200 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9ce328700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cd326700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9c80a1550 0x7fe9c8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9ce328700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54510/0 (socket says 172.21.15.125:54510) 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9ce328700 1 -- 172.21.15.125:0/3981569402 learned_addr learned my addr 172.21.15.125:0/3981569402 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cd326700 1 -- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 msgr2=0x7fe9c813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cd326700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cd326700 1 -- 172.21.15.125:0/3981569402 >> v1:172.21.15.125:6789/0 conn(0x7fe9c80a0a70 legacy=0x7fe9c80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9cd326700 1 -- 172.21.15.125:0/3981569402 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c809e6a0 con 0x7fe9c80a1550 2023-10-03T10:16:50.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9ccb25700 1 -- 172.21.15.125:0/3981569402 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024647870 0 0) 0x7fe9c809e9d0 con 0x7fe9c80a0a70 2023-10-03T10:16:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.091+0000 7fe9ce328700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cd326700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a1550 0x7fe9c8138cc0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009840 tx=0x7fe9b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd6fd0a43a2fbcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9ccb25700 1 -- 172.21.15.125:0/3981569402 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011830 con 0x7fe9c80a1550 2023-10-03T10:16:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9ccb25700 1 -- 172.21.15.125:0/3981569402 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8011990 con 0x7fe9c80a1550 2023-10-03T10:16:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9ccb25700 1 -- 172.21.15.125:0/3981569402 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011d20 con 0x7fe9c80a1550 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a1550 msgr2=0x7fe9c8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a1550 0x7fe9c8138cc0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009840 tx=0x7fe9b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/3981569402 shutdown_connections 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/3981569402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a1550 0x7fe9c8138cc0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.092+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/3981569402 >> 172.21.15.125:0/3981569402 conn(0x7fe9c80a6610 msgr2=0x7fe9c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.093+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/3981569402 shutdown_connections 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.093+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/3981569402 wait complete. 2023-10-03T10:16:50.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 Processor -- start 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 -- start start 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 0x7fe9c81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c8121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8124420 con 0x7fe9c80a0a70 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80a5100 con 0x7fe9c8139200 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.094+0000 7fe9cfd8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8123ac0 con 0x7fe9c80a1550 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cdb27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 0x7fe9c81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51090/0 (socket says 172.21.15.125:51090) 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 -- 172.21.15.125:0/1707793237 learned_addr learned my addr 172.21.15.125:0/1707793237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9ce328700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c8121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 -- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 msgr2=0x7fe9c8121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c8121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 -- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 msgr2=0x7fe9c81207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 0x7fe9c81207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 -- 172.21.15.125:0/1707793237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009b30 con 0x7fe9c80a1550 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cdb27700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 0x7fe9c81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9ce328700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cd326700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009fd0 tx=0x7fe9b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80036a0 con 0x7fe9c80a1550 2023-10-03T10:16:50.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b801f070 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8003a60 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80094a0 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.095+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c8124030 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.096+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9b8003bc0 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.096+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c804f2a0 con 0x7fe9c80a1550 2023-10-03T10:16:50.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.096+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9b8021070 con 0x7fe9c80a1550 2023-10-03T10:16:50.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.101+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9b80253e0 con 0x7fe9c80a1550 2023-10-03T10:16:50.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 Processor -- start 2023-10-03T10:16:50.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 -- start start 2023-10-03T10:16:50.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009bc70 0x7f180009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.131+0000 7f1808418700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1800131440 con 0x7f1800131a80 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f1808418700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000a23a0 con 0x7f180009bc70 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f1808418700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1800132390 con 0x7f180009c600 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18061b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51102/0 (socket says 172.21.15.125:51102) 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18061b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48334/0 (socket says 172.21.15.125:48334) 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 -- 172.21.15.125:0/3692907980 learned_addr learned my addr 172.21.15.125:0/3692907980 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18059b3700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009bc70 0x7f180009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 -- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009bc70 msgr2=0x7f180009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009bc70 0x7f180009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 -- 172.21.15.125:0/3692907980 >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 msgr2=0x7f1800131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 --2- 172.21.15.125:0/3692907980 >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 -- 172.21.15.125:0/3692907980 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180006eaa0 con 0x7f180009c600 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18061b4700 1 --2- 172.21.15.125:0/3692907980 >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18069b5700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85d59d28ff67f3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18051b2700 1 -- 172.21.15.125:0/3692907980 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800e070 con 0x7f180009c600 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18051b2700 1 -- 172.21.15.125:0/3692907980 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800b910 con 0x7f180009c600 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.132+0000 7f18051b2700 1 -- 172.21.15.125:0/3692907980 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800bcc0 con 0x7f180009c600 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 -- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 msgr2=0x7f1800138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 -- 172.21.15.125:0/3692907980 shutdown_connections 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009c600 0x7f1800138770 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 --2- 172.21.15.125:0/3692907980 >> v2:172.21.15.125:3300/0 conn(0x7f1800131a80 0x7f1800131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 --2- 172.21.15.125:0/3692907980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009bc70 0x7f180009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 -- 172.21.15.125:0/3692907980 >> 172.21.15.125:0/3692907980 conn(0x7f18000a2980 msgr2=0x7f18000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 -- 172.21.15.125:0/3692907980 shutdown_connections 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.133+0000 7f1808418700 1 -- 172.21.15.125:0/3692907980 wait complete. 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 Processor -- start 2023-10-03T10:16:50.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 -- start start 2023-10-03T10:16:50.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009bc70 0x7f1800119610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 0x7f180011a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180011daa0 con 0x7f1800131a80 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180011b1d0 con 0x7f180009c600 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f1808418700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f180011c420 con 0x7f180009bc70 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f18059b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f18059b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54538/0 (socket says 172.21.15.125:54538) 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f18059b3700 1 -- 172.21.15.125:0/1616734746 learned_addr learned my addr 172.21.15.125:0/1616734746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.134+0000 7f18069b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 0x7f180011a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18061b4700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009bc70 0x7f1800119610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 -- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009bc70 msgr2=0x7f1800119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009bc70 0x7f1800119610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 -- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 msgr2=0x7f180011a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 0x7f180011a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 -- 172.21.15.125:0/1616734746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc009430 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18069b5700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 0x7f180011a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f18059b3700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0009710 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f000ee80 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000ca50 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f8009b30 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.135+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1800130a40 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.136+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17f000cbb0 con 0x7f180009c600 2023-10-03T10:16:50.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.136+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17f003f700 con 0x7f180009c600 2023-10-03T10:16:50.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.136+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180004f2a0 con 0x7f180009c600 2023-10-03T10:16:50.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.141+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17f00232f0 con 0x7f180009c600 2023-10-03T10:16:50.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.297+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9c8122bf0 con 0x7fe9c80a1550 2023-10-03T10:16:50.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.298+0000 7fe9be7fc700 1 -- 172.21.15.125:0/1707793237 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9b8019eb0 con 0x7fe9c80a1550 2023-10-03T10:16:50.299 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 msgr2=0x7fe9c8120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009fd0 tx=0x7fe9b8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 shutdown_connections 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c8139200 0x7fe9c8121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c80a0a70 0x7fe9c81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 --2- 172.21.15.125:0/1707793237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a1550 0x7fe9c8120d30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 >> 172.21.15.125:0/1707793237 conn(0x7fe9c80a6610 msgr2=0x7fe9c80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 shutdown_connections 2023-10-03T10:16:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.301+0000 7fe9cfd8b700 1 -- 172.21.15.125:0/1707793237 wait complete. 2023-10-03T10:16:50.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.345+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f180006bce0 con 0x7f180009c600 2023-10-03T10:16:50.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.345+0000 7f17f6ffd700 1 -- 172.21.15.125:0/1616734746 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17f001ae80 con 0x7f180009c600 2023-10-03T10:16:50.345 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:50.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 msgr2=0x7f1800119b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 shutdown_connections 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1800131a80 0x7f180011a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f180009bc70 0x7f1800119610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 --2- 172.21.15.125:0/1616734746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180009c600 0x7f1800119b50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 >> 172.21.15.125:0/1616734746 conn(0x7f18000a2980 msgr2=0x7f180012e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 shutdown_connections 2023-10-03T10:16:50.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.347+0000 7f1808418700 1 -- 172.21.15.125:0/1616734746 wait complete. 2023-10-03T10:16:50.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:50.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:50.432 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:50.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.524+0000 7f61774e7700 1 Processor -- start 2023-10-03T10:16:50.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.524+0000 7f61774e7700 1 -- start start 2023-10-03T10:16:50.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617009f180 0x7f6170133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 0x7f6170134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700a0370 con 0x7f617009f180 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617009fa00 con 0x7f6170134160 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f61774e7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617009ada0 con 0x7f617009e870 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617009f180 0x7f6170133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6175283700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f617009f180 0x7f6170133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48352/0 (socket says 172.21.15.125:48352) 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6175a84700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 0x7f6170134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6175283700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51126/0 (socket says 172.21.15.125:51126) 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 -- 172.21.15.125:0/974632032 learned_addr learned my addr 172.21.15.125:0/974632032 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 -- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 msgr2=0x7f617009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 -- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 msgr2=0x7f6170134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 0x7f6170134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 -- 172.21.15.125:0/974632032 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617006bec0 con 0x7f617009f180 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6175283700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6175a84700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 0x7f6170134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6174a82700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617009f180 0x7f6170133c20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6160009920 tx=0x7f6160009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9128abdbc5b5a209 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6167fff700 1 -- 172.21.15.125:0/974632032 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160011830 con 0x7f617009f180 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6167fff700 1 -- 172.21.15.125:0/974632032 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160011990 con 0x7f617009f180 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.525+0000 7f6167fff700 1 -- 172.21.15.125:0/974632032 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160011d20 con 0x7f617009f180 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 -- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617009f180 msgr2=0x7f6170133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617009f180 0x7f6170133c20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6160009920 tx=0x7f6160009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 -- 172.21.15.125:0/974632032 shutdown_connections 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6170134160 0x7f6170134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009e870 0x7f617009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 --2- 172.21.15.125:0/974632032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f617009f180 0x7f6170133c20 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 -- 172.21.15.125:0/974632032 >> 172.21.15.125:0/974632032 conn(0x7f61700a4430 msgr2=0x7f61700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 -- 172.21.15.125:0/974632032 shutdown_connections 2023-10-03T10:16:50.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.526+0000 7f61774e7700 1 -- 172.21.15.125:0/974632032 wait complete. 2023-10-03T10:16:50.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.527+0000 7f61774e7700 1 Processor -- start 2023-10-03T10:16:50.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.527+0000 7f61774e7700 1 -- start start 2023-10-03T10:16:50.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 0x7f6170122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170125b30 con 0x7f6170134160 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6170124fc0 con 0x7f617009e870 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f61774e7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617006cfa0 con 0x7f617009f180 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175283700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48364/0 (socket says 172.21.15.125:48364) 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 -- 172.21.15.125:0/3828820171 learned_addr learned my addr 172.21.15.125:0/3828820171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175283700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54546/0 (socket says 172.21.15.125:54546) 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6174a82700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 0x7f6170122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 -- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 msgr2=0x7f6170122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 0x7f6170122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 -- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 msgr2=0x7f6170122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175a84700 1 -- 172.21.15.125:0/3828820171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0094a0 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6175283700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.528+0000 7f6174a82700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 0x7f6170122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f6175a84700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6168009f00 tx=0x7f616800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168009d70 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616800f040 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6168009a70 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800cd70 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.529+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6160009550 con 0x7f6170134160 2023-10-03T10:16:50.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.530+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6168014480 con 0x7f6170134160 2023-10-03T10:16:50.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.530+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f616803fc90 con 0x7f6170134160 2023-10-03T10:16:50.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.530+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617004f2a0 con 0x7f6170134160 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.535+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6168012930 con 0x7f6170134160 2023-10-03T10:16:50.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 Processor -- start 2023-10-03T10:16:50.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 -- start start 2023-10-03T10:16:50.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 0x7f357c099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c09a540 con 0x7f357c099920 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c09ad40 con 0x7f357c12feb0 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f3581259700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357c09e640 con 0x7f357c1307c0 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357b59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 0x7f357c099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51148/0 (socket says 172.21.15.125:51148) 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54560/0 (socket says 172.21.15.125:54560) 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.567+0000 7f357a59c700 1 -- 172.21.15.125:0/2508190880 learned_addr learned my addr 172.21.15.125:0/2508190880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 -- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 msgr2=0x7f357c0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 -- 172.21.15.125:0/2508190880 >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 msgr2=0x7f357c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 --2- 172.21.15.125:0/2508190880 >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 0x7f357c099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 -- 172.21.15.125:0/2508190880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c09e3c0 con 0x7f357c12feb0 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357a59c700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357b59e700 1 --2- 172.21.15.125:0/2508190880 >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 0x7f357c099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f357ad9d700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f356c00bac0 tx=0x7f356c00bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38499cf3f0c69d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f3579d9b700 1 -- 172.21.15.125:0/2508190880 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c005e30 con 0x7f357c12feb0 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f3579d9b700 1 -- 172.21.15.125:0/2508190880 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c00d860 con 0x7f357c12feb0 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.568+0000 7f3579d9b700 1 -- 172.21.15.125:0/2508190880 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c00dbf0 con 0x7f357c12feb0 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 -- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 msgr2=0x7f357c130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f356c00bac0 tx=0x7f356c00bdd0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 -- 172.21.15.125:0/2508190880 shutdown_connections 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c12feb0 0x7f357c130280 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 --2- 172.21.15.125:0/2508190880 >> v2:172.21.15.125:3300/0 conn(0x7f357c099920 0x7f357c099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 --2- 172.21.15.125:0/2508190880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c1307c0 0x7f357c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 -- 172.21.15.125:0/2508190880 >> 172.21.15.125:0/2508190880 conn(0x7f357c0a2b30 msgr2=0x7f357c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 -- 172.21.15.125:0/2508190880 shutdown_connections 2023-10-03T10:16:50.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.569+0000 7f3581259700 1 -- 172.21.15.125:0/2508190880 wait complete. 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 Processor -- start 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 -- start start 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 0x7f357c0989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 0x7f357c12a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c12c420 con 0x7f357c1307c0 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c098f20 con 0x7f357c099920 2023-10-03T10:16:50.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f3581259700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357c071ac0 con 0x7f357c12feb0 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54574/0 (socket says 172.21.15.125:54574) 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f357b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 0x7f357c12a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.570+0000 7f357ad9d700 1 -- 172.21.15.125:0/3918692626 learned_addr learned my addr 172.21.15.125:0/3918692626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357a59c700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 0x7f357c0989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 -- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 msgr2=0x7f357c0989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 0x7f357c0989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 -- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 msgr2=0x7f357c12a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 0x7f357c12a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 -- 172.21.15.125:0/3918692626 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009a70 con 0x7f357c099920 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357b59e700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 0x7f357c12a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357a59c700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 0x7f357c0989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f357ad9d700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f357c09ae80 tx=0x7f356c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c01f070 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570009550 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c010bb0 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c00b6d0 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.571+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c004050 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.572+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f356c0041b0 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.572+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c12a250 con 0x7f357c099920 2023-10-03T10:16:50.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.572+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f356c040c50 con 0x7f357c099920 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.581+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f356c015030 con 0x7f357c099920 2023-10-03T10:16:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.734+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61701338f0 con 0x7f6170134160 2023-10-03T10:16:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.735+0000 7f6165ffb700 1 -- 172.21.15.125:0/3828820171 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f616802a090 con 0x7f6170134160 2023-10-03T10:16:50.735 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.736+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 msgr2=0x7f6170122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.736+0000 7f61774e7700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6168009f00 tx=0x7f616800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 shutdown_connections 2023-10-03T10:16:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6170134160 0x7f6170122fa0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617009e870 0x7f6170122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 --2- 172.21.15.125:0/3828820171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f617009f180 0x7f6170122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 >> 172.21.15.125:0/3828820171 conn(0x7f61700a4430 msgr2=0x7f6170070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 shutdown_connections 2023-10-03T10:16:50.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.737+0000 7f61774e7700 1 -- 172.21.15.125:0/3828820171 wait complete. 2023-10-03T10:16:50.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.773+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f357c04f2a0 con 0x7f357c099920 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.773+0000 7f35637fe700 1 -- 172.21.15.125:0/3918692626 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f356c0237d0 con 0x7f357c099920 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 msgr2=0x7f357c0984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f357c09ae80 tx=0x7f356c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 shutdown_connections 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f357c1307c0 0x7f357c12a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f357c099920 0x7f357c0984a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 --2- 172.21.15.125:0/3918692626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f357c12feb0 0x7f357c0989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 >> 172.21.15.125:0/3918692626 conn(0x7f357c0a2b30 msgr2=0x7f357c1bbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 shutdown_connections 2023-10-03T10:16:50.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:50.775+0000 7f3581259700 1 -- 172.21.15.125:0/3918692626 wait complete. 2023-10-03T10:16:50.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:51.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:51.360 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:51.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.448+0000 7f0b6c0af700 1 Processor -- start 2023-10-03T10:16:51.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 -- start start 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0b64134120 0x7f0b6413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6409dc00 con 0x7f0b640a1380 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6409ea60 con 0x7f0b64134120 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6c0af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6409dec0 con 0x7f0b640a0a70 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b69e4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b6a64c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0b64134120 0x7f0b6413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b69e4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54584/0 (socket says 172.21.15.125:54584) 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.449+0000 7f0b69e4b700 1 -- 172.21.15.125:0/1066852635 learned_addr learned my addr 172.21.15.125:0/1066852635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6a64c700 1 -- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 msgr2=0x7f0b640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6a64c700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6a64c700 1 -- 172.21.15.125:0/1066852635 >> v1:172.21.15.125:6789/0 conn(0x7f0b640a1380 legacy=0x7f0b64133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6a64c700 1 -- 172.21.15.125:0/1066852635 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6409e6a0 con 0x7f0b64134120 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b68e49700 1 -- 172.21.15.125:0/1066852635 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999956095 0 0) 0x7f0b6409dc00 con 0x7f0b640a1380 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b69e4b700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6a64c700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b64134120 0x7f0b6413bce0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009d90 tx=0x7f0b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e63e8b8a8f8b3c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b68e49700 1 -- 172.21.15.125:0/1066852635 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00e070 con 0x7f0b64134120 2023-10-03T10:16:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b68e49700 1 -- 172.21.15.125:0/1066852635 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00bb20 con 0x7f0b64134120 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b68e49700 1 -- 172.21.15.125:0/1066852635 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c012430 con 0x7f0b64134120 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b64134120 msgr2=0x7f0b6413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b64134120 0x7f0b6413bce0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009d90 tx=0x7f0b5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1066852635 shutdown_connections 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.450+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b64134120 0x7f0b6413bce0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.451+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1066852635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a0a70 0x7f0b640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.451+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1066852635 >> 172.21.15.125:0/1066852635 conn(0x7f0b640a6610 msgr2=0x7f0b640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.451+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1066852635 shutdown_connections 2023-10-03T10:16:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.451+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1066852635 wait complete. 2023-10-03T10:16:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 Processor -- start 2023-10-03T10:16:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 -- start start 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b640a0a70 0x7f0b64122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 0x7f0b641231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.452+0000 7f0b6c0af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641332b0 con 0x7f0b640a0a70 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6c0af700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641258b0 con 0x7f0b640a1380 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6c0af700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641242c0 con 0x7f0b64134120 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54600/0 (socket says 172.21.15.125:54600) 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6a64c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 0x7f0b641231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 -- 172.21.15.125:0/1438202764 learned_addr learned my addr 172.21.15.125:0/1438202764 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b69e4b700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b640a0a70 0x7f0b64122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 -- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 msgr2=0x7f0b641231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 0x7f0b641231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 -- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b640a0a70 msgr2=0x7f0b64122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b640a0a70 0x7f0b64122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 -- 172.21.15.125:0/1438202764 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009550 con 0x7f0b640a1380 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6a64c700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 0x7f0b641231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6964a700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c550 tx=0x7f0b5400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540054e0 con 0x7f0b640a1380 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54003680 con 0x7f0b640a1380 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c009a70 con 0x7f0b640a1380 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003a30 con 0x7f0b640a1380 2023-10-03T10:16:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.453+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b64125c30 con 0x7f0b640a1380 2023-10-03T10:16:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.454+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b54003b90 con 0x7f0b640a1380 2023-10-03T10:16:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.454+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6404f2a0 con 0x7f0b640a1380 2023-10-03T10:16:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.455+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b5403eaa0 con 0x7f0b640a1380 2023-10-03T10:16:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.459+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b54003e40 con 0x7f0b640a1380 2023-10-03T10:16:51.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.489+0000 7f829eae4700 1 Processor -- start 2023-10-03T10:16:51.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.489+0000 7f829eae4700 1 -- start start 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 0x7f8298131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829809aaa0 con 0x7f829809e170 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829809f870 con 0x7f8298130ce0 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829eae4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829809b360 con 0x7f829809d860 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829c880700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f8297fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 0x7f8298131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829c880700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51176/0 (socket says 172.21.15.125:51176) 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f8297fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48400/0 (socket says 172.21.15.125:48400) 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829c880700 1 -- 172.21.15.125:0/630946746 learned_addr learned my addr 172.21.15.125:0/630946746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 -- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 msgr2=0x7f829809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 -- 172.21.15.125:0/630946746 >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 msgr2=0x7f82981307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 --2- 172.21.15.125:0/630946746 >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 -- 172.21.15.125:0/630946746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829809b620 con 0x7f8298130ce0 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829c880700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f8297fff700 1 --2- 172.21.15.125:0/630946746 >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f829d081700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 0x7f8298131180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f829000bfd0 tx=0x7f829000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d62699ddabf20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f82977fe700 1 -- 172.21.15.125:0/630946746 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290010070 con 0x7f8298130ce0 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f82977fe700 1 -- 172.21.15.125:0/630946746 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000b2e0 con 0x7f8298130ce0 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.490+0000 7f82977fe700 1 -- 172.21.15.125:0/630946746 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000dc30 con 0x7f8298130ce0 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 -- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 msgr2=0x7f8298131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 0x7f8298131180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f829000bfd0 tx=0x7f829000d330 comp rx=0 tx=0).stop 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 -- 172.21.15.125:0/630946746 shutdown_connections 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8298130ce0 0x7f8298131180 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 --2- 172.21.15.125:0/630946746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f829809d860 0x7f829809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 --2- 172.21.15.125:0/630946746 >> v2:172.21.15.125:3300/0 conn(0x7f829809e170 0x7f82981307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 -- 172.21.15.125:0/630946746 >> 172.21.15.125:0/630946746 conn(0x7f8298099c40 msgr2=0x7f82980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 -- 172.21.15.125:0/630946746 shutdown_connections 2023-10-03T10:16:51.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.491+0000 7f829eae4700 1 -- 172.21.15.125:0/630946746 wait complete. 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.492+0000 7f829eae4700 1 Processor -- start 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.492+0000 7f829eae4700 1 -- start start 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 0x7f829811d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 0x7f829811d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829811e390 con 0x7f829809e170 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829811eaf0 con 0x7f829809d860 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829eae4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829811fd40 con 0x7f8298130ce0 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829c880700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829c880700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54606/0 (socket says 172.21.15.125:54606) 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829c880700 1 -- 172.21.15.125:0/3769012382 learned_addr learned my addr 172.21.15.125:0/3769012382 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f8297fff700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 0x7f829811d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.493+0000 7f829d081700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 0x7f829811d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 -- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 msgr2=0x7f829811d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 0x7f829811d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 -- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 msgr2=0x7f829811d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 0x7f829811d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 -- 172.21.15.125:0/3769012382 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009550 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f8297fff700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 0x7f829811d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829d081700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 0x7f829811d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829c880700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e930 tx=0x7f828c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c004030 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c004190 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c004520 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82840094a0 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.494+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829000bc80 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.495+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f828c0036a0 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.495+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f828c03f430 con 0x7f829809d860 2023-10-03T10:16:51.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.495+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980a0660 con 0x7f829809d860 2023-10-03T10:16:51.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.500+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f828c020030 con 0x7f829809d860 2023-10-03T10:16:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.652+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b64072980 con 0x7f0b640a1380 2023-10-03T10:16:51.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.653+0000 7f0b5a7fc700 1 -- 172.21.15.125:0/1438202764 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b54017030 con 0x7f0b640a1380 2023-10-03T10:16:51.653 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 msgr2=0x7f0b64122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c550 tx=0x7f0b5400c860 comp rx=0 tx=0).stop 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 shutdown_connections 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0b64134120 0x7f0b641231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b640a0a70 0x7f0b64122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 --2- 172.21.15.125:0/1438202764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0b640a1380 0x7f0b64122c90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 >> 172.21.15.125:0/1438202764 conn(0x7f0b640a6610 msgr2=0x7f0b6411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 shutdown_connections 2023-10-03T10:16:51.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.655+0000 7f0b6c0af700 1 -- 172.21.15.125:0/1438202764 wait complete. 2023-10-03T10:16:51.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:51.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.692+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f829809c8b0 con 0x7f829809d860 2023-10-03T10:16:51.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.692+0000 7f82957fa700 1 -- 172.21.15.125:0/3769012382 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f828c003950 con 0x7f829809d860 2023-10-03T10:16:51.693 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 msgr2=0x7f829811cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e930 tx=0x7f828c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 shutdown_connections 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8298130ce0 0x7f829811d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829809d860 0x7f829811cee0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 --2- 172.21.15.125:0/3769012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829809e170 0x7f829811d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 >> 172.21.15.125:0/3769012382 conn(0x7f8298099c40 msgr2=0x7f829812fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 shutdown_connections 2023-10-03T10:16:51.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.694+0000 7f829eae4700 1 -- 172.21.15.125:0/3769012382 wait complete. 2023-10-03T10:16:51.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:51.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:51.787 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:51.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.875+0000 7fdc3c230700 1 Processor -- start 2023-10-03T10:16:51.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.875+0000 7fdc3c230700 1 -- start start 2023-10-03T10:16:51.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3c230700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc3409ad40 0x7fdc34133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3c230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3c230700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3409b110 con 0x7fdc340a0a70 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3c230700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340a3b60 con 0x7fdc3409ad40 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3c230700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341348e0 con 0x7fdc34133f70 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc397cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc39fcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc3409ad40 0x7fdc34133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3a7cd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdc340a0a70 0x7fdc340a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41988/0 (socket says 172.21.15.125:41988) 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc39fcc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc3409ad40 0x7fdc34133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48412/0 (socket says 172.21.15.125:48412) 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc397cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51192/0 (socket says 172.21.15.125:51192) 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.876+0000 7fdc3a7cd700 1 -- 172.21.15.125:0/3572699156 learned_addr learned my addr 172.21.15.125:0/3572699156 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:51.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc38fca700 1 -- 172.21.15.125:0/3572699156 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333832768 0 0) 0x7fdc3409b110 con 0x7fdc340a0a70 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc38fca700 1 -- 172.21.15.125:0/3572699156 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc200035b0 con 0x7fdc340a0a70 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc39fcc700 1 -- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 msgr2=0x7fdc341343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc39fcc700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc39fcc700 1 -- 172.21.15.125:0/3572699156 >> v1:172.21.15.125:6789/0 conn(0x7fdc340a0a70 legacy=0x7fdc340a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc39fcc700 1 -- 172.21.15.125:0/3572699156 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340a2fa0 con 0x7fdc3409ad40 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc397cb700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc39fcc700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3409ad40 0x7fdc34133a30 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009840 tx=0x7fdc30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dec261bbdc41ae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc38fca700 1 -- 172.21.15.125:0/3572699156 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30011830 con 0x7fdc3409ad40 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc38fca700 1 -- 172.21.15.125:0/3572699156 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30011990 con 0x7fdc3409ad40 2023-10-03T10:16:51.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.877+0000 7fdc38fca700 1 -- 172.21.15.125:0/3572699156 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30011d20 con 0x7fdc3409ad40 2023-10-03T10:16:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 -- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3409ad40 msgr2=0x7fdc34133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3409ad40 0x7fdc34133a30 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009840 tx=0x7fdc30009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 -- 172.21.15.125:0/3572699156 shutdown_connections 2023-10-03T10:16:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3409ad40 0x7fdc34133a30 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 --2- 172.21.15.125:0/3572699156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc34133f70 0x7fdc341343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 -- 172.21.15.125:0/3572699156 >> 172.21.15.125:0/3572699156 conn(0x7fdc34099c40 msgr2=0x7fdc3406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 -- 172.21.15.125:0/3572699156 shutdown_connections 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.878+0000 7fdc3c230700 1 -- 172.21.15.125:0/3572699156 wait complete. 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 Processor -- start 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 -- start start 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc3409ad40 0x7fdc3411f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 0x7fdc341c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34122420 con 0x7fdc34133f70 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34120d40 con 0x7fdc3409ad40 2023-10-03T10:16:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3c230700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34122600 con 0x7fdc340a0a70 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51194/0 (socket says 172.21.15.125:51194) 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 -- 172.21.15.125:0/2825744131 learned_addr learned my addr 172.21.15.125:0/2825744131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc3a7cd700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 0x7fdc341c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc39fcc700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc3409ad40 0x7fdc3411f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 -- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc3409ad40 msgr2=0x7fdc3411f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc3409ad40 0x7fdc3411f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 -- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 msgr2=0x7fdc341c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.879+0000 7fdc397cb700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 0x7fdc341c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc397cb700 1 -- 172.21.15.125:0/2825744131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240094a0 con 0x7fdc340a0a70 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc3a7cd700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 0x7fdc341c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc397cb700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400ec10 tx=0x7fdc2400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400c850 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400c9b0 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400cd20 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc300094a0 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.880+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc34133470 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.881+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc24013470 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.881+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc2403fb10 con 0x7fdc340a0a70 2023-10-03T10:16:51.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.881+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3404f2a0 con 0x7fdc340a0a70 2023-10-03T10:16:51.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.886+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc24017020 con 0x7fdc340a0a70 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.918+0000 7f4330293700 1 Processor -- start 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.918+0000 7f4330293700 1 -- start start 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f4330293700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f43280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f4330293700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 0x7f432813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f4330293700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432809dc00 con 0x7f43280a1380 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f4330293700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432809ea90 con 0x7f4328134120 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f4330293700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432809dec0 con 0x7f43280a0a70 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f43280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e830700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 0x7f432813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d82e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f43280a1380 0x7f4328133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42002/0 (socket says 172.21.15.125:42002) 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d82e700 1 -- 172.21.15.125:0/3952563773 learned_addr learned my addr 172.21.15.125:0/3952563773 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 -- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 msgr2=0x7f432813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d02d700 1 -- 172.21.15.125:0/3952563773 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147987112 0 0) 0x7f432809dc00 con 0x7f43280a1380 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 0x7f432813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 -- 172.21.15.125:0/3952563773 >> v1:172.21.15.125:6789/0 conn(0x7f43280a1380 legacy=0x7f4328133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 -- 172.21.15.125:0/3952563773 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432809e6a0 con 0x7f43280a0a70 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e830700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 0x7f432813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432e02f700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f43280a0e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4324009870 tx=0x7f4324009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0050b05b61c65f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d02d700 1 -- 172.21.15.125:0/3952563773 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324011830 con 0x7f43280a0a70 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d02d700 1 -- 172.21.15.125:0/3952563773 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324011990 con 0x7f43280a0a70 2023-10-03T10:16:51.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.919+0000 7f432d02d700 1 -- 172.21.15.125:0/3952563773 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324011d20 con 0x7f43280a0a70 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 -- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 msgr2=0x7f43280a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f43280a0e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4324009870 tx=0x7f4324009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 -- 172.21.15.125:0/3952563773 shutdown_connections 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4328134120 0x7f432813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 --2- 172.21.15.125:0/3952563773 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f43280a0e40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 -- 172.21.15.125:0/3952563773 >> 172.21.15.125:0/3952563773 conn(0x7f43280a6610 msgr2=0x7f43280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 -- 172.21.15.125:0/3952563773 shutdown_connections 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.920+0000 7f4330293700 1 -- 172.21.15.125:0/3952563773 wait complete. 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 Processor -- start 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 -- start start 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a1380 0x7f4328122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328125920 con 0x7f4328134120 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4328124310 con 0x7f43280a1380 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.921+0000 7f4330293700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43281332d0 con 0x7f43280a0a70 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51226/0 (socket says 172.21.15.125:51226) 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 -- 172.21.15.125:0/272338105 learned_addr learned my addr 172.21.15.125:0/272338105 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48436/0 (socket says 172.21.15.125:48436) 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432d82e700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a1380 0x7f4328122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 -- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a1380 msgr2=0x7f4328122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a1380 0x7f4328122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 -- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 msgr2=0x7f4328123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 -- 172.21.15.125:0/272338105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009a70 con 0x7f43280a0a70 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e830700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f432e02f700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43240090b0 tx=0x7f4324004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240044d0 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432401f070 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43240094a0 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240038e0 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.922+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280a03e0 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.923+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4324003a40 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.923+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4324021070 con 0x7f43280a0a70 2023-10-03T10:16:51.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.923+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432804f2a0 con 0x7f43280a0a70 2023-10-03T10:16:51.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:51.928+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4324003cf0 con 0x7f43280a0a70 2023-10-03T10:16:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.076+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc34120ee0 con 0x7fdc340a0a70 2023-10-03T10:16:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.077+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/2825744131 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc2400ce80 con 0x7fdc340a0a70 2023-10-03T10:16:52.077 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 msgr2=0x7fdc3411fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400ec10 tx=0x7fdc2400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 shutdown_connections 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc34133f70 0x7fdc341c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc3409ad40 0x7fdc3411f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 --2- 172.21.15.125:0/2825744131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdc340a0a70 0x7fdc3411fb20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 >> 172.21.15.125:0/2825744131 conn(0x7fdc34099c40 msgr2=0x7fdc341bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 shutdown_connections 2023-10-03T10:16:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.079+0000 7fdc3c230700 1 -- 172.21.15.125:0/2825744131 wait complete. 2023-10-03T10:16:52.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:52.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.117+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4328072980 con 0x7f43280a0a70 2023-10-03T10:16:52.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.117+0000 7f431effd700 1 -- 172.21.15.125:0/272338105 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4324024b70 con 0x7f43280a0a70 2023-10-03T10:16:52.117 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 msgr2=0x7f4328122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43240090b0 tx=0x7f4324004750 comp rx=0 tx=0).stop 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 shutdown_connections 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4328134120 0x7f4328123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f43280a0a70 0x7f4328122700 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 --2- 172.21.15.125:0/272338105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43280a1380 0x7f4328122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 >> 172.21.15.125:0/272338105 conn(0x7f43280a6610 msgr2=0x7f432809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 shutdown_connections 2023-10-03T10:16:52.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.119+0000 7f4330293700 1 -- 172.21.15.125:0/272338105 wait complete. 2023-10-03T10:16:52.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:52.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:52.707 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.797+0000 7f70f24fb700 1 Processor -- start 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.797+0000 7f70f24fb700 1 -- start start 2023-10-03T10:16:52.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f24fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f24fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f24fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec09c970 con 0x7f70ec09e870 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f24fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0a0920 con 0x7f70ec1371c0 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f24fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec09f9c0 con 0x7f70ec09f350 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f0a98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f0a98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54652/0 (socket says 172.21.15.125:54652) 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70ebfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f70ec09e870 0x7f70ec09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42010/0 (socket says 172.21.15.125:42010) 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51238/0 (socket says 172.21.15.125:51238) 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70f0a98700 1 -- 172.21.15.125:0/3457603243 learned_addr learned my addr 172.21.15.125:0/3457603243 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eaffd700 1 -- 172.21.15.125:0/3457603243 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234494241 0 0) 0x7f70ec09c970 con 0x7f70ec09e870 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 -- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 msgr2=0x7f70ec1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 --2- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 -- 172.21.15.125:0/3457603243 >> v1:172.21.15.125:6789/0 conn(0x7f70ec09e870 legacy=0x7f70ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.798+0000 7f70eb7fe700 1 -- 172.21.15.125:0/3457603243 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec09bab0 con 0x7f70ec09f350 2023-10-03T10:16:52.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70eb7fe700 1 --2- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009870 tx=0x7f70e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e6fa6a7ceaa271 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70eaffd700 1 -- 172.21.15.125:0/3457603243 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011830 con 0x7f70ec09f350 2023-10-03T10:16:52.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70eaffd700 1 -- 172.21.15.125:0/3457603243 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0011990 con 0x7f70ec09f350 2023-10-03T10:16:52.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70eaffd700 1 -- 172.21.15.125:0/3457603243 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011d20 con 0x7f70ec09f350 2023-10-03T10:16:52.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 -- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 msgr2=0x7f70ec136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 --2- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009870 tx=0x7f70e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 -- 172.21.15.125:0/3457603243 shutdown_connections 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 --2- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 --2- 172.21.15.125:0/3457603243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09f350 0x7f70ec136c80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.799+0000 7f70f24fb700 1 -- 172.21.15.125:0/3457603243 >> 172.21.15.125:0/3457603243 conn(0x7f70ec0a4430 msgr2=0x7f70ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.800+0000 7f70f24fb700 1 -- 172.21.15.125:0/3457603243 shutdown_connections 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.800+0000 7f70f24fb700 1 -- 172.21.15.125:0/3457603243 wait complete. 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.800+0000 7f70f24fb700 1 Processor -- start 2023-10-03T10:16:52.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 -- start start 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 0x7f70ec11fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec121300 con 0x7f70ec09f350 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec122e20 con 0x7f70ec1371c0 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f24fb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec1217b0 con 0x7f70ec09e870 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51240/0 (socket says 172.21.15.125:51240) 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 -- 172.21.15.125:0/4114524626 learned_addr learned my addr 172.21.15.125:0/4114524626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f0a98700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70eb7fe700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 0x7f70ec11fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 -- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 msgr2=0x7f70ec120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 -- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 msgr2=0x7f70ec11fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 0x7f70ec11fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70ebfff700 1 -- 172.21.15.125:0/4114524626 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00094a0 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70f0a98700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.801+0000 7f70eb7fe700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 0x7f70ec11fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70ebfff700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c520 tx=0x7f70dc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc004c80 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc004e00 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec09dba0 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc007310 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.802+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec123890 con 0x7f70ec09e870 2023-10-03T10:16:52.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.803+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70dc007470 con 0x7f70ec09e870 2023-10-03T10:16:52.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.803+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70dc03f2d0 con 0x7f70ec09e870 2023-10-03T10:16:52.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.803+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec122a60 con 0x7f70ec09e870 2023-10-03T10:16:52.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.807+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70dc0123b0 con 0x7f70ec09e870 2023-10-03T10:16:52.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.838+0000 7feb574b9700 1 Processor -- start 2023-10-03T10:16:52.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.838+0000 7feb574b9700 1 -- start start 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb574b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb574b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb574b9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5006b2d0 con 0x7feb501300a0 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb574b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb50133610 con 0x7feb50130bc0 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb574b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5009a500 con 0x7feb50133ad0 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55a56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55a56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48452/0 (socket says 172.21.15.125:48452) 2023-10-03T10:16:52.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55a56700 1 -- 172.21.15.125:0/667101937 learned_addr learned my addr 172.21.15.125:0/667101937 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51250/0 (socket says 172.21.15.125:51250) 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb47fff700 1 -- 172.21.15.125:0/667101937 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704984893 0 0) 0x7feb5006b2d0 con 0x7feb501300a0 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb47fff700 1 -- 172.21.15.125:0/667101937 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb3c0035b0 con 0x7feb501300a0 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 -- 172.21.15.125:0/667101937 >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 msgr2=0x7feb5013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 --2- 172.21.15.125:0/667101937 >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 -- 172.21.15.125:0/667101937 >> v1:172.21.15.125:6789/0 conn(0x7feb501300a0 legacy=0x7feb501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 -- 172.21.15.125:0/667101937 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb501338b0 con 0x7feb50133ad0 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55a56700 1 --2- 172.21.15.125:0/667101937 >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb55255700 1 --2- 172.21.15.125:0/667101937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009840 tx=0x7feb4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5050a3abfb11acb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb47fff700 1 -- 172.21.15.125:0/667101937 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011830 con 0x7feb50133ad0 2023-10-03T10:16:52.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb47fff700 1 -- 172.21.15.125:0/667101937 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c011990 con 0x7feb50133ad0 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.839+0000 7feb47fff700 1 -- 172.21.15.125:0/667101937 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011d20 con 0x7feb50133ad0 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 -- 172.21.15.125:0/667101937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 msgr2=0x7feb50133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 --2- 172.21.15.125:0/667101937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009840 tx=0x7feb4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 -- 172.21.15.125:0/667101937 shutdown_connections 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 --2- 172.21.15.125:0/667101937 >> v2:172.21.15.125:3300/0 conn(0x7feb50130bc0 0x7feb5013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 --2- 172.21.15.125:0/667101937 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb50133ad0 0x7feb50133ea0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 -- 172.21.15.125:0/667101937 >> 172.21.15.125:0/667101937 conn(0x7feb50099c40 msgr2=0x7feb500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 -- 172.21.15.125:0/667101937 shutdown_connections 2023-10-03T10:16:52.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.840+0000 7feb574b9700 1 -- 172.21.15.125:0/667101937 wait complete. 2023-10-03T10:16:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 Processor -- start 2023-10-03T10:16:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 -- start start 2023-10-03T10:16:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 0x7feb50071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb50133ad0 0x7feb50071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5011fcc0 con 0x7feb50130bc0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5011fec0 con 0x7feb50133ad0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.841+0000 7feb574b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb50072700 con 0x7feb501300a0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb55255700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 0x7feb50071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb55255700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51256/0 (socket says 172.21.15.125:51256) 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb55255700 1 -- 172.21.15.125:0/1546455761 learned_addr learned my addr 172.21.15.125:0/1546455761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb55a56700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb50133ad0 0x7feb50071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 -- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 msgr2=0x7feb50071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 -- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb50133ad0 msgr2=0x7feb50071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb50133ad0 0x7feb50071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 -- 172.21.15.125:0/1546455761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009b30 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb55255700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb54a54700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 0x7feb50071870 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7feb4000c390 tx=0x7feb4000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400052d0 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40005450 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0094a0 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400038c0 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.842+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5011f920 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.843+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb40003a20 con 0x7feb50130bc0 2023-10-03T10:16:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.843+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb4003ea90 con 0x7feb50130bc0 2023-10-03T10:16:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.843+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb500a3490 con 0x7feb50130bc0 2023-10-03T10:16:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:52.848+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb40017070 con 0x7feb50130bc0 2023-10-03T10:16:53.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.001+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70ec04f2a0 con 0x7f70ec09e870 2023-10-03T10:16:53.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.002+0000 7f70e8ff9700 1 -- 172.21.15.125:0/4114524626 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70dc011360 con 0x7f70ec09e870 2023-10-03T10:16:53.003 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 msgr2=0x7f70ec11f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c520 tx=0x7f70dc00c830 comp rx=0 tx=0).stop 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 shutdown_connections 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70ec1371c0 0x7f70ec120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f70ec09e870 0x7f70ec11f5e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 --2- 172.21.15.125:0/4114524626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70ec09f350 0x7f70ec11fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 >> 172.21.15.125:0/4114524626 conn(0x7f70ec0a4430 msgr2=0x7f70ec09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 shutdown_connections 2023-10-03T10:16:53.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.004+0000 7f70f24fb700 1 -- 172.21.15.125:0/4114524626 wait complete. 2023-10-03T10:16:53.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:53.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.039+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb5009cb20 con 0x7feb50130bc0 2023-10-03T10:16:53.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.040+0000 7feb45ffb700 1 -- 172.21.15.125:0/1546455761 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb40019d20 con 0x7feb50130bc0 2023-10-03T10:16:53.040 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:53.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 msgr2=0x7feb50071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 0x7feb50071870 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7feb4000c390 tx=0x7feb4000c6a0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 shutdown_connections 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb50133ad0 0x7feb50071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb501300a0 0x7feb50071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 --2- 172.21.15.125:0/1546455761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb50130bc0 0x7feb50071870 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 >> 172.21.15.125:0/1546455761 conn(0x7feb50099c40 msgr2=0x7feb50132a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 shutdown_connections 2023-10-03T10:16:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.042+0000 7feb574b9700 1 -- 172.21.15.125:0/1546455761 wait complete. 2023-10-03T10:16:53.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:53.092 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:53.132 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:53.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.219+0000 7f1a2cd97700 1 Processor -- start 2023-10-03T10:16:53.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.219+0000 7f1a2cd97700 1 -- start start 2023-10-03T10:16:53.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2cd97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2cd97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2cd97700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2809b110 con 0x7f1a2809ad40 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2cd97700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280a3b60 con 0x7f1a28134140 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2cd97700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280a1a80 con 0x7f1a28134570 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a25d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a26d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1a2809ad40 0x7f1a28133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42024/0 (socket says 172.21.15.125:42024) 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a25d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54688/0 (socket says 172.21.15.125:54688) 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a26d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51264/0 (socket says 172.21.15.125:51264) 2023-10-03T10:16:53.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.220+0000 7f1a2659c700 1 -- 172.21.15.125:0/2542457617 learned_addr learned my addr 172.21.15.125:0/2542457617 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a25d9b700 1 -- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 msgr2=0x7f1a2813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a25d9b700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a25d9b700 1 -- 172.21.15.125:0/2542457617 >> v1:172.21.15.125:6789/0 conn(0x7f1a2809ad40 legacy=0x7f1a28133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a25d9b700 1 -- 172.21.15.125:0/2542457617 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280a2fa0 con 0x7f1a28134140 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2559a700 1 -- 172.21.15.125:0/2542457617 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161118819 0 0) 0x7f1a2809b110 con 0x7f1a2809ad40 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a26d9d700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a25d9b700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0098a0 tx=0x7f1a1c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab72e5ea5ae03257 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2559a700 1 -- 172.21.15.125:0/2542457617 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c011830 con 0x7f1a28134140 2023-10-03T10:16:53.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2559a700 1 -- 172.21.15.125:0/2542457617 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c011990 con 0x7f1a28134140 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2559a700 1 -- 172.21.15.125:0/2542457617 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c011d20 con 0x7f1a28134140 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2cd97700 1 -- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 msgr2=0x7f1a28138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.221+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0098a0 tx=0x7f1a1c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 -- 172.21.15.125:0/2542457617 shutdown_connections 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/2542457617 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a28134140 0x7f1a28138e80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 -- 172.21.15.125:0/2542457617 >> 172.21.15.125:0/2542457617 conn(0x7f1a28099c40 msgr2=0x7f1a2806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 -- 172.21.15.125:0/2542457617 shutdown_connections 2023-10-03T10:16:53.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.222+0000 7f1a2cd97700 1 -- 172.21.15.125:0/2542457617 wait complete. 2023-10-03T10:16:53.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 Processor -- start 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 -- start start 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2811edf0 con 0x7f1a28134140 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2813aa10 con 0x7f1a2809ad40 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2cd97700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2811e1c0 con 0x7f1a28134570 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a25d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a25d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48470/0 (socket says 172.21.15.125:48470) 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a2659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54698/0 (socket says 172.21.15.125:54698) 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a26d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.223+0000 7f1a25d9b700 1 -- 172.21.15.125:0/653797472 learned_addr learned my addr 172.21.15.125:0/653797472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 -- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 msgr2=0x7f1a2811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 -- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 msgr2=0x7f1a2811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 -- 172.21.15.125:0/653797472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009a70 con 0x7f1a2809ad40 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a25d9b700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a26d9d700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2659c700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c3f0 tx=0x7f1a1800c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18004a70 con 0x7f1a2809ad40 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18004c10 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c0094a0 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180070d0 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.224+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a28133710 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.225+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2811e970 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.225+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a18007230 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.226+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a1803f890 con 0x7f1a2809ad40 2023-10-03T10:16:53.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.230+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a180010e0 con 0x7f1a2809ad40 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.263+0000 7f9ea2de6700 1 Processor -- start 2023-10-03T10:16:53.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.263+0000 7f9ea2de6700 1 -- start start 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9c09e870 0x7f9e9c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 0x7f9e9c134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c06ce60 con 0x7f9e9c09e870 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c06bec0 con 0x7f9e9c09f180 2023-10-03T10:16:53.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea2de6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c09fa00 con 0x7f9e9c1341d0 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9c09e870 0x7f9e9c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54708/0 (socket says 172.21.15.125:54708) 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e9c09e870 0x7f9e9c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48482/0 (socket says 172.21.15.125:48482) 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9e9bfff700 1 -- 172.21.15.125:0/2098729132 learned_addr learned my addr 172.21.15.125:0/2098729132 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea1383700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 0x7f9e9c134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 -- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 msgr2=0x7f9e9c134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 0x7f9e9c134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 -- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 msgr2=0x7f9e9c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 -- 172.21.15.125:0/2098729132 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c09ad80 con 0x7f9e9c09e870 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9e9bfff700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea1383700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 0x7f9e9c134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.264+0000 7f9ea0b82700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c09e870 0x7f9e9c09ec40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009870 tx=0x7f9e90009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71134d381019b66b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9e9b7fe700 1 -- 172.21.15.125:0/2098729132 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90011830 con 0x7f9e9c09e870 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9e9b7fe700 1 -- 172.21.15.125:0/2098729132 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90011990 con 0x7f9e9c09e870 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9e9b7fe700 1 -- 172.21.15.125:0/2098729132 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90011d20 con 0x7f9e9c09e870 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 -- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c09e870 msgr2=0x7f9e9c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c09e870 0x7f9e9c09ec40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009870 tx=0x7f9e90009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 -- 172.21.15.125:0/2098729132 shutdown_connections 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c1341d0 0x7f9e9c134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c09e870 0x7f9e9c09ec40 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/2098729132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 -- 172.21.15.125:0/2098729132 >> 172.21.15.125:0/2098729132 conn(0x7f9e9c0a4430 msgr2=0x7f9e9c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 -- 172.21.15.125:0/2098729132 shutdown_connections 2023-10-03T10:16:53.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.265+0000 7f9ea2de6700 1 -- 172.21.15.125:0/2098729132 wait complete. 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.266+0000 7f9ea2de6700 1 Processor -- start 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.266+0000 7f9ea2de6700 1 -- start start 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 0x7f9e9c122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 0x7f9e9c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c125020 con 0x7f9e9c1341d0 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c126060 con 0x7f9e9c09f180 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea2de6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c125b50 con 0x7f9e9c09e870 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea0b82700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 0x7f9e9c122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9ea1383700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 0x7f9e9c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54710/0 (socket says 172.21.15.125:54710) 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.267+0000 7f9e9bfff700 1 -- 172.21.15.125:0/872926139 learned_addr learned my addr 172.21.15.125:0/872926139 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 -- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 msgr2=0x7f9e9c122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 0x7f9e9c122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 -- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 msgr2=0x7f9e9c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 0x7f9e9c122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 -- 172.21.15.125:0/872926139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009550 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9ea0b82700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 0x7f9e9c122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9ea1383700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 0x7f9e9c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e9bfff700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ebe0 tx=0x7f9e8800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800c850 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8800c9b0 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800cd20 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e94009a70 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.268+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e900094a0 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.269+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e88013470 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.269+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e8803faf0 con 0x7f9e9c09f180 2023-10-03T10:16:53.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.269+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c06cfa0 con 0x7f9e9c09f180 2023-10-03T10:16:53.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.274+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e88017070 con 0x7f9e9c09f180 2023-10-03T10:16:53.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.424+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a2804f2a0 con 0x7f1a2809ad40 2023-10-03T10:16:53.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.425+0000 7f1a16ffd700 1 -- 172.21.15.125:0/653797472 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a1801b340 con 0x7f1a2809ad40 2023-10-03T10:16:53.425 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:53.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 msgr2=0x7f1a2811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c3f0 tx=0x7f1a1800c700 comp rx=0 tx=0).stop 2023-10-03T10:16:53.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 shutdown_connections 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1a28134570 0x7f1a2811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a2809ad40 0x7f1a2811c8c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 --2- 172.21.15.125:0/653797472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a28134140 0x7f1a2811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 >> 172.21.15.125:0/653797472 conn(0x7f1a28099c40 msgr2=0x7f1a2809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 shutdown_connections 2023-10-03T10:16:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.427+0000 7f1a2cd97700 1 -- 172.21.15.125:0/653797472 wait complete. 2023-10-03T10:16:53.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:53.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.466+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9e9c04f2a0 con 0x7f9e9c09f180 2023-10-03T10:16:53.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.466+0000 7f9e997fa700 1 -- 172.21.15.125:0/872926139 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e8802a090 con 0x7f9e9c09f180 2023-10-03T10:16:53.467 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 msgr2=0x7f9e9c122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ebe0 tx=0x7f9e8800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 shutdown_connections 2023-10-03T10:16:53.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e9c1341d0 0x7f9e9c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9e9c09e870 0x7f9e9c122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 --2- 172.21.15.125:0/872926139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e9c09f180 0x7f9e9c122a80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 >> 172.21.15.125:0/872926139 conn(0x7f9e9c0a4430 msgr2=0x7f9e9c072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 shutdown_connections 2023-10-03T10:16:53.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:53.469+0000 7f9ea2de6700 1 -- 172.21.15.125:0/872926139 wait complete. 2023-10-03T10:16:53.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:54.017 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:54.054 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:54.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.148+0000 7fb2b9a20700 1 Processor -- start 2023-10-03T10:16:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.148+0000 7fb2b9a20700 1 -- start start 2023-10-03T10:16:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b9a20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b9a20700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b9a20700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b409c970 con 0x7fb2b4131d70 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b9a20700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40a0920 con 0x7fb2b409f180 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b9a20700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b409f9c0 con 0x7fb2b409e870 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48504/0 (socket says 172.21.15.125:48504) 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54716/0 (socket says 172.21.15.125:54716) 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b27fc700 1 -- 172.21.15.125:0/602270768 learned_addr learned my addr 172.21.15.125:0/602270768 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b37fe700 1 --1- 172.21.15.125:0/602270768 >> v1:172.21.15.125:6789/0 conn(0x7fb2b4131d70 0x7fb2b4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42032/0 (socket says 172.21.15.125:42032) 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 -- 172.21.15.125:0/602270768 >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 msgr2=0x7fb2b4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 --2- 172.21.15.125:0/602270768 >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 -- 172.21.15.125:0/602270768 >> v1:172.21.15.125:6789/0 conn(0x7fb2b4131d70 legacy=0x7fb2b4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 -- 172.21.15.125:0/602270768 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b409bab0 con 0x7fb2b409e870 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b1ffb700 1 -- 172.21.15.125:0/602270768 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888175486 0 0) 0x7fb2b409c970 con 0x7fb2b4131d70 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b27fc700 1 --2- 172.21.15.125:0/602270768 >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b2ffd700 1 --2- 172.21.15.125:0/602270768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b05d445cb509233 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b1ffb700 1 -- 172.21.15.125:0/602270768 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011830 con 0x7fb2b409e870 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b1ffb700 1 -- 172.21.15.125:0/602270768 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4011990 con 0x7fb2b409e870 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.149+0000 7fb2b1ffb700 1 -- 172.21.15.125:0/602270768 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011d20 con 0x7fb2b409e870 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 -- 172.21.15.125:0/602270768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 msgr2=0x7fb2b409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/602270768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009840 tx=0x7fb2a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 -- 172.21.15.125:0/602270768 shutdown_connections 2023-10-03T10:16:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/602270768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b409e870 0x7fb2b409ec40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/602270768 >> v2:172.21.15.125:3300/0 conn(0x7fb2b409f180 0x7fb2b4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 -- 172.21.15.125:0/602270768 >> 172.21.15.125:0/602270768 conn(0x7fb2b40a4430 msgr2=0x7fb2b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 -- 172.21.15.125:0/602270768 shutdown_connections 2023-10-03T10:16:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.150+0000 7fb2b9a20700 1 -- 172.21.15.125:0/602270768 wait complete. 2023-10-03T10:16:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.151+0000 7fb2b9a20700 1 Processor -- start 2023-10-03T10:16:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.151+0000 7fb2b9a20700 1 -- start start 2023-10-03T10:16:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 0x7fb2b411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4121830 con 0x7fb2b409f180 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b409dba0 con 0x7fb2b4131d70 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4131980 con 0x7fb2b409e870 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54722/0 (socket says 172.21.15.125:54722) 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51290/0 (socket says 172.21.15.125:51290) 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 -- 172.21.15.125:0/2463672458 learned_addr learned my addr 172.21.15.125:0/2463672458 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b27fc700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 0x7fb2b411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 -- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 msgr2=0x7fb2b411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 -- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 msgr2=0x7fb2b411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 0x7fb2b411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 -- 172.21.15.125:0/2463672458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009550 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b27fc700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 0x7fb2b411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b2ffd700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b37fe700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00cc70 tx=0x7fb2ac00cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00aac0 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac00ac40 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40094a0 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.152+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0070d0 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.153+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b40a2890 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.153+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2ac007250 con 0x7fb2b4131d70 2023-10-03T10:16:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.153+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b409ec40 con 0x7fb2b4131d70 2023-10-03T10:16:54.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.154+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2ac03f1d0 con 0x7fb2b4131d70 2023-10-03T10:16:54.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.158+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2ac01b360 con 0x7fb2b4131d70 2023-10-03T10:16:54.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 Processor -- start 2023-10-03T10:16:54.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 -- start start 2023-10-03T10:16:54.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef01347b0 0x7f1ef0136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 0x7f1ef01394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef006f970 con 0x7f1ef0098410 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00720a0 con 0x7f1ef01347b0 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1ef4afb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0098ef0 con 0x7f1ef01370d0 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1eedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef01347b0 0x7f1ef0136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1eeed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 0x7f1ef01394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1eedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ef01347b0 0x7f1ef0136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48508/0 (socket says 172.21.15.125:48508) 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.190+0000 7f1eedd9b700 1 -- 172.21.15.125:0/2878297764 learned_addr learned my addr 172.21.15.125:0/2878297764 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eedd9b700 1 -- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 msgr2=0x7f1ef01394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 0x7f1ef01394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eedd9b700 1 -- 172.21.15.125:0/2878297764 >> v1:172.21.15.125:6789/0 conn(0x7f1ef0098410 legacy=0x7f1ef00987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eed59a700 1 -- 172.21.15.125:0/2878297764 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706206943 0 0) 0x7f1ef006f970 con 0x7f1ef0098410 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eedd9b700 1 -- 172.21.15.125:0/2878297764 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0072290 con 0x7f1ef01347b0 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eeed9d700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 0x7f1ef01394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef01347b0 0x7f1ef0136b90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80be52379b187a25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eed59a700 1 -- 172.21.15.125:0/2878297764 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011830 con 0x7f1ef01347b0 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eed59a700 1 -- 172.21.15.125:0/2878297764 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4011990 con 0x7f1ef01347b0 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.191+0000 7f1eed59a700 1 -- 172.21.15.125:0/2878297764 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011d20 con 0x7f1ef01347b0 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 -- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef01347b0 msgr2=0x7f1ef0136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef01347b0 0x7f1ef0136b90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:54.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 -- 172.21.15.125:0/2878297764 shutdown_connections 2023-10-03T10:16:54.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01370d0 0x7f1ef01394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/2878297764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef01347b0 0x7f1ef0136b90 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 -- 172.21.15.125:0/2878297764 >> 172.21.15.125:0/2878297764 conn(0x7f1ef00a2b30 msgr2=0x7f1ef009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 -- 172.21.15.125:0/2878297764 shutdown_connections 2023-10-03T10:16:54.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.192+0000 7f1ef4afb700 1 -- 172.21.15.125:0/2878297764 wait complete. 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.193+0000 7f1ef4afb700 1 Processor -- start 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.193+0000 7f1ef4afb700 1 -- start start 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01370d0 0x7f1ef0127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00a1c00 con 0x7f1ef0098410 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0129940 con 0x7f1ef01347b0 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1ef4afb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef012a8a0 con 0x7f1ef01370d0 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eee59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54728/0 (socket says 172.21.15.125:54728) 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eee59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48510/0 (socket says 172.21.15.125:48510) 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 -- 172.21.15.125:0/634841549 learned_addr learned my addr 172.21.15.125:0/634841549 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eeed9d700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01370d0 0x7f1ef0127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 -- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01370d0 msgr2=0x7f1ef0127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01370d0 0x7f1ef0127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 -- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 msgr2=0x7f1ef0126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 -- 172.21.15.125:0/634841549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009a70 con 0x7f1ef01347b0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eee59c700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1eedd9b700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009c40 tx=0x7f1ee4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.194+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4004550 con 0x7f1ef01347b0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee401d7c0 con 0x7f1ef01347b0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee401db70 con 0x7f1ef01347b0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4009550 con 0x7f1ef01347b0 2023-10-03T10:16:54.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef0128260 con 0x7f1ef01347b0 2023-10-03T10:16:54.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ee401dcd0 con 0x7f1ef01347b0 2023-10-03T10:16:54.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ee4044b20 con 0x7f1ef01347b0 2023-10-03T10:16:54.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.195+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef009dfe0 con 0x7f1ef01347b0 2023-10-03T10:16:54.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.200+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ee4015080 con 0x7f1ef01347b0 2023-10-03T10:16:54.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.352+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2b404f2a0 con 0x7fb2b4131d70 2023-10-03T10:16:54.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.352+0000 7fb29bfff700 1 -- 172.21.15.125:0/2463672458 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2ac018030 con 0x7fb2b4131d70 2023-10-03T10:16:54.353 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 msgr2=0x7fb2b411f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00cc70 tx=0x7fb2ac00cf80 comp rx=0 tx=0).stop 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 shutdown_connections 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2b4131d70 0x7fb2b411f550 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2b409e870 0x7fb2b411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 --2- 172.21.15.125:0/2463672458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b409f180 0x7fb2b411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 >> 172.21.15.125:0/2463672458 conn(0x7fb2b40a4430 msgr2=0x7fb2b406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.354+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 shutdown_connections 2023-10-03T10:16:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.355+0000 7fb2b9a20700 1 -- 172.21.15.125:0/2463672458 wait complete. 2023-10-03T10:16:54.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.397+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1ef004f2a0 con 0x7f1ef01347b0 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.397+0000 7f1edeffd700 1 -- 172.21.15.125:0/634841549 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ee4030440 con 0x7f1ef01347b0 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 msgr2=0x7f1ef01274e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009c40 tx=0x7f1ee4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 shutdown_connections 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1ef01370d0 0x7f1ef0127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ef0098410 0x7f1ef0126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 --2- 172.21.15.125:0/634841549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ef01347b0 0x7f1ef01274e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 >> 172.21.15.125:0/634841549 conn(0x7f1ef00a2b30 msgr2=0x7f1ef009c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 shutdown_connections 2023-10-03T10:16:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.399+0000 7f1ef4afb700 1 -- 172.21.15.125:0/634841549 wait complete. 2023-10-03T10:16:54.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:54.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:54.482 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.579+0000 7fe9ce47c700 1 Processor -- start 2023-10-03T10:16:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 -- start start 2023-10-03T10:16:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 0x7fe9c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 0x7fe9c813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c809dc00 con 0x7fe9c80a1380 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809ea90 con 0x7fe9c80a0a70 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9ce47c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809dec0 con 0x7fe9c8134120 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9cca19700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 0x7fe9c813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9c7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 0x7fe9c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9c77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe9c80a1380 0x7fe9c8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42040/0 (socket says 172.21.15.125:42040) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.580+0000 7fe9c77fe700 1 -- 172.21.15.125:0/4168575898 learned_addr learned my addr 172.21.15.125:0/4168575898 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c7fff700 1 -- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 msgr2=0x7fe9c813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c7fff700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 0x7fe9c813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c7fff700 1 -- 172.21.15.125:0/4168575898 >> v1:172.21.15.125:6789/0 conn(0x7fe9c80a1380 legacy=0x7fe9c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c7fff700 1 -- 172.21.15.125:0/4168575898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c809e6a0 con 0x7fe9c80a0a70 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c6ffd700 1 -- 172.21.15.125:0/4168575898 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758805902 0 0) 0x7fe9c809dc00 con 0x7fe9c80a1380 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9cca19700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 0x7fe9c813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c7fff700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 0x7fe9c80a0e40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009870 tx=0x7fe9b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8cf6964cf10a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c6ffd700 1 -- 172.21.15.125:0/4168575898 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011830 con 0x7fe9c80a0a70 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c6ffd700 1 -- 172.21.15.125:0/4168575898 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8011990 con 0x7fe9c80a0a70 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.581+0000 7fe9c6ffd700 1 -- 172.21.15.125:0/4168575898 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011d20 con 0x7fe9c80a0a70 2023-10-03T10:16:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 -- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 msgr2=0x7fe9c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 0x7fe9c80a0e40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009870 tx=0x7fe9b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 -- 172.21.15.125:0/4168575898 shutdown_connections 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c8134120 0x7fe9c813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/4168575898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a0a70 0x7fe9c80a0e40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 -- 172.21.15.125:0/4168575898 >> 172.21.15.125:0/4168575898 conn(0x7fe9c80a6610 msgr2=0x7fe9c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 -- 172.21.15.125:0/4168575898 shutdown_connections 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.582+0000 7fe9ce47c700 1 -- 172.21.15.125:0/4168575898 wait complete. 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.583+0000 7fe9ce47c700 1 Processor -- start 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.583+0000 7fe9ce47c700 1 -- start start 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 0x7fe9c8122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 0x7fe9c81233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81270d0 con 0x7fe9c8134120 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80a03e0 con 0x7fe9c80a1380 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9ce47c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8125eb0 con 0x7fe9c80a0a70 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54744/0 (socket says 172.21.15.125:54744) 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9c77fe700 1 -- 172.21.15.125:0/3178960156 learned_addr learned my addr 172.21.15.125:0/3178960156 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9cca19700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 0x7fe9c81233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.584+0000 7fe9c7fff700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 0x7fe9c8122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 -- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 msgr2=0x7fe9c8122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 0x7fe9c8122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 -- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 msgr2=0x7fe9c8122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 -- 172.21.15.125:0/3178960156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009a70 con 0x7fe9c8134120 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9c7fff700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 0x7fe9c8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9c77fe700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9cca19700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 0x7fe9c81233b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000efc0 tx=0x7fe9c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ca90 con 0x7fe9c8134120 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000f040 con 0x7fe9c8134120 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80094a0 con 0x7fe9c8134120 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ce30 con 0x7fe9c8134120 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.585+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c8126450 con 0x7fe9c8134120 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.586+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9c0014480 con 0x7fe9c8134120 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.586+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9c003fd20 con 0x7fe9c8134120 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.586+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c809a020 con 0x7fe9c8134120 2023-10-03T10:16:54.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.594+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9c0012930 con 0x7fe9c8134120 2023-10-03T10:16:54.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 Processor -- start 2023-10-03T10:16:54.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 -- start start 2023-10-03T10:16:54.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c0a3b60 con 0x7f053c0a0a70 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c1348e0 con 0x7f053c133f70 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0540ebb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f053c09b110 con 0x7f053c09ad40 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f053ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f053a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0539d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0539d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54752/0 (socket says 172.21.15.125:54752) 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f0539d9b700 1 -- 172.21.15.125:0/3185899362 learned_addr learned my addr 172.21.15.125:0/3185899362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f053ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48528/0 (socket says 172.21.15.125:48528) 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.625+0000 7f053a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51320/0 (socket says 172.21.15.125:51320) 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 -- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 msgr2=0x7f053c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 -- 172.21.15.125:0/3185899362 >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 msgr2=0x7f053c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 --2- 172.21.15.125:0/3185899362 >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 -- 172.21.15.125:0/3185899362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0a2fa0 con 0x7f053c133f70 2023-10-03T10:16:54.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f053a59c700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f053ad9d700 1 --2- 172.21.15.125:0/3185899362 >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f0539d9b700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0530009920 tx=0x7f0530009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf72bf486f39f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f053959a700 1 -- 172.21.15.125:0/3185899362 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530011830 con 0x7f053c133f70 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f053959a700 1 -- 172.21.15.125:0/3185899362 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0530011990 con 0x7f053c133f70 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.626+0000 7f053959a700 1 -- 172.21.15.125:0/3185899362 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530011d20 con 0x7f053c133f70 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 -- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 msgr2=0x7f053c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0530009920 tx=0x7f0530009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 -- 172.21.15.125:0/3185899362 shutdown_connections 2023-10-03T10:16:54.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 --2- 172.21.15.125:0/3185899362 >> v2:172.21.15.125:3300/0 conn(0x7f053c0a0a70 0x7f053c0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 --2- 172.21.15.125:0/3185899362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c1343a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 -- 172.21.15.125:0/3185899362 >> 172.21.15.125:0/3185899362 conn(0x7f053c099c40 msgr2=0x7f053c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 -- 172.21.15.125:0/3185899362 shutdown_connections 2023-10-03T10:16:54.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.627+0000 7f0540ebb700 1 -- 172.21.15.125:0/3185899362 wait complete. 2023-10-03T10:16:54.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 Processor -- start 2023-10-03T10:16:54.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 -- start start 2023-10-03T10:16:54.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 0x7f053c121950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c122fd0 con 0x7f053c0a0a70 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c122870 con 0x7f053c133f70 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0540ebb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f053c123e60 con 0x7f053c09ad40 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f053a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f0539d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 0x7f053c121950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f053a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51326/0 (socket says 172.21.15.125:51326) 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f053a59c700 1 -- 172.21.15.125:0/701123970 learned_addr learned my addr 172.21.15.125:0/701123970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.628+0000 7f053ad9d700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 -- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 msgr2=0x7f053c121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c121e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 -- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 msgr2=0x7f053c121950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 0x7f053c121950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 -- 172.21.15.125:0/701123970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0094a0 con 0x7f053c09ad40 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f0539d9b700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 0x7f053c121950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f053a59c700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e980 tx=0x7f052c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0096e0 con 0x7f053c09ad40 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00c640 con 0x7f053c09ad40 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00c9f0 con 0x7f053c09ad40 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0534009a70 con 0x7f053c09ad40 2023-10-03T10:16:54.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.629+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530009550 con 0x7f053c09ad40 2023-10-03T10:16:54.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.630+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c09bf00 con 0x7f053c09ad40 2023-10-03T10:16:54.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.630+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f052c00cb50 con 0x7f053c09ad40 2023-10-03T10:16:54.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.630+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f052c03f9c0 con 0x7f053c09ad40 2023-10-03T10:16:54.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.635+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f052c013470 con 0x7f053c09ad40 2023-10-03T10:16:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.788+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9c81260b0 con 0x7fe9c8134120 2023-10-03T10:16:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.788+0000 7fe9c4ff9700 1 -- 172.21.15.125:0/3178960156 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9c0012340 con 0x7fe9c8134120 2023-10-03T10:16:54.788 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:54.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 msgr2=0x7fe9c81233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 0x7fe9c81233b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000efc0 tx=0x7fe9c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 shutdown_connections 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9c8134120 0x7fe9c81233b0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe9c80a0a70 0x7fe9c8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 --2- 172.21.15.125:0/3178960156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9c80a1380 0x7fe9c8122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 >> 172.21.15.125:0/3178960156 conn(0x7fe9c80a6610 msgr2=0x7fe9c80a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 shutdown_connections 2023-10-03T10:16:54.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.790+0000 7fe9ce47c700 1 -- 172.21.15.125:0/3178960156 wait complete. 2023-10-03T10:16:54.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:54.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.829+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f053c11e060 con 0x7f053c09ad40 2023-10-03T10:16:54.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.829+0000 7f052affd700 1 -- 172.21.15.125:0/701123970 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f052c021070 con 0x7f053c09ad40 2023-10-03T10:16:54.829 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 msgr2=0x7f053c121410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e980 tx=0x7f052c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 shutdown_connections 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f053c133f70 0x7f053c121e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f053c09ad40 0x7f053c121410 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 --2- 172.21.15.125:0/701123970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f053c0a0a70 0x7f053c121950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 >> 172.21.15.125:0/701123970 conn(0x7f053c099c40 msgr2=0x7f053c1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 shutdown_connections 2023-10-03T10:16:54.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:54.831+0000 7f0540ebb700 1 -- 172.21.15.125:0/701123970 wait complete. 2023-10-03T10:16:54.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:55.368 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:55.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.496+0000 7fa505a2d700 1 Processor -- start 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.496+0000 7fa505a2d700 1 -- start start 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa505a2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5000a0a70 0x7fa5000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa505a2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5000a1380 0x7fa500133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa505a2d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50009dc00 con 0x7fa500133f50 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa505a2d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50009ea60 con 0x7fa5000a1380 2023-10-03T10:16:55.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa505a2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50009dec0 con 0x7fa5000a0a70 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5000a1380 0x7fa500133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5000a1380 0x7fa500133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56900/0 (socket says 172.21.15.125:56900) 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/634866809 learned_addr learned my addr 172.21.15.125:0/634866809 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4ff7fe700 1 --1- 172.21.15.125:0/634866809 >> v1:172.21.15.125:6789/0 conn(0x7fa500133f50 0x7fa50013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51602/0 (socket says 172.21.15.125:51602) 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4feffd700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5000a0a70 0x7fa5000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5000a0a70 msgr2=0x7fa5000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5000a0a70 0x7fa5000a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/634866809 >> v1:172.21.15.125:6789/0 conn(0x7fa500133f50 legacy=0x7fa50013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/634866809 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50009e6a0 con 0x7fa5000a1380 2023-10-03T10:16:55.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fdffb700 1 -- 172.21.15.125:0/634866809 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857511419 0 0) 0x7fa50009dc00 con 0x7fa500133f50 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.497+0000 7fa4fe7fc700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500133a10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40098f0 tx=0x7fa4f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d795e47d8543b267 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa4fdffb700 1 -- 172.21.15.125:0/634866809 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011830 con 0x7fa5000a1380 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa4fdffb700 1 -- 172.21.15.125:0/634866809 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4011990 con 0x7fa5000a1380 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa4fdffb700 1 -- 172.21.15.125:0/634866809 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011d20 con 0x7fa5000a1380 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 -- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 msgr2=0x7fa500133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500133a10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40098f0 tx=0x7fa4f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 -- 172.21.15.125:0/634866809 shutdown_connections 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa5000a0a70 0x7fa5000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 --2- 172.21.15.125:0/634866809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500133a10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 -- 172.21.15.125:0/634866809 >> 172.21.15.125:0/634866809 conn(0x7fa5000a6610 msgr2=0x7fa5000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 -- 172.21.15.125:0/634866809 shutdown_connections 2023-10-03T10:16:55.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.498+0000 7fa505a2d700 1 -- 172.21.15.125:0/634866809 wait complete. 2023-10-03T10:16:55.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.499+0000 7fa505a2d700 1 Processor -- start 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.499+0000 7fa505a2d700 1 -- start start 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5000a0a70 0x7fa500122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 0x7fa500123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500126220 con 0x7fa5000a1380 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa500133960 con 0x7fa5000a0a70 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa500133420 con 0x7fa500133f50 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56916/0 (socket says 172.21.15.125:56916) 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/20985865 learned_addr learned my addr 172.21.15.125:0/20985865 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5000a0a70 0x7fa500122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4ff7fe700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 0x7fa500123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 msgr2=0x7fa500123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 0x7fa500123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5000a0a70 msgr2=0x7fa500122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5000a0a70 0x7fa500122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 -- 172.21.15.125:0/20985865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4009550 con 0x7fa5000a1380 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4ff7fe700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 0x7fa500123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4fe7fc700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009c40 tx=0x7fa4f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4004300 con 0x7fa5000a1380 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f401f070 con 0x7fa5000a1380 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5000a03e0 con 0x7fa5000a1380 2023-10-03T10:16:55.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.500+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40036a0 con 0x7fa5000a1380 2023-10-03T10:16:55.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.501+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa500124d80 con 0x7fa5000a1380 2023-10-03T10:16:55.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.501+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4f4021030 con 0x7fa5000a1380 2023-10-03T10:16:55.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.501+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4f4040930 con 0x7fa5000a1380 2023-10-03T10:16:55.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.502+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50004f2a0 con 0x7fa5000a1380 2023-10-03T10:16:55.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.506+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4f40199a0 con 0x7fa5000a1380 2023-10-03T10:16:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 Processor -- start 2023-10-03T10:16:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 -- start start 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66f409f3b0 0x7f66f413f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f4072b30 con 0x7f66f409a130 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f409a500 con 0x7f66f409f3b0 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.538+0000 7f66f9477700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f409ada0 con 0x7f66f409ef80 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66f409f3b0 0x7f66f413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55728/0 (socket says 172.21.15.125:55728) 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 -- 172.21.15.125:0/3398130732 learned_addr learned my addr 172.21.15.125:0/3398130732 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 -- 172.21.15.125:0/3398130732 >> v2:172.21.15.125:3300/0 conn(0x7f66f409f3b0 msgr2=0x7f66f413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 --2- 172.21.15.125:0/3398130732 >> v2:172.21.15.125:3300/0 conn(0x7f66f409f3b0 0x7f66f413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 -- 172.21.15.125:0/3398130732 >> v1:172.21.15.125:6789/0 conn(0x7f66f409a130 legacy=0x7f66f409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 -- 172.21.15.125:0/3398130732 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f409fe00 con 0x7f66f409ef80 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f27fc700 1 --2- 172.21.15.125:0/3398130732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098f0 tx=0x7f66e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca64755de91c6744 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f1ffb700 1 -- 172.21.15.125:0/3398130732 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011830 con 0x7f66f409ef80 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f1ffb700 1 -- 172.21.15.125:0/3398130732 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8011990 con 0x7f66f409ef80 2023-10-03T10:16:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.539+0000 7f66f1ffb700 1 -- 172.21.15.125:0/3398130732 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011d20 con 0x7f66f409ef80 2023-10-03T10:16:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 -- 172.21.15.125:0/3398130732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 msgr2=0x7f66f413d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 --2- 172.21.15.125:0/3398130732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098f0 tx=0x7f66e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 -- 172.21.15.125:0/3398130732 shutdown_connections 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 --2- 172.21.15.125:0/3398130732 >> v2:172.21.15.125:3300/0 conn(0x7f66f409f3b0 0x7f66f413f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 --2- 172.21.15.125:0/3398130732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409ef80 0x7f66f413d420 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 -- 172.21.15.125:0/3398130732 >> 172.21.15.125:0/3398130732 conn(0x7f66f40a4430 msgr2=0x7f66f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 -- 172.21.15.125:0/3398130732 shutdown_connections 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.540+0000 7f66f9477700 1 -- 172.21.15.125:0/3398130732 wait complete. 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.541+0000 7f66f9477700 1 Processor -- start 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.541+0000 7f66f9477700 1 -- start start 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f409a130 0x7f66f411a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66f409ef80 0x7f66f411ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f411ba90 con 0x7f66f409a130 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f411c710 con 0x7f66f409f3b0 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f9477700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f413b1a0 con 0x7f66f409ef80 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55736/0 (socket says 172.21.15.125:55736) 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 -- 172.21.15.125:0/1994489579 learned_addr learned my addr 172.21.15.125:0/1994489579 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f27fc700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66f409ef80 0x7f66f411ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f2ffd700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f409a130 0x7f66f411a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 -- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66f409ef80 msgr2=0x7f66f411ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66f409ef80 0x7f66f411ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 -- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f409a130 msgr2=0x7f66f411a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f409a130 0x7f66f411a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 -- 172.21.15.125:0/1994489579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009550 con 0x7f66f409f3b0 2023-10-03T10:16:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.542+0000 7f66f37fe700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00efc0 tx=0x7f66ec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.543+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec009ea0 con 0x7f66f409f3b0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.543+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00f040 con 0x7f66f409f3b0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.543+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f40a00f0 con 0x7f66f409f3b0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.543+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec014480 con 0x7f66f409f3b0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.543+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f411d4e0 con 0x7f66f409f3b0 2023-10-03T10:16:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.544+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66ec0145e0 con 0x7f66f409f3b0 2023-10-03T10:16:55.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.544+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66ec0402b0 con 0x7f66f409f3b0 2023-10-03T10:16:55.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.544+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f404f2a0 con 0x7f66f409f3b0 2023-10-03T10:16:55.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.548+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66ec018030 con 0x7f66f409f3b0 2023-10-03T10:16:55.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.698+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa500072980 con 0x7fa5000a1380 2023-10-03T10:16:55.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.699+0000 7fa4e7fff700 1 -- 172.21.15.125:0/20985865 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4f4015020 con 0x7fa5000a1380 2023-10-03T10:16:55.699 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:55.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 msgr2=0x7fa500122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009c40 tx=0x7fa4f4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 shutdown_connections 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa500133f50 0x7fa500123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5000a0a70 0x7fa500122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 --2- 172.21.15.125:0/20985865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5000a1380 0x7fa500122e40 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 >> 172.21.15.125:0/20985865 conn(0x7fa5000a6610 msgr2=0x7fa5000a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 shutdown_connections 2023-10-03T10:16:55.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.701+0000 7fa505a2d700 1 -- 172.21.15.125:0/20985865 wait complete. 2023-10-03T10:16:55.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.743+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66f411db30 con 0x7f66f409f3b0 2023-10-03T10:16:55.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.743+0000 7f66db7fe700 1 -- 172.21.15.125:0/1994489579 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66ec02b090 con 0x7f66f409f3b0 2023-10-03T10:16:55.744 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:55.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 msgr2=0x7f66f411b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00efc0 tx=0x7f66ec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 shutdown_connections 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66f409f3b0 0x7f66f411b140 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f409a130 0x7f66f411a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 --2- 172.21.15.125:0/1994489579 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f66f409ef80 0x7f66f411ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 >> 172.21.15.125:0/1994489579 conn(0x7f66f40a4430 msgr2=0x7f66f40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 shutdown_connections 2023-10-03T10:16:55.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.746+0000 7f66f9477700 1 -- 172.21.15.125:0/1994489579 wait complete. 2023-10-03T10:16:55.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:55.803 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:55.844 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 Processor -- start 2023-10-03T10:16:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 -- start start 2023-10-03T10:16:55.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40720a0 con 0x7f42e409d8f0 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406f970 con 0x7f42e4098410 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.931+0000 7f42e98d2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42e409e6e0 con 0x7f42e409e240 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55742/0 (socket says 172.21.15.125:55742) 2023-10-03T10:16:55.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56950/0 (socket says 172.21.15.125:56950) 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59258/0 (socket says 172.21.15.125:59258) 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e2ffd700 1 -- 172.21.15.125:0/2808540354 learned_addr learned my addr 172.21.15.125:0/2808540354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 -- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 msgr2=0x7f42e40987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 -- 172.21.15.125:0/2808540354 >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 msgr2=0x7f42e409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 --2- 172.21.15.125:0/2808540354 >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 -- 172.21.15.125:0/2808540354 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4072290 con 0x7f42e409e240 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e2ffd700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e27fc700 1 --2- 172.21.15.125:0/2808540354 >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e37fe700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511559cbdd20b2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e1ffb700 1 -- 172.21.15.125:0/2808540354 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00e070 con 0x7f42e409e240 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e1ffb700 1 -- 172.21.15.125:0/2808540354 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00bb20 con 0x7f42e409e240 2023-10-03T10:16:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.932+0000 7f42e1ffb700 1 -- 172.21.15.125:0/2808540354 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc012430 con 0x7f42e409e240 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 -- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 msgr2=0x7f42e41387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 -- 172.21.15.125:0/2808540354 shutdown_connections 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e40987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 --2- 172.21.15.125:0/2808540354 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e41387d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 --2- 172.21.15.125:0/2808540354 >> v2:172.21.15.125:3300/0 conn(0x7f42e409d8f0 0x7f42e409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 -- 172.21.15.125:0/2808540354 >> 172.21.15.125:0/2808540354 conn(0x7f42e40a2b30 msgr2=0x7f42e409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 -- 172.21.15.125:0/2808540354 shutdown_connections 2023-10-03T10:16:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.933+0000 7f42e98d2700 1 -- 172.21.15.125:0/2808540354 wait complete. 2023-10-03T10:16:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 Processor -- start 2023-10-03T10:16:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 -- start start 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e409a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e409ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e409beb0 con 0x7f42e409d8f0 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e408bff0 con 0x7f42e4098410 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e98d2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40a1770 con 0x7f42e409e240 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e409ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56960/0 (socket says 172.21.15.125:56960) 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.934+0000 7f42e27fc700 1 -- 172.21.15.125:0/3652303131 learned_addr learned my addr 172.21.15.125:0/3652303131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e2ffd700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e409a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 -- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 msgr2=0x7f42e409ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e409ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 -- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 msgr2=0x7f42e409a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e409a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 -- 172.21.15.125:0/3652303131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4009500 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e27fc700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f42d800ebb0 tx=0x7f42d800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800c850 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d800c9b0 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d80094a0 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800cd40 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.935+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc009a70 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.936+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42d8013470 con 0x7f42e409d8f0 2023-10-03T10:16:55.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.936+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f42d803fc50 con 0x7f42e409d8f0 2023-10-03T10:16:55.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.936+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e40718e0 con 0x7f42e409d8f0 2023-10-03T10:16:55.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.945+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42d803fe60 con 0x7f42e409d8f0 2023-10-03T10:16:55.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.974+0000 7fad08fdf700 1 Processor -- start 2023-10-03T10:16:55.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.974+0000 7fad08fdf700 1 -- start start 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad08fdf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad040a0a70 0x7fad040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad08fdf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 0x7fad04133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad08fdf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0409dc00 con 0x7fad04133f50 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad08fdf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0409ea60 con 0x7fad040a0a70 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad08fdf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0409dec0 con 0x7fad040a1380 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad0259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad040a0a70 0x7fad040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.975+0000 7fad01d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 0x7fad04133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad040a0a70 0x7fad040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56968/0 (socket says 172.21.15.125:56968) 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad01d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 0x7fad04133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55756/0 (socket says 172.21.15.125:55756) 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 -- 172.21.15.125:0/2673247796 learned_addr learned my addr 172.21.15.125:0/2673247796 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 -- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 msgr2=0x7fad04133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 --2- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 0x7fad04133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 -- 172.21.15.125:0/2673247796 >> v1:172.21.15.125:6789/0 conn(0x7fad04133f50 legacy=0x7fad0413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0159a700 1 -- 172.21.15.125:0/2673247796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226719495 0 0) 0x7fad0409dc00 con 0x7fad04133f50 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 -- 172.21.15.125:0/2673247796 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0409e6a0 con 0x7fad040a0a70 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0259c700 1 --2- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a0a70 0x7fad040a0e40 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7facf40098f0 tx=0x7facf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa4470183d410fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0159a700 1 -- 172.21.15.125:0/2673247796 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011830 con 0x7fad040a0a70 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0159a700 1 -- 172.21.15.125:0/2673247796 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4011990 con 0x7fad040a0a70 2023-10-03T10:16:55.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.976+0000 7fad0159a700 1 -- 172.21.15.125:0/2673247796 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011d20 con 0x7fad040a0a70 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 -- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a0a70 msgr2=0x7fad040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a0a70 0x7fad040a0e40 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7facf40098f0 tx=0x7facf4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 -- 172.21.15.125:0/2673247796 shutdown_connections 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a0a70 0x7fad040a0e40 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2673247796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad040a1380 0x7fad04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 -- 172.21.15.125:0/2673247796 >> 172.21.15.125:0/2673247796 conn(0x7fad040a6610 msgr2=0x7fad040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 -- 172.21.15.125:0/2673247796 shutdown_connections 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.977+0000 7fad08fdf700 1 -- 172.21.15.125:0/2673247796 wait complete. 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 Processor -- start 2023-10-03T10:16:55.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 -- start start 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a1380 0x7fad04123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 0x7fad041c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040a03e0 con 0x7fad040a1380 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad04126620 con 0x7fad04133f50 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad08fdf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad04124610 con 0x7fad040a0a70 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad0259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad02d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 0x7fad041c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad0259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59276/0 (socket says 172.21.15.125:59276) 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.979+0000 7fad0259c700 1 -- 172.21.15.125:0/2488718542 learned_addr learned my addr 172.21.15.125:0/2488718542 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:55.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad01d9b700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a1380 0x7fad04123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 -- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 msgr2=0x7fad041c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 0x7fad041c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 -- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a1380 msgr2=0x7fad04123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a1380 0x7fad04123810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 -- 172.21.15.125:0/2488718542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4009550 con 0x7fad040a0a70 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad02d9d700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 0x7fad041c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad0259c700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7facf4009c40 tx=0x7facf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4004550 con 0x7fad040a0a70 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf40036a0 con 0x7fad040a0a70 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4003a30 con 0x7fad040a0a70 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad04125f80 con 0x7fad040a0a70 2023-10-03T10:16:55.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.980+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04126cb0 con 0x7fad040a0a70 2023-10-03T10:16:55.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.981+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facf4021070 con 0x7fad040a0a70 2023-10-03T10:16:55.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.981+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad040746f0 con 0x7fad040a0a70 2023-10-03T10:16:55.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.981+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7facf4040b50 con 0x7fad040a0a70 2023-10-03T10:16:55.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:55.990+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facf402d760 con 0x7fad040a0a70 2023-10-03T10:16:56.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.143+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42e404f2a0 con 0x7f42e409d8f0 2023-10-03T10:16:56.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.144+0000 7f42cbfff700 1 -- 172.21.15.125:0/3652303131 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42d8017020 con 0x7f42e409d8f0 2023-10-03T10:16:56.144 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 msgr2=0x7f42e409a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f42d800ebb0 tx=0x7f42d800eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 shutdown_connections 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f42e409e240 0x7f42e409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42e4098410 0x7f42e409a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 --2- 172.21.15.125:0/3652303131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42e409d8f0 0x7f42e409a8a0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 >> 172.21.15.125:0/3652303131 conn(0x7f42e40a2b30 msgr2=0x7f42e409fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 shutdown_connections 2023-10-03T10:16:56.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.146+0000 7f42e98d2700 1 -- 172.21.15.125:0/3652303131 wait complete. 2023-10-03T10:16:56.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:56.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.182+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad0404f2a0 con 0x7fad040a0a70 2023-10-03T10:16:56.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.184+0000 7facf2ffd700 1 -- 172.21.15.125:0/2488718542 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facf4029070 con 0x7fad040a0a70 2023-10-03T10:16:56.184 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:56.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 msgr2=0x7fad041232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7facf4009c40 tx=0x7facf4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 shutdown_connections 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad04133f50 0x7fad041c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fad040a0a70 0x7fad041232d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 --2- 172.21.15.125:0/2488718542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a1380 0x7fad04123810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 >> 172.21.15.125:0/2488718542 conn(0x7fad040a6610 msgr2=0x7fad040a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 shutdown_connections 2023-10-03T10:16:56.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.186+0000 7fad08fdf700 1 -- 172.21.15.125:0/2488718542 wait complete. 2023-10-03T10:16:56.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:56.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:56.759 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:56.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.844+0000 7fd97cee6700 1 Processor -- start 2023-10-03T10:16:56.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.844+0000 7fd97cee6700 1 -- start start 2023-10-03T10:16:56.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97cee6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9780a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97cee6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 0x7fd978133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97cee6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97809db90 con 0x7fd978133f40 2023-10-03T10:16:56.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97cee6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97809de10 con 0x7fd9780a09e0 2023-10-03T10:16:56.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97cee6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780a2560 con 0x7fd9780a12f0 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9780a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd976d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd978133f40 0x7fd97813acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51636/0 (socket says 172.21.15.125:51636) 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd976d9d700 1 -- 172.21.15.125:0/143454596 learned_addr learned my addr 172.21.15.125:0/143454596 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd975d9b700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 0x7fd978133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97559a700 1 -- 172.21.15.125:0/143454596 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454026119 0 0) 0x7fd97809db90 con 0x7fd978133f40 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97559a700 1 -- 172.21.15.125:0/143454596 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9600035b0 con 0x7fd978133f40 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 -- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 msgr2=0x7fd978133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 0x7fd978133a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 -- 172.21.15.125:0/143454596 >> v1:172.21.15.125:6789/0 conn(0x7fd978133f40 legacy=0x7fd97813acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 -- 172.21.15.125:0/143454596 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780a1f60 con 0x7fd9780a09e0 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd975d9b700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 0x7fd978133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.845+0000 7fd97659c700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9780a0db0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd968009870 tx=0x7fd968009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce80be8792bb999 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97559a700 1 -- 172.21.15.125:0/143454596 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968011830 con 0x7fd9780a09e0 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97559a700 1 -- 172.21.15.125:0/143454596 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968011990 con 0x7fd9780a09e0 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97559a700 1 -- 172.21.15.125:0/143454596 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968011d20 con 0x7fd9780a09e0 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 -- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 msgr2=0x7fd9780a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9780a0db0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd968009870 tx=0x7fd968009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:56.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 -- 172.21.15.125:0/143454596 shutdown_connections 2023-10-03T10:16:56.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9780a0db0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 --2- 172.21.15.125:0/143454596 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd9780a12f0 0x7fd978133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 -- 172.21.15.125:0/143454596 >> 172.21.15.125:0/143454596 conn(0x7fd9780a3000 msgr2=0x7fd9780a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 -- 172.21.15.125:0/143454596 shutdown_connections 2023-10-03T10:16:56.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.846+0000 7fd97cee6700 1 -- 172.21.15.125:0/143454596 wait complete. 2023-10-03T10:16:56.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 Processor -- start 2023-10-03T10:16:56.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 -- start start 2023-10-03T10:16:56.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 0x7fd9781c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 0x7fd9781c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978124d60 con 0x7fd9780a12f0 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd978122db0 con 0x7fd9780a09e0 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.848+0000 7fd97cee6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9781263e0 con 0x7fd978133f40 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55792/0 (socket says 172.21.15.125:55792) 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 0x7fd9781c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97659c700 1 -- 172.21.15.125:0/2450628102 learned_addr learned my addr 172.21.15.125:0/2450628102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:56.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd975d9b700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 0x7fd9781c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 -- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 msgr2=0x7fd9781c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 -- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 msgr2=0x7fd9781c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 0x7fd9781c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 -- 172.21.15.125:0/2450628102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0094a0 con 0x7fd978133f40 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97659c700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd975d9b700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 0x7fd9781c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd976d9d700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 0x7fd9781c8ca0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd97000ca70 tx=0x7fd97000cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000a940 con 0x7fd978133f40 2023-10-03T10:16:56.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97000aaa0 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9680094a0 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000ae30 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.849+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd978126100 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.850+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97804f2a0 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.851+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd970007d50 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.851+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd97003f430 con 0x7fd978133f40 2023-10-03T10:16:56.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.855+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9700192c0 con 0x7fd978133f40 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 Processor -- start 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 -- start start 2023-10-03T10:16:56.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 0x7f1d940a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940a2640 con 0x7f1d940a0970 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9409dde0 con 0x7f1d940a1280 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d989fe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940a2820 con 0x7f1d94133de0 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d92d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 0x7f1d940a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d9259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55794/0 (socket says 172.21.15.125:55794) 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59296/0 (socket says 172.21.15.125:59296) 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.886+0000 7f1d9259c700 1 -- 172.21.15.125:0/3651219083 learned_addr learned my addr 172.21.15.125:0/3651219083 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 -- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 msgr2=0x7f1d94134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 -- 172.21.15.125:0/3651219083 >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 msgr2=0x7f1d940a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 --2- 172.21.15.125:0/3651219083 >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 0x7f1d940a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 -- 172.21.15.125:0/3651219083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940a2330 con 0x7f1d940a1280 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9359e700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d92d9d700 1 --2- 172.21.15.125:0/3651219083 >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 0x7f1d940a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d9259c700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1d880098f0 tx=0x7f1d88009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1b077c4aa75a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d91d9b700 1 -- 172.21.15.125:0/3651219083 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88011830 con 0x7f1d940a1280 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d91d9b700 1 -- 172.21.15.125:0/3651219083 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88011990 con 0x7f1d940a1280 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d91d9b700 1 -- 172.21.15.125:0/3651219083 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88011d20 con 0x7f1d940a1280 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 -- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 msgr2=0x7f1d941338a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1d880098f0 tx=0x7f1d88009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 -- 172.21.15.125:0/3651219083 shutdown_connections 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 --2- 172.21.15.125:0/3651219083 >> v2:172.21.15.125:3300/0 conn(0x7f1d940a0970 0x7f1d940a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 --2- 172.21.15.125:0/3651219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a1280 0x7f1d941338a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.887+0000 7f1d989fe700 1 -- 172.21.15.125:0/3651219083 >> 172.21.15.125:0/3651219083 conn(0x7f1d940a6070 msgr2=0x7f1d940a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.888+0000 7f1d989fe700 1 -- 172.21.15.125:0/3651219083 shutdown_connections 2023-10-03T10:16:56.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.888+0000 7f1d989fe700 1 -- 172.21.15.125:0/3651219083 wait complete. 2023-10-03T10:16:56.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.889+0000 7f1d989fe700 1 Processor -- start 2023-10-03T10:16:56.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.889+0000 7f1d989fe700 1 -- start start 2023-10-03T10:16:56.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d940a1280 0x7f1d94121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94133830 con 0x7f1d940a1280 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94122e70 con 0x7f1d940a0970 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d989fe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94124d50 con 0x7f1d94133de0 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55804/0 (socket says 172.21.15.125:55804) 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d9359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59312/0 (socket says 172.21.15.125:59312) 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 -- 172.21.15.125:0/659563381 learned_addr learned my addr 172.21.15.125:0/659563381 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d9259c700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d940a1280 0x7f1d94121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 -- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 msgr2=0x7f1d94121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 -- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d940a1280 msgr2=0x7f1d94121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d940a1280 0x7f1d94121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 -- 172.21.15.125:0/659563381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840094a0 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d92d9d700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400ebe0 tx=0x7f1d8400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.890+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84009760 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.891+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400c850 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.891+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c009a70 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.891+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400cbe0 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.891+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88009550 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.891+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d8400cd40 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.892+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d8403fa90 con 0x7f1d940a0970 2023-10-03T10:16:56.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.892+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9411de60 con 0x7f1d940a0970 2023-10-03T10:16:56.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:56.896+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d8401b3b0 con 0x7f1d940a0970 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.051+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd978124a40 con 0x7fd978133f40 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.052+0000 7fd966ffd700 1 -- 172.21.15.125:0/2450628102 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd970007070 con 0x7fd978133f40 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 msgr2=0x7fd9781c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 0x7fd9781c8ca0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd97000ca70 tx=0x7fd97000cd80 comp rx=0 tx=0).stop 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 shutdown_connections 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd978133f40 0x7fd9781c8ca0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9780a09e0 0x7fd9781c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 --2- 172.21.15.125:0/2450628102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9780a12f0 0x7fd9781c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 >> 172.21.15.125:0/2450628102 conn(0x7fd9780a3000 msgr2=0x7fd97809ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 shutdown_connections 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.054+0000 7fd97cee6700 1 -- 172.21.15.125:0/2450628102 wait complete. 2023-10-03T10:16:57.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.090+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d941246c0 con 0x7f1d940a0970 2023-10-03T10:16:57.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.090+0000 7f1d7b7fe700 1 -- 172.21.15.125:0/659563381 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d84021020 con 0x7f1d940a0970 2023-10-03T10:16:57.091 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 msgr2=0x7f1d941212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400ebe0 tx=0x7f1d8400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 shutdown_connections 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1d94133de0 0x7f1d94121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d940a0970 0x7f1d941212f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 --2- 172.21.15.125:0/659563381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d940a1280 0x7f1d94121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 >> 172.21.15.125:0/659563381 conn(0x7f1d940a6070 msgr2=0x7f1d941330a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 shutdown_connections 2023-10-03T10:16:57.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.092+0000 7f1d989fe700 1 -- 172.21.15.125:0/659563381 wait complete. 2023-10-03T10:16:57.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:57.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:57.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.286+0000 7f3452444700 1 Processor -- start 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.286+0000 7f3452444700 1 -- start start 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f3452444700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f3452444700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f3452444700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c09dc00 con 0x7f344c133f50 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f3452444700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c09ea60 con 0x7f344c0a1380 2023-10-03T10:16:57.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f3452444700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c09dec0 con 0x7f344c0a0a70 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57022/0 (socket says 172.21.15.125:57022) 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f34509e1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f344c133f50 0x7f344c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51650/0 (socket says 172.21.15.125:51650) 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 -- 172.21.15.125:0/165740505 learned_addr learned my addr 172.21.15.125:0/165740505 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 -- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 msgr2=0x7f344c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 -- 172.21.15.125:0/165740505 >> v1:172.21.15.125:6789/0 conn(0x7f344c133f50 legacy=0x7f344c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 -- 172.21.15.125:0/165740505 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c09e6a0 con 0x7f344c0a1380 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344bfff700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344b7fe700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f34400098f0 tx=0x7f3440009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a481e4c685a06ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344affd700 1 -- 172.21.15.125:0/165740505 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440011830 con 0x7f344c0a1380 2023-10-03T10:16:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.287+0000 7f344affd700 1 -- 172.21.15.125:0/165740505 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440011990 con 0x7f344c0a1380 2023-10-03T10:16:57.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f344affd700 1 -- 172.21.15.125:0/165740505 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440011d20 con 0x7f344c0a1380 2023-10-03T10:16:57.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 -- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 msgr2=0x7f344c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f34400098f0 tx=0x7f3440009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:57.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 -- 172.21.15.125:0/165740505 shutdown_connections 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 --2- 172.21.15.125:0/165740505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 -- 172.21.15.125:0/165740505 >> 172.21.15.125:0/165740505 conn(0x7f344c0a6610 msgr2=0x7f344c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 -- 172.21.15.125:0/165740505 shutdown_connections 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.288+0000 7f3452444700 1 -- 172.21.15.125:0/165740505 wait complete. 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.289+0000 7f3452444700 1 Processor -- start 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.289+0000 7f3452444700 1 -- start start 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c123830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c126030 con 0x7f344c0a0a70 2023-10-03T10:16:57.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c124ec0 con 0x7f344c133f50 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3452444700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344c122f00 con 0x7f344c0a1380 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c123830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57026/0 (socket says 172.21.15.125:57026) 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344bfff700 1 -- 172.21.15.125:0/107747274 learned_addr learned my addr 172.21.15.125:0/107747274 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f34509e1700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 -- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 msgr2=0x7f344c1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 -- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 msgr2=0x7f344c1232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 -- 172.21.15.125:0/107747274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0094a0 con 0x7f344c0a1380 2023-10-03T10:16:57.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344bfff700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f34509e1700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f344b7fe700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c123830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3440016000 tx=0x7f3440004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.290+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440004400 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344001f070 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3440009550 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400038e0 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c124630 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3440021030 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.291+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3440040910 con 0x7f344c0a1380 2023-10-03T10:16:57.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.292+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c125e80 con 0x7f344c0a1380 2023-10-03T10:16:57.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.296+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3440015080 con 0x7f344c0a1380 2023-10-03T10:16:57.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.327+0000 7faa00a8b700 1 Processor -- start 2023-10-03T10:16:57.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.327+0000 7faa00a8b700 1 -- start start 2023-10-03T10:16:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 0x7fa9fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc09e9d0 con 0x7fa9fc0a1380 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc09dc00 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7faa00a8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc09dec0 con 0x7fa9fc133f50 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55826/0 (socket says 172.21.15.125:55826) 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59338/0 (socket says 172.21.15.125:59338) 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 -- 172.21.15.125:0/3189384765 learned_addr learned my addr 172.21.15.125:0/3189384765 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9f9d9b700 1 --2- 172.21.15.125:0/3189384765 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 0x7fa9fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 -- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 msgr2=0x7fa9fc134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 -- 172.21.15.125:0/3189384765 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 msgr2=0x7fa9fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 --2- 172.21.15.125:0/3189384765 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 0x7fa9fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fa59c700 1 -- 172.21.15.125:0/3189384765 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc09e6a0 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9fad9d700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.328+0000 7fa9f9d9b700 1 --2- 172.21.15.125:0/3189384765 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 0x7fa9fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7fa9fa59c700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0098f0 tx=0x7fa9ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f7910576c5dde81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7fa9f959a700 1 -- 172.21.15.125:0/3189384765 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec011830 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7fa9f959a700 1 -- 172.21.15.125:0/3189384765 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec011990 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7fa9f959a700 1 -- 172.21.15.125:0/3189384765 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec011d20 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 -- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 msgr2=0x7fa9fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0098f0 tx=0x7fa9ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 -- 172.21.15.125:0/3189384765 shutdown_connections 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc0a0e40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 --2- 172.21.15.125:0/3189384765 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 --2- 172.21.15.125:0/3189384765 >> v2:172.21.15.125:3300/0 conn(0x7fa9fc0a1380 0x7fa9fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 -- 172.21.15.125:0/3189384765 >> 172.21.15.125:0/3189384765 conn(0x7fa9fc0a6610 msgr2=0x7fa9fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 -- 172.21.15.125:0/3189384765 shutdown_connections 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.329+0000 7faa00a8b700 1 -- 172.21.15.125:0/3189384765 wait complete. 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.330+0000 7faa00a8b700 1 Processor -- start 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.330+0000 7faa00a8b700 1 -- start start 2023-10-03T10:16:57.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc1224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc125d20 con 0x7fa9fc0a1380 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc126000 con 0x7fa9fc0a0a70 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7faa00a8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0a51f0 con 0x7fa9fc133f50 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9fad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57040/0 (socket says 172.21.15.125:57040) 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 -- 172.21.15.125:0/1920905809 learned_addr learned my addr 172.21.15.125:0/1920905809 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9fa59c700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc1224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 -- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 msgr2=0x7fa9fc122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 -- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 msgr2=0x7fa9fc1224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc1224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 -- 172.21.15.125:0/1920905809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00094a0 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9fad9d700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.331+0000 7fa9f9d9b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000ebb0 tx=0x7fa9f000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0009e80 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f000c850 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f4009a70 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000cbc0 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec009550 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.332+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f000cd20 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.333+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc11f760 con 0x7fa9fc0a1380 2023-10-03T10:16:57.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.333+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9f003fa40 con 0x7fa9fc0a1380 2023-10-03T10:16:57.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.337+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f001b3b0 con 0x7fa9fc0a1380 2023-10-03T10:16:57.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.491+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f344c1252a0 con 0x7f344c0a1380 2023-10-03T10:16:57.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.492+0000 7f3448ff9700 1 -- 172.21.15.125:0/107747274 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34400239c0 con 0x7f344c0a1380 2023-10-03T10:16:57.492 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:57.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 msgr2=0x7f344c123830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c123830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3440016000 tx=0x7f3440004750 comp rx=0 tx=0).stop 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 shutdown_connections 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c1232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 --2- 172.21.15.125:0/107747274 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c123830 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 >> 172.21.15.125:0/107747274 conn(0x7f344c0a6610 msgr2=0x7f344c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 shutdown_connections 2023-10-03T10:16:57.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.494+0000 7f3452444700 1 -- 172.21.15.125:0/107747274 wait complete. 2023-10-03T10:16:57.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.529+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9fc06d660 con 0x7fa9fc0a1380 2023-10-03T10:16:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.530+0000 7fa9eaffd700 1 -- 172.21.15.125:0/1920905809 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9f0021020 con 0x7fa9fc0a1380 2023-10-03T10:16:57.530 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:57.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 msgr2=0x7fa9fc122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000ebb0 tx=0x7fa9f000eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 shutdown_connections 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa9fc133f50 0x7fa9fc122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9fc0a0a70 0x7fa9fc1224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 --2- 172.21.15.125:0/1920905809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9fc0a1380 0x7fa9fc122a20 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 >> 172.21.15.125:0/1920905809 conn(0x7fa9fc0a6610 msgr2=0x7fa9fc11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 shutdown_connections 2023-10-03T10:16:57.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:57.532+0000 7faa00a8b700 1 -- 172.21.15.125:0/1920905809 wait complete. 2023-10-03T10:16:57.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:58.067 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:58.105 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.201+0000 7fdf15b4f700 1 Processor -- start 2023-10-03T10:16:58.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.201+0000 7fdf15b4f700 1 -- start start 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf15b4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf15b4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 0x7fdf10131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf15b4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1009c970 con 0x7fdf10131d70 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf15b4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100a0920 con 0x7fdf1009f180 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf15b4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1009f9c0 con 0x7fdf1009e870 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 0x7fdf10131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59344/0 (socket says 172.21.15.125:59344) 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0f7fe700 1 -- 172.21.15.125:0/3746644687 learned_addr learned my addr 172.21.15.125:0/3746644687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 -- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 msgr2=0x7fdf1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0e7fc700 1 -- 172.21.15.125:0/3746644687 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104695703 0 0) 0x7fdf1009c970 con 0x7fdf10131d70 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 -- 172.21.15.125:0/3746644687 >> v1:172.21.15.125:6789/0 conn(0x7fdf10131d70 legacy=0x7fdf10138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 -- 172.21.15.125:0/3746644687 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1009bab0 con 0x7fdf1009f180 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0f7fe700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0effd700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 0x7fdf10131830 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f51d9dcb82528ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.202+0000 7fdf0e7fc700 1 -- 172.21.15.125:0/3746644687 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011830 con 0x7fdf1009f180 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf0e7fc700 1 -- 172.21.15.125:0/3746644687 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8011990 con 0x7fdf1009f180 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf0e7fc700 1 -- 172.21.15.125:0/3746644687 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011d20 con 0x7fdf1009f180 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 -- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 msgr2=0x7fdf10131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 0x7fdf10131830 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 -- 172.21.15.125:0/3746644687 shutdown_connections 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009e870 0x7fdf1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/3746644687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009f180 0x7fdf10131830 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 -- 172.21.15.125:0/3746644687 >> 172.21.15.125:0/3746644687 conn(0x7fdf100a4430 msgr2=0x7fdf100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 -- 172.21.15.125:0/3746644687 shutdown_connections 2023-10-03T10:16:58.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.203+0000 7fdf15b4f700 1 -- 172.21.15.125:0/3746644687 wait complete. 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.204+0000 7fdf15b4f700 1 Processor -- start 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.204+0000 7fdf15b4f700 1 -- start start 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009e870 0x7fdf1011f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf10131d70 0x7fdf1011fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10120cf0 con 0x7fdf10131d70 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10121b80 con 0x7fdf1009e870 2023-10-03T10:16:58.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf15b4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10122660 con 0x7fdf1009f180 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf10131d70 0x7fdf1011fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59356/0 (socket says 172.21.15.125:59356) 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 -- 172.21.15.125:0/1677741494 learned_addr learned my addr 172.21.15.125:0/1677741494 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0f7fe700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009e870 0x7fdf1011f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 -- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009e870 msgr2=0x7fdf1011f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009e870 0x7fdf1011f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 -- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf10131d70 msgr2=0x7fdf1011fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf10131d70 0x7fdf1011fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 -- 172.21.15.125:0/1677741494 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08009550 con 0x7fdf1009f180 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf0effd700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdef80090b0 tx=0x7fdef8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.205+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004510 con 0x7fdf1009f180 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef801f070 con 0x7fdf1009f180 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80094a0 con 0x7fdf1009f180 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80038e0 con 0x7fdf1009f180 2023-10-03T10:16:58.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1009dba0 con 0x7fdf1009f180 2023-10-03T10:16:58.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef8003a40 con 0x7fdf1009f180 2023-10-03T10:16:58.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.206+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1011be60 con 0x7fdf1009f180 2023-10-03T10:16:58.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.207+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdef8021070 con 0x7fdf1009f180 2023-10-03T10:16:58.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.211+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef801a430 con 0x7fdf1009f180 2023-10-03T10:16:58.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 Processor -- start 2023-10-03T10:16:58.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 -- start start 2023-10-03T10:16:58.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 0x7f59e013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e009dc00 con 0x7f59e00a1380 2023-10-03T10:16:58.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e009ea90 con 0x7f59e00a0a70 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e86e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e009dec0 con 0x7f59e0134120 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e6484700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e6484700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57054/0 (socket says 172.21.15.125:57054) 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e6c85700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 0x7f59e013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e6484700 1 -- 172.21.15.125:0/2529315882 learned_addr learned my addr 172.21.15.125:0/2529315882 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.239+0000 7f59e5c83700 1 --1- 172.21.15.125:0/2529315882 >> v1:172.21.15.125:6789/0 conn(0x7f59e00a1380 0x7f59e0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51666/0 (socket says 172.21.15.125:51666) 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6c85700 1 -- 172.21.15.125:0/2529315882 >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 msgr2=0x7f59e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6c85700 1 --2- 172.21.15.125:0/2529315882 >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6c85700 1 -- 172.21.15.125:0/2529315882 >> v1:172.21.15.125:6789/0 conn(0x7f59e00a1380 legacy=0x7f59e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6c85700 1 -- 172.21.15.125:0/2529315882 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e009e6a0 con 0x7f59e0134120 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6484700 1 --2- 172.21.15.125:0/2529315882 >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e6c85700 1 --2- 172.21.15.125:0/2529315882 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 0x7f59e013bce0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcfc464438ef74e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e5482700 1 -- 172.21.15.125:0/2529315882 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800e070 con 0x7f59e0134120 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e5482700 1 -- 172.21.15.125:0/2529315882 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d800bb20 con 0x7f59e0134120 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.240+0000 7f59e5482700 1 -- 172.21.15.125:0/2529315882 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8012430 con 0x7f59e0134120 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 -- 172.21.15.125:0/2529315882 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 msgr2=0x7f59e013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 --2- 172.21.15.125:0/2529315882 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 0x7f59e013bce0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 -- 172.21.15.125:0/2529315882 shutdown_connections 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 --2- 172.21.15.125:0/2529315882 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e0134120 0x7f59e013bce0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 --2- 172.21.15.125:0/2529315882 >> v2:172.21.15.125:3300/0 conn(0x7f59e00a0a70 0x7f59e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 -- 172.21.15.125:0/2529315882 >> 172.21.15.125:0/2529315882 conn(0x7f59e00a6610 msgr2=0x7f59e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 -- 172.21.15.125:0/2529315882 shutdown_connections 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.241+0000 7f59e86e8700 1 -- 172.21.15.125:0/2529315882 wait complete. 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 Processor -- start 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 -- start start 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e00a1380 0x7f59e0122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e0134120 0x7f59e0123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0133850 con 0x7f59e00a1380 2023-10-03T10:16:58.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0133a80 con 0x7f59e0134120 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e86e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01260d0 con 0x7f59e00a0a70 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59364/0 (socket says 172.21.15.125:59364) 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 -- 172.21.15.125:0/3589791184 learned_addr learned my addr 172.21.15.125:0/3589791184 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6c85700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e0134120 0x7f59e0123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e5c83700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e00a1380 0x7f59e0122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 -- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e0134120 msgr2=0x7f59e0123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e0134120 0x7f59e0123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 -- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e00a1380 msgr2=0x7f59e0122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e00a1380 0x7f59e0122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.242+0000 7f59e6484700 1 -- 172.21.15.125:0/3589791184 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009550 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59e6484700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00ebe0 tx=0x7f59dc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00c7f0 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc00c950 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00cce0 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8009a70 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e0125e10 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.243+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59dc013470 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.244+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59dc03fbb0 con 0x7f59e00a0a70 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.244+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e004f2a0 con 0x7f59e00a0a70 2023-10-03T10:16:58.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.248+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59dc013720 con 0x7f59e00a0a70 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.401+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf1004f2a0 con 0x7fdf1009f180 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.401+0000 7fdf07fff700 1 -- 172.21.15.125:0/1677741494 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef802b020 con 0x7fdf1009f180 2023-10-03T10:16:58.402 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 msgr2=0x7fdf1011f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdef80090b0 tx=0x7fdef8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 shutdown_connections 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf10131d70 0x7fdf1011fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf1009e870 0x7fdf1011f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 --2- 172.21.15.125:0/1677741494 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdf1009f180 0x7fdf1011f620 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 >> 172.21.15.125:0/1677741494 conn(0x7fdf100a4430 msgr2=0x7fdf10131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 shutdown_connections 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.403+0000 7fdf15b4f700 1 -- 172.21.15.125:0/1677741494 wait complete. 2023-10-03T10:16:58.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.438+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f59e0126ba0 con 0x7f59e00a0a70 2023-10-03T10:16:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.438+0000 7f59d6ffd700 1 -- 172.21.15.125:0/3589791184 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59dc021030 con 0x7f59e00a0a70 2023-10-03T10:16:58.439 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 msgr2=0x7f59e0122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00ebe0 tx=0x7f59dc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 shutdown_connections 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59e0134120 0x7f59e0123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59e00a0a70 0x7f59e0122910 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 --2- 172.21.15.125:0/3589791184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e00a1380 0x7f59e0122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.440+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 >> 172.21.15.125:0/3589791184 conn(0x7f59e00a6610 msgr2=0x7f59e009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.441+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 shutdown_connections 2023-10-03T10:16:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.441+0000 7f59e86e8700 1 -- 172.21.15.125:0/3589791184 wait complete. 2023-10-03T10:16:58.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:58.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:58.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:58.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.632+0000 7f1cf5a1f700 1 Processor -- start 2023-10-03T10:16:58.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.632+0000 7f1cf5a1f700 1 -- start start 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1cf009ad40 0x7f1cf0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00a3b60 con 0x7f1cf009ad40 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01348e0 con 0x7f1cf0133f70 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cf5a1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf009b110 con 0x7f1cf00a0a70 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1cf009ad40 0x7f1cf0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cee7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59380/0 (socket says 172.21.15.125:59380) 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cef7fe700 1 -- 172.21.15.125:0/1047898637 learned_addr learned my addr 172.21.15.125:0/1047898637 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 -- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 msgr2=0x7f1cf00a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 -- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 msgr2=0x7f1cf01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1ceeffd700 1 -- 172.21.15.125:0/1047898637 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00a2fa0 con 0x7f1cf009ad40 2023-10-03T10:16:58.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cee7fc700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.633+0000 7f1cef7fe700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1ceeffd700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf0133a30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d055e4dd2cf4a512 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cedffb700 1 -- 172.21.15.125:0/1047898637 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0011830 con 0x7f1cf009ad40 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cedffb700 1 -- 172.21.15.125:0/1047898637 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0011990 con 0x7f1cf009ad40 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cedffb700 1 -- 172.21.15.125:0/1047898637 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0011d20 con 0x7f1cf009ad40 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 msgr2=0x7f1cf0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf0133a30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/1047898637 shutdown_connections 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf0133a30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/1047898637 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/1047898637 >> 172.21.15.125:0/1047898637 conn(0x7f1cf0099c40 msgr2=0x7f1cf006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/1047898637 shutdown_connections 2023-10-03T10:16:58.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.634+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/1047898637 wait complete. 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.635+0000 7f1cf5a1f700 1 Processor -- start 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.635+0000 7f1cf5a1f700 1 -- start start 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf011d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf011dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0120bb0 con 0x7f1cf009ad40 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01306c0 con 0x7f1cf0133f70 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cf5a1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0120130 con 0x7f1cf00a0a70 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1ceeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59384/0 (socket says 172.21.15.125:59384) 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 -- 172.21.15.125:0/3183678537 learned_addr learned my addr 172.21.15.125:0/3183678537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cef7fe700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf011dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 -- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 msgr2=0x7f1cf011dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf011dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 -- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 msgr2=0x7f1cf011d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf011d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 -- 172.21.15.125:0/3183678537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8009b30 con 0x7f1cf00a0a70 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.636+0000 7f1cee7fc700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400ec10 tx=0x7f1ce400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.637+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400c850 con 0x7f1cf00a0a70 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.637+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400c9b0 con 0x7f1cf00a0a70 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.637+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400cd20 con 0x7f1cf00a0a70 2023-10-03T10:16:58.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.637+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40094a0 con 0x7f1cf00a0a70 2023-10-03T10:16:58.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.637+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce00094a0 con 0x7f1cf00a0a70 2023-10-03T10:16:58.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.638+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf00a3540 con 0x7f1cf00a0a70 2023-10-03T10:16:58.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.638+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ce4013470 con 0x7f1cf00a0a70 2023-10-03T10:16:58.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.638+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ce403ff50 con 0x7f1cf00a0a70 2023-10-03T10:16:58.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.646+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ce4013720 con 0x7f1cf00a0a70 2023-10-03T10:16:58.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.677+0000 7f4b29d4f700 1 Processor -- start 2023-10-03T10:16:58.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 -- start start 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b241343a0 0x7f4b2413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406bec0 con 0x7f4b2409f180 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2406ce60 con 0x7f4b241343a0 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b29d4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2409fa00 con 0x7f4b2409e870 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b23fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b241343a0 0x7f4b2413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55898/0 (socket says 172.21.15.125:55898) 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.678+0000 7f4b237fe700 1 -- 172.21.15.125:0/3619086501 learned_addr learned my addr 172.21.15.125:0/3619086501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b23fff700 1 -- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 msgr2=0x7f4b2409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b23fff700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b23fff700 1 -- 172.21.15.125:0/3619086501 >> v1:172.21.15.125:6789/0 conn(0x7f4b2409f180 legacy=0x7f4b24133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b23fff700 1 -- 172.21.15.125:0/3619086501 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2409ad80 con 0x7f4b241343a0 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b22ffd700 1 -- 172.21.15.125:0/3619086501 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801180576 0 0) 0x7f4b2406bec0 con 0x7f4b2409f180 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b237fe700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b23fff700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b241343a0 0x7f4b2413bf60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009d90 tx=0x7f4b1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3642d44fe232054 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b22ffd700 1 -- 172.21.15.125:0/3619086501 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00e070 con 0x7f4b241343a0 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b22ffd700 1 -- 172.21.15.125:0/3619086501 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00bb20 con 0x7f4b241343a0 2023-10-03T10:16:58.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b22ffd700 1 -- 172.21.15.125:0/3619086501 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c012430 con 0x7f4b241343a0 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b241343a0 msgr2=0x7f4b2413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b241343a0 0x7f4b2413bf60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009d90 tx=0x7f4b1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3619086501 shutdown_connections 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b241343a0 0x7f4b2413bf60 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3619086501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409e870 0x7f4b2409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.679+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3619086501 >> 172.21.15.125:0/3619086501 conn(0x7f4b240a4430 msgr2=0x7f4b240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.680+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3619086501 shutdown_connections 2023-10-03T10:16:58.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.680+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3619086501 wait complete. 2023-10-03T10:16:58.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.680+0000 7f4b29d4f700 1 Processor -- start 2023-10-03T10:16:58.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.680+0000 7f4b29d4f700 1 -- start start 2023-10-03T10:16:58.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 0x7f4b24122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b241343a0 0x7f4b24123530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240a3c40 con 0x7f4b2409e870 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406cfa0 con 0x7f4b2409f180 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b29d4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24124790 con 0x7f4b241343a0 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 0x7f4b24122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55900/0 (socket says 172.21.15.125:55900) 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b1bfff700 1 -- 172.21.15.125:0/3376996587 learned_addr learned my addr 172.21.15.125:0/3376996587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 -- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b241343a0 msgr2=0x7f4b24123530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b241343a0 0x7f4b24123530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 -- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 msgr2=0x7f4b24122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 -- 172.21.15.125:0/3376996587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009550 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b1bfff700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.681+0000 7f4b237fe700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 0x7f4b24122ab0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400e9a0 tx=0x7f4b1400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004030 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14004190 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c009a70 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004520 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b241262b0 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.682+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b1400c850 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.683+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b1403f8f0 con 0x7f4b2409e870 2023-10-03T10:16:58.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.683+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24074f10 con 0x7f4b2409e870 2023-10-03T10:16:58.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.692+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b140036a0 con 0x7f4b2409e870 2023-10-03T10:16:58.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.840+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1cf009c7e0 con 0x7f1cf00a0a70 2023-10-03T10:16:58.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.840+0000 7f1cd7fff700 1 -- 172.21.15.125:0/3183678537 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ce4021070 con 0x7f1cf00a0a70 2023-10-03T10:16:58.841 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 msgr2=0x7f1cf011d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400ec10 tx=0x7f1ce400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 shutdown_connections 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cf0133f70 0x7f1cf011dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cf009ad40 0x7f1cf011d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 --2- 172.21.15.125:0/3183678537 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cf00a0a70 0x7f1cf011d810 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 >> 172.21.15.125:0/3183678537 conn(0x7f1cf0099c40 msgr2=0x7f1cf0131fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 shutdown_connections 2023-10-03T10:16:58.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.842+0000 7f1cf5a1f700 1 -- 172.21.15.125:0/3183678537 wait complete. 2023-10-03T10:16:58.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:16:58.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.879+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b2404f2a0 con 0x7f4b2409e870 2023-10-03T10:16:58.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.879+0000 7f4b20ff9700 1 -- 172.21.15.125:0/3376996587 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b14020020 con 0x7f4b2409e870 2023-10-03T10:16:58.880 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:16:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 msgr2=0x7f4b24122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 0x7f4b24122ab0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400e9a0 tx=0x7f4b1400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 shutdown_connections 2023-10-03T10:16:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b241343a0 0x7f4b24123530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b2409e870 0x7f4b24122ab0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 --2- 172.21.15.125:0/3376996587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b2409f180 0x7f4b24122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 >> 172.21.15.125:0/3376996587 conn(0x7f4b240a4430 msgr2=0x7f4b2409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 shutdown_connections 2023-10-03T10:16:58.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:58.881+0000 7f4b29d4f700 1 -- 172.21.15.125:0/3376996587 wait complete. 2023-10-03T10:16:58.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:16:59.416 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:59.454 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.542+0000 7f5df86c3700 1 Processor -- start 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.542+0000 7f5df86c3700 1 -- start start 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 0x7f5df0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0133f50 0x7f5df01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df009e9d0 con 0x7f5df00a0a70 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009dc00 con 0x7f5df00a1380 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df86c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009dec0 con 0x7f5df0133f50 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df645f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 0x7f5df0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df6c60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0133f50 0x7f5df01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df645f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57100/0 (socket says 172.21.15.125:57100) 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df645f700 1 -- 172.21.15.125:0/4260393669 learned_addr learned my addr 172.21.15.125:0/4260393669 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 -- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0133f50 msgr2=0x7f5df01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 --2- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0133f50 0x7f5df01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 -- 172.21.15.125:0/4260393669 >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 msgr2=0x7f5df00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 --2- 172.21.15.125:0/4260393669 >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df5c5e700 1 -- 172.21.15.125:0/4260393669 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df009e6a0 con 0x7f5df00a1380 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.543+0000 7f5df645f700 1 --2- 172.21.15.125:0/4260393669 >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df5c5e700 1 --2- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 0x7f5df0133a10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009840 tx=0x7f5de0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ac5860e10c8b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df545d700 1 -- 172.21.15.125:0/4260393669 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0011830 con 0x7f5df00a1380 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df545d700 1 -- 172.21.15.125:0/4260393669 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0011990 con 0x7f5df00a1380 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df545d700 1 -- 172.21.15.125:0/4260393669 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0011d20 con 0x7f5df00a1380 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 -- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 msgr2=0x7f5df0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 --2- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 0x7f5df0133a10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009840 tx=0x7f5de0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 -- 172.21.15.125:0/4260393669 shutdown_connections 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 --2- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0133f50 0x7f5df01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 --2- 172.21.15.125:0/4260393669 >> v2:172.21.15.125:3300/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 --2- 172.21.15.125:0/4260393669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1380 0x7f5df0133a10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 -- 172.21.15.125:0/4260393669 >> 172.21.15.125:0/4260393669 conn(0x7f5df00a6610 msgr2=0x7f5df00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 -- 172.21.15.125:0/4260393669 shutdown_connections 2023-10-03T10:16:59.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.544+0000 7f5df86c3700 1 -- 172.21.15.125:0/4260393669 wait complete. 2023-10-03T10:16:59.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.545+0000 7f5df86c3700 1 Processor -- start 2023-10-03T10:16:59.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.545+0000 7f5df86c3700 1 -- start start 2023-10-03T10:16:59.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 0x7f5df0122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0125180 con 0x7f5df00a1380 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0124dc0 con 0x7f5df0133f50 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df86c3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00a03e0 con 0x7f5df00a0a70 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df5c5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df5c5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57102/0 (socket says 172.21.15.125:57102) 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df5c5e700 1 -- 172.21.15.125:0/3700380573 learned_addr learned my addr 172.21.15.125:0/3700380573 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59416/0 (socket says 172.21.15.125:59416) 2023-10-03T10:16:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df6c60700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 0x7f5df0122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 -- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 msgr2=0x7f5df0122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 0x7f5df0122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 -- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 msgr2=0x7f5df01228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 -- 172.21.15.125:0/3700380573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009550 con 0x7f5df00a0a70 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df6c60700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 0x7f5df0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df5c5e700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5df645f700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9b0 tx=0x7f5dec00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.546+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00c640 con 0x7f5df00a0a70 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.547+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00c7a0 con 0x7f5df00a0a70 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.547+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00cb30 con 0x7f5df00a0a70 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.547+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de00094a0 con 0x7f5df00a0a70 2023-10-03T10:16:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.547+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0125e40 con 0x7f5df00a0a70 2023-10-03T10:16:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.548+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dec00cc90 con 0x7f5df00a0a70 2023-10-03T10:16:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.548+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df011f760 con 0x7f5df00a0a70 2023-10-03T10:16:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.548+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5dec03f630 con 0x7f5df00a0a70 2023-10-03T10:16:59.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.556+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dec021080 con 0x7f5df00a0a70 2023-10-03T10:16:59.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.587+0000 7f229a05e700 1 Processor -- start 2023-10-03T10:16:59.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.587+0000 7f229a05e700 1 -- start start 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f229a05e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 0x7f22940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f229a05e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f229a05e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229409dc00 con 0x7f2294133f50 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f229a05e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229409ea60 con 0x7f22940a0a70 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f229a05e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f229409dec0 con 0x7f22940a1380 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59424/0 (socket says 172.21.15.125:59424) 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 -- 172.21.15.125:0/1473447387 learned_addr learned my addr 172.21.15.125:0/1473447387 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f22937fe700 1 --2- 172.21.15.125:0/1473447387 >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 0x7f22940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 -- 172.21.15.125:0/1473447387 >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 msgr2=0x7f22940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 --2- 172.21.15.125:0/1473447387 >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 0x7f22940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 -- 172.21.15.125:0/1473447387 >> v1:172.21.15.125:6789/0 conn(0x7f2294133f50 legacy=0x7f229413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f22927fc700 1 -- 172.21.15.125:0/1473447387 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453675062 0 0) 0x7f229409dc00 con 0x7f2294133f50 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 -- 172.21.15.125:0/1473447387 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229409e6a0 con 0x7f22940a1380 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f22937fe700 1 --2- 172.21.15.125:0/1473447387 >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 0x7f22940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f2292ffd700 1 --2- 172.21.15.125:0/1473447387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f22880098f0 tx=0x7f2288009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed52a75265875aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.588+0000 7f22927fc700 1 -- 172.21.15.125:0/1473447387 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011830 con 0x7f22940a1380 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f22927fc700 1 -- 172.21.15.125:0/1473447387 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288011990 con 0x7f22940a1380 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f22927fc700 1 -- 172.21.15.125:0/1473447387 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011d20 con 0x7f22940a1380 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 -- 172.21.15.125:0/1473447387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 msgr2=0x7f2294133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 --2- 172.21.15.125:0/1473447387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f22880098f0 tx=0x7f2288009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 -- 172.21.15.125:0/1473447387 shutdown_connections 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 --2- 172.21.15.125:0/1473447387 >> v2:172.21.15.125:3300/0 conn(0x7f22940a0a70 0x7f22940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 --2- 172.21.15.125:0/1473447387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a1380 0x7f2294133a10 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 -- 172.21.15.125:0/1473447387 >> 172.21.15.125:0/1473447387 conn(0x7f22940a6610 msgr2=0x7f22940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 -- 172.21.15.125:0/1473447387 shutdown_connections 2023-10-03T10:16:59.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.589+0000 7f229a05e700 1 -- 172.21.15.125:0/1473447387 wait complete. 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.590+0000 7f229a05e700 1 Processor -- start 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.590+0000 7f229a05e700 1 -- start start 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a0a70 0x7f22941c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22940a1380 0x7f22941c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294122320 con 0x7f2294133f50 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294120660 con 0x7f22940a1380 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22940a17b0 con 0x7f22940a0a70 2023-10-03T10:16:59.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22940a1380 0x7f22941c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57122/0 (socket says 172.21.15.125:57122) 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 -- 172.21.15.125:0/76260574 learned_addr learned my addr 172.21.15.125:0/76260574 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f22937fe700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a0a70 0x7f22941c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 -- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a0a70 msgr2=0x7f22941c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a0a70 0x7f22941c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 -- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22940a1380 msgr2=0x7f22941c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22940a1380 0x7f22941c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 -- 172.21.15.125:0/76260574 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840094a0 con 0x7f2294133f50 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f2293fff700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f228c001560 tx=0x7f228c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c003e30 con 0x7f2294133f50 2023-10-03T10:16:59.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c005070 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2288009550 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.591+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c005420 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.592+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294120e50 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.592+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f228c005580 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.592+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f228c03ee10 con 0x7f2294133f50 2023-10-03T10:16:59.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.593+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229404f2a0 con 0x7f2294133f50 2023-10-03T10:16:59.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.597+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f228c017070 con 0x7f2294133f50 2023-10-03T10:16:59.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.754+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5df004f2a0 con 0x7f5df00a0a70 2023-10-03T10:16:59.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.754+0000 7f5de6ffd700 1 -- 172.21.15.125:0/3700380573 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dec017020 con 0x7f5df00a0a70 2023-10-03T10:16:59.755 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 msgr2=0x7f5df01223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9b0 tx=0x7f5dec00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 shutdown_connections 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df0133f50 0x7f5df0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df00a0a70 0x7f5df01223b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 --2- 172.21.15.125:0/3700380573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1380 0x7f5df01228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 >> 172.21.15.125:0/3700380573 conn(0x7f5df00a6610 msgr2=0x7f5df011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 shutdown_connections 2023-10-03T10:16:59.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.756+0000 7f5df86c3700 1 -- 172.21.15.125:0/3700380573 wait complete. 2023-10-03T10:16:59.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:16:59.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.789+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22940a5660 con 0x7f2294133f50 2023-10-03T10:16:59.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.789+0000 7f227bfff700 1 -- 172.21.15.125:0/76260574 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f228c00ab40 con 0x7f2294133f50 2023-10-03T10:16:59.790 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:16:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 msgr2=0x7f22941c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f228c001560 tx=0x7f228c00cb50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 shutdown_connections 2023-10-03T10:16:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2294133f50 0x7f22941c8ee0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22940a0a70 0x7f22941c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.791+0000 7f229a05e700 1 --2- 172.21.15.125:0/76260574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22940a1380 0x7f22941c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.792+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 >> 172.21.15.125:0/76260574 conn(0x7f22940a6610 msgr2=0x7f22940a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.792+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 shutdown_connections 2023-10-03T10:16:59.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.792+0000 7f229a05e700 1 -- 172.21.15.125:0/76260574 wait complete. 2023-10-03T10:16:59.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:59.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:59.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.980+0000 7f6c21022700 1 Processor -- start 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.980+0000 7f6c21022700 1 -- start start 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 0x7f6c1c132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c09f770 con 0x7f6c1c131cf0 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c09dce0 con 0x7f6c1c06b080 2023-10-03T10:16:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c21022700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c09da80 con 0x7f6c1c06a770 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1b59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 0x7f6c1c132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59428/0 (socket says 172.21.15.125:59428) 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1ad9d700 1 -- 172.21.15.125:0/2566535276 learned_addr learned my addr 172.21.15.125:0/2566535276 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 -- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 msgr2=0x7f6c1c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 -- 172.21.15.125:0/2566535276 >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 msgr2=0x7f6c1c132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 --2- 172.21.15.125:0/2566535276 >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 0x7f6c1c132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 -- 172.21.15.125:0/2566535276 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c09eb20 con 0x7f6c1c06b080 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1b59e700 1 --2- 172.21.15.125:0/2566535276 >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 0x7f6c1c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1ad9d700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c1a59c700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c1317b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565da83ae42a313e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c19d9b700 1 -- 172.21.15.125:0/2566535276 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011830 con 0x7f6c1c06b080 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c19d9b700 1 -- 172.21.15.125:0/2566535276 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c011990 con 0x7f6c1c06b080 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.981+0000 7f6c19d9b700 1 -- 172.21.15.125:0/2566535276 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011d20 con 0x7f6c1c06b080 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 -- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 msgr2=0x7f6c1c1317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c1317b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 -- 172.21.15.125:0/2566535276 shutdown_connections 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 --2- 172.21.15.125:0/2566535276 >> v2:172.21.15.125:3300/0 conn(0x7f6c1c131cf0 0x7f6c1c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 --2- 172.21.15.125:0/2566535276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c1317b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 -- 172.21.15.125:0/2566535276 >> 172.21.15.125:0/2566535276 conn(0x7f6c1c099c40 msgr2=0x7f6c1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 -- 172.21.15.125:0/2566535276 shutdown_connections 2023-10-03T10:16:59.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.982+0000 7f6c21022700 1 -- 172.21.15.125:0/2566535276 wait complete. 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.983+0000 7f6c21022700 1 Processor -- start 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.983+0000 7f6c21022700 1 -- start start 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 0x7f6c1c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c124210 con 0x7f6c1c131cf0 2023-10-03T10:16:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c071e10 con 0x7f6c1c06b080 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c21022700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c09a150 con 0x7f6c1c06a770 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59438/0 (socket says 172.21.15.125:59438) 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 -- 172.21.15.125:0/4037446567 learned_addr learned my addr 172.21.15.125:0/4037446567 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1a59c700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1b59e700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 0x7f6c1c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 -- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 msgr2=0x7f6c1c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 -- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 msgr2=0x7f6c1c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 0x7f6c1c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 -- 172.21.15.125:0/4037446567 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10009550 con 0x7f6c1c06a770 2023-10-03T10:16:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1a59c700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1b59e700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 0x7f6c1c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c1ad9d700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000ec10 tx=0x7f6c1000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.984+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000c850 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000c9b0 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c14009a70 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cd20 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c0094a0 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c10013470 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.985+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c1003fb10 con 0x7f6c1c06a770 2023-10-03T10:16:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.986+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c04f2a0 con 0x7f6c1c06a770 2023-10-03T10:16:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:16:59.990+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c10013720 con 0x7f6c1c06a770 2023-10-03T10:17:00.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 Processor -- start 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 -- start start 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c09a540 con 0x7f765c099920 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c09ad40 con 0x7f765c1307c0 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f7661753700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c09e640 con 0x7f765c12feb0 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.025+0000 7f765affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57148/0 (socket says 172.21.15.125:57148) 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55958/0 (socket says 172.21.15.125:55958) 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765a7fc700 1 -- 172.21.15.125:0/4045555081 learned_addr learned my addr 172.21.15.125:0/4045555081 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 -- 172.21.15.125:0/4045555081 >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 msgr2=0x7f765c0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 --2- 172.21.15.125:0/4045555081 >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 -- 172.21.15.125:0/4045555081 >> v1:172.21.15.125:6789/0 conn(0x7f765c099920 legacy=0x7f765c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 -- 172.21.15.125:0/4045555081 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c09e3c0 con 0x7f765c12feb0 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f7659ffb700 1 -- 172.21.15.125:0/4045555081 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562855773 0 0) 0x7f765c09a540 con 0x7f765c099920 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765a7fc700 1 --2- 172.21.15.125:0/4045555081 >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f765affd700 1 --2- 172.21.15.125:0/4045555081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f764c009820 tx=0x7f764c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5804f2bbf9a5bf3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f7659ffb700 1 -- 172.21.15.125:0/4045555081 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c005e30 con 0x7f765c12feb0 2023-10-03T10:17:00.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f7659ffb700 1 -- 172.21.15.125:0/4045555081 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c006030 con 0x7f765c12feb0 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.026+0000 7f7659ffb700 1 -- 172.21.15.125:0/4045555081 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0063c0 con 0x7f765c12feb0 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 -- 172.21.15.125:0/4045555081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 msgr2=0x7f765c130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 --2- 172.21.15.125:0/4045555081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f764c009820 tx=0x7f764c009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 -- 172.21.15.125:0/4045555081 shutdown_connections 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 --2- 172.21.15.125:0/4045555081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c130280 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 --2- 172.21.15.125:0/4045555081 >> v2:172.21.15.125:3300/0 conn(0x7f765c1307c0 0x7f765c0993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 -- 172.21.15.125:0/4045555081 >> 172.21.15.125:0/4045555081 conn(0x7f765c0a2b30 msgr2=0x7f765c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 -- 172.21.15.125:0/4045555081 shutdown_connections 2023-10-03T10:17:00.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.027+0000 7f7661753700 1 -- 172.21.15.125:0/4045555081 wait complete. 2023-10-03T10:17:00.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.028+0000 7f7661753700 1 Processor -- start 2023-10-03T10:17:00.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.028+0000 7f7661753700 1 -- start start 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f765c1307c0 0x7f765c1b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c06ed10 con 0x7f765c099920 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1b9190 con 0x7f765c12feb0 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f7661753700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f765c06ea20 con 0x7f765c1307c0 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55968/0 (socket says 172.21.15.125:55968) 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765a7fc700 1 -- 172.21.15.125:0/220501299 learned_addr learned my addr 172.21.15.125:0/220501299 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57156/0 (socket says 172.21.15.125:57156) 2023-10-03T10:17:00.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765b7fe700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f765c1307c0 0x7f765c1b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 -- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f765c1307c0 msgr2=0x7f765c1b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f765c1307c0 0x7f765c1b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 -- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 msgr2=0x7f765c1b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765affd700 1 -- 172.21.15.125:0/220501299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009550 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.029+0000 7f765a7fc700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f765affd700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f764c015000 tx=0x7f764c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c004240 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c0043a0 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c006910 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c009430 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.030+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c12a250 con 0x7f765c099920 2023-10-03T10:17:00.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.031+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f764c024070 con 0x7f765c099920 2023-10-03T10:17:00.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.031+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f764c042f60 con 0x7f765c099920 2023-10-03T10:17:00.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.031+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c04f2a0 con 0x7f765c099920 2023-10-03T10:17:00.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.035+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f764c02c030 con 0x7f765c099920 2023-10-03T10:17:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.180+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c1c1248b0 con 0x7f6c1c06a770 2023-10-03T10:17:00.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.181+0000 7f6c037fe700 1 -- 172.21.15.125:0/4037446567 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c1c1248b0 con 0x7f6c1c06a770 2023-10-03T10:17:00.181 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:00.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 msgr2=0x7f6c1c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000ec10 tx=0x7f6c1000ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:00.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 shutdown_connections 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c1c131cf0 0x7f6c1c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c1c06a770 0x7f6c1c09a490 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 --2- 172.21.15.125:0/4037446567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c1c06b080 0x7f6c1c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 >> 172.21.15.125:0/4037446567 conn(0x7f6c1c099c40 msgr2=0x7f6c1c071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 shutdown_connections 2023-10-03T10:17:00.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.183+0000 7f6c21022700 1 -- 172.21.15.125:0/4037446567 wait complete. 2023-10-03T10:17:00.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:00.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.225+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f765c06ef30 con 0x7f765c099920 2023-10-03T10:17:00.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.226+0000 7f76437fe700 1 -- 172.21.15.125:0/220501299 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f764c0319b0 con 0x7f765c099920 2023-10-03T10:17:00.226 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.227+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 msgr2=0x7f765c1b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.227+0000 7f7661753700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f764c015000 tx=0x7f764c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 shutdown_connections 2023-10-03T10:17:00.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f765c1307c0 0x7f765c1b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765c099920 0x7f765c1b7da0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 --2- 172.21.15.125:0/220501299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f765c12feb0 0x7f765c1b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 >> 172.21.15.125:0/220501299 conn(0x7f765c0a2b30 msgr2=0x7f765c12ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 shutdown_connections 2023-10-03T10:17:00.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.228+0000 7f7661753700 1 -- 172.21.15.125:0/220501299 wait complete. 2023-10-03T10:17:00.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:00.770 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:00.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.900+0000 7f081c1cc700 1 Processor -- start 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 -- start start 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 0x7f0814133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 0x7f08140a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081409b110 con 0x7f0814133f70 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140a3b60 con 0x7f08141343a0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081c1cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08140a2fa0 con 0x7f081409ad40 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f0819f68700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 0x7f0814133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f0819767700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0814133f70 0x7f08140a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51702/0 (socket says 172.21.15.125:51702) 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f081a769700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 0x7f08140a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.901+0000 7f0819767700 1 -- 172.21.15.125:0/2205518811 learned_addr learned my addr 172.21.15.125:0/2205518811 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0818f66700 1 -- 172.21.15.125:0/2205518811 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297313909 0 0) 0x7f081409b110 con 0x7f0814133f70 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0818f66700 1 -- 172.21.15.125:0/2205518811 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08000035b0 con 0x7f0814133f70 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0819f68700 1 -- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 msgr2=0x7f08140a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0819f68700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 0x7f08140a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0819f68700 1 -- 172.21.15.125:0/2205518811 >> v1:172.21.15.125:6789/0 conn(0x7f0814133f70 legacy=0x7f08140a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0819f68700 1 -- 172.21.15.125:0/2205518811 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081409a280 con 0x7f081409ad40 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f081a769700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 0x7f08140a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0819f68700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 0x7f0814133a30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0810009870 tx=0x7f0810009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fbcbc2080d3c792 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0818f66700 1 -- 172.21.15.125:0/2205518811 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011830 con 0x7f081409ad40 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0818f66700 1 -- 172.21.15.125:0/2205518811 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810011990 con 0x7f081409ad40 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.902+0000 7f0818f66700 1 -- 172.21.15.125:0/2205518811 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011d20 con 0x7f081409ad40 2023-10-03T10:17:00.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 -- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 msgr2=0x7f0814133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 0x7f0814133a30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0810009870 tx=0x7f0810009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:00.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 -- 172.21.15.125:0/2205518811 shutdown_connections 2023-10-03T10:17:00.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08141343a0 0x7f08140a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 --2- 172.21.15.125:0/2205518811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f081409ad40 0x7f0814133a30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 -- 172.21.15.125:0/2205518811 >> 172.21.15.125:0/2205518811 conn(0x7f0814099c40 msgr2=0x7f081406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 -- 172.21.15.125:0/2205518811 shutdown_connections 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.903+0000 7f081c1cc700 1 -- 172.21.15.125:0/2205518811 wait complete. 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 Processor -- start 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 -- start start 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0814133f70 0x7f08141216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08141343a0 0x7f0814121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814125640 con 0x7f0814133f70 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08141249a0 con 0x7f081409ad40 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081c1cc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081409e7a0 con 0x7f08141343a0 2023-10-03T10:17:00.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f0819f68700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f0819f68700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56000/0 (socket says 172.21.15.125:56000) 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f081a769700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08141343a0 0x7f0814121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f0819f68700 1 -- 172.21.15.125:0/3277158034 learned_addr learned my addr 172.21.15.125:0/3277158034 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.904+0000 7f0819767700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0814133f70 0x7f08141216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 -- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08141343a0 msgr2=0x7f0814121be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08141343a0 0x7f0814121be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 -- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0814133f70 msgr2=0x7f08141216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0814133f70 0x7f08141216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 -- 172.21.15.125:0/3277158034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009a70 con 0x7f081409ad40 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f0819f68700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f08100090b0 tx=0x7f0810004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810004450 con 0x7f081409ad40 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081001e070 con 0x7f081409ad40 2023-10-03T10:17:00.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100094a0 con 0x7f081409ad40 2023-10-03T10:17:00.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100038e0 con 0x7f081409ad40 2023-10-03T10:17:00.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.905+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08141246e0 con 0x7f081409ad40 2023-10-03T10:17:00.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.906+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0810003a40 con 0x7f081409ad40 2023-10-03T10:17:00.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.906+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0810020070 con 0x7f081409ad40 2023-10-03T10:17:00.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.906+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814124ae0 con 0x7f081409ad40 2023-10-03T10:17:00.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.911+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0814124ae0 con 0x7f081409ad40 2023-10-03T10:17:00.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 Processor -- start 2023-10-03T10:17:00.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 -- start start 2023-10-03T10:17:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 0x7fe030133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03006b2d0 con 0x7fe0301300a0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe030133610 con 0x7fe030133ad0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe034a8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03009a500 con 0x7fe0301309f0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe02dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.941+0000 7fe02ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 0x7fe030133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59474/0 (socket says 172.21.15.125:59474) 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 -- 172.21.15.125:0/2646166521 learned_addr learned my addr 172.21.15.125:0/2646166521 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57180/0 (socket says 172.21.15.125:57180) 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 -- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 msgr2=0x7fe030133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 0x7fe030133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 -- 172.21.15.125:0/2646166521 >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 msgr2=0x7fe0301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 --2- 172.21.15.125:0/2646166521 >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 -- 172.21.15.125:0/2646166521 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0301338b0 con 0x7fe0301309f0 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02dd9b700 1 --2- 172.21.15.125:0/2646166521 >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02e59c700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 0x7fe030133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02ed9d700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe028009e50 tx=0x7fe02800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b911ea5a2a1cd8b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02d59a700 1 -- 172.21.15.125:0/2646166521 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800e070 con 0x7fe0301309f0 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02d59a700 1 -- 172.21.15.125:0/2646166521 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02800b910 con 0x7fe0301309f0 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.942+0000 7fe02d59a700 1 -- 172.21.15.125:0/2646166521 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800bcc0 con 0x7fe0301309f0 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 -- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 msgr2=0x7fe03013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe028009e50 tx=0x7fe02800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 -- 172.21.15.125:0/2646166521 shutdown_connections 2023-10-03T10:17:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe030133ad0 0x7fe030133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 --2- 172.21.15.125:0/2646166521 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0301309f0 0x7fe03013a980 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 --2- 172.21.15.125:0/2646166521 >> v2:172.21.15.125:3300/0 conn(0x7fe0301300a0 0x7fe0301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 -- 172.21.15.125:0/2646166521 >> 172.21.15.125:0/2646166521 conn(0x7fe030099c40 msgr2=0x7fe0300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 -- 172.21.15.125:0/2646166521 shutdown_connections 2023-10-03T10:17:00.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.943+0000 7fe034a8b700 1 -- 172.21.15.125:0/2646166521 wait complete. 2023-10-03T10:17:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 Processor -- start 2023-10-03T10:17:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 -- start start 2023-10-03T10:17:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03011f950 con 0x7fe0301300a0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03012d730 con 0x7fe0301309f0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe034a8b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03012f7e0 con 0x7fe030133ad0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56020/0 (socket says 172.21.15.125:56020) 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02ed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59482/0 (socket says 172.21.15.125:59482) 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57192/0 (socket says 172.21.15.125:57192) 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.944+0000 7fe02dd9b700 1 -- 172.21.15.125:0/366585162 learned_addr learned my addr 172.21.15.125:0/366585162 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 -- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 msgr2=0x7fe03011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 -- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 msgr2=0x7fe03011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 -- 172.21.15.125:0/366585162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240094a0 con 0x7fe0301309f0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02ed9d700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02e59c700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe02dd9b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe02400ebb0 tx=0x7fe02400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400c850 con 0x7fe0301309f0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02400c9b0 con 0x7fe0301309f0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200094a0 con 0x7fe0301309f0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400cd40 con 0x7fe0301309f0 2023-10-03T10:17:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.945+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe028009b30 con 0x7fe0301309f0 2023-10-03T10:17:00.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.946+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03011fb70 con 0x7fe0301309f0 2023-10-03T10:17:00.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.946+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe024013470 con 0x7fe0301309f0 2023-10-03T10:17:00.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.947+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe024040070 con 0x7fe0301309f0 2023-10-03T10:17:00.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:00.951+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe024024760 con 0x7fe0301309f0 2023-10-03T10:17:01.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.101+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0814124ae0 con 0x7f081409ad40 2023-10-03T10:17:01.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.101+0000 7f080a7fc700 1 -- 172.21.15.125:0/3277158034 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0814124ae0 con 0x7f081409ad40 2023-10-03T10:17:01.102 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 msgr2=0x7f0814121160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f08100090b0 tx=0x7f0810004750 comp rx=0 tx=0).stop 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 shutdown_connections 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f08141343a0 0x7f0814121be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f081409ad40 0x7f0814121160 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 --2- 172.21.15.125:0/3277158034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0814133f70 0x7f08141216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 >> 172.21.15.125:0/3277158034 conn(0x7f0814099c40 msgr2=0x7f08141332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.103+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 shutdown_connections 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.104+0000 7f081c1cc700 1 -- 172.21.15.125:0/3277158034 wait complete. 2023-10-03T10:17:01.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.135+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe03004f2a0 con 0x7fe0301309f0 2023-10-03T10:17:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.136+0000 7fe01effd700 1 -- 172.21.15.125:0/366585162 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe024021020 con 0x7fe0301309f0 2023-10-03T10:17:01.136 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:01.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 msgr2=0x7fe03011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe02400ebb0 tx=0x7fe02400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 shutdown_connections 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe030133ad0 0x7fe03011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0301300a0 0x7fe03011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 --2- 172.21.15.125:0/366585162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0301309f0 0x7fe03011df80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 >> 172.21.15.125:0/366585162 conn(0x7fe030099c40 msgr2=0x7fe03012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 shutdown_connections 2023-10-03T10:17:01.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.138+0000 7fe034a8b700 1 -- 172.21.15.125:0/366585162 wait complete. 2023-10-03T10:17:01.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:01.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:01.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 Processor -- start 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 -- start start 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7900a1380 0x7ff790133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79009dc00 con 0x7ff790133f50 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79009ea60 con 0x7ff7900a1380 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.323+0000 7ff798551700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff79009dec0 con 0x7ff7900a0a70 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7962ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7900a1380 0x7ff790133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7962ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59494/0 (socket says 172.21.15.125:59494) 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff796aee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff790133f50 0x7ff79013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51718/0 (socket says 172.21.15.125:51718) 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7900a1380 0x7ff790133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57202/0 (socket says 172.21.15.125:57202) 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7962ed700 1 -- 172.21.15.125:0/3542402007 learned_addr learned my addr 172.21.15.125:0/3542402007 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 -- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 msgr2=0x7ff7900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 -- 172.21.15.125:0/3542402007 >> v1:172.21.15.125:6789/0 conn(0x7ff790133f50 legacy=0x7ff79013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 -- 172.21.15.125:0/3542402007 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79009e6a0 con 0x7ff7900a1380 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7952eb700 1 -- 172.21.15.125:0/3542402007 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557027032 0 0) 0x7ff79009dc00 con 0x7ff790133f50 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7962ed700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff795aec700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7900a1380 0x7ff790133a10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff780009840 tx=0x7ff780009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0ab53041d0f05b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7952eb700 1 -- 172.21.15.125:0/3542402007 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011830 con 0x7ff7900a1380 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7952eb700 1 -- 172.21.15.125:0/3542402007 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780011990 con 0x7ff7900a1380 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.324+0000 7ff7952eb700 1 -- 172.21.15.125:0/3542402007 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011d20 con 0x7ff7900a1380 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 -- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7900a1380 msgr2=0x7ff790133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7900a1380 0x7ff790133a10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff780009840 tx=0x7ff780009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 -- 172.21.15.125:0/3542402007 shutdown_connections 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff7900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 --2- 172.21.15.125:0/3542402007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7900a1380 0x7ff790133a10 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 -- 172.21.15.125:0/3542402007 >> 172.21.15.125:0/3542402007 conn(0x7ff7900a6610 msgr2=0x7ff7900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 -- 172.21.15.125:0/3542402007 shutdown_connections 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.325+0000 7ff798551700 1 -- 172.21.15.125:0/3542402007 wait complete. 2023-10-03T10:17:01.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 Processor -- start 2023-10-03T10:17:01.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 -- start start 2023-10-03T10:17:01.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff790122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 0x7ff790123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff790126220 con 0x7ff790133f50 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790133960 con 0x7ff7900a1380 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff798551700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff790133420 con 0x7ff7900a0a70 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff796aee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 0x7ff790123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff795aec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff795aec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56030/0 (socket says 172.21.15.125:56030) 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff795aec700 1 -- 172.21.15.125:0/1190414825 learned_addr learned my addr 172.21.15.125:0/1190414825 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.326+0000 7ff7962ed700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff790122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 -- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 msgr2=0x7ff790122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff790122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 -- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 msgr2=0x7ff790123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 0x7ff790123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 -- 172.21.15.125:0/1190414825 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009550 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff796aee700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 0x7ff790123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff7962ed700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff790122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff795aec700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7800090b0 tx=0x7ff780004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800036a0 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78001f070 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7800094a0 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780003a60 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.327+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff790126bb0 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.328+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff780003bc0 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.328+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff780021070 con 0x7ff7900a1380 2023-10-03T10:17:01.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.328+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79004f2a0 con 0x7ff7900a1380 2023-10-03T10:17:01.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.333+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff780015070 con 0x7ff7900a1380 2023-10-03T10:17:01.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.366+0000 7fb0dfaf7700 1 Processor -- start 2023-10-03T10:17:01.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.366+0000 7fb0dfaf7700 1 -- start start 2023-10-03T10:17:01.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dfaf7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dfaf7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8134120 0x7fb0d813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dfaf7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d809dc00 con 0x7fb0d80a1380 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dfaf7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d809ea60 con 0x7fb0d8134120 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dfaf7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809dec0 con 0x7fb0d80a0a70 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0de094700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8134120 0x7fb0d813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dd893700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dd092700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb0d80a1380 0x7fb0d8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51734/0 (socket says 172.21.15.125:51734) 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0de094700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0d8134120 0x7fb0d813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57212/0 (socket says 172.21.15.125:57212) 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0dd092700 1 -- 172.21.15.125:0/1851507477 learned_addr learned my addr 172.21.15.125:0/1851507477 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0de094700 1 -- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 msgr2=0x7fb0d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.367+0000 7fb0de094700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0de094700 1 -- 172.21.15.125:0/1851507477 >> v1:172.21.15.125:6789/0 conn(0x7fb0d80a1380 legacy=0x7fb0d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0de094700 1 -- 172.21.15.125:0/1851507477 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d809e6a0 con 0x7fb0d8134120 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dc891700 1 -- 172.21.15.125:0/1851507477 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248840816 0 0) 0x7fb0d809dc00 con 0x7fb0d80a1380 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dd893700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0de094700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d8134120 0x7fb0d813bce0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009d90 tx=0x7fb0d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267a4fbcb6292cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dc891700 1 -- 172.21.15.125:0/1851507477 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000e070 con 0x7fb0d8134120 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dc891700 1 -- 172.21.15.125:0/1851507477 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d000bb20 con 0x7fb0d8134120 2023-10-03T10:17:01.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dc891700 1 -- 172.21.15.125:0/1851507477 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0012430 con 0x7fb0d8134120 2023-10-03T10:17:01.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d8134120 msgr2=0x7fb0d813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d8134120 0x7fb0d813bce0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009d90 tx=0x7fb0d000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/1851507477 shutdown_connections 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d8134120 0x7fb0d813bce0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.368+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/1851507477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.369+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/1851507477 >> 172.21.15.125:0/1851507477 conn(0x7fb0d80a6610 msgr2=0x7fb0d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.369+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/1851507477 shutdown_connections 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.369+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/1851507477 wait complete. 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.369+0000 7fb0dfaf7700 1 Processor -- start 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 -- start start 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 0x7fb0d8122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8134120 0x7fb0d81231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81332b0 con 0x7fb0d80a0a70 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81258b0 con 0x7fb0d80a1380 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dfaf7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81242c0 con 0x7fb0d8134120 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd092700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 0x7fb0d8122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57220/0 (socket says 172.21.15.125:57220) 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd092700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 0x7fb0d8122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56048/0 (socket says 172.21.15.125:56048) 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 -- 172.21.15.125:0/796755604 learned_addr learned my addr 172.21.15.125:0/796755604 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0de094700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8134120 0x7fb0d81231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 -- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8134120 msgr2=0x7fb0d81231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8134120 0x7fb0d81231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 -- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 msgr2=0x7fb0d8122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 0x7fb0d8122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.370+0000 7fb0dd893700 1 -- 172.21.15.125:0/796755604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40094a0 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0dd893700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400ec10 tx=0x7fb0d400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400c850 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400c9b0 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d0009a70 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400cd20 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d8125c30 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.371+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d4013470 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.372+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d804f2a0 con 0x7fb0d80a0a70 2023-10-03T10:17:01.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.372+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0d403f890 con 0x7fb0d80a0a70 2023-10-03T10:17:01.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.376+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d4013720 con 0x7fb0d80a0a70 2023-10-03T10:17:01.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.529+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff790072980 con 0x7ff7900a1380 2023-10-03T10:17:01.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.529+0000 7ff786ffd700 1 -- 172.21.15.125:0/1190414825 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff78001a430 con 0x7ff7900a1380 2023-10-03T10:17:01.530 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.531+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 msgr2=0x7ff790122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.531+0000 7ff798551700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7800090b0 tx=0x7ff780004750 comp rx=0 tx=0).stop 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 shutdown_connections 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff790133f50 0x7ff790123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff7900a0a70 0x7ff790122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 --2- 172.21.15.125:0/1190414825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7900a1380 0x7ff790122e40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 >> 172.21.15.125:0/1190414825 conn(0x7ff7900a6610 msgr2=0x7ff7900a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 shutdown_connections 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.532+0000 7ff798551700 1 -- 172.21.15.125:0/1190414825 wait complete. 2023-10-03T10:17:01.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:01.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.571+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0d8072980 con 0x7fb0d80a0a70 2023-10-03T10:17:01.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.571+0000 7fb0ce7fc700 1 -- 172.21.15.125:0/796755604 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d4021030 con 0x7fb0d80a0a70 2023-10-03T10:17:01.572 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 msgr2=0x7fb0d8122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400ec10 tx=0x7fb0d400ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 shutdown_connections 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb0d8134120 0x7fb0d81231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0d80a0a70 0x7fb0d8122750 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 --2- 172.21.15.125:0/796755604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0d80a1380 0x7fb0d8122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 >> 172.21.15.125:0/796755604 conn(0x7fb0d80a6610 msgr2=0x7fb0d811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 shutdown_connections 2023-10-03T10:17:01.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:01.574+0000 7fb0dfaf7700 1 -- 172.21.15.125:0/796755604 wait complete. 2023-10-03T10:17:01.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:02.116 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:02.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:02.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.248+0000 7f78e0475700 1 Processor -- start 2023-10-03T10:17:02.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.248+0000 7f78e0475700 1 -- start start 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 0x7f78d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d809e9d0 con 0x7f78d80a1380 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d809dc00 con 0x7f78d80a0a70 2023-10-03T10:17:02.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78e0475700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78d809dec0 con 0x7f78d8133f50 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78de211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78dea12700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78dda10700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 0x7f78d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78de211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56054/0 (socket says 172.21.15.125:56054) 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.249+0000 7f78de211700 1 -- 172.21.15.125:0/1352367323 learned_addr learned my addr 172.21.15.125:0/1352367323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 -- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 msgr2=0x7f78d8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 --2- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 -- 172.21.15.125:0/1352367323 >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 msgr2=0x7f78d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 --2- 172.21.15.125:0/1352367323 >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 0x7f78d8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 -- 172.21.15.125:0/1352367323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d809e6a0 con 0x7f78d80a0a70 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78dda10700 1 --2- 172.21.15.125:0/1352367323 >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 0x7f78d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78de211700 1 --2- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f78d40098f0 tx=0x7f78d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a0eb4d96f06da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78dd20f700 1 -- 172.21.15.125:0/1352367323 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4011830 con 0x7f78d80a0a70 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78dd20f700 1 -- 172.21.15.125:0/1352367323 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4011990 con 0x7f78d80a0a70 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.250+0000 7f78dd20f700 1 -- 172.21.15.125:0/1352367323 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4011d20 con 0x7f78d80a0a70 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 -- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 msgr2=0x7f78d80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 --2- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f78d40098f0 tx=0x7f78d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 -- 172.21.15.125:0/1352367323 shutdown_connections 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 --2- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d80a0e40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 --2- 172.21.15.125:0/1352367323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 --2- 172.21.15.125:0/1352367323 >> v2:172.21.15.125:3300/0 conn(0x7f78d80a1380 0x7f78d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 -- 172.21.15.125:0/1352367323 >> 172.21.15.125:0/1352367323 conn(0x7f78d80a6610 msgr2=0x7f78d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 -- 172.21.15.125:0/1352367323 shutdown_connections 2023-10-03T10:17:02.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.251+0000 7f78e0475700 1 -- 172.21.15.125:0/1352367323 wait complete. 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.252+0000 7f78e0475700 1 Processor -- start 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.252+0000 7f78e0475700 1 -- start start 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 0x7f78d8122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8124190 con 0x7f78d80a1380 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80a0450 con 0x7f78d80a0a70 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81239c0 con 0x7f78d8133f50 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78de211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78de211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56066/0 (socket says 172.21.15.125:56066) 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78de211700 1 -- 172.21.15.125:0/1191066594 learned_addr learned my addr 172.21.15.125:0/1191066594 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 0x7f78d8122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dea12700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 -- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 msgr2=0x7f78d8123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 -- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 msgr2=0x7f78d8122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 -- 172.21.15.125:0/1191066594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80094a0 con 0x7f78d80a1380 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78de211700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78dda10700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 0x7f78d8122ac0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e980 tx=0x7f78c800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004240 con 0x7f78d80a1380 2023-10-03T10:17:02.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c80043a0 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d4009550 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.253+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80036a0 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.254+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d8124a10 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.254+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d804f2a0 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.255+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78c8003800 con 0x7f78d80a1380 2023-10-03T10:17:02.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.255+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78c803fc50 con 0x7f78d80a1380 2023-10-03T10:17:02.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.259+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78c803fe60 con 0x7f78d80a1380 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.287+0000 7f5408932700 1 Processor -- start 2023-10-03T10:17:02.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.287+0000 7f5408932700 1 -- start start 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5408932700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5408932700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5408932700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540409dc00 con 0x7f54040a1380 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5408932700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540409ea90 con 0x7f5404134120 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5408932700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540409dec0 con 0x7f54040a0a70 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5402d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5401d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f54040a1380 0x7f5404133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51748/0 (socket says 172.21.15.125:51748) 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59540/0 (socket says 172.21.15.125:59540) 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5401d9b700 1 -- 172.21.15.125:0/1753533574 learned_addr learned my addr 172.21.15.125:0/1753533574 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:02.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 -- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 msgr2=0x7f540413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 -- 172.21.15.125:0/1753533574 >> v1:172.21.15.125:6789/0 conn(0x7f54040a1380 legacy=0x7f5404133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 -- 172.21.15.125:0/1753533574 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540409e6a0 con 0x7f54040a0a70 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540159a700 1 -- 172.21.15.125:0/1753533574 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121055206 0 0) 0x7f540409dc00 con 0x7f54040a1380 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f5402d9d700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540259c700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20c6583af87c1553 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540159a700 1 -- 172.21.15.125:0/1753533574 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4011830 con 0x7f54040a0a70 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540159a700 1 -- 172.21.15.125:0/1753533574 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4011990 con 0x7f54040a0a70 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.288+0000 7f540159a700 1 -- 172.21.15.125:0/1753533574 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4011d20 con 0x7f54040a0a70 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 -- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 msgr2=0x7f54040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 -- 172.21.15.125:0/1753533574 shutdown_connections 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5404134120 0x7f540413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 --2- 172.21.15.125:0/1753533574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a0a70 0x7f54040a0e40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 -- 172.21.15.125:0/1753533574 >> 172.21.15.125:0/1753533574 conn(0x7f54040a6610 msgr2=0x7f54040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 -- 172.21.15.125:0/1753533574 shutdown_connections 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.289+0000 7f5408932700 1 -- 172.21.15.125:0/1753533574 wait complete. 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.290+0000 7f5408932700 1 Processor -- start 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.290+0000 7f5408932700 1 -- start start 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a1380 0x7f5404122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5404124390 con 0x7f5404134120 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5404133310 con 0x7f54040a0a70 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5404125d00 con 0x7f54040a1380 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56080/0 (socket says 172.21.15.125:56080) 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 -- 172.21.15.125:0/3706081131 learned_addr learned my addr 172.21.15.125:0/3706081131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5402d9d700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5401d9b700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a1380 0x7f5404122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 -- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a1380 msgr2=0x7f5404122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a1380 0x7f5404122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 -- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 msgr2=0x7f5404123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 -- 172.21.15.125:0/3706081131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009a70 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5402d9d700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f540259c700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009840 tx=0x7f53f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40045d0 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f401f070 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f40094a0 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.291+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40038e0 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.292+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54040a03e0 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.292+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53f4003a40 con 0x7f54040a0a70 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.292+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53f4021070 con 0x7f54040a0a70 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.292+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540404f2a0 con 0x7f54040a0a70 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.297+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53f401a430 con 0x7f54040a0a70 2023-10-03T10:17:02.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.453+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78d8125d20 con 0x7f78d80a1380 2023-10-03T10:17:02.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.453+0000 7f78ceffd700 1 -- 172.21.15.125:0/1191066594 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78c8011350 con 0x7f78d80a1380 2023-10-03T10:17:02.454 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 msgr2=0x7f78d8122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 0x7f78d8122ac0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e980 tx=0x7f78c800ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 shutdown_connections 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78d8133f50 0x7f78d8123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78d80a0a70 0x7f78d8122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 --2- 172.21.15.125:0/1191066594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78d80a1380 0x7f78d8122ac0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 >> 172.21.15.125:0/1191066594 conn(0x7f78d80a6610 msgr2=0x7f78d809f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 shutdown_connections 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.455+0000 7f78e0475700 1 -- 172.21.15.125:0/1191066594 wait complete. 2023-10-03T10:17:02.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:02.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.492+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5404072980 con 0x7f54040a0a70 2023-10-03T10:17:02.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.492+0000 7f53f2ffd700 1 -- 172.21.15.125:0/3706081131 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53f402b020 con 0x7f54040a0a70 2023-10-03T10:17:02.494 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:02.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 msgr2=0x7f5404122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009840 tx=0x7f53f4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 shutdown_connections 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5404134120 0x7f5404123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54040a0a70 0x7f5404122780 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 --2- 172.21.15.125:0/3706081131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f54040a1380 0x7f5404122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 >> 172.21.15.125:0/3706081131 conn(0x7f54040a6610 msgr2=0x7f54040a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 shutdown_connections 2023-10-03T10:17:02.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.494+0000 7f5408932700 1 -- 172.21.15.125:0/3706081131 wait complete. 2023-10-03T10:17:02.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:02.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:02.587 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:02.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.671+0000 7fef01d91700 1 Processor -- start 2023-10-03T10:17:02.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.671+0000 7fef01d91700 1 -- start start 2023-10-03T10:17:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7fef01d91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 0x7feefc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7fef01d91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 0x7feefc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7fef01d91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc09e9d0 con 0x7feefc0a0a70 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7fef01d91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc09dc00 con 0x7feefc139200 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7fef01d91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feefc09dec0 con 0x7feefc0a1550 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 0x7feefc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feefc0a0a70 0x7feefc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51758/0 (socket says 172.21.15.125:51758) 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefb7fe700 1 -- 172.21.15.125:0/611902202 learned_addr learned my addr 172.21.15.125:0/611902202 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 0x7feefc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefa7fc700 1 -- 172.21.15.125:0/611902202 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686904760 0 0) 0x7feefc09e9d0 con 0x7feefc0a0a70 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefa7fc700 1 -- 172.21.15.125:0/611902202 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee40035b0 con 0x7feefc0a0a70 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 -- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 msgr2=0x7feefc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 0x7feefc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 -- 172.21.15.125:0/611902202 >> v1:172.21.15.125:6789/0 conn(0x7feefc0a0a70 legacy=0x7feefc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 -- 172.21.15.125:0/611902202 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc09e6a0 con 0x7feefc0a1550 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefbfff700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 0x7feefc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefaffd700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 0x7feefc138cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c436eee7d424df2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefa7fc700 1 -- 172.21.15.125:0/611902202 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011830 con 0x7feefc0a1550 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefa7fc700 1 -- 172.21.15.125:0/611902202 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0011990 con 0x7feefc0a1550 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.672+0000 7feefa7fc700 1 -- 172.21.15.125:0/611902202 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011d00 con 0x7feefc0a1550 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 -- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 msgr2=0x7feefc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 0x7feefc138cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 -- 172.21.15.125:0/611902202 shutdown_connections 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc139200 0x7feefc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 --2- 172.21.15.125:0/611902202 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc0a1550 0x7feefc138cc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 -- 172.21.15.125:0/611902202 >> 172.21.15.125:0/611902202 conn(0x7feefc0a6610 msgr2=0x7feefc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 -- 172.21.15.125:0/611902202 shutdown_connections 2023-10-03T10:17:02.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.673+0000 7fef01d91700 1 -- 172.21.15.125:0/611902202 wait complete. 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.674+0000 7fef01d91700 1 Processor -- start 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.674+0000 7fef01d91700 1 -- start start 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc0a0a70 0x7feefc11e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 0x7feefc11f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc121e80 con 0x7feefc0a1550 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc122060 con 0x7feefc0a0a70 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0a03e0 con 0x7feefc139200 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 0x7feefc11f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57254/0 (socket says 172.21.15.125:57254) 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefaffd700 1 -- 172.21.15.125:0/920070020 learned_addr learned my addr 172.21.15.125:0/920070020 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefb7fe700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc0a0a70 0x7feefc11e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 -- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc0a0a70 msgr2=0x7feefc11e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc0a0a70 0x7feefc11e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 -- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 msgr2=0x7feefc11ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 -- 172.21.15.125:0/920070020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4009a70 con 0x7feefc139200 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefaffd700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feefbfff700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 0x7feefc11f2a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feef400efc0 tx=0x7feef400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400ca90 con 0x7feefc139200 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef400f040 con 0x7feefc139200 2023-10-03T10:17:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400ce30 con 0x7feefc139200 2023-10-03T10:17:02.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef00094a0 con 0x7feefc139200 2023-10-03T10:17:02.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.675+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc09d340 con 0x7feefc139200 2023-10-03T10:17:02.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.676+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feef4014480 con 0x7feefc139200 2023-10-03T10:17:02.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.676+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feef403fbf0 con 0x7feefc139200 2023-10-03T10:17:02.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.677+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc1221a0 con 0x7feefc139200 2023-10-03T10:17:02.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.681+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feefc1221a0 con 0x7feefc139200 2023-10-03T10:17:02.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.714+0000 7f7922470700 1 Processor -- start 2023-10-03T10:17:02.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 -- start start 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f791c0a0a70 0x7f791c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c09dc00 con 0x7f791c0a1380 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c09ea90 con 0x7f791c0a0a70 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7922470700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c09dec0 con 0x7f791c134120 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7920a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f791c0a0a70 0x7f791c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7920a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56108/0 (socket says 172.21.15.125:56108) 2023-10-03T10:17:02.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f791c0a0a70 0x7f791c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57256/0 (socket says 172.21.15.125:57256) 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7920a0d700 1 -- 172.21.15.125:0/3331729610 learned_addr learned my addr 172.21.15.125:0/3331729610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791b7fe700 1 --1- 172.21.15.125:0/3331729610 >> v1:172.21.15.125:6789/0 conn(0x7f791c0a1380 0x7f791c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51760/0 (socket says 172.21.15.125:51760) 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 -- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 msgr2=0x7f791c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 -- 172.21.15.125:0/3331729610 >> v1:172.21.15.125:6789/0 conn(0x7f791c0a1380 legacy=0x7f791c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791bfff700 1 -- 172.21.15.125:0/3331729610 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c09e6a0 con 0x7f791c0a0a70 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f791affd700 1 -- 172.21.15.125:0/3331729610 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739962117 0 0) 0x7f791c09dc00 con 0x7f791c0a1380 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.715+0000 7f7920a0d700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f791bfff700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c0a0e40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f790c009840 tx=0x7f790c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6542677c40e8a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f791affd700 1 -- 172.21.15.125:0/3331729610 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c011830 con 0x7f791c0a0a70 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f791affd700 1 -- 172.21.15.125:0/3331729610 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c011990 con 0x7f791c0a0a70 2023-10-03T10:17:02.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f791affd700 1 -- 172.21.15.125:0/3331729610 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c011d20 con 0x7f791c0a0a70 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 -- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 msgr2=0x7f791c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c0a0e40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f790c009840 tx=0x7f790c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 -- 172.21.15.125:0/3331729610 shutdown_connections 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 --2- 172.21.15.125:0/3331729610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c0a0e40 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 -- 172.21.15.125:0/3331729610 >> 172.21.15.125:0/3331729610 conn(0x7f791c0a6610 msgr2=0x7f791c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 -- 172.21.15.125:0/3331729610 shutdown_connections 2023-10-03T10:17:02.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.716+0000 7f7922470700 1 -- 172.21.15.125:0/3331729610 wait complete. 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.717+0000 7f7922470700 1 Processor -- start 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.717+0000 7f7922470700 1 -- start start 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f791c0a1380 0x7f791c122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c133300 con 0x7f791c0a0a70 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c125920 con 0x7f791c134120 2023-10-03T10:17:02.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7922470700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f791c124310 con 0x7f791c0a1380 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56112/0 (socket says 172.21.15.125:56112) 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 -- 172.21.15.125:0/876948811 learned_addr learned my addr 172.21.15.125:0/876948811 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f791b7fe700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f791c0a1380 0x7f791c122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f791bfff700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 -- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f791c0a1380 msgr2=0x7f791c122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f791c0a1380 0x7f791c122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 -- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 msgr2=0x7f791c122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 -- 172.21.15.125:0/876948811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914009b30 con 0x7f791c134120 2023-10-03T10:17:02.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f791bfff700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.718+0000 7f7920a0d700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f791400efc0 tx=0x7f791400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914018070 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400f040 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0094a0 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914003c20 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c125c80 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.719+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f791400c880 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.720+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f791403f7f0 con 0x7f791c134120 2023-10-03T10:17:02.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.720+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c04f2a0 con 0x7f791c134120 2023-10-03T10:17:02.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.724+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f791400ce10 con 0x7f791c134120 2023-10-03T10:17:02.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.877+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feefc1221a0 con 0x7feefc139200 2023-10-03T10:17:02.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.877+0000 7feee3fff700 1 -- 172.21.15.125:0/920070020 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feefc1221a0 con 0x7feefc139200 2023-10-03T10:17:02.878 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 msgr2=0x7feefc11f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 0x7feefc11f2a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feef400efc0 tx=0x7feef400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 shutdown_connections 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feefc139200 0x7feefc11f2a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feefc0a0a70 0x7feefc11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 --2- 172.21.15.125:0/920070020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feefc0a1550 0x7feefc11ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 >> 172.21.15.125:0/920070020 conn(0x7feefc0a6610 msgr2=0x7feefc09a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 shutdown_connections 2023-10-03T10:17:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.880+0000 7fef01d91700 1 -- 172.21.15.125:0/920070020 wait complete. 2023-10-03T10:17:02.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:02.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.927+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f791c072980 con 0x7f791c134120 2023-10-03T10:17:02.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.927+0000 7f7918ff9700 1 -- 172.21.15.125:0/876948811 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f791401cbb0 con 0x7f791c134120 2023-10-03T10:17:02.928 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:02.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 msgr2=0x7f791c123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f791400efc0 tx=0x7f791400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 shutdown_connections 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f791c134120 0x7f791c123180 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f791c0a0a70 0x7f791c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 --2- 172.21.15.125:0/876948811 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f791c0a1380 0x7f791c122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 >> 172.21.15.125:0/876948811 conn(0x7f791c0a6610 msgr2=0x7f791c0a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 shutdown_connections 2023-10-03T10:17:02.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:02.930+0000 7f7922470700 1 -- 172.21.15.125:0/876948811 wait complete. 2023-10-03T10:17:02.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:03.469 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:03.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:03.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 Processor -- start 2023-10-03T10:17:03.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 -- start start 2023-10-03T10:17:03.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272c133f50 0x7f272c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c09e9d0 con 0x7f272c133f50 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c09dc00 con 0x7f272c0a0a70 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f273104d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272c09dec0 con 0x7f272c0a1380 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f272a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56114/0 (socket says 172.21.15.125:56114) 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f272ad9d700 1 -- 172.21.15.125:0/3007953036 learned_addr learned my addr 172.21.15.125:0/3007953036 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.596+0000 7f272b59e700 1 --2- 172.21.15.125:0/3007953036 >> v2:172.21.15.125:3300/0 conn(0x7f272c133f50 0x7f272c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 -- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 msgr2=0x7f272c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 -- 172.21.15.125:0/3007953036 >> v2:172.21.15.125:3300/0 conn(0x7f272c133f50 msgr2=0x7f272c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 --2- 172.21.15.125:0/3007953036 >> v2:172.21.15.125:3300/0 conn(0x7f272c133f50 0x7f272c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 -- 172.21.15.125:0/3007953036 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c09e6a0 con 0x7f272c0a1380 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272ad9d700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f272a59c700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c133a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2720009840 tx=0x7f2720009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c51fb1d65bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f2729d9b700 1 -- 172.21.15.125:0/3007953036 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011830 con 0x7f272c0a1380 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f2729d9b700 1 -- 172.21.15.125:0/3007953036 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720011990 con 0x7f272c0a1380 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.597+0000 7f2729d9b700 1 -- 172.21.15.125:0/3007953036 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011d20 con 0x7f272c0a1380 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 -- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 msgr2=0x7f272c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c133a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2720009840 tx=0x7f2720009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 -- 172.21.15.125:0/3007953036 shutdown_connections 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c0a0a70 0x7f272c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 --2- 172.21.15.125:0/3007953036 >> v2:172.21.15.125:3300/0 conn(0x7f272c133f50 0x7f272c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 --2- 172.21.15.125:0/3007953036 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c133a10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 -- 172.21.15.125:0/3007953036 >> 172.21.15.125:0/3007953036 conn(0x7f272c0a6610 msgr2=0x7f272c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 -- 172.21.15.125:0/3007953036 shutdown_connections 2023-10-03T10:17:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.598+0000 7f273104d700 1 -- 172.21.15.125:0/3007953036 wait complete. 2023-10-03T10:17:03.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 Processor -- start 2023-10-03T10:17:03.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 -- start start 2023-10-03T10:17:03.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c133f50 0x7f272c122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c125250 con 0x7f272c0a0a70 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c124180 con 0x7f272c133f50 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f273104d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272c124e90 con 0x7f272c0a1380 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f272a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57290/0 (socket says 172.21.15.125:57290) 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.599+0000 7f272a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59596/0 (socket says 172.21.15.125:59596) 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 -- 172.21.15.125:0/1342330032 learned_addr learned my addr 172.21.15.125:0/1342330032 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272b59e700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c133f50 0x7f272c122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 -- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 msgr2=0x7f272c122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 -- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c133f50 msgr2=0x7f272c122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c133f50 0x7f272c122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 -- 172.21.15.125:0/1342330032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009550 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272a59c700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f271c00ebe0 tx=0x7f271c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004030 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c004190 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27200094a0 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004520 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.600+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c125970 con 0x7f272c0a0a70 2023-10-03T10:17:03.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.601+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f271c00c850 con 0x7f272c0a0a70 2023-10-03T10:17:03.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.601+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c04f2a0 con 0x7f272c0a0a70 2023-10-03T10:17:03.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.601+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f271c03f630 con 0x7f272c0a0a70 2023-10-03T10:17:03.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.606+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271c0036a0 con 0x7f272c0a0a70 2023-10-03T10:17:03.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 Processor -- start 2023-10-03T10:17:03.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 -- start start 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 0x7f16680a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 0x7f166813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166809dc00 con 0x7f16680a1380 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166809ea60 con 0x7f1668134120 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.636+0000 7f166d17e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166809dec0 con 0x7f16680a0a70 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 0x7f16680a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f166759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 0x7f166813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f166659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f16680a1380 0x7f1668133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51768/0 (socket says 172.21.15.125:51768) 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f166659c700 1 -- 172.21.15.125:0/646170126 learned_addr learned my addr 172.21.15.125:0/646170126 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:03.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 -- 172.21.15.125:0/646170126 >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 msgr2=0x7f166813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 --2- 172.21.15.125:0/646170126 >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 0x7f166813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 -- 172.21.15.125:0/646170126 >> v1:172.21.15.125:6789/0 conn(0x7f16680a1380 legacy=0x7f1668133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 -- 172.21.15.125:0/646170126 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166809e6a0 con 0x7f16680a0a70 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f166759e700 1 --2- 172.21.15.125:0/646170126 >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 0x7f166813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1666d9d700 1 --2- 172.21.15.125:0/646170126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 0x7f16680a0e40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1658009840 tx=0x7f1658009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf09f0c96f1a1b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1665d9b700 1 -- 172.21.15.125:0/646170126 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658011830 con 0x7f16680a0a70 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1665d9b700 1 -- 172.21.15.125:0/646170126 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658011990 con 0x7f16680a0a70 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.637+0000 7f1665d9b700 1 -- 172.21.15.125:0/646170126 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658011d20 con 0x7f16680a0a70 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 -- 172.21.15.125:0/646170126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 msgr2=0x7f16680a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 --2- 172.21.15.125:0/646170126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 0x7f16680a0e40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1658009840 tx=0x7f1658009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 -- 172.21.15.125:0/646170126 shutdown_connections 2023-10-03T10:17:03.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 --2- 172.21.15.125:0/646170126 >> v2:172.21.15.125:3300/0 conn(0x7f1668134120 0x7f166813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 --2- 172.21.15.125:0/646170126 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a0a70 0x7f16680a0e40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 -- 172.21.15.125:0/646170126 >> 172.21.15.125:0/646170126 conn(0x7f16680a6610 msgr2=0x7f16680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 -- 172.21.15.125:0/646170126 shutdown_connections 2023-10-03T10:17:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.638+0000 7f166d17e700 1 -- 172.21.15.125:0/646170126 wait complete. 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 Processor -- start 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 -- start start 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1668134120 0x7f16681233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668133a90 con 0x7f16680a0a70 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16680a03e0 con 0x7f1668134120 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.639+0000 7f166d17e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16681337f0 con 0x7f16680a1380 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57310/0 (socket says 172.21.15.125:57310) 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59626/0 (socket says 172.21.15.125:59626) 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 -- 172.21.15.125:0/1584466215 learned_addr learned my addr 172.21.15.125:0/1584466215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166759e700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1668134120 0x7f16681233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 -- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 msgr2=0x7f1668122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 -- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1668134120 msgr2=0x7f16681233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1668134120 0x7f16681233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 -- 172.21.15.125:0/1584466215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660009a70 con 0x7f16680a0a70 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166659c700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f1666d9d700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1658009fd0 tx=0x7f1658004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580045d0 con 0x7f16680a0a70 2023-10-03T10:17:03.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165801f070 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580094a0 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580038e0 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.640+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1668126b50 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.641+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1668125ed0 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.642+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1658003a40 con 0x7f16680a0a70 2023-10-03T10:17:03.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.642+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1658021070 con 0x7f16680a0a70 2023-10-03T10:17:03.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.646+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1658010380 con 0x7f16680a0a70 2023-10-03T10:17:03.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.798+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f272c125710 con 0x7f272c0a0a70 2023-10-03T10:17:03.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.799+0000 7f27137fe700 1 -- 172.21.15.125:0/1342330032 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271c019ab0 con 0x7f272c0a0a70 2023-10-03T10:17:03.799 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 msgr2=0x7f272c122440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f271c00ebe0 tx=0x7f271c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 shutdown_connections 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272c133f50 0x7f272c122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0a0a70 0x7f272c122440 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 --2- 172.21.15.125:0/1342330032 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272c0a1380 0x7f272c122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 >> 172.21.15.125:0/1342330032 conn(0x7f272c0a6610 msgr2=0x7f272c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 shutdown_connections 2023-10-03T10:17:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.801+0000 7f273104d700 1 -- 172.21.15.125:0/1342330032 wait complete. 2023-10-03T10:17:03.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:03.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.839+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16680a2710 con 0x7f16680a0a70 2023-10-03T10:17:03.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.839+0000 7f164f7fe700 1 -- 172.21.15.125:0/1584466215 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1658035090 con 0x7f16680a0a70 2023-10-03T10:17:03.840 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 msgr2=0x7f1668122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1658009fd0 tx=0x7f1658004750 comp rx=0 tx=0).stop 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 shutdown_connections 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1668134120 0x7f16681233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16680a0a70 0x7f1668122970 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 --2- 172.21.15.125:0/1584466215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16680a1380 0x7f1668122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 >> 172.21.15.125:0/1584466215 conn(0x7f16680a6610 msgr2=0x7f16680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 shutdown_connections 2023-10-03T10:17:03.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:03.841+0000 7f166d17e700 1 -- 172.21.15.125:0/1584466215 wait complete. 2023-10-03T10:17:03.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:03.898 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:03.943 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:04.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.024+0000 7f25104e1700 1 Processor -- start 2023-10-03T10:17:04.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.024+0000 7f25104e1700 1 -- start start 2023-10-03T10:17:04.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.024+0000 7f25104e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.024+0000 7f25104e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f25104e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250809dc00 con 0x7f2508133f50 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f25104e1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250809ea60 con 0x7f25080a1380 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f25104e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f250809dec0 con 0x7f25080a0a70 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250da7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250da7c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57326/0 (socket says 172.21.15.125:57326) 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250ea7e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2508133f50 0x7f250813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51776/0 (socket says 172.21.15.125:51776) 2023-10-03T10:17:04.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250da7c700 1 -- 172.21.15.125:0/357219673 learned_addr learned my addr 172.21.15.125:0/357219673 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 -- 172.21.15.125:0/357219673 >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 msgr2=0x7f2508133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 --2- 172.21.15.125:0/357219673 >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 -- 172.21.15.125:0/357219673 >> v1:172.21.15.125:6789/0 conn(0x7f2508133f50 legacy=0x7f250813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 -- 172.21.15.125:0/357219673 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250809e6a0 con 0x7f25080a0a70 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250da7c700 1 --2- 172.21.15.125:0/357219673 >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250e27d700 1 --2- 172.21.15.125:0/357219673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25080a0e40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2504009840 tx=0x7f2504009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7764c6511568de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250d27b700 1 -- 172.21.15.125:0/357219673 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011830 con 0x7f25080a0a70 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250d27b700 1 -- 172.21.15.125:0/357219673 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504011990 con 0x7f25080a0a70 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.025+0000 7f250d27b700 1 -- 172.21.15.125:0/357219673 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011d20 con 0x7f25080a0a70 2023-10-03T10:17:04.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 -- 172.21.15.125:0/357219673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 msgr2=0x7f25080a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 --2- 172.21.15.125:0/357219673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25080a0e40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2504009840 tx=0x7f2504009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 -- 172.21.15.125:0/357219673 shutdown_connections 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 --2- 172.21.15.125:0/357219673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25080a0e40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 --2- 172.21.15.125:0/357219673 >> v2:172.21.15.125:3300/0 conn(0x7f25080a1380 0x7f2508133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 -- 172.21.15.125:0/357219673 >> 172.21.15.125:0/357219673 conn(0x7f25080a6610 msgr2=0x7f25080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 -- 172.21.15.125:0/357219673 shutdown_connections 2023-10-03T10:17:04.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.026+0000 7f25104e1700 1 -- 172.21.15.125:0/357219673 wait complete. 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 Processor -- start 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 -- start start 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 0x7f25081c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508133f50 0x7f25081c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25081247f0 con 0x7f25080a1380 2023-10-03T10:17:04.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2508124600 con 0x7f2508133f50 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f25104e1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25081252e0 con 0x7f25080a0a70 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f250e27d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f250e27d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59636/0 (socket says 172.21.15.125:59636) 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f250e27d700 1 -- 172.21.15.125:0/3388594943 learned_addr learned my addr 172.21.15.125:0/3388594943 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.027+0000 7f250da7c700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 0x7f25081c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250ea7e700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508133f50 0x7f25081c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 -- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508133f50 msgr2=0x7f25081c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508133f50 0x7f25081c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 -- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 msgr2=0x7f25081c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 0x7f25081c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 -- 172.21.15.125:0/3388594943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8009550 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250da7c700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 0x7f25081c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f250e27d700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f25040090b0 tx=0x7f2504004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040036a0 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250401f070 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25040094a0 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504003a60 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.028+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508126230 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.029+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2504003bc0 con 0x7f25080a0a70 2023-10-03T10:17:04.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.029+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2504021070 con 0x7f25080a0a70 2023-10-03T10:17:04.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.029+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2508133a10 con 0x7f25080a0a70 2023-10-03T10:17:04.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.034+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2504015020 con 0x7f25080a0a70 2023-10-03T10:17:04.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 Processor -- start 2023-10-03T10:17:04.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 -- start start 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 0x7ff5f8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f809b110 con 0x7ff5f809ad40 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80a3b60 con 0x7ff5f8134140 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.068+0000 7ff5fde5a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80a1a80 con 0x7ff5f81345a0 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 0x7ff5f8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff5f809ad40 0x7ff5f8133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51792/0 (socket says 172.21.15.125:51792) 2023-10-03T10:17:04.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f77fe700 1 -- 172.21.15.125:0/3474364333 learned_addr learned my addr 172.21.15.125:0/3474364333 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 -- 172.21.15.125:0/3474364333 >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 msgr2=0x7ff5f8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 --2- 172.21.15.125:0/3474364333 >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 0x7ff5f8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 -- 172.21.15.125:0/3474364333 >> v1:172.21.15.125:6789/0 conn(0x7ff5f809ad40 legacy=0x7ff5f8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 -- 172.21.15.125:0/3474364333 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80a2fa0 con 0x7ff5f81345a0 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f67fc700 1 -- 172.21.15.125:0/3474364333 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206757039 0 0) 0x7ff5f809b110 con 0x7ff5f809ad40 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f6ffd700 1 --2- 172.21.15.125:0/3474364333 >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 0x7ff5f8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f7fff700 1 --2- 172.21.15.125:0/3474364333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f813b3d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009840 tx=0x7ff5f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a48f0b2cc764c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f67fc700 1 -- 172.21.15.125:0/3474364333 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0011830 con 0x7ff5f81345a0 2023-10-03T10:17:04.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f67fc700 1 -- 172.21.15.125:0/3474364333 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0011990 con 0x7ff5f81345a0 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.069+0000 7ff5f67fc700 1 -- 172.21.15.125:0/3474364333 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0011d20 con 0x7ff5f81345a0 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 -- 172.21.15.125:0/3474364333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 msgr2=0x7ff5f813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/3474364333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f813b3d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009840 tx=0x7ff5f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 -- 172.21.15.125:0/3474364333 shutdown_connections 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/3474364333 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f813b3d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/3474364333 >> v2:172.21.15.125:3300/0 conn(0x7ff5f8134140 0x7ff5f8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 -- 172.21.15.125:0/3474364333 >> 172.21.15.125:0/3474364333 conn(0x7ff5f8099c40 msgr2=0x7ff5f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 -- 172.21.15.125:0/3474364333 shutdown_connections 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.070+0000 7ff5fde5a700 1 -- 172.21.15.125:0/3474364333 wait complete. 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 Processor -- start 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 -- start start 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f8134140 0x7ff5f811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f811df30 con 0x7ff5f809ad40 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80a4430 con 0x7ff5f8134140 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.071+0000 7ff5fde5a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f811e6d0 con 0x7ff5f81345a0 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57360/0 (socket says 172.21.15.125:57360) 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 -- 172.21.15.125:0/4182735880 learned_addr learned my addr 172.21.15.125:0/4182735880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59658/0 (socket says 172.21.15.125:59658) 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 -- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 msgr2=0x7ff5f811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 -- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f8134140 msgr2=0x7ff5f811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f8134140 0x7ff5f811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 -- 172.21.15.125:0/4182735880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0094a0 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5f77fe700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800cc10 tx=0x7ff5e800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800ab10 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800ac70 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f00094a0 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80070d0 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.072+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f811da20 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.073+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5e8007230 con 0x7ff5f809ad40 2023-10-03T10:17:04.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.073+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5e803f5c0 con 0x7ff5f809ad40 2023-10-03T10:17:04.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.073+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f81361e0 con 0x7ff5f809ad40 2023-10-03T10:17:04.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.078+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5e8018020 con 0x7ff5f809ad40 2023-10-03T10:17:04.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.226+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f250804f2a0 con 0x7f25080a0a70 2023-10-03T10:17:04.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.226+0000 7f24feffd700 1 -- 172.21.15.125:0/3388594943 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f250401a430 con 0x7f25080a0a70 2023-10-03T10:17:04.228 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 msgr2=0x7f25081c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f25040090b0 tx=0x7f2504004750 comp rx=0 tx=0).stop 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 shutdown_connections 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2508133f50 0x7f25081c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25080a0a70 0x7f25081c8200 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 --2- 172.21.15.125:0/3388594943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25080a1380 0x7f25081c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 >> 172.21.15.125:0/3388594943 conn(0x7f25080a6610 msgr2=0x7f25080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 shutdown_connections 2023-10-03T10:17:04.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.228+0000 7f25104e1700 1 -- 172.21.15.125:0/3388594943 wait complete. 2023-10-03T10:17:04.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:04.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.269+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5f804f2a0 con 0x7ff5f809ad40 2023-10-03T10:17:04.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.269+0000 7ff5dffff700 1 -- 172.21.15.125:0/4182735880 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5e801a8b0 con 0x7ff5f809ad40 2023-10-03T10:17:04.270 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:04.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 msgr2=0x7ff5f811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800cc10 tx=0x7ff5e800cf20 comp rx=0 tx=0).stop 2023-10-03T10:17:04.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 shutdown_connections 2023-10-03T10:17:04.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff5f81345a0 0x7ff5f811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5f809ad40 0x7ff5f811c8c0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 --2- 172.21.15.125:0/4182735880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5f8134140 0x7ff5f811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 >> 172.21.15.125:0/4182735880 conn(0x7ff5f8099c40 msgr2=0x7ff5f813b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 shutdown_connections 2023-10-03T10:17:04.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.271+0000 7ff5fde5a700 1 -- 172.21.15.125:0/4182735880 wait complete. 2023-10-03T10:17:04.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:04.814 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:04.854 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:04.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.941+0000 7f345fac7700 1 Processor -- start 2023-10-03T10:17:04.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.941+0000 7f345fac7700 1 -- start start 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345fac7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345fac7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34580a1380 0x7f3458133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345fac7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345809dc00 con 0x7f3458133f50 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345fac7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345809ea60 con 0x7f34580a1380 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345fac7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345809dec0 con 0x7f34580a0a70 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34580a1380 0x7f3458133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d863700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34580a1380 0x7f3458133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57368/0 (socket says 172.21.15.125:57368) 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d863700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:56164/0 (socket says 172.21.15.125:56164) 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 -- 172.21.15.125:0/2644200175 learned_addr learned my addr 172.21.15.125:0/2644200175 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345e064700 1 --1- 172.21.15.125:0/2644200175 >> v1:172.21.15.125:6789/0 conn(0x7f3458133f50 0x7f345813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51794/0 (socket says 172.21.15.125:51794) 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 -- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 msgr2=0x7f34580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 -- 172.21.15.125:0/2644200175 >> v1:172.21.15.125:6789/0 conn(0x7f3458133f50 legacy=0x7f345813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 -- 172.21.15.125:0/2644200175 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345809e6a0 con 0x7f34580a1380 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345c861700 1 -- 172.21.15.125:0/2644200175 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490222593 0 0) 0x7f345809dc00 con 0x7f3458133f50 2023-10-03T10:17:04.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d863700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.942+0000 7f345d062700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458133a10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f34480098f0 tx=0x7f3448009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675884c62b89657c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345c861700 1 -- 172.21.15.125:0/2644200175 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011830 con 0x7f34580a1380 2023-10-03T10:17:04.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345c861700 1 -- 172.21.15.125:0/2644200175 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448011990 con 0x7f34580a1380 2023-10-03T10:17:04.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345c861700 1 -- 172.21.15.125:0/2644200175 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011d20 con 0x7f34580a1380 2023-10-03T10:17:04.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 -- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 msgr2=0x7f3458133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458133a10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f34480098f0 tx=0x7f3448009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:04.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 -- 172.21.15.125:0/2644200175 shutdown_connections 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34580a0a70 0x7f34580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 --2- 172.21.15.125:0/2644200175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458133a10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 -- 172.21.15.125:0/2644200175 >> 172.21.15.125:0/2644200175 conn(0x7f34580a6610 msgr2=0x7f34580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 -- 172.21.15.125:0/2644200175 shutdown_connections 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.943+0000 7f345fac7700 1 -- 172.21.15.125:0/2644200175 wait complete. 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.944+0000 7f345fac7700 1 Processor -- start 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.944+0000 7f345fac7700 1 -- start start 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3458133f50 0x7f3458123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458126220 con 0x7f34580a1380 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3458133960 con 0x7f3458133f50 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3458133420 con 0x7f34580a0a70 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d863700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57380/0 (socket says 172.21.15.125:57380) 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d863700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59670/0 (socket says 172.21.15.125:59670) 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 -- 172.21.15.125:0/1862683730 learned_addr learned my addr 172.21.15.125:0/1862683730 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345e064700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3458133f50 0x7f3458123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 -- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 msgr2=0x7f3458122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 -- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3458133f50 msgr2=0x7f3458123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3458133f50 0x7f3458123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 -- 172.21.15.125:0/1862683730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540094a0 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d863700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345d062700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3448009c40 tx=0x7f3448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448004300 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344801f070 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34480036a0 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3448009550 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.945+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3458126bb0 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.946+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3448021030 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.946+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345804f2a0 con 0x7f34580a1380 2023-10-03T10:17:04.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.947+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3448040930 con 0x7f34580a1380 2023-10-03T10:17:04.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.951+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34480199a0 con 0x7f34580a1380 2023-10-03T10:17:04.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 Processor -- start 2023-10-03T10:17:04.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 -- start start 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 0x7f71ec138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 0x7f71ec13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec09e9d0 con 0x7f71ec0a0a70 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec09dc00 con 0x7f71ec0a1550 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71f1f24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec09dec0 con 0x7f71ec139200 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71eb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f71ec0a0a70 0x7f71ec0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51802/0 (socket says 172.21.15.125:51802) 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71eb7fe700 1 -- 172.21.15.125:0/3439811844 learned_addr learned my addr 172.21.15.125:0/3439811844 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 0x7f71ec13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.983+0000 7f71eaffd700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 0x7f71ec138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ebfff700 1 -- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 msgr2=0x7f71ec138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ea7fc700 1 -- 172.21.15.125:0/3439811844 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272406956 0 0) 0x7f71ec09e9d0 con 0x7f71ec0a0a70 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 0x7f71ec138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ebfff700 1 -- 172.21.15.125:0/3439811844 >> v1:172.21.15.125:6789/0 conn(0x7f71ec0a0a70 legacy=0x7f71ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ebfff700 1 -- 172.21.15.125:0/3439811844 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec09e6a0 con 0x7f71ec139200 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71eaffd700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 0x7f71ec138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 0x7f71ec13b5e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009dc0 tx=0x7f71dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2db9cc1f4bbb39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ea7fc700 1 -- 172.21.15.125:0/3439811844 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00e070 con 0x7f71ec139200 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ea7fc700 1 -- 172.21.15.125:0/3439811844 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00bb20 con 0x7f71ec139200 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71ea7fc700 1 -- 172.21.15.125:0/3439811844 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc012430 con 0x7f71ec139200 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 -- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 msgr2=0x7f71ec13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 0x7f71ec13b5e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009dc0 tx=0x7f71dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 -- 172.21.15.125:0/3439811844 shutdown_connections 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec139200 0x7f71ec13b5e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3439811844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a1550 0x7f71ec138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 -- 172.21.15.125:0/3439811844 >> 172.21.15.125:0/3439811844 conn(0x7f71ec0a6610 msgr2=0x7f71ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.984+0000 7f71f1f24700 1 -- 172.21.15.125:0/3439811844 shutdown_connections 2023-10-03T10:17:04.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.985+0000 7f71f1f24700 1 -- 172.21.15.125:0/3439811844 wait complete. 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.985+0000 7f71f1f24700 1 Processor -- start 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 -- start start 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a0a70 0x7f71ec1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec122620 con 0x7f71ec139200 2023-10-03T10:17:04.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec123da0 con 0x7f71ec0a0a70 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71f1f24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec09c510 con 0x7f71ec0a1550 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:59682/0 (socket says 172.21.15.125:59682) 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71eaffd700 1 -- 172.21.15.125:0/3026009350 learned_addr learned my addr 172.21.15.125:0/3026009350 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57386/0 (socket says 172.21.15.125:57386) 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71eb7fe700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a0a70 0x7f71ec1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 -- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 msgr2=0x7f71ec1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 -- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a0a70 msgr2=0x7f71ec1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a0a70 0x7f71ec1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71ebfff700 1 -- 172.21.15.125:0/3026009350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40094a0 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.986+0000 7f71eaffd700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71ebfff700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f71dc016000 tx=0x7f71dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc012430 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc020070 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc004280 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc009a70 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.987+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec1243b0 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.988+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71dc0043e0 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.988+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec123fc0 con 0x7f71ec139200 2023-10-03T10:17:04.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.988+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71dc022070 con 0x7f71ec139200 2023-10-03T10:17:04.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:04.992+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71dc004690 con 0x7f71ec139200 2023-10-03T10:17:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.147+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3458072980 con 0x7f34580a1380 2023-10-03T10:17:05.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.147+0000 7f344e7fc700 1 -- 172.21.15.125:0/1862683730 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3448015030 con 0x7f34580a1380 2023-10-03T10:17:05.148 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 msgr2=0x7f3458122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3448009c40 tx=0x7f3448004750 comp rx=0 tx=0).stop 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 shutdown_connections 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3458133f50 0x7f3458123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f34580a0a70 0x7f3458122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 --2- 172.21.15.125:0/1862683730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34580a1380 0x7f3458122e40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 >> 172.21.15.125:0/1862683730 conn(0x7f34580a6610 msgr2=0x7f34580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 shutdown_connections 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.149+0000 7f345fac7700 1 -- 172.21.15.125:0/1862683730 wait complete. 2023-10-03T10:17:05.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.186+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71ec04f2a0 con 0x7f71ec139200 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.186+0000 7f71e3fff700 1 -- 172.21.15.125:0/3026009350 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71dc0303a0 con 0x7f71ec139200 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 msgr2=0x7f71ec120890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f71dc016000 tx=0x7f71dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 shutdown_connections 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71ec139200 0x7f71ec120890 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71ec0a0a70 0x7f71ec1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 --2- 172.21.15.125:0/3026009350 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71ec0a1550 0x7f71ec1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 >> 172.21.15.125:0/3026009350 conn(0x7f71ec0a6610 msgr2=0x7f71ec136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 shutdown_connections 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.188+0000 7f71f1f24700 1 -- 172.21.15.125:0/3026009350 wait complete. 2023-10-03T10:17:05.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:05.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:05.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.369+0000 7fd328c70700 1 Processor -- start 2023-10-03T10:17:05.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.369+0000 7fd328c70700 1 -- start start 2023-10-03T10:17:05.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd328c70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd328c70700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd328c70700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32409dc00 con 0x7fd324133f50 2023-10-03T10:17:05.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd328c70700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32409ea60 con 0x7fd3240a1380 2023-10-03T10:17:05.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd328c70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd32409dec0 con 0x7fd3240a0a70 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd321d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd32259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd32259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51122/0 (socket says 172.21.15.125:51122) 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd321d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40298/0 (socket says 172.21.15.125:40298) 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd322d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd324133f50 0x7fd32413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58984/0 (socket says 172.21.15.125:58984) 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.370+0000 7fd32259c700 1 -- 172.21.15.125:0/1106390131 learned_addr learned my addr 172.21.15.125:0/1106390131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32259c700 1 -- 172.21.15.125:0/1106390131 >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 msgr2=0x7fd324133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32259c700 1 --2- 172.21.15.125:0/1106390131 >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32259c700 1 -- 172.21.15.125:0/1106390131 >> v1:172.21.15.125:6789/0 conn(0x7fd324133f50 legacy=0x7fd32413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32259c700 1 -- 172.21.15.125:0/1106390131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32409e6a0 con 0x7fd3240a0a70 2023-10-03T10:17:05.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd321d9b700 1 --2- 172.21.15.125:0/1106390131 >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32259c700 1 --2- 172.21.15.125:0/1106390131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098f0 tx=0x7fd314009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93acab6c0ba4343d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32159a700 1 -- 172.21.15.125:0/1106390131 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011830 con 0x7fd3240a0a70 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32159a700 1 -- 172.21.15.125:0/1106390131 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314011990 con 0x7fd3240a0a70 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd32159a700 1 -- 172.21.15.125:0/1106390131 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011d20 con 0x7fd3240a0a70 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd328c70700 1 -- 172.21.15.125:0/1106390131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 msgr2=0x7fd3240a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.371+0000 7fd328c70700 1 --2- 172.21.15.125:0/1106390131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098f0 tx=0x7fd314009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 -- 172.21.15.125:0/1106390131 shutdown_connections 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 --2- 172.21.15.125:0/1106390131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3240a0e40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 --2- 172.21.15.125:0/1106390131 >> v2:172.21.15.125:3300/0 conn(0x7fd3240a1380 0x7fd324133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 -- 172.21.15.125:0/1106390131 >> 172.21.15.125:0/1106390131 conn(0x7fd3240a6610 msgr2=0x7fd3240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 -- 172.21.15.125:0/1106390131 shutdown_connections 2023-10-03T10:17:05.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.372+0000 7fd328c70700 1 -- 172.21.15.125:0/1106390131 wait complete. 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 Processor -- start 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 -- start start 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3240a1380 0x7fd3241c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd324133f50 0x7fd3241c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241247f0 con 0x7fd324133f50 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324124600 con 0x7fd3240a1380 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd328c70700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241252e0 con 0x7fd3240a0a70 2023-10-03T10:17:05.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51134/0 (socket says 172.21.15.125:51134) 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 -- 172.21.15.125:0/1780662323 learned_addr learned my addr 172.21.15.125:0/1780662323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd321d9b700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3240a1380 0x7fd3241c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd322d9d700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd324133f50 0x7fd3241c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 -- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3240a1380 msgr2=0x7fd3241c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3240a1380 0x7fd3241c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 -- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd324133f50 msgr2=0x7fd3241c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd324133f50 0x7fd3241c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.373+0000 7fd32259c700 1 -- 172.21.15.125:0/1780662323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180094a0 con 0x7fd3240a0a70 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd32259c700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd314009c40 tx=0x7fd314004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314004400 con 0x7fd3240a0a70 2023-10-03T10:17:05.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31401f070 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314009550 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140038e0 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.374+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd324126230 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.375+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd314021030 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.375+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32404f2a0 con 0x7fd3240a0a70 2023-10-03T10:17:05.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.375+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd314040b50 con 0x7fd3240a0a70 2023-10-03T10:17:05.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.379+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd31400b9d0 con 0x7fd3240a0a70 2023-10-03T10:17:05.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.412+0000 7fcba0d1d700 1 Processor -- start 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.412+0000 7fcba0d1d700 1 -- start start 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcba0d1d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb9c09e870 0x7fcb9c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcba0d1d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 0x7fcb9c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcba0d1d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c09c970 con 0x7fcb9c131d70 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcba0d1d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c0a0920 con 0x7fcb9c09e870 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcba0d1d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c09f9c0 con 0x7fcb9c09f180 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb9c09e870 0x7fcb9c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcb9c131d70 0x7fcb9c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59000/0 (socket says 172.21.15.125:59000) 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb99d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 0x7fcb9c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9ad9d700 1 -- 172.21.15.125:0/1714380776 learned_addr learned my addr 172.21.15.125:0/1714380776 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 -- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 msgr2=0x7fcb9c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 0x7fcb9c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 -- 172.21.15.125:0/1714380776 >> v1:172.21.15.125:6789/0 conn(0x7fcb9c131d70 legacy=0x7fcb9c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 -- 172.21.15.125:0/1714380776 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c09bab0 con 0x7fcb9c09e870 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb99d9b700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 0x7fcb9c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9959a700 1 -- 172.21.15.125:0/1714380776 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139039599 0 0) 0x7fcb9c09c970 con 0x7fcb9c131d70 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.413+0000 7fcb9a59c700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09e870 0x7fcb9c09ec40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009840 tx=0x7fcb8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d6cee891f971cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcb9959a700 1 -- 172.21.15.125:0/1714380776 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011830 con 0x7fcb9c09e870 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcb9959a700 1 -- 172.21.15.125:0/1714380776 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c011990 con 0x7fcb9c09e870 2023-10-03T10:17:05.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcb9959a700 1 -- 172.21.15.125:0/1714380776 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011d20 con 0x7fcb9c09e870 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 -- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09e870 msgr2=0x7fcb9c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09e870 0x7fcb9c09ec40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009840 tx=0x7fcb8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 -- 172.21.15.125:0/1714380776 shutdown_connections 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09e870 0x7fcb9c09ec40 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/1714380776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c09f180 0x7fcb9c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 -- 172.21.15.125:0/1714380776 >> 172.21.15.125:0/1714380776 conn(0x7fcb9c0a4430 msgr2=0x7fcb9c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 -- 172.21.15.125:0/1714380776 shutdown_connections 2023-10-03T10:17:05.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.414+0000 7fcba0d1d700 1 -- 172.21.15.125:0/1714380776 wait complete. 2023-10-03T10:17:05.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.415+0000 7fcba0d1d700 1 Processor -- start 2023-10-03T10:17:05.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.415+0000 7fcba0d1d700 1 -- start start 2023-10-03T10:17:05.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb9c09e870 0x7fcb9c11f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c131d70 0x7fcb9c11fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1205b0 con 0x7fcb9c09f180 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c122b90 con 0x7fcb9c131d70 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcba0d1d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c122680 con 0x7fcb9c09e870 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb9ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c131d70 0x7fcb9c11fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40336/0 (socket says 172.21.15.125:40336) 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 -- 172.21.15.125:0/698391400 learned_addr learned my addr 172.21.15.125:0/698391400 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb9a59c700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb9c09e870 0x7fcb9c11f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 -- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb9c09e870 msgr2=0x7fcb9c11f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb9c09e870 0x7fcb9c11f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 -- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c131d70 msgr2=0x7fcb9c11fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c131d70 0x7fcb9c11fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 -- 172.21.15.125:0/698391400 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900094a0 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.416+0000 7fcb99d9b700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ec10 tx=0x7fcb9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000c850 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000c9b0 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000cd20 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0094a0 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c09dba0 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb90013470 con 0x7fcb9c09f180 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.417+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c11be60 con 0x7fcb9c09f180 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.418+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb9003f7f0 con 0x7fcb9c09f180 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.422+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb90013720 con 0x7fcb9c09f180 2023-10-03T10:17:05.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.574+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd324124b70 con 0x7fd3240a0a70 2023-10-03T10:17:05.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.574+0000 7fd312ffd700 1 -- 172.21.15.125:0/1780662323 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd314015070 con 0x7fd3240a0a70 2023-10-03T10:17:05.575 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 msgr2=0x7fd3241c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd314009c40 tx=0x7fd314004750 comp rx=0 tx=0).stop 2023-10-03T10:17:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 shutdown_connections 2023-10-03T10:17:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd324133f50 0x7fd3241c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3240a0a70 0x7fd3241c8200 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 --2- 172.21.15.125:0/1780662323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3240a1380 0x7fd3241c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 >> 172.21.15.125:0/1780662323 conn(0x7fd3240a6610 msgr2=0x7fd3240a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 shutdown_connections 2023-10-03T10:17:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.576+0000 7fd328c70700 1 -- 172.21.15.125:0/1780662323 wait complete. 2023-10-03T10:17:05.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.615+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb9c04f2a0 con 0x7fcb9c09f180 2023-10-03T10:17:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.616+0000 7fcb8affd700 1 -- 172.21.15.125:0/698391400 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb9001bb60 con 0x7fcb9c09f180 2023-10-03T10:17:05.616 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.617+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 msgr2=0x7fcb9c11f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ec10 tx=0x7fcb9000ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 shutdown_connections 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb9c131d70 0x7fcb9c11fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb9c09e870 0x7fcb9c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 --2- 172.21.15.125:0/698391400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb9c09f180 0x7fcb9c11f640 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 >> 172.21.15.125:0/698391400 conn(0x7fcb9c0a4430 msgr2=0x7fcb9c131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 shutdown_connections 2023-10-03T10:17:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:05.618+0000 7fcba0d1d700 1 -- 172.21.15.125:0/698391400 wait complete. 2023-10-03T10:17:05.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:06.162 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:06.202 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 Processor -- start 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 -- start start 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33ec0a0a70 0x7f33ec0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0a3b60 con 0x7f33ec0a0a70 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1348e0 con 0x7f33ec133f70 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.295+0000 7f33f1c62700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec09b110 con 0x7f33ec09ad40 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45092/0 (socket says 172.21.15.125:45092) 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51144/0 (socket says 172.21.15.125:51144) 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eaffd700 1 -- 172.21.15.125:0/3542255078 learned_addr learned my addr 172.21.15.125:0/3542255078 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 --2- 172.21.15.125:0/3542255078 >> v2:172.21.15.125:3300/0 conn(0x7f33ec0a0a70 0x7f33ec0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 -- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 msgr2=0x7f33ec133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 -- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 msgr2=0x7f33ec1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 -- 172.21.15.125:0/3542255078 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0a2fa0 con 0x7f33ec0a0a70 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eaffd700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33eb7fe700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ebfff700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec0a0ef0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae73ff70c94169cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ea7fc700 1 -- 172.21.15.125:0/3542255078 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011830 con 0x7f33ec0a0a70 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ea7fc700 1 -- 172.21.15.125:0/3542255078 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4011990 con 0x7f33ec0a0a70 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.296+0000 7f33ea7fc700 1 -- 172.21.15.125:0/3542255078 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011d20 con 0x7f33ec0a0a70 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 -- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 msgr2=0x7f33ec0a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec0a0ef0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 -- 172.21.15.125:0/3542255078 shutdown_connections 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec0a0ef0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 --2- 172.21.15.125:0/3542255078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 -- 172.21.15.125:0/3542255078 >> 172.21.15.125:0/3542255078 conn(0x7f33ec099c40 msgr2=0x7f33ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 -- 172.21.15.125:0/3542255078 shutdown_connections 2023-10-03T10:17:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.297+0000 7f33f1c62700 1 -- 172.21.15.125:0/3542255078 wait complete. 2023-10-03T10:17:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.298+0000 7f33f1c62700 1 Processor -- start 2023-10-03T10:17:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.298+0000 7f33f1c62700 1 -- start start 2023-10-03T10:17:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec1c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec121460 con 0x7f33ec0a0a70 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec09c7e0 con 0x7f33ec133f70 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec11f750 con 0x7f33ec09ad40 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40362/0 (socket says 172.21.15.125:40362) 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec1c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eaffd700 1 -- 172.21.15.125:0/2571663234 learned_addr learned my addr 172.21.15.125:0/2571663234 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 -- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 msgr2=0x7f33ec1c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec1c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 -- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 msgr2=0x7f33ec1c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 -- 172.21.15.125:0/2571663234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a70 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eaffd700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33eb7fe700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec1c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33ebfff700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1c8d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f33e4016000 tx=0x7f33e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004240 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e401f070 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40045a0 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.299+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e0009550 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.300+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40094a0 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.300+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec04f2a0 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.301+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e4021030 con 0x7f33ec133f70 2023-10-03T10:17:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.301+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33e4040990 con 0x7f33ec133f70 2023-10-03T10:17:06.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.310+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e40036a0 con 0x7f33ec133f70 2023-10-03T10:17:06.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.335+0000 7fb55e141700 1 Processor -- start 2023-10-03T10:17:06.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.335+0000 7fb55e141700 1 -- start start 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb55e141700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb55e141700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5581343a0 0x7fb5580a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb55e141700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55809b110 con 0x7fb558133f70 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb55e141700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580a3b60 con 0x7fb5581343a0 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb55e141700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580a2fa0 con 0x7fb55809ad40 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5581343a0 0x7fb5580a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb556ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb558133f70 0x7fb5580a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59008/0 (socket says 172.21.15.125:59008) 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45112/0 (socket says 172.21.15.125:45112) 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb556ffd700 1 -- 172.21.15.125:0/3254392121 learned_addr learned my addr 172.21.15.125:0/3254392121 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb5581343a0 0x7fb5580a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40364/0 (socket says 172.21.15.125:40364) 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 -- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 msgr2=0x7fb558133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 -- 172.21.15.125:0/3254392121 >> v1:172.21.15.125:6789/0 conn(0x7fb558133f70 legacy=0x7fb5580a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb557fff700 1 -- 172.21.15.125:0/3254392121 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55809a280 con 0x7fb5581343a0 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb5567fc700 1 -- 172.21.15.125:0/3254392121 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319449163 0 0) 0x7fb55809b110 con 0x7fb558133f70 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.336+0000 7fb5577fe700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb557fff700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5581343a0 0x7fb5580a1180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffd361751e1125a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb5567fc700 1 -- 172.21.15.125:0/3254392121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e070 con 0x7fb5581343a0 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb5567fc700 1 -- 172.21.15.125:0/3254392121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000bb20 con 0x7fb5581343a0 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb5567fc700 1 -- 172.21.15.125:0/3254392121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550012430 con 0x7fb5581343a0 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 -- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5581343a0 msgr2=0x7fb5580a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5581343a0 0x7fb5580a1180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 -- 172.21.15.125:0/3254392121 shutdown_connections 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5581343a0 0x7fb5580a1180 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 --2- 172.21.15.125:0/3254392121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb55809ad40 0x7fb558133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 -- 172.21.15.125:0/3254392121 >> 172.21.15.125:0/3254392121 conn(0x7fb558099c40 msgr2=0x7fb55806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 -- 172.21.15.125:0/3254392121 shutdown_connections 2023-10-03T10:17:06.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.337+0000 7fb55e141700 1 -- 172.21.15.125:0/3254392121 wait complete. 2023-10-03T10:17:06.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.338+0000 7fb55e141700 1 Processor -- start 2023-10-03T10:17:06.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 -- start start 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5581343a0 0x7fb5581c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55811efd0 con 0x7fb55809ad40 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558120730 con 0x7fb558133f70 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb55e141700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb558122740 con 0x7fb5581343a0 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb556ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40372/0 (socket says 172.21.15.125:40372) 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb5577fe700 1 -- 172.21.15.125:0/2249483562 learned_addr learned my addr 172.21.15.125:0/2249483562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb556ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45118/0 (socket says 172.21.15.125:45118) 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb557fff700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5581343a0 0x7fb5581c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.339+0000 7fb556ffd700 1 -- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5581343a0 msgr2=0x7fb5581c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb556ffd700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5581343a0 0x7fb5581c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb556ffd700 1 -- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 msgr2=0x7fb5581c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb556ffd700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb556ffd700 1 -- 172.21.15.125:0/2249483562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480094a0 con 0x7fb558133f70 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb5577fe700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb556ffd700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb55806bec0 tx=0x7fb54c00c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004c80 con 0x7fb558133f70 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c004de0 con 0x7fb558133f70 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007310 con 0x7fb558133f70 2023-10-03T10:17:06.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb550009a70 con 0x7fb558133f70 2023-10-03T10:17:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.340+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558120f20 con 0x7fb558133f70 2023-10-03T10:17:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.341+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb54c007470 con 0x7fb558133f70 2023-10-03T10:17:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.341+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb54c03f1a0 con 0x7fb558133f70 2023-10-03T10:17:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.341+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558122580 con 0x7fb558133f70 2023-10-03T10:17:06.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.345+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb558122580 con 0x7fb558133f70 2023-10-03T10:17:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.507+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33ec121020 con 0x7f33ec133f70 2023-10-03T10:17:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.508+0000 7f33d3fff700 1 -- 172.21.15.125:0/2571663234 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e4015030 con 0x7f33ec133f70 2023-10-03T10:17:06.508 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.509+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 msgr2=0x7f33ec1c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1c8d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f33e4016000 tx=0x7f33e4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 shutdown_connections 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33ec133f70 0x7f33ec1c8d10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33ec09ad40 0x7f33ec1c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 --2- 172.21.15.125:0/2571663234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33ec0a0a70 0x7f33ec1c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 >> 172.21.15.125:0/2571663234 conn(0x7f33ec099c40 msgr2=0x7f33ec09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 shutdown_connections 2023-10-03T10:17:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.510+0000 7f33f1c62700 1 -- 172.21.15.125:0/2571663234 wait complete. 2023-10-03T10:17:06.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:06.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.540+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb558122580 con 0x7fb558133f70 2023-10-03T10:17:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.540+0000 7fb53ffff700 1 -- 172.21.15.125:0/2249483562 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb558122580 con 0x7fb558133f70 2023-10-03T10:17:06.541 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:06.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 msgr2=0x7fb5581c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb55806bec0 tx=0x7fb54c00c750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 shutdown_connections 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb5581343a0 0x7fb5581c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb55809ad40 0x7fb5581c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 --2- 172.21.15.125:0/2249483562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb558133f70 0x7fb5581c8660 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 >> 172.21.15.125:0/2249483562 conn(0x7fb558099c40 msgr2=0x7fb5581bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 shutdown_connections 2023-10-03T10:17:06.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.543+0000 7fb55e141700 1 -- 172.21.15.125:0/2249483562 wait complete. 2023-10-03T10:17:06.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:06.590 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:06.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:06.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.722+0000 7f2e2c4d9700 1 Processor -- start 2023-10-03T10:17:06.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.722+0000 7f2e2c4d9700 1 -- start start 2023-10-03T10:17:06.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2c4d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 0x7f2e240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2c4d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 0x7f2e24133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2c4d9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2409dc00 con 0x7f2e24133f50 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2c4d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2409ea60 con 0x7f2e240a0a70 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2c4d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2409dec0 con 0x7f2e240a1380 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e29a74700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 0x7f2e24133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2aa76700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2e24133f50 0x7f2e2413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59024/0 (socket says 172.21.15.125:59024) 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2aa76700 1 -- 172.21.15.125:0/2602596474 learned_addr learned my addr 172.21.15.125:0/2602596474 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.723+0000 7f2e2a275700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 0x7f2e240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29273700 1 -- 172.21.15.125:0/2602596474 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319675386 0 0) 0x7f2e2409dc00 con 0x7f2e24133f50 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29a74700 1 -- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 msgr2=0x7f2e240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29a74700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 0x7f2e240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29a74700 1 -- 172.21.15.125:0/2602596474 >> v1:172.21.15.125:6789/0 conn(0x7f2e24133f50 legacy=0x7f2e2413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29a74700 1 -- 172.21.15.125:0/2602596474 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2409e6a0 con 0x7f2e240a1380 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e2a275700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 0x7f2e240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29a74700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 0x7f2e24133a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009870 tx=0x7f2e14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e02705d0c34c460 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29273700 1 -- 172.21.15.125:0/2602596474 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14011830 con 0x7f2e240a1380 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29273700 1 -- 172.21.15.125:0/2602596474 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14011990 con 0x7f2e240a1380 2023-10-03T10:17:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.724+0000 7f2e29273700 1 -- 172.21.15.125:0/2602596474 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14011d20 con 0x7f2e240a1380 2023-10-03T10:17:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 msgr2=0x7f2e24133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 0x7f2e24133a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009870 tx=0x7f2e14009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/2602596474 shutdown_connections 2023-10-03T10:17:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e240a0a70 0x7f2e240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/2602596474 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a1380 0x7f2e24133a10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/2602596474 >> 172.21.15.125:0/2602596474 conn(0x7f2e240a6610 msgr2=0x7f2e240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/2602596474 shutdown_connections 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.725+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/2602596474 wait complete. 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 Processor -- start 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 -- start start 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a0a70 0x7f2e24122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 0x7f2e24123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24126110 con 0x7f2e240a1380 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24123cf0 con 0x7f2e24133f50 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2c4d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24126360 con 0x7f2e240a0a70 2023-10-03T10:17:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e29a74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e29a74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40382/0 (socket says 172.21.15.125:40382) 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e29a74700 1 -- 172.21.15.125:0/3913277501 learned_addr learned my addr 172.21.15.125:0/3913277501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2aa76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 0x7f2e24123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.726+0000 7f2e2a275700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a0a70 0x7f2e24122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 -- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a0a70 msgr2=0x7f2e24122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a0a70 0x7f2e24122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 -- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 msgr2=0x7f2e24123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 0x7f2e24123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 -- 172.21.15.125:0/3913277501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200094a0 con 0x7f2e240a1380 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e2aa76700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 0x7f2e24123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e29a74700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2e14013000 tx=0x7f2e14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14004590 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1401f070 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e140094a0 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140038c0 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.727+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e240a03e0 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.728+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e14003a20 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.728+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e14021070 con 0x7f2e240a1380 2023-10-03T10:17:06.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.728+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2404f2a0 con 0x7f2e240a1380 2023-10-03T10:17:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.732+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e14015080 con 0x7f2e240a1380 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 Processor -- start 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 -- start start 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 0x7f123c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0a0920 con 0x7f123c131d70 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c09c970 con 0x7f123c09f180 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.766+0000 7f124279f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f123c09bab0 con 0x7f123c09e870 2023-10-03T10:17:06.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f1240d3c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 0x7f123c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51172/0 (socket says 172.21.15.125:51172) 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45138/0 (socket says 172.21.15.125:45138) 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 -- 172.21.15.125:0/46576076 learned_addr learned my addr 172.21.15.125:0/46576076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 -- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 msgr2=0x7f123c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 -- 172.21.15.125:0/46576076 >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 msgr2=0x7f123c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 --2- 172.21.15.125:0/46576076 >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 0x7f123c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 -- 172.21.15.125:0/46576076 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c09f9c0 con 0x7f123c09e870 2023-10-03T10:17:06.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f1240d3c700 1 --2- 172.21.15.125:0/46576076 >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 0x7f123c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123b7fe700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123bfff700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f12300098f0 tx=0x7f1230009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b906ebee86be096c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123affd700 1 -- 172.21.15.125:0/46576076 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011830 con 0x7f123c09e870 2023-10-03T10:17:06.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123affd700 1 -- 172.21.15.125:0/46576076 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230011990 con 0x7f123c09e870 2023-10-03T10:17:06.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.767+0000 7f123affd700 1 -- 172.21.15.125:0/46576076 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011d20 con 0x7f123c09e870 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 -- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 msgr2=0x7f123c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f12300098f0 tx=0x7f1230009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 -- 172.21.15.125:0/46576076 shutdown_connections 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 --2- 172.21.15.125:0/46576076 >> v2:172.21.15.125:3300/0 conn(0x7f123c131d70 0x7f123c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c09ec40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 --2- 172.21.15.125:0/46576076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c09f180 0x7f123c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 -- 172.21.15.125:0/46576076 >> 172.21.15.125:0/46576076 conn(0x7f123c0a4430 msgr2=0x7f123c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 -- 172.21.15.125:0/46576076 shutdown_connections 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.768+0000 7f124279f700 1 -- 172.21.15.125:0/46576076 wait complete. 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 Processor -- start 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 -- start start 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c11f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c120c90 con 0x7f123c09f180 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c122960 con 0x7f123c131d70 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f124279f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f123c121b20 con 0x7f123c09e870 2023-10-03T10:17:06.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f1240d3c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40404/0 (socket says 172.21.15.125:40404) 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f1240d3c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45154/0 (socket says 172.21.15.125:45154) 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.769+0000 7f123b7fe700 1 -- 172.21.15.125:0/861891949 learned_addr learned my addr 172.21.15.125:0/861891949 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f123bfff700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c11f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 -- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 msgr2=0x7f123c11f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c11f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 -- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 msgr2=0x7f123c11f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 -- 172.21.15.125:0/861891949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0094a0 con 0x7f123c131d70 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f123bfff700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c11f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f123b7fe700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1240d3c700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1234009e50 tx=0x7f123400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400ca90 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400f040 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1234009a70 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400ce50 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.770+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1230009550 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.771+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1234014480 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.771+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f123403fcc0 con 0x7f123c131d70 2023-10-03T10:17:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.771+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c11be60 con 0x7f123c131d70 2023-10-03T10:17:06.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.776+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1234012700 con 0x7f123c131d70 2023-10-03T10:17:06.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.927+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e24133360 con 0x7f2e240a1380 2023-10-03T10:17:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.927+0000 7f2e1affd700 1 -- 172.21.15.125:0/3913277501 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e14035090 con 0x7f2e240a1380 2023-10-03T10:17:06.928 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 msgr2=0x7f2e24122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2e14013000 tx=0x7f2e14004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 shutdown_connections 2023-10-03T10:17:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e24133f50 0x7f2e24123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e240a0a70 0x7f2e24122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 --2- 172.21.15.125:0/3913277501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240a1380 0x7f2e24122dd0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 >> 172.21.15.125:0/3913277501 conn(0x7f2e240a6610 msgr2=0x7f2e2409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 shutdown_connections 2023-10-03T10:17:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.930+0000 7f2e2c4d9700 1 -- 172.21.15.125:0/3913277501 wait complete. 2023-10-03T10:17:06.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.970+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f123c0a0210 con 0x7f123c131d70 2023-10-03T10:17:06.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.970+0000 7f1238ff9700 1 -- 172.21.15.125:0/861891949 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1234012340 con 0x7f123c131d70 2023-10-03T10:17:06.969 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:06.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 msgr2=0x7f123c11fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1234009e50 tx=0x7f123400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 shutdown_connections 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f123c131d70 0x7f123c11fba0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f123c09e870 0x7f123c11f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 --2- 172.21.15.125:0/861891949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f123c09f180 0x7f123c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 >> 172.21.15.125:0/861891949 conn(0x7f123c0a4430 msgr2=0x7f123c1310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 shutdown_connections 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:06.972+0000 7f124279f700 1 -- 172.21.15.125:0/861891949 wait complete. 2023-10-03T10:17:06.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:07.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:07.555 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:07.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.652+0000 7fc12aede700 1 Processor -- start 2023-10-03T10:17:07.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.652+0000 7fc12aede700 1 -- start start 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12aede700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12aede700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12aede700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12409b110 con 0x7fc12409ad40 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12aede700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240a3b60 con 0x7fc124134140 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12aede700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240a1a80 con 0x7fc124134570 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12947b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45158/0 (socket says 172.21.15.125:45158) 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc128c7a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc12409ad40 0x7fc124133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59038/0 (socket says 172.21.15.125:59038) 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 -- 172.21.15.125:0/1394612549 learned_addr learned my addr 172.21.15.125:0/1394612549 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12947b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51202/0 (socket says 172.21.15.125:51202) 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 -- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 msgr2=0x7fc12413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc1237fe700 1 -- 172.21.15.125:0/1394612549 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668516846 0 0) 0x7fc12409b110 con 0x7fc12409ad40 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 -- 172.21.15.125:0/1394612549 >> v1:172.21.15.125:6789/0 conn(0x7fc12409ad40 legacy=0x7fc124133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc123fff700 1 -- 172.21.15.125:0/1394612549 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240a2fa0 con 0x7fc124134140 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.653+0000 7fc12947b700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc123fff700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc110009950 tx=0x7fc110009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62e5d2a63177c71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc1237fe700 1 -- 172.21.15.125:0/1394612549 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110011830 con 0x7fc124134140 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc1237fe700 1 -- 172.21.15.125:0/1394612549 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110011990 con 0x7fc124134140 2023-10-03T10:17:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc1237fe700 1 -- 172.21.15.125:0/1394612549 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110011d40 con 0x7fc124134140 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 -- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 msgr2=0x7fc124138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc110009950 tx=0x7fc110009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 -- 172.21.15.125:0/1394612549 shutdown_connections 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc124134570 0x7fc12413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 --2- 172.21.15.125:0/1394612549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc124138e80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 -- 172.21.15.125:0/1394612549 >> 172.21.15.125:0/1394612549 conn(0x7fc124099c40 msgr2=0x7fc12406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 -- 172.21.15.125:0/1394612549 shutdown_connections 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.654+0000 7fc12aede700 1 -- 172.21.15.125:0/1394612549 wait complete. 2023-10-03T10:17:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.655+0000 7fc12aede700 1 Processor -- start 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.655+0000 7fc12aede700 1 -- start start 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc12411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 0x7fc12411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12411ee60 con 0x7fc124134570 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12411f7d0 con 0x7fc124134140 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12aede700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12413a0d0 con 0x7fc12409ad40 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12947b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 0x7fc12411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51216/0 (socket says 172.21.15.125:51216) 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 -- 172.21.15.125:0/3964055227 learned_addr learned my addr 172.21.15.125:0/3964055227 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc123fff700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc12411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 -- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 msgr2=0x7fc12411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc12411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 -- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 msgr2=0x7fc12411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 0x7fc12411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc128c7a700 1 -- 172.21.15.125:0/3964055227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c009a70 con 0x7fc12409ad40 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc123fff700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc12411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.656+0000 7fc12947b700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 0x7fc12411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc128c7a700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c550 tx=0x7fc11800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118004c80 con 0x7fc12409ad40 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118004de0 con 0x7fc12409ad40 2023-10-03T10:17:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118007310 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc110009550 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12409e500 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.657+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc118007470 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.658+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc11803f330 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.658+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1241361e0 con 0x7fc12409ad40 2023-10-03T10:17:07.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.662+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1180123b0 con 0x7fc12409ad40 2023-10-03T10:17:07.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.692+0000 7fed6a5f9700 1 Processor -- start 2023-10-03T10:17:07.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.692+0000 7fed6a5f9700 1 -- start start 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed6a5f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed6a5f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed64139200 0x7fed6413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed6a5f9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6409e9d0 con 0x7fed640a0a70 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed6a5f9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6409dc00 con 0x7fed64139200 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed6a5f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed6409dec0 con 0x7fed640a1550 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed637fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed64139200 0x7fed6413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed637fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51230/0 (socket says 172.21.15.125:51230) 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed637fe700 1 -- 172.21.15.125:0/681777678 learned_addr learned my addr 172.21.15.125:0/681777678 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 -- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 msgr2=0x7fed64138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 -- 172.21.15.125:0/681777678 >> v1:172.21.15.125:6789/0 conn(0x7fed640a0a70 legacy=0x7fed640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 -- 172.21.15.125:0/681777678 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6409e6a0 con 0x7fed64139200 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed637fe700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed62ffd700 1 -- 172.21.15.125:0/681777678 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868571778 0 0) 0x7fed6409e9d0 con 0x7fed640a0a70 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.693+0000 7fed68b96700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed6413b5e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009d90 tx=0x7fed5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8138f79b816f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed62ffd700 1 -- 172.21.15.125:0/681777678 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00e070 con 0x7fed64139200 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed62ffd700 1 -- 172.21.15.125:0/681777678 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c00bb20 con 0x7fed64139200 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed62ffd700 1 -- 172.21.15.125:0/681777678 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c012430 con 0x7fed64139200 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 -- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 msgr2=0x7fed6413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed6413b5e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009d90 tx=0x7fed5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 -- 172.21.15.125:0/681777678 shutdown_connections 2023-10-03T10:17:07.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed6413b5e0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/681777678 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a1550 0x7fed64138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 -- 172.21.15.125:0/681777678 >> 172.21.15.125:0/681777678 conn(0x7fed640a6610 msgr2=0x7fed640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 -- 172.21.15.125:0/681777678 shutdown_connections 2023-10-03T10:17:07.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.694+0000 7fed6a5f9700 1 -- 172.21.15.125:0/681777678 wait complete. 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.695+0000 7fed6a5f9700 1 Processor -- start 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.695+0000 7fed6a5f9700 1 -- start start 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed640a1550 0x7fed64121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed641221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64125280 con 0x7fed64139200 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64123990 con 0x7fed640a1550 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed640a03e0 con 0x7fed640a0a70 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51246/0 (socket says 172.21.15.125:51246) 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 -- 172.21.15.125:0/2636470898 learned_addr learned my addr 172.21.15.125:0/2636470898 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed637fe700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed640a1550 0x7fed64121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed68b96700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed641221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 -- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed640a1550 msgr2=0x7fed64121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed640a1550 0x7fed64121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 -- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 msgr2=0x7fed641221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed641221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 -- 172.21.15.125:0/2636470898 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58009550 con 0x7fed640a0a70 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed63fff700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fed54001eb0 tx=0x7fed5400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540054e0 con 0x7fed640a0a70 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54003680 con 0x7fed640a0a70 2023-10-03T10:17:07.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c009a70 con 0x7fed640a0a70 2023-10-03T10:17:07.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540039f0 con 0x7fed640a0a70 2023-10-03T10:17:07.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.696+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64124ce0 con 0x7fed640a0a70 2023-10-03T10:17:07.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.697+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6404f2a0 con 0x7fed640a0a70 2023-10-03T10:17:07.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.698+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed54003b50 con 0x7fed640a0a70 2023-10-03T10:17:07.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.698+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed5403ef50 con 0x7fed640a0a70 2023-10-03T10:17:07.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.702+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed5401b3b0 con 0x7fed640a0a70 2023-10-03T10:17:07.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.858+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc12404f2a0 con 0x7fc12409ad40 2023-10-03T10:17:07.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.858+0000 7fc1217fa700 1 -- 172.21.15.125:0/3964055227 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc118011360 con 0x7fc12409ad40 2023-10-03T10:17:07.858 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 msgr2=0x7fc12411c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c550 tx=0x7fc11800c860 comp rx=0 tx=0).stop 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 shutdown_connections 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc124134570 0x7fc12411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc12409ad40 0x7fc12411c8c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 --2- 172.21.15.125:0/3964055227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc124134140 0x7fc12411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 >> 172.21.15.125:0/3964055227 conn(0x7fc124099c40 msgr2=0x7fc12413b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 shutdown_connections 2023-10-03T10:17:07.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.860+0000 7fc12aede700 1 -- 172.21.15.125:0/3964055227 wait complete. 2023-10-03T10:17:07.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:07.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.895+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed64072980 con 0x7fed640a0a70 2023-10-03T10:17:07.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.895+0000 7fed60ff9700 1 -- 172.21.15.125:0/2636470898 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed54017030 con 0x7fed640a0a70 2023-10-03T10:17:07.895 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 msgr2=0x7fed64121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fed54001eb0 tx=0x7fed5400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 shutdown_connections 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed64139200 0x7fed641221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed640a0a70 0x7fed64121760 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 --2- 172.21.15.125:0/2636470898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed640a1550 0x7fed64121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 >> 172.21.15.125:0/2636470898 conn(0x7fed640a6610 msgr2=0x7fed640a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 shutdown_connections 2023-10-03T10:17:07.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:07.897+0000 7fed6a5f9700 1 -- 172.21.15.125:0/2636470898 wait complete. 2023-10-03T10:17:07.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:07.943 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:07.983 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.074+0000 7f5c02cdc700 1 Processor -- start 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.074+0000 7f5c02cdc700 1 -- start start 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 0x7f5bfc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bfc09e9d0 con 0x7f5bfc0a0a70 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc09dc00 con 0x7f5bfc133f50 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c02cdc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc09dec0 con 0x7f5bfc0a1380 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c00a78700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c01279700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 0x7f5bfc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51258/0 (socket says 172.21.15.125:51258) 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c00a78700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40446/0 (socket says 172.21.15.125:40446) 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 -- 172.21.15.125:0/428783257 learned_addr learned my addr 172.21.15.125:0/428783257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 -- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 msgr2=0x7f5bfc1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 0x7f5bfc1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 -- 172.21.15.125:0/428783257 >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 msgr2=0x7f5bfc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 --2- 172.21.15.125:0/428783257 >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 -- 172.21.15.125:0/428783257 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc09e6a0 con 0x7f5bfc0a1380 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c00a78700 1 --2- 172.21.15.125:0/428783257 >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5c01279700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 0x7f5bfc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfbfff700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098f0 tx=0x7f5be8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc158546a1715b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfb7fe700 1 -- 172.21.15.125:0/428783257 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8011830 con 0x7f5bfc0a1380 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfb7fe700 1 -- 172.21.15.125:0/428783257 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8011990 con 0x7f5bfc0a1380 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.075+0000 7f5bfb7fe700 1 -- 172.21.15.125:0/428783257 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8011d20 con 0x7f5bfc0a1380 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 -- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 msgr2=0x7f5bfc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098f0 tx=0x7f5be8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 -- 172.21.15.125:0/428783257 shutdown_connections 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc133f50 0x7f5bfc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/428783257 >> v2:172.21.15.125:3300/0 conn(0x7f5bfc0a0a70 0x7f5bfc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/428783257 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc0a1380 0x7f5bfc133a10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 -- 172.21.15.125:0/428783257 >> 172.21.15.125:0/428783257 conn(0x7f5bfc0a6610 msgr2=0x7f5bfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 -- 172.21.15.125:0/428783257 shutdown_connections 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.076+0000 7f5c02cdc700 1 -- 172.21.15.125:0/428783257 wait complete. 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.077+0000 7f5c02cdc700 1 Processor -- start 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.077+0000 7f5c02cdc700 1 -- start start 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 0x7f5bfc1224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc0a1380 0x7f5bfc1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 0x7f5bfc122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1241a0 con 0x7f5bfc0a0a70 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc124eb0 con 0x7f5bfc0a1380 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c02cdc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc125270 con 0x7f5bfc133f50 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c00a78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 0x7f5bfc1224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c01279700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 0x7f5bfc122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c00a78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 0x7f5bfc1224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40454/0 (socket says 172.21.15.125:40454) 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5bfbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc0a1380 0x7f5bfc1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.078+0000 7f5c00a78700 1 -- 172.21.15.125:0/3175798101 learned_addr learned my addr 172.21.15.125:0/3175798101 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 -- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc0a1380 msgr2=0x7f5bfc1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc0a1380 0x7f5bfc1229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 -- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 msgr2=0x7f5bfc1224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 0x7f5bfc1224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 -- 172.21.15.125:0/3175798101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00094a0 con 0x7f5bfc133f50 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c01279700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 0x7f5bfc122f30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009e50 tx=0x7f5bf400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4003a20 con 0x7f5bfc133f50 2023-10-03T10:17:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400f040 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4003de0 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf4009a70 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.079+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8009550 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.080+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bf400ca30 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.080+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc04f2a0 con 0x7f5bfc133f50 2023-10-03T10:17:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.080+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bf403fe90 con 0x7f5bfc133f50 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.085+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bf4014e40 con 0x7f5bfc133f50 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 Processor -- start 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 -- start start 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 0x7f53f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f409e9d0 con 0x7f53f40a0a70 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f409dc00 con 0x7f53f4133f50 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.117+0000 7f53fc6ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f409dec0 con 0x7f53f40a1380 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9c47700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fa448700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 0x7f53f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45198/0 (socket says 172.21.15.125:45198) 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fa448700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 0x7f53f40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40460/0 (socket says 172.21.15.125:40460) 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 -- 172.21.15.125:0/1259846666 learned_addr learned my addr 172.21.15.125:0/1259846666 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9c47700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51272/0 (socket says 172.21.15.125:51272) 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 -- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 msgr2=0x7f53f4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 -- 172.21.15.125:0/1259846666 >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 msgr2=0x7f53f40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 --2- 172.21.15.125:0/1259846666 >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 0x7f53f40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 -- 172.21.15.125:0/1259846666 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f409e6a0 con 0x7f53f4133f50 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9c47700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53fac49700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009e50 tx=0x7f53ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b504ff07e1f5972f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9446700 1 -- 172.21.15.125:0/1259846666 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00e070 con 0x7f53f4133f50 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9446700 1 -- 172.21.15.125:0/1259846666 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec00b910 con 0x7f53f4133f50 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.118+0000 7f53f9446700 1 -- 172.21.15.125:0/1259846666 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00bcc0 con 0x7f53f4133f50 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 msgr2=0x7f53f41343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009e50 tx=0x7f53ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1259846666 shutdown_connections 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f4133f50 0x7f53f41343b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1259846666 >> v2:172.21.15.125:3300/0 conn(0x7f53f40a0a70 0x7f53f40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1259846666 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f40a1380 0x7f53f4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1259846666 >> 172.21.15.125:0/1259846666 conn(0x7f53f40a6610 msgr2=0x7f53f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1259846666 shutdown_connections 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.119+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1259846666 wait complete. 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 Processor -- start 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 -- start start 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f40a0a70 0x7f53f4121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f4133f50 0x7f53f4121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4124e50 con 0x7f53f40a1380 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4123dd0 con 0x7f53f40a0a70 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fc6ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40a03e0 con 0x7f53f4133f50 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53f9c47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53f9c47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40464/0 (socket says 172.21.15.125:40464) 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53f9c47700 1 -- 172.21.15.125:0/1529979980 learned_addr learned my addr 172.21.15.125:0/1529979980 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fa448700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f40a0a70 0x7f53f4121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.120+0000 7f53fac49700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f4133f50 0x7f53f4121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 -- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f4133f50 msgr2=0x7f53f4121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f4133f50 0x7f53f4121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 -- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f40a0a70 msgr2=0x7f53f4121330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f40a0a70 0x7f53f4121330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 -- 172.21.15.125:0/1529979980 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40094a0 con 0x7f53f40a1380 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53f9c47700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f53e400ec10 tx=0x7f53e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400c850 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400c9b0 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec009b30 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400cd20 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.121+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f4122f40 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.122+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53e4013470 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.122+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f411e040 con 0x7f53f40a1380 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.122+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53e403f7f0 con 0x7f53f40a1380 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.127+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53e4013720 con 0x7f53f40a1380 2023-10-03T10:17:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.278+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bfc072980 con 0x7f5bfc133f50 2023-10-03T10:17:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.278+0000 7f5bf97fa700 1 -- 172.21.15.125:0/3175798101 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bf4014e40 con 0x7f5bfc133f50 2023-10-03T10:17:08.278 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 msgr2=0x7f5bfc122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 0x7f5bfc122f30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009e50 tx=0x7f5bf400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 shutdown_connections 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5bfc133f50 0x7f5bfc122f30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bfc0a0a70 0x7f5bfc1224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 --2- 172.21.15.125:0/3175798101 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5bfc0a1380 0x7f5bfc1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 >> 172.21.15.125:0/3175798101 conn(0x7f5bfc0a6610 msgr2=0x7f5bfc09b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 shutdown_connections 2023-10-03T10:17:08.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.280+0000 7f5c02cdc700 1 -- 172.21.15.125:0/3175798101 wait complete. 2023-10-03T10:17:08.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.320+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53f404f2a0 con 0x7f53f40a1380 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.320+0000 7f53eaffd700 1 -- 172.21.15.125:0/1529979980 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53e401bba0 con 0x7f53f40a1380 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:08.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 msgr2=0x7f53f4121870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f53e400ec10 tx=0x7f53e400ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 shutdown_connections 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f53f4133f50 0x7f53f4121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53f40a0a70 0x7f53f4121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 --2- 172.21.15.125:0/1529979980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53f40a1380 0x7f53f4121870 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 >> 172.21.15.125:0/1529979980 conn(0x7f53f40a6610 msgr2=0x7f53f4133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 shutdown_connections 2023-10-03T10:17:08.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:08.322+0000 7f53fc6ac700 1 -- 172.21.15.125:0/1529979980 wait complete. 2023-10-03T10:17:08.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:08.873 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:08.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:09.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.007+0000 7fcb2cdad700 1 Processor -- start 2023-10-03T10:17:09.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.007+0000 7fcb2cdad700 1 -- start start 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb2809ad40 0x7fcb28133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb280a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280a3b60 con 0x7fcb2809ad40 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281348e0 con 0x7fcb280a0a70 2023-10-03T10:17:09.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2cdad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2809b110 con 0x7fcb28133f70 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb2809ad40 0x7fcb28133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb25d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb26d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb280a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb25d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51290/0 (socket says 172.21.15.125:51290) 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb2809ad40 0x7fcb28133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40466/0 (socket says 172.21.15.125:40466) 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb25d9b700 1 -- 172.21.15.125:0/2008905952 learned_addr learned my addr 172.21.15.125:0/2008905952 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2659c700 1 -- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 msgr2=0x7fcb281343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.008+0000 7fcb2659c700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2659c700 1 -- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 msgr2=0x7fcb280a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2659c700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb280a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2659c700 1 -- 172.21.15.125:0/2008905952 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280a2fa0 con 0x7fcb2809ad40 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb25d9b700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb26d9d700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb280a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2659c700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2809ad40 0x7fcb28133a30 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009870 tx=0x7fcb18009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9922fca7ab696930 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2559a700 1 -- 172.21.15.125:0/2008905952 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011830 con 0x7fcb2809ad40 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2559a700 1 -- 172.21.15.125:0/2008905952 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18011990 con 0x7fcb2809ad40 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2559a700 1 -- 172.21.15.125:0/2008905952 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011d20 con 0x7fcb2809ad40 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2cdad700 1 -- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2809ad40 msgr2=0x7fcb28133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.009+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2809ad40 0x7fcb28133a30 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009870 tx=0x7fcb18009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 -- 172.21.15.125:0/2008905952 shutdown_connections 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb280a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2809ad40 0x7fcb28133a30 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/2008905952 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb28133f70 0x7fcb281343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 -- 172.21.15.125:0/2008905952 >> 172.21.15.125:0/2008905952 conn(0x7fcb28099c40 msgr2=0x7fcb2806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 -- 172.21.15.125:0/2008905952 shutdown_connections 2023-10-03T10:17:09.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.010+0000 7fcb2cdad700 1 -- 172.21.15.125:0/2008905952 wait complete. 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 Processor -- start 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 -- start start 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb281228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 0x7fcb28122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28125ca0 con 0x7fcb28133f70 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28125e80 con 0x7fcb280a0a70 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2cdad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28123810 con 0x7fcb2809ad40 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51292/0 (socket says 172.21.15.125:51292) 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb26d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 0x7fcb28122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb2659c700 1 -- 172.21.15.125:0/3311431477 learned_addr learned my addr 172.21.15.125:0/3311431477 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.011+0000 7fcb25d9b700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb281228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 -- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 msgr2=0x7fcb281228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb281228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 -- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 msgr2=0x7fcb28122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 0x7fcb28122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 -- 172.21.15.125:0/3311431477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009a70 con 0x7fcb2809ad40 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb25d9b700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb281228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb26d9d700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 0x7fcb28122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2659c700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009840 tx=0x7fcb18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18004450 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1801e070 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c009550 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180038e0 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.012+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180094a0 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.013+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb18003a40 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.013+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb18040380 con 0x7fcb2809ad40 2023-10-03T10:17:09.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.013+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28125ac0 con 0x7fcb2809ad40 2023-10-03T10:17:09.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.018+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb18015070 con 0x7fcb2809ad40 2023-10-03T10:17:09.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.046+0000 7ff0ad574700 1 Processor -- start 2023-10-03T10:17:09.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.046+0000 7ff0ad574700 1 -- start start 2023-10-03T10:17:09.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.046+0000 7ff0ad574700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.046+0000 7ff0ad574700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0a81343d0 0x7ff0a80a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0ad574700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a809a360 con 0x7ff0a8133fa0 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0ad574700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8067fe0 con 0x7ff0a81343d0 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0ad574700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a809a880 con 0x7ff0a8067c10 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45224/0 (socket says 172.21.15.125:45224) 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0a81343d0 0x7ff0a80a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a6ffd700 1 -- 172.21.15.125:0/3213033256 learned_addr learned my addr 172.21.15.125:0/3213033256 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 -- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 msgr2=0x7ff0a8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 -- 172.21.15.125:0/3213033256 >> v1:172.21.15.125:6789/0 conn(0x7ff0a8133fa0 legacy=0x7ff0a80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 -- 172.21.15.125:0/3213033256 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8099e00 con 0x7ff0a81343d0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a5ffb700 1 -- 172.21.15.125:0/3213033256 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28404470 0 0) 0x7ff0a809a360 con 0x7ff0a8133fa0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a6ffd700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a77fe700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a81343d0 0x7ff0a80a0ff0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395e73696a5d1724 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a5ffb700 1 -- 172.21.15.125:0/3213033256 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000e070 con 0x7ff0a81343d0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a5ffb700 1 -- 172.21.15.125:0/3213033256 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000bb20 con 0x7ff0a81343d0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.047+0000 7ff0a5ffb700 1 -- 172.21.15.125:0/3213033256 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0012430 con 0x7ff0a81343d0 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 -- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a81343d0 msgr2=0x7ff0a80a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a81343d0 0x7ff0a80a0ff0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 -- 172.21.15.125:0/3213033256 shutdown_connections 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a81343d0 0x7ff0a80a0ff0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 --2- 172.21.15.125:0/3213033256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a8067c10 0x7ff0a8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 -- 172.21.15.125:0/3213033256 >> 172.21.15.125:0/3213033256 conn(0x7ff0a80a2980 msgr2=0x7ff0a80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 -- 172.21.15.125:0/3213033256 shutdown_connections 2023-10-03T10:17:09.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.048+0000 7ff0ad574700 1 -- 172.21.15.125:0/3213033256 wait complete. 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.049+0000 7ff0ad574700 1 Processor -- start 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.049+0000 7ff0ad574700 1 -- start start 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0a8133fa0 0x7ff0a81c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a81343d0 0x7ff0a81c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8133000 con 0x7ff0a8067c10 2023-10-03T10:17:09.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a811d380 con 0x7ff0a81343d0 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0ad574700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a811e7d0 con 0x7ff0a8133fa0 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0a6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0a6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40496/0 (socket says 172.21.15.125:40496) 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0a6ffd700 1 -- 172.21.15.125:0/2816592595 learned_addr learned my addr 172.21.15.125:0/2816592595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0a67fc700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0a8133fa0 0x7ff0a81c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.050+0000 7ff0a77fe700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a81343d0 0x7ff0a81c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 -- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0a8133fa0 msgr2=0x7ff0a81c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0a8133fa0 0x7ff0a81c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 -- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a81343d0 msgr2=0x7ff0a81c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a81343d0 0x7ff0a81c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 -- 172.21.15.125:0/2816592595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009550 con 0x7ff0a8067c10 2023-10-03T10:17:09.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0a6ffd700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff09800e9b0 tx=0x7ff09800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800ee50 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800c850 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0009a70 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800cbc0 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.051+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a811c310 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.052+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff09800cd20 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.052+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff09803f530 con 0x7ff0a8067c10 2023-10-03T10:17:09.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.052+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a811c310 con 0x7ff0a8067c10 2023-10-03T10:17:09.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.057+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0a811c310 con 0x7ff0a8067c10 2023-10-03T10:17:09.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.210+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb2804f2a0 con 0x7fcb2809ad40 2023-10-03T10:17:09.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.210+0000 7fcb16ffd700 1 -- 172.21.15.125:0/3311431477 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb18003cf0 con 0x7fcb2809ad40 2023-10-03T10:17:09.210 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 msgr2=0x7fcb281223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009840 tx=0x7fcb18004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 shutdown_connections 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb28133f70 0x7fcb28122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcb2809ad40 0x7fcb281223b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 --2- 172.21.15.125:0/3311431477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb280a0a70 0x7fcb281228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 >> 172.21.15.125:0/3311431477 conn(0x7fcb28099c40 msgr2=0x7fcb280a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 shutdown_connections 2023-10-03T10:17:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.213+0000 7fcb2cdad700 1 -- 172.21.15.125:0/3311431477 wait complete. 2023-10-03T10:17:09.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:09.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.259+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0a811c310 con 0x7ff0a8067c10 2023-10-03T10:17:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.259+0000 7ff08f7fe700 1 -- 172.21.15.125:0/2816592595 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0a811c310 con 0x7ff0a8067c10 2023-10-03T10:17:09.259 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 msgr2=0x7ff0a811b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff09800e9b0 tx=0x7ff09800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 shutdown_connections 2023-10-03T10:17:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0a81343d0 0x7ff0a81c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0a8067c10 0x7ff0a811b530 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 --2- 172.21.15.125:0/2816592595 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0a8133fa0 0x7ff0a81c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 >> 172.21.15.125:0/2816592595 conn(0x7ff0a80a2980 msgr2=0x7ff0a81baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.261+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 shutdown_connections 2023-10-03T10:17:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.262+0000 7ff0ad574700 1 -- 172.21.15.125:0/2816592595 wait complete. 2023-10-03T10:17:09.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:09.292 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:09.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.439+0000 7fadd9b56700 1 Processor -- start 2023-10-03T10:17:09.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.439+0000 7fadd9b56700 1 -- start start 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd9b56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd9b56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd9b56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd409c970 con 0x7fadd409e870 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd9b56700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40a0920 con 0x7fadd409f350 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd9b56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd409f9c0 con 0x7fadd41371c0 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fadd409e870 0x7fadd409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59062/0 (socket says 172.21.15.125:59062) 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd37fe700 1 -- 172.21.15.125:0/2149692419 learned_addr learned my addr 172.21.15.125:0/2149692419 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd2ffd700 1 --2- 172.21.15.125:0/2149692419 >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40506/0 (socket says 172.21.15.125:40506) 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 --2- 172.21.15.125:0/2149692419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45246/0 (socket says 172.21.15.125:45246) 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 -- 172.21.15.125:0/2149692419 >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 msgr2=0x7fadd4136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 --2- 172.21.15.125:0/2149692419 >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 -- 172.21.15.125:0/2149692419 >> v1:172.21.15.125:6789/0 conn(0x7fadd409e870 legacy=0x7fadd409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd3fff700 1 -- 172.21.15.125:0/2149692419 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd409bab0 con 0x7fadd41371c0 2023-10-03T10:17:09.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd27fc700 1 -- 172.21.15.125:0/2149692419 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347049328 0 0) 0x7fadd409c970 con 0x7fadd409e870 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.440+0000 7fadd2ffd700 1 --2- 172.21.15.125:0/2149692419 >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd3fff700 1 --2- 172.21.15.125:0/2149692419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009840 tx=0x7fadcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd9dca7f0e4855b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd27fc700 1 -- 172.21.15.125:0/2149692419 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011830 con 0x7fadd41371c0 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd27fc700 1 -- 172.21.15.125:0/2149692419 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc011990 con 0x7fadd41371c0 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd27fc700 1 -- 172.21.15.125:0/2149692419 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011d20 con 0x7fadd41371c0 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 -- 172.21.15.125:0/2149692419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 msgr2=0x7fadd41395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 --2- 172.21.15.125:0/2149692419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009840 tx=0x7fadcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 -- 172.21.15.125:0/2149692419 shutdown_connections 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 --2- 172.21.15.125:0/2149692419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd41371c0 0x7fadd41395a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 --2- 172.21.15.125:0/2149692419 >> v2:172.21.15.125:3300/0 conn(0x7fadd409f350 0x7fadd4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 -- 172.21.15.125:0/2149692419 >> 172.21.15.125:0/2149692419 conn(0x7fadd40a4430 msgr2=0x7fadd40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 -- 172.21.15.125:0/2149692419 shutdown_connections 2023-10-03T10:17:09.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.441+0000 7fadd9b56700 1 -- 172.21.15.125:0/2149692419 wait complete. 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.443+0000 7fadd9b56700 1 Processor -- start 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.443+0000 7fadd9b56700 1 -- start start 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.443+0000 7fadd9b56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 0x7fadd4120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.443+0000 7fadd9b56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 0x7fadd4120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41229a0 con 0x7fadd41371c0 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4124250 con 0x7fadd409e870 2023-10-03T10:17:09.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd409dba0 con 0x7fadd409f350 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40508/0 (socket says 172.21.15.125:40508) 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 0x7fadd4120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 -- 172.21.15.125:0/1628247099 learned_addr learned my addr 172.21.15.125:0/1628247099 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 0x7fadd4120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 -- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 msgr2=0x7fadd4120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 0x7fadd4120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 -- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 msgr2=0x7fadd4120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 0x7fadd4120730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 -- 172.21.15.125:0/1628247099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc80094a0 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd37fe700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 0x7fadd4120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd2ffd700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 0x7fadd4120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd3fff700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0036a0 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc01f070 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc003a60 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc0094a0 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.444+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd4123cb0 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.446+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadcc003bc0 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.446+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd4122b90 con 0x7fadd41371c0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.446+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fadcc021070 con 0x7fadd41371c0 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.450+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadcc02fd70 con 0x7fadd41371c0 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 Processor -- start 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 -- start start 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809e870 0x7ff4f809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f809c970 con 0x7ff4f809f180 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80a0920 con 0x7ff4f8131f40 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.483+0000 7ff4ff772700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f809f9c0 con 0x7ff4f809e870 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fd50e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809e870 0x7ff4f809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45264/0 (socket says 172.21.15.125:45264) 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/2961349332 learned_addr learned my addr 172.21.15.125:0/2961349332 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809e870 msgr2=0x7ff4f809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809e870 0x7ff4f809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/2961349332 >> v1:172.21.15.125:6789/0 conn(0x7ff4f809f180 legacy=0x7ff4f8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/2961349332 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f809bab0 con 0x7ff4f8131f40 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009e80 tx=0x7ff4f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7606842e7387c240 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4effff700 1 -- 172.21.15.125:0/2961349332 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000e070 con 0x7ff4f8131f40 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4effff700 1 -- 172.21.15.125:0/2961349332 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000b910 con 0x7ff4f8131f40 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.484+0000 7ff4effff700 1 -- 172.21.15.125:0/2961349332 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000bcc0 con 0x7ff4f8131f40 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 -- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 msgr2=0x7ff4f8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 --2- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009e80 tx=0x7ff4f000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 -- 172.21.15.125:0/2961349332 shutdown_connections 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 --2- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8139ca0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 --2- 172.21.15.125:0/2961349332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809e870 0x7ff4f809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 -- 172.21.15.125:0/2961349332 >> 172.21.15.125:0/2961349332 conn(0x7ff4f80a4430 msgr2=0x7ff4f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 -- 172.21.15.125:0/2961349332 shutdown_connections 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.485+0000 7ff4ff772700 1 -- 172.21.15.125:0/2961349332 wait complete. 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 Processor -- start 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 -- start start 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 0x7ff4f8120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.486+0000 7ff4ff772700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8131510 con 0x7ff4f809e870 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4ff772700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8121630 con 0x7ff4f8131f40 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4ff772700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8122be0 con 0x7ff4f809f180 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fcd0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 0x7ff4f8120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fd50e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fd50e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40524/0 (socket says 172.21.15.125:40524) 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fd50e700 1 -- 172.21.15.125:0/1870652512 learned_addr learned my addr 172.21.15.125:0/1870652512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fcd0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 0x7ff4f8120710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51328/0 (socket says 172.21.15.125:51328) 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 msgr2=0x7ff4f8120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 0x7ff4f8120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 msgr2=0x7ff4f81201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 -- 172.21.15.125:0/1870652512 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009b30 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fd50e700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4fdd0f700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8120c50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80673f0 tx=0x7ff4f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0004450 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00092e0 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81236c0 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.487+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0004830 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.488+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f809dba0 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.488+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4f001c410 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.488+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4f0041140 con 0x7ff4f8131f40 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.489+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f811d580 con 0x7ff4f8131f40 2023-10-03T10:17:09.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.493+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4f0011b80 con 0x7ff4f8131f40 2023-10-03T10:17:09.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.645+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadd404f2a0 con 0x7fadd41371c0 2023-10-03T10:17:09.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.645+0000 7fadbbfff700 1 -- 172.21.15.125:0/1628247099 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadcc015070 con 0x7fadd41371c0 2023-10-03T10:17:09.645 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 msgr2=0x7fadd41211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 shutdown_connections 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadd41371c0 0x7fadd41211b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fadd409e870 0x7fadd4120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 --2- 172.21.15.125:0/1628247099 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fadd409f350 0x7fadd4120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.647+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 >> 172.21.15.125:0/1628247099 conn(0x7fadd40a4430 msgr2=0x7fadd40a2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.648+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 shutdown_connections 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.648+0000 7fadd9b56700 1 -- 172.21.15.125:0/1628247099 wait complete. 2023-10-03T10:17:09.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:09.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.685+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4f804f2a0 con 0x7ff4f8131f40 2023-10-03T10:17:09.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.685+0000 7ff4edffb700 1 -- 172.21.15.125:0/1870652512 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4f0034090 con 0x7ff4f8131f40 2023-10-03T10:17:09.685 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:09.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.687+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 msgr2=0x7ff4f8120c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.687+0000 7ff4ff772700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8120c50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80673f0 tx=0x7ff4f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 shutdown_connections 2023-10-03T10:17:09.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4f8131f40 0x7ff4f8120c50 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4f809e870 0x7ff4f81201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 --2- 172.21.15.125:0/1870652512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff4f809f180 0x7ff4f8120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 >> 172.21.15.125:0/1870652512 conn(0x7ff4f80a4430 msgr2=0x7ff4f811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 shutdown_connections 2023-10-03T10:17:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:09.688+0000 7ff4ff772700 1 -- 172.21.15.125:0/1870652512 wait complete. 2023-10-03T10:17:09.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:10.229 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:10.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:10.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.358+0000 7f0a758b5700 1 Processor -- start 2023-10-03T10:17:10.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 -- start start 2023-10-03T10:17:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a700a3b60 con 0x7f0a70133f70 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701348e0 con 0x7f0a7009ad40 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a758b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7009b110 con 0x7f0a700a0a70 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51340/0 (socket says 172.21.15.125:51340) 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40528/0 (socket says 172.21.15.125:40528) 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45294/0 (socket says 172.21.15.125:45294) 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/113722941 learned_addr learned my addr 172.21.15.125:0/113722941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 msgr2=0x7f0a70133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/113722941 >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 msgr2=0x7f0a701343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/113722941 >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/113722941 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700a2fa0 con 0x7f0a700a0a70 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6e7fc700 1 --2- 172.21.15.125:0/113722941 >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.359+0000 7f0a6effd700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009e80 tx=0x7f0a6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23134611806ddcd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a6dffb700 1 -- 172.21.15.125:0/113722941 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800e070 con 0x7f0a700a0a70 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a6dffb700 1 -- 172.21.15.125:0/113722941 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800b8d0 con 0x7f0a700a0a70 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a6dffb700 1 -- 172.21.15.125:0/113722941 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800bc80 con 0x7f0a700a0a70 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 -- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 msgr2=0x7f0a700a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009e80 tx=0x7f0a6800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 -- 172.21.15.125:0/113722941 shutdown_connections 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7009ad40 0x7f0a70133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 --2- 172.21.15.125:0/113722941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a700a0a70 0x7f0a700a0ed0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 --2- 172.21.15.125:0/113722941 >> v2:172.21.15.125:3300/0 conn(0x7f0a70133f70 0x7f0a701343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 -- 172.21.15.125:0/113722941 >> 172.21.15.125:0/113722941 conn(0x7f0a70099c40 msgr2=0x7f0a7006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 -- 172.21.15.125:0/113722941 shutdown_connections 2023-10-03T10:17:10.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.360+0000 7f0a758b5700 1 -- 172.21.15.125:0/113722941 wait complete. 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.361+0000 7f0a758b5700 1 Processor -- start 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 -- start start 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 0x7f0a70122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701337e0 con 0x7f0a7009ad40 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70124eb0 con 0x7f0a700a0a70 2023-10-03T10:17:10.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a758b5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70125990 con 0x7f0a70133f70 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 0x7f0a70122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 0x7f0a70122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45300/0 (socket says 172.21.15.125:45300) 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6e7fc700 1 -- 172.21.15.125:0/2070305482 learned_addr learned my addr 172.21.15.125:0/2070305482 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6effd700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40538/0 (socket says 172.21.15.125:40538) 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51354/0 (socket says 172.21.15.125:51354) 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 msgr2=0x7f0a70122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 0x7f0a70122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 msgr2=0x7f0a70122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6f7fe700 1 -- 172.21.15.125:0/2070305482 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600094a0 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.362+0000 7f0a6effd700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a6f7fe700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0a7006b550 tx=0x7f0a68004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004450 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a680045b0 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640094a0 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004960 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.363+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a68009b30 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.364+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a6801c440 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.364+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a68040bb0 con 0x7f0a70133f70 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.365+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7009c7e0 con 0x7f0a70133f70 2023-10-03T10:17:10.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.369+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a680247c0 con 0x7f0a70133f70 2023-10-03T10:17:10.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.400+0000 7f8599216700 1 Processor -- start 2023-10-03T10:17:10.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.400+0000 7f8599216700 1 -- start start 2023-10-03T10:17:10.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8599216700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8599216700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8599216700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859409e9d0 con 0x7f85940a0a70 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8599216700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859409dc00 con 0x7f8594139200 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8599216700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859409dec0 con 0x7f85940a1550 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f859359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f859259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f859359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40552/0 (socket says 172.21.15.125:40552) 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f8592d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f85940a0a70 0x7f85940a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59082/0 (socket says 172.21.15.125:59082) 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f859259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45308/0 (socket says 172.21.15.125:45308) 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.401+0000 7f859359e700 1 -- 172.21.15.125:0/3998061690 learned_addr learned my addr 172.21.15.125:0/3998061690 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859259c700 1 -- 172.21.15.125:0/3998061690 >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 msgr2=0x7f859413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859259c700 1 --2- 172.21.15.125:0/3998061690 >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859259c700 1 -- 172.21.15.125:0/3998061690 >> v1:172.21.15.125:6789/0 conn(0x7f85940a0a70 legacy=0x7f85940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859259c700 1 -- 172.21.15.125:0/3998061690 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859409e6a0 con 0x7f85940a1550 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f8591d9b700 1 -- 172.21.15.125:0/3998061690 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822850632 0 0) 0x7f859409e9d0 con 0x7f85940a0a70 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859359e700 1 --2- 172.21.15.125:0/3998061690 >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f859259c700 1 --2- 172.21.15.125:0/3998061690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8588009840 tx=0x7f8588009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b753a1cac9fa6eeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f8591d9b700 1 -- 172.21.15.125:0/3998061690 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588011830 con 0x7f85940a1550 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f8591d9b700 1 -- 172.21.15.125:0/3998061690 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588011990 con 0x7f85940a1550 2023-10-03T10:17:10.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.402+0000 7f8591d9b700 1 -- 172.21.15.125:0/3998061690 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588011d20 con 0x7f85940a1550 2023-10-03T10:17:10.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 -- 172.21.15.125:0/3998061690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 msgr2=0x7f8594138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 --2- 172.21.15.125:0/3998061690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8588009840 tx=0x7f8588009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:10.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 -- 172.21.15.125:0/3998061690 shutdown_connections 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 --2- 172.21.15.125:0/3998061690 >> v2:172.21.15.125:3300/0 conn(0x7f8594139200 0x7f859413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 --2- 172.21.15.125:0/3998061690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594138cc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 -- 172.21.15.125:0/3998061690 >> 172.21.15.125:0/3998061690 conn(0x7f85940a6610 msgr2=0x7f85940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 -- 172.21.15.125:0/3998061690 shutdown_connections 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.403+0000 7f8599216700 1 -- 172.21.15.125:0/3998061690 wait complete. 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.404+0000 7f8599216700 1 Processor -- start 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.404+0000 7f8599216700 1 -- start start 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940a03e0 con 0x7f85940a0a70 2023-10-03T10:17:10.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85941239b0 con 0x7f85940a1550 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8599216700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8594123ed0 con 0x7f8594139200 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8592d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51362/0 (socket says 172.21.15.125:51362) 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8592d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40566/0 (socket says 172.21.15.125:40566) 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 -- 172.21.15.125:0/3018605599 learned_addr learned my addr 172.21.15.125:0/3018605599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859259c700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 -- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 msgr2=0x7f8594120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 -- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 msgr2=0x7f8594120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 -- 172.21.15.125:0/3018605599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c009b30 con 0x7f8594139200 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f8592d9d700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.405+0000 7f859359e700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f858c00efc0 tx=0x7f858c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.406+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c018070 con 0x7f8594139200 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.406+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00f040 con 0x7f8594139200 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.406+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c003c20 con 0x7f8594139200 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.406+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85880094a0 con 0x7f8594139200 2023-10-03T10:17:10.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.406+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8594124940 con 0x7f8594139200 2023-10-03T10:17:10.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.407+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8594123d10 con 0x7f8594139200 2023-10-03T10:17:10.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.407+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f858c00c880 con 0x7f8594139200 2023-10-03T10:17:10.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.407+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f858c040540 con 0x7f8594139200 2023-10-03T10:17:10.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.412+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f858c00cb30 con 0x7f8594139200 2023-10-03T10:17:10.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.570+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a7004f2a0 con 0x7f0a70133f70 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.570+0000 7f0a57fff700 1 -- 172.21.15.125:0/2070305482 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a68011390 con 0x7f0a70133f70 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 msgr2=0x7f0a70122e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0a7006b550 tx=0x7f0a68004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 shutdown_connections 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a70133f70 0x7f0a70122e90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7009ad40 0x7f0a70122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 --2- 172.21.15.125:0/2070305482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a700a0a70 0x7f0a70122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 >> 172.21.15.125:0/2070305482 conn(0x7f0a70099c40 msgr2=0x7f0a7009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 shutdown_connections 2023-10-03T10:17:10.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.572+0000 7f0a758b5700 1 -- 172.21.15.125:0/2070305482 wait complete. 2023-10-03T10:17:10.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:10.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.606+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8594123b20 con 0x7f8594139200 2023-10-03T10:17:10.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.607+0000 7f857b7fe700 1 -- 172.21.15.125:0/3018605599 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f858c013bd0 con 0x7f8594139200 2023-10-03T10:17:10.606 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 msgr2=0x7f8594121110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f858c00efc0 tx=0x7f858c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 shutdown_connections 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8594139200 0x7f8594121110 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85940a0a70 0x7f8594120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 --2- 172.21.15.125:0/3018605599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85940a1550 0x7f8594120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 >> 172.21.15.125:0/3018605599 conn(0x7f85940a6610 msgr2=0x7f85940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 shutdown_connections 2023-10-03T10:17:10.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.609+0000 7f8599216700 1 -- 172.21.15.125:0/3018605599 wait complete. 2023-10-03T10:17:10.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:10.659 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:10.700 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.786+0000 7f26fa99a700 1 Processor -- start 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.786+0000 7f26fa99a700 1 -- start start 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26fa99a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26f4134140 0x7f26f4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26fa99a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26fa99a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f409b110 con 0x7f26f409ad40 2023-10-03T10:17:10.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26fa99a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f40a3b60 con 0x7f26f4134140 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26fa99a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40a1a80 con 0x7f26f41345a0 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26f4134140 0x7f26f4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f8f37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26f4134140 0x7f26f4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40578/0 (socket says 172.21.15.125:40578) 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f8f37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45330/0 (socket says 172.21.15.125:45330) 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 -- 172.21.15.125:0/4134928894 learned_addr learned my addr 172.21.15.125:0/4134928894 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 -- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 msgr2=0x7f26f413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 -- 172.21.15.125:0/4134928894 >> v1:172.21.15.125:6789/0 conn(0x7f26f409ad40 legacy=0x7f26f4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 -- 172.21.15.125:0/4134928894 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40a2fa0 con 0x7f26f4134140 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f2ffd700 1 -- 172.21.15.125:0/4134928894 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052366234 0 0) 0x7f26f409b110 con 0x7f26f409ad40 2023-10-03T10:17:10.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f8f37700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f37fe700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f4134140 0x7f26f4138e80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f26e80098f0 tx=0x7f26e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13135747e9416808 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f2ffd700 1 -- 172.21.15.125:0/4134928894 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8011830 con 0x7f26f4134140 2023-10-03T10:17:10.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.787+0000 7f26f2ffd700 1 -- 172.21.15.125:0/4134928894 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e8011990 con 0x7f26f4134140 2023-10-03T10:17:10.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26f2ffd700 1 -- 172.21.15.125:0/4134928894 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8011d20 con 0x7f26f4134140 2023-10-03T10:17:10.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 -- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f4134140 msgr2=0x7f26f4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f4134140 0x7f26f4138e80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f26e80098f0 tx=0x7f26e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 -- 172.21.15.125:0/4134928894 shutdown_connections 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f41345a0 0x7f26f413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 --2- 172.21.15.125:0/4134928894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f4134140 0x7f26f4138e80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 -- 172.21.15.125:0/4134928894 >> 172.21.15.125:0/4134928894 conn(0x7f26f4099c40 msgr2=0x7f26f406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 -- 172.21.15.125:0/4134928894 shutdown_connections 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.788+0000 7f26fa99a700 1 -- 172.21.15.125:0/4134928894 wait complete. 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 Processor -- start 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 -- start start 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f409ad40 0x7f26f411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26f41345a0 0x7f26f411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f411f840 con 0x7f26f409ad40 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f411da10 con 0x7f26f4134140 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26fa99a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26f411ee60 con 0x7f26f41345a0 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26f37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26f3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f409ad40 0x7f26f411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26f37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45332/0 (socket says 172.21.15.125:45332) 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26f8f37700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26f41345a0 0x7f26f411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.790+0000 7f26f37fe700 1 -- 172.21.15.125:0/390844400 learned_addr learned my addr 172.21.15.125:0/390844400 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 -- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26f41345a0 msgr2=0x7f26f411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26f41345a0 0x7f26f411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 -- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f409ad40 msgr2=0x7f26f411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f409ad40 0x7f26f411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 -- 172.21.15.125:0/390844400 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec009a70 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f37fe700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f26f409a5d0 tx=0x7f26e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80045d0 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e80036a0 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e8009550 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8003a30 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.791+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f411e640 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.792+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26e8021070 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.792+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26e8040ab0 con 0x7f26f4134140 2023-10-03T10:17:10.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.792+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f41361e0 con 0x7f26f4134140 2023-10-03T10:17:10.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.797+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26e8029080 con 0x7f26f4134140 2023-10-03T10:17:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.829+0000 7fa4dedb1700 1 Processor -- start 2023-10-03T10:17:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.829+0000 7fa4dedb1700 1 -- start start 2023-10-03T10:17:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4d80a1380 0x7fa4d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 0x7fa4d8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d809e9d0 con 0x7fa4d80a1380 2023-10-03T10:17:10.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d809dc00 con 0x7fa4d80a0a70 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dedb1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d809dec0 con 0x7fa4d8133f50 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4d80a1380 0x7fa4d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dcb4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4d80a1380 0x7fa4d8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40590/0 (socket says 172.21.15.125:40590) 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 -- 172.21.15.125:0/961171121 learned_addr learned my addr 172.21.15.125:0/961171121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dd34e700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 0x7fa4d8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 -- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 msgr2=0x7fa4d8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 0x7fa4d8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 -- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 msgr2=0x7fa4d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 -- 172.21.15.125:0/961171121 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d809e6a0 con 0x7fa4d80a1380 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dcb4d700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4dd34e700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 0x7fa4d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.830+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d80a1380 0x7fa4d8133a10 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098f0 tx=0x7fa4c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e0b437672e3b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4d77fe700 1 -- 172.21.15.125:0/961171121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011830 con 0x7fa4d80a1380 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4d77fe700 1 -- 172.21.15.125:0/961171121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4011990 con 0x7fa4d80a1380 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4d77fe700 1 -- 172.21.15.125:0/961171121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011d20 con 0x7fa4d80a1380 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 -- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d80a1380 msgr2=0x7fa4d8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d80a1380 0x7fa4d8133a10 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098f0 tx=0x7fa4c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 -- 172.21.15.125:0/961171121 shutdown_connections 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d8133f50 0x7fa4d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/961171121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d80a1380 0x7fa4d8133a10 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 -- 172.21.15.125:0/961171121 >> 172.21.15.125:0/961171121 conn(0x7fa4d80a6610 msgr2=0x7fa4d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 -- 172.21.15.125:0/961171121 shutdown_connections 2023-10-03T10:17:10.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.831+0000 7fa4dedb1700 1 -- 172.21.15.125:0/961171121 wait complete. 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.832+0000 7fa4dedb1700 1 Processor -- start 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 -- start start 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d8122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 0x7fa4d8122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d8133f50 0x7fa4d8123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81239f0 con 0x7fa4d8133f50 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80a03e0 con 0x7fa4d80a0a70 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dedb1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80a5180 con 0x7fa4d80a1380 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dcb4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d8122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dd34e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d8133f50 0x7fa4d8123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4d7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 0x7fa4d8122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dcb4d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d8122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45340/0 (socket says 172.21.15.125:45340) 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.833+0000 7fa4dcb4d700 1 -- 172.21.15.125:0/1828277933 learned_addr learned my addr 172.21.15.125:0/1828277933 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 -- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 msgr2=0x7fa4d8122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d8122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 -- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d8133f50 msgr2=0x7fa4d8123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d8133f50 0x7fa4d8123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 -- 172.21.15.125:0/1828277933 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0094a0 con 0x7fa4d80a1380 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d7fff700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 0x7fa4d8122ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4016000 tx=0x7fa4c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4004240 con 0x7fa4d80a1380 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c401f070 con 0x7fa4d80a1380 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d0009a70 con 0x7fa4d80a1380 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40036a0 con 0x7fa4d80a1380 2023-10-03T10:17:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.834+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4009550 con 0x7fa4d80a1380 2023-10-03T10:17:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.835+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4c4021030 con 0x7fa4d80a1380 2023-10-03T10:17:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.835+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8125c30 con 0x7fa4d80a1380 2023-10-03T10:17:10.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.835+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4c4040730 con 0x7fa4d80a1380 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.840+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4d8125c30 con 0x7fa4d80a1380 2023-10-03T10:17:10.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.988+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26f409c7e0 con 0x7f26f4134140 2023-10-03T10:17:10.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.988+0000 7f26f0ff9700 1 -- 172.21.15.125:0/390844400 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26e8015020 con 0x7f26f4134140 2023-10-03T10:17:10.988 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 msgr2=0x7f26f411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f26f409a5d0 tx=0x7f26e8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 shutdown_connections 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26f41345a0 0x7f26f411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26f409ad40 0x7f26f411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 --2- 172.21.15.125:0/390844400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26f4134140 0x7f26f411ce00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 >> 172.21.15.125:0/390844400 conn(0x7f26f4099c40 msgr2=0x7f26f413b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 shutdown_connections 2023-10-03T10:17:10.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:10.990+0000 7f26fa99a700 1 -- 172.21.15.125:0/390844400 wait complete. 2023-10-03T10:17:11.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:11.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.028+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4d804f2a0 con 0x7fa4d80a1380 2023-10-03T10:17:11.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.028+0000 7fa4d57fa700 1 -- 172.21.15.125:0/1828277933 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4c4015070 con 0x7fa4d80a1380 2023-10-03T10:17:11.028 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 msgr2=0x7fa4d8122ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 0x7fa4d8122ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4016000 tx=0x7fa4c4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 shutdown_connections 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4d8133f50 0x7fa4d8123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4d80a0a70 0x7fa4d8122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 --2- 172.21.15.125:0/1828277933 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa4d80a1380 0x7fa4d8122ad0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 >> 172.21.15.125:0/1828277933 conn(0x7fa4d80a6610 msgr2=0x7fa4d809c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 shutdown_connections 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.031+0000 7fa4dedb1700 1 -- 172.21.15.125:0/1828277933 wait complete. 2023-10-03T10:17:11.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:11.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:11.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:11.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.717+0000 7fd1c2905700 1 Processor -- start 2023-10-03T10:17:11.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.717+0000 7fd1c2905700 1 -- start start 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.717+0000 7fd1c2905700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c2905700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc133f70 0x7fd1bc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c2905700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c2905700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0a3b60 con 0x7fd1bc09ad40 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c2905700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1348e0 con 0x7fd1bc133f70 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c2905700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc09b110 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1bbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1bb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc133f70 0x7fd1bc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1bbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40594/0 (socket says 172.21.15.125:40594) 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1bbfff700 1 -- 172.21.15.125:0/894949907 learned_addr learned my addr 172.21.15.125:0/894949907 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 -- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc133f70 msgr2=0x7fd1bc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 --2- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc133f70 0x7fd1bc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 -- 172.21.15.125:0/894949907 >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 msgr2=0x7fd1bc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 --2- 172.21.15.125:0/894949907 >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 -- 172.21.15.125:0/894949907 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0a2fa0 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1bbfff700 1 --2- 172.21.15.125:0/894949907 >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1c0ea2700 1 --2- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc0a0f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009dc0 tx=0x7fd1b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fc29ef7859ca6fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1baffd700 1 -- 172.21.15.125:0/894949907 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400e070 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1baffd700 1 -- 172.21.15.125:0/894949907 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400bae0 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.718+0000 7fd1baffd700 1 -- 172.21.15.125:0/894949907 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400be90 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 -- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 msgr2=0x7fd1bc0a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 --2- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc0a0f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009dc0 tx=0x7fd1b400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 -- 172.21.15.125:0/894949907 shutdown_connections 2023-10-03T10:17:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 --2- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc0a0f10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 --2- 172.21.15.125:0/894949907 >> v2:172.21.15.125:3300/0 conn(0x7fd1bc09ad40 0x7fd1bc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 --2- 172.21.15.125:0/894949907 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc133f70 0x7fd1bc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 -- 172.21.15.125:0/894949907 >> 172.21.15.125:0/894949907 conn(0x7fd1bc099c40 msgr2=0x7fd1bc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 -- 172.21.15.125:0/894949907 shutdown_connections 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.719+0000 7fd1c2905700 1 -- 172.21.15.125:0/894949907 wait complete. 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.720+0000 7fd1c2905700 1 Processor -- start 2023-10-03T10:17:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.720+0000 7fd1c2905700 1 -- start start 2023-10-03T10:17:11.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.720+0000 7fd1c2905700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.720+0000 7fd1c2905700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.720+0000 7fd1c2905700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 0x7fd1bc1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c2905700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc121330 con 0x7fd1bc133f70 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c2905700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc11f670 con 0x7fd1bc09ad40 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c2905700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc09c140 con 0x7fd1bc0a0a70 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c0ea2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 0x7fd1bc1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45366/0 (socket says 172.21.15.125:45366) 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 -- 172.21.15.125:0/2156676671 learned_addr learned my addr 172.21.15.125:0/2156676671 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bb7fe700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 -- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 msgr2=0x7fd1bc1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 -- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 msgr2=0x7fd1bc1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 0x7fd1bc1c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 -- 172.21.15.125:0/2156676671 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009550 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bb7fe700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c0ea2700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 0x7fd1bc1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1bbfff700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e930 tx=0x7fd1ac00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac004030 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac004190 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4009a70 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac004520 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.721+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc11fe60 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.722+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1ac0036a0 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.722+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc04f2a0 con 0x7fd1bc09ad40 2023-10-03T10:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.722+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1ac03f480 con 0x7fd1bc09ad40 2023-10-03T10:17:11.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.727+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1ac019b80 con 0x7fd1bc09ad40 2023-10-03T10:17:11.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.760+0000 7f8c1b74a700 1 Processor -- start 2023-10-03T10:17:11.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.760+0000 7f8c1b74a700 1 -- start start 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c1b74a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c1409e870 0x7f8c1409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c1b74a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 0x7f8c1413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c1b74a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1409fa00 con 0x7f8c1409f180 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c1b74a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c140a0370 con 0x7f8c1409e870 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c1b74a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1406bec0 con 0x7f8c14134330 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c1409e870 0x7f8c1409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c1409e870 0x7f8c1409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40614/0 (socket says 172.21.15.125:40614) 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 -- 172.21.15.125:0/2178113976 learned_addr learned my addr 172.21.15.125:0/2178113976 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:11.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c19ce7700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 0x7f8c1413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 -- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 msgr2=0x7f8c1413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 0x7f8c1413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 -- 172.21.15.125:0/2178113976 >> v1:172.21.15.125:6789/0 conn(0x7f8c1409f180 legacy=0x7f8c14133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 -- 172.21.15.125:0/2178113976 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1409ada0 con 0x7f8c1409e870 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c19ce7700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 0x7f8c1413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.761+0000 7f8c194e6700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c1409e870 0x7f8c1409ec40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8c100098f0 tx=0x7f8c10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b5d67f3d53a8b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c0bfff700 1 -- 172.21.15.125:0/2178113976 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10011830 con 0x7f8c1409e870 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c0bfff700 1 -- 172.21.15.125:0/2178113976 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10011990 con 0x7f8c1409e870 2023-10-03T10:17:11.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c0bfff700 1 -- 172.21.15.125:0/2178113976 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10011d20 con 0x7f8c1409e870 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 -- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c1409e870 msgr2=0x7f8c1409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c1409e870 0x7f8c1409ec40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8c100098f0 tx=0x7f8c10009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 -- 172.21.15.125:0/2178113976 shutdown_connections 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c14134330 0x7f8c1413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/2178113976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c1409e870 0x7f8c1409ec40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 -- 172.21.15.125:0/2178113976 >> 172.21.15.125:0/2178113976 conn(0x7f8c140a4430 msgr2=0x7f8c140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 -- 172.21.15.125:0/2178113976 shutdown_connections 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.762+0000 7f8c1b74a700 1 -- 172.21.15.125:0/2178113976 wait complete. 2023-10-03T10:17:11.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 Processor -- start 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 -- start start 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 0x7f8c14122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c14134330 0x7f8c14123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14124500 con 0x7f8c14134330 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141334c0 con 0x7f8c1409f180 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c1b74a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14126410 con 0x7f8c1409e870 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c194e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c194e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51422/0 (socket says 172.21.15.125:51422) 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c194e6700 1 -- 172.21.15.125:0/170409147 learned_addr learned my addr 172.21.15.125:0/170409147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:11.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.764+0000 7f8c18ce5700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 0x7f8c14122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c19ce7700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c14134330 0x7f8c14123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 -- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 msgr2=0x7f8c141228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 -- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c14134330 msgr2=0x7f8c14123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c14134330 0x7f8c14123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 -- 172.21.15.125:0/170409147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009a70 con 0x7f8c1409f180 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c194e6700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c18ce5700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 0x7f8c14122e30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8c04000f60 tx=0x7f8c0400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040052d0 con 0x7f8c1409f180 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04005430 con 0x7f8c1409f180 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c10009550 con 0x7f8c1409f180 2023-10-03T10:17:11.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040038c0 con 0x7f8c1409f180 2023-10-03T10:17:11.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.765+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c14125e70 con 0x7f8c1409f180 2023-10-03T10:17:11.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.766+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c04003a20 con 0x7f8c1409f180 2023-10-03T10:17:11.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.766+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c0403e990 con 0x7f8c1409f180 2023-10-03T10:17:11.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.766+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1404f2a0 con 0x7f8c1409f180 2023-10-03T10:17:11.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.775+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c04017080 con 0x7f8c1409f180 2023-10-03T10:17:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.932+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1bc1202e0 con 0x7fd1bc09ad40 2023-10-03T10:17:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.933+0000 7fd1b8ff9700 1 -- 172.21.15.125:0/2156676671 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1ac020030 con 0x7fd1bc09ad40 2023-10-03T10:17:11.932 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:11.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 msgr2=0x7fd1bc1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e930 tx=0x7fd1ac00ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:11.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 shutdown_connections 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1bc133f70 0x7fd1bc1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1bc09ad40 0x7fd1bc1c8200 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 --2- 172.21.15.125:0/2156676671 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd1bc0a0a70 0x7fd1bc1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 >> 172.21.15.125:0/2156676671 conn(0x7fd1bc099c40 msgr2=0x7fd1bc09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 shutdown_connections 2023-10-03T10:17:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.935+0000 7fd1c2905700 1 -- 172.21.15.125:0/2156676671 wait complete. 2023-10-03T10:17:11.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:11.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.973+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c14072d60 con 0x7f8c1409f180 2023-10-03T10:17:11.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.974+0000 7f8c09ffb700 1 -- 172.21.15.125:0/170409147 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c04011590 con 0x7f8c1409f180 2023-10-03T10:17:11.974 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:11.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 msgr2=0x7f8c14122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 0x7f8c14122e30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8c04000f60 tx=0x7f8c0400c730 comp rx=0 tx=0).stop 2023-10-03T10:17:11.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 shutdown_connections 2023-10-03T10:17:11.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c14134330 0x7f8c14123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c1409e870 0x7f8c141228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 --2- 172.21.15.125:0/170409147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c1409f180 0x7f8c14122e30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 >> 172.21.15.125:0/170409147 conn(0x7f8c140a4430 msgr2=0x7f8c140a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 shutdown_connections 2023-10-03T10:17:11.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:11.976+0000 7f8c1b74a700 1 -- 172.21.15.125:0/170409147 wait complete. 2023-10-03T10:17:11.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:12.003 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:12.043 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:12.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 Processor -- start 2023-10-03T10:17:12.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 -- start start 2023-10-03T10:17:12.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64c80a0a70 0x7f64c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c809dc00 con 0x7f64c80a1380 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c809ea90 con 0x7f64c80a0a70 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cf567700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c809dec0 con 0x7f64c8134120 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cdb04700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cd303700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64c80a0a70 0x7f64c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cdb04700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51424/0 (socket says 172.21.15.125:51424) 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.154+0000 7f64cdb04700 1 -- 172.21.15.125:0/3481934730 learned_addr learned my addr 172.21.15.125:0/3481934730 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cd303700 1 -- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 msgr2=0x7f64c813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cd303700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cd303700 1 -- 172.21.15.125:0/3481934730 >> v1:172.21.15.125:6789/0 conn(0x7f64c80a1380 legacy=0x7f64c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cd303700 1 -- 172.21.15.125:0/3481934730 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c809e6a0 con 0x7f64c80a0a70 2023-10-03T10:17:12.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64bffff700 1 -- 172.21.15.125:0/3481934730 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963150843 0 0) 0x7f64c809dc00 con 0x7f64c80a1380 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cdb04700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64cd303700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c80a0e40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009840 tx=0x7f64c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f05eb379f4a33f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64bffff700 1 -- 172.21.15.125:0/3481934730 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4011830 con 0x7f64c80a0a70 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64bffff700 1 -- 172.21.15.125:0/3481934730 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4011990 con 0x7f64c80a0a70 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.155+0000 7f64bffff700 1 -- 172.21.15.125:0/3481934730 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4011d20 con 0x7f64c80a0a70 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 -- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 msgr2=0x7f64c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c80a0e40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009840 tx=0x7f64c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 -- 172.21.15.125:0/3481934730 shutdown_connections 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 --2- 172.21.15.125:0/3481934730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c80a0e40 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 -- 172.21.15.125:0/3481934730 >> 172.21.15.125:0/3481934730 conn(0x7f64c80a6610 msgr2=0x7f64c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 -- 172.21.15.125:0/3481934730 shutdown_connections 2023-10-03T10:17:12.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.156+0000 7f64cf567700 1 -- 172.21.15.125:0/3481934730 wait complete. 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 Processor -- start 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 -- start start 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c80a1380 0x7f64c8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8133300 con 0x7f64c80a0a70 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8125920 con 0x7f64c80a1380 2023-10-03T10:17:12.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cf567700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8124310 con 0x7f64c8134120 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cd303700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64ccb02700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c80a1380 0x7f64c8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cd303700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40644/0 (socket says 172.21.15.125:40644) 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cdb04700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cd303700 1 -- 172.21.15.125:0/932095676 learned_addr learned my addr 172.21.15.125:0/932095676 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.157+0000 7f64cd303700 1 -- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 msgr2=0x7f64c8123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cd303700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c8123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cd303700 1 -- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c80a1380 msgr2=0x7f64c8122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cd303700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c80a1380 0x7f64c8122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cd303700 1 -- 172.21.15.125:0/932095676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009b30 con 0x7f64c80a0a70 2023-10-03T10:17:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cd303700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009fd0 tx=0x7f64c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40036a0 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c401f070 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c40094a0 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4003a60 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.158+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8125c80 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.159+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c804f2a0 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.159+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64c4003bc0 con 0x7f64c80a0a70 2023-10-03T10:17:12.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.159+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64c4021070 con 0x7f64c80a0a70 2023-10-03T10:17:12.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.164+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64c4025d70 con 0x7f64c80a0a70 2023-10-03T10:17:12.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.198+0000 7f1cb1318700 1 Processor -- start 2023-10-03T10:17:12.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.198+0000 7f1cb1318700 1 -- start start 2023-10-03T10:17:12.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.198+0000 7f1cb1318700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.198+0000 7f1cb1318700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cb1318700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0741b0 con 0x7f1cac093d60 2023-10-03T10:17:12.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cb1318700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac094fa0 con 0x7f1cac13d720 2023-10-03T10:17:12.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cb1318700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac09ebb0 con 0x7f1cac13ae00 2023-10-03T10:17:12.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1caaffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1cac093d60 0x7f1cac094130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59130/0 (socket says 172.21.15.125:59130) 2023-10-03T10:17:12.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1caaffd700 1 -- 172.21.15.125:0/580789222 learned_addr learned my addr 172.21.15.125:0/580789222 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:12.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1caa7fc700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 -- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 msgr2=0x7f1cac13d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac13d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 -- 172.21.15.125:0/580789222 >> v1:172.21.15.125:6789/0 conn(0x7f1cac093d60 legacy=0x7f1cac094130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1ca9ffb700 1 -- 172.21.15.125:0/580789222 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830533061 0 0) 0x7f1cac0741b0 con 0x7f1cac093d60 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 -- 172.21.15.125:0/580789222 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac094c50 con 0x7f1cac13d720 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.199+0000 7f1cab7fe700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac13fb00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009dc0 tx=0x7f1ca400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba2ba9962893a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.200+0000 7f1ca9ffb700 1 -- 172.21.15.125:0/580789222 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400e070 con 0x7f1cac13d720 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.200+0000 7f1ca9ffb700 1 -- 172.21.15.125:0/580789222 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca400bb20 con 0x7f1cac13d720 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.200+0000 7f1ca9ffb700 1 -- 172.21.15.125:0/580789222 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4012430 con 0x7f1cac13d720 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 -- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 msgr2=0x7f1cac13fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac13fb00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009dc0 tx=0x7f1ca400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 -- 172.21.15.125:0/580789222 shutdown_connections 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac13fb00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 --2- 172.21.15.125:0/580789222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac13d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 -- 172.21.15.125:0/580789222 >> 172.21.15.125:0/580789222 conn(0x7f1cac0a2eb0 msgr2=0x7f1cac09eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 -- 172.21.15.125:0/580789222 shutdown_connections 2023-10-03T10:17:12.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.201+0000 7f1cb1318700 1 -- 172.21.15.125:0/580789222 wait complete. 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.202+0000 7f1cb1318700 1 Processor -- start 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.202+0000 7f1cb1318700 1 -- start start 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 0x7f1cac1cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac1ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac1cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac09c6a0 con 0x7f1cac093d60 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac09d5f0 con 0x7f1cac13d720 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cb1318700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac09a9a0 con 0x7f1cac13ae00 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac1cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac1cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45402/0 (socket says 172.21.15.125:45402) 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 0x7f1cac1cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1cab7fe700 1 -- 172.21.15.125:0/1370606038 learned_addr learned my addr 172.21.15.125:0/1370606038 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caa7fc700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac1ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 -- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 msgr2=0x7f1cac1ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac1ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 -- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 msgr2=0x7f1cac1cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac1cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 -- 172.21.15.125:0/1370606038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4009a70 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caa7fc700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac1ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.203+0000 7f1caaffd700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 0x7f1cac1cc8a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c4a0 tx=0x7f1c9c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c004c80 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c004de0 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac096380 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c007310 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac097df0 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.204+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c9c007470 con 0x7f1cac093d60 2023-10-03T10:17:12.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.205+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c9c03f350 con 0x7f1cac093d60 2023-10-03T10:17:12.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.205+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac04f2a0 con 0x7f1cac093d60 2023-10-03T10:17:12.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.209+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c9c007720 con 0x7f1cac093d60 2023-10-03T10:17:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.362+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64c8072980 con 0x7f64c80a0a70 2023-10-03T10:17:12.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.362+0000 7f64bdffb700 1 -- 172.21.15.125:0/932095676 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64c4015030 con 0x7f64c80a0a70 2023-10-03T10:17:12.361 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:12.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 msgr2=0x7f64c8122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009fd0 tx=0x7f64c4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 shutdown_connections 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64c8134120 0x7f64c8123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80a0a70 0x7f64c8122700 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 --2- 172.21.15.125:0/932095676 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64c80a1380 0x7f64c8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 >> 172.21.15.125:0/932095676 conn(0x7f64c80a6610 msgr2=0x7f64c80a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 shutdown_connections 2023-10-03T10:17:12.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.364+0000 7f64cf567700 1 -- 172.21.15.125:0/932095676 wait complete. 2023-10-03T10:17:12.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.404+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1cac099f10 con 0x7f1cac093d60 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.404+0000 7f1c937fe700 1 -- 172.21.15.125:0/1370606038 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c9c011360 con 0x7f1cac093d60 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 msgr2=0x7f1cac1cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 0x7f1cac1cc8a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c4a0 tx=0x7f1c9c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 shutdown_connections 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1cac13d720 0x7f1cac1cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cac093d60 0x7f1cac1cc8a0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 --2- 172.21.15.125:0/1370606038 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1cac13ae00 0x7f1cac1ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 >> 172.21.15.125:0/1370606038 conn(0x7f1cac0a2eb0 msgr2=0x7f1cac0a01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 shutdown_connections 2023-10-03T10:17:12.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:12.406+0000 7f1cb1318700 1 -- 172.21.15.125:0/1370606038 wait complete. 2023-10-03T10:17:12.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:12.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:12.988 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:13.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 Processor -- start 2023-10-03T10:17:13.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 -- start start 2023-10-03T10:17:13.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b8c09ad40 0x7f5b8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 0x7f5b8c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c09b110 con 0x7f5b8c133f70 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c0a3b60 con 0x7f5b8c09ad40 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.076+0000 7f5b944ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c134850 con 0x7f5b8c1343d0 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b8c09ad40 0x7f5b8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92a49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 0x7f5b8c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91a47700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5b8c133f70 0x7f5b8c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59142/0 (socket says 172.21.15.125:59142) 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91a47700 1 -- 172.21.15.125:0/3871581753 learned_addr learned my addr 172.21.15.125:0/3871581753 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91246700 1 -- 172.21.15.125:0/3871581753 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256735646 0 0) 0x7f5b8c09b110 con 0x7f5b8c133f70 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91246700 1 -- 172.21.15.125:0/3871581753 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b780035b0 con 0x7f5b8c133f70 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 -- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 msgr2=0x7f5b8c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 0x7f5b8c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 -- 172.21.15.125:0/3871581753 >> v1:172.21.15.125:6789/0 conn(0x7f5b8c133f70 legacy=0x7f5b8c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 -- 172.21.15.125:0/3871581753 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0a2fa0 con 0x7f5b8c09ad40 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92a49700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 0x7f5b8c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b92248700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c09ad40 0x7f5b8c133a30 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009840 tx=0x7f5b88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a1b8992e376614 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91246700 1 -- 172.21.15.125:0/3871581753 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88011830 con 0x7f5b8c09ad40 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91246700 1 -- 172.21.15.125:0/3871581753 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88011990 con 0x7f5b8c09ad40 2023-10-03T10:17:13.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.077+0000 7f5b91246700 1 -- 172.21.15.125:0/3871581753 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88011d20 con 0x7f5b8c09ad40 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 -- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c09ad40 msgr2=0x7f5b8c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c09ad40 0x7f5b8c133a30 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009840 tx=0x7f5b88009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 -- 172.21.15.125:0/3871581753 shutdown_connections 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c1343d0 0x7f5b8c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3871581753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c09ad40 0x7f5b8c133a30 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 -- 172.21.15.125:0/3871581753 >> 172.21.15.125:0/3871581753 conn(0x7f5b8c099c40 msgr2=0x7f5b8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 -- 172.21.15.125:0/3871581753 shutdown_connections 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.078+0000 7f5b944ac700 1 -- 172.21.15.125:0/3871581753 wait complete. 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 Processor -- start 2023-10-03T10:17:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 -- start start 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 0x7f5b8c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 0x7f5b8c1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c120be0 con 0x7f5b8c1343d0 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09c850 con 0x7f5b8c09ad40 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b944ac700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c120740 con 0x7f5b8c133f70 2023-10-03T10:17:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b92a49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b91a47700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 0x7f5b8c1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b92a49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40674/0 (socket says 172.21.15.125:40674) 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b92a49700 1 -- 172.21.15.125:0/3844621509 learned_addr learned my addr 172.21.15.125:0/3844621509 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.079+0000 7f5b92248700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 0x7f5b8c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 -- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 msgr2=0x7f5b8c1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 0x7f5b8c1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 -- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 msgr2=0x7f5b8c1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 -- 172.21.15.125:0/3844621509 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84009a70 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b92248700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 0x7f5b8c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b92a49700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b91a47700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 0x7f5b8c1c8740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c490 tx=0x7f5b7c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c005d70 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0070d0 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880094a0 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007440 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.080+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c1221f0 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.081+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b7c0075a0 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.081+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c1223e0 con 0x7f5b8c133f70 2023-10-03T10:17:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.081+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b7c03ea70 con 0x7f5b8c133f70 2023-10-03T10:17:13.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.086+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b7c040e60 con 0x7f5b8c133f70 2023-10-03T10:17:13.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.117+0000 7f5743d44700 1 Processor -- start 2023-10-03T10:17:13.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 -- start start 2023-10-03T10:17:13.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f573c134120 0x7f573c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c09dc00 con 0x7f573c0a1380 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c09ea60 con 0x7f573c134120 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5743d44700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c09dec0 con 0x7f573c0a0a70 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f57422e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f573c134120 0x7f573c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5741ae0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5741ae0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45428/0 (socket says 172.21.15.125:45428) 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f57422e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f573c134120 0x7f573c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40682/0 (socket says 172.21.15.125:40682) 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f5741ae0700 1 -- 172.21.15.125:0/1644760626 learned_addr learned my addr 172.21.15.125:0/1644760626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.118+0000 7f57412df700 1 --1- 172.21.15.125:0/1644760626 >> v1:172.21.15.125:6789/0 conn(0x7f573c0a1380 0x7f573c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59148/0 (socket says 172.21.15.125:59148) 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f57422e1700 1 -- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 msgr2=0x7f573c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f57422e1700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f57422e1700 1 -- 172.21.15.125:0/1644760626 >> v1:172.21.15.125:6789/0 conn(0x7f573c0a1380 legacy=0x7f573c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f57422e1700 1 -- 172.21.15.125:0/1644760626 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c09e6a0 con 0x7f573c134120 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f5740ade700 1 -- 172.21.15.125:0/1644760626 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195421876 0 0) 0x7f573c09dc00 con 0x7f573c0a1380 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f5741ae0700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f57422e1700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c13bce0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5734009d90 tx=0x7f573400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91b91adbd87436d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f5740ade700 1 -- 172.21.15.125:0/1644760626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400e070 con 0x7f573c134120 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f5740ade700 1 -- 172.21.15.125:0/1644760626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400bb20 con 0x7f573c134120 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.119+0000 7f5740ade700 1 -- 172.21.15.125:0/1644760626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734012430 con 0x7f573c134120 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 -- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 msgr2=0x7f573c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c13bce0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5734009d90 tx=0x7f573400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:13.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 -- 172.21.15.125:0/1644760626 shutdown_connections 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c13bce0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 --2- 172.21.15.125:0/1644760626 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a0a70 0x7f573c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 -- 172.21.15.125:0/1644760626 >> 172.21.15.125:0/1644760626 conn(0x7f573c0a6610 msgr2=0x7f573c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 -- 172.21.15.125:0/1644760626 shutdown_connections 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.120+0000 7f5743d44700 1 -- 172.21.15.125:0/1644760626 wait complete. 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 Processor -- start 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 -- start start 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f573c0a0a70 0x7f573c122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 0x7f573c122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1332b0 con 0x7f573c134120 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1258b0 con 0x7f573c0a1380 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5743d44700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1242c0 con 0x7f573c0a0a70 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40694/0 (socket says 172.21.15.125:40694) 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 -- 172.21.15.125:0/973233782 learned_addr learned my addr 172.21.15.125:0/973233782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57412df700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 0x7f573c122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f5741ae0700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f573c0a0a70 0x7f573c122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 -- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f573c0a0a70 msgr2=0x7f573c122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f573c0a0a70 0x7f573c122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 -- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 msgr2=0x7f573c122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 0x7f573c122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57422e1700 1 -- 172.21.15.125:0/973233782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009550 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.121+0000 7f57412df700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 0x7f573c122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f57422e1700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f573400b680 tx=0x7f5734004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734012430 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734020070 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5734009a70 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734004280 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c125c30 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.122+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57340043e0 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.123+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5734022070 con 0x7f573c134120 2023-10-03T10:17:13.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.123+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c04f2a0 con 0x7f573c134120 2023-10-03T10:17:13.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.127+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f573401b400 con 0x7f573c134120 2023-10-03T10:17:13.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.280+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b8c04f2a0 con 0x7f5b8c133f70 2023-10-03T10:17:13.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.280+0000 7f5b82ffd700 1 -- 172.21.15.125:0/3844621509 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b7c017070 con 0x7f5b8c133f70 2023-10-03T10:17:13.280 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 msgr2=0x7f5b8c1c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 0x7f5b8c1c8740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c490 tx=0x7f5b7c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 shutdown_connections 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b8c1343d0 0x7f5b8c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b8c09ad40 0x7f5b8c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 --2- 172.21.15.125:0/3844621509 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5b8c133f70 0x7f5b8c1c8740 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 >> 172.21.15.125:0/3844621509 conn(0x7f5b8c099c40 msgr2=0x7f5b8c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 shutdown_connections 2023-10-03T10:17:13.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.282+0000 7f5b944ac700 1 -- 172.21.15.125:0/3844621509 wait complete. 2023-10-03T10:17:13.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:13.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.320+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f573c072980 con 0x7f573c134120 2023-10-03T10:17:13.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.321+0000 7f57327fc700 1 -- 172.21.15.125:0/973233782 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57340257f0 con 0x7f573c134120 2023-10-03T10:17:13.320 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:13.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 msgr2=0x7f573c1231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f573400b680 tx=0x7f5734004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 shutdown_connections 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f573c134120 0x7f573c1231d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f573c0a0a70 0x7f573c122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 --2- 172.21.15.125:0/973233782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f573c0a1380 0x7f573c122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 >> 172.21.15.125:0/973233782 conn(0x7f573c0a6610 msgr2=0x7f573c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 shutdown_connections 2023-10-03T10:17:13.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.323+0000 7f5743d44700 1 -- 172.21.15.125:0/973233782 wait complete. 2023-10-03T10:17:13.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:13.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:13.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:13.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 Processor -- start 2023-10-03T10:17:13.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 -- start start 2023-10-03T10:17:13.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 0x7f3ef8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 0x7f3ef8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80a0920 con 0x7f3ef809f180 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef809c970 con 0x7f3ef8131d70 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.503+0000 7f3efff17700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef809bab0 con 0x7f3ef809e870 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efd4b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 0x7f3ef8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51504/0 (socket says 172.21.15.125:51504) 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 -- 172.21.15.125:0/3364712151 learned_addr learned my addr 172.21.15.125:0/3364712151 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efe4b4700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 0x7f3ef8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 -- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 msgr2=0x7f3ef8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 0x7f3ef8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 -- 172.21.15.125:0/3364712151 >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 msgr2=0x7f3ef8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 --2- 172.21.15.125:0/3364712151 >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 0x7f3ef8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 -- 172.21.15.125:0/3364712151 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef809f9c0 con 0x7f3ef809e870 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efd4b2700 1 --2- 172.21.15.125:0/3364712151 >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 0x7f3ef8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efe4b4700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 0x7f3ef8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efdcb3700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40098f0 tx=0x7f3ef4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14f5bf9dd054ded server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efccb1700 1 -- 172.21.15.125:0/3364712151 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4011830 con 0x7f3ef809e870 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efccb1700 1 -- 172.21.15.125:0/3364712151 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4011990 con 0x7f3ef809e870 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.504+0000 7f3efccb1700 1 -- 172.21.15.125:0/3364712151 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4011d20 con 0x7f3ef809e870 2023-10-03T10:17:13.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 -- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 msgr2=0x7f3ef809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40098f0 tx=0x7f3ef4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 -- 172.21.15.125:0/3364712151 shutdown_connections 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef8131d70 0x7f3ef8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 --2- 172.21.15.125:0/3364712151 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef809e870 0x7f3ef809ec40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 --2- 172.21.15.125:0/3364712151 >> v2:172.21.15.125:3300/0 conn(0x7f3ef809f180 0x7f3ef8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 -- 172.21.15.125:0/3364712151 >> 172.21.15.125:0/3364712151 conn(0x7f3ef80a4430 msgr2=0x7f3ef80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 -- 172.21.15.125:0/3364712151 shutdown_connections 2023-10-03T10:17:13.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.505+0000 7f3efff17700 1 -- 172.21.15.125:0/3364712151 wait complete. 2023-10-03T10:17:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.506+0000 7f3efff17700 1 Processor -- start 2023-10-03T10:17:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.506+0000 7f3efff17700 1 -- start start 2023-10-03T10:17:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef809e870 0x7f3ef8120230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 0x7f3ef8120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8123d50 con 0x7f3ef809e870 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8122cd0 con 0x7f3ef809f180 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efff17700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81237b0 con 0x7f3ef8131d70 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efd4b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 0x7f3ef8120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efd4b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45466/0 (socket says 172.21.15.125:45466) 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efd4b2700 1 -- 172.21.15.125:0/3614391771 learned_addr learned my addr 172.21.15.125:0/3614391771 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efdcb3700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef809e870 0x7f3ef8120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 -- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 msgr2=0x7f3ef8120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 -- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef809e870 msgr2=0x7f3ef8120230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef809e870 0x7f3ef8120230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 -- 172.21.15.125:0/3614391771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80094a0 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efd4b2700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.507+0000 7f3efe4b4700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 0x7f3ef8120cb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009e50 tx=0x7f3ef000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000cc90 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef000f040 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef0009a70 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0014480 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef4009550 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.508+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ef0014600 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.509+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ef0040340 con 0x7f3ef8131d70 2023-10-03T10:17:13.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.509+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef804f2a0 con 0x7f3ef8131d70 2023-10-03T10:17:13.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.513+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ef00076f0 con 0x7f3ef8131d70 2023-10-03T10:17:13.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.545+0000 7f327ac24700 1 Processor -- start 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.545+0000 7f327ac24700 1 -- start start 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f327ac24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f327ac24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f327ac24700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327406b2d0 con 0x7f3274133ad0 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f327ac24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741345b0 con 0x7f3274136960 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f327ac24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3274133610 con 0x7f3274139280 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f3273fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51508/0 (socket says 172.21.15.125:51508) 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f3273fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45482/0 (socket says 172.21.15.125:45482) 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 -- 172.21.15.125:0/172574762 learned_addr learned my addr 172.21.15.125:0/172574762 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 -- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 msgr2=0x7f3274138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32737fe700 1 -- 172.21.15.125:0/172574762 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980315045 0 0) 0x7f327406b2d0 con 0x7f3274133ad0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 -- 172.21.15.125:0/172574762 >> v1:172.21.15.125:6789/0 conn(0x7f3274133ad0 legacy=0x7f3274133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 -- 172.21.15.125:0/172574762 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327409a500 con 0x7f3274139280 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f3273fff700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32791c1700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e80 tx=0x7f326c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccaa7ccc6763db2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32737fe700 1 -- 172.21.15.125:0/172574762 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00e070 con 0x7f3274139280 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.546+0000 7f32737fe700 1 -- 172.21.15.125:0/172574762 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00b910 con 0x7f3274139280 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f32737fe700 1 -- 172.21.15.125:0/172574762 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00bcc0 con 0x7f3274139280 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 -- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 msgr2=0x7f327413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e80 tx=0x7f326c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 -- 172.21.15.125:0/172574762 shutdown_connections 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327413b660 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 --2- 172.21.15.125:0/172574762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274136960 0x7f3274138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 -- 172.21.15.125:0/172574762 >> 172.21.15.125:0/172574762 conn(0x7f3274099c40 msgr2=0x7f32740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 -- 172.21.15.125:0/172574762 shutdown_connections 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.547+0000 7f327ac24700 1 -- 172.21.15.125:0/172574762 wait complete. 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.548+0000 7f327ac24700 1 Processor -- start 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.548+0000 7f327ac24700 1 -- start start 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 0x7f327412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327406edd0 con 0x7f3274136960 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741301e0 con 0x7f3274133ad0 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f327ac24700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3274130930 con 0x7f3274139280 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f3273fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f32789c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 0x7f327412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f3273fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40738/0 (socket says 172.21.15.125:40738) 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f3273fff700 1 -- 172.21.15.125:0/2731230940 learned_addr learned my addr 172.21.15.125:0/2731230940 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.549+0000 7f32791c1700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 -- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 msgr2=0x7f327412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 -- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 msgr2=0x7f327412cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 0x7f327412cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 -- 172.21.15.125:0/2731230940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600094a0 con 0x7f3274136960 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f32789c0700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 0x7f327412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f3273fff700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f326000ebe0 tx=0x7f326000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326000c850 con 0x7f3274136960 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326000c9b0 con 0x7f3274136960 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326000cd40 con 0x7f3274136960 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c009b30 con 0x7f3274136960 2023-10-03T10:17:13.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.550+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327409f390 con 0x7f3274136960 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.551+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3260013470 con 0x7f3274136960 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.551+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f326003f970 con 0x7f3274136960 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.551+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3274070240 con 0x7f3274136960 2023-10-03T10:17:13.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.560+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3260013720 con 0x7f3274136960 2023-10-03T10:17:13.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.706+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ef8131b50 con 0x7f3ef8131d70 2023-10-03T10:17:13.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.706+0000 7f3eee7fc700 1 -- 172.21.15.125:0/3614391771 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ef0007330 con 0x7f3ef8131d70 2023-10-03T10:17:13.706 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 msgr2=0x7f3ef8120cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 0x7f3ef8120cb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009e50 tx=0x7f3ef000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 shutdown_connections 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3ef8131d70 0x7f3ef8120cb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef809e870 0x7f3ef8120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 --2- 172.21.15.125:0/3614391771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ef809f180 0x7f3ef8120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 >> 172.21.15.125:0/3614391771 conn(0x7f3ef80a4430 msgr2=0x7f3ef806f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 shutdown_connections 2023-10-03T10:17:13.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.708+0000 7f3efff17700 1 -- 172.21.15.125:0/3614391771 wait complete. 2023-10-03T10:17:13.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:13.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.748+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f327404f2a0 con 0x7f3274136960 2023-10-03T10:17:13.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.748+0000 7f32717fa700 1 -- 172.21.15.125:0/2731230940 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f326002a090 con 0x7f3274136960 2023-10-03T10:17:13.747 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 msgr2=0x7f327412d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f326000ebe0 tx=0x7f326000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 shutdown_connections 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3274139280 0x7f327412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3274133ad0 0x7f327412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 --2- 172.21.15.125:0/2731230940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3274136960 0x7f327412d070 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 >> 172.21.15.125:0/2731230940 conn(0x7f3274099c40 msgr2=0x7f3274134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 shutdown_connections 2023-10-03T10:17:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:13.750+0000 7f327ac24700 1 -- 172.21.15.125:0/2731230940 wait complete. 2023-10-03T10:17:13.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:14.297 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:14.335 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.425+0000 7fc513b38700 1 Processor -- start 2023-10-03T10:17:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.425+0000 7fc513b38700 1 -- start start 2023-10-03T10:17:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc513b38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc513b38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc513b38700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c09aa00 con 0x7fc50c0a0e20 2023-10-03T10:17:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc513b38700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c09a080 con 0x7fc50c099a60 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc513b38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c133750 con 0x7fc50c133b80 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5110d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51526/0 (socket says 172.21.15.125:51526) 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5110d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40742/0 (socket says 172.21.15.125:40742) 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 -- 172.21.15.125:0/3609278542 learned_addr learned my addr 172.21.15.125:0/3609278542 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5120d5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc50c0a0e20 0x7fc50c13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59170/0 (socket says 172.21.15.125:59170) 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 -- 172.21.15.125:0/3609278542 >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 msgr2=0x7fc50c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 --2- 172.21.15.125:0/3609278542 >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 -- 172.21.15.125:0/3609278542 >> v1:172.21.15.125:6789/0 conn(0x7fc50c0a0e20 legacy=0x7fc50c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5118d4700 1 -- 172.21.15.125:0/3609278542 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c09a760 con 0x7fc50c133b80 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5108d2700 1 -- 172.21.15.125:0/3609278542 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183873410 0 0) 0x7fc50c09aa00 con 0x7fc50c0a0e20 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.426+0000 7fc5110d3700 1 --2- 172.21.15.125:0/3609278542 >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc5118d4700 1 --2- 172.21.15.125:0/3609278542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94cf768bada44ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc5108d2700 1 -- 172.21.15.125:0/3609278542 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508005e30 con 0x7fc50c133b80 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc5108d2700 1 -- 172.21.15.125:0/3609278542 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508004030 con 0x7fc50c133b80 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc5108d2700 1 -- 172.21.15.125:0/3609278542 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5080043e0 con 0x7fc50c133b80 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 -- 172.21.15.125:0/3609278542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 msgr2=0x7fc50c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 --2- 172.21.15.125:0/3609278542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 -- 172.21.15.125:0/3609278542 shutdown_connections 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 --2- 172.21.15.125:0/3609278542 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c133b80 0x7fc50c133f50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 --2- 172.21.15.125:0/3609278542 >> v2:172.21.15.125:3300/0 conn(0x7fc50c099a60 0x7fc50c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.427+0000 7fc513b38700 1 -- 172.21.15.125:0/3609278542 >> 172.21.15.125:0/3609278542 conn(0x7fc50c0a2980 msgr2=0x7fc50c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.428+0000 7fc513b38700 1 -- 172.21.15.125:0/3609278542 shutdown_connections 2023-10-03T10:17:14.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.428+0000 7fc513b38700 1 -- 172.21.15.125:0/3609278542 wait complete. 2023-10-03T10:17:14.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 Processor -- start 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 -- start start 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc50c0a0e20 0x7fc50c11dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc50c133b80 0x7fc50c11e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1211b0 con 0x7fc50c0a0e20 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c120580 con 0x7fc50c133b80 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc513b38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c121b50 con 0x7fc50c099a60 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.429+0000 7fc5118d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51532/0 (socket says 172.21.15.125:51532) 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 -- 172.21.15.125:0/747509386 learned_addr learned my addr 172.21.15.125:0/747509386 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5120d5700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc50c133b80 0x7fc50c11e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5110d3700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc50c0a0e20 0x7fc50c11dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 -- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc50c133b80 msgr2=0x7fc50c11e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc50c133b80 0x7fc50c11e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 -- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc50c0a0e20 msgr2=0x7fc50c11dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc50c0a0e20 0x7fc50c11dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 -- 172.21.15.125:0/747509386 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0094a0 con 0x7fc50c099a60 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5118d4700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc508009c10 tx=0x7fc508004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5080045d0 con 0x7fc50c099a60 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508011420 con 0x7fc50c099a60 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011790 con 0x7fc50c099a60 2023-10-03T10:17:14.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508009500 con 0x7fc50c099a60 2023-10-03T10:17:14.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.430+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c09a2c0 con 0x7fc50c099a60 2023-10-03T10:17:14.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.431+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc508018030 con 0x7fc50c099a60 2023-10-03T10:17:14.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.431+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc508040b80 con 0x7fc50c099a60 2023-10-03T10:17:14.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.431+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c120d50 con 0x7fc50c099a60 2023-10-03T10:17:14.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.436+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc508040e60 con 0x7fc50c099a60 2023-10-03T10:17:14.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.467+0000 7f0635eec700 1 Processor -- start 2023-10-03T10:17:14.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.467+0000 7f0635eec700 1 -- start start 2023-10-03T10:17:14.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f0635eec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 0x7f06300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f0635eec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 0x7f063013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f0635eec700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063009dc00 con 0x7f06300a1380 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f0635eec700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063009ea90 con 0x7f0630134120 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f0635eec700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063009dec0 con 0x7f06300a0a70 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 0x7f063013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f06300a1380 0x7f0630133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59172/0 (socket says 172.21.15.125:59172) 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062effd700 1 -- 172.21.15.125:0/859142115 learned_addr learned my addr 172.21.15.125:0/859142115 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062f7fe700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 0x7f06300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 -- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 msgr2=0x7f06300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 0x7f06300a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062e7fc700 1 -- 172.21.15.125:0/859142115 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191225310 0 0) 0x7f063009dc00 con 0x7f06300a1380 2023-10-03T10:17:14.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 -- 172.21.15.125:0/859142115 >> v1:172.21.15.125:6789/0 conn(0x7f06300a1380 legacy=0x7f0630133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 -- 172.21.15.125:0/859142115 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063009e6a0 con 0x7f0630134120 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062f7fe700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 0x7f06300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062ffff700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 0x7f063013bce0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0628009dc0 tx=0x7f062800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3727c1d149afc92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062e7fc700 1 -- 172.21.15.125:0/859142115 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800e070 con 0x7f0630134120 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062e7fc700 1 -- 172.21.15.125:0/859142115 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800bb20 con 0x7f0630134120 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.468+0000 7f062e7fc700 1 -- 172.21.15.125:0/859142115 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628012430 con 0x7f0630134120 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 -- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 msgr2=0x7f063013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 0x7f063013bce0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0628009dc0 tx=0x7f062800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 -- 172.21.15.125:0/859142115 shutdown_connections 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0630134120 0x7f063013bce0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 --2- 172.21.15.125:0/859142115 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06300a0a70 0x7f06300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 -- 172.21.15.125:0/859142115 >> 172.21.15.125:0/859142115 conn(0x7f06300a6610 msgr2=0x7f06300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 -- 172.21.15.125:0/859142115 shutdown_connections 2023-10-03T10:17:14.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.469+0000 7f0635eec700 1 -- 172.21.15.125:0/859142115 wait complete. 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.470+0000 7f0635eec700 1 Processor -- start 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.470+0000 7f0635eec700 1 -- start start 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06300a0a70 0x7f06301226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 0x7f0630123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630123b50 con 0x7f06300a0a70 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0630125c70 con 0x7f06300a1380 2023-10-03T10:17:14.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f0635eec700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0630133640 con 0x7f0630134120 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 0x7f0630123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45522/0 (socket says 172.21.15.125:45522) 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 -- 172.21.15.125:0/605198393 learned_addr learned my addr 172.21.15.125:0/605198393 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062f7fe700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06300a0a70 0x7f06301226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 -- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 msgr2=0x7f0630123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 0x7f0630123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 -- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06300a0a70 msgr2=0x7f06301226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.471+0000 7f062effd700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06300a0a70 0x7f06301226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f062effd700 1 -- 172.21.15.125:0/605198393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200094a0 con 0x7f06300a1380 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f062ffff700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 0x7f0630123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f062effd700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0624001eb0 tx=0x7f062400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624004c80 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624004de0 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624007310 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628009a70 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.472+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0630126280 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.473+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0624007470 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.473+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630125e90 con 0x7f06300a1380 2023-10-03T10:17:14.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.473+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f062403f2c0 con 0x7f06300a1380 2023-10-03T10:17:14.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.477+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06240106d0 con 0x7f06300a1380 2023-10-03T10:17:14.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.629+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc50c11a590 con 0x7fc50c099a60 2023-10-03T10:17:14.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.629+0000 7fc5027fc700 1 -- 172.21.15.125:0/747509386 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc508034090 con 0x7fc50c099a60 2023-10-03T10:17:14.629 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:14.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.631+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 msgr2=0x7fc50c11d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.631+0000 7fc513b38700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc508009c10 tx=0x7fc508004750 comp rx=0 tx=0).stop 2023-10-03T10:17:14.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 shutdown_connections 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc50c133b80 0x7fc50c11e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc50c099a60 0x7fc50c11d690 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 --2- 172.21.15.125:0/747509386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc50c0a0e20 0x7fc50c11dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 >> 172.21.15.125:0/747509386 conn(0x7fc50c0a2980 msgr2=0x7fc50c1bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 shutdown_connections 2023-10-03T10:17:14.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.632+0000 7fc513b38700 1 -- 172.21.15.125:0/747509386 wait complete. 2023-10-03T10:17:14.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:14.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.671+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f063004f2a0 con 0x7f06300a1380 2023-10-03T10:17:14.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.672+0000 7f0617fff700 1 -- 172.21.15.125:0/605198393 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0624011360 con 0x7f06300a1380 2023-10-03T10:17:14.671 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:14.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 msgr2=0x7f0630122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0624001eb0 tx=0x7f062400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 shutdown_connections 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0630134120 0x7f0630123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06300a0a70 0x7f06301226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 --2- 172.21.15.125:0/605198393 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06300a1380 0x7f0630122c30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 >> 172.21.15.125:0/605198393 conn(0x7f06300a6610 msgr2=0x7f063009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 shutdown_connections 2023-10-03T10:17:14.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.674+0000 7f0635eec700 1 -- 172.21.15.125:0/605198393 wait complete. 2023-10-03T10:17:14.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:14.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:14.763 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:14.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.854+0000 7f2d0e668700 1 Processor -- start 2023-10-03T10:17:14.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.854+0000 7f2d0e668700 1 -- start start 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d0e668700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d0e668700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 0x7f2d081304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d0e668700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0806b2d0 con 0x7f2d081309f0 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d0e668700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08133610 con 0x7f2d081300a0 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d0e668700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0809a500 con 0x7f2d08133ad0 2023-10-03T10:17:14.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51564/0 (socket says 172.21.15.125:51564) 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 -- 172.21.15.125:0/1150039452 learned_addr learned my addr 172.21.15.125:0/1150039452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 0x7f2d081304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d06ffd700 1 -- 172.21.15.125:0/1150039452 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075233995 0 0) 0x7f2d0806b2d0 con 0x7f2d081309f0 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 -- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 msgr2=0x7f2d081304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 0x7f2d081304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 -- 172.21.15.125:0/1150039452 >> v1:172.21.15.125:6789/0 conn(0x7f2d081309f0 legacy=0x7f2d0813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d07fff700 1 -- 172.21.15.125:0/1150039452 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d081338b0 con 0x7f2d08133ad0 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.855+0000 7f2d077fe700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 0x7f2d081304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d07fff700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009920 tx=0x7f2cf0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452f7ca5cc8405e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d06ffd700 1 -- 172.21.15.125:0/1150039452 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0011830 con 0x7f2d08133ad0 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d06ffd700 1 -- 172.21.15.125:0/1150039452 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf0011990 con 0x7f2d08133ad0 2023-10-03T10:17:14.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d06ffd700 1 -- 172.21.15.125:0/1150039452 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0011d20 con 0x7f2d08133ad0 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 -- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 msgr2=0x7f2d08133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009920 tx=0x7f2cf0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 -- 172.21.15.125:0/1150039452 shutdown_connections 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d08133ea0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1150039452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081300a0 0x7f2d081304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 -- 172.21.15.125:0/1150039452 >> 172.21.15.125:0/1150039452 conn(0x7f2d08099c40 msgr2=0x7f2d080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 -- 172.21.15.125:0/1150039452 shutdown_connections 2023-10-03T10:17:14.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.856+0000 7f2d0e668700 1 -- 172.21.15.125:0/1150039452 wait complete. 2023-10-03T10:17:14.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.857+0000 7f2d0e668700 1 Processor -- start 2023-10-03T10:17:14.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.857+0000 7f2d0e668700 1 -- start start 2023-10-03T10:17:14.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081300a0 0x7f2d0811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08120050 con 0x7f2d081300a0 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0812d990 con 0x7f2d081309f0 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0e668700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0811f060 con 0x7f2d08133ad0 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0cc05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45544/0 (socket says 172.21.15.125:45544) 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0cc05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51572/0 (socket says 172.21.15.125:51572) 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 -- 172.21.15.125:0/1953896871 learned_addr learned my addr 172.21.15.125:0/1953896871 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d07fff700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081300a0 0x7f2d0811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 -- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 msgr2=0x7f2d0811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 -- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081300a0 msgr2=0x7f2d0811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081300a0 0x7f2d0811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d077fe700 1 -- 172.21.15.125:0/1953896871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80094a0 con 0x7f2d081309f0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.858+0000 7f2d0cc05700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d077fe700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800ebe0 tx=0x7f2cf800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800c850 con 0x7f2d081309f0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800c9b0 con 0x7f2d081309f0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0009550 con 0x7f2d081309f0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800cd40 con 0x7f2d081309f0 2023-10-03T10:17:14.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.859+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0812dd00 con 0x7f2d081309f0 2023-10-03T10:17:14.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.860+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d080a2620 con 0x7f2d081309f0 2023-10-03T10:17:14.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.860+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf8013470 con 0x7f2d081309f0 2023-10-03T10:17:14.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.860+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cf803fa70 con 0x7f2d081309f0 2023-10-03T10:17:14.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.868+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cf8041e60 con 0x7f2d081309f0 2023-10-03T10:17:14.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.898+0000 7faa069b9700 1 Processor -- start 2023-10-03T10:17:14.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 -- start start 2023-10-03T10:17:14.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0009e9d0 con 0x7faa000a0a70 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009dc00 con 0x7faa00133f50 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa069b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009dec0 con 0x7faa000a1380 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7fa9fffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa04f56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa04f56700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:45552/0 (socket says 172.21.15.125:45552) 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51584/0 (socket says 172.21.15.125:51584) 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7fa9fffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40776/0 (socket says 172.21.15.125:40776) 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.899+0000 7faa04f56700 1 -- 172.21.15.125:0/2213453149 learned_addr learned my addr 172.21.15.125:0/2213453149 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 -- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 msgr2=0x7faa001343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 -- 172.21.15.125:0/2213453149 >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 msgr2=0x7faa000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 --2- 172.21.15.125:0/2213453149 >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 -- 172.21.15.125:0/2213453149 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0009e6a0 con 0x7faa000a1380 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9fffff700 1 --2- 172.21.15.125:0/2213453149 >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa04f56700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9ff7fe700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009840 tx=0x7fa9f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598b0b8c091c639 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9feffd700 1 -- 172.21.15.125:0/2213453149 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4011830 con 0x7faa000a1380 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9feffd700 1 -- 172.21.15.125:0/2213453149 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4011990 con 0x7faa000a1380 2023-10-03T10:17:14.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7fa9feffd700 1 -- 172.21.15.125:0/2213453149 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4011d20 con 0x7faa000a1380 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 -- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 msgr2=0x7faa00133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009840 tx=0x7fa9f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 -- 172.21.15.125:0/2213453149 shutdown_connections 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa00133f50 0x7faa001343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 --2- 172.21.15.125:0/2213453149 >> v2:172.21.15.125:3300/0 conn(0x7faa000a0a70 0x7faa000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 --2- 172.21.15.125:0/2213453149 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa000a1380 0x7faa00133a10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 -- 172.21.15.125:0/2213453149 >> 172.21.15.125:0/2213453149 conn(0x7faa000a6610 msgr2=0x7faa000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.900+0000 7faa069b9700 1 -- 172.21.15.125:0/2213453149 shutdown_connections 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.901+0000 7faa069b9700 1 -- 172.21.15.125:0/2213453149 wait complete. 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.901+0000 7faa069b9700 1 Processor -- start 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 -- start start 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa000a0a70 0x7faa00122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 0x7faa00122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00124600 con 0x7faa000a1380 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa00125c80 con 0x7faa000a0a70 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa069b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa000a03e0 con 0x7faa00133f50 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40778/0 (socket says 172.21.15.125:40778) 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7fa9fffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa000a0a70 0x7faa00122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 0x7faa00122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7fa9ff7fe700 1 -- 172.21.15.125:0/601561624 learned_addr learned my addr 172.21.15.125:0/601561624 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 -- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa000a0a70 msgr2=0x7faa00122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa000a0a70 0x7faa00122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 -- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 msgr2=0x7faa00122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7faa04f56700 1 -- 172.21.15.125:0/601561624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00094a0 con 0x7faa00133f50 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.902+0000 7fa9ff7fe700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7faa04f56700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 0x7faa00122fc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800efc0 tx=0x7fa9f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8018070 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800f040 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8009b30 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8003c60 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.903+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f40094a0 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.904+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f800c880 con 0x7faa00133f50 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.904+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0004f2a0 con 0x7faa00133f50 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.904+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9f803f720 con 0x7faa00133f50 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:14.908+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f801cd90 con 0x7faa00133f50 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.057+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d0804f2a0 con 0x7f2d081309f0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.057+0000 7f2d04ff9700 1 -- 172.21.15.125:0/1953896871 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf8013720 con 0x7f2d081309f0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 msgr2=0x7f2d0811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800ebe0 tx=0x7f2cf800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 shutdown_connections 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2d08133ad0 0x7f2d0811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081300a0 0x7f2d0811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 --2- 172.21.15.125:0/1953896871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2d081309f0 0x7f2d0811df80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 >> 172.21.15.125:0/1953896871 conn(0x7f2d08099c40 msgr2=0x7f2d08132c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 shutdown_connections 2023-10-03T10:17:15.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.059+0000 7f2d0e668700 1 -- 172.21.15.125:0/1953896871 wait complete. 2023-10-03T10:17:15.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.099+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa00125ea0 con 0x7faa00133f50 2023-10-03T10:17:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.099+0000 7fa9fcff9700 1 -- 172.21.15.125:0/601561624 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9f801cbb0 con 0x7faa00133f50 2023-10-03T10:17:15.099 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 msgr2=0x7faa00122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 0x7faa00122fc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800efc0 tx=0x7fa9f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 shutdown_connections 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa00133f50 0x7faa00122fc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa000a0a70 0x7faa00122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 --2- 172.21.15.125:0/601561624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa000a1380 0x7faa00122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 >> 172.21.15.125:0/601561624 conn(0x7faa000a6610 msgr2=0x7faa0009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 shutdown_connections 2023-10-03T10:17:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.101+0000 7faa069b9700 1 -- 172.21.15.125:0/601561624 wait complete. 2023-10-03T10:17:15.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:15.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:15.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:15.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 Processor -- start 2023-10-03T10:17:15.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 -- start start 2023-10-03T10:17:15.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed00993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed009a2b0 con 0x7faed012feb0 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed009a540 con 0x7faed01307c0 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faed51aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed009ad40 con 0x7faed0099920 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faecf59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faeced9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faece59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed00993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faecf59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52350/0 (socket says 172.21.15.125:52350) 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faeced9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43966/0 (socket says 172.21.15.125:43966) 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faece59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed00993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38152/0 (socket says 172.21.15.125:38152) 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.775+0000 7faecf59e700 1 -- 172.21.15.125:0/2780861152 learned_addr learned my addr 172.21.15.125:0/2780861152 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 -- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 msgr2=0x7faed00993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 --2- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed00993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 -- 172.21.15.125:0/2780861152 >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 msgr2=0x7faed0130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 --2- 172.21.15.125:0/2780861152 >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 -- 172.21.15.125:0/2780861152 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed009e640 con 0x7faed0099920 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faeced9d700 1 --2- 172.21.15.125:0/2780861152 >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecf59e700 1 --2- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e50 tx=0x7faec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4410028bde17ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecdd9b700 1 -- 172.21.15.125:0/2780861152 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800e070 con 0x7faed0099920 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecdd9b700 1 -- 172.21.15.125:0/2780861152 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800b910 con 0x7faed0099920 2023-10-03T10:17:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faecdd9b700 1 -- 172.21.15.125:0/2780861152 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800bcc0 con 0x7faed0099920 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 -- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 msgr2=0x7faed0099d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 --2- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e50 tx=0x7faec800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 -- 172.21.15.125:0/2780861152 shutdown_connections 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 --2- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed0099920 0x7faed0099d70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 --2- 172.21.15.125:0/2780861152 >> v2:172.21.15.125:3300/0 conn(0x7faed012feb0 0x7faed0130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 --2- 172.21.15.125:0/2780861152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed00993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.776+0000 7faed51aa700 1 -- 172.21.15.125:0/2780861152 >> 172.21.15.125:0/2780861152 conn(0x7faed00a2b30 msgr2=0x7faed009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.777+0000 7faed51aa700 1 -- 172.21.15.125:0/2780861152 shutdown_connections 2023-10-03T10:17:15.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.777+0000 7faed51aa700 1 -- 172.21.15.125:0/2780861152 wait complete. 2023-10-03T10:17:15.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 Processor -- start 2023-10-03T10:17:15.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 -- start start 2023-10-03T10:17:15.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faed0099920 0x7faed01c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed01c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0071f80 con 0x7faed0099920 2023-10-03T10:17:15.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed0070550 con 0x7faed01307c0 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faed51aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed0071230 con 0x7faed012feb0 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faece59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faece59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52352/0 (socket says 172.21.15.125:52352) 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faece59c700 1 -- 172.21.15.125:0/2535229103 learned_addr learned my addr 172.21.15.125:0/2535229103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faecf59e700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed01c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.778+0000 7faeced9d700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faed0099920 0x7faed01c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 -- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 msgr2=0x7faed01c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed01c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 -- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faed0099920 msgr2=0x7faed01c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faed0099920 0x7faed01c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 -- 172.21.15.125:0/2535229103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec000b4e0 con 0x7faed012feb0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faece59c700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faec4012fc0 tx=0x7faec40100c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400dbb0 con 0x7faed012feb0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4013040 con 0x7faed012feb0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4010b40 con 0x7faed012feb0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8009b30 con 0x7faed012feb0 2023-10-03T10:17:15.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.779+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0072160 con 0x7faed012feb0 2023-10-03T10:17:15.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.780+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faec4010ca0 con 0x7faed012feb0 2023-10-03T10:17:15.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.780+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faec4043aa0 con 0x7faed012feb0 2023-10-03T10:17:15.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.780+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed004f2a0 con 0x7faed012feb0 2023-10-03T10:17:15.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.785+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faec4022460 con 0x7faed012feb0 2023-10-03T10:17:15.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.816+0000 7f83df99c700 1 Processor -- start 2023-10-03T10:17:15.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.816+0000 7f83df99c700 1 -- start start 2023-10-03T10:17:15.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83df99c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 0x7f83d8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83df99c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83df99c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d809b110 con 0x7f83d8133f70 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83df99c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80a3b60 con 0x7f83d81343a0 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83df99c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80a2fa0 con 0x7f83d809ad40 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83ddf39700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dd738700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 0x7f83d8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83ddf39700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43978/0 (socket says 172.21.15.125:43978) 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83ddf39700 1 -- 172.21.15.125:0/2355168482 learned_addr learned my addr 172.21.15.125:0/2355168482 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dcf37700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83d8133f70 0x7f83d80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43806/0 (socket says 172.21.15.125:43806) 2023-10-03T10:17:15.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dd738700 1 -- 172.21.15.125:0/2355168482 >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 msgr2=0x7f83d80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dd738700 1 --2- 172.21.15.125:0/2355168482 >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dd738700 1 -- 172.21.15.125:0/2355168482 >> v1:172.21.15.125:6789/0 conn(0x7f83d8133f70 legacy=0x7f83d80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83dd738700 1 -- 172.21.15.125:0/2355168482 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d809a280 con 0x7f83d809ad40 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83cffff700 1 -- 172.21.15.125:0/2355168482 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296232211 0 0) 0x7f83d809b110 con 0x7f83d8133f70 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.817+0000 7f83ddf39700 1 --2- 172.21.15.125:0/2355168482 >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83dd738700 1 --2- 172.21.15.125:0/2355168482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 0x7f83d8133a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009870 tx=0x7f83d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1946746a5bf081dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83cffff700 1 -- 172.21.15.125:0/2355168482 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4011830 con 0x7f83d809ad40 2023-10-03T10:17:15.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83cffff700 1 -- 172.21.15.125:0/2355168482 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4011990 con 0x7f83d809ad40 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83cffff700 1 -- 172.21.15.125:0/2355168482 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4011d20 con 0x7f83d809ad40 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 -- 172.21.15.125:0/2355168482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 msgr2=0x7f83d8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 --2- 172.21.15.125:0/2355168482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 0x7f83d8133a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009870 tx=0x7f83d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 -- 172.21.15.125:0/2355168482 shutdown_connections 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 --2- 172.21.15.125:0/2355168482 >> v2:172.21.15.125:3300/0 conn(0x7f83d81343a0 0x7f83d80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 --2- 172.21.15.125:0/2355168482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d809ad40 0x7f83d8133a30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 -- 172.21.15.125:0/2355168482 >> 172.21.15.125:0/2355168482 conn(0x7f83d8099c40 msgr2=0x7f83d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 -- 172.21.15.125:0/2355168482 shutdown_connections 2023-10-03T10:17:15.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.818+0000 7f83df99c700 1 -- 172.21.15.125:0/2355168482 wait complete. 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.819+0000 7f83df99c700 1 Processor -- start 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.819+0000 7f83df99c700 1 -- start start 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d809ad40 0x7f83d811e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83d81343a0 0x7f83d811ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d81216d0 con 0x7f83d809ad40 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d809c7e0 con 0x7f83d8133f70 2023-10-03T10:17:15.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d811fff0 con 0x7f83d81343a0 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dd738700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d809ad40 0x7f83d811e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38186/0 (socket says 172.21.15.125:38186) 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 -- 172.21.15.125:0/2954851728 learned_addr learned my addr 172.21.15.125:0/2954851728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83ddf39700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83d81343a0 0x7f83d811ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 -- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83d81343a0 msgr2=0x7f83d811ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83d81343a0 0x7f83d811ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 -- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d809ad40 msgr2=0x7f83d811e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d809ad40 0x7f83d811e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 -- 172.21.15.125:0/2954851728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0009b30 con 0x7f83d8133f70 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83dcf37700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83c800c520 tx=0x7f83c800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8004c80 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8004de0 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c80072f0 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.820+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d40094a0 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.821+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d8121e60 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.821+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83c8007450 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.821+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d804f2a0 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.822+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83c803f3b0 con 0x7f83d8133f70 2023-10-03T10:17:15.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.826+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83c8007700 con 0x7f83d8133f70 2023-10-03T10:17:15.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.978+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faed006b2a0 con 0x7faed012feb0 2023-10-03T10:17:15.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.978+0000 7faeb77fe700 1 -- 172.21.15.125:0/2535229103 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faec4020360 con 0x7faed012feb0 2023-10-03T10:17:15.978 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:15.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 msgr2=0x7faed01c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faec4012fc0 tx=0x7faec40100c0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 shutdown_connections 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faed01307c0 0x7faed01c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faed0099920 0x7faed01c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 --2- 172.21.15.125:0/2535229103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faed012feb0 0x7faed01c4200 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 >> 172.21.15.125:0/2535229103 conn(0x7faed00a2b30 msgr2=0x7faed009c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 shutdown_connections 2023-10-03T10:17:15.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:15.981+0000 7faed51aa700 1 -- 172.21.15.125:0/2535229103 wait complete. 2023-10-03T10:17:15.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.017+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83d8133d50 con 0x7f83d8133f70 2023-10-03T10:17:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.018+0000 7f83cdffb700 1 -- 172.21.15.125:0/2954851728 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83c8011e80 con 0x7f83d8133f70 2023-10-03T10:17:16.017 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 msgr2=0x7f83d811e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83c800c520 tx=0x7f83c800c830 comp rx=0 tx=0).stop 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 shutdown_connections 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83d81343a0 0x7f83d811ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d809ad40 0x7f83d811e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 --2- 172.21.15.125:0/2954851728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83d8133f70 0x7f83d811e950 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 >> 172.21.15.125:0/2954851728 conn(0x7f83d8099c40 msgr2=0x7f83d809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 shutdown_connections 2023-10-03T10:17:16.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.020+0000 7f83df99c700 1 -- 172.21.15.125:0/2954851728 wait complete. 2023-10-03T10:17:16.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:16.071 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:16.113 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:16.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 Processor -- start 2023-10-03T10:17:16.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 -- start start 2023-10-03T10:17:16.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 0x7f6c94133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9409dc00 con 0x7f6c94133f50 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9409ea60 con 0x7f6c940a0a70 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.198+0000 7f6c9ad82700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9409dec0 con 0x7f6c940a1380 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c98b1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c9931f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6c94133f50 0x7f6c9413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43816/0 (socket says 172.21.15.125:43816) 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c98b1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44002/0 (socket says 172.21.15.125:44002) 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c9931f700 1 -- 172.21.15.125:0/2662159192 learned_addr learned my addr 172.21.15.125:0/2662159192 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 0x7f6c94133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 -- 172.21.15.125:0/2662159192 >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 msgr2=0x7f6c940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 --2- 172.21.15.125:0/2662159192 >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 -- 172.21.15.125:0/2662159192 >> v1:172.21.15.125:6789/0 conn(0x7f6c94133f50 legacy=0x7f6c9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c937fe700 1 -- 172.21.15.125:0/2662159192 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384767784 0 0) 0x7f6c9409dc00 con 0x7f6c94133f50 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 -- 172.21.15.125:0/2662159192 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9409e6a0 con 0x7f6c940a1380 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c98b1e700 1 --2- 172.21.15.125:0/2662159192 >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c93fff700 1 --2- 172.21.15.125:0/2662159192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 0x7f6c94133a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009840 tx=0x7f6c80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e826c701f30f4cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c937fe700 1 -- 172.21.15.125:0/2662159192 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011830 con 0x7f6c940a1380 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c937fe700 1 -- 172.21.15.125:0/2662159192 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80011990 con 0x7f6c940a1380 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.199+0000 7f6c937fe700 1 -- 172.21.15.125:0/2662159192 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011d20 con 0x7f6c940a1380 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 -- 172.21.15.125:0/2662159192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 msgr2=0x7f6c94133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/2662159192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 0x7f6c94133a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009840 tx=0x7f6c80009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 -- 172.21.15.125:0/2662159192 shutdown_connections 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/2662159192 >> v2:172.21.15.125:3300/0 conn(0x7f6c940a0a70 0x7f6c940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/2662159192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c940a1380 0x7f6c94133a10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 -- 172.21.15.125:0/2662159192 >> 172.21.15.125:0/2662159192 conn(0x7f6c940a6610 msgr2=0x7f6c940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 -- 172.21.15.125:0/2662159192 shutdown_connections 2023-10-03T10:17:16.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.200+0000 7f6c9ad82700 1 -- 172.21.15.125:0/2662159192 wait complete. 2023-10-03T10:17:16.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.201+0000 7f6c9ad82700 1 Processor -- start 2023-10-03T10:17:16.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.201+0000 7f6c9ad82700 1 -- start start 2023-10-03T10:17:16.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 0x7f6c9406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9406f680 con 0x7f6c940a0a70 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9406fca0 con 0x7f6c94133f50 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9ad82700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940707b0 con 0x7f6c940a1380 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9931f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c93fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9931f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38206/0 (socket says 172.21.15.125:38206) 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c93fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52370/0 (socket says 172.21.15.125:52370) 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.202+0000 7f6c9931f700 1 -- 172.21.15.125:0/3637774548 learned_addr learned my addr 172.21.15.125:0/3637774548 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c98b1e700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 0x7f6c9406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 -- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 msgr2=0x7f6c9406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 -- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 msgr2=0x7f6c9406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 0x7f6c9406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 -- 172.21.15.125:0/3637774548 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880094a0 con 0x7f6c940a1380 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c9931f700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c98b1e700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 0x7f6c9406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c93fff700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6c80016000 tx=0x7f6c80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800036a0 con 0x7f6c940a1380 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8001f070 con 0x7f6c940a1380 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80003a20 con 0x7f6c940a1380 2023-10-03T10:17:16.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c800094a0 con 0x7f6c940a1380 2023-10-03T10:17:16.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.203+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c940a03e0 con 0x7f6c940a1380 2023-10-03T10:17:16.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.204+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c80003b80 con 0x7f6c940a1380 2023-10-03T10:17:16.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.204+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c80021070 con 0x7f6c940a1380 2023-10-03T10:17:16.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.204+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c94070f50 con 0x7f6c940a1380 2023-10-03T10:17:16.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.209+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c94070f50 con 0x7f6c940a1380 2023-10-03T10:17:16.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.240+0000 7fcc33049700 1 Processor -- start 2023-10-03T10:17:16.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.240+0000 7fcc33049700 1 -- start start 2023-10-03T10:17:16.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc33049700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 0x7fcc2c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc33049700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc33049700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c133a60 con 0x7fcc2c133c80 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc33049700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c09a360 con 0x7fcc2c136a80 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc33049700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c09a880 con 0x7fcc2c1393a0 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 0x7fcc2c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc30de5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcc2c133c80 0x7fcc2c134050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43824/0 (socket says 172.21.15.125:43824) 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc30de5700 1 -- 172.21.15.125:0/816024167 learned_addr learned my addr 172.21.15.125:0/816024167 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc315e6700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 -- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 msgr2=0x7fcc2c13b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c13b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 -- 172.21.15.125:0/816024167 >> v1:172.21.15.125:6789/0 conn(0x7fcc2c133c80 legacy=0x7fcc2c134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2b7fe700 1 -- 172.21.15.125:0/816024167 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497304859 0 0) 0x7fcc2c133a60 con 0x7fcc2c133c80 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 -- 172.21.15.125:0/816024167 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c09ab40 con 0x7fcc2c136a80 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2bfff700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 0x7fcc2c138e60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e493c35d2fb2cc7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2b7fe700 1 -- 172.21.15.125:0/816024167 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18011830 con 0x7fcc2c136a80 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2b7fe700 1 -- 172.21.15.125:0/816024167 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18011990 con 0x7fcc2c136a80 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.241+0000 7fcc2b7fe700 1 -- 172.21.15.125:0/816024167 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18011d20 con 0x7fcc2c136a80 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 -- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 msgr2=0x7fcc2c138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 0x7fcc2c138e60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc18009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 -- 172.21.15.125:0/816024167 shutdown_connections 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 --2- 172.21.15.125:0/816024167 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c136a80 0x7fcc2c138e60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 -- 172.21.15.125:0/816024167 >> 172.21.15.125:0/816024167 conn(0x7fcc2c0a2980 msgr2=0x7fcc2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 -- 172.21.15.125:0/816024167 shutdown_connections 2023-10-03T10:17:16.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.242+0000 7fcc33049700 1 -- 172.21.15.125:0/816024167 wait complete. 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.243+0000 7fcc33049700 1 Processor -- start 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.243+0000 7fcc33049700 1 -- start start 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 0x7fcc2c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c12df40 con 0x7fcc2c136a80 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c11b0a0 con 0x7fcc2c133c80 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc33049700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c11a9d0 con 0x7fcc2c1393a0 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44026/0 (socket says 172.21.15.125:44026) 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc2bfff700 1 -- 172.21.15.125:0/826321566 learned_addr learned my addr 172.21.15.125:0/826321566 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc315e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.244+0000 7fcc30de5700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 0x7fcc2c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 -- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 msgr2=0x7fcc2c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 -- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 msgr2=0x7fcc2c119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 -- 172.21.15.125:0/826321566 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180094a0 con 0x7fcc2c133c80 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc2bfff700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc315e6700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc30de5700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 0x7fcc2c118df0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c470 tx=0x7fcc2000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004c80 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc20004de0 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20007310 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c09f2b0 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.245+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c11b640 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.246+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc20007470 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.246+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcc2003f1f0 con 0x7fcc2c133c80 2023-10-03T10:17:16.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.246+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c04f2a0 con 0x7fcc2c133c80 2023-10-03T10:17:16.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.255+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc20007720 con 0x7fcc2c133c80 2023-10-03T10:17:16.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.406+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c94070f50 con 0x7f6c940a1380 2023-10-03T10:17:16.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.406+0000 7f6c917fa700 1 -- 172.21.15.125:0/3637774548 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c94070f50 con 0x7f6c940a1380 2023-10-03T10:17:16.406 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.408+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 msgr2=0x7f6c9406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.408+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6c80016000 tx=0x7f6c80004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 shutdown_connections 2023-10-03T10:17:16.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6c94133f50 0x7f6c9406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c940a0a70 0x7f6c9406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 --2- 172.21.15.125:0/3637774548 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6c940a1380 0x7f6c9406e000 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 >> 172.21.15.125:0/3637774548 conn(0x7f6c940a6610 msgr2=0x7f6c940a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 shutdown_connections 2023-10-03T10:17:16.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.409+0000 7f6c9ad82700 1 -- 172.21.15.125:0/3637774548 wait complete. 2023-10-03T10:17:16.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.448+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc2c06bce0 con 0x7fcc2c133c80 2023-10-03T10:17:16.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.448+0000 7fcc297fa700 1 -- 172.21.15.125:0/826321566 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc20011360 con 0x7fcc2c133c80 2023-10-03T10:17:16.448 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:16.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.450+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 msgr2=0x7fcc2c118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.450+0000 7fcc33049700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 0x7fcc2c118df0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c470 tx=0x7fcc2000c780 comp rx=0 tx=0).stop 2023-10-03T10:17:16.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.450+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 shutdown_connections 2023-10-03T10:17:16.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcc2c1393a0 0x7fcc2c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcc2c133c80 0x7fcc2c118df0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 --2- 172.21.15.125:0/826321566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc2c136a80 0x7fcc2c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 >> 172.21.15.125:0/826321566 conn(0x7fcc2c0a2980 msgr2=0x7fcc2c131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 shutdown_connections 2023-10-03T10:17:16.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:16.451+0000 7fcc33049700 1 -- 172.21.15.125:0/826321566 wait complete. 2023-10-03T10:17:16.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:16.993 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:17.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:17.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.124+0000 7fd53cb10700 1 Processor -- start 2023-10-03T10:17:17.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 -- start start 2023-10-03T10:17:17.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd538133ad0 0x7fd538133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53806b2d0 con 0x7fd538133ad0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538133610 con 0x7fd5381300a0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53cb10700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd53809a500 con 0x7fd5381309f0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd538133ad0 0x7fd538133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd536d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd535d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd538133ad0 0x7fd538133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44042/0 (socket says 172.21.15.125:44042) 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd535d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38220/0 (socket says 172.21.15.125:38220) 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd536d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52400/0 (socket says 172.21.15.125:52400) 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.125+0000 7fd53659c700 1 -- 172.21.15.125:0/48042132 learned_addr learned my addr 172.21.15.125:0/48042132 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 -- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 msgr2=0x7fd53813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 -- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 msgr2=0x7fd5381304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 -- 172.21.15.125:0/48042132 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5381338b0 con 0x7fd538133ad0 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd536d9d700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd535d9b700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53659c700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd538133ad0 0x7fd538133ea0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd5280098f0 tx=0x7fd528009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3dfa6ecd129440 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53559a700 1 -- 172.21.15.125:0/48042132 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011830 con 0x7fd538133ad0 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53559a700 1 -- 172.21.15.125:0/48042132 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528011990 con 0x7fd538133ad0 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.126+0000 7fd53559a700 1 -- 172.21.15.125:0/48042132 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011d20 con 0x7fd538133ad0 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 -- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd538133ad0 msgr2=0x7fd538133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd538133ad0 0x7fd538133ea0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd5280098f0 tx=0x7fd528009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 -- 172.21.15.125:0/48042132 shutdown_connections 2023-10-03T10:17:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5381309f0 0x7fd53813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd538133ad0 0x7fd538133ea0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 --2- 172.21.15.125:0/48042132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 -- 172.21.15.125:0/48042132 >> 172.21.15.125:0/48042132 conn(0x7fd538099c40 msgr2=0x7fd5380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 -- 172.21.15.125:0/48042132 shutdown_connections 2023-10-03T10:17:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.127+0000 7fd53cb10700 1 -- 172.21.15.125:0/48042132 wait complete. 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 Processor -- start 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 -- start start 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 0x7fd5381c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53811fe90 con 0x7fd5381309f0 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538120170 con 0x7fd5381300a0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53cb10700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380a33c0 con 0x7fd538133ad0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd535d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd53659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd535d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44050/0 (socket says 172.21.15.125:44050) 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd535d9b700 1 -- 172.21.15.125:0/3878198990 learned_addr learned my addr 172.21.15.125:0/3878198990 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.128+0000 7fd536d9d700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 0x7fd5381c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 -- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 msgr2=0x7fd5381c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 0x7fd5381c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 -- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 msgr2=0x7fd5381c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 -- 172.21.15.125:0/3878198990 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c0094a0 con 0x7fd5381300a0 2023-10-03T10:17:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd536d9d700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 0x7fd5381c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd535d9b700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53659c700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381c8750 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd528016000 tx=0x7fd528004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528004240 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52801f070 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd530009a70 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5280036a0 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.129+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd528009550 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.130+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd528021030 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.130+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd538133270 con 0x7fd5381300a0 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.130+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd528040780 con 0x7fd5381300a0 2023-10-03T10:17:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.135+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5280239c0 con 0x7fd5381300a0 2023-10-03T10:17:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 Processor -- start 2023-10-03T10:17:17.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 -- start start 2023-10-03T10:17:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7009ad40 0x7f6a70133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7009b110 con 0x7f6a70133f70 2023-10-03T10:17:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700a3b60 con 0x7f6a7009ad40 2023-10-03T10:17:17.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a75dc0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70134850 con 0x7f6a701343d0 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7009ad40 0x7f6a70133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7009ad40 0x7f6a70133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44060/0 (socket says 172.21.15.125:44060) 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52420/0 (socket says 172.21.15.125:52420) 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6f7fe700 1 -- 172.21.15.125:0/2110608101 learned_addr learned my addr 172.21.15.125:0/2110608101 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.164+0000 7f6a6effd700 1 --1- 172.21.15.125:0/2110608101 >> v1:172.21.15.125:6789/0 conn(0x7f6a70133f70 0x7f6a700a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43830/0 (socket says 172.21.15.125:43830) 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6f7fe700 1 -- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 msgr2=0x7f6a700a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6f7fe700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6f7fe700 1 -- 172.21.15.125:0/2110608101 >> v1:172.21.15.125:6789/0 conn(0x7f6a70133f70 legacy=0x7f6a700a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6f7fe700 1 -- 172.21.15.125:0/2110608101 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700a2fa0 con 0x7f6a7009ad40 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6ffff700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6e7fc700 1 -- 172.21.15.125:0/2110608101 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650877383 0 0) 0x7f6a7009b110 con 0x7f6a70133f70 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6f7fe700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a70133a30 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098f0 tx=0x7f6a60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fbeaa4f1e5acc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6e7fc700 1 -- 172.21.15.125:0/2110608101 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60011830 con 0x7f6a7009ad40 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6e7fc700 1 -- 172.21.15.125:0/2110608101 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60011990 con 0x7f6a7009ad40 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.165+0000 7f6a6e7fc700 1 -- 172.21.15.125:0/2110608101 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60011d20 con 0x7f6a7009ad40 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 -- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 msgr2=0x7f6a70133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a70133a30 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098f0 tx=0x7f6a60009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 -- 172.21.15.125:0/2110608101 shutdown_connections 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a701343d0 0x7f6a700a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/2110608101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a70133a30 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 -- 172.21.15.125:0/2110608101 >> 172.21.15.125:0/2110608101 conn(0x7f6a70099c40 msgr2=0x7f6a7006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 -- 172.21.15.125:0/2110608101 shutdown_connections 2023-10-03T10:17:17.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.166+0000 7f6a75dc0700 1 -- 172.21.15.125:0/2110608101 wait complete. 2023-10-03T10:17:17.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.167+0000 7f6a75dc0700 1 Processor -- start 2023-10-03T10:17:17.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.167+0000 7f6a75dc0700 1 -- start start 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a7011f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 0x7f6a7011fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 0x7f6a701c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7011f140 con 0x7f6a7009ad40 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70133790 con 0x7f6a701343d0 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70133550 con 0x7f6a70133f70 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 0x7f6a7011fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a7011f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 0x7f6a701c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 0x7f6a7011fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52428/0 (socket says 172.21.15.125:52428) 2023-10-03T10:17:17.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a7011f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44070/0 (socket says 172.21.15.125:44070) 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6effd700 1 -- 172.21.15.125:0/1655223083 learned_addr learned my addr 172.21.15.125:0/1655223083 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 -- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 msgr2=0x7f6a7011fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 0x7f6a7011fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 -- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 msgr2=0x7f6a7011f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a7011f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 -- 172.21.15.125:0/1655223083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009a70 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a6ffff700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 0x7f6a701c8230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009e50 tx=0x7f6a6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800ca90 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800f040 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60009550 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800ce50 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.168+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a701207d0 con 0x7f6a701343d0 2023-10-03T10:17:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.169+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a68014480 con 0x7f6a701343d0 2023-10-03T10:17:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.169+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a6803fc90 con 0x7f6a701343d0 2023-10-03T10:17:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.169+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7004f2a0 con 0x7f6a701343d0 2023-10-03T10:17:17.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.174+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a68012930 con 0x7f6a701343d0 2023-10-03T10:17:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.324+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd53804f2a0 con 0x7fd5381300a0 2023-10-03T10:17:17.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.324+0000 7fd526ffd700 1 -- 172.21.15.125:0/3878198990 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5280233d0 con 0x7fd5381300a0 2023-10-03T10:17:17.324 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 msgr2=0x7fd5381c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381c8750 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd528016000 tx=0x7fd528004750 comp rx=0 tx=0).stop 2023-10-03T10:17:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 shutdown_connections 2023-10-03T10:17:17.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd538133ad0 0x7fd5381c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5381300a0 0x7fd5381c8750 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 --2- 172.21.15.125:0/3878198990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5381309f0 0x7fd5381c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.326+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 >> 172.21.15.125:0/3878198990 conn(0x7fd538099c40 msgr2=0x7fd5381320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.327+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 shutdown_connections 2023-10-03T10:17:17.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.327+0000 7fd53cb10700 1 -- 172.21.15.125:0/3878198990 wait complete. 2023-10-03T10:17:17.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.363+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a70120d50 con 0x7f6a701343d0 2023-10-03T10:17:17.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.363+0000 7f6a57fff700 1 -- 172.21.15.125:0/1655223083 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a68012340 con 0x7f6a701343d0 2023-10-03T10:17:17.363 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 msgr2=0x7f6a701c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 0x7f6a701c8230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009e50 tx=0x7f6a6800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 shutdown_connections 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a701343d0 0x7f6a701c8230 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7009ad40 0x7f6a7011f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 --2- 172.21.15.125:0/1655223083 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a70133f70 0x7f6a7011fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 >> 172.21.15.125:0/1655223083 conn(0x7f6a70099c40 msgr2=0x7f6a700a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 shutdown_connections 2023-10-03T10:17:17.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.365+0000 7f6a75dc0700 1 -- 172.21.15.125:0/1655223083 wait complete. 2023-10-03T10:17:17.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:17.421 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:17.463 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:17.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.549+0000 7f20fc93d700 1 Processor -- start 2023-10-03T10:17:17.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.549+0000 7f20fc93d700 1 -- start start 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20fc93d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 0x7f20f8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20fc93d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20fc93d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f809b110 con 0x7f20f809ad40 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20fc93d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f80a3b60 con 0x7f20f8134140 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20fc93d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80a1a80 con 0x7f20f81345a0 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 0x7f20f8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52434/0 (socket says 172.21.15.125:52434) 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 -- 172.21.15.125:0/144156755 learned_addr learned my addr 172.21.15.125:0/144156755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 -- 172.21.15.125:0/144156755 >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 msgr2=0x7f20f8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 --2- 172.21.15.125:0/144156755 >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 0x7f20f8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 -- 172.21.15.125:0/144156755 >> v1:172.21.15.125:6789/0 conn(0x7f20f809ad40 legacy=0x7f20f8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f6d9d700 1 -- 172.21.15.125:0/144156755 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80a2fa0 con 0x7f20f81345a0 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f559a700 1 -- 172.21.15.125:0/144156755 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427424824 0 0) 0x7f20f809b110 con 0x7f20f809ad40 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.550+0000 7f20f5d9b700 1 --2- 172.21.15.125:0/144156755 >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 0x7f20f8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20f6d9d700 1 --2- 172.21.15.125:0/144156755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009e50 tx=0x7f20f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4db9ed3c9c57e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20f559a700 1 -- 172.21.15.125:0/144156755 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000e070 con 0x7f20f81345a0 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20f559a700 1 -- 172.21.15.125:0/144156755 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f000b910 con 0x7f20f81345a0 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20f559a700 1 -- 172.21.15.125:0/144156755 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000bcc0 con 0x7f20f81345a0 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 -- 172.21.15.125:0/144156755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 msgr2=0x7f20f813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 --2- 172.21.15.125:0/144156755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009e50 tx=0x7f20f000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:17.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 -- 172.21.15.125:0/144156755 shutdown_connections 2023-10-03T10:17:17.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 --2- 172.21.15.125:0/144156755 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f81345a0 0x7f20f813b3d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 --2- 172.21.15.125:0/144156755 >> v2:172.21.15.125:3300/0 conn(0x7f20f8134140 0x7f20f8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 -- 172.21.15.125:0/144156755 >> 172.21.15.125:0/144156755 conn(0x7f20f8099c40 msgr2=0x7f20f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 -- 172.21.15.125:0/144156755 shutdown_connections 2023-10-03T10:17:17.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.551+0000 7f20fc93d700 1 -- 172.21.15.125:0/144156755 wait complete. 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 Processor -- start 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 -- start start 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 0x7f20f8139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 0x7f20f8139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f811ea20 con 0x7f20f8134140 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f811cd50 con 0x7f20f81345a0 2023-10-03T10:17:17.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.553+0000 7f20fc93d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20f811dfa0 con 0x7f20f809ad40 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52444/0 (socket says 172.21.15.125:52444) 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 -- 172.21.15.125:0/1187043374 learned_addr learned my addr 172.21.15.125:0/1187043374 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f6d9d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 0x7f20f8139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f5d9b700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 0x7f20f8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 -- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 msgr2=0x7f20f8139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 0x7f20f8139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 -- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 msgr2=0x7f20f8139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 0x7f20f8139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 -- 172.21.15.125:0/1187043374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0094a0 con 0x7f20f809ad40 2023-10-03T10:17:17.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f6d9d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 0x7f20f8139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f5d9b700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 0x7f20f8139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20f659c700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c480 tx=0x7f20e800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80054e0 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800ce50 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80038c0 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0009b30 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.554+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f809c7e0 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.555+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20e8003a20 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.555+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f81361e0 con 0x7f20f809ad40 2023-10-03T10:17:17.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.555+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20e803ea30 con 0x7f20f809ad40 2023-10-03T10:17:17.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.560+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20e8017070 con 0x7f20f809ad40 2023-10-03T10:17:17.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.591+0000 7f52cc005700 1 Processor -- start 2023-10-03T10:17:17.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.591+0000 7f52cc005700 1 -- start start 2023-10-03T10:17:17.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 0x7f52c40a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40a3b60 con 0x7f52c40a0a70 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41348e0 con 0x7f52c409ad40 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52cc005700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c409b110 con 0x7f52c4133f70 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c9da1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52458/0 (socket says 172.21.15.125:52458) 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c9da1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38248/0 (socket says 172.21.15.125:38248) 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 -- 172.21.15.125:0/3368128264 learned_addr learned my addr 172.21.15.125:0/3368128264 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52ca5a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 0x7f52c40a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 -- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 msgr2=0x7f52c4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 -- 172.21.15.125:0/3368128264 >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 msgr2=0x7f52c40a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 --2- 172.21.15.125:0/3368128264 >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 0x7f52c40a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c95a0700 1 -- 172.21.15.125:0/3368128264 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40a2fa0 con 0x7f52c4133f70 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52ca5a2700 1 --2- 172.21.15.125:0/3368128264 >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 0x7f52c40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.592+0000 7f52c9da1700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52c95a0700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098f0 tx=0x7f52b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8686056177a94cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52c8d9f700 1 -- 172.21.15.125:0/3368128264 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52c4133f70 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52c8d9f700 1 -- 172.21.15.125:0/3368128264 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4011990 con 0x7f52c4133f70 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52c8d9f700 1 -- 172.21.15.125:0/3368128264 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d20 con 0x7f52c4133f70 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 -- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 msgr2=0x7f52c41343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098f0 tx=0x7f52b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 -- 172.21.15.125:0/3368128264 shutdown_connections 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c409ad40 0x7f52c4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 --2- 172.21.15.125:0/3368128264 >> v2:172.21.15.125:3300/0 conn(0x7f52c40a0a70 0x7f52c40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 --2- 172.21.15.125:0/3368128264 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c4133f70 0x7f52c41343a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 -- 172.21.15.125:0/3368128264 >> 172.21.15.125:0/3368128264 conn(0x7f52c4099c40 msgr2=0x7f52c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 -- 172.21.15.125:0/3368128264 shutdown_connections 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.593+0000 7f52cc005700 1 -- 172.21.15.125:0/3368128264 wait complete. 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.594+0000 7f52cc005700 1 Processor -- start 2023-10-03T10:17:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.594+0000 7f52cc005700 1 -- start start 2023-10-03T10:17:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 0x7f52c4121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 0x7f52c4121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4122e40 con 0x7f52c4133f70 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4124b10 con 0x7f52c40a0a70 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52cc005700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4123cd0 con 0x7f52c409ad40 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c95a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 0x7f52c4121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c9da1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 0x7f52c4121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c95a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38256/0 (socket says 172.21.15.125:38256) 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c95a0700 1 -- 172.21.15.125:0/100188850 learned_addr learned my addr 172.21.15.125:0/100188850 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 -- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 msgr2=0x7f52c4121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 0x7f52c4121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 -- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 msgr2=0x7f52c4121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 -- 172.21.15.125:0/100188850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00094a0 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c95a0700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52c9da1700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 0x7f52c4121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ca5a2700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 0x7f52c4121cb0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.595+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc003a20 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.596+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00f040 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.596+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc003de0 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.596+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc009a70 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.596+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b4009550 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.596+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52bc00ca30 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.597+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52bc03ff70 con 0x7f52c4133f70 2023-10-03T10:17:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.597+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c409bf00 con 0x7f52c4133f70 2023-10-03T10:17:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.601+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52bc01b360 con 0x7f52c4133f70 2023-10-03T10:17:17.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.754+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20f804f2a0 con 0x7f20f809ad40 2023-10-03T10:17:17.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.754+0000 7f20e6ffd700 1 -- 172.21.15.125:0/1187043374 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20e8019b20 con 0x7f20f809ad40 2023-10-03T10:17:17.754 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 msgr2=0x7f20f8139320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c480 tx=0x7f20e800c790 comp rx=0 tx=0).stop 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 shutdown_connections 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f81345a0 0x7f20f8139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f20f809ad40 0x7f20f8139320 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 --2- 172.21.15.125:0/1187043374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f8134140 0x7f20f8139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 >> 172.21.15.125:0/1187043374 conn(0x7f20f8099c40 msgr2=0x7f20f813af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 shutdown_connections 2023-10-03T10:17:17.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.756+0000 7f20fc93d700 1 -- 172.21.15.125:0/1187043374 wait complete. 2023-10-03T10:17:17.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.794+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52c411e060 con 0x7f52c4133f70 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.795+0000 7f52ba7fc700 1 -- 172.21.15.125:0/100188850 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52bc02c090 con 0x7f52c4133f70 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:17.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 msgr2=0x7f52c4121cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 0x7f52c4121cb0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 shutdown_connections 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52c4133f70 0x7f52c4121cb0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52c409ad40 0x7f52c4121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 --2- 172.21.15.125:0/100188850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52c40a0a70 0x7f52c4121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 >> 172.21.15.125:0/100188850 conn(0x7f52c4099c40 msgr2=0x7f52c41332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 shutdown_connections 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:17.797+0000 7f52cc005700 1 -- 172.21.15.125:0/100188850 wait complete. 2023-10-03T10:17:17.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:18.339 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:18.377 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:18.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.467+0000 7f487d5a2700 1 Processor -- start 2023-10-03T10:17:18.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.467+0000 7f487d5a2700 1 -- start start 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f487809e870 0x7f487809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4878131d70 0x7f48781321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48780a0920 con 0x7f487809e870 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487809c970 con 0x7f487809f180 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f487d5a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487809bab0 con 0x7f4878131d70 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48777fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4878131d70 0x7f48781321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38268/0 (socket says 172.21.15.125:38268) 2023-10-03T10:17:18.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 -- 172.21.15.125:0/1710442581 learned_addr learned my addr 172.21.15.125:0/1710442581 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f4876ffd700 1 --2- 172.21.15.125:0/1710442581 >> v2:172.21.15.125:3300/0 conn(0x7f487809e870 0x7f487809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 -- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4878131d70 msgr2=0x7f48781321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 --2- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4878131d70 0x7f48781321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 -- 172.21.15.125:0/1710442581 >> v2:172.21.15.125:3300/0 conn(0x7f487809e870 msgr2=0x7f487809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 --2- 172.21.15.125:0/1710442581 >> v2:172.21.15.125:3300/0 conn(0x7f487809e870 0x7f487809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 -- 172.21.15.125:0/1710442581 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487809f9c0 con 0x7f487809f180 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f48767fc700 1 --2- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f486c009920 tx=0x7f486c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f83601c3e2879f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f4875ffb700 1 -- 172.21.15.125:0/1710442581 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c011830 con 0x7f487809f180 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f4875ffb700 1 -- 172.21.15.125:0/1710442581 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c011990 con 0x7f487809f180 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.468+0000 7f4875ffb700 1 -- 172.21.15.125:0/1710442581 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c011d20 con 0x7f487809f180 2023-10-03T10:17:18.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 -- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 msgr2=0x7f4878131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 --2- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f486c009920 tx=0x7f486c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 -- 172.21.15.125:0/1710442581 shutdown_connections 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 --2- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4878131d70 0x7f48781321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 --2- 172.21.15.125:0/1710442581 >> v2:172.21.15.125:3300/0 conn(0x7f487809e870 0x7f487809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 --2- 172.21.15.125:0/1710442581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f487809f180 0x7f4878131830 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 -- 172.21.15.125:0/1710442581 >> 172.21.15.125:0/1710442581 conn(0x7f48780a4430 msgr2=0x7f48780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 -- 172.21.15.125:0/1710442581 shutdown_connections 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.469+0000 7f487d5a2700 1 -- 172.21.15.125:0/1710442581 wait complete. 2023-10-03T10:17:18.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.470+0000 7f487d5a2700 1 Processor -- start 2023-10-03T10:17:18.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.470+0000 7f487d5a2700 1 -- start start 2023-10-03T10:17:18.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487809e870 0x7f48781c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 0x7f48781c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4878120ff0 con 0x7f487809e870 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487806d6b0 con 0x7f4878131d70 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f487d5a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4878122630 con 0x7f487809f180 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48767fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48767fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52492/0 (socket says 172.21.15.125:52492) 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 0x7f48781c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48767fc700 1 -- 172.21.15.125:0/431538292 learned_addr learned my addr 172.21.15.125:0/431538292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f4876ffd700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487809e870 0x7f48781c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 -- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 msgr2=0x7f48781c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 -- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487809e870 msgr2=0x7f48781c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487809e870 0x7f48781c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 -- 172.21.15.125:0/431538292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009550 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48767fc700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f48777fe700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 0x7f48781c8db0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f487000efc0 tx=0x7f487000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.471+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000cc90 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.472+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000f040 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.472+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700146c0 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.472+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48781216a0 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.472+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487809dba0 con 0x7f4878131d70 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.473+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4870014820 con 0x7f4878131d70 2023-10-03T10:17:18.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.473+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4870040560 con 0x7f4878131d70 2023-10-03T10:17:18.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.474+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487804f2a0 con 0x7f4878131d70 2023-10-03T10:17:18.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.479+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4870009e60 con 0x7f4878131d70 2023-10-03T10:17:18.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.510+0000 7f183a123700 1 Processor -- start 2023-10-03T10:17:18.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.510+0000 7f183a123700 1 -- start start 2023-10-03T10:17:18.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f183a123700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f183a123700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f183a123700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183409dc00 con 0x7f1834133f50 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f183a123700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183409ea60 con 0x7f18340a0a70 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f183a123700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f183409dec0 con 0x7f18340a1380 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44120/0 (socket says 172.21.15.125:44120) 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52508/0 (socket says 172.21.15.125:52508) 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18337fe700 1 -- 172.21.15.125:0/3126092315 learned_addr learned my addr 172.21.15.125:0/3126092315 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 -- 172.21.15.125:0/3126092315 >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 msgr2=0x7f18340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 --2- 172.21.15.125:0/3126092315 >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 -- 172.21.15.125:0/3126092315 >> v1:172.21.15.125:6789/0 conn(0x7f1834133f50 legacy=0x7f183413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 -- 172.21.15.125:0/3126092315 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183409e6a0 con 0x7f18340a1380 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18327fc700 1 -- 172.21.15.125:0/3126092315 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537285392 0 0) 0x7f183409dc00 con 0x7f1834133f50 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18337fe700 1 --2- 172.21.15.125:0/3126092315 >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f1832ffd700 1 --2- 172.21.15.125:0/3126092315 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f181c009840 tx=0x7f181c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d578e9e794a87ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.511+0000 7f18327fc700 1 -- 172.21.15.125:0/3126092315 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c011830 con 0x7f18340a1380 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f18327fc700 1 -- 172.21.15.125:0/3126092315 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c011990 con 0x7f18340a1380 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f18327fc700 1 -- 172.21.15.125:0/3126092315 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c011d20 con 0x7f18340a1380 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 -- 172.21.15.125:0/3126092315 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 msgr2=0x7f1834133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 --2- 172.21.15.125:0/3126092315 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f181c009840 tx=0x7f181c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 -- 172.21.15.125:0/3126092315 shutdown_connections 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 --2- 172.21.15.125:0/3126092315 >> v2:172.21.15.125:3300/0 conn(0x7f18340a0a70 0x7f18340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 --2- 172.21.15.125:0/3126092315 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f1834133a10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 -- 172.21.15.125:0/3126092315 >> 172.21.15.125:0/3126092315 conn(0x7f18340a6610 msgr2=0x7f18340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 -- 172.21.15.125:0/3126092315 shutdown_connections 2023-10-03T10:17:18.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.512+0000 7f183a123700 1 -- 172.21.15.125:0/3126092315 wait complete. 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.513+0000 7f183a123700 1 Processor -- start 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.513+0000 7f183a123700 1 -- start start 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1834133f50 0x7f18341c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834122320 con 0x7f18340a0a70 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1834120660 con 0x7f1834133f50 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18340a17b0 con 0x7f18340a1380 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f18337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52510/0 (socket says 172.21.15.125:52510) 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 -- 172.21.15.125:0/710686266 learned_addr learned my addr 172.21.15.125:0/710686266 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f18337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44122/0 (socket says 172.21.15.125:44122) 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1833fff700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1834133f50 0x7f18341c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 -- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1834133f50 msgr2=0x7f18341c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1834133f50 0x7f18341c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 -- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 msgr2=0x7f18341c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 -- 172.21.15.125:0/710686266 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009b30 con 0x7f18340a1380 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f18337fe700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f1832ffd700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f181c009fd0 tx=0x7f181c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0036a0 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c01f070 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 -- 172.21.15.125:0/710686266 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c0094a0 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c003a60 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.514+0000 7f183a123700 1 -- 172.21.15.125:0/710686266 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1834120e50 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.515+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f181c003bc0 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.515+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f181c021070 con 0x7f18340a1380 2023-10-03T10:17:18.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.515+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c0052e0 con 0x7f18340a1380 2023-10-03T10:17:18.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.524+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f181c015020 con 0x7f18340a1380 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.675+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4878122410 con 0x7f4878131d70 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.676+0000 7f485f7fe700 1 -- 172.21.15.125:0/431538292 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f487002c090 con 0x7f4878131d70 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 msgr2=0x7f48781c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 0x7f48781c8db0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f487000efc0 tx=0x7f487000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 shutdown_connections 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4878131d70 0x7f48781c8db0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f487809e870 0x7f48781c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 --2- 172.21.15.125:0/431538292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f487809f180 0x7f48781c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 >> 172.21.15.125:0/431538292 conn(0x7f48780a4430 msgr2=0x7f48781b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 shutdown_connections 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.678+0000 7f487d5a2700 1 -- 172.21.15.125:0/431538292 wait complete. 2023-10-03T10:17:18.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:18.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.716+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f180c005590 con 0x7f18340a1380 2023-10-03T10:17:18.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.716+0000 7f182bfff700 1 -- 172.21.15.125:0/710686266 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f181c0253e0 con 0x7f18340a1380 2023-10-03T10:17:18.716 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 msgr2=0x7f18341c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f181c009fd0 tx=0x7f181c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 shutdown_connections 2023-10-03T10:17:18.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1834133f50 0x7f18341c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18340a0a70 0x7f18341c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 --2- 172.21.15.125:0/710686266 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f18340a1380 0x7f18341c89a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.718+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 >> 172.21.15.125:0/710686266 conn(0x7f18340a6610 msgr2=0x7f18340a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.719+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 shutdown_connections 2023-10-03T10:17:18.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.719+0000 7f1829ffb700 1 -- 172.21.15.125:0/710686266 wait complete. 2023-10-03T10:17:18.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:18.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:18.808 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:18.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.898+0000 7fbd6c73f700 1 Processor -- start 2023-10-03T10:17:18.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.898+0000 7fbd6c73f700 1 -- start start 2023-10-03T10:17:18.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd6409e870 0x7fbd6409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 0x7fbd64131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 0x7fbd641321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd640a0920 con 0x7fbd6409e870 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409c970 con 0x7fbd64131d70 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6c73f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409bab0 con 0x7fbd6409f180 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6a4db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd6409e870 0x7fbd6409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd69cda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 0x7fbd64131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6acdc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 0x7fbd641321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6a4db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd6409e870 0x7fbd6409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44138/0 (socket says 172.21.15.125:44138) 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd69cda700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 0x7fbd64131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52520/0 (socket says 172.21.15.125:52520) 2023-10-03T10:17:18.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.899+0000 7fbd6a4db700 1 -- 172.21.15.125:0/1185343272 learned_addr learned my addr 172.21.15.125:0/1185343272 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 -- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 msgr2=0x7fbd64131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 0x7fbd64131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 -- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 msgr2=0x7fbd641321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 0x7fbd641321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 -- 172.21.15.125:0/1185343272 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6409f9c0 con 0x7fbd6409e870 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6acdc700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 0x7fbd641321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd6a4db700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409e870 0x7fbd6409ec40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009920 tx=0x7fbd60009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ba6be7611d60a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd694d9700 1 -- 172.21.15.125:0/1185343272 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60011830 con 0x7fbd6409e870 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd694d9700 1 -- 172.21.15.125:0/1185343272 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60011990 con 0x7fbd6409e870 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.900+0000 7fbd694d9700 1 -- 172.21.15.125:0/1185343272 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60011d20 con 0x7fbd6409e870 2023-10-03T10:17:18.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 -- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409e870 msgr2=0x7fbd6409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409e870 0x7fbd6409ec40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009920 tx=0x7fbd60009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 -- 172.21.15.125:0/1185343272 shutdown_connections 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd64131d70 0x7fbd641321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409e870 0x7fbd6409ec40 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/1185343272 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd6409f180 0x7fbd64131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 -- 172.21.15.125:0/1185343272 >> 172.21.15.125:0/1185343272 conn(0x7fbd640a4430 msgr2=0x7fbd640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 -- 172.21.15.125:0/1185343272 shutdown_connections 2023-10-03T10:17:18.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.901+0000 7fbd6c73f700 1 -- 172.21.15.125:0/1185343272 wait complete. 2023-10-03T10:17:18.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.902+0000 7fbd6c73f700 1 Processor -- start 2023-10-03T10:17:18.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.902+0000 7fbd6c73f700 1 -- start start 2023-10-03T10:17:18.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 0x7fbd6411d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 0x7fbd6411db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd641208e0 con 0x7fbd6409f180 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409dba0 con 0x7fbd6409e870 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6c73f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6411edc0 con 0x7fbd64131d70 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44140/0 (socket says 172.21.15.125:44140) 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6a4db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 0x7fbd6411d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 -- 172.21.15.125:0/736601941 learned_addr learned my addr 172.21.15.125:0/736601941 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6acdc700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 0x7fbd6411db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 -- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 msgr2=0x7fbd6411db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 0x7fbd6411db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 -- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 msgr2=0x7fbd6411d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 0x7fbd6411d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 -- 172.21.15.125:0/736601941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c009a70 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6acdc700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 0x7fbd6411db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd6a4db700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 0x7fbd6411d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd69cda700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e960 tx=0x7fbd5400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400c5e0 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.903+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400c740 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd60009550 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400cad0 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd64120bc0 con 0x7fbd6409f180 2023-10-03T10:17:18.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd5400cc30 con 0x7fbd6409f180 2023-10-03T10:17:18.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd5403f9d0 con 0x7fbd6409f180 2023-10-03T10:17:18.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.904+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6404f2a0 con 0x7fbd6409f180 2023-10-03T10:17:18.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.909+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd54017080 con 0x7fbd6409f180 2023-10-03T10:17:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.940+0000 7f8c48b64700 1 Processor -- start 2023-10-03T10:17:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.940+0000 7f8c48b64700 1 -- start start 2023-10-03T10:17:18.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c48b64700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c440a0a70 0x7f8c440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c48b64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 0x7f8c44133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c48b64700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4409dc00 con 0x7f8c44133f50 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c48b64700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4409ea60 con 0x7f8c440a0a70 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c48b64700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4409dec0 con 0x7f8c440a1380 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c440a0a70 0x7f8c440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c42d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8c44133f50 0x7f8c4413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43864/0 (socket says 172.21.15.125:43864) 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c41d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 0x7f8c44133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c440a0a70 0x7f8c440a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44150/0 (socket says 172.21.15.125:44150) 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c42d9d700 1 -- 172.21.15.125:0/4261106133 learned_addr learned my addr 172.21.15.125:0/4261106133 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 -- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 msgr2=0x7f8c44133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 0x7f8c44133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 -- 172.21.15.125:0/4261106133 >> v1:172.21.15.125:6789/0 conn(0x7f8c44133f50 legacy=0x7f8c4413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4259c700 1 -- 172.21.15.125:0/4261106133 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4409e6a0 con 0x7f8c440a0a70 2023-10-03T10:17:18.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c4159a700 1 -- 172.21.15.125:0/4261106133 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418278641 0 0) 0x7f8c4409dc00 con 0x7f8c44133f50 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.941+0000 7f8c41d9b700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 0x7f8c44133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c4259c700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c440a0a70 0x7f8c440a0e40 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009840 tx=0x7f8c34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933bf9e7c03a57a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c4159a700 1 -- 172.21.15.125:0/4261106133 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011830 con 0x7f8c440a0a70 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c4159a700 1 -- 172.21.15.125:0/4261106133 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011990 con 0x7f8c440a0a70 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c4159a700 1 -- 172.21.15.125:0/4261106133 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011d20 con 0x7f8c440a0a70 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 -- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c440a0a70 msgr2=0x7f8c440a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c440a0a70 0x7f8c440a0e40 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009840 tx=0x7f8c34009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 -- 172.21.15.125:0/4261106133 shutdown_connections 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c440a0a70 0x7f8c440a0e40 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 --2- 172.21.15.125:0/4261106133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a1380 0x7f8c44133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 -- 172.21.15.125:0/4261106133 >> 172.21.15.125:0/4261106133 conn(0x7f8c440a6610 msgr2=0x7f8c440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 -- 172.21.15.125:0/4261106133 shutdown_connections 2023-10-03T10:17:18.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.942+0000 7f8c48b64700 1 -- 172.21.15.125:0/4261106133 wait complete. 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.943+0000 7f8c48b64700 1 Processor -- start 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 -- start start 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c440a1380 0x7f8c44122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 0x7f8c441232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44133ad0 con 0x7f8c44133f50 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44125de0 con 0x7f8c440a1380 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c48b64700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44124510 con 0x7f8c440a0a70 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c42d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 0x7f8c441232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52548/0 (socket says 172.21.15.125:52548) 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 -- 172.21.15.125:0/2736292570 learned_addr learned my addr 172.21.15.125:0/2736292570 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:18.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c41d9b700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c440a1380 0x7f8c44122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 -- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c440a1380 msgr2=0x7f8c44122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c440a1380 0x7f8c44122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 -- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 msgr2=0x7f8c441232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 0x7f8c441232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c4259c700 1 -- 172.21.15.125:0/2736292570 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380094a0 con 0x7f8c440a0a70 2023-10-03T10:17:18.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.944+0000 7f8c42d9d700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 0x7f8c441232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c4259c700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8c340090b0 tx=0x7f8c34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004400 con 0x7f8c440a0a70 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3401f070 con 0x7f8c440a0a70 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c340094a0 con 0x7f8c440a0a70 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340038e0 con 0x7f8c440a0a70 2023-10-03T10:17:18.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c44133380 con 0x7f8c440a0a70 2023-10-03T10:17:18.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.945+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c34021030 con 0x7f8c440a0a70 2023-10-03T10:17:18.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.946+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c34040810 con 0x7f8c440a0a70 2023-10-03T10:17:18.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.946+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4404f2a0 con 0x7f8c440a0a70 2023-10-03T10:17:18.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:18.950+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c34004560 con 0x7f8c440a0a70 2023-10-03T10:17:19.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.101+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd6406b2a0 con 0x7fbd6409f180 2023-10-03T10:17:19.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.101+0000 7fbd5affd700 1 -- 172.21.15.125:0/736601941 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd54011d90 con 0x7fbd6409f180 2023-10-03T10:17:19.102 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 msgr2=0x7fbd6411d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e960 tx=0x7fbd5400ec70 comp rx=0 tx=0).stop 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 shutdown_connections 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd64131d70 0x7fbd6411db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6409e870 0x7fbd6411d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 --2- 172.21.15.125:0/736601941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd6409f180 0x7fbd6411d5e0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 >> 172.21.15.125:0/736601941 conn(0x7fbd640a4430 msgr2=0x7fbd6409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 shutdown_connections 2023-10-03T10:17:19.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.103+0000 7fbd6c73f700 1 -- 172.21.15.125:0/736601941 wait complete. 2023-10-03T10:17:19.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:19.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.137+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c44072980 con 0x7f8c440a0a70 2023-10-03T10:17:19.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.137+0000 7f8c32ffd700 1 -- 172.21.15.125:0/2736292570 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c34015020 con 0x7f8c440a0a70 2023-10-03T10:17:19.138 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:19.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 msgr2=0x7f8c44122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8c340090b0 tx=0x7f8c34004750 comp rx=0 tx=0).stop 2023-10-03T10:17:19.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 shutdown_connections 2023-10-03T10:17:19.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c44133f50 0x7f8c441232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c440a0a70 0x7f8c44122860 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 --2- 172.21.15.125:0/2736292570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c440a1380 0x7f8c44122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 >> 172.21.15.125:0/2736292570 conn(0x7f8c440a6610 msgr2=0x7f8c4409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.139+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 shutdown_connections 2023-10-03T10:17:19.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.140+0000 7f8c48b64700 1 -- 172.21.15.125:0/2736292570 wait complete. 2023-10-03T10:17:19.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:19.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:19.731 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:19.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.817+0000 7f5d3883b700 1 Processor -- start 2023-10-03T10:17:19.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.817+0000 7f5d3883b700 1 -- start start 2023-10-03T10:17:19.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 0x7f5d341343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d340a3b60 con 0x7f5d340a0a70 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341348e0 con 0x7f5d34133f70 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3883b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3409b110 con 0x7f5d3409ad40 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d32d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d31d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 0x7f5d341343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52562/0 (socket says 172.21.15.125:52562) 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d32d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44172/0 (socket says 172.21.15.125:44172) 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 -- 172.21.15.125:0/614475701 learned_addr learned my addr 172.21.15.125:0/614475701 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 -- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 msgr2=0x7f5d341343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 0x7f5d341343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 -- 172.21.15.125:0/614475701 >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 msgr2=0x7f5d340a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 --2- 172.21.15.125:0/614475701 >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d3259c700 1 -- 172.21.15.125:0/614475701 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340a2fa0 con 0x7f5d3409ad40 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d31d9b700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 0x7f5d341343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.818+0000 7f5d32d9d700 1 --2- 172.21.15.125:0/614475701 >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3259c700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b2a5cd187e9fed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3159a700 1 -- 172.21.15.125:0/614475701 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011830 con 0x7f5d3409ad40 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3159a700 1 -- 172.21.15.125:0/614475701 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24011990 con 0x7f5d3409ad40 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3159a700 1 -- 172.21.15.125:0/614475701 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011d20 con 0x7f5d3409ad40 2023-10-03T10:17:19.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 -- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 msgr2=0x7f5d34133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:19.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 -- 172.21.15.125:0/614475701 shutdown_connections 2023-10-03T10:17:19.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 --2- 172.21.15.125:0/614475701 >> v2:172.21.15.125:3300/0 conn(0x7f5d340a0a70 0x7f5d340a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d3409ad40 0x7f5d34133a30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 --2- 172.21.15.125:0/614475701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d34133f70 0x7f5d341343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.819+0000 7f5d3883b700 1 -- 172.21.15.125:0/614475701 >> 172.21.15.125:0/614475701 conn(0x7f5d34099c40 msgr2=0x7f5d3406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.820+0000 7f5d3883b700 1 -- 172.21.15.125:0/614475701 shutdown_connections 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.820+0000 7f5d3883b700 1 -- 172.21.15.125:0/614475701 wait complete. 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 Processor -- start 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 -- start start 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 0x7f5d3411d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34120bb0 con 0x7f5d340a0a70 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3411f2c0 con 0x7f5d3409ad40 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.821+0000 7f5d3883b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3411ff80 con 0x7f5d34133f70 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d32d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44182/0 (socket says 172.21.15.125:44182) 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d32d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52576/0 (socket says 172.21.15.125:52576) 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 -- 172.21.15.125:0/1505480687 learned_addr learned my addr 172.21.15.125:0/1505480687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d3259c700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 0x7f5d3411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 -- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 msgr2=0x7f5d3411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 -- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 msgr2=0x7f5d3411d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 0x7f5d3411d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 -- 172.21.15.125:0/1505480687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c009a70 con 0x7f5d340a0a70 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d3259c700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 0x7f5d3411d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d32d9d700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d31d9b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800ebe0 tx=0x7f5d2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800c850 con 0x7f5d340a0a70 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800c9b0 con 0x7f5d340a0a70 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280094a0 con 0x7f5d340a0a70 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800cd40 con 0x7f5d340a0a70 2023-10-03T10:17:19.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.822+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d24009550 con 0x7f5d340a0a70 2023-10-03T10:17:19.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.823+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d28013470 con 0x7f5d340a0a70 2023-10-03T10:17:19.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.823+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d2803fb60 con 0x7f5d340a0a70 2023-10-03T10:17:19.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.823+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d34132a20 con 0x7f5d340a0a70 2023-10-03T10:17:19.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.828+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d28013720 con 0x7f5d340a0a70 2023-10-03T10:17:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 Processor -- start 2023-10-03T10:17:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 -- start start 2023-10-03T10:17:19.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f2870134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287009e9d0 con 0x7f28700a1380 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287009dc00 con 0x7f2870133f50 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f2874b86700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f287009dec0 con 0x7f28700a0a70 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44184/0 (socket says 172.21.15.125:44184) 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52590/0 (socket says 172.21.15.125:52590) 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286dd9b700 1 -- 172.21.15.125:0/697780377 learned_addr learned my addr 172.21.15.125:0/697780377 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.859+0000 7f286ed9d700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f2870134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 -- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 msgr2=0x7f2870134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f2870134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 -- 172.21.15.125:0/697780377 >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 msgr2=0x7f2870133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 --2- 172.21.15.125:0/697780377 >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 -- 172.21.15.125:0/697780377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287009e6a0 con 0x7f28700a0a70 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286dd9b700 1 --2- 172.21.15.125:0/697780377 >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286e59c700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2860009840 tx=0x7f2860009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4729d463f9c7e080 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286d59a700 1 -- 172.21.15.125:0/697780377 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011830 con 0x7f28700a0a70 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286d59a700 1 -- 172.21.15.125:0/697780377 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860011990 con 0x7f28700a0a70 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.860+0000 7f286d59a700 1 -- 172.21.15.125:0/697780377 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011d20 con 0x7f28700a0a70 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 -- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 msgr2=0x7f28700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2860009840 tx=0x7f2860009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 -- 172.21.15.125:0/697780377 shutdown_connections 2023-10-03T10:17:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f2870134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 --2- 172.21.15.125:0/697780377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f28700a0e40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 --2- 172.21.15.125:0/697780377 >> v2:172.21.15.125:3300/0 conn(0x7f28700a1380 0x7f2870133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 -- 172.21.15.125:0/697780377 >> 172.21.15.125:0/697780377 conn(0x7f28700a6610 msgr2=0x7f28700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 -- 172.21.15.125:0/697780377 shutdown_connections 2023-10-03T10:17:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.861+0000 7f2874b86700 1 -- 172.21.15.125:0/697780377 wait complete. 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.862+0000 7f2874b86700 1 Processor -- start 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.862+0000 7f2874b86700 1 -- start start 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f287011fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870122bd0 con 0x7f28700a1380 2023-10-03T10:17:19.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28701207f0 con 0x7f2870133f50 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f2874b86700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28700a03e0 con 0x7f28700a0a70 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52594/0 (socket says 172.21.15.125:52594) 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44198/0 (socket says 172.21.15.125:44198) 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 -- 172.21.15.125:0/3970134326 learned_addr learned my addr 172.21.15.125:0/3970134326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286ed9d700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f287011fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 -- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 msgr2=0x7f287011fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f287011fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 -- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 msgr2=0x7f287011f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 -- 172.21.15.125:0/3970134326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009550 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286dd9b700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.863+0000 7f286e59c700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fd0 tx=0x7f2860004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860004450 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286001e070 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28600094a0 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600038e0 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870122910 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2860003a40 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.864+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28600402b0 con 0x7f28700a0a70 2023-10-03T10:17:19.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.865+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287004f2a0 con 0x7f28700a0a70 2023-10-03T10:17:19.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:19.869+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2860015080 con 0x7f28700a0a70 2023-10-03T10:17:20.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.032+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d3404f2a0 con 0x7f5d340a0a70 2023-10-03T10:17:20.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.033+0000 7f5d22ffd700 1 -- 172.21.15.125:0/1505480687 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d28017020 con 0x7f5d340a0a70 2023-10-03T10:17:20.033 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:20.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 msgr2=0x7f5d3411d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800ebe0 tx=0x7f5d2800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 shutdown_connections 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5d34133f70 0x7f5d3411db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5d3409ad40 0x7f5d3411d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 --2- 172.21.15.125:0/1505480687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d340a0a70 0x7f5d3411d620 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 >> 172.21.15.125:0/1505480687 conn(0x7f5d34099c40 msgr2=0x7f5d34132200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 shutdown_connections 2023-10-03T10:17:20.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.035+0000 7f5d3883b700 1 -- 172.21.15.125:0/1505480687 wait complete. 2023-10-03T10:17:20.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:20.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.080+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2870072980 con 0x7f28700a0a70 2023-10-03T10:17:20.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.081+0000 7f285effd700 1 -- 172.21.15.125:0/3970134326 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2860003cf0 con 0x7f28700a0a70 2023-10-03T10:17:20.081 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 msgr2=0x7f287011f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fd0 tx=0x7f2860004750 comp rx=0 tx=0).stop 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 shutdown_connections 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2870133f50 0x7f287011fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f28700a0a70 0x7f287011f390 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 --2- 172.21.15.125:0/3970134326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28700a1380 0x7f287011f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 >> 172.21.15.125:0/3970134326 conn(0x7f28700a6610 msgr2=0x7f287009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 shutdown_connections 2023-10-03T10:17:20.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.083+0000 7f2874b86700 1 -- 172.21.15.125:0/3970134326 wait complete. 2023-10-03T10:17:20.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:20.116 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:20.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:20.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.264+0000 7f33ad6de700 1 Processor -- start 2023-10-03T10:17:20.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 -- start start 2023-10-03T10:17:20.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a806b2d0 con 0x7f33a81309f0 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8133610 con 0x7f33a8133ad0 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33ad6de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a809a500 con 0x7f33a81300a0 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38366/0 (socket says 172.21.15.125:38366) 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a6ffd700 1 -- 172.21.15.125:0/3230706625 learned_addr learned my addr 172.21.15.125:0/3230706625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52596/0 (socket says 172.21.15.125:52596) 2023-10-03T10:17:20.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a5ffb700 1 -- 172.21.15.125:0/3230706625 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33571928 0 0) 0x7f33a806b2d0 con 0x7f33a81309f0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a67fc700 1 -- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 msgr2=0x7f33a8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.265+0000 7f33a67fc700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a67fc700 1 -- 172.21.15.125:0/3230706625 >> v1:172.21.15.125:6789/0 conn(0x7f33a81309f0 legacy=0x7f33a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a67fc700 1 -- 172.21.15.125:0/3230706625 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a81338b0 con 0x7f33a81300a0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a6ffd700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a67fc700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f339c009870 tx=0x7f339c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3d09cc6fa93cba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a5ffb700 1 -- 172.21.15.125:0/3230706625 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011830 con 0x7f33a81300a0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a5ffb700 1 -- 172.21.15.125:0/3230706625 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c011990 con 0x7f33a81300a0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33a5ffb700 1 -- 172.21.15.125:0/3230706625 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011d20 con 0x7f33a81300a0 2023-10-03T10:17:20.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 -- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 msgr2=0x7f33a81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f339c009870 tx=0x7f339c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 -- 172.21.15.125:0/3230706625 shutdown_connections 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3230706625 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81300a0 0x7f33a81304b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.266+0000 7f33ad6de700 1 -- 172.21.15.125:0/3230706625 >> 172.21.15.125:0/3230706625 conn(0x7f33a8099c40 msgr2=0x7f33a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.267+0000 7f33ad6de700 1 -- 172.21.15.125:0/3230706625 shutdown_connections 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.267+0000 7f33ad6de700 1 -- 172.21.15.125:0/3230706625 wait complete. 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 Processor -- start 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 -- start start 2023-10-03T10:17:20.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 0x7f33a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8120950 con 0x7f33a81300a0 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a812d930 con 0x7f33a8133ad0 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33ad6de700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a811fd00 con 0x7f33a81309f0 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 0x7f33a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52604/0 (socket says 172.21.15.125:52604) 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 -- 172.21.15.125:0/3843013791 learned_addr learned my addr 172.21.15.125:0/3843013791 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:20.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a77fe700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 -- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 msgr2=0x7f33a811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 -- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 msgr2=0x7f33a811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 0x7f33a811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a67fc700 1 -- 172.21.15.125:0/3843013791 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398009550 con 0x7f33a81309f0 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a77fe700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.268+0000 7f33a6ffd700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 0x7f33a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f33a67fc700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f339c009840 tx=0x7f339c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c004590 con 0x7f33a81309f0 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c01e070 con 0x7f33a81309f0 2023-10-03T10:17:20.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c0094a0 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0038c0 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80a3400 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.269+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f339c003a20 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.270+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f339c020070 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.270+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a812dd00 con 0x7f33a81309f0 2023-10-03T10:17:20.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.275+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f339c01a420 con 0x7f33a81309f0 2023-10-03T10:17:20.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 Processor -- start 2023-10-03T10:17:20.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 -- start start 2023-10-03T10:17:20.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 0x7f697c13b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c133640 con 0x7f697c133a70 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0a1d50 con 0x7f697c136950 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f6981e26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c134550 con 0x7f697c139270 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f697affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f697bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 0x7f697c13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f697affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44226/0 (socket says 172.21.15.125:44226) 2023-10-03T10:17:20.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f697b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f697c133a70 0x7f697c133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43884/0 (socket says 172.21.15.125:43884) 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.306+0000 7f697affd700 1 -- 172.21.15.125:0/716853247 learned_addr learned my addr 172.21.15.125:0/716853247 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697bfff700 1 -- 172.21.15.125:0/716853247 >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 msgr2=0x7f697c138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697bfff700 1 --2- 172.21.15.125:0/716853247 >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697bfff700 1 -- 172.21.15.125:0/716853247 >> v1:172.21.15.125:6789/0 conn(0x7f697c133a70 legacy=0x7f697c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697bfff700 1 -- 172.21.15.125:0/716853247 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c09b620 con 0x7f697c139270 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697a7fc700 1 -- 172.21.15.125:0/716853247 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581688730 0 0) 0x7f697c133640 con 0x7f697c133a70 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697affd700 1 --2- 172.21.15.125:0/716853247 >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697bfff700 1 --2- 172.21.15.125:0/716853247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 0x7f697c13b650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6974009d90 tx=0x7f697400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724fe969ef8c7424 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697a7fc700 1 -- 172.21.15.125:0/716853247 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400e070 con 0x7f697c139270 2023-10-03T10:17:20.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697a7fc700 1 -- 172.21.15.125:0/716853247 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400bb20 con 0x7f697c139270 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.307+0000 7f697a7fc700 1 -- 172.21.15.125:0/716853247 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974012430 con 0x7f697c139270 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 -- 172.21.15.125:0/716853247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 msgr2=0x7f697c13b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 --2- 172.21.15.125:0/716853247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 0x7f697c13b650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6974009d90 tx=0x7f697400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 -- 172.21.15.125:0/716853247 shutdown_connections 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 --2- 172.21.15.125:0/716853247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c139270 0x7f697c13b650 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 --2- 172.21.15.125:0/716853247 >> v2:172.21.15.125:3300/0 conn(0x7f697c136950 0x7f697c138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 -- 172.21.15.125:0/716853247 >> 172.21.15.125:0/716853247 conn(0x7f697c0a2980 msgr2=0x7f697c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 -- 172.21.15.125:0/716853247 shutdown_connections 2023-10-03T10:17:20.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.308+0000 7f6981e26700 1 -- 172.21.15.125:0/716853247 wait complete. 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.309+0000 7f6981e26700 1 Processor -- start 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.309+0000 7f6981e26700 1 -- start start 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 0x7f697c119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c136950 0x7f697c11a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c11d740 con 0x7f697c139270 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c11b110 con 0x7f697c136950 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f6981e26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f697c11caf0 con 0x7f697c133a70 2023-10-03T10:17:20.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 0x7f697c119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44242/0 (socket says 172.21.15.125:44242) 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697bfff700 1 -- 172.21.15.125:0/2431722023 learned_addr learned my addr 172.21.15.125:0/2431722023 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697affd700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c136950 0x7f697c11a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 0x7f697c119cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52606/0 (socket says 172.21.15.125:52606) 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.310+0000 7f697bfff700 1 -- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 msgr2=0x7f697c119cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f697bfff700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 0x7f697c119cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f697bfff700 1 -- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c136950 msgr2=0x7f697c11a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f697bfff700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c136950 0x7f697c11a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f697bfff700 1 -- 172.21.15.125:0/2431722023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009550 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f697bfff700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6974014040 tx=0x7f6974004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974012430 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974020070 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974004280 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974009a70 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.311+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c09a350 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.312+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69740043e0 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.312+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6974022070 con 0x7f697c139270 2023-10-03T10:17:20.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.312+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c04f2a0 con 0x7f697c139270 2023-10-03T10:17:20.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.317+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f697401b400 con 0x7f697c139270 2023-10-03T10:17:20.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.467+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33a804f2a0 con 0x7f33a81309f0 2023-10-03T10:17:20.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.468+0000 7f338f7fe700 1 -- 172.21.15.125:0/3843013791 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f339c02a030 con 0x7f33a81309f0 2023-10-03T10:17:20.468 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:20.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 msgr2=0x7f33a811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f339c009840 tx=0x7f339c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:20.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 shutdown_connections 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33a8133ad0 0x7f33a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a81300a0 0x7f33a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 --2- 172.21.15.125:0/3843013791 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f33a81309f0 0x7f33a811df80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 >> 172.21.15.125:0/3843013791 conn(0x7f33a8099c40 msgr2=0x7f33a812e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 shutdown_connections 2023-10-03T10:17:20.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.470+0000 7f33ad6de700 1 -- 172.21.15.125:0/3843013791 wait complete. 2023-10-03T10:17:20.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:20.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.506+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f697c06bce0 con 0x7f697c139270 2023-10-03T10:17:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.507+0000 7f6963fff700 1 -- 172.21.15.125:0/2431722023 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f697402c020 con 0x7f697c139270 2023-10-03T10:17:20.507 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 msgr2=0x7f697c11a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6974014040 tx=0x7f6974004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 shutdown_connections 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c139270 0x7f697c11a730 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f697c133a70 0x7f697c119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 --2- 172.21.15.125:0/2431722023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c136950 0x7f697c11a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.508+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 >> 172.21.15.125:0/2431722023 conn(0x7f697c0a2980 msgr2=0x7f697c134710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.509+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 shutdown_connections 2023-10-03T10:17:20.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:20.509+0000 7f6981e26700 1 -- 172.21.15.125:0/2431722023 wait complete. 2023-10-03T10:17:20.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:21.052 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:21.096 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:21.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 Processor -- start 2023-10-03T10:17:21.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 -- start start 2023-10-03T10:17:21.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae809ad40 0x7fbae8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae809b110 con 0x7fbae8133f70 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae80a3b60 con 0x7fbae809ad40 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.178+0000 7fbaf060d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8134850 con 0x7fbae81343d0 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae809ad40 0x7fbae8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaeebaa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae809ad40 0x7fbae8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44252/0 (socket says 172.21.15.125:44252) 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaedba8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbae8133f70 0x7fbae80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43900/0 (socket says 172.21.15.125:43900) 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaeebaa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52608/0 (socket says 172.21.15.125:52608) 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 -- 172.21.15.125:0/1653566670 learned_addr learned my addr 172.21.15.125:0/1653566670 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 -- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 msgr2=0x7fbae80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 -- 172.21.15.125:0/1653566670 >> v1:172.21.15.125:6789/0 conn(0x7fbae8133f70 legacy=0x7fbae80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 -- 172.21.15.125:0/1653566670 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80a2fa0 con 0x7fbae809ad40 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaed3a7700 1 -- 172.21.15.125:0/1653566670 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197087404 0 0) 0x7fbae809b110 con 0x7fbae8133f70 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaeebaa700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaee3a9700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae809ad40 0x7fbae8133a30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fbae40098f0 tx=0x7fbae4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516358b15d1bd1e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaed3a7700 1 -- 172.21.15.125:0/1653566670 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011830 con 0x7fbae809ad40 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaed3a7700 1 -- 172.21.15.125:0/1653566670 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4011990 con 0x7fbae809ad40 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.179+0000 7fbaed3a7700 1 -- 172.21.15.125:0/1653566670 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011d20 con 0x7fbae809ad40 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 -- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae809ad40 msgr2=0x7fbae8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae809ad40 0x7fbae8133a30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fbae40098f0 tx=0x7fbae4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 -- 172.21.15.125:0/1653566670 shutdown_connections 2023-10-03T10:17:21.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae81343d0 0x7fbae80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 --2- 172.21.15.125:0/1653566670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae809ad40 0x7fbae8133a30 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 -- 172.21.15.125:0/1653566670 >> 172.21.15.125:0/1653566670 conn(0x7fbae8099c40 msgr2=0x7fbae806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 -- 172.21.15.125:0/1653566670 shutdown_connections 2023-10-03T10:17:21.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.180+0000 7fbaf060d700 1 -- 172.21.15.125:0/1653566670 wait complete. 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 Processor -- start 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 -- start start 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133f70 0x7fbae811fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae81343d0 0x7fbae81c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8122530 con 0x7fbae8133f70 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8120e50 con 0x7fbae81343d0 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaf060d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8122710 con 0x7fbae809ad40 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaee3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaee3a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52618/0 (socket says 172.21.15.125:52618) 2023-10-03T10:17:21.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaee3a9700 1 -- 172.21.15.125:0/4128937294 learned_addr learned my addr 172.21.15.125:0/4128937294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaedba8700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133f70 0x7fbae811fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.181+0000 7fbaeebaa700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae81343d0 0x7fbae81c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 -- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae81343d0 msgr2=0x7fbae81c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae81343d0 0x7fbae81c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 -- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133f70 msgr2=0x7fbae811fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133f70 0x7fbae811fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 -- 172.21.15.125:0/4128937294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009a70 con 0x7fbae809ad40 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaee3a9700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009130 tx=0x7fbae4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40044d0 con 0x7fbae809ad40 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae401e070 con 0x7fbae809ad40 2023-10-03T10:17:21.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae4009550 con 0x7fbae809ad40 2023-10-03T10:17:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40038c0 con 0x7fbae809ad40 2023-10-03T10:17:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.182+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae8120ff0 con 0x7fbae809ad40 2023-10-03T10:17:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.183+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbae4003a20 con 0x7fbae809ad40 2023-10-03T10:17:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.183+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae804f2a0 con 0x7fbae809ad40 2023-10-03T10:17:21.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.183+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbae40405f0 con 0x7fbae809ad40 2023-10-03T10:17:21.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.188+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbae4003cd0 con 0x7fbae809ad40 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.223+0000 7f5df5abf700 1 Processor -- start 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.223+0000 7f5df5abf700 1 -- start start 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5df5abf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 0x7f5df0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5df5abf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5df5abf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df009e9d0 con 0x7f5df00a0a70 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5df5abf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009dc00 con 0x7f5df00a1550 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5df5abf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009dec0 con 0x7f5df0139200 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52632/0 (socket says 172.21.15.125:52632) 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5def7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5df00a0a70 0x7f5df00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43914/0 (socket says 172.21.15.125:43914) 2023-10-03T10:17:21.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deffff700 1 -- 172.21.15.125:0/4293025317 learned_addr learned my addr 172.21.15.125:0/4293025317 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 0x7f5df0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 -- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 msgr2=0x7f5df013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5dee7fc700 1 -- 172.21.15.125:0/4293025317 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733684105 0 0) 0x7f5df009e9d0 con 0x7f5df00a0a70 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 -- 172.21.15.125:0/4293025317 >> v1:172.21.15.125:6789/0 conn(0x7f5df00a0a70 legacy=0x7f5df00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 -- 172.21.15.125:0/4293025317 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df009e6a0 con 0x7f5df00a1550 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deffff700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5deeffd700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 0x7f5df0138cc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009870 tx=0x7f5dd8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e84aae9d5cf490ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5dee7fc700 1 -- 172.21.15.125:0/4293025317 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011830 con 0x7f5df00a1550 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5dee7fc700 1 -- 172.21.15.125:0/4293025317 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8011990 con 0x7f5df00a1550 2023-10-03T10:17:21.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.224+0000 7f5dee7fc700 1 -- 172.21.15.125:0/4293025317 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011d20 con 0x7f5df00a1550 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 -- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 msgr2=0x7f5df0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 0x7f5df0138cc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009870 tx=0x7f5dd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 -- 172.21.15.125:0/4293025317 shutdown_connections 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 --2- 172.21.15.125:0/4293025317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a1550 0x7f5df0138cc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 -- 172.21.15.125:0/4293025317 >> 172.21.15.125:0/4293025317 conn(0x7f5df00a6610 msgr2=0x7f5df00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 -- 172.21.15.125:0/4293025317 shutdown_connections 2023-10-03T10:17:21.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.225+0000 7f5df5abf700 1 -- 172.21.15.125:0/4293025317 wait complete. 2023-10-03T10:17:21.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 Processor -- start 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 -- start start 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 0x7f5df011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01222d0 con 0x7f5df00a1550 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00a03e0 con 0x7f5df00a0a70 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.226+0000 7f5df5abf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00a5100 con 0x7f5df0139200 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38432/0 (socket says 172.21.15.125:38432) 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 -- 172.21.15.125:0/3385301152 learned_addr learned my addr 172.21.15.125:0/3385301152 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5deeffd700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 0x7f5df011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5deffff700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 -- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 msgr2=0x7f5df011f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df011f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 -- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 msgr2=0x7f5df011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 0x7f5df011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 -- 172.21.15.125:0/3385301152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009550 con 0x7f5df00a0a70 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5deffff700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5deeffd700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 0x7f5df011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5def7fe700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5de000cc80 tx=0x7f5de000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000ab00 con 0x7f5df00a0a70 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000ac60 con 0x7f5df00a0a70 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00070d0 con 0x7f5df00a0a70 2023-10-03T10:17:21.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd80094a0 con 0x7f5df00a0a70 2023-10-03T10:17:21.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.227+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0121d30 con 0x7f5df00a0a70 2023-10-03T10:17:21.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.228+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5de0007230 con 0x7f5df00a0a70 2023-10-03T10:17:21.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.228+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0134730 con 0x7f5df00a0a70 2023-10-03T10:17:21.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.228+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5de003f240 con 0x7f5df00a0a70 2023-10-03T10:17:21.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.233+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5de0019860 con 0x7f5df00a0a70 2023-10-03T10:17:21.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.382+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbae8120870 con 0x7fbae809ad40 2023-10-03T10:17:21.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.382+0000 7fbadeffd700 1 -- 172.21.15.125:0/4128937294 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbae4015030 con 0x7fbae809ad40 2023-10-03T10:17:21.383 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 msgr2=0x7fbae811f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009130 tx=0x7fbae4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 shutdown_connections 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae81343d0 0x7fbae81c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae809ad40 0x7fbae811f750 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 --2- 172.21.15.125:0/4128937294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133f70 0x7fbae811fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 >> 172.21.15.125:0/4128937294 conn(0x7fbae8099c40 msgr2=0x7fbae80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 shutdown_connections 2023-10-03T10:17:21.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.384+0000 7fbaf060d700 1 -- 172.21.15.125:0/4128937294 wait complete. 2023-10-03T10:17:21.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:21.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.427+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5df004f2a0 con 0x7f5df00a0a70 2023-10-03T10:17:21.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.428+0000 7f5de7fff700 1 -- 172.21.15.125:0/3385301152 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5de0018020 con 0x7f5df00a0a70 2023-10-03T10:17:21.428 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:21.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 msgr2=0x7f5df011e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5de000cc80 tx=0x7f5de000cf90 comp rx=0 tx=0).stop 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 shutdown_connections 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5df0139200 0x7f5df011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5df00a0a70 0x7f5df011e7b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 --2- 172.21.15.125:0/3385301152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5df00a1550 0x7f5df011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 >> 172.21.15.125:0/3385301152 conn(0x7f5df00a6610 msgr2=0x7f5df00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 shutdown_connections 2023-10-03T10:17:21.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.430+0000 7f5df5abf700 1 -- 172.21.15.125:0/3385301152 wait complete. 2023-10-03T10:17:21.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:21.483 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:21.522 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 Processor -- start 2023-10-03T10:17:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 -- start start 2023-10-03T10:17:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa620133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62009b110 con 0x7fa6200a0a70 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200a3b60 con 0x7fa620133f70 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa626a6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201348e0 con 0x7fa62009ad40 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa624806700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa620133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa625007700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6200a0a70 0x7fa6200a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43928/0 (socket says 172.21.15.125:43928) 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa61ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.609+0000 7fa625007700 1 -- 172.21.15.125:0/3696423378 learned_addr learned my addr 172.21.15.125:0/3696423378 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61ffff700 1 -- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 msgr2=0x7fa620133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61ffff700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa620133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61ffff700 1 -- 172.21.15.125:0/3696423378 >> v1:172.21.15.125:6789/0 conn(0x7fa6200a0a70 legacy=0x7fa6200a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61f7fe700 1 -- 172.21.15.125:0/3696423378 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651315128 0 0) 0x7fa62009b110 con 0x7fa6200a0a70 2023-10-03T10:17:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61ffff700 1 -- 172.21.15.125:0/3696423378 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200a2fa0 con 0x7fa620133f70 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa624806700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa620133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61ffff700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201343a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009870 tx=0x7fa60c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a075c826aa0b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61f7fe700 1 -- 172.21.15.125:0/3696423378 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c011830 con 0x7fa620133f70 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61f7fe700 1 -- 172.21.15.125:0/3696423378 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c011990 con 0x7fa620133f70 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.610+0000 7fa61f7fe700 1 -- 172.21.15.125:0/3696423378 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c011d20 con 0x7fa620133f70 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 -- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 msgr2=0x7fa6201343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201343a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009870 tx=0x7fa60c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 -- 172.21.15.125:0/3696423378 shutdown_connections 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa620133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 --2- 172.21.15.125:0/3696423378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201343a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 -- 172.21.15.125:0/3696423378 >> 172.21.15.125:0/3696423378 conn(0x7fa620099c40 msgr2=0x7fa62006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 -- 172.21.15.125:0/3696423378 shutdown_connections 2023-10-03T10:17:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.611+0000 7fa626a6a700 1 -- 172.21.15.125:0/3696423378 wait complete. 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 Processor -- start 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 -- start start 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa6201c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 0x7fa6201c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620120be0 con 0x7fa6200a0a70 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62009c850 con 0x7fa620133f70 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa626a6a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa620120740 con 0x7fa62009ad40 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa61ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 0x7fa6201c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa625007700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa624806700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa6201c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa61ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 0x7fa6201c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44286/0 (socket says 172.21.15.125:44286) 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.612+0000 7fa61ffff700 1 -- 172.21.15.125:0/410780450 learned_addr learned my addr 172.21.15.125:0/410780450 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 -- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 msgr2=0x7fa6201c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa6201c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 -- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 msgr2=0x7fa6201c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 0x7fa6201c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 -- 172.21.15.125:0/410780450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140094a0 con 0x7fa620133f70 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa625007700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201c8c10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa61800cc10 tx=0x7fa61800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800aa00 con 0x7fa620133f70 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800ab80 con 0x7fa620133f70 2023-10-03T10:17:21.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0094a0 con 0x7fa620133f70 2023-10-03T10:17:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180070d0 con 0x7fa620133f70 2023-10-03T10:17:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.613+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6201221f0 con 0x7fa620133f70 2023-10-03T10:17:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.614+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa618007230 con 0x7fa620133f70 2023-10-03T10:17:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.614+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6201223e0 con 0x7fa620133f70 2023-10-03T10:17:21.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.614+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa61803f170 con 0x7fa620133f70 2023-10-03T10:17:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.619+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa618019860 con 0x7fa620133f70 2023-10-03T10:17:21.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.651+0000 7fef9cdf2700 1 Processor -- start 2023-10-03T10:17:21.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.651+0000 7fef9cdf2700 1 -- start start 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef9809e870 0x7fef9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980a0920 con 0x7fef9809e870 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9809c970 con 0x7fef98131d70 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9cdf2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9809bab0 con 0x7fef9809f180 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef95d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef96d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef9809e870 0x7fef9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef9809e870 0x7fef9809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44292/0 (socket says 172.21.15.125:44292) 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef95d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52658/0 (socket says 172.21.15.125:52658) 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef96d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38452/0 (socket says 172.21.15.125:38452) 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 -- 172.21.15.125:0/494765979 learned_addr learned my addr 172.21.15.125:0/494765979 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 -- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 msgr2=0x7fef98131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 -- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 msgr2=0x7fef981321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 -- 172.21.15.125:0/494765979 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9809f9c0 con 0x7fef9809e870 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef96d9d700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef95d9b700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9659c700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809e870 0x7fef9809ec40 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fef88009920 tx=0x7fef88009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec8624b303bdd36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.652+0000 7fef9559a700 1 -- 172.21.15.125:0/494765979 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88011830 con 0x7fef9809e870 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9559a700 1 -- 172.21.15.125:0/494765979 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef88011990 con 0x7fef9809e870 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9559a700 1 -- 172.21.15.125:0/494765979 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88011d20 con 0x7fef9809e870 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 -- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809e870 msgr2=0x7fef9809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809e870 0x7fef9809ec40 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fef88009920 tx=0x7fef88009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 -- 172.21.15.125:0/494765979 shutdown_connections 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef98131d70 0x7fef981321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809e870 0x7fef9809ec40 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/494765979 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef9809f180 0x7fef98131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 -- 172.21.15.125:0/494765979 >> 172.21.15.125:0/494765979 conn(0x7fef980a4430 msgr2=0x7fef980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 -- 172.21.15.125:0/494765979 shutdown_connections 2023-10-03T10:17:21.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.653+0000 7fef9cdf2700 1 -- 172.21.15.125:0/494765979 wait complete. 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.654+0000 7fef9cdf2700 1 Processor -- start 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.654+0000 7fef9cdf2700 1 -- start start 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809f180 0x7fef9806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 0x7fef9806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef98121ab0 con 0x7fef9809f180 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98122980 con 0x7fef9809e870 2023-10-03T10:17:21.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9cdf2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9806d550 con 0x7fef98131d70 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef96d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 0x7fef9806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38464/0 (socket says 172.21.15.125:38464) 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 -- 172.21.15.125:0/419638574 learned_addr learned my addr 172.21.15.125:0/419638574 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef95d9b700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809f180 0x7fef9806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 -- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 msgr2=0x7fef9806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 0x7fef9806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 -- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809f180 msgr2=0x7fef9806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809f180 0x7fef9806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 -- 172.21.15.125:0/419638574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0094a0 con 0x7fef9809e870 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef96d9d700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 0x7fef9806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef9659c700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef88009870 tx=0x7fef88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.655+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88004240 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8801f070 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90009a70 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880036a0 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef88009550 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef88021030 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef88040850 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.656+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9809dba0 con 0x7fef9809e870 2023-10-03T10:17:21.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.661+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef88015080 con 0x7fef9809e870 2023-10-03T10:17:21.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.808+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa62004f2a0 con 0x7fa620133f70 2023-10-03T10:17:21.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.808+0000 7fa61d7fa700 1 -- 172.21.15.125:0/410780450 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa618018030 con 0x7fa620133f70 2023-10-03T10:17:21.809 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 msgr2=0x7fa6201c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201c8c10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa61800cc10 tx=0x7fa61800cf20 comp rx=0 tx=0).stop 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 shutdown_connections 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa620133f70 0x7fa6201c8c10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa62009ad40 0x7fa6201c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 --2- 172.21.15.125:0/410780450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6200a0a70 0x7fa6201c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 >> 172.21.15.125:0/410780450 conn(0x7fa620099c40 msgr2=0x7fa6201bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 shutdown_connections 2023-10-03T10:17:21.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.810+0000 7fa626a6a700 1 -- 172.21.15.125:0/410780450 wait complete. 2023-10-03T10:17:21.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:21.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.849+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef9804f2a0 con 0x7fef9809e870 2023-10-03T10:17:21.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.849+0000 7fef86ffd700 1 -- 172.21.15.125:0/419638574 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef880239c0 con 0x7fef9809e870 2023-10-03T10:17:21.850 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:21.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 msgr2=0x7fef9806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef88009870 tx=0x7fef88004750 comp rx=0 tx=0).stop 2023-10-03T10:17:21.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 shutdown_connections 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fef98131d70 0x7fef9806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef9809e870 0x7fef9806b880 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 --2- 172.21.15.125:0/419638574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef9809f180 0x7fef9806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 >> 172.21.15.125:0/419638574 conn(0x7fef980a4430 msgr2=0x7fef9809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 shutdown_connections 2023-10-03T10:17:21.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:21.852+0000 7fef9cdf2700 1 -- 172.21.15.125:0/419638574 wait complete. 2023-10-03T10:17:21.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:22.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:22.442 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.528+0000 7fce28d0f700 1 Processor -- start 2023-10-03T10:17:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.528+0000 7fce28d0f700 1 -- start start 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce28d0f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce28d0f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce28d0f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2409e9d0 con 0x7fce240a0a70 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce28d0f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2409dc00 con 0x7fce240a1550 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce28d0f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce2409dec0 con 0x7fce24139200 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce21d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce2259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fce240a0a70 0x7fce240a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43942/0 (socket says 172.21.15.125:43942) 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce21d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44318/0 (socket says 172.21.15.125:44318) 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce2259c700 1 -- 172.21.15.125:0/1254609164 learned_addr learned my addr 172.21.15.125:0/1254609164 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52668/0 (socket says 172.21.15.125:52668) 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 -- 172.21.15.125:0/1254609164 >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 msgr2=0x7fce24138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1254609164 >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 -- 172.21.15.125:0/1254609164 >> v1:172.21.15.125:6789/0 conn(0x7fce240a0a70 legacy=0x7fce240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 -- 172.21.15.125:0/1254609164 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2409e6a0 con 0x7fce24139200 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce21d9b700 1 --2- 172.21.15.125:0/1254609164 >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.529+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1254609164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009d90 tx=0x7fce1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4017da23bb86811a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce2159a700 1 -- 172.21.15.125:0/1254609164 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00e070 con 0x7fce24139200 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce2159a700 1 -- 172.21.15.125:0/1254609164 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c00bb20 con 0x7fce24139200 2023-10-03T10:17:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce2159a700 1 -- 172.21.15.125:0/1254609164 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c012430 con 0x7fce24139200 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 -- 172.21.15.125:0/1254609164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 msgr2=0x7fce2413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1254609164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009d90 tx=0x7fce1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 -- 172.21.15.125:0/1254609164 shutdown_connections 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1254609164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2413b5e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1254609164 >> v2:172.21.15.125:3300/0 conn(0x7fce240a1550 0x7fce24138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 -- 172.21.15.125:0/1254609164 >> 172.21.15.125:0/1254609164 conn(0x7fce240a6610 msgr2=0x7fce240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 -- 172.21.15.125:0/1254609164 shutdown_connections 2023-10-03T10:17:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.530+0000 7fce28d0f700 1 -- 172.21.15.125:0/1254609164 wait complete. 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.531+0000 7fce28d0f700 1 Processor -- start 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.531+0000 7fce28d0f700 1 -- start start 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 0x7fce2411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2411f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce240a0470 con 0x7fce240a1550 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce24122050 con 0x7fce240a0a70 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce28d0f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce24121aa0 con 0x7fce24139200 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce21d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce2259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 0x7fce2411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce21d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44322/0 (socket says 172.21.15.125:44322) 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce21d9b700 1 -- 172.21.15.125:0/1798422986 learned_addr learned my addr 172.21.15.125:0/1798422986 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2411f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 -- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 msgr2=0x7fce2411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 0x7fce2411e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 -- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 msgr2=0x7fce2411ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce22d9d700 1 -- 172.21.15.125:0/1798422986 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180094a0 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce21d9b700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.532+0000 7fce2259c700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 0x7fce2411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce22d9d700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2411f320 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fce240a72d0 tx=0x7fce1c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c012430 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c020070 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c009a70 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0098f0 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.533+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce24120530 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.534+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2404f2a0 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.534+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce1c004040 con 0x7fce24139200 2023-10-03T10:17:22.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.534+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce1c022070 con 0x7fce24139200 2023-10-03T10:17:22.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.538+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce1c011980 con 0x7fce24139200 2023-10-03T10:17:22.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.569+0000 7f7a158f8700 1 Processor -- start 2023-10-03T10:17:22.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.569+0000 7f7a158f8700 1 -- start start 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a158f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a158f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a1013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a158f8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1009dc00 con 0x7f7a100a1380 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a158f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1009ea90 con 0x7f7a100a0a70 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a158f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1009dec0 con 0x7f7a10134120 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a100a1380 0x7f7a10133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43952/0 (socket says 172.21.15.125:43952) 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38470/0 (socket says 172.21.15.125:38470) 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/1635048673 learned_addr learned my addr 172.21.15.125:0/1635048673 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0f7fe700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a1013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0dffb700 1 -- 172.21.15.125:0/1635048673 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402410653 0 0) 0x7f7a1009dc00 con 0x7f7a100a1380 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 -- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 msgr2=0x7f7a1013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a1013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 -- 172.21.15.125:0/1635048673 >> v1:172.21.15.125:6789/0 conn(0x7f7a100a1380 legacy=0x7f7a10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 -- 172.21.15.125:0/1635048673 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1009e6a0 con 0x7f7a100a0a70 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0f7fe700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a1013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.570+0000 7f7a0effd700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009870 tx=0x7f7a00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63250f2e9fb8dea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a0dffb700 1 -- 172.21.15.125:0/1635048673 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00011830 con 0x7f7a100a0a70 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a0dffb700 1 -- 172.21.15.125:0/1635048673 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00011990 con 0x7f7a100a0a70 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a0dffb700 1 -- 172.21.15.125:0/1635048673 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00011d20 con 0x7f7a100a0a70 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 -- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 msgr2=0x7f7a100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009870 tx=0x7f7a00009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 -- 172.21.15.125:0/1635048673 shutdown_connections 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a1013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 --2- 172.21.15.125:0/1635048673 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a0a70 0x7f7a100a0e40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 -- 172.21.15.125:0/1635048673 >> 172.21.15.125:0/1635048673 conn(0x7f7a100a6610 msgr2=0x7f7a100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 -- 172.21.15.125:0/1635048673 shutdown_connections 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.571+0000 7f7a158f8700 1 -- 172.21.15.125:0/1635048673 wait complete. 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.572+0000 7f7a158f8700 1 Processor -- start 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.572+0000 7f7a158f8700 1 -- start start 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a101233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101270d0 con 0x7f7a100a0a70 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100a03e0 con 0x7f7a100a1380 2023-10-03T10:17:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a158f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10125eb0 con 0x7f7a10134120 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a101233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44338/0 (socket says 172.21.15.125:44338) 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38484/0 (socket says 172.21.15.125:38484) 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 -- 172.21.15.125:0/2265741250 learned_addr learned my addr 172.21.15.125:0/2265741250 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 -- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 msgr2=0x7f7a101233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a101233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 -- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 msgr2=0x7f7a10122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 -- 172.21.15.125:0/2265741250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009a70 con 0x7f7a100a0a70 2023-10-03T10:17:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0f7fe700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a101233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0e7fc700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f7a0effd700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009840 tx=0x7f7a00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000045d0 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.573+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0001f070 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.574+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a000094a0 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.574+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000038e0 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.574+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10126450 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.574+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a00003a40 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.574+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a00021070 con 0x7f7a100a0a70 2023-10-03T10:17:22.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.575+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10126020 con 0x7f7a100a0a70 2023-10-03T10:17:22.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.579+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a00015020 con 0x7f7a100a0a70 2023-10-03T10:17:22.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.734+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce24120c10 con 0x7fce24139200 2023-10-03T10:17:22.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.734+0000 7fce12ffd700 1 -- 172.21.15.125:0/1798422986 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce1c02c020 con 0x7fce24139200 2023-10-03T10:17:22.735 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 msgr2=0x7fce2411f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2411f320 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fce240a72d0 tx=0x7fce1c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 shutdown_connections 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce24139200 0x7fce2411f320 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce240a0a70 0x7fce2411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 --2- 172.21.15.125:0/1798422986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce240a1550 0x7fce2411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 >> 172.21.15.125:0/1798422986 conn(0x7fce240a6610 msgr2=0x7fce24138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 shutdown_connections 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.736+0000 7fce28d0f700 1 -- 172.21.15.125:0/1798422986 wait complete. 2023-10-03T10:17:22.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:22.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.772+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a1009a020 con 0x7f7a100a0a70 2023-10-03T10:17:22.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.773+0000 7f79f7fff700 1 -- 172.21.15.125:0/2265741250 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a00010380 con 0x7f7a100a0a70 2023-10-03T10:17:22.773 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:22.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 msgr2=0x7f7a10122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009840 tx=0x7f7a00004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 shutdown_connections 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7a10134120 0x7f7a101233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a100a0a70 0x7f7a10122930 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 --2- 172.21.15.125:0/2265741250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a100a1380 0x7f7a10122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 >> 172.21.15.125:0/2265741250 conn(0x7f7a100a6610 msgr2=0x7f7a100a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 shutdown_connections 2023-10-03T10:17:22.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.775+0000 7f7a158f8700 1 -- 172.21.15.125:0/2265741250 wait complete. 2023-10-03T10:17:22.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:22.823 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:22.865 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.953+0000 7efc904c6700 1 Processor -- start 2023-10-03T10:17:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.953+0000 7efc904c6700 1 -- start start 2023-10-03T10:17:22.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc88133f50 0x7efc881343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8809e9d0 con 0x7efc88133f50 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8809dc00 con 0x7efc880a1380 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc904c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8809dec0 con 0x7efc880a0a70 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8e262700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8da61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc88133f50 0x7efc881343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8e262700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52710/0 (socket says 172.21.15.125:52710) 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8da61700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38494/0 (socket says 172.21.15.125:38494) 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8e262700 1 -- 172.21.15.125:0/4157011050 learned_addr learned my addr 172.21.15.125:0/4157011050 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc88133f50 0x7efc881343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44352/0 (socket says 172.21.15.125:44352) 2023-10-03T10:17:22.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 -- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 msgr2=0x7efc880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 -- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 msgr2=0x7efc88133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8ea63700 1 -- 172.21.15.125:0/4157011050 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8809e6a0 con 0x7efc88133f50 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8da61700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.954+0000 7efc8e262700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc8ea63700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc88133f50 0x7efc881343f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efc80009d90 tx=0x7efc8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338d5ec93e5f3aed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc8d260700 1 -- 172.21.15.125:0/4157011050 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000e070 con 0x7efc88133f50 2023-10-03T10:17:22.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc8d260700 1 -- 172.21.15.125:0/4157011050 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8000bb20 con 0x7efc88133f50 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc8d260700 1 -- 172.21.15.125:0/4157011050 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80012430 con 0x7efc88133f50 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 -- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc88133f50 msgr2=0x7efc881343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc88133f50 0x7efc881343f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efc80009d90 tx=0x7efc8000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 -- 172.21.15.125:0/4157011050 shutdown_connections 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc88133f50 0x7efc881343f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 --2- 172.21.15.125:0/4157011050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc880a1380 0x7efc88133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.955+0000 7efc904c6700 1 -- 172.21.15.125:0/4157011050 >> 172.21.15.125:0/4157011050 conn(0x7efc880a6610 msgr2=0x7efc880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.956+0000 7efc904c6700 1 -- 172.21.15.125:0/4157011050 shutdown_connections 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.956+0000 7efc904c6700 1 -- 172.21.15.125:0/4157011050 wait complete. 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.956+0000 7efc904c6700 1 Processor -- start 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.956+0000 7efc904c6700 1 -- start start 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc88133f50 0x7efc88122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88126090 con 0x7efc880a1380 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc880a03e0 con 0x7efc88133f50 2023-10-03T10:17:22.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc904c6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8809d340 con 0x7efc880a0a70 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8da61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52718/0 (socket says 172.21.15.125:52718) 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8da61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44362/0 (socket says 172.21.15.125:44362) 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 -- 172.21.15.125:0/3728674816 learned_addr learned my addr 172.21.15.125:0/3728674816 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8ea63700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc88133f50 0x7efc88122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 -- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc88133f50 msgr2=0x7efc88122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc88133f50 0x7efc88122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 -- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 msgr2=0x7efc88122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 -- 172.21.15.125:0/3728674816 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009550 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8da61700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.957+0000 7efc8e262700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efc8400ebb0 tx=0x7efc8400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004030 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84004190 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc780094a0 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004520 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80009a70 con 0x7efc880a0a70 2023-10-03T10:17:22.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc8400c850 con 0x7efc880a0a70 2023-10-03T10:17:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.958+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc8403f550 con 0x7efc880a0a70 2023-10-03T10:17:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.959+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8811f760 con 0x7efc880a0a70 2023-10-03T10:17:22.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.963+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc840036a0 con 0x7efc880a0a70 2023-10-03T10:17:22.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 Processor -- start 2023-10-03T10:17:22.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 -- start start 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 0x7f53081321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080a0920 con 0x7f530809e870 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530809c970 con 0x7f530809f180 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f53102f6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f530809bab0 con 0x7f5308131d70 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530d891700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530e092700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530e893700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 0x7f53081321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530d891700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38504/0 (socket says 172.21.15.125:38504) 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530e092700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44366/0 (socket says 172.21.15.125:44366) 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530e893700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 0x7f53081321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52734/0 (socket says 172.21.15.125:52734) 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.997+0000 7f530d891700 1 -- 172.21.15.125:0/3032358485 learned_addr learned my addr 172.21.15.125:0/3032358485 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 -- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 msgr2=0x7f53081321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 --2- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 0x7f53081321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 -- 172.21.15.125:0/3032358485 >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 msgr2=0x7f530809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 --2- 172.21.15.125:0/3032358485 >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 -- 172.21.15.125:0/3032358485 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530809f9c0 con 0x7f530809f180 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530e092700 1 --2- 172.21.15.125:0/3032358485 >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d891700 1 --2- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009920 tx=0x7f52f8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12a80a85622e1a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d090700 1 -- 172.21.15.125:0/3032358485 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8011830 con 0x7f530809f180 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d090700 1 -- 172.21.15.125:0/3032358485 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8011990 con 0x7f530809f180 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.998+0000 7f530d090700 1 -- 172.21.15.125:0/3032358485 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8011d20 con 0x7f530809f180 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 -- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 msgr2=0x7f5308131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 --2- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009920 tx=0x7f52f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 -- 172.21.15.125:0/3032358485 shutdown_connections 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 --2- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5308131d70 0x7f53081321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 --2- 172.21.15.125:0/3032358485 >> v2:172.21.15.125:3300/0 conn(0x7f530809e870 0x7f530809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 --2- 172.21.15.125:0/3032358485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f530809f180 0x7f5308131830 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 -- 172.21.15.125:0/3032358485 >> 172.21.15.125:0/3032358485 conn(0x7f53080a4430 msgr2=0x7f53080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 -- 172.21.15.125:0/3032358485 shutdown_connections 2023-10-03T10:17:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:22.999+0000 7f53102f6700 1 -- 172.21.15.125:0/3032358485 wait complete. 2023-10-03T10:17:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 Processor -- start 2023-10-03T10:17:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 -- start start 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f530809f180 0x7f530811d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 0x7f53081c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308120250 con 0x7f530809e870 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5308120430 con 0x7f5308131d70 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f53102f6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53081312a0 con 0x7f530809f180 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f530e092700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f530e092700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44380/0 (socket says 172.21.15.125:44380) 2023-10-03T10:17:23.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f530e092700 1 -- 172.21.15.125:0/2151787139 learned_addr learned my addr 172.21.15.125:0/2151787139 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f530e893700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 0x7f53081c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.000+0000 7f530d891700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f530809f180 0x7f530811d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 -- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f530809f180 msgr2=0x7f530811d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f530809f180 0x7f530811d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 -- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 msgr2=0x7f53081c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 0x7f53081c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 -- 172.21.15.125:0/2151787139 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040094a0 con 0x7f530809e870 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e893700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 0x7f53081c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f530e092700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f530400ec10 tx=0x7f530400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304009780 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400c850 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8009550 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400cbe0 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.001+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530809dba0 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.002+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f530400cd40 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.002+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530804f2a0 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.002+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f530403fa90 con 0x7f530809e870 2023-10-03T10:17:23.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.006+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f530401b3b0 con 0x7f530809e870 2023-10-03T10:17:23.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.157+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc88125c30 con 0x7efc880a0a70 2023-10-03T10:17:23.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.158+0000 7efc7effd700 1 -- 172.21.15.125:0/3728674816 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc84020020 con 0x7efc880a0a70 2023-10-03T10:17:23.158 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:23.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 msgr2=0x7efc88122570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efc8400ebb0 tx=0x7efc8400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 shutdown_connections 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc88133f50 0x7efc88122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efc880a0a70 0x7efc88122570 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 --2- 172.21.15.125:0/3728674816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc880a1380 0x7efc88122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 >> 172.21.15.125:0/3728674816 conn(0x7efc880a6610 msgr2=0x7efc8811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 shutdown_connections 2023-10-03T10:17:23.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.160+0000 7efc904c6700 1 -- 172.21.15.125:0/3728674816 wait complete. 2023-10-03T10:17:23.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:23.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.200+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f530811ed10 con 0x7f530809e870 2023-10-03T10:17:23.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.200+0000 7f52feffd700 1 -- 172.21.15.125:0/2151787139 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5304021030 con 0x7f530809e870 2023-10-03T10:17:23.200 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 msgr2=0x7f530811d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f530400ec10 tx=0x7f530400ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 shutdown_connections 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5308131d70 0x7f53081c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f530809e870 0x7f530811d370 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 --2- 172.21.15.125:0/2151787139 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f530809f180 0x7f530811d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 >> 172.21.15.125:0/2151787139 conn(0x7f53080a4430 msgr2=0x7f53081b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 shutdown_connections 2023-10-03T10:17:23.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.202+0000 7f53102f6700 1 -- 172.21.15.125:0/2151787139 wait complete. 2023-10-03T10:17:23.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:23.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:23.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:23.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 Processor -- start 2023-10-03T10:17:23.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 -- start start 2023-10-03T10:17:23.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f4398133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439809b110 con 0x7f43980a0a70 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.880+0000 7f439e51b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43980a3b60 con 0x7f4398133f70 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f439e51b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43981348e0 con 0x7f439809ad40 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f4398133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f439cab8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f43980a0a70 0x7f43980a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43968/0 (socket says 172.21.15.125:43968) 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f439cab8700 1 -- 172.21.15.125:0/1281345323 learned_addr learned my addr 172.21.15.125:0/1281345323 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f43977fe700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 -- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 msgr2=0x7f43981343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 -- 172.21.15.125:0/1281345323 >> v1:172.21.15.125:6789/0 conn(0x7f43980a0a70 legacy=0x7f43980a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4396ffd700 1 -- 172.21.15.125:0/1281345323 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074771767 0 0) 0x7f439809b110 con 0x7f43980a0a70 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 -- 172.21.15.125:0/1281345323 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43980a2fa0 con 0x7f439809ad40 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f43977fe700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4397fff700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f4398133a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f4388009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653860311b86913c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4396ffd700 1 -- 172.21.15.125:0/1281345323 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011830 con 0x7f439809ad40 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4396ffd700 1 -- 172.21.15.125:0/1281345323 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388011990 con 0x7f439809ad40 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.881+0000 7f4396ffd700 1 -- 172.21.15.125:0/1281345323 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011d20 con 0x7f439809ad40 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 -- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 msgr2=0x7f4398133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f4398133a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f4388009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 -- 172.21.15.125:0/1281345323 shutdown_connections 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f4398133a30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 --2- 172.21.15.125:0/1281345323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 -- 172.21.15.125:0/1281345323 >> 172.21.15.125:0/1281345323 conn(0x7f4398099c40 msgr2=0x7f439806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 -- 172.21.15.125:0/1281345323 shutdown_connections 2023-10-03T10:17:23.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.882+0000 7f439e51b700 1 -- 172.21.15.125:0/1281345323 wait complete. 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.883+0000 7f439e51b700 1 Processor -- start 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.883+0000 7f439e51b700 1 -- start start 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4398122500 con 0x7f43980a0a70 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4398133370 con 0x7f4398133f70 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439e51b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f439811eec0 con 0x7f439809ad40 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f4397fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44390/0 (socket says 172.21.15.125:44390) 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f4397fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52760/0 (socket says 172.21.15.125:52760) 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 -- 172.21.15.125:0/3925741891 learned_addr learned my addr 172.21.15.125:0/3925741891 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f439cab8700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 -- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 msgr2=0x7f439811f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 -- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 msgr2=0x7f43981c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f43977fe700 1 -- 172.21.15.125:0/3925741891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0094a0 con 0x7f43980a0a70 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.884+0000 7f4397fff700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f43977fe700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f438c00ebb0 tx=0x7f438c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00c850 con 0x7f43980a0a70 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c00c9b0 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43880094a0 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00cd40 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.885+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439809c830 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.886+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f438c013470 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.886+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f438c03f750 con 0x7f43980a0a70 2023-10-03T10:17:23.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.886+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4398120650 con 0x7f43980a0a70 2023-10-03T10:17:23.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.891+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f438c021080 con 0x7f43980a0a70 2023-10-03T10:17:23.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.919+0000 7fed43e38700 1 Processor -- start 2023-10-03T10:17:23.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.919+0000 7fed43e38700 1 -- start start 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.919+0000 7fed43e38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 0x7fed3c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed43e38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a1380 0x7fed3c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed43e38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 0x7fed3c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed43e38700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c09e9d0 con 0x7fed3c133f50 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed43e38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c09dc00 con 0x7fed3c0a1380 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed43e38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c09dec0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed423d5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 0x7fed3c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 0x7fed3c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed423d5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 0x7fed3c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44396/0 (socket says 172.21.15.125:44396) 2023-10-03T10:17:23.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed423d5700 1 -- 172.21.15.125:0/653905261 learned_addr learned my addr 172.21.15.125:0/653905261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed413d3700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a1380 0x7fed3c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 -- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a1380 msgr2=0x7fed3c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a1380 0x7fed3c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 -- 172.21.15.125:0/653905261 >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 msgr2=0x7fed3c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 --2- 172.21.15.125:0/653905261 >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 0x7fed3c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 -- 172.21.15.125:0/653905261 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c09e6a0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed41bd4700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 0x7fed3c0a0e40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fed38009840 tx=0x7fed38009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca617a4861dcb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed40bd2700 1 -- 172.21.15.125:0/653905261 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011830 con 0x7fed3c0a0a70 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed40bd2700 1 -- 172.21.15.125:0/653905261 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38011990 con 0x7fed3c0a0a70 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.920+0000 7fed40bd2700 1 -- 172.21.15.125:0/653905261 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011d20 con 0x7fed3c0a0a70 2023-10-03T10:17:23.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 -- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 msgr2=0x7fed3c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 0x7fed3c0a0e40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fed38009840 tx=0x7fed38009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 -- 172.21.15.125:0/653905261 shutdown_connections 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 --2- 172.21.15.125:0/653905261 >> v2:172.21.15.125:3300/0 conn(0x7fed3c133f50 0x7fed3c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a0a70 0x7fed3c0a0e40 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 --2- 172.21.15.125:0/653905261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a1380 0x7fed3c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 -- 172.21.15.125:0/653905261 >> 172.21.15.125:0/653905261 conn(0x7fed3c0a6610 msgr2=0x7fed3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 -- 172.21.15.125:0/653905261 shutdown_connections 2023-10-03T10:17:23.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.921+0000 7fed43e38700 1 -- 172.21.15.125:0/653905261 wait complete. 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 Processor -- start 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 -- start start 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a1380 0x7fed3c121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 0x7fed3c121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c122ed0 con 0x7fed3c133f50 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c122720 con 0x7fed3c0a0a70 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed43e38700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c123d60 con 0x7fed3c0a1380 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed41bd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed41bd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38540/0 (socket says 172.21.15.125:38540) 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed41bd4700 1 -- 172.21.15.125:0/4009092284 learned_addr learned my addr 172.21.15.125:0/4009092284 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed423d5700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 0x7fed3c121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.922+0000 7fed413d3700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a1380 0x7fed3c121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 -- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a1380 msgr2=0x7fed3c121800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a1380 0x7fed3c121800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 -- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 msgr2=0x7fed3c121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 0x7fed3c121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 -- 172.21.15.125:0/4009092284 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380094a0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed423d5700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 0x7fed3c121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed41bd4700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fed38000c00 tx=0x7fed38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004450 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3801f070 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c124840 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380038e0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.923+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c0a03e0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.924+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed38003a40 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.924+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c04f2a0 con 0x7fed3c0a0a70 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.924+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed38021070 con 0x7fed3c0a0a70 2023-10-03T10:17:23.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:23.929+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed3801a430 con 0x7fed3c0a0a70 2023-10-03T10:17:24.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.084+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f439804f2a0 con 0x7f43980a0a70 2023-10-03T10:17:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.084+0000 7f4394ff9700 1 -- 172.21.15.125:0/3925741891 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f438c017020 con 0x7f43980a0a70 2023-10-03T10:17:24.085 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.086+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 msgr2=0x7f439811f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.086+0000 7f439e51b700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f438c00ebb0 tx=0x7f438c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 shutdown_connections 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4398133f70 0x7f43981c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f439809ad40 0x7f439811f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 --2- 172.21.15.125:0/3925741891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43980a0a70 0x7f439811f7f0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 >> 172.21.15.125:0/3925741891 conn(0x7f4398099c40 msgr2=0x7f43981bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 shutdown_connections 2023-10-03T10:17:24.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.087+0000 7f439e51b700 1 -- 172.21.15.125:0/3925741891 wait complete. 2023-10-03T10:17:24.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:24.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.120+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed3c072980 con 0x7fed3c0a0a70 2023-10-03T10:17:24.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.120+0000 7fed327fc700 1 -- 172.21.15.125:0/4009092284 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed38015030 con 0x7fed3c0a0a70 2023-10-03T10:17:24.121 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:24.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 msgr2=0x7fed3c1212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fed38000c00 tx=0x7fed38004750 comp rx=0 tx=0).stop 2023-10-03T10:17:24.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 shutdown_connections 2023-10-03T10:17:24.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed3c133f50 0x7fed3c121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed3c0a0a70 0x7fed3c1212c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 --2- 172.21.15.125:0/4009092284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed3c0a1380 0x7fed3c121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 >> 172.21.15.125:0/4009092284 conn(0x7fed3c0a6610 msgr2=0x7fed3c09bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 shutdown_connections 2023-10-03T10:17:24.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.122+0000 7fed43e38700 1 -- 172.21.15.125:0/4009092284 wait complete. 2023-10-03T10:17:24.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:24.174 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:24.217 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:24.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.299+0000 7f6a679aa700 1 Processor -- start 2023-10-03T10:17:24.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 -- start start 2023-10-03T10:17:24.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 0x7f6a60133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6009dc00 con 0x7f6a60133f50 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6009ea60 con 0x7f6a600a1380 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a679aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6009dec0 con 0x7f6a600a0a70 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a65746700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a64f45700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 0x7f6a60133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a65746700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52782/0 (socket says 172.21.15.125:52782) 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a65f47700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6a60133f50 0x7f6a6013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43982/0 (socket says 172.21.15.125:43982) 2023-10-03T10:17:24.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.300+0000 7f6a65746700 1 -- 172.21.15.125:0/125378798 learned_addr learned my addr 172.21.15.125:0/125378798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a57fff700 1 -- 172.21.15.125:0/125378798 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611122198 0 0) 0x7f6a6009dc00 con 0x7f6a60133f50 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a57fff700 1 -- 172.21.15.125:0/125378798 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c0035b0 con 0x7f6a60133f50 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a65746700 1 -- 172.21.15.125:0/125378798 >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 msgr2=0x7f6a60133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a65746700 1 --2- 172.21.15.125:0/125378798 >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 0x7f6a60133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a65746700 1 -- 172.21.15.125:0/125378798 >> v1:172.21.15.125:6789/0 conn(0x7f6a60133f50 legacy=0x7f6a6013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a65746700 1 -- 172.21.15.125:0/125378798 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6009e6a0 con 0x7f6a600a0a70 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a64f45700 1 --2- 172.21.15.125:0/125378798 >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 0x7f6a60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a65746700 1 --2- 172.21.15.125:0/125378798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0098f0 tx=0x7f6a5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9f9a7832311f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a57fff700 1 -- 172.21.15.125:0/125378798 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c011830 con 0x7f6a600a0a70 2023-10-03T10:17:24.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a57fff700 1 -- 172.21.15.125:0/125378798 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c011990 con 0x7f6a600a0a70 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.301+0000 7f6a57fff700 1 -- 172.21.15.125:0/125378798 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c011d20 con 0x7f6a600a0a70 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 -- 172.21.15.125:0/125378798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 msgr2=0x7f6a600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 --2- 172.21.15.125:0/125378798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0098f0 tx=0x7f6a5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 -- 172.21.15.125:0/125378798 shutdown_connections 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 --2- 172.21.15.125:0/125378798 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a600a0e40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 --2- 172.21.15.125:0/125378798 >> v2:172.21.15.125:3300/0 conn(0x7f6a600a1380 0x7f6a60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 -- 172.21.15.125:0/125378798 >> 172.21.15.125:0/125378798 conn(0x7f6a600a6610 msgr2=0x7f6a600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 -- 172.21.15.125:0/125378798 shutdown_connections 2023-10-03T10:17:24.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.302+0000 7f6a679aa700 1 -- 172.21.15.125:0/125378798 wait complete. 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.303+0000 7f6a679aa700 1 Processor -- start 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.303+0000 7f6a679aa700 1 -- start start 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 0x7f6a60122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 0x7f6a601232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60126180 con 0x7f6a60133f50 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60126360 con 0x7f6a600a1380 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60125dc0 con 0x7f6a600a0a70 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52784/0 (socket says 172.21.15.125:52784) 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 -- 172.21.15.125:0/1176832523 learned_addr learned my addr 172.21.15.125:0/1176832523 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a64f45700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 0x7f6a60122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65f47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 0x7f6a601232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 -- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 msgr2=0x7f6a60122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 0x7f6a60122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 -- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 msgr2=0x7f6a601232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 0x7f6a601232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 -- 172.21.15.125:0/1176832523 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500094a0 con 0x7f6a600a0a70 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a64f45700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 0x7f6a60122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65f47700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 0x7f6a601232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a65746700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c00 tx=0x7f6a5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c004300 con 0x7f6a600a0a70 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c01f070 con 0x7f6a600a0a70 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c009550 con 0x7f6a600a0a70 2023-10-03T10:17:24.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.304+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0036a0 con 0x7f6a600a0a70 2023-10-03T10:17:24.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.305+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a60124560 con 0x7f6a600a0a70 2023-10-03T10:17:24.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.305+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6004f2a0 con 0x7f6a600a0a70 2023-10-03T10:17:24.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.306+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a5c021030 con 0x7f6a600a0a70 2023-10-03T10:17:24.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.306+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a5c040db0 con 0x7f6a600a0a70 2023-10-03T10:17:24.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.310+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a5c0199a0 con 0x7f6a600a0a70 2023-10-03T10:17:24.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.342+0000 7f6088fab700 1 Processor -- start 2023-10-03T10:17:24.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.342+0000 7f6088fab700 1 -- start start 2023-10-03T10:17:24.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6088fab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6088fab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 0x7f6084133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6088fab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608409dc00 con 0x7f6084133f50 2023-10-03T10:17:24.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6088fab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608409ea60 con 0x7f60840a1380 2023-10-03T10:17:24.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6088fab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608409dec0 con 0x7f60840a0a70 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52796/0 (socket says 172.21.15.125:52796) 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 -- 172.21.15.125:0/3957419834 learned_addr learned my addr 172.21.15.125:0/3957419834 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6081d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 0x7f6084133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 -- 172.21.15.125:0/3957419834 >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 msgr2=0x7f6084133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 --2- 172.21.15.125:0/3957419834 >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 0x7f6084133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 -- 172.21.15.125:0/3957419834 >> v1:172.21.15.125:6789/0 conn(0x7f6084133f50 legacy=0x7f608413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608259c700 1 -- 172.21.15.125:0/3957419834 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608409e6a0 con 0x7f60840a0a70 2023-10-03T10:17:24.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f608159a700 1 -- 172.21.15.125:0/3957419834 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680033635 0 0) 0x7f608409dc00 con 0x7f6084133f50 2023-10-03T10:17:24.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.343+0000 7f6081d9b700 1 --2- 172.21.15.125:0/3957419834 >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 0x7f6084133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f608259c700 1 --2- 172.21.15.125:0/3957419834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f60740098f0 tx=0x7f6074009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe3063203ce220f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f608159a700 1 -- 172.21.15.125:0/3957419834 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011830 con 0x7f60840a0a70 2023-10-03T10:17:24.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f608159a700 1 -- 172.21.15.125:0/3957419834 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074011990 con 0x7f60840a0a70 2023-10-03T10:17:24.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f608159a700 1 -- 172.21.15.125:0/3957419834 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011d20 con 0x7f60840a0a70 2023-10-03T10:17:24.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 -- 172.21.15.125:0/3957419834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 msgr2=0x7f60840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 --2- 172.21.15.125:0/3957419834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f60740098f0 tx=0x7f6074009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:24.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 -- 172.21.15.125:0/3957419834 shutdown_connections 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 --2- 172.21.15.125:0/3957419834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60840a0a70 0x7f60840a0e40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 --2- 172.21.15.125:0/3957419834 >> v2:172.21.15.125:3300/0 conn(0x7f60840a1380 0x7f6084133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 -- 172.21.15.125:0/3957419834 >> 172.21.15.125:0/3957419834 conn(0x7f60840a6610 msgr2=0x7f60840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 -- 172.21.15.125:0/3957419834 shutdown_connections 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.344+0000 7f6088fab700 1 -- 172.21.15.125:0/3957419834 wait complete. 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.345+0000 7f6088fab700 1 Processor -- start 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.345+0000 7f6088fab700 1 -- start start 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 0x7f6084122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60840a1380 0x7f6084122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 0x7f60841232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084126140 con 0x7f60840a0a70 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60841244d0 con 0x7f60840a1380 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6088fab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6084126340 con 0x7f6084133f50 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f608259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 0x7f6084122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 0x7f60841232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f608259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 0x7f6084122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44450/0 (socket says 172.21.15.125:44450) 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f608259c700 1 -- 172.21.15.125:0/995936226 learned_addr learned my addr 172.21.15.125:0/995936226 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 -- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60840a1380 msgr2=0x7f6084122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60840a1380 0x7f6084122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 -- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 msgr2=0x7f6084122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 0x7f6084122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 -- 172.21.15.125:0/995936226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780094a0 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6082d9d700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 0x7f60841232a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c7f0 tx=0x7f607c00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c003e30 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.346+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c005070 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074009550 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c005420 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084125da0 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f607c005580 con 0x7f6084133f50 2023-10-03T10:17:24.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f607c03ed40 con 0x7f6084133f50 2023-10-03T10:17:24.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.347+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608404f2a0 con 0x7f6084133f50 2023-10-03T10:17:24.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.352+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f607c017070 con 0x7f6084133f50 2023-10-03T10:17:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.508+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a60133360 con 0x7f6a600a0a70 2023-10-03T10:17:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.509+0000 7f6a55ffb700 1 -- 172.21.15.125:0/1176832523 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a5c015070 con 0x7f6a600a0a70 2023-10-03T10:17:24.509 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 msgr2=0x7f6a60122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c00 tx=0x7f6a5c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 shutdown_connections 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a60133f50 0x7f6a601232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a600a0a70 0x7f6a60122840 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 --2- 172.21.15.125:0/1176832523 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a600a1380 0x7f6a60122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 >> 172.21.15.125:0/1176832523 conn(0x7f6a600a6610 msgr2=0x7f6a600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 shutdown_connections 2023-10-03T10:17:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.511+0000 7f6a679aa700 1 -- 172.21.15.125:0/1176832523 wait complete. 2023-10-03T10:17:24.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.545+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60841339b0 con 0x7f6084133f50 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.545+0000 7f6072ffd700 1 -- 172.21.15.125:0/995936226 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f607c00a930 con 0x7f6084133f50 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 msgr2=0x7f60841232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 0x7f60841232a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c7f0 tx=0x7f607c00cb00 comp rx=0 tx=0).stop 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 shutdown_connections 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6084133f50 0x7f60841232a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60840a0a70 0x7f6084122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 --2- 172.21.15.125:0/995936226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60840a1380 0x7f6084122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 >> 172.21.15.125:0/995936226 conn(0x7f60840a6610 msgr2=0x7f60840a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 shutdown_connections 2023-10-03T10:17:24.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:24.547+0000 7f6088fab700 1 -- 172.21.15.125:0/995936226 wait complete. 2023-10-03T10:17:24.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:25.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:25.135 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:25.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.230+0000 7f03dabf6700 1 Processor -- start 2023-10-03T10:17:25.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.230+0000 7f03dabf6700 1 -- start start 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03dabf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03dabf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03dabf6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d409dc00 con 0x7f03d40a1380 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03dabf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d409ea90 con 0x7f03d40a0a70 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03dabf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03d409dec0 con 0x7f03d4134120 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d8992700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f03d40a1380 0x7f03d4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43994/0 (socket says 172.21.15.125:43994) 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d8992700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44460/0 (socket says 172.21.15.125:44460) 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d3fff700 1 -- 172.21.15.125:0/3974913934 learned_addr learned my addr 172.21.15.125:0/3974913934 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52812/0 (socket says 172.21.15.125:52812) 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 -- 172.21.15.125:0/3974913934 >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 msgr2=0x7f03d40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 --2- 172.21.15.125:0/3974913934 >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 -- 172.21.15.125:0/3974913934 >> v1:172.21.15.125:6789/0 conn(0x7f03d40a1380 legacy=0x7f03d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d9193700 1 -- 172.21.15.125:0/3974913934 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d409e6a0 con 0x7f03d4134120 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.231+0000 7f03d8992700 1 --2- 172.21.15.125:0/3974913934 >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03d9193700 1 --2- 172.21.15.125:0/3974913934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d90 tx=0x7f03cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3df01607c67b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03d37fe700 1 -- 172.21.15.125:0/3974913934 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00e070 con 0x7f03d4134120 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03d37fe700 1 -- 172.21.15.125:0/3974913934 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc00bb20 con 0x7f03d4134120 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03d37fe700 1 -- 172.21.15.125:0/3974913934 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc012430 con 0x7f03d4134120 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 -- 172.21.15.125:0/3974913934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 msgr2=0x7f03d413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 --2- 172.21.15.125:0/3974913934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d90 tx=0x7f03cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 -- 172.21.15.125:0/3974913934 shutdown_connections 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 --2- 172.21.15.125:0/3974913934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d4134120 0x7f03d413bce0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 --2- 172.21.15.125:0/3974913934 >> v2:172.21.15.125:3300/0 conn(0x7f03d40a0a70 0x7f03d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 -- 172.21.15.125:0/3974913934 >> 172.21.15.125:0/3974913934 conn(0x7f03d40a6610 msgr2=0x7f03d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 -- 172.21.15.125:0/3974913934 shutdown_connections 2023-10-03T10:17:25.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.232+0000 7f03dabf6700 1 -- 172.21.15.125:0/3974913934 wait complete. 2023-10-03T10:17:25.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.233+0000 7f03dabf6700 1 Processor -- start 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.233+0000 7f03dabf6700 1 -- start start 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 0x7f03d4122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 0x7f03d4122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4133850 con 0x7f03d40a1380 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4133a80 con 0x7f03d4134120 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03dabf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03d41260d0 con 0x7f03d40a0a70 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38568/0 (socket says 172.21.15.125:38568) 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 -- 172.21.15.125:0/1616527905 learned_addr learned my addr 172.21.15.125:0/1616527905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d8992700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 0x7f03d4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 0x7f03d4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 -- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 msgr2=0x7f03d4122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 0x7f03d4122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 -- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 msgr2=0x7f03d4122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 0x7f03d4122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d9193700 1 -- 172.21.15.125:0/1616527905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80094a0 con 0x7f03d4134120 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d8992700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 0x7f03d4122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.234+0000 7f03d3fff700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 0x7f03d4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03d9193700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f03d409e000 tx=0x7f03cc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc012430 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc020070 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc009a70 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc003ea0 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.235+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d4125e10 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.236+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03cc004040 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.236+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d404f2a0 con 0x7f03d4134120 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.236+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03cc022070 con 0x7f03d4134120 2023-10-03T10:17:25.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.241+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03cc01a970 con 0x7f03d4134120 2023-10-03T10:17:25.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.270+0000 7f9d969fd700 1 Processor -- start 2023-10-03T10:17:25.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 -- start start 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d90130350 0x7f9d901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90137680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9009b9a0 con 0x7f9d90130350 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9009ae40 con 0x7f9d9012d280 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d969fd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9009bbb0 con 0x7f9d90130ce0 2023-10-03T10:17:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d90130350 0x7f9d901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53388/0 (socket says 172.21.15.125:53388) 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8ffff700 1 -- 172.21.15.125:0/2083513710 learned_addr learned my addr 172.21.15.125:0/2083513710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d94f9a700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 -- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 msgr2=0x7f9d90137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90137680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 -- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 msgr2=0x7f9d9012d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8f7fe700 1 -- 172.21.15.125:0/2083513710 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9009b250 con 0x7f9d90130350 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.271+0000 7f9d8ffff700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d8f7fe700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d90130350 0x7f9d901307a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400dc60 tx=0x7f9d8400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916a6db87eeb8189 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d8effd700 1 -- 172.21.15.125:0/2083513710 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84012070 con 0x7f9d90130350 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d8effd700 1 -- 172.21.15.125:0/2083513710 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400d2e0 con 0x7f9d90130350 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d8effd700 1 -- 172.21.15.125:0/2083513710 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400f900 con 0x7f9d90130350 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 -- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d90130350 msgr2=0x7f9d901307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d90130350 0x7f9d901307a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400dc60 tx=0x7f9d8400df70 comp rx=0 tx=0).stop 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 -- 172.21.15.125:0/2083513710 shutdown_connections 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d9012d280 0x7f9d9012d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 --2- 172.21.15.125:0/2083513710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d90130350 0x7f9d901307a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 -- 172.21.15.125:0/2083513710 >> 172.21.15.125:0/2083513710 conn(0x7f9d900a2980 msgr2=0x7f9d900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 -- 172.21.15.125:0/2083513710 shutdown_connections 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.272+0000 7f9d969fd700 1 -- 172.21.15.125:0/2083513710 wait complete. 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.273+0000 7f9d969fd700 1 Processor -- start 2023-10-03T10:17:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.273+0000 7f9d969fd700 1 -- start start 2023-10-03T10:17:25.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 0x7f9d90070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 0x7f9d90070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9011a4e0 con 0x7f9d9012d280 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d901194e0 con 0x7f9d90130350 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d969fd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9012ec30 con 0x7f9d90130ce0 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d94f9a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 0x7f9d90070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d94f9a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35142/0 (socket says 172.21.15.125:35142) 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 0x7f9d90070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 0x7f9d90070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53394/0 (socket says 172.21.15.125:53394) 2023-10-03T10:17:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d94f9a700 1 -- 172.21.15.125:0/849482119 learned_addr learned my addr 172.21.15.125:0/849482119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 -- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 msgr2=0x7f9d90071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 -- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 msgr2=0x7f9d90070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 0x7f9d90070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 -- 172.21.15.125:0/849482119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8000b5b0 con 0x7f9d9012d280 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d94f9a700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.274+0000 7f9d8ffff700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 0x7f9d90070a90 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000fdb0 tx=0x7f9d8000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000dd90 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80005a20 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8400d940 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80005db0 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9011af70 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.275+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d80006030 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.276+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d8003fda0 con 0x7f9d9012d280 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.276+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9004f2a0 con 0x7f9d9012d280 2023-10-03T10:17:25.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.280+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d8001f900 con 0x7f9d9012d280 2023-10-03T10:17:25.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.456+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03d4126ba0 con 0x7f03d4134120 2023-10-03T10:17:25.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.457+0000 7f03d17fa700 1 -- 172.21.15.125:0/1616527905 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03cc035090 con 0x7f03d4134120 2023-10-03T10:17:25.457 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.458+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 msgr2=0x7f03d4123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.458+0000 7f03dabf6700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f03d409e000 tx=0x7f03cc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 shutdown_connections 2023-10-03T10:17:25.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03d4134120 0x7f03d4123390 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f03d40a0a70 0x7f03d4122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 --2- 172.21.15.125:0/1616527905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03d40a1380 0x7f03d4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 >> 172.21.15.125:0/1616527905 conn(0x7f03d40a6610 msgr2=0x7f03d409ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 shutdown_connections 2023-10-03T10:17:25.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.459+0000 7f03dabf6700 1 -- 172.21.15.125:0/1616527905 wait complete. 2023-10-03T10:17:25.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:25.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.494+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d9006bce0 con 0x7f9d9012d280 2023-10-03T10:17:25.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.495+0000 7f9d8cff9700 1 -- 172.21.15.125:0/849482119 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d8001f310 con 0x7f9d9012d280 2023-10-03T10:17:25.495 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 msgr2=0x7f9d90070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 0x7f9d90070a90 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000fdb0 tx=0x7f9d8000d630 comp rx=0 tx=0).stop 2023-10-03T10:17:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 shutdown_connections 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d90130ce0 0x7f9d90071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d9012d280 0x7f9d90070a90 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 --2- 172.21.15.125:0/849482119 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d90130350 0x7f9d90070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 >> 172.21.15.125:0/849482119 conn(0x7f9d900a2980 msgr2=0x7f9d9012c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 shutdown_connections 2023-10-03T10:17:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.497+0000 7f9d969fd700 1 -- 172.21.15.125:0/849482119 wait complete. 2023-10-03T10:17:25.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:25.524 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:25.560 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:25.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 Processor -- start 2023-10-03T10:17:25.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 -- start start 2023-10-03T10:17:25.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 0x7fd050136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05009c970 con 0x7fd05009e870 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0500a0920 con 0x7fd0501371c0 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.674+0000 7fd0582cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05009f9c0 con 0x7fd05009f350 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05686c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05686c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54802/0 (socket says 172.21.15.125:54802) 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05686c700 1 -- 172.21.15.125:0/1445128306 learned_addr learned my addr 172.21.15.125:0/1445128306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 --2- 172.21.15.125:0/1445128306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 0x7fd050136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05606b700 1 --1- 172.21.15.125:0/1445128306 >> v1:172.21.15.125:6789/0 conn(0x7fd05009e870 0x7fd05009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42756/0 (socket says 172.21.15.125:42756) 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 -- 172.21.15.125:0/1445128306 >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 msgr2=0x7fd0501395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 --2- 172.21.15.125:0/1445128306 >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 -- 172.21.15.125:0/1445128306 >> v1:172.21.15.125:6789/0 conn(0x7fd05009e870 legacy=0x7fd05009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 -- 172.21.15.125:0/1445128306 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05009bab0 con 0x7fd05009f350 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05686c700 1 --2- 172.21.15.125:0/1445128306 >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd05586a700 1 --2- 172.21.15.125:0/1445128306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 0x7fd050136c80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd040009840 tx=0x7fd040009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91040b837d11fece server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd055069700 1 -- 172.21.15.125:0/1445128306 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040011830 con 0x7fd05009f350 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd055069700 1 -- 172.21.15.125:0/1445128306 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd040011990 con 0x7fd05009f350 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.675+0000 7fd055069700 1 -- 172.21.15.125:0/1445128306 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040011d20 con 0x7fd05009f350 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 -- 172.21.15.125:0/1445128306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 msgr2=0x7fd050136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 --2- 172.21.15.125:0/1445128306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 0x7fd050136c80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd040009840 tx=0x7fd040009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 -- 172.21.15.125:0/1445128306 shutdown_connections 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 --2- 172.21.15.125:0/1445128306 >> v2:172.21.15.125:3300/0 conn(0x7fd0501371c0 0x7fd0501395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 --2- 172.21.15.125:0/1445128306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009f350 0x7fd050136c80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 -- 172.21.15.125:0/1445128306 >> 172.21.15.125:0/1445128306 conn(0x7fd0500a4430 msgr2=0x7fd0500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 -- 172.21.15.125:0/1445128306 shutdown_connections 2023-10-03T10:17:25.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.676+0000 7fd0582cf700 1 -- 172.21.15.125:0/1445128306 wait complete. 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 Processor -- start 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 -- start start 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 0x7fd05011ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 0x7fd05011e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05011ed50 con 0x7fd05009f350 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd050121350 con 0x7fd0501371c0 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd0582cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05011f440 con 0x7fd05009e870 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd05606b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd05606b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35152/0 (socket says 172.21.15.125:35152) 2023-10-03T10:17:25.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd05586a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 0x7fd05011ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd05606b700 1 -- 172.21.15.125:0/3773304707 learned_addr learned my addr 172.21.15.125:0/3773304707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.677+0000 7fd05686c700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 0x7fd05011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 -- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 msgr2=0x7fd05011e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 0x7fd05011e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 -- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 msgr2=0x7fd05011ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 0x7fd05011ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 -- 172.21.15.125:0/3773304707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048009b30 con 0x7fd05009e870 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05586a700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 0x7fd05011ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05686c700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 0x7fd05011e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd05606b700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c550 tx=0x7fd04c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c005cb0 con 0x7fd05009e870 2023-10-03T10:17:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c005e10 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400094a0 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0072d0 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.678+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd050120db0 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.679+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd04c007430 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.679+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd04c03ea80 con 0x7fd05009e870 2023-10-03T10:17:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.679+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05004f2a0 con 0x7fd05009e870 2023-10-03T10:17:25.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.684+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd04c017030 con 0x7fd05009e870 2023-10-03T10:17:25.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 Processor -- start 2023-10-03T10:17:25.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 -- start start 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 0x7fbd90138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 0x7fbd9013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9009e9d0 con 0x7fbd900a0a70 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9009dc00 con 0x7fbd90139200 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.717+0000 7fbd96420700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9009dec0 con 0x7fbd900a1550 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbd900a0a70 0x7fbd900a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42764/0 (socket says 172.21.15.125:42764) 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 0x7fbd9013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 0x7fbd90138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8ffff700 1 -- 172.21.15.125:0/2725858612 learned_addr learned my addr 172.21.15.125:0/2725858612 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8effd700 1 -- 172.21.15.125:0/2725858612 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199764157 0 0) 0x7fbd9009e9d0 con 0x7fbd900a0a70 2023-10-03T10:17:25.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 -- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 msgr2=0x7fbd90138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 0x7fbd90138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 -- 172.21.15.125:0/2725858612 >> v1:172.21.15.125:6789/0 conn(0x7fbd900a0a70 legacy=0x7fbd900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 -- 172.21.15.125:0/2725858612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9009e6a0 con 0x7fbd90139200 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8f7fe700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 0x7fbd90138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd949bd700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 0x7fbd9013b5e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009dc0 tx=0x7fbd8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449a3d0941d28c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8effd700 1 -- 172.21.15.125:0/2725858612 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800e070 con 0x7fbd90139200 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8effd700 1 -- 172.21.15.125:0/2725858612 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8800bb20 con 0x7fbd90139200 2023-10-03T10:17:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.718+0000 7fbd8effd700 1 -- 172.21.15.125:0/2725858612 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88012430 con 0x7fbd90139200 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 -- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 msgr2=0x7fbd9013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 0x7fbd9013b5e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009dc0 tx=0x7fbd8800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 -- 172.21.15.125:0/2725858612 shutdown_connections 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd90139200 0x7fbd9013b5e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 --2- 172.21.15.125:0/2725858612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a1550 0x7fbd90138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 -- 172.21.15.125:0/2725858612 >> 172.21.15.125:0/2725858612 conn(0x7fbd900a6610 msgr2=0x7fbd900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 -- 172.21.15.125:0/2725858612 shutdown_connections 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.719+0000 7fbd96420700 1 -- 172.21.15.125:0/2725858612 wait complete. 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 Processor -- start 2023-10-03T10:17:25.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 -- start start 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 0x7fbd9011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 0x7fbd9011edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900a03e0 con 0x7fbd90139200 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901220d0 con 0x7fbd900a1550 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.720+0000 7fbd96420700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901205b0 con 0x7fbd900a0a70 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd949bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 0x7fbd9011edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 0x7fbd9011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd949bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54826/0 (socket says 172.21.15.125:54826) 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 0x7fbd9011edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53420/0 (socket says 172.21.15.125:53420) 2023-10-03T10:17:25.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd949bd700 1 -- 172.21.15.125:0/3246029123 learned_addr learned my addr 172.21.15.125:0/3246029123 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 -- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 msgr2=0x7fbd9011edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 0x7fbd9011edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 -- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 msgr2=0x7fbd9011f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 -- 172.21.15.125:0/3246029123 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd840094a0 con 0x7fbd900a0a70 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd949bd700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8ffff700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 0x7fbd9011e890 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c470 tx=0x7fbd8000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80004c80 con 0x7fbd900a0a70 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80004de0 con 0x7fbd900a0a70 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd88009a70 con 0x7fbd900a0a70 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80007310 con 0x7fbd900a0a70 2023-10-03T10:17:25.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.721+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9009d390 con 0x7fbd900a0a70 2023-10-03T10:17:25.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.722+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd80007470 con 0x7fbd900a0a70 2023-10-03T10:17:25.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.722+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd8003f260 con 0x7fbd900a0a70 2023-10-03T10:17:25.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.722+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd90122c00 con 0x7fbd900a0a70 2023-10-03T10:17:25.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.727+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd80007720 con 0x7fbd900a0a70 2023-10-03T10:17:25.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.880+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd05011fc50 con 0x7fd05009e870 2023-10-03T10:17:25.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.881+0000 7fd046ffd700 1 -- 172.21.15.125:0/3773304707 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd04c01b3b0 con 0x7fd05009e870 2023-10-03T10:17:25.881 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 msgr2=0x7fd05011d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c550 tx=0x7fd04c00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 shutdown_connections 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0501371c0 0x7fd05011e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd05009e870 0x7fd05011d880 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 --2- 172.21.15.125:0/3773304707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd05009f350 0x7fd05011ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 >> 172.21.15.125:0/3773304707 conn(0x7fd0500a4430 msgr2=0x7fd0500a1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 shutdown_connections 2023-10-03T10:17:25.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.883+0000 7fd0582cf700 1 -- 172.21.15.125:0/3773304707 wait complete. 2023-10-03T10:17:25.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.917+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd9004f2a0 con 0x7fbd900a0a70 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.917+0000 7fbd8cff9700 1 -- 172.21.15.125:0/3246029123 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd80011360 con 0x7fbd900a0a70 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 msgr2=0x7fbd9011e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 0x7fbd9011e890 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c470 tx=0x7fbd8000c780 comp rx=0 tx=0).stop 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 shutdown_connections 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd90139200 0x7fbd9011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbd900a0a70 0x7fbd9011e890 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 --2- 172.21.15.125:0/3246029123 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd900a1550 0x7fbd9011edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 >> 172.21.15.125:0/3246029123 conn(0x7fbd900a6610 msgr2=0x7fbd90136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 shutdown_connections 2023-10-03T10:17:25.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:25.919+0000 7fbd96420700 1 -- 172.21.15.125:0/3246029123 wait complete. 2023-10-03T10:17:25.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:26.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:26.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:26.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.598+0000 7f10f1c2a700 1 Processor -- start 2023-10-03T10:17:26.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.598+0000 7f10f1c2a700 1 -- start start 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 0x7f10ec0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec0a3b60 con 0x7f10ec0a0a70 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1348e0 con 0x7f10ec09ad40 2023-10-03T10:17:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10f1c2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec09b110 con 0x7f10ec133f70 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53430/0 (socket says 172.21.15.125:53430) 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35192/0 (socket says 172.21.15.125:35192) 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 -- 172.21.15.125:0/2335791329 learned_addr learned my addr 172.21.15.125:0/2335791329 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10ebfff700 1 --2- 172.21.15.125:0/2335791329 >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 0x7f10ec0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 -- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 msgr2=0x7f10ec1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 -- 172.21.15.125:0/2335791329 >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 msgr2=0x7f10ec0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 --2- 172.21.15.125:0/2335791329 >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 0x7f10ec0a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eb7fe700 1 -- 172.21.15.125:0/2335791329 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0a2fa0 con 0x7f10ec09ad40 2023-10-03T10:17:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10eaffd700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.599+0000 7f10ebfff700 1 --2- 172.21.15.125:0/2335791329 >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 0x7f10ec0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10eb7fe700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009e80 tx=0x7f10dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d828095cf885a78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10ea7fc700 1 -- 172.21.15.125:0/2335791329 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00e070 con 0x7f10ec09ad40 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10ea7fc700 1 -- 172.21.15.125:0/2335791329 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00b8d0 con 0x7f10ec09ad40 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10ea7fc700 1 -- 172.21.15.125:0/2335791329 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00bc80 con 0x7f10ec09ad40 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 -- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 msgr2=0x7f10ec133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009e80 tx=0x7f10dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 -- 172.21.15.125:0/2335791329 shutdown_connections 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec09ad40 0x7f10ec133a30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/2335791329 >> v2:172.21.15.125:3300/0 conn(0x7f10ec0a0a70 0x7f10ec0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/2335791329 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec133f70 0x7f10ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 -- 172.21.15.125:0/2335791329 >> 172.21.15.125:0/2335791329 conn(0x7f10ec099c40 msgr2=0x7f10ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 -- 172.21.15.125:0/2335791329 shutdown_connections 2023-10-03T10:17:26.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.600+0000 7f10f1c2a700 1 -- 172.21.15.125:0/2335791329 wait complete. 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.602+0000 7f10f1c2a700 1 Processor -- start 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.602+0000 7f10f1c2a700 1 -- start start 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 0x7f10ec121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec124d30 con 0x7f10ec133f70 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec123cd0 con 0x7f10ec0a0a70 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec122670 con 0x7f10ec09ad40 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53434/0 (socket says 172.21.15.125:53434) 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54840/0 (socket says 172.21.15.125:54840) 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eaffd700 1 -- 172.21.15.125:0/848964777 learned_addr learned my addr 172.21.15.125:0/848964777 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eb7fe700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 0x7f10ec121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 -- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 msgr2=0x7f10ec121210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 0x7f10ec121210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 -- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 msgr2=0x7f10ec121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 -- 172.21.15.125:0/848964777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40094a0 con 0x7f10ec133f70 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eaffd700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10eb7fe700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 0x7f10ec121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10ebfff700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e930 tx=0x7f10e400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4013680 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e40137e0 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d40094a0 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4013b50 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.603+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc009b30 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.604+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e4013cb0 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.604+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10e403f9d0 con 0x7f10ec133f70 2023-10-03T10:17:26.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.605+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec1247f0 con 0x7f10ec133f70 2023-10-03T10:17:26.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.609+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10ec1247f0 con 0x7f10ec133f70 2023-10-03T10:17:26.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.640+0000 7f4b3bd67700 1 Processor -- start 2023-10-03T10:17:26.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 -- start start 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b340a0a70 0x7f4b340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 0x7f4b3413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3409dc00 con 0x7f4b340a1380 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3409ea90 con 0x7f4b340a0a70 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3bd67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3409dec0 con 0x7f4b34134120 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b39b03700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4b340a0a70 0x7f4b340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b3a304700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 0x7f4b3413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b39302700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b340a1380 0x7f4b34133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42778/0 (socket says 172.21.15.125:42778) 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b39302700 1 -- 172.21.15.125:0/3803139580 learned_addr learned my addr 172.21.15.125:0/3803139580 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.641+0000 7f4b39b03700 1 -- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 msgr2=0x7f4b3413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b39b03700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 0x7f4b3413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b39b03700 1 -- 172.21.15.125:0/3803139580 >> v1:172.21.15.125:6789/0 conn(0x7f4b340a1380 legacy=0x7f4b34133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b39b03700 1 -- 172.21.15.125:0/3803139580 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3409e6a0 con 0x7f4b340a0a70 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3a304700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 0x7f4b3413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b39b03700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b340a0e40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009840 tx=0x7f4b30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db064fdc8ab45c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b38b01700 1 -- 172.21.15.125:0/3803139580 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011830 con 0x7f4b340a0a70 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b38b01700 1 -- 172.21.15.125:0/3803139580 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30011990 con 0x7f4b340a0a70 2023-10-03T10:17:26.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b38b01700 1 -- 172.21.15.125:0/3803139580 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011d20 con 0x7f4b340a0a70 2023-10-03T10:17:26.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 -- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 msgr2=0x7f4b340a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b340a0e40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009840 tx=0x7f4b30009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 -- 172.21.15.125:0/3803139580 shutdown_connections 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b34134120 0x7f4b3413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/3803139580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b340a0e40 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.642+0000 7f4b3bd67700 1 -- 172.21.15.125:0/3803139580 >> 172.21.15.125:0/3803139580 conn(0x7f4b340a6610 msgr2=0x7f4b340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.643+0000 7f4b3bd67700 1 -- 172.21.15.125:0/3803139580 shutdown_connections 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.643+0000 7f4b3bd67700 1 -- 172.21.15.125:0/3803139580 wait complete. 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.643+0000 7f4b3bd67700 1 Processor -- start 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.643+0000 7f4b3bd67700 1 -- start start 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b34123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b34134120 0x7f4b341c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34133aa0 con 0x7f4b340a0a70 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340a03e0 con 0x7f4b34134120 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3bd67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34125300 con 0x7f4b340a1380 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39b03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b34123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39b03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b34123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54848/0 (socket says 172.21.15.125:54848) 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b3a304700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b34134120 0x7f4b341c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35232/0 (socket says 172.21.15.125:35232) 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39b03700 1 -- 172.21.15.125:0/1739650964 learned_addr learned my addr 172.21.15.125:0/1739650964 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 -- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b34134120 msgr2=0x7f4b341c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b34134120 0x7f4b341c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 -- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 msgr2=0x7f4b34123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b34123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 -- 172.21.15.125:0/1739650964 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009a70 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.644+0000 7f4b39302700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400c500 tx=0x7f4b2400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400cea0 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24005d70 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b300094a0 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240072d0 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b34126d30 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b24007430 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.645+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b2403e920 con 0x7f4b340a1380 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.646+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3409c8f0 con 0x7f4b340a1380 2023-10-03T10:17:26.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.654+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b2401b3b0 con 0x7f4b340a1380 2023-10-03T10:17:26.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.806+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10ec1247f0 con 0x7f10ec133f70 2023-10-03T10:17:26.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.807+0000 7f10e3fff700 1 -- 172.21.15.125:0/848964777 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10ec1247f0 con 0x7f10ec133f70 2023-10-03T10:17:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 msgr2=0x7f10ec121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e930 tx=0x7f10e400ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:26.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 shutdown_connections 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10ec133f70 0x7f10ec121c90 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f10ec09ad40 0x7f10ec121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 --2- 172.21.15.125:0/848964777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10ec0a0a70 0x7f10ec121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 >> 172.21.15.125:0/848964777 conn(0x7f10ec099c40 msgr2=0x7f10ec133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 shutdown_connections 2023-10-03T10:17:26.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.809+0000 7f10f1c2a700 1 -- 172.21.15.125:0/848964777 wait complete. 2023-10-03T10:17:26.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:26.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.847+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b3404f2a0 con 0x7f4b340a1380 2023-10-03T10:17:26.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.848+0000 7f4b2a7fc700 1 -- 172.21.15.125:0/1739650964 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b24017020 con 0x7f4b340a1380 2023-10-03T10:17:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 msgr2=0x7f4b34123890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400c500 tx=0x7f4b2400c810 comp rx=0 tx=0).stop 2023-10-03T10:17:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 shutdown_connections 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b34134120 0x7f4b341c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b340a0a70 0x7f4b34123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 --2- 172.21.15.125:0/1739650964 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4b340a1380 0x7f4b34123890 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 >> 172.21.15.125:0/1739650964 conn(0x7f4b340a6610 msgr2=0x7f4b340a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 shutdown_connections 2023-10-03T10:17:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:26.850+0000 7f4b3bd67700 1 -- 172.21.15.125:0/1739650964 wait complete. 2023-10-03T10:17:26.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:26.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:26.933 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:27.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 Processor -- start 2023-10-03T10:17:27.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 -- start start 2023-10-03T10:17:27.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee00136960 0x7fee00138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 0x7fee0013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0006b2d0 con 0x7fee00133ad0 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee001345b0 con 0x7fee00136960 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee070bf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee00133610 con 0x7fee00139280 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fedfffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee00136960 0x7fee00138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee0565c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 0x7fee0013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee04e5b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fee00133ad0 0x7fee00133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42782/0 (socket says 172.21.15.125:42782) 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fee04e5b700 1 -- 172.21.15.125:0/1158823153 learned_addr learned my addr 172.21.15.125:0/1158823153 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.030+0000 7fedfffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee00136960 0x7fee00138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54854/0 (socket says 172.21.15.125:54854) 2023-10-03T10:17:27.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedfffff700 1 -- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 msgr2=0x7fee0013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedfffff700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 0x7fee0013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedfffff700 1 -- 172.21.15.125:0/1158823153 >> v1:172.21.15.125:6789/0 conn(0x7fee00133ad0 legacy=0x7fee00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedfffff700 1 -- 172.21.15.125:0/1158823153 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0009a500 con 0x7fee00136960 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedff7fe700 1 -- 172.21.15.125:0/1158823153 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944298075 0 0) 0x7fee0006b2d0 con 0x7fee00133ad0 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fee0565c700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 0x7fee0013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedfffff700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00136960 0x7fee00138d40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fedec009840 tx=0x7fedec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cd123a159b46ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedff7fe700 1 -- 172.21.15.125:0/1158823153 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011830 con 0x7fee00136960 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedff7fe700 1 -- 172.21.15.125:0/1158823153 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec011990 con 0x7fee00136960 2023-10-03T10:17:27.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.031+0000 7fedff7fe700 1 -- 172.21.15.125:0/1158823153 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011d20 con 0x7fee00136960 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 -- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00136960 msgr2=0x7fee00138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00136960 0x7fee00138d40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fedec009840 tx=0x7fedec009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 -- 172.21.15.125:0/1158823153 shutdown_connections 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00139280 0x7fee0013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 --2- 172.21.15.125:0/1158823153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00136960 0x7fee00138d40 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 -- 172.21.15.125:0/1158823153 >> 172.21.15.125:0/1158823153 conn(0x7fee00099c40 msgr2=0x7fee000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 -- 172.21.15.125:0/1158823153 shutdown_connections 2023-10-03T10:17:27.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.032+0000 7fee070bf700 1 -- 172.21.15.125:0/1158823153 wait complete. 2023-10-03T10:17:27.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.033+0000 7fee070bf700 1 Processor -- start 2023-10-03T10:17:27.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.033+0000 7fee070bf700 1 -- start start 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee00133ad0 0x7fee00071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 0x7fee00071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0006ec30 con 0x7fee00139280 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00072200 con 0x7fee00133ad0 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee070bf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee001317a0 con 0x7fee00136960 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee0565c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee04e5b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee00133ad0 0x7fee00071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 0x7fee00071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee0565c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54862/0 (socket says 172.21.15.125:54862) 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee0565c700 1 -- 172.21.15.125:0/3436815716 learned_addr learned my addr 172.21.15.125:0/3436815716 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 -- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee00133ad0 msgr2=0x7fee00071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee00133ad0 0x7fee00071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 -- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 msgr2=0x7fee00071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 -- 172.21.15.125:0/3436815716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8009a70 con 0x7fee00136960 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fee0565c700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.034+0000 7fedfffff700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 0x7fee00071690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fedec016000 tx=0x7fedec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec004480 con 0x7fee00136960 2023-10-03T10:17:27.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec01f070 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0094a0 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0038a0 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0006ee50 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.035+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedec021030 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.036+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fedec040a20 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.036+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0004f2a0 con 0x7fee00136960 2023-10-03T10:17:27.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.040+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedec003a00 con 0x7fee00136960 2023-10-03T10:17:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.071+0000 7fc3dd61c700 1 Processor -- start 2023-10-03T10:17:27.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.071+0000 7fc3dd61c700 1 -- start start 2023-10-03T10:17:27.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3dd61c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3dd61c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3dd61c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d809b110 con 0x7fc3d8133f70 2023-10-03T10:17:27.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3dd61c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80a3b60 con 0x7fc3d809ad40 2023-10-03T10:17:27.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3dd61c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80a2fa0 con 0x7fc3d81343a0 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d67fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc3d8133f70 0x7fc3d80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42788/0 (socket says 172.21.15.125:42788) 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d67fc700 1 -- 172.21.15.125:0/392547484 learned_addr learned my addr 172.21.15.125:0/392547484 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53464/0 (socket says 172.21.15.125:53464) 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d77fe700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 -- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 msgr2=0x7fc3d80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d5ffb700 1 -- 172.21.15.125:0/392547484 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735604881 0 0) 0x7fc3d809b110 con 0x7fc3d8133f70 2023-10-03T10:17:27.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 -- 172.21.15.125:0/392547484 >> v1:172.21.15.125:6789/0 conn(0x7fc3d8133f70 legacy=0x7fc3d80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.072+0000 7fc3d6ffd700 1 -- 172.21.15.125:0/392547484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d809a280 con 0x7fc3d809ad40 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3d6ffd700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009870 tx=0x7fc3c8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a614c79f242ac882 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3d5ffb700 1 -- 172.21.15.125:0/392547484 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011830 con 0x7fc3d809ad40 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3d5ffb700 1 -- 172.21.15.125:0/392547484 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8011990 con 0x7fc3d809ad40 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3d5ffb700 1 -- 172.21.15.125:0/392547484 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011d20 con 0x7fc3d809ad40 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 -- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 msgr2=0x7fc3d8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009870 tx=0x7fc3c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 -- 172.21.15.125:0/392547484 shutdown_connections 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/392547484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d8133a30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 -- 172.21.15.125:0/392547484 >> 172.21.15.125:0/392547484 conn(0x7fc3d8099c40 msgr2=0x7fc3d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.073+0000 7fc3dd61c700 1 -- 172.21.15.125:0/392547484 shutdown_connections 2023-10-03T10:17:27.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.074+0000 7fc3dd61c700 1 -- 172.21.15.125:0/392547484 wait complete. 2023-10-03T10:17:27.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.074+0000 7fc3dd61c700 1 Processor -- start 2023-10-03T10:17:27.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 -- start start 2023-10-03T10:17:27.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d81212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8124a40 con 0x7fc3d8133f70 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8122f20 con 0x7fc3d809ad40 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3dd61c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d809e880 con 0x7fc3d81343a0 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54866/0 (socket says 172.21.15.125:54866) 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35260/0 (socket says 172.21.15.125:35260) 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 -- 172.21.15.125:0/696260921 learned_addr learned my addr 172.21.15.125:0/696260921 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d6ffd700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d81212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 -- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 msgr2=0x7fc3d8121d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 -- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 msgr2=0x7fc3d81212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d81212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d67fc700 1 -- 172.21.15.125:0/696260921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80094a0 con 0x7fc3d8133f70 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.075+0000 7fc3d77fe700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3d67fc700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc001eb0 tx=0x7fc3cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc004c80 con 0x7fc3d8133f70 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc004de0 con 0x7fc3d8133f70 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc007310 con 0x7fc3d8133f70 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d809c7e0 con 0x7fc3d8133f70 2023-10-03T10:17:27.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.076+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d81325d0 con 0x7fc3d8133f70 2023-10-03T10:17:27.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.077+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3cc007470 con 0x7fc3d8133f70 2023-10-03T10:17:27.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.077+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3cc03f2b0 con 0x7fc3d8133f70 2023-10-03T10:17:27.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.077+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d8124b80 con 0x7fc3d8133f70 2023-10-03T10:17:27.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.081+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3d8124b80 con 0x7fc3d8133f70 2023-10-03T10:17:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.233+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee0009f0f0 con 0x7fee00136960 2023-10-03T10:17:27.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.234+0000 7fedfd7fa700 1 -- 172.21.15.125:0/3436815716 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedec015020 con 0x7fee00136960 2023-10-03T10:17:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 msgr2=0x7fee00071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 0x7fee00071690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fedec016000 tx=0x7fedec004750 comp rx=0 tx=0).stop 2023-10-03T10:17:27.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 shutdown_connections 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00139280 0x7fee00071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee00133ad0 0x7fee00071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 --2- 172.21.15.125:0/3436815716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee00136960 0x7fee00071690 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 >> 172.21.15.125:0/3436815716 conn(0x7fee00099c40 msgr2=0x7fee000a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 shutdown_connections 2023-10-03T10:17:27.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.236+0000 7fee070bf700 1 -- 172.21.15.125:0/3436815716 wait complete. 2023-10-03T10:17:27.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.276+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3d8124b80 con 0x7fc3d8133f70 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.276+0000 7fc3bf7fe700 1 -- 172.21.15.125:0/696260921 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3d8124b80 con 0x7fc3d8133f70 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 msgr2=0x7fc3d81217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc001eb0 tx=0x7fc3cc00c800 comp rx=0 tx=0).stop 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 shutdown_connections 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc3d81343a0 0x7fc3d8121d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3d809ad40 0x7fc3d81212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 --2- 172.21.15.125:0/696260921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3d8133f70 0x7fc3d81217e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 >> 172.21.15.125:0/696260921 conn(0x7fc3d8099c40 msgr2=0x7fc3d80a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 shutdown_connections 2023-10-03T10:17:27.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.278+0000 7fc3dd61c700 1 -- 172.21.15.125:0/696260921 wait complete. 2023-10-03T10:17:27.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:27.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:27.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:27.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.952+0000 7f1f739be700 1 Processor -- start 2023-10-03T10:17:27.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.952+0000 7f1f739be700 1 -- start start 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f739be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 0x7f1f6c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f739be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f6c134120 0x7f1f6c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f739be700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c09dc00 con 0x7f1f6c0a1380 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f739be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c09ea60 con 0x7f1f6c134120 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f739be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c09dec0 con 0x7f1f6c0a0a70 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f70f59700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1f6c0a1380 0x7f1f6c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42800/0 (socket says 172.21.15.125:42800) 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f7175a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 0x7f1f6c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f6c134120 0x7f1f6c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f70f59700 1 -- 172.21.15.125:0/3564947308 learned_addr learned my addr 172.21.15.125:0/3564947308 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f63fff700 1 -- 172.21.15.125:0/3564947308 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833766728 0 0) 0x7f1f6c09dc00 con 0x7f1f6c0a1380 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f63fff700 1 -- 172.21.15.125:0/3564947308 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f580035b0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 -- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 msgr2=0x7f1f6c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 0x7f1f6c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 -- 172.21.15.125:0/3564947308 >> v1:172.21.15.125:6789/0 conn(0x7f1f6c0a1380 legacy=0x7f1f6c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 -- 172.21.15.125:0/3564947308 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c09e6a0 con 0x7f1f6c134120 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f7175a700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 0x7f1f6c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.953+0000 7f1f71f5b700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c13bce0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009d90 tx=0x7f1f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68140e7c593756d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f63fff700 1 -- 172.21.15.125:0/3564947308 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400e070 con 0x7f1f6c134120 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f63fff700 1 -- 172.21.15.125:0/3564947308 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400bb20 con 0x7f1f6c134120 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f63fff700 1 -- 172.21.15.125:0/3564947308 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64012430 con 0x7f1f6c134120 2023-10-03T10:17:27.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 -- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 msgr2=0x7f1f6c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c13bce0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009d90 tx=0x7f1f6400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 -- 172.21.15.125:0/3564947308 shutdown_connections 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c13bce0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 --2- 172.21.15.125:0/3564947308 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a0a70 0x7f1f6c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 -- 172.21.15.125:0/3564947308 >> 172.21.15.125:0/3564947308 conn(0x7f1f6c0a6610 msgr2=0x7f1f6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 -- 172.21.15.125:0/3564947308 shutdown_connections 2023-10-03T10:17:27.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.954+0000 7f1f739be700 1 -- 172.21.15.125:0/3564947308 wait complete. 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 Processor -- start 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 -- start start 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 0x7f1f6c122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 0x7f1f6c122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c1233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c124e10 con 0x7f1f6c134120 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c133880 con 0x7f1f6c0a0a70 2023-10-03T10:17:27.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f739be700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c126170 con 0x7f1f6c0a1380 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f7175a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 0x7f1f6c122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f70f59700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 0x7f1f6c122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f71f5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c1233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f7175a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 0x7f1f6c122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53480/0 (socket says 172.21.15.125:53480) 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.956+0000 7f1f7175a700 1 -- 172.21.15.125:0/4204768281 learned_addr learned my addr 172.21.15.125:0/4204768281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 -- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 msgr2=0x7f1f6c122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 0x7f1f6c122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 -- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 msgr2=0x7f1f6c1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c1233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 -- 172.21.15.125:0/4204768281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094a0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f71f5b700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f70f59700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 0x7f1f6c122e70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c490 tx=0x7f1f5c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c005d70 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0070d0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64009a70 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c007440 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.957+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c125f00 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.958+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f5c0075a0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.958+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f5c03e730 con 0x7f1f6c0a1380 2023-10-03T10:17:27.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.958+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c1263b0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.963+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f5c018af0 con 0x7f1f6c0a1380 2023-10-03T10:17:27.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.991+0000 7f3cb8366700 1 Processor -- start 2023-10-03T10:17:27.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.991+0000 7f3cb8366700 1 -- start start 2023-10-03T10:17:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb8366700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 0x7f3cb0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb8366700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb8366700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb009fa00 con 0x7f3cb009e870 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb8366700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00a0370 con 0x7f3cb01393a0 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb8366700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb006bec0 con 0x7f3cb009f350 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb6903700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb5901700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 0x7f3cb0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb6102700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3cb009e870 0x7f3cb009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42802/0 (socket says 172.21.15.125:42802) 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb6102700 1 -- 172.21.15.125:0/3594268687 learned_addr learned my addr 172.21.15.125:0/3594268687 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.992+0000 7f3cb5100700 1 -- 172.21.15.125:0/3594268687 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432156620 0 0) 0x7f3cb009fa00 con 0x7f3cb009e870 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5100700 1 -- 172.21.15.125:0/3594268687 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c9c0035b0 con 0x7f3cb009e870 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5901700 1 -- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 msgr2=0x7f3cb013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5901700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5901700 1 -- 172.21.15.125:0/3594268687 >> v1:172.21.15.125:6789/0 conn(0x7f3cb009e870 legacy=0x7f3cb009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5901700 1 -- 172.21.15.125:0/3594268687 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb009ada0 con 0x7f3cb009f350 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb6903700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5901700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 0x7f3cb0138e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3256f23f0b557f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5100700 1 -- 172.21.15.125:0/3594268687 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0011830 con 0x7f3cb009f350 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5100700 1 -- 172.21.15.125:0/3594268687 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0011990 con 0x7f3cb009f350 2023-10-03T10:17:27.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb5100700 1 -- 172.21.15.125:0/3594268687 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0011d20 con 0x7f3cb009f350 2023-10-03T10:17:27.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb8366700 1 -- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 msgr2=0x7f3cb0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.993+0000 7f3cb8366700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 0x7f3cb0138e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 -- 172.21.15.125:0/3594268687 shutdown_connections 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 --2- 172.21.15.125:0/3594268687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009f350 0x7f3cb0138e60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 -- 172.21.15.125:0/3594268687 >> 172.21.15.125:0/3594268687 conn(0x7f3cb00a4430 msgr2=0x7f3cb00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 -- 172.21.15.125:0/3594268687 shutdown_connections 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 -- 172.21.15.125:0/3594268687 wait complete. 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.994+0000 7f3cb8366700 1 Processor -- start 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 -- start start 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009e870 0x7f3cb01209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb0121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0124500 con 0x7f3cb009f350 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0123bf0 con 0x7f3cb01393a0 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb8366700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00a1760 con 0x7f3cb009e870 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54902/0 (socket says 172.21.15.125:54902) 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 -- 172.21.15.125:0/14853681 learned_addr learned my addr 172.21.15.125:0/14853681 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb6903700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb0121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb6102700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009e870 0x7f3cb01209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 -- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009e870 msgr2=0x7f3cb01209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009e870 0x7f3cb01209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 -- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 msgr2=0x7f3cb0121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb0121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb5901700 1 -- 172.21.15.125:0/14853681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8009a70 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.995+0000 7f3cb6903700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb0121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3cb5901700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00090b0 tx=0x7f3ca0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0004550 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca001f070 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00038e0 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca00094a0 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb0122d00 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.996+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca0003a40 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.997+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ca0021070 con 0x7f3cb009f350 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:27.997+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb004f2a0 con 0x7f3cb009f350 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.001+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ca001a430 con 0x7f3cb009f350 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.158+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f6c04f2a0 con 0x7f1f6c0a1380 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.159+0000 7f1f61ffb700 1 -- 172.21.15.125:0/4204768281 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f5c017020 con 0x7f1f6c0a1380 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 msgr2=0x7f1f6c122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 0x7f1f6c122e70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c490 tx=0x7f1f5c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 shutdown_connections 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6c134120 0x7f1f6c1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6c0a0a70 0x7f1f6c122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 --2- 172.21.15.125:0/4204768281 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1f6c0a1380 0x7f1f6c122e70 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 >> 172.21.15.125:0/4204768281 conn(0x7f1f6c0a6610 msgr2=0x7f1f6c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 shutdown_connections 2023-10-03T10:17:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.161+0000 7f1f739be700 1 -- 172.21.15.125:0/4204768281 wait complete. 2023-10-03T10:17:28.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.194+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cb0072d60 con 0x7f3cb009f350 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.194+0000 7f3ca6ffd700 1 -- 172.21.15.125:0/14853681 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ca0015020 con 0x7f3cb009f350 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 msgr2=0x7f3cb0120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00090b0 tx=0x7f3ca0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 shutdown_connections 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb01393a0 0x7f3cb0121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb009e870 0x7f3cb01209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 --2- 172.21.15.125:0/14853681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb009f350 0x7f3cb0120f20 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 >> 172.21.15.125:0/14853681 conn(0x7f3cb00a4430 msgr2=0x7f3cb0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 shutdown_connections 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.196+0000 7f3cb8366700 1 -- 172.21.15.125:0/14853681 wait complete. 2023-10-03T10:17:28.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:28.249 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:28.292 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:28.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 Processor -- start 2023-10-03T10:17:28.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 -- start start 2023-10-03T10:17:28.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 0x7f242c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 0x7f242c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c06b5c0 con 0x7f242c131a00 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c06e900 con 0x7f242c06a770 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f2432547700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f242c09d180 con 0x7f242c09dec0 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.376+0000 7f242bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 0x7f242c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f2430ae4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f242c131a00 0x7f242c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42808/0 (socket says 172.21.15.125:42808) 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f2430ae4700 1 -- 172.21.15.125:0/245531622 learned_addr learned my addr 172.21.15.125:0/245531622 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242b7fe700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 0x7f242c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242bfff700 1 -- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 msgr2=0x7f242c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242affd700 1 -- 172.21.15.125:0/245531622 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306624206 0 0) 0x7f242c06b5c0 con 0x7f242c131a00 2023-10-03T10:17:28.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242bfff700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 0x7f242c06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242bfff700 1 -- 172.21.15.125:0/245531622 >> v1:172.21.15.125:6789/0 conn(0x7f242c131a00 legacy=0x7f242c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242bfff700 1 -- 172.21.15.125:0/245531622 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c09e780 con 0x7f242c06a770 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242b7fe700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 0x7f242c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242bfff700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 0x7f242c06ab40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ef2e553bda83f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242affd700 1 -- 172.21.15.125:0/245531622 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011830 con 0x7f242c06a770 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242affd700 1 -- 172.21.15.125:0/245531622 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c011990 con 0x7f242c06a770 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.377+0000 7f242affd700 1 -- 172.21.15.125:0/245531622 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011d20 con 0x7f242c06a770 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 -- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 msgr2=0x7f242c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 0x7f242c06ab40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 -- 172.21.15.125:0/245531622 shutdown_connections 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c06a770 0x7f242c06ab40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 --2- 172.21.15.125:0/245531622 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c09dec0 0x7f242c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 -- 172.21.15.125:0/245531622 >> 172.21.15.125:0/245531622 conn(0x7f242c099c40 msgr2=0x7f242c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 -- 172.21.15.125:0/245531622 shutdown_connections 2023-10-03T10:17:28.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.378+0000 7f2432547700 1 -- 172.21.15.125:0/245531622 wait complete. 2023-10-03T10:17:28.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 Processor -- start 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 -- start start 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 0x7f242c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 0x7f242c1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f242c131a00 0x7f242c1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c09c290 con 0x7f242c131a00 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c1205a0 con 0x7f242c09dec0 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2432547700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f242c11f610 con 0x7f242c06a770 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 0x7f242c1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f242bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 0x7f242c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 0x7f242c1c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53506/0 (socket says 172.21.15.125:53506) 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f242b7fe700 1 -- 172.21.15.125:0/1132818940 learned_addr learned my addr 172.21.15.125:0/1132818940 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:28.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.379+0000 7f2430ae4700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f242c131a00 0x7f242c1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 -- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 msgr2=0x7f242c1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 0x7f242c1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 -- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f242c131a00 msgr2=0x7f242c1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f242c131a00 0x7f242c1c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 -- 172.21.15.125:0/1132818940 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200094a0 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f242bfff700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 0x7f242c1c8200 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f241c016000 tx=0x7f241c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c004550 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c01f070 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c0094a0 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0038e0 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.380+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c071ce0 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.381+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f241c003a40 con 0x7f242c06a770 2023-10-03T10:17:28.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.381+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c04f2a0 con 0x7f242c06a770 2023-10-03T10:17:28.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.381+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f241c021070 con 0x7f242c06a770 2023-10-03T10:17:28.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.386+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f241c02f3a0 con 0x7f242c06a770 2023-10-03T10:17:28.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.418+0000 7fd241bc8700 1 Processor -- start 2023-10-03T10:17:28.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.418+0000 7fd241bc8700 1 -- start start 2023-10-03T10:17:28.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd241bc8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd23c09f350 0x7fd23c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd241bc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd241bc8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c09c970 con 0x7fd23c09e870 2023-10-03T10:17:28.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd241bc8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0a0920 con 0x7fd23c09f350 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd241bc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c09f9c0 con 0x7fd23c1371c0 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd23c09f350 0x7fd23c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd23c09f350 0x7fd23c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54918/0 (socket says 172.21.15.125:54918) 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53518/0 (socket says 172.21.15.125:53518) 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 -- 172.21.15.125:0/85632472 learned_addr learned my addr 172.21.15.125:0/85632472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 -- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 msgr2=0x7fd23c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 -- 172.21.15.125:0/85632472 >> v1:172.21.15.125:6789/0 conn(0x7fd23c09e870 legacy=0x7fd23c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 -- 172.21.15.125:0/85632472 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c09bab0 con 0x7fd23c09f350 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23a7fc700 1 -- 172.21.15.125:0/85632472 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822788713 0 0) 0x7fd23c09c970 con 0x7fd23c09e870 2023-10-03T10:17:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23bfff700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23affd700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09f350 0x7fd23c136c80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd2240098f0 tx=0x7fd224009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc70a3fcbc7cfeae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23a7fc700 1 -- 172.21.15.125:0/85632472 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011830 con 0x7fd23c09f350 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23a7fc700 1 -- 172.21.15.125:0/85632472 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd224011990 con 0x7fd23c09f350 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.419+0000 7fd23a7fc700 1 -- 172.21.15.125:0/85632472 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011d20 con 0x7fd23c09f350 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 -- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09f350 msgr2=0x7fd23c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09f350 0x7fd23c136c80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd2240098f0 tx=0x7fd224009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 -- 172.21.15.125:0/85632472 shutdown_connections 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c1371c0 0x7fd23c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 --2- 172.21.15.125:0/85632472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09f350 0x7fd23c136c80 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 -- 172.21.15.125:0/85632472 >> 172.21.15.125:0/85632472 conn(0x7fd23c0a4430 msgr2=0x7fd23c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 -- 172.21.15.125:0/85632472 shutdown_connections 2023-10-03T10:17:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.420+0000 7fd241bc8700 1 -- 172.21.15.125:0/85632472 wait complete. 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 Processor -- start 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 -- start start 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd23c1371c0 0x7fd23c121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c122310 con 0x7fd23c09e870 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c09dba0 con 0x7fd23c09f350 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd241bc8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c123fb0 con 0x7fd23c1371c0 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd23affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.421+0000 7fd23b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53534/0 (socket says 172.21.15.125:53534) 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 -- 172.21.15.125:0/1804555947 learned_addr learned my addr 172.21.15.125:0/1804555947 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54928/0 (socket says 172.21.15.125:54928) 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23bfff700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd23c1371c0 0x7fd23c121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 -- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd23c1371c0 msgr2=0x7fd23c121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd23c1371c0 0x7fd23c121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 -- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 msgr2=0x7fd23c120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 -- 172.21.15.125:0/1804555947 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340094a0 con 0x7fd23c09f350 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23b7fe700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd23affd700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd224009c40 tx=0x7fd224004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224004340 con 0x7fd23c09f350 2023-10-03T10:17:28.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22401f070 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224009550 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240036a0 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.422+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c1365f0 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.423+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c04f2a0 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.423+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd224021030 con 0x7fd23c09f350 2023-10-03T10:17:28.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.423+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd224040970 con 0x7fd23c09f350 2023-10-03T10:17:28.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.432+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2240199a0 con 0x7fd23c09f350 2023-10-03T10:17:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.584+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f242c09e380 con 0x7f242c06a770 2023-10-03T10:17:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.584+0000 7f2428ff9700 1 -- 172.21.15.125:0/1132818940 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f241c02b030 con 0x7f242c06a770 2023-10-03T10:17:28.585 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 msgr2=0x7f242c1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 0x7f242c1c8200 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f241c016000 tx=0x7f241c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 shutdown_connections 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f242c131a00 0x7f242c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f242c06a770 0x7f242c1c8200 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 --2- 172.21.15.125:0/1132818940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f242c09dec0 0x7f242c1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 >> 172.21.15.125:0/1132818940 conn(0x7f242c099c40 msgr2=0x7f242c0a19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 shutdown_connections 2023-10-03T10:17:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.586+0000 7f2432547700 1 -- 172.21.15.125:0/1132818940 wait complete. 2023-10-03T10:17:28.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:28.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.626+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd23c1238a0 con 0x7fd23c09f350 2023-10-03T10:17:28.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.626+0000 7fd233fff700 1 -- 172.21.15.125:0/1804555947 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd224015030 con 0x7fd23c09f350 2023-10-03T10:17:28.627 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 msgr2=0x7fd23c120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd224009c40 tx=0x7fd224004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 shutdown_connections 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd23c1371c0 0x7fd23c121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd23c09e870 0x7fd23c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 --2- 172.21.15.125:0/1804555947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd23c09f350 0x7fd23c120c40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.628+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 >> 172.21.15.125:0/1804555947 conn(0x7fd23c0a4430 msgr2=0x7fd23c0a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.629+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 shutdown_connections 2023-10-03T10:17:28.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:28.629+0000 7fd241bc8700 1 -- 172.21.15.125:0/1804555947 wait complete. 2023-10-03T10:17:28.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:29.174 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:29.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:29.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.303+0000 7fc10f39e700 1 Processor -- start 2023-10-03T10:17:29.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 -- start start 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1080a1450 0x7fc108138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080a2640 con 0x7fc1080a0970 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10809dde0 con 0x7fc1080a1450 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.304+0000 7fc10f39e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080a2820 con 0x7fc108139090 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10eb9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1080a1450 0x7fc108138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10e39c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc1080a0970 0x7fc1080a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42826/0 (socket says 172.21.15.125:42826) 2023-10-03T10:17:29.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10eb9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35340/0 (socket says 172.21.15.125:35340) 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10e39c700 1 -- 172.21.15.125:0/436712728 learned_addr learned my addr 172.21.15.125:0/436712728 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc1080a1450 0x7fc108138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54936/0 (socket says 172.21.15.125:54936) 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 -- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 msgr2=0x7fc10813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 -- 172.21.15.125:0/436712728 >> v1:172.21.15.125:6789/0 conn(0x7fc1080a0970 legacy=0x7fc1080a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 -- 172.21.15.125:0/436712728 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080a2330 con 0x7fc1080a1450 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10d39a700 1 -- 172.21.15.125:0/436712728 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835609643 0 0) 0x7fc1080a2640 con 0x7fc1080a0970 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10eb9d700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10db9b700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1080a1450 0x7fc108138b50 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009840 tx=0x7fc0f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcab532d752e08c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10d39a700 1 -- 172.21.15.125:0/436712728 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8011830 con 0x7fc1080a1450 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10d39a700 1 -- 172.21.15.125:0/436712728 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8011990 con 0x7fc1080a1450 2023-10-03T10:17:29.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.305+0000 7fc10d39a700 1 -- 172.21.15.125:0/436712728 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8011d20 con 0x7fc1080a1450 2023-10-03T10:17:29.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 -- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1080a1450 msgr2=0x7fc108138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1080a1450 0x7fc108138b50 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009840 tx=0x7fc0f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 -- 172.21.15.125:0/436712728 shutdown_connections 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc108139090 0x7fc10813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 --2- 172.21.15.125:0/436712728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1080a1450 0x7fc108138b50 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 -- 172.21.15.125:0/436712728 >> 172.21.15.125:0/436712728 conn(0x7fc1080a6070 msgr2=0x7fc1080a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 -- 172.21.15.125:0/436712728 shutdown_connections 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.306+0000 7fc10f39e700 1 -- 172.21.15.125:0/436712728 wait complete. 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.307+0000 7fc10f39e700 1 Processor -- start 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 -- start start 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 0x7fc1081207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 0x7fc108121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108122390 con 0x7fc108139090 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081229b0 con 0x7fc1080a0970 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10f39e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10809cdc0 con 0x7fc1080a1450 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10db9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10db9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35342/0 (socket says 172.21.15.125:35342) 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10eb9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 0x7fc108121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10e39c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 0x7fc1081207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.308+0000 7fc10db9b700 1 -- 172.21.15.125:0/3750932398 learned_addr learned my addr 172.21.15.125:0/3750932398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 -- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 msgr2=0x7fc108120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 -- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 msgr2=0x7fc1081207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 0x7fc1081207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 -- 172.21.15.125:0/3750932398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009a70 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10db9b700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10e39c700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 0x7fc1081207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10eb9d700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 0x7fc108121250 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000ca90 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000f040 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80094a0 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000ce30 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.309+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc108123a90 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.310+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc100014480 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.310+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc10003fac0 con 0x7fc108139090 2023-10-03T10:17:29.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.310+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1081240e0 con 0x7fc108139090 2023-10-03T10:17:29.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.315+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc100012750 con 0x7fc108139090 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.342+0000 7fe09b980700 1 Processor -- start 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 -- start start 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 0x7fe094138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe094139200 0x7fe09413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09409e9d0 con 0x7fe0940a0a70 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09409dc00 con 0x7fe094139200 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09b980700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09409dec0 con 0x7fe0940a1550 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe099f1d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe094139200 0x7fe09413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe098f1b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 0x7fe094138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09971c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe0940a0a70 0x7fe0940a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42830/0 (socket says 172.21.15.125:42830) 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.343+0000 7fe09971c700 1 -- 172.21.15.125:0/2705583690 learned_addr learned my addr 172.21.15.125:0/2705583690 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe099f1d700 1 -- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 msgr2=0x7fe094138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe099f1d700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 0x7fe094138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe099f1d700 1 -- 172.21.15.125:0/2705583690 >> v1:172.21.15.125:6789/0 conn(0x7fe0940a0a70 legacy=0x7fe0940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe099f1d700 1 -- 172.21.15.125:0/2705583690 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09409e6a0 con 0x7fe094139200 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe08bfff700 1 -- 172.21.15.125:0/2705583690 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141692769 0 0) 0x7fe09409e9d0 con 0x7fe0940a0a70 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe098f1b700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 0x7fe094138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe099f1d700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe09413b5e0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009d90 tx=0x7fe08c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a244cd979d1aa7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe08bfff700 1 -- 172.21.15.125:0/2705583690 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00e070 con 0x7fe094139200 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe08bfff700 1 -- 172.21.15.125:0/2705583690 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00bb20 con 0x7fe094139200 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.344+0000 7fe08bfff700 1 -- 172.21.15.125:0/2705583690 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c012430 con 0x7fe094139200 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 -- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 msgr2=0x7fe09413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe09413b5e0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009d90 tx=0x7fe08c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 -- 172.21.15.125:0/2705583690 shutdown_connections 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe09413b5e0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 --2- 172.21.15.125:0/2705583690 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a1550 0x7fe094138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 -- 172.21.15.125:0/2705583690 >> 172.21.15.125:0/2705583690 conn(0x7fe0940a6610 msgr2=0x7fe0940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 -- 172.21.15.125:0/2705583690 shutdown_connections 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.345+0000 7fe09b980700 1 -- 172.21.15.125:0/2705583690 wait complete. 2023-10-03T10:17:29.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.346+0000 7fe09b980700 1 Processor -- start 2023-10-03T10:17:29.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.346+0000 7fe09b980700 1 -- start start 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 0x7fe094121c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe094122170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe094125180 con 0x7fe094139200 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe094124550 con 0x7fe0940a0a70 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09b980700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940a55f0 con 0x7fe0940a1550 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09971c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 0x7fe094121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09971c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53542/0 (socket says 172.21.15.125:53542) 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09971c700 1 -- 172.21.15.125:0/3165384597 learned_addr learned my addr 172.21.15.125:0/3165384597 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe099f1d700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe094122170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 -- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 msgr2=0x7fe0941216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 -- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 msgr2=0x7fe094122170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe094122170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe098f1b700 1 -- 172.21.15.125:0/3165384597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840094a0 con 0x7fe0940a1550 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe09971c700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.347+0000 7fe099f1d700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe094122170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe098f1b700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 0x7fe094121c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e9b0 tx=0x7fe08400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400ee50 con 0x7fe0940a1550 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400c850 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c009a70 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400cc00 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.348+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0940a03e0 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.349+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe084013470 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.349+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe08403f730 con 0x7fe0940a1550 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.349+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe094124b40 con 0x7fe0940a1550 2023-10-03T10:17:29.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.354+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe094124b40 con 0x7fe0940a1550 2023-10-03T10:17:29.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.508+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc108123a30 con 0x7fc108139090 2023-10-03T10:17:29.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.508+0000 7fc0feffd700 1 -- 172.21.15.125:0/3750932398 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc10001b360 con 0x7fc108139090 2023-10-03T10:17:29.509 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 msgr2=0x7fc108121250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 0x7fc108121250 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 shutdown_connections 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc108139090 0x7fc108121250 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1080a0970 0x7fc1081207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 --2- 172.21.15.125:0/3750932398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc1080a1450 0x7fc108120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.511+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 >> 172.21.15.125:0/3750932398 conn(0x7fc1080a6070 msgr2=0x7fc1081368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.512+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 shutdown_connections 2023-10-03T10:17:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.512+0000 7fc10f39e700 1 -- 172.21.15.125:0/3750932398 wait complete. 2023-10-03T10:17:29.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:29.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.555+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe094124b40 con 0x7fe0940a1550 2023-10-03T10:17:29.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.556+0000 7fe089ffb700 1 -- 172.21.15.125:0/3165384597 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe094124b40 con 0x7fe0940a1550 2023-10-03T10:17:29.556 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 msgr2=0x7fe094121c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 0x7fe094121c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e9b0 tx=0x7fe08400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 shutdown_connections 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe094139200 0x7fe094122170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0940a0a70 0x7fe0941216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 --2- 172.21.15.125:0/3165384597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe0940a1550 0x7fe094121c30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 >> 172.21.15.125:0/3165384597 conn(0x7fe0940a6610 msgr2=0x7fe094137cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 shutdown_connections 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.558+0000 7fe09b980700 1 -- 172.21.15.125:0/3165384597 wait complete. 2023-10-03T10:17:29.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:29.599 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:29.641 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:29.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.736+0000 7f567707b700 1 Processor -- start 2023-10-03T10:17:29.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.736+0000 7f567707b700 1 -- start start 2023-10-03T10:17:29.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f567707b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 0x7f5670138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f567707b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f567707b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567009b110 con 0x7f567009ad40 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f567707b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56700a3b60 con 0x7f5670134140 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f567707b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56700a1a80 con 0x7f56701345a0 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f5675618700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f566ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 0x7f5670138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f5675618700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35374/0 (socket says 172.21.15.125:35374) 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.737+0000 7f5675618700 1 -- 172.21.15.125:0/3738635603 learned_addr learned my addr 172.21.15.125:0/3738635603 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f5675618700 1 -- 172.21.15.125:0/3738635603 >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 msgr2=0x7f5670138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f5675618700 1 --2- 172.21.15.125:0/3738635603 >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 0x7f5670138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f5675618700 1 -- 172.21.15.125:0/3738635603 >> v1:172.21.15.125:6789/0 conn(0x7f567009ad40 legacy=0x7f5670133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f5675618700 1 -- 172.21.15.125:0/3738635603 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700a2fa0 con 0x7f56701345a0 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f566f7fe700 1 -- 172.21.15.125:0/3738635603 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165516770 0 0) 0x7f567009b110 con 0x7f567009ad40 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f566ffff700 1 --2- 172.21.15.125:0/3738635603 >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 0x7f5670138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f5675618700 1 --2- 172.21.15.125:0/3738635603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc3cc683834fb07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f566f7fe700 1 -- 172.21.15.125:0/3738635603 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800e070 con 0x7f56701345a0 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f566f7fe700 1 -- 172.21.15.125:0/3738635603 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800b910 con 0x7f56701345a0 2023-10-03T10:17:29.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.738+0000 7f566f7fe700 1 -- 172.21.15.125:0/3738635603 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800bcc0 con 0x7f56701345a0 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 -- 172.21.15.125:0/3738635603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 msgr2=0x7f567013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 --2- 172.21.15.125:0/3738635603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 -- 172.21.15.125:0/3738635603 shutdown_connections 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 --2- 172.21.15.125:0/3738635603 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56701345a0 0x7f567013b3d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 --2- 172.21.15.125:0/3738635603 >> v2:172.21.15.125:3300/0 conn(0x7f5670134140 0x7f5670138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 -- 172.21.15.125:0/3738635603 >> 172.21.15.125:0/3738635603 conn(0x7f5670099c40 msgr2=0x7f567006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 -- 172.21.15.125:0/3738635603 shutdown_connections 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.739+0000 7f567707b700 1 -- 172.21.15.125:0/3738635603 wait complete. 2023-10-03T10:17:29.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 Processor -- start 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 -- start start 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 0x7f567011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56701345a0 0x7f567011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567011df30 con 0x7f5670134140 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56700a4430 con 0x7f56701345a0 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f567707b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567011e6d0 con 0x7f567009ad40 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f566ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f5674e17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 0x7f567011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f566ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54988/0 (socket says 172.21.15.125:54988) 2023-10-03T10:17:29.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f566ffff700 1 -- 172.21.15.125:0/87096577 learned_addr learned my addr 172.21.15.125:0/87096577 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.740+0000 7f5674e17700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 0x7f567011c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35390/0 (socket says 172.21.15.125:35390) 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f5675618700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56701345a0 0x7f567011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 -- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 msgr2=0x7f567011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 0x7f567011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 -- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56701345a0 msgr2=0x7f567011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56701345a0 0x7f567011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 -- 172.21.15.125:0/87096577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0094a0 con 0x7f5670134140 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566ffff700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f565c00ec10 tx=0x7f565c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c009760 con 0x7f5670134140 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00c850 con 0x7f5670134140 2023-10-03T10:17:29.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668009b30 con 0x7f5670134140 2023-10-03T10:17:29.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00cbe0 con 0x7f5670134140 2023-10-03T10:17:29.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.741+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567011da20 con 0x7f5670134140 2023-10-03T10:17:29.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.742+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f565c00cd40 con 0x7f5670134140 2023-10-03T10:17:29.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.742+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56701361e0 con 0x7f5670134140 2023-10-03T10:17:29.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.742+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f565c03f710 con 0x7f5670134140 2023-10-03T10:17:29.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.747+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f565c0232f0 con 0x7f5670134140 2023-10-03T10:17:29.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 Processor -- start 2023-10-03T10:17:29.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 -- start start 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfe8099920 0x7fcfe8099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe809a540 con 0x7fcfe8099920 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe809ad40 con 0x7fcfe812feb0 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfee397700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe809e640 con 0x7fcfe81307c0 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35406/0 (socket says 172.21.15.125:35406) 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfe77fe700 1 -- 172.21.15.125:0/3061517237 learned_addr learned my addr 172.21.15.125:0/3061517237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53570/0 (socket says 172.21.15.125:53570) 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.780+0000 7fcfec934700 1 --2- 172.21.15.125:0/3061517237 >> v2:172.21.15.125:3300/0 conn(0x7fcfe8099920 0x7fcfe8099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 -- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 msgr2=0x7fcfe80993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 -- 172.21.15.125:0/3061517237 >> v2:172.21.15.125:3300/0 conn(0x7fcfe8099920 msgr2=0x7fcfe8099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/3061517237 >> v2:172.21.15.125:3300/0 conn(0x7fcfe8099920 0x7fcfe8099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 -- 172.21.15.125:0/3061517237 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe809e3c0 con 0x7fcfe812feb0 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009820 tx=0x7fcfdc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15db78351ff43664 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/3061517237 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc005e30 con 0x7fcfe812feb0 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/3061517237 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc006030 con 0x7fcfe812feb0 2023-10-03T10:17:29.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.781+0000 7fcfe6ffd700 1 -- 172.21.15.125:0/3061517237 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0063c0 con 0x7fcfe812feb0 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 -- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 msgr2=0x7fcfe8130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009820 tx=0x7fcfdc009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 -- 172.21.15.125:0/3061517237 shutdown_connections 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe812feb0 0x7fcfe8130280 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 --2- 172.21.15.125:0/3061517237 >> v2:172.21.15.125:3300/0 conn(0x7fcfe8099920 0x7fcfe8099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 --2- 172.21.15.125:0/3061517237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe81307c0 0x7fcfe80993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 -- 172.21.15.125:0/3061517237 >> 172.21.15.125:0/3061517237 conn(0x7fcfe80a2b30 msgr2=0x7fcfe809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 -- 172.21.15.125:0/3061517237 shutdown_connections 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.782+0000 7fcfee397700 1 -- 172.21.15.125:0/3061517237 wait complete. 2023-10-03T10:17:29.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 Processor -- start 2023-10-03T10:17:29.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 -- start start 2023-10-03T10:17:29.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe81307c0 0x7fcfe81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8128920 con 0x7fcfe81307c0 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe808bbf0 con 0x7fcfe8099920 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfee397700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8128610 con 0x7fcfe812feb0 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53582/0 (socket says 172.21.15.125:53582) 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35412/0 (socket says 172.21.15.125:35412) 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfe7fff700 1 -- 172.21.15.125:0/3678595864 learned_addr learned my addr 172.21.15.125:0/3678595864 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.783+0000 7fcfec934700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe81307c0 0x7fcfe81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 -- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 msgr2=0x7fcfe81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 -- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe81307c0 msgr2=0x7fcfe81c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe81307c0 0x7fcfe81c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 -- 172.21.15.125:0/3678595864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd800b7f0 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe7fff700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe77fe700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8067370 tx=0x7fcfd800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800dd90 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8004030 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc009430 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80043a0 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.784+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe808bed0 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.785+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfd80036a0 con 0x7fcfe812feb0 2023-10-03T10:17:29.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.785+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcfd803fba0 con 0x7fcfe812feb0 2023-10-03T10:17:29.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.785+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe804f2a0 con 0x7fcfe812feb0 2023-10-03T10:17:29.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.790+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfd8014080 con 0x7fcfe812feb0 2023-10-03T10:17:29.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.941+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f567004f2a0 con 0x7f5670134140 2023-10-03T10:17:29.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.941+0000 7f566d7fa700 1 -- 172.21.15.125:0/87096577 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f565c01bba0 con 0x7f5670134140 2023-10-03T10:17:29.942 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:29.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.943+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 msgr2=0x7f567011ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.943+0000 7f567707b700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f565c00ec10 tx=0x7f565c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:29.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.943+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 shutdown_connections 2023-10-03T10:17:29.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56701345a0 0x7f567011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f567009ad40 0x7f567011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 --2- 172.21.15.125:0/87096577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5670134140 0x7f567011ce00 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 >> 172.21.15.125:0/87096577 conn(0x7f5670099c40 msgr2=0x7f567013b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 shutdown_connections 2023-10-03T10:17:29.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.944+0000 7f567707b700 1 -- 172.21.15.125:0/87096577 wait complete. 2023-10-03T10:17:29.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.982+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfe806b2a0 con 0x7fcfe812feb0 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.982+0000 7fcfe4ff9700 1 -- 172.21.15.125:0/3678595864 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfd8010440 con 0x7fcfe812feb0 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 msgr2=0x7fcfe81c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8067370 tx=0x7fcfd800d630 comp rx=0 tx=0).stop 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 shutdown_connections 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfe81307c0 0x7fcfe81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfe8099920 0x7fcfe81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 --2- 172.21.15.125:0/3678595864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfe812feb0 0x7fcfe81c8660 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 >> 172.21.15.125:0/3678595864 conn(0x7fcfe80a2b30 msgr2=0x7fcfe812c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 shutdown_connections 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:29.984+0000 7fcfee397700 1 -- 172.21.15.125:0/3678595864 wait complete. 2023-10-03T10:17:29.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:30.529 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:30.571 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:30.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.657+0000 7f26e436b700 1 Processor -- start 2023-10-03T10:17:30.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.657+0000 7f26e436b700 1 -- start start 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e436b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e436b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e436b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc09c970 con 0x7f26dc131d70 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e436b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0a0920 con 0x7f26dc09f180 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e436b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09f9c0 con 0x7f26dc09e870 2023-10-03T10:17:30.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2107700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2908700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f26dc131d70 0x7f26dc138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42854/0 (socket says 172.21.15.125:42854) 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2908700 1 -- 172.21.15.125:0/1029456610 learned_addr learned my addr 172.21.15.125:0/1029456610 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e1906700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2107700 1 -- 172.21.15.125:0/1029456610 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09f180 msgr2=0x7f26dc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2107700 1 --2- 172.21.15.125:0/1029456610 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2107700 1 -- 172.21.15.125:0/1029456610 >> v1:172.21.15.125:6789/0 conn(0x7f26dc131d70 legacy=0x7f26dc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.658+0000 7f26e2107700 1 -- 172.21.15.125:0/1029456610 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc09bab0 con 0x7f26dc09e870 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e2107700 1 --2- 172.21.15.125:0/1029456610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc09ec40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009840 tx=0x7f26d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59d4498f992e6b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e1105700 1 -- 172.21.15.125:0/1029456610 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8011830 con 0x7f26dc09e870 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e1105700 1 -- 172.21.15.125:0/1029456610 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8011990 con 0x7f26dc09e870 2023-10-03T10:17:30.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e1105700 1 -- 172.21.15.125:0/1029456610 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8011d20 con 0x7f26dc09e870 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 -- 172.21.15.125:0/1029456610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 msgr2=0x7f26dc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 --2- 172.21.15.125:0/1029456610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc09ec40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009840 tx=0x7f26d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 -- 172.21.15.125:0/1029456610 shutdown_connections 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 --2- 172.21.15.125:0/1029456610 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 --2- 172.21.15.125:0/1029456610 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 -- 172.21.15.125:0/1029456610 >> 172.21.15.125:0/1029456610 conn(0x7f26dc0a4430 msgr2=0x7f26dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 -- 172.21.15.125:0/1029456610 shutdown_connections 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.659+0000 7f26e436b700 1 -- 172.21.15.125:0/1029456610 wait complete. 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.660+0000 7f26e436b700 1 Processor -- start 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.660+0000 7f26e436b700 1 -- start start 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc131d70 0x7f26dc123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc125710 con 0x7f26dc131d70 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc1249f0 con 0x7f26dc09e870 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e436b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09dba0 con 0x7f26dc09f180 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e1906700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53612/0 (socket says 172.21.15.125:53612) 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 -- 172.21.15.125:0/2618690563 learned_addr learned my addr 172.21.15.125:0/2618690563 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2908700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc131d70 0x7f26dc123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 -- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 msgr2=0x7f26dc122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 -- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc131d70 msgr2=0x7f26dc123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc131d70 0x7f26dc123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 -- 172.21.15.125:0/2618690563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d80094a0 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e1906700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26e2107700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009fd0 tx=0x7f26d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.661+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80036a0 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d801e070 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc0a2c40 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8003a40 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc126010 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26d8003ba0 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.662+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26d8040730 con 0x7f26dc09e870 2023-10-03T10:17:30.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.663+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc04f2a0 con 0x7f26dc09e870 2023-10-03T10:17:30.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.667+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26d8015020 con 0x7f26dc09e870 2023-10-03T10:17:30.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.698+0000 7f1e9c5bb700 1 Processor -- start 2023-10-03T10:17:30.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.698+0000 7f1e9c5bb700 1 -- start start 2023-10-03T10:17:30.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9c5bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9c5bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9c5bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9409aaa0 con 0x7f1e9409e170 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9c5bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9409f870 con 0x7f1e94130eb0 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9c5bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9409b360 con 0x7f1e9409d860 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9ab58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9ab58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55028/0 (socket says 172.21.15.125:55028) 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9ab58700 1 -- 172.21.15.125:0/1288286124 learned_addr learned my addr 172.21.15.125:0/1288286124 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9a357700 1 --2- 172.21.15.125:0/1288286124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.699+0000 7f1e9a357700 1 -- 172.21.15.125:0/1288286124 >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 msgr2=0x7f1e94138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9a357700 1 --2- 172.21.15.125:0/1288286124 >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9a357700 1 -- 172.21.15.125:0/1288286124 >> v1:172.21.15.125:6789/0 conn(0x7f1e9409e170 legacy=0x7f1e941307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e99355700 1 -- 172.21.15.125:0/1288286124 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157054824 0 0) 0x7f1e9409aaa0 con 0x7f1e9409e170 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9a357700 1 -- 172.21.15.125:0/1288286124 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9409b620 con 0x7f1e9409d860 2023-10-03T10:17:30.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9ab58700 1 --2- 172.21.15.125:0/1288286124 >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9a357700 1 --2- 172.21.15.125:0/1288286124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9409dc30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009840 tx=0x7f1e90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f76a2214d44714c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e99355700 1 -- 172.21.15.125:0/1288286124 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90011830 con 0x7f1e9409d860 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e99355700 1 -- 172.21.15.125:0/1288286124 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90011990 con 0x7f1e9409d860 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e99355700 1 -- 172.21.15.125:0/1288286124 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90011d20 con 0x7f1e9409d860 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/1288286124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 msgr2=0x7f1e9409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/1288286124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9409dc30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009840 tx=0x7f1e90009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/1288286124 shutdown_connections 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/1288286124 >> v2:172.21.15.125:3300/0 conn(0x7f1e94130eb0 0x7f1e94138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/1288286124 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9409dc30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.700+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/1288286124 >> 172.21.15.125:0/1288286124 conn(0x7f1e94099c40 msgr2=0x7f1e940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.701+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/1288286124 shutdown_connections 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.701+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/1288286124 wait complete. 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.701+0000 7f1e9c5bb700 1 Processor -- start 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.701+0000 7f1e9c5bb700 1 -- start start 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e9409e170 0x7f1e9411f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e94130eb0 0x7f1e9411fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9409c8b0 con 0x7f1e94130eb0 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94122bc0 con 0x7f1e9409e170 2023-10-03T10:17:30.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9c5bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940a0770 con 0x7f1e9409d860 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35440/0 (socket says 172.21.15.125:35440) 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 -- 172.21.15.125:0/2728976260 learned_addr learned my addr 172.21.15.125:0/2728976260 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9ab58700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e94130eb0 0x7f1e9411fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e99b56700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e9409e170 0x7f1e9411f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 -- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e9409e170 msgr2=0x7f1e9411f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e9409e170 0x7f1e9411f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 -- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e94130eb0 msgr2=0x7f1e9411fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e94130eb0 0x7f1e9411fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 -- 172.21.15.125:0/2728976260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c009b30 con 0x7f1e9409d860 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.702+0000 7f1e9a357700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e900090b0 tx=0x7f1e90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900036a0 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90003800 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90003bb0 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900094a0 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9412fea0 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e90003d10 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.703+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e900424c0 con 0x7f1e9409d860 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.704+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e941236f0 con 0x7f1e9409d860 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.708+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e9000bda0 con 0x7f1e9409d860 2023-10-03T10:17:30.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.861+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26dc124bd0 con 0x7f26dc09e870 2023-10-03T10:17:30.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.862+0000 7f26d2ffd700 1 -- 172.21.15.125:0/2618690563 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26d802d7d0 con 0x7f26dc09e870 2023-10-03T10:17:30.862 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:30.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.863+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 msgr2=0x7f26dc1228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.863+0000 7f26e436b700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009fd0 tx=0x7f26d8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:30.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 shutdown_connections 2023-10-03T10:17:30.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc131d70 0x7f26dc123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc09e870 0x7f26dc1228b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 --2- 172.21.15.125:0/2618690563 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 >> 172.21.15.125:0/2618690563 conn(0x7f26dc0a4430 msgr2=0x7f26dc09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 shutdown_connections 2023-10-03T10:17:30.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.864+0000 7f26e436b700 1 -- 172.21.15.125:0/2618690563 wait complete. 2023-10-03T10:17:30.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.900+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e9404f2a0 con 0x7f1e9409d860 2023-10-03T10:17:30.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.900+0000 7f1e8affd700 1 -- 172.21.15.125:0/2728976260 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e90029030 con 0x7f1e9409d860 2023-10-03T10:17:30.901 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 msgr2=0x7f1e9411f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e900090b0 tx=0x7f1e90004750 comp rx=0 tx=0).stop 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 shutdown_connections 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e94130eb0 0x7f1e9411fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1e9409d860 0x7f1e9411f420 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 --2- 172.21.15.125:0/2728976260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e9409e170 0x7f1e9411f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 >> 172.21.15.125:0/2728976260 conn(0x7f1e94099c40 msgr2=0x7f1e94119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 shutdown_connections 2023-10-03T10:17:30.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:30.902+0000 7f1e9c5bb700 1 -- 172.21.15.125:0/2728976260 wait complete. 2023-10-03T10:17:30.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:30.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:30.997 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.082+0000 7f98b5522700 1 Processor -- start 2023-10-03T10:17:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.082+0000 7f98b5522700 1 -- start start 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98b5522700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 0x7f98b0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98b5522700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 0x7f98b013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98b5522700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b009e9d0 con 0x7f98b00a0a70 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98b5522700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b009dc00 con 0x7f98b0139200 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98b5522700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b009dec0 con 0x7f98b00a1550 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 0x7f98b013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98aeffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f98b00a0a70 0x7f98b00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42872/0 (socket says 172.21.15.125:42872) 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98aeffd700 1 -- 172.21.15.125:0/2669100561 learned_addr learned my addr 172.21.15.125:0/2669100561 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 0x7f98b0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98adffb700 1 -- 172.21.15.125:0/2669100561 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636335155 0 0) 0x7f98b009e9d0 con 0x7f98b00a0a70 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98adffb700 1 -- 172.21.15.125:0/2669100561 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98980035b0 con 0x7f98b00a0a70 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 -- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 msgr2=0x7f98b013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 0x7f98b013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 -- 172.21.15.125:0/2669100561 >> v1:172.21.15.125:6789/0 conn(0x7f98b00a0a70 legacy=0x7f98b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 -- 172.21.15.125:0/2669100561 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b009e6a0 con 0x7f98b00a1550 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98af7fe700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 0x7f98b013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98ae7fc700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 0x7f98b0138cc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009870 tx=0x7f98a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532fb1497385869 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98adffb700 1 -- 172.21.15.125:0/2669100561 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011830 con 0x7f98b00a1550 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98adffb700 1 -- 172.21.15.125:0/2669100561 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4011990 con 0x7f98b00a1550 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.083+0000 7f98adffb700 1 -- 172.21.15.125:0/2669100561 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011d20 con 0x7f98b00a1550 2023-10-03T10:17:31.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 -- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 msgr2=0x7f98b0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 0x7f98b0138cc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009870 tx=0x7f98a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 -- 172.21.15.125:0/2669100561 shutdown_connections 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b0139200 0x7f98b013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 --2- 172.21.15.125:0/2669100561 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b00a1550 0x7f98b0138cc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 -- 172.21.15.125:0/2669100561 >> 172.21.15.125:0/2669100561 conn(0x7f98b00a6610 msgr2=0x7f98b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 -- 172.21.15.125:0/2669100561 shutdown_connections 2023-10-03T10:17:31.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.084+0000 7f98b5522700 1 -- 172.21.15.125:0/2669100561 wait complete. 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 Processor -- start 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 -- start start 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 0x7f98b0120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b0139200 0x7f98b0121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01223e0 con 0x7f98b00a1550 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.085+0000 7f98b5522700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01366c0 con 0x7f98b00a0a70 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98b5522700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0123a80 con 0x7f98b0139200 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98af7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b0139200 0x7f98b0121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53648/0 (socket says 172.21.15.125:53648) 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 -- 172.21.15.125:0/3837283615 learned_addr learned my addr 172.21.15.125:0/3837283615 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98ae7fc700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 0x7f98b0120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 -- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b0139200 msgr2=0x7f98b0121250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b0139200 0x7f98b0121250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 -- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 msgr2=0x7f98b0120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 0x7f98b0120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 -- 172.21.15.125:0/3837283615 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009a70 con 0x7f98b00a0a70 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98ae7fc700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 0x7f98b0120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98aeffd700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c700 tx=0x7f98a000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0005d70 con 0x7f98b00a0a70 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a00070d0 con 0x7f98b00a0a70 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40094a0 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0007460 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.086+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b00a5100 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.087+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98a00075c0 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.087+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f98a003eaf0 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.087+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b004f2a0 con 0x7f98b00a0a70 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.092+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98a000f260 con 0x7f98b00a0a70 2023-10-03T10:17:31.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.123+0000 7f7d92775700 1 Processor -- start 2023-10-03T10:17:31.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.123+0000 7f7d92775700 1 -- start start 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d92775700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d92775700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 0x7f7d8c0a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d92775700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c09a460 con 0x7f7d8c134040 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d92775700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c067fe0 con 0x7f7d8c067c10 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d92775700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0a21a0 con 0x7f7d8c134460 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d8bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 0x7f7d8c0a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d8bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55056/0 (socket says 172.21.15.125:55056) 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d8bfff700 1 -- 172.21.15.125:0/3805920362 learned_addr learned my addr 172.21.15.125:0/3805920362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 -- 172.21.15.125:0/3805920362 >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 msgr2=0x7f7d8c133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 --2- 172.21.15.125:0/3805920362 >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 -- 172.21.15.125:0/3805920362 >> v1:172.21.15.125:6789/0 conn(0x7f7d8c134040 legacy=0x7f7d8c0a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 -- 172.21.15.125:0/3805920362 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c09a960 con 0x7f7d8c134460 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d8affd700 1 -- 172.21.15.125:0/3805920362 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855802385 0 0) 0x7f7d8c09a460 con 0x7f7d8c134040 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d8bfff700 1 --2- 172.21.15.125:0/3805920362 >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.124+0000 7f7d90d12700 1 --2- 172.21.15.125:0/3805920362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 0x7f7d8c0a1090 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39acec1328caf699 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d8affd700 1 -- 172.21.15.125:0/3805920362 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400e070 con 0x7f7d8c134460 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d8affd700 1 -- 172.21.15.125:0/3805920362 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400bb20 con 0x7f7d8c134460 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d8affd700 1 -- 172.21.15.125:0/3805920362 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84012430 con 0x7f7d8c134460 2023-10-03T10:17:31.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 -- 172.21.15.125:0/3805920362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 msgr2=0x7f7d8c0a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 --2- 172.21.15.125:0/3805920362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 0x7f7d8c0a1090 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 -- 172.21.15.125:0/3805920362 shutdown_connections 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 --2- 172.21.15.125:0/3805920362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c134460 0x7f7d8c0a1090 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 --2- 172.21.15.125:0/3805920362 >> v2:172.21.15.125:3300/0 conn(0x7f7d8c067c10 0x7f7d8c133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 -- 172.21.15.125:0/3805920362 >> 172.21.15.125:0/3805920362 conn(0x7f7d8c0a2980 msgr2=0x7f7d8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 -- 172.21.15.125:0/3805920362 shutdown_connections 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.125+0000 7f7d92775700 1 -- 172.21.15.125:0/3805920362 wait complete. 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.126+0000 7f7d92775700 1 Processor -- start 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.126+0000 7f7d92775700 1 -- start start 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 0x7f7d8c11ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 0x7f7d8c11b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c11d990 con 0x7f7d8c067c10 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c11dc50 con 0x7f7d8c134040 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d92775700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c11c0b0 con 0x7f7d8c11e430 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 0x7f7d8c11ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d8b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 0x7f7d8c11b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35476/0 (socket says 172.21.15.125:35476) 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 -- 172.21.15.125:0/141710195 learned_addr learned my addr 172.21.15.125:0/141710195 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 -- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 msgr2=0x7f7d8c11b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 0x7f7d8c11b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 -- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 msgr2=0x7f7d8c11ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 0x7f7d8c11ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 -- 172.21.15.125:0/141710195 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009550 con 0x7f7d8c11e430 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d8bfff700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 0x7f7d8c11ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d8b7fe700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 0x7f7d8c11b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.127+0000 7f7d90d12700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7d84014040 tx=0x7f7d84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84012430 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84020070 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d84009a70 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84004280 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c1338d0 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d840043e0 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.128+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c099f50 con 0x7f7d8c11e430 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.129+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d84022070 con 0x7f7d8c11e430 2023-10-03T10:17:31.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.133+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d8c099f50 con 0x7f7d8c11e430 2023-10-03T10:17:31.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.282+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98b0072980 con 0x7f98b00a0a70 2023-10-03T10:17:31.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.282+0000 7f98977fe700 1 -- 172.21.15.125:0/3837283615 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98a0017020 con 0x7f98b00a0a70 2023-10-03T10:17:31.283 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 msgr2=0x7f98b01207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c700 tx=0x7f98a000ca10 comp rx=0 tx=0).stop 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 shutdown_connections 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f98b0139200 0x7f98b0121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f98b00a0a70 0x7f98b01207d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 --2- 172.21.15.125:0/3837283615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98b00a1550 0x7f98b0120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 >> 172.21.15.125:0/3837283615 conn(0x7f98b00a6610 msgr2=0x7f98b00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 shutdown_connections 2023-10-03T10:17:31.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.284+0000 7f98b5522700 1 -- 172.21.15.125:0/3837283615 wait complete. 2023-10-03T10:17:31.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:31.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.322+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d8c099f50 con 0x7f7d8c11e430 2023-10-03T10:17:31.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.322+0000 7f7d88ff9700 1 -- 172.21.15.125:0/141710195 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d8c099f50 con 0x7f7d8c11e430 2023-10-03T10:17:31.323 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 msgr2=0x7f7d8c1c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7d84014040 tx=0x7f7d84004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 shutdown_connections 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7d8c11e430 0x7f7d8c1c7f20 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d8c067c10 0x7f7d8c11ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 --2- 172.21.15.125:0/141710195 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d8c134040 0x7f7d8c11b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 >> 172.21.15.125:0/141710195 conn(0x7f7d8c0a2980 msgr2=0x7f7d8c1bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 shutdown_connections 2023-10-03T10:17:31.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:31.324+0000 7f7d92775700 1 -- 172.21.15.125:0/141710195 wait complete. 2023-10-03T10:17:31.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:31.877 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:31.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 Processor -- start 2023-10-03T10:17:32.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 -- start start 2023-10-03T10:17:32.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 0x7fde740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 0x7fde74133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7409dc00 con 0x7fde74133f50 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.006+0000 7fde7c0e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7409ea60 con 0x7fde740a0a70 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7c0e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde7409dec0 con 0x7fde740a1380 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde79e80700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 0x7fde740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 0x7fde74133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde79e80700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 0x7fde740a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53670/0 (socket says 172.21.15.125:53670) 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde79e80700 1 -- 172.21.15.125:0/1665115309 learned_addr learned my addr 172.21.15.125:0/1665115309 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7a681700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde74133f50 0x7fde7413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42878/0 (socket says 172.21.15.125:42878) 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 -- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 msgr2=0x7fde740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 --2- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 0x7fde740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 -- 172.21.15.125:0/1665115309 >> v1:172.21.15.125:6789/0 conn(0x7fde74133f50 legacy=0x7fde7413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 -- 172.21.15.125:0/1665115309 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7409e6a0 con 0x7fde740a1380 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde7967f700 1 --2- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 0x7fde74133a10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fde64009870 tx=0x7fde64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515ebcdc8008c74d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde78e7e700 1 -- 172.21.15.125:0/1665115309 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011830 con 0x7fde740a1380 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde78e7e700 1 -- 172.21.15.125:0/1665115309 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64011990 con 0x7fde740a1380 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.007+0000 7fde78e7e700 1 -- 172.21.15.125:0/1665115309 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011d20 con 0x7fde740a1380 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 -- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 msgr2=0x7fde74133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 0x7fde74133a10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fde64009870 tx=0x7fde64009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 -- 172.21.15.125:0/1665115309 shutdown_connections 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a0a70 0x7fde740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/1665115309 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde740a1380 0x7fde74133a10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 -- 172.21.15.125:0/1665115309 >> 172.21.15.125:0/1665115309 conn(0x7fde740a6610 msgr2=0x7fde740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 -- 172.21.15.125:0/1665115309 shutdown_connections 2023-10-03T10:17:32.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.008+0000 7fde7c0e4700 1 -- 172.21.15.125:0/1665115309 wait complete. 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.009+0000 7fde7c0e4700 1 Processor -- start 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.009+0000 7fde7c0e4700 1 -- start start 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a1380 0x7fde74123830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74124630 con 0x7fde740a0a70 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde741252a0 con 0x7fde740a1380 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7c0e4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde740a03e0 con 0x7fde74133f50 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde79e80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35494/0 (socket says 172.21.15.125:35494) 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 -- 172.21.15.125:0/461166707 learned_addr learned my addr 172.21.15.125:0/461166707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde79e80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55074/0 (socket says 172.21.15.125:55074) 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7967f700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a1380 0x7fde74123830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 -- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a1380 msgr2=0x7fde74123830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a1380 0x7fde74123830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 -- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 msgr2=0x7fde741232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde7a681700 1 -- 172.21.15.125:0/461166707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640094a0 con 0x7fde74133f50 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.010+0000 7fde79e80700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde7a681700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00cbd0 tx=0x7fde6c00cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00aaa0 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ac00 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c007070 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde74124ba0 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde74126cd0 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.011+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde6c0071d0 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.012+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde6c03f3e0 con 0x7fde74133f50 2023-10-03T10:17:32.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.012+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7404f2a0 con 0x7fde74133f50 2023-10-03T10:17:32.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.016+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde6c017020 con 0x7fde74133f50 2023-10-03T10:17:32.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.047+0000 7f2a679f8700 1 Processor -- start 2023-10-03T10:17:32.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.047+0000 7f2a679f8700 1 -- start start 2023-10-03T10:17:32.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 0x7f2a601343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6009e9d0 con 0x7f2a600a0a70 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6009dc00 con 0x7f2a60133f50 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a679f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6009dec0 con 0x7f2a600a1380 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a64f93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a65794700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a64f93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35502/0 (socket says 172.21.15.125:35502) 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a65f95700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 0x7f2a601343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.048+0000 7f2a64f93700 1 -- 172.21.15.125:0/2211713294 learned_addr learned my addr 172.21.15.125:0/2211713294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 -- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 msgr2=0x7f2a601343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 0x7f2a601343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 -- 172.21.15.125:0/2211713294 >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 msgr2=0x7f2a600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 --2- 172.21.15.125:0/2211713294 >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 -- 172.21.15.125:0/2211713294 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6009e6a0 con 0x7f2a600a1380 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a65f95700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 0x7f2a601343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a65794700 1 --2- 172.21.15.125:0/2211713294 >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a64f93700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2a500098f0 tx=0x7f2a50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee652570ab85e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a57fff700 1 -- 172.21.15.125:0/2211713294 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011830 con 0x7f2a600a1380 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a57fff700 1 -- 172.21.15.125:0/2211713294 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50011990 con 0x7f2a600a1380 2023-10-03T10:17:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a57fff700 1 -- 172.21.15.125:0/2211713294 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011d20 con 0x7f2a600a1380 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a679f8700 1 -- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 msgr2=0x7f2a60133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.049+0000 7f2a679f8700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2a500098f0 tx=0x7f2a50009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 -- 172.21.15.125:0/2211713294 shutdown_connections 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a60133f50 0x7f2a601343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 --2- 172.21.15.125:0/2211713294 >> v2:172.21.15.125:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 --2- 172.21.15.125:0/2211713294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 -- 172.21.15.125:0/2211713294 >> 172.21.15.125:0/2211713294 conn(0x7f2a600a6610 msgr2=0x7f2a600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 -- 172.21.15.125:0/2211713294 shutdown_connections 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.050+0000 7f2a679f8700 1 -- 172.21.15.125:0/2211713294 wait complete. 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 Processor -- start 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 -- start start 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a600a1380 0x7f2a601229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60133f50 0x7f2a60122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601241a0 con 0x7f2a600a0a70 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60124eb0 con 0x7f2a600a1380 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a679f8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60125270 con 0x7f2a60133f50 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65f95700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60133f50 0x7f2a60122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55090/0 (socket says 172.21.15.125:55090) 2023-10-03T10:17:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 -- 172.21.15.125:0/1775262452 learned_addr learned my addr 172.21.15.125:0/1775262452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a64f93700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a600a1380 0x7f2a601229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 -- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60133f50 msgr2=0x7f2a60122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60133f50 0x7f2a60122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 -- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a600a1380 msgr2=0x7f2a601229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a600a1380 0x7f2a601229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.051+0000 7f2a65794700 1 -- 172.21.15.125:0/1775262452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0094a0 con 0x7f2a600a0a70 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a65794700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00ec10 tx=0x7f2a5c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c009780 con 0x7f2a600a0a70 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00c7f0 con 0x7f2a600a0a70 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a58009a70 con 0x7f2a600a0a70 2023-10-03T10:17:32.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00cb80 con 0x7f2a600a0a70 2023-10-03T10:17:32.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.052+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50009550 con 0x7f2a600a0a70 2023-10-03T10:17:32.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.053+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6004f2a0 con 0x7f2a600a0a70 2023-10-03T10:17:32.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.053+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a5c00cce0 con 0x7f2a600a0a70 2023-10-03T10:17:32.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.053+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a5c03f7b0 con 0x7f2a600a0a70 2023-10-03T10:17:32.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.058+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a5c0232f0 con 0x7f2a600a0a70 2023-10-03T10:17:32.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.209+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde740a2710 con 0x7fde74133f50 2023-10-03T10:17:32.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.209+0000 7fde6a7fc700 1 -- 172.21.15.125:0/461166707 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde6c01b3b0 con 0x7fde74133f50 2023-10-03T10:17:32.210 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 msgr2=0x7fde741c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00cbd0 tx=0x7fde6c00cee0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 shutdown_connections 2023-10-03T10:17:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde74133f50 0x7fde741c8260 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740a0a70 0x7fde741232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 --2- 172.21.15.125:0/461166707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde740a1380 0x7fde74123830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 >> 172.21.15.125:0/461166707 conn(0x7fde740a6610 msgr2=0x7fde740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 shutdown_connections 2023-10-03T10:17:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.211+0000 7fde7c0e4700 1 -- 172.21.15.125:0/461166707 wait complete. 2023-10-03T10:17:32.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.246+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a60072980 con 0x7f2a600a0a70 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.247+0000 7f2a55ffb700 1 -- 172.21.15.125:0/1775262452 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a5c01bba0 con 0x7f2a600a0a70 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:32.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 msgr2=0x7f2a601224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00ec10 tx=0x7f2a5c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:32.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 shutdown_connections 2023-10-03T10:17:32.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2a60133f50 0x7f2a60122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a600a0a70 0x7f2a601224b0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 --2- 172.21.15.125:0/1775262452 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a600a1380 0x7f2a601229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 >> 172.21.15.125:0/1775262452 conn(0x7f2a600a6610 msgr2=0x7f2a6009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 shutdown_connections 2023-10-03T10:17:32.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.249+0000 7f2a679f8700 1 -- 172.21.15.125:0/1775262452 wait complete. 2023-10-03T10:17:32.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:32.298 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:32.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.426+0000 7fd5e24d1700 1 Processor -- start 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.426+0000 7fd5e24d1700 1 -- start start 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 0x7fd5dc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc09e9d0 con 0x7fd5dc133f50 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc09dc00 con 0x7fd5dc0a1380 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e24d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc09dec0 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5db7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e0a6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 0x7fd5dc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5db7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53706/0 (socket says 172.21.15.125:53706) 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35524/0 (socket says 172.21.15.125:35524) 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5db7fe700 1 -- 172.21.15.125:0/1987029578 learned_addr learned my addr 172.21.15.125:0/1987029578 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 -- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 msgr2=0x7fd5dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 -- 172.21.15.125:0/1987029578 >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 msgr2=0x7fd5dc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 --2- 172.21.15.125:0/1987029578 >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 0x7fd5dc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 -- 172.21.15.125:0/1987029578 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc09e6a0 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5db7fe700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5e0a6e700 1 --2- 172.21.15.125:0/1987029578 >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 0x7fd5dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.427+0000 7fd5dbfff700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009840 tx=0x7fd5cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=292056756f97cbf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5daffd700 1 -- 172.21.15.125:0/1987029578 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011830 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5daffd700 1 -- 172.21.15.125:0/1987029578 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc011990 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5daffd700 1 -- 172.21.15.125:0/1987029578 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011d20 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 -- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 msgr2=0x7fd5dc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009840 tx=0x7fd5cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 -- 172.21.15.125:0/1987029578 shutdown_connections 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/1987029578 >> v2:172.21.15.125:3300/0 conn(0x7fd5dc133f50 0x7fd5dc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc0a0a70 0x7fd5dc0a0e40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/1987029578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 -- 172.21.15.125:0/1987029578 >> 172.21.15.125:0/1987029578 conn(0x7fd5dc0a6610 msgr2=0x7fd5dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 -- 172.21.15.125:0/1987029578 shutdown_connections 2023-10-03T10:17:32.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.428+0000 7fd5e24d1700 1 -- 172.21.15.125:0/1987029578 wait complete. 2023-10-03T10:17:32.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.429+0000 7fd5e24d1700 1 Processor -- start 2023-10-03T10:17:32.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.429+0000 7fd5e24d1700 1 -- start start 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 0x7fd5dc122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc133f50 0x7fd5dc122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc133a90 con 0x7fd5dc0a0a70 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc1253a0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e24d1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc124fe0 con 0x7fd5dc133f50 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53720/0 (socket says 172.21.15.125:53720) 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5e0a6e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc133f50 0x7fd5dc122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5dbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 0x7fd5dc122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 -- 172.21.15.125:0/443484703 learned_addr learned my addr 172.21.15.125:0/443484703 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 -- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc133f50 msgr2=0x7fd5dc122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc133f50 0x7fd5dc122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 -- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 msgr2=0x7fd5dc122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 0x7fd5dc122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 -- 172.21.15.125:0/443484703 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009550 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5dbfff700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 0x7fd5dc122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5db7fe700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ebb0 tx=0x7fd5d000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.430+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0009e60 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.431+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0004240 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.431+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d00036a0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.431+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d4009a70 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.431+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc0094a0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.431+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5d0003800 con 0x7fd5dc0a1380 2023-10-03T10:17:32.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.432+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5d003f810 con 0x7fd5dc0a1380 2023-10-03T10:17:32.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.432+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc1257f0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.440+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5d000c5e0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.471+0000 7ff1010dd700 1 Processor -- start 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.471+0000 7ff1010dd700 1 -- start start 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0fc09f180 0x7ff0fc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0a0370 con 0x7ff0fc09f180 2023-10-03T10:17:32.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09fa00 con 0x7ff0fc09e870 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff1010dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09ada0 con 0x7ff0fc134160 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0fc09f180 0x7ff0fc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fb59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35544/0 (socket says 172.21.15.125:35544) 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fb59e700 1 -- 172.21.15.125:0/249250267 learned_addr learned my addr 172.21.15.125:0/249250267 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fad9d700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 -- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 msgr2=0x7ff0fc134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 -- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 msgr2=0x7ff0fc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fa59c700 1 -- 172.21.15.125:0/249250267 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc06bec0 con 0x7ff0fc09f180 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fb59e700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.472+0000 7ff0fad9d700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff0fa59c700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc09f180 0x7ff0fc133c20 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009870 tx=0x7ff0f0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dafdcb252c6ec44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff0f9d9b700 1 -- 172.21.15.125:0/249250267 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0011830 con 0x7ff0fc09f180 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff0f9d9b700 1 -- 172.21.15.125:0/249250267 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f0011990 con 0x7ff0fc09f180 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff0f9d9b700 1 -- 172.21.15.125:0/249250267 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0011d20 con 0x7ff0fc09f180 2023-10-03T10:17:32.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 -- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc09f180 msgr2=0x7ff0fc133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc09f180 0x7ff0fc133c20 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009870 tx=0x7ff0f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 -- 172.21.15.125:0/249250267 shutdown_connections 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc134160 0x7ff0fc134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 --2- 172.21.15.125:0/249250267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc09f180 0x7ff0fc133c20 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 -- 172.21.15.125:0/249250267 >> 172.21.15.125:0/249250267 conn(0x7ff0fc0a4430 msgr2=0x7ff0fc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 -- 172.21.15.125:0/249250267 shutdown_connections 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.473+0000 7ff1010dd700 1 -- 172.21.15.125:0/249250267 wait complete. 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 Processor -- start 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 -- start start 2023-10-03T10:17:32.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 0x7ff0fc122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 0x7ff0fc122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc1240e0 con 0x7ff0fc134160 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc123980 con 0x7ff0fc09e870 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff1010dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc124f70 con 0x7ff0fc09f180 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff0fad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff0fb59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 0x7ff0fc122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff0fad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53730/0 (socket says 172.21.15.125:53730) 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff0fad9d700 1 -- 172.21.15.125:0/3753113879 learned_addr learned my addr 172.21.15.125:0/3753113879 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.475+0000 7ff0fa59c700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 0x7ff0fc122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 -- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 msgr2=0x7ff0fc122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 0x7ff0fc122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 -- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 msgr2=0x7ff0fc122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 -- 172.21.15.125:0/3753113879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0094a0 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fad9d700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fa59c700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 0x7ff0fc122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0fb59e700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 0x7ff0fc122fa0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009e50 tx=0x7ff0f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4018070 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400f040 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4009b30 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4003c40 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.476+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f00094a0 con 0x7ff0fc134160 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.477+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f400c880 con 0x7ff0fc134160 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.477+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0f403f640 con 0x7ff0fc134160 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.477+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc0a1600 con 0x7ff0fc134160 2023-10-03T10:17:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.486+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f400cb30 con 0x7ff0fc134160 2023-10-03T10:17:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.638+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5dc04f2a0 con 0x7fd5dc0a1380 2023-10-03T10:17:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.639+0000 7fd5d8ff9700 1 -- 172.21.15.125:0/443484703 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5d002a090 con 0x7fd5dc0a1380 2023-10-03T10:17:32.640 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:32.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 msgr2=0x7fd5dc122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ebb0 tx=0x7fd5d000eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 shutdown_connections 2023-10-03T10:17:32.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5dc133f50 0x7fd5dc122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5dc0a0a70 0x7fd5dc122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 --2- 172.21.15.125:0/443484703 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5dc0a1380 0x7fd5dc122a80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 >> 172.21.15.125:0/443484703 conn(0x7fd5dc0a6610 msgr2=0x7fd5dc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 shutdown_connections 2023-10-03T10:17:32.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.641+0000 7fd5e24d1700 1 -- 172.21.15.125:0/443484703 wait complete. 2023-10-03T10:17:32.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:32.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.677+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0fc06cfa0 con 0x7ff0fc134160 2023-10-03T10:17:32.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.678+0000 7ff0e37fe700 1 -- 172.21.15.125:0/3753113879 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0f401cb60 con 0x7ff0fc134160 2023-10-03T10:17:32.678 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:32.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.679+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 msgr2=0x7ff0fc122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.679+0000 7ff1010dd700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 0x7ff0fc122fa0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009e50 tx=0x7ff0f400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 shutdown_connections 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0fc134160 0x7ff0fc122fa0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0fc09e870 0x7ff0fc122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 --2- 172.21.15.125:0/3753113879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff0fc09f180 0x7ff0fc122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 >> 172.21.15.125:0/3753113879 conn(0x7ff0fc0a4430 msgr2=0x7ff0fc072600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 shutdown_connections 2023-10-03T10:17:32.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:32.680+0000 7ff1010dd700 1 -- 172.21.15.125:0/3753113879 wait complete. 2023-10-03T10:17:32.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:33.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:33.262 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:33.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 Processor -- start 2023-10-03T10:17:33.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 -- start start 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789009c970 con 0x7f7890131d70 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900a0920 con 0x7f789009e870 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.353+0000 7f7894881700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f789009f9c0 con 0x7f789009f180 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35562/0 (socket says 172.21.15.125:35562) 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788e59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53740/0 (socket says 172.21.15.125:53740) 2023-10-03T10:17:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 -- 172.21.15.125:0/661278059 learned_addr learned my addr 172.21.15.125:0/661278059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 -- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 msgr2=0x7f789009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788d59a700 1 -- 172.21.15.125:0/661278059 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654875660 0 0) 0x7f789009c970 con 0x7f7890131d70 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 -- 172.21.15.125:0/661278059 >> v1:172.21.15.125:6789/0 conn(0x7f7890131d70 legacy=0x7f7890138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 -- 172.21.15.125:0/661278059 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789009bab0 con 0x7f789009f180 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788e59c700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788dd9b700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7884009920 tx=0x7f7884009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efd42f10e785658 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788d59a700 1 -- 172.21.15.125:0/661278059 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011830 con 0x7f789009f180 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788d59a700 1 -- 172.21.15.125:0/661278059 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884011990 con 0x7f789009f180 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.354+0000 7f788d59a700 1 -- 172.21.15.125:0/661278059 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011d20 con 0x7f789009f180 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 -- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 msgr2=0x7f7890131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7884009920 tx=0x7f7884009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 -- 172.21.15.125:0/661278059 shutdown_connections 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009e870 0x7f789009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 --2- 172.21.15.125:0/661278059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009f180 0x7f7890131830 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 -- 172.21.15.125:0/661278059 >> 172.21.15.125:0/661278059 conn(0x7f78900a4430 msgr2=0x7f78900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 -- 172.21.15.125:0/661278059 shutdown_connections 2023-10-03T10:17:33.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.355+0000 7f7894881700 1 -- 172.21.15.125:0/661278059 wait complete. 2023-10-03T10:17:33.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 Processor -- start 2023-10-03T10:17:33.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 -- start start 2023-10-03T10:17:33.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 0x7f789011b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 0x7f789011bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789011cc10 con 0x7f7890131d70 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789011de60 con 0x7f789009f180 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f7894881700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f789011d1f0 con 0x7f789009e870 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f788e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f788dd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 0x7f789011b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f788e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35574/0 (socket says 172.21.15.125:35574) 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f788e59c700 1 -- 172.21.15.125:0/1067559999 learned_addr learned my addr 172.21.15.125:0/1067559999 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.357+0000 7f788ed9d700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 0x7f789011bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 -- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 msgr2=0x7f789011b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 0x7f789011b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 -- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 msgr2=0x7f789011bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 0x7f789011bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 -- 172.21.15.125:0/1067559999 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788000d940 con 0x7f789009e870 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788dd9b700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 0x7f789011b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788ed9d700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 0x7f789011bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f788e59c700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7880012fc0 tx=0x7f78800103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880010b00 con 0x7f789009e870 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880013040 con 0x7f789009e870 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7884009550 con 0x7f789009e870 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880010e80 con 0x7f789009e870 2023-10-03T10:17:33.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.358+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900a2a80 con 0x7f789009e870 2023-10-03T10:17:33.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.359+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7880018480 con 0x7f789009e870 2023-10-03T10:17:33.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.359+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7880043530 con 0x7f789009e870 2023-10-03T10:17:33.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.359+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789011e7a0 con 0x7f789009e870 2023-10-03T10:17:33.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.364+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f788000de60 con 0x7f789009e870 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.396+0000 7f2526c0e700 1 Processor -- start 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 -- start start 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 0x7f25201359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2520135f20 0x7f2520138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252009aaa0 con 0x7f252009d860 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252009e730 con 0x7f2520135f20 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f2526c0e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252009f870 con 0x7f252009e340 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25251ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2520135f20 0x7f2520138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25249aa700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f252009d860 0x7f252009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42888/0 (socket says 172.21.15.125:42888) 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25251ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2520135f20 0x7f2520138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55132/0 (socket says 172.21.15.125:55132) 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25249aa700 1 -- 172.21.15.125:0/3069189247 learned_addr learned my addr 172.21.15.125:0/3069189247 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f251ffff700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 0x7f25201359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25251ab700 1 -- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 msgr2=0x7f25201359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25251ab700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 0x7f25201359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.397+0000 7f25251ab700 1 -- 172.21.15.125:0/3069189247 >> v1:172.21.15.125:6789/0 conn(0x7f252009d860 legacy=0x7f252009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f25251ab700 1 -- 172.21.15.125:0/3069189247 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252009b360 con 0x7f2520135f20 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f251ffff700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 0x7f25201359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f251f7fe700 1 -- 172.21.15.125:0/3069189247 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093451291 0 0) 0x7f252009aaa0 con 0x7f252009d860 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f25251ab700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2520135f20 0x7f2520138300 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899913181b07259f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f251f7fe700 1 -- 172.21.15.125:0/3069189247 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011830 con 0x7f2520135f20 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f251f7fe700 1 -- 172.21.15.125:0/3069189247 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518011990 con 0x7f2520135f20 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f251f7fe700 1 -- 172.21.15.125:0/3069189247 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011d20 con 0x7f2520135f20 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 -- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2520135f20 msgr2=0x7f2520138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2520135f20 0x7f2520138300 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 -- 172.21.15.125:0/3069189247 shutdown_connections 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2520135f20 0x7f2520138300 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 --2- 172.21.15.125:0/3069189247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f252009e340 0x7f25201359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 -- 172.21.15.125:0/3069189247 >> 172.21.15.125:0/3069189247 conn(0x7f2520099c40 msgr2=0x7f25200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 -- 172.21.15.125:0/3069189247 shutdown_connections 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.398+0000 7f2526c0e700 1 -- 172.21.15.125:0/3069189247 wait complete. 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.399+0000 7f2526c0e700 1 Processor -- start 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.399+0000 7f2526c0e700 1 -- start start 2023-10-03T10:17:33.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 0x7f252011c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2520135f20 0x7f252011cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252011fcd0 con 0x7f252009d860 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252011e3e0 con 0x7f2520135f20 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f2526c0e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f252009c920 con 0x7f252009e340 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f251ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 0x7f252011c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55148/0 (socket says 172.21.15.125:55148) 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 -- 172.21.15.125:0/2337013966 learned_addr learned my addr 172.21.15.125:0/2337013966 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25251ab700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2520135f20 0x7f252011cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 -- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 msgr2=0x7f252011c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 0x7f252011c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 -- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2520135f20 msgr2=0x7f252011cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2520135f20 0x7f252011cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 -- 172.21.15.125:0/2337013966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094a0 con 0x7f252009d860 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f251ffff700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 0x7f252011c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.400+0000 7f25249aa700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f251000ccb0 tx=0x7f251000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000aa90 con 0x7f252009d860 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000abf0 con 0x7f252009d860 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25180094a0 con 0x7f252009d860 2023-10-03T10:17:33.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100070d0 con 0x7f252009d860 2023-10-03T10:17:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252011f460 con 0x7f252009d860 2023-10-03T10:17:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.401+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2510007230 con 0x7f252009d860 2023-10-03T10:17:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.402+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f251003f280 con 0x7f252009d860 2023-10-03T10:17:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.402+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252011e610 con 0x7f252009d860 2023-10-03T10:17:33.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.406+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2510018070 con 0x7f252009d860 2023-10-03T10:17:33.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.553+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f789004f2a0 con 0x7f789009e870 2023-10-03T10:17:33.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.553+0000 7f787effd700 1 -- 172.21.15.125:0/1067559999 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7880016340 con 0x7f789009e870 2023-10-03T10:17:33.554 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 msgr2=0x7f789011b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7880012fc0 tx=0x7f78800103a0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 shutdown_connections 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7890131d70 0x7f789011bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f789009e870 0x7f789011b050 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 --2- 172.21.15.125:0/1067559999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f789009f180 0x7f789011b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 >> 172.21.15.125:0/1067559999 conn(0x7f78900a4430 msgr2=0x7f789012fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 shutdown_connections 2023-10-03T10:17:33.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.555+0000 7f7894881700 1 -- 172.21.15.125:0/1067559999 wait complete. 2023-10-03T10:17:33.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:33.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.597+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f252004f2a0 con 0x7f252009d860 2023-10-03T10:17:33.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.597+0000 7f251d7fa700 1 -- 172.21.15.125:0/2337013966 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2510019860 con 0x7f252009d860 2023-10-03T10:17:33.598 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 msgr2=0x7f252011c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f251000ccb0 tx=0x7f251000a060 comp rx=0 tx=0).stop 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 shutdown_connections 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2520135f20 0x7f252011cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f252009d860 0x7f252011c1b0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 --2- 172.21.15.125:0/2337013966 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f252009e340 0x7f252011c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.599+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 >> 172.21.15.125:0/2337013966 conn(0x7f2520099c40 msgr2=0x7f25200a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.600+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 shutdown_connections 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.600+0000 7f2526c0e700 1 -- 172.21.15.125:0/2337013966 wait complete. 2023-10-03T10:17:33.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:33.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:33.693 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:33.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 Processor -- start 2023-10-03T10:17:33.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 -- start start 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09e870 0x7f351c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 0x7f351c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c09c970 con 0x7f351c09f180 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0a0920 con 0x7f351c09e870 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f3521225700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c09f9c0 con 0x7f351c131f40 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f351b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 0x7f351c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f351ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09e870 0x7f351c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f351a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f351c09f180 0x7f351c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42894/0 (socket says 172.21.15.125:42894) 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.782+0000 7f351a59c700 1 -- 172.21.15.125:0/4126517959 learned_addr learned my addr 172.21.15.125:0/4126517959 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f351b59e700 1 -- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09e870 msgr2=0x7f351c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f351b59e700 1 --2- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09e870 0x7f351c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f351b59e700 1 -- 172.21.15.125:0/4126517959 >> v1:172.21.15.125:6789/0 conn(0x7f351c09f180 legacy=0x7f351c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f351b59e700 1 -- 172.21.15.125:0/4126517959 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c09bab0 con 0x7f351c131f40 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3519d9b700 1 -- 172.21.15.125:0/4126517959 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927300087 0 0) 0x7f351c09c970 con 0x7f351c09f180 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f351b59e700 1 --2- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 0x7f351c139ca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3514009dc0 tx=0x7f351400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39805104c88db8ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3519d9b700 1 -- 172.21.15.125:0/4126517959 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400e070 con 0x7f351c131f40 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3519d9b700 1 -- 172.21.15.125:0/4126517959 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400bb20 con 0x7f351c131f40 2023-10-03T10:17:33.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3519d9b700 1 -- 172.21.15.125:0/4126517959 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514012430 con 0x7f351c131f40 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3521225700 1 -- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 msgr2=0x7f351c139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.783+0000 7f3521225700 1 --2- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 0x7f351c139ca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3514009dc0 tx=0x7f351400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 -- 172.21.15.125:0/4126517959 shutdown_connections 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 --2- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c131f40 0x7f351c139ca0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 --2- 172.21.15.125:0/4126517959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09e870 0x7f351c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 -- 172.21.15.125:0/4126517959 >> 172.21.15.125:0/4126517959 conn(0x7f351c0a4430 msgr2=0x7f351c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 -- 172.21.15.125:0/4126517959 shutdown_connections 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.784+0000 7f3521225700 1 -- 172.21.15.125:0/4126517959 wait complete. 2023-10-03T10:17:33.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 Processor -- start 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 -- start start 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09f180 0x7f351c11d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c131f40 0x7f351c1c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0a2c70 con 0x7f351c131f40 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c09dba0 con 0x7f351c09f180 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f3521225700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c11e560 con 0x7f351c09e870 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f351ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f351a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09f180 0x7f351c11d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f351ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35600/0 (socket says 172.21.15.125:35600) 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f351ad9d700 1 -- 172.21.15.125:0/4051275251 learned_addr learned my addr 172.21.15.125:0/4051275251 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:33.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.785+0000 7f351b59e700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c131f40 0x7f351c1c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 -- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09f180 msgr2=0x7f351c11d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09f180 0x7f351c11d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 -- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c131f40 msgr2=0x7f351c1c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c131f40 0x7f351c1c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 -- 172.21.15.125:0/4051275251 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514009a70 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f351ad9d700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e870 tx=0x7f350c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c009590 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c013680 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c11ecc0 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0139f0 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.786+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c11cd70 con 0x7f351c09e870 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.787+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f350c013b50 con 0x7f351c09e870 2023-10-03T10:17:33.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.787+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f350c03f580 con 0x7f351c09e870 2023-10-03T10:17:33.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.787+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c04f2a0 con 0x7f351c09e870 2023-10-03T10:17:33.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.792+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f350c017080 con 0x7f351c09e870 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.824+0000 7fdb3d74b700 1 Processor -- start 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.824+0000 7fdb3d74b700 1 -- start start 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb3d74b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 0x7fdb38138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb3d74b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb38139200 0x7fdb3813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb3d74b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3809e9d0 con 0x7fdb380a0a70 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb3d74b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809dc00 con 0x7fdb380a1550 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb3d74b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809dec0 con 0x7fdb38139200 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 0x7fdb38138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb377fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb38139200 0x7fdb3813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb36ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdb380a0a70 0x7fdb380a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42898/0 (socket says 172.21.15.125:42898) 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb36ffd700 1 -- 172.21.15.125:0/4066734287 learned_addr learned my addr 172.21.15.125:0/4066734287 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb35ffb700 1 -- 172.21.15.125:0/4066734287 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116135223 0 0) 0x7fdb3809e9d0 con 0x7fdb380a0a70 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 -- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb38139200 msgr2=0x7fdb3813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 --2- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb38139200 0x7fdb3813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 -- 172.21.15.125:0/4066734287 >> v1:172.21.15.125:6789/0 conn(0x7fdb380a0a70 legacy=0x7fdb380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 -- 172.21.15.125:0/4066734287 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3809e6a0 con 0x7fdb380a1550 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb367fc700 1 --2- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 0x7fdb38138cc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f914bcb99cac602 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb35ffb700 1 -- 172.21.15.125:0/4066734287 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011830 con 0x7fdb380a1550 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb35ffb700 1 -- 172.21.15.125:0/4066734287 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c011990 con 0x7fdb380a1550 2023-10-03T10:17:33.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.825+0000 7fdb35ffb700 1 -- 172.21.15.125:0/4066734287 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011d20 con 0x7fdb380a1550 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 -- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 msgr2=0x7fdb38138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 0x7fdb38138cc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 -- 172.21.15.125:0/4066734287 shutdown_connections 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb38139200 0x7fdb3813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/4066734287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a1550 0x7fdb38138cc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 -- 172.21.15.125:0/4066734287 >> 172.21.15.125:0/4066734287 conn(0x7fdb380a6610 msgr2=0x7fdb380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 -- 172.21.15.125:0/4066734287 shutdown_connections 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.826+0000 7fdb3d74b700 1 -- 172.21.15.125:0/4066734287 wait complete. 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 Processor -- start 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 -- start start 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 0x7fdb3811f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38133fc0 con 0x7fdb38139200 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381345a0 con 0x7fdb380a0a70 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.827+0000 7fdb3d74b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38120b20 con 0x7fdb380a1550 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 0x7fdb3811f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35618/0 (socket says 172.21.15.125:35618) 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53816/0 (socket says 172.21.15.125:53816) 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 -- 172.21.15.125:0/258854619 learned_addr learned my addr 172.21.15.125:0/258854619 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 -- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 msgr2=0x7fdb3811e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 -- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 msgr2=0x7fdb3811f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 0x7fdb3811f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 -- 172.21.15.125:0/258854619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0094a0 con 0x7fdb380a1550 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb36ffd700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb377fe700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 0x7fdb3811f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb367fc700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c004510 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c01f070 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb381221d0 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0038e0 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.828+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb380a03e0 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.829+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb2c003a40 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.829+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb2c021070 con 0x7fdb380a1550 2023-10-03T10:17:33.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.829+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3804f2a0 con 0x7fdb380a1550 2023-10-03T10:17:33.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:33.834+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb2c01a430 con 0x7fdb380a1550 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.006+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f351c06b2a0 con 0x7f351c09e870 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.007+0000 7f35037fe700 1 -- 172.21.15.125:0/4051275251 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f350c021020 con 0x7f351c09e870 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 msgr2=0x7f351c11d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e870 tx=0x7f350c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 shutdown_connections 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f351c131f40 0x7f351c1c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f351c09e870 0x7f351c11d280 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 --2- 172.21.15.125:0/4051275251 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f351c09f180 0x7f351c11d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 >> 172.21.15.125:0/4051275251 conn(0x7f351c0a4430 msgr2=0x7f351c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 shutdown_connections 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.009+0000 7f3521225700 1 -- 172.21.15.125:0/4051275251 wait complete. 2023-10-03T10:17:34.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:34.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.046+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb38072980 con 0x7fdb380a1550 2023-10-03T10:17:34.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.046+0000 7fdb1f7fe700 1 -- 172.21.15.125:0/258854619 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb2c02b070 con 0x7fdb380a1550 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 msgr2=0x7fdb3811ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 shutdown_connections 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb38139200 0x7fdb3811f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb380a0a70 0x7fdb3811e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 --2- 172.21.15.125:0/258854619 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb380a1550 0x7fdb3811ecd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 >> 172.21.15.125:0/258854619 conn(0x7fdb380a6610 msgr2=0x7fdb3809a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 shutdown_connections 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.048+0000 7fdb3d74b700 1 -- 172.21.15.125:0/258854619 wait complete. 2023-10-03T10:17:34.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:34.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:34.612 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:34.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.695+0000 7f3d5d222700 1 Processor -- start 2023-10-03T10:17:34.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.695+0000 7f3d5d222700 1 -- start start 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 0x7f3d581343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 0x7f3d580a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580a3b60 con 0x7f3d580a0a70 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581348e0 con 0x7f3d5809ad40 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5d222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5809b110 con 0x7f3d58133f70 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 0x7f3d581343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 0x7f3d580a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53824/0 (socket says 172.21.15.125:53824) 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 0x7f3d581343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35630/0 (socket says 172.21.15.125:35630) 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 -- 172.21.15.125:0/486599203 learned_addr learned my addr 172.21.15.125:0/486599203 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 -- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 msgr2=0x7f3d581343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 --2- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 0x7f3d581343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 -- 172.21.15.125:0/486599203 >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 msgr2=0x7f3d580a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 --2- 172.21.15.125:0/486599203 >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 0x7f3d580a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 -- 172.21.15.125:0/486599203 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580a2fa0 con 0x7f3d5809ad40 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d5759e700 1 --2- 172.21.15.125:0/486599203 >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 0x7f3d580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.696+0000 7f3d56d9d700 1 --2- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009920 tx=0x7f3d48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d3f6c06689ced08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d55d9b700 1 -- 172.21.15.125:0/486599203 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011830 con 0x7f3d5809ad40 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d55d9b700 1 -- 172.21.15.125:0/486599203 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48011990 con 0x7f3d5809ad40 2023-10-03T10:17:34.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d55d9b700 1 -- 172.21.15.125:0/486599203 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011d20 con 0x7f3d5809ad40 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 -- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 msgr2=0x7f3d58133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 --2- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009920 tx=0x7f3d48009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 -- 172.21.15.125:0/486599203 shutdown_connections 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 --2- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5809ad40 0x7f3d58133a30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 --2- 172.21.15.125:0/486599203 >> v2:172.21.15.125:3300/0 conn(0x7f3d580a0a70 0x7f3d580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 --2- 172.21.15.125:0/486599203 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d58133f70 0x7f3d581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 -- 172.21.15.125:0/486599203 >> 172.21.15.125:0/486599203 conn(0x7f3d58099c40 msgr2=0x7f3d5806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 -- 172.21.15.125:0/486599203 shutdown_connections 2023-10-03T10:17:34.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.697+0000 7f3d5d222700 1 -- 172.21.15.125:0/486599203 wait complete. 2023-10-03T10:17:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 Processor -- start 2023-10-03T10:17:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 -- start start 2023-10-03T10:17:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 0x7f3d5811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5809bee0 con 0x7f3d5809ad40 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58120fb0 con 0x7f3d58133f70 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.699+0000 7f3d5d222700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58122080 con 0x7f3d580a0a70 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35634/0 (socket says 172.21.15.125:35634) 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53838/0 (socket says 172.21.15.125:53838) 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 -- 172.21.15.125:0/4261008860 learned_addr learned my addr 172.21.15.125:0/4261008860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d56d9d700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 0x7f3d5811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 -- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 msgr2=0x7f3d5811fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 -- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 msgr2=0x7f3d5811f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 0x7f3d5811f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 -- 172.21.15.125:0/4261008860 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009a70 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d56d9d700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 0x7f3d5811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5759e700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5659c700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00e980 tx=0x7f3d4c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c009710 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00c640 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d48009550 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00c9b0 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.700+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d58122d40 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.701+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d4c00cb10 con 0x7f3d580a0a70 2023-10-03T10:17:34.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.701+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d580a6fd0 con 0x7f3d580a0a70 2023-10-03T10:17:34.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.701+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d4c03f650 con 0x7f3d580a0a70 2023-10-03T10:17:34.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.706+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d4c0137f0 con 0x7f3d580a0a70 2023-10-03T10:17:34.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.738+0000 7f09e772b700 1 Processor -- start 2023-10-03T10:17:34.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.738+0000 7f09e772b700 1 -- start start 2023-10-03T10:17:34.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 0x7f09e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e009aaa0 con 0x7f09e009e170 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009f870 con 0x7f09e009d860 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e772b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009b360 con 0x7f09e0130ce0 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e4cc6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e54c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 0x7f09e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35636/0 (socket says 172.21.15.125:35636) 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e4cc6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55188/0 (socket says 172.21.15.125:55188) 2023-10-03T10:17:34.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 -- 172.21.15.125:0/2902847301 learned_addr learned my addr 172.21.15.125:0/2902847301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 -- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 msgr2=0x7f09e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 0x7f09e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 -- 172.21.15.125:0/2902847301 >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 msgr2=0x7f09e01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/2902847301 >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 -- 172.21.15.125:0/2902847301 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e009b620 con 0x7f09e0130ce0 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e4cc6700 1 --2- 172.21.15.125:0/2902847301 >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e54c7700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 0x7f09e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f09d800bf20 tx=0x7f09d8009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17cfc6ec3508856 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09d7fff700 1 -- 172.21.15.125:0/2902847301 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800b480 con 0x7f09e0130ce0 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09d7fff700 1 -- 172.21.15.125:0/2902847301 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d800c910 con 0x7f09e0130ce0 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.739+0000 7f09d7fff700 1 -- 172.21.15.125:0/2902847301 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800ccc0 con 0x7f09e0130ce0 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 -- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 msgr2=0x7f09e0131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f09d800bf20 tx=0x7f09d8009370 comp rx=0 tx=0).stop 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 -- 172.21.15.125:0/2902847301 shutdown_connections 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e009d860 0x7f09e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 --2- 172.21.15.125:0/2902847301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0130ce0 0x7f09e0131180 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 --2- 172.21.15.125:0/2902847301 >> v2:172.21.15.125:3300/0 conn(0x7f09e009e170 0x7f09e01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 -- 172.21.15.125:0/2902847301 >> 172.21.15.125:0/2902847301 conn(0x7f09e0099c40 msgr2=0x7f09e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 -- 172.21.15.125:0/2902847301 shutdown_connections 2023-10-03T10:17:34.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.740+0000 7f09e772b700 1 -- 172.21.15.125:0/2902847301 wait complete. 2023-10-03T10:17:34.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 Processor -- start 2023-10-03T10:17:34.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 -- start start 2023-10-03T10:17:34.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e009e170 0x7f09e011dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 0x7f09e011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0120bf0 con 0x7f09e009d860 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0071a10 con 0x7f09e0130ce0 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e772b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009c8b0 con 0x7f09e009e170 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e54c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e5cc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 0x7f09e011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e54c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55204/0 (socket says 172.21.15.125:55204) 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.741+0000 7f09e54c7700 1 -- 172.21.15.125:0/140450681 learned_addr learned my addr 172.21.15.125:0/140450681 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e4cc6700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e009e170 0x7f09e011dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 -- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e009e170 msgr2=0x7f09e011dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e009e170 0x7f09e011dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 -- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 msgr2=0x7f09e011d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 -- 172.21.15.125:0/140450681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0094a0 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e54c7700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e5cc8700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 0x7f09e011e010 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f09e009a060 tx=0x7f09d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800cec0 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8003c30 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d000d940 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8009930 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.742+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d800bb50 con 0x7f09e0130ce0 2023-10-03T10:17:34.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.743+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09d801a070 con 0x7f09e0130ce0 2023-10-03T10:17:34.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.743+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e0120a40 con 0x7f09e0130ce0 2023-10-03T10:17:34.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.743+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09d8040580 con 0x7f09e0130ce0 2023-10-03T10:17:34.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.748+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09d8025d50 con 0x7f09e0130ce0 2023-10-03T10:17:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.902+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d58122850 con 0x7f3d580a0a70 2023-10-03T10:17:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.902+0000 7f3d3f7fe700 1 -- 172.21.15.125:0/4261008860 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d4c017020 con 0x7f3d580a0a70 2023-10-03T10:17:34.903 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 msgr2=0x7f3d5811f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00e980 tx=0x7f3d4c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 shutdown_connections 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58133f70 0x7f3d5811fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d5809ad40 0x7f3d5811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 --2- 172.21.15.125:0/4261008860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d580a0a70 0x7f3d5811f7b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 >> 172.21.15.125:0/4261008860 conn(0x7f3d58099c40 msgr2=0x7f3d580a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 shutdown_connections 2023-10-03T10:17:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.904+0000 7f3d5d222700 1 -- 172.21.15.125:0/4261008860 wait complete. 2023-10-03T10:17:34.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.940+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09e004f2a0 con 0x7f09e0130ce0 2023-10-03T10:17:34.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.940+0000 7f09d5ffb700 1 -- 172.21.15.125:0/140450681 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09d8021070 con 0x7f09e0130ce0 2023-10-03T10:17:34.941 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 msgr2=0x7f09e011e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 0x7f09e011e010 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f09e009a060 tx=0x7f09d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 shutdown_connections 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e0130ce0 0x7f09e011e010 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e009d860 0x7f09e011d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 --2- 172.21.15.125:0/140450681 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e009e170 0x7f09e011dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 >> 172.21.15.125:0/140450681 conn(0x7f09e0099c40 msgr2=0x7f09e0130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 shutdown_connections 2023-10-03T10:17:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:34.943+0000 7f09e772b700 1 -- 172.21.15.125:0/140450681 wait complete. 2023-10-03T10:17:34.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:35.022 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:35.061 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:35.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.150+0000 7fae1f8a5700 1 Processor -- start 2023-10-03T10:17:35.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.150+0000 7fae1f8a5700 1 -- start start 2023-10-03T10:17:35.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1f8a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae1809f350 0x7fae18136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1f8a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1f8a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1809c970 con 0x7fae1809e870 2023-10-03T10:17:35.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1f8a5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180a0920 con 0x7fae1809f350 2023-10-03T10:17:35.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1f8a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1809f9c0 con 0x7fae181371c0 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae1809f350 0x7fae18136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1de42700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1d641700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fae1809e870 0x7fae1809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42912/0 (socket says 172.21.15.125:42912) 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1de42700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35652/0 (socket says 172.21.15.125:35652) 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1d641700 1 -- 172.21.15.125:0/3211781913 learned_addr learned my addr 172.21.15.125:0/3211781913 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae1809f350 0x7fae18136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55216/0 (socket says 172.21.15.125:55216) 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 -- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 msgr2=0x7fae181395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 -- 172.21.15.125:0/3211781913 >> v1:172.21.15.125:6789/0 conn(0x7fae1809e870 legacy=0x7fae1809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae0ffff700 1 -- 172.21.15.125:0/3211781913 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350922937 0 0) 0x7fae1809c970 con 0x7fae1809e870 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 -- 172.21.15.125:0/3211781913 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1809bab0 con 0x7fae1809f350 2023-10-03T10:17:35.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1de42700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.151+0000 7fae1ce40700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809f350 0x7fae18136c80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fae08009840 tx=0x7fae08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7047a2991e817c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae0ffff700 1 -- 172.21.15.125:0/3211781913 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011830 con 0x7fae1809f350 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae0ffff700 1 -- 172.21.15.125:0/3211781913 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08011990 con 0x7fae1809f350 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae0ffff700 1 -- 172.21.15.125:0/3211781913 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011d20 con 0x7fae1809f350 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 -- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809f350 msgr2=0x7fae18136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809f350 0x7fae18136c80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fae08009840 tx=0x7fae08009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 -- 172.21.15.125:0/3211781913 shutdown_connections 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae181395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/3211781913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809f350 0x7fae18136c80 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 -- 172.21.15.125:0/3211781913 >> 172.21.15.125:0/3211781913 conn(0x7fae180a4430 msgr2=0x7fae180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 -- 172.21.15.125:0/3211781913 shutdown_connections 2023-10-03T10:17:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.152+0000 7fae1f8a5700 1 -- 172.21.15.125:0/3211781913 wait complete. 2023-10-03T10:17:35.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.153+0000 7fae1f8a5700 1 Processor -- start 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.153+0000 7fae1f8a5700 1 -- start start 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 0x7fae1806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae1809f350 0x7fae1806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae18125f10 con 0x7fae1809e870 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1806d560 con 0x7fae1809f350 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae18126140 con 0x7fae181371c0 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1d641700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 0x7fae1806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:35656/0 (socket says 172.21.15.125:35656) 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 -- 172.21.15.125:0/2512821926 learned_addr learned my addr 172.21.15.125:0/2512821926 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1ce40700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae1809f350 0x7fae1806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 -- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae1809f350 msgr2=0x7fae1806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae1809f350 0x7fae1806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 -- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 msgr2=0x7fae1806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 0x7fae1806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 -- 172.21.15.125:0/2512821926 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009a70 con 0x7fae181371c0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1d641700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 0x7fae1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1de42700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fae1000efc0 tx=0x7fae1000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000ca90 con 0x7fae181371c0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000f040 con 0x7fae181371c0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000ce10 con 0x7fae181371c0 2023-10-03T10:17:35.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.154+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080094a0 con 0x7fae181371c0 2023-10-03T10:17:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.155+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae18124d00 con 0x7fae181371c0 2023-10-03T10:17:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.155+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae10014480 con 0x7fae181371c0 2023-10-03T10:17:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.155+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae1003fd10 con 0x7fae181371c0 2023-10-03T10:17:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.156+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1804f2a0 con 0x7fae181371c0 2023-10-03T10:17:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.164+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae10012930 con 0x7fae181371c0 2023-10-03T10:17:35.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.196+0000 7fc9704b2700 1 Processor -- start 2023-10-03T10:17:35.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.196+0000 7fc9704b2700 1 -- start start 2023-10-03T10:17:35.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc9704b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc96809e870 0x7fc96809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc9704b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc96809f180 0x7fc968131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc9704b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96809c970 con 0x7fc968131d70 2023-10-03T10:17:35.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc9704b2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680a0920 con 0x7fc96809e870 2023-10-03T10:17:35.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc9704b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96809f9c0 con 0x7fc96809f180 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc96809e870 0x7fc96809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96da4d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc96809f180 0x7fc968131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc96809e870 0x7fc96809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55246/0 (socket says 172.21.15.125:55246) 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 -- 172.21.15.125:0/3672454164 learned_addr learned my addr 172.21.15.125:0/3672454164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96ea4f700 1 --1- 172.21.15.125:0/3672454164 >> v1:172.21.15.125:6789/0 conn(0x7fc968131d70 0x7fc968138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42928/0 (socket says 172.21.15.125:42928) 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 -- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc96809f180 msgr2=0x7fc968131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 --2- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc96809f180 0x7fc968131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 -- 172.21.15.125:0/3672454164 >> v1:172.21.15.125:6789/0 conn(0x7fc968131d70 legacy=0x7fc968138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 -- 172.21.15.125:0/3672454164 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96809bab0 con 0x7fc96809e870 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.197+0000 7fc96e24e700 1 --2- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809e870 0x7fc96809ec40 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098f0 tx=0x7fc958009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e377972ff4d870 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc96d24c700 1 -- 172.21.15.125:0/3672454164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011830 con 0x7fc96809e870 2023-10-03T10:17:35.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc96d24c700 1 -- 172.21.15.125:0/3672454164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958011990 con 0x7fc96809e870 2023-10-03T10:17:35.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc96d24c700 1 -- 172.21.15.125:0/3672454164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011d20 con 0x7fc96809e870 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 -- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809e870 msgr2=0x7fc96809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 --2- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809e870 0x7fc96809ec40 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098f0 tx=0x7fc958009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 -- 172.21.15.125:0/3672454164 shutdown_connections 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 --2- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809e870 0x7fc96809ec40 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 --2- 172.21.15.125:0/3672454164 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc96809f180 0x7fc968131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 -- 172.21.15.125:0/3672454164 >> 172.21.15.125:0/3672454164 conn(0x7fc9680a4430 msgr2=0x7fc9680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 -- 172.21.15.125:0/3672454164 shutdown_connections 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.198+0000 7fc9704b2700 1 -- 172.21.15.125:0/3672454164 wait complete. 2023-10-03T10:17:35.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.199+0000 7fc9704b2700 1 Processor -- start 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.199+0000 7fc9704b2700 1 -- start start 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 0x7fc96806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96809dba0 con 0x7fc96809f180 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680a2cc0 con 0x7fc96809e870 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc968124690 con 0x7fc968131d70 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96e24e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96ea4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 0x7fc96806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55252/0 (socket says 172.21.15.125:55252) 2023-10-03T10:17:35.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96e24e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53878/0 (socket says 172.21.15.125:53878) 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 -- 172.21.15.125:0/1698377864 learned_addr learned my addr 172.21.15.125:0/1698377864 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 -- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 msgr2=0x7fc96806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 0x7fc96806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 -- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 msgr2=0x7fc96806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 -- 172.21.15.125:0/1698377864 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009550 con 0x7fc96809f180 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96ea4f700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 0x7fc96806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96e24e700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc96da4d700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e9b0 tx=0x7fc96400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964009710 con 0x7fc96809f180 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400ee50 con 0x7fc96809f180 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96806cc80 con 0x7fc96809f180 2023-10-03T10:17:35.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.200+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400ca50 con 0x7fc96809f180 2023-10-03T10:17:35.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.201+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9681237e0 con 0x7fc96809f180 2023-10-03T10:17:35.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.201+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc96400cbb0 con 0x7fc96809f180 2023-10-03T10:17:35.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.201+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc96403f720 con 0x7fc96809f180 2023-10-03T10:17:35.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.201+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96804f2a0 con 0x7fc96809f180 2023-10-03T10:17:35.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.206+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9640232f0 con 0x7fc96809f180 2023-10-03T10:17:35.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.358+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae18136880 con 0x7fae181371c0 2023-10-03T10:17:35.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.359+0000 7fae0dffb700 1 -- 172.21.15.125:0/2512821926 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae1002a090 con 0x7fae181371c0 2023-10-03T10:17:35.359 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 msgr2=0x7fae1806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fae1000efc0 tx=0x7fae1000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 shutdown_connections 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae181371c0 0x7fae1806c330 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae1809e870 0x7fae1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 --2- 172.21.15.125:0/2512821926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae1809f350 0x7fae1806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 >> 172.21.15.125:0/2512821926 conn(0x7fae180a4430 msgr2=0x7fae180a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 shutdown_connections 2023-10-03T10:17:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.361+0000 7fae1f8a5700 1 -- 172.21.15.125:0/2512821926 wait complete. 2023-10-03T10:17:35.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:35.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.401+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc96806b2a0 con 0x7fc96809f180 2023-10-03T10:17:35.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.402+0000 7fc95effd700 1 -- 172.21.15.125:0/1698377864 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc964017020 con 0x7fc96809f180 2023-10-03T10:17:35.402 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.403+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 msgr2=0x7fc96806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.403+0000 7fc9704b2700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e9b0 tx=0x7fc96400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 shutdown_connections 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968131d70 0x7fc96806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc96809e870 0x7fc96806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 --2- 172.21.15.125:0/1698377864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96809f180 0x7fc96806bdf0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 >> 172.21.15.125:0/1698377864 conn(0x7fc9680a4430 msgr2=0x7fc9680719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 shutdown_connections 2023-10-03T10:17:35.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:35.404+0000 7fc9704b2700 1 -- 172.21.15.125:0/1698377864 wait complete. 2023-10-03T10:17:35.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:35.918 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:35.956 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 Processor -- start 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 -- start start 2023-10-03T10:17:36.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 0x7f59a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a409dc00 con 0x7f59a40a1380 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a409ea90 con 0x7f59a40a0a70 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a8a76700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a409dec0 con 0x7f59a4134120 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 0x7f59a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a2d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34366/0 (socket says 172.21.15.125:34366) 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1082980133 learned_addr learned my addr 172.21.15.125:0/1082980133 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.045+0000 7f59a1d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f59a40a1380 0x7f59a4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41952/0 (socket says 172.21.15.125:41952) 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1082980133 >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 msgr2=0x7f59a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1082980133 >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 0x7f59a40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1082980133 >> v1:172.21.15.125:6789/0 conn(0x7f59a40a1380 legacy=0x7f59a4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1082980133 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a409e6a0 con 0x7f59a4134120 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a259c700 1 --2- 172.21.15.125:0/1082980133 >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 0x7f59a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1082980133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd9addae2e3781af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a159a700 1 -- 172.21.15.125:0/1082980133 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00e070 con 0x7f59a4134120 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a159a700 1 -- 172.21.15.125:0/1082980133 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00b910 con 0x7f59a4134120 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.046+0000 7f59a159a700 1 -- 172.21.15.125:0/1082980133 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00bcc0 con 0x7f59a4134120 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 -- 172.21.15.125:0/1082980133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 msgr2=0x7f59a413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1082980133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:36.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 -- 172.21.15.125:0/1082980133 shutdown_connections 2023-10-03T10:17:36.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1082980133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a4134120 0x7f59a413bce0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1082980133 >> v2:172.21.15.125:3300/0 conn(0x7f59a40a0a70 0x7f59a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 -- 172.21.15.125:0/1082980133 >> 172.21.15.125:0/1082980133 conn(0x7f59a40a6610 msgr2=0x7f59a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 -- 172.21.15.125:0/1082980133 shutdown_connections 2023-10-03T10:17:36.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.047+0000 7f59a8a76700 1 -- 172.21.15.125:0/1082980133 wait complete. 2023-10-03T10:17:36.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.048+0000 7f59a8a76700 1 Processor -- start 2023-10-03T10:17:36.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.048+0000 7f59a8a76700 1 -- start start 2023-10-03T10:17:36.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 0x7f59a4122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4133850 con 0x7f59a40a1380 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4133a80 con 0x7f59a4134120 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a8a76700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a41260d0 con 0x7f59a40a0a70 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50322/0 (socket says 172.21.15.125:50322) 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a1d9b700 1 -- 172.21.15.125:0/1702209372 learned_addr learned my addr 172.21.15.125:0/1702209372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 0x7f59a4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57524/0 (socket says 172.21.15.125:57524) 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 msgr2=0x7f59a4122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 0x7f59a4122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 msgr2=0x7f59a4122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a2d9d700 1 -- 172.21.15.125:0/1702209372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940094a0 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a259c700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 0x7f59a4122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.049+0000 7f59a1d9b700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f59a2d9d700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f599c015000 tx=0x7f599c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c004800 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c004960 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c009b30 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c01c680 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.050+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a4125e10 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.051+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f599c01c7e0 con 0x7f59a4134120 2023-10-03T10:17:36.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.051+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f599c040fe0 con 0x7f59a4134120 2023-10-03T10:17:36.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.051+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a404f2a0 con 0x7f59a4134120 2023-10-03T10:17:36.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.056+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f599c0123f0 con 0x7f59a4134120 2023-10-03T10:17:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 Processor -- start 2023-10-03T10:17:36.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 -- start start 2023-10-03T10:17:36.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733009e9d0 con 0x7f73300a0a70 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733009dc00 con 0x7f7330133f50 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7337516700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f733009dec0 con 0x7f73300a1380 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7335ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f73352b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7334ab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f73352b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50338/0 (socket says 172.21.15.125:50338) 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7334ab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34380/0 (socket says 172.21.15.125:34380) 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f7335ab3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57534/0 (socket says 172.21.15.125:57534) 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.086+0000 7f73352b2700 1 -- 172.21.15.125:0/3125982201 learned_addr learned my addr 172.21.15.125:0/3125982201 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 -- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 msgr2=0x7f73301343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 -- 172.21.15.125:0/3125982201 >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 msgr2=0x7f73300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 --2- 172.21.15.125:0/3125982201 >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 -- 172.21.15.125:0/3125982201 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733009e6a0 con 0x7f73300a1380 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f73352b2700 1 --2- 172.21.15.125:0/3125982201 >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7335ab3700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7334ab1700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7320009840 tx=0x7f7320009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcb689fef5642f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7327fff700 1 -- 172.21.15.125:0/3125982201 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011830 con 0x7f73300a1380 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7327fff700 1 -- 172.21.15.125:0/3125982201 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320011990 con 0x7f73300a1380 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.087+0000 7f7327fff700 1 -- 172.21.15.125:0/3125982201 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011d20 con 0x7f73300a1380 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 -- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 msgr2=0x7f7330133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7320009840 tx=0x7f7320009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 -- 172.21.15.125:0/3125982201 shutdown_connections 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7330133f50 0x7f73301343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 --2- 172.21.15.125:0/3125982201 >> v2:172.21.15.125:3300/0 conn(0x7f73300a0a70 0x7f73300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 --2- 172.21.15.125:0/3125982201 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f7330133a10 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 -- 172.21.15.125:0/3125982201 >> 172.21.15.125:0/3125982201 conn(0x7f73300a6610 msgr2=0x7f73300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 -- 172.21.15.125:0/3125982201 shutdown_connections 2023-10-03T10:17:36.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.088+0000 7f7337516700 1 -- 172.21.15.125:0/3125982201 wait complete. 2023-10-03T10:17:36.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 Processor -- start 2023-10-03T10:17:36.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 -- start start 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73300a0a70 0x7f73301224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 0x7f7330122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73301241a0 con 0x7f7330133f50 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7330124eb0 con 0x7f73300a0a70 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7337516700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7330125270 con 0x7f73300a1380 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7334ab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7335ab3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 0x7f7330122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7334ab1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34396/0 (socket says 172.21.15.125:34396) 2023-10-03T10:17:36.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f7334ab1700 1 -- 172.21.15.125:0/1875412211 learned_addr learned my addr 172.21.15.125:0/1875412211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.089+0000 7f73352b2700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73300a0a70 0x7f73301224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 -- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73300a0a70 msgr2=0x7f73301224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73300a0a70 0x7f73301224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 -- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 msgr2=0x7f7330122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 0x7f7330122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 -- 172.21.15.125:0/1875412211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009550 con 0x7f73300a1380 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7335ab3700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 0x7f7330122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7334ab1700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f7320004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200044d0 con 0x7f73300a1380 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732001f070 con 0x7f73300a1380 2023-10-03T10:17:36.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328009a70 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200038e0 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.090+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73200094a0 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.091+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7320003a40 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.091+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733004f2a0 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.091+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7320021070 con 0x7f73300a1380 2023-10-03T10:17:36.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.096+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7320010380 con 0x7f73300a1380 2023-10-03T10:17:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.249+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59a4072980 con 0x7f59a4134120 2023-10-03T10:17:36.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.249+0000 7f5992ffd700 1 -- 172.21.15.125:0/1702209372 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f599c033090 con 0x7f59a4134120 2023-10-03T10:17:36.250 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 msgr2=0x7f59a4123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f599c015000 tx=0x7f599c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 shutdown_connections 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59a4134120 0x7f59a4123390 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f59a40a0a70 0x7f59a4122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 --2- 172.21.15.125:0/1702209372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59a40a1380 0x7f59a4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 >> 172.21.15.125:0/1702209372 conn(0x7f59a40a6610 msgr2=0x7f59a409ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 shutdown_connections 2023-10-03T10:17:36.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.251+0000 7f59a8a76700 1 -- 172.21.15.125:0/1702209372 wait complete. 2023-10-03T10:17:36.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.290+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7330072980 con 0x7f73300a1380 2023-10-03T10:17:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.290+0000 7f7325ffb700 1 -- 172.21.15.125:0/1875412211 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7320015070 con 0x7f73300a1380 2023-10-03T10:17:36.291 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:36.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 msgr2=0x7f73301229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f7320004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 shutdown_connections 2023-10-03T10:17:36.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7330133f50 0x7f7330122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73300a0a70 0x7f73301224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 --2- 172.21.15.125:0/1875412211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f73300a1380 0x7f73301229f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.292+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 >> 172.21.15.125:0/1875412211 conn(0x7f73300a6610 msgr2=0x7f733009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.293+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 shutdown_connections 2023-10-03T10:17:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.293+0000 7f7337516700 1 -- 172.21.15.125:0/1875412211 wait complete. 2023-10-03T10:17:36.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:36.374 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:36.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 Processor -- start 2023-10-03T10:17:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 -- start start 2023-10-03T10:17:36.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1501300a0 0x7fb1501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15006b2d0 con 0x7fb1501309f0 2023-10-03T10:17:36.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb150133610 con 0x7fb1501300a0 2023-10-03T10:17:36.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb1558dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb15009a500 con 0x7fb150133ad0 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1501300a0 0x7fb1501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34404/0 (socket says 172.21.15.125:34404) 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1501309f0 0x7fb15013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41964/0 (socket says 172.21.15.125:41964) 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14effd700 1 -- 172.21.15.125:0/3726836713 learned_addr learned my addr 172.21.15.125:0/3726836713 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.500+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3726836713 >> v2:172.21.15.125:3300/0 conn(0x7fb1501300a0 0x7fb1501304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50360/0 (socket says 172.21.15.125:50360) 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 msgr2=0x7fb150133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3726836713 >> v1:172.21.15.125:6789/0 conn(0x7fb1501309f0 legacy=0x7fb15013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3726836713 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1501338b0 con 0x7fb1501300a0 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14dffb700 1 -- 172.21.15.125:0/3726836713 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512343468 0 0) 0x7fb15006b2d0 con 0x7fb1501309f0 2023-10-03T10:17:36.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14effd700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1501300a0 0x7fb1501304b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb144009840 tx=0x7fb144009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5144e006bc8db0fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14dffb700 1 -- 172.21.15.125:0/3726836713 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144011830 con 0x7fb1501300a0 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14dffb700 1 -- 172.21.15.125:0/3726836713 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144011990 con 0x7fb1501300a0 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.501+0000 7fb14dffb700 1 -- 172.21.15.125:0/3726836713 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144011d20 con 0x7fb1501300a0 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 -- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1501300a0 msgr2=0x7fb1501304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1501300a0 0x7fb1501304b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb144009840 tx=0x7fb144009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 -- 172.21.15.125:0/3726836713 shutdown_connections 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb150133ad0 0x7fb150133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3726836713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1501300a0 0x7fb1501304b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 -- 172.21.15.125:0/3726836713 >> 172.21.15.125:0/3726836713 conn(0x7fb150099c40 msgr2=0x7fb1500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 -- 172.21.15.125:0/3726836713 shutdown_connections 2023-10-03T10:17:36.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.502+0000 7fb1558dd700 1 -- 172.21.15.125:0/3726836713 wait complete. 2023-10-03T10:17:36.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 Processor -- start 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 -- start start 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 0x7fb1500712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500a3470 con 0x7fb150133ad0 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15011e100 con 0x7fb1501309f0 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb1558dd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb15011f1b0 con 0x7fb1501300a0 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50364/0 (socket says 172.21.15.125:50364) 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57542/0 (socket says 172.21.15.125:57542) 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14f7fe700 1 -- 172.21.15.125:0/3781743716 learned_addr learned my addr 172.21.15.125:0/3781743716 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.503+0000 7fb14effd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 0x7fb1500712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 msgr2=0x7fb1500712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 0x7fb1500712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 msgr2=0x7fb150071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 -- 172.21.15.125:0/3781743716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009550 con 0x7fb1501309f0 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14f7fe700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14effd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 0x7fb1500712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb14e7fc700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb144016000 tx=0x7fb144004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440036a0 con 0x7fb1501309f0 2023-10-03T10:17:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14401f070 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440094a0 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144003a40 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.504+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15011f8f0 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.505+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500a2620 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.505+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb144003ba0 con 0x7fb1501309f0 2023-10-03T10:17:36.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.505+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb144021070 con 0x7fb1501309f0 2023-10-03T10:17:36.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.510+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb14402f3a0 con 0x7fb1501309f0 2023-10-03T10:17:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 Processor -- start 2023-10-03T10:17:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 -- start start 2023-10-03T10:17:36.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac09aaa0 con 0x7f29ac130ce0 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac09f870 con 0x7f29ac09d860 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b2fd2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac09b360 con 0x7f29ac09e170 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29b0d6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.543+0000 7f29abfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29b0d6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50370/0 (socket says 172.21.15.125:50370) 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29b156f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f29ac130ce0 0x7f29ac1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41978/0 (socket says 172.21.15.125:41978) 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29b0d6e700 1 -- 172.21.15.125:0/2225327757 learned_addr learned my addr 172.21.15.125:0/2225327757 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57544/0 (socket says 172.21.15.125:57544) 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 -- 172.21.15.125:0/2225327757 >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 msgr2=0x7f29ac09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 --2- 172.21.15.125:0/2225327757 >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 -- 172.21.15.125:0/2225327757 >> v1:172.21.15.125:6789/0 conn(0x7f29ac130ce0 legacy=0x7f29ac1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 -- 172.21.15.125:0/2225327757 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac09b620 con 0x7f29ac09e170 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29b0d6e700 1 --2- 172.21.15.125:0/2225327757 >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29abfff700 1 --2- 172.21.15.125:0/2225327757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2998009840 tx=0x7f2998009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d64cef23d09ff8b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29ab7fe700 1 -- 172.21.15.125:0/2225327757 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011830 con 0x7f29ac09e170 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29ab7fe700 1 -- 172.21.15.125:0/2225327757 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998011990 con 0x7f29ac09e170 2023-10-03T10:17:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.544+0000 7f29ab7fe700 1 -- 172.21.15.125:0/2225327757 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011d20 con 0x7f29ac09e170 2023-10-03T10:17:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 -- 172.21.15.125:0/2225327757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 msgr2=0x7f29ac1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/2225327757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2998009840 tx=0x7f2998009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 -- 172.21.15.125:0/2225327757 shutdown_connections 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/2225327757 >> v2:172.21.15.125:3300/0 conn(0x7f29ac09d860 0x7f29ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/2225327757 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1307a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 -- 172.21.15.125:0/2225327757 >> 172.21.15.125:0/2225327757 conn(0x7f29ac099c40 msgr2=0x7f29ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 -- 172.21.15.125:0/2225327757 shutdown_connections 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.545+0000 7f29b2fd2700 1 -- 172.21.15.125:0/2225327757 wait complete. 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 Processor -- start 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 -- start start 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 0x7f29ac1c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac130590 con 0x7f29ac09d860 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac070540 con 0x7f29ac09e170 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b2fd2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac070730 con 0x7f29ac130ce0 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b0d6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b156f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 0x7f29ac1c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b0d6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50384/0 (socket says 172.21.15.125:50384) 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29b0d6e700 1 -- 172.21.15.125:0/3854978651 learned_addr learned my addr 172.21.15.125:0/3854978651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.546+0000 7f29abfff700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 -- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 msgr2=0x7f29ac1c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 -- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 msgr2=0x7f29ac1c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 -- 172.21.15.125:0/3854978651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0009550 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29abfff700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b0d6e700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b156f700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 0x7f29ac1c8c90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f29a400cb40 tx=0x7f29a400ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400a9a0 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400ab00 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400ae70 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29980094a0 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.547+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac126200 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.548+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29a4007070 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.548+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac126060 con 0x7f29ac130ce0 2023-10-03T10:17:36.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.548+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29a403f310 con 0x7f29ac130ce0 2023-10-03T10:17:36.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.553+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29ac126060 con 0x7f29ac130ce0 2023-10-03T10:17:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.703+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb15004f2a0 con 0x7fb1501309f0 2023-10-03T10:17:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.704+0000 7fb137fff700 1 -- 172.21.15.125:0/3781743716 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb14402b020 con 0x7fb1501309f0 2023-10-03T10:17:36.704 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 msgr2=0x7fb1500717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb144016000 tx=0x7fb144004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 shutdown_connections 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150133ad0 0x7fb150071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1501300a0 0x7fb1500712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 --2- 172.21.15.125:0/3781743716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1501309f0 0x7fb1500717e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 >> 172.21.15.125:0/3781743716 conn(0x7fb150099c40 msgr2=0x7fb1501329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 shutdown_connections 2023-10-03T10:17:36.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.706+0000 7fb1558dd700 1 -- 172.21.15.125:0/3781743716 wait complete. 2023-10-03T10:17:36.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.745+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29ac126060 con 0x7f29ac130ce0 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.745+0000 7f29a97fa700 1 -- 172.21.15.125:0/3854978651 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29ac126060 con 0x7f29ac130ce0 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 msgr2=0x7f29ac1c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 0x7f29ac1c8c90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f29a400cb40 tx=0x7f29a400ce50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 shutdown_connections 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29ac130ce0 0x7f29ac1c8c90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac09d860 0x7f29ac1c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 --2- 172.21.15.125:0/3854978651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29ac09e170 0x7f29ac1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 >> 172.21.15.125:0/3854978651 conn(0x7f29ac099c40 msgr2=0x7f29ac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 shutdown_connections 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:36.747+0000 7f29b2fd2700 1 -- 172.21.15.125:0/3854978651 wait complete. 2023-10-03T10:17:36.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:37.264 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:37.305 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:37.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.391+0000 7f7681236700 1 Processor -- start 2023-10-03T10:17:37.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.391+0000 7f7681236700 1 -- start start 2023-10-03T10:17:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7681236700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f767c09f350 0x7f767c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7681236700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7681236700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c09fa00 con 0x7f767c09e870 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7681236700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0a0370 con 0x7f767c09f350 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7681236700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767c06bec0 con 0x7f767c1393a0 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f767c09f350 0x7f767c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767b59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34438/0 (socket says 172.21.15.125:34438) 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767b59e700 1 -- 172.21.15.125:0/1330212875 learned_addr learned my addr 172.21.15.125:0/1330212875 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 -- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 msgr2=0x7f767c13b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 -- 172.21.15.125:0/1330212875 >> v1:172.21.15.125:6789/0 conn(0x7f767c09e870 legacy=0x7f767c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 -- 172.21.15.125:0/1330212875 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c09ada0 con 0x7f767c09f350 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7679d9b700 1 -- 172.21.15.125:0/1330212875 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000205027 0 0) 0x7f767c09fa00 con 0x7f767c09e870 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767b59e700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f767a59c700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09f350 0x7f767c138e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7670009840 tx=0x7f7670009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d23996c43faf44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.392+0000 7f7679d9b700 1 -- 172.21.15.125:0/1330212875 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011830 con 0x7f767c09f350 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7679d9b700 1 -- 172.21.15.125:0/1330212875 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670011990 con 0x7f767c09f350 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7679d9b700 1 -- 172.21.15.125:0/1330212875 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011d20 con 0x7f767c09f350 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 -- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09f350 msgr2=0x7f767c138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09f350 0x7f767c138e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7670009840 tx=0x7f7670009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 -- 172.21.15.125:0/1330212875 shutdown_connections 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 --2- 172.21.15.125:0/1330212875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09f350 0x7f767c138e60 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 -- 172.21.15.125:0/1330212875 >> 172.21.15.125:0/1330212875 conn(0x7f767c0a4430 msgr2=0x7f767c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 -- 172.21.15.125:0/1330212875 shutdown_connections 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.393+0000 7f7681236700 1 -- 172.21.15.125:0/1330212875 wait complete. 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.394+0000 7f7681236700 1 Processor -- start 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.394+0000 7f7681236700 1 -- start start 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c1214f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c06fcc0 con 0x7f767c09e870 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c122590 con 0x7f767c09f350 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f7681236700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767c122d10 con 0x7f767c1393a0 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50394/0 (socket says 172.21.15.125:50394) 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57564/0 (socket says 172.21.15.125:57564) 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767ad9d700 1 -- 172.21.15.125:0/3202211256 learned_addr learned my addr 172.21.15.125:0/3202211256 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767b59e700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c1214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 -- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 msgr2=0x7f767c1214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c1214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 -- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 msgr2=0x7f767c120a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 -- 172.21.15.125:0/3202211256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674009b30 con 0x7f767c09f350 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767b59e700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c1214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767ad9d700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.395+0000 7f767a59c700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7670016000 tx=0x7f7670004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.396+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700036a0 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.396+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767001f070 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.396+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76700094a0 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.396+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670003a20 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.396+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c124c00 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.397+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7670003b80 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.397+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7670021070 con 0x7f767c09f350 2023-10-03T10:17:37.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.397+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c04f2a0 con 0x7f767c09f350 2023-10-03T10:17:37.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.405+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f767002b080 con 0x7f767c09f350 2023-10-03T10:17:37.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 Processor -- start 2023-10-03T10:17:37.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 -- start start 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c0a13a0 0x7f922c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0a1fe0 con 0x7f922c133f70 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0a3aa0 con 0x7f922c0a0a90 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f92317d7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922c09a540 con 0x7f922c0a13a0 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f922affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f922b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f922c133f70 0x7f922c13ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41990/0 (socket says 172.21.15.125:41990) 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f922b7fe700 1 -- 172.21.15.125:0/4025995543 learned_addr learned my addr 172.21.15.125:0/4025995543 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.436+0000 7f922a7fc700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c0a13a0 0x7f922c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f922affd700 1 -- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c0a13a0 msgr2=0x7f922c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f922affd700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c0a13a0 0x7f922c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f922affd700 1 -- 172.21.15.125:0/4025995543 >> v1:172.21.15.125:6789/0 conn(0x7f922c133f70 legacy=0x7f922c13ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f9229ffb700 1 -- 172.21.15.125:0/4025995543 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672805470 0 0) 0x7f922c0a1fe0 con 0x7f922c133f70 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f922affd700 1 -- 172.21.15.125:0/4025995543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c09a280 con 0x7f922c0a0a90 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f922affd700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c0a0e60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f921c009870 tx=0x7f921c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c9cccf8c2376c73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f9229ffb700 1 -- 172.21.15.125:0/4025995543 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011830 con 0x7f922c0a0a90 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f9229ffb700 1 -- 172.21.15.125:0/4025995543 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c011990 con 0x7f922c0a0a90 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.437+0000 7f9229ffb700 1 -- 172.21.15.125:0/4025995543 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011d20 con 0x7f922c0a0a90 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 -- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 msgr2=0x7f922c0a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c0a0e60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f921c009870 tx=0x7f921c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:37.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 -- 172.21.15.125:0/4025995543 shutdown_connections 2023-10-03T10:17:37.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c0a0e60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 --2- 172.21.15.125:0/4025995543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c0a13a0 0x7f922c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 -- 172.21.15.125:0/4025995543 >> 172.21.15.125:0/4025995543 conn(0x7f922c099c40 msgr2=0x7f922c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 -- 172.21.15.125:0/4025995543 shutdown_connections 2023-10-03T10:17:37.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.438+0000 7f92317d7700 1 -- 172.21.15.125:0/4025995543 wait complete. 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 Processor -- start 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 -- start start 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c11d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 0x7f922c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c120790 con 0x7f922c0a13a0 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c130840 con 0x7f922c0a0a90 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f92317d7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922c11e320 con 0x7f922c133f70 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f922a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f922b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 0x7f922c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f922a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50406/0 (socket says 172.21.15.125:50406) 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f922a7fc700 1 -- 172.21.15.125:0/1177777700 learned_addr learned my addr 172.21.15.125:0/1177777700 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.439+0000 7f922affd700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c11d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 -- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 msgr2=0x7f922c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 0x7f922c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 -- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 msgr2=0x7f922c11d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c11d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 -- 172.21.15.125:0/1177777700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0094a0 con 0x7f922c0a13a0 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922affd700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c11d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922b7fe700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 0x7f922c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f922a7fc700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f922000e980 tx=0x7f922000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220009710 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922000c690 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c11fbe0 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922000ca20 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.440+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c11f740 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.441+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c1201e0 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.441+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f922000cb80 con 0x7f922c0a13a0 2023-10-03T10:17:37.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.441+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f922003f700 con 0x7f922c0a13a0 2023-10-03T10:17:37.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.446+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92200232f0 con 0x7f922c0a13a0 2023-10-03T10:17:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.599+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f767c072d60 con 0x7f767c09f350 2023-10-03T10:17:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.599+0000 7f76637fe700 1 -- 172.21.15.125:0/3202211256 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7670015020 con 0x7f767c09f350 2023-10-03T10:17:37.599 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 msgr2=0x7f767c120fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7670016000 tx=0x7f7670004750 comp rx=0 tx=0).stop 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 shutdown_connections 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f767c1393a0 0x7f767c1214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f767c09e870 0x7f767c120a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 --2- 172.21.15.125:0/3202211256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f767c09f350 0x7f767c120fb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 >> 172.21.15.125:0/3202211256 conn(0x7f767c0a4430 msgr2=0x7f767c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 shutdown_connections 2023-10-03T10:17:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.601+0000 7f7681236700 1 -- 172.21.15.125:0/3202211256 wait complete. 2023-10-03T10:17:37.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:37.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.638+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f922c121230 con 0x7f922c0a13a0 2023-10-03T10:17:37.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.638+0000 7f92137fe700 1 -- 172.21.15.125:0/1177777700 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f922001bd00 con 0x7f922c0a13a0 2023-10-03T10:17:37.639 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 msgr2=0x7f922c11dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f922000e980 tx=0x7f922000ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 shutdown_connections 2023-10-03T10:17:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f922c133f70 0x7f922c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f922c0a0a90 0x7f922c11d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 --2- 172.21.15.125:0/1177777700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f922c0a13a0 0x7f922c11dde0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.640+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 >> 172.21.15.125:0/1177777700 conn(0x7f922c099c40 msgr2=0x7f922c131f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.641+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 shutdown_connections 2023-10-03T10:17:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.641+0000 7f92317d7700 1 -- 172.21.15.125:0/1177777700 wait complete. 2023-10-03T10:17:37.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:37.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:37.760 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:37.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 Processor -- start 2023-10-03T10:17:37.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 -- start start 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 0x7fa2181343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21809e9d0 con 0x7fa218133f50 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21809dc00 con 0x7fa2180a0a70 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.845+0000 7fa21f208700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21809dec0 con 0x7fa2180a1380 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21cfa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21d7a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 0x7fa2181343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21cfa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57598/0 (socket says 172.21.15.125:57598) 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34476/0 (socket says 172.21.15.125:34476) 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21cfa4700 1 -- 172.21.15.125:0/772557399 learned_addr learned my addr 172.21.15.125:0/772557399 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 -- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 msgr2=0x7fa2180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 -- 172.21.15.125:0/772557399 >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 msgr2=0x7fa2181343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 --2- 172.21.15.125:0/772557399 >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 0x7fa2181343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 -- 172.21.15.125:0/772557399 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21809e6a0 con 0x7fa2180a1380 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21cfa4700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa21d7a5700 1 --2- 172.21.15.125:0/772557399 >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 0x7fa2181343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa217fff700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa204009840 tx=0x7fa204009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6742df811410b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa2177fe700 1 -- 172.21.15.125:0/772557399 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204011830 con 0x7fa2180a1380 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa2177fe700 1 -- 172.21.15.125:0/772557399 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa204011990 con 0x7fa2180a1380 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.846+0000 7fa2177fe700 1 -- 172.21.15.125:0/772557399 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204011d20 con 0x7fa2180a1380 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 -- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 msgr2=0x7fa218133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa204009840 tx=0x7fa204009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 -- 172.21.15.125:0/772557399 shutdown_connections 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2180a0a70 0x7fa2180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 --2- 172.21.15.125:0/772557399 >> v2:172.21.15.125:3300/0 conn(0x7fa218133f50 0x7fa2181343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 --2- 172.21.15.125:0/772557399 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa218133a10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 -- 172.21.15.125:0/772557399 >> 172.21.15.125:0/772557399 conn(0x7fa2180a6610 msgr2=0x7fa2180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 -- 172.21.15.125:0/772557399 shutdown_connections 2023-10-03T10:17:37.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.847+0000 7fa21f208700 1 -- 172.21.15.125:0/772557399 wait complete. 2023-10-03T10:17:37.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 Processor -- start 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 -- start start 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2180a0a70 0x7fa21811f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa21811fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180a5080 con 0x7fa2180a0a70 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181223c0 con 0x7fa218133f50 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.848+0000 7fa21f208700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181228e0 con 0x7fa2180a1380 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21d7a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa21811fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21d7a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57604/0 (socket says 172.21.15.125:57604) 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21d7a5700 1 -- 172.21.15.125:0/3452134150 learned_addr learned my addr 172.21.15.125:0/3452134150 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21cfa4700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2180a0a70 0x7fa21811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 -- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 msgr2=0x7fa2181c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 -- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2180a0a70 msgr2=0x7fa21811f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2180a0a70 0x7fa21811f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 -- 172.21.15.125:0/3452134150 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009550 con 0x7fa2180a1380 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21d7a5700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa217fff700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa21811fb20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa204016000 tx=0x7fa204004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204004450 con 0x7fa2180a1380 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20401f070 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa210009a70 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2040038e0 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.849+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2040094a0 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.850+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa204003a40 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.850+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa204021070 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.850+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218122500 con 0x7fa2180a1380 2023-10-03T10:17:37.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.855+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa218122500 con 0x7fa2180a1380 2023-10-03T10:17:37.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 Processor -- start 2023-10-03T10:17:37.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 -- start start 2023-10-03T10:17:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f883009e870 0x7f883009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 0x7f88301345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300a0370 con 0x7f883009e870 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883009fa00 con 0x7f883009f180 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.887+0000 7f8837559700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883009ada0 con 0x7f8830134160 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8834af4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f883009e870 0x7f883009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f883009e870 0x7f883009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50444/0 (socket says 172.21.15.125:50444) 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8835af6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 0x7f88301345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8834af4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57610/0 (socket says 172.21.15.125:57610) 2023-10-03T10:17:37.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 -- 172.21.15.125:0/2128325687 learned_addr learned my addr 172.21.15.125:0/2128325687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 -- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 msgr2=0x7f88301345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 0x7f88301345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 -- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 msgr2=0x7f8830133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 -- 172.21.15.125:0/2128325687 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883006bec0 con 0x7f883009e870 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8835af6700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 0x7f88301345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8834af4700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f88352f5700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009e870 0x7f883009ec40 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f882c009920 tx=0x7f882c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c797f939f67a15fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8827fff700 1 -- 172.21.15.125:0/2128325687 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011830 con 0x7f883009e870 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8827fff700 1 -- 172.21.15.125:0/2128325687 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c011990 con 0x7f883009e870 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.888+0000 7f8827fff700 1 -- 172.21.15.125:0/2128325687 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011d20 con 0x7f883009e870 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 -- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009e870 msgr2=0x7f883009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009e870 0x7f883009ec40 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f882c009920 tx=0x7f882c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 -- 172.21.15.125:0/2128325687 shutdown_connections 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8830134160 0x7f88301345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009e870 0x7f883009ec40 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 --2- 172.21.15.125:0/2128325687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f883009f180 0x7f8830133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 -- 172.21.15.125:0/2128325687 >> 172.21.15.125:0/2128325687 conn(0x7f88300a4430 msgr2=0x7f88300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 -- 172.21.15.125:0/2128325687 shutdown_connections 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.889+0000 7f8837559700 1 -- 172.21.15.125:0/2128325687 wait complete. 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.890+0000 7f8837559700 1 Processor -- start 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.890+0000 7f8837559700 1 -- start start 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009f180 0x7f8830122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8830134160 0x7f8830123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830123a60 con 0x7f883009f180 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8830133960 con 0x7f8830134160 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8837559700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8830125030 con 0x7f883009e870 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34496/0 (socket says 172.21.15.125:34496) 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 -- 172.21.15.125:0/1255931339 learned_addr learned my addr 172.21.15.125:0/1255931339 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8835af6700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8830134160 0x7f8830123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f8834af4700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009f180 0x7f8830122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 -- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8830134160 msgr2=0x7f8830123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8830134160 0x7f8830123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 -- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009f180 msgr2=0x7f8830122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009f180 0x7f8830122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 -- 172.21.15.125:0/1255931339 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88200094a0 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.891+0000 7f88352f5700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f882c009130 tx=0x7f882c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.892+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c004450 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.892+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c01e070 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.892+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8828009a70 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.892+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0038e0 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.892+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c009550 con 0x7f883009e870 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.893+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f882c003a40 con 0x7f883009e870 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.893+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f882c040310 con 0x7f883009e870 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.893+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883006cfa0 con 0x7f883009e870 2023-10-03T10:17:37.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:37.897+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f882c02d450 con 0x7f883009e870 2023-10-03T10:17:38.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.043+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa218122500 con 0x7fa2180a1380 2023-10-03T10:17:38.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.043+0000 7fa2157fa700 1 -- 172.21.15.125:0/3452134150 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa218122500 con 0x7fa2180a1380 2023-10-03T10:17:38.044 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 msgr2=0x7fa21811fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa21811fb20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa204016000 tx=0x7fa204004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 shutdown_connections 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa218133f50 0x7fa2181c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2180a0a70 0x7fa21811f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 --2- 172.21.15.125:0/3452134150 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa2180a1380 0x7fa21811fb20 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 >> 172.21.15.125:0/3452134150 conn(0x7fa2180a6610 msgr2=0x7fa2181bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 shutdown_connections 2023-10-03T10:17:38.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.045+0000 7fa21f208700 1 -- 172.21.15.125:0/3452134150 wait complete. 2023-10-03T10:17:38.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:38.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.086+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f883004f2a0 con 0x7f883009e870 2023-10-03T10:17:38.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.086+0000 7f8825ffb700 1 -- 172.21.15.125:0/1255931339 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f882c023ba0 con 0x7f883009e870 2023-10-03T10:17:38.087 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 msgr2=0x7f8830122590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f882c009130 tx=0x7f882c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 shutdown_connections 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8830134160 0x7f8830123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f883009e870 0x7f8830122590 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 --2- 172.21.15.125:0/1255931339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f883009f180 0x7f8830122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 >> 172.21.15.125:0/1255931339 conn(0x7f88300a4430 msgr2=0x7f8830070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 shutdown_connections 2023-10-03T10:17:38.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.088+0000 7f8837559700 1 -- 172.21.15.125:0/1255931339 wait complete. 2023-10-03T10:17:38.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:38.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:38.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:38.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 Processor -- start 2023-10-03T10:17:38.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 -- start start 2023-10-03T10:17:38.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e3013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3009dc00 con 0x7f2e300a1380 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3009ea90 con 0x7f2e300a0a70 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.742+0000 7f2e34da3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3009dec0 con 0x7f2e30134120 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e3013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50458/0 (socket says 172.21.15.125:50458) 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2e300a1380 0x7f2e30133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41998/0 (socket says 172.21.15.125:41998) 2023-10-03T10:17:38.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2e59c700 1 -- 172.21.15.125:0/3471850008 learned_addr learned my addr 172.21.15.125:0/3471850008 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 -- 172.21.15.125:0/3471850008 >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 msgr2=0x7f2e300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 --2- 172.21.15.125:0/3471850008 >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 -- 172.21.15.125:0/3471850008 >> v1:172.21.15.125:6789/0 conn(0x7f2e300a1380 legacy=0x7f2e30133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 -- 172.21.15.125:0/3471850008 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3009e6a0 con 0x7f2e30134120 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2d59a700 1 -- 172.21.15.125:0/3471850008 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786775249 0 0) 0x7f2e3009dc00 con 0x7f2e300a1380 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2e59c700 1 --2- 172.21.15.125:0/3471850008 >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2ed9d700 1 --2- 172.21.15.125:0/3471850008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e3013bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009d90 tx=0x7f2e2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63608ccb222eee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2d59a700 1 -- 172.21.15.125:0/3471850008 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800e070 con 0x7f2e30134120 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2d59a700 1 -- 172.21.15.125:0/3471850008 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800bb20 con 0x7f2e30134120 2023-10-03T10:17:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.743+0000 7f2e2d59a700 1 -- 172.21.15.125:0/3471850008 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28012430 con 0x7f2e30134120 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 -- 172.21.15.125:0/3471850008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 msgr2=0x7f2e3013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3471850008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e3013bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009d90 tx=0x7f2e2800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 -- 172.21.15.125:0/3471850008 shutdown_connections 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3471850008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e3013bce0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3471850008 >> v2:172.21.15.125:3300/0 conn(0x7f2e300a0a70 0x7f2e300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 -- 172.21.15.125:0/3471850008 >> 172.21.15.125:0/3471850008 conn(0x7f2e300a6610 msgr2=0x7f2e300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 -- 172.21.15.125:0/3471850008 shutdown_connections 2023-10-03T10:17:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.744+0000 7f2e34da3700 1 -- 172.21.15.125:0/3471850008 wait complete. 2023-10-03T10:17:38.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.745+0000 7f2e34da3700 1 Processor -- start 2023-10-03T10:17:38.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.745+0000 7f2e34da3700 1 -- start start 2023-10-03T10:17:38.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 0x7f2e30122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e301231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30125c30 con 0x7f2e300a0a70 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30133600 con 0x7f2e30134120 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300a03e0 con 0x7f2e300a1380 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e301231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34510/0 (socket says 172.21.15.125:34510) 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2dd9b700 1 -- 172.21.15.125:0/3427405694 learned_addr learned my addr 172.21.15.125:0/3427405694 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 0x7f2e30122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 -- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 msgr2=0x7f2e30122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 -- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 msgr2=0x7f2e301231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e301231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 -- 172.21.15.125:0/3427405694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009550 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2dd9b700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2ed9d700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e301231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e2e59c700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 0x7f2e30122750 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000e9a0 tx=0x7f2e2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004030 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20004190 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e28009a70 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.746+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004520 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.747+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e30123ba0 con 0x7f2e300a0a70 2023-10-03T10:17:38.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.747+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e200036a0 con 0x7f2e300a0a70 2023-10-03T10:17:38.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.747+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e2003f8c0 con 0x7f2e300a0a70 2023-10-03T10:17:38.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.748+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e30126a20 con 0x7f2e300a0a70 2023-10-03T10:17:38.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.752+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e20011db0 con 0x7f2e300a0a70 2023-10-03T10:17:38.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.782+0000 7f8f0caff700 1 Processor -- start 2023-10-03T10:17:38.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 -- start start 2023-10-03T10:17:38.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f080a0a70 0x7f8f080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0809e9d0 con 0x7f8f080a0a70 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0809dc00 con 0x7f8f080a1380 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0caff700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0809dec0 con 0x7f8f08133f50 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f05d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f0659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f080a0a70 0x7f8f080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f05d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57632/0 (socket says 172.21.15.125:57632) 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34518/0 (socket says 172.21.15.125:34518) 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.783+0000 7f8f05d9b700 1 -- 172.21.15.125:0/691559806 learned_addr learned my addr 172.21.15.125:0/691559806 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:38.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 -- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 msgr2=0x7f8f081343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 -- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 msgr2=0x7f8f08133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 -- 172.21.15.125:0/691559806 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0809e6a0 con 0x7f8f080a0a70 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f05d9b700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f06d9d700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0659c700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f080a0a70 0x7f8f080a0e40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009840 tx=0x7f8ef8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e466e1e8af2354 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0559a700 1 -- 172.21.15.125:0/691559806 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011830 con 0x7f8f080a0a70 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0559a700 1 -- 172.21.15.125:0/691559806 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8011990 con 0x7f8f080a0a70 2023-10-03T10:17:38.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0559a700 1 -- 172.21.15.125:0/691559806 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011d20 con 0x7f8f080a0a70 2023-10-03T10:17:38.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.784+0000 7f8f0caff700 1 -- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f080a0a70 msgr2=0x7f8f080a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f080a0a70 0x7f8f080a0e40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009840 tx=0x7f8ef8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 -- 172.21.15.125:0/691559806 shutdown_connections 2023-10-03T10:17:38.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f08133f50 0x7f8f081343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f080a0a70 0x7f8f080a0e40 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 --2- 172.21.15.125:0/691559806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a1380 0x7f8f08133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 -- 172.21.15.125:0/691559806 >> 172.21.15.125:0/691559806 conn(0x7f8f080a6610 msgr2=0x7f8f080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 -- 172.21.15.125:0/691559806 shutdown_connections 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.785+0000 7f8f0caff700 1 -- 172.21.15.125:0/691559806 wait complete. 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.786+0000 7f8f0caff700 1 Processor -- start 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.786+0000 7f8f0caff700 1 -- start start 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 0x7f8f08121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 0x7f8f08122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08132900 con 0x7f8f08133f50 2023-10-03T10:17:38.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08123fd0 con 0x7f8f080a0a70 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0caff700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08124ab0 con 0x7f8f080a1380 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 0x7f8f08122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57646/0 (socket says 172.21.15.125:57646) 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 -- 172.21.15.125:0/1065436950 learned_addr learned my addr 172.21.15.125:0/1065436950 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f05d9b700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 0x7f8f08121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 -- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 msgr2=0x7f8f08121ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 0x7f8f08121ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 -- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 msgr2=0x7f8f08122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 0x7f8f08122000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f0659c700 1 -- 172.21.15.125:0/1065436950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009550 con 0x7f8f080a0a70 2023-10-03T10:17:38.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f06d9d700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 0x7f8f08122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.787+0000 7f8f05d9b700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 0x7f8f08121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8f0659c700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f0809eb10 tx=0x7f8ef8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80044d0 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef801f070 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80038e0 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f00009a70 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.788+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef80094a0 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.789+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ef8003a40 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.789+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ef8021070 con 0x7f8f080a0a70 2023-10-03T10:17:38.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.789+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0811e040 con 0x7f8f080a0a70 2023-10-03T10:17:38.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.793+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ef802b080 con 0x7f8f080a0a70 2023-10-03T10:17:38.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.948+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e3004f2a0 con 0x7f2e300a0a70 2023-10-03T10:17:38.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.948+0000 7f2e1effd700 1 -- 172.21.15.125:0/3427405694 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e20020020 con 0x7f2e300a0a70 2023-10-03T10:17:38.949 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 msgr2=0x7f2e30122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 0x7f2e30122750 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000e9a0 tx=0x7f2e2000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 shutdown_connections 2023-10-03T10:17:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e30134120 0x7f2e301231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e300a0a70 0x7f2e30122750 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 --2- 172.21.15.125:0/3427405694 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2e300a1380 0x7f2e30122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 >> 172.21.15.125:0/3427405694 conn(0x7f2e300a6610 msgr2=0x7f2e300a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 shutdown_connections 2023-10-03T10:17:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.950+0000 7f2e34da3700 1 -- 172.21.15.125:0/3427405694 wait complete. 2023-10-03T10:17:38.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.985+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f08133a10 con 0x7f8f080a0a70 2023-10-03T10:17:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.985+0000 7f8ef6ffd700 1 -- 172.21.15.125:0/1065436950 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ef8015020 con 0x7f8f080a0a70 2023-10-03T10:17:38.986 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 msgr2=0x7f8f08121580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f0809eb10 tx=0x7f8ef8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 shutdown_connections 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08133f50 0x7f8f08122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f080a0a70 0x7f8f08121580 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 --2- 172.21.15.125:0/1065436950 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8f080a1380 0x7f8f08121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 >> 172.21.15.125:0/1065436950 conn(0x7f8f080a6610 msgr2=0x7f8f081332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 shutdown_connections 2023-10-03T10:17:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:38.988+0000 7f8f0caff700 1 -- 172.21.15.125:0/1065436950 wait complete. 2023-10-03T10:17:39.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:39.058 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:39.102 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:39.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 Processor -- start 2023-10-03T10:17:39.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 -- start start 2023-10-03T10:17:39.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b4139200 0x7f44b413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b409e9d0 con 0x7f44b40a0a70 2023-10-03T10:17:39.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b409dc00 con 0x7f44b4139200 2023-10-03T10:17:39.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b9cb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44b409dec0 con 0x7f44b40a1550 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f44b40a0a70 0x7f44b40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42000/0 (socket says 172.21.15.125:42000) 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b37fe700 1 -- 172.21.15.125:0/522114793 learned_addr learned my addr 172.21.15.125:0/522114793 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b3fff700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b4139200 0x7f44b413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b27fc700 1 -- 172.21.15.125:0/522114793 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723334833 0 0) 0x7f44b409e9d0 con 0x7f44b40a0a70 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.183+0000 7f44b27fc700 1 -- 172.21.15.125:0/522114793 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449c0035b0 con 0x7f44b40a0a70 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b2ffd700 1 -- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b4139200 msgr2=0x7f44b413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b2ffd700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b4139200 0x7f44b413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b2ffd700 1 -- 172.21.15.125:0/522114793 >> v1:172.21.15.125:6789/0 conn(0x7f44b40a0a70 legacy=0x7f44b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b2ffd700 1 -- 172.21.15.125:0/522114793 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b409e6a0 con 0x7f44b40a1550 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b2ffd700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4138cc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009870 tx=0x7f44a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f0a0c6a5d5cc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b27fc700 1 -- 172.21.15.125:0/522114793 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011830 con 0x7f44b40a1550 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b27fc700 1 -- 172.21.15.125:0/522114793 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8011990 con 0x7f44b40a1550 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b27fc700 1 -- 172.21.15.125:0/522114793 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011d20 con 0x7f44b40a1550 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 -- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 msgr2=0x7f44b4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4138cc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009870 tx=0x7f44a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 -- 172.21.15.125:0/522114793 shutdown_connections 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b4139200 0x7f44b413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/522114793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4138cc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 -- 172.21.15.125:0/522114793 >> 172.21.15.125:0/522114793 conn(0x7f44b40a6610 msgr2=0x7f44b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.184+0000 7f44b9cb2700 1 -- 172.21.15.125:0/522114793 shutdown_connections 2023-10-03T10:17:39.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.185+0000 7f44b9cb2700 1 -- 172.21.15.125:0/522114793 wait complete. 2023-10-03T10:17:39.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.186+0000 7f44b9cb2700 1 Processor -- start 2023-10-03T10:17:39.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.186+0000 7f44b9cb2700 1 -- start start 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 0x7f44b4120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44b4139200 0x7f44b4121200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4122930 con 0x7f44b4139200 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4124200 con 0x7f44b40a0a70 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40a5680 con 0x7f44b40a1550 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 0x7f44b4120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34552/0 (socket says 172.21.15.125:34552) 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 -- 172.21.15.125:0/162993020 learned_addr learned my addr 172.21.15.125:0/162993020 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b3fff700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44b4139200 0x7f44b4121200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 -- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 msgr2=0x7f44b4120780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 0x7f44b4120780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 -- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44b4139200 msgr2=0x7f44b4121200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44b4139200 0x7f44b4121200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 -- 172.21.15.125:0/162993020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80094a0 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b37fe700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 0x7f44b4120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b2ffd700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f44a80090b0 tx=0x7f44a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80044d0 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a801f070 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b41222f0 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80038e0 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.187+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b4122ae0 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.188+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44a8003a40 con 0x7f44b40a1550 2023-10-03T10:17:39.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.188+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44a8021070 con 0x7f44b40a1550 2023-10-03T10:17:39.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.188+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b404f2a0 con 0x7f44b40a1550 2023-10-03T10:17:39.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.193+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44a802b080 con 0x7f44b40a1550 2023-10-03T10:17:39.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.226+0000 7f615f8e6700 1 Processor -- start 2023-10-03T10:17:39.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 -- start start 2023-10-03T10:17:39.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 0x7f615809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 0x7f615813bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615806bec0 con 0x7f615809f180 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615806ce60 con 0x7f61581343a0 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615f8e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f615809fa00 con 0x7f615809e870 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615d682700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 0x7f615809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615ce81700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f615809f180 0x7f6158133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42008/0 (socket says 172.21.15.125:42008) 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615ce81700 1 -- 172.21.15.125:0/3124308629 learned_addr learned my addr 172.21.15.125:0/3124308629 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:39.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615de83700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 0x7f615813bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615d682700 1 -- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 msgr2=0x7f615813bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615d682700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 0x7f615813bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615d682700 1 -- 172.21.15.125:0/3124308629 >> v1:172.21.15.125:6789/0 conn(0x7f615809f180 legacy=0x7f6158133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.227+0000 7f615d682700 1 -- 172.21.15.125:0/3124308629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615809ad80 con 0x7f615809e870 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.228+0000 7f615de83700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 0x7f615813bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.228+0000 7f615d682700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 0x7f615809ec40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f6154009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b347082d2bbfcd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.229+0000 7f614ffff700 1 -- 172.21.15.125:0/3124308629 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011830 con 0x7f615809e870 2023-10-03T10:17:39.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.229+0000 7f614ffff700 1 -- 172.21.15.125:0/3124308629 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154011990 con 0x7f615809e870 2023-10-03T10:17:39.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.229+0000 7f614ffff700 1 -- 172.21.15.125:0/3124308629 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011d20 con 0x7f615809e870 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 -- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 msgr2=0x7f615809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 0x7f615809ec40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f6154009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 -- 172.21.15.125:0/3124308629 shutdown_connections 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61581343a0 0x7f615813bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 --2- 172.21.15.125:0/3124308629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f615809e870 0x7f615809ec40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 -- 172.21.15.125:0/3124308629 >> 172.21.15.125:0/3124308629 conn(0x7f61580a4430 msgr2=0x7f61580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 -- 172.21.15.125:0/3124308629 shutdown_connections 2023-10-03T10:17:39.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.230+0000 7f615f8e6700 1 -- 172.21.15.125:0/3124308629 wait complete. 2023-10-03T10:17:39.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.231+0000 7f615f8e6700 1 Processor -- start 2023-10-03T10:17:39.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 -- start start 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f615809e870 0x7f6158122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 0x7f61581234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615806fca0 con 0x7f615809f180 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615806cfa0 con 0x7f615809e870 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615f8e6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6158124ea0 con 0x7f61581343a0 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615ce81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615ce81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50496/0 (socket says 172.21.15.125:50496) 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615ce81700 1 -- 172.21.15.125:0/4119276728 learned_addr learned my addr 172.21.15.125:0/4119276728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615de83700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 0x7f61581234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.232+0000 7f615d682700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f615809e870 0x7f6158122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 -- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f615809e870 msgr2=0x7f6158122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f615809e870 0x7f6158122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 -- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 msgr2=0x7f6158122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 -- 172.21.15.125:0/4119276728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009a70 con 0x7f61581343a0 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615ce81700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615de83700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 0x7f61581234b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f615000efc0 tx=0x7f615000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000ca90 con 0x7f61581343a0 2023-10-03T10:17:39.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000f040 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61540094a0 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000ce30 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.233+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61581247a0 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.234+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6150014480 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.234+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f615003fc00 con 0x7f61581343a0 2023-10-03T10:17:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.234+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615804f2a0 con 0x7f61581343a0 2023-10-03T10:17:39.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.239+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6150012930 con 0x7f61581343a0 2023-10-03T10:17:39.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.388+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44b4072980 con 0x7f44b40a1550 2023-10-03T10:17:39.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.388+0000 7f449bfff700 1 -- 172.21.15.125:0/162993020 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44a8015070 con 0x7f44b40a1550 2023-10-03T10:17:39.389 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 msgr2=0x7f44b4120cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f44a80090b0 tx=0x7f44a8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 shutdown_connections 2023-10-03T10:17:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44b4139200 0x7f44b4121200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44b40a0a70 0x7f44b4120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 --2- 172.21.15.125:0/162993020 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44b40a1550 0x7f44b4120cc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.390+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 >> 172.21.15.125:0/162993020 conn(0x7f44b40a6610 msgr2=0x7f44b4136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.391+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 shutdown_connections 2023-10-03T10:17:39.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.391+0000 7f44b9cb2700 1 -- 172.21.15.125:0/162993020 wait complete. 2023-10-03T10:17:39.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.431+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6158072d20 con 0x7f61581343a0 2023-10-03T10:17:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.431+0000 7f614dffb700 1 -- 172.21.15.125:0/4119276728 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6150012340 con 0x7f61581343a0 2023-10-03T10:17:39.432 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 msgr2=0x7f61581234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 0x7f61581234b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f615000efc0 tx=0x7f615000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 shutdown_connections 2023-10-03T10:17:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f61581343a0 0x7f61581234b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f615809e870 0x7f6158122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 --2- 172.21.15.125:0/4119276728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615809f180 0x7f6158122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 >> 172.21.15.125:0/4119276728 conn(0x7f61580a4430 msgr2=0x7f615809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 shutdown_connections 2023-10-03T10:17:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:39.433+0000 7f615f8e6700 1 -- 172.21.15.125:0/4119276728 wait complete. 2023-10-03T10:17:39.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:39.964 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:40.001 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.097+0000 7fb747caf700 1 Processor -- start 2023-10-03T10:17:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 -- start start 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb740133640 con 0x7fb7400a1290 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400a1d50 con 0x7fb7400a08e0 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb747caf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74009b620 con 0x7fb740133a70 2023-10-03T10:17:40.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb745a4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb74524a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb745a4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57692/0 (socket says 172.21.15.125:57692) 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb74524a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50502/0 (socket says 172.21.15.125:50502) 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb74624c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb7400a1290 0x7fb74013a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42012/0 (socket says 172.21.15.125:42012) 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.098+0000 7fb745a4b700 1 -- 172.21.15.125:0/1637254270 learned_addr learned my addr 172.21.15.125:0/1637254270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb745a4b700 1 -- 172.21.15.125:0/1637254270 >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 msgr2=0x7fb7400a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb745a4b700 1 --2- 172.21.15.125:0/1637254270 >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb745a4b700 1 -- 172.21.15.125:0/1637254270 >> v1:172.21.15.125:6789/0 conn(0x7fb7400a1290 legacy=0x7fb74013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb745a4b700 1 -- 172.21.15.125:0/1637254270 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740133870 con 0x7fb740133a70 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb744a49700 1 -- 172.21.15.125:0/1637254270 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387468494 0 0) 0x7fb740133640 con 0x7fb7400a1290 2023-10-03T10:17:40.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb74524a700 1 --2- 172.21.15.125:0/1637254270 >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb745a4b700 1 --2- 172.21.15.125:0/1637254270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c4c1c2e806e4c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb744a49700 1 -- 172.21.15.125:0/1637254270 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c005e30 con 0x7fb740133a70 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb744a49700 1 -- 172.21.15.125:0/1637254270 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c004030 con 0x7fb740133a70 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.099+0000 7fb744a49700 1 -- 172.21.15.125:0/1637254270 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0043e0 con 0x7fb740133a70 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 -- 172.21.15.125:0/1637254270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 msgr2=0x7fb740133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 --2- 172.21.15.125:0/1637254270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 -- 172.21.15.125:0/1637254270 shutdown_connections 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 --2- 172.21.15.125:0/1637254270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb740133a70 0x7fb740133e40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 --2- 172.21.15.125:0/1637254270 >> v2:172.21.15.125:3300/0 conn(0x7fb7400a08e0 0x7fb7400a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 -- 172.21.15.125:0/1637254270 >> 172.21.15.125:0/1637254270 conn(0x7fb7400a2980 msgr2=0x7fb7400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 -- 172.21.15.125:0/1637254270 shutdown_connections 2023-10-03T10:17:40.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.100+0000 7fb747caf700 1 -- 172.21.15.125:0/1637254270 wait complete. 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 Processor -- start 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 -- start start 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7400a08e0 0x7fb74011c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 0x7fb74011d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74011e380 con 0x7fb7400a1290 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74011fb70 con 0x7fb7400a08e0 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb747caf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb740120110 con 0x7fb740133a70 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb74524a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb74624c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 0x7fb74011d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb74524a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50506/0 (socket says 172.21.15.125:50506) 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb74524a700 1 -- 172.21.15.125:0/1856422501 learned_addr learned my addr 172.21.15.125:0/1856422501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.101+0000 7fb745a4b700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7400a08e0 0x7fb74011c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 -- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7400a08e0 msgr2=0x7fb74011c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7400a08e0 0x7fb74011c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 -- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 msgr2=0x7fb74011cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 -- 172.21.15.125:0/1856422501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300094a0 con 0x7fb740133a70 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74524a700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb74624c700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 0x7fb74011d070 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb73800cc10 tx=0x7fb73800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800aa00 con 0x7fb740133a70 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800ab80 con 0x7fb740133a70 2023-10-03T10:17:40.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380070d0 con 0x7fb740133a70 2023-10-03T10:17:40.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c009500 con 0x7fb740133a70 2023-10-03T10:17:40.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.102+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74012ffb0 con 0x7fb740133a70 2023-10-03T10:17:40.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.103+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb738007230 con 0x7fb740133a70 2023-10-03T10:17:40.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.103+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb73803f160 con 0x7fb740133a70 2023-10-03T10:17:40.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.103+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74004f2a0 con 0x7fb740133a70 2023-10-03T10:17:40.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.107+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb738018020 con 0x7fb740133a70 2023-10-03T10:17:40.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.137+0000 7f93d5abc700 1 Processor -- start 2023-10-03T10:17:40.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.137+0000 7f93d5abc700 1 -- start start 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93d5abc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93d5abc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93d5abc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d009e9d0 con 0x7f93d00a0a70 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93d5abc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d009dc00 con 0x7f93d00a1550 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93d5abc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d009dec0 con 0x7f93d0139200 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57698/0 (socket says 172.21.15.125:57698) 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 -- 172.21.15.125:0/3135110932 learned_addr learned my addr 172.21.15.125:0/3135110932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93cffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34572/0 (socket says 172.21.15.125:34572) 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 -- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 msgr2=0x7f93d013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 -- 172.21.15.125:0/3135110932 >> v1:172.21.15.125:6789/0 conn(0x7f93d00a0a70 legacy=0x7f93d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 -- 172.21.15.125:0/3135110932 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d009e6a0 con 0x7f93d00a1550 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93cffff700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93c6ffd700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009920 tx=0x7f93b8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cc8e548ff7af18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93ceffd700 1 -- 172.21.15.125:0/3135110932 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8011830 con 0x7f93d00a1550 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93ceffd700 1 -- 172.21.15.125:0/3135110932 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b8011990 con 0x7f93d00a1550 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.138+0000 7f93ceffd700 1 -- 172.21.15.125:0/3135110932 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8011d20 con 0x7f93d00a1550 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 -- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 msgr2=0x7f93d0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009920 tx=0x7f93b8009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 -- 172.21.15.125:0/3135110932 shutdown_connections 2023-10-03T10:17:40.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d0139200 0x7f93d013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 --2- 172.21.15.125:0/3135110932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d0138cc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 -- 172.21.15.125:0/3135110932 >> 172.21.15.125:0/3135110932 conn(0x7f93d00a6610 msgr2=0x7f93d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 -- 172.21.15.125:0/3135110932 shutdown_connections 2023-10-03T10:17:40.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.139+0000 7f93d5abc700 1 -- 172.21.15.125:0/3135110932 wait complete. 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.140+0000 7f93d5abc700 1 Processor -- start 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.140+0000 7f93d5abc700 1 -- start start 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.140+0000 7f93d5abc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.140+0000 7f93d5abc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d011ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01227a0 con 0x7f93d0139200 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0120c00 con 0x7f93d00a1550 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00a5400 con 0x7f93d00a0a70 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34576/0 (socket says 172.21.15.125:34576) 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50516/0 (socket says 172.21.15.125:50516) 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 -- 172.21.15.125:0/1340491382 learned_addr learned my addr 172.21.15.125:0/1340491382 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93c6ffd700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d011ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 -- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 msgr2=0x7f93d011ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d011ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 -- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 msgr2=0x7f93d011f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 -- 172.21.15.125:0/1340491382 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8009a70 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cffff700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93c6ffd700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d011ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93cf7fe700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c4e0 tx=0x7f93c000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00052d0 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0005430 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8009550 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00038c0 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.141+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d0120e40 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.142+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93c0003a20 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.142+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93c003ea60 con 0x7f93d00a0a70 2023-10-03T10:17:40.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.142+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0121ed0 con 0x7f93d00a0a70 2023-10-03T10:17:40.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.147+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93c0018260 con 0x7f93d00a0a70 2023-10-03T10:17:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.304+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb74006bce0 con 0x7fb740133a70 2023-10-03T10:17:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.304+0000 7fb7367fc700 1 -- 172.21.15.125:0/1856422501 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7380074e0 con 0x7fb740133a70 2023-10-03T10:17:40.305 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 msgr2=0x7fb74011d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 0x7fb74011d070 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb73800cc10 tx=0x7fb73800cf20 comp rx=0 tx=0).stop 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 shutdown_connections 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb740133a70 0x7fb74011d070 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb7400a08e0 0x7fb74011c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 --2- 172.21.15.125:0/1856422501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7400a1290 0x7fb74011cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 >> 172.21.15.125:0/1856422501 conn(0x7fb7400a2980 msgr2=0x7fb7401baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 shutdown_connections 2023-10-03T10:17:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.306+0000 7fb747caf700 1 -- 172.21.15.125:0/1856422501 wait complete. 2023-10-03T10:17:40.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:40.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.341+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93d004f2a0 con 0x7f93d00a0a70 2023-10-03T10:17:40.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.341+0000 7f93ccff9700 1 -- 172.21.15.125:0/1340491382 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93c0017020 con 0x7f93d00a0a70 2023-10-03T10:17:40.342 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 msgr2=0x7f93d011ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c4e0 tx=0x7f93c000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 shutdown_connections 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93d0139200 0x7f93d011f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f93d00a0a70 0x7f93d011ea40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 --2- 172.21.15.125:0/1340491382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f93d00a1550 0x7f93d011ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 >> 172.21.15.125:0/1340491382 conn(0x7f93d00a6610 msgr2=0x7f93d01382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 shutdown_connections 2023-10-03T10:17:40.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.343+0000 7f93d5abc700 1 -- 172.21.15.125:0/1340491382 wait complete. 2023-10-03T10:17:40.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:40.404 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:40.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:40.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 Processor -- start 2023-10-03T10:17:40.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 -- start start 2023-10-03T10:17:40.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 0x7ff92c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c09b110 con 0x7ff92c09ad40 2023-10-03T10:17:40.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.530+0000 7ff93359a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0a3b60 con 0x7ff92c134570 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff93359a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0a1a80 con 0x7ff92c134140 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff930b35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931336700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff92c09ad40 0x7ff92c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42036/0 (socket says 172.21.15.125:42036) 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931336700 1 -- 172.21.15.125:0/160139971 learned_addr learned my addr 172.21.15.125:0/160139971 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 0x7ff92c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff923fff700 1 -- 172.21.15.125:0/160139971 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216047158 0 0) 0x7ff92c09b110 con 0x7ff92c09ad40 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 -- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 msgr2=0x7ff92c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 -- 172.21.15.125:0/160139971 >> v1:172.21.15.125:6789/0 conn(0x7ff92c09ad40 legacy=0x7ff92c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 -- 172.21.15.125:0/160139971 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0a2fa0 con 0x7ff92c134570 2023-10-03T10:17:40.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff930b35700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff931b37700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 0x7ff92c13b3d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff924009df0 tx=0x7ff92400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09fd56d386e310d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff923fff700 1 -- 172.21.15.125:0/160139971 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400e070 con 0x7ff92c134570 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff923fff700 1 -- 172.21.15.125:0/160139971 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92400bae0 con 0x7ff92c134570 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.531+0000 7ff923fff700 1 -- 172.21.15.125:0/160139971 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400be90 con 0x7ff92c134570 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 -- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 msgr2=0x7ff92c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 0x7ff92c13b3d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff924009df0 tx=0x7ff92400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 -- 172.21.15.125:0/160139971 shutdown_connections 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c134570 0x7ff92c13b3d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 --2- 172.21.15.125:0/160139971 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 -- 172.21.15.125:0/160139971 >> 172.21.15.125:0/160139971 conn(0x7ff92c099c40 msgr2=0x7ff92c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 -- 172.21.15.125:0/160139971 shutdown_connections 2023-10-03T10:17:40.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.532+0000 7ff93359a700 1 -- 172.21.15.125:0/160139971 wait complete. 2023-10-03T10:17:40.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 Processor -- start 2023-10-03T10:17:40.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 -- start start 2023-10-03T10:17:40.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c09ad40 0x7ff92c139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c11cf70 con 0x7ff92c134570 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c11ea90 con 0x7ff92c09ad40 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff93359a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c09e490 con 0x7ff92c134140 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff931b37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff931b37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50520/0 (socket says 172.21.15.125:50520) 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff931b37700 1 -- 172.21.15.125:0/3924966721 learned_addr learned my addr 172.21.15.125:0/3924966721 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.533+0000 7ff930b35700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931336700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c09ad40 0x7ff92c139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 -- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 msgr2=0x7ff92c139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c139960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 -- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c09ad40 msgr2=0x7ff92c139420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c09ad40 0x7ff92c139420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 -- 172.21.15.125:0/3924966721 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0094a0 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff931b37700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ff92400b370 tx=0x7ff924004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004650 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924020070 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924009a70 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924027480 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.534+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c09c830 con 0x7ff92c134570 2023-10-03T10:17:40.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.535+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c11e900 con 0x7ff92c134570 2023-10-03T10:17:40.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.535+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff924012430 con 0x7ff92c134570 2023-10-03T10:17:40.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.535+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff924022070 con 0x7ff92c134570 2023-10-03T10:17:40.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.540+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9240269d0 con 0x7ff92c134570 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.572+0000 7fb2f9fd6700 1 Processor -- start 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.572+0000 7fb2f9fd6700 1 -- start start 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f9fd6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 0x7fb2f409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f9fd6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 0x7fb2f409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f9fd6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f409af80 con 0x7fb2f4133c20 2023-10-03T10:17:40.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f9fd6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f409fe00 con 0x7fb2f409edb0 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f9fd6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f406bec0 con 0x7fb2f409a150 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 0x7fb2f409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 0x7fb2f409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb2f4133c20 0x7fb2f4134070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42050/0 (socket says 172.21.15.125:42050) 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f3fff700 1 -- 172.21.15.125:0/3919801506 learned_addr learned my addr 172.21.15.125:0/3919801506 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f37fe700 1 -- 172.21.15.125:0/3919801506 >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 msgr2=0x7fb2f409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f37fe700 1 --2- 172.21.15.125:0/3919801506 >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 0x7fb2f409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f37fe700 1 -- 172.21.15.125:0/3919801506 >> v1:172.21.15.125:6789/0 conn(0x7fb2f4133c20 legacy=0x7fb2f4134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f37fe700 1 -- 172.21.15.125:0/3919801506 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f409f6e0 con 0x7fb2f409a150 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.573+0000 7fb2f2ffd700 1 --2- 172.21.15.125:0/3919801506 >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 0x7fb2f409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f37fe700 1 --2- 172.21.15.125:0/3919801506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 0x7fb2f409e870 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009dc0 tx=0x7fb2e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d06c032384d7377 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f27fc700 1 -- 172.21.15.125:0/3919801506 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400e070 con 0x7fb2f409a150 2023-10-03T10:17:40.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f27fc700 1 -- 172.21.15.125:0/3919801506 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400bae0 con 0x7fb2f409a150 2023-10-03T10:17:40.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f27fc700 1 -- 172.21.15.125:0/3919801506 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400be90 con 0x7fb2f409a150 2023-10-03T10:17:40.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/3919801506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 msgr2=0x7fb2f409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/3919801506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 0x7fb2f409e870 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009dc0 tx=0x7fb2e400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/3919801506 shutdown_connections 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/3919801506 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f409a150 0x7fb2f409e870 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/3919801506 >> v2:172.21.15.125:3300/0 conn(0x7fb2f409edb0 0x7fb2f409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/3919801506 >> 172.21.15.125:0/3919801506 conn(0x7fb2f40a4430 msgr2=0x7fb2f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/3919801506 shutdown_connections 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.574+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/3919801506 wait complete. 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.575+0000 7fb2f9fd6700 1 Processor -- start 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.575+0000 7fb2f9fd6700 1 -- start start 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 0x7fb2f4122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 0x7fb2f4123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4126520 con 0x7fb2f409edb0 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4124610 con 0x7fb2f409a150 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f9fd6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40a3700 con 0x7fb2f4133c20 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 0x7fb2f4122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50552/0 (socket says 172.21.15.125:50552) 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 -- 172.21.15.125:0/1224168601 learned_addr learned my addr 172.21.15.125:0/1224168601 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f3fff700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 0x7fb2f4123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 -- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 msgr2=0x7fb2f4123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 0x7fb2f4123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 -- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 msgr2=0x7fb2f4122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 0x7fb2f4122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 -- 172.21.15.125:0/1224168601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80094a0 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f37fe700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 0x7fb2f4122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f3fff700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 0x7fb2f4123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.576+0000 7fb2f2ffd700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800ebb0 tx=0x7fb2e800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800c850 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800c9b0 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4009a70 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800cd40 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4133520 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.577+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2e8013470 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.578+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2e803faf0 con 0x7fb2f409edb0 2023-10-03T10:17:40.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.578+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f409fa30 con 0x7fb2f409edb0 2023-10-03T10:17:40.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.582+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2e8017020 con 0x7fb2f409edb0 2023-10-03T10:17:40.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.729+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff92c1361e0 con 0x7ff92c134570 2023-10-03T10:17:40.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.730+0000 7ff921ffb700 1 -- 172.21.15.125:0/3924966721 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff92402c030 con 0x7ff92c134570 2023-10-03T10:17:40.730 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 msgr2=0x7ff92c139ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ff92400b370 tx=0x7ff924004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 shutdown_connections 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff92c134570 0x7ff92c139ea0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff92c09ad40 0x7ff92c139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 --2- 172.21.15.125:0/3924966721 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff92c134140 0x7ff92c139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 >> 172.21.15.125:0/3924966721 conn(0x7ff92c099c40 msgr2=0x7ff92c13b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 shutdown_connections 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.732+0000 7ff93359a700 1 -- 172.21.15.125:0/3924966721 wait complete. 2023-10-03T10:17:40.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:40.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.768+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2f409d5f0 con 0x7fb2f409edb0 2023-10-03T10:17:40.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.768+0000 7fb2dbfff700 1 -- 172.21.15.125:0/1224168601 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2e801b3b0 con 0x7fb2f409edb0 2023-10-03T10:17:40.769 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 msgr2=0x7fb2f4122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800ebb0 tx=0x7fb2e800eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 shutdown_connections 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2f4133c20 0x7fb2f4123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2f409a150 0x7fb2f4122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 --2- 172.21.15.125:0/1224168601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2f409edb0 0x7fb2f4122f40 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 >> 172.21.15.125:0/1224168601 conn(0x7fb2f40a4430 msgr2=0x7fb2f409c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 shutdown_connections 2023-10-03T10:17:40.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:40.770+0000 7fb2f9fd6700 1 -- 172.21.15.125:0/1224168601 wait complete. 2023-10-03T10:17:40.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:41.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:41.356 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:41.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.446+0000 7fac74e11700 1 Processor -- start 2023-10-03T10:17:41.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.446+0000 7fac74e11700 1 -- start start 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac74e11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 0x7fac70138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac74e11700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac74e11700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7009e9d0 con 0x7fac700a0a70 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac74e11700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7009dc00 con 0x7fac70139200 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac74e11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac7009dec0 con 0x7fac700a1550 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50556/0 (socket says 172.21.15.125:50556) 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 0x7fac70138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6ed9d700 1 -- 172.21.15.125:0/412601010 learned_addr learned my addr 172.21.15.125:0/412601010 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 -- 172.21.15.125:0/412601010 >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 msgr2=0x7fac7013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 --2- 172.21.15.125:0/412601010 >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 -- 172.21.15.125:0/412601010 >> v1:172.21.15.125:6789/0 conn(0x7fac700a0a70 legacy=0x7fac700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 -- 172.21.15.125:0/412601010 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7009e6a0 con 0x7fac700a1550 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6d59a700 1 -- 172.21.15.125:0/412601010 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672706768 0 0) 0x7fac7009e9d0 con 0x7fac700a0a70 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6ed9d700 1 --2- 172.21.15.125:0/412601010 >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6dd9b700 1 --2- 172.21.15.125:0/412601010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 0x7fac70138cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fac64009840 tx=0x7fac64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf605b4640bc248 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6d59a700 1 -- 172.21.15.125:0/412601010 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64011830 con 0x7fac700a1550 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6d59a700 1 -- 172.21.15.125:0/412601010 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64011990 con 0x7fac700a1550 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.447+0000 7fac6d59a700 1 -- 172.21.15.125:0/412601010 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64011d20 con 0x7fac700a1550 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 -- 172.21.15.125:0/412601010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 msgr2=0x7fac70138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 --2- 172.21.15.125:0/412601010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 0x7fac70138cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fac64009840 tx=0x7fac64009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 -- 172.21.15.125:0/412601010 shutdown_connections 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 --2- 172.21.15.125:0/412601010 >> v2:172.21.15.125:3300/0 conn(0x7fac70139200 0x7fac7013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 --2- 172.21.15.125:0/412601010 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a1550 0x7fac70138cc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 -- 172.21.15.125:0/412601010 >> 172.21.15.125:0/412601010 conn(0x7fac700a6610 msgr2=0x7fac700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 -- 172.21.15.125:0/412601010 shutdown_connections 2023-10-03T10:17:41.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.448+0000 7fac74e11700 1 -- 172.21.15.125:0/412601010 wait complete. 2023-10-03T10:17:41.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.449+0000 7fac74e11700 1 Processor -- start 2023-10-03T10:17:41.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.449+0000 7fac74e11700 1 -- start start 2023-10-03T10:17:41.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac700a1550 0x7fac7011ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac70139200 0x7fac7011f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac70122270 con 0x7fac70139200 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac701345a0 con 0x7fac700a1550 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac70120b20 con 0x7fac700a0a70 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34622/0 (socket says 172.21.15.125:34622) 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 -- 172.21.15.125:0/1117919034 learned_addr learned my addr 172.21.15.125:0/1117919034 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6dd9b700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac700a1550 0x7fac7011ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6ed9d700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac70139200 0x7fac7011f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 -- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac700a1550 msgr2=0x7fac7011ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac700a1550 0x7fac7011ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 -- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac70139200 msgr2=0x7fac7011f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac70139200 0x7fac7011f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 -- 172.21.15.125:0/1117919034 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68009b30 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac6e59c700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fac60001eb0 tx=0x7fac6000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600054e0 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60003680 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac640094a0 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.450+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600039f0 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.451+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac700a03e0 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.451+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac60003b50 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.451+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac6003eab0 con 0x7fac700a0a70 2023-10-03T10:17:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.452+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7004f2a0 con 0x7fac700a0a70 2023-10-03T10:17:41.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.456+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac6001b3b0 con 0x7fac700a0a70 2023-10-03T10:17:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.501+0000 7f4dd3e1f700 1 Processor -- start 2023-10-03T10:17:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 -- start start 2023-10-03T10:17:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc09e870 0x7f4dcc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dcc131d70 0x7f4dcc132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0a0920 con 0x7f4dcc131d70 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc09c970 con 0x7f4dcc09f180 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd3e1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc09bab0 con 0x7f4dcc09e870 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.502+0000 7f4dd13ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dcc131d70 0x7f4dcc132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd13ba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57730/0 (socket says 172.21.15.125:57730) 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd13ba700 1 -- 172.21.15.125:0/3299937293 learned_addr learned my addr 172.21.15.125:0/3299937293 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd1bbb700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc09e870 0x7f4dcc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 -- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc09e870 msgr2=0x7f4dcc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc09e870 0x7f4dcc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 -- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 msgr2=0x7f4dcc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 -- 172.21.15.125:0/3299937293 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc09f9c0 con 0x7f4dcc131d70 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd13ba700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd23bc700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc131d70 0x7f4dcc132210 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009d90 tx=0x7f4dc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab8728b3beeec4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd0bb9700 1 -- 172.21.15.125:0/3299937293 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400e070 con 0x7f4dcc131d70 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd0bb9700 1 -- 172.21.15.125:0/3299937293 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400bb20 con 0x7f4dcc131d70 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.503+0000 7f4dd0bb9700 1 -- 172.21.15.125:0/3299937293 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012430 con 0x7f4dcc131d70 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc131d70 msgr2=0x7f4dcc132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc131d70 0x7f4dcc132210 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009d90 tx=0x7f4dc400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/3299937293 shutdown_connections 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc131d70 0x7f4dcc132210 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc09e870 0x7f4dcc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/3299937293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09f180 0x7f4dcc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/3299937293 >> 172.21.15.125:0/3299937293 conn(0x7f4dcc0a4430 msgr2=0x7f4dcc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/3299937293 shutdown_connections 2023-10-03T10:17:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.504+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/3299937293 wait complete. 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 Processor -- start 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 -- start start 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 0x7f4dcc1c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc131d70 0x7f4dcc1c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc11c2c0 con 0x7f4dcc09f180 2023-10-03T10:17:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc11e8e0 con 0x7f4dcc09e870 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd3e1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc1c1ad0 con 0x7f4dcc131d70 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd13ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd1bbb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 0x7f4dcc1c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd13ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50586/0 (socket says 172.21.15.125:50586) 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd13ba700 1 -- 172.21.15.125:0/4074484402 learned_addr learned my addr 172.21.15.125:0/4074484402 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.505+0000 7f4dd23bc700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc131d70 0x7f4dcc1c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 -- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc131d70 msgr2=0x7f4dcc1c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc131d70 0x7f4dcc1c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 -- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 msgr2=0x7f4dcc1c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 0x7f4dcc1c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 -- 172.21.15.125:0/4074484402 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009550 con 0x7f4dcc09f180 2023-10-03T10:17:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd1bbb700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 0x7f4dcc1c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd13ba700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00ebe0 tx=0x7f4dbc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00c850 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00c9b0 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc4009a70 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00cd60 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.506+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc11dc20 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.507+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dbc013470 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.507+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4dbc03f780 con 0x7f4dcc09f180 2023-10-03T10:17:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.507+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc11e2a0 con 0x7f4dcc09f180 2023-10-03T10:17:41.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.512+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dbc0232f0 con 0x7f4dcc09f180 2023-10-03T10:17:41.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.668+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac70121fb0 con 0x7fac700a0a70 2023-10-03T10:17:41.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.668+0000 7fac5effd700 1 -- 172.21.15.125:0/1117919034 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac60017020 con 0x7fac700a0a70 2023-10-03T10:17:41.669 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 msgr2=0x7fac7011e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fac60001eb0 tx=0x7fac6000c800 comp rx=0 tx=0).stop 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 shutdown_connections 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac70139200 0x7fac7011f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac700a0a70 0x7fac7011e6b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 --2- 172.21.15.125:0/1117919034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac700a1550 0x7fac7011ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 >> 172.21.15.125:0/1117919034 conn(0x7fac700a6610 msgr2=0x7fac700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 shutdown_connections 2023-10-03T10:17:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.671+0000 7fac74e11700 1 -- 172.21.15.125:0/1117919034 wait complete. 2023-10-03T10:17:41.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.703+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4dcc04f2a0 con 0x7f4dcc09f180 2023-10-03T10:17:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.703+0000 7f4dc27fc700 1 -- 172.21.15.125:0/4074484402 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dbc021020 con 0x7f4dcc09f180 2023-10-03T10:17:41.703 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 msgr2=0x7f4dcc1c1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00ebe0 tx=0x7f4dbc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 shutdown_connections 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4dcc131d70 0x7f4dcc1c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dcc09e870 0x7f4dcc1c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 --2- 172.21.15.125:0/4074484402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dcc09f180 0x7f4dcc1c1590 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 >> 172.21.15.125:0/4074484402 conn(0x7f4dcc0a4430 msgr2=0x7f4dcc12fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 shutdown_connections 2023-10-03T10:17:41.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.705+0000 7f4dd3e1f700 1 -- 172.21.15.125:0/4074484402 wait complete. 2023-10-03T10:17:41.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:41.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:41.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:41.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.884+0000 7f218e3b8700 1 Processor -- start 2023-10-03T10:17:41.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.884+0000 7f218e3b8700 1 -- start start 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218e3b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218e3b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 0x7f21881395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218e3b8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218809c970 con 0x7f218809e870 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218e3b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880a0920 con 0x7f21881371c0 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218e3b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f218809f9c0 con 0x7f218809f350 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218c955700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 0x7f21881395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34642/0 (socket says 172.21.15.125:34642) 2023-10-03T10:17:41.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 -- 172.21.15.125:0/424436838 learned_addr learned my addr 172.21.15.125:0/424436838 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 -- 172.21.15.125:0/424436838 >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 msgr2=0x7f21881395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 --2- 172.21.15.125:0/424436838 >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 0x7f21881395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 -- 172.21.15.125:0/424436838 >> v1:172.21.15.125:6789/0 conn(0x7f218809e870 legacy=0x7f218809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 -- 172.21.15.125:0/424436838 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218809bab0 con 0x7f218809f350 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f218c955700 1 --2- 172.21.15.125:0/424436838 >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 0x7f21881395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f2186ffd700 1 -- 172.21.15.125:0/424436838 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014511025 0 0) 0x7f218809c970 con 0x7f218809e870 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f21877fe700 1 --2- 172.21.15.125:0/424436838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098f0 tx=0x7f217c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e06fd1d518b65eec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f2186ffd700 1 -- 172.21.15.125:0/424436838 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c011830 con 0x7f218809f350 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f2186ffd700 1 -- 172.21.15.125:0/424436838 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c011990 con 0x7f218809f350 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.885+0000 7f2186ffd700 1 -- 172.21.15.125:0/424436838 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c011d20 con 0x7f218809f350 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 -- 172.21.15.125:0/424436838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 msgr2=0x7f2188136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 --2- 172.21.15.125:0/424436838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098f0 tx=0x7f217c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 -- 172.21.15.125:0/424436838 shutdown_connections 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 --2- 172.21.15.125:0/424436838 >> v2:172.21.15.125:3300/0 conn(0x7f21881371c0 0x7f21881395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 --2- 172.21.15.125:0/424436838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809f350 0x7f2188136c80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 -- 172.21.15.125:0/424436838 >> 172.21.15.125:0/424436838 conn(0x7f21880a4430 msgr2=0x7f21880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 -- 172.21.15.125:0/424436838 shutdown_connections 2023-10-03T10:17:41.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.886+0000 7f218e3b8700 1 -- 172.21.15.125:0/424436838 wait complete. 2023-10-03T10:17:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.887+0000 7f218e3b8700 1 Processor -- start 2023-10-03T10:17:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.887+0000 7f218e3b8700 1 -- start start 2023-10-03T10:17:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809e870 0x7f2188120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218809dba0 con 0x7f21881371c0 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2188124070 con 0x7f218809f350 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2188123b30 con 0x7f218809e870 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f21877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50612/0 (socket says 172.21.15.125:50612) 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f21877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57740/0 (socket says 172.21.15.125:57740) 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 -- 172.21.15.125:0/466477429 learned_addr learned my addr 172.21.15.125:0/466477429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f2187fff700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809e870 0x7f2188120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 -- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809e870 msgr2=0x7f2188120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809e870 0x7f2188120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 -- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 msgr2=0x7f2188120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 -- 172.21.15.125:0/466477429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009a70 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f21877fe700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218c955700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f218000ef90 tx=0x7f218000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000cc90 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000f040 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800146c0 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.888+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c009550 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.889+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2188072340 con 0x7f21881371c0 2023-10-03T10:17:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.889+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2180014820 con 0x7f21881371c0 2023-10-03T10:17:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.889+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2180040390 con 0x7f21881371c0 2023-10-03T10:17:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.890+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188122cd0 con 0x7f21881371c0 2023-10-03T10:17:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.898+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2188122cd0 con 0x7f21881371c0 2023-10-03T10:17:41.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.929+0000 7fa029a6f700 1 Processor -- start 2023-10-03T10:17:41.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.929+0000 7fa029a6f700 1 -- start start 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa029a6f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa0240a1550 0x7fa024138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa029a6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa029a6f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02409e9d0 con 0x7fa0240a0a70 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa029a6f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02409dc00 con 0x7fa0240a1550 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa029a6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02409dec0 con 0x7fa024139200 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa022ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa0240a1550 0x7fa024138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa0237fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa0240a0a70 0x7fa0240a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42056/0 (socket says 172.21.15.125:42056) 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57746/0 (socket says 172.21.15.125:57746) 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa0237fe700 1 -- 172.21.15.125:0/2637976281 learned_addr learned my addr 172.21.15.125:0/2637976281 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa022ffd700 1 -- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 msgr2=0x7fa02413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa022ffd700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa022ffd700 1 -- 172.21.15.125:0/2637976281 >> v1:172.21.15.125:6789/0 conn(0x7fa0240a0a70 legacy=0x7fa0240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa022ffd700 1 -- 172.21.15.125:0/2637976281 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02409e6a0 con 0x7fa0240a1550 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa0227fc700 1 -- 172.21.15.125:0/2637976281 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542674748 0 0) 0x7fa02409e9d0 con 0x7fa0240a0a70 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.930+0000 7fa023fff700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa022ffd700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a1550 0x7fa024138cc0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa018009840 tx=0x7fa018009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86de7ef05747d742 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa0227fc700 1 -- 172.21.15.125:0/2637976281 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011830 con 0x7fa0240a1550 2023-10-03T10:17:41.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa0227fc700 1 -- 172.21.15.125:0/2637976281 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018011990 con 0x7fa0240a1550 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa0227fc700 1 -- 172.21.15.125:0/2637976281 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011d20 con 0x7fa0240a1550 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 -- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a1550 msgr2=0x7fa024138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a1550 0x7fa024138cc0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa018009840 tx=0x7fa018009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 -- 172.21.15.125:0/2637976281 shutdown_connections 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa02413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2637976281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a1550 0x7fa024138cc0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 -- 172.21.15.125:0/2637976281 >> 172.21.15.125:0/2637976281 conn(0x7fa0240a6610 msgr2=0x7fa0240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 -- 172.21.15.125:0/2637976281 shutdown_connections 2023-10-03T10:17:41.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.931+0000 7fa029a6f700 1 -- 172.21.15.125:0/2637976281 wait complete. 2023-10-03T10:17:41.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.932+0000 7fa029a6f700 1 Processor -- start 2023-10-03T10:17:41.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.932+0000 7fa029a6f700 1 -- start start 2023-10-03T10:17:41.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 0x7fa024120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa024121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024124420 con 0x7fa0240a0a70 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240a5100 con 0x7fa024139200 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa029a6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa024123ac0 con 0x7fa0240a1550 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa0237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa0237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50620/0 (socket says 172.21.15.125:50620) 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa023fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa024121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 0x7fa024120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa0237fe700 1 -- 172.21.15.125:0/2655685364 learned_addr learned my addr 172.21.15.125:0/2655685364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 -- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 msgr2=0x7fa024121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa024121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 -- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 msgr2=0x7fa0241207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 -- 172.21.15.125:0/2655685364 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009a70 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa0237fe700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa023fff700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa024121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.933+0000 7fa022ffd700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 0x7fa024120d30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa018016000 tx=0x7fa018004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0180045d0 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01801f070 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0180038a0 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0180094a0 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024124030 con 0x7fa0240a1550 2023-10-03T10:17:41.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.934+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa018003a00 con 0x7fa0240a1550 2023-10-03T10:17:41.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.935+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa018021070 con 0x7fa0240a1550 2023-10-03T10:17:41.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.935+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02404f2a0 con 0x7fa0240a1550 2023-10-03T10:17:41.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:41.939+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa018015020 con 0x7fa0240a1550 2023-10-03T10:17:42.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.093+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21881241b0 con 0x7f21881371c0 2023-10-03T10:17:42.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.093+0000 7f2184ff9700 1 -- 172.21.15.125:0/466477429 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21881241b0 con 0x7f21881371c0 2023-10-03T10:17:42.094 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 msgr2=0x7f21881212b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f218000ef90 tx=0x7f218000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 shutdown_connections 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21881371c0 0x7f21881212b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f218809e870 0x7f2188120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 --2- 172.21.15.125:0/466477429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f218809f350 0x7f2188120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.095+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 >> 172.21.15.125:0/466477429 conn(0x7f21880a4430 msgr2=0x7f21880a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.096+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 shutdown_connections 2023-10-03T10:17:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.096+0000 7f218e3b8700 1 -- 172.21.15.125:0/466477429 wait complete. 2023-10-03T10:17:42.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:42.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.131+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa024122bf0 con 0x7fa0240a1550 2023-10-03T10:17:42.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.132+0000 7fa00bfff700 1 -- 172.21.15.125:0/2655685364 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa018034070 con 0x7fa0240a1550 2023-10-03T10:17:42.132 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:42.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 msgr2=0x7fa024120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 0x7fa024120d30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa018016000 tx=0x7fa018004750 comp rx=0 tx=0).stop 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 shutdown_connections 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa024139200 0x7fa024121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0240a0a70 0x7fa0241207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 --2- 172.21.15.125:0/2655685364 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa0240a1550 0x7fa024120d30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 >> 172.21.15.125:0/2655685364 conn(0x7fa0240a6610 msgr2=0x7fa0240a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 shutdown_connections 2023-10-03T10:17:42.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.134+0000 7fa029a6f700 1 -- 172.21.15.125:0/2655685364 wait complete. 2023-10-03T10:17:42.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:42.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:42.718 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:42.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 Processor -- start 2023-10-03T10:17:42.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 -- start start 2023-10-03T10:17:42.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feeb009ad40 0x7feeb0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb0133f70 0x7feeb01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00a3b60 con 0x7feeb009ad40 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01348e0 con 0x7feeb00a0a70 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.812+0000 7feeb516a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb009b110 con 0x7feeb0133f70 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feeb009ad40 0x7feeb0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaf59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeae59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb0133f70 0x7feeb01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feeb009ad40 0x7feeb0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50628/0 (socket says 172.21.15.125:50628) 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 -- 172.21.15.125:0/1872600834 learned_addr learned my addr 172.21.15.125:0/1872600834 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaf59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57756/0 (socket says 172.21.15.125:57756) 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 -- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb0133f70 msgr2=0x7feeb01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb0133f70 0x7feeb01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 -- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 msgr2=0x7feeb00a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 -- 172.21.15.125:0/1872600834 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00a2fa0 con 0x7feeb009ad40 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaf59e700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeaed9d700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb009ad40 0x7feeb0133a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feea0009920 tx=0x7feea0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2740e6668ea9b8b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeadd9b700 1 -- 172.21.15.125:0/1872600834 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0011830 con 0x7feeb009ad40 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeadd9b700 1 -- 172.21.15.125:0/1872600834 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0011990 con 0x7feeb009ad40 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.813+0000 7feeadd9b700 1 -- 172.21.15.125:0/1872600834 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0011d20 con 0x7feeb009ad40 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 -- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb009ad40 msgr2=0x7feeb0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb009ad40 0x7feeb0133a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feea0009920 tx=0x7feea0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 -- 172.21.15.125:0/1872600834 shutdown_connections 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb009ad40 0x7feeb0133a30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 --2- 172.21.15.125:0/1872600834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb0133f70 0x7feeb01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 -- 172.21.15.125:0/1872600834 >> 172.21.15.125:0/1872600834 conn(0x7feeb0099c40 msgr2=0x7feeb006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 -- 172.21.15.125:0/1872600834 shutdown_connections 2023-10-03T10:17:42.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.814+0000 7feeb516a700 1 -- 172.21.15.125:0/1872600834 wait complete. 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 Processor -- start 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 -- start start 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 0x7feeb0121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0123f00 con 0x7feeb0133f70 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0124cd0 con 0x7feeb00a0a70 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.815+0000 7feeb516a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01327c0 con 0x7feeb009ad40 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeae59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57762/0 (socket says 172.21.15.125:57762) 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 0x7feeb0121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34676/0 (socket says 172.21.15.125:34676) 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeae59c700 1 -- 172.21.15.125:0/4211655047 learned_addr learned my addr 172.21.15.125:0/4211655047 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 -- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 msgr2=0x7feeb0121470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 -- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 msgr2=0x7feeb01219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 -- 172.21.15.125:0/4211655047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009a70 con 0x7feeb0133f70 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeae59c700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaed9d700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeaf59e700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 0x7feeb0121ef0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feea800eed0 tx=0x7feea800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8010040 con 0x7feeb0133f70 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800ba80 con 0x7feeb0133f70 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800be30 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0009550 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.816+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb0124970 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.817+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feea801d410 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.817+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feea803f750 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.817+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb011e060 con 0x7feeb0133f70 2023-10-03T10:17:42.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.822+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feea8007920 con 0x7feeb0133f70 2023-10-03T10:17:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.853+0000 7fd8ef37b700 1 Processor -- start 2023-10-03T10:17:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 -- start start 2023-10-03T10:17:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8e80a0a70 0x7fd8e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e809dc00 con 0x7fd8e8133f50 2023-10-03T10:17:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e809ea60 con 0x7fd8e80a0a70 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ef37b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e809dec0 con 0x7fd8e80a1380 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ec916700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed117700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8e80a0a70 0x7fd8e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed918700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd8e8133f50 0x7fd8e813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42066/0 (socket says 172.21.15.125:42066) 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed918700 1 -- 172.21.15.125:0/2375562197 learned_addr learned my addr 172.21.15.125:0/2375562197 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8dffff700 1 -- 172.21.15.125:0/2375562197 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400634825 0 0) 0x7fd8e809dc00 con 0x7fd8e8133f50 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed117700 1 -- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 msgr2=0x7fd8e8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed117700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed117700 1 -- 172.21.15.125:0/2375562197 >> v1:172.21.15.125:6789/0 conn(0x7fd8e8133f50 legacy=0x7fd8e813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ed117700 1 -- 172.21.15.125:0/2375562197 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e809e6a0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.854+0000 7fd8ec916700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ed117700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e80a0e40 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009840 tx=0x7fd8e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f7310319895b08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8dffff700 1 -- 172.21.15.125:0/2375562197 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011830 con 0x7fd8e80a0a70 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8dffff700 1 -- 172.21.15.125:0/2375562197 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4011990 con 0x7fd8e80a0a70 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8dffff700 1 -- 172.21.15.125:0/2375562197 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011d20 con 0x7fd8e80a0a70 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 -- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 msgr2=0x7fd8e80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e80a0e40 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009840 tx=0x7fd8e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 -- 172.21.15.125:0/2375562197 shutdown_connections 2023-10-03T10:17:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e80a0e40 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/2375562197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 -- 172.21.15.125:0/2375562197 >> 172.21.15.125:0/2375562197 conn(0x7fd8e80a6610 msgr2=0x7fd8e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 -- 172.21.15.125:0/2375562197 shutdown_connections 2023-10-03T10:17:42.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.855+0000 7fd8ef37b700 1 -- 172.21.15.125:0/2375562197 wait complete. 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.856+0000 7fd8ef37b700 1 Processor -- start 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.856+0000 7fd8ef37b700 1 -- start start 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8e8133f50 0x7fd8e81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8133ad0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8125de0 con 0x7fd8e80a1380 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8124510 con 0x7fd8e8133f50 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ec916700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ec916700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57784/0 (socket says 172.21.15.125:57784) 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ec916700 1 -- 172.21.15.125:0/3752331155 learned_addr learned my addr 172.21.15.125:0/3752331155 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed918700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8e8133f50 0x7fd8e81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 -- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8e8133f50 msgr2=0x7fd8e81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8e8133f50 0x7fd8e81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 -- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 msgr2=0x7fd8e8122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 -- 172.21.15.125:0/3752331155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80094a0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ec916700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ed117700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e8122860 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4016000 tx=0x7fd8e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40036a0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e401f070 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4003a20 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.857+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e40094a0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.858+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e8133380 con 0x7fd8e80a0a70 2023-10-03T10:17:42.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.859+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8e4003b80 con 0x7fd8e80a0a70 2023-10-03T10:17:42.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.859+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e804f2a0 con 0x7fd8e80a0a70 2023-10-03T10:17:42.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.859+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8e4021070 con 0x7fd8e80a0a70 2023-10-03T10:17:42.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:42.863+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8e4010380 con 0x7fd8e80a0a70 2023-10-03T10:17:43.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.016+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feeb0124250 con 0x7feeb0133f70 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.016+0000 7fee977fe700 1 -- 172.21.15.125:0/4211655047 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feea8007330 con 0x7feeb0133f70 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 msgr2=0x7feeb0121ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 0x7feeb0121ef0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feea800eed0 tx=0x7feea800b390 comp rx=0 tx=0).stop 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 shutdown_connections 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feeb0133f70 0x7feeb0121ef0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feeb009ad40 0x7feeb0121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 --2- 172.21.15.125:0/4211655047 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feeb00a0a70 0x7feeb01219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 >> 172.21.15.125:0/4211655047 conn(0x7feeb0099c40 msgr2=0x7feeb01332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 shutdown_connections 2023-10-03T10:17:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.018+0000 7feeb516a700 1 -- 172.21.15.125:0/4211655047 wait complete. 2023-10-03T10:17:43.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.055+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8e8072980 con 0x7fd8e80a0a70 2023-10-03T10:17:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.055+0000 7fd8ddffb700 1 -- 172.21.15.125:0/3752331155 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8e402b030 con 0x7fd8e80a0a70 2023-10-03T10:17:43.056 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:43.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 msgr2=0x7fd8e8122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e8122860 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4016000 tx=0x7fd8e4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:43.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 shutdown_connections 2023-10-03T10:17:43.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd8e8133f50 0x7fd8e81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8e80a0a70 0x7fd8e8122860 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 --2- 172.21.15.125:0/3752331155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8e80a1380 0x7fd8e8122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 >> 172.21.15.125:0/3752331155 conn(0x7fd8e80a6610 msgr2=0x7fd8e809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 shutdown_connections 2023-10-03T10:17:43.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.057+0000 7fd8ef37b700 1 -- 172.21.15.125:0/3752331155 wait complete. 2023-10-03T10:17:43.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:43.109 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:43.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:43.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.236+0000 7f758e530700 1 Processor -- start 2023-10-03T10:17:43.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 -- start start 2023-10-03T10:17:43.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f758809e170 0x7f75881307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758809aaa0 con 0x7f7588130ce0 2023-10-03T10:17:43.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758809f870 con 0x7f758809e170 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f758e530700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758809b360 con 0x7f758809d860 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f75877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f758809e170 0x7f75881307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f75877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f758809e170 0x7f75881307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50656/0 (socket says 172.21.15.125:50656) 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f75877fe700 1 -- 172.21.15.125:0/1824883932 learned_addr learned my addr 172.21.15.125:0/1824883932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.237+0000 7f7587fff700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f75877fe700 1 -- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 msgr2=0x7f758809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f75877fe700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f75877fe700 1 -- 172.21.15.125:0/1824883932 >> v1:172.21.15.125:6789/0 conn(0x7f7588130ce0 legacy=0x7f75881379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f75877fe700 1 -- 172.21.15.125:0/1824883932 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758809b620 con 0x7f758809e170 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f7586ffd700 1 -- 172.21.15.125:0/1824883932 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313251305 0 0) 0x7f758809aaa0 con 0x7f7588130ce0 2023-10-03T10:17:43.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f7587fff700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f75877fe700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f75881307a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098f0 tx=0x7f757c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97159219b601f009 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f7586ffd700 1 -- 172.21.15.125:0/1824883932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c011830 con 0x7f758809e170 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f7586ffd700 1 -- 172.21.15.125:0/1824883932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c011990 con 0x7f758809e170 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.238+0000 7f7586ffd700 1 -- 172.21.15.125:0/1824883932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c011d20 con 0x7f758809e170 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 -- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 msgr2=0x7f75881307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f75881307a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098f0 tx=0x7f757c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 -- 172.21.15.125:0/1824883932 shutdown_connections 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 --2- 172.21.15.125:0/1824883932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f75881307a0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 -- 172.21.15.125:0/1824883932 >> 172.21.15.125:0/1824883932 conn(0x7f7588099c40 msgr2=0x7f75880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 -- 172.21.15.125:0/1824883932 shutdown_connections 2023-10-03T10:17:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.239+0000 7f758e530700 1 -- 172.21.15.125:0/1824883932 wait complete. 2023-10-03T10:17:43.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 Processor -- start 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 -- start start 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758811f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7588130ce0 0x7f758811ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881210d0 con 0x7f758809e170 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758809c8b0 con 0x7f758809d860 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758e530700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7588120920 con 0x7f7588130ce0 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f75877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f75877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50666/0 (socket says 172.21.15.125:50666) 2023-10-03T10:17:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f75877fe700 1 -- 172.21.15.125:0/205601306 learned_addr learned my addr 172.21.15.125:0/205601306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.240+0000 7f758cacd700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7588130ce0 0x7f758811ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f7587fff700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758811f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 -- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7588130ce0 msgr2=0x7f758811ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7588130ce0 0x7f758811ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 -- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 msgr2=0x7f758811f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758811f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 -- 172.21.15.125:0/205601306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780094a0 con 0x7f758809e170 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f75877fe700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f757c013000 tx=0x7f757c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c004300 con 0x7f758809e170 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c01f070 con 0x7f758809e170 2023-10-03T10:17:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c009550 con 0x7f758809e170 2023-10-03T10:17:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0036a0 con 0x7f758809e170 2023-10-03T10:17:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.241+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75880a3360 con 0x7f758809e170 2023-10-03T10:17:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.242+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f757c021030 con 0x7f758809e170 2023-10-03T10:17:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.242+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f757c040990 con 0x7f758809e170 2023-10-03T10:17:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.242+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758804f2a0 con 0x7f758809e170 2023-10-03T10:17:43.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.247+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f757c015080 con 0x7f758809e170 2023-10-03T10:17:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.278+0000 7f8560713700 1 Processor -- start 2023-10-03T10:17:43.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.278+0000 7f8560713700 1 -- start start 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f855809f180 0x7f8558133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580a0370 con 0x7f855809f180 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855809fa00 con 0x7f8558134160 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f8560713700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f855809ada0 con 0x7f855809e870 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855e4af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855ecb0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f855809f180 0x7f8558133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855e4af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34722/0 (socket says 172.21.15.125:34722) 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855ecb0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57820/0 (socket says 172.21.15.125:57820) 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855e4af700 1 -- 172.21.15.125:0/1272776734 learned_addr learned my addr 172.21.15.125:0/1272776734 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 -- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 msgr2=0x7f855809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 -- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 msgr2=0x7f8558134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 -- 172.21.15.125:0/1272776734 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855806bec0 con 0x7f855809f180 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855ecb0700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855e4af700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855dcae700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f855809f180 0x7f8558133c20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8548009870 tx=0x7f8548009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ba8292ecd9e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855d4ad700 1 -- 172.21.15.125:0/1272776734 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548011830 con 0x7f855809f180 2023-10-03T10:17:43.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855d4ad700 1 -- 172.21.15.125:0/1272776734 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548011990 con 0x7f855809f180 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.279+0000 7f855d4ad700 1 -- 172.21.15.125:0/1272776734 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548011d20 con 0x7f855809f180 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 -- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f855809f180 msgr2=0x7f8558133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f855809f180 0x7f8558133c20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8548009870 tx=0x7f8548009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 -- 172.21.15.125:0/1272776734 shutdown_connections 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8558134160 0x7f8558134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f855809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 --2- 172.21.15.125:0/1272776734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f855809f180 0x7f8558133c20 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 -- 172.21.15.125:0/1272776734 >> 172.21.15.125:0/1272776734 conn(0x7f85580a4430 msgr2=0x7f85580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 -- 172.21.15.125:0/1272776734 shutdown_connections 2023-10-03T10:17:43.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.280+0000 7f8560713700 1 -- 172.21.15.125:0/1272776734 wait complete. 2023-10-03T10:17:43.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.281+0000 7f8560713700 1 Processor -- start 2023-10-03T10:17:43.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.281+0000 7f8560713700 1 -- start start 2023-10-03T10:17:43.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f8558122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 0x7f8558122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558125340 con 0x7f8558134160 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8558124f80 con 0x7f855809f180 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85580a1690 con 0x7f855809e870 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855ecb0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 0x7f8558122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855ecb0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50694/0 (socket says 172.21.15.125:50694) 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855ecb0700 1 -- 172.21.15.125:0/759227635 learned_addr learned my addr 172.21.15.125:0/759227635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855e4af700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f8558122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 -- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 msgr2=0x7f8558122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f8558122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 -- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 msgr2=0x7f8558122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 -- 172.21.15.125:0/759227635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009550 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855ecb0700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f855dcae700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 0x7f8558122ab0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8548016000 tx=0x7f8548004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548004450 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854801f070 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480038e0 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8550009a70 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.282+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85480094a0 con 0x7f855809f180 2023-10-03T10:17:43.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.283+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8548003a40 con 0x7f855809f180 2023-10-03T10:17:43.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.283+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855804f2a0 con 0x7f855809f180 2023-10-03T10:17:43.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.283+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8548021070 con 0x7f855809f180 2023-10-03T10:17:43.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.288+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f854802b020 con 0x7f855809f180 2023-10-03T10:17:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.437+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f758806c3b0 con 0x7f758809e170 2023-10-03T10:17:43.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.437+0000 7f7584ff9700 1 -- 172.21.15.125:0/205601306 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f757c0199a0 con 0x7f758809e170 2023-10-03T10:17:43.438 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.439+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 msgr2=0x7f758811fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.439+0000 7f758e530700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f757c013000 tx=0x7f757c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 shutdown_connections 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7588130ce0 0x7f758811ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758809d860 0x7f758811f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 --2- 172.21.15.125:0/205601306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f758809e170 0x7f758811fa00 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 >> 172.21.15.125:0/205601306 conn(0x7f7588099c40 msgr2=0x7f7588119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 shutdown_connections 2023-10-03T10:17:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.440+0000 7f758e530700 1 -- 172.21.15.125:0/205601306 wait complete. 2023-10-03T10:17:43.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:43.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.475+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8558072d60 con 0x7f855809f180 2023-10-03T10:17:43.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.475+0000 7f854effd700 1 -- 172.21.15.125:0/759227635 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8548015070 con 0x7f855809f180 2023-10-03T10:17:43.476 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.477+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 msgr2=0x7f8558122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.477+0000 7f8560713700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 0x7f8558122ab0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8548016000 tx=0x7f8548004750 comp rx=0 tx=0).stop 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 shutdown_connections 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8558134160 0x7f8558122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f855809e870 0x7f8558122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 --2- 172.21.15.125:0/759227635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f855809f180 0x7f8558122ab0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 >> 172.21.15.125:0/759227635 conn(0x7f85580a4430 msgr2=0x7f85580724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 shutdown_connections 2023-10-03T10:17:43.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:43.478+0000 7f8560713700 1 -- 172.21.15.125:0/759227635 wait complete. 2023-10-03T10:17:43.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:44.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:44.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:44.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 Processor -- start 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 -- start start 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a409dc00 con 0x7f24a40a1380 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a409ea90 con 0x7f24a4134120 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24aaf98700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a409dec0 con 0x7f24a40a0a70 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24a8d34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24a3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f24a40a1380 0x7f24a4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42084/0 (socket says 172.21.15.125:42084) 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24a3fff700 1 -- 172.21.15.125:0/4077540930 learned_addr learned my addr 172.21.15.125:0/4077540930 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:44.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.169+0000 7f24a9535700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a8d34700 1 -- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 msgr2=0x7f24a413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a8d34700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a8d34700 1 -- 172.21.15.125:0/4077540930 >> v1:172.21.15.125:6789/0 conn(0x7f24a40a1380 legacy=0x7f24a4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a37fe700 1 -- 172.21.15.125:0/4077540930 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506043022 0 0) 0x7f24a409dc00 con 0x7f24a40a1380 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a8d34700 1 -- 172.21.15.125:0/4077540930 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a409e6a0 con 0x7f24a40a0a70 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a9535700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a8d34700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2498009870 tx=0x7f2498009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514a9bdb2d537849 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a37fe700 1 -- 172.21.15.125:0/4077540930 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011830 con 0x7f24a40a0a70 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a37fe700 1 -- 172.21.15.125:0/4077540930 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498011990 con 0x7f24a40a0a70 2023-10-03T10:17:44.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.170+0000 7f24a37fe700 1 -- 172.21.15.125:0/4077540930 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011d20 con 0x7f24a40a0a70 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 -- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 msgr2=0x7f24a40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2498009870 tx=0x7f2498009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 -- 172.21.15.125:0/4077540930 shutdown_connections 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4077540930 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 -- 172.21.15.125:0/4077540930 >> 172.21.15.125:0/4077540930 conn(0x7f24a40a6610 msgr2=0x7f24a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 -- 172.21.15.125:0/4077540930 shutdown_connections 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.171+0000 7f24aaf98700 1 -- 172.21.15.125:0/4077540930 wait complete. 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.172+0000 7f24aaf98700 1 Processor -- start 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.172+0000 7f24aaf98700 1 -- start start 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 0x7f24a4122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4125920 con 0x7f24a40a1380 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4124310 con 0x7f24a4134120 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24aaf98700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41332d0 con 0x7f24a40a0a70 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a9535700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 0x7f24a4122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34746/0 (socket says 172.21.15.125:34746) 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a9535700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57844/0 (socket says 172.21.15.125:57844) 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 -- 172.21.15.125:0/4003826245 learned_addr learned my addr 172.21.15.125:0/4003826245 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:44.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 -- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 msgr2=0x7f24a4123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 -- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 msgr2=0x7f24a4122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 0x7f24a4122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a8d34700 1 -- 172.21.15.125:0/4003826245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c009a70 con 0x7f24a40a0a70 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a9535700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.173+0000 7f24a3fff700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 0x7f24a4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24a8d34700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24980090b0 tx=0x7f2498004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980044d0 con 0x7f24a40a0a70 2023-10-03T10:17:44.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249801f070 con 0x7f24a40a0a70 2023-10-03T10:17:44.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980038e0 con 0x7f24a40a0a70 2023-10-03T10:17:44.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24980094a0 con 0x7f24a40a0a70 2023-10-03T10:17:44.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.174+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40a03e0 con 0x7f24a40a0a70 2023-10-03T10:17:44.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.175+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a404f2a0 con 0x7f24a40a0a70 2023-10-03T10:17:44.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.175+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2498003a40 con 0x7f24a40a0a70 2023-10-03T10:17:44.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.175+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2498021070 con 0x7f24a40a0a70 2023-10-03T10:17:44.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.179+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24980253e0 con 0x7f24a40a0a70 2023-10-03T10:17:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.206+0000 7f8e031f1700 1 Processor -- start 2023-10-03T10:17:44.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.206+0000 7f8e031f1700 1 -- start start 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e031f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e031f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e031f1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc09dc00 con 0x7f8dfc133f50 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e031f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc09ea60 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e031f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc09dec0 con 0x7f8dfc0a1380 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e0178e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8dfc133f50 0x7f8dfc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42086/0 (socket says 172.21.15.125:42086) 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e0178e700 1 -- 172.21.15.125:0/2571826914 learned_addr learned my addr 172.21.15.125:0/2571826914 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 -- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 msgr2=0x7f8dfc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 -- 172.21.15.125:0/2571826914 >> v1:172.21.15.125:6789/0 conn(0x7f8dfc133f50 legacy=0x7f8dfc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfb7fe700 1 -- 172.21.15.125:0/2571826914 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950265954 0 0) 0x7f8dfc09dc00 con 0x7f8dfc133f50 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 -- 172.21.15.125:0/2571826914 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc09e6a0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfbfff700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc0a0e40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009870 tx=0x7f8df0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b15b87091ace70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfb7fe700 1 -- 172.21.15.125:0/2571826914 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011830 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfb7fe700 1 -- 172.21.15.125:0/2571826914 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0011990 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.207+0000 7f8dfb7fe700 1 -- 172.21.15.125:0/2571826914 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011d20 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 -- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 msgr2=0x7f8dfc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc0a0e40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009870 tx=0x7f8df0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 -- 172.21.15.125:0/2571826914 shutdown_connections 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc0a0e40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 --2- 172.21.15.125:0/2571826914 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 -- 172.21.15.125:0/2571826914 >> 172.21.15.125:0/2571826914 conn(0x7f8dfc0a6610 msgr2=0x7f8dfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 -- 172.21.15.125:0/2571826914 shutdown_connections 2023-10-03T10:17:44.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.208+0000 7f8e031f1700 1 -- 172.21.15.125:0/2571826914 wait complete. 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.209+0000 7f8e031f1700 1 Processor -- start 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.209+0000 7f8e031f1700 1 -- start start 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.209+0000 7f8e031f1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.209+0000 7f8e031f1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.209+0000 7f8e031f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e031f1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc126170 con 0x7f8dfc133f50 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e031f1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc126350 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e031f1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc125db0 con 0x7f8dfc0a1380 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e0178e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57870/0 (socket says 172.21.15.125:57870) 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 -- 172.21.15.125:0/3015826191 learned_addr learned my addr 172.21.15.125:0/3015826191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e0178e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50712/0 (socket says 172.21.15.125:50712) 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8dfbfff700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 -- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 msgr2=0x7f8dfc122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 -- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 msgr2=0x7f8dfc123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 -- 172.21.15.125:0/3015826191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80094a0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8dfbfff700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e0178e700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e00f8d700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8df00090b0 tx=0x7f8df0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0004510 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df001f070 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df00094a0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00038c0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.210+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc133350 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.211+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8df0003a20 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.211+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc04f2a0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.211+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8df0021070 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.216+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8df002b020 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.376+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24a4072980 con 0x7f24a40a0a70 2023-10-03T10:17:44.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.376+0000 7f24a17fa700 1 -- 172.21.15.125:0/4003826245 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2498034090 con 0x7f24a40a0a70 2023-10-03T10:17:44.377 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:44.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 msgr2=0x7f24a4122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24980090b0 tx=0x7f2498004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 shutdown_connections 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24a4134120 0x7f24a4123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24a40a0a70 0x7f24a4122700 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 --2- 172.21.15.125:0/4003826245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a40a1380 0x7f24a4122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 >> 172.21.15.125:0/4003826245 conn(0x7f24a40a6610 msgr2=0x7f24a409aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 shutdown_connections 2023-10-03T10:17:44.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.379+0000 7f24aaf98700 1 -- 172.21.15.125:0/4003826245 wait complete. 2023-10-03T10:17:44.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:44.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.408+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8dfc1339c0 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.408+0000 7f8df97fa700 1 -- 172.21.15.125:0/3015826191 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8df0015070 con 0x7f8dfc0a0a70 2023-10-03T10:17:44.409 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 msgr2=0x7f8dfc1228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8df00090b0 tx=0x7f8df0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 shutdown_connections 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc133f50 0x7f8dfc123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dfc0a0a70 0x7f8dfc1228d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 --2- 172.21.15.125:0/3015826191 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8dfc0a1380 0x7f8dfc122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 >> 172.21.15.125:0/3015826191 conn(0x7f8dfc0a6610 msgr2=0x7f8dfc0a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 shutdown_connections 2023-10-03T10:17:44.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.410+0000 7f8e031f1700 1 -- 172.21.15.125:0/3015826191 wait complete. 2023-10-03T10:17:44.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:44.453 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:44.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:44.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.588+0000 7f57609ae700 1 Processor -- start 2023-10-03T10:17:44.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.588+0000 7f57609ae700 1 -- start start 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f57609ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f57609ae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f57609ae700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c09e9d0 con 0x7f575c0a0a70 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f57609ae700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c09dc00 con 0x7f575c139200 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f57609ae700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f575c09dec0 con 0x7f575c0a1550 2023-10-03T10:17:44.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34754/0 (socket says 172.21.15.125:34754) 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:57878/0 (socket says 172.21.15.125:57878) 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 -- 172.21.15.125:0/2152518326 learned_addr learned my addr 172.21.15.125:0/2152518326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575959a700 1 -- 172.21.15.125:0/2152518326 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047695055 0 0) 0x7f575c09e9d0 con 0x7f575c0a0a70 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575959a700 1 -- 172.21.15.125:0/2152518326 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57440035b0 con 0x7f575c0a0a70 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 -- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 msgr2=0x7f575c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 -- 172.21.15.125:0/2152518326 >> v1:172.21.15.125:6789/0 conn(0x7f575c0a0a70 legacy=0x7f575c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 -- 172.21.15.125:0/2152518326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c09e6a0 con 0x7f575c0a1550 2023-10-03T10:17:44.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575ad9d700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f5759d9b700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5750009920 tx=0x7f5750009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57895c669834a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.589+0000 7f575959a700 1 -- 172.21.15.125:0/2152518326 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750004230 con 0x7f575c0a1550 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f575959a700 1 -- 172.21.15.125:0/2152518326 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750004390 con 0x7f575c0a1550 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f575959a700 1 -- 172.21.15.125:0/2152518326 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500036a0 con 0x7f575c0a1550 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 -- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 msgr2=0x7f575c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5750009920 tx=0x7f5750009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 -- 172.21.15.125:0/2152518326 shutdown_connections 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 --2- 172.21.15.125:0/2152518326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c138cc0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 -- 172.21.15.125:0/2152518326 >> 172.21.15.125:0/2152518326 conn(0x7f575c0a6610 msgr2=0x7f575c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 -- 172.21.15.125:0/2152518326 shutdown_connections 2023-10-03T10:17:44.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.590+0000 7f57609ae700 1 -- 172.21.15.125:0/2152518326 wait complete. 2023-10-03T10:17:44.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.591+0000 7f57609ae700 1 Processor -- start 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.591+0000 7f57609ae700 1 -- start start 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 0x7f575c11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c11f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c121f00 con 0x7f575c0a0a70 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0a03e0 con 0x7f575c139200 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f57609ae700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f575c1220e0 con 0x7f575c0a1550 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c11f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34768/0 (socket says 172.21.15.125:34768) 2023-10-03T10:17:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 -- 172.21.15.125:0/3633306865 learned_addr learned my addr 172.21.15.125:0/3633306865 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f575a59c700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 0x7f575c11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 -- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 msgr2=0x7f575c11f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c11f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 -- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 msgr2=0x7f575c11e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 0x7f575c11e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 -- 172.21.15.125:0/3633306865 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009a70 con 0x7f575c0a1550 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f575ad9d700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f575a59c700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 0x7f575c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f5759d9b700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f575c09e050 tx=0x7f5750004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750003c30 con 0x7f575c0a1550 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.592+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750003db0 con 0x7f575c0a1550 2023-10-03T10:17:44.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.593+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750011870 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.593+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5750009550 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.593+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c120c70 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.593+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5750021070 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.593+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5750040c00 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.594+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c121d60 con 0x7f575c0a1550 2023-10-03T10:17:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.598+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f575c121d60 con 0x7f575c0a1550 2023-10-03T10:17:44.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.632+0000 7f4ad119f700 1 Processor -- start 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.632+0000 7f4ad119f700 1 -- start start 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ad119f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 0x7f4acc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ad119f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4acc130a60 0x7f4acc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ad119f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc099a60 con 0x7f4acc09a730 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ad119f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc09bf50 con 0x7f4acc130a60 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ad119f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc09b230 con 0x7f4acc099e20 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4acc130a60 0x7f4acc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 0x7f4acc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4aca59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4acc09a730 0x7f4acc130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42114/0 (socket says 172.21.15.125:42114) 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4aca59c700 1 -- 172.21.15.125:0/388346744 learned_addr learned my addr 172.21.15.125:0/388346744 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:44.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 -- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 msgr2=0x7f4acc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 0x7f4acc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 -- 172.21.15.125:0/388346744 >> v1:172.21.15.125:6789/0 conn(0x7f4acc09a730 legacy=0x7f4acc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 -- 172.21.15.125:0/388346744 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc09bb90 con 0x7f4acc130a60 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acad9d700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 0x7f4acc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4acb59e700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc130a60 0x7f4acc138690 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987b5941326fdaf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ac9d9b700 1 -- 172.21.15.125:0/388346744 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400e070 con 0x7f4acc130a60 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ac9d9b700 1 -- 172.21.15.125:0/388346744 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400bb20 con 0x7f4acc130a60 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.633+0000 7f4ac9d9b700 1 -- 172.21.15.125:0/388346744 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4012430 con 0x7f4acc130a60 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 -- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc130a60 msgr2=0x7f4acc138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc130a60 0x7f4acc138690 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 -- 172.21.15.125:0/388346744 shutdown_connections 2023-10-03T10:17:44.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc130a60 0x7f4acc138690 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 --2- 172.21.15.125:0/388346744 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc099e20 0x7f4acc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 -- 172.21.15.125:0/388346744 >> 172.21.15.125:0/388346744 conn(0x7f4acc0a2980 msgr2=0x7f4acc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 -- 172.21.15.125:0/388346744 shutdown_connections 2023-10-03T10:17:44.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.634+0000 7f4ad119f700 1 -- 172.21.15.125:0/388346744 wait complete. 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.635+0000 7f4ad119f700 1 Processor -- start 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.635+0000 7f4ad119f700 1 -- start start 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc09a730 0x7f4acc09d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 0x7f4acc09dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc1201d0 con 0x7f4acc099e20 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc09b470 con 0x7f4acc130a60 2023-10-03T10:17:44.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc11ecb0 con 0x7f4acc09a730 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4aca59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc09a730 0x7f4acc09d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50732/0 (socket says 172.21.15.125:50732) 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 -- 172.21.15.125:0/96717461 learned_addr learned my addr 172.21.15.125:0/96717461 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acb59e700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 0x7f4acc09dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 -- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc09a730 msgr2=0x7f4acc09d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc09a730 0x7f4acc09d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 -- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 msgr2=0x7f4acc09dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 0x7f4acc09dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 -- 172.21.15.125:0/96717461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009430 con 0x7f4acc099e20 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acb59e700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 0x7f4acc09dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4acad9d700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebe0 tx=0x7f4abc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc005a20 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc005b80 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4009a70 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00c850 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.636+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc11ff10 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.637+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4abc00c9b0 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.637+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4abc03f930 con 0x7f4acc099e20 2023-10-03T10:17:44.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.637+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc120d00 con 0x7f4acc099e20 2023-10-03T10:17:44.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.642+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4abc022300 con 0x7f4acc099e20 2023-10-03T10:17:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.791+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f575c121d60 con 0x7f575c0a1550 2023-10-03T10:17:44.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.791+0000 7f574affd700 1 -- 172.21.15.125:0/3633306865 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f575c121d60 con 0x7f575c0a1550 2023-10-03T10:17:44.792 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:44.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 msgr2=0x7f575c11eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f575c09e050 tx=0x7f5750004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 shutdown_connections 2023-10-03T10:17:44.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f575c139200 0x7f575c11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f575c0a0a70 0x7f575c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 --2- 172.21.15.125:0/3633306865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f575c0a1550 0x7f575c11eec0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 >> 172.21.15.125:0/3633306865 conn(0x7f575c0a6610 msgr2=0x7f575c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.793+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 shutdown_connections 2023-10-03T10:17:44.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.794+0000 7f57609ae700 1 -- 172.21.15.125:0/3633306865 wait complete. 2023-10-03T10:17:44.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.838+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4acc120410 con 0x7f4acc099e20 2023-10-03T10:17:44.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.838+0000 7f4ab37fe700 1 -- 172.21.15.125:0/96717461 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4abc02a090 con 0x7f4acc099e20 2023-10-03T10:17:44.839 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 msgr2=0x7f4acc09d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebe0 tx=0x7f4abc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 shutdown_connections 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc130a60 0x7f4acc09dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc099e20 0x7f4acc09d1f0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 --2- 172.21.15.125:0/96717461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4acc09a730 0x7f4acc09d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 >> 172.21.15.125:0/96717461 conn(0x7f4acc0a2980 msgr2=0x7f4acc0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 shutdown_connections 2023-10-03T10:17:44.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:44.840+0000 7f4ad119f700 1 -- 172.21.15.125:0/96717461 wait complete. 2023-10-03T10:17:44.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:45.392 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:45.424 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:45.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.521+0000 7fbb0d85f700 1 Processor -- start 2023-10-03T10:17:45.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.521+0000 7fbb0d85f700 1 -- start start 2023-10-03T10:17:45.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 0x7fbb08133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 0x7fbb080a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080a3b60 con 0x7fbb0809ad40 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb081348e0 con 0x7fbb080a0a70 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb0d85f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0809b110 con 0x7fbb08133f70 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51554/0 (socket says 172.21.15.125:51554) 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb067fc700 1 -- 172.21.15.125:0/2151347524 learned_addr learned my addr 172.21.15.125:0/2151347524 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 0x7fbb080a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb06ffd700 1 --2- 172.21.15.125:0/2151347524 >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 0x7fbb08133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 -- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 msgr2=0x7fbb081343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 -- 172.21.15.125:0/2151347524 >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 msgr2=0x7fbb08133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 --2- 172.21.15.125:0/2151347524 >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 0x7fbb08133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 -- 172.21.15.125:0/2151347524 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080a2fa0 con 0x7fbb080a0a70 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb067fc700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb06ffd700 1 --2- 172.21.15.125:0/2151347524 >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 0x7fbb08133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb077fe700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 0x7fbb080a0f10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009d90 tx=0x7fbb0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a84ef21b0cce947 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.522+0000 7fbb05ffb700 1 -- 172.21.15.125:0/2151347524 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x7fbb080a0a70 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb05ffb700 1 -- 172.21.15.125:0/2151347524 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000bb20 con 0x7fbb080a0a70 2023-10-03T10:17:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb05ffb700 1 -- 172.21.15.125:0/2151347524 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00012430 con 0x7fbb080a0a70 2023-10-03T10:17:45.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 -- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 msgr2=0x7fbb080a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 0x7fbb080a0f10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009d90 tx=0x7fbb0000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 -- 172.21.15.125:0/2151347524 shutdown_connections 2023-10-03T10:17:45.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb080a0a70 0x7fbb080a0f10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/2151347524 >> v2:172.21.15.125:3300/0 conn(0x7fbb0809ad40 0x7fbb08133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/2151347524 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb08133f70 0x7fbb081343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 -- 172.21.15.125:0/2151347524 >> 172.21.15.125:0/2151347524 conn(0x7fbb08099c40 msgr2=0x7fbb0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 -- 172.21.15.125:0/2151347524 shutdown_connections 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.523+0000 7fbb0d85f700 1 -- 172.21.15.125:0/2151347524 wait complete. 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.524+0000 7fbb0d85f700 1 Processor -- start 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.524+0000 7fbb0d85f700 1 -- start start 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 0x7fbb081c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08121570 con 0x7fbb0809ad40 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0811f8b0 con 0x7fbb08133f70 2023-10-03T10:17:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb0d85f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0809be30 con 0x7fbb080a0a70 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51566/0 (socket says 172.21.15.125:51566) 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55038/0 (socket says 172.21.15.125:55038) 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 -- 172.21.15.125:0/1008144271 learned_addr learned my addr 172.21.15.125:0/1008144271 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb077fe700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 0x7fbb081c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 -- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 msgr2=0x7fbb081c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 0x7fbb081c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 -- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 msgr2=0x7fbb081c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 -- 172.21.15.125:0/1008144271 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80094a0 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb06ffd700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb077fe700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 0x7fbb081c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbb067fc700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00ebe0 tx=0x7fbafc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.525+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00c850 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc00c9b0 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc009550 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00cd40 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb00009a70 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbafc013470 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.526+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0804f2a0 con 0x7fbb080a0a70 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.527+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbafc03f8a0 con 0x7fbb080a0a70 2023-10-03T10:17:45.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.531+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbafc0232f0 con 0x7fbb080a0a70 2023-10-03T10:17:45.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.561+0000 7fbe2bed1700 1 Processor -- start 2023-10-03T10:17:45.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 -- start start 2023-10-03T10:17:45.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe240a0920 con 0x7fbe2409f180 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2409c970 con 0x7fbe24131d70 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2bed1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2409bab0 con 0x7fbe2409e870 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2a46e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2946c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51580/0 (socket says 172.21.15.125:51580) 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2a46e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53892/0 (socket says 172.21.15.125:53892) 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2946c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55054/0 (socket says 172.21.15.125:55054) 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2a46e700 1 -- 172.21.15.125:0/4162995058 learned_addr learned my addr 172.21.15.125:0/4162995058 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 -- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 msgr2=0x7fbe24132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 -- 172.21.15.125:0/4162995058 >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 msgr2=0x7fbe24131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 --2- 172.21.15.125:0/4162995058 >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe29c6d700 1 -- 172.21.15.125:0/4162995058 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2409f9c0 con 0x7fbe2409e870 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2946c700 1 --2- 172.21.15.125:0/4162995058 >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.562+0000 7fbe2a46e700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe29c6d700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009840 tx=0x7fbe20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f255bec56d6c004d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe28c6b700 1 -- 172.21.15.125:0/4162995058 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20011830 con 0x7fbe2409e870 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe28c6b700 1 -- 172.21.15.125:0/4162995058 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20011990 con 0x7fbe2409e870 2023-10-03T10:17:45.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe28c6b700 1 -- 172.21.15.125:0/4162995058 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20011d20 con 0x7fbe2409e870 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 -- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 msgr2=0x7fbe2409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009840 tx=0x7fbe20009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 -- 172.21.15.125:0/4162995058 shutdown_connections 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe24131d70 0x7fbe24132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/4162995058 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409e870 0x7fbe2409ec40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/4162995058 >> v2:172.21.15.125:3300/0 conn(0x7fbe2409f180 0x7fbe24131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.563+0000 7fbe2bed1700 1 -- 172.21.15.125:0/4162995058 >> 172.21.15.125:0/4162995058 conn(0x7fbe240a4430 msgr2=0x7fbe240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.564+0000 7fbe2bed1700 1 -- 172.21.15.125:0/4162995058 shutdown_connections 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.564+0000 7fbe2bed1700 1 -- 172.21.15.125:0/4162995058 wait complete. 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.564+0000 7fbe2bed1700 1 Processor -- start 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.564+0000 7fbe2bed1700 1 -- start start 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 0x7fbe241b9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409f180 0x7fbe241b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241bb100 con 0x7fbe24131d70 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241ba820 con 0x7fbe2409e870 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2bed1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241baf10 con 0x7fbe2409f180 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe29c6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 0x7fbe241b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55058/0 (socket says 172.21.15.125:55058) 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 -- 172.21.15.125:0/3929046976 learned_addr learned my addr 172.21.15.125:0/3929046976 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2946c700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409f180 0x7fbe241b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 -- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409f180 msgr2=0x7fbe241b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409f180 0x7fbe241b9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 -- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 msgr2=0x7fbe241b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 0x7fbe241b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 -- 172.21.15.125:0/3929046976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140094a0 con 0x7fbe24131d70 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe29c6d700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 0x7fbe241b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.565+0000 7fbe2a46e700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f10 tx=0x7fbe1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c018070 con 0x7fbe24131d70 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00f040 con 0x7fbe24131d70 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c009b30 con 0x7fbe24131d70 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c003c40 con 0x7fbe24131d70 2023-10-03T10:17:45.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe200094a0 con 0x7fbe24131d70 2023-10-03T10:17:45.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.566+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe1c00c940 con 0x7fbe24131d70 2023-10-03T10:17:45.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.567+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe1c03f7d0 con 0x7fbe24131d70 2023-10-03T10:17:45.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.567+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2411f850 con 0x7fbe24131d70 2023-10-03T10:17:45.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.571+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe2411f850 con 0x7fbe24131d70 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.723+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb081213b0 con 0x7fbb080a0a70 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.724+0000 7fbaeffff700 1 -- 172.21.15.125:0/1008144271 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbafc017030 con 0x7fbb080a0a70 2023-10-03T10:17:45.725 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 msgr2=0x7fbb081c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00ebe0 tx=0x7fbafc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 shutdown_connections 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb08133f70 0x7fbb081c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb0809ad40 0x7fbb081c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 --2- 172.21.15.125:0/1008144271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb080a0a70 0x7fbb081c89c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 >> 172.21.15.125:0/1008144271 conn(0x7fbb08099c40 msgr2=0x7fbb0809e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 shutdown_connections 2023-10-03T10:17:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.726+0000 7fbb0d85f700 1 -- 172.21.15.125:0/1008144271 wait complete. 2023-10-03T10:17:45.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:45.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.762+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe2411f850 con 0x7fbe24131d70 2023-10-03T10:17:45.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.762+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/3929046976 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe2411f850 con 0x7fbe24131d70 2023-10-03T10:17:45.763 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 msgr2=0x7fbe241b9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f10 tx=0x7fbe1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 shutdown_connections 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe24131d70 0x7fbe241b9dd0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe2409e870 0x7fbe241b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 --2- 172.21.15.125:0/3929046976 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbe2409f180 0x7fbe241b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 >> 172.21.15.125:0/3929046976 conn(0x7fbe240a4430 msgr2=0x7fbe241313e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 shutdown_connections 2023-10-03T10:17:45.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.764+0000 7fbe2bed1700 1 -- 172.21.15.125:0/3929046976 wait complete. 2023-10-03T10:17:45.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:45.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:45.854 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:45.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.942+0000 7f7f8a302700 1 Processor -- start 2023-10-03T10:17:45.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.942+0000 7f7f8a302700 1 -- start start 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 0x7f7f84133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f84133f50 0x7f7f841343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8409e9d0 con 0x7f7f84133f50 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409dc00 con 0x7f7f840a1380 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8a302700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409dec0 con 0x7f7f840a0a70 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f84133f50 0x7f7f841343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f83fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f84133f50 0x7f7f841343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55062/0 (socket says 172.21.15.125:55062) 2023-10-03T10:17:45.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 -- 172.21.15.125:0/1799653090 learned_addr learned my addr 172.21.15.125:0/1799653090 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 0x7f7f84133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 -- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 msgr2=0x7f7f840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 -- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 msgr2=0x7f7f84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 0x7f7f84133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 -- 172.21.15.125:0/1799653090 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8409e6a0 con 0x7f7f84133f50 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f83fff700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 0x7f7f84133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.943+0000 7f7f8889f700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f84133f50 0x7f7f841343f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009e50 tx=0x7f7f7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faa1d90344ee5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f82ffd700 1 -- 172.21.15.125:0/1799653090 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00e070 con 0x7f7f84133f50 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f82ffd700 1 -- 172.21.15.125:0/1799653090 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00b910 con 0x7f7f84133f50 2023-10-03T10:17:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f82ffd700 1 -- 172.21.15.125:0/1799653090 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00bcc0 con 0x7f7f84133f50 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 -- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f84133f50 msgr2=0x7f7f841343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f84133f50 0x7f7f841343f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009e50 tx=0x7f7f7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 -- 172.21.15.125:0/1799653090 shutdown_connections 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f84133f50 0x7f7f841343f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1799653090 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a1380 0x7f7f84133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 -- 172.21.15.125:0/1799653090 >> 172.21.15.125:0/1799653090 conn(0x7f7f840a6610 msgr2=0x7f7f840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 -- 172.21.15.125:0/1799653090 shutdown_connections 2023-10-03T10:17:45.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.944+0000 7f7f8a302700 1 -- 172.21.15.125:0/1799653090 wait complete. 2023-10-03T10:17:45.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.945+0000 7f7f8a302700 1 Processor -- start 2023-10-03T10:17:45.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.945+0000 7f7f8a302700 1 -- start start 2023-10-03T10:17:45.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 0x7f7f84122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f84133f50 0x7f7f84122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84126090 con 0x7f7f840a1380 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840a03e0 con 0x7f7f840a0a70 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409d340 con 0x7f7f84133f50 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f83fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f83fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53928/0 (socket says 172.21.15.125:53928) 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f83fff700 1 -- 172.21.15.125:0/1330365851 learned_addr learned my addr 172.21.15.125:0/1330365851 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 0x7f7f84122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8889f700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f84133f50 0x7f7f84122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 -- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f84133f50 msgr2=0x7f7f84122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f84133f50 0x7f7f84122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 -- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 msgr2=0x7f7f84122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 -- 172.21.15.125:0/1330365851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740094a0 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f83fff700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f837fe700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 0x7f7f84122ab0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800e980 tx=0x7f7f7800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800c690 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7800c7f0 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800cb80 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.946+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780094a0 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.947+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c009b30 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.947+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f7800cce0 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.947+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f7803f660 con 0x7f7f840a1380 2023-10-03T10:17:45.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.947+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8411f760 con 0x7f7f840a1380 2023-10-03T10:17:45.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.952+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f7801bb50 con 0x7f7f840a1380 2023-10-03T10:17:45.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.985+0000 7f8a7e6ad700 1 Processor -- start 2023-10-03T10:17:45.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.985+0000 7f8a7e6ad700 1 -- start start 2023-10-03T10:17:45.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7e6ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 0x7f8a78138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7e6ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 0x7f8a7813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7e6ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7809e9d0 con 0x7f8a780a0a70 2023-10-03T10:17:45.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7e6ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7809dc00 con 0x7f8a78139200 2023-10-03T10:17:45.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7e6ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7809dec0 con 0x7f8a780a1550 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7cc4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 0x7f8a7813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 0x7f8a78138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a77fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8a780a0a70 0x7f8a780a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45868/0 (socket says 172.21.15.125:45868) 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a77fff700 1 -- 172.21.15.125:0/1246082465 learned_addr learned my addr 172.21.15.125:0/1246082465 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 -- 172.21.15.125:0/1246082465 >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 msgr2=0x7f8a7813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 --2- 172.21.15.125:0/1246082465 >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 0x7f8a7813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 -- 172.21.15.125:0/1246082465 >> v1:172.21.15.125:6789/0 conn(0x7f8a780a0a70 legacy=0x7f8a780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 -- 172.21.15.125:0/1246082465 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7809e6a0 con 0x7f8a780a1550 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a76ffd700 1 -- 172.21.15.125:0/1246082465 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250899786 0 0) 0x7f8a7809e9d0 con 0x7f8a780a0a70 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a7cc4a700 1 --2- 172.21.15.125:0/1246082465 >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 0x7f8a7813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.986+0000 7f8a777fe700 1 --2- 172.21.15.125:0/1246082465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 0x7f8a78138cc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009840 tx=0x7f8a6c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf28f5d9d7a90400 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a76ffd700 1 -- 172.21.15.125:0/1246082465 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c011830 con 0x7f8a780a1550 2023-10-03T10:17:45.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a76ffd700 1 -- 172.21.15.125:0/1246082465 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c011990 con 0x7f8a780a1550 2023-10-03T10:17:45.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a76ffd700 1 -- 172.21.15.125:0/1246082465 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c011d20 con 0x7f8a780a1550 2023-10-03T10:17:45.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1246082465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 msgr2=0x7f8a78138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1246082465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 0x7f8a78138cc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009840 tx=0x7f8a6c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:45.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1246082465 shutdown_connections 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1246082465 >> v2:172.21.15.125:3300/0 conn(0x7f8a78139200 0x7f8a7813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1246082465 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a780a1550 0x7f8a78138cc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.987+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1246082465 >> 172.21.15.125:0/1246082465 conn(0x7f8a780a6610 msgr2=0x7f8a780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.988+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1246082465 shutdown_connections 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.988+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1246082465 wait complete. 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.988+0000 7f8a7e6ad700 1 Processor -- start 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 -- start start 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 0x7f8a78121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78123680 con 0x7f8a780a0a70 2023-10-03T10:17:45.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78123ca0 con 0x7f8a780a1550 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7e6ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780a03e0 con 0x7f8a78139200 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51620/0 (socket says 172.21.15.125:51620) 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53944/0 (socket says 172.21.15.125:53944) 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 -- 172.21.15.125:0/1867090381 learned_addr learned my addr 172.21.15.125:0/1867090381 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a77fff700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 0x7f8a78121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 -- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 msgr2=0x7f8a78121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 -- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 msgr2=0x7f8a78121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.989+0000 7f8a7cc4a700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 0x7f8a78121a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a7cc4a700 1 -- 172.21.15.125:0/1867090381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70009a70 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a77fff700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 0x7f8a78121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a777fe700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a7cc4a700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009f00 tx=0x7f8a7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70009d70 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000f040 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c0094a0 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000cd70 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.990+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a78124d70 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.991+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a70014480 con 0x7f8a78139200 2023-10-03T10:17:45.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.991+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a7003fcf0 con 0x7f8a78139200 2023-10-03T10:17:45.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.991+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a781257d0 con 0x7f8a78139200 2023-10-03T10:17:45.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:45.996+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a781257d0 con 0x7f8a78139200 2023-10-03T10:17:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.143+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f84125c30 con 0x7f7f840a1380 2023-10-03T10:17:46.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.144+0000 7f7f80ff9700 1 -- 172.21.15.125:0/1330365851 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f78021020 con 0x7f7f840a1380 2023-10-03T10:17:46.144 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 msgr2=0x7f7f84122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 0x7f7f84122ab0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800e980 tx=0x7f7f7800ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 shutdown_connections 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f84133f50 0x7f7f84122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f840a0a70 0x7f7f84122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 --2- 172.21.15.125:0/1330365851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f840a1380 0x7f7f84122ab0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 >> 172.21.15.125:0/1330365851 conn(0x7f7f840a6610 msgr2=0x7f7f8411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 shutdown_connections 2023-10-03T10:17:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.146+0000 7f7f8a302700 1 -- 172.21.15.125:0/1330365851 wait complete. 2023-10-03T10:17:46.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.184+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a781257d0 con 0x7f8a78139200 2023-10-03T10:17:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.184+0000 7f8a74ff9700 1 -- 172.21.15.125:0/1867090381 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a781257d0 con 0x7f8a78139200 2023-10-03T10:17:46.184 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 msgr2=0x7f8a781224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009f00 tx=0x7f8a7000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 shutdown_connections 2023-10-03T10:17:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a78139200 0x7f8a781224f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a780a0a70 0x7f8a78121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 --2- 172.21.15.125:0/1867090381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a780a1550 0x7f8a78121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 >> 172.21.15.125:0/1867090381 conn(0x7f8a780a6610 msgr2=0x7f8a780a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 shutdown_connections 2023-10-03T10:17:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.186+0000 7f8a7e6ad700 1 -- 172.21.15.125:0/1867090381 wait complete. 2023-10-03T10:17:46.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:46.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:46.777 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.869+0000 7f1949f31700 1 Processor -- start 2023-10-03T10:17:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 -- start start 2023-10-03T10:17:46.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 0x7f1944138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f194413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194409b110 con 0x7f194409ad40 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19440a3b60 con 0x7f1944134570 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1949f31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19440a1a80 con 0x7f1944134140 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1943fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f194413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f19437fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f194409ad40 0x7f1944133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45878/0 (socket says 172.21.15.125:45878) 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f19437fe700 1 -- 172.21.15.125:0/1956783834 learned_addr learned my addr 172.21.15.125:0/1956783834 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1942ffd700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 0x7f1944138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f19427fc700 1 -- 172.21.15.125:0/1956783834 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985884616 0 0) 0x7f194409b110 con 0x7f194409ad40 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f19427fc700 1 -- 172.21.15.125:0/1956783834 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f192c0035b0 con 0x7f194409ad40 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1943fff700 1 -- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 msgr2=0x7f1944138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1943fff700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 0x7f1944138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1943fff700 1 -- 172.21.15.125:0/1956783834 >> v1:172.21.15.125:6789/0 conn(0x7f194409ad40 legacy=0x7f1944133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1943fff700 1 -- 172.21.15.125:0/1956783834 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440a2fa0 con 0x7f1944134570 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.870+0000 7f1942ffd700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 0x7f1944138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1943fff700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f194413b3d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f193c009df0 tx=0x7f193c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c427d9f0980e6ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f19427fc700 1 -- 172.21.15.125:0/1956783834 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00e070 con 0x7f1944134570 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f19427fc700 1 -- 172.21.15.125:0/1956783834 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00bae0 con 0x7f1944134570 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f19427fc700 1 -- 172.21.15.125:0/1956783834 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00be90 con 0x7f1944134570 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 -- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 msgr2=0x7f194413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f194413b3d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f193c009df0 tx=0x7f193c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 -- 172.21.15.125:0/1956783834 shutdown_connections 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f194413b3d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 --2- 172.21.15.125:0/1956783834 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1944134140 0x7f1944138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.871+0000 7f1949f31700 1 -- 172.21.15.125:0/1956783834 >> 172.21.15.125:0/1956783834 conn(0x7f1944099c40 msgr2=0x7f194406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.872+0000 7f1949f31700 1 -- 172.21.15.125:0/1956783834 shutdown_connections 2023-10-03T10:17:46.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.872+0000 7f1949f31700 1 -- 172.21.15.125:0/1956783834 wait complete. 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.872+0000 7f1949f31700 1 Processor -- start 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 -- start start 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 0x7f19441393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f1944139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194411eae0 con 0x7f1944134140 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194411ce30 con 0x7f1944134570 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1949f31700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f194411e060 con 0x7f194409ad40 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1942ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 0x7f19441393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1942ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55102/0 (socket says 172.21.15.125:55102) 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1942ffd700 1 -- 172.21.15.125:0/3816353117 learned_addr learned my addr 172.21.15.125:0/3816353117 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1943fff700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f1944139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 -- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 msgr2=0x7f1944139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f1944139e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 -- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 msgr2=0x7f1944139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f19437fe700 1 -- 172.21.15.125:0/3816353117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19380094a0 con 0x7f194409ad40 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.873+0000 7f1942ffd700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f19437fe700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 0x7f19441393e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f193400c460 tx=0x7f193400c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934005d70 con 0x7f194409ad40 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19340070d0 con 0x7f194409ad40 2023-10-03T10:17:46.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c009a70 con 0x7f194409ad40 2023-10-03T10:17:46.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934007460 con 0x7f194409ad40 2023-10-03T10:17:46.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.874+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194411d670 con 0x7f194409ad40 2023-10-03T10:17:46.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.875+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19340075c0 con 0x7f194409ad40 2023-10-03T10:17:46.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.875+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f193403e9c0 con 0x7f194409ad40 2023-10-03T10:17:46.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.875+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19441361e0 con 0x7f194409ad40 2023-10-03T10:17:46.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.880+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1934017080 con 0x7f194409ad40 2023-10-03T10:17:46.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 Processor -- start 2023-10-03T10:17:46.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 -- start start 2023-10-03T10:17:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300a3b60 con 0x7ff230133f70 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301348e0 con 0x7ff23009ad40 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff237752700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff23009b110 con 0x7ff2300a0a70 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff235cef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff234ced700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff2354ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff2354ee700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53968/0 (socket says 172.21.15.125:53968) 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff235cef700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51646/0 (socket says 172.21.15.125:51646) 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff234ced700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55116/0 (socket says 172.21.15.125:55116) 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.910+0000 7ff2354ee700 1 -- 172.21.15.125:0/2022294236 learned_addr learned my addr 172.21.15.125:0/2022294236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 -- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 msgr2=0x7ff2300a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 -- 172.21.15.125:0/2022294236 >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 msgr2=0x7ff2301343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 --2- 172.21.15.125:0/2022294236 >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 -- 172.21.15.125:0/2022294236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300a2fa0 con 0x7ff23009ad40 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff234ced700 1 --2- 172.21.15.125:0/2022294236 >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff235cef700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff2354ee700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098f0 tx=0x7ff22c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0d8239998b4890c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff227fff700 1 -- 172.21.15.125:0/2022294236 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c011830 con 0x7ff23009ad40 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff227fff700 1 -- 172.21.15.125:0/2022294236 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c011990 con 0x7ff23009ad40 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.911+0000 7ff227fff700 1 -- 172.21.15.125:0/2022294236 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c011d20 con 0x7ff23009ad40 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 -- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 msgr2=0x7ff230133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098f0 tx=0x7ff22c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:46.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 -- 172.21.15.125:0/2022294236 shutdown_connections 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff23009ad40 0x7ff230133a30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 --2- 172.21.15.125:0/2022294236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff2300a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 --2- 172.21.15.125:0/2022294236 >> v2:172.21.15.125:3300/0 conn(0x7ff230133f70 0x7ff2301343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 -- 172.21.15.125:0/2022294236 >> 172.21.15.125:0/2022294236 conn(0x7ff230099c40 msgr2=0x7ff23006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 -- 172.21.15.125:0/2022294236 shutdown_connections 2023-10-03T10:17:46.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.912+0000 7ff237752700 1 -- 172.21.15.125:0/2022294236 wait complete. 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.913+0000 7ff237752700 1 Processor -- start 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.913+0000 7ff237752700 1 -- start start 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff23011fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 0x7ff2301c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230133b00 con 0x7ff23009ad40 2023-10-03T10:17:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230121ff0 con 0x7ff230133f70 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff237752700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff230133400 con 0x7ff2300a0a70 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff235cef700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 0x7ff2301c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55128/0 (socket says 172.21.15.125:55128) 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 -- 172.21.15.125:0/498874695 learned_addr learned my addr 172.21.15.125:0/498874695 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff234ced700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff23011fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 -- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 msgr2=0x7ff23011fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff23011fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 -- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 msgr2=0x7ff2301c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 0x7ff2301c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 -- 172.21.15.125:0/498874695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009a70 con 0x7ff23009ad40 2023-10-03T10:17:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff235cef700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 0x7ff2301c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.914+0000 7ff2354ee700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009c40 tx=0x7ff22c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.915+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c004450 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.915+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c01e070 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.915+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0038e0 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.915+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2200094a0 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.915+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c009550 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.916+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff22c003a40 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.916+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23009c7e0 con 0x7ff23009ad40 2023-10-03T10:17:46.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.916+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff22c020070 con 0x7ff23009ad40 2023-10-03T10:17:46.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:46.925+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff22c023bc0 con 0x7ff23009ad40 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.080+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f194409e450 con 0x7f194409ad40 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.080+0000 7f192bfff700 1 -- 172.21.15.125:0/3816353117 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193400f260 con 0x7f194409ad40 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 msgr2=0x7f19441393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 0x7f19441393e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f193400c460 tx=0x7f193400c770 comp rx=0 tx=0).stop 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 shutdown_connections 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1944134570 0x7f1944139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f194409ad40 0x7f19441393e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 --2- 172.21.15.125:0/3816353117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1944134140 0x7f1944139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 >> 172.21.15.125:0/3816353117 conn(0x7f1944099c40 msgr2=0x7f194413b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 shutdown_connections 2023-10-03T10:17:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.082+0000 7f1949f31700 1 -- 172.21.15.125:0/3816353117 wait complete. 2023-10-03T10:17:47.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:47.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.119+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff23004f2a0 con 0x7ff23009ad40 2023-10-03T10:17:47.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.119+0000 7ff225ffb700 1 -- 172.21.15.125:0/498874695 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff22c015070 con 0x7ff23009ad40 2023-10-03T10:17:47.120 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:47.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 msgr2=0x7ff23011f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009c40 tx=0x7ff22c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:47.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 shutdown_connections 2023-10-03T10:17:47.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff230133f70 0x7ff2301c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23009ad40 0x7ff23011f530 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 --2- 172.21.15.125:0/498874695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2300a0a70 0x7ff23011fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 >> 172.21.15.125:0/498874695 conn(0x7ff230099c40 msgr2=0x7ff2301bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 shutdown_connections 2023-10-03T10:17:47.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.122+0000 7ff237752700 1 -- 172.21.15.125:0/498874695 wait complete. 2023-10-03T10:17:47.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:47.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:47.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:47.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.300+0000 7f21bd1f5700 1 Processor -- start 2023-10-03T10:17:47.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 -- start start 2023-10-03T10:17:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 0x7f21b809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b80a0370 con 0x7f21b8134160 2023-10-03T10:17:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b809fa00 con 0x7f21b809e870 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21bd1f5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b809ada0 con 0x7f21b809f180 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 0x7f21b809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51670/0 (socket says 172.21.15.125:51670) 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55140/0 (socket says 172.21.15.125:55140) 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 -- 172.21.15.125:0/1256652140 learned_addr learned my addr 172.21.15.125:0/1256652140 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 -- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 msgr2=0x7f21b809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 0x7f21b809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 -- 172.21.15.125:0/1256652140 >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 msgr2=0x7f21b8134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 --2- 172.21.15.125:0/1256652140 >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b659c700 1 -- 172.21.15.125:0/1256652140 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b806bec0 con 0x7f21b809f180 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b759e700 1 --2- 172.21.15.125:0/1256652140 >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.301+0000 7f21b6d9d700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 0x7f21b809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21b659c700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009920 tx=0x7f21ac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde499b57ebfb2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21b5d9b700 1 -- 172.21.15.125:0/1256652140 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011830 con 0x7f21b809f180 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21b5d9b700 1 -- 172.21.15.125:0/1256652140 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac011990 con 0x7f21b809f180 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21b5d9b700 1 -- 172.21.15.125:0/1256652140 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011d20 con 0x7f21b809f180 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 msgr2=0x7f21b8133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009920 tx=0x7f21ac009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1256652140 shutdown_connections 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809e870 0x7f21b809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1256652140 >> v2:172.21.15.125:3300/0 conn(0x7f21b8134160 0x7f21b8134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1256652140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b809f180 0x7f21b8133c20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1256652140 >> 172.21.15.125:0/1256652140 conn(0x7f21b80a4430 msgr2=0x7f21b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1256652140 shutdown_connections 2023-10-03T10:17:47.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.302+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1256652140 wait complete. 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 Processor -- start 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 -- start start 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 0x7f21b8123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8126110 con 0x7f21b809e870 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8125c00 con 0x7f21b809f180 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21bd1f5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8125090 con 0x7f21b8134160 2023-10-03T10:17:47.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 0x7f21b8123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:53996/0 (socket says 172.21.15.125:53996) 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b659c700 1 -- 172.21.15.125:0/1175368179 learned_addr learned my addr 172.21.15.125:0/1175368179 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b6d9d700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55150/0 (socket says 172.21.15.125:55150) 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b759e700 1 -- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 msgr2=0x7f21b8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.304+0000 7f21b759e700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b759e700 1 -- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 msgr2=0x7f21b81225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b759e700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b759e700 1 -- 172.21.15.125:0/1175368179 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80094a0 con 0x7f21b8134160 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b659c700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b6d9d700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21b759e700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 0x7f21b8123070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f21b000efc0 tx=0x7f21b000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000ca90 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000f040 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000ce30 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b0009a70 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.305+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac009550 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.306+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21b0014480 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.306+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b80a16a0 con 0x7f21b8134160 2023-10-03T10:17:47.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.306+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21b003fc90 con 0x7f21b8134160 2023-10-03T10:17:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.314+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21b0012910 con 0x7f21b8134160 2023-10-03T10:17:47.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 Processor -- start 2023-10-03T10:17:47.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 -- start start 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 0x7fee1c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 0x7fee1c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c09b110 con 0x7fee1c133f70 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0a3b60 con 0x7fee1c1343a0 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.347+0000 7fee21a0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0a2fa0 con 0x7fee1c09ad40 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 0x7fee1c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fee1c133f70 0x7fee1c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45886/0 (socket says 172.21.15.125:45886) 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1a7fc700 1 -- 172.21.15.125:0/454221530 learned_addr learned my addr 172.21.15.125:0/454221530 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1affd700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 0x7fee1c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee19ffb700 1 -- 172.21.15.125:0/454221530 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164777921 0 0) 0x7fee1c09b110 con 0x7fee1c133f70 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 -- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 msgr2=0x7fee1c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 0x7fee1c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 -- 172.21.15.125:0/454221530 >> v1:172.21.15.125:6789/0 conn(0x7fee1c133f70 legacy=0x7fee1c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 -- 172.21.15.125:0/454221530 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c09a280 con 0x7fee1c1343a0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1affd700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 0x7fee1c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee1b7fe700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 0x7fee1c0a1180 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee14009dc0 tx=0x7fee1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc38f94e3011f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee19ffb700 1 -- 172.21.15.125:0/454221530 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400e070 con 0x7fee1c1343a0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee19ffb700 1 -- 172.21.15.125:0/454221530 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1400bb20 con 0x7fee1c1343a0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.348+0000 7fee19ffb700 1 -- 172.21.15.125:0/454221530 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14012430 con 0x7fee1c1343a0 2023-10-03T10:17:47.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 -- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 msgr2=0x7fee1c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 0x7fee1c0a1180 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee14009dc0 tx=0x7fee1400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 -- 172.21.15.125:0/454221530 shutdown_connections 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c1343a0 0x7fee1c0a1180 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 --2- 172.21.15.125:0/454221530 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c09ad40 0x7fee1c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 -- 172.21.15.125:0/454221530 >> 172.21.15.125:0/454221530 conn(0x7fee1c099c40 msgr2=0x7fee1c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 -- 172.21.15.125:0/454221530 shutdown_connections 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.349+0000 7fee21a0d700 1 -- 172.21.15.125:0/454221530 wait complete. 2023-10-03T10:17:47.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 Processor -- start 2023-10-03T10:17:47.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 -- start start 2023-10-03T10:17:47.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 0x7fee1c11f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c122010 con 0x7fee1c133f70 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c133390 con 0x7fee1c09ad40 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee21a0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c122640 con 0x7fee1c1343a0 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee1a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.350+0000 7fee1affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 0x7fee1c11f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51686/0 (socket says 172.21.15.125:51686) 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55158/0 (socket says 172.21.15.125:55158) 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 -- 172.21.15.125:0/3796677284 learned_addr learned my addr 172.21.15.125:0/3796677284 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 -- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 msgr2=0x7fee1c11f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 0x7fee1c11f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 -- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 msgr2=0x7fee1c11fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 -- 172.21.15.125:0/3796677284 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0094a0 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1affd700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 0x7fee1c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1a7fc700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee1b7fe700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fee14014040 tx=0x7fee14004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14012430 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14020070 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14004280 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee14009a70 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.351+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c11ef00 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.352+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee140043e0 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.352+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee14022070 con 0x7fee1c1343a0 2023-10-03T10:17:47.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.352+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c11ef00 con 0x7fee1c1343a0 2023-10-03T10:17:47.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.357+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee1c11ef00 con 0x7fee1c1343a0 2023-10-03T10:17:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.506+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21b804f2a0 con 0x7f21b8134160 2023-10-03T10:17:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.506+0000 7f219f7fe700 1 -- 172.21.15.125:0/1175368179 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b0012340 con 0x7f21b8134160 2023-10-03T10:17:47.507 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 msgr2=0x7f21b8123070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 0x7f21b8123070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f21b000efc0 tx=0x7f21b000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 shutdown_connections 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b8134160 0x7f21b8123070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b809e870 0x7f21b81225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 --2- 172.21.15.125:0/1175368179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b809f180 0x7f21b8122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 >> 172.21.15.125:0/1175368179 conn(0x7f21b80a4430 msgr2=0x7f21b80a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 shutdown_connections 2023-10-03T10:17:47.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.508+0000 7f21bd1f5700 1 -- 172.21.15.125:0/1175368179 wait complete. 2023-10-03T10:17:47.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:47.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.550+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee1c11ef00 con 0x7fee1c1343a0 2023-10-03T10:17:47.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.550+0000 7fee03fff700 1 -- 172.21.15.125:0/3796677284 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee1c11ef00 con 0x7fee1c1343a0 2023-10-03T10:17:47.551 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:47.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 msgr2=0x7fee1c1c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fee14014040 tx=0x7fee14004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 shutdown_connections 2023-10-03T10:17:47.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fee1c1343a0 0x7fee1c1c8190 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee1c09ad40 0x7fee1c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 --2- 172.21.15.125:0/3796677284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee1c133f70 0x7fee1c11fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 >> 172.21.15.125:0/3796677284 conn(0x7fee1c099c40 msgr2=0x7fee1c1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 shutdown_connections 2023-10-03T10:17:47.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:47.552+0000 7fee21a0d700 1 -- 172.21.15.125:0/3796677284 wait complete. 2023-10-03T10:17:47.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:48.095 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:48.135 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.223+0000 7fe60e64e700 1 Processor -- start 2023-10-03T10:17:48.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.223+0000 7fe60e64e700 1 -- start start 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60e64e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 0x7fe608138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60e64e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 0x7fe60813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60e64e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60809e9d0 con 0x7fe6080a0a70 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60e64e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809dc00 con 0x7fe6080a1550 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60e64e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809dec0 con 0x7fe608139200 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe6077fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 0x7fe608138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 0x7fe60813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe607fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe6080a0a70 0x7fe6080a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45888/0 (socket says 172.21.15.125:45888) 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe607fff700 1 -- 172.21.15.125:0/2985700745 learned_addr learned my addr 172.21.15.125:0/2985700745 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe606ffd700 1 -- 172.21.15.125:0/2985700745 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524483770 0 0) 0x7fe60809e9d0 con 0x7fe6080a0a70 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 -- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 msgr2=0x7fe608138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 0x7fe608138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 -- 172.21.15.125:0/2985700745 >> v1:172.21.15.125:6789/0 conn(0x7fe6080a0a70 legacy=0x7fe6080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 -- 172.21.15.125:0/2985700745 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60809e6a0 con 0x7fe608139200 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe6077fe700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 0x7fe608138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe60cbeb700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 0x7fe60813b5e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe600009dc0 tx=0x7fe60000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d8bd102d69341b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.224+0000 7fe606ffd700 1 -- 172.21.15.125:0/2985700745 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e070 con 0x7fe608139200 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe606ffd700 1 -- 172.21.15.125:0/2985700745 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000bb20 con 0x7fe608139200 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe606ffd700 1 -- 172.21.15.125:0/2985700745 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600012430 con 0x7fe608139200 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 -- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 msgr2=0x7fe60813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 0x7fe60813b5e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe600009dc0 tx=0x7fe60000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 -- 172.21.15.125:0/2985700745 shutdown_connections 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe608139200 0x7fe60813b5e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 --2- 172.21.15.125:0/2985700745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6080a1550 0x7fe608138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 -- 172.21.15.125:0/2985700745 >> 172.21.15.125:0/2985700745 conn(0x7fe6080a6610 msgr2=0x7fe6080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 -- 172.21.15.125:0/2985700745 shutdown_connections 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.225+0000 7fe60e64e700 1 -- 172.21.15.125:0/2985700745 wait complete. 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.226+0000 7fe60e64e700 1 Processor -- start 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.226+0000 7fe60e64e700 1 -- start start 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 0x7fe6081206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608124270 con 0x7fe6080a0a70 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081365a0 con 0x7fe608139200 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60e64e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809cb50 con 0x7fe6080a1550 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60cbeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51704/0 (socket says 172.21.15.125:51704) 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60cbeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54040/0 (socket says 172.21.15.125:54040) 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 -- 172.21.15.125:0/117690269 learned_addr learned my addr 172.21.15.125:0/117690269 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe607fff700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 0x7fe6081206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 -- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 msgr2=0x7fe608121130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 -- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 msgr2=0x7fe6081206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 0x7fe6081206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 -- 172.21.15.125:0/117690269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094a0 con 0x7fe6080a1550 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe60cbeb700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe607fff700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 0x7fe6081206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.227+0000 7fe6077fe700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00ec10 tx=0x7fe5fc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00c850 con 0x7fe6080a1550 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00c9b0 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600009a70 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00cd20 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6080a0430 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.228+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5fc013470 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.229+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5fc03fb30 con 0x7fe6080a1550 2023-10-03T10:17:48.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.229+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608124010 con 0x7fe6080a1550 2023-10-03T10:17:48.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.233+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5fc021070 con 0x7fe6080a1550 2023-10-03T10:17:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.266+0000 7fc25d19d700 1 Processor -- start 2023-10-03T10:17:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.266+0000 7fc25d19d700 1 -- start start 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2580700e0 0x7fc2580704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 0x7fc25812cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25809aad0 con 0x7fc2580700e0 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc258099d90 con 0x7fc25812d290 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25d19d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25806b670 con 0x7fc2580709f0 2023-10-03T10:17:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2580700e0 0x7fc2580704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25c99c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 0x7fc25812cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2580700e0 0x7fc2580704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55182/0 (socket says 172.21.15.125:55182) 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 -- 172.21.15.125:0/2896728256 learned_addr learned my addr 172.21.15.125:0/2896728256 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25c99c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54054/0 (socket says 172.21.15.125:54054) 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 -- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 msgr2=0x7fc25812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 0x7fc25812cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 -- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 msgr2=0x7fc25812d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 -- 172.21.15.125:0/2896728256 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25809a4c0 con 0x7fc2580700e0 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc2577fe700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 0x7fc25812cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc25c99c700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.267+0000 7fc257fff700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2580700e0 0x7fc2580704b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc2480098f0 tx=0x7fc248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d773321e3c4291 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc256ffd700 1 -- 172.21.15.125:0/2896728256 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248011830 con 0x7fc2580700e0 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc256ffd700 1 -- 172.21.15.125:0/2896728256 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248011990 con 0x7fc2580700e0 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc256ffd700 1 -- 172.21.15.125:0/2896728256 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248011d20 con 0x7fc2580700e0 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 -- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2580700e0 msgr2=0x7fc2580704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2580700e0 0x7fc2580704b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc2480098f0 tx=0x7fc248009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 -- 172.21.15.125:0/2896728256 shutdown_connections 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc25812d290 0x7fc25812d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2580700e0 0x7fc2580704b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2896728256 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580709f0 0x7fc25812cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 -- 172.21.15.125:0/2896728256 >> 172.21.15.125:0/2896728256 conn(0x7fc2580a27a0 msgr2=0x7fc2580a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 -- 172.21.15.125:0/2896728256 shutdown_connections 2023-10-03T10:17:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.268+0000 7fc25d19d700 1 -- 172.21.15.125:0/2896728256 wait complete. 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.269+0000 7fc25d19d700 1 Processor -- start 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.269+0000 7fc25d19d700 1 -- start start 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580700e0 0x7fc2581c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25812cb40 con 0x7fc25812d290 2023-10-03T10:17:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581224b0 con 0x7fc2580709f0 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25d19d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25811d5c0 con 0x7fc2580700e0 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55192/0 (socket says 172.21.15.125:55192) 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 -- 172.21.15.125:0/2199344468 learned_addr learned my addr 172.21.15.125:0/2199344468 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc2577fe700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54070/0 (socket says 172.21.15.125:54070) 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc257fff700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580700e0 0x7fc2581c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 -- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580700e0 msgr2=0x7fc2581c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580700e0 0x7fc2581c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 -- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 msgr2=0x7fc2581c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 -- 172.21.15.125:0/2199344468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0094a0 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc2577fe700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc25c99c700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc25000efc0 tx=0x7fc25000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.270+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000ca90 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25000f040 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc250009a70 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000ce10 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc248009550 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc250014480 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.271+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25809fca0 con 0x7fc25812d290 2023-10-03T10:17:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.272+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc25003fdb0 con 0x7fc25812d290 2023-10-03T10:17:48.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.276+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc250012700 con 0x7fc25812d290 2023-10-03T10:17:48.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.426+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe60804f2a0 con 0x7fe6080a1550 2023-10-03T10:17:48.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.426+0000 7fe604ff9700 1 -- 172.21.15.125:0/117690269 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5fc02a090 con 0x7fe6080a1550 2023-10-03T10:17:48.427 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:48.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.428+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 msgr2=0x7fe608120bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.428+0000 7fe60e64e700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00ec10 tx=0x7fe5fc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:48.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 shutdown_connections 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe608139200 0x7fe608121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6080a0a70 0x7fe6081206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 --2- 172.21.15.125:0/117690269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe6080a1550 0x7fe608120bf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 >> 172.21.15.125:0/117690269 conn(0x7fe6080a6610 msgr2=0x7fe6080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 shutdown_connections 2023-10-03T10:17:48.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.429+0000 7fe60e64e700 1 -- 172.21.15.125:0/117690269 wait complete. 2023-10-03T10:17:48.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.465+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc25804f2a0 con 0x7fc25812d290 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.465+0000 7fc254ff9700 1 -- 172.21.15.125:0/2199344468 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc250009d70 con 0x7fc25812d290 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 msgr2=0x7fc2581c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc25000efc0 tx=0x7fc25000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 shutdown_connections 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc25812d290 0x7fc2581c8d20 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2580700e0 0x7fc2581c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 --2- 172.21.15.125:0/2199344468 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2580709f0 0x7fc2581c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 >> 172.21.15.125:0/2199344468 conn(0x7fc2580a27a0 msgr2=0x7fc25812f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 shutdown_connections 2023-10-03T10:17:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.467+0000 7fc25d19d700 1 -- 172.21.15.125:0/2199344468 wait complete. 2023-10-03T10:17:48.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:48.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:48.565 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.646+0000 7fbfbcf60700 1 Processor -- start 2023-10-03T10:17:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.646+0000 7fbfbcf60700 1 -- start start 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfbcf60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfbcf60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfbcf60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb809b110 con 0x7fbfb8133f70 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfbcf60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb80a3b60 con 0x7fbfb809ad40 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfbcf60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8134850 con 0x7fbfb81343d0 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb5d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbfb8133f70 0x7fbfb80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45904/0 (socket says 172.21.15.125:45904) 2023-10-03T10:17:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55194/0 (socket says 172.21.15.125:55194) 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54082/0 (socket says 172.21.15.125:54082) 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.647+0000 7fbfb5d9b700 1 -- 172.21.15.125:0/873006976 learned_addr learned my addr 172.21.15.125:0/873006976 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/873006976 >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 msgr2=0x7fbfb8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb6d9d700 1 --2- 172.21.15.125:0/873006976 >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/873006976 >> v1:172.21.15.125:6789/0 conn(0x7fbfb8133f70 legacy=0x7fbfb80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb559a700 1 -- 172.21.15.125:0/873006976 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279722054 0 0) 0x7fbfb809b110 con 0x7fbfb8133f70 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/873006976 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80a2fa0 con 0x7fbfb81343d0 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb659c700 1 --2- 172.21.15.125:0/873006976 >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb6d9d700 1 --2- 172.21.15.125:0/873006976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009d90 tx=0x7fbfb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7052512517531f27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb559a700 1 -- 172.21.15.125:0/873006976 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000e070 con 0x7fbfb81343d0 2023-10-03T10:17:48.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb559a700 1 -- 172.21.15.125:0/873006976 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000bb20 con 0x7fbfb81343d0 2023-10-03T10:17:48.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.648+0000 7fbfb559a700 1 -- 172.21.15.125:0/873006976 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0012430 con 0x7fbfb81343d0 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 -- 172.21.15.125:0/873006976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 msgr2=0x7fbfb80a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/873006976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009d90 tx=0x7fbfb000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 -- 172.21.15.125:0/873006976 shutdown_connections 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/873006976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb81343d0 0x7fbfb80a1180 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/873006976 >> v2:172.21.15.125:3300/0 conn(0x7fbfb809ad40 0x7fbfb8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 -- 172.21.15.125:0/873006976 >> 172.21.15.125:0/873006976 conn(0x7fbfb8099c40 msgr2=0x7fbfb806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 -- 172.21.15.125:0/873006976 shutdown_connections 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.649+0000 7fbfbcf60700 1 -- 172.21.15.125:0/873006976 wait complete. 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.650+0000 7fbfbcf60700 1 Processor -- start 2023-10-03T10:17:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 -- start start 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 0x7fbfb81212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 0x7fbfb81217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8122eb0 con 0x7fbfb809ad40 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8123d40 con 0x7fbfb8133f70 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfbcf60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8124820 con 0x7fbfb81343d0 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfb5d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 0x7fbfb81217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51734/0 (socket says 172.21.15.125:51734) 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/96447385 learned_addr learned my addr 172.21.15.125:0/96447385 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.651+0000 7fbfb659c700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 0x7fbfb81212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 msgr2=0x7fbfb81217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 0x7fbfb81217e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 msgr2=0x7fbfb81212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 0x7fbfb81212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 -- 172.21.15.125:0/96447385 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80094a0 con 0x7fbfb81343d0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb5d9b700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 0x7fbfb81217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb659c700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 0x7fbfb81212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfb6d9d700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0014040 tx=0x7fbfb0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0012430 con 0x7fbfb81343d0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0020070 con 0x7fbfb81343d0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb0009a70 con 0x7fbfb81343d0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0004280 con 0x7fbfb81343d0 2023-10-03T10:17:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.652+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb809c7e0 con 0x7fbfb81343d0 2023-10-03T10:17:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.653+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfb00043e0 con 0x7fbfb81343d0 2023-10-03T10:17:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.653+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfb0022070 con 0x7fbfb81343d0 2023-10-03T10:17:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.653+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb811e060 con 0x7fbfb81343d0 2023-10-03T10:17:48.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.658+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfb00263e0 con 0x7fbfb81343d0 2023-10-03T10:17:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.691+0000 7f52ae409700 1 Processor -- start 2023-10-03T10:17:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.691+0000 7f52ae409700 1 -- start start 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ae409700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52a809d860 0x7f52a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ae409700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ae409700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a809aaa0 con 0x7f52a809e170 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ae409700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a809f870 con 0x7f52a809d860 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ae409700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a809b360 con 0x7f52a8130eb0 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ac9a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52a809d860 0x7f52a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ac9a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51738/0 (socket says 172.21.15.125:51738) 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ac9a6700 1 -- 172.21.15.125:0/3004199637 learned_addr learned my addr 172.21.15.125:0/3004199637 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 -- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 msgr2=0x7f52a8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 -- 172.21.15.125:0/3004199637 >> v1:172.21.15.125:6789/0 conn(0x7f52a809e170 legacy=0x7f52a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 -- 172.21.15.125:0/3004199637 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a809b620 con 0x7f52a809d860 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52ac9a6700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a7fff700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809d860 0x7f52a809dc30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f529c009840 tx=0x7f529c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7aa70c8af05dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a6ffd700 1 -- 172.21.15.125:0/3004199637 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c011830 con 0x7f52a809d860 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a6ffd700 1 -- 172.21.15.125:0/3004199637 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c011990 con 0x7f52a809d860 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.692+0000 7f52a6ffd700 1 -- 172.21.15.125:0/3004199637 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c011d20 con 0x7f52a809d860 2023-10-03T10:17:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 -- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809d860 msgr2=0x7f52a809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809d860 0x7f52a809dc30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f529c009840 tx=0x7f529c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 -- 172.21.15.125:0/3004199637 shutdown_connections 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 --2- 172.21.15.125:0/3004199637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809d860 0x7f52a809dc30 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 -- 172.21.15.125:0/3004199637 >> 172.21.15.125:0/3004199637 conn(0x7f52a8099c40 msgr2=0x7f52a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 -- 172.21.15.125:0/3004199637 shutdown_connections 2023-10-03T10:17:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.693+0000 7f52ae409700 1 -- 172.21.15.125:0/3004199637 wait complete. 2023-10-03T10:17:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.694+0000 7f52ae409700 1 Processor -- start 2023-10-03T10:17:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.694+0000 7f52ae409700 1 -- start start 2023-10-03T10:17:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 0x7f52a81c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a81c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8124e60 con 0x7f52a809e170 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8072720 con 0x7f52a809d860 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a809c8b0 con 0x7f52a8130eb0 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 0x7f52a81c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54094/0 (socket says 172.21.15.125:54094) 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 -- 172.21.15.125:0/2881769135 learned_addr learned my addr 172.21.15.125:0/2881769135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ac9a6700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a81c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 -- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 msgr2=0x7f52a81c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a81c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 -- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 msgr2=0x7f52a81c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 0x7f52a81c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 -- 172.21.15.125:0/2881769135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0009b30 con 0x7f52a809d860 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a77fe700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 0x7f52a81c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a7fff700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f529c009fd0 tx=0x7f529c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c004400 con 0x7f52a809d860 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c01f070 con 0x7f52a809d860 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c0094a0 con 0x7f52a809d860 2023-10-03T10:17:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0038e0 con 0x7f52a809d860 2023-10-03T10:17:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.695+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a8125000 con 0x7f52a809d860 2023-10-03T10:17:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.696+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f529c021030 con 0x7f52a809d860 2023-10-03T10:17:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.696+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f529c040790 con 0x7f52a809d860 2023-10-03T10:17:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.696+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a804f2a0 con 0x7f52a809d860 2023-10-03T10:17:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.701+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f529c0239c0 con 0x7f52a809d860 2023-10-03T10:17:48.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.852+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfb8124960 con 0x7fbfb81343d0 2023-10-03T10:17:48.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.852+0000 7fbfa6ffd700 1 -- 172.21.15.125:0/96447385 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfb001ab70 con 0x7fbfb81343d0 2023-10-03T10:17:48.853 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:48.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 msgr2=0x7fbfb8121d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0014040 tx=0x7fbfb0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 shutdown_connections 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbfb81343d0 0x7fbfb8121d20 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfb809ad40 0x7fbfb81212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 --2- 172.21.15.125:0/96447385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfb8133f70 0x7fbfb81217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 >> 172.21.15.125:0/96447385 conn(0x7fbfb8099c40 msgr2=0x7fbfb81332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 shutdown_connections 2023-10-03T10:17:48.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.855+0000 7fbfbcf60700 1 -- 172.21.15.125:0/96447385 wait complete. 2023-10-03T10:17:48.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:48.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.892+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52a8126210 con 0x7f52a809d860 2023-10-03T10:17:48.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.892+0000 7f52a4ff9700 1 -- 172.21.15.125:0/2881769135 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f529c015020 con 0x7f52a809d860 2023-10-03T10:17:48.893 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 msgr2=0x7f52a81c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f529c009fd0 tx=0x7f529c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 shutdown_connections 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f52a8130eb0 0x7f52a81c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52a809d860 0x7f52a81c74c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 --2- 172.21.15.125:0/2881769135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a809e170 0x7f52a81c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 >> 172.21.15.125:0/2881769135 conn(0x7f52a8099c40 msgr2=0x7f52a806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 shutdown_connections 2023-10-03T10:17:48.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:48.894+0000 7f52ae409700 1 -- 172.21.15.125:0/2881769135 wait complete. 2023-10-03T10:17:48.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:49.442 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:49.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:49.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 Processor -- start 2023-10-03T10:17:49.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 -- start start 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48140a1380 0x7f4814133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481409e9d0 con 0x7f48140a1380 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481409dc00 con 0x7f4814133f50 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f481b8f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f481409dec0 con 0x7f48140a0a70 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f4819693700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.572+0000 7f4819e94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4819e94700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54102/0 (socket says 172.21.15.125:54102) 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4819693700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51756/0 (socket says 172.21.15.125:51756) 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4819e94700 1 -- 172.21.15.125:0/3913648046 learned_addr learned my addr 172.21.15.125:0/3913648046 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 --2- 172.21.15.125:0/3913648046 >> v2:172.21.15.125:3300/0 conn(0x7f48140a1380 0x7f4814133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 -- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 msgr2=0x7f48140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 -- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 msgr2=0x7f4814134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 -- 172.21.15.125:0/3913648046 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481409e6a0 con 0x7f48140a1380 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4819693700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4819e94700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f4818e92700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48140a1380 0x7f4814133a10 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4804009840 tx=0x7f4804009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb5c3328f6f4de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f480bfff700 1 -- 172.21.15.125:0/3913648046 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011830 con 0x7f48140a1380 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f480bfff700 1 -- 172.21.15.125:0/3913648046 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804011990 con 0x7f48140a1380 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.573+0000 7f480bfff700 1 -- 172.21.15.125:0/3913648046 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011d20 con 0x7f48140a1380 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 -- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48140a1380 msgr2=0x7f4814133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48140a1380 0x7f4814133a10 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4804009840 tx=0x7f4804009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 -- 172.21.15.125:0/3913648046 shutdown_connections 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4814133f50 0x7f4814134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a0a70 0x7f48140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3913648046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48140a1380 0x7f4814133a10 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 -- 172.21.15.125:0/3913648046 >> 172.21.15.125:0/3913648046 conn(0x7f48140a6610 msgr2=0x7f48140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 -- 172.21.15.125:0/3913648046 shutdown_connections 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.574+0000 7f481b8f7700 1 -- 172.21.15.125:0/3913648046 wait complete. 2023-10-03T10:17:49.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.575+0000 7f481b8f7700 1 Processor -- start 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.575+0000 7f481b8f7700 1 -- start start 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 0x7f4814122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 0x7f4814122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814133760 con 0x7f4814133f50 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48141237f0 con 0x7f48140a0a70 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f481b8f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4814124e30 con 0x7f48140a1380 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4819e94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 0x7f4814122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51764/0 (socket says 172.21.15.125:51764) 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 -- 172.21.15.125:0/3577937693 learned_addr learned my addr 172.21.15.125:0/3577937693 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4819693700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 0x7f4814122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 -- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 msgr2=0x7f4814122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 0x7f4814122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 -- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 msgr2=0x7f4814122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 0x7f4814122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 -- 172.21.15.125:0/3577937693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100094a0 con 0x7f48140a1380 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4819693700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 0x7f4814122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4819e94700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 0x7f4814122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.576+0000 7f4818e92700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4804000c00 tx=0x7f4804004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.577+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804004450 con 0x7f48140a1380 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.577+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480401f070 con 0x7f48140a1380 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.577+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c009b30 con 0x7f48140a1380 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.577+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040038e0 con 0x7f48140a1380 2023-10-03T10:17:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.577+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48040094a0 con 0x7f48140a1380 2023-10-03T10:17:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.578+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481411f760 con 0x7f48140a1380 2023-10-03T10:17:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.578+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4804003a40 con 0x7f48140a1380 2023-10-03T10:17:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.578+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4804021070 con 0x7f48140a1380 2023-10-03T10:17:49.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.582+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4804040e60 con 0x7f48140a1380 2023-10-03T10:17:49.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.613+0000 7f1665590700 1 Processor -- start 2023-10-03T10:17:49.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.613+0000 7f1665590700 1 -- start start 2023-10-03T10:17:49.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f1665590700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 0x7f16600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f1665590700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 0x7f166013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f1665590700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166009dc00 con 0x7f16600a1380 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f1665590700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166009ea60 con 0x7f1660134120 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f1665590700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166009dec0 con 0x7f16600a0a70 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f165e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f16600a1380 0x7f1660133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45918/0 (socket says 172.21.15.125:45918) 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f165f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 0x7f166013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f165e7fc700 1 -- 172.21.15.125:0/1543750208 learned_addr learned my addr 172.21.15.125:0/1543750208 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.614+0000 7f165effd700 1 --2- 172.21.15.125:0/1543750208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 0x7f16600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165dffb700 1 -- 172.21.15.125:0/1543750208 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678966535 0 0) 0x7f166009dc00 con 0x7f16600a1380 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165dffb700 1 -- 172.21.15.125:0/1543750208 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16480035b0 con 0x7f16600a1380 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165effd700 1 -- 172.21.15.125:0/1543750208 >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 msgr2=0x7f166013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165effd700 1 --2- 172.21.15.125:0/1543750208 >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 0x7f166013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165effd700 1 -- 172.21.15.125:0/1543750208 >> v1:172.21.15.125:6789/0 conn(0x7f16600a1380 legacy=0x7f1660133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165effd700 1 -- 172.21.15.125:0/1543750208 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166009e6a0 con 0x7f16600a0a70 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165f7fe700 1 --2- 172.21.15.125:0/1543750208 >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 0x7f166013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165effd700 1 --2- 172.21.15.125:0/1543750208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 0x7f16600a0e40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1650009840 tx=0x7f1650009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1485221f8ef2524e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165dffb700 1 -- 172.21.15.125:0/1543750208 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011830 con 0x7f16600a0a70 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165dffb700 1 -- 172.21.15.125:0/1543750208 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650011990 con 0x7f16600a0a70 2023-10-03T10:17:49.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f165dffb700 1 -- 172.21.15.125:0/1543750208 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011d20 con 0x7f16600a0a70 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f1665590700 1 -- 172.21.15.125:0/1543750208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 msgr2=0x7f16600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.615+0000 7f1665590700 1 --2- 172.21.15.125:0/1543750208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 0x7f16600a0e40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1650009840 tx=0x7f1650009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 -- 172.21.15.125:0/1543750208 shutdown_connections 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 --2- 172.21.15.125:0/1543750208 >> v2:172.21.15.125:3300/0 conn(0x7f1660134120 0x7f166013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 --2- 172.21.15.125:0/1543750208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a0a70 0x7f16600a0e40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 -- 172.21.15.125:0/1543750208 >> 172.21.15.125:0/1543750208 conn(0x7f16600a6610 msgr2=0x7f16600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 -- 172.21.15.125:0/1543750208 shutdown_connections 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.616+0000 7f1665590700 1 -- 172.21.15.125:0/1543750208 wait complete. 2023-10-03T10:17:49.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 Processor -- start 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 -- start start 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 0x7f1660122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1660134120 0x7f1660123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16601262c0 con 0x7f16600a0a70 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1660125930 con 0x7f1660134120 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f1665590700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1660124320 con 0x7f16600a1380 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f165effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f165e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 0x7f1660122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f165effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55250/0 (socket says 172.21.15.125:55250) 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f165effd700 1 -- 172.21.15.125:0/1655404157 learned_addr learned my addr 172.21.15.125:0/1655404157 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:49.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.617+0000 7f165f7fe700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1660134120 0x7f1660123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 -- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1660134120 msgr2=0x7f1660123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1660134120 0x7f1660123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 -- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 msgr2=0x7f16601227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 -- 172.21.15.125:0/1655404157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658009a70 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165effd700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f165e7fc700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 0x7f1660122ce0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f165400c490 tx=0x7f165400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654005d70 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540070d0 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16500094a0 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654007440 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.618+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1660133660 con 0x7f16600a1380 2023-10-03T10:17:49.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.619+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16540075a0 con 0x7f16600a1380 2023-10-03T10:17:49.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.619+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f165403ea90 con 0x7f16600a1380 2023-10-03T10:17:49.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.619+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166004f2a0 con 0x7f16600a1380 2023-10-03T10:17:49.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.624+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f165401bb10 con 0x7f16600a1380 2023-10-03T10:17:49.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.775+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48140a5180 con 0x7f48140a1380 2023-10-03T10:17:49.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.775+0000 7f4809ffb700 1 -- 172.21.15.125:0/3577937693 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4804034090 con 0x7f48140a1380 2023-10-03T10:17:49.775 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 msgr2=0x7f48141228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4804000c00 tx=0x7f4804004750 comp rx=0 tx=0).stop 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 shutdown_connections 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4814133f50 0x7f4814122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f48140a0a70 0x7f4814122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 --2- 172.21.15.125:0/3577937693 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f48140a1380 0x7f48141228d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 >> 172.21.15.125:0/3577937693 conn(0x7f48140a6610 msgr2=0x7f481411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 shutdown_connections 2023-10-03T10:17:49.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.777+0000 7f481b8f7700 1 -- 172.21.15.125:0/3577937693 wait complete. 2023-10-03T10:17:49.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:49.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.817+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16601339a0 con 0x7f16600a1380 2023-10-03T10:17:49.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.817+0000 7f16477fe700 1 -- 172.21.15.125:0/1655404157 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16540192c0 con 0x7f16600a1380 2023-10-03T10:17:49.818 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 msgr2=0x7f1660122ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 0x7f1660122ce0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f165400c490 tx=0x7f165400c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 shutdown_connections 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1660134120 0x7f1660123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16600a0a70 0x7f16601227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 --2- 172.21.15.125:0/1655404157 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16600a1380 0x7f1660122ce0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 >> 172.21.15.125:0/1655404157 conn(0x7f16600a6610 msgr2=0x7f166009b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 shutdown_connections 2023-10-03T10:17:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.819+0000 7f1665590700 1 -- 172.21.15.125:0/1655404157 wait complete. 2023-10-03T10:17:49.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:49.868 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:49.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:49.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.997+0000 7f0e1662a700 1 Processor -- start 2023-10-03T10:17:49.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.997+0000 7f0e1662a700 1 -- start start 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e1662a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e1662a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e1662a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1009dc00 con 0x7f0e10133f50 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e1662a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1009ea60 con 0x7f0e100a0a70 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e1662a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1009dec0 con 0x7f0e100a1380 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55258/0 (socket says 172.21.15.125:55258) 2023-10-03T10:17:50.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51788/0 (socket says 172.21.15.125:51788) 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0ffff700 1 -- 172.21.15.125:0/1447397564 learned_addr learned my addr 172.21.15.125:0/1447397564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0effd700 1 -- 172.21.15.125:0/1447397564 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980657006 0 0) 0x7f0e1009dc00 con 0x7f0e10133f50 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/1447397564 >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 msgr2=0x7f0e100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 --2- 172.21.15.125:0/1447397564 >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/1447397564 >> v1:172.21.15.125:6789/0 conn(0x7f0e10133f50 legacy=0x7f0e1013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/1447397564 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1009e6a0 con 0x7f0e100a1380 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0ffff700 1 --2- 172.21.15.125:0/1447397564 >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0f7fe700 1 --2- 172.21.15.125:0/1447397564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009840 tx=0x7f0e04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcca2c2f0710a805 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0effd700 1 -- 172.21.15.125:0/1447397564 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04011830 con 0x7f0e100a1380 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.998+0000 7f0e0effd700 1 -- 172.21.15.125:0/1447397564 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04011990 con 0x7f0e100a1380 2023-10-03T10:17:50.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e0effd700 1 -- 172.21.15.125:0/1447397564 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04011d20 con 0x7f0e100a1380 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 -- 172.21.15.125:0/1447397564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 msgr2=0x7f0e10133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 --2- 172.21.15.125:0/1447397564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009840 tx=0x7f0e04009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 -- 172.21.15.125:0/1447397564 shutdown_connections 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 --2- 172.21.15.125:0/1447397564 >> v2:172.21.15.125:3300/0 conn(0x7f0e100a0a70 0x7f0e100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 --2- 172.21.15.125:0/1447397564 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e10133a10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 -- 172.21.15.125:0/1447397564 >> 172.21.15.125:0/1447397564 conn(0x7f0e100a6610 msgr2=0x7f0e100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 -- 172.21.15.125:0/1447397564 shutdown_connections 2023-10-03T10:17:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:49.999+0000 7f0e1662a700 1 -- 172.21.15.125:0/1447397564 wait complete. 2023-10-03T10:17:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.000+0000 7f0e1662a700 1 Processor -- start 2023-10-03T10:17:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.000+0000 7f0e1662a700 1 -- start start 2023-10-03T10:17:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e100a0a70 0x7f0e101c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 0x7f0e101c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e10122320 con 0x7f0e10133f50 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e10120660 con 0x7f0e100a0a70 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e1662a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100a17b0 con 0x7f0e100a1380 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e14bc7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 0x7f0e101c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51800/0 (socket says 172.21.15.125:51800) 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/2171281392 learned_addr learned my addr 172.21.15.125:0/2171281392 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e100a0a70 0x7f0e101c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e100a0a70 msgr2=0x7f0e101c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e100a0a70 0x7f0e101c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 msgr2=0x7f0e101c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 0x7f0e101c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 -- 172.21.15.125:0/2171281392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00009550 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e14bc7700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 0x7f0e101c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0f7fe700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009fd0 tx=0x7f0e04004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040036a0 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.001+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0401f070 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.002+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04003a60 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.002+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e040094a0 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.002+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e10120e50 con 0x7f0e100a1380 2023-10-03T10:17:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.002+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e04003bc0 con 0x7f0e100a1380 2023-10-03T10:17:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.003+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e04021070 con 0x7f0e100a1380 2023-10-03T10:17:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.003+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1004f2a0 con 0x7f0e100a1380 2023-10-03T10:17:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.007+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e04015020 con 0x7f0e100a1380 2023-10-03T10:17:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 Processor -- start 2023-10-03T10:17:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 -- start start 2023-10-03T10:17:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 0x7f44e80a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e809aa00 con 0x7f44e8099a60 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e809a080 con 0x7f44e8133b80 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.039+0000 7f44f0159700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8133750 con 0x7f44e80a0e20 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ed6f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ee6f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 0x7f44e80a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54132/0 (socket says 172.21.15.125:54132) 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ed6f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55262/0 (socket says 172.21.15.125:55262) 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 -- 172.21.15.125:0/373796562 learned_addr learned my addr 172.21.15.125:0/373796562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 -- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 msgr2=0x7f44e80a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 0x7f44e80a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 -- 172.21.15.125:0/373796562 >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 msgr2=0x7f44e80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 --2- 172.21.15.125:0/373796562 >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 -- 172.21.15.125:0/373796562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e809a760 con 0x7f44e8133b80 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ee6f6700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 0x7f44e80a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ed6f4700 1 --2- 172.21.15.125:0/373796562 >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44edef5700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006fd0 tx=0x7f44e4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e6567d26d94e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ecef3700 1 -- 172.21.15.125:0/373796562 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4005e30 con 0x7f44e8133b80 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ecef3700 1 -- 172.21.15.125:0/373796562 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4004030 con 0x7f44e8133b80 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.040+0000 7f44ecef3700 1 -- 172.21.15.125:0/373796562 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40043e0 con 0x7f44e8133b80 2023-10-03T10:17:50.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 -- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 msgr2=0x7f44e8133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006fd0 tx=0x7f44e4009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 -- 172.21.15.125:0/373796562 shutdown_connections 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8133b80 0x7f44e8133f50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 --2- 172.21.15.125:0/373796562 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e80a0e20 0x7f44e80a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 --2- 172.21.15.125:0/373796562 >> v2:172.21.15.125:3300/0 conn(0x7f44e8099a60 0x7f44e80a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 -- 172.21.15.125:0/373796562 >> 172.21.15.125:0/373796562 conn(0x7f44e80a2980 msgr2=0x7f44e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 -- 172.21.15.125:0/373796562 shutdown_connections 2023-10-03T10:17:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.041+0000 7f44f0159700 1 -- 172.21.15.125:0/373796562 wait complete. 2023-10-03T10:17:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 Processor -- start 2023-10-03T10:17:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 -- start start 2023-10-03T10:17:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 0x7f44e811b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e8133b80 0x7f44e811c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e811d920 con 0x7f44e8099a60 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e811ec70 con 0x7f44e80a0e20 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44f0159700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e809a2c0 con 0x7f44e8133b80 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44ed6f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44ee6f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e8133b80 0x7f44e811c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44ed6f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54148/0 (socket says 172.21.15.125:54148) 2023-10-03T10:17:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44ed6f4700 1 -- 172.21.15.125:0/2907149923 learned_addr learned my addr 172.21.15.125:0/2907149923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.042+0000 7f44edef5700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 0x7f44e811b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 -- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e8133b80 msgr2=0x7f44e811c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e8133b80 0x7f44e811c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 -- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 msgr2=0x7f44e811b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 0x7f44e811b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 -- 172.21.15.125:0/2907149923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80094a0 con 0x7f44e80a0e20 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44edef5700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 0x7f44e811b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44ed6f4700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e9b0 tx=0x7f44d800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800ee40 con 0x7f44e80a0e20 2023-10-03T10:17:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800c850 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e0009a70 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800cc00 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.043+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e4009500 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.044+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44d8013470 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.044+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44d803faa0 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.044+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e811e9a0 con 0x7f44e80a0e20 2023-10-03T10:17:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.048+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44d8021080 con 0x7f44e80a0e20 2023-10-03T10:17:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.205+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e100a5660 con 0x7f0e100a1380 2023-10-03T10:17:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.206+0000 7f0e0cff9700 1 -- 172.21.15.125:0/2171281392 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e040253e0 con 0x7f0e100a1380 2023-10-03T10:17:50.206 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:50.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 msgr2=0x7f0e101c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009fd0 tx=0x7f0e04004750 comp rx=0 tx=0).stop 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 shutdown_connections 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e10133f50 0x7f0e101c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e100a0a70 0x7f0e101c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 --2- 172.21.15.125:0/2171281392 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0e100a1380 0x7f0e101c89a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 >> 172.21.15.125:0/2171281392 conn(0x7f0e100a6610 msgr2=0x7f0e100a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 shutdown_connections 2023-10-03T10:17:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.208+0000 7f0e1662a700 1 -- 172.21.15.125:0/2171281392 wait complete. 2023-10-03T10:17:50.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:50.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.242+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44e8134410 con 0x7f44e80a0e20 2023-10-03T10:17:50.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.242+0000 7f44de7fc700 1 -- 172.21.15.125:0/2907149923 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44d8017020 con 0x7f44e80a0e20 2023-10-03T10:17:50.242 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 msgr2=0x7f44e811bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e9b0 tx=0x7f44d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 shutdown_connections 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f44e8133b80 0x7f44e811c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8099a60 0x7f44e811b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 --2- 172.21.15.125:0/2907149923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e80a0e20 0x7f44e811bc80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 >> 172.21.15.125:0/2907149923 conn(0x7f44e80a2980 msgr2=0x7f44e81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 shutdown_connections 2023-10-03T10:17:50.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.244+0000 7f44f0159700 1 -- 172.21.15.125:0/2907149923 wait complete. 2023-10-03T10:17:50.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:50.790 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:50.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:50.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.918+0000 7f5639b77700 1 Processor -- start 2023-10-03T10:17:50.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.918+0000 7f5639b77700 1 -- start start 2023-10-03T10:17:50.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5639b77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5639b77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 0x7f5634138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5639b77700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563409aaa0 con 0x7f563409d860 2023-10-03T10:17:50.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5639b77700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563409e730 con 0x7f5634135f20 2023-10-03T10:17:50.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5639b77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f563409f870 con 0x7f563409e340 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5632ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5632ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51822/0 (socket says 172.21.15.125:51822) 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5632ffd700 1 -- 172.21.15.125:0/93893009 learned_addr learned my addr 172.21.15.125:0/93893009 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.919+0000 7f5633fff700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 0x7f5634138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f56327fc700 1 -- 172.21.15.125:0/93893009 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278284239 0 0) 0x7f563409aaa0 con 0x7f563409d860 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5632ffd700 1 -- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 msgr2=0x7f5634138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5632ffd700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 0x7f5634138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5632ffd700 1 -- 172.21.15.125:0/93893009 >> v1:172.21.15.125:6789/0 conn(0x7f563409d860 legacy=0x7f563409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5632ffd700 1 -- 172.21.15.125:0/93893009 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563409b360 con 0x7f563409e340 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5633fff700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 0x7f5634138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f5632ffd700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f561c009950 tx=0x7f561c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0344690ef3bfef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f56327fc700 1 -- 172.21.15.125:0/93893009 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c011830 con 0x7f563409e340 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f56327fc700 1 -- 172.21.15.125:0/93893009 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c011990 con 0x7f563409e340 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.920+0000 7f56327fc700 1 -- 172.21.15.125:0/93893009 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c011d40 con 0x7f563409e340 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 -- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 msgr2=0x7f56341359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f561c009950 tx=0x7f561c009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 -- 172.21.15.125:0/93893009 shutdown_connections 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5634135f20 0x7f5634138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 --2- 172.21.15.125:0/93893009 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f563409e340 0x7f56341359e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 -- 172.21.15.125:0/93893009 >> 172.21.15.125:0/93893009 conn(0x7f5634099c40 msgr2=0x7f56340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 -- 172.21.15.125:0/93893009 shutdown_connections 2023-10-03T10:17:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.921+0000 7f5639b77700 1 -- 172.21.15.125:0/93893009 wait complete. 2023-10-03T10:17:50.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 Processor -- start 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 -- start start 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 0x7f5634139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 0x7f563413a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634121220 con 0x7f563409d860 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56341205f0 con 0x7f563409e340 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5639b77700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f563411fb90 con 0x7f5634135f20 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f56337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5633fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 0x7f563413a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f56337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55284/0 (socket says 172.21.15.125:55284) 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f56337fe700 1 -- 172.21.15.125:0/1040410096 learned_addr learned my addr 172.21.15.125:0/1040410096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.922+0000 7f5632ffd700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 0x7f5634139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 -- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 msgr2=0x7f563413a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 0x7f563413a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 -- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 msgr2=0x7f5634139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 0x7f5634139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 -- 172.21.15.125:0/1040410096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0094a0 con 0x7f563409d860 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f5633fff700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 0x7f563413a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f5632ffd700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 0x7f5634139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f56337fe700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f562400c8f0 tx=0x7f562400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624003e30 con 0x7f563409d860 2023-10-03T10:17:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624005070 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c009550 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624005420 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.923+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340a27b0 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.924+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5624005580 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.924+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f562403f2e0 con 0x7f563409d860 2023-10-03T10:17:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.924+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563409c910 con 0x7f563409d860 2023-10-03T10:17:50.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.929+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5624019710 con 0x7f563409d860 2023-10-03T10:17:50.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.959+0000 7fd5b53e9700 1 Processor -- start 2023-10-03T10:17:50.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.959+0000 7fd5b53e9700 1 -- start start 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5b53e9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5b00a0a70 0x7fd5b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5b53e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5b53e9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b009dc00 con 0x7fd5b00a1380 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5b53e9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b009ea90 con 0x7fd5b00a0a70 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5b53e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b009dec0 con 0x7fd5b0134120 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54172/0 (socket says 172.21.15.125:54172) 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5b00a0a70 0x7fd5b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5af7fe700 1 -- 172.21.15.125:0/877432750 learned_addr learned my addr 172.21.15.125:0/877432750 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 -- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 msgr2=0x7fd5b013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 -- 172.21.15.125:0/877432750 >> v1:172.21.15.125:6789/0 conn(0x7fd5b00a1380 legacy=0x7fd5b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 -- 172.21.15.125:0/877432750 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b009e6a0 con 0x7fd5b00a0a70 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5adffb700 1 -- 172.21.15.125:0/877432750 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84002919 0 0) 0x7fd5b009dc00 con 0x7fd5b00a1380 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5af7fe700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5aeffd700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b00a0e40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009840 tx=0x7fd5a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1ec2e8fea556b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5adffb700 1 -- 172.21.15.125:0/877432750 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011830 con 0x7fd5b00a0a70 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5adffb700 1 -- 172.21.15.125:0/877432750 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0011990 con 0x7fd5b00a0a70 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.960+0000 7fd5adffb700 1 -- 172.21.15.125:0/877432750 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011d20 con 0x7fd5b00a0a70 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 -- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 msgr2=0x7fd5b00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b00a0e40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009840 tx=0x7fd5a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 -- 172.21.15.125:0/877432750 shutdown_connections 2023-10-03T10:17:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/877432750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b00a0e40 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 -- 172.21.15.125:0/877432750 >> 172.21.15.125:0/877432750 conn(0x7fd5b00a6610 msgr2=0x7fd5b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 -- 172.21.15.125:0/877432750 shutdown_connections 2023-10-03T10:17:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.961+0000 7fd5b53e9700 1 -- 172.21.15.125:0/877432750 wait complete. 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 Processor -- start 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 -- start start 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b0122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5b00a1380 0x7fd5b0122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0133300 con 0x7fd5b00a0a70 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0125920 con 0x7fd5b0134120 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5b53e9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0124310 con 0x7fd5b00a1380 2023-10-03T10:17:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5b00a1380 0x7fd5b0122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54174/0 (socket says 172.21.15.125:54174) 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5af7fe700 1 -- 172.21.15.125:0/1089472129 learned_addr learned my addr 172.21.15.125:0/1089472129 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.963+0000 7fd5aeffd700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b0122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 -- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5b00a1380 msgr2=0x7fd5b0122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5b00a1380 0x7fd5b0122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 -- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 msgr2=0x7fd5b0122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b0122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 -- 172.21.15.125:0/1089472129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009b30 con 0x7fd5b0134120 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5af7fe700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800efc0 tx=0x7fd5a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8018070 con 0x7fd5b0134120 2023-10-03T10:17:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800f040 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a00094a0 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003c20 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.964+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b0125c80 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.965+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5a800c880 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.965+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5a803f7d0 con 0x7fd5b0134120 2023-10-03T10:17:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.965+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b004f2a0 con 0x7fd5b0134120 2023-10-03T10:17:50.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:50.974+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5a8014480 con 0x7fd5b0134120 2023-10-03T10:17:51.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.126+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5634120dc0 con 0x7f563409d860 2023-10-03T10:17:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.126+0000 7f562bfff700 1 -- 172.21.15.125:0/1040410096 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f562401a360 con 0x7f563409d860 2023-10-03T10:17:51.127 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 msgr2=0x7f5634139880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f562400c8f0 tx=0x7f562400cc00 comp rx=0 tx=0).stop 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 shutdown_connections 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5634135f20 0x7f563413a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f563409d860 0x7f5634139880 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 --2- 172.21.15.125:0/1040410096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f563409e340 0x7f5634139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 >> 172.21.15.125:0/1040410096 conn(0x7f5634099c40 msgr2=0x7f56340a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 shutdown_connections 2023-10-03T10:17:51.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.128+0000 7f5639b77700 1 -- 172.21.15.125:0/1040410096 wait complete. 2023-10-03T10:17:51.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:51.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.167+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5b0072980 con 0x7fd5b0134120 2023-10-03T10:17:51.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.167+0000 7fd5977fe700 1 -- 172.21.15.125:0/1089472129 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5a801cbb0 con 0x7fd5b0134120 2023-10-03T10:17:51.168 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 msgr2=0x7fd5b0123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800efc0 tx=0x7fd5a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 shutdown_connections 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b0134120 0x7fd5b0123180 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b00a0a70 0x7fd5b0122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 --2- 172.21.15.125:0/1089472129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd5b00a1380 0x7fd5b0122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 >> 172.21.15.125:0/1089472129 conn(0x7fd5b00a6610 msgr2=0x7fd5b00a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 shutdown_connections 2023-10-03T10:17:51.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.169+0000 7fd5b53e9700 1 -- 172.21.15.125:0/1089472129 wait complete. 2023-10-03T10:17:51.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:51.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:51.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 Processor -- start 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 -- start start 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 0x7f90c4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40a0920 con 0x7f90c409f180 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c409c970 con 0x7f90c409e870 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.348+0000 7f90c98d6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c409bab0 con 0x7f90c4131d70 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 0x7f90c4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54184/0 (socket says 172.21.15.125:54184) 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55308/0 (socket says 172.21.15.125:55308) 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c2ffd700 1 -- 172.21.15.125:0/2403477262 learned_addr learned my addr 172.21.15.125:0/2403477262 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 -- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 msgr2=0x7f90c409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 -- 172.21.15.125:0/2403477262 >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 msgr2=0x7f90c4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2403477262 >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 -- 172.21.15.125:0/2403477262 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c409f9c0 con 0x7f90c4131d70 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c2ffd700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c27fc700 1 --2- 172.21.15.125:0/2403477262 >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 0x7f90c4132210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88efb92ac10e9dca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c1ffb700 1 -- 172.21.15.125:0/2403477262 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00e070 con 0x7f90c4131d70 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c1ffb700 1 -- 172.21.15.125:0/2403477262 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc00bb20 con 0x7f90c4131d70 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.349+0000 7f90c1ffb700 1 -- 172.21.15.125:0/2403477262 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc012430 con 0x7f90c4131d70 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 -- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 msgr2=0x7f90c4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 0x7f90c4132210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009d90 tx=0x7f90bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 -- 172.21.15.125:0/2403477262 shutdown_connections 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409e870 0x7f90c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2403477262 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c4131d70 0x7f90c4132210 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2403477262 >> v2:172.21.15.125:3300/0 conn(0x7f90c409f180 0x7f90c4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 -- 172.21.15.125:0/2403477262 >> 172.21.15.125:0/2403477262 conn(0x7f90c40a4430 msgr2=0x7f90c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 -- 172.21.15.125:0/2403477262 shutdown_connections 2023-10-03T10:17:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.350+0000 7f90c98d6700 1 -- 172.21.15.125:0/2403477262 wait complete. 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 Processor -- start 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 -- start start 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 0x7f90c406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 0x7f90c406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.351+0000 7f90c98d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c406d560 con 0x7f90c4131d70 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c98d6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41229a0 con 0x7f90c409f180 2023-10-03T10:17:51.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c98d6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4131830 con 0x7f90c409e870 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 0x7f90c406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55324/0 (socket says 172.21.15.125:55324) 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 -- 172.21.15.125:0/2573254147 learned_addr learned my addr 172.21.15.125:0/2573254147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c27fc700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 0x7f90c406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 -- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 msgr2=0x7f90c406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 0x7f90c406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 -- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 msgr2=0x7f90c406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 0x7f90c406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 -- 172.21.15.125:0/2573254147 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4009550 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c27fc700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 0x7f90c406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c2ffd700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 0x7f90c406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c37fe700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b680 tx=0x7f90bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004960 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc020070 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b80094a0 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0276c0 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.352+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc009a70 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.353+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c404f2a0 con 0x7f90c4131d70 2023-10-03T10:17:51.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.354+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90bc031470 con 0x7f90c4131d70 2023-10-03T10:17:51.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.354+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90bc022070 con 0x7f90c4131d70 2023-10-03T10:17:51.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.358+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90bc031e30 con 0x7f90c4131d70 2023-10-03T10:17:51.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 Processor -- start 2023-10-03T10:17:51.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 -- start start 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8724136da0 0x7f8724139180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872409bc40 con 0x7f872409e720 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872409b6a0 con 0x7f8724136da0 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.391+0000 7f872359e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87240a0480 con 0x7f872409f200 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8722d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8724136da0 0x7f8724139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51858/0 (socket says 172.21.15.125:51858) 2023-10-03T10:17:51.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 -- 172.21.15.125:0/2009991161 learned_addr learned my addr 172.21.15.125:0/2009991161 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f872259c700 1 --1- 172.21.15.125:0/2009991161 >> v1:172.21.15.125:6789/0 conn(0x7f872409e720 0x7f872409eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45948/0 (socket says 172.21.15.125:45948) 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 -- 172.21.15.125:0/2009991161 >> v2:172.21.15.125:3300/0 conn(0x7f8724136da0 msgr2=0x7f8724139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 --2- 172.21.15.125:0/2009991161 >> v2:172.21.15.125:3300/0 conn(0x7f8724136da0 0x7f8724139180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 -- 172.21.15.125:0/2009991161 >> v1:172.21.15.125:6789/0 conn(0x7f872409e720 legacy=0x7f872409eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 -- 172.21.15.125:0/2009991161 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872409fee0 con 0x7f872409f200 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f8721d9b700 1 --2- 172.21.15.125:0/2009991161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f87180098f0 tx=0x7f8718009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e886923013b9dad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f872159a700 1 -- 172.21.15.125:0/2009991161 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011830 con 0x7f872409f200 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f872159a700 1 -- 172.21.15.125:0/2009991161 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718011990 con 0x7f872409f200 2023-10-03T10:17:51.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.392+0000 7f872159a700 1 -- 172.21.15.125:0/2009991161 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011d20 con 0x7f872409f200 2023-10-03T10:17:51.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 -- 172.21.15.125:0/2009991161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 msgr2=0x7f8724136860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 --2- 172.21.15.125:0/2009991161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f87180098f0 tx=0x7f8718009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:51.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 -- 172.21.15.125:0/2009991161 shutdown_connections 2023-10-03T10:17:51.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 --2- 172.21.15.125:0/2009991161 >> v2:172.21.15.125:3300/0 conn(0x7f8724136da0 0x7f8724139180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 --2- 172.21.15.125:0/2009991161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f872409f200 0x7f8724136860 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 -- 172.21.15.125:0/2009991161 >> 172.21.15.125:0/2009991161 conn(0x7f87240a0d40 msgr2=0x7f87240a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 -- 172.21.15.125:0/2009991161 shutdown_connections 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.393+0000 7f872359e700 1 -- 172.21.15.125:0/2009991161 wait complete. 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 Processor -- start 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 -- start start 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 0x7f87241c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f872409f200 0x7f87241c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87241bd110 con 0x7f872409e720 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872406d610 con 0x7f872409f200 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872359e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872411f2b0 con 0x7f8724136da0 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f8722d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 0x7f87241c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f8722d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51868/0 (socket says 172.21.15.125:51868) 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.394+0000 7f872259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 0x7f87241c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55340/0 (socket says 172.21.15.125:55340) 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 -- 172.21.15.125:0/2803246263 learned_addr learned my addr 172.21.15.125:0/2803246263 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8721d9b700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f872409f200 0x7f87241c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 -- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f872409f200 msgr2=0x7f87241c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f872409f200 0x7f87241c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 -- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 msgr2=0x7f87241c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 0x7f87241c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 -- 172.21.15.125:0/2803246263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718009550 con 0x7f8724136da0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8722d9d700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f871c00efc0 tx=0x7f871c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00cc30 con 0x7f8724136da0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00f040 con 0x7f8724136da0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872409ae00 con 0x7f8724136da0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c014480 con 0x7f8724136da0 2023-10-03T10:17:51.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.395+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872412fee0 con 0x7f8724136da0 2023-10-03T10:17:51.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.396+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f871c0145e0 con 0x7f8724136da0 2023-10-03T10:17:51.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.396+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f871c040390 con 0x7f8724136da0 2023-10-03T10:17:51.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.396+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87241c9120 con 0x7f8724136da0 2023-10-03T10:17:51.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.401+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f871c012520 con 0x7f8724136da0 2023-10-03T10:17:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.551+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90c409f660 con 0x7f90c4131d70 2023-10-03T10:17:51.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.552+0000 7f90abfff700 1 -- 172.21.15.125:0/2573254147 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90bc036090 con 0x7f90c4131d70 2023-10-03T10:17:51.552 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:51.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 msgr2=0x7f90c406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b680 tx=0x7f90bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 shutdown_connections 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90c4131d70 0x7f90c406c330 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f90c409e870 0x7f90c406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 --2- 172.21.15.125:0/2573254147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90c409f180 0x7f90c406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 >> 172.21.15.125:0/2573254147 conn(0x7f90c40a4430 msgr2=0x7f90c409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 shutdown_connections 2023-10-03T10:17:51.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.554+0000 7f90c98d6700 1 -- 172.21.15.125:0/2573254147 wait complete. 2023-10-03T10:17:51.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:51.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.593+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f872411ea30 con 0x7f8724136da0 2023-10-03T10:17:51.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.594+0000 7f8712ffd700 1 -- 172.21.15.125:0/2803246263 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f872411ea30 con 0x7f8724136da0 2023-10-03T10:17:51.594 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:51.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.595+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 msgr2=0x7f872411b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.595+0000 7f872359e700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f871c00efc0 tx=0x7f871c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.595+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 shutdown_connections 2023-10-03T10:17:51.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8724136da0 0x7f872411b5e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f872409e720 0x7f87241c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 --2- 172.21.15.125:0/2803246263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f872409f200 0x7f87241c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 >> 172.21.15.125:0/2803246263 conn(0x7f87240a0d40 msgr2=0x7f872406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 shutdown_connections 2023-10-03T10:17:51.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:51.596+0000 7f872359e700 1 -- 172.21.15.125:0/2803246263 wait complete. 2023-10-03T10:17:51.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:52.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:52.182 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.271+0000 7f64bf238700 1 Processor -- start 2023-10-03T10:17:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.271+0000 7f64bf238700 1 -- start start 2023-10-03T10:17:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bf238700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 0x7f64b809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bf238700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 0x7f64b8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bf238700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b809c970 con 0x7f64b8131d70 2023-10-03T10:17:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bf238700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80a0920 con 0x7f64b809f180 2023-10-03T10:17:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bf238700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64b809f9c0 con 0x7f64b809e870 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64b7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 0x7f64b8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bcfd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 0x7f64b809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bd7d5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f64b8131d70 0x7f64b8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45964/0 (socket says 172.21.15.125:45964) 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bd7d5700 1 -- 172.21.15.125:0/3101014242 learned_addr learned my addr 172.21.15.125:0/3101014242 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bcfd4700 1 -- 172.21.15.125:0/3101014242 >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 msgr2=0x7f64b8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bcfd4700 1 --2- 172.21.15.125:0/3101014242 >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 0x7f64b8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bcfd4700 1 -- 172.21.15.125:0/3101014242 >> v1:172.21.15.125:6789/0 conn(0x7f64b8131d70 legacy=0x7f64b8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64bcfd4700 1 -- 172.21.15.125:0/3101014242 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b809bab0 con 0x7f64b809e870 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64b77fe700 1 -- 172.21.15.125:0/3101014242 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544261540 0 0) 0x7f64b809c970 con 0x7f64b8131d70 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.272+0000 7f64b7fff700 1 --2- 172.21.15.125:0/3101014242 >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 0x7f64b8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bcfd4700 1 --2- 172.21.15.125:0/3101014242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 0x7f64b809ec40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009840 tx=0x7f64ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84bb03dd910bca38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64b77fe700 1 -- 172.21.15.125:0/3101014242 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac011830 con 0x7f64b809e870 2023-10-03T10:17:52.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64b77fe700 1 -- 172.21.15.125:0/3101014242 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac011990 con 0x7f64b809e870 2023-10-03T10:17:52.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64b77fe700 1 -- 172.21.15.125:0/3101014242 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac011d20 con 0x7f64b809e870 2023-10-03T10:17:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 -- 172.21.15.125:0/3101014242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 msgr2=0x7f64b809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 --2- 172.21.15.125:0/3101014242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 0x7f64b809ec40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009840 tx=0x7f64ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 -- 172.21.15.125:0/3101014242 shutdown_connections 2023-10-03T10:17:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 --2- 172.21.15.125:0/3101014242 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b809e870 0x7f64b809ec40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 --2- 172.21.15.125:0/3101014242 >> v2:172.21.15.125:3300/0 conn(0x7f64b809f180 0x7f64b8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 -- 172.21.15.125:0/3101014242 >> 172.21.15.125:0/3101014242 conn(0x7f64b80a4430 msgr2=0x7f64b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 -- 172.21.15.125:0/3101014242 shutdown_connections 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.273+0000 7f64bf238700 1 -- 172.21.15.125:0/3101014242 wait complete. 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.274+0000 7f64bf238700 1 Processor -- start 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.274+0000 7f64bf238700 1 -- start start 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64b809f180 0x7f64b806c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 0x7f64b81c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8122460 con 0x7f64b809e870 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b806cce0 con 0x7f64b809f180 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bf238700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81314b0 con 0x7f64b8131d70 2023-10-03T10:17:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bcfd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 0x7f64b81c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bcfd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55354/0 (socket says 172.21.15.125:55354) 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bcfd4700 1 -- 172.21.15.125:0/361978737 learned_addr learned my addr 172.21.15.125:0/361978737 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64b7fff700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64b809f180 0x7f64b806c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 -- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64b809f180 msgr2=0x7f64b806c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64b809f180 0x7f64b806c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 -- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 msgr2=0x7f64b806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bd7d5700 1 -- 172.21.15.125:0/361978737 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40094a0 con 0x7f64b8131d70 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.275+0000 7f64bcfd4700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64bd7d5700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 0x7f64b81c81c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f64b000cc10 tx=0x7f64b000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000aa00 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000ab80 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0094a0 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00070d0 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.276+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b809dba0 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.277+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64b0007230 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.277+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64b003f390 con 0x7f64b8131d70 2023-10-03T10:17:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.277+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b804f2a0 con 0x7f64b8131d70 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.285+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64b0018070 con 0x7f64b8131d70 2023-10-03T10:17:52.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.314+0000 7fce04a32700 1 Processor -- start 2023-10-03T10:17:52.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.314+0000 7fce04a32700 1 -- start start 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fce04a32700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fce04a32700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fce04a32700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0009e9d0 con 0x7fce000a0a70 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fce04a32700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0009dc00 con 0x7fce000a1550 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fce04a32700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce0009dec0 con 0x7fce00139200 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54234/0 (socket says 172.21.15.125:54234) 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 -- 172.21.15.125:0/3868859781 learned_addr learned my addr 172.21.15.125:0/3868859781 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfed9d700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfe59c700 1 --1- 172.21.15.125:0/3868859781 >> v1:172.21.15.125:6789/0 conn(0x7fce000a0a70 0x7fce000a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45970/0 (socket says 172.21.15.125:45970) 2023-10-03T10:17:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 -- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 msgr2=0x7fce0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfd59a700 1 -- 172.21.15.125:0/3868859781 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814468606 0 0) 0x7fce0009e9d0 con 0x7fce000a0a70 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 -- 172.21.15.125:0/3868859781 >> v1:172.21.15.125:6789/0 conn(0x7fce000a0a70 legacy=0x7fce000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 -- 172.21.15.125:0/3868859781 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0009e6a0 con 0x7fce000a1550 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfed9d700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfdd9b700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009920 tx=0x7fcdf4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef991e339cbadd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfd59a700 1 -- 172.21.15.125:0/3868859781 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4011830 con 0x7fce000a1550 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfd59a700 1 -- 172.21.15.125:0/3868859781 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4011990 con 0x7fce000a1550 2023-10-03T10:17:52.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.315+0000 7fcdfd59a700 1 -- 172.21.15.125:0/3868859781 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4011d20 con 0x7fce000a1550 2023-10-03T10:17:52.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 -- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 msgr2=0x7fce00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009920 tx=0x7fcdf4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:52.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 -- 172.21.15.125:0/3868859781 shutdown_connections 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 --2- 172.21.15.125:0/3868859781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a1550 0x7fce00138cc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 -- 172.21.15.125:0/3868859781 >> 172.21.15.125:0/3868859781 conn(0x7fce000a6610 msgr2=0x7fce000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 -- 172.21.15.125:0/3868859781 shutdown_connections 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.316+0000 7fce04a32700 1 -- 172.21.15.125:0/3868859781 wait complete. 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.317+0000 7fce04a32700 1 Processor -- start 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.317+0000 7fce04a32700 1 -- start start 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a0a70 0x7fce0011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 0x7fce0011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce00120370 con 0x7fce000a1550 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce00134650 con 0x7fce000a0a70 2023-10-03T10:17:52.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce00121fa0 con 0x7fce00139200 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfe59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a0a70 0x7fce0011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51894/0 (socket says 172.21.15.125:51894) 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 -- 172.21.15.125:0/33996517 learned_addr learned my addr 172.21.15.125:0/33996517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfdd9b700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 0x7fce0011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 -- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a0a70 msgr2=0x7fce0011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a0a70 0x7fce0011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 -- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 msgr2=0x7fce0011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 0x7fce0011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 -- 172.21.15.125:0/33996517 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009a70 con 0x7fce00139200 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfdd9b700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 0x7fce0011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdfed9d700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800efb0 tx=0x7fcdf800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800cc90 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800f040 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf4009550 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8014480 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.318+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00120b90 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.319+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdf80145e0 con 0x7fce00139200 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.319+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcdf8040440 con 0x7fce00139200 2023-10-03T10:17:52.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.319+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce000a03e0 con 0x7fce00139200 2023-10-03T10:17:52.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.324+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdf8012930 con 0x7fce00139200 2023-10-03T10:17:52.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.480+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f64b81216b0 con 0x7f64b8131d70 2023-10-03T10:17:52.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.480+0000 7f64b57fa700 1 -- 172.21.15.125:0/361978737 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64b0018070 con 0x7f64b8131d70 2023-10-03T10:17:52.481 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 msgr2=0x7f64b81c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 0x7f64b81c81c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f64b000cc10 tx=0x7f64b000cf20 comp rx=0 tx=0).stop 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 shutdown_connections 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f64b8131d70 0x7f64b81c81c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64b809e870 0x7f64b806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.482+0000 7f64bf238700 1 --2- 172.21.15.125:0/361978737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64b809f180 0x7f64b806c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.483+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 >> 172.21.15.125:0/361978737 conn(0x7f64b80a4430 msgr2=0x7f64b81b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.483+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 shutdown_connections 2023-10-03T10:17:52.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.483+0000 7f64bf238700 1 -- 172.21.15.125:0/361978737 wait complete. 2023-10-03T10:17:52.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:52.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.519+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fce0004f2a0 con 0x7fce00139200 2023-10-03T10:17:52.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.519+0000 7fcdeeffd700 1 -- 172.21.15.125:0/33996517 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdf802c090 con 0x7fce00139200 2023-10-03T10:17:52.520 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 msgr2=0x7fce0011f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800efb0 tx=0x7fcdf800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 shutdown_connections 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fce00139200 0x7fce0011f230 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce000a0a70 0x7fce0011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 --2- 172.21.15.125:0/33996517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce000a1550 0x7fce0011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 >> 172.21.15.125:0/33996517 conn(0x7fce000a6610 msgr2=0x7fce000a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 shutdown_connections 2023-10-03T10:17:52.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.521+0000 7fce04a32700 1 -- 172.21.15.125:0/33996517 wait complete. 2023-10-03T10:17:52.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:52.567 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:52.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:52.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.699+0000 7f92d501e700 1 Processor -- start 2023-10-03T10:17:52.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.699+0000 7f92d501e700 1 -- start start 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92d501e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 0x7f92d006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92d501e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92d501e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d006e900 con 0x7f92d009dec0 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92d501e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d009d180 con 0x7f92d0136cb0 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92d501e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d009e780 con 0x7f92d006a770 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92ce59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f92d009dec0 0x7f92d006b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45976/0 (socket says 172.21.15.125:45976) 2023-10-03T10:17:52.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92ce59c700 1 -- 172.21.15.125:0/2197605205 learned_addr learned my addr 172.21.15.125:0/2197605205 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cf59e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92ced9d700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 0x7f92d006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cf59e700 1 -- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 msgr2=0x7f92d006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cdd9b700 1 -- 172.21.15.125:0/2197605205 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544667730 0 0) 0x7f92d006e900 con 0x7f92d009dec0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cf59e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 0x7f92d006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cf59e700 1 -- 172.21.15.125:0/2197605205 >> v1:172.21.15.125:6789/0 conn(0x7f92d009dec0 legacy=0x7f92d006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.700+0000 7f92cf59e700 1 -- 172.21.15.125:0/2197605205 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d009d3c0 con 0x7f92d0136cb0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92ced9d700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 0x7f92d006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92cf59e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0139090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009dc0 tx=0x7f92c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6a14915d345f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92cdd9b700 1 -- 172.21.15.125:0/2197605205 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800e070 con 0x7f92d0136cb0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92cdd9b700 1 -- 172.21.15.125:0/2197605205 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800bb20 con 0x7f92d0136cb0 2023-10-03T10:17:52.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92cdd9b700 1 -- 172.21.15.125:0/2197605205 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8012430 con 0x7f92d0136cb0 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 -- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 msgr2=0x7f92d0139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0139090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009dc0 tx=0x7f92c800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 -- 172.21.15.125:0/2197605205 shutdown_connections 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0139090 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 --2- 172.21.15.125:0/2197605205 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d006a770 0x7f92d006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 -- 172.21.15.125:0/2197605205 >> 172.21.15.125:0/2197605205 conn(0x7f92d0099c40 msgr2=0x7f92d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 -- 172.21.15.125:0/2197605205 shutdown_connections 2023-10-03T10:17:52.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.701+0000 7f92d501e700 1 -- 172.21.15.125:0/2197605205 wait complete. 2023-10-03T10:17:52.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.703+0000 7f92d501e700 1 Processor -- start 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.703+0000 7f92d501e700 1 -- start start 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 0x7f92d0133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0071d70 con 0x7f92d006a770 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d011a760 con 0x7f92d0136cb0 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92d501e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0135760 con 0x7f92d009dec0 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92cf59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51906/0 (socket says 172.21.15.125:51906) 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92cf59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54262/0 (socket says 172.21.15.125:54262) 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 -- 172.21.15.125:0/842140229 learned_addr learned my addr 172.21.15.125:0/842140229 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ced9d700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 0x7f92d0133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 -- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 msgr2=0x7f92d0134510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 -- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 msgr2=0x7f92d0133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 0x7f92d0133a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 -- 172.21.15.125:0/842140229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00094a0 con 0x7f92d009dec0 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92cf59e700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ced9d700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 0x7f92d0133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92ce59c700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c550 tx=0x7f92c400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.704+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004c80 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.705+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4004e00 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.705+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8009a70 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.705+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4007310 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.705+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d011aa40 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.705+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c4007470 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.706+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f92c403f290 con 0x7f92d009dec0 2023-10-03T10:17:52.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.706+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d011a8a0 con 0x7f92d009dec0 2023-10-03T10:17:52.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.710+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92d011a8a0 con 0x7f92d009dec0 2023-10-03T10:17:52.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 Processor -- start 2023-10-03T10:17:52.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 -- start start 2023-10-03T10:17:52.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 0x7f4a140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1409dc00 con 0x7f4a140a1380 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1409ea90 con 0x7f4a140a0a70 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a1b105700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409dec0 con 0x7f4a14134120 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a196a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a18ea1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 0x7f4a140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a196a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54276/0 (socket says 172.21.15.125:54276) 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a18ea1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 0x7f4a140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55366/0 (socket says 172.21.15.125:55366) 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a196a2700 1 -- 172.21.15.125:0/1072559793 learned_addr learned my addr 172.21.15.125:0/1072559793 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.743+0000 7f4a13fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4a140a1380 0x7f4a14133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45980/0 (socket says 172.21.15.125:45980) 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a196a2700 1 -- 172.21.15.125:0/1072559793 >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 msgr2=0x7f4a140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a196a2700 1 --2- 172.21.15.125:0/1072559793 >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 0x7f4a140a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a196a2700 1 -- 172.21.15.125:0/1072559793 >> v1:172.21.15.125:6789/0 conn(0x7f4a140a1380 legacy=0x7f4a14133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a196a2700 1 -- 172.21.15.125:0/1072559793 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1409e6a0 con 0x7f4a14134120 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a196a2700 1 --2- 172.21.15.125:0/1072559793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009e50 tx=0x7f4a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eaa7c2c5ad36df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a137fe700 1 -- 172.21.15.125:0/1072559793 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00e070 con 0x7f4a14134120 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a137fe700 1 -- 172.21.15.125:0/1072559793 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00b910 con 0x7f4a14134120 2023-10-03T10:17:52.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.744+0000 7f4a137fe700 1 -- 172.21.15.125:0/1072559793 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00bcc0 con 0x7f4a14134120 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 -- 172.21.15.125:0/1072559793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 msgr2=0x7f4a1413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 --2- 172.21.15.125:0/1072559793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009e50 tx=0x7f4a0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 -- 172.21.15.125:0/1072559793 shutdown_connections 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 --2- 172.21.15.125:0/1072559793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a14134120 0x7f4a1413bce0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 --2- 172.21.15.125:0/1072559793 >> v2:172.21.15.125:3300/0 conn(0x7f4a140a0a70 0x7f4a140a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 -- 172.21.15.125:0/1072559793 >> 172.21.15.125:0/1072559793 conn(0x7f4a140a6610 msgr2=0x7f4a140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 -- 172.21.15.125:0/1072559793 shutdown_connections 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.745+0000 7f4a1b105700 1 -- 172.21.15.125:0/1072559793 wait complete. 2023-10-03T10:17:52.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 Processor -- start 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 -- start start 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 0x7f4a14122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 0x7f4a141232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14126190 con 0x7f4a14134120 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14125dd0 con 0x7f4a140a1380 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a1b105700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14126370 con 0x7f4a140a0a70 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a13fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a13fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54278/0 (socket says 172.21.15.125:54278) 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a13fff700 1 -- 172.21.15.125:0/2040118044 learned_addr learned my addr 172.21.15.125:0/2040118044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a18ea1700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 0x7f4a14122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.746+0000 7f4a196a2700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 0x7f4a141232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 -- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 msgr2=0x7f4a14122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 0x7f4a14122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 -- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 msgr2=0x7f4a141232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 0x7f4a141232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 -- 172.21.15.125:0/2040118044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c009b30 con 0x7f4a140a1380 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a18ea1700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 0x7f4a14122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a196a2700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 0x7f4a141232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a13fff700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c520 tx=0x7f4a0000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00005cb0 con 0x7f4a140a1380 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00005e10 con 0x7f4a140a1380 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a14124570 con 0x7f4a140a1380 2023-10-03T10:17:52.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000072d0 con 0x7f4a140a1380 2023-10-03T10:17:52.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.747+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a141339e0 con 0x7f4a140a1380 2023-10-03T10:17:52.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.748+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a00007430 con 0x7f4a140a1380 2023-10-03T10:17:52.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.748+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1404f2a0 con 0x7f4a140a1380 2023-10-03T10:17:52.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.748+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a0003ea00 con 0x7f4a140a1380 2023-10-03T10:17:52.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.753+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a0001b3b0 con 0x7f4a140a1380 2023-10-03T10:17:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.904+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92d011a8a0 con 0x7f92d009dec0 2023-10-03T10:17:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.904+0000 7f92b77fe700 1 -- 172.21.15.125:0/842140229 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92d011a8a0 con 0x7f92d009dec0 2023-10-03T10:17:52.905 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 msgr2=0x7f92d0133fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c550 tx=0x7f92c400c860 comp rx=0 tx=0).stop 2023-10-03T10:17:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 shutdown_connections 2023-10-03T10:17:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92d0136cb0 0x7f92d0134510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92d006a770 0x7f92d0133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 --2- 172.21.15.125:0/842140229 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f92d009dec0 0x7f92d0133fd0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 >> 172.21.15.125:0/842140229 conn(0x7f92d0099c40 msgr2=0x7f92d0136360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 shutdown_connections 2023-10-03T10:17:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.907+0000 7f92d501e700 1 -- 172.21.15.125:0/842140229 wait complete. 2023-10-03T10:17:52.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:52.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.945+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a14072980 con 0x7f4a140a1380 2023-10-03T10:17:52.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.945+0000 7f4a117fa700 1 -- 172.21.15.125:0/2040118044 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a00017030 con 0x7f4a140a1380 2023-10-03T10:17:52.946 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:52.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 msgr2=0x7f4a14122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c520 tx=0x7f4a0000c830 comp rx=0 tx=0).stop 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 shutdown_connections 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a14134120 0x7f4a141232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4a140a0a70 0x7f4a14122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 --2- 172.21.15.125:0/2040118044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4a140a1380 0x7f4a14122d90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 >> 172.21.15.125:0/2040118044 conn(0x7f4a140a6610 msgr2=0x7f4a140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 shutdown_connections 2023-10-03T10:17:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:52.948+0000 7f4a1b105700 1 -- 172.21.15.125:0/2040118044 wait complete. 2023-10-03T10:17:52.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:53.496 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:53.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 Processor -- start 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 -- start start 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a4131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a4131670 con 0x7f75a409d860 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a409aaa0 con 0x7f75a409e170 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75aa101700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a409f870 con 0x7f75a4130ce0 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54282/0 (socket says 172.21.15.125:54282) 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a4131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55388/0 (socket says 172.21.15.125:55388) 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.624+0000 7f75a2ffd700 1 -- 172.21.15.125:0/4052860306 learned_addr learned my addr 172.21.15.125:0/4052860306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 -- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 msgr2=0x7f75a4131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a4131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 -- 172.21.15.125:0/4052860306 >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 msgr2=0x7f75a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 --2- 172.21.15.125:0/4052860306 >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 -- 172.21.15.125:0/4052860306 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a409b360 con 0x7f75a409e170 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a3fff700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a4131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a37fe700 1 --2- 172.21.15.125:0/4052860306 >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a2ffd700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f75980098f0 tx=0x7f7598009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4eceecacac2bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a27fc700 1 -- 172.21.15.125:0/4052860306 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598011830 con 0x7f75a409e170 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a27fc700 1 -- 172.21.15.125:0/4052860306 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598011990 con 0x7f75a409e170 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75a27fc700 1 -- 172.21.15.125:0/4052860306 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598011d20 con 0x7f75a409e170 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 -- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 msgr2=0x7f75a41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f75980098f0 tx=0x7f7598009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 -- 172.21.15.125:0/4052860306 shutdown_connections 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a4131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 --2- 172.21.15.125:0/4052860306 >> v2:172.21.15.125:3300/0 conn(0x7f75a409d860 0x7f75a409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 --2- 172.21.15.125:0/4052860306 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a41307a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 -- 172.21.15.125:0/4052860306 >> 172.21.15.125:0/4052860306 conn(0x7f75a4099c40 msgr2=0x7f75a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 -- 172.21.15.125:0/4052860306 shutdown_connections 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.625+0000 7f75aa101700 1 -- 172.21.15.125:0/4052860306 wait complete. 2023-10-03T10:17:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.626+0000 7f75aa101700 1 Processor -- start 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 -- start start 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 0x7f75a411ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a411c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40a3410 con 0x7f75a409d860 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a411da00 con 0x7f75a409e170 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75aa101700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a409c8b0 con 0x7f75a4130ce0 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a411c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 0x7f75a411ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54298/0 (socket says 172.21.15.125:54298) 2023-10-03T10:17:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a2ffd700 1 -- 172.21.15.125:0/1606567836 learned_addr learned my addr 172.21.15.125:0/1606567836 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 -- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 msgr2=0x7f75a411bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 -- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 msgr2=0x7f75a411ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 0x7f75a411ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a3fff700 1 -- 172.21.15.125:0/1606567836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940094a0 con 0x7f75a4130ce0 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a2ffd700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.627+0000 7f75a37fe700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 0x7f75a411ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f75a3fff700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a411c4f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f759c00efc0 tx=0x7f759c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00ca90 con 0x7f75a4130ce0 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00f040 con 0x7f75a4130ce0 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c009a70 con 0x7f75a4130ce0 2023-10-03T10:17:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00ce30 con 0x7f75a4130ce0 2023-10-03T10:17:53.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598009550 con 0x7f75a4130ce0 2023-10-03T10:17:53.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.628+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f759c014480 con 0x7f75a4130ce0 2023-10-03T10:17:53.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.629+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f759c03fbd0 con 0x7f75a4130ce0 2023-10-03T10:17:53.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.629+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a409d380 con 0x7f75a4130ce0 2023-10-03T10:17:53.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.633+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f759c012930 con 0x7f75a4130ce0 2023-10-03T10:17:53.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.794+0000 7f13c7d7b700 1 Processor -- start 2023-10-03T10:17:53.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 -- start start 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c009c970 con 0x7f13c0131d70 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00a0920 con 0x7f13c009e870 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c7d7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009f9c0 con 0x7f13c009f180 2023-10-03T10:17:53.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c5b17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c5b17700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54300/0 (socket says 172.21.15.125:54300) 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c6318700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13c0131d70 0x7f13c0138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45984/0 (socket says 172.21.15.125:45984) 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c5b17700 1 -- 172.21.15.125:0/23787631 learned_addr learned my addr 172.21.15.125:0/23787631 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.795+0000 7f13c5316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5316700 1 -- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 msgr2=0x7f13c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5316700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5316700 1 -- 172.21.15.125:0/23787631 >> v1:172.21.15.125:6789/0 conn(0x7f13c0131d70 legacy=0x7f13c0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c4b15700 1 -- 172.21.15.125:0/23787631 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171097983 0 0) 0x7f13c009c970 con 0x7f13c0131d70 2023-10-03T10:17:53.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5316700 1 -- 172.21.15.125:0/23787631 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c009bab0 con 0x7f13c009f180 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5b17700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c5316700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c0131830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009870 tx=0x7f13bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457ecdcbf9f9358 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c4b15700 1 -- 172.21.15.125:0/23787631 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011830 con 0x7f13c009f180 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c4b15700 1 -- 172.21.15.125:0/23787631 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc011990 con 0x7f13c009f180 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.796+0000 7f13c4b15700 1 -- 172.21.15.125:0/23787631 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011d20 con 0x7f13c009f180 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 -- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 msgr2=0x7f13c0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c0131830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009870 tx=0x7f13bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 -- 172.21.15.125:0/23787631 shutdown_connections 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c009e870 0x7f13c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/23787631 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c0131830 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 -- 172.21.15.125:0/23787631 >> 172.21.15.125:0/23787631 conn(0x7f13c00a4430 msgr2=0x7f13c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 -- 172.21.15.125:0/23787631 shutdown_connections 2023-10-03T10:17:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.797+0000 7f13c7d7b700 1 -- 172.21.15.125:0/23787631 wait complete. 2023-10-03T10:17:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 Processor -- start 2023-10-03T10:17:53.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 -- start start 2023-10-03T10:17:53.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13c009e870 0x7f13c0120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c0131d70 0x7f13c0120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0121760 con 0x7f13c009e870 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0123d60 con 0x7f13c0131d70 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c7d7b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0122ce0 con 0x7f13c009f180 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c5316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.798+0000 7f13c6318700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c0131d70 0x7f13c0120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51964/0 (socket says 172.21.15.125:51964) 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 -- 172.21.15.125:0/3786319422 learned_addr learned my addr 172.21.15.125:0/3786319422 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5b17700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13c009e870 0x7f13c0120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 -- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c0131d70 msgr2=0x7f13c0120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c0131d70 0x7f13c0120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 -- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13c009e870 msgr2=0x7f13c0120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13c009e870 0x7f13c0120290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 -- 172.21.15.125:0/3786319422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009550 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c5316700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f13bc013000 tx=0x7f13bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc004510 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc01f070 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc0094a0 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0038c0 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.799+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c01230a0 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.800+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13bc003a20 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.800+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c011d580 con 0x7f13c009f180 2023-10-03T10:17:53.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.800+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13bc021070 con 0x7f13c009f180 2023-10-03T10:17:53.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.804+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13bc024be0 con 0x7f13c009f180 2023-10-03T10:17:53.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.831+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75a404f2a0 con 0x7f75a4130ce0 2023-10-03T10:17:53.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.831+0000 7f758bfff700 1 -- 172.21.15.125:0/1606567836 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f759c009cc0 con 0x7f75a4130ce0 2023-10-03T10:17:53.832 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 msgr2=0x7f75a411c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a411c4f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f759c00efc0 tx=0x7f759c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 shutdown_connections 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f75a4130ce0 0x7f75a411c4f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75a409d860 0x7f75a411ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 --2- 172.21.15.125:0/1606567836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f75a409e170 0x7f75a411bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 >> 172.21.15.125:0/1606567836 conn(0x7f75a4099c40 msgr2=0x7f75a41b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 shutdown_connections 2023-10-03T10:17:53.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.833+0000 7f75aa101700 1 -- 172.21.15.125:0/1606567836 wait complete. 2023-10-03T10:17:53.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:53.919 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:53.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:53.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.998+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13c004f2a0 con 0x7f13c009f180 2023-10-03T10:17:53.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:53.998+0000 7f13b67fc700 1 -- 172.21.15.125:0/3786319422 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13bc02b030 con 0x7f13c009f180 2023-10-03T10:17:53.999 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:54.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 msgr2=0x7f13c01207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f13bc013000 tx=0x7f13bc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 shutdown_connections 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13c0131d70 0x7f13c0120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13c009e870 0x7f13c0120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 --2- 172.21.15.125:0/3786319422 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f13c009f180 0x7f13c01207d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 >> 172.21.15.125:0/3786319422 conn(0x7f13c00a4430 msgr2=0x7f13c011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 shutdown_connections 2023-10-03T10:17:54.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.000+0000 7f13c7d7b700 1 -- 172.21.15.125:0/3786319422 wait complete. 2023-10-03T10:17:54.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:54.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.047+0000 7f2edcaa3700 1 Processor -- start 2023-10-03T10:17:54.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.047+0000 7f2edcaa3700 1 -- start start 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2edcaa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2edcaa3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2ed809bc70 0x7f2ed809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2edcaa3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80a1640 con 0x7f2ed809c5c0 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2edcaa3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed806eb30 con 0x7f2ed809bc70 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2edcaa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a22d0 con 0x7f2ed8131980 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2ed809bc70 0x7f2ed809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54316/0 (socket says 172.21.15.125:54316) 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed6d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2ed809c5c0 0x7f2ed8138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45986/0 (socket says 172.21.15.125:45986) 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed659c700 1 -- 172.21.15.125:0/2318437768 learned_addr learned my addr 172.21.15.125:0/2318437768 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 -- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 msgr2=0x7f2ed8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 -- 172.21.15.125:0/2318437768 >> v1:172.21.15.125:6789/0 conn(0x7f2ed809c5c0 legacy=0x7f2ed8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 -- 172.21.15.125:0/2318437768 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8131550 con 0x7f2ed809bc70 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed559a700 1 -- 172.21.15.125:0/2318437768 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028594426 0 0) 0x7f2ed80a1640 con 0x7f2ed809c5c0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed659c700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed5d9b700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809bc70 0x7f2ed809c080 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009840 tx=0x7f2ecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf33eb88d68c01eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.048+0000 7f2ed559a700 1 -- 172.21.15.125:0/2318437768 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc011830 con 0x7f2ed809bc70 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2ed559a700 1 -- 172.21.15.125:0/2318437768 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc011990 con 0x7f2ed809bc70 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2ed559a700 1 -- 172.21.15.125:0/2318437768 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc011d20 con 0x7f2ed809bc70 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 -- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809bc70 msgr2=0x7f2ed809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809bc70 0x7f2ed809c080 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009840 tx=0x7f2ecc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 -- 172.21.15.125:0/2318437768 shutdown_connections 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed8131980 0x7f2ed8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/2318437768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed809bc70 0x7f2ed809c080 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 -- 172.21.15.125:0/2318437768 >> 172.21.15.125:0/2318437768 conn(0x7f2ed80a2980 msgr2=0x7f2ed80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 -- 172.21.15.125:0/2318437768 shutdown_connections 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.049+0000 7f2edcaa3700 1 -- 172.21.15.125:0/2318437768 wait complete. 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.050+0000 7f2edcaa3700 1 Processor -- start 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.050+0000 7f2edcaa3700 1 -- start start 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809c5c0 0x7f2ed809a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8121ae0 con 0x7f2ed8131980 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8120470 con 0x7f2ed809bc70 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2edcaa3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8120840 con 0x7f2ed809c5c0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54318/0 (socket says 172.21.15.125:54318) 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 -- 172.21.15.125:0/884672502 learned_addr learned my addr 172.21.15.125:0/884672502 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55436/0 (socket says 172.21.15.125:55436) 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 -- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809c5c0 msgr2=0x7f2ed809a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809c5c0 0x7f2ed809a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 -- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 msgr2=0x7f2ed81c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 -- 172.21.15.125:0/884672502 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009500 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed6d9d700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.051+0000 7f2ed659c700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800ebb0 tx=0x7f2ec800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8005a20 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8005b80 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc0094a0 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800c850 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8130b00 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.052+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed81b8570 con 0x7f2ed809bc70 2023-10-03T10:17:54.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.053+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec800c9b0 con 0x7f2ed809bc70 2023-10-03T10:17:54.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.053+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ec803ffd0 con 0x7f2ed809bc70 2023-10-03T10:17:54.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.057+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec8023350 con 0x7f2ed809bc70 2023-10-03T10:17:54.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 Processor -- start 2023-10-03T10:17:54.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 -- start start 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 0x7f3c54138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5409aaa0 con 0x7f3c5409e170 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5409f870 con 0x7f3c5409d860 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.090+0000 7f3c5aa4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5409b360 con 0x7f3c54130eb0 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c53fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c53fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55446/0 (socket says 172.21.15.125:55446) 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c537fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3c5409e170 0x7f3c541307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46002/0 (socket says 172.21.15.125:46002) 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c53fff700 1 -- 172.21.15.125:0/1809245513 learned_addr learned my addr 172.21.15.125:0/1809245513 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 --2- 172.21.15.125:0/1809245513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 0x7f3c54138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 -- 172.21.15.125:0/1809245513 >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 msgr2=0x7f3c5409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 --2- 172.21.15.125:0/1809245513 >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 -- 172.21.15.125:0/1809245513 >> v1:172.21.15.125:6789/0 conn(0x7f3c5409e170 legacy=0x7f3c541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 -- 172.21.15.125:0/1809245513 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5409b620 con 0x7f3c54130eb0 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c53fff700 1 --2- 172.21.15.125:0/1809245513 >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c58fec700 1 --2- 172.21.15.125:0/1809245513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 0x7f3c54138a00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009d90 tx=0x7f3c4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1cd575df9142556 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c52ffd700 1 -- 172.21.15.125:0/1809245513 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00e070 con 0x7f3c54130eb0 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c52ffd700 1 -- 172.21.15.125:0/1809245513 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00bb20 con 0x7f3c54130eb0 2023-10-03T10:17:54.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.091+0000 7f3c52ffd700 1 -- 172.21.15.125:0/1809245513 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c012430 con 0x7f3c54130eb0 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/1809245513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 msgr2=0x7f3c54138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/1809245513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 0x7f3c54138a00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009d90 tx=0x7f3c4c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/1809245513 shutdown_connections 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/1809245513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c54130eb0 0x7f3c54138a00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/1809245513 >> v2:172.21.15.125:3300/0 conn(0x7f3c5409d860 0x7f3c5409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/1809245513 >> 172.21.15.125:0/1809245513 conn(0x7f3c54099c40 msgr2=0x7f3c540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/1809245513 shutdown_connections 2023-10-03T10:17:54.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.092+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/1809245513 wait complete. 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 Processor -- start 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 -- start start 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 0x7f3c5411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c54130eb0 0x7f3c5411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541201e0 con 0x7f3c54130eb0 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5411fff0 con 0x7f3c5409d860 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.093+0000 7f3c5aa4f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540a21b0 con 0x7f3c5409e170 2023-10-03T10:17:54.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c537fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 0x7f3c5411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54330/0 (socket says 172.21.15.125:54330) 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c537fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 0x7f3c5411ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51992/0 (socket says 172.21.15.125:51992) 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 -- 172.21.15.125:0/3201996736 learned_addr learned my addr 172.21.15.125:0/3201996736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c58fec700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c54130eb0 0x7f3c5411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 -- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 msgr2=0x7f3c5411ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 0x7f3c5411ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 -- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c54130eb0 msgr2=0x7f3c5411ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c54130eb0 0x7f3c5411ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 -- 172.21.15.125:0/3201996736 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009550 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c53fff700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800ebe0 tx=0x7f3c4800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800c850 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800c9b0 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c009a70 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800cd40 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.094+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c54121c90 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.095+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c48013470 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.095+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3c4803fd50 con 0x7f3c5409d860 2023-10-03T10:17:54.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.095+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5404f2a0 con 0x7f3c5409d860 2023-10-03T10:17:54.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.100+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c4801b3b0 con 0x7f3c5409d860 2023-10-03T10:17:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.253+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ed8121760 con 0x7f2ed809bc70 2023-10-03T10:17:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.253+0000 7f2ec6ffd700 1 -- 172.21.15.125:0/884672502 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ed8121760 con 0x7f2ed809bc70 2023-10-03T10:17:54.254 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 msgr2=0x7f2ed809a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800ebb0 tx=0x7f2ec800eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 shutdown_connections 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ed8131980 0x7f2ed81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ed809bc70 0x7f2ed809a360 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 --2- 172.21.15.125:0/884672502 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2ed809c5c0 0x7f2ed809a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 >> 172.21.15.125:0/884672502 conn(0x7f2ed80a2980 msgr2=0x7f2ed8070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 shutdown_connections 2023-10-03T10:17:54.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.255+0000 7f2edcaa3700 1 -- 172.21.15.125:0/884672502 wait complete. 2023-10-03T10:17:54.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:54.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.296+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c5406c3b0 con 0x7f3c5409d860 2023-10-03T10:17:54.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.296+0000 7f3c50ff9700 1 -- 172.21.15.125:0/3201996736 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c48024350 con 0x7f3c5409d860 2023-10-03T10:17:54.297 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 msgr2=0x7f3c5411e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800ebe0 tx=0x7f3c4800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 shutdown_connections 2023-10-03T10:17:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c54130eb0 0x7f3c5411ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c5409d860 0x7f3c5411e4d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 --2- 172.21.15.125:0/3201996736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3c5409e170 0x7f3c5411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 >> 172.21.15.125:0/3201996736 conn(0x7f3c54099c40 msgr2=0x7f3c540a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 shutdown_connections 2023-10-03T10:17:54.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.298+0000 7f3c5aa4f700 1 -- 172.21.15.125:0/3201996736 wait complete. 2023-10-03T10:17:54.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:54.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.975+0000 7fc2d7cc9700 1 Processor -- start 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.975+0000 7fc2d7cc9700 1 -- start start 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d7cc9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d7cc9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2d009e170 0x7fc2d01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d7cc9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d009aaa0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d7cc9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d009f870 con 0x7fc2d009e170 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d7cc9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d009b360 con 0x7fc2d009d860 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2d009e170 0x7fc2d01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5a65700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5a65700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:51996/0 (socket says 172.21.15.125:51996) 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2d009e170 0x7fc2d01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55460/0 (socket says 172.21.15.125:55460) 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d6266700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2d0130ce0 0x7fc2d01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46014/0 (socket says 172.21.15.125:46014) 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5a65700 1 -- 172.21.15.125:0/2019080245 learned_addr learned my addr 172.21.15.125:0/2019080245 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 -- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 msgr2=0x7fc2d009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 -- 172.21.15.125:0/2019080245 >> v1:172.21.15.125:6789/0 conn(0x7fc2d0130ce0 legacy=0x7fc2d01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 -- 172.21.15.125:0/2019080245 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d009b620 con 0x7fc2d009e170 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d4a63700 1 -- 172.21.15.125:0/2019080245 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615470307 0 0) 0x7fc2d009aaa0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5a65700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.976+0000 7fc2d5264700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d01307a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009840 tx=0x7fc2cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51f16ab4399170d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d4a63700 1 -- 172.21.15.125:0/2019080245 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc011830 con 0x7fc2d009e170 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d4a63700 1 -- 172.21.15.125:0/2019080245 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc011990 con 0x7fc2d009e170 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d4a63700 1 -- 172.21.15.125:0/2019080245 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc011d20 con 0x7fc2d009e170 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 msgr2=0x7fc2d01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d01307a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009840 tx=0x7fc2cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/2019080245 shutdown_connections 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d009d860 0x7fc2d009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/2019080245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d01307a0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/2019080245 >> 172.21.15.125:0/2019080245 conn(0x7fc2d0099c40 msgr2=0x7fc2d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/2019080245 shutdown_connections 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.977+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/2019080245 wait complete. 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 Processor -- start 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 -- start start 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2d009d860 0x7fc2d01355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d0135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.978+0000 7fc2d7cc9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0138ab0 con 0x7fc2d009e170 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d7cc9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d01387e0 con 0x7fc2d009d860 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d7cc9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0072740 con 0x7fc2d0130ce0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d5a65700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2d009d860 0x7fc2d01355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:52012/0 (socket says 172.21.15.125:52012) 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 -- 172.21.15.125:0/819686320 learned_addr learned my addr 172.21.15.125:0/819686320 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d5264700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d0135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 -- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2d009d860 msgr2=0x7fc2d01355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2d009d860 0x7fc2d01355d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 -- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 msgr2=0x7fc2d0135b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d0135b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 -- 172.21.15.125:0/819686320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0009550 con 0x7fc2d0130ce0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d6266700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8002230 tx=0x7fc2c800cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800aac0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800ac40 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0094a0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80070d0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.979+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d01376a0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.980+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2c8007250 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.980+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2c803f4f0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.980+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d004f2a0 con 0x7fc2d0130ce0 2023-10-03T10:17:54.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:54.985+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2c8018080 con 0x7fc2d0130ce0 2023-10-03T10:17:55.014 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:55.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 Processor -- start 2023-10-03T10:17:55.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 -- start start 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb18409ad40 0x7fb184133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 0x7fb1841343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18409b110 con 0x7fb1840a0a70 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1840a3b60 con 0x7fb18409ad40 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb18a012700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1841348e0 con 0x7fb184133f70 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb1837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb18409ad40 0x7fb184133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb182ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 0x7fb1841343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb183fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1840a0a70 0x7fb1840a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46016/0 (socket says 172.21.15.125:46016) 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb1837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb18409ad40 0x7fb184133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55490/0 (socket says 172.21.15.125:55490) 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.138+0000 7fb183fff700 1 -- 172.21.15.125:0/1644129548 learned_addr learned my addr 172.21.15.125:0/1644129548 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1837fe700 1 -- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 msgr2=0x7fb1841343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1837fe700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 0x7fb1841343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1837fe700 1 -- 172.21.15.125:0/1644129548 >> v1:172.21.15.125:6789/0 conn(0x7fb1840a0a70 legacy=0x7fb1840a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1837fe700 1 -- 172.21.15.125:0/1644129548 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840a2fa0 con 0x7fb18409ad40 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1827fc700 1 -- 172.21.15.125:0/1644129548 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650464369 0 0) 0x7fb18409b110 con 0x7fb1840a0a70 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb182ffd700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 0x7fb1841343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1837fe700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb18409ad40 0x7fb184133a30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb174009840 tx=0x7fb174009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5c145ebd0cea57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1827fc700 1 -- 172.21.15.125:0/1644129548 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174011830 con 0x7fb18409ad40 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1827fc700 1 -- 172.21.15.125:0/1644129548 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174011990 con 0x7fb18409ad40 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.139+0000 7fb1827fc700 1 -- 172.21.15.125:0/1644129548 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174011d20 con 0x7fb18409ad40 2023-10-03T10:17:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 -- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb18409ad40 msgr2=0x7fb184133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb18409ad40 0x7fb184133a30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb174009840 tx=0x7fb174009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 -- 172.21.15.125:0/1644129548 shutdown_connections 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb18409ad40 0x7fb184133a30 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 --2- 172.21.15.125:0/1644129548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb184133f70 0x7fb1841343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 -- 172.21.15.125:0/1644129548 >> 172.21.15.125:0/1644129548 conn(0x7fb184099c40 msgr2=0x7fb18406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 -- 172.21.15.125:0/1644129548 shutdown_connections 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.140+0000 7fb18a012700 1 -- 172.21.15.125:0/1644129548 wait complete. 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 Processor -- start 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 -- start start 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 0x7fb184121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb184133f70 0x7fb184121cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184124ca0 con 0x7fb1840a0a70 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184122e30 con 0x7fb18409ad40 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb18a012700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb18409be00 con 0x7fb184133f70 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.141+0000 7fb182ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 0x7fb184121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb182ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:55494/0 (socket says 172.21.15.125:55494) 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb182ffd700 1 -- 172.21.15.125:0/147935290 learned_addr learned my addr 172.21.15.125:0/147935290 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb183fff700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb184133f70 0x7fb184121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 -- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb184133f70 msgr2=0x7fb184121cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb184133f70 0x7fb184121cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 -- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 msgr2=0x7fb184121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 -- 172.21.15.125:0/147935290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780094a0 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb182ffd700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb1837fe700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 0x7fb184121250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb174016000 tx=0x7fb174004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740045d0 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17401e070 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740094a0 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740038c0 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.142+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1841232a0 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.143+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb174003a20 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.143+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb174040590 con 0x7fb18409ad40 2023-10-03T10:17:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.143+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18404f2a0 con 0x7fb18409ad40 2023-10-03T10:17:55.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.148+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb17401a420 con 0x7fb18409ad40 2023-10-03T10:17:55.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.181+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2d0137950 con 0x7fc2d0130ce0 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.181+0000 7fc2c67fc700 1 -- 172.21.15.125:0/819686320 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2c8007500 con 0x7fc2d0130ce0 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:55.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.183+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 msgr2=0x7fc2d0136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.183+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8002230 tx=0x7fc2c800cf50 comp rx=0 tx=0).stop 2023-10-03T10:17:55.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 shutdown_connections 2023-10-03T10:17:55.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc2d0130ce0 0x7fc2d0136050 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2d009d860 0x7fc2d01355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 --2- 172.21.15.125:0/819686320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2d009e170 0x7fc2d0135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 >> 172.21.15.125:0/819686320 conn(0x7fc2d0099c40 msgr2=0x7fc2d01393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 shutdown_connections 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.184+0000 7fc2d7cc9700 1 -- 172.21.15.125:0/819686320 wait complete. 2023-10-03T10:17:55.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:55.269 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:55.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:55.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.344+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb184124870 con 0x7fb18409ad40 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.344+0000 7fb16bfff700 1 -- 172.21.15.125:0/147935290 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb174015020 con 0x7fb18409ad40 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 msgr2=0x7fb184121250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 0x7fb184121250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb174016000 tx=0x7fb174004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 shutdown_connections 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb184133f70 0x7fb184121cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb18409ad40 0x7fb184121250 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 --2- 172.21.15.125:0/147935290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1840a0a70 0x7fb184121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.346+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 >> 172.21.15.125:0/147935290 conn(0x7fb184099c40 msgr2=0x7fb1840a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.347+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 shutdown_connections 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.347+0000 7fb18a012700 1 -- 172.21.15.125:0/147935290 wait complete. 2023-10-03T10:17:55.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.394+0000 7f56eaba1700 1 Processor -- start 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.394+0000 7f56eaba1700 1 -- start start 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.394+0000 7f56eaba1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 0x7f56e40a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56eaba1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56eaba1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 0x7f56e4134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56eaba1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40a2640 con 0x7f56e4133de0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56eaba1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e409dde0 con 0x7f56e40a0970 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56eaba1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40a2820 con 0x7f56e40a1280 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e939e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 0x7f56e40a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56ea3a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 0x7f56e4134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e939e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60900/0 (socket says 172.21.15.125:60900) 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e939e700 1 -- 172.21.15.125:0/3993674079 learned_addr learned my addr 172.21.15.125:0/3993674079 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 -- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 msgr2=0x7f56e41338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 -- 172.21.15.125:0/3993674079 >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 msgr2=0x7f56e4134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/3993674079 >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 0x7f56e4134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 -- 172.21.15.125:0/3993674079 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40a2330 con 0x7f56e40a0970 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56ea3a0700 1 --2- 172.21.15.125:0/3993674079 >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 0x7f56e4134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e939e700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 0x7f56e40a0d40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009870 tx=0x7f56e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f24ed778632854b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e8b9d700 1 -- 172.21.15.125:0/3993674079 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011830 con 0x7f56e40a0970 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e8b9d700 1 -- 172.21.15.125:0/3993674079 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0011990 con 0x7f56e40a0970 2023-10-03T10:17:55.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.395+0000 7f56e8b9d700 1 -- 172.21.15.125:0/3993674079 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011d20 con 0x7f56e40a0970 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 -- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 msgr2=0x7f56e40a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 0x7f56e40a0d40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009870 tx=0x7f56e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 -- 172.21.15.125:0/3993674079 shutdown_connections 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e40a0970 0x7f56e40a0d40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 --2- 172.21.15.125:0/3993674079 >> v2:172.21.15.125:3300/0 conn(0x7f56e4133de0 0x7f56e4134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 --2- 172.21.15.125:0/3993674079 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a1280 0x7f56e41338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 -- 172.21.15.125:0/3993674079 >> 172.21.15.125:0/3993674079 conn(0x7f56e40a6070 msgr2=0x7f56e40a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 -- 172.21.15.125:0/3993674079 shutdown_connections 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.396+0000 7f56eaba1700 1 -- 172.21.15.125:0/3993674079 wait complete. 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.397+0000 7f56eaba1700 1 Processor -- start 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.397+0000 7f56eaba1700 1 -- start start 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56e40a1280 0x7f56e4122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e4133de0 0x7f56e4122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4125bf0 con 0x7f56e40a1280 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4124e90 con 0x7f56e4133de0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56eaba1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4123dc0 con 0x7f56e40a0970 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60908/0 (socket says 172.21.15.125:60908) 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 -- 172.21.15.125:0/1917894111 learned_addr learned my addr 172.21.15.125:0/1917894111 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56ea3a0700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e4133de0 0x7f56e4122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e939e700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56e40a1280 0x7f56e4122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 -- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e4133de0 msgr2=0x7f56e4122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e4133de0 0x7f56e4122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 -- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56e40a1280 msgr2=0x7f56e4122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56e40a1280 0x7f56e4122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.398+0000 7f56e9b9f700 1 -- 172.21.15.125:0/1917894111 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009550 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56e9b9f700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f56e00090b0 tx=0x7f56e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004450 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e001f070 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc009a70 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00038c0 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.399+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e00094a0 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.400+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e404f2a0 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.400+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56e0003a20 con 0x7f56e40a0970 2023-10-03T10:17:55.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.400+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56e0021070 con 0x7f56e40a0970 2023-10-03T10:17:55.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.404+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56e00045b0 con 0x7f56e40a0970 2023-10-03T10:17:55.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.437+0000 7f7b7d7cb700 1 Processor -- start 2023-10-03T10:17:55.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 -- start start 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7809dc00 con 0x7f7b78133f50 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7809ea60 con 0x7f7b780a0a70 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b7d7cb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7809dec0 con 0x7f7b780a1380 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b767fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50828/0 (socket says 172.21.15.125:50828) 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b767fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60922/0 (socket says 172.21.15.125:60922) 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 -- 172.21.15.125:0/799969215 learned_addr learned my addr 172.21.15.125:0/799969215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b777fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7b78133f50 0x7f7b7813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38090/0 (socket says 172.21.15.125:38090) 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 -- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 msgr2=0x7f7b78133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b75ffb700 1 -- 172.21.15.125:0/799969215 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380189816 0 0) 0x7f7b7809dc00 con 0x7f7b78133f50 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 -- 172.21.15.125:0/799969215 >> v1:172.21.15.125:6789/0 conn(0x7f7b78133f50 legacy=0x7f7b7813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b76ffd700 1 -- 172.21.15.125:0/799969215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7809e6a0 con 0x7f7b780a0a70 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.438+0000 7f7b767fc700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b76ffd700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009920 tx=0x7f7b68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ef4905f18a9095 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b75ffb700 1 -- 172.21.15.125:0/799969215 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011830 con 0x7f7b780a0a70 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b75ffb700 1 -- 172.21.15.125:0/799969215 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68011990 con 0x7f7b780a0a70 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b75ffb700 1 -- 172.21.15.125:0/799969215 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011d20 con 0x7f7b780a0a70 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 msgr2=0x7f7b780a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009920 tx=0x7f7b68009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/799969215 shutdown_connections 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a0a70 0x7f7b780a0e40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/799969215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b780a1380 0x7f7b78133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/799969215 >> 172.21.15.125:0/799969215 conn(0x7f7b780a6610 msgr2=0x7f7b780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/799969215 shutdown_connections 2023-10-03T10:17:55.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.439+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/799969215 wait complete. 2023-10-03T10:17:55.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.440+0000 7f7b7d7cb700 1 Processor -- start 2023-10-03T10:17:55.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.440+0000 7f7b7d7cb700 1 -- start start 2023-10-03T10:17:55.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 0x7f7b78122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 0x7f7b781234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780a0450 con 0x7f7b780a0a70 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78126fb0 con 0x7f7b780a1380 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b7d7cb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78125e30 con 0x7f7b78133f50 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b777fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 0x7f7b781234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50830/0 (socket says 172.21.15.125:50830) 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b777fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 0x7f7b781234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60934/0 (socket says 172.21.15.125:60934) 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 -- 172.21.15.125:0/1483003868 learned_addr learned my addr 172.21.15.125:0/1483003868 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b76ffd700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 0x7f7b78122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 -- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 msgr2=0x7f7b781234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 0x7f7b781234a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 -- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 msgr2=0x7f7b78122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 0x7f7b78122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 -- 172.21.15.125:0/1483003868 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0094a0 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b76ffd700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 0x7f7b78122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.441+0000 7f7b767fc700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ebb0 tx=0x7f7b6c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.442+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00c850 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.442+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c00c9b0 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.442+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b68009550 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.442+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00cd40 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.442+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78124530 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.443+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b6c013470 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.443+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b6c03faa0 con 0x7f7b780a1380 2023-10-03T10:17:55.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.443+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7804f2a0 con 0x7f7b780a1380 2023-10-03T10:17:55.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.447+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b6c017080 con 0x7f7b780a1380 2023-10-03T10:17:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.601+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56e4072800 con 0x7f56e40a0970 2023-10-03T10:17:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.601+0000 7f56da7fc700 1 -- 172.21.15.125:0/1917894111 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56e002b020 con 0x7f56e40a0970 2023-10-03T10:17:55.602 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 msgr2=0x7f56e4122030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f56e00090b0 tx=0x7f56e0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 shutdown_connections 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56e4133de0 0x7f56e4122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56e40a0970 0x7f56e4122030 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 --2- 172.21.15.125:0/1917894111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56e40a1280 0x7f56e4122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 >> 172.21.15.125:0/1917894111 conn(0x7f56e40a6070 msgr2=0x7f56e4099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 shutdown_connections 2023-10-03T10:17:55.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.603+0000 7f56eaba1700 1 -- 172.21.15.125:0/1917894111 wait complete. 2023-10-03T10:17:55.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:55.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.641+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b78126bc0 con 0x7f7b780a1380 2023-10-03T10:17:55.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.642+0000 7f7b5f7fe700 1 -- 172.21.15.125:0/1483003868 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b6c021020 con 0x7f7b780a1380 2023-10-03T10:17:55.642 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 msgr2=0x7f7b78122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ebb0 tx=0x7f7b6c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 shutdown_connections 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7b78133f50 0x7f7b781234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b780a0a70 0x7f7b78122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 --2- 172.21.15.125:0/1483003868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b780a1380 0x7f7b78122f60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 >> 172.21.15.125:0/1483003868 conn(0x7f7b780a6610 msgr2=0x7f7b780a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 shutdown_connections 2023-10-03T10:17:55.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:55.644+0000 7f7b7d7cb700 1 -- 172.21.15.125:0/1483003868 wait complete. 2023-10-03T10:17:55.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:56.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:56.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.323+0000 7f7f75315700 1 Processor -- start 2023-10-03T10:17:56.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.323+0000 7f7f75315700 1 -- start start 2023-10-03T10:17:56.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f75315700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f700a0a90 0x7f7f700a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f75315700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f7013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f75315700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700a1fe0 con 0x7f7f700a13a0 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f75315700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700a3aa0 con 0x7f7f700a0a90 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f75315700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7009a540 con 0x7f7f70134140 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f7013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f700a0a90 0x7f7f700a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7f700a13a0 0x7f7f70133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38096/0 (socket says 172.21.15.125:38096) 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6e7fc700 1 -- 172.21.15.125:0/3633339402 learned_addr learned my addr 172.21.15.125:0/3633339402 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:56.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 -- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 msgr2=0x7f7f7013bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f7013bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 -- 172.21.15.125:0/3633339402 >> v1:172.21.15.125:6789/0 conn(0x7f7f700a13a0 legacy=0x7f7f70133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 -- 172.21.15.125:0/3633339402 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7009a280 con 0x7f7f700a0a90 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6f7fe700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f7013bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6dffb700 1 -- 172.21.15.125:0/3633339402 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057256713 0 0) 0x7f7f700a1fe0 con 0x7f7f700a13a0 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.324+0000 7f7f6effd700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f700a0e60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009840 tx=0x7f7f64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76862b00eacbb31c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f6dffb700 1 -- 172.21.15.125:0/3633339402 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011830 con 0x7f7f700a0a90 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f6dffb700 1 -- 172.21.15.125:0/3633339402 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64011990 con 0x7f7f700a0a90 2023-10-03T10:17:56.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f6dffb700 1 -- 172.21.15.125:0/3633339402 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011d20 con 0x7f7f700a0a90 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 -- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 msgr2=0x7f7f700a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f700a0e60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009840 tx=0x7f7f64009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 -- 172.21.15.125:0/3633339402 shutdown_connections 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f7013bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 --2- 172.21.15.125:0/3633339402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f700a0e60 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 -- 172.21.15.125:0/3633339402 >> 172.21.15.125:0/3633339402 conn(0x7f7f70099c40 msgr2=0x7f7f7006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 -- 172.21.15.125:0/3633339402 shutdown_connections 2023-10-03T10:17:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.325+0000 7f7f75315700 1 -- 172.21.15.125:0/3633339402 wait complete. 2023-10-03T10:17:56.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.326+0000 7f7f75315700 1 Processor -- start 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.326+0000 7f7f75315700 1 -- start start 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f700a13a0 0x7f7f701219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f70121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70124c00 con 0x7f7f700a0a90 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7009c7e0 con 0x7f7f70134140 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70124de0 con 0x7f7f700a13a0 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57140/0 (socket says 172.21.15.125:57140) 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6effd700 1 -- 172.21.15.125:0/1962037372 learned_addr learned my addr 172.21.15.125:0/1962037372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f700a13a0 0x7f7f701219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f70121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 -- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f700a13a0 msgr2=0x7f7f701219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f700a13a0 0x7f7f701219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 -- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 msgr2=0x7f7f70121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 -- 172.21.15.125:0/1962037372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009a70 con 0x7f7f70134140 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6effd700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f6f7fe700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f70121ee0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800efc0 tx=0x7f7f6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800ca90 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800f040 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f640094a0 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800ce30 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.327+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f70123390 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.328+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f68014480 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.328+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f6803fc20 con 0x7f7f70134140 2023-10-03T10:17:56.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.328+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7011e060 con 0x7f7f70134140 2023-10-03T10:17:56.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.333+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f68012930 con 0x7f7f70134140 2023-10-03T10:17:56.361 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.484+0000 7feb68b4e700 1 Processor -- start 2023-10-03T10:17:56.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.484+0000 7feb68b4e700 1 -- start start 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb68b4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb68b4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 0x7feb64133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb68b4e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6409dc00 con 0x7feb64133f50 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb68b4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6409ea60 con 0x7feb640a1380 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb68b4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb6409dec0 con 0x7feb640a0a70 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60956/0 (socket says 172.21.15.125:60956) 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb62d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feb64133f50 0x7feb6413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38100/0 (socket says 172.21.15.125:38100) 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6259c700 1 -- 172.21.15.125:0/1794750993 learned_addr learned my addr 172.21.15.125:0/1794750993 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 0x7feb64133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6159a700 1 -- 172.21.15.125:0/1794750993 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516323919 0 0) 0x7feb6409dc00 con 0x7feb64133f50 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 -- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 msgr2=0x7feb640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 -- 172.21.15.125:0/1794750993 >> v1:172.21.15.125:6789/0 conn(0x7feb64133f50 legacy=0x7feb6413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 -- 172.21.15.125:0/1794750993 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6409e6a0 con 0x7feb640a1380 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6259c700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb61d9b700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 0x7feb64133a10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb58009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99044eddef9cceac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6159a700 1 -- 172.21.15.125:0/1794750993 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011830 con 0x7feb640a1380 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6159a700 1 -- 172.21.15.125:0/1794750993 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58011990 con 0x7feb640a1380 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.485+0000 7feb6159a700 1 -- 172.21.15.125:0/1794750993 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011d20 con 0x7feb640a1380 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 -- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 msgr2=0x7feb64133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 0x7feb64133a10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb58009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 -- 172.21.15.125:0/1794750993 shutdown_connections 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a0a70 0x7feb640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1794750993 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb640a1380 0x7feb64133a10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 -- 172.21.15.125:0/1794750993 >> 172.21.15.125:0/1794750993 conn(0x7feb640a6610 msgr2=0x7feb640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 -- 172.21.15.125:0/1794750993 shutdown_connections 2023-10-03T10:17:56.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.486+0000 7feb68b4e700 1 -- 172.21.15.125:0/1794750993 wait complete. 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.487+0000 7feb68b4e700 1 Processor -- start 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.487+0000 7feb68b4e700 1 -- start start 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.487+0000 7feb68b4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 0x7feb641c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb64124fa0 con 0x7feb640a0a70 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb64126370 con 0x7feb64133f50 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb641246b0 con 0x7feb640a1380 2023-10-03T10:17:56.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb61d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 0x7feb641c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb6259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb61d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 0x7feb641c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60962/0 (socket says 172.21.15.125:60962) 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50880/0 (socket says 172.21.15.125:50880) 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb61d9b700 1 -- 172.21.15.125:0/1700783194 learned_addr learned my addr 172.21.15.125:0/1700783194 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb6259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57150/0 (socket says 172.21.15.125:57150) 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 -- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 msgr2=0x7feb641c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 0x7feb641c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 -- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 msgr2=0x7feb641c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 -- 172.21.15.125:0/1700783194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54009550 con 0x7feb64133f50 2023-10-03T10:17:56.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb6259c700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb62d9d700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00cbe0 tx=0x7feb5c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00aa40 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c00abc0 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580094a0 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0070d0 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.488+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb640a03e0 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.489+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb5c007230 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.489+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb641253e0 con 0x7feb64133f50 2023-10-03T10:17:56.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.489+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb5c03f030 con 0x7feb64133f50 2023-10-03T10:17:56.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.494+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb5c0074e0 con 0x7feb64133f50 2023-10-03T10:17:56.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.533+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f7004f2a0 con 0x7f7f70134140 2023-10-03T10:17:56.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.533+0000 7f7f577fe700 1 -- 172.21.15.125:0/1962037372 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f68012340 con 0x7f7f70134140 2023-10-03T10:17:56.533 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 msgr2=0x7f7f70121ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f70121ee0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800efc0 tx=0x7f7f6800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 shutdown_connections 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f70134140 0x7f7f70121ee0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f700a0a90 0x7f7f70121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 --2- 172.21.15.125:0/1962037372 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f700a13a0 0x7f7f701219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 >> 172.21.15.125:0/1962037372 conn(0x7f7f70099c40 msgr2=0x7f7f70133240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 shutdown_connections 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.535+0000 7f7f75315700 1 -- 172.21.15.125:0/1962037372 wait complete. 2023-10-03T10:17:56.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:56.616 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:56.657 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:56.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.687+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb6404f2a0 con 0x7feb64133f50 2023-10-03T10:17:56.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.687+0000 7feb52ffd700 1 -- 172.21.15.125:0/1700783194 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb5c018020 con 0x7feb64133f50 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 msgr2=0x7feb641c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00cbe0 tx=0x7feb5c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 shutdown_connections 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb64133f50 0x7feb641c8d50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb640a0a70 0x7feb641c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 --2- 172.21.15.125:0/1700783194 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feb640a1380 0x7feb641c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 >> 172.21.15.125:0/1700783194 conn(0x7feb640a6610 msgr2=0x7feb640a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 shutdown_connections 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.689+0000 7feb68b4e700 1 -- 172.21.15.125:0/1700783194 wait complete. 2023-10-03T10:17:56.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 Processor -- start 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 -- start start 2023-10-03T10:17:56.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 0x7fa158136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1581371c0 0x7fa1581395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15809c970 con 0x7fa15809e870 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1580a0920 con 0x7fa1581371c0 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.742+0000 7fa15ef67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa15809f9c0 con 0x7fa15809f350 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1581371c0 0x7fa1581395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa157fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 0x7fa158136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1581371c0 0x7fa1581395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57160/0 (socket says 172.21.15.125:57160) 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa157fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 0x7fa158136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60970/0 (socket says 172.21.15.125:60970) 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15cd03700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa15809e870 0x7fa15809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38104/0 (socket says 172.21.15.125:38104) 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 -- 172.21.15.125:0/200348340 learned_addr learned my addr 172.21.15.125:0/200348340 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 -- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 msgr2=0x7fa158136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 --2- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 0x7fa158136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 -- 172.21.15.125:0/200348340 >> v1:172.21.15.125:6789/0 conn(0x7fa15809e870 legacy=0x7fa15809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 -- 172.21.15.125:0/200348340 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15809bab0 con 0x7fa1581371c0 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa1577fe700 1 -- 172.21.15.125:0/200348340 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151798785 0 0) 0x7fa15809c970 con 0x7fa15809e870 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa15d504700 1 --2- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa1581395a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fa150009e50 tx=0x7fa15000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f24daeabcae9f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa1577fe700 1 -- 172.21.15.125:0/200348340 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000e070 con 0x7fa1581371c0 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa1577fe700 1 -- 172.21.15.125:0/200348340 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15000b910 con 0x7fa1581371c0 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.743+0000 7fa1577fe700 1 -- 172.21.15.125:0/200348340 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000bcc0 con 0x7fa1581371c0 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 -- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 msgr2=0x7fa1581395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 --2- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa1581395a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fa150009e50 tx=0x7fa15000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 -- 172.21.15.125:0/200348340 shutdown_connections 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 --2- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa1581395a0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 --2- 172.21.15.125:0/200348340 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809f350 0x7fa158136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 -- 172.21.15.125:0/200348340 >> 172.21.15.125:0/200348340 conn(0x7fa1580a4430 msgr2=0x7fa1580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 -- 172.21.15.125:0/200348340 shutdown_connections 2023-10-03T10:17:56.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.744+0000 7fa15ef67700 1 -- 172.21.15.125:0/200348340 wait complete. 2023-10-03T10:17:56.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 Processor -- start 2023-10-03T10:17:56.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 -- start start 2023-10-03T10:17:56.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809e870 0x7fa1581c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 0x7fa1581c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581c9210 con 0x7fa1581371c0 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581369d0 con 0x7fa15809f350 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15ef67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581363d0 con 0x7fa15809e870 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15d504700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa157fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 0x7fa1581c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15d504700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57162/0 (socket says 172.21.15.125:57162) 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15d504700 1 -- 172.21.15.125:0/1043095994 learned_addr learned my addr 172.21.15.125:0/1043095994 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.745+0000 7fa15cd03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809e870 0x7fa1581c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 -- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809e870 msgr2=0x7fa1581c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809e870 0x7fa1581c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 -- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 msgr2=0x7fa1581c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 0x7fa1581c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 -- 172.21.15.125:0/1043095994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150009b30 con 0x7fa1581371c0 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa157fff700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 0x7fa1581c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15d504700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b680 tx=0x7fa150004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150004870 con 0x7fa1581371c0 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1500092e0 con 0x7fa1581371c0 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15806d600 con 0x7fa1581371c0 2023-10-03T10:17:56.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15001c660 con 0x7fa1581371c0 2023-10-03T10:17:56.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.746+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa158072300 con 0x7fa1581371c0 2023-10-03T10:17:56.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.747+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa15001c7c0 con 0x7fa1581371c0 2023-10-03T10:17:56.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.747+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15809dba0 con 0x7fa1581371c0 2023-10-03T10:17:56.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.747+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa150041240 con 0x7fa1581371c0 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.756+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa150025450 con 0x7fa1581371c0 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 Processor -- start 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 -- start start 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2809e9d0 con 0x7f5f280a0a70 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2809dc00 con 0x7f5f280a1380 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.788+0000 7f5f2e696700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2809dec0 con 0x7f5f28133f50 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f27fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f2cc33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f2cc33700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:60988/0 (socket says 172.21.15.125:60988) 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f27fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57166/0 (socket says 172.21.15.125:57166) 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50890/0 (socket says 172.21.15.125:50890) 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f2cc33700 1 -- 172.21.15.125:0/2697801589 learned_addr learned my addr 172.21.15.125:0/2697801589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 -- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 msgr2=0x7f5f281343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 -- 172.21.15.125:0/2697801589 >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 msgr2=0x7f5f280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 --2- 172.21.15.125:0/2697801589 >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 -- 172.21.15.125:0/2697801589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2809e6a0 con 0x7f5f280a1380 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f2cc33700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f27fff700 1 --2- 172.21.15.125:0/2697801589 >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f277fe700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009840 tx=0x7f5f1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed62a45998a11401 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f26ffd700 1 -- 172.21.15.125:0/2697801589 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c011830 con 0x7f5f280a1380 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f26ffd700 1 -- 172.21.15.125:0/2697801589 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c011990 con 0x7f5f280a1380 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.789+0000 7f5f26ffd700 1 -- 172.21.15.125:0/2697801589 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c011d20 con 0x7f5f280a1380 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 -- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 msgr2=0x7f5f28133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009840 tx=0x7f5f1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 -- 172.21.15.125:0/2697801589 shutdown_connections 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f28133f50 0x7f5f281343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 --2- 172.21.15.125:0/2697801589 >> v2:172.21.15.125:3300/0 conn(0x7f5f280a0a70 0x7f5f280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 --2- 172.21.15.125:0/2697801589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28133a10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 -- 172.21.15.125:0/2697801589 >> 172.21.15.125:0/2697801589 conn(0x7f5f280a6610 msgr2=0x7f5f280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 -- 172.21.15.125:0/2697801589 shutdown_connections 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.790+0000 7f5f2e696700 1 -- 172.21.15.125:0/2697801589 wait complete. 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 Processor -- start 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 -- start start 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 0x7f5f28122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f281336f0 con 0x7f5f28133f50 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28123780 con 0x7f5f280a1380 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2e696700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28124dc0 con 0x7f5f280a0a70 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f27fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f2cc33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 0x7f5f28122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f27fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32770/0 (socket says 172.21.15.125:32770) 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f27fff700 1 -- 172.21.15.125:0/1305244093 learned_addr learned my addr 172.21.15.125:0/1305244093 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.791+0000 7f5f277fe700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 -- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 msgr2=0x7f5f28122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 -- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 msgr2=0x7f5f28122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 0x7f5f28122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 -- 172.21.15.125:0/1305244093 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180094a0 con 0x7f5f280a0a70 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f2cc33700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 0x7f5f28122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f27fff700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800ec10 tx=0x7f5f1800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18009780 con 0x7f5f280a0a70 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1800c850 con 0x7f5f280a0a70 2023-10-03T10:17:56.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800cbe0 con 0x7f5f280a0a70 2023-10-03T10:17:56.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f20009b30 con 0x7f5f280a0a70 2023-10-03T10:17:56.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.792+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0094a0 con 0x7f5f280a0a70 2023-10-03T10:17:56.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.793+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f1800cd40 con 0x7f5f280a0a70 2023-10-03T10:17:56.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.793+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f1803fac0 con 0x7f5f280a0a70 2023-10-03T10:17:56.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.793+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f280a5120 con 0x7f5f280a0a70 2023-10-03T10:17:56.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.797+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f1801b3b0 con 0x7f5f280a0a70 2023-10-03T10:17:56.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.951+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa15804f2a0 con 0x7fa1581371c0 2023-10-03T10:17:56.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.951+0000 7fa1557fa700 1 -- 172.21.15.125:0/1043095994 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa15002d7c0 con 0x7fa1581371c0 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 msgr2=0x7fa15806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b680 tx=0x7fa150004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 shutdown_connections 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1581371c0 0x7fa15806b8b0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa15809e870 0x7fa1581c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 --2- 172.21.15.125:0/1043095994 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa15809f350 0x7fa1581c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 >> 172.21.15.125:0/1043095994 conn(0x7fa1580a4430 msgr2=0x7fa1580a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 shutdown_connections 2023-10-03T10:17:56.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.953+0000 7fa15ef67700 1 -- 172.21.15.125:0/1043095994 wait complete. 2023-10-03T10:17:56.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:56.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.990+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f2811f760 con 0x7f5f280a0a70 2023-10-03T10:17:56.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.990+0000 7f5f24ff9700 1 -- 172.21.15.125:0/1305244093 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f18017020 con 0x7f5f280a0a70 2023-10-03T10:17:56.991 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 msgr2=0x7f5f28122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800ec10 tx=0x7f5f1800ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 shutdown_connections 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f28133f50 0x7f5f28122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f280a0a70 0x7f5f28122320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 --2- 172.21.15.125:0/1305244093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280a1380 0x7f5f28122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.992+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 >> 172.21.15.125:0/1305244093 conn(0x7f5f280a6610 msgr2=0x7f5f2811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.993+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 shutdown_connections 2023-10-03T10:17:56.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:56.993+0000 7f5f2e696700 1 -- 172.21.15.125:0/1305244093 wait complete. 2023-10-03T10:17:57.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:57.548 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:57.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.674+0000 7fb4081f4700 1 Processor -- start 2023-10-03T10:17:57.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 -- start start 2023-10-03T10:17:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40009fa00 con 0x7fb40009f180 2023-10-03T10:17:57.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000a0370 con 0x7fb40009e870 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb4081f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40006bec0 con 0x7fb400134330 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb405f90700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32786/0 (socket says 172.21.15.125:32786) 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb40578f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb40009f180 0x7fb400133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38114/0 (socket says 172.21.15.125:38114) 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb405f90700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57190/0 (socket says 172.21.15.125:57190) 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 -- 172.21.15.125:0/3490397326 learned_addr learned my addr 172.21.15.125:0/3490397326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 -- 172.21.15.125:0/3490397326 >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 msgr2=0x7fb40009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 --2- 172.21.15.125:0/3490397326 >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 -- 172.21.15.125:0/3490397326 >> v1:172.21.15.125:6789/0 conn(0x7fb40009f180 legacy=0x7fb400133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb406791700 1 -- 172.21.15.125:0/3490397326 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009ada0 con 0x7fb400134330 2023-10-03T10:17:57.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.675+0000 7fb405f90700 1 --2- 172.21.15.125:0/3490397326 >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb406791700 1 --2- 172.21.15.125:0/3490397326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e50 tx=0x7fb3f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a886bc2babebd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb404f8e700 1 -- 172.21.15.125:0/3490397326 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800e070 con 0x7fb400134330 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb404f8e700 1 -- 172.21.15.125:0/3490397326 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800b910 con 0x7fb400134330 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb404f8e700 1 -- 172.21.15.125:0/3490397326 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800bcc0 con 0x7fb400134330 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 -- 172.21.15.125:0/3490397326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 msgr2=0x7fb40013be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 --2- 172.21.15.125:0/3490397326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e50 tx=0x7fb3f800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 -- 172.21.15.125:0/3490397326 shutdown_connections 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 --2- 172.21.15.125:0/3490397326 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb40013be80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 --2- 172.21.15.125:0/3490397326 >> v2:172.21.15.125:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 -- 172.21.15.125:0/3490397326 >> 172.21.15.125:0/3490397326 conn(0x7fb4000a4430 msgr2=0x7fb4000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 -- 172.21.15.125:0/3490397326 shutdown_connections 2023-10-03T10:17:57.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.676+0000 7fb4081f4700 1 -- 172.21.15.125:0/3490397326 wait complete. 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.677+0000 7fb4081f4700 1 Processor -- start 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.677+0000 7fb4081f4700 1 -- start start 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 0x7fb400122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 0x7fb400122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb4001233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb400125ec0 con 0x7fb40009f180 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400124550 con 0x7fb40009e870 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb400123da0 con 0x7fb400134330 2023-10-03T10:17:57.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb405f90700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 0x7fb400122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb4001233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb405f90700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 0x7fb400122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50906/0 (socket says 172.21.15.125:50906) 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb405f90700 1 -- 172.21.15.125:0/1218225597 learned_addr learned my addr 172.21.15.125:0/1218225597 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb40578f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 0x7fb400122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 -- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 msgr2=0x7fb400122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 0x7fb400122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 -- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 msgr2=0x7fb400122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 0x7fb400122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 -- 172.21.15.125:0/1218225597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00094a0 con 0x7fb400134330 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb40578f700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 0x7fb400122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb406791700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb4001233c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8015000 tx=0x7fb3f8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004800 con 0x7fb400134330 2023-10-03T10:17:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8004960 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.678+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f8009b30 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.679+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f801c680 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.679+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40006cfa0 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.679+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f801c7e0 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.679+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3f8040ff0 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.679+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40004f2a0 con 0x7fb400134330 2023-10-03T10:17:57.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.684+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f80249a0 con 0x7fb400134330 2023-10-03T10:17:57.703 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 Processor -- start 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 -- start start 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 0x7f29dc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc09c970 con 0x7f29dc09f180 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0a0920 con 0x7f29dc131f40 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.825+0000 7f29e0e05700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc09f9c0 con 0x7f29dc09e870 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29dad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 0x7f29dc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29d9d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f29dc09f180 0x7f29dc131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38126/0 (socket says 172.21.15.125:38126) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50918/0 (socket says 172.21.15.125:50918) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29dad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 0x7f29dc139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57216/0 (socket says 172.21.15.125:57216) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29d9d9b700 1 -- 172.21.15.125:0/3952770381 learned_addr learned my addr 172.21.15.125:0/3952770381 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 -- 172.21.15.125:0/3952770381 >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 msgr2=0x7f29dc139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 --2- 172.21.15.125:0/3952770381 >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 0x7f29dc139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 -- 172.21.15.125:0/3952770381 >> v1:172.21.15.125:6789/0 conn(0x7f29dc09f180 legacy=0x7f29dc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 -- 172.21.15.125:0/3952770381 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc09bab0 con 0x7f29dc09e870 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29da59c700 1 --2- 172.21.15.125:0/3952770381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009840 tx=0x7f29cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f21a2f4361ea6f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29d959a700 1 -- 172.21.15.125:0/3952770381 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc011830 con 0x7f29dc09e870 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29d959a700 1 -- 172.21.15.125:0/3952770381 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc011990 con 0x7f29dc09e870 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.826+0000 7f29d959a700 1 -- 172.21.15.125:0/3952770381 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc011d20 con 0x7f29dc09e870 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 -- 172.21.15.125:0/3952770381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 msgr2=0x7f29dc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 --2- 172.21.15.125:0/3952770381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009840 tx=0x7f29cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 -- 172.21.15.125:0/3952770381 shutdown_connections 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 --2- 172.21.15.125:0/3952770381 >> v2:172.21.15.125:3300/0 conn(0x7f29dc131f40 0x7f29dc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 --2- 172.21.15.125:0/3952770381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc09ec40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 -- 172.21.15.125:0/3952770381 >> 172.21.15.125:0/3952770381 conn(0x7f29dc0a4430 msgr2=0x7f29dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 -- 172.21.15.125:0/3952770381 shutdown_connections 2023-10-03T10:17:57.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.827+0000 7f29e0e05700 1 -- 172.21.15.125:0/3952770381 wait complete. 2023-10-03T10:17:57.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 Processor -- start 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 -- start start 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 0x7f29dc120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 0x7f29dc120dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0a2ed0 con 0x7f29dc09f180 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc122ce0 con 0x7f29dc09e870 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29e0e05700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc123560 con 0x7f29dc131f40 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29dad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 0x7f29dc120dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29d9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 0x7f29dc120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29dad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 0x7f29dc120dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32812/0 (socket says 172.21.15.125:32812) 2023-10-03T10:17:57.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.828+0000 7f29da59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50932/0 (socket says 172.21.15.125:50932) 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29dad9d700 1 -- 172.21.15.125:0/2167352147 learned_addr learned my addr 172.21.15.125:0/2167352147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 -- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 msgr2=0x7f29dc120dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 0x7f29dc120dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 -- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 msgr2=0x7f29dc120890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 0x7f29dc120890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 -- 172.21.15.125:0/2167352147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0094a0 con 0x7f29dc09e870 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29d9d9b700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 0x7f29dc120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29da59c700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f29cc016000 tx=0x7f29cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0036a0 con 0x7f29dc09e870 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc01e070 con 0x7f29dc09e870 2023-10-03T10:17:57.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc003a60 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29e0e05700 1 -- 172.21.15.125:0/2167352147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc1226b0 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.829+0000 7f29e0e05700 1 -- 172.21.15.125:0/2167352147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc123af0 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.830+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29cc003bc0 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.830+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29cc040640 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.830+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40052e0 con 0x7f29dc09e870 2023-10-03T10:17:57.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.835+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29cc02c3a0 con 0x7f29dc09e870 2023-10-03T10:17:57.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.877+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb400133460 con 0x7fb400134330 2023-10-03T10:17:57.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.877+0000 7fb3f67fc700 1 -- 172.21.15.125:0/1218225597 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f8033090 con 0x7fb400134330 2023-10-03T10:17:57.878 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 msgr2=0x7fb4001233c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb4001233c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8015000 tx=0x7fb3f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 shutdown_connections 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb400134330 0x7fb4001233c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb40009e870 0x7fb400122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 --2- 172.21.15.125:0/1218225597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb40009f180 0x7fb400122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 >> 172.21.15.125:0/1218225597 conn(0x7fb4000a4430 msgr2=0x7fb400070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 shutdown_connections 2023-10-03T10:17:57.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:57.879+0000 7fb4081f4700 1 -- 172.21.15.125:0/1218225597 wait complete. 2023-10-03T10:17:57.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:57.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:58.005 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.027+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f29b4005590 con 0x7f29dc09e870 2023-10-03T10:17:58.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.027+0000 7f29caffd700 1 -- 172.21.15.125:0/2167352147 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29cc010b70 con 0x7f29dc09e870 2023-10-03T10:17:58.028 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:58.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 msgr2=0x7f29dc120350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f29cc016000 tx=0x7f29cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 shutdown_connections 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29dc131f40 0x7f29dc120dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29dc09e870 0x7f29dc120350 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 --2- 172.21.15.125:0/2167352147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29dc09f180 0x7f29dc120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 >> 172.21.15.125:0/2167352147 conn(0x7f29dc0a4430 msgr2=0x7f29dc11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 shutdown_connections 2023-10-03T10:17:58.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.031+0000 7f29c8ff9700 1 -- 172.21.15.125:0/2167352147 wait complete. 2023-10-03T10:17:58.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.093+0000 7f149dbe6700 1 Processor -- start 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.093+0000 7f149dbe6700 1 -- start start 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f149dbe6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f1498136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f149dbe6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 0x7f14981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f149dbe6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149809c970 con 0x7f149809e870 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f149dbe6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980a0920 con 0x7f149809f350 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f149dbe6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f149809f9c0 con 0x7f14981371c0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1497fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 0x7f14981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1496ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f1498136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f14977fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f149809e870 0x7f149809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38134/0 (socket says 172.21.15.125:38134) 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f14977fe700 1 -- 172.21.15.125:0/1836580447 learned_addr learned my addr 172.21.15.125:0/1836580447 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f14967fc700 1 -- 172.21.15.125:0/1836580447 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225641474 0 0) 0x7f149809c970 con 0x7f149809e870 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1497fff700 1 -- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 msgr2=0x7f1498136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1497fff700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f1498136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1497fff700 1 -- 172.21.15.125:0/1836580447 >> v1:172.21.15.125:6789/0 conn(0x7f149809e870 legacy=0x7f149809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1497fff700 1 -- 172.21.15.125:0/1836580447 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149809bab0 con 0x7f14981371c0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.094+0000 7f1496ffd700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f1498136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f1497fff700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 0x7f14981395a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1490009dc0 tx=0x7f149000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62e389130514490 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f14967fc700 1 -- 172.21.15.125:0/1836580447 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e070 con 0x7f14981371c0 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f14967fc700 1 -- 172.21.15.125:0/1836580447 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000bb20 con 0x7f14981371c0 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f14967fc700 1 -- 172.21.15.125:0/1836580447 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012430 con 0x7f14981371c0 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 -- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 msgr2=0x7f14981395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 0x7f14981395a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1490009dc0 tx=0x7f149000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 -- 172.21.15.125:0/1836580447 shutdown_connections 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f14981371c0 0x7f14981395a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 --2- 172.21.15.125:0/1836580447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f1498136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 -- 172.21.15.125:0/1836580447 >> 172.21.15.125:0/1836580447 conn(0x7f14980a4430 msgr2=0x7f14980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 -- 172.21.15.125:0/1836580447 shutdown_connections 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.095+0000 7f149dbe6700 1 -- 172.21.15.125:0/1836580447 wait complete. 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.096+0000 7f149dbe6700 1 Processor -- start 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.096+0000 7f149dbe6700 1 -- start start 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f14981c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149806d3d0 con 0x7f14981371c0 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149806d5c0 con 0x7f149809f350 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f149dbe6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14981364f0 con 0x7f149809e870 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f1497fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32834/0 (socket says 172.21.15.125:32834) 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f1497fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57232/0 (socket says 172.21.15.125:57232) 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 -- 172.21.15.125:0/3991959970 learned_addr learned my addr 172.21.15.125:0/3991959970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f1496ffd700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f14981c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 -- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 msgr2=0x7f14981c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f14981c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 -- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 msgr2=0x7f149806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 -- 172.21.15.125:0/3991959970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0094a0 con 0x7f149809e870 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f1497fff700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.097+0000 7f14977fe700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f148800c520 tx=0x7f148800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.098+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488004c80 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.098+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488004de0 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.098+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1490009a70 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.098+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488007310 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.098+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1498126160 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.099+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1488007470 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.099+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14981368a0 con 0x7f149809e870 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.099+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f148803f350 con 0x7f149809e870 2023-10-03T10:17:58.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.107+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14880123b0 con 0x7f149809e870 2023-10-03T10:17:58.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.138+0000 7f29d74c8700 1 Processor -- start 2023-10-03T10:17:58.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.138+0000 7f29d74c8700 1 -- start start 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d74c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d74c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 0x7f29d0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d74c8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d009c970 con 0x7f29d0131d70 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d74c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d00a0920 con 0x7f29d009f180 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d74c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d009f9c0 con 0x7f29d009e870 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d4a63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 0x7f29d0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50952/0 (socket says 172.21.15.125:50952) 2023-10-03T10:17:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 -- 172.21.15.125:0/871514352 learned_addr learned my addr 172.21.15.125:0/871514352 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 -- 172.21.15.125:0/871514352 >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 msgr2=0x7f29d0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 --2- 172.21.15.125:0/871514352 >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 0x7f29d0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 -- 172.21.15.125:0/871514352 >> v1:172.21.15.125:6789/0 conn(0x7f29d0131d70 legacy=0x7f29d0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 -- 172.21.15.125:0/871514352 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d009bab0 con 0x7f29d009e870 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29c7fff700 1 -- 172.21.15.125:0/871514352 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096610590 0 0) 0x7f29d009c970 con 0x7f29d0131d70 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d4a63700 1 --2- 172.21.15.125:0/871514352 >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 0x7f29d0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29d5264700 1 --2- 172.21.15.125:0/871514352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0098f0 tx=0x7f29cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b38e2ddba8af4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.139+0000 7f29c7fff700 1 -- 172.21.15.125:0/871514352 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc011830 con 0x7f29d009e870 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29c7fff700 1 -- 172.21.15.125:0/871514352 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc011990 con 0x7f29d009e870 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29c7fff700 1 -- 172.21.15.125:0/871514352 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc011d20 con 0x7f29d009e870 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 -- 172.21.15.125:0/871514352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 msgr2=0x7f29d009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 --2- 172.21.15.125:0/871514352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0098f0 tx=0x7f29cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 -- 172.21.15.125:0/871514352 shutdown_connections 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 --2- 172.21.15.125:0/871514352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009e870 0x7f29d009ec40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 --2- 172.21.15.125:0/871514352 >> v2:172.21.15.125:3300/0 conn(0x7f29d009f180 0x7f29d0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 -- 172.21.15.125:0/871514352 >> 172.21.15.125:0/871514352 conn(0x7f29d00a4430 msgr2=0x7f29d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 -- 172.21.15.125:0/871514352 shutdown_connections 2023-10-03T10:17:58.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.140+0000 7f29d74c8700 1 -- 172.21.15.125:0/871514352 wait complete. 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.141+0000 7f29d74c8700 1 Processor -- start 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.141+0000 7f29d74c8700 1 -- start start 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.141+0000 7f29d74c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.141+0000 7f29d74c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009f180 0x7f29d01c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d74c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d0131d70 0x7f29d01c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d74c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0121090 con 0x7f29d009e870 2023-10-03T10:17:58.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d74c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00a2ae0 con 0x7f29d009f180 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d74c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01218b0 con 0x7f29d0131d70 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d4a63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009f180 0x7f29d01c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57244/0 (socket says 172.21.15.125:57244) 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 -- 172.21.15.125:0/3116682424 learned_addr learned my addr 172.21.15.125:0/3116682424 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5a65700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d0131d70 0x7f29d01c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 -- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d0131d70 msgr2=0x7f29d01c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d0131d70 0x7f29d01c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 -- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009f180 msgr2=0x7f29d01c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009f180 0x7f29d01c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 -- 172.21.15.125:0/3116682424 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00094a0 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d5264700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009c40 tx=0x7f29cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc004510 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc01e070 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc009550 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.142+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0038c0 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.143+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0122510 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.143+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29cc003a20 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.143+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29cc040450 con 0x7f29d009e870 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.144+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d01222e0 con 0x7f29d009e870 2023-10-03T10:17:58.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.148+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29cc02d7d0 con 0x7f29d009e870 2023-10-03T10:17:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.301+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f149804f2a0 con 0x7f149809e870 2023-10-03T10:17:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.302+0000 7f147ffff700 1 -- 172.21.15.125:0/3991959970 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f148801b340 con 0x7f149809e870 2023-10-03T10:17:58.302 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:58.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.303+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 msgr2=0x7f14981c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.303+0000 7f149dbe6700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f148800c520 tx=0x7f148800c830 comp rx=0 tx=0).stop 2023-10-03T10:17:58.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 shutdown_connections 2023-10-03T10:17:58.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14981371c0 0x7f149806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f149809e870 0x7f14981c8600 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 --2- 172.21.15.125:0/3991959970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f149809f350 0x7f14981c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 >> 172.21.15.125:0/3991959970 conn(0x7f14980a4430 msgr2=0x7f14980704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 shutdown_connections 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.304+0000 7f149dbe6700 1 -- 172.21.15.125:0/3991959970 wait complete. 2023-10-03T10:17:58.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:58.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.341+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29d004f2a0 con 0x7f29d009e870 2023-10-03T10:17:58.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.341+0000 7f29c5ffb700 1 -- 172.21.15.125:0/3116682424 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29cc023ba0 con 0x7f29d009e870 2023-10-03T10:17:58.342 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:58.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 msgr2=0x7f29d01c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009c40 tx=0x7f29cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 shutdown_connections 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f29d0131d70 0x7f29d01c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29d009e870 0x7f29d01c8230 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 --2- 172.21.15.125:0/3116682424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29d009f180 0x7f29d01c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 >> 172.21.15.125:0/3116682424 conn(0x7f29d00a4430 msgr2=0x7f29d009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 shutdown_connections 2023-10-03T10:17:58.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:58.344+0000 7f29d74c8700 1 -- 172.21.15.125:0/3116682424 wait complete. 2023-10-03T10:17:58.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:17:58.893 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:59.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.017+0000 7f15b382c700 1 Processor -- start 2023-10-03T10:17:59.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 -- start start 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 0x7f15ac136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 0x7f15ac1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0a1640 con 0x7f15ac131980 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06eb30 con 0x7f15ac137000 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b382c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0a22d0 con 0x7f15ac1346e0 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b0dc7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 0x7f15ac136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b1dc9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 0x7f15ac1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b15c8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f15ac131980 0x7f15ac131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38162/0 (socket says 172.21.15.125:38162) 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b15c8700 1 -- 172.21.15.125:0/699082706 learned_addr learned my addr 172.21.15.125:0/699082706 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15a3fff700 1 -- 172.21.15.125:0/699082706 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169003610 0 0) 0x7f15ac0a1640 con 0x7f15ac131980 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b0dc7700 1 -- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 msgr2=0x7f15ac1393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b0dc7700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 0x7f15ac1393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b0dc7700 1 -- 172.21.15.125:0/699082706 >> v1:172.21.15.125:6789/0 conn(0x7f15ac131980 legacy=0x7f15ac131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b0dc7700 1 -- 172.21.15.125:0/699082706 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac131550 con 0x7f15ac1346e0 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.018+0000 7f15b1dc9700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 0x7f15ac1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b0dc7700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 0x7f15ac136ac0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009870 tx=0x7f15a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc6e236c1409da1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15a3fff700 1 -- 172.21.15.125:0/699082706 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8011830 con 0x7f15ac1346e0 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15a3fff700 1 -- 172.21.15.125:0/699082706 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8011990 con 0x7f15ac1346e0 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15a3fff700 1 -- 172.21.15.125:0/699082706 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8011d20 con 0x7f15ac1346e0 2023-10-03T10:17:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 -- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 msgr2=0x7f15ac136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 0x7f15ac136ac0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009870 tx=0x7f15a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 -- 172.21.15.125:0/699082706 shutdown_connections 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac137000 0x7f15ac1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 --2- 172.21.15.125:0/699082706 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac1346e0 0x7f15ac136ac0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 -- 172.21.15.125:0/699082706 >> 172.21.15.125:0/699082706 conn(0x7f15ac0a2980 msgr2=0x7f15ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 -- 172.21.15.125:0/699082706 shutdown_connections 2023-10-03T10:17:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.019+0000 7f15b382c700 1 -- 172.21.15.125:0/699082706 wait complete. 2023-10-03T10:17:59.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.020+0000 7f15b382c700 1 Processor -- start 2023-10-03T10:17:59.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.020+0000 7f15b382c700 1 -- start start 2023-10-03T10:17:59.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15ac1346e0 0x7f15ac119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 0x7f15ac119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac11c370 con 0x7f15ac1346e0 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0a1c40 con 0x7f15ac131980 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac11aa80 con 0x7f15ac137000 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b1dc9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 0x7f15ac119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b0dc7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15ac1346e0 0x7f15ac119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:50972/0 (socket says 172.21.15.125:50972) 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b1dc9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 0x7f15ac119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32872/0 (socket says 172.21.15.125:32872) 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 -- 172.21.15.125:0/3237670460 learned_addr learned my addr 172.21.15.125:0/3237670460 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 -- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 msgr2=0x7f15ac119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 0x7f15ac119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 -- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15ac1346e0 msgr2=0x7f15ac119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15ac1346e0 0x7f15ac119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 -- 172.21.15.125:0/3237670460 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009a70 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b15c8700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c6d0 tx=0x7f159c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0074e0 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c007640 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a80094a0 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.021+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c005a70 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.022+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac12eca0 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.022+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f159c005bd0 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.022+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f159c03eb40 con 0x7f15ac131980 2023-10-03T10:17:59.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.023+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac04f2a0 con 0x7f15ac131980 2023-10-03T10:17:59.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.027+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f159c017080 con 0x7f15ac131980 2023-10-03T10:17:59.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.169+0000 7fbc2a1cd700 1 Processor -- start 2023-10-03T10:17:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 -- start start 2023-10-03T10:17:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 0x7fbc24133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 0x7fbc241343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2409b110 con 0x7fbc240a0a70 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240a3b60 con 0x7fbc24133f70 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc2a1cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc241348e0 con 0x7fbc2409ad40 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc22ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 0x7fbc241343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc23fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbc240a0a70 0x7fbc240a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38178/0 (socket says 172.21.15.125:38178) 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc23fff700 1 -- 172.21.15.125:0/1127587341 learned_addr learned my addr 172.21.15.125:0/1127587341 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc237fe700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 0x7fbc24133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc227fc700 1 -- 172.21.15.125:0/1127587341 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690802758 0 0) 0x7fbc2409b110 con 0x7fbc240a0a70 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc237fe700 1 -- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 msgr2=0x7fbc241343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc237fe700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 0x7fbc241343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc237fe700 1 -- 172.21.15.125:0/1127587341 >> v1:172.21.15.125:6789/0 conn(0x7fbc240a0a70 legacy=0x7fbc240a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc237fe700 1 -- 172.21.15.125:0/1127587341 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240a2fa0 con 0x7fbc2409ad40 2023-10-03T10:17:59.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.170+0000 7fbc22ffd700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 0x7fbc241343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc237fe700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 0x7fbc24133a30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009870 tx=0x7fbc1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda8cba5b3039fb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc227fc700 1 -- 172.21.15.125:0/1127587341 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c011830 con 0x7fbc2409ad40 2023-10-03T10:17:59.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc227fc700 1 -- 172.21.15.125:0/1127587341 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c011990 con 0x7fbc2409ad40 2023-10-03T10:17:59.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc227fc700 1 -- 172.21.15.125:0/1127587341 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c011d20 con 0x7fbc2409ad40 2023-10-03T10:17:59.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 msgr2=0x7fbc24133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 0x7fbc24133a30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009870 tx=0x7fbc1c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:59.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/1127587341 shutdown_connections 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc2409ad40 0x7fbc24133a30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/1127587341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc24133f70 0x7fbc241343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/1127587341 >> 172.21.15.125:0/1127587341 conn(0x7fbc24099c40 msgr2=0x7fbc2406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/1127587341 shutdown_connections 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.171+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/1127587341 wait complete. 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.172+0000 7fbc2a1cd700 1 Processor -- start 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.172+0000 7fbc2a1cd700 1 -- start start 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc2409ad40 0x7fbc2411f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 0x7fbc241c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc24122500 con 0x7fbc24133f70 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc24133370 con 0x7fbc2409ad40 2023-10-03T10:17:59.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc2a1cd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2411eec0 con 0x7fbc240a0a70 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 0x7fbc241c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc22ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32890/0 (socket says 172.21.15.125:32890) 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc22ffd700 1 -- 172.21.15.125:0/2837511353 learned_addr learned my addr 172.21.15.125:0/2837511353 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc237fe700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc2409ad40 0x7fbc2411f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 -- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 msgr2=0x7fbc2411f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 -- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc2409ad40 msgr2=0x7fbc2411f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc2409ad40 0x7fbc2411f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 -- 172.21.15.125:0/2837511353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c0094a0 con 0x7fbc24133f70 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc22ffd700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc23fff700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 0x7fbc241c8190 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400cbe0 tx=0x7fbc1400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.173+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1400aa40 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.174+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1400abc0 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.174+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c0094a0 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.174+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140070d0 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.174+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2409c830 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.174+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc14007230 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.175+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc24120650 con 0x7fbc24133f70 2023-10-03T10:17:59.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.175+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbc1403f390 con 0x7fbc24133f70 2023-10-03T10:17:59.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.179+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc14018030 con 0x7fbc24133f70 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.225+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15ac12ee90 con 0x7f15ac131980 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.225+0000 7f15a1ffb700 1 -- 172.21.15.125:0/3237670460 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f159c01bb10 con 0x7f15ac131980 2023-10-03T10:17:59.226 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 msgr2=0x7f15ac118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c6d0 tx=0x7f159c00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 shutdown_connections 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f15ac137000 0x7f15ac119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15ac131980 0x7f15ac118df0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 --2- 172.21.15.125:0/3237670460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15ac1346e0 0x7f15ac119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 >> 172.21.15.125:0/3237670460 conn(0x7f15ac0a2980 msgr2=0x7f15ac133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 shutdown_connections 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.227+0000 7f15b382c700 1 -- 172.21.15.125:0/3237670460 wait complete. 2023-10-03T10:17:59.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:17:59.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:59.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:59.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.375+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbc2404f2a0 con 0x7fbc24133f70 2023-10-03T10:17:59.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.375+0000 7fbc1bfff700 1 -- 172.21.15.125:0/2837511353 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc140074e0 con 0x7fbc24133f70 2023-10-03T10:17:59.376 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:17:59.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 msgr2=0x7fbc241c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 0x7fbc241c8190 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400cbe0 tx=0x7fbc1400cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 shutdown_connections 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc24133f70 0x7fbc241c8190 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc2409ad40 0x7fbc2411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 --2- 172.21.15.125:0/2837511353 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbc240a0a70 0x7fbc2411f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 >> 172.21.15.125:0/2837511353 conn(0x7fbc24099c40 msgr2=0x7fbc241bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 shutdown_connections 2023-10-03T10:17:59.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.379+0000 7fbc2a1cd700 1 -- 172.21.15.125:0/2837511353 wait complete. 2023-10-03T10:17:59.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:59.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.451+0000 7fe26bd3f700 1 Processor -- start 2023-10-03T10:17:59.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.451+0000 7fe26bd3f700 1 -- start start 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.451+0000 7fe26bd3f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe26409e870 0x7fe26409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe26bd3f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe26bd3f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26409c970 con 0x7fe264131d70 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe26bd3f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640a0920 con 0x7fe26409e870 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe26bd3f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26409f9c0 con 0x7fe26409f180 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe2692da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe26409e870 0x7fe26409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe2692da700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51002/0 (socket says 172.21.15.125:51002) 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe2692da700 1 -- 172.21.15.125:0/169908707 learned_addr learned my addr 172.21.15.125:0/169908707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe26a2dc700 1 --1- 172.21.15.125:0/169908707 >> v1:172.21.15.125:6789/0 conn(0x7fe264131d70 0x7fe264138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38194/0 (socket says 172.21.15.125:38194) 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 -- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 msgr2=0x7fe264131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 -- 172.21.15.125:0/169908707 >> v1:172.21.15.125:6789/0 conn(0x7fe264131d70 legacy=0x7fe264138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 -- 172.21.15.125:0/169908707 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26409bab0 con 0x7fe26409e870 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe268ad9700 1 -- 172.21.15.125:0/169908707 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443106415 0 0) 0x7fe26409c970 con 0x7fe264131d70 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe2692da700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe269adb700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe26409e870 0x7fe26409ec40 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe260009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21b0cd1b3639c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe268ad9700 1 -- 172.21.15.125:0/169908707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011830 con 0x7fe26409e870 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe268ad9700 1 -- 172.21.15.125:0/169908707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260011990 con 0x7fe26409e870 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.452+0000 7fe268ad9700 1 -- 172.21.15.125:0/169908707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011d20 con 0x7fe26409e870 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 -- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe26409e870 msgr2=0x7fe26409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe26409e870 0x7fe26409ec40 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe260009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 -- 172.21.15.125:0/169908707 shutdown_connections 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe26409e870 0x7fe26409ec40 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/169908707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409f180 0x7fe264131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 -- 172.21.15.125:0/169908707 >> 172.21.15.125:0/169908707 conn(0x7fe2640a4430 msgr2=0x7fe2640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 -- 172.21.15.125:0/169908707 shutdown_connections 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.453+0000 7fe26bd3f700 1 -- 172.21.15.125:0/169908707 wait complete. 2023-10-03T10:17:59.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.454+0000 7fe26bd3f700 1 Processor -- start 2023-10-03T10:17:59.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.454+0000 7fe26bd3f700 1 -- start start 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe26409f180 0x7fe26406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 0x7fe26406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26406cd80 con 0x7fe264131d70 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264124d90 con 0x7fe26409e870 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26bd3f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe264124520 con 0x7fe26409f180 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51012/0 (socket says 172.21.15.125:51012) 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 -- 172.21.15.125:0/1161512014 learned_addr learned my addr 172.21.15.125:0/1161512014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe2692da700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe26409f180 0x7fe26406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26a2dc700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 0x7fe26406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 -- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe26409f180 msgr2=0x7fe26406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe26409f180 0x7fe26406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 -- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 msgr2=0x7fe26406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 0x7fe26406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe269adb700 1 -- 172.21.15.125:0/1161512014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009550 con 0x7fe26409e870 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.455+0000 7fe26a2dc700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 0x7fe26406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe269adb700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe260009b90 tx=0x7fe260004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2600036a0 con 0x7fe26409e870 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26001e070 con 0x7fe26409e870 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2600094a0 con 0x7fe26409e870 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260003a20 con 0x7fe26409e870 2023-10-03T10:17:59.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264130620 con 0x7fe26409e870 2023-10-03T10:17:59.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.456+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe260003b80 con 0x7fe26409e870 2023-10-03T10:17:59.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.457+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe260040660 con 0x7fe26409e870 2023-10-03T10:17:59.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.457+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26411be60 con 0x7fe26409e870 2023-10-03T10:17:59.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.461+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe26002d7d0 con 0x7fe26409e870 2023-10-03T10:17:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 Processor -- start 2023-10-03T10:17:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 -- start start 2023-10-03T10:17:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f777c0a0a70 0x7f777c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c09dc00 con 0x7f777c133f50 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777c09ea60 con 0x7f777c0a0a70 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7783cc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c09dec0 con 0x7f777c0a1380 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7781263700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7781a64700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f777c0a0a70 0x7f777c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7781263700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51018/0 (socket says 172.21.15.125:51018) 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7782265700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f777c133f50 0x7f777c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38202/0 (socket says 172.21.15.125:38202) 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.489+0000 7f7781263700 1 -- 172.21.15.125:0/3670697154 learned_addr learned my addr 172.21.15.125:0/3670697154 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781a64700 1 -- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 msgr2=0x7f777c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781a64700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781a64700 1 -- 172.21.15.125:0/3670697154 >> v1:172.21.15.125:6789/0 conn(0x7f777c133f50 legacy=0x7f777c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781a64700 1 -- 172.21.15.125:0/3670697154 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c09e6a0 con 0x7f777c0a0a70 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7780a62700 1 -- 172.21.15.125:0/3670697154 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470143076 0 0) 0x7f777c09dc00 con 0x7f777c133f50 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781263700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7781a64700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c0a0a70 0x7f777c0a0e40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7778009840 tx=0x7f7778009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bac0fba4becddd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7780a62700 1 -- 172.21.15.125:0/3670697154 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778011830 con 0x7f777c0a0a70 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7780a62700 1 -- 172.21.15.125:0/3670697154 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778011990 con 0x7f777c0a0a70 2023-10-03T10:17:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.490+0000 7f7780a62700 1 -- 172.21.15.125:0/3670697154 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778011d20 con 0x7f777c0a0a70 2023-10-03T10:17:59.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 -- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c0a0a70 msgr2=0x7f777c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c0a0a70 0x7f777c0a0e40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7778009840 tx=0x7f7778009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 -- 172.21.15.125:0/3670697154 shutdown_connections 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c0a0a70 0x7f777c0a0e40 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3670697154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a1380 0x7f777c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 -- 172.21.15.125:0/3670697154 >> 172.21.15.125:0/3670697154 conn(0x7f777c0a6610 msgr2=0x7f777c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 -- 172.21.15.125:0/3670697154 shutdown_connections 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.491+0000 7f7783cc8700 1 -- 172.21.15.125:0/3670697154 wait complete. 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 Processor -- start 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 -- start start 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f777c0a1380 0x7f777c122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c133f50 0x7f777c1233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c133aa0 con 0x7f777c133f50 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c124560 con 0x7f777c0a0a70 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7783cc8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777c124c90 con 0x7f777c0a1380 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7781a64700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7782265700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c133f50 0x7f777c1233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7781263700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f777c0a1380 0x7f777c122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7781a64700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51028/0 (socket says 172.21.15.125:51028) 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.492+0000 7f7781a64700 1 -- 172.21.15.125:0/3519460161 learned_addr learned my addr 172.21.15.125:0/3519460161 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 -- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f777c0a1380 msgr2=0x7f777c122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f777c0a1380 0x7f777c122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 -- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c133f50 msgr2=0x7f777c1233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c133f50 0x7f777c1233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 -- 172.21.15.125:0/3519460161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009550 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7781a64700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7778009fd0 tx=0x7f7778004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778004550 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777801f070 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780094a0 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780038e0 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.493+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c133360 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.494+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7778003a40 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.494+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c04f2a0 con 0x7f777c0a0a70 2023-10-03T10:17:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.494+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7778021070 con 0x7f777c0a0a70 2023-10-03T10:17:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.498+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f777802b020 con 0x7f777c0a0a70 2023-10-03T10:17:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.656+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe26404f2a0 con 0x7fe26409e870 2023-10-03T10:17:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.657+0000 7fe25a7fc700 1 -- 172.21.15.125:0/1161512014 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe260015020 con 0x7fe26409e870 2023-10-03T10:17:59.657 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 msgr2=0x7fe26406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe260009b90 tx=0x7fe260004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 shutdown_connections 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe264131d70 0x7fe26406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe26409e870 0x7fe26406b8b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 --2- 172.21.15.125:0/1161512014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe26409f180 0x7fe26406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 >> 172.21.15.125:0/1161512014 conn(0x7fe2640a4430 msgr2=0x7fe264131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 shutdown_connections 2023-10-03T10:17:59.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.659+0000 7fe26bd3f700 1 -- 172.21.15.125:0/1161512014 wait complete. 2023-10-03T10:17:59.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:17:59.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.690+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f777c072980 con 0x7f777c0a0a70 2023-10-03T10:17:59.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.690+0000 7f77727fc700 1 -- 172.21.15.125:0/3519460161 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7778034070 con 0x7f777c0a0a70 2023-10-03T10:17:59.691 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:17:59.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 msgr2=0x7f777c122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7778009fd0 tx=0x7f7778004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 shutdown_connections 2023-10-03T10:17:59.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f777c133f50 0x7f777c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f777c0a0a70 0x7f777c122920 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 --2- 172.21.15.125:0/3519460161 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f777c0a1380 0x7f777c122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 >> 172.21.15.125:0/3519460161 conn(0x7f777c0a6610 msgr2=0x7f777c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 shutdown_connections 2023-10-03T10:17:59.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:17:59.692+0000 7f7783cc8700 1 -- 172.21.15.125:0/3519460161 wait complete. 2023-10-03T10:17:59.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:00.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:00.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 Processor -- start 2023-10-03T10:18:00.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 -- start start 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 0x7eff40133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4009dc00 con 0x7eff40133f50 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4009ea60 con 0x7eff400a0a70 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff4546d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4009dec0 con 0x7eff400a1380 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff3e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 0x7eff40133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51042/0 (socket says 172.21.15.125:51042) 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff3f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7eff40133f50 0x7eff4013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38214/0 (socket says 172.21.15.125:38214) 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.370+0000 7eff3effd700 1 -- 172.21.15.125:0/648808214 learned_addr learned my addr 172.21.15.125:0/648808214 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3dffb700 1 -- 172.21.15.125:0/648808214 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202001632 0 0) 0x7eff4009dc00 con 0x7eff40133f50 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3dffb700 1 -- 172.21.15.125:0/648808214 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff280035b0 con 0x7eff40133f50 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3effd700 1 -- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 msgr2=0x7eff40133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3effd700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 0x7eff40133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3effd700 1 -- 172.21.15.125:0/648808214 >> v1:172.21.15.125:6789/0 conn(0x7eff40133f50 legacy=0x7eff4013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3effd700 1 -- 172.21.15.125:0/648808214 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4009e6a0 con 0x7eff400a0a70 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3e7fc700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 0x7eff40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3effd700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7eff34009920 tx=0x7eff34009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80e032f7fb197ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3dffb700 1 -- 172.21.15.125:0/648808214 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34011830 con 0x7eff400a0a70 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3dffb700 1 -- 172.21.15.125:0/648808214 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34011990 con 0x7eff400a0a70 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.371+0000 7eff3dffb700 1 -- 172.21.15.125:0/648808214 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34011d20 con 0x7eff400a0a70 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 -- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 msgr2=0x7eff400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7eff34009920 tx=0x7eff34009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 -- 172.21.15.125:0/648808214 shutdown_connections 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff400a0e40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 --2- 172.21.15.125:0/648808214 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff400a1380 0x7eff40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 -- 172.21.15.125:0/648808214 >> 172.21.15.125:0/648808214 conn(0x7eff400a6610 msgr2=0x7eff400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 -- 172.21.15.125:0/648808214 shutdown_connections 2023-10-03T10:18:00.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.372+0000 7eff4546d700 1 -- 172.21.15.125:0/648808214 wait complete. 2023-10-03T10:18:00.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.373+0000 7eff4546d700 1 Processor -- start 2023-10-03T10:18:00.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.373+0000 7eff4546d700 1 -- start start 2023-10-03T10:18:00.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff400a1380 0x7eff40122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 0x7eff40123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40126140 con 0x7eff400a1380 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff401244d0 con 0x7eff400a0a70 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff40125da0 con 0x7eff40133f50 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51052/0 (socket says 172.21.15.125:51052) 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 0x7eff40123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 -- 172.21.15.125:0/4269623463 learned_addr learned my addr 172.21.15.125:0/4269623463 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3e7fc700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff400a1380 0x7eff40122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 -- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 msgr2=0x7eff40123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 0x7eff40123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 -- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff400a1380 msgr2=0x7eff40122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff400a1380 0x7eff40122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 -- 172.21.15.125:0/4269623463 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094a0 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3f7fe700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 0x7eff40123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff3effd700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7eff4009eba0 tx=0x7eff34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34004450 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340045b0 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff34009550 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340038e0 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.374+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff400a0430 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.375+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff34003a40 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.375+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff34021030 con 0x7eff400a0a70 2023-10-03T10:18:00.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.375+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff40133a10 con 0x7eff400a0a70 2023-10-03T10:18:00.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.380+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff34003cf0 con 0x7eff400a0a70 2023-10-03T10:18:00.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.520+0000 7f971737f700 1 Processor -- start 2023-10-03T10:18:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.520+0000 7f971737f700 1 -- start start 2023-10-03T10:18:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971737f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 0x7f9710138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971737f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 0x7f971013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971737f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971009b110 con 0x7f971009ad40 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971737f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97100a3b60 con 0x7f9710134140 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971737f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97100a1a80 con 0x7f9710134570 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971491a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 0x7f9710138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971511b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f971009ad40 0x7f9710133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38216/0 (socket says 172.21.15.125:38216) 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971511b700 1 -- 172.21.15.125:0/4000258380 learned_addr learned my addr 172.21.15.125:0/4000258380 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971591c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 0x7f971013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f9707fff700 1 -- 172.21.15.125:0/4000258380 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581182177 0 0) 0x7f971009b110 con 0x7f971009ad40 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971591c700 1 -- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 msgr2=0x7f9710138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971591c700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 0x7f9710138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971591c700 1 -- 172.21.15.125:0/4000258380 >> v1:172.21.15.125:6789/0 conn(0x7f971009ad40 legacy=0x7f9710133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971591c700 1 -- 172.21.15.125:0/4000258380 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100a2fa0 con 0x7f9710134570 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.521+0000 7f971491a700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 0x7f9710138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971591c700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 0x7f971013b3d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9708009dc0 tx=0x7f970800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744e3b2aa6e59954 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f9707fff700 1 -- 172.21.15.125:0/4000258380 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800e070 con 0x7f9710134570 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f9707fff700 1 -- 172.21.15.125:0/4000258380 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800bb20 con 0x7f9710134570 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f9707fff700 1 -- 172.21.15.125:0/4000258380 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708012430 con 0x7f9710134570 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 -- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 msgr2=0x7f971013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 0x7f971013b3d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9708009dc0 tx=0x7f970800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 -- 172.21.15.125:0/4000258380 shutdown_connections 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134570 0x7f971013b3d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 --2- 172.21.15.125:0/4000258380 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9710134140 0x7f9710138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 -- 172.21.15.125:0/4000258380 >> 172.21.15.125:0/4000258380 conn(0x7f9710099c40 msgr2=0x7f971006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 -- 172.21.15.125:0/4000258380 shutdown_connections 2023-10-03T10:18:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.522+0000 7f971737f700 1 -- 172.21.15.125:0/4000258380 wait complete. 2023-10-03T10:18:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.523+0000 7f971737f700 1 Processor -- start 2023-10-03T10:18:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.523+0000 7f971737f700 1 -- start start 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 0x7f971011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 0x7f971011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971013a120 con 0x7f9710134570 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971011eb20 con 0x7f971009ad40 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971009e250 con 0x7f9710134140 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971491a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971591c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 0x7f971011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 0x7f971011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971591c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 0x7f971011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57314/0 (socket says 172.21.15.125:57314) 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971491a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32958/0 (socket says 172.21.15.125:32958) 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971591c700 1 -- 172.21.15.125:0/2278180316 learned_addr learned my addr 172.21.15.125:0/2278180316 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 -- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 msgr2=0x7f971011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 -- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 msgr2=0x7f971011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 0x7f971011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 -- 172.21.15.125:0/2278180316 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000094a0 con 0x7f971009ad40 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971491a700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971511b700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 0x7f971011c8c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f970c00c3c0 tx=0x7f970c00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c004a70 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c004bf0 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9708009a70 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.524+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0070d0 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.525+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971011e0b0 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.525+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f970c007230 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.525+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f970c03f260 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.525+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971004f2a0 con 0x7f971009ad40 2023-10-03T10:18:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.530+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f970c01bbc0 con 0x7f971009ad40 2023-10-03T10:18:00.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.575+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff4004f2a0 con 0x7eff400a0a70 2023-10-03T10:18:00.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.575+0000 7eff277fe700 1 -- 172.21.15.125:0/4269623463 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff34015020 con 0x7eff400a0a70 2023-10-03T10:18:00.576 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 msgr2=0x7eff40122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7eff4009eba0 tx=0x7eff34004750 comp rx=0 tx=0).stop 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 shutdown_connections 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7eff40133f50 0x7eff40123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff400a0a70 0x7eff40122980 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 --2- 172.21.15.125:0/4269623463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff400a1380 0x7eff40122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 >> 172.21.15.125:0/4269623463 conn(0x7eff400a6610 msgr2=0x7eff400a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 shutdown_connections 2023-10-03T10:18:00.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.578+0000 7eff4546d700 1 -- 172.21.15.125:0/4269623463 wait complete. 2023-10-03T10:18:00.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:00.673 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:00.705 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:00.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.725+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97100729d0 con 0x7f971009ad40 2023-10-03T10:18:00.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.726+0000 7f9705ffb700 1 -- 172.21.15.125:0/2278180316 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f970c01ce50 con 0x7f971009ad40 2023-10-03T10:18:00.726 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 msgr2=0x7f971011c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 0x7f971011c8c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f970c00c3c0 tx=0x7f970c00c6d0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 shutdown_connections 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9710134570 0x7f971011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971009ad40 0x7f971011c8c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 --2- 172.21.15.125:0/2278180316 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9710134140 0x7f971011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 >> 172.21.15.125:0/2278180316 conn(0x7f9710099c40 msgr2=0x7f971009b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 shutdown_connections 2023-10-03T10:18:00.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.728+0000 7f971737f700 1 -- 172.21.15.125:0/2278180316 wait complete. 2023-10-03T10:18:00.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:00.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.801+0000 7fceeef18700 1 Processor -- start 2023-10-03T10:18:00.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 -- start start 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee809e9d0 con 0x7fcee80a0a70 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee809dc00 con 0x7fcee8139200 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeef18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcee809dec0 con 0x7fcee80a1550 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceed4b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceed4b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57326/0 (socket says 172.21.15.125:57326) 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32974/0 (socket says 172.21.15.125:32974) 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceed4b5700 1 -- 172.21.15.125:0/2081268338 learned_addr learned my addr 172.21.15.125:0/2081268338 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceeccb4700 1 --1- 172.21.15.125:0/2081268338 >> v1:172.21.15.125:6789/0 conn(0x7fcee80a0a70 0x7fcee80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38220/0 (socket says 172.21.15.125:38220) 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 -- 172.21.15.125:0/2081268338 >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 msgr2=0x7fcee813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 --2- 172.21.15.125:0/2081268338 >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 -- 172.21.15.125:0/2081268338 >> v1:172.21.15.125:6789/0 conn(0x7fcee80a0a70 legacy=0x7fcee80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fcee7fff700 1 -- 172.21.15.125:0/2081268338 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee809e6a0 con 0x7fcee80a1550 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.802+0000 7fceed4b5700 1 --2- 172.21.15.125:0/2081268338 >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fcee7fff700 1 --2- 172.21.15.125:0/2081268338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fced4009840 tx=0x7fced4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33683857b0f5c7d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fcee77fe700 1 -- 172.21.15.125:0/2081268338 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4011830 con 0x7fcee80a1550 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fcee77fe700 1 -- 172.21.15.125:0/2081268338 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4011990 con 0x7fcee80a1550 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fcee77fe700 1 -- 172.21.15.125:0/2081268338 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4011d20 con 0x7fcee80a1550 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 -- 172.21.15.125:0/2081268338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 msgr2=0x7fcee8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 --2- 172.21.15.125:0/2081268338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fced4009840 tx=0x7fced4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 -- 172.21.15.125:0/2081268338 shutdown_connections 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 --2- 172.21.15.125:0/2081268338 >> v2:172.21.15.125:3300/0 conn(0x7fcee8139200 0x7fcee813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 --2- 172.21.15.125:0/2081268338 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a1550 0x7fcee8138cc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 -- 172.21.15.125:0/2081268338 >> 172.21.15.125:0/2081268338 conn(0x7fcee80a6610 msgr2=0x7fcee80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 -- 172.21.15.125:0/2081268338 shutdown_connections 2023-10-03T10:18:00.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.803+0000 7fceeef18700 1 -- 172.21.15.125:0/2081268338 wait complete. 2023-10-03T10:18:00.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.804+0000 7fceeef18700 1 Processor -- start 2023-10-03T10:18:00.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.804+0000 7fceeef18700 1 -- start start 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 0x7fcee811edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 0x7fcee811f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8134100 con 0x7fcee80a1550 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8122310 con 0x7fcee8139200 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeef18700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80a03e0 con 0x7fcee80a0a70 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32980/0 (socket says 172.21.15.125:32980) 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 -- 172.21.15.125:0/1283337674 learned_addr learned my addr 172.21.15.125:0/1283337674 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceed4b5700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 0x7fcee811f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fcee7fff700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 0x7fcee811edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 -- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 msgr2=0x7fcee811f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 0x7fcee811f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 -- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 msgr2=0x7fcee811edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 0x7fcee811edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceeccb4700 1 -- 172.21.15.125:0/1283337674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0009b30 con 0x7fcee80a0a70 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fcee7fff700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 0x7fcee811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.805+0000 7fceed4b5700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 0x7fcee811f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fceeccb4700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00c520 tx=0x7fcedc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc005cb0 con 0x7fcee80a0a70 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc005e10 con 0x7fcee80a0a70 2023-10-03T10:18:00.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40094a0 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0072d0 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee8121d70 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.806+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcedc007430 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.807+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcedc03ea80 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.807+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee8120c50 con 0x7fcee80a0a70 2023-10-03T10:18:00.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.811+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcedc017070 con 0x7fcee80a0a70 2023-10-03T10:18:00.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.842+0000 7f69045c8700 1 Processor -- start 2023-10-03T10:18:00.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.843+0000 7f69045c8700 1 -- start start 2023-10-03T10:18:00.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.843+0000 7f69045c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.843+0000 7f69045c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.843+0000 7f69045c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 0x7f68fc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.843+0000 7f69045c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc09e9d0 con 0x7f68fc0a1380 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f69045c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc09dc00 con 0x7f68fc0a0a70 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f69045c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc09dec0 con 0x7f68fc133f50 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901b63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902364700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 0x7f68fc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901b63700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57344/0 (socket says 172.21.15.125:57344) 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902364700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51086/0 (socket says 172.21.15.125:51086) 2023-10-03T10:18:00.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901b63700 1 -- 172.21.15.125:0/460857133 learned_addr learned my addr 172.21.15.125:0/460857133 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 -- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 msgr2=0x7f68fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 -- 172.21.15.125:0/460857133 >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 msgr2=0x7f68fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 --2- 172.21.15.125:0/460857133 >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 -- 172.21.15.125:0/460857133 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc09e6a0 con 0x7f68fc133f50 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901b63700 1 --2- 172.21.15.125:0/460857133 >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902364700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6902b65700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 0x7f68fc134380 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009d90 tx=0x7f68f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536010bac255e32d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901362700 1 -- 172.21.15.125:0/460857133 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400e070 con 0x7f68fc133f50 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901362700 1 -- 172.21.15.125:0/460857133 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400bb20 con 0x7f68fc133f50 2023-10-03T10:18:00.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.844+0000 7f6901362700 1 -- 172.21.15.125:0/460857133 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4012430 con 0x7f68fc133f50 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 -- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 msgr2=0x7f68fc134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 0x7f68fc134380 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009d90 tx=0x7f68f400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 -- 172.21.15.125:0/460857133 shutdown_connections 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a0a70 0x7f68fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 --2- 172.21.15.125:0/460857133 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc133f50 0x7f68fc134380 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 --2- 172.21.15.125:0/460857133 >> v2:172.21.15.125:3300/0 conn(0x7f68fc0a1380 0x7f68fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 -- 172.21.15.125:0/460857133 >> 172.21.15.125:0/460857133 conn(0x7f68fc0a6610 msgr2=0x7f68fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 -- 172.21.15.125:0/460857133 shutdown_connections 2023-10-03T10:18:00.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.845+0000 7f69045c8700 1 -- 172.21.15.125:0/460857133 wait complete. 2023-10-03T10:18:00.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 Processor -- start 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 -- start start 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 0x7f68fc121d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc124d60 con 0x7f68fc133f50 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc124850 con 0x7f68fc0a1380 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f69045c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc123ce0 con 0x7f68fc0a0a70 2023-10-03T10:18:00.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6902364700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6901b63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6902b65700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 0x7f68fc121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6902364700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32984/0 (socket says 172.21.15.125:32984) 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6902364700 1 -- 172.21.15.125:0/4102318824 learned_addr learned my addr 172.21.15.125:0/4102318824 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.846+0000 7f6901b63700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51094/0 (socket says 172.21.15.125:51094) 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 -- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 msgr2=0x7f68fc1217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 -- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 msgr2=0x7f68fc121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 0x7f68fc121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 -- 172.21.15.125:0/4102318824 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80094a0 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6901b63700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902b65700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 0x7f68fc121d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f6902364700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f68f800e980 tx=0x7f68f800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80096e0 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8013680 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec009550 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8013a10 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.847+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f4009a70 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.848+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68f8013b70 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.848+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68f803f680 con 0x7f68fc0a0a70 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.848+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0a03e0 con 0x7f68fc0a0a70 2023-10-03T10:18:00.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:00.853+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68f8017080 con 0x7f68fc0a0a70 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.005+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcee804f2a0 con 0x7fcee80a0a70 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.006+0000 7fcee57fa700 1 -- 172.21.15.125:0/1283337674 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcedc01b3b0 con 0x7fcee80a0a70 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 msgr2=0x7fcee811e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00c520 tx=0x7fcedc00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 shutdown_connections 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcee8139200 0x7fcee811f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcee80a0a70 0x7fcee811e880 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 --2- 172.21.15.125:0/1283337674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcee80a1550 0x7fcee811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 >> 172.21.15.125:0/1283337674 conn(0x7fcee80a6610 msgr2=0x7fcee80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 shutdown_connections 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.008+0000 7fceeef18700 1 -- 172.21.15.125:0/1283337674 wait complete. 2023-10-03T10:18:01.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:01.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.044+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68fc04f2a0 con 0x7f68fc0a0a70 2023-10-03T10:18:01.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.044+0000 7f68f2ffd700 1 -- 172.21.15.125:0/4102318824 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68f801b3b0 con 0x7f68fc0a0a70 2023-10-03T10:18:01.045 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:01.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 msgr2=0x7f68fc1212b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f68f800e980 tx=0x7f68f800ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:01.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 shutdown_connections 2023-10-03T10:18:01.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68fc133f50 0x7f68fc121d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68fc0a0a70 0x7f68fc1212b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 --2- 172.21.15.125:0/4102318824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68fc0a1380 0x7f68fc1217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.046+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 >> 172.21.15.125:0/4102318824 conn(0x7f68fc0a6610 msgr2=0x7f68fc09bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.047+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 shutdown_connections 2023-10-03T10:18:01.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.047+0000 7f69045c8700 1 -- 172.21.15.125:0/4102318824 wait complete. 2023-10-03T10:18:01.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:01.591 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:01.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 Processor -- start 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 -- start start 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c06b2d0 con 0x7fbb2c1309f0 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c133610 con 0x7fbb2c1300a0 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb32308700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c09a500 con 0x7fbb2c133ad0 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb2b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb2b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57352/0 (socket says 172.21.15.125:57352) 2023-10-03T10:18:01.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51096/0 (socket says 172.21.15.125:51096) 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb2b7fe700 1 -- 172.21.15.125:0/4185551675 learned_addr learned my addr 172.21.15.125:0/4185551675 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.719+0000 7fbb308a5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbb2c1309f0 0x7fbb2c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38222/0 (socket says 172.21.15.125:38222) 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2bfff700 1 -- 172.21.15.125:0/4185551675 >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 msgr2=0x7fbb2c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2bfff700 1 --2- 172.21.15.125:0/4185551675 >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2bfff700 1 -- 172.21.15.125:0/4185551675 >> v1:172.21.15.125:6789/0 conn(0x7fbb2c1309f0 legacy=0x7fbb2c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2bfff700 1 -- 172.21.15.125:0/4185551675 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c1338b0 con 0x7fbb2c133ad0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2affd700 1 -- 172.21.15.125:0/4185551675 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997582899 0 0) 0x7fbb2c06b2d0 con 0x7fbb2c1309f0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2b7fe700 1 --2- 172.21.15.125:0/4185551675 >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2bfff700 1 --2- 172.21.15.125:0/4185551675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009840 tx=0x7fbb1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f235a9a77979e87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2affd700 1 -- 172.21.15.125:0/4185551675 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c011830 con 0x7fbb2c133ad0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2affd700 1 -- 172.21.15.125:0/4185551675 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c011990 con 0x7fbb2c133ad0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb2affd700 1 -- 172.21.15.125:0/4185551675 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c011d20 con 0x7fbb2c133ad0 2023-10-03T10:18:01.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb32308700 1 -- 172.21.15.125:0/4185551675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 msgr2=0x7fbb2c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb32308700 1 --2- 172.21.15.125:0/4185551675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009840 tx=0x7fbb1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb32308700 1 -- 172.21.15.125:0/4185551675 shutdown_connections 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.720+0000 7fbb32308700 1 --2- 172.21.15.125:0/4185551675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c133ad0 0x7fbb2c133ea0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.721+0000 7fbb32308700 1 --2- 172.21.15.125:0/4185551675 >> v2:172.21.15.125:3300/0 conn(0x7fbb2c1300a0 0x7fbb2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.721+0000 7fbb32308700 1 -- 172.21.15.125:0/4185551675 >> 172.21.15.125:0/4185551675 conn(0x7fbb2c099c40 msgr2=0x7fbb2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.721+0000 7fbb32308700 1 -- 172.21.15.125:0/4185551675 shutdown_connections 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.721+0000 7fbb32308700 1 -- 172.21.15.125:0/4185551675 wait complete. 2023-10-03T10:18:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.721+0000 7fbb32308700 1 Processor -- start 2023-10-03T10:18:01.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 -- start start 2023-10-03T10:18:01.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 0x7fbb2c071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 0x7fbb2c071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c11fe60 con 0x7fbb2c1309f0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c11f950 con 0x7fbb2c1300a0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb32308700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c11f5f0 con 0x7fbb2c133ad0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 0x7fbb2c071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51098/0 (socket says 172.21.15.125:51098) 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 -- 172.21.15.125:0/3619626713 learned_addr learned my addr 172.21.15.125:0/3619626713 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb308a5700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 0x7fbb2c071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 -- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 msgr2=0x7fbb2c071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 0x7fbb2c071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 -- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 msgr2=0x7fbb2c071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 0x7fbb2c071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2bfff700 1 -- 172.21.15.125:0/3619626713 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009550 con 0x7fbb2c1300a0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb2b7fe700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 0x7fbb2c071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.722+0000 7fbb308a5700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 0x7fbb2c071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb2bfff700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009fd0 tx=0x7fbb1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c004480 con 0x7fbb2c1300a0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c01f070 con 0x7fbb2c1300a0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c0094a0 con 0x7fbb2c1300a0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0038e0 con 0x7fbb2c1300a0 2023-10-03T10:18:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.723+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c12dd00 con 0x7fbb2c1300a0 2023-10-03T10:18:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.724+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c0a2620 con 0x7fbb2c1300a0 2023-10-03T10:18:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.724+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb1c021030 con 0x7fbb2c1300a0 2023-10-03T10:18:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.724+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb1c040890 con 0x7fbb2c1300a0 2023-10-03T10:18:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.729+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb1c0239c0 con 0x7fbb2c1300a0 2023-10-03T10:18:01.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:01.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.865+0000 7fe3fe316700 1 Processor -- start 2023-10-03T10:18:01.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.865+0000 7fe3fe316700 1 -- start start 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fe316700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fe316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fe316700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f809a760 con 0x7fe3f8133900 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fe316700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f81336e0 con 0x7fe3f81368e0 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fe316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f809a080 con 0x7fe3f8139200 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:32998/0 (socket says 172.21.15.125:32998) 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe3f8133900 0x7fe3f8133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38236/0 (socket says 172.21.15.125:38236) 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57382/0 (socket says 172.21.15.125:57382) 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/3105637825 learned_addr learned my addr 172.21.15.125:0/3105637825 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/3105637825 >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 msgr2=0x7fe3f8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 --2- 172.21.15.125:0/3105637825 >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/3105637825 >> v1:172.21.15.125:6789/0 conn(0x7fe3f8133900 legacy=0x7fe3f8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/3105637825 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80a23e0 con 0x7fe3f8139200 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f77fe700 1 --2- 172.21.15.125:0/3105637825 >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3fc8b3700 1 --2- 172.21.15.125:0/3105637825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e50 tx=0x7fe3f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f572d450b5fc385 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f6ffd700 1 -- 172.21.15.125:0/3105637825 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e070 con 0x7fe3f8139200 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f6ffd700 1 -- 172.21.15.125:0/3105637825 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000b910 con 0x7fe3f8139200 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.866+0000 7fe3f6ffd700 1 -- 172.21.15.125:0/3105637825 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000bcc0 con 0x7fe3f8139200 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 -- 172.21.15.125:0/3105637825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 msgr2=0x7fe3f813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 --2- 172.21.15.125:0/3105637825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e50 tx=0x7fe3f000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 -- 172.21.15.125:0/3105637825 shutdown_connections 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 --2- 172.21.15.125:0/3105637825 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f8139200 0x7fe3f813b5e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 --2- 172.21.15.125:0/3105637825 >> v2:172.21.15.125:3300/0 conn(0x7fe3f81368e0 0x7fe3f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 -- 172.21.15.125:0/3105637825 >> 172.21.15.125:0/3105637825 conn(0x7fe3f80a2980 msgr2=0x7fe3f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 -- 172.21.15.125:0/3105637825 shutdown_connections 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.867+0000 7fe3fe316700 1 -- 172.21.15.125:0/3105637825 wait complete. 2023-10-03T10:18:01.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 Processor -- start 2023-10-03T10:18:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 -- start start 2023-10-03T10:18:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 0x7fe3f811b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 0x7fe3f811b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f811e1d0 con 0x7fe3f8139200 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f811cb50 con 0x7fe3f8133900 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.868+0000 7fe3fe316700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8135be0 con 0x7fe3f81368e0 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 0x7fe3f811b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 0x7fe3f811b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51114/0 (socket says 172.21.15.125:51114) 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f7fff700 1 -- 172.21.15.125:0/243505870 learned_addr learned my addr 172.21.15.125:0/243505870 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 msgr2=0x7fe3f811b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 0x7fe3f811b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 msgr2=0x7fe3f811af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 -- 172.21.15.125:0/243505870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0094a0 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f77fe700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 0x7fe3f811b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f7fff700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fc8b3700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 0x7fe3f811b9c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0015000 tx=0x7fe3f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004800 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0004960 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0009b30 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001c680 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.869+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f811d310 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.870+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3f001c7e0 con 0x7fe3f8139200 2023-10-03T10:18:01.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.870+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f804f2a0 con 0x7fe3f8139200 2023-10-03T10:18:01.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.870+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe3f0040fd0 con 0x7fe3f8139200 2023-10-03T10:18:01.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.875+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3f00249a0 con 0x7fe3f8139200 2023-10-03T10:18:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.924+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb2c04f2a0 con 0x7fbb2c1300a0 2023-10-03T10:18:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.924+0000 7fbb28ff9700 1 -- 172.21.15.125:0/3619626713 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb1c015070 con 0x7fbb2c1300a0 2023-10-03T10:18:01.925 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 msgr2=0x7fbb2c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009fd0 tx=0x7fbb1c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 shutdown_connections 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbb2c133ad0 0x7fbb2c071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb2c1300a0 0x7fbb2c0712f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 --2- 172.21.15.125:0/3619626713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb2c1309f0 0x7fbb2c071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 >> 172.21.15.125:0/3619626713 conn(0x7fbb2c099c40 msgr2=0x7fbb2c132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 shutdown_connections 2023-10-03T10:18:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:01.926+0000 7fbb32308700 1 -- 172.21.15.125:0/3619626713 wait complete. 2023-10-03T10:18:01.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:02.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:02.060 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:02.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.068+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3f81343b0 con 0x7fe3f8139200 2023-10-03T10:18:02.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.068+0000 7fe3f4ff9700 1 -- 172.21.15.125:0/243505870 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3f00243b0 con 0x7fe3f8139200 2023-10-03T10:18:02.069 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:02.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 msgr2=0x7fe3f811b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 0x7fe3f811b9c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0015000 tx=0x7fe3f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 shutdown_connections 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3f8139200 0x7fe3f811b9c0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3f8133900 0x7fe3f811af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 --2- 172.21.15.125:0/243505870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3f81368e0 0x7fe3f811b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 >> 172.21.15.125:0/243505870 conn(0x7fe3f80a2980 msgr2=0x7fe3f8131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 shutdown_connections 2023-10-03T10:18:02.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.071+0000 7fe3fe316700 1 -- 172.21.15.125:0/243505870 wait complete. 2023-10-03T10:18:02.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 Processor -- start 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 -- start start 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 0x7f8a741317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7409da80 con 0x7f8a74131cf0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7409dce0 con 0x7f8a7406a770 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7c3db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7409eb20 con 0x7f8a7406b080 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a7a177700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.150+0000 7f8a79976700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 0x7f8a741317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a7a177700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57392/0 (socket says 172.21.15.125:57392) 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a7a177700 1 -- 172.21.15.125:0/3181039389 learned_addr learned my addr 172.21.15.125:0/3181039389 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79976700 1 -- 172.21.15.125:0/3181039389 >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 msgr2=0x7f8a7406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79976700 1 --2- 172.21.15.125:0/3181039389 >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79976700 1 -- 172.21.15.125:0/3181039389 >> v1:172.21.15.125:6789/0 conn(0x7f8a74131cf0 legacy=0x7f8a74138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79976700 1 -- 172.21.15.125:0/3181039389 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7409d860 con 0x7f8a7406b080 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a7a177700 1 --2- 172.21.15.125:0/3181039389 >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79976700 1 --2- 172.21.15.125:0/3181039389 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 0x7f8a741317b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009840 tx=0x7f8a64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2fafbe8aba0974 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79175700 1 -- 172.21.15.125:0/3181039389 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011830 con 0x7f8a7406b080 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79175700 1 -- 172.21.15.125:0/3181039389 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64011990 con 0x7f8a7406b080 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.151+0000 7f8a79175700 1 -- 172.21.15.125:0/3181039389 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011d20 con 0x7f8a7406b080 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 -- 172.21.15.125:0/3181039389 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 msgr2=0x7f8a741317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/3181039389 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 0x7f8a741317b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009840 tx=0x7f8a64009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 -- 172.21.15.125:0/3181039389 shutdown_connections 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/3181039389 >> v2:172.21.15.125:3300/0 conn(0x7f8a7406a770 0x7f8a7406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/3181039389 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a7406b080 0x7f8a741317b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 -- 172.21.15.125:0/3181039389 >> 172.21.15.125:0/3181039389 conn(0x7f8a74099c40 msgr2=0x7f8a740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 -- 172.21.15.125:0/3181039389 shutdown_connections 2023-10-03T10:18:02.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.152+0000 7f8a7c3db700 1 -- 172.21.15.125:0/3181039389 wait complete. 2023-10-03T10:18:02.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 Processor -- start 2023-10-03T10:18:02.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 -- start start 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a74131cf0 0x7f8a7409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74123ab0 con 0x7f8a7406b080 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74123d90 con 0x7f8a7406a770 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7c3db700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740a2a10 con 0x7f8a74131cf0 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7a177700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a79976700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7a978700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a74131cf0 0x7f8a7409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a79976700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57402/0 (socket says 172.21.15.125:57402) 2023-10-03T10:18:02.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a7a177700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51118/0 (socket says 172.21.15.125:51118) 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.153+0000 7f8a79976700 1 -- 172.21.15.125:0/1851049583 learned_addr learned my addr 172.21.15.125:0/1851049583 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 -- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a74131cf0 msgr2=0x7f8a7409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a74131cf0 0x7f8a7409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 -- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 msgr2=0x7f8a7409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 -- 172.21.15.125:0/1851049583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70009550 con 0x7f8a7406b080 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a7a177700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a79976700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a640036a0 con 0x7f8a7406b080 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6401f070 con 0x7f8a7406b080 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a640094a0 con 0x7f8a7406b080 2023-10-03T10:18:02.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64003a60 con 0x7f8a7406b080 2023-10-03T10:18:02.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.154+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a741237f0 con 0x7f8a7406b080 2023-10-03T10:18:02.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.155+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a64003bc0 con 0x7f8a7406b080 2023-10-03T10:18:02.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.155+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a64021070 con 0x7f8a7406b080 2023-10-03T10:18:02.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.155+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7411add0 con 0x7f8a7406b080 2023-10-03T10:18:02.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.160+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a64015080 con 0x7f8a7406b080 2023-10-03T10:18:02.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.191+0000 7f55a7934700 1 Processor -- start 2023-10-03T10:18:02.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 -- start start 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55a00a1550 0x7f55a0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a009e9d0 con 0x7f55a00a0a70 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a009dc00 con 0x7f55a00a1550 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a7934700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55a009dec0 con 0x7f55a0139200 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a4ecf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55a00a1550 0x7f55a0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a5ed1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a5ed1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33042/0 (socket says 172.21.15.125:33042) 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a4ecf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55a00a1550 0x7f55a0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57404/0 (socket says 172.21.15.125:57404) 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.192+0000 7f55a5ed1700 1 -- 172.21.15.125:0/689520726 learned_addr learned my addr 172.21.15.125:0/689520726 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a4ecf700 1 -- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 msgr2=0x7f55a013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a4ecf700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a4ecf700 1 -- 172.21.15.125:0/689520726 >> v1:172.21.15.125:6789/0 conn(0x7f55a00a0a70 legacy=0x7f55a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a4ecf700 1 -- 172.21.15.125:0/689520726 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a009e6a0 con 0x7f55a00a1550 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f5597fff700 1 -- 172.21.15.125:0/689520726 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372432437 0 0) 0x7f55a009e9d0 con 0x7f55a00a0a70 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a5ed1700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a4ecf700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a00a1550 0x7f55a0138cc0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f9b28b8e8e5542 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f5597fff700 1 -- 172.21.15.125:0/689520726 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011830 con 0x7f55a00a1550 2023-10-03T10:18:02.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f5597fff700 1 -- 172.21.15.125:0/689520726 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590011990 con 0x7f55a00a1550 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f5597fff700 1 -- 172.21.15.125:0/689520726 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011d20 con 0x7f55a00a1550 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 -- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a00a1550 msgr2=0x7f55a0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a00a1550 0x7f55a0138cc0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 -- 172.21.15.125:0/689520726 shutdown_connections 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a0139200 0x7f55a013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 --2- 172.21.15.125:0/689520726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a00a1550 0x7f55a0138cc0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.193+0000 7f55a7934700 1 -- 172.21.15.125:0/689520726 >> 172.21.15.125:0/689520726 conn(0x7f55a00a6610 msgr2=0x7f55a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.194+0000 7f55a7934700 1 -- 172.21.15.125:0/689520726 shutdown_connections 2023-10-03T10:18:02.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.194+0000 7f55a7934700 1 -- 172.21.15.125:0/689520726 wait complete. 2023-10-03T10:18:02.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 Processor -- start 2023-10-03T10:18:02.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 -- start start 2023-10-03T10:18:02.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 0x7f55a01207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 0x7f55a0120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 0x7f55a0121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0124420 con 0x7f55a0139200 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00a5100 con 0x7f55a00a0a70 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.195+0000 7f55a7934700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0123ac0 con 0x7f55a00a1550 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a4ecf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 0x7f55a0120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 0x7f55a0121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a4ecf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 0x7f55a0120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33044/0 (socket says 172.21.15.125:33044) 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a4ecf700 1 -- 172.21.15.125:0/3379662324 learned_addr learned my addr 172.21.15.125:0/3379662324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a56d0700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 0x7f55a01207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 -- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 msgr2=0x7f55a0120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 0x7f55a0120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 -- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 msgr2=0x7f55a01207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 0x7f55a01207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 -- 172.21.15.125:0/3379662324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598009b30 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a56d0700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 0x7f55a01207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a5ed1700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 0x7f55a0121270 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f559800ef90 tx=0x7f559800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598018070 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800f040 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900094a0 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598003c60 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.196+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0124030 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.197+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f559800c880 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.197+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f559803f820 con 0x7f55a0139200 2023-10-03T10:18:02.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.197+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a004f2a0 con 0x7f55a0139200 2023-10-03T10:18:02.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.202+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5598003dc0 con 0x7f55a0139200 2023-10-03T10:18:02.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.355+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a741245e0 con 0x7f8a7406b080 2023-10-03T10:18:02.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.355+0000 7f8a6affd700 1 -- 172.21.15.125:0/1851049583 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a6401a430 con 0x7f8a7406b080 2023-10-03T10:18:02.355 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:02.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 msgr2=0x7f8a7409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a64004750 comp rx=0 tx=0).stop 2023-10-03T10:18:02.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 shutdown_connections 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8a74131cf0 0x7f8a7409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a7406a770 0x7f8a7409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 --2- 172.21.15.125:0/1851049583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a7406b080 0x7f8a7409a9d0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 >> 172.21.15.125:0/1851049583 conn(0x7f8a74099c40 msgr2=0x7f8a7412ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 shutdown_connections 2023-10-03T10:18:02.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.357+0000 7f8a7c3db700 1 -- 172.21.15.125:0/1851049583 wait complete. 2023-10-03T10:18:02.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:02.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.397+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f55a00a03e0 con 0x7f55a0139200 2023-10-03T10:18:02.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.397+0000 7f5595ffb700 1 -- 172.21.15.125:0/3379662324 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f559801cbb0 con 0x7f55a0139200 2023-10-03T10:18:02.398 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 msgr2=0x7f55a0121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 0x7f55a0121270 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f559800ef90 tx=0x7f559800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 shutdown_connections 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55a0139200 0x7f55a0121270 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55a00a0a70 0x7f55a01207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 --2- 172.21.15.125:0/3379662324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55a00a1550 0x7f55a0120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 >> 172.21.15.125:0/3379662324 conn(0x7f55a00a6610 msgr2=0x7f55a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 shutdown_connections 2023-10-03T10:18:02.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:02.399+0000 7f55a7934700 1 -- 172.21.15.125:0/3379662324 wait complete. 2023-10-03T10:18:02.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:02.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:03.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.065+0000 7f5ffb1b6700 1 Processor -- start 2023-10-03T10:18:03.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.065+0000 7f5ffb1b6700 1 -- start start 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ff40a0a90 0x7f5ff40a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 0x7f5ff41343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40a3aa0 con 0x7f5ff40a0a90 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff409a540 con 0x7f5ff40a13a0 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ffb1b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40a1fe0 con 0x7f5ff4133f70 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ff40a0a90 0x7f5ff40a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51142/0 (socket says 172.21.15.125:51142) 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ff40a0a90 0x7f5ff40a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57418/0 (socket says 172.21.15.125:57418) 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff3fff700 1 -- 172.21.15.125:0/2086957366 learned_addr learned my addr 172.21.15.125:0/2086957366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff9753700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 0x7f5ff41343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 -- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 msgr2=0x7f5ff41343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 0x7f5ff41343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 -- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 msgr2=0x7f5ff4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff8f52700 1 -- 172.21.15.125:0/2086957366 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff409a280 con 0x7f5ff40a0a90 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff9753700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 0x7f5ff41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.066+0000 7f5ff3fff700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff40a0e60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009dc0 tx=0x7f5fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfea3fec58a04cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ff37fe700 1 -- 172.21.15.125:0/2086957366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e070 con 0x7f5ff40a0a90 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ff37fe700 1 -- 172.21.15.125:0/2086957366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00bae0 con 0x7f5ff40a0a90 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ff37fe700 1 -- 172.21.15.125:0/2086957366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00be90 con 0x7f5ff40a0a90 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 msgr2=0x7f5ff40a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff40a0e60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009dc0 tx=0x7f5fec00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/2086957366 shutdown_connections 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff4133f70 0x7f5ff41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff40a0e60 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/2086957366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff40a13a0 0x7f5ff4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/2086957366 >> 172.21.15.125:0/2086957366 conn(0x7f5ff4099c40 msgr2=0x7f5ff406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/2086957366 shutdown_connections 2023-10-03T10:18:03.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.067+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/2086957366 wait complete. 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.068+0000 7f5ffb1b6700 1 Processor -- start 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.068+0000 7f5ffb1b6700 1 -- start start 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff41c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff4133f70 0x7f5ff41c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4122330 con 0x7f5ff40a0a90 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4133820 con 0x7f5ff4133f70 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4122070 con 0x7f5ff40a13a0 2023-10-03T10:18:03.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff41c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff9753700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff4133f70 0x7f5ff41c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33068/0 (socket says 172.21.15.125:33068) 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff3fff700 1 -- 172.21.15.125:0/1453657271 learned_addr learned my addr 172.21.15.125:0/1453657271 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 -- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 msgr2=0x7f5ff41c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 -- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff4133f70 msgr2=0x7f5ff41c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff4133f70 0x7f5ff41c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 -- 172.21.15.125:0/1453657271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009550 con 0x7f5ff40a0a90 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff3fff700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff8f52700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff41c8300 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f5fec016000 tx=0x7f5fec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0045d0 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec020070 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec027480 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.069+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe40094a0 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.070+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec009a70 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.070+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fec012430 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.070+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5fec022070 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.070+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff4122570 con 0x7f5ff40a0a90 2023-10-03T10:18:03.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.075+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fec01c400 con 0x7f5ff40a0a90 2023-10-03T10:18:03.086 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:03.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.210+0000 7fab12347700 1 Processor -- start 2023-10-03T10:18:03.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.210+0000 7fab12347700 1 -- start start 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.210+0000 7fab12347700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.210+0000 7fab12347700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab12347700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 0x7fab0c0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab12347700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c0a3b60 con 0x7fab0c0a0a70 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab12347700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c1348e0 con 0x7fab0c133f70 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab12347700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c09b110 con 0x7fab0c09ad40 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab108e4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 0x7fab0c0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab108e4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 0x7fab0c0a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57436/0 (socket says 172.21.15.125:57436) 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab108e4700 1 -- 172.21.15.125:0/2944950002 learned_addr learned my addr 172.21.15.125:0/2944950002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 -- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 msgr2=0x7fab0c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 -- 172.21.15.125:0/2944950002 >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 msgr2=0x7fab0c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/2944950002 >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 0x7fab0c0a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 -- 172.21.15.125:0/2944950002 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0a2fa0 con 0x7fab0c133f70 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0bfff700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1343a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab00009870 tx=0x7fab00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3cd6ba9f77cd8f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0affd700 1 -- 172.21.15.125:0/2944950002 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00011830 con 0x7fab0c133f70 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0affd700 1 -- 172.21.15.125:0/2944950002 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00011990 con 0x7fab0c133f70 2023-10-03T10:18:03.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.211+0000 7fab0affd700 1 -- 172.21.15.125:0/2944950002 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00011d20 con 0x7fab0c133f70 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 -- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 msgr2=0x7fab0c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1343a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab00009870 tx=0x7fab00009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 -- 172.21.15.125:0/2944950002 shutdown_connections 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 --2- 172.21.15.125:0/2944950002 >> v2:172.21.15.125:3300/0 conn(0x7fab0c0a0a70 0x7fab0c0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 --2- 172.21.15.125:0/2944950002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1343a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 -- 172.21.15.125:0/2944950002 >> 172.21.15.125:0/2944950002 conn(0x7fab0c099c40 msgr2=0x7fab0c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 -- 172.21.15.125:0/2944950002 shutdown_connections 2023-10-03T10:18:03.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.212+0000 7fab12347700 1 -- 172.21.15.125:0/2944950002 wait complete. 2023-10-03T10:18:03.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 Processor -- start 2023-10-03T10:18:03.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 -- start start 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c11f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c11f290 con 0x7fab0c0a0a70 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c133710 con 0x7fab0c133f70 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.213+0000 7fab12347700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c09c7e0 con 0x7fab0c09ad40 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57442/0 (socket says 172.21.15.125:57442) 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab108e4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 -- 172.21.15.125:0/3432243879 learned_addr learned my addr 172.21.15.125:0/3432243879 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0bfff700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c11f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 -- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 msgr2=0x7fab0c11f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c11f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 -- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 msgr2=0x7fab0c1c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 -- 172.21.15.125:0/3432243879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0094a0 con 0x7fab0c0a0a70 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab108e4700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab0b7fe700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fab000097c0 tx=0x7fab00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00004450 con 0x7fab0c0a0a70 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab000045b0 con 0x7fab0c0a0a70 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000094a0 con 0x7fab0c0a0a70 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab000038c0 con 0x7fab0c0a0a70 2023-10-03T10:18:03.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.214+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c120160 con 0x7fab0c0a0a70 2023-10-03T10:18:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.215+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab00003a20 con 0x7fab0c0a0a70 2023-10-03T10:18:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.215+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c074f10 con 0x7fab0c0a0a70 2023-10-03T10:18:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.215+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab00040120 con 0x7fab0c0a0a70 2023-10-03T10:18:03.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.220+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab0001a420 con 0x7fab0c0a0a70 2023-10-03T10:18:03.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.286+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ff404f2a0 con 0x7f5ff40a0a90 2023-10-03T10:18:03.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.286+0000 7f5ff17fa700 1 -- 172.21.15.125:0/1453657271 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fec02c070 con 0x7f5ff40a0a90 2023-10-03T10:18:03.286 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 msgr2=0x7f5ff41c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff41c8300 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f5fec016000 tx=0x7f5fec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 shutdown_connections 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ff4133f70 0x7f5ff41c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ff40a0a90 0x7f5ff41c8300 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 --2- 172.21.15.125:0/1453657271 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ff40a13a0 0x7f5ff41c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 >> 172.21.15.125:0/1453657271 conn(0x7f5ff4099c40 msgr2=0x7f5ff41bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 shutdown_connections 2023-10-03T10:18:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.288+0000 7f5ffb1b6700 1 -- 172.21.15.125:0/1453657271 wait complete. 2023-10-03T10:18:03.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:03.370 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:03.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:03.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.426+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab0c04f2a0 con 0x7fab0c0a0a70 2023-10-03T10:18:03.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.427+0000 7fab08ff9700 1 -- 172.21.15.125:0/3432243879 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab00015030 con 0x7fab0c0a0a70 2023-10-03T10:18:03.427 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 msgr2=0x7fab0c11fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fab000097c0 tx=0x7fab00004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 shutdown_connections 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab0c133f70 0x7fab0c1c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab0c09ad40 0x7fab0c11f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 --2- 172.21.15.125:0/3432243879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab0c0a0a70 0x7fab0c11fc20 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 >> 172.21.15.125:0/3432243879 conn(0x7fab0c099c40 msgr2=0x7fab0c1bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 shutdown_connections 2023-10-03T10:18:03.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.429+0000 7fab12347700 1 -- 172.21.15.125:0/3432243879 wait complete. 2023-10-03T10:18:03.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:03.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 Processor -- start 2023-10-03T10:18:03.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 -- start start 2023-10-03T10:18:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 0x7f7644138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7644134570 0x7f764413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764409b110 con 0x7f764409ad40 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440a3b60 con 0x7f7644134570 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.496+0000 7f7648892700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440a1a80 con 0x7f7644134140 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7641d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 0x7f7644138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f764409ad40 0x7f7644133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38266/0 (socket says 172.21.15.125:38266) 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764259c700 1 -- 172.21.15.125:0/712058665 learned_addr learned my addr 172.21.15.125:0/712058665 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 --2- 172.21.15.125:0/712058665 >> v2:172.21.15.125:3300/0 conn(0x7f7644134570 0x7f764413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 -- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 msgr2=0x7f7644138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 0x7f7644138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 -- 172.21.15.125:0/712058665 >> v1:172.21.15.125:6789/0 conn(0x7f764409ad40 legacy=0x7f7644133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764159a700 1 -- 172.21.15.125:0/712058665 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792090732 0 0) 0x7f764409b110 con 0x7f764409ad40 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 -- 172.21.15.125:0/712058665 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440a2fa0 con 0x7f7644134570 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7641d9b700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 0x7f7644138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f7642d9d700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134570 0x7f764413b3d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f763c009d90 tx=0x7f763c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1689da070e6b358 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764159a700 1 -- 172.21.15.125:0/712058665 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00e070 con 0x7f7644134570 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764159a700 1 -- 172.21.15.125:0/712058665 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c00bb20 con 0x7f7644134570 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.497+0000 7f764159a700 1 -- 172.21.15.125:0/712058665 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c012430 con 0x7f7644134570 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 -- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134570 msgr2=0x7f764413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134570 0x7f764413b3d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f763c009d90 tx=0x7f763c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:03.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 -- 172.21.15.125:0/712058665 shutdown_connections 2023-10-03T10:18:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134570 0x7f764413b3d0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 --2- 172.21.15.125:0/712058665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134140 0x7f7644138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 -- 172.21.15.125:0/712058665 >> 172.21.15.125:0/712058665 conn(0x7f7644099c40 msgr2=0x7f764406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 -- 172.21.15.125:0/712058665 shutdown_connections 2023-10-03T10:18:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.498+0000 7f7648892700 1 -- 172.21.15.125:0/712058665 wait complete. 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 Processor -- start 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 -- start start 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 0x7f76441393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 0x7f7644139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764411e4a0 con 0x7f7644134140 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764409c7e0 con 0x7f7644134570 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7648892700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76440a43a0 con 0x7f764409ad40 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.499+0000 7f7641d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f764259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 0x7f76441393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 0x7f7644139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7641d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57468/0 (socket says 172.21.15.125:57468) 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f764259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 0x7f76441393d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33094/0 (socket says 172.21.15.125:33094) 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7641d9b700 1 -- 172.21.15.125:0/453255683 learned_addr learned my addr 172.21.15.125:0/453255683 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 -- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 msgr2=0x7f76441393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 0x7f76441393d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 -- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 msgr2=0x7f7644139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 -- 172.21.15.125:0/453255683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094a0 con 0x7f7644134570 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7641d9b700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7642d9d700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 0x7f7644139e50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f763c016000 tx=0x7f763c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c012430 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c020070 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c009a70 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c004280 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.500+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764411e050 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.501+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f763c0043e0 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.501+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76441361e0 con 0x7f7644134570 2023-10-03T10:18:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.501+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f763c022070 con 0x7f7644134570 2023-10-03T10:18:03.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.506+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f763c009860 con 0x7f7644134570 2023-10-03T10:18:03.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.538+0000 7f974fe0d700 1 Processor -- start 2023-10-03T10:18:03.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.538+0000 7f974fe0d700 1 -- start start 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974fe0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 0x7f9748138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974fe0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9748139200 0x7f974813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974fe0d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974809e9d0 con 0x7f97480a0a70 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974fe0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974809dc00 con 0x7f97480a1550 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974fe0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f974809dec0 con 0x7f9748139200 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974e3aa700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9748139200 0x7f974813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974dba9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97480a0a70 0x7f97480a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38270/0 (socket says 172.21.15.125:38270) 2023-10-03T10:18:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974dba9700 1 -- 172.21.15.125:0/1267724815 learned_addr learned my addr 172.21.15.125:0/1267724815 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 0x7f9748138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974cba7700 1 -- 172.21.15.125:0/1267724815 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525971308 0 0) 0x7f974809e9d0 con 0x7f97480a0a70 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974cba7700 1 -- 172.21.15.125:0/1267724815 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97340035b0 con 0x7f97480a0a70 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 -- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9748139200 msgr2=0x7f974813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9748139200 0x7f974813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 -- 172.21.15.125:0/1267724815 >> v1:172.21.15.125:6789/0 conn(0x7f97480a0a70 legacy=0x7f97480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 -- 172.21.15.125:0/1267724815 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974809e6a0 con 0x7f97480a1550 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974d3a8700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 0x7f9748138cc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9738009870 tx=0x7f9738009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8af896f3e11cd8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974cba7700 1 -- 172.21.15.125:0/1267724815 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738011830 con 0x7f97480a1550 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.539+0000 7f974cba7700 1 -- 172.21.15.125:0/1267724815 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738011990 con 0x7f97480a1550 2023-10-03T10:18:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974cba7700 1 -- 172.21.15.125:0/1267724815 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738011d20 con 0x7f97480a1550 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 -- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 msgr2=0x7f9748138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 0x7f9748138cc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9738009870 tx=0x7f9738009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 -- 172.21.15.125:0/1267724815 shutdown_connections 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9748139200 0x7f974813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 --2- 172.21.15.125:0/1267724815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a1550 0x7f9748138cc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 -- 172.21.15.125:0/1267724815 >> 172.21.15.125:0/1267724815 conn(0x7f97480a6610 msgr2=0x7f97480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 -- 172.21.15.125:0/1267724815 shutdown_connections 2023-10-03T10:18:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.540+0000 7f974fe0d700 1 -- 172.21.15.125:0/1267724815 wait complete. 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 Processor -- start 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 -- start start 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 0x7f974811e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 0x7f974811ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480a03e0 con 0x7f9748139200 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748134410 con 0x7f97480a0a70 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.541+0000 7f974fe0d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97480a5100 con 0x7f97480a1550 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974e3aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974dba9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 0x7f974811e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974e3aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57474/0 (socket says 172.21.15.125:57474) 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974e3aa700 1 -- 172.21.15.125:0/55615381 learned_addr learned my addr 172.21.15.125:0/55615381 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 0x7f974811ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 -- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 msgr2=0x7f974811e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 0x7f974811e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 -- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 msgr2=0x7f974811f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 -- 172.21.15.125:0/55615381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380094a0 con 0x7f97480a1550 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974e3aa700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974dba9700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 0x7f974811e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974d3a8700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 0x7f974811ee80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9738016000 tx=0x7f9738004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738004450 con 0x7f97480a1550 2023-10-03T10:18:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973801f070 con 0x7f97480a1550 2023-10-03T10:18:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97481205d0 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380038e0 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.542+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748122b60 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.543+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9738003a40 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.543+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9748122020 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.543+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9738021070 con 0x7f97480a1550 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.548+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97380253e0 con 0x7f97480a1550 2023-10-03T10:18:03.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.695+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f764411e8b0 con 0x7f7644134570 2023-10-03T10:18:03.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.696+0000 7f7632ffd700 1 -- 172.21.15.125:0/453255683 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f763c02c020 con 0x7f7644134570 2023-10-03T10:18:03.696 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 msgr2=0x7f7644139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 0x7f7644139e50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f763c016000 tx=0x7f763c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 shutdown_connections 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7644134570 0x7f7644139e50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f764409ad40 0x7f76441393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 --2- 172.21.15.125:0/453255683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7644134140 0x7f7644139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 >> 172.21.15.125:0/453255683 conn(0x7f7644099c40 msgr2=0x7f764413b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 shutdown_connections 2023-10-03T10:18:03.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.698+0000 7f7648892700 1 -- 172.21.15.125:0/453255683 wait complete. 2023-10-03T10:18:03.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:03.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.734+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f974809f920 con 0x7f97480a1550 2023-10-03T10:18:03.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.735+0000 7f973e7fc700 1 -- 172.21.15.125:0/55615381 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9738015020 con 0x7f97480a1550 2023-10-03T10:18:03.735 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:03.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 msgr2=0x7f974811ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 0x7f974811ee80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9738016000 tx=0x7f9738004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 shutdown_connections 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9748139200 0x7f974811f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97480a0a70 0x7f974811e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 --2- 172.21.15.125:0/55615381 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97480a1550 0x7f974811ee80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 >> 172.21.15.125:0/55615381 conn(0x7f97480a6610 msgr2=0x7f97480a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 shutdown_connections 2023-10-03T10:18:03.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:03.737+0000 7f974fe0d700 1 -- 172.21.15.125:0/55615381 wait complete. 2023-10-03T10:18:03.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:04.303 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:04.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 Processor -- start 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 -- start start 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f040a13a0 0x7f7f04133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040a1fe0 con 0x7f7f04133f70 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040a3aa0 con 0x7f7f040a13a0 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.429+0000 7f7f094a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409a540 con 0x7f7f040a0a90 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f040a13a0 0x7f7f04133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51252/0 (socket says 172.21.15.125:51252) 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f040a13a0 0x7f7f04133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57486/0 (socket says 172.21.15.125:57486) 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f02ffd700 1 -- 172.21.15.125:0/1320755552 learned_addr learned my addr 172.21.15.125:0/1320755552 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 -- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 msgr2=0x7f7f040a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 -- 172.21.15.125:0/1320755552 >> v1:172.21.15.125:6789/0 conn(0x7f7f04133f70 legacy=0x7f7f0413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f01ffb700 1 -- 172.21.15.125:0/1320755552 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669901327 0 0) 0x7f7f040a1fe0 con 0x7f7f04133f70 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 -- 172.21.15.125:0/1320755552 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0409a280 con 0x7f7f040a13a0 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f02ffd700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f027fc700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a13a0 0x7f7f04133a30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009840 tx=0x7f7ef4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d003b02884390b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f01ffb700 1 -- 172.21.15.125:0/1320755552 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011830 con 0x7f7f040a13a0 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f01ffb700 1 -- 172.21.15.125:0/1320755552 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4011990 con 0x7f7f040a13a0 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.430+0000 7f7f01ffb700 1 -- 172.21.15.125:0/1320755552 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011d20 con 0x7f7f040a13a0 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 -- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a13a0 msgr2=0x7f7f04133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a13a0 0x7f7f04133a30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009840 tx=0x7f7ef4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 -- 172.21.15.125:0/1320755552 shutdown_connections 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f040a0a90 0x7f7f040a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 --2- 172.21.15.125:0/1320755552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a13a0 0x7f7f04133a30 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 -- 172.21.15.125:0/1320755552 >> 172.21.15.125:0/1320755552 conn(0x7f7f04099c40 msgr2=0x7f7f0406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 -- 172.21.15.125:0/1320755552 shutdown_connections 2023-10-03T10:18:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.431+0000 7f7f094a2700 1 -- 172.21.15.125:0/1320755552 wait complete. 2023-10-03T10:18:04.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 Processor -- start 2023-10-03T10:18:04.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 -- start start 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f040a13a0 0x7f7f041c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 0x7f7f041c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04120c70 con 0x7f7f040a0a90 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04120810 con 0x7f7f04133f70 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f094a2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04122530 con 0x7f7f040a13a0 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f027fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f040a13a0 0x7f7f041c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57496/0 (socket says 172.21.15.125:57496) 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f02ffd700 1 -- 172.21.15.125:0/2161343410 learned_addr learned my addr 172.21.15.125:0/2161343410 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.432+0000 7f7f037fe700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 0x7f7f041c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 -- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f040a13a0 msgr2=0x7f7f041c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f040a13a0 0x7f7f041c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 -- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 msgr2=0x7f7f041c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 0x7f7f041c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 -- 172.21.15.125:0/2161343410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8009550 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f037fe700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 0x7f7f041c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f02ffd700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ec10 tx=0x7f7ef800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800c850 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef800c9b0 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40094a0 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800cd40 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.433+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04122250 con 0x7f7f040a0a90 2023-10-03T10:18:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.434+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ef8013470 con 0x7f7f040a0a90 2023-10-03T10:18:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.434+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ef803fc00 con 0x7f7f040a0a90 2023-10-03T10:18:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.434+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f041220b0 con 0x7f7f040a0a90 2023-10-03T10:18:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.438+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f041220b0 con 0x7f7f040a0a90 2023-10-03T10:18:04.443 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:04.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.568+0000 7fe05ab72700 1 Processor -- start 2023-10-03T10:18:04.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.568+0000 7fe05ab72700 1 -- start start 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05ab72700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a1550 0x7fe054138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05ab72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe05413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05ab72700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05409e9d0 con 0x7fe0540a0a70 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05ab72700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05409dc00 con 0x7fe0540a1550 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05ab72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe05409dec0 con 0x7fe054139200 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05890e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe0540a0a70 0x7fe0540a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38290/0 (socket says 172.21.15.125:38290) 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe05413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05890e700 1 -- 172.21.15.125:0/2524147140 learned_addr learned my addr 172.21.15.125:0/2524147140 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe053fff700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a1550 0x7fe054138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe0537fe700 1 -- 172.21.15.125:0/2524147140 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669935105 0 0) 0x7fe05409e9d0 con 0x7fe0540a0a70 2023-10-03T10:18:04.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 -- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a1550 msgr2=0x7fe054138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a1550 0x7fe054138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 -- 172.21.15.125:0/2524147140 >> v1:172.21.15.125:6789/0 conn(0x7fe0540a0a70 legacy=0x7fe0540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 -- 172.21.15.125:0/2524147140 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05409e6a0 con 0x7fe054139200 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe05910f700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe05413b5e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009dc0 tx=0x7fe04c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34552a6f35560bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe0537fe700 1 -- 172.21.15.125:0/2524147140 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00e070 con 0x7fe054139200 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe0537fe700 1 -- 172.21.15.125:0/2524147140 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00bb20 con 0x7fe054139200 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.569+0000 7fe0537fe700 1 -- 172.21.15.125:0/2524147140 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c012430 con 0x7fe054139200 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 -- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 msgr2=0x7fe05413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe05413b5e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009dc0 tx=0x7fe04c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 -- 172.21.15.125:0/2524147140 shutdown_connections 2023-10-03T10:18:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe05413b5e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 --2- 172.21.15.125:0/2524147140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a1550 0x7fe054138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 -- 172.21.15.125:0/2524147140 >> 172.21.15.125:0/2524147140 conn(0x7fe0540a6610 msgr2=0x7fe0540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 -- 172.21.15.125:0/2524147140 shutdown_connections 2023-10-03T10:18:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.570+0000 7fe05ab72700 1 -- 172.21.15.125:0/2524147140 wait complete. 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.571+0000 7fe05ab72700 1 Processor -- start 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.571+0000 7fe05ab72700 1 -- start start 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 0x7fe054121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe0541221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054125250 con 0x7fe0540a1550 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540a56b0 con 0x7fe0540a0a70 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05ab72700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540a03e0 con 0x7fe054139200 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05890e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05910f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe0541221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05890e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51280/0 (socket says 172.21.15.125:51280) 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe05890e700 1 -- 172.21.15.125:0/3694865189 learned_addr learned my addr 172.21.15.125:0/3694865189 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe053fff700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 0x7fe054121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.572+0000 7fe053fff700 1 -- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 msgr2=0x7fe0541221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe053fff700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe0541221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe053fff700 1 -- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 msgr2=0x7fe054121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe053fff700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe053fff700 1 -- 172.21.15.125:0/3694865189 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009a70 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe05910f700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe0541221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe05890e700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe053fff700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 0x7fe054121cb0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e900 tx=0x7fe04000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040013680 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0400137e0 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe054123340 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040013b50 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.573+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe054123b30 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.574+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05404f2a0 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.574+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe040013cb0 con 0x7fe0540a1550 2023-10-03T10:18:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.574+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe04003fe50 con 0x7fe0540a1550 2023-10-03T10:18:04.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.578+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe040011350 con 0x7fe0540a1550 2023-10-03T10:18:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.634+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f041220b0 con 0x7f7f040a0a90 2023-10-03T10:18:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.634+0000 7f7eeb7fe700 1 -- 172.21.15.125:0/2161343410 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f041220b0 con 0x7f7f040a0a90 2023-10-03T10:18:04.635 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 msgr2=0x7f7f041c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ec10 tx=0x7f7ef800ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 shutdown_connections 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f04133f70 0x7f7f041c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f040a0a90 0x7f7f041c8190 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 --2- 172.21.15.125:0/2161343410 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f040a13a0 0x7f7f041c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 >> 172.21.15.125:0/2161343410 conn(0x7f7f04099c40 msgr2=0x7f7f041bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 shutdown_connections 2023-10-03T10:18:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.636+0000 7f7f094a2700 1 -- 172.21.15.125:0/2161343410 wait complete. 2023-10-03T10:18:04.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:04.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:04.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:04.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.771+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe054072980 con 0x7fe0540a1550 2023-10-03T10:18:04.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.772+0000 7fe0517fa700 1 -- 172.21.15.125:0/3694865189 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe040024b40 con 0x7fe0540a1550 2023-10-03T10:18:04.772 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 msgr2=0x7fe054121cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 0x7fe054121cb0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e900 tx=0x7fe04000ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 shutdown_connections 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe054139200 0x7fe0541221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0540a0a70 0x7fe054121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 --2- 172.21.15.125:0/3694865189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0540a1550 0x7fe054121cb0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 >> 172.21.15.125:0/3694865189 conn(0x7fe0540a6610 msgr2=0x7fe054137d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 shutdown_connections 2023-10-03T10:18:04.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.775+0000 7fe05ab72700 1 -- 172.21.15.125:0/3694865189 wait complete. 2023-10-03T10:18:04.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:04.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.837+0000 7f38b7640700 1 Processor -- start 2023-10-03T10:18:04.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.837+0000 7f38b7640700 1 -- start start 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 0x7f38b00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b00a3b60 con 0x7f38b009ad40 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b01348e0 con 0x7f38b0133f70 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b7640700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38b009b110 con 0x7f38b00a0a70 2023-10-03T10:18:04.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b53dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b4bdb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b53dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57526/0 (socket says 172.21.15.125:57526) 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b53dc700 1 -- 172.21.15.125:0/3553197984 learned_addr learned my addr 172.21.15.125:0/3553197984 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b4bdb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51288/0 (socket says 172.21.15.125:51288) 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 0x7f38b00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 -- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 msgr2=0x7f38b01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 -- 172.21.15.125:0/3553197984 >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 msgr2=0x7f38b0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/3553197984 >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b5bdd700 1 -- 172.21.15.125:0/3553197984 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00a2fa0 con 0x7f38b00a0a70 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b4bdb700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.838+0000 7f38b53dc700 1 --2- 172.21.15.125:0/3553197984 >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 0x7f38b00a0f10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009dc0 tx=0x7f38a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1923705d66beaef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38a7fff700 1 -- 172.21.15.125:0/3553197984 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800e070 con 0x7f38b00a0a70 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38a7fff700 1 -- 172.21.15.125:0/3553197984 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a800bae0 con 0x7f38b00a0a70 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38a7fff700 1 -- 172.21.15.125:0/3553197984 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800be90 con 0x7f38b00a0a70 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 -- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 msgr2=0x7f38b00a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 0x7f38b00a0f10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009dc0 tx=0x7f38a800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 -- 172.21.15.125:0/3553197984 shutdown_connections 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b00a0a70 0x7f38b00a0f10 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 --2- 172.21.15.125:0/3553197984 >> v2:172.21.15.125:3300/0 conn(0x7f38b009ad40 0x7f38b0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 --2- 172.21.15.125:0/3553197984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.839+0000 7f38b7640700 1 -- 172.21.15.125:0/3553197984 >> 172.21.15.125:0/3553197984 conn(0x7f38b0099c40 msgr2=0x7f38b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.840+0000 7f38b7640700 1 -- 172.21.15.125:0/3553197984 shutdown_connections 2023-10-03T10:18:04.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.840+0000 7f38b7640700 1 -- 172.21.15.125:0/3553197984 wait complete. 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.840+0000 7f38b7640700 1 Processor -- start 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.840+0000 7f38b7640700 1 -- start start 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0121330 con 0x7f38b00a0a70 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b011f670 con 0x7f38b0133f70 2023-10-03T10:18:04.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b7640700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38b009c140 con 0x7f38b009ad40 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b4bdb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b53dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:51296/0 (socket says 172.21.15.125:51296) 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b4bdb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57542/0 (socket says 172.21.15.125:57542) 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 -- 172.21.15.125:0/4224120300 learned_addr learned my addr 172.21.15.125:0/4224120300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b53dc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33156/0 (socket says 172.21.15.125:33156) 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 -- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 msgr2=0x7f38b01c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 -- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 msgr2=0x7f38b01c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b5bdd700 1 -- 172.21.15.125:0/4224120300 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009550 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b53dc700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.841+0000 7f38b4bdb700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38b5bdd700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f38a8014040 tx=0x7f38a8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8004680 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a8020070 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a00094a0 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8027480 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.842+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8009a70 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.843+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38a8012430 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.843+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38a8022070 con 0x7f38b0133f70 2023-10-03T10:18:04.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.843+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b011fec0 con 0x7f38b0133f70 2023-10-03T10:18:04.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.848+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38a8009840 con 0x7f38b0133f70 2023-10-03T10:18:04.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.880+0000 7f9988572700 1 Processor -- start 2023-10-03T10:18:04.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.880+0000 7f9988572700 1 -- start start 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9988572700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9988572700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 0x7f998013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9988572700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998009e9d0 con 0x7f99800a0a70 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9988572700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998009dc00 con 0x7f99800a1550 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9988572700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998009dec0 con 0x7f9980139200 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9985b0d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9985b0d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57556/0 (socket says 172.21.15.125:57556) 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f998630e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f99800a0a70 0x7f99800a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38300/0 (socket says 172.21.15.125:38300) 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9985b0d700 1 -- 172.21.15.125:0/416839955 learned_addr learned my addr 172.21.15.125:0/416839955 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.881+0000 7f9986b0f700 1 --2- 172.21.15.125:0/416839955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 0x7f998013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f998530c700 1 -- 172.21.15.125:0/416839955 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786357554 0 0) 0x7f998009e9d0 con 0x7f99800a0a70 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f998530c700 1 -- 172.21.15.125:0/416839955 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996c0035b0 con 0x7f99800a0a70 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9986b0f700 1 -- 172.21.15.125:0/416839955 >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 msgr2=0x7f9980138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9986b0f700 1 --2- 172.21.15.125:0/416839955 >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9986b0f700 1 -- 172.21.15.125:0/416839955 >> v1:172.21.15.125:6789/0 conn(0x7f99800a0a70 legacy=0x7f99800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9986b0f700 1 -- 172.21.15.125:0/416839955 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998009e6a0 con 0x7f9980139200 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9985b0d700 1 --2- 172.21.15.125:0/416839955 >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f9986b0f700 1 --2- 172.21.15.125:0/416839955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 0x7f998013b5e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9978009d90 tx=0x7f997800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad442b3b77d6b09e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f998530c700 1 -- 172.21.15.125:0/416839955 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800e070 con 0x7f9980139200 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f998530c700 1 -- 172.21.15.125:0/416839955 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800bb20 con 0x7f9980139200 2023-10-03T10:18:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.882+0000 7f998530c700 1 -- 172.21.15.125:0/416839955 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978012430 con 0x7f9980139200 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 -- 172.21.15.125:0/416839955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 msgr2=0x7f998013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 --2- 172.21.15.125:0/416839955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 0x7f998013b5e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9978009d90 tx=0x7f997800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 -- 172.21.15.125:0/416839955 shutdown_connections 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 --2- 172.21.15.125:0/416839955 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9980139200 0x7f998013b5e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 --2- 172.21.15.125:0/416839955 >> v2:172.21.15.125:3300/0 conn(0x7f99800a1550 0x7f9980138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 -- 172.21.15.125:0/416839955 >> 172.21.15.125:0/416839955 conn(0x7f99800a6610 msgr2=0x7f99800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 -- 172.21.15.125:0/416839955 shutdown_connections 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.883+0000 7f9988572700 1 -- 172.21.15.125:0/416839955 wait complete. 2023-10-03T10:18:04.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.884+0000 7f9988572700 1 Processor -- start 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.884+0000 7f9988572700 1 -- start start 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99800a0a70 0x7f998011e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9980139200 0x7f998011f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801222c0 con 0x7f99800a1550 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99801219b0 con 0x7f9980139200 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9988572700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99800a03e0 con 0x7f99800a0a70 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9985b0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9985b0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57572/0 (socket says 172.21.15.125:57572) 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9985b0d700 1 -- 172.21.15.125:0/1553729212 learned_addr learned my addr 172.21.15.125:0/1553729212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f998630e700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99800a0a70 0x7f998011e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9986b0f700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9980139200 0x7f998011f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.885+0000 7f9985b0d700 1 -- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99800a0a70 msgr2=0x7f998011e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9985b0d700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99800a0a70 0x7f998011e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9985b0d700 1 -- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9980139200 msgr2=0x7f998011f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9985b0d700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9980139200 0x7f998011f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9985b0d700 1 -- 172.21.15.125:0/1553729212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009550 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9985b0d700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f997000ec10 tx=0x7f997000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000c850 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000c9b0 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9978009a70 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000cd40 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.886+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9980120ac0 con 0x7f99800a1550 2023-10-03T10:18:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.887+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9970013470 con 0x7f99800a1550 2023-10-03T10:18:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.887+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f997003fcc0 con 0x7f99800a1550 2023-10-03T10:18:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.887+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998004f2a0 con 0x7f99800a1550 2023-10-03T10:18:04.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:04.892+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9970013720 con 0x7f99800a1550 2023-10-03T10:18:05.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.042+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38b004f2a0 con 0x7f38b0133f70 2023-10-03T10:18:05.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.042+0000 7f38a5ffb700 1 -- 172.21.15.125:0/4224120300 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38a8011390 con 0x7f38b0133f70 2023-10-03T10:18:05.043 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 msgr2=0x7f38b01c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f38a8014040 tx=0x7f38a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 shutdown_connections 2023-10-03T10:18:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b0133f70 0x7f38b01c8c80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38b009ad40 0x7f38b01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 --2- 172.21.15.125:0/4224120300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b00a0a70 0x7f38b01c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.044+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 >> 172.21.15.125:0/4224120300 conn(0x7f38b0099c40 msgr2=0x7f38b009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.045+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 shutdown_connections 2023-10-03T10:18:05.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.045+0000 7f38b7640700 1 -- 172.21.15.125:0/4224120300 wait complete. 2023-10-03T10:18:05.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:05.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.086+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9980121bc0 con 0x7f99800a1550 2023-10-03T10:18:05.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.086+0000 7f9976ffd700 1 -- 172.21.15.125:0/1553729212 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9980121bc0 con 0x7f99800a1550 2023-10-03T10:18:05.087 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 msgr2=0x7f998011ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f997000ec10 tx=0x7f997000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 shutdown_connections 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9980139200 0x7f998011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f99800a0a70 0x7f998011e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 --2- 172.21.15.125:0/1553729212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99800a1550 0x7f998011ec40 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 >> 172.21.15.125:0/1553729212 conn(0x7f99800a6610 msgr2=0x7f99800a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 shutdown_connections 2023-10-03T10:18:05.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.088+0000 7f9988572700 1 -- 172.21.15.125:0/1553729212 wait complete. 2023-10-03T10:18:05.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:05.650 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:05.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 Processor -- start 2023-10-03T10:18:05.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 -- start start 2023-10-03T10:18:05.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38a806a770 0x7f38a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a809f770 con 0x7f38a806a770 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a809dce0 con 0x7f38a8131cf0 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.772+0000 7f38aef71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a809da80 con 0x7f38a806b080 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38a806a770 0x7f38a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38ad50e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37570/0 (socket says 172.21.15.125:37570) 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38a806a770 0x7f38a806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60836/0 (socket says 172.21.15.125:60836) 2023-10-03T10:18:05.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38ad50e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35206/0 (socket says 172.21.15.125:35206) 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a7fff700 1 -- 172.21.15.125:0/630805975 learned_addr learned my addr 172.21.15.125:0/630805975 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 -- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 msgr2=0x7f38a81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 -- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 msgr2=0x7f38a8132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 -- 172.21.15.125:0/630805975 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a809eb20 con 0x7f38a806a770 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38ad50e700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a7fff700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38acd0d700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a806a770 0x7f38a806ab40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f389c00dc60 tx=0x7f389c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c68e30f4288006 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a77fe700 1 -- 172.21.15.125:0/630805975 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c012070 con 0x7f38a806a770 2023-10-03T10:18:05.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a77fe700 1 -- 172.21.15.125:0/630805975 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00d2e0 con 0x7f38a806a770 2023-10-03T10:18:05.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.773+0000 7f38a77fe700 1 -- 172.21.15.125:0/630805975 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00f900 con 0x7f38a806a770 2023-10-03T10:18:05.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 -- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a806a770 msgr2=0x7f38a806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a806a770 0x7f38a806ab40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f389c00dc60 tx=0x7f389c00df70 comp rx=0 tx=0).stop 2023-10-03T10:18:05.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 -- 172.21.15.125:0/630805975 shutdown_connections 2023-10-03T10:18:05.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a8131cf0 0x7f38a8132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a806a770 0x7f38a806ab40 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 --2- 172.21.15.125:0/630805975 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806b080 0x7f38a81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 -- 172.21.15.125:0/630805975 >> 172.21.15.125:0/630805975 conn(0x7f38a8099c40 msgr2=0x7f38a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 -- 172.21.15.125:0/630805975 shutdown_connections 2023-10-03T10:18:05.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.774+0000 7f38aef71700 1 -- 172.21.15.125:0/630805975 wait complete. 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 Processor -- start 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 -- start start 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 0x7f38a811ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a811d450 con 0x7f38a8131cf0 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a811db20 con 0x7f38a806b080 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38aef71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a811e140 con 0x7f38a806a770 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38acd0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38acd0d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37572/0 (socket says 172.21.15.125:37572) 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38acd0d700 1 -- 172.21.15.125:0/732410259 learned_addr learned my addr 172.21.15.125:0/732410259 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38a7fff700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35208/0 (socket says 172.21.15.125:35208) 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.775+0000 7f38ad50e700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 0x7f38a811ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 -- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 msgr2=0x7f38a811bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 -- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 msgr2=0x7f38a811c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 -- 172.21.15.125:0/732410259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894009550 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38acd0d700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38a7fff700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38ad50e700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 0x7f38a811ca20 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009e50 tx=0x7f38a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000ca90 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000f040 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0009a70 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000ce50 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.776+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c00d940 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.777+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38a0014480 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.777+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38a003fb80 con 0x7f38a8131cf0 2023-10-03T10:18:05.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.777+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a80a2850 con 0x7f38a8131cf0 2023-10-03T10:18:05.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.782+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38a003fe60 con 0x7f38a8131cf0 2023-10-03T10:18:05.789 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:05.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.911+0000 7fe3d9d7a700 1 Processor -- start 2023-10-03T10:18:05.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.911+0000 7fe3d9d7a700 1 -- start start 2023-10-03T10:18:05.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d9d7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 0x7fe3d4138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d9d7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d9d7a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d406bec0 con 0x7fe3d409e870 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d9d7a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406ce60 con 0x7fe3d409f350 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d9d7a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d409f740 con 0x7fe3d4139480 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d2ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 0x7fe3d4138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe3d409e870 0x7fe3d409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55300/0 (socket says 172.21.15.125:55300) 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d37fe700 1 -- 172.21.15.125:0/1516279711 learned_addr learned my addr 172.21.15.125:0/1516279711 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d2ffd700 1 -- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 msgr2=0x7fe3d413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d2ffd700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d27fc700 1 -- 172.21.15.125:0/1516279711 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764229783 0 0) 0x7fe3d406bec0 con 0x7fe3d409e870 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d2ffd700 1 -- 172.21.15.125:0/1516279711 >> v1:172.21.15.125:6789/0 conn(0x7fe3d409e870 legacy=0x7fe3d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d2ffd700 1 -- 172.21.15.125:0/1516279711 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d409fa00 con 0x7fe3d409f350 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.912+0000 7fe3d3fff700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d2ffd700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 0x7fe3d4138f40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098a0 tx=0x7fe3bc009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7278102e873410d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d27fc700 1 -- 172.21.15.125:0/1516279711 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc011830 con 0x7fe3d409f350 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d27fc700 1 -- 172.21.15.125:0/1516279711 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc011990 con 0x7fe3d409f350 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d27fc700 1 -- 172.21.15.125:0/1516279711 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc011d20 con 0x7fe3d409f350 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 msgr2=0x7fe3d4138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 0x7fe3d4138f40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098a0 tx=0x7fe3bc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/1516279711 shutdown_connections 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/1516279711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409f350 0x7fe3d4138f40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/1516279711 >> 172.21.15.125:0/1516279711 conn(0x7fe3d40a4430 msgr2=0x7fe3d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/1516279711 shutdown_connections 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.913+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/1516279711 wait complete. 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.914+0000 7fe3d9d7a700 1 Processor -- start 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.914+0000 7fe3d9d7a700 1 -- start start 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 0x7fe3d411eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41228b0 con 0x7fe3d409f350 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406d010 con 0x7fe3d409e870 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41208e0 con 0x7fe3d4139480 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 0x7fe3d411eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37586/0 (socket says 172.21.15.125:37586) 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d3fff700 1 -- 172.21.15.125:0/3855891166 learned_addr learned my addr 172.21.15.125:0/3855891166 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60860/0 (socket says 172.21.15.125:60860) 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 -- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 msgr2=0x7fe3d411f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 -- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 msgr2=0x7fe3d411f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 -- 172.21.15.125:0/3855891166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4009a70 con 0x7fe3d409e870 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d3fff700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d2ffd700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d37fe700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 0x7fe3d411eb50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3c0 tx=0x7fe3cc00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004a70 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc004bf0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0070d0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.915+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3bc0094a0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.916+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d41223e0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.916+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3cc007230 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.916+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe3cc03efe0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.916+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d41223e0 con 0x7fe3d409e870 2023-10-03T10:18:05.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.921+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3d41223e0 con 0x7fe3d409e870 2023-10-03T10:18:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.977+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38a8071e10 con 0x7f38a8131cf0 2023-10-03T10:18:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.977+0000 7f38a57fa700 1 -- 172.21.15.125:0/732410259 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38a0012700 con 0x7f38a8131cf0 2023-10-03T10:18:05.978 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 msgr2=0x7f38a811ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 0x7f38a811ca20 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009e50 tx=0x7f38a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 shutdown_connections 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38a8131cf0 0x7f38a811ca20 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38a806a770 0x7f38a811bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 --2- 172.21.15.125:0/732410259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38a806b080 0x7f38a811c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 >> 172.21.15.125:0/732410259 conn(0x7f38a8099c40 msgr2=0x7f38a8130dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 shutdown_connections 2023-10-03T10:18:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:05.979+0000 7f38aef71700 1 -- 172.21.15.125:0/732410259 wait complete. 2023-10-03T10:18:05.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:06.058 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:06.102 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.113+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3d41223e0 con 0x7fe3d409e870 2023-10-03T10:18:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.113+0000 7fe3cbfff700 1 -- 172.21.15.125:0/3855891166 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3d41223e0 con 0x7fe3d409e870 2023-10-03T10:18:06.114 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:06.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 msgr2=0x7fe3d411eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 0x7fe3d411eb50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3c0 tx=0x7fe3cc00c6d0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 shutdown_connections 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe3d4139480 0x7fe3d411f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3d409e870 0x7fe3d411eb50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 --2- 172.21.15.125:0/3855891166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3d409f350 0x7fe3d411f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 >> 172.21.15.125:0/3855891166 conn(0x7fe3d40a4430 msgr2=0x7fe3d40a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 shutdown_connections 2023-10-03T10:18:06.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.117+0000 7fe3d9d7a700 1 -- 172.21.15.125:0/3855891166 wait complete. 2023-10-03T10:18:06.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.190+0000 7f559e375700 1 Processor -- start 2023-10-03T10:18:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.190+0000 7f559e375700 1 -- start start 2023-10-03T10:18:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 0x7f559809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f559809e170 0x7f55981307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 0x7f5598131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559809aaa0 con 0x7f559809e170 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559809f870 con 0x7f5598130ce0 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559e375700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559809b360 con 0x7f559809d860 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f55977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f559809e170 0x7f55981307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f5597fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 0x7f559809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f55977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f559809e170 0x7f55981307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60862/0 (socket says 172.21.15.125:60862) 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f55977fe700 1 -- 172.21.15.125:0/2857059361 learned_addr learned my addr 172.21.15.125:0/2857059361 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.191+0000 7f559c912700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 0x7f5598131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 -- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 msgr2=0x7f559809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 0x7f559809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 -- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 msgr2=0x7f5598131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 0x7f5598131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 -- 172.21.15.125:0/2857059361 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559809b620 con 0x7f559809e170 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f5597fff700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 0x7f559809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f559c912700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 0x7f5598131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f55977fe700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f55981307a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f558c0098f0 tx=0x7f558c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef170bcd67b75949 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f5596ffd700 1 -- 172.21.15.125:0/2857059361 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011830 con 0x7f559809e170 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f5596ffd700 1 -- 172.21.15.125:0/2857059361 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c011990 con 0x7f559809e170 2023-10-03T10:18:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.192+0000 7f5596ffd700 1 -- 172.21.15.125:0/2857059361 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011d20 con 0x7f559809e170 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 -- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 msgr2=0x7f55981307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f55981307a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f558c0098f0 tx=0x7f558c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 -- 172.21.15.125:0/2857059361 shutdown_connections 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5598130ce0 0x7f5598131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f559809d860 0x7f559809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 --2- 172.21.15.125:0/2857059361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f55981307a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 -- 172.21.15.125:0/2857059361 >> 172.21.15.125:0/2857059361 conn(0x7f5598099c40 msgr2=0x7f55980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 -- 172.21.15.125:0/2857059361 shutdown_connections 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 -- 172.21.15.125:0/2857059361 wait complete. 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.193+0000 7f559e375700 1 Processor -- start 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 -- start start 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f559811d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 0x7f559811da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598120240 con 0x7f559809e170 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559809c8b0 con 0x7f559809d860 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559e375700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5598071a10 con 0x7f5598130ce0 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f5597fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f559c912700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 0x7f559811da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f5597fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35240/0 (socket says 172.21.15.125:35240) 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f5597fff700 1 -- 172.21.15.125:0/902514884 learned_addr learned my addr 172.21.15.125:0/902514884 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.194+0000 7f55977fe700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f559811d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 -- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 msgr2=0x7f559811da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 0x7f559811da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 -- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 msgr2=0x7f559811cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 -- 172.21.15.125:0/902514884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558800b550 con 0x7f559809e170 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f559c912700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 0x7f559811da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f5597fff700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f55977fe700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f559811d4d0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f559809a100 tx=0x7f558c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c004450 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c0045b0 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559000bc50 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0038c0 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.195+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c009550 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.196+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f558c021070 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.196+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f558c040910 con 0x7f559809e170 2023-10-03T10:18:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.196+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5598120650 con 0x7f559809e170 2023-10-03T10:18:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.205+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f558c015070 con 0x7f559809e170 2023-10-03T10:18:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.231+0000 7f6bc4e2c700 1 Processor -- start 2023-10-03T10:18:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.231+0000 7f6bc4e2c700 1 -- start start 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bc009ad40 0x7f6bc0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 0x7f6bc01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00a3b60 con 0x7f6bc009ad40 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01348e0 con 0x7f6bc0133f70 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bc4e2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc009b110 con 0x7f6bc00a0a70 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bc009ad40 0x7f6bc0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37598/0 (socket says 172.21.15.125:37598) 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbed9d700 1 -- 172.21.15.125:0/1840713742 learned_addr learned my addr 172.21.15.125:0/1840713742 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbdd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 0x7f6bc01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 -- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 msgr2=0x7f6bc00a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 -- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 msgr2=0x7f6bc01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 0x7f6bc01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbe59c700 1 -- 172.21.15.125:0/1840713742 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00a2fa0 con 0x7f6bc009ad40 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbed9d700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.232+0000 7f6bbdd9b700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 0x7f6bc01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bbe59c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc009ad40 0x7f6bc0133a30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009870 tx=0x7f6bb0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146e6f8ceb01bc5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bbd59a700 1 -- 172.21.15.125:0/1840713742 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0011830 con 0x7f6bc009ad40 2023-10-03T10:18:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bbd59a700 1 -- 172.21.15.125:0/1840713742 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0011990 con 0x7f6bc009ad40 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bbd59a700 1 -- 172.21.15.125:0/1840713742 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0011d20 con 0x7f6bc009ad40 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc009ad40 msgr2=0x7f6bc0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc009ad40 0x7f6bc0133a30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009870 tx=0x7f6bb0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/1840713742 shutdown_connections 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc00a0a70 0x7f6bc00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc009ad40 0x7f6bc0133a30 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/1840713742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc0133f70 0x7f6bc01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/1840713742 >> 172.21.15.125:0/1840713742 conn(0x7f6bc0099c40 msgr2=0x7f6bc006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/1840713742 shutdown_connections 2023-10-03T10:18:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.233+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/1840713742 wait complete. 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.234+0000 7f6bc4e2c700 1 Processor -- start 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.234+0000 7f6bc4e2c700 1 -- start start 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc009ad40 0x7f6bc01c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc00a0a70 0x7f6bc01c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0122480 con 0x7f6bc0133f70 2023-10-03T10:18:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0120770 con 0x7f6bc00a0a70 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bc4e2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc009be70 con 0x7f6bc009ad40 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbe59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc009ad40 0x7f6bc01c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbdd9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc00a0a70 0x7f6bc01c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60896/0 (socket says 172.21.15.125:60896) 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 -- 172.21.15.125:0/3921131845 learned_addr learned my addr 172.21.15.125:0/3921131845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 -- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc009ad40 msgr2=0x7f6bc01c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc009ad40 0x7f6bc01c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 -- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc00a0a70 msgr2=0x7f6bc01c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc00a0a70 0x7f6bc01c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 -- 172.21.15.125:0/3921131845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009b30 con 0x7f6bc0133f70 2023-10-03T10:18:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.235+0000 7f6bbed9d700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800eed0 tx=0x7f6bb800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8018070 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80092e0 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40094a0 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8010040 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb00094a0 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.237+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb800b870 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.236+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc004f2a0 con 0x7f6bc0133f70 2023-10-03T10:18:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.237+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bb803f350 con 0x7f6bc0133f70 2023-10-03T10:18:06.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.242+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb8013d30 con 0x7f6bc0133f70 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.399+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f559804f2a0 con 0x7f559809e170 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.399+0000 7f5594ff9700 1 -- 172.21.15.125:0/902514884 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f558c003a20 con 0x7f559809e170 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 msgr2=0x7f559811d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f559811d4d0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f559809a100 tx=0x7f558c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 shutdown_connections 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5598130ce0 0x7f559811da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f559809d860 0x7f559811cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 --2- 172.21.15.125:0/902514884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f559809e170 0x7f559811d4d0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.401+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 >> 172.21.15.125:0/902514884 conn(0x7f5598099c40 msgr2=0x7f559812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.402+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 shutdown_connections 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.402+0000 7f559e375700 1 -- 172.21.15.125:0/902514884 wait complete. 2023-10-03T10:18:06.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.436+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bc00729d0 con 0x7f6bc0133f70 2023-10-03T10:18:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.437+0000 7f6baeffd700 1 -- 172.21.15.125:0/3921131845 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bb8013b50 con 0x7f6bc0133f70 2023-10-03T10:18:06.437 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 msgr2=0x7f6bc01c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800eed0 tx=0x7f6bb800b390 comp rx=0 tx=0).stop 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 shutdown_connections 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bc0133f70 0x7f6bc01c8d10 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bc009ad40 0x7f6bc01c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 --2- 172.21.15.125:0/3921131845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bc00a0a70 0x7f6bc01c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 >> 172.21.15.125:0/3921131845 conn(0x7f6bc0099c40 msgr2=0x7f6bc01bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 shutdown_connections 2023-10-03T10:18:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:06.439+0000 7f6bc4e2c700 1 -- 172.21.15.125:0/3921131845 wait complete. 2023-10-03T10:18:06.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:06.993 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:07.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.118+0000 7f3741a03700 1 Processor -- start 2023-10-03T10:18:07.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.118+0000 7f3741a03700 1 -- start start 2023-10-03T10:18:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f3741a03700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 0x7f373c09e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f3741a03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f3741a03700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c09aaa0 con 0x7f373c12cf70 2023-10-03T10:18:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f3741a03700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c09bf30 con 0x7f373c09bb60 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f3741a03700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c09a8e0 con 0x7f373c130720 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f373affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 0x7f373c09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f373b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f373a7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f373c12cf70 0x7f373c130010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55310/0 (socket says 172.21.15.125:55310) 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.119+0000 7f373a7fc700 1 -- 172.21.15.125:0/3609555069 learned_addr learned my addr 172.21.15.125:0/3609555069 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3739ffb700 1 -- 172.21.15.125:0/3609555069 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288737785 0 0) 0x7f373c09aaa0 con 0x7f373c12cf70 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3739ffb700 1 -- 172.21.15.125:0/3609555069 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37240035b0 con 0x7f373c12cf70 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373b7fe700 1 -- 172.21.15.125:0/3609555069 >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 msgr2=0x7f373c09e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373b7fe700 1 --2- 172.21.15.125:0/3609555069 >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 0x7f373c09e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373b7fe700 1 -- 172.21.15.125:0/3609555069 >> v1:172.21.15.125:6789/0 conn(0x7f373c12cf70 legacy=0x7f373c130010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373b7fe700 1 -- 172.21.15.125:0/3609555069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c12d450 con 0x7f373c130720 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373affd700 1 --2- 172.21.15.125:0/3609555069 >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 0x7f373c09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f373b7fe700 1 --2- 172.21.15.125:0/3609555069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c130b20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f373400be60 tx=0x7f3734009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c671c40b95e159 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3739ffb700 1 -- 172.21.15.125:0/3609555069 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400c850 con 0x7f373c130720 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3739ffb700 1 -- 172.21.15.125:0/3609555069 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400c9b0 con 0x7f373c130720 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3739ffb700 1 -- 172.21.15.125:0/3609555069 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400cd60 con 0x7f373c130720 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 -- 172.21.15.125:0/3609555069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 msgr2=0x7f373c130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 --2- 172.21.15.125:0/3609555069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c130b20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f373400be60 tx=0x7f3734009290 comp rx=0 tx=0).stop 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 -- 172.21.15.125:0/3609555069 shutdown_connections 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 --2- 172.21.15.125:0/3609555069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c130b20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 --2- 172.21.15.125:0/3609555069 >> v2:172.21.15.125:3300/0 conn(0x7f373c09bb60 0x7f373c09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.120+0000 7f3741a03700 1 -- 172.21.15.125:0/3609555069 >> 172.21.15.125:0/3609555069 conn(0x7f373c0a2d80 msgr2=0x7f373c0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.121+0000 7f3741a03700 1 -- 172.21.15.125:0/3609555069 shutdown_connections 2023-10-03T10:18:07.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.121+0000 7f3741a03700 1 -- 172.21.15.125:0/3609555069 wait complete. 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.122+0000 7f3741a03700 1 Processor -- start 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.122+0000 7f3741a03700 1 -- start start 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.122+0000 7f3741a03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.122+0000 7f3741a03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 0x7f373c119910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.122+0000 7f3741a03700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3741a03700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c072120 con 0x7f373c12cf70 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3741a03700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c071f30 con 0x7f373c130720 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3741a03700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f373c11b2f0 con 0x7f373c09bb60 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 0x7f373c119910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37608/0 (socket says 172.21.15.125:37608) 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373affd700 1 -- 172.21.15.125:0/2918061902 learned_addr learned my addr 172.21.15.125:0/2918061902 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373b7fe700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 -- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 msgr2=0x7f373c1193d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 -- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 msgr2=0x7f373c119e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c119e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 -- 172.21.15.125:0/2918061902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c00d940 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373affd700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f373a7fc700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 0x7f373c119910 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f373000c4c0 tx=0x7f373000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730005d70 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300070d0 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730007440 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373400ba90 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.123+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c12a6a0 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.124+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37300075a0 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.124+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f373003e710 con 0x7f373c12cf70 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.124+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c04f2a0 con 0x7f373c12cf70 2023-10-03T10:18:07.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.129+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3730018af0 con 0x7f373c12cf70 2023-10-03T10:18:07.135 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 Processor -- start 2023-10-03T10:18:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 -- start start 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d0136cb0 0x7f81d0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d006e900 con 0x7f81d009dec0 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d009d180 con 0x7f81d0136cb0 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.261+0000 7f81d70bf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d009e780 con 0x7f81d006a770 2023-10-03T10:18:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.262+0000 7f81d4e5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.262+0000 7f81d4e5b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37616/0 (socket says 172.21.15.125:37616) 2023-10-03T10:18:07.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.262+0000 7f81d4e5b700 1 -- 172.21.15.125:0/2093036741 learned_addr learned my addr 172.21.15.125:0/2093036741 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d565c700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d0136cb0 0x7f81d0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81cf7fe700 1 -- 172.21.15.125:0/2093036741 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437136186 0 0) 0x7f81d006e900 con 0x7f81d009dec0 2023-10-03T10:18:07.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81cf7fe700 1 -- 172.21.15.125:0/2093036741 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c00035b0 con 0x7f81d009dec0 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d4e5b700 1 -- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d0136cb0 msgr2=0x7f81d0139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d4e5b700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d0136cb0 0x7f81d0139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d4e5b700 1 -- 172.21.15.125:0/2093036741 >> v1:172.21.15.125:6789/0 conn(0x7f81d009dec0 legacy=0x7f81d006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d4e5b700 1 -- 172.21.15.125:0/2093036741 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d009d3c0 con 0x7f81d006a770 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81d4e5b700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009920 tx=0x7f81c4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa3c40700a8a930 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81cf7fe700 1 -- 172.21.15.125:0/2093036741 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011830 con 0x7f81d006a770 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81cf7fe700 1 -- 172.21.15.125:0/2093036741 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4011990 con 0x7f81d006a770 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.263+0000 7f81cf7fe700 1 -- 172.21.15.125:0/2093036741 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011d20 con 0x7f81d006a770 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 -- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 msgr2=0x7f81d006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009920 tx=0x7f81c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 -- 172.21.15.125:0/2093036741 shutdown_connections 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d0136cb0 0x7f81d0139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 --2- 172.21.15.125:0/2093036741 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d006a770 0x7f81d006ab40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 -- 172.21.15.125:0/2093036741 >> 172.21.15.125:0/2093036741 conn(0x7f81d0099c40 msgr2=0x7f81d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 -- 172.21.15.125:0/2093036741 shutdown_connections 2023-10-03T10:18:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.264+0000 7f81d70bf700 1 -- 172.21.15.125:0/2093036741 wait complete. 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 Processor -- start 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 -- start start 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d0136cb0 0x7f81d009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0139110 con 0x7f81d006a770 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0134030 con 0x7f81d009dec0 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d70bf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0135170 con 0x7f81d0136cb0 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81cffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d4e5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.265+0000 7f81d565c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d0136cb0 0x7f81d009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60928/0 (socket says 172.21.15.125:60928) 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 -- 172.21.15.125:0/1632323932 learned_addr learned my addr 172.21.15.125:0/1632323932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81cffff700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35270/0 (socket says 172.21.15.125:35270) 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 -- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d0136cb0 msgr2=0x7f81d009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d0136cb0 0x7f81d009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 -- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 msgr2=0x7f81d009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 -- 172.21.15.125:0/1632323932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009550 con 0x7f81d006a770 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81cffff700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d4e5b700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f81c4000c00 tx=0x7f81c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004450 con 0x7f81d006a770 2023-10-03T10:18:07.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40045b0 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d012f340 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40038e0 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.266+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0135970 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.267+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c4003a40 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.267+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81c4021030 con 0x7f81d006a770 2023-10-03T10:18:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.267+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0135330 con 0x7f81d006a770 2023-10-03T10:18:07.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.272+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c401a430 con 0x7f81d006a770 2023-10-03T10:18:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.340+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f373c11b840 con 0x7f373c12cf70 2023-10-03T10:18:07.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.340+0000 7f3723fff700 1 -- 172.21.15.125:0/2918061902 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3730017020 con 0x7f373c12cf70 2023-10-03T10:18:07.339 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 msgr2=0x7f373c119910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 0x7f373c119910 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f373000c4c0 tx=0x7f373000c7d0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 shutdown_connections 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f373c130720 0x7f373c119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f373c09bb60 0x7f373c1193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 --2- 172.21.15.125:0/2918061902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f373c12cf70 0x7f373c119910 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 >> 172.21.15.125:0/2918061902 conn(0x7f373c0a2d80 msgr2=0x7f373c09c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 shutdown_connections 2023-10-03T10:18:07.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.342+0000 7f3741a03700 1 -- 172.21.15.125:0/2918061902 wait complete. 2023-10-03T10:18:07.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:07.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:07.452 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:07.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.476+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81d0071a50 con 0x7f81d006a770 2023-10-03T10:18:07.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.477+0000 7f81cd7fa700 1 -- 172.21.15.125:0/1632323932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81c402b030 con 0x7f81d006a770 2023-10-03T10:18:07.476 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:07.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 msgr2=0x7f81d009a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f81c4000c00 tx=0x7f81c4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 shutdown_connections 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f81d0136cb0 0x7f81d009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d006a770 0x7f81d009a490 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 --2- 172.21.15.125:0/1632323932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81d009dec0 0x7f81d009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 >> 172.21.15.125:0/1632323932 conn(0x7f81d0099c40 msgr2=0x7f81d0070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 shutdown_connections 2023-10-03T10:18:07.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.479+0000 7f81d70bf700 1 -- 172.21.15.125:0/1632323932 wait complete. 2023-10-03T10:18:07.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:07.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 Processor -- start 2023-10-03T10:18:07.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 -- start start 2023-10-03T10:18:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 0x7f3cb80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 0x7f3cb813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb809dc00 con 0x7f3cb80a1380 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb809ea90 con 0x7f3cb8134120 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.544+0000 7f3cbffd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb809dec0 con 0x7f3cb80a0a70 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbd56f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3cb80a1380 0x7f3cb8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55328/0 (socket says 172.21.15.125:55328) 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 0x7f3cb813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbd56f700 1 -- 172.21.15.125:0/4193804787 learned_addr learned my addr 172.21.15.125:0/4193804787 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbdd70700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 0x7f3cb80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 -- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 msgr2=0x7f3cb80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 0x7f3cb80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 -- 172.21.15.125:0/4193804787 >> v1:172.21.15.125:6789/0 conn(0x7f3cb80a1380 legacy=0x7f3cb8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbcd6e700 1 -- 172.21.15.125:0/4193804787 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039829901 0 0) 0x7f3cb809dc00 con 0x7f3cb80a1380 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 -- 172.21.15.125:0/4193804787 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb809e6a0 con 0x7f3cb8134120 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbdd70700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 0x7f3cb80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbe571700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 0x7f3cb813bce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009dc0 tx=0x7f3cb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a75210b5603c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbcd6e700 1 -- 172.21.15.125:0/4193804787 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000e070 con 0x7f3cb8134120 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbcd6e700 1 -- 172.21.15.125:0/4193804787 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000bb20 con 0x7f3cb8134120 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.545+0000 7f3cbcd6e700 1 -- 172.21.15.125:0/4193804787 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0012430 con 0x7f3cb8134120 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 msgr2=0x7f3cb813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 0x7f3cb813bce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009dc0 tx=0x7f3cb000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4193804787 shutdown_connections 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb8134120 0x7f3cb813bce0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4193804787 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a0a70 0x7f3cb80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4193804787 >> 172.21.15.125:0/4193804787 conn(0x7f3cb80a6610 msgr2=0x7f3cb80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4193804787 shutdown_connections 2023-10-03T10:18:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.546+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4193804787 wait complete. 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 Processor -- start 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 -- start start 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 0x7f3cb811edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb81336f0 con 0x7f3cb8134120 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8121140 con 0x7f3cb80a0a70 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbffd4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8120750 con 0x7f3cb80a1380 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbd56f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbdd70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbd56f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37650/0 (socket says 172.21.15.125:37650) 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbdd70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35296/0 (socket says 172.21.15.125:35296) 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.547+0000 7f3cbd56f700 1 -- 172.21.15.125:0/4230817384 learned_addr learned my addr 172.21.15.125:0/4230817384 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbe571700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 0x7f3cb811edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 -- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 msgr2=0x7f3cb811e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 -- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 msgr2=0x7f3cb811edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 0x7f3cb811edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 -- 172.21.15.125:0/4230817384 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4013a10 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbdd70700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbe571700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 0x7f3cb811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbd56f700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001eb0 tx=0x7f3ca800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8004c80 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8004de0 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb0009a70 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8007310 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.548+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb80a03e0 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.549+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca8007470 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.549+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ca803f2c0 con 0x7f3cb80a1380 2023-10-03T10:18:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.549+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb8070950 con 0x7f3cb80a1380 2023-10-03T10:18:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.554+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ca80123b0 con 0x7f3cb80a1380 2023-10-03T10:18:07.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.586+0000 7f2ab18bb700 1 Processor -- start 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.586+0000 7f2ab18bb700 1 -- start start 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2ab18bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2aac1309f0 0x7f2aac130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2ab18bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2ab18bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac09c1f0 con 0x7f2aac09d8f0 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2ab18bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac09b1f0 con 0x7f2aac1309f0 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2ab18bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac131300 con 0x7f2aac09e450 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2aac1309f0 0x7f2aac130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2aac1309f0 0x7f2aac130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60946/0 (socket says 172.21.15.125:60946) 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35304/0 (socket says 172.21.15.125:35304) 2023-10-03T10:18:07.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 -- 172.21.15.125:0/1430275064 learned_addr learned my addr 172.21.15.125:0/1430275064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaa7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2aac09d8f0 0x7f2aac09dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55334/0 (socket says 172.21.15.125:55334) 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 -- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 msgr2=0x7f2aac138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 -- 172.21.15.125:0/1430275064 >> v1:172.21.15.125:6789/0 conn(0x7f2aac09d8f0 legacy=0x7f2aac09dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 -- 172.21.15.125:0/1430275064 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac1305a0 con 0x7f2aac1309f0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aa9ffb700 1 -- 172.21.15.125:0/1430275064 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616002905 0 0) 0x7f2aac09c1f0 con 0x7f2aac09d8f0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aab7fe700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.587+0000 7f2aaaffd700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac1309f0 0x7f2aac130dc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fff0781409a560 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2aa9ffb700 1 -- 172.21.15.125:0/1430275064 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005e30 con 0x7f2aac1309f0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2aa9ffb700 1 -- 172.21.15.125:0/1430275064 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c004030 con 0x7f2aac1309f0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2aa9ffb700 1 -- 172.21.15.125:0/1430275064 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0043e0 con 0x7f2aac1309f0 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 -- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac1309f0 msgr2=0x7f2aac130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac1309f0 0x7f2aac130dc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c00bc80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 -- 172.21.15.125:0/1430275064 shutdown_connections 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac09e450 0x7f2aac138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/1430275064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac1309f0 0x7f2aac130dc0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 -- 172.21.15.125:0/1430275064 >> 172.21.15.125:0/1430275064 conn(0x7f2aac0a2b30 msgr2=0x7f2aac09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 -- 172.21.15.125:0/1430275064 shutdown_connections 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.588+0000 7f2ab18bb700 1 -- 172.21.15.125:0/1430275064 wait complete. 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.589+0000 7f2ab18bb700 1 Processor -- start 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.589+0000 7f2ab18bb700 1 -- start start 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 0x7f2aac126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac12ad40 con 0x7f2aac09e450 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac12a130 con 0x7f2aac1309f0 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2ab18bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0a0400 con 0x7f2aac09d8f0 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60950/0 (socket says 172.21.15.125:60950) 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 -- 172.21.15.125:0/800883314 learned_addr learned my addr 172.21.15.125:0/800883314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aab7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35310/0 (socket says 172.21.15.125:35310) 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaaffd700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 0x7f2aac126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 -- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 msgr2=0x7f2aac126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 0x7f2aac126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 -- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 msgr2=0x7f2aac127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 -- 172.21.15.125:0/800883314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa400f050 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaaffd700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 0x7f2aac126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aab7fe700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2aaa7fc700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c520 tx=0x7f2aa000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.590+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0004c80 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa0004de0 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c00b5b0 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0007310 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac12a3d0 con 0x7f2aac09e450 2023-10-03T10:18:07.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2aa0007470 con 0x7f2aac09e450 2023-10-03T10:18:07.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.591+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2aa003f1f0 con 0x7f2aac09e450 2023-10-03T10:18:07.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.592+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac12a3d0 con 0x7f2aac09e450 2023-10-03T10:18:07.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.596+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2aac12a3d0 con 0x7f2aac09e450 2023-10-03T10:18:07.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.749+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3cb804f2a0 con 0x7f3cb80a1380 2023-10-03T10:18:07.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.749+0000 7f3cae7fc700 1 -- 172.21.15.125:0/4230817384 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ca80102c0 con 0x7f3cb80a1380 2023-10-03T10:18:07.749 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 msgr2=0x7f3cb811e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001eb0 tx=0x7f3ca800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 shutdown_connections 2023-10-03T10:18:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cb8134120 0x7f3cb811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3cb80a0a70 0x7f3cb811e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 --2- 172.21.15.125:0/4230817384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3cb80a1380 0x7f3cb811e8b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.752+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 >> 172.21.15.125:0/4230817384 conn(0x7f3cb80a6610 msgr2=0x7f3cb806da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.753+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 shutdown_connections 2023-10-03T10:18:07.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.753+0000 7f3cbffd4700 1 -- 172.21.15.125:0/4230817384 wait complete. 2023-10-03T10:18:07.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.790+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2aac12a3d0 con 0x7f2aac09e450 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.790+0000 7f2a93fff700 1 -- 172.21.15.125:0/800883314 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2aac12a3d0 con 0x7f2aac09e450 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 msgr2=0x7f2aac1274e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c520 tx=0x7f2aa000c830 comp rx=0 tx=0).stop 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 shutdown_connections 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2aac1309f0 0x7f2aac127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2aac09d8f0 0x7f2aac126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 --2- 172.21.15.125:0/800883314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2aac09e450 0x7f2aac1274e0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 >> 172.21.15.125:0/800883314 conn(0x7f2aac0a2b30 msgr2=0x7f2aac098790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 shutdown_connections 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:07.792+0000 7f2ab18bb700 1 -- 172.21.15.125:0/800883314 wait complete. 2023-10-03T10:18:07.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:08.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:08.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.479+0000 7f07e3b62700 1 Processor -- start 2023-10-03T10:18:08.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.479+0000 7f07e3b62700 1 -- start start 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e3b62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e3b62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07dc131ec0 0x7f07dc139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e3b62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc09da80 con 0x7f07dc06b080 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e3b62700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc09dce0 con 0x7f07dc131ec0 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e3b62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc09eb20 con 0x7f07dc06a770 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e18fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07dc131ec0 0x7f07dc139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e10fd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f07dc06b080 0x7f07dc1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55346/0 (socket says 172.21.15.125:55346) 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07dc131ec0 0x7f07dc139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60958/0 (socket says 172.21.15.125:60958) 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e18fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35314/0 (socket says 172.21.15.125:35314) 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e10fd700 1 -- 172.21.15.125:0/2208728632 learned_addr learned my addr 172.21.15.125:0/2208728632 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 -- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 msgr2=0x7f07dc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 -- 172.21.15.125:0/2208728632 >> v1:172.21.15.125:6789/0 conn(0x7f07dc06b080 legacy=0x7f07dc1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e20ff700 1 -- 172.21.15.125:0/2208728632 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc09d860 con 0x7f07dc131ec0 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e08fc700 1 -- 172.21.15.125:0/2208728632 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516703707 0 0) 0x7f07dc09da80 con 0x7f07dc06b080 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.480+0000 7f07e18fe700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e20ff700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc131ec0 0x7f07dc139c20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009d90 tx=0x7f07d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02ce8b1c811cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e08fc700 1 -- 172.21.15.125:0/2208728632 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400e070 con 0x7f07dc131ec0 2023-10-03T10:18:08.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e08fc700 1 -- 172.21.15.125:0/2208728632 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400bb20 con 0x7f07dc131ec0 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e08fc700 1 -- 172.21.15.125:0/2208728632 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4012430 con 0x7f07dc131ec0 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 -- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc131ec0 msgr2=0x7f07dc139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc131ec0 0x7f07dc139c20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009d90 tx=0x7f07d400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 -- 172.21.15.125:0/2208728632 shutdown_connections 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc131ec0 0x7f07dc139c20 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 --2- 172.21.15.125:0/2208728632 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06a770 0x7f07dc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 -- 172.21.15.125:0/2208728632 >> 172.21.15.125:0/2208728632 conn(0x7f07dc099c40 msgr2=0x7f07dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 -- 172.21.15.125:0/2208728632 shutdown_connections 2023-10-03T10:18:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.481+0000 7f07e3b62700 1 -- 172.21.15.125:0/2208728632 wait complete. 2023-10-03T10:18:08.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.482+0000 7f07e3b62700 1 Processor -- start 2023-10-03T10:18:08.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.482+0000 7f07e3b62700 1 -- start start 2023-10-03T10:18:08.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 0x7f07dc09b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07dc131ec0 0x7f07dc1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc071e80 con 0x7f07dc06a770 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc121fe0 con 0x7f07dc06b080 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc09b840 con 0x7f07dc131ec0 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60960/0 (socket says 172.21.15.125:60960) 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 -- 172.21.15.125:0/718371348 learned_addr learned my addr 172.21.15.125:0/718371348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e10fd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 0x7f07dc09b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e20ff700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07dc131ec0 0x7f07dc1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 -- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07dc131ec0 msgr2=0x7f07dc1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07dc131ec0 0x7f07dc1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 -- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 msgr2=0x7f07dc09b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 0x7f07dc09b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 -- 172.21.15.125:0/718371348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0094a0 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e10fd700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 0x7f07dc09b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e18fe700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00ebe0 tx=0x7f07cc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00c850 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00c9b0 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d4009a70 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00cd40 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.483+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc09aa60 con 0x7f07dc06a770 2023-10-03T10:18:08.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.484+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc04f2a0 con 0x7f07dc06a770 2023-10-03T10:18:08.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.484+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07cc013470 con 0x7f07dc06a770 2023-10-03T10:18:08.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.485+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07cc03ff50 con 0x7f07dc06a770 2023-10-03T10:18:08.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.489+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07cc013720 con 0x7f07dc06a770 2023-10-03T10:18:08.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:08.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.617+0000 7f83ce631700 1 Processor -- start 2023-10-03T10:18:08.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.617+0000 7f83ce631700 1 -- start start 2023-10-03T10:18:08.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ce631700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83c809f350 0x7f83c8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ce631700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ce631700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c809c970 con 0x7f83c809e870 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ce631700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c80a0920 con 0x7f83c809f350 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ce631700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c809f9c0 con 0x7f83c81371c0 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ccbce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83c77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83c809f350 0x7f83c8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83c7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83c809e870 0x7f83c809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55362/0 (socket says 172.21.15.125:55362) 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83c7fff700 1 -- 172.21.15.125:0/3727627305 learned_addr learned my addr 172.21.15.125:0/3727627305 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:08.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.618+0000 7f83ccbce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35334/0 (socket says 172.21.15.125:35334) 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c77fe700 1 -- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 msgr2=0x7f83c81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c77fe700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c77fe700 1 -- 172.21.15.125:0/3727627305 >> v1:172.21.15.125:6789/0 conn(0x7f83c809e870 legacy=0x7f83c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c77fe700 1 -- 172.21.15.125:0/3727627305 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c809bab0 con 0x7f83c809f350 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c6ffd700 1 -- 172.21.15.125:0/3727627305 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730317024 0 0) 0x7f83c809c970 con 0x7f83c809e870 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83ccbce700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c77fe700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c809f350 0x7f83c8136c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009840 tx=0x7f83bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0499b9ddfec3bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c6ffd700 1 -- 172.21.15.125:0/3727627305 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011830 con 0x7f83c809f350 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c6ffd700 1 -- 172.21.15.125:0/3727627305 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc011990 con 0x7f83c809f350 2023-10-03T10:18:08.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.619+0000 7f83c6ffd700 1 -- 172.21.15.125:0/3727627305 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011d20 con 0x7f83c809f350 2023-10-03T10:18:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 -- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c809f350 msgr2=0x7f83c8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c809f350 0x7f83c8136c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009840 tx=0x7f83bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 -- 172.21.15.125:0/3727627305 shutdown_connections 2023-10-03T10:18:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c81371c0 0x7f83c81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 --2- 172.21.15.125:0/3727627305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c809f350 0x7f83c8136c80 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 -- 172.21.15.125:0/3727627305 >> 172.21.15.125:0/3727627305 conn(0x7f83c80a4430 msgr2=0x7f83c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 -- 172.21.15.125:0/3727627305 shutdown_connections 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.620+0000 7f83ce631700 1 -- 172.21.15.125:0/3727627305 wait complete. 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 Processor -- start 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 -- start start 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83c809f350 0x7f83c8120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c81371c0 0x7f83c8121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8122310 con 0x7f83c81371c0 2023-10-03T10:18:08.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c809dba0 con 0x7f83c809e870 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ce631700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8123fb0 con 0x7f83c809f350 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83c7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83c7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35342/0 (socket says 172.21.15.125:35342) 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83c7fff700 1 -- 172.21.15.125:0/3841242269 learned_addr learned my addr 172.21.15.125:0/3841242269 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83c77fe700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83c809f350 0x7f83c8120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.621+0000 7f83ccbce700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c81371c0 0x7f83c8121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 -- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83c809f350 msgr2=0x7f83c8120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83c809f350 0x7f83c8120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 -- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c81371c0 msgr2=0x7f83c8121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c81371c0 0x7f83c8121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 -- 172.21.15.125:0/3841242269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0009a70 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c7fff700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c520 tx=0x7f83b800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8004c80 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8004de0 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8007310 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0094a0 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.622+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c81365f0 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.623+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83b8007470 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.623+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83b803f370 con 0x7f83c809e870 2023-10-03T10:18:08.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.623+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c804f2a0 con 0x7f83c809e870 2023-10-03T10:18:08.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.628+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83b80123b0 con 0x7f83c809e870 2023-10-03T10:18:08.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.683+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07dc122360 con 0x7f07dc06a770 2023-10-03T10:18:08.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.683+0000 7f07d27fc700 1 -- 172.21.15.125:0/718371348 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07cc01ab10 con 0x7f07dc06a770 2023-10-03T10:18:08.683 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 msgr2=0x7f07dc09adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00ebe0 tx=0x7f07cc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 shutdown_connections 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f07dc131ec0 0x7f07dc1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc06a770 0x7f07dc09adc0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 --2- 172.21.15.125:0/718371348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07dc06b080 0x7f07dc09b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 >> 172.21.15.125:0/718371348 conn(0x7f07dc099c40 msgr2=0x7f07dc1b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 shutdown_connections 2023-10-03T10:18:08.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.685+0000 7f07e3b62700 1 -- 172.21.15.125:0/718371348 wait complete. 2023-10-03T10:18:08.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:08.765 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:08.804 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:08.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.817+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83c81238a0 con 0x7f83c809e870 2023-10-03T10:18:08.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.817+0000 7f83c4ff9700 1 -- 172.21.15.125:0/3841242269 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83b8011360 con 0x7f83c809e870 2023-10-03T10:18:08.817 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 msgr2=0x7f83c8120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c520 tx=0x7f83b800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 shutdown_connections 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83c81371c0 0x7f83c8121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83c809e870 0x7f83c8120700 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 --2- 172.21.15.125:0/3841242269 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f83c809f350 0x7f83c8120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.819+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 >> 172.21.15.125:0/3841242269 conn(0x7f83c80a4430 msgr2=0x7f83c80a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.822+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 shutdown_connections 2023-10-03T10:18:08.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.822+0000 7f83ce631700 1 -- 172.21.15.125:0/3841242269 wait complete. 2023-10-03T10:18:08.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 Processor -- start 2023-10-03T10:18:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 -- start start 2023-10-03T10:18:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 0x7f6094138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 0x7f609413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609409e9d0 con 0x7f60940a0a70 2023-10-03T10:18:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609409dc00 con 0x7f6094139200 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609c0d4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609409dec0 con 0x7f60940a1550 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609966f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 0x7f6094138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f6099e70700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f60940a0a70 0x7f60940a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55364/0 (socket says 172.21.15.125:55364) 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f609a671700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 0x7f609413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.892+0000 7f6099e70700 1 -- 172.21.15.125:0/1240203328 learned_addr learned my addr 172.21.15.125:0/1240203328 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f6098e6e700 1 -- 172.21.15.125:0/1240203328 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547289008 0 0) 0x7f609409e9d0 con 0x7f60940a0a70 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f6098e6e700 1 -- 172.21.15.125:0/1240203328 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60800035b0 con 0x7f60940a0a70 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609966f700 1 -- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 msgr2=0x7f609413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609966f700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 0x7f609413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609966f700 1 -- 172.21.15.125:0/1240203328 >> v1:172.21.15.125:6789/0 conn(0x7f60940a0a70 legacy=0x7f60940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609966f700 1 -- 172.21.15.125:0/1240203328 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609409e6a0 con 0x7f60940a1550 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609a671700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 0x7f609413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f609966f700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 0x7f6094138cc0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6084009870 tx=0x7f6084009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da63fd3e4b81a012 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f6098e6e700 1 -- 172.21.15.125:0/1240203328 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084011830 con 0x7f60940a1550 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f6098e6e700 1 -- 172.21.15.125:0/1240203328 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084011990 con 0x7f60940a1550 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.893+0000 7f6098e6e700 1 -- 172.21.15.125:0/1240203328 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084011d20 con 0x7f60940a1550 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 -- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 msgr2=0x7f6094138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 0x7f6094138cc0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6084009870 tx=0x7f6084009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 -- 172.21.15.125:0/1240203328 shutdown_connections 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6094139200 0x7f609413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 --2- 172.21.15.125:0/1240203328 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f60940a1550 0x7f6094138cc0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 -- 172.21.15.125:0/1240203328 >> 172.21.15.125:0/1240203328 conn(0x7f60940a6610 msgr2=0x7f60940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 -- 172.21.15.125:0/1240203328 shutdown_connections 2023-10-03T10:18:08.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.894+0000 7f609c0d4700 1 -- 172.21.15.125:0/1240203328 wait complete. 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 Processor -- start 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 -- start start 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6094139200 0x7f6094121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60941223e0 con 0x7f60940a1550 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60941366c0 con 0x7f60940a0a70 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609c0d4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6094123a80 con 0x7f6094139200 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609966f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f6099e70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609966f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60982/0 (socket says 172.21.15.125:60982) 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609966f700 1 -- 172.21.15.125:0/3350645738 learned_addr learned my addr 172.21.15.125:0/3350645738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f6099e70700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35358/0 (socket says 172.21.15.125:35358) 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.895+0000 7f609a671700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6094139200 0x7f6094121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 -- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6094139200 msgr2=0x7f6094121250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6094139200 0x7f6094121250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 -- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 msgr2=0x7f60941207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 -- 172.21.15.125:0/3350645738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009a70 con 0x7f60940a1550 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f6099e70700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609966f700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f60840090b0 tx=0x7f6084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084004450 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608401f070 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60840094a0 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840038e0 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.896+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60940a5100 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.897+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6084003a40 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.897+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6084021070 con 0x7f60940a1550 2023-10-03T10:18:08.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.897+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60940a0440 con 0x7f60940a1550 2023-10-03T10:18:08.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.901+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6084015020 con 0x7f60940a1550 2023-10-03T10:18:08.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.935+0000 7fac5bffe700 1 Processor -- start 2023-10-03T10:18:08.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.935+0000 7fac5bffe700 1 -- start start 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5bffe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 0x7fac54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5bffe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac541300a0 0x7fac541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5bffe700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5406b2d0 con 0x7fac541309f0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5bffe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac54133610 con 0x7fac541300a0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5bffe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5409a500 con 0x7fac54133ad0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59d9a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 0x7fac54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5a59b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fac541309f0 0x7fac5413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55378/0 (socket says 172.21.15.125:55378) 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac5a59b700 1 -- 172.21.15.125:0/4008700986 learned_addr learned my addr 172.21.15.125:0/4008700986 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 --2- 172.21.15.125:0/4008700986 >> v2:172.21.15.125:3300/0 conn(0x7fac541300a0 0x7fac541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 -- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 msgr2=0x7fac54133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 0x7fac54133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 -- 172.21.15.125:0/4008700986 >> v1:172.21.15.125:6789/0 conn(0x7fac541309f0 legacy=0x7fac5413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 -- 172.21.15.125:0/4008700986 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac541338b0 con 0x7fac541300a0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac58d98700 1 -- 172.21.15.125:0/4008700986 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144353033 0 0) 0x7fac5406b2d0 con 0x7fac541309f0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59d9a700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 0x7fac54133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.936+0000 7fac59599700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac541300a0 0x7fac541304b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fac50009840 tx=0x7fac50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9663b1477c8b3af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac58d98700 1 -- 172.21.15.125:0/4008700986 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011830 con 0x7fac541300a0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac58d98700 1 -- 172.21.15.125:0/4008700986 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50011990 con 0x7fac541300a0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac58d98700 1 -- 172.21.15.125:0/4008700986 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011d20 con 0x7fac541300a0 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 -- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac541300a0 msgr2=0x7fac541304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac541300a0 0x7fac541304b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fac50009840 tx=0x7fac50009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 -- 172.21.15.125:0/4008700986 shutdown_connections 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac54133ad0 0x7fac54133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 --2- 172.21.15.125:0/4008700986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac541300a0 0x7fac541304b0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 -- 172.21.15.125:0/4008700986 >> 172.21.15.125:0/4008700986 conn(0x7fac54099c40 msgr2=0x7fac540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 -- 172.21.15.125:0/4008700986 shutdown_connections 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.937+0000 7fac5bffe700 1 -- 172.21.15.125:0/4008700986 wait complete. 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.938+0000 7fac5bffe700 1 Processor -- start 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.938+0000 7fac5bffe700 1 -- start start 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac541300a0 0x7fac540712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54133ad0 0x7fac54071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540a3470 con 0x7fac54133ad0 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5411e100 con 0x7fac541300a0 2023-10-03T10:18:08.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5411f1b0 con 0x7fac541309f0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59d9a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac541300a0 0x7fac540712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37716/0 (socket says 172.21.15.125:37716) 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 -- 172.21.15.125:0/1810890103 learned_addr learned my addr 172.21.15.125:0/1810890103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5a59b700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54133ad0 0x7fac54071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 -- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac541300a0 msgr2=0x7fac540712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac541300a0 0x7fac540712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 -- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54133ad0 msgr2=0x7fac54071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54133ad0 0x7fac54071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 -- 172.21.15.125:0/1810890103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440094a0 con 0x7fac541309f0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac59599700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fac500090b0 tx=0x7fac50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac500036a0 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5001f070 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50003a40 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac500094a0 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.939+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5411fee0 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.940+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac50003ba0 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.940+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac540a2620 con 0x7fac541309f0 2023-10-03T10:18:08.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.940+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac50021070 con 0x7fac541309f0 2023-10-03T10:18:08.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:08.945+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac50019590 con 0x7fac541309f0 2023-10-03T10:18:09.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.096+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f609404f2a0 con 0x7f60940a1550 2023-10-03T10:18:09.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.096+0000 7f608a7fc700 1 -- 172.21.15.125:0/3350645738 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6084010380 con 0x7f60940a1550 2023-10-03T10:18:09.096 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 msgr2=0x7f6094120d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f60840090b0 tx=0x7f6084004750 comp rx=0 tx=0).stop 2023-10-03T10:18:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 shutdown_connections 2023-10-03T10:18:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6094139200 0x7f6094121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60940a0a70 0x7f60941207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 --2- 172.21.15.125:0/3350645738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60940a1550 0x7f6094120d10 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 >> 172.21.15.125:0/3350645738 conn(0x7f60940a6610 msgr2=0x7f60940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 shutdown_connections 2023-10-03T10:18:09.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.098+0000 7f609c0d4700 1 -- 172.21.15.125:0/3350645738 wait complete. 2023-10-03T10:18:09.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.137+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac5411fee0 con 0x7fac541309f0 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.137+0000 7fac4a7fc700 1 -- 172.21.15.125:0/1810890103 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac5411fee0 con 0x7fac541309f0 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:09.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 msgr2=0x7fac540717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fac500090b0 tx=0x7fac50004750 comp rx=0 tx=0).stop 2023-10-03T10:18:09.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 shutdown_connections 2023-10-03T10:18:09.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54133ad0 0x7fac54071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac541300a0 0x7fac540712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 --2- 172.21.15.125:0/1810890103 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fac541309f0 0x7fac540717e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 >> 172.21.15.125:0/1810890103 conn(0x7fac54099c40 msgr2=0x7fac541329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.139+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 shutdown_connections 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.140+0000 7fac5bffe700 1 -- 172.21.15.125:0/1810890103 wait complete. 2023-10-03T10:18:09.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:09.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:09.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.824+0000 7feda6bb3700 1 Processor -- start 2023-10-03T10:18:09.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 -- start start 2023-10-03T10:18:09.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feda009f350 0x7feda0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda009c970 con 0x7feda009e870 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda00a0920 con 0x7feda009f350 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda6bb3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda009f9c0 con 0x7feda01371c0 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feda009f350 0x7feda0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda5150700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feda009f350 0x7feda0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60996/0 (socket says 172.21.15.125:60996) 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 -- 172.21.15.125:0/2270809717 learned_addr learned my addr 172.21.15.125:0/2270809717 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda494f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feda009e870 0x7feda009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55380/0 (socket says 172.21.15.125:55380) 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 -- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 msgr2=0x7feda01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 -- 172.21.15.125:0/2270809717 >> v1:172.21.15.125:6789/0 conn(0x7feda009e870 legacy=0x7feda009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9ffff700 1 -- 172.21.15.125:0/2270809717 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda009bab0 con 0x7feda009f350 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7feda5150700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.825+0000 7fed9f7fe700 1 -- 172.21.15.125:0/2270809717 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373175620 0 0) 0x7feda009c970 con 0x7feda009e870 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7fed9ffff700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda0136c80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00dd10 tx=0x7fed8c00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dbafc5727543d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7fed9f7fe700 1 -- 172.21.15.125:0/2270809717 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c012070 con 0x7feda009f350 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7fed9f7fe700 1 -- 172.21.15.125:0/2270809717 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00d2e0 con 0x7feda009f350 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7fed9f7fe700 1 -- 172.21.15.125:0/2270809717 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00fb10 con 0x7feda009f350 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 -- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 msgr2=0x7feda0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda0136c80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00dd10 tx=0x7fed8c00f330 comp rx=0 tx=0).stop 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 -- 172.21.15.125:0/2270809717 shutdown_connections 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 --2- 172.21.15.125:0/2270809717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda0136c80 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 -- 172.21.15.125:0/2270809717 >> 172.21.15.125:0/2270809717 conn(0x7feda00a4430 msgr2=0x7feda00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 -- 172.21.15.125:0/2270809717 shutdown_connections 2023-10-03T10:18:09.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.826+0000 7feda6bb3700 1 -- 172.21.15.125:0/2270809717 wait complete. 2023-10-03T10:18:09.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.827+0000 7feda6bb3700 1 Processor -- start 2023-10-03T10:18:09.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.827+0000 7feda6bb3700 1 -- start start 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda011efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda01220e0 con 0x7feda009f350 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda011f9e0 con 0x7feda01371c0 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda6bb3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda006d1f0 con 0x7feda009e870 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32774/0 (socket says 172.21.15.125:32774) 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda5150700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda011efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7fed9ffff700 1 -- 172.21.15.125:0/3415747237 learned_addr learned my addr 172.21.15.125:0/3415747237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37730/0 (socket says 172.21.15.125:37730) 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 -- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 msgr2=0x7feda011efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda011efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 -- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 msgr2=0x7feda011ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 -- 172.21.15.125:0/3415747237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98009a70 con 0x7feda009e870 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7fed9ffff700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7feda494f700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c4a0 tx=0x7fed9400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.828+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94004c80 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.829+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94004de0 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.829+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c00d9f0 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.829+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94007310 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.829+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda01227d0 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.829+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed94007470 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.830+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda004f2a0 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.830+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed9403f220 con 0x7feda009e870 2023-10-03T10:18:09.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.834+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed94007720 con 0x7feda009e870 2023-10-03T10:18:09.835 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:09.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.959+0000 7f4f6039e700 1 Processor -- start 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.959+0000 7f4f6039e700 1 -- start start 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.959+0000 7f4f6039e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.959+0000 7f4f6039e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 0x7f4f58133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.959+0000 7f4f6039e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5809dc00 con 0x7f4f58133f50 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f6039e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5809ea60 con 0x7f4f580a0a70 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f6039e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5809dec0 con 0x7f4f580a1380 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 0x7f4f58133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5e13a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5e93b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f58133f50 0x7f4f5813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55396/0 (socket says 172.21.15.125:55396) 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5e93b700 1 -- 172.21.15.125:0/789000247 learned_addr learned my addr 172.21.15.125:0/789000247 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:09.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 -- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 msgr2=0x7f4f580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 -- 172.21.15.125:0/789000247 >> v1:172.21.15.125:6789/0 conn(0x7f4f58133f50 legacy=0x7f4f5813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 -- 172.21.15.125:0/789000247 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5809e6a0 con 0x7f4f580a1380 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5e13a700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d138700 1 -- 172.21.15.125:0/789000247 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676764799 0 0) 0x7f4f5809dc00 con 0x7f4f58133f50 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d939700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 0x7f4f58133a10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009870 tx=0x7f4f48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56714a72f60762f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d138700 1 -- 172.21.15.125:0/789000247 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48011830 con 0x7f4f580a1380 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d138700 1 -- 172.21.15.125:0/789000247 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48011990 con 0x7f4f580a1380 2023-10-03T10:18:09.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.960+0000 7f4f5d138700 1 -- 172.21.15.125:0/789000247 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48011d20 con 0x7f4f580a1380 2023-10-03T10:18:09.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 -- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 msgr2=0x7f4f58133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 0x7f4f58133a10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009870 tx=0x7f4f48009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 -- 172.21.15.125:0/789000247 shutdown_connections 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 --2- 172.21.15.125:0/789000247 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f580a1380 0x7f4f58133a10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 -- 172.21.15.125:0/789000247 >> 172.21.15.125:0/789000247 conn(0x7f4f580a6610 msgr2=0x7f4f580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 -- 172.21.15.125:0/789000247 shutdown_connections 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.961+0000 7f4f6039e700 1 -- 172.21.15.125:0/789000247 wait complete. 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 Processor -- start 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 -- start start 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f58122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f580a1380 0x7f4f58122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58126110 con 0x7f4f580a1380 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58123cf0 con 0x7f4f580a0a70 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f6039e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58126360 con 0x7f4f58133f50 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f5e93b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f5e93b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37748/0 (socket says 172.21.15.125:37748) 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f5e93b700 1 -- 172.21.15.125:0/1244638222 learned_addr learned my addr 172.21.15.125:0/1244638222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f5e13a700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f58122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.962+0000 7f4f5d939700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f580a1380 0x7f4f58122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 -- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 msgr2=0x7f4f58122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f58122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 -- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f580a1380 msgr2=0x7f4f58122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f580a1380 0x7f4f58122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 -- 172.21.15.125:0/1244638222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540094a0 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f5e93b700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000cc70 tx=0x7f4f5000cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000aac0 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000ac40 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500070d0 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f480094a0 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.963+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f58124540 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.964+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f50007250 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.964+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f5003f160 con 0x7f4f58133f50 2023-10-03T10:18:09.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.964+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5804f2a0 con 0x7f4f58133f50 2023-10-03T10:18:09.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:09.968+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f50018080 con 0x7f4f58133f50 2023-10-03T10:18:10.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.027+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feda006b2a0 con 0x7feda009e870 2023-10-03T10:18:10.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.028+0000 7fed9d7fa700 1 -- 172.21.15.125:0/3415747237 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed9401b7b0 con 0x7feda009e870 2023-10-03T10:18:10.027 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:10.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 msgr2=0x7feda011e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c4a0 tx=0x7fed9400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 shutdown_connections 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feda01371c0 0x7feda011efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feda009e870 0x7feda011e520 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 --2- 172.21.15.125:0/3415747237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feda009f350 0x7feda011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 >> 172.21.15.125:0/3415747237 conn(0x7feda00a4430 msgr2=0x7feda006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 shutdown_connections 2023-10-03T10:18:10.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.030+0000 7feda6bb3700 1 -- 172.21.15.125:0/3415747237 wait complete. 2023-10-03T10:18:10.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:10.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:10.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.161+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f58133790 con 0x7f4f58133f50 2023-10-03T10:18:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.161+0000 7f4f4effd700 1 -- 172.21.15.125:0/1244638222 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f50007500 con 0x7f4f58133f50 2023-10-03T10:18:10.161 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 msgr2=0x7f4f58123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000cc70 tx=0x7f4f5000cf80 comp rx=0 tx=0).stop 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 shutdown_connections 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4f58133f50 0x7f4f58123310 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f580a0a70 0x7f4f58122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 --2- 172.21.15.125:0/1244638222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f580a1380 0x7f4f58122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.164+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 >> 172.21.15.125:0/1244638222 conn(0x7f4f580a6610 msgr2=0x7f4f5809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.165+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 shutdown_connections 2023-10-03T10:18:10.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.165+0000 7f4f6039e700 1 -- 172.21.15.125:0/1244638222 wait complete. 2023-10-03T10:18:10.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 Processor -- start 2023-10-03T10:18:10.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 -- start start 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 0x7f8c741343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740a3b60 con 0x7f8c740a0a70 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741348e0 con 0x7f8c74133f70 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c7943c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7409b110 con 0x7f8c7409ad40 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.239+0000 7f8c72ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c727fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 0x7f8c741343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37756/0 (socket says 172.21.15.125:37756) 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32806/0 (socket says 172.21.15.125:32806) 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 -- 172.21.15.125:0/2652027526 learned_addr learned my addr 172.21.15.125:0/2652027526 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 -- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 msgr2=0x7f8c741343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 0x7f8c741343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 -- 172.21.15.125:0/2652027526 >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 msgr2=0x7f8c740a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 --2- 172.21.15.125:0/2652027526 >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 -- 172.21.15.125:0/2652027526 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740a2fa0 con 0x7f8c7409ad40 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c727fc700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 0x7f8c741343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c737fe700 1 --2- 172.21.15.125:0/2652027526 >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c72ffd700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098f0 tx=0x7f8c64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6ccb8c039f3f1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c71ffb700 1 -- 172.21.15.125:0/2652027526 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011830 con 0x7f8c7409ad40 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c71ffb700 1 -- 172.21.15.125:0/2652027526 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64011990 con 0x7f8c7409ad40 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.240+0000 7f8c71ffb700 1 -- 172.21.15.125:0/2652027526 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011d20 con 0x7f8c7409ad40 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 -- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 msgr2=0x7f8c74133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098f0 tx=0x7f8c64009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 -- 172.21.15.125:0/2652027526 shutdown_connections 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 --2- 172.21.15.125:0/2652027526 >> v2:172.21.15.125:3300/0 conn(0x7f8c740a0a70 0x7f8c740a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c7409ad40 0x7f8c74133a30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 --2- 172.21.15.125:0/2652027526 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c74133f70 0x7f8c741343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 -- 172.21.15.125:0/2652027526 >> 172.21.15.125:0/2652027526 conn(0x7f8c74099c40 msgr2=0x7f8c7406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 -- 172.21.15.125:0/2652027526 shutdown_connections 2023-10-03T10:18:10.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.241+0000 7f8c7943c700 1 -- 172.21.15.125:0/2652027526 wait complete. 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 Processor -- start 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 -- start start 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741327d0 con 0x7f8c7409ad40 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c74124ca0 con 0x7f8c740a0a70 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c7943c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7409d360 con 0x7f8c74133f70 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c72ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c727fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.242+0000 7f8c737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c72ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32814/0 (socket says 172.21.15.125:32814) 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c727fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35396/0 (socket says 172.21.15.125:35396) 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c72ffd700 1 -- 172.21.15.125:0/351417885 learned_addr learned my addr 172.21.15.125:0/351417885 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37772/0 (socket says 172.21.15.125:37772) 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 -- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 msgr2=0x7f8c74121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 -- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 msgr2=0x7f8c741214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 -- 172.21.15.125:0/351417885 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009a70 con 0x7f8c74133f70 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c72ffd700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c727fc700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c737fe700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00eed0 tx=0x7f8c6c00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c010040 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00ba80 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c680094a0 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00be30 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.243+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c64009550 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.244+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c6c01d410 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.244+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c6c03f850 con 0x7f8c74133f70 2023-10-03T10:18:10.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.244+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c741257d0 con 0x7f8c74133f70 2023-10-03T10:18:10.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.249+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c6c007920 con 0x7f8c74133f70 2023-10-03T10:18:10.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.281+0000 7fa776f60700 1 Processor -- start 2023-10-03T10:18:10.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.281+0000 7fa776f60700 1 -- start start 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 0x7fa770133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 0x7fa770134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77009e9d0 con 0x7fa7700a1380 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77009dc00 con 0x7fa7700a0a70 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa776f60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa77009dec0 con 0x7fa770133f50 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa76ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 0x7fa770133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa7754fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 0x7fa770134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35406/0 (socket says 172.21.15.125:35406) 2023-10-03T10:18:10.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 -- 172.21.15.125:0/711844059 learned_addr learned my addr 172.21.15.125:0/711844059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 -- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 msgr2=0x7fa770134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 0x7fa770134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 -- 172.21.15.125:0/711844059 >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 msgr2=0x7fa770133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 --2- 172.21.15.125:0/711844059 >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 0x7fa770133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 -- 172.21.15.125:0/711844059 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77009e6a0 con 0x7fa7700a0a70 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa7754fd700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 0x7fa770134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa76ffff700 1 --2- 172.21.15.125:0/711844059 >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 0x7fa770133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa774cfc700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098f0 tx=0x7fa764009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8975185c27527722 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.282+0000 7fa76f7fe700 1 -- 172.21.15.125:0/711844059 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011830 con 0x7fa7700a0a70 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa76f7fe700 1 -- 172.21.15.125:0/711844059 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764011990 con 0x7fa7700a0a70 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa76f7fe700 1 -- 172.21.15.125:0/711844059 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011d20 con 0x7fa7700a0a70 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 -- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 msgr2=0x7fa7700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098f0 tx=0x7fa764009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 -- 172.21.15.125:0/711844059 shutdown_connections 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7700a0e40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 --2- 172.21.15.125:0/711844059 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa770133f50 0x7fa770134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 --2- 172.21.15.125:0/711844059 >> v2:172.21.15.125:3300/0 conn(0x7fa7700a1380 0x7fa770133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 -- 172.21.15.125:0/711844059 >> 172.21.15.125:0/711844059 conn(0x7fa7700a6610 msgr2=0x7fa7700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 -- 172.21.15.125:0/711844059 shutdown_connections 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.283+0000 7fa776f60700 1 -- 172.21.15.125:0/711844059 wait complete. 2023-10-03T10:18:10.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.284+0000 7fa776f60700 1 Processor -- start 2023-10-03T10:18:10.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.284+0000 7fa776f60700 1 -- start start 2023-10-03T10:18:10.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7701223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 0x7fa770122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa770123890 con 0x7fa770133f50 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa770133790 con 0x7fa7700a0a70 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa776f60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa770124e60 con 0x7fa7700a1380 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37796/0 (socket says 172.21.15.125:37796) 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa76ffff700 1 -- 172.21.15.125:0/3860552659 learned_addr learned my addr 172.21.15.125:0/3860552659 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa7754fd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 0x7fa770122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.285+0000 7fa774cfc700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7701223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 -- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 msgr2=0x7fa7701223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7701223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 -- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 msgr2=0x7fa770122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 0x7fa770122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 -- 172.21.15.125:0/3860552659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0094a0 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa7754fd700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 0x7fa770122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76ffff700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00ebe0 tx=0x7fa75c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00c850 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00c9b0 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768009a70 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00cd40 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.286+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764009550 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.287+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa75c013470 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.287+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77011f050 con 0x7fa7700a1380 2023-10-03T10:18:10.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.287+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa75c03f6e0 con 0x7fa7700a1380 2023-10-03T10:18:10.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.291+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa75c013720 con 0x7fa7700a1380 2023-10-03T10:18:10.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.446+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c7404f2a0 con 0x7f8c74133f70 2023-10-03T10:18:10.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.446+0000 7f8c5b7fe700 1 -- 172.21.15.125:0/351417885 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c6c007330 con 0x7f8c74133f70 2023-10-03T10:18:10.446 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 msgr2=0x7f8c74121f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00eed0 tx=0x7f8c6c00b390 comp rx=0 tx=0).stop 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 shutdown_connections 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8c74133f70 0x7f8c74121f60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c7409ad40 0x7f8c741214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 --2- 172.21.15.125:0/351417885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8c740a0a70 0x7f8c74121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 >> 172.21.15.125:0/351417885 conn(0x7f8c74099c40 msgr2=0x7f8c7409e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 shutdown_connections 2023-10-03T10:18:10.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.448+0000 7f8c7943c700 1 -- 172.21.15.125:0/351417885 wait complete. 2023-10-03T10:18:10.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:10.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.484+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7700a50e0 con 0x7fa7700a1380 2023-10-03T10:18:10.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.484+0000 7fa76d7fa700 1 -- 172.21.15.125:0/3860552659 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa75c021020 con 0x7fa7700a1380 2023-10-03T10:18:10.484 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 msgr2=0x7fa770122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00ebe0 tx=0x7fa75c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 shutdown_connections 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa770133f50 0x7fa770122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7700a0a70 0x7fa7701223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 --2- 172.21.15.125:0/3860552659 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa7700a1380 0x7fa770122900 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 >> 172.21.15.125:0/3860552659 conn(0x7fa7700a6610 msgr2=0x7fa77009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 shutdown_connections 2023-10-03T10:18:10.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:10.486+0000 7fa776f60700 1 -- 172.21.15.125:0/3860552659 wait complete. 2023-10-03T10:18:10.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:11.043 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:11.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.168+0000 7fe22bf67700 1 Processor -- start 2023-10-03T10:18:11.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.168+0000 7fe22bf67700 1 -- start start 2023-10-03T10:18:11.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22bf67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22bf67700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe224130bc0 0x7fe22413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22bf67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22406b2d0 con 0x7fe2241300a0 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22bf67700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe224133610 con 0x7fe224130bc0 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22bf67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe22409a500 con 0x7fe224133ad0 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe224130bc0 0x7fe22413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe229d03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe229d03700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37812/0 (socket says 172.21.15.125:37812) 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe224130bc0 0x7fe22413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32838/0 (socket says 172.21.15.125:32838) 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe229502700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe2241300a0 0x7fe2241304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55410/0 (socket says 172.21.15.125:55410) 2023-10-03T10:18:11.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe229d03700 1 -- 172.21.15.125:0/2100326567 learned_addr learned my addr 172.21.15.125:0/2100326567 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 -- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 msgr2=0x7fe224133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 -- 172.21.15.125:0/2100326567 >> v1:172.21.15.125:6789/0 conn(0x7fe2241300a0 legacy=0x7fe2241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 -- 172.21.15.125:0/2100326567 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2241338b0 con 0x7fe224130bc0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe228d01700 1 -- 172.21.15.125:0/2100326567 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166943688 0 0) 0x7fe22406b2d0 con 0x7fe2241300a0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe229d03700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe22a504700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe224130bc0 0x7fe22413b990 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9179a5104ca38909 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe228d01700 1 -- 172.21.15.125:0/2100326567 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00e070 con 0x7fe224130bc0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe228d01700 1 -- 172.21.15.125:0/2100326567 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00bb20 con 0x7fe224130bc0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.169+0000 7fe228d01700 1 -- 172.21.15.125:0/2100326567 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012430 con 0x7fe224130bc0 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 -- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe224130bc0 msgr2=0x7fe22413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe224130bc0 0x7fe22413b990 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 -- 172.21.15.125:0/2100326567 shutdown_connections 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe224130bc0 0x7fe22413b990 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 --2- 172.21.15.125:0/2100326567 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe224133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 -- 172.21.15.125:0/2100326567 >> 172.21.15.125:0/2100326567 conn(0x7fe224099c40 msgr2=0x7fe2240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 -- 172.21.15.125:0/2100326567 shutdown_connections 2023-10-03T10:18:11.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.170+0000 7fe22bf67700 1 -- 172.21.15.125:0/2100326567 wait complete. 2023-10-03T10:18:11.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 Processor -- start 2023-10-03T10:18:11.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 -- start start 2023-10-03T10:18:11.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe224130bc0 0x7fe22411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe22411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22411f8e0 con 0x7fe2241300a0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240a3420 con 0x7fe224130bc0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22bf67700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe22412dd00 con 0x7fe224133ad0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe229d03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe22a504700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe22411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe229d03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32840/0 (socket says 172.21.15.125:32840) 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe229d03700 1 -- 172.21.15.125:0/179499120 learned_addr learned my addr 172.21.15.125:0/179499120 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.171+0000 7fe229502700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe224130bc0 0x7fe22411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 -- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe224130bc0 msgr2=0x7fe22411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe224130bc0 0x7fe22411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 -- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 msgr2=0x7fe22411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 -- 172.21.15.125:0/179499120 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009550 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe229d03700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22a504700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe22411e4c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe21c016000 tx=0x7fe21c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012430 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c020070 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c009a70 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c004280 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.172+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22411f0b0 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.173+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22406b2d0 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.173+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe21c0043e0 con 0x7fe224133ad0 2023-10-03T10:18:11.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.173+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe21c022070 con 0x7fe224133ad0 2023-10-03T10:18:11.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.178+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe21c004690 con 0x7fe224133ad0 2023-10-03T10:18:11.178 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 Processor -- start 2023-10-03T10:18:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 -- start start 2023-10-03T10:18:11.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79d41371c0 0x7f79d41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d409c970 con 0x7f79d409e870 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40a0920 con 0x7f79d41371c0 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79dab27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409f9c0 con 0x7f79d409f350 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d90c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79d41371c0 0x7f79d41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d88c3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f79d409e870 0x7f79d409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55416/0 (socket says 172.21.15.125:55416) 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d90c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79d41371c0 0x7f79d41395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32856/0 (socket says 172.21.15.125:32856) 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d88c3700 1 -- 172.21.15.125:0/2939311915 learned_addr learned my addr 172.21.15.125:0/2939311915 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:11.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.306+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35428/0 (socket says 172.21.15.125:35428) 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d90c4700 1 -- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 msgr2=0x7f79d4136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d90c4700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d90c4700 1 -- 172.21.15.125:0/2939311915 >> v1:172.21.15.125:6789/0 conn(0x7f79d409e870 legacy=0x7f79d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d90c4700 1 -- 172.21.15.125:0/2939311915 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d409bab0 con 0x7f79d41371c0 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d3fff700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d90c4700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d41395a0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009d90 tx=0x7f79cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba3ed44dfd056bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d37fe700 1 -- 172.21.15.125:0/2939311915 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00e070 con 0x7f79d41371c0 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d37fe700 1 -- 172.21.15.125:0/2939311915 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00bb20 con 0x7f79d41371c0 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79d37fe700 1 -- 172.21.15.125:0/2939311915 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc012430 con 0x7f79d41371c0 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79dab27700 1 -- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 msgr2=0x7f79d41395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.307+0000 7f79dab27700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d41395a0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009d90 tx=0x7f79cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 -- 172.21.15.125:0/2939311915 shutdown_connections 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d41395a0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 --2- 172.21.15.125:0/2939311915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409f350 0x7f79d4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 -- 172.21.15.125:0/2939311915 >> 172.21.15.125:0/2939311915 conn(0x7f79d40a4430 msgr2=0x7f79d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 -- 172.21.15.125:0/2939311915 shutdown_connections 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 -- 172.21.15.125:0/2939311915 wait complete. 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.308+0000 7f79dab27700 1 Processor -- start 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 -- start start 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 0x7f79d41c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d41250d0 con 0x7f79d41371c0 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d41bc2a0 con 0x7f79d409e870 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79dab27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4135360 con 0x7f79d409f350 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79d88c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 0x7f79d41c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79d88c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35442/0 (socket says 172.21.15.125:35442) 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79d90c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.309+0000 7f79d88c3700 1 -- 172.21.15.125:0/2692121104 learned_addr learned my addr 172.21.15.125:0/2692121104 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 -- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 msgr2=0x7f79d41c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 -- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 msgr2=0x7f79d406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 -- 172.21.15.125:0/2692121104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00094a0 con 0x7f79d409f350 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d88c3700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d90c4700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d3fff700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 0x7f79d41c8cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e9e0 tx=0x7f79c000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000ee80 con 0x7f79d409f350 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000c850 con 0x7f79d409f350 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc009a70 con 0x7f79d409f350 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000cc00 con 0x7f79d409f350 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.310+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d4072480 con 0x7f79d409f350 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.311+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79c000cd60 con 0x7f79d409f350 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.311+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d409dc00 con 0x7f79d409f350 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.311+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79c003f710 con 0x7f79d409f350 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.315+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79c001be10 con 0x7f79d409f350 2023-10-03T10:18:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.378+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe22404f2a0 con 0x7fe224133ad0 2023-10-03T10:18:11.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.378+0000 7fe21a7fc700 1 -- 172.21.15.125:0/179499120 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe21c011b80 con 0x7fe224133ad0 2023-10-03T10:18:11.378 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 msgr2=0x7fe22411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe22411e4c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe21c016000 tx=0x7fe21c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 shutdown_connections 2023-10-03T10:18:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe224133ad0 0x7fe22411e4c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2241300a0 0x7fe22411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 --2- 172.21.15.125:0/179499120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe224130bc0 0x7fe22411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.380+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 >> 172.21.15.125:0/179499120 conn(0x7fe224099c40 msgr2=0x7fe224131f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.381+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 shutdown_connections 2023-10-03T10:18:11.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.381+0000 7fe22bf67700 1 -- 172.21.15.125:0/179499120 wait complete. 2023-10-03T10:18:11.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:11.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:11.498 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.507+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79d404f2a0 con 0x7f79d409f350 2023-10-03T10:18:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.507+0000 7f79d17fa700 1 -- 172.21.15.125:0/2692121104 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79c001b3b0 con 0x7f79d409f350 2023-10-03T10:18:11.507 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 msgr2=0x7f79d41c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 0x7f79d41c8cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e9e0 tx=0x7f79c000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 shutdown_connections 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79d41371c0 0x7f79d406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79d409e870 0x7f79d41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 --2- 172.21.15.125:0/2692121104 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f79d409f350 0x7f79d41c8cf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 >> 172.21.15.125:0/2692121104 conn(0x7f79d40a4430 msgr2=0x7f79d40a2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 shutdown_connections 2023-10-03T10:18:11.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.509+0000 7f79dab27700 1 -- 172.21.15.125:0/2692121104 wait complete. 2023-10-03T10:18:11.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:11.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.587+0000 7f02f7d91700 1 Processor -- start 2023-10-03T10:18:11.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 -- start start 2023-10-03T10:18:11.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f009e9d0 con 0x7f02f00a0a70 2023-10-03T10:18:11.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f009dc00 con 0x7f02f00a1550 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f7d91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02f009dec0 con 0x7f02f0139200 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f632e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f5b2d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f02f00a0a70 0x7f02f00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55420/0 (socket says 172.21.15.125:55420) 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f5b2d700 1 -- 172.21.15.125:0/2049893109 learned_addr learned my addr 172.21.15.125:0/2049893109 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f532c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.588+0000 7f02f4b2b700 1 -- 172.21.15.125:0/2049893109 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961395252 0 0) 0x7f02f009e9d0 con 0x7f02f00a0a70 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f532c700 1 -- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 msgr2=0x7f02f013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f532c700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f532c700 1 -- 172.21.15.125:0/2049893109 >> v1:172.21.15.125:6789/0 conn(0x7f02f00a0a70 legacy=0x7f02f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f532c700 1 -- 172.21.15.125:0/2049893109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f009e6a0 con 0x7f02f00a1550 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f632e700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f532c700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f0138cc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5ea10d1fc6e258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f4b2b700 1 -- 172.21.15.125:0/2049893109 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0011830 con 0x7f02f00a1550 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f4b2b700 1 -- 172.21.15.125:0/2049893109 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0011990 con 0x7f02f00a1550 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f4b2b700 1 -- 172.21.15.125:0/2049893109 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0011d20 con 0x7f02f00a1550 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 -- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 msgr2=0x7f02f0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f0138cc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 -- 172.21.15.125:0/2049893109 shutdown_connections 2023-10-03T10:18:11.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 --2- 172.21.15.125:0/2049893109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f0138cc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.589+0000 7f02f7d91700 1 -- 172.21.15.125:0/2049893109 >> 172.21.15.125:0/2049893109 conn(0x7f02f00a6610 msgr2=0x7f02f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.590+0000 7f02f7d91700 1 -- 172.21.15.125:0/2049893109 shutdown_connections 2023-10-03T10:18:11.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.590+0000 7f02f7d91700 1 -- 172.21.15.125:0/2049893109 wait complete. 2023-10-03T10:18:11.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.590+0000 7f02f7d91700 1 Processor -- start 2023-10-03T10:18:11.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.590+0000 7f02f7d91700 1 -- start start 2023-10-03T10:18:11.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02f00a0a70 0x7f02f011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01222d0 con 0x7f02f00a0a70 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00a03e0 con 0x7f02f00a1550 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f7d91700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00a5100 con 0x7f02f0139200 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f5b2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02f00a0a70 0x7f02f011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35460/0 (socket says 172.21.15.125:35460) 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 -- 172.21.15.125:0/1021277204 learned_addr learned my addr 172.21.15.125:0/1021277204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f632e700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 -- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 msgr2=0x7f02f011f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f011f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 -- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02f00a0a70 msgr2=0x7f02f011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02f00a0a70 0x7f02f011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 -- 172.21.15.125:0/1021277204 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009a70 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.591+0000 7f02f532c700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009840 tx=0x7f02e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00044d0 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e001f070 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00038e0 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e00094a0 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f0121d30 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02e0003a40 con 0x7f02f00a1550 2023-10-03T10:18:11.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.592+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f004f2a0 con 0x7f02f00a1550 2023-10-03T10:18:11.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.593+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f02e0021070 con 0x7f02f00a1550 2023-10-03T10:18:11.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.601+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02e002f3a0 con 0x7f02f00a1550 2023-10-03T10:18:11.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.633+0000 7f6c02244700 1 Processor -- start 2023-10-03T10:18:11.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.633+0000 7f6c02244700 1 -- start start 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6c02244700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6c02244700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bfc134120 0x7f6bfc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6c02244700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc09dc00 con 0x7f6bfc0a1380 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6c02244700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc09ea60 con 0x7f6bfc134120 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6c02244700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc09dec0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bfc134120 0x7f6bfc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bfc134120 0x7f6bfc13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32896/0 (socket says 172.21.15.125:32896) 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfbfff700 1 -- 172.21.15.125:0/2828615734 learned_addr learned my addr 172.21.15.125:0/2828615734 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfaffd700 1 --1- 172.21.15.125:0/2828615734 >> v1:172.21.15.125:6789/0 conn(0x7f6bfc0a1380 0x7f6bfc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55430/0 (socket says 172.21.15.125:55430) 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfb7fe700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfa7fc700 1 -- 172.21.15.125:0/2828615734 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640214110 0 0) 0x7f6bfc09dc00 con 0x7f6bfc0a1380 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.634+0000 7f6bfa7fc700 1 -- 172.21.15.125:0/2828615734 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be40035b0 con 0x7f6bfc0a1380 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfbfff700 1 -- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 msgr2=0x7f6bfc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfbfff700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfbfff700 1 -- 172.21.15.125:0/2828615734 >> v1:172.21.15.125:6789/0 conn(0x7f6bfc0a1380 legacy=0x7f6bfc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfbfff700 1 -- 172.21.15.125:0/2828615734 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc09e6a0 con 0x7f6bfc134120 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfb7fe700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfbfff700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc13bce0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098f0 tx=0x7f6bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1fca293ba72e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfa7fc700 1 -- 172.21.15.125:0/2828615734 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011830 con 0x7f6bfc134120 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfa7fc700 1 -- 172.21.15.125:0/2828615734 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4011990 con 0x7f6bfc134120 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6bfa7fc700 1 -- 172.21.15.125:0/2828615734 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011d20 con 0x7f6bfc134120 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6c02244700 1 -- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 msgr2=0x7f6bfc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.635+0000 7f6c02244700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc13bce0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098f0 tx=0x7f6bf4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 -- 172.21.15.125:0/2828615734 shutdown_connections 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc13bce0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 --2- 172.21.15.125:0/2828615734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 -- 172.21.15.125:0/2828615734 >> 172.21.15.125:0/2828615734 conn(0x7f6bfc0a6610 msgr2=0x7f6bfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 -- 172.21.15.125:0/2828615734 shutdown_connections 2023-10-03T10:18:11.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 -- 172.21.15.125:0/2828615734 wait complete. 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.636+0000 7f6c02244700 1 Processor -- start 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 -- start start 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bfc0a1380 0x7f6bfc122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc1233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc124e10 con 0x7f6bfc134120 2023-10-03T10:18:11.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc133880 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6c02244700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc126170 con 0x7f6bfc0a1380 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bfc0a1380 0x7f6bfc122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35472/0 (socket says 172.21.15.125:35472) 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 -- 172.21.15.125:0/3286074635 learned_addr learned my addr 172.21.15.125:0/3286074635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc1233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 -- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bfc0a1380 msgr2=0x7f6bfc122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bfc0a1380 0x7f6bfc122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 -- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 msgr2=0x7f6bfc1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc1233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfb7fe700 1 -- 172.21.15.125:0/3286074635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009a70 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.637+0000 7f6bfbfff700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6bfb7fe700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00efc0 tx=0x7f6bec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00cdd0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00f040 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf4009550 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0146a0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.638+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc126be0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.639+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bec014800 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.639+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bec040310 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.639+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc1263b0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.643+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bec01d400 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.796+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02f01346a0 con 0x7f02f00a1550 2023-10-03T10:18:11.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.796+0000 7f02e67fc700 1 -- 172.21.15.125:0/1021277204 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02e002b030 con 0x7f02f00a1550 2023-10-03T10:18:11.795 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 msgr2=0x7f02f011ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009840 tx=0x7f02e0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 shutdown_connections 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f02f0139200 0x7f02f011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02f00a0a70 0x7f02f011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 --2- 172.21.15.125:0/1021277204 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02f00a1550 0x7f02f011ecf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 >> 172.21.15.125:0/1021277204 conn(0x7f02f00a6610 msgr2=0x7f02f00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 shutdown_connections 2023-10-03T10:18:11.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.798+0000 7f02f7d91700 1 -- 172.21.15.125:0/1021277204 wait complete. 2023-10-03T10:18:11.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:11.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.836+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bfc04f2a0 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.836+0000 7f6be3fff700 1 -- 172.21.15.125:0/3286074635 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bec02b090 con 0x7f6bfc0a0a70 2023-10-03T10:18:11.836 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.838+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 msgr2=0x7f6bfc122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.838+0000 7f6c02244700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00efc0 tx=0x7f6bec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.838+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 shutdown_connections 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bfc134120 0x7f6bfc1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bfc0a0a70 0x7f6bfc122930 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 --2- 172.21.15.125:0/3286074635 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6bfc0a1380 0x7f6bfc122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 >> 172.21.15.125:0/3286074635 conn(0x7f6bfc0a6610 msgr2=0x7f6bfc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 shutdown_connections 2023-10-03T10:18:11.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:11.839+0000 7f6c02244700 1 -- 172.21.15.125:0/3286074635 wait complete. 2023-10-03T10:18:11.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:12.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.521+0000 7f51a640e700 1 Processor -- start 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.521+0000 7f51a640e700 1 -- start start 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a640e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a640e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51a009e170 0x7f51a01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a640e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a009aaa0 con 0x7f51a0130ce0 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a640e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a009f870 con 0x7f51a009e170 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a640e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a009b360 con 0x7f51a009d860 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51a009e170 0x7f51a01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a49ab700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51a0130ce0 0x7f51a01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55446/0 (socket says 172.21.15.125:55446) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51a009e170 0x7f51a01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32912/0 (socket says 172.21.15.125:32912) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37886/0 (socket says 172.21.15.125:37886) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f51a49ab700 1 -- 172.21.15.125:0/2697211003 learned_addr learned my addr 172.21.15.125:0/2697211003 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 -- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 msgr2=0x7f51a009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 -- 172.21.15.125:0/2697211003 >> v1:172.21.15.125:6789/0 conn(0x7f51a0130ce0 legacy=0x7f51a01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519f7fe700 1 -- 172.21.15.125:0/2697211003 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a009b620 con 0x7f51a009e170 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519effd700 1 -- 172.21.15.125:0/2697211003 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958405399 0 0) 0x7f51a009aaa0 con 0x7f51a0130ce0 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.522+0000 7f519ffff700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f519f7fe700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a009e170 0x7f51a01307a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5188009840 tx=0x7f5188009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13ce120c2cf6779 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f519effd700 1 -- 172.21.15.125:0/2697211003 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188011830 con 0x7f51a009e170 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f519effd700 1 -- 172.21.15.125:0/2697211003 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188011990 con 0x7f51a009e170 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f519effd700 1 -- 172.21.15.125:0/2697211003 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188011d20 con 0x7f51a009e170 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 -- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a009e170 msgr2=0x7f51a01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a009e170 0x7f51a01307a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5188009840 tx=0x7f5188009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 -- 172.21.15.125:0/2697211003 shutdown_connections 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 --2- 172.21.15.125:0/2697211003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a009e170 0x7f51a01307a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 -- 172.21.15.125:0/2697211003 >> 172.21.15.125:0/2697211003 conn(0x7f51a0099c40 msgr2=0x7f51a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 -- 172.21.15.125:0/2697211003 shutdown_connections 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.523+0000 7f51a640e700 1 -- 172.21.15.125:0/2697211003 wait complete. 2023-10-03T10:18:12.526 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:12.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.524+0000 7f51a640e700 1 Processor -- start 2023-10-03T10:18:12.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.524+0000 7f51a640e700 1 -- start start 2023-10-03T10:18:12.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a011f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 0x7f51a011fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00a3320 con 0x7f51a0130ce0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a009c8b0 con 0x7f51a009e170 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0121090 con 0x7f51a009d860 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 0x7f51a011fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a011f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 0x7f51a011fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35474/0 (socket says 172.21.15.125:35474) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a011f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37902/0 (socket says 172.21.15.125:37902) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519f7fe700 1 -- 172.21.15.125:0/3994574237 learned_addr learned my addr 172.21.15.125:0/3994574237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32918/0 (socket says 172.21.15.125:32918) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 -- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 msgr2=0x7f51a011f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a011f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 -- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 msgr2=0x7f51a011fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 0x7f51a011fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 -- 172.21.15.125:0/3994574237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094a0 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a49ab700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f519800cbe0 tx=0x7f519800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800aa40 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800abc0 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51880094a0 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.525+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980070d0 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.526+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a0122660 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.526+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5198007230 con 0x7f51a0130ce0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.526+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f519803f3e0 con 0x7f51a0130ce0 2023-10-03T10:18:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.526+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0122c50 con 0x7f51a0130ce0 2023-10-03T10:18:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.531+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5198018070 con 0x7f51a0130ce0 2023-10-03T10:18:12.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 Processor -- start 2023-10-03T10:18:12.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 -- start start 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 0x7fb914138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91409aaa0 con 0x7fb91409e170 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91409f870 con 0x7fb914130eb0 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.656+0000 7fb91a326700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409b360 con 0x7fb91409d860 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37916/0 (socket says 172.21.15.125:37916) 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 -- 172.21.15.125:0/1449966471 learned_addr learned my addr 172.21.15.125:0/1449966471 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb9188c3700 1 --2- 172.21.15.125:0/1449966471 >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 0x7fb914138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 -- 172.21.15.125:0/1449966471 >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 msgr2=0x7fb914138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 --2- 172.21.15.125:0/1449966471 >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 0x7fb914138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 -- 172.21.15.125:0/1449966471 >> v1:172.21.15.125:6789/0 conn(0x7fb91409e170 legacy=0x7fb9141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 -- 172.21.15.125:0/1449966471 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91409b620 con 0x7fb91409d860 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb912ffd700 1 -- 172.21.15.125:0/1449966471 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454292667 0 0) 0x7fb91409aaa0 con 0x7fb91409e170 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb9188c3700 1 --2- 172.21.15.125:0/1449966471 >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 0x7fb914138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb913fff700 1 --2- 172.21.15.125:0/1449966471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb90400bb90 tx=0x7fb90400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67cf8a6d35d5bef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb912ffd700 1 -- 172.21.15.125:0/1449966471 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400dd30 con 0x7fb91409d860 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb912ffd700 1 -- 172.21.15.125:0/1449966471 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90400de90 con 0x7fb91409d860 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.657+0000 7fb912ffd700 1 -- 172.21.15.125:0/1449966471 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904010690 con 0x7fb91409d860 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 -- 172.21.15.125:0/1449966471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 msgr2=0x7fb91409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 --2- 172.21.15.125:0/1449966471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb90400bb90 tx=0x7fb90400bea0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 -- 172.21.15.125:0/1449966471 shutdown_connections 2023-10-03T10:18:12.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 --2- 172.21.15.125:0/1449966471 >> v2:172.21.15.125:3300/0 conn(0x7fb914130eb0 0x7fb914138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 --2- 172.21.15.125:0/1449966471 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91409dc30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 -- 172.21.15.125:0/1449966471 >> 172.21.15.125:0/1449966471 conn(0x7fb914099c40 msgr2=0x7fb9140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 -- 172.21.15.125:0/1449966471 shutdown_connections 2023-10-03T10:18:12.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.658+0000 7fb91a326700 1 -- 172.21.15.125:0/1449966471 wait complete. 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.659+0000 7fb91a326700 1 Processor -- start 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.659+0000 7fb91a326700 1 -- start start 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 0x7fb91411e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb914130eb0 0x7fb91411ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914121ea0 con 0x7fb91409e170 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9141216d0 con 0x7fb914130eb0 2023-10-03T10:18:12.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb91a326700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409c8b0 con 0x7fb91409d860 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb913fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 0x7fb91411e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb913fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37924/0 (socket says 172.21.15.125:37924) 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb913fff700 1 -- 172.21.15.125:0/4253606040 learned_addr learned my addr 172.21.15.125:0/4253606040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9188c3700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb914130eb0 0x7fb91411ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 -- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 msgr2=0x7fb91411e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 -- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb914130eb0 msgr2=0x7fb91411ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb914130eb0 0x7fb91411ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb9137fe700 1 -- 172.21.15.125:0/4253606040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c009a70 con 0x7fb91409e170 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.660+0000 7fb913fff700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb9137fe700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 0x7fb91411e8c0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb91409a100 tx=0x7fb90800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080052e0 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908005460 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90400b7f0 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080038c0 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.661+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb914071fc0 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.662+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb908003a20 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.662+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb90803e990 con 0x7fb91409e170 2023-10-03T10:18:12.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.662+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb914130370 con 0x7fb91409e170 2023-10-03T10:18:12.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.667+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb908019b20 con 0x7fb91409e170 2023-10-03T10:18:12.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.748+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51a004f2a0 con 0x7f51a0130ce0 2023-10-03T10:18:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.749+0000 7f519cff9700 1 -- 172.21.15.125:0/3994574237 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51980074e0 con 0x7f51a0130ce0 2023-10-03T10:18:12.748 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 msgr2=0x7f51a011fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f519800cbe0 tx=0x7f519800cef0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 shutdown_connections 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51a0130ce0 0x7f51a011fff0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f51a009d860 0x7f51a011f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 --2- 172.21.15.125:0/3994574237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51a009e170 0x7f51a011fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 >> 172.21.15.125:0/3994574237 conn(0x7f51a0099c40 msgr2=0x7f51a0119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 shutdown_connections 2023-10-03T10:18:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.751+0000 7f51a640e700 1 -- 172.21.15.125:0/3994574237 wait complete. 2023-10-03T10:18:12.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:12.810 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:12.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:12.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.878+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb91404f2a0 con 0x7fb91409e170 2023-10-03T10:18:12.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.878+0000 7fb910ff9700 1 -- 172.21.15.125:0/4253606040 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb908017020 con 0x7fb91409e170 2023-10-03T10:18:12.878 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:12.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 msgr2=0x7fb91411e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 0x7fb91411e8c0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb91409a100 tx=0x7fb90800c710 comp rx=0 tx=0).stop 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 shutdown_connections 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb914130eb0 0x7fb91411ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb91409d860 0x7fb91411e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 --2- 172.21.15.125:0/4253606040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb91409e170 0x7fb91411e8c0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 >> 172.21.15.125:0/4253606040 conn(0x7fb914099c40 msgr2=0x7fb914070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 shutdown_connections 2023-10-03T10:18:12.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.881+0000 7fb91a326700 1 -- 172.21.15.125:0/4253606040 wait complete. 2023-10-03T10:18:12.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:12.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 Processor -- start 2023-10-03T10:18:12.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 -- start start 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd40134120 0x7efd4013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4009dc00 con 0x7efd400a1380 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4009ea60 con 0x7efd40134120 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd45c58700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd4009dec0 con 0x7efd400a0a70 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd40134120 0x7efd4013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd3effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efd400a1380 0x7efd40133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55456/0 (socket says 172.21.15.125:55456) 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.936+0000 7efd3effd700 1 -- 172.21.15.125:0/3564564959 learned_addr learned my addr 172.21.15.125:0/3564564959 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3ffff700 1 -- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 msgr2=0x7efd400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3ffff700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd400a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3ffff700 1 -- 172.21.15.125:0/3564564959 >> v1:172.21.15.125:6789/0 conn(0x7efd400a1380 legacy=0x7efd40133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3ffff700 1 -- 172.21.15.125:0/3564564959 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4009e6a0 con 0x7efd40134120 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3f7fe700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3e7fc700 1 -- 172.21.15.125:0/3564564959 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576626981 0 0) 0x7efd4009dc00 con 0x7efd400a1380 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3ffff700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd4013bce0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7efd38009840 tx=0x7efd38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f24f04567a16630 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3e7fc700 1 -- 172.21.15.125:0/3564564959 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38011830 con 0x7efd40134120 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3e7fc700 1 -- 172.21.15.125:0/3564564959 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38011990 con 0x7efd40134120 2023-10-03T10:18:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.937+0000 7efd3e7fc700 1 -- 172.21.15.125:0/3564564959 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38011d20 con 0x7efd40134120 2023-10-03T10:18:12.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 -- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 msgr2=0x7efd4013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd4013bce0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7efd38009840 tx=0x7efd38009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 -- 172.21.15.125:0/3564564959 shutdown_connections 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd4013bce0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 --2- 172.21.15.125:0/3564564959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 -- 172.21.15.125:0/3564564959 >> 172.21.15.125:0/3564564959 conn(0x7efd400a6610 msgr2=0x7efd400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 -- 172.21.15.125:0/3564564959 shutdown_connections 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.938+0000 7efd45c58700 1 -- 172.21.15.125:0/3564564959 wait complete. 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 Processor -- start 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 -- start start 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd40122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd401231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401332b0 con 0x7efd40134120 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd401258b0 con 0x7efd400a1380 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd45c58700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd401242c0 con 0x7efd400a0a70 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd3effd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35494/0 (socket says 172.21.15.125:35494) 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd40122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd3effd700 1 -- 172.21.15.125:0/2760542629 learned_addr learned my addr 172.21.15.125:0/2760542629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.939+0000 7efd3ffff700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd401231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 -- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 msgr2=0x7efd40122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 -- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 msgr2=0x7efd401231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd401231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 -- 172.21.15.125:0/2760542629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30009a70 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3effd700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd3f7fe700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd40122750 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efd30009e60 tx=0x7efd3000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000cd10 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000f040 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300146c0 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd380094a0 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.940+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd40125c30 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.941+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd30014820 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.941+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4004f2a0 con 0x7efd400a0a70 2023-10-03T10:18:12.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.941+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd30040250 con 0x7efd400a0a70 2023-10-03T10:18:12.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.946+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd30007510 con 0x7efd400a0a70 2023-10-03T10:18:12.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.978+0000 7f62cafde700 1 Processor -- start 2023-10-03T10:18:12.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.978+0000 7f62cafde700 1 -- start start 2023-10-03T10:18:12.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c40a1380 0x7f62c4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c4134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c409e9d0 con 0x7f62c40a1380 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c409dc00 con 0x7f62c40a0a70 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62cafde700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c409dec0 con 0x7f62c4133f50 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c40a1380 0x7f62c4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c957b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c4134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c8d7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c40a1380 0x7f62c4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32972/0 (socket says 172.21.15.125:32972) 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c3fff700 1 -- 172.21.15.125:0/448186416 learned_addr learned my addr 172.21.15.125:0/448186416 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c8d7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35496/0 (socket says 172.21.15.125:35496) 2023-10-03T10:18:12.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.979+0000 7f62c957b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c4134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37960/0 (socket says 172.21.15.125:37960) 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 -- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 msgr2=0x7f62c4134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c4134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 -- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 msgr2=0x7f62c40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 -- 172.21.15.125:0/448186416 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c409e6a0 con 0x7f62c40a1380 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c8d7a700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c3fff700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a1380 0x7f62c4133a10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f62b00098f0 tx=0x7f62b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26949839310e26b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c37fe700 1 -- 172.21.15.125:0/448186416 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011830 con 0x7f62c40a1380 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c37fe700 1 -- 172.21.15.125:0/448186416 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0011990 con 0x7f62c40a1380 2023-10-03T10:18:12.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.980+0000 7f62c37fe700 1 -- 172.21.15.125:0/448186416 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011d20 con 0x7f62c40a1380 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 -- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a1380 msgr2=0x7f62c4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a1380 0x7f62c4133a10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f62b00098f0 tx=0x7f62b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 -- 172.21.15.125:0/448186416 shutdown_connections 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a0a70 0x7f62c40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 --2- 172.21.15.125:0/448186416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a1380 0x7f62c4133a10 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 -- 172.21.15.125:0/448186416 >> 172.21.15.125:0/448186416 conn(0x7f62c40a6610 msgr2=0x7f62c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 -- 172.21.15.125:0/448186416 shutdown_connections 2023-10-03T10:18:12.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.981+0000 7f62cafde700 1 -- 172.21.15.125:0/448186416 wait complete. 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.982+0000 7f62cafde700 1 Processor -- start 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.982+0000 7f62cafde700 1 -- start start 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c411ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41214e0 con 0x7f62c40a0a70 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4122780 con 0x7f62c40a1380 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62cafde700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40a03e0 con 0x7f62c4133f50 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c8d7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c8d7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32982/0 (socket says 172.21.15.125:32982) 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35504/0 (socket says 172.21.15.125:35504) 2023-10-03T10:18:12.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c8d7a700 1 -- 172.21.15.125:0/3946090605 learned_addr learned my addr 172.21.15.125:0/3946090605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c957b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c411ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 -- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 msgr2=0x7f62c411ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c411ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 -- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 msgr2=0x7f62c411f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 -- 172.21.15.125:0/3946090605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80094a0 con 0x7f62c40a1380 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c8d7a700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c957b700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c411ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.983+0000 7f62c3fff700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f62c40672b0 tx=0x7f62b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004240 con 0x7f62c40a1380 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b001f070 con 0x7f62c40a1380 2023-10-03T10:18:12.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00036a0 con 0x7f62c40a1380 2023-10-03T10:18:12.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b0009550 con 0x7f62c40a1380 2023-10-03T10:18:12.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4133a10 con 0x7f62c40a1380 2023-10-03T10:18:12.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.984+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62b0021030 con 0x7f62c40a1380 2023-10-03T10:18:12.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.985+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4132280 con 0x7f62c40a1380 2023-10-03T10:18:12.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.985+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62b0040880 con 0x7f62c40a1380 2023-10-03T10:18:12.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:12.989+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b0015020 con 0x7f62c40a1380 2023-10-03T10:18:13.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.141+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd40072980 con 0x7efd400a0a70 2023-10-03T10:18:13.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.141+0000 7efd37fff700 1 -- 172.21.15.125:0/2760542629 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd30007330 con 0x7efd400a0a70 2023-10-03T10:18:13.141 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 msgr2=0x7efd40122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd40122750 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efd30009e60 tx=0x7efd3000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 shutdown_connections 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd40134120 0x7efd401231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efd400a0a70 0x7efd40122750 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 --2- 172.21.15.125:0/2760542629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd400a1380 0x7efd40122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 >> 172.21.15.125:0/2760542629 conn(0x7efd400a6610 msgr2=0x7efd4011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 shutdown_connections 2023-10-03T10:18:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.143+0000 7efd45c58700 1 -- 172.21.15.125:0/2760542629 wait complete. 2023-10-03T10:18:13.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:13.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.179+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f62c404f2a0 con 0x7f62c40a1380 2023-10-03T10:18:13.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.180+0000 7f62c17fa700 1 -- 172.21.15.125:0/3946090605 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62b00199a0 con 0x7f62c40a1380 2023-10-03T10:18:13.179 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 msgr2=0x7f62c411f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f62c40672b0 tx=0x7f62b0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 shutdown_connections 2023-10-03T10:18:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f62c4133f50 0x7f62c411ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c40a0a70 0x7f62c411f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 --2- 172.21.15.125:0/3946090605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40a1380 0x7f62c411f9c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 >> 172.21.15.125:0/3946090605 conn(0x7f62c40a6610 msgr2=0x7f62c40a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 shutdown_connections 2023-10-03T10:18:13.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.182+0000 7f62cafde700 1 -- 172.21.15.125:0/3946090605 wait complete. 2023-10-03T10:18:13.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:13.763 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:13.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.891+0000 7f26e232d700 1 Processor -- start 2023-10-03T10:18:13.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.891+0000 7f26e232d700 1 -- start start 2023-10-03T10:18:13.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0a0920 con 0x7f26dc09e870 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09c970 con 0x7f26dc131d70 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e232d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09bab0 con 0x7f26dc09f180 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35508/0 (socket says 172.21.15.125:35508) 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32996/0 (socket says 172.21.15.125:32996) 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:37992/0 (socket says 172.21.15.125:37992) 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 -- 172.21.15.125:0/3833869431 learned_addr learned my addr 172.21.15.125:0/3833869431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:13.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 -- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 msgr2=0x7f26dc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 --2- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 -- 172.21.15.125:0/3833869431 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 msgr2=0x7f26dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 --2- 172.21.15.125:0/3833869431 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 -- 172.21.15.125:0/3833869431 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc09f9c0 con 0x7f26dc131d70 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26dbfff700 1 --2- 172.21.15.125:0/3833869431 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26e08ca700 1 --2- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009e80 tx=0x7f26d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7883e619d4e19561 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26daffd700 1 -- 172.21.15.125:0/3833869431 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400e070 con 0x7f26dc131d70 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26daffd700 1 -- 172.21.15.125:0/3833869431 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400b8d0 con 0x7f26dc131d70 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.892+0000 7f26daffd700 1 -- 172.21.15.125:0/3833869431 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400bc80 con 0x7f26dc131d70 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 -- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 msgr2=0x7f26dc1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 --2- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009e80 tx=0x7f26d400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 -- 172.21.15.125:0/3833869431 shutdown_connections 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 --2- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc1321f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 --2- 172.21.15.125:0/3833869431 >> v2:172.21.15.125:3300/0 conn(0x7f26dc09e870 0x7f26dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 --2- 172.21.15.125:0/3833869431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09f180 0x7f26dc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 -- 172.21.15.125:0/3833869431 >> 172.21.15.125:0/3833869431 conn(0x7f26dc0a4430 msgr2=0x7f26dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 -- 172.21.15.125:0/3833869431 shutdown_connections 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.893+0000 7f26e232d700 1 -- 172.21.15.125:0/3833869431 wait complete. 2023-10-03T10:18:13.895 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 Processor -- start 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 -- start start 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc09f180 0x7f26dc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc06cd80 con 0x7f26dc09f180 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc125cc0 con 0x7f26dc131d70 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.894+0000 7f26e232d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc125450 con 0x7f26dc09e870 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26e08ca700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38004/0 (socket says 172.21.15.125:38004) 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc09f180 0x7f26dc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 -- 172.21.15.125:0/1378732660 learned_addr learned my addr 172.21.15.125:0/1378732660 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 -- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 msgr2=0x7f26dc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 -- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc09f180 msgr2=0x7f26dc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc09f180 0x7f26dc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 -- 172.21.15.125:0/1378732660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0094a0 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26dbfff700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ec10 tx=0x7f26cc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc009780 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc00c850 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d4009b30 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00cbe0 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.895+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc125770 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.896+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26cc00cd40 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.896+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26cc03fae0 con 0x7f26dc09e870 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.896+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc11d580 con 0x7f26dc09e870 2023-10-03T10:18:13.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:13.901+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26cc017080 con 0x7f26dc09e870 2023-10-03T10:18:14.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 Processor -- start 2023-10-03T10:18:14.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 -- start start 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 0x7ff2e4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 0x7ff2e413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e406b2d0 con 0x7ff2e4133ad0 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41345b0 con 0x7ff2e4136960 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.025+0000 7ff2eb827700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4133610 con 0x7ff2e4139280 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e95c3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff2e4133ad0 0x7ff2e4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55472/0 (socket says 172.21.15.125:55472) 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 0x7ff2e413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e95c3700 1 -- 172.21.15.125:0/2705657014 learned_addr learned my addr 172.21.15.125:0/2705657014 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e8dc2700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 0x7ff2e4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 msgr2=0x7ff2e4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 0x7ff2e4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2705657014 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306353869 0 0) 0x7ff2e406b2d0 con 0x7ff2e4133ad0 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2705657014 >> v1:172.21.15.125:6789/0 conn(0x7ff2e4133ad0 legacy=0x7ff2e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2705657014 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e409a500 con 0x7ff2e4139280 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e8dc2700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 0x7ff2e4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2e9dc4700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 0x7ff2e413b660 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009dc0 tx=0x7ff2dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5cd1f3284611ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2705657014 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e070 con 0x7ff2e4139280 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2705657014 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00bb20 con 0x7ff2e4139280 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.026+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2705657014 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc012430 con 0x7ff2e4139280 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 -- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 msgr2=0x7ff2e413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 0x7ff2e413b660 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009dc0 tx=0x7ff2dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:14.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 -- 172.21.15.125:0/2705657014 shutdown_connections 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4139280 0x7ff2e413b660 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2705657014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4136960 0x7ff2e4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 -- 172.21.15.125:0/2705657014 >> 172.21.15.125:0/2705657014 conn(0x7ff2e4099c40 msgr2=0x7ff2e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 -- 172.21.15.125:0/2705657014 shutdown_connections 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.027+0000 7ff2eb827700 1 -- 172.21.15.125:0/2705657014 wait complete. 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.028+0000 7ff2eb827700 1 Processor -- start 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.028+0000 7ff2eb827700 1 -- start start 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4133ad0 0x7ff2e4070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 0x7ff2e40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e406fd00 con 0x7ff2e4136960 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e412dd00 con 0x7ff2e4139280 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4072590 con 0x7ff2e4133ad0 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35530/0 (socket says 172.21.15.125:35530) 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2650525294 learned_addr learned my addr 172.21.15.125:0/2650525294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e8dc2700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 0x7ff2e40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e95c3700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4133ad0 0x7ff2e4070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4133ad0 msgr2=0x7ff2e4070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4133ad0 0x7ff2e4070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 msgr2=0x7ff2e40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 0x7ff2e40713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 -- 172.21.15.125:0/2650525294 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40094a0 con 0x7ff2e4139280 2023-10-03T10:18:14.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e8dc2700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 0x7ff2e40713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2e9dc4700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00b370 tx=0x7ff2dc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc012430 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc020070 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc009a70 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.029+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc004280 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.030+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e406f980 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.030+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2dc0043e0 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.031+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2dc022070 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.031+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e404f2a0 con 0x7ff2e4139280 2023-10-03T10:18:14.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.035+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2dc02c080 con 0x7ff2e4139280 2023-10-03T10:18:14.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.098+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26dc04f2a0 con 0x7f26dc09e870 2023-10-03T10:18:14.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.099+0000 7f26d8ff9700 1 -- 172.21.15.125:0/1378732660 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26cc011d90 con 0x7f26dc09e870 2023-10-03T10:18:14.098 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 msgr2=0x7f26dc06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ec10 tx=0x7f26cc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 shutdown_connections 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26dc131d70 0x7f26dc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26dc09e870 0x7f26dc06b8b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 --2- 172.21.15.125:0/1378732660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26dc09f180 0x7f26dc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 >> 172.21.15.125:0/1378732660 conn(0x7f26dc0a4430 msgr2=0x7f26dc11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 shutdown_connections 2023-10-03T10:18:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.101+0000 7f26e232d700 1 -- 172.21.15.125:0/1378732660 wait complete. 2023-10-03T10:18:14.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:14.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:14.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:14.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.233+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2e406c3b0 con 0x7ff2e4139280 2023-10-03T10:18:14.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.234+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/2650525294 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2dc009860 con 0x7ff2e4139280 2023-10-03T10:18:14.233 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:14.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 msgr2=0x7ff2e4071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00b370 tx=0x7ff2dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 shutdown_connections 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2e4139280 0x7ff2e4071900 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2e4133ad0 0x7ff2e4070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 --2- 172.21.15.125:0/2650525294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e4136960 0x7ff2e40713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 >> 172.21.15.125:0/2650525294 conn(0x7ff2e4099c40 msgr2=0x7ff2e4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 shutdown_connections 2023-10-03T10:18:14.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.236+0000 7ff2eb827700 1 -- 172.21.15.125:0/2650525294 wait complete. 2023-10-03T10:18:14.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 Processor -- start 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 -- start start 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 0x7f3fb8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb809e9d0 con 0x7f3fb80a0a70 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb809dc00 con 0x7f3fb8133f50 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbe3a4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb809dec0 con 0x7f3fb80a1380 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fb77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 0x7f3fb8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fb7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbc941700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fb7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33020/0 (socket says 172.21.15.125:33020) 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fb77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 0x7f3fb8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38036/0 (socket says 172.21.15.125:38036) 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fb7fff700 1 -- 172.21.15.125:0/1309463322 learned_addr learned my addr 172.21.15.125:0/1309463322 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.282+0000 7f3fbc941700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:35534/0 (socket says 172.21.15.125:35534) 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 -- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 msgr2=0x7f3fb8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 0x7f3fb8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 -- 172.21.15.125:0/1309463322 >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 msgr2=0x7f3fb80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1309463322 >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 -- 172.21.15.125:0/1309463322 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb809e6a0 con 0x7f3fb8133f50 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fb7fff700 1 --2- 172.21.15.125:0/1309463322 >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009d90 tx=0x7f3fb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f13ac6dacec93bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fb6ffd700 1 -- 172.21.15.125:0/1309463322 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000e070 con 0x7f3fb8133f50 2023-10-03T10:18:14.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fb6ffd700 1 -- 172.21.15.125:0/1309463322 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000bb20 con 0x7f3fb8133f50 2023-10-03T10:18:14.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.283+0000 7f3fb6ffd700 1 -- 172.21.15.125:0/1309463322 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0012430 con 0x7f3fb8133f50 2023-10-03T10:18:14.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 msgr2=0x7f3fb81343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009d90 tx=0x7f3fb000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1309463322 shutdown_connections 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb8133f50 0x7f3fb81343b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1309463322 >> v2:172.21.15.125:3300/0 conn(0x7f3fb80a0a70 0x7f3fb80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1309463322 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb80a1380 0x7f3fb8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1309463322 >> 172.21.15.125:0/1309463322 conn(0x7f3fb80a6610 msgr2=0x7f3fb80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1309463322 shutdown_connections 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.284+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1309463322 wait complete. 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.285+0000 7f3fbe3a4700 1 Processor -- start 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.285+0000 7f3fbe3a4700 1 -- start start 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 0x7f3fb8121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 0x7f3fb8121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8124cd0 con 0x7f3fb80a0a70 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8124eb0 con 0x7f3fb80a1380 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbe3a4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8122930 con 0x7f3fb8133f50 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fb7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 0x7f3fb8121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38044/0 (socket says 172.21.15.125:38044) 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 -- 172.21.15.125:0/1741991283 learned_addr learned my addr 172.21.15.125:0/1741991283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fb77fe700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 0x7f3fb8121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 -- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 msgr2=0x7f3fb8121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 0x7f3fb8121aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 -- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 msgr2=0x7f3fb8121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 0x7f3fb8121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fbc941700 1 -- 172.21.15.125:0/1741991283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009550 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fb7fff700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 0x7f3fb8121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.286+0000 7f3fb77fe700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 0x7f3fb8121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fbc941700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3fb809dd40 tx=0x7f3fb0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00044d0 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0020070 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0004890 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb0009a70 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb80a03e0 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.287+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fb0012430 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.288+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fb0022070 con 0x7f3fb8133f50 2023-10-03T10:18:14.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.288+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8124b10 con 0x7f3fb8133f50 2023-10-03T10:18:14.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.293+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fb8124b10 con 0x7f3fb8133f50 2023-10-03T10:18:14.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 Processor -- start 2023-10-03T10:18:14.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 -- start start 2023-10-03T10:18:14.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 0x7f971c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c09b110 con 0x7f971c0a0a70 2023-10-03T10:18:14.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0a3b60 con 0x7f971c133f70 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9720e9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1348e0 con 0x7f971c09ad40 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f9719d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 0x7f971c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f971a59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f971ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f971c0a0a70 0x7f971c0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55480/0 (socket says 172.21.15.125:55480) 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f971ad9d700 1 -- 172.21.15.125:0/4227320285 learned_addr learned my addr 172.21.15.125:0/4227320285 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.328+0000 7f971a59c700 1 --2- 172.21.15.125:0/4227320285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38048/0 (socket says 172.21.15.125:38048) 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971959a700 1 -- 172.21.15.125:0/4227320285 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188592444 0 0) 0x7f971c09b110 con 0x7f971c0a0a70 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971959a700 1 -- 172.21.15.125:0/4227320285 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97040035b0 con 0x7f971c0a0a70 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971a59c700 1 -- 172.21.15.125:0/4227320285 >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 msgr2=0x7f971c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971a59c700 1 --2- 172.21.15.125:0/4227320285 >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 0x7f971c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971a59c700 1 -- 172.21.15.125:0/4227320285 >> v1:172.21.15.125:6789/0 conn(0x7f971c0a0a70 legacy=0x7f971c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971a59c700 1 -- 172.21.15.125:0/4227320285 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0a2fa0 con 0x7f971c09ad40 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f9719d9b700 1 --2- 172.21.15.125:0/4227320285 >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 0x7f971c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971a59c700 1 --2- 172.21.15.125:0/4227320285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f970c009870 tx=0x7f970c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2ff7d465b220ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971959a700 1 -- 172.21.15.125:0/4227320285 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c011830 con 0x7f971c09ad40 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971959a700 1 -- 172.21.15.125:0/4227320285 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c011990 con 0x7f971c09ad40 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.329+0000 7f971959a700 1 -- 172.21.15.125:0/4227320285 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c011d00 con 0x7f971c09ad40 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 -- 172.21.15.125:0/4227320285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 msgr2=0x7f971c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 --2- 172.21.15.125:0/4227320285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f970c009870 tx=0x7f970c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 -- 172.21.15.125:0/4227320285 shutdown_connections 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 --2- 172.21.15.125:0/4227320285 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c09ad40 0x7f971c133a30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 --2- 172.21.15.125:0/4227320285 >> v2:172.21.15.125:3300/0 conn(0x7f971c133f70 0x7f971c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 -- 172.21.15.125:0/4227320285 >> 172.21.15.125:0/4227320285 conn(0x7f971c099c40 msgr2=0x7f971c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 -- 172.21.15.125:0/4227320285 shutdown_connections 2023-10-03T10:18:14.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.330+0000 7f9720e9d700 1 -- 172.21.15.125:0/4227320285 wait complete. 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 Processor -- start 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 -- start start 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971c133f70 0x7f971c1c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1213f0 con 0x7f971c09ad40 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c11f8f0 con 0x7f971c133f70 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9720e9d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971c132710 con 0x7f971c0a0a70 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f9719d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.331+0000 7f971a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38054/0 (socket says 172.21.15.125:38054) 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f971a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33042/0 (socket says 172.21.15.125:33042) 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 -- 172.21.15.125:0/3226952823 learned_addr learned my addr 172.21.15.125:0/3226952823 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f971ad9d700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971c133f70 0x7f971c1c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 -- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971c133f70 msgr2=0x7f971c1c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971c133f70 0x7f971c1c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 -- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 msgr2=0x7f971c1c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 -- 172.21.15.125:0/3226952823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100094a0 con 0x7f971c0a0a70 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f971a59c700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9719d9b700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f971000ebb0 tx=0x7f971000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000c850 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971000c9b0 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c0094a0 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000cd40 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.332+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c121130 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.333+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9710013470 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.333+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f971003fb40 con 0x7f971c0a0a70 2023-10-03T10:18:14.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.333+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c09c7e0 con 0x7f971c0a0a70 2023-10-03T10:18:14.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.338+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f971c09c7e0 con 0x7f971c0a0a70 2023-10-03T10:18:14.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.487+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fb8124b10 con 0x7f3fb8133f50 2023-10-03T10:18:14.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.488+0000 7f3fb4ff9700 1 -- 172.21.15.125:0/1741991283 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fb8124b10 con 0x7f3fb8133f50 2023-10-03T10:18:14.487 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 msgr2=0x7f3fb8121fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3fb809dd40 tx=0x7f3fb0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 shutdown_connections 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fb8133f50 0x7f3fb8121fe0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fb80a0a70 0x7f3fb8121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 --2- 172.21.15.125:0/1741991283 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fb80a1380 0x7f3fb8121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 >> 172.21.15.125:0/1741991283 conn(0x7f3fb80a6610 msgr2=0x7f3fb809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 shutdown_connections 2023-10-03T10:18:14.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.490+0000 7f3fbe3a4700 1 -- 172.21.15.125:0/1741991283 wait complete. 2023-10-03T10:18:14.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:14.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.530+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f971c09c7e0 con 0x7f971c0a0a70 2023-10-03T10:18:14.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.531+0000 7f970affd700 1 -- 172.21.15.125:0/3226952823 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f971c09c7e0 con 0x7f971c0a0a70 2023-10-03T10:18:14.530 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:14.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 msgr2=0x7f971c1c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f971000ebb0 tx=0x7f971000eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 shutdown_connections 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f971c133f70 0x7f971c1c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f971c09ad40 0x7f971c1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 --2- 172.21.15.125:0/3226952823 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f971c0a0a70 0x7f971c1c8950 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 >> 172.21.15.125:0/3226952823 conn(0x7f971c099c40 msgr2=0x7f971c132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 shutdown_connections 2023-10-03T10:18:14.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:14.533+0000 7f9720e9d700 1 -- 172.21.15.125:0/3226952823 wait complete. 2023-10-03T10:18:14.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:15.113 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:15.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.239+0000 7faa53412700 1 Processor -- start 2023-10-03T10:18:15.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.239+0000 7faa53412700 1 -- start start 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa53412700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa4c136960 0x7faa4c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa53412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa53412700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c06b2d0 con 0x7faa4c133ad0 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa53412700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c1345b0 con 0x7faa4c136960 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa53412700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c133610 con 0x7faa4c139280 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa4c136960 0x7faa4c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa519af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa519af700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:38062/0 (socket says 172.21.15.125:38062) 2023-10-03T10:18:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa4c136960 0x7faa4c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33056/0 (socket says 172.21.15.125:33056) 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa511ae700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faa4c133ad0 0x7faa4c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55490/0 (socket says 172.21.15.125:55490) 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa519af700 1 -- 172.21.15.125:0/3934860487 learned_addr learned my addr 172.21.15.125:0/3934860487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 -- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 msgr2=0x7faa4c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 -- 172.21.15.125:0/3934860487 >> v1:172.21.15.125:6789/0 conn(0x7faa4c133ad0 legacy=0x7faa4c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa509ad700 1 -- 172.21.15.125:0/3934860487 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c09a500 con 0x7faa4c136960 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa43fff700 1 -- 172.21.15.125:0/3934860487 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108688531 0 0) 0x7faa4c06b2d0 con 0x7faa4c133ad0 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.240+0000 7faa519af700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa509ad700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c136960 0x7faa4c138d40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7faa48009840 tx=0x7faa48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e11a7957a1a405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa43fff700 1 -- 172.21.15.125:0/3934860487 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48011830 con 0x7faa4c136960 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa43fff700 1 -- 172.21.15.125:0/3934860487 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48011990 con 0x7faa4c136960 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa43fff700 1 -- 172.21.15.125:0/3934860487 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48011d20 con 0x7faa4c136960 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 -- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c136960 msgr2=0x7faa4c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c136960 0x7faa4c138d40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7faa48009840 tx=0x7faa48009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 -- 172.21.15.125:0/3934860487 shutdown_connections 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c139280 0x7faa4c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 --2- 172.21.15.125:0/3934860487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c136960 0x7faa4c138d40 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 -- 172.21.15.125:0/3934860487 >> 172.21.15.125:0/3934860487 conn(0x7faa4c099c40 msgr2=0x7faa4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 -- 172.21.15.125:0/3934860487 shutdown_connections 2023-10-03T10:18:15.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.241+0000 7faa53412700 1 -- 172.21.15.125:0/3934860487 wait complete. 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.242+0000 7faa53412700 1 Processor -- start 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.242+0000 7faa53412700 1 -- start start 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 0x7faa4c071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 0x7faa4c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c06ec30 con 0x7faa4c133ad0 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c072200 con 0x7faa4c139280 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c1317a0 con 0x7faa4c136960 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33060/0 (socket says 172.21.15.125:33060) 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 -- 172.21.15.125:0/3008309323 learned_addr learned my addr 172.21.15.125:0/3008309323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa509ad700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 0x7faa4c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa519af700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 0x7faa4c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 -- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 msgr2=0x7faa4c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 0x7faa4c071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 -- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 msgr2=0x7faa4c071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 0x7faa4c071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 -- 172.21.15.125:0/3008309323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009b30 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa509ad700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 0x7faa4c071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa519af700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 0x7faa4c071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa511ae700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c520 tx=0x7faa3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004c80 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c004de0 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c007310 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.243+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa480094a0 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.244+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c06ee50 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.244+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa3c007470 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.244+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa3c03f370 con 0x7faa4c133ad0 2023-10-03T10:18:15.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.244+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c04f2a0 con 0x7faa4c133ad0 2023-10-03T10:18:15.248 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:15.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.249+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa3c0123b0 con 0x7faa4c133ad0 2023-10-03T10:18:15.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 Processor -- start 2023-10-03T10:18:15.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 -- start start 2023-10-03T10:18:15.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 0x7fd3880a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd388134110 0x7fd38813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38809db90 con 0x7fd3880a12f0 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38809de10 con 0x7fd388134110 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38eec4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880a2560 con 0x7fd3880a09e0 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38d461700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd388134110 0x7fd38813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd38cc60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 0x7fd3880a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd387fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd3880a12f0 0x7fd388133a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39846/0 (socket says 172.21.15.125:39846) 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.374+0000 7fd387fff700 1 -- 172.21.15.125:0/276869362 learned_addr learned my addr 172.21.15.125:0/276869362 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38d461700 1 -- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 msgr2=0x7fd3880a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38d461700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 0x7fd3880a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38d461700 1 -- 172.21.15.125:0/276869362 >> v1:172.21.15.125:6789/0 conn(0x7fd3880a12f0 legacy=0x7fd388133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd3877fe700 1 -- 172.21.15.125:0/276869362 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934965058 0 0) 0x7fd38809db90 con 0x7fd3880a12f0 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38d461700 1 -- 172.21.15.125:0/276869362 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880a1f60 con 0x7fd388134110 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38cc60700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 0x7fd3880a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38d461700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd38813bcd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b01c182d4b0eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd3877fe700 1 -- 172.21.15.125:0/276869362 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000e070 con 0x7fd388134110 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd3877fe700 1 -- 172.21.15.125:0/276869362 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000bb20 con 0x7fd388134110 2023-10-03T10:18:15.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd3877fe700 1 -- 172.21.15.125:0/276869362 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380012430 con 0x7fd388134110 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 -- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 msgr2=0x7fd38813bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd38813bcd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 -- 172.21.15.125:0/276869362 shutdown_connections 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd38813bcd0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 --2- 172.21.15.125:0/276869362 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a09e0 0x7fd3880a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 -- 172.21.15.125:0/276869362 >> 172.21.15.125:0/276869362 conn(0x7fd3880a3000 msgr2=0x7fd3880a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.375+0000 7fd38eec4700 1 -- 172.21.15.125:0/276869362 shutdown_connections 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.376+0000 7fd38eec4700 1 -- 172.21.15.125:0/276869362 wait complete. 2023-10-03T10:18:15.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.376+0000 7fd38eec4700 1 Processor -- start 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.376+0000 7fd38eec4700 1 -- start start 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3880a09e0 0x7fd3881204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388133740 con 0x7fd388134110 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38809cdc0 con 0x7fd3880a09e0 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38eec4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd388123b90 con 0x7fd3880a12f0 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd387fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57748/0 (socket says 172.21.15.125:57748) 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd387fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56030/0 (socket says 172.21.15.125:56030) 2023-10-03T10:18:15.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 -- 172.21.15.125:0/3606688900 learned_addr learned my addr 172.21.15.125:0/3606688900 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 -- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 msgr2=0x7fd3881209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 -- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3880a09e0 msgr2=0x7fd3881204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3880a09e0 0x7fd3881204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd38d461700 1 -- 172.21.15.125:0/3606688900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0094a0 con 0x7fd388134110 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.377+0000 7fd387fff700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd38d461700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fd380014040 tx=0x7fd380004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380012430 con 0x7fd388134110 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380020070 con 0x7fd388134110 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380004280 con 0x7fd388134110 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380009a70 con 0x7fd388134110 2023-10-03T10:18:15.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.378+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3881231b0 con 0x7fd388134110 2023-10-03T10:18:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.379+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3800043e0 con 0x7fd388134110 2023-10-03T10:18:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.379+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd380022070 con 0x7fd388134110 2023-10-03T10:18:15.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.379+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388121900 con 0x7fd388134110 2023-10-03T10:18:15.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.388+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd38001b400 con 0x7fd388134110 2023-10-03T10:18:15.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.450+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa4c09f0f0 con 0x7faa4c133ad0 2023-10-03T10:18:15.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.450+0000 7faa41ffb700 1 -- 172.21.15.125:0/3008309323 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa3c011360 con 0x7faa4c133ad0 2023-10-03T10:18:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:15.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.452+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 msgr2=0x7faa4c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.452+0000 7faa53412700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c520 tx=0x7faa3c00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:15.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 shutdown_connections 2023-10-03T10:18:15.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c139280 0x7faa4c071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c133ad0 0x7faa4c071150 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 --2- 172.21.15.125:0/3008309323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7faa4c136960 0x7faa4c071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 >> 172.21.15.125:0/3008309323 conn(0x7faa4c099c40 msgr2=0x7faa4c0a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 shutdown_connections 2023-10-03T10:18:15.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.453+0000 7faa53412700 1 -- 172.21.15.125:0/3008309323 wait complete. 2023-10-03T10:18:15.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:15.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:15.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:15.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.588+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd38809d630 con 0x7fd388134110 2023-10-03T10:18:15.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.588+0000 7fd3857fa700 1 -- 172.21.15.125:0/3606688900 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd38809d630 con 0x7fd388134110 2023-10-03T10:18:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 msgr2=0x7fd388120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fd380014040 tx=0x7fd380004b20 comp rx=0 tx=0).stop 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 shutdown_connections 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd388134110 0x7fd388120f20 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3880a09e0 0x7fd3881204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 --2- 172.21.15.125:0/3606688900 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd3880a12f0 0x7fd3881209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 >> 172.21.15.125:0/3606688900 conn(0x7fd3880a3000 msgr2=0x7fd38809ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 shutdown_connections 2023-10-03T10:18:15.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.590+0000 7fd38eec4700 1 -- 172.21.15.125:0/3606688900 wait complete. 2023-10-03T10:18:15.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.636+0000 7f152652d700 1 Processor -- start 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.636+0000 7f152652d700 1 -- start start 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009e870 0x7f152009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 0x7f1520134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152006ce60 con 0x7f15201341d0 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152006bec0 con 0x7f152009f180 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f152652d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152009fa00 con 0x7f152009e870 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54920/0 (socket says 172.21.15.125:54920) 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 -- 172.21.15.125:0/889335135 learned_addr learned my addr 172.21.15.125:0/889335135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f1524aca700 1 --2- 172.21.15.125:0/889335135 >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 0x7f1520134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151ffff700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009e870 0x7f152009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 -- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009e870 msgr2=0x7f152009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009e870 0x7f152009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 -- 172.21.15.125:0/889335135 >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 msgr2=0x7f1520134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 --2- 172.21.15.125:0/889335135 >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 0x7f1520134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f151f7fe700 1 -- 172.21.15.125:0/889335135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152009ad80 con 0x7f152009f180 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.637+0000 7f1524aca700 1 --2- 172.21.15.125:0/889335135 >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 0x7f1520134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f151f7fe700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1514009920 tx=0x7f1514009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d9500ccac7c36ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f151effd700 1 -- 172.21.15.125:0/889335135 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011830 con 0x7f152009f180 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f151effd700 1 -- 172.21.15.125:0/889335135 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514011990 con 0x7f152009f180 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f151effd700 1 -- 172.21.15.125:0/889335135 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011d20 con 0x7f152009f180 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 -- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 msgr2=0x7f1520133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1514009920 tx=0x7f1514009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 -- 172.21.15.125:0/889335135 shutdown_connections 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 --2- 172.21.15.125:0/889335135 >> v2:172.21.15.125:3300/0 conn(0x7f15201341d0 0x7f1520134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009e870 0x7f152009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 --2- 172.21.15.125:0/889335135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009f180 0x7f1520133c90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 -- 172.21.15.125:0/889335135 >> 172.21.15.125:0/889335135 conn(0x7f15200a4430 msgr2=0x7f15200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.638+0000 7f152652d700 1 -- 172.21.15.125:0/889335135 shutdown_connections 2023-10-03T10:18:15.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.639+0000 7f152652d700 1 -- 172.21.15.125:0/889335135 wait complete. 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.639+0000 7f152652d700 1 Processor -- start 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 -- start start 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 0x7f1520122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 0x7f1520122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520125db0 con 0x7f15201341d0 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15201338a0 con 0x7f152009e870 2023-10-03T10:18:15.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f152652d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1520125a50 con 0x7f152009f180 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 0x7f1520122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56050/0 (socket says 172.21.15.125:56050) 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151f7fe700 1 -- 172.21.15.125:0/999509867 learned_addr learned my addr 172.21.15.125:0/999509867 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151ffff700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 0x7f1520122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 -- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 msgr2=0x7f1520122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 -- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 msgr2=0x7f1520122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 0x7f1520122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f1524aca700 1 -- 172.21.15.125:0/999509867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009a70 con 0x7f15201341d0 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151f7fe700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.640+0000 7f151ffff700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 0x7f1520122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f1524aca700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 0x7f1520122ff0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f1518009e50 tx=0x7f151800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800ca90 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151800f040 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1514009550 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800ce50 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15200a17e0 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.641+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1518014480 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.642+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f151803faf0 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.642+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1520125840 con 0x7f15201341d0 2023-10-03T10:18:15.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.646+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1518012930 con 0x7f15201341d0 2023-10-03T10:18:15.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 Processor -- start 2023-10-03T10:18:15.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 -- start start 2023-10-03T10:18:15.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 0x7f26cc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc09e9d0 con 0x7f26cc0a0a70 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc09dc00 con 0x7f26cc0a1550 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26d182f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc09dec0 con 0x7f26cc139200 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 0x7f26cc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 0x7f26cc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56052/0 (socket says 172.21.15.125:56052) 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54946/0 (socket says 172.21.15.125:54946) 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26caffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f26cc0a0a70 0x7f26cc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39850/0 (socket says 172.21.15.125:39850) 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.675+0000 7f26cb7fe700 1 -- 172.21.15.125:0/2380701111 learned_addr learned my addr 172.21.15.125:0/2380701111 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26ca7fc700 1 -- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 msgr2=0x7f26cc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26ca7fc700 1 --2- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 0x7f26cc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26ca7fc700 1 -- 172.21.15.125:0/2380701111 >> v1:172.21.15.125:6789/0 conn(0x7f26cc0a0a70 legacy=0x7f26cc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26c9ffb700 1 -- 172.21.15.125:0/2380701111 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820568325 0 0) 0x7f26cc09e9d0 con 0x7f26cc0a0a70 2023-10-03T10:18:15.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26ca7fc700 1 -- 172.21.15.125:0/2380701111 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc09e6a0 con 0x7f26cc0a1550 2023-10-03T10:18:15.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26ca7fc700 1 --2- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009870 tx=0x7f26c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155f0c9d50ee959a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26c9ffb700 1 -- 172.21.15.125:0/2380701111 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011830 con 0x7f26cc0a1550 2023-10-03T10:18:15.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26c9ffb700 1 -- 172.21.15.125:0/2380701111 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0011990 con 0x7f26cc0a1550 2023-10-03T10:18:15.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26c9ffb700 1 -- 172.21.15.125:0/2380701111 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011d20 con 0x7f26cc0a1550 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26d182f700 1 -- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 msgr2=0x7f26cc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.676+0000 7f26d182f700 1 --2- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009870 tx=0x7f26c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 -- 172.21.15.125:0/2380701111 shutdown_connections 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 --2- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc139200 0x7f26cc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 --2- 172.21.15.125:0/2380701111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc138cc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 -- 172.21.15.125:0/2380701111 >> 172.21.15.125:0/2380701111 conn(0x7f26cc0a6610 msgr2=0x7f26cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 -- 172.21.15.125:0/2380701111 shutdown_connections 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 -- 172.21.15.125:0/2380701111 wait complete. 2023-10-03T10:18:15.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.677+0000 7f26d182f700 1 Processor -- start 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 -- start start 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc0a0a70 0x7f26cc11e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26cc139200 0x7f26cc11f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc133fc0 con 0x7f26cc139200 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc1345a0 con 0x7f26cc0a1550 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26d182f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc120b20 con 0x7f26cc0a0a70 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26caffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc0a0a70 0x7f26cc11e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26ca7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54960/0 (socket says 172.21.15.125:54960) 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26ca7fc700 1 -- 172.21.15.125:0/1108140055 learned_addr learned my addr 172.21.15.125:0/1108140055 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.678+0000 7f26cb7fe700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26cc139200 0x7f26cc11f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 -- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc0a0a70 msgr2=0x7f26cc11e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc0a0a70 0x7f26cc11e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 -- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26cc139200 msgr2=0x7f26cc11f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26cc139200 0x7f26cc11f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 -- 172.21.15.125:0/1108140055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00094a0 con 0x7f26cc0a1550 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26ca7fc700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26c00090b0 tx=0x7f26c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004510 con 0x7f26cc0a1550 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c001f070 con 0x7f26cc0a1550 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc1221d0 con 0x7f26cc0a1550 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00038e0 con 0x7f26cc0a1550 2023-10-03T10:18:15.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.679+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0a03e0 con 0x7f26cc0a1550 2023-10-03T10:18:15.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.680+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26c0003a40 con 0x7f26cc0a1550 2023-10-03T10:18:15.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.680+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26c0021070 con 0x7f26cc0a1550 2023-10-03T10:18:15.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.680+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc04f2a0 con 0x7f26cc0a1550 2023-10-03T10:18:15.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.685+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26c0015080 con 0x7f26cc0a1550 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.842+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f152004f2a0 con 0x7f15201341d0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.842+0000 7f151cff9700 1 -- 172.21.15.125:0/999509867 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1518012340 con 0x7f15201341d0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.844+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 msgr2=0x7f1520122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 0x7f1520122ff0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f1518009e50 tx=0x7f151800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 shutdown_connections 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15201341d0 0x7f1520122ff0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f152009e870 0x7f1520122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 --2- 172.21.15.125:0/999509867 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f152009f180 0x7f1520122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 >> 172.21.15.125:0/999509867 conn(0x7f15200a4430 msgr2=0x7f1520071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 shutdown_connections 2023-10-03T10:18:15.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.845+0000 7f152652d700 1 -- 172.21.15.125:0/999509867 wait complete. 2023-10-03T10:18:15.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:15.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.877+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26cc072980 con 0x7f26cc0a1550 2023-10-03T10:18:15.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.877+0000 7f26b3fff700 1 -- 172.21.15.125:0/1108140055 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26c0035090 con 0x7f26cc0a1550 2023-10-03T10:18:15.877 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 msgr2=0x7f26cc11ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26c00090b0 tx=0x7f26c0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 shutdown_connections 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26cc139200 0x7f26cc11f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f26cc0a0a70 0x7f26cc11e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 --2- 172.21.15.125:0/1108140055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26cc0a1550 0x7f26cc11ecd0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 >> 172.21.15.125:0/1108140055 conn(0x7f26cc0a6610 msgr2=0x7f26cc09a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 shutdown_connections 2023-10-03T10:18:15.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:15.879+0000 7f26d182f700 1 -- 172.21.15.125:0/1108140055 wait complete. 2023-10-03T10:18:15.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:16.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 Processor -- start 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 -- start start 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2809fa00 con 0x7f7e2809e870 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e280a0370 con 0x7f7e281393a0 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.591+0000 7f7e2dec3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2806bec0 con 0x7f7e2809f350 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e27fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e27fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57780/0 (socket says 172.21.15.125:57780) 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56072/0 (socket says 172.21.15.125:56072) 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e277fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7e2809e870 0x7f7e2809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39862/0 (socket says 172.21.15.125:39862) 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e27fff700 1 -- 172.21.15.125:0/4281112146 learned_addr learned my addr 172.21.15.125:0/4281112146 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 -- 172.21.15.125:0/4281112146 >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 msgr2=0x7f7e2813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 --2- 172.21.15.125:0/4281112146 >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 -- 172.21.15.125:0/4281112146 >> v1:172.21.15.125:6789/0 conn(0x7f7e2809e870 legacy=0x7f7e2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 -- 172.21.15.125:0/4281112146 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2809ada0 con 0x7f7e2809f350 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e27fff700 1 --2- 172.21.15.125:0/4281112146 >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e26ffd700 1 --2- 172.21.15.125:0/4281112146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009d90 tx=0x7f7e1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79b95db10ab1b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e267fc700 1 -- 172.21.15.125:0/4281112146 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800e070 con 0x7f7e2809f350 2023-10-03T10:18:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e267fc700 1 -- 172.21.15.125:0/4281112146 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800bb20 con 0x7f7e2809f350 2023-10-03T10:18:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.592+0000 7f7e267fc700 1 -- 172.21.15.125:0/4281112146 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18012430 con 0x7f7e2809f350 2023-10-03T10:18:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 -- 172.21.15.125:0/4281112146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 msgr2=0x7f7e28138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/4281112146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009d90 tx=0x7f7e1800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 -- 172.21.15.125:0/4281112146 shutdown_connections 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/4281112146 >> v2:172.21.15.125:3300/0 conn(0x7f7e281393a0 0x7f7e2813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/4281112146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e28138e60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 -- 172.21.15.125:0/4281112146 >> 172.21.15.125:0/4281112146 conn(0x7f7e280a4430 msgr2=0x7f7e280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 -- 172.21.15.125:0/4281112146 shutdown_connections 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.593+0000 7f7e2dec3700 1 -- 172.21.15.125:0/4281112146 wait complete. 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.594+0000 7f7e2dec3700 1 Processor -- start 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.594+0000 7f7e2dec3700 1 -- start start 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e2811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 0x7f7e2811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28134350 con 0x7f7e281393a0 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28122280 con 0x7f7e2809e870 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e2dec3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2806cfa0 con 0x7f7e2809f350 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e2811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54966/0 (socket says 172.21.15.125:54966) 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e27fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 0x7f7e2811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 -- 172.21.15.125:0/3733639236 learned_addr learned my addr 172.21.15.125:0/3733639236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 -- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 msgr2=0x7f7e2811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e2811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 -- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 msgr2=0x7f7e2811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 0x7f7e2811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 -- 172.21.15.125:0/3733639236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20009550 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e26ffd700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e2811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e27fff700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 0x7f7e2811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e277fe700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c530 tx=0x7f7e1c00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00cea0 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c005cb0 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.595+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0072d0 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.596+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e18009a70 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.596+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e28120760 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.596+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e1c007430 con 0x7f7e2809e870 2023-10-03T10:18:16.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.596+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e1c03e9c0 con 0x7f7e2809e870 2023-10-03T10:18:16.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.597+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e28120ea0 con 0x7f7e2809e870 2023-10-03T10:18:16.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.601+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e1c017080 con 0x7f7e2809e870 2023-10-03T10:18:16.609 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.731+0000 7f14141c0700 1 Processor -- start 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.731+0000 7f14141c0700 1 -- start start 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f14141c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f14141c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f140c133f70 0x7f140c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f14141c0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c09b110 con 0x7f140c0a0a70 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f14141c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0a3b60 con 0x7f140c133f70 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f14141c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1348e0 con 0x7f140c09ad40 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f1411f5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f140c133f70 0x7f140c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f140c133f70 0x7f140c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57802/0 (socket says 172.21.15.125:57802) 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f1411f5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56094/0 (socket says 172.21.15.125:56094) 2023-10-03T10:18:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 -- 172.21.15.125:0/1247496857 learned_addr learned my addr 172.21.15.125:0/1247496857 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141275d700 1 --1- 172.21.15.125:0/1247496857 >> v1:172.21.15.125:6789/0 conn(0x7f140c0a0a70 0x7f140c0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39864/0 (socket says 172.21.15.125:39864) 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 -- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 msgr2=0x7f140c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 -- 172.21.15.125:0/1247496857 >> v1:172.21.15.125:6789/0 conn(0x7f140c0a0a70 legacy=0x7f140c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f141175b700 1 -- 172.21.15.125:0/1247496857 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0a2fa0 con 0x7f140c133f70 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.732+0000 7f1411f5c700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f141175b700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c1343a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0098f0 tx=0x7f13fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c135a2484ba2118 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f1410f5a700 1 -- 172.21.15.125:0/1247496857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011830 con 0x7f140c133f70 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f1410f5a700 1 -- 172.21.15.125:0/1247496857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc011990 con 0x7f140c133f70 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f1410f5a700 1 -- 172.21.15.125:0/1247496857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011d20 con 0x7f140c133f70 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 -- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 msgr2=0x7f140c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c1343a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0098f0 tx=0x7f13fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 -- 172.21.15.125:0/1247496857 shutdown_connections 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c09ad40 0x7f140c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 --2- 172.21.15.125:0/1247496857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c1343a0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 -- 172.21.15.125:0/1247496857 >> 172.21.15.125:0/1247496857 conn(0x7f140c099c40 msgr2=0x7f140c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 -- 172.21.15.125:0/1247496857 shutdown_connections 2023-10-03T10:18:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.733+0000 7f14141c0700 1 -- 172.21.15.125:0/1247496857 wait complete. 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.734+0000 7f14141c0700 1 Processor -- start 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.734+0000 7f14141c0700 1 -- start start 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 0x7f140c11e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c0a0a70 0x7f140c11e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c122530 con 0x7f140c133f70 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c11fc60 con 0x7f140c09ad40 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f140c120280 con 0x7f140c0a0a70 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f141275d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 0x7f140c11e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f141175b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c0a0a70 0x7f140c11e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f141275d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57804/0 (socket says 172.21.15.125:57804) 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f141275d700 1 -- 172.21.15.125:0/2800233486 learned_addr learned my addr 172.21.15.125:0/2800233486 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 -- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c0a0a70 msgr2=0x7f140c11e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c0a0a70 0x7f140c11e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 -- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 msgr2=0x7f140c11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 -- 172.21.15.125:0/2800233486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080094a0 con 0x7f140c09ad40 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f141275d700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f1411f5c700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 0x7f140c11e050 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f140800e930 tx=0x7f140800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408013680 con 0x7f140c09ad40 2023-10-03T10:18:16.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14080137e0 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408013b90 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc009550 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.735+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c0a0eb0 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.737+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c09ed10 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.737+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1408013cf0 con 0x7f140c09ad40 2023-10-03T10:18:16.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.737+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f140803fdb0 con 0x7f140c09ad40 2023-10-03T10:18:16.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.741+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1408024350 con 0x7f140c09ad40 2023-10-03T10:18:16.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.796+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e2804f2a0 con 0x7f7e2809e870 2023-10-03T10:18:16.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.796+0000 7f7e0ffff700 1 -- 172.21.15.125:0/3733639236 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e1c0076e0 con 0x7f7e2809e870 2023-10-03T10:18:16.796 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:16.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 msgr2=0x7f7e2811ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c530 tx=0x7f7e1c00c840 comp rx=0 tx=0).stop 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 shutdown_connections 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e281393a0 0x7f7e2811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e2809e870 0x7f7e2811ead0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 --2- 172.21.15.125:0/3733639236 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e2809f350 0x7f7e2811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.799+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 >> 172.21.15.125:0/3733639236 conn(0x7f7e280a4430 msgr2=0x7f7e280a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.800+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 shutdown_connections 2023-10-03T10:18:16.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.800+0000 7f7e2dec3700 1 -- 172.21.15.125:0/3733639236 wait complete. 2023-10-03T10:18:16.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:16.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:16.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.939+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f140c09c7e0 con 0x7f140c09ad40 2023-10-03T10:18:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.939+0000 7f14027fc700 1 -- 172.21.15.125:0/2800233486 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1408017070 con 0x7f140c09ad40 2023-10-03T10:18:16.939 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 msgr2=0x7f140c11e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 0x7f140c11e050 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f140800e930 tx=0x7f140800ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 shutdown_connections 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c133f70 0x7f140c11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f140c09ad40 0x7f140c11e050 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 --2- 172.21.15.125:0/2800233486 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f140c0a0a70 0x7f140c11e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 >> 172.21.15.125:0/2800233486 conn(0x7f140c099c40 msgr2=0x7f140c1330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 shutdown_connections 2023-10-03T10:18:16.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.941+0000 7f14141c0700 1 -- 172.21.15.125:0/2800233486 wait complete. 2023-10-03T10:18:16.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:16.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.985+0000 7fbc025b3700 1 Processor -- start 2023-10-03T10:18:16.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.985+0000 7fbc025b3700 1 -- start start 2023-10-03T10:18:16.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc025b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc025b3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbfc1343a0 0x7fbbfc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc025b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc09b110 con 0x7fbbfc133f70 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc025b3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0a3b60 con 0x7fbbfc1343a0 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc025b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0a2fa0 con 0x7fbbfc09ad40 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbfc1343a0 0x7fbbfc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbbfc133f70 0x7fbbfc0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39866/0 (socket says 172.21.15.125:39866) 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbfc1343a0 0x7fbbfc0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57812/0 (socket says 172.21.15.125:57812) 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56116/0 (socket says 172.21.15.125:56116) 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfb7fe700 1 -- 172.21.15.125:0/3701709261 learned_addr learned my addr 172.21.15.125:0/3701709261 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:16.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 -- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 msgr2=0x7fbbfc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 -- 172.21.15.125:0/3701709261 >> v1:172.21.15.125:6789/0 conn(0x7fbbfc133f70 legacy=0x7fbbfc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 -- 172.21.15.125:0/3701709261 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc09a280 con 0x7fbbfc1343a0 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfbfff700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfaffd700 1 -- 172.21.15.125:0/3701709261 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503455983 0 0) 0x7fbbfc09b110 con 0x7fbbfc133f70 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbc00b50700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc1343a0 0x7fbbfc0a1180 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009d90 tx=0x7fbbf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76ef01f0af4b36e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.986+0000 7fbbfaffd700 1 -- 172.21.15.125:0/3701709261 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400e070 con 0x7fbbfc1343a0 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbbfaffd700 1 -- 172.21.15.125:0/3701709261 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400bb20 con 0x7fbbfc1343a0 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbbfaffd700 1 -- 172.21.15.125:0/3701709261 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4012430 con 0x7fbbfc1343a0 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 -- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc1343a0 msgr2=0x7fbbfc0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc1343a0 0x7fbbfc0a1180 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009d90 tx=0x7fbbf400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 -- 172.21.15.125:0/3701709261 shutdown_connections 2023-10-03T10:18:16.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc1343a0 0x7fbbfc0a1180 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 --2- 172.21.15.125:0/3701709261 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc09ad40 0x7fbbfc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 -- 172.21.15.125:0/3701709261 >> 172.21.15.125:0/3701709261 conn(0x7fbbfc099c40 msgr2=0x7fbbfc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 -- 172.21.15.125:0/3701709261 shutdown_connections 2023-10-03T10:18:16.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.987+0000 7fbc025b3700 1 -- 172.21.15.125:0/3701709261 wait complete. 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.988+0000 7fbc025b3700 1 Processor -- start 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.988+0000 7fbc025b3700 1 -- start start 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 0x7fbbfc1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 0x7fbbfc1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc11efd0 con 0x7fbbfc09ad40 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc120730 con 0x7fbbfc1343a0 2023-10-03T10:18:16.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc025b3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc122740 con 0x7fbbfc133f70 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc00b50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 0x7fbbfc1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc00b50700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 0x7fbbfc1c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54994/0 (socket says 172.21.15.125:54994) 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56122/0 (socket says 172.21.15.125:56122) 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbc00b50700 1 -- 172.21.15.125:0/1050997945 learned_addr learned my addr 172.21.15.125:0/1050997945 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfbfff700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 0x7fbbfc1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 -- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 msgr2=0x7fbbfc1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 0x7fbbfc1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 -- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 msgr2=0x7fbbfc1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 0x7fbbfc1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 -- 172.21.15.125:0/1050997945 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0094a0 con 0x7fbbfc133f70 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfbfff700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 0x7fbbfc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbfb7fe700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000c470 tx=0x7fbbf000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0004c80 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.989+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf0004de0 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf4009a70 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0007310 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc120f20 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbf0007470 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbbf003f1c0 con 0x7fbbfc133f70 2023-10-03T10:18:16.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.990+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc122580 con 0x7fbbfc133f70 2023-10-03T10:18:16.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:16.995+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbfc122580 con 0x7fbbfc133f70 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 Processor -- start 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 -- start start 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 0x7f39881395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398809c970 con 0x7f398809e870 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880a0920 con 0x7f39881371c0 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.040+0000 7f398e4c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398809f9c0 con 0x7f398809f350 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f398ca65700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 0x7f39881395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f3987fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f398809e870 0x7f398809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39870/0 (socket says 172.21.15.125:39870) 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55008/0 (socket says 172.21.15.125:55008) 2023-10-03T10:18:17.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f3987fff700 1 -- 172.21.15.125:0/1145096080 learned_addr learned my addr 172.21.15.125:0/1145096080 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 -- 172.21.15.125:0/1145096080 >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 msgr2=0x7f39881395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 --2- 172.21.15.125:0/1145096080 >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 0x7f39881395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 -- 172.21.15.125:0/1145096080 >> v1:172.21.15.125:6789/0 conn(0x7f398809e870 legacy=0x7f398809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 -- 172.21.15.125:0/1145096080 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398809bab0 con 0x7f398809f350 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f398ca65700 1 --2- 172.21.15.125:0/1145096080 >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 0x7f39881395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f39877fe700 1 --2- 172.21.15.125:0/1145096080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f397c009840 tx=0x7f397c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=536845b677d1e668 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f3986ffd700 1 -- 172.21.15.125:0/1145096080 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011830 con 0x7f398809f350 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f3986ffd700 1 -- 172.21.15.125:0/1145096080 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c011990 con 0x7f398809f350 2023-10-03T10:18:17.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.041+0000 7f3986ffd700 1 -- 172.21.15.125:0/1145096080 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011d20 con 0x7f398809f350 2023-10-03T10:18:17.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 -- 172.21.15.125:0/1145096080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 msgr2=0x7f3988136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 --2- 172.21.15.125:0/1145096080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f397c009840 tx=0x7f397c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 -- 172.21.15.125:0/1145096080 shutdown_connections 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 --2- 172.21.15.125:0/1145096080 >> v2:172.21.15.125:3300/0 conn(0x7f39881371c0 0x7f39881395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 --2- 172.21.15.125:0/1145096080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398809f350 0x7f3988136c80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 -- 172.21.15.125:0/1145096080 >> 172.21.15.125:0/1145096080 conn(0x7f39880a4430 msgr2=0x7f39880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 -- 172.21.15.125:0/1145096080 shutdown_connections 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.042+0000 7f398e4c8700 1 -- 172.21.15.125:0/1145096080 wait complete. 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.043+0000 7f398e4c8700 1 Processor -- start 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.043+0000 7f398e4c8700 1 -- start start 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 0x7f39881209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f398809f350 0x7f3988120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988122550 con 0x7f398809e870 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988122b70 con 0x7f39881371c0 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398e4c8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398809dc10 con 0x7f398809f350 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398ca65700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f3987fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 0x7f39881209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398ca65700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55024/0 (socket says 172.21.15.125:55024) 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.044+0000 7f398ca65700 1 -- 172.21.15.125:0/2016567927 learned_addr learned my addr 172.21.15.125:0/2016567927 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 -- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f398809f350 msgr2=0x7f3988120f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f398809f350 0x7f3988120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 -- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 msgr2=0x7f39881209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 0x7f39881209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 -- 172.21.15.125:0/2016567927 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009a70 con 0x7f39881371c0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f3987fff700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 0x7f39881209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398ca65700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f398000efc0 tx=0x7f398000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000cce0 con 0x7f39881371c0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000f040 con 0x7f39881371c0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800146c0 con 0x7f39881371c0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c0094a0 con 0x7f39881371c0 2023-10-03T10:18:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.045+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3988123ec0 con 0x7f39881371c0 2023-10-03T10:18:17.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.046+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3980014820 con 0x7f39881371c0 2023-10-03T10:18:17.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.046+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398804f2a0 con 0x7f39881371c0 2023-10-03T10:18:17.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.046+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39800405a0 con 0x7f39881371c0 2023-10-03T10:18:17.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.050+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3980012700 con 0x7f39881371c0 2023-10-03T10:18:17.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.204+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbbfc122580 con 0x7fbbfc133f70 2023-10-03T10:18:17.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.204+0000 7fbbf8ff9700 1 -- 172.21.15.125:0/1050997945 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbfc122580 con 0x7fbbfc133f70 2023-10-03T10:18:17.204 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 msgr2=0x7fbbfc1c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000c470 tx=0x7fbbf000c780 comp rx=0 tx=0).stop 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 shutdown_connections 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbfc1343a0 0x7fbbfc1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbfc09ad40 0x7fbbfc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 --2- 172.21.15.125:0/1050997945 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbbfc133f70 0x7fbbfc1c8660 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 >> 172.21.15.125:0/1050997945 conn(0x7fbbfc099c40 msgr2=0x7fbbfc1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 shutdown_connections 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.206+0000 7fbc025b3700 1 -- 172.21.15.125:0/1050997945 wait complete. 2023-10-03T10:18:17.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.243+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3988122d40 con 0x7f39881371c0 2023-10-03T10:18:17.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.243+0000 7f3984ff9700 1 -- 172.21.15.125:0/2016567927 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3980012b60 con 0x7f39881371c0 2023-10-03T10:18:17.243 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 msgr2=0x7f3988121460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f398000efc0 tx=0x7f398000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 shutdown_connections 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39881371c0 0x7f3988121460 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398809e870 0x7f39881209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 --2- 172.21.15.125:0/2016567927 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f398809f350 0x7f3988120f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 >> 172.21.15.125:0/2016567927 conn(0x7f39880a4430 msgr2=0x7f39880a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 shutdown_connections 2023-10-03T10:18:17.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.245+0000 7f398e4c8700 1 -- 172.21.15.125:0/2016567927 wait complete. 2023-10-03T10:18:17.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:17.812 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:17.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 Processor -- start 2023-10-03T10:18:17.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 -- start start 2023-10-03T10:18:17.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae8133900 0x7fbae8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae809a760 con 0x7fbae80a0ee0 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae81336e0 con 0x7fbae8133900 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeec69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae809a080 con 0x7fbae8134210 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbaeca05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae8133900 0x7fbae8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.937+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbae8133900 0x7fbae8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57842/0 (socket says 172.21.15.125:57842) 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaed206700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbae80a0ee0 0x7fbae813a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39884/0 (socket says 172.21.15.125:39884) 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56130/0 (socket says 172.21.15.125:56130) 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 -- 172.21.15.125:0/1583285041 learned_addr learned my addr 172.21.15.125:0/1583285041 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 -- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 msgr2=0x7fbae80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 -- 172.21.15.125:0/1583285041 >> v1:172.21.15.125:6789/0 conn(0x7fbae80a0ee0 legacy=0x7fbae813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 -- 172.21.15.125:0/1583285041 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80a23e0 con 0x7fbae8133900 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae7fff700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae77fe700 1 -- 172.21.15.125:0/1583285041 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262338643 0 0) 0x7fbae809a760 con 0x7fbae80a0ee0 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbaeca05700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133900 0x7fbae8133cd0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbadc006fd0 tx=0x7fbadc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb61863f12106a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae77fe700 1 -- 172.21.15.125:0/1583285041 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc005e30 con 0x7fbae8133900 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae77fe700 1 -- 172.21.15.125:0/1583285041 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc004030 con 0x7fbae8133900 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.938+0000 7fbae77fe700 1 -- 172.21.15.125:0/1583285041 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0043e0 con 0x7fbae8133900 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 -- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133900 msgr2=0x7fbae8133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133900 0x7fbae8133cd0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbadc006fd0 tx=0x7fbadc009bd0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 -- 172.21.15.125:0/1583285041 shutdown_connections 2023-10-03T10:18:17.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8133900 0x7fbae8133cd0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 --2- 172.21.15.125:0/1583285041 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae8134210 0x7fbae80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 -- 172.21.15.125:0/1583285041 >> 172.21.15.125:0/1583285041 conn(0x7fbae80a2980 msgr2=0x7fbae80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 -- 172.21.15.125:0/1583285041 shutdown_connections 2023-10-03T10:18:17.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.939+0000 7fbaeec69700 1 -- 172.21.15.125:0/1583285041 wait complete. 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 Processor -- start 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 -- start start 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae8133900 0x7fbae811baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 0x7fbae811c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae811eed0 con 0x7fbae8134210 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae811fa90 con 0x7fbae8133900 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeec69700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae811f0d0 con 0x7fbae80a0ee0 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeca05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeca05700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56136/0 (socket says 172.21.15.125:56136) 2023-10-03T10:18:17.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae8133900 0x7fbae811baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaeca05700 1 -- 172.21.15.125:0/4103212 learned_addr learned my addr 172.21.15.125:0/4103212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.940+0000 7fbaed206700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 0x7fbae811c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 -- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae8133900 msgr2=0x7fbae811baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae8133900 0x7fbae811baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 -- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 msgr2=0x7fbae811c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 0x7fbae811c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 -- 172.21.15.125:0/4103212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40094a0 con 0x7fbae80a0ee0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaed206700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 0x7fbae811c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeca05700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbae8133820 tx=0x7fbadc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc003c30 con 0x7fbae80a0ee0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc003d90 con 0x7fbae80a0ee0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc009500 con 0x7fbae80a0ee0 2023-10-03T10:18:17.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc01c640 con 0x7fbae80a0ee0 2023-10-03T10:18:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.941+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae811e480 con 0x7fbae80a0ee0 2023-10-03T10:18:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.942+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbadc01c7a0 con 0x7fbae80a0ee0 2023-10-03T10:18:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.942+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbadc0405d0 con 0x7fbae80a0ee0 2023-10-03T10:18:17.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.942+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae809f570 con 0x7fbae80a0ee0 2023-10-03T10:18:17.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:17.946+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbadc016070 con 0x7fbae80a0ee0 2023-10-03T10:18:17.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.078+0000 7f3d2e2c5700 1 Processor -- start 2023-10-03T10:18:18.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.078+0000 7f3d2e2c5700 1 -- start start 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d2809f180 0x7f3d28131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d280a0920 con 0x7f3d2809f180 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2809c970 con 0x7f3d28131d70 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2e2c5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2809bab0 con 0x7f3d2809e870 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d27fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2c862700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d277fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d2809f180 0x7f3d28131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d27fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56140/0 (socket says 172.21.15.125:56140) 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d2c862700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55048/0 (socket says 172.21.15.125:55048) 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.079+0000 7f3d27fff700 1 -- 172.21.15.125:0/3636405727 learned_addr learned my addr 172.21.15.125:0/3636405727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 -- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 msgr2=0x7f3d2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 -- 172.21.15.125:0/3636405727 >> v2:172.21.15.125:3300/0 conn(0x7f3d2809f180 msgr2=0x7f3d28131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 --2- 172.21.15.125:0/3636405727 >> v2:172.21.15.125:3300/0 conn(0x7f3d2809f180 0x7f3d28131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 -- 172.21.15.125:0/3636405727 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2809f9c0 con 0x7f3d28131d70 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d27fff700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2c862700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009dc0 tx=0x7f3d2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea712e3c2f63d3f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d26ffd700 1 -- 172.21.15.125:0/3636405727 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000e070 con 0x7f3d28131d70 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d26ffd700 1 -- 172.21.15.125:0/3636405727 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000bae0 con 0x7f3d28131d70 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d26ffd700 1 -- 172.21.15.125:0/3636405727 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000be90 con 0x7f3d28131d70 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 msgr2=0x7f3d28132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009dc0 tx=0x7f3d2000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/3636405727 shutdown_connections 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d28132210 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.080+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/3636405727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809e870 0x7f3d2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.081+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/3636405727 >> v2:172.21.15.125:3300/0 conn(0x7f3d2809f180 0x7f3d28131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.081+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/3636405727 >> 172.21.15.125:0/3636405727 conn(0x7f3d280a4430 msgr2=0x7f3d280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.081+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/3636405727 shutdown_connections 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.081+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/3636405727 wait complete. 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.082+0000 7f3d2e2c5700 1 Processor -- start 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.082+0000 7f3d2e2c5700 1 -- start start 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.082+0000 7f3d2e2c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d2809e870 0x7f3d2811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.082+0000 7f3d2e2c5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d2811fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28120ca0 con 0x7f3d2809e870 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28121b30 con 0x7f3d28131d70 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28122610 con 0x7f3d2809f180 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56146/0 (socket says 172.21.15.125:56146) 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 -- 172.21.15.125:0/159258577 learned_addr learned my addr 172.21.15.125:0/159258577 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d27fff700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d2809e870 0x7f3d2811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2c862700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d2811fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 -- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 msgr2=0x7f3d2811fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d2811fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 -- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d2809e870 msgr2=0x7f3d2811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d2809e870 0x7f3d2811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 -- 172.21.15.125:0/159258577 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18009550 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d277fe700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00e980 tx=0x7f3d1c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c009710 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00c640 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d20009a70 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00c9b0 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.083+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d280a0210 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.084+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d1c00cb10 con 0x7f3d2809f180 2023-10-03T10:18:18.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.084+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2804f2a0 con 0x7f3d2809f180 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.084+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d1c03f9f0 con 0x7f3d2809f180 2023-10-03T10:18:18.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.089+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d1c01b3b0 con 0x7f3d2809f180 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.140+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbae809a2c0 con 0x7fbae80a0ee0 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.140+0000 7fbae57fa700 1 -- 172.21.15.125:0/4103212 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbadc011420 con 0x7fbae80a0ee0 2023-10-03T10:18:18.140 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 msgr2=0x7fbae811b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbae8133820 tx=0x7fbadc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 shutdown_connections 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbae8134210 0x7fbae811c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbae80a0ee0 0x7fbae811b5b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 --2- 172.21.15.125:0/4103212 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbae8133900 0x7fbae811baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 >> 172.21.15.125:0/4103212 conn(0x7fbae80a2980 msgr2=0x7fbae8130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 shutdown_connections 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.142+0000 7fbaeec69700 1 -- 172.21.15.125:0/4103212 wait complete. 2023-10-03T10:18:18.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:18.218 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:18.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:18.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.286+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d2809f660 con 0x7f3d2809f180 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.286+0000 7f3d24ff9700 1 -- 172.21.15.125:0/159258577 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d1c021030 con 0x7f3d2809f180 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:18.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 msgr2=0x7f3d2811f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00e980 tx=0x7f3d1c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 shutdown_connections 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d28131d70 0x7f3d2811fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d2809e870 0x7f3d2811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 --2- 172.21.15.125:0/159258577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3d2809f180 0x7f3d2811f620 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.289+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 >> 172.21.15.125:0/159258577 conn(0x7f3d280a4430 msgr2=0x7f3d2809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.290+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 shutdown_connections 2023-10-03T10:18:18.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.290+0000 7f3d2e2c5700 1 -- 172.21.15.125:0/159258577 wait complete. 2023-10-03T10:18:18.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:18.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.348+0000 7f9c3550b700 1 Processor -- start 2023-10-03T10:18:18.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.348+0000 7f9c3550b700 1 -- start start 2023-10-03T10:18:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009e870 0x7f9c3009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c30131d70 0x7f9c30132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300a0920 con 0x7f9c30131d70 2023-10-03T10:18:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3009c970 con 0x7f9c3009f180 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c3550b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3009bab0 con 0x7f9c3009e870 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9c30131d70 0x7f9c30132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2effd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009e870 0x7f9c3009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2e7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55064/0 (socket says 172.21.15.125:55064) 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2e7fc700 1 -- 172.21.15.125:0/499856873 learned_addr learned my addr 172.21.15.125:0/499856873 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 -- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009e870 msgr2=0x7f9c3009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009e870 0x7f9c3009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 -- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 msgr2=0x7f9c30131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 -- 172.21.15.125:0/499856873 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3009f9c0 con 0x7f9c30131d70 2023-10-03T10:18:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2e7fc700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2f7fe700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c30132210 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009d90 tx=0x7f9c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2769bc387fe1fd8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2dffb700 1 -- 172.21.15.125:0/499856873 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800e070 con 0x7f9c30131d70 2023-10-03T10:18:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2dffb700 1 -- 172.21.15.125:0/499856873 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2800bb20 con 0x7f9c30131d70 2023-10-03T10:18:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.349+0000 7f9c2dffb700 1 -- 172.21.15.125:0/499856873 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28012430 con 0x7f9c30131d70 2023-10-03T10:18:18.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 -- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 msgr2=0x7f9c30132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c30132210 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009d90 tx=0x7f9c2800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:18.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 -- 172.21.15.125:0/499856873 shutdown_connections 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c30132210 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009e870 0x7f9c3009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 --2- 172.21.15.125:0/499856873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009f180 0x7f9c30131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 -- 172.21.15.125:0/499856873 >> 172.21.15.125:0/499856873 conn(0x7f9c300a4430 msgr2=0x7f9c300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 -- 172.21.15.125:0/499856873 shutdown_connections 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.350+0000 7f9c3550b700 1 -- 172.21.15.125:0/499856873 wait complete. 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 Processor -- start 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 -- start start 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 0x7f9c301c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3011e6d0 con 0x7f9c30131d70 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3011e4e0 con 0x7f9c3009e870 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.352+0000 7f9c3550b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301203f0 con 0x7f9c3009f180 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56168/0 (socket says 172.21.15.125:56168) 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57902/0 (socket says 172.21.15.125:57902) 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 -- 172.21.15.125:0/3809891348 learned_addr learned my addr 172.21.15.125:0/3809891348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2effd700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 0x7f9c301c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 -- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 msgr2=0x7f9c301c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 0x7f9c301c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 -- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 msgr2=0x7f9c301c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 -- 172.21.15.125:0/3809891348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24009550 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2f7fe700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2effd700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 0x7f9c301c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c2e7fc700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400ebe0 tx=0x7f9c2400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400c850 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2400c9b0 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c28009a70 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400cd60 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.353+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30120110 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.354+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c24013470 con 0x7f9c3009f180 2023-10-03T10:18:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.354+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c2403f780 con 0x7f9c3009f180 2023-10-03T10:18:18.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.355+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3004f2a0 con 0x7f9c3009f180 2023-10-03T10:18:18.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.359+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c240232f0 con 0x7f9c3009f180 2023-10-03T10:18:18.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 Processor -- start 2023-10-03T10:18:18.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 -- start start 2023-10-03T10:18:18.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f809e9d0 con 0x7fe5f80a0a70 2023-10-03T10:18:18.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f809dc00 con 0x7fe5f8139200 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5ff16a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f809dec0 con 0x7fe5f80a1550 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5fd707700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56176/0 (socket says 172.21.15.125:56176) 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5fd707700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55080/0 (socket says 172.21.15.125:55080) 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5f7fff700 1 -- 172.21.15.125:0/2162469407 learned_addr learned my addr 172.21.15.125:0/2162469407 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.392+0000 7fe5fcf06700 1 --1- 172.21.15.125:0/2162469407 >> v1:172.21.15.125:6789/0 conn(0x7fe5f80a0a70 0x7fe5f80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39900/0 (socket says 172.21.15.125:39900) 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5fd707700 1 -- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 msgr2=0x7fe5f8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5f77fe700 1 -- 172.21.15.125:0/2162469407 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478591951 0 0) 0x7fe5f809e9d0 con 0x7fe5f80a0a70 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5fd707700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5fd707700 1 -- 172.21.15.125:0/2162469407 >> v1:172.21.15.125:6789/0 conn(0x7fe5f80a0a70 legacy=0x7fe5f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5fd707700 1 -- 172.21.15.125:0/2162469407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f809e6a0 con 0x7fe5f8139200 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5fd707700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009dc0 tx=0x7fe5f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c408780affe3adc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5f77fe700 1 -- 172.21.15.125:0/2162469407 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000e070 con 0x7fe5f8139200 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5f77fe700 1 -- 172.21.15.125:0/2162469407 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000bb20 con 0x7fe5f8139200 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5f77fe700 1 -- 172.21.15.125:0/2162469407 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0012430 con 0x7fe5f8139200 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5ff16a700 1 -- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 msgr2=0x7fe5f813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.393+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009dc0 tx=0x7fe5f000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 -- 172.21.15.125:0/2162469407 shutdown_connections 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f8139200 0x7fe5f813b5e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/2162469407 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f80a1550 0x7fe5f8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 -- 172.21.15.125:0/2162469407 >> 172.21.15.125:0/2162469407 conn(0x7fe5f80a6610 msgr2=0x7fe5f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 -- 172.21.15.125:0/2162469407 shutdown_connections 2023-10-03T10:18:18.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.394+0000 7fe5ff16a700 1 -- 172.21.15.125:0/2162469407 wait complete. 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.395+0000 7fe5ff16a700 1 Processor -- start 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.395+0000 7fe5ff16a700 1 -- start start 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 0x7fe5f8120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8139200 0x7fe5f81210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8122240 con 0x7fe5f80a0a70 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8123ee0 con 0x7fe5f80a1550 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8124150 con 0x7fe5f8139200 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5fcf06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 0x7fe5f8120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55092/0 (socket says 172.21.15.125:55092) 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5fd707700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8139200 0x7fe5f81210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 -- 172.21.15.125:0/1554563814 learned_addr learned my addr 172.21.15.125:0/1554563814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 -- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8139200 msgr2=0x7fe5f81210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8139200 0x7fe5f81210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 -- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 msgr2=0x7fe5f8120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 0x7fe5f8120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 -- 172.21.15.125:0/1554563814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009550 con 0x7fe5f80a1550 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5fcf06700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 0x7fe5f8120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400ebe0 tx=0x7fe5e400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400c850 con 0x7fe5f80a1550 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400c9b0 con 0x7fe5f80a1550 2023-10-03T10:18:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0009a70 con 0x7fe5f80a1550 2023-10-03T10:18:18.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400cd40 con 0x7fe5f80a1550 2023-10-03T10:18:18.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.396+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8136520 con 0x7fe5f80a1550 2023-10-03T10:18:18.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.397+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5e4013470 con 0x7fe5f80a1550 2023-10-03T10:18:18.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.397+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f804f2a0 con 0x7fe5f80a1550 2023-10-03T10:18:18.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.397+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5e403f860 con 0x7fe5f80a1550 2023-10-03T10:18:18.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.402+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5e40232f0 con 0x7fe5f80a1550 2023-10-03T10:18:18.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.553+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c3011ecd0 con 0x7f9c3009f180 2023-10-03T10:18:18.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.554+0000 7f9c177fe700 1 -- 172.21.15.125:0/3809891348 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c24021030 con 0x7f9c3009f180 2023-10-03T10:18:18.553 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:18.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 msgr2=0x7f9c301c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400ebe0 tx=0x7f9c2400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 shutdown_connections 2023-10-03T10:18:18.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c30131d70 0x7f9c301c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9c3009e870 0x7f9c301c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 --2- 172.21.15.125:0/3809891348 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9c3009f180 0x7f9c301c65d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 >> 172.21.15.125:0/3809891348 conn(0x7f9c300a4430 msgr2=0x7f9c301b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 shutdown_connections 2023-10-03T10:18:18.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.556+0000 7f9c3550b700 1 -- 172.21.15.125:0/3809891348 wait complete. 2023-10-03T10:18:18.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:18.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.594+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5f81237d0 con 0x7fe5f80a1550 2023-10-03T10:18:18.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.595+0000 7fe5f57fa700 1 -- 172.21.15.125:0/1554563814 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5e4021070 con 0x7fe5f80a1550 2023-10-03T10:18:18.594 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:18.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 msgr2=0x7fe5f8120b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400ebe0 tx=0x7fe5e400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 shutdown_connections 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5f8139200 0x7fe5f81210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80a0a70 0x7fe5f8120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 --2- 172.21.15.125:0/1554563814 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f80a1550 0x7fe5f8120b70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 >> 172.21.15.125:0/1554563814 conn(0x7fe5f80a6610 msgr2=0x7fe5f80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 shutdown_connections 2023-10-03T10:18:18.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:18.597+0000 7fe5ff16a700 1 -- 172.21.15.125:0/1554563814 wait complete. 2023-10-03T10:18:18.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:19.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:19.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.278+0000 7f7f337a0700 1 Processor -- start 2023-10-03T10:18:19.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.278+0000 7f7f337a0700 1 -- start start 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 0x7f7f2c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0a0920 con 0x7f7f2c09f180 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c09c970 con 0x7f7f2c09e870 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f337a0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c09bab0 con 0x7f7f2c131d70 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f31d3d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f30d3b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 0x7f7f2c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55098/0 (socket says 172.21.15.125:55098) 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f31d3d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56190/0 (socket says 172.21.15.125:56190) 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 -- 172.21.15.125:0/2803342840 learned_addr learned my addr 172.21.15.125:0/2803342840 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 -- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 msgr2=0x7f7f2c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 -- 172.21.15.125:0/2803342840 >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 msgr2=0x7f7f2c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 --2- 172.21.15.125:0/2803342840 >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 0x7f7f2c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 -- 172.21.15.125:0/2803342840 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c09f9c0 con 0x7f7f2c09e870 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f30d3b700 1 --2- 172.21.15.125:0/2803342840 >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 0x7f7f2c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f31d3d700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.279+0000 7f7f3153c700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800dd40 tx=0x7f7f2800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3afb8e43c6bd997 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f23fff700 1 -- 172.21.15.125:0/2803342840 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28012070 con 0x7f7f2c09e870 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f23fff700 1 -- 172.21.15.125:0/2803342840 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2800de90 con 0x7f7f2c09e870 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f23fff700 1 -- 172.21.15.125:0/2803342840 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2800faf0 con 0x7f7f2c09e870 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 -- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 msgr2=0x7f7f2c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800dd40 tx=0x7f7f2800f330 comp rx=0 tx=0).stop 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 -- 172.21.15.125:0/2803342840 shutdown_connections 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09e870 0x7f7f2c09ec40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 --2- 172.21.15.125:0/2803342840 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 --2- 172.21.15.125:0/2803342840 >> v2:172.21.15.125:3300/0 conn(0x7f7f2c09f180 0x7f7f2c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 -- 172.21.15.125:0/2803342840 >> 172.21.15.125:0/2803342840 conn(0x7f7f2c0a4430 msgr2=0x7f7f2c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 -- 172.21.15.125:0/2803342840 shutdown_connections 2023-10-03T10:18:19.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.280+0000 7f7f337a0700 1 -- 172.21.15.125:0/2803342840 wait complete. 2023-10-03T10:18:19.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.281+0000 7f7f337a0700 1 Processor -- start 2023-10-03T10:18:19.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 -- start start 2023-10-03T10:18:19.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c09e870 0x7f7f2c1c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c1c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c11e860 con 0x7f7f2c09e870 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c11ec20 con 0x7f7f2c09f180 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f337a0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c11f360 con 0x7f7f2c131d70 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f30d3b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f30d3b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55102/0 (socket says 172.21.15.125:55102) 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f31d3d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c1c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f30d3b700 1 -- 172.21.15.125:0/3333114152 learned_addr learned my addr 172.21.15.125:0/3333114152 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.282+0000 7f7f3153c700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c09e870 0x7f7f2c1c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 -- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 msgr2=0x7f7f2c1c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c1c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 -- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c09e870 msgr2=0x7f7f2c1c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c09e870 0x7f7f2c1c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 -- 172.21.15.125:0/3333114152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0094a0 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f30d3b700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ebb0 tx=0x7f7f1c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c009e80 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00c850 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f24009a70 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00cbc0 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.283+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2800d9f0 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.284+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f1c00cd20 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.284+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f1c03f6b0 con 0x7f7f2c09f180 2023-10-03T10:18:19.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.284+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c04f2a0 con 0x7f7f2c09f180 2023-10-03T10:18:19.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.289+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f1c0232f0 con 0x7f7f2c09f180 2023-10-03T10:18:19.302 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.425+0000 7f00a7aeb700 1 Processor -- start 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.426+0000 7f00a7aeb700 1 -- start start 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.426+0000 7f00a7aeb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00a009ad40 0x7f00a0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.426+0000 7f00a7aeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a7aeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a7aeb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00a3b60 con 0x7f00a009ad40 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a7aeb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a01348e0 con 0x7f00a0133f70 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a7aeb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a009b110 con 0x7f00a00a0a70 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5086700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a6088700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00a009ad40 0x7f00a0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5086700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55114/0 (socket says 172.21.15.125:55114) 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00a009ad40 0x7f00a0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57928/0 (socket says 172.21.15.125:57928) 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a6088700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56212/0 (socket says 172.21.15.125:56212) 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5086700 1 -- 172.21.15.125:0/1400483222 learned_addr learned my addr 172.21.15.125:0/1400483222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 -- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 msgr2=0x7f00a00a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 -- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 msgr2=0x7f00a01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 -- 172.21.15.125:0/1400483222 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00a2fa0 con 0x7f00a009ad40 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5086700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a6088700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a5887700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a0133a30 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f009c009870 tx=0x7f009c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58910b56d2bc2d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a4885700 1 -- 172.21.15.125:0/1400483222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011830 con 0x7f00a009ad40 2023-10-03T10:18:19.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a4885700 1 -- 172.21.15.125:0/1400483222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c011990 con 0x7f00a009ad40 2023-10-03T10:18:19.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.427+0000 7f00a4885700 1 -- 172.21.15.125:0/1400483222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011d20 con 0x7f00a009ad40 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 msgr2=0x7f00a0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a0133a30 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f009c009870 tx=0x7f009c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1400483222 shutdown_connections 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a00a0a70 0x7f00a00a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a0133a30 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1400483222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a0133f70 0x7f00a01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1400483222 >> 172.21.15.125:0/1400483222 conn(0x7f00a0099c40 msgr2=0x7f00a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1400483222 shutdown_connections 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.428+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1400483222 wait complete. 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 Processor -- start 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 -- start start 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a00a0a70 0x7f00a011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0120bb0 con 0x7f00a009ad40 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a01306c0 con 0x7f00a00a0a70 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a7aeb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0120130 con 0x7f00a0133f70 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a5887700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a6088700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.430+0000 7f00a5887700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57936/0 (socket says 172.21.15.125:57936) 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 -- 172.21.15.125:0/1309049639 learned_addr learned my addr 172.21.15.125:0/1309049639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a6088700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56228/0 (socket says 172.21.15.125:56228) 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5086700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a00a0a70 0x7f00a011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 -- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 msgr2=0x7f00a011dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 -- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a00a0a70 msgr2=0x7f00a011d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a00a0a70 0x7f00a011d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 -- 172.21.15.125:0/1309049639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098009a70 con 0x7f00a009ad40 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a6088700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a5887700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f009c0090b0 tx=0x7f009c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c004450 con 0x7f00a009ad40 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c01e070 con 0x7f00a009ad40 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0090009550 con 0x7f00a009ad40 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0038c0 con 0x7f00a009ad40 2023-10-03T10:18:19.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.431+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c0094a0 con 0x7f00a009ad40 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.432+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f009c003a20 con 0x7f00a009ad40 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.432+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a00a3540 con 0x7f00a009ad40 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.432+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f009c040350 con 0x7f00a009ad40 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.437+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f009c0045b0 con 0x7f00a009ad40 2023-10-03T10:18:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.485+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f2c09f660 con 0x7f7f2c09f180 2023-10-03T10:18:19.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.486+0000 7f7f21ffb700 1 -- 172.21.15.125:0/3333114152 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f1c021020 con 0x7f7f2c09f180 2023-10-03T10:18:19.486 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:19.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 msgr2=0x7f7f2c1c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ebb0 tx=0x7f7f1c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 shutdown_connections 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7f2c131d70 0x7f7f2c1c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f2c09e870 0x7f7f2c1c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 --2- 172.21.15.125:0/3333114152 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f2c09f180 0x7f7f2c1c1640 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 >> 172.21.15.125:0/3333114152 conn(0x7f7f2c0a4430 msgr2=0x7f7f2c130d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 shutdown_connections 2023-10-03T10:18:19.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.488+0000 7f7f337a0700 1 -- 172.21.15.125:0/3333114152 wait complete. 2023-10-03T10:18:19.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:19.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:19.609 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.629+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00a009c7e0 con 0x7f00a009ad40 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.629+0000 7f00967fc700 1 -- 172.21.15.125:0/1309049639 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f009c015020 con 0x7f00a009ad40 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 msgr2=0x7f00a011d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f009c0090b0 tx=0x7f009c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 shutdown_connections 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f00a0133f70 0x7f00a011dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a009ad40 0x7f00a011d2d0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 --2- 172.21.15.125:0/1309049639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00a00a0a70 0x7f00a011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 >> 172.21.15.125:0/1309049639 conn(0x7f00a0099c40 msgr2=0x7f00a0131fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 shutdown_connections 2023-10-03T10:18:19.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.631+0000 7f00a7aeb700 1 -- 172.21.15.125:0/1309049639 wait complete. 2023-10-03T10:18:19.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:19.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.693+0000 7fdff8709700 1 Processor -- start 2023-10-03T10:18:19.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.693+0000 7fdff8709700 1 -- start start 2023-10-03T10:18:19.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdff009e870 0x7fdff009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 0x7fdff0134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff006ce60 con 0x7fdff009e870 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff006bec0 con 0x7fdff009f180 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff8709700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdff009fa00 con 0x7fdff01341d0 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff5ca4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff6ca6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 0x7fdff0134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdff009e870 0x7fdff009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff5ca4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55126/0 (socket says 172.21.15.125:55126) 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff5ca4700 1 -- 172.21.15.125:0/2937468464 learned_addr learned my addr 172.21.15.125:0/2937468464 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 -- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 msgr2=0x7fdff0134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 0x7fdff0134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 -- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 msgr2=0x7fdff0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff64a5700 1 -- 172.21.15.125:0/2937468464 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff009ad80 con 0x7fdff009e870 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff6ca6700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 0x7fdff0134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.694+0000 7fdff5ca4700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff64a5700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff009e870 0x7fdff009ec40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc9c3a487707bad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff54a3700 1 -- 172.21.15.125:0/2937468464 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec011830 con 0x7fdff009e870 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff54a3700 1 -- 172.21.15.125:0/2937468464 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec011990 con 0x7fdff009e870 2023-10-03T10:18:19.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff54a3700 1 -- 172.21.15.125:0/2937468464 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec011d20 con 0x7fdff009e870 2023-10-03T10:18:19.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 -- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff009e870 msgr2=0x7fdff009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff009e870 0x7fdff009ec40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009870 tx=0x7fdfec009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:19.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 -- 172.21.15.125:0/2937468464 shutdown_connections 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff01341d0 0x7fdff0134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff009e870 0x7fdff009ec40 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 --2- 172.21.15.125:0/2937468464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009f180 0x7fdff0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 -- 172.21.15.125:0/2937468464 >> 172.21.15.125:0/2937468464 conn(0x7fdff00a4430 msgr2=0x7fdff00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.695+0000 7fdff8709700 1 -- 172.21.15.125:0/2937468464 shutdown_connections 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.696+0000 7fdff8709700 1 -- 172.21.15.125:0/2937468464 wait complete. 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.696+0000 7fdff8709700 1 Processor -- start 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.696+0000 7fdff8709700 1 -- start start 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 0x7fdff0122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 0x7fdff0122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0125020 con 0x7fdff01341d0 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0126060 con 0x7fdff009e870 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff8709700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0125b50 con 0x7fdff009f180 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff64a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 0x7fdff0122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff6ca6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 0x7fdff0122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56238/0 (socket says 172.21.15.125:56238) 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 -- 172.21.15.125:0/3960796365 learned_addr learned my addr 172.21.15.125:0/3960796365 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff64a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 0x7fdff0122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55138/0 (socket says 172.21.15.125:55138) 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 -- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 msgr2=0x7fdff0122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 0x7fdff0122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 -- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 msgr2=0x7fdff0122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 0x7fdff0122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 -- 172.21.15.125:0/3960796365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0009550 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff6ca6700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 0x7fdff0122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdff5ca4700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ec10 tx=0x7fdfe000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.697+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000c850 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.698+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000c9b0 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.698+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe8009a70 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.698+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000cd20 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.698+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec0094a0 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.698+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff006cfa0 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.699+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfe0013470 con 0x7fdff009f180 2023-10-03T10:18:19.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.699+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdfe003ff40 con 0x7fdff009f180 2023-10-03T10:18:19.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.703+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfe0013720 con 0x7fdff009f180 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 Processor -- start 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 -- start start 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 0x7fb294136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 0x7fb2941395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29409c970 con 0x7fb29409e870 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940a0920 con 0x7fb29409f350 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.737+0000 7fb299619700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb29409f9c0 con 0x7fb2941371c0 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 0x7fb2941395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2927fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 0x7fb294136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb292ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb29409e870 0x7fb29409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39908/0 (socket says 172.21.15.125:39908) 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb292ffd700 1 -- 172.21.15.125:0/2275418638 learned_addr learned my addr 172.21.15.125:0/2275418638 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 -- 172.21.15.125:0/2275418638 >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 msgr2=0x7fb294136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 --2- 172.21.15.125:0/2275418638 >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 0x7fb294136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 -- 172.21.15.125:0/2275418638 >> v1:172.21.15.125:6789/0 conn(0x7fb29409e870 legacy=0x7fb29409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 -- 172.21.15.125:0/2275418638 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29409bab0 con 0x7fb2941371c0 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb291ffb700 1 -- 172.21.15.125:0/2275418638 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974950902 0 0) 0x7fb29409c970 con 0x7fb29409e870 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2927fc700 1 --2- 172.21.15.125:0/2275418638 >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 0x7fb294136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb2937fe700 1 --2- 172.21.15.125:0/2275418638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 0x7fb2941395a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009d90 tx=0x7fb28c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6686839af83c0d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb291ffb700 1 -- 172.21.15.125:0/2275418638 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00e070 con 0x7fb2941371c0 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb291ffb700 1 -- 172.21.15.125:0/2275418638 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c00bb20 con 0x7fb2941371c0 2023-10-03T10:18:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.738+0000 7fb291ffb700 1 -- 172.21.15.125:0/2275418638 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c012430 con 0x7fb2941371c0 2023-10-03T10:18:19.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 -- 172.21.15.125:0/2275418638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 msgr2=0x7fb2941395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 --2- 172.21.15.125:0/2275418638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 0x7fb2941395a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009d90 tx=0x7fb28c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 -- 172.21.15.125:0/2275418638 shutdown_connections 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 --2- 172.21.15.125:0/2275418638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb2941371c0 0x7fb2941395a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 --2- 172.21.15.125:0/2275418638 >> v2:172.21.15.125:3300/0 conn(0x7fb29409f350 0x7fb294136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 -- 172.21.15.125:0/2275418638 >> 172.21.15.125:0/2275418638 conn(0x7fb2940a4430 msgr2=0x7fb2940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 -- 172.21.15.125:0/2275418638 shutdown_connections 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.739+0000 7fb299619700 1 -- 172.21.15.125:0/2275418638 wait complete. 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.740+0000 7fb299619700 1 Processor -- start 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.740+0000 7fb299619700 1 -- start start 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 0x7fb29406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2941371c0 0x7fb29406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29406d540 con 0x7fb29409f350 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb294126150 con 0x7fb2941371c0 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb299619700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb294072200 con 0x7fb29409e870 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56264/0 (socket says 172.21.15.125:56264) 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 -- 172.21.15.125:0/1108314529 learned_addr learned my addr 172.21.15.125:0/1108314529 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb2927fc700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 0x7fb29406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb2937fe700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2941371c0 0x7fb29406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 -- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2941371c0 msgr2=0x7fb29406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2941371c0 0x7fb29406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 -- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 msgr2=0x7fb29406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 0x7fb29406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 -- 172.21.15.125:0/1108314529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880094a0 con 0x7fb29409e870 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb2927fc700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 0x7fb29406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.741+0000 7fb292ffd700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c520 tx=0x7fb28400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.742+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284004c80 con 0x7fb29409e870 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.742+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284004e00 con 0x7fb29409e870 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.742+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c009a70 con 0x7fb29409e870 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.742+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284007310 con 0x7fb29409e870 2023-10-03T10:18:19.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.742+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294124f10 con 0x7fb29409e870 2023-10-03T10:18:19.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.743+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb284007470 con 0x7fb29409e870 2023-10-03T10:18:19.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.743+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29404f2a0 con 0x7fb29409e870 2023-10-03T10:18:19.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.743+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb28403f300 con 0x7fb29409e870 2023-10-03T10:18:19.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.747+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2840133c0 con 0x7fb29409e870 2023-10-03T10:18:19.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.893+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdff004f2a0 con 0x7fdff009f180 2023-10-03T10:18:19.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.894+0000 7fdfe6ffd700 1 -- 172.21.15.125:0/3960796365 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfe002a090 con 0x7fdff009f180 2023-10-03T10:18:19.894 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:19.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 msgr2=0x7fdff0122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ec10 tx=0x7fdfe000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:19.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 shutdown_connections 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdff01341d0 0x7fdff0122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdff009e870 0x7fdff0122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 --2- 172.21.15.125:0/3960796365 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdff009f180 0x7fdff0122a80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 >> 172.21.15.125:0/3960796365 conn(0x7fdff00a4430 msgr2=0x7fdff0072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 shutdown_connections 2023-10-03T10:18:19.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.896+0000 7fdff8709700 1 -- 172.21.15.125:0/3960796365 wait complete. 2023-10-03T10:18:19.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:19.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.935+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2941264f0 con 0x7fb29409e870 2023-10-03T10:18:19.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.936+0000 7fb27b7fe700 1 -- 172.21.15.125:0/1108314529 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb284011360 con 0x7fb29409e870 2023-10-03T10:18:19.936 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:19.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 msgr2=0x7fb29406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c520 tx=0x7fb28400c830 comp rx=0 tx=0).stop 2023-10-03T10:18:19.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 shutdown_connections 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2941371c0 0x7fb29406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb29409e870 0x7fb29406b8b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 --2- 172.21.15.125:0/1108314529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29409f350 0x7fb29406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 >> 172.21.15.125:0/1108314529 conn(0x7fb2940a4430 msgr2=0x7fb294070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 shutdown_connections 2023-10-03T10:18:19.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:19.938+0000 7fb299619700 1 -- 172.21.15.125:0/1108314529 wait complete. 2023-10-03T10:18:19.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:20.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.624+0000 7fc96ce06700 1 Processor -- start 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.624+0000 7fc96ce06700 1 -- start start 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96ce06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 0x7fc968133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96ce06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc9681304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96ce06700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96806b2d0 con 0x7fc9681309f0 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96ce06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968133610 con 0x7fc9681300a0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96ce06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96809a500 con 0x7fc968133ad0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 0x7fc968133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc965d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc9681304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc966d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc9681309f0 0x7fc96813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39912/0 (socket says 172.21.15.125:39912) 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc966d9d700 1 -- 172.21.15.125:0/3341640746 learned_addr learned my addr 172.21.15.125:0/3341640746 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96559a700 1 -- 172.21.15.125:0/3341640746 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225745018 0 0) 0x7fc96806b2d0 con 0x7fc9681309f0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc96559a700 1 -- 172.21.15.125:0/3341640746 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9500035b0 con 0x7fc9681309f0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc965d9b700 1 -- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 msgr2=0x7fc968133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc965d9b700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 0x7fc968133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.625+0000 7fc965d9b700 1 -- 172.21.15.125:0/3341640746 >> v1:172.21.15.125:6789/0 conn(0x7fc9681309f0 legacy=0x7fc96813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc965d9b700 1 -- 172.21.15.125:0/3341640746 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9681338b0 con 0x7fc9681300a0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96659c700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 0x7fc968133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc965d9b700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc9681304b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc958009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59800b3264bf7680 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96559a700 1 -- 172.21.15.125:0/3341640746 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011830 con 0x7fc9681300a0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96559a700 1 -- 172.21.15.125:0/3341640746 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958011990 con 0x7fc9681300a0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96559a700 1 -- 172.21.15.125:0/3341640746 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011d20 con 0x7fc9681300a0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 -- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 msgr2=0x7fc9681304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc9681304b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc958009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 -- 172.21.15.125:0/3341640746 shutdown_connections 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc968133ad0 0x7fc968133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 --2- 172.21.15.125:0/3341640746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc9681304b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 -- 172.21.15.125:0/3341640746 >> 172.21.15.125:0/3341640746 conn(0x7fc968099c40 msgr2=0x7fc9680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 -- 172.21.15.125:0/3341640746 shutdown_connections 2023-10-03T10:18:20.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.626+0000 7fc96ce06700 1 -- 172.21.15.125:0/3341640746 wait complete. 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.627+0000 7fc96ce06700 1 Processor -- start 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.627+0000 7fc96ce06700 1 -- start start 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc96811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 0x7fc96811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96811ef60 con 0x7fc968133ad0 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968072060 con 0x7fc9681300a0 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96ce06700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681202c0 con 0x7fc9681309f0 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc96659c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc96811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc966d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 0x7fc96811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56286/0 (socket says 172.21.15.125:56286) 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 -- 172.21.15.125:0/493325629 learned_addr learned my addr 172.21.15.125:0/493325629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 -- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 msgr2=0x7fc96811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc96811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 -- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 msgr2=0x7fc96811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 0x7fc96811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 -- 172.21.15.125:0/493325629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0094a0 con 0x7fc9681309f0 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc966d9d700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 0x7fc96811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.628+0000 7fc965d9b700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc9580090b0 tx=0x7fc958004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004450 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95801e070 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9580094a0 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580038e0 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680a3400 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc958003a40 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc958020070 con 0x7fc9681309f0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.629+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96812dd00 con 0x7fc9681309f0 2023-10-03T10:18:20.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.634+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc95802a080 con 0x7fc9681309f0 2023-10-03T10:18:20.646 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.769+0000 7fdb20e23700 1 Processor -- start 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.769+0000 7fdb20e23700 1 -- start start 2023-10-03T10:18:20.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb20e23700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb20e23700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 0x7fdb1c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb20e23700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c09b110 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb20e23700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c0a3b60 con 0x7fdb1c133f70 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb20e23700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1348e0 con 0x7fdb1c09ad40 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55172/0 (socket says 172.21.15.125:55172) 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb1a59c700 1 -- 172.21.15.125:0/2751797240 learned_addr learned my addr 172.21.15.125:0/2751797240 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.770+0000 7fdb19d9b700 1 --2- 172.21.15.125:0/2751797240 >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 0x7fdb1c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1a59c700 1 -- 172.21.15.125:0/2751797240 >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 msgr2=0x7fdb1c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1a59c700 1 --2- 172.21.15.125:0/2751797240 >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 0x7fdb1c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1a59c700 1 -- 172.21.15.125:0/2751797240 >> v1:172.21.15.125:6789/0 conn(0x7fdb1c0a0a70 legacy=0x7fdb1c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1959a700 1 -- 172.21.15.125:0/2751797240 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798650111 0 0) 0x7fdb1c09b110 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1a59c700 1 -- 172.21.15.125:0/2751797240 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0a2fa0 con 0x7fdb1c09ad40 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb19d9b700 1 --2- 172.21.15.125:0/2751797240 >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 0x7fdb1c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1a59c700 1 --2- 172.21.15.125:0/2751797240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009920 tx=0x7fdb0c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8f153503390ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1959a700 1 -- 172.21.15.125:0/2751797240 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011830 con 0x7fdb1c09ad40 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1959a700 1 -- 172.21.15.125:0/2751797240 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c011990 con 0x7fdb1c09ad40 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb1959a700 1 -- 172.21.15.125:0/2751797240 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011d20 con 0x7fdb1c09ad40 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb20e23700 1 -- 172.21.15.125:0/2751797240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 msgr2=0x7fdb1c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.771+0000 7fdb20e23700 1 --2- 172.21.15.125:0/2751797240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009920 tx=0x7fdb0c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 -- 172.21.15.125:0/2751797240 shutdown_connections 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 --2- 172.21.15.125:0/2751797240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c133a30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 --2- 172.21.15.125:0/2751797240 >> v2:172.21.15.125:3300/0 conn(0x7fdb1c133f70 0x7fdb1c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 -- 172.21.15.125:0/2751797240 >> 172.21.15.125:0/2751797240 conn(0x7fdb1c099c40 msgr2=0x7fdb1c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 -- 172.21.15.125:0/2751797240 shutdown_connections 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.772+0000 7fdb20e23700 1 -- 172.21.15.125:0/2751797240 wait complete. 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 Processor -- start 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 -- start start 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 0x7fdb1c1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb1c133f70 0x7fdb1c1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c122200 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1205d0 con 0x7fdb1c09ad40 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb20e23700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c120b50 con 0x7fdb1c133f70 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb19d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 0x7fdb1c1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb1a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55186/0 (socket says 172.21.15.125:55186) 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb1a59c700 1 -- 172.21.15.125:0/1314198243 learned_addr learned my addr 172.21.15.125:0/1314198243 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb1ad9d700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb1c133f70 0x7fdb1c1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.773+0000 7fdb19d9b700 1 -- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb1c133f70 msgr2=0x7fdb1c1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb19d9b700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb1c133f70 0x7fdb1c1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb19d9b700 1 -- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 msgr2=0x7fdb1c1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb19d9b700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb19d9b700 1 -- 172.21.15.125:0/1314198243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100094a0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb1a59c700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb19d9b700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 0x7fdb1c1c86d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e980 tx=0x7fdb1000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1000c690 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1000c7f0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c009550 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1000cb80 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.774+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c122c70 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.775+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb1000cce0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.775+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb1003fa70 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.775+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c04f2a0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.780+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb1001b3b0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.828+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc96804f2a0 con 0x7fc9681309f0 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.828+0000 7fc956ffd700 1 -- 172.21.15.125:0/493325629 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc958015020 con 0x7fc9681309f0 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 msgr2=0x7fc96811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc9580090b0 tx=0x7fc958004750 comp rx=0 tx=0).stop 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 shutdown_connections 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc968133ad0 0x7fc96811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9681300a0 0x7fc96811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 --2- 172.21.15.125:0/493325629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9681309f0 0x7fc96811df80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 >> 172.21.15.125:0/493325629 conn(0x7fc968099c40 msgr2=0x7fc96812e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 shutdown_connections 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.831+0000 7fc96ce06700 1 -- 172.21.15.125:0/493325629 wait complete. 2023-10-03T10:18:20.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:20.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:20.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:20.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.978+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb1c0729d0 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.979+0000 7fdb0affd700 1 -- 172.21.15.125:0/1314198243 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb10021030 con 0x7fdb1c0a0a70 2023-10-03T10:18:20.979 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:20.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 msgr2=0x7fdb1c1c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 0x7fdb1c1c86d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e980 tx=0x7fdb1000ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:20.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 shutdown_connections 2023-10-03T10:18:20.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb1c133f70 0x7fdb1c1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb1c09ad40 0x7fdb1c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 --2- 172.21.15.125:0/1314198243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb1c0a0a70 0x7fdb1c1c86d0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.981+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 >> 172.21.15.125:0/1314198243 conn(0x7fdb1c099c40 msgr2=0x7fdb1c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.982+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 shutdown_connections 2023-10-03T10:18:20.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:20.982+0000 7fdb20e23700 1 -- 172.21.15.125:0/1314198243 wait complete. 2023-10-03T10:18:20.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:21.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.036+0000 7fc93814b700 1 Processor -- start 2023-10-03T10:18:21.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 -- start start 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93006b2d0 con 0x7fc9301309f0 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc930133610 con 0x7fc9301300a0 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc93814b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93009a500 con 0x7fc930133ad0 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc9356e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56298/0 (socket says 172.21.15.125:56298) 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc9356e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57992/0 (socket says 172.21.15.125:57992) 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc9366e8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc9301309f0 0x7fc93013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39924/0 (socket says 172.21.15.125:39924) 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 -- 172.21.15.125:0/2916248550 learned_addr learned my addr 172.21.15.125:0/2916248550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 -- 172.21.15.125:0/2916248550 >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 msgr2=0x7fc9301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 --2- 172.21.15.125:0/2916248550 >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 -- 172.21.15.125:0/2916248550 >> v1:172.21.15.125:6789/0 conn(0x7fc9301309f0 legacy=0x7fc93013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc935ee7700 1 -- 172.21.15.125:0/2916248550 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9301338b0 con 0x7fc930133ad0 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc934ee5700 1 -- 172.21.15.125:0/2916248550 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288402820 0 0) 0x7fc93006b2d0 con 0x7fc9301309f0 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.037+0000 7fc9356e6700 1 --2- 172.21.15.125:0/2916248550 >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc935ee7700 1 --2- 172.21.15.125:0/2916248550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0098f0 tx=0x7fc92c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b6e7dd61856151 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc934ee5700 1 -- 172.21.15.125:0/2916248550 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011830 con 0x7fc930133ad0 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc934ee5700 1 -- 172.21.15.125:0/2916248550 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c011990 con 0x7fc930133ad0 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc934ee5700 1 -- 172.21.15.125:0/2916248550 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011d20 con 0x7fc930133ad0 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 -- 172.21.15.125:0/2916248550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 msgr2=0x7fc930133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 --2- 172.21.15.125:0/2916248550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0098f0 tx=0x7fc92c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 -- 172.21.15.125:0/2916248550 shutdown_connections 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 --2- 172.21.15.125:0/2916248550 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc930133ad0 0x7fc930133ea0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 --2- 172.21.15.125:0/2916248550 >> v2:172.21.15.125:3300/0 conn(0x7fc9301300a0 0x7fc9301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.038+0000 7fc93814b700 1 -- 172.21.15.125:0/2916248550 >> 172.21.15.125:0/2916248550 conn(0x7fc930099c40 msgr2=0x7fc9300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.039+0000 7fc93814b700 1 -- 172.21.15.125:0/2916248550 shutdown_connections 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.039+0000 7fc93814b700 1 -- 172.21.15.125:0/2916248550 wait complete. 2023-10-03T10:18:21.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.039+0000 7fc93814b700 1 Processor -- start 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.039+0000 7fc93814b700 1 -- start start 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 0x7fc9300712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 0x7fc930071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93011fe60 con 0x7fc930133ad0 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93011f950 con 0x7fc9301300a0 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc93814b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93011f5f0 con 0x7fc9301309f0 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9356e6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 0x7fc930071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58000/0 (socket says 172.21.15.125:58000) 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 -- 172.21.15.125:0/1385285779 learned_addr learned my addr 172.21.15.125:0/1385285779 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc935ee7700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 0x7fc9300712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 -- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 msgr2=0x7fc930071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 0x7fc930071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 -- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 msgr2=0x7fc9300712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 0x7fc9300712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 -- 172.21.15.125:0/1385285779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200094a0 con 0x7fc930133ad0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc935ee7700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 0x7fc9300712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9356e6700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 0x7fc930071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.040+0000 7fc9366e8700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc928002230 tx=0x7fc92800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92800aac0 con 0x7fc930133ad0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92800ac40 con 0x7fc930133ad0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c009550 con 0x7fc930133ad0 2023-10-03T10:18:21.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280070d0 con 0x7fc930133ad0 2023-10-03T10:18:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93012dd00 con 0x7fc930133ad0 2023-10-03T10:18:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.041+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc928007250 con 0x7fc930133ad0 2023-10-03T10:18:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.042+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300a2620 con 0x7fc930133ad0 2023-10-03T10:18:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.042+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc92803f4c0 con 0x7fc930133ad0 2023-10-03T10:18:21.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.046+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc928007500 con 0x7fc930133ad0 2023-10-03T10:18:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 Processor -- start 2023-10-03T10:18:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 -- start start 2023-10-03T10:18:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 0x7f0aec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 0x7f0aec13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec09dc00 con 0x7f0aec0a1380 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec09ea90 con 0x7f0aec0a0a70 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0af103b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec09dec0 con 0x7f0aec134120 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0aead9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 0x7f0aec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0aeb59e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 0x7f0aec13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0aea59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0aec0a1380 0x7f0aec133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39934/0 (socket says 172.21.15.125:39934) 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.078+0000 7f0aea59c700 1 -- 172.21.15.125:0/905899372 learned_addr learned my addr 172.21.15.125:0/905899372 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aeb59e700 1 -- 172.21.15.125:0/905899372 >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 msgr2=0x7f0aec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aeb59e700 1 --2- 172.21.15.125:0/905899372 >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 0x7f0aec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aeb59e700 1 -- 172.21.15.125:0/905899372 >> v1:172.21.15.125:6789/0 conn(0x7f0aec0a1380 legacy=0x7f0aec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aeb59e700 1 -- 172.21.15.125:0/905899372 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec09e6a0 con 0x7f0aec134120 2023-10-03T10:18:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aead9d700 1 --2- 172.21.15.125:0/905899372 >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 0x7f0aec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0aeb59e700 1 --2- 172.21.15.125:0/905899372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 0x7f0aec13bce0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8662c2636239308 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0ae9d9b700 1 -- 172.21.15.125:0/905899372 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400e070 con 0x7f0aec134120 2023-10-03T10:18:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0ae9d9b700 1 -- 172.21.15.125:0/905899372 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400bb20 con 0x7f0aec134120 2023-10-03T10:18:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.079+0000 7f0ae9d9b700 1 -- 172.21.15.125:0/905899372 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4012430 con 0x7f0aec134120 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 -- 172.21.15.125:0/905899372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 msgr2=0x7f0aec13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 --2- 172.21.15.125:0/905899372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 0x7f0aec13bce0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 -- 172.21.15.125:0/905899372 shutdown_connections 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 --2- 172.21.15.125:0/905899372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec134120 0x7f0aec13bce0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 --2- 172.21.15.125:0/905899372 >> v2:172.21.15.125:3300/0 conn(0x7f0aec0a0a70 0x7f0aec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 -- 172.21.15.125:0/905899372 >> 172.21.15.125:0/905899372 conn(0x7f0aec0a6610 msgr2=0x7f0aec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 -- 172.21.15.125:0/905899372 shutdown_connections 2023-10-03T10:18:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.080+0000 7f0af103b700 1 -- 172.21.15.125:0/905899372 wait complete. 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 Processor -- start 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 -- start start 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0aec0a0a70 0x7f0aec122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 0x7f0aec122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 0x7f0aec123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec133850 con 0x7f0aec134120 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec133a80 con 0x7f0aec0a1380 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0af103b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1260d0 con 0x7f0aec0a0a70 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 0x7f0aec122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0aeb59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 0x7f0aec123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 0x7f0aec122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55224/0 (socket says 172.21.15.125:55224) 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0aead9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0aec0a0a70 0x7f0aec122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.081+0000 7f0aea59c700 1 -- 172.21.15.125:0/2792340868 learned_addr learned my addr 172.21.15.125:0/2792340868 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 -- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0aec0a0a70 msgr2=0x7f0aec122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0aec0a0a70 0x7f0aec122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 -- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 msgr2=0x7f0aec122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 0x7f0aec122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 -- 172.21.15.125:0/2792340868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0094a0 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0aeb59e700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 0x7f0aec123390 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4016000 tx=0x7f0ae4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4012430 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4020070 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40098f0 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4009a70 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.082+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec125e10 con 0x7f0aec134120 2023-10-03T10:18:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.083+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ae4004040 con 0x7f0aec134120 2023-10-03T10:18:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.083+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ae4022070 con 0x7f0aec134120 2023-10-03T10:18:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.083+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec04f2a0 con 0x7f0aec134120 2023-10-03T10:18:21.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.088+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ae402c080 con 0x7f0aec134120 2023-10-03T10:18:21.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.241+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc93004f2a0 con 0x7fc930133ad0 2023-10-03T10:18:21.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.241+0000 7fc9267fc700 1 -- 172.21.15.125:0/1385285779 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc928018020 con 0x7fc930133ad0 2023-10-03T10:18:21.242 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 msgr2=0x7fc930071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc928002230 tx=0x7fc92800cf50 comp rx=0 tx=0).stop 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 shutdown_connections 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc930133ad0 0x7fc930071d70 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9301300a0 0x7fc9300712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 --2- 172.21.15.125:0/1385285779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc9301309f0 0x7fc930071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 >> 172.21.15.125:0/1385285779 conn(0x7fc930099c40 msgr2=0x7fc930132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 shutdown_connections 2023-10-03T10:18:21.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.243+0000 7fc93814b700 1 -- 172.21.15.125:0/1385285779 wait complete. 2023-10-03T10:18:21.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.282+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0aec126ba0 con 0x7f0aec134120 2023-10-03T10:18:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.282+0000 7f0ad37fe700 1 -- 172.21.15.125:0/2792340868 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ae40269d0 con 0x7f0aec134120 2023-10-03T10:18:21.283 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 msgr2=0x7f0aec123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 0x7f0aec123390 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4016000 tx=0x7f0ae4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 shutdown_connections 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0aec134120 0x7f0aec123390 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0aec0a0a70 0x7f0aec122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 --2- 172.21.15.125:0/2792340868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0aec0a1380 0x7f0aec122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 >> 172.21.15.125:0/2792340868 conn(0x7f0aec0a6610 msgr2=0x7f0aec09ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 shutdown_connections 2023-10-03T10:18:21.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.284+0000 7f0af103b700 1 -- 172.21.15.125:0/2792340868 wait complete. 2023-10-03T10:18:21.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:21.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:21.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.974+0000 7f3fc51c0700 1 Processor -- start 2023-10-03T10:18:21.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.974+0000 7f3fc51c0700 1 -- start start 2023-10-03T10:18:21.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fc0131980 0x7f3fc0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc0138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc006eb30 con 0x7f3fc0131980 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00a1640 con 0x7f3fc009bc70 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fc51c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00a22d0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbe59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc0138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fc0131980 0x7f3fc0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbe59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55228/0 (socket says 172.21.15.125:55228) 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc0138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56318/0 (socket says 172.21.15.125:56318) 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbe59c700 1 -- 172.21.15.125:0/2873486190 learned_addr learned my addr 172.21.15.125:0/2873486190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3fc0131980 0x7f3fc0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58038/0 (socket says 172.21.15.125:58038) 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 -- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 msgr2=0x7f3fc0138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc0138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 -- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 msgr2=0x7f3fc009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 -- 172.21.15.125:0/2873486190 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0131550 con 0x7f3fc0131980 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbe59c700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbed9d700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc0131d50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009850 tx=0x7f3fb4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d972964e7e24e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.975+0000 7f3fbdd9b700 1 -- 172.21.15.125:0/2873486190 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4005e30 con 0x7f3fc0131980 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fbdd9b700 1 -- 172.21.15.125:0/2873486190 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4006030 con 0x7f3fc0131980 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fbdd9b700 1 -- 172.21.15.125:0/2873486190 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40063c0 con 0x7f3fc0131980 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 -- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 msgr2=0x7f3fc0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc0131d50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009850 tx=0x7f3fb4009b60 comp rx=0 tx=0).stop 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 -- 172.21.15.125:0/2873486190 shutdown_connections 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc0138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc0131d50 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/2873486190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 -- 172.21.15.125:0/2873486190 >> 172.21.15.125:0/2873486190 conn(0x7f3fc00a2980 msgr2=0x7f3fc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 -- 172.21.15.125:0/2873486190 shutdown_connections 2023-10-03T10:18:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.976+0000 7f3fc51c0700 1 -- 172.21.15.125:0/2873486190 wait complete. 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.977+0000 7f3fc51c0700 1 Processor -- start 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.977+0000 7f3fc51c0700 1 -- start start 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc011b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc011bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc011f220 con 0x7f3fc0131980 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc011e5f0 con 0x7f3fc009bc70 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc011fbc0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc011b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc011bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbed9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc011b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55244/0 (socket says 172.21.15.125:55244) 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbed9d700 1 -- 172.21.15.125:0/228212931 learned_addr learned my addr 172.21.15.125:0/228212931 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbf59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58052/0 (socket says 172.21.15.125:58052) 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 -- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 msgr2=0x7f3fc011b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc011b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 -- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 msgr2=0x7f3fc011c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 -- 172.21.15.125:0/228212931 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009550 con 0x7f3fc009c5c0 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbf59e700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fbe59c700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc011bcd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000d940 tx=0x7f3fb000dc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000b5d0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000b730 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4009430 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.978+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000bac0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.979+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00a1c40 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.979+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fb000bc20 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.979+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc004f2a0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.979+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fb003f1d0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:21.984+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fb00152a0 con 0x7f3fc009c5c0 2023-10-03T10:18:21.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:22.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 Processor -- start 2023-10-03T10:18:22.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 -- start start 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 0x7efee01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee009e9d0 con 0x7efee0133f50 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee009dc00 con 0x7efee00a0a70 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee7656700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee009dec0 con 0x7efee00a1380 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee53f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee4bf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee5bf3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 0x7efee01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee4bf1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56332/0 (socket says 172.21.15.125:56332) 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee53f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55250/0 (socket says 172.21.15.125:55250) 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.118+0000 7efee4bf1700 1 -- 172.21.15.125:0/768205416 learned_addr learned my addr 172.21.15.125:0/768205416 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 -- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 msgr2=0x7efee0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 --2- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 -- 172.21.15.125:0/768205416 >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 msgr2=0x7efee01343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 --2- 172.21.15.125:0/768205416 >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 0x7efee01343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 -- 172.21.15.125:0/768205416 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee009e6a0 con 0x7efee00a0a70 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee5bf3700 1 --2- 172.21.15.125:0/768205416 >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 0x7efee01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efee53f2700 1 --2- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efedc009840 tx=0x7efedc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6298153b52d5016e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efed7fff700 1 -- 172.21.15.125:0/768205416 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc011830 con 0x7efee00a0a70 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efed7fff700 1 -- 172.21.15.125:0/768205416 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc011990 con 0x7efee00a0a70 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.119+0000 7efed7fff700 1 -- 172.21.15.125:0/768205416 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc011d20 con 0x7efee00a0a70 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 -- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 msgr2=0x7efee00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 --2- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efedc009840 tx=0x7efedc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 -- 172.21.15.125:0/768205416 shutdown_connections 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 --2- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee00a0e40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 --2- 172.21.15.125:0/768205416 >> v2:172.21.15.125:3300/0 conn(0x7efee0133f50 0x7efee01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 --2- 172.21.15.125:0/768205416 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 -- 172.21.15.125:0/768205416 >> 172.21.15.125:0/768205416 conn(0x7efee00a6610 msgr2=0x7efee00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 -- 172.21.15.125:0/768205416 shutdown_connections 2023-10-03T10:18:22.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.120+0000 7efee7656700 1 -- 172.21.15.125:0/768205416 wait complete. 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.121+0000 7efee7656700 1 Processor -- start 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.121+0000 7efee7656700 1 -- start start 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee01224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0125d30 con 0x7efee0133f50 2023-10-03T10:18:22.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee01249d0 con 0x7efee00a0a70 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee00a5150 con 0x7efee00a1380 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee53f2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee01224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58068/0 (socket says 172.21.15.125:58068) 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 -- 172.21.15.125:0/1975070454 learned_addr learned my addr 172.21.15.125:0/1975070454 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee4bf1700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 -- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 msgr2=0x7efee0122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 -- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 msgr2=0x7efee01224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee01224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 -- 172.21.15.125:0/1975070454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8009a70 con 0x7efee0133f50 2023-10-03T10:18:22.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee53f2700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee01224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee5bf3700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7efed800efc0 tx=0x7efed800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800cb40 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800f040 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc0094a0 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.122+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8003a20 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.123+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee0124f20 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.123+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efed8014480 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.123+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efed803ff90 con 0x7efee0133f50 2023-10-03T10:18:22.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.124+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee011f050 con 0x7efee0133f50 2023-10-03T10:18:22.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.128+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efed8012520 con 0x7efee0133f50 2023-10-03T10:18:22.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.190+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fc006bce0 con 0x7f3fc009c5c0 2023-10-03T10:18:22.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.190+0000 7f3fa77fe700 1 -- 172.21.15.125:0/228212931 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fb0010ad0 con 0x7f3fc009c5c0 2023-10-03T10:18:22.191 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 msgr2=0x7f3fc011bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc011bcd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000d940 tx=0x7f3fb000dc50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 shutdown_connections 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3fc0131980 0x7f3fc011c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3fc009bc70 0x7f3fc011b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 --2- 172.21.15.125:0/228212931 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3fc009c5c0 0x7f3fc011bcd0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 >> 172.21.15.125:0/228212931 conn(0x7f3fc00a2980 msgr2=0x7f3fc01b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 shutdown_connections 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.193+0000 7f3fc51c0700 1 -- 172.21.15.125:0/228212931 wait complete. 2023-10-03T10:18:22.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:22.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:22.297 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:22.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.333+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efee006d3f0 con 0x7efee0133f50 2023-10-03T10:18:22.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.333+0000 7efed5ffb700 1 -- 172.21.15.125:0/1975070454 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efed8012340 con 0x7efee0133f50 2023-10-03T10:18:22.334 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:22.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 msgr2=0x7efee0122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7efed800efc0 tx=0x7efed800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 shutdown_connections 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efee0133f50 0x7efee0122f70 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efee00a0a70 0x7efee01224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 --2- 172.21.15.125:0/1975070454 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efee00a1380 0x7efee0122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 >> 172.21.15.125:0/1975070454 conn(0x7efee00a6610 msgr2=0x7efee009c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 shutdown_connections 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.336+0000 7efee7656700 1 -- 172.21.15.125:0/1975070454 wait complete. 2023-10-03T10:18:22.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.384+0000 7fcfc799f700 1 Processor -- start 2023-10-03T10:18:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.384+0000 7fcfc799f700 1 -- start start 2023-10-03T10:18:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc799f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc799f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfc00a1460 0x7fcfc013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc799f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc0133640 con 0x7fcfc00a08e0 2023-10-03T10:18:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc799f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00a1d50 con 0x7fcfc00a1460 2023-10-03T10:18:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc799f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc009b620 con 0x7fcfc0133a70 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfc00a1460 0x7fcfc013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc573b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfc00a1460 0x7fcfc013b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58074/0 (socket says 172.21.15.125:58074) 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3602927481 learned_addr learned my addr 172.21.15.125:0/3602927481 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc573b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56346/0 (socket says 172.21.15.125:56346) 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc4f3a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcfc00a08e0 0x7fcfc00a0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39942/0 (socket says 172.21.15.125:39942) 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 msgr2=0x7fcfc0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3602927481 >> v1:172.21.15.125:6789/0 conn(0x7fcfc00a08e0 legacy=0x7fcfc00a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3602927481 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0133870 con 0x7fcfc00a1460 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfb7fff700 1 -- 172.21.15.125:0/3602927481 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619972575 0 0) 0x7fcfc0133640 con 0x7fcfc00a08e0 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.385+0000 7fcfc573b700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc013b980 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009e50 tx=0x7fcfb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56f1218a861820f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfb7fff700 1 -- 172.21.15.125:0/3602927481 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800e070 con 0x7fcfc00a1460 2023-10-03T10:18:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfb7fff700 1 -- 172.21.15.125:0/3602927481 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb800b910 con 0x7fcfc00a1460 2023-10-03T10:18:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfb7fff700 1 -- 172.21.15.125:0/3602927481 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800bcc0 con 0x7fcfc00a1460 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 -- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 msgr2=0x7fcfc013b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc013b980 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009e50 tx=0x7fcfb800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 -- 172.21.15.125:0/3602927481 shutdown_connections 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc013b980 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3602927481 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 -- 172.21.15.125:0/3602927481 >> 172.21.15.125:0/3602927481 conn(0x7fcfc00a2980 msgr2=0x7fcfc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 -- 172.21.15.125:0/3602927481 shutdown_connections 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.386+0000 7fcfc799f700 1 -- 172.21.15.125:0/3602927481 wait complete. 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.387+0000 7fcfc799f700 1 Processor -- start 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.387+0000 7fcfc799f700 1 -- start start 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 0x7fcfc011a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc011b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc011de90 con 0x7fcfc00a1460 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc011ea50 con 0x7fcfc00a08e0 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc799f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc011d000 con 0x7fcfc0133a70 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc4f3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc573b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 0x7fcfc011a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc4f3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58082/0 (socket says 172.21.15.125:58082) 2023-10-03T10:18:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc4f3a700 1 -- 172.21.15.125:0/3993307025 learned_addr learned my addr 172.21.15.125:0/3993307025 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc011b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 msgr2=0x7fcfc011a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 0x7fcfc011a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 msgr2=0x7fcfc011ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 -- 172.21.15.125:0/3993307025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009430 con 0x7fcfc0133a70 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc573b700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 0x7fcfc011a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc4f3a700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.388+0000 7fcfc5f3c700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc011b040 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8015000 tx=0x7fcfb8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.389+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004670 con 0x7fcfc0133a70 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.389+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80047f0 con 0x7fcfc0133a70 2023-10-03T10:18:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.389+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb8009b30 con 0x7fcfc0133a70 2023-10-03T10:18:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.389+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb801c680 con 0x7fcfc0133a70 2023-10-03T10:18:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.389+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc011c220 con 0x7fcfc0133a70 2023-10-03T10:18:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.390+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc004f2a0 con 0x7fcfc0133a70 2023-10-03T10:18:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.390+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfb801c7e0 con 0x7fcfc0133a70 2023-10-03T10:18:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.391+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcfb80411f0 con 0x7fcfc0133a70 2023-10-03T10:18:22.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.395+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfb8023ba0 con 0x7fcfc0133a70 2023-10-03T10:18:22.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 Processor -- start 2023-10-03T10:18:22.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 -- start start 2023-10-03T10:18:22.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006b2d0 con 0x7ff230133ad0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230133610 con 0x7ff2301300a0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff23826b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff23009a500 con 0x7ff2301309f0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff235806700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.427+0000 7ff236007700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236808700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58090/0 (socket says 172.21.15.125:58090) 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff235806700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55282/0 (socket says 172.21.15.125:55282) 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 -- 172.21.15.125:0/3481537360 learned_addr learned my addr 172.21.15.125:0/3481537360 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 -- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 msgr2=0x7ff23013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 -- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 msgr2=0x7ff2301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 -- 172.21.15.125:0/3481537360 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2301338b0 con 0x7ff230133ad0 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff235806700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236808700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff236007700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230133ad0 0x7ff230133ea0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098f0 tx=0x7ff22c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef0f4af1edfac58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff235005700 1 -- 172.21.15.125:0/3481537360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c011830 con 0x7ff230133ad0 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff235005700 1 -- 172.21.15.125:0/3481537360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c011990 con 0x7ff230133ad0 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.428+0000 7ff235005700 1 -- 172.21.15.125:0/3481537360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c011d20 con 0x7ff230133ad0 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 -- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230133ad0 msgr2=0x7ff230133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230133ad0 0x7ff230133ea0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0098f0 tx=0x7ff22c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 -- 172.21.15.125:0/3481537360 shutdown_connections 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 --2- 172.21.15.125:0/3481537360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 -- 172.21.15.125:0/3481537360 >> 172.21.15.125:0/3481537360 conn(0x7ff230099c40 msgr2=0x7ff2300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 -- 172.21.15.125:0/3481537360 shutdown_connections 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.429+0000 7ff23826b700 1 -- 172.21.15.125:0/3481537360 wait complete. 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.430+0000 7ff23826b700 1 Processor -- start 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.430+0000 7ff23826b700 1 -- start start 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff23011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 0x7ff23011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23011fd00 con 0x7ff2301309f0 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23012dd00 con 0x7ff2301300a0 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff23826b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff230120950 con 0x7ff230133ad0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58106/0 (socket says 172.21.15.125:58106) 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 -- 172.21.15.125:0/2893966431 learned_addr learned my addr 172.21.15.125:0/2893966431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff236808700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 0x7ff23011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff236007700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff23011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 -- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 msgr2=0x7ff23011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 0x7ff23011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 -- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 msgr2=0x7ff23011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff23011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 -- 172.21.15.125:0/2893966431 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200094a0 con 0x7ff2301309f0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff236808700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 0x7ff23011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff236007700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff23011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff235806700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff22000ebe0 tx=0x7ff22000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.431+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220009800 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22000c850 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff228009a70 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22000cbc0 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c009550 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff22000cd20 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.432+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff22003fb40 con 0x7ff2301309f0 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.433+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23011eea0 con 0x7ff2301309f0 2023-10-03T10:18:22.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.441+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff22001adc0 con 0x7ff2301309f0 2023-10-03T10:18:22.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.596+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfc006bce0 con 0x7fcfc0133a70 2023-10-03T10:18:22.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.596+0000 7fcfb5ffb700 1 -- 172.21.15.125:0/3993307025 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfb8023970 con 0x7fcfc0133a70 2023-10-03T10:18:22.597 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 msgr2=0x7fcfc011b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc011b040 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8015000 tx=0x7fcfb8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 shutdown_connections 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcfc0133a70 0x7fcfc011b040 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfc00a08e0 0x7fcfc011a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 --2- 172.21.15.125:0/3993307025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfc00a1460 0x7fcfc011ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.598+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 >> 172.21.15.125:0/3993307025 conn(0x7fcfc00a2980 msgr2=0x7fcfc012f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.599+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 shutdown_connections 2023-10-03T10:18:22.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.599+0000 7fcfc799f700 1 -- 172.21.15.125:0/3993307025 wait complete. 2023-10-03T10:18:22.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:22.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.635+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff23004f2a0 con 0x7ff2301309f0 2023-10-03T10:18:22.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.635+0000 7ff226ffd700 1 -- 172.21.15.125:0/2893966431 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff220017020 con 0x7ff2301309f0 2023-10-03T10:18:22.635 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:22.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 msgr2=0x7ff23011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff22000ebe0 tx=0x7ff22000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 shutdown_connections 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff230133ad0 0x7ff23011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2301300a0 0x7ff23011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 --2- 172.21.15.125:0/2893966431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2301309f0 0x7ff23011df80 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 >> 172.21.15.125:0/2893966431 conn(0x7ff230099c40 msgr2=0x7ff23012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 shutdown_connections 2023-10-03T10:18:22.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:22.637+0000 7ff23826b700 1 -- 172.21.15.125:0/2893966431 wait complete. 2023-10-03T10:18:22.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:23.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 Processor -- start 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 -- start start 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 0x7fa4041359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 0x7fa404138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40409aaa0 con 0x7fa40409d860 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40409e730 con 0x7fa40409e340 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa408ef8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa40409f870 con 0x7fa404135f20 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa402d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 0x7fa404138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa40259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa40409d860 0x7fa40409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39948/0 (socket says 172.21.15.125:39948) 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa401d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 0x7fa4041359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.338+0000 7fa40259c700 1 -- 172.21.15.125:0/2405388838 learned_addr learned my addr 172.21.15.125:0/2405388838 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa402d9d700 1 -- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 msgr2=0x7fa4041359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa40159a700 1 -- 172.21.15.125:0/2405388838 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674666214 0 0) 0x7fa40409aaa0 con 0x7fa40409d860 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa402d9d700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 0x7fa4041359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa402d9d700 1 -- 172.21.15.125:0/2405388838 >> v1:172.21.15.125:6789/0 conn(0x7fa40409d860 legacy=0x7fa40409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa402d9d700 1 -- 172.21.15.125:0/2405388838 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40409b360 con 0x7fa404135f20 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa401d9b700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 0x7fa4041359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa402d9d700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 0x7fa404138300 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009df0 tx=0x7fa3fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c6427b49583977 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa40159a700 1 -- 172.21.15.125:0/2405388838 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00e070 con 0x7fa404135f20 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa40159a700 1 -- 172.21.15.125:0/2405388838 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00bae0 con 0x7fa404135f20 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.339+0000 7fa40159a700 1 -- 172.21.15.125:0/2405388838 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00be90 con 0x7fa404135f20 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 -- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 msgr2=0x7fa404138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 0x7fa404138300 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009df0 tx=0x7fa3fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 -- 172.21.15.125:0/2405388838 shutdown_connections 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa404135f20 0x7fa404138300 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 --2- 172.21.15.125:0/2405388838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409e340 0x7fa4041359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 -- 172.21.15.125:0/2405388838 >> 172.21.15.125:0/2405388838 conn(0x7fa404099c40 msgr2=0x7fa4040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 -- 172.21.15.125:0/2405388838 shutdown_connections 2023-10-03T10:18:23.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.340+0000 7fa408ef8700 1 -- 172.21.15.125:0/2405388838 wait complete. 2023-10-03T10:18:23.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.341+0000 7fa408ef8700 1 Processor -- start 2023-10-03T10:18:23.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.341+0000 7fa408ef8700 1 -- start start 2023-10-03T10:18:23.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa40409e340 0x7fa4041c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 0x7fa4041c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404125160 con 0x7fa404135f20 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa404125340 con 0x7fa40409d860 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa408ef8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa40411e4c0 con 0x7fa40409e340 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55306/0 (socket says 172.21.15.125:55306) 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa402d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 0x7fa4041c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 -- 172.21.15.125:0/3071150600 learned_addr learned my addr 172.21.15.125:0/3071150600 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa401d9b700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa40409e340 0x7fa4041c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 -- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa40409e340 msgr2=0x7fa4041c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa40409e340 0x7fa4041c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 -- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 msgr2=0x7fa4041c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 0x7fa4041c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 -- 172.21.15.125:0/3071150600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094a0 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa402d9d700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 0x7fa4041c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa40259c700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c550 tx=0x7fa3f400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.342+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4004c80 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.343+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f4004de0 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.343+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc009a70 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.343+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4007310 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.343+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4040a07f0 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.343+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3f4007470 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.344+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa3f403f220 con 0x7fa40409d860 2023-10-03T10:18:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.344+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40404f2a0 con 0x7fa40409d860 2023-10-03T10:18:23.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.348+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3f40123b0 con 0x7fa40409d860 2023-10-03T10:18:23.350 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 Processor -- start 2023-10-03T10:18:23.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 -- start start 2023-10-03T10:18:23.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 0x7f55fc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc09c970 con 0x7f55fc09f180 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0a0920 con 0x7f55fc131f40 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f5600a6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc09f9c0 con 0x7f55fc09e870 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.475+0000 7f55fa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 0x7f55fc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55312/0 (socket says 172.21.15.125:55312) 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 -- 172.21.15.125:0/3609070832 learned_addr learned my addr 172.21.15.125:0/3609070832 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 -- 172.21.15.125:0/3609070832 >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 msgr2=0x7f55fc139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 --2- 172.21.15.125:0/3609070832 >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 0x7f55fc139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 -- 172.21.15.125:0/3609070832 >> v1:172.21.15.125:6789/0 conn(0x7f55fc09f180 legacy=0x7f55fc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 -- 172.21.15.125:0/3609070832 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc09bab0 con 0x7f55fc09e870 2023-10-03T10:18:23.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fad9d700 1 --2- 172.21.15.125:0/3609070832 >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 0x7f55fc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55fa59c700 1 --2- 172.21.15.125:0/3609070832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0098f0 tx=0x7f55ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3757e529f9e1454 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55f959a700 1 -- 172.21.15.125:0/3609070832 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec011830 con 0x7f55fc09e870 2023-10-03T10:18:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55f959a700 1 -- 172.21.15.125:0/3609070832 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec011990 con 0x7f55fc09e870 2023-10-03T10:18:23.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.476+0000 7f55f959a700 1 -- 172.21.15.125:0/3609070832 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec011d20 con 0x7f55fc09e870 2023-10-03T10:18:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 -- 172.21.15.125:0/3609070832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 msgr2=0x7f55fc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 --2- 172.21.15.125:0/3609070832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0098f0 tx=0x7f55ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 -- 172.21.15.125:0/3609070832 shutdown_connections 2023-10-03T10:18:23.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 --2- 172.21.15.125:0/3609070832 >> v2:172.21.15.125:3300/0 conn(0x7f55fc131f40 0x7f55fc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 --2- 172.21.15.125:0/3609070832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc09ec40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 -- 172.21.15.125:0/3609070832 >> 172.21.15.125:0/3609070832 conn(0x7f55fc0a4430 msgr2=0x7f55fc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 -- 172.21.15.125:0/3609070832 shutdown_connections 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.477+0000 7f5600a6c700 1 -- 172.21.15.125:0/3609070832 wait complete. 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 Processor -- start 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 -- start start 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc11e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 0x7f55fc11e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc11fca0 con 0x7f55fc131f40 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1202c0 con 0x7f55fc09e870 2023-10-03T10:18:23.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f5600a6c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc120ef0 con 0x7f55fc09f180 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55f9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 0x7f55fc11e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55fad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55fad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58142/0 (socket says 172.21.15.125:58142) 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55fad9d700 1 -- 172.21.15.125:0/1607115518 learned_addr learned my addr 172.21.15.125:0/1607115518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55f9d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 0x7f55fc11e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56406/0 (socket says 172.21.15.125:56406) 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.478+0000 7f55fa59c700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc11e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 -- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 msgr2=0x7f55fc11e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 0x7f55fc11e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 -- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 msgr2=0x7f55fc11e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc11e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 -- 172.21.15.125:0/1607115518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f400f050 con 0x7f55fc131f40 2023-10-03T10:18:23.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55fad9d700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f55f400f500 tx=0x7f55f400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4012050 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4013040 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4003e40 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec009550 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.479+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0a2ed0 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.480+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55f4004030 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.480+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc04f2a0 con 0x7f55fc131f40 2023-10-03T10:18:23.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.480+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55f4044000 con 0x7f55fc131f40 2023-10-03T10:18:23.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.485+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55f40042e0 con 0x7f55fc131f40 2023-10-03T10:18:23.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.545+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa40406b280 con 0x7fa40409d860 2023-10-03T10:18:23.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.546+0000 7fa3f2ffd700 1 -- 172.21.15.125:0/3071150600 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3f4011360 con 0x7fa40409d860 2023-10-03T10:18:23.546 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 msgr2=0x7fa4041c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c550 tx=0x7fa3f400c860 comp rx=0 tx=0).stop 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 shutdown_connections 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa404135f20 0x7fa4041c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa40409d860 0x7fa4041c81b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 --2- 172.21.15.125:0/3071150600 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa40409e340 0x7fa4041c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 >> 172.21.15.125:0/3071150600 conn(0x7fa404099c40 msgr2=0x7fa4040a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 shutdown_connections 2023-10-03T10:18:23.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.548+0000 7fa408ef8700 1 -- 172.21.15.125:0/3071150600 wait complete. 2023-10-03T10:18:23.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:23.612 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:23.650 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:23.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.680+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55fc06b2a0 con 0x7f55fc131f40 2023-10-03T10:18:23.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.680+0000 7f55eaffd700 1 -- 172.21.15.125:0/1607115518 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55f4021360 con 0x7f55fc131f40 2023-10-03T10:18:23.681 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 msgr2=0x7f55fc11eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f55f400f500 tx=0x7f55f400f810 comp rx=0 tx=0).stop 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 shutdown_connections 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55fc131f40 0x7f55fc11eb60 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55fc09e870 0x7f55fc11e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 --2- 172.21.15.125:0/1607115518 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f55fc09f180 0x7f55fc11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.682+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 >> 172.21.15.125:0/1607115518 conn(0x7f55fc0a4430 msgr2=0x7f55fc06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.683+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 shutdown_connections 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.683+0000 7f5600a6c700 1 -- 172.21.15.125:0/1607115518 wait complete. 2023-10-03T10:18:23.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:23.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.737+0000 7f3b064d3700 1 Processor -- start 2023-10-03T10:18:23.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.737+0000 7f3b064d3700 1 -- start start 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b00133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0009e9d0 con 0x7f3b000a0a70 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0009dc00 con 0x7f3b000a1380 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b064d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0009dec0 con 0x7f3b00133f50 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b04a70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3afffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b00133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b04a70700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56416/0 (socket says 172.21.15.125:56416) 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b04a70700 1 -- 172.21.15.125:0/2242173934 learned_addr learned my addr 172.21.15.125:0/2242173934 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3afffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58154/0 (socket says 172.21.15.125:58154) 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 -- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 msgr2=0x7f3b001343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 -- 172.21.15.125:0/2242173934 >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 msgr2=0x7f3b000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/2242173934 >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 -- 172.21.15.125:0/2242173934 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0009e6a0 con 0x7f3b000a1380 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3afffff700 1 --2- 172.21.15.125:0/2242173934 >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3b04a70700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.738+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b00133a10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009840 tx=0x7f3af4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0063b91f2896cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3afeffd700 1 -- 172.21.15.125:0/2242173934 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011830 con 0x7f3b000a1380 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3afeffd700 1 -- 172.21.15.125:0/2242173934 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4011990 con 0x7f3b000a1380 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3afeffd700 1 -- 172.21.15.125:0/2242173934 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011d20 con 0x7f3b000a1380 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 -- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 msgr2=0x7f3b00133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b00133a10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009840 tx=0x7f3af4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 -- 172.21.15.125:0/2242173934 shutdown_connections 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b00133f50 0x7f3b001343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 --2- 172.21.15.125:0/2242173934 >> v2:172.21.15.125:3300/0 conn(0x7f3b000a0a70 0x7f3b000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 --2- 172.21.15.125:0/2242173934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b00133a10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 -- 172.21.15.125:0/2242173934 >> 172.21.15.125:0/2242173934 conn(0x7f3b000a6610 msgr2=0x7f3b000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 -- 172.21.15.125:0/2242173934 shutdown_connections 2023-10-03T10:18:23.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.739+0000 7f3b064d3700 1 -- 172.21.15.125:0/2242173934 wait complete. 2023-10-03T10:18:23.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.740+0000 7f3b064d3700 1 Processor -- start 2023-10-03T10:18:23.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.740+0000 7f3b064d3700 1 -- start start 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001241a0 con 0x7f3b00133f50 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00124eb0 con 0x7f3b000a1380 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b064d3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00125270 con 0x7f3b000a0a70 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b04a70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3afffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b04a70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58164/0 (socket says 172.21.15.125:58164) 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3afffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56428/0 (socket says 172.21.15.125:56428) 2023-10-03T10:18:23.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b04a70700 1 -- 172.21.15.125:0/1037868839 learned_addr learned my addr 172.21.15.125:0/1037868839 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55342/0 (socket says 172.21.15.125:55342) 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 -- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 msgr2=0x7f3b001224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 -- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 msgr2=0x7f3b00122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3aff7fe700 1 -- 172.21.15.125:0/1037868839 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00094a0 con 0x7f3b000a1380 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3afffff700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.741+0000 7f3b04a70700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3aff7fe700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3af4016000 tx=0x7f3af4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4004450 con 0x7f3b000a1380 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af401f070 con 0x7f3b000a1380 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40038e0 con 0x7f3b000a1380 2023-10-03T10:18:23.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af8009b30 con 0x7f3b000a1380 2023-10-03T10:18:23.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.742+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af40094a0 con 0x7f3b000a1380 2023-10-03T10:18:23.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.743+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3af4003a40 con 0x7f3b000a1380 2023-10-03T10:18:23.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.743+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3af4021070 con 0x7f3b000a1380 2023-10-03T10:18:23.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.743+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0004f2a0 con 0x7f3b000a1380 2023-10-03T10:18:23.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.751+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3af4015080 con 0x7f3b000a1380 2023-10-03T10:18:23.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 Processor -- start 2023-10-03T10:18:23.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 -- start start 2023-10-03T10:18:23.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba409aaa0 con 0x7fbba4130ce0 2023-10-03T10:18:23.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba409f870 con 0x7fbba409d860 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.785+0000 7fbbaaaf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbba409b360 con 0x7fbba409e170 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba8892700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56438/0 (socket says 172.21.15.125:56438) 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 -- 172.21.15.125:0/1029599691 learned_addr learned my addr 172.21.15.125:0/1029599691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba8892700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58166/0 (socket says 172.21.15.125:58166) 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 -- 172.21.15.125:0/1029599691 >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 msgr2=0x7fbba409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 --2- 172.21.15.125:0/1029599691 >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 -- 172.21.15.125:0/1029599691 >> v1:172.21.15.125:6789/0 conn(0x7fbba4130ce0 legacy=0x7fbba41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 -- 172.21.15.125:0/1029599691 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba409b620 con 0x7fbba409e170 2023-10-03T10:18:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba8892700 1 --2- 172.21.15.125:0/1029599691 >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba3fff700 1 --2- 172.21.15.125:0/1029599691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbb900098f0 tx=0x7fbb90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214cdcee75464c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba37fe700 1 -- 172.21.15.125:0/1029599691 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011830 con 0x7fbba409e170 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba37fe700 1 -- 172.21.15.125:0/1029599691 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90011990 con 0x7fbba409e170 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.786+0000 7fbba37fe700 1 -- 172.21.15.125:0/1029599691 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011d20 con 0x7fbba409e170 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/1029599691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 msgr2=0x7fbba41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/1029599691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbb900098f0 tx=0x7fbb90009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/1029599691 shutdown_connections 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/1029599691 >> v2:172.21.15.125:3300/0 conn(0x7fbba409d860 0x7fbba409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/1029599691 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba409e170 0x7fbba41307a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/1029599691 >> 172.21.15.125:0/1029599691 conn(0x7fbba4099c40 msgr2=0x7fbba40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/1029599691 shutdown_connections 2023-10-03T10:18:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.787+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/1029599691 wait complete. 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.788+0000 7fbbaaaf6700 1 Processor -- start 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.788+0000 7fbbaaaf6700 1 -- start start 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 0x7fbba411e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40a2140 con 0x7fbba409e170 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4121ea0 con 0x7fbba409d860 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbbaaaf6700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbba41305c0 con 0x7fbba4130ce0 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba9093700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba8892700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 0x7fbba411e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58168/0 (socket says 172.21.15.125:58168) 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 -- 172.21.15.125:0/2037873077 learned_addr learned my addr 172.21.15.125:0/2037873077 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba9093700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56446/0 (socket says 172.21.15.125:56446) 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 -- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 msgr2=0x7fbba411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 -- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 msgr2=0x7fbba411e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 0x7fbba411e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.789+0000 7fbba3fff700 1 -- 172.21.15.125:0/2037873077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9800b740 con 0x7fbba409e170 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba9093700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba8892700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 0x7fbba411e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba3fff700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000c00 tx=0x7fbb90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900036a0 con 0x7fbba409e170 2023-10-03T10:18:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90003800 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb90009550 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90003bb0 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.790+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba4120380 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.791+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb90021070 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.791+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb90040b40 con 0x7fbba409e170 2023-10-03T10:18:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.791+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba4121b40 con 0x7fbba409e170 2023-10-03T10:18:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.796+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb90040e60 con 0x7fbba409e170 2023-10-03T10:18:23.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.945+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3b00072980 con 0x7f3b000a1380 2023-10-03T10:18:23.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.945+0000 7f3afcff9700 1 -- 172.21.15.125:0/1037868839 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3af402b020 con 0x7f3b000a1380 2023-10-03T10:18:23.945 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 msgr2=0x7f3b001229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3af4016000 tx=0x7f3af4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 shutdown_connections 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b00133f50 0x7f3b00122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3b000a0a70 0x7f3b001224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 --2- 172.21.15.125:0/1037868839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b000a1380 0x7f3b001229f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 >> 172.21.15.125:0/1037868839 conn(0x7f3b000a6610 msgr2=0x7f3b0009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 shutdown_connections 2023-10-03T10:18:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.947+0000 7f3b064d3700 1 -- 172.21.15.125:0/1037868839 wait complete. 2023-10-03T10:18:23.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:23.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.988+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbba404f2a0 con 0x7fbba409e170 2023-10-03T10:18:23.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.988+0000 7fbba17fa700 1 -- 172.21.15.125:0/2037873077 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbba4121b40 con 0x7fbba409e170 2023-10-03T10:18:23.989 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 msgr2=0x7fbba411eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000c00 tx=0x7fbb90004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 shutdown_connections 2023-10-03T10:18:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbba4130ce0 0x7fbba411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba409d860 0x7fbba411e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 --2- 172.21.15.125:0/2037873077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba409e170 0x7fbba411eba0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 >> 172.21.15.125:0/2037873077 conn(0x7fbba4099c40 msgr2=0x7fbba40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 shutdown_connections 2023-10-03T10:18:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:23.991+0000 7fbbaaaf6700 1 -- 172.21.15.125:0/2037873077 wait complete. 2023-10-03T10:18:24.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:24.562 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:24.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.689+0000 7fc687b47700 1 Processor -- start 2023-10-03T10:18:24.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 -- start start 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc680133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68009fa00 con 0x7fc680134160 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800a0370 con 0x7fc68009e870 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc687b47700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68006bec0 con 0x7fc68009f180 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6858e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6850e2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc680133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6860e4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc680134160 0x7fc68013ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39974/0 (socket says 172.21.15.125:39974) 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6860e4700 1 -- 172.21.15.125:0/902437138 learned_addr learned my addr 172.21.15.125:0/902437138 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6858e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58182/0 (socket says 172.21.15.125:58182) 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6850e2700 1 -- 172.21.15.125:0/902437138 >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 msgr2=0x7fc68009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6850e2700 1 --2- 172.21.15.125:0/902437138 >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6850e2700 1 -- 172.21.15.125:0/902437138 >> v1:172.21.15.125:6789/0 conn(0x7fc680134160 legacy=0x7fc68013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6850e2700 1 -- 172.21.15.125:0/902437138 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68009ada0 con 0x7fc68009f180 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.690+0000 7fc6858e3700 1 --2- 172.21.15.125:0/902437138 >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc6850e2700 1 --2- 172.21.15.125:0/902437138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc680133c20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009840 tx=0x7fc67c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b1dd7789be59ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc6848e1700 1 -- 172.21.15.125:0/902437138 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c011830 con 0x7fc68009f180 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc6848e1700 1 -- 172.21.15.125:0/902437138 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c011990 con 0x7fc68009f180 2023-10-03T10:18:24.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc6848e1700 1 -- 172.21.15.125:0/902437138 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c011d20 con 0x7fc68009f180 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 -- 172.21.15.125:0/902437138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 msgr2=0x7fc680133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 --2- 172.21.15.125:0/902437138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc680133c20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009840 tx=0x7fc67c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 -- 172.21.15.125:0/902437138 shutdown_connections 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 --2- 172.21.15.125:0/902437138 >> v2:172.21.15.125:3300/0 conn(0x7fc68009e870 0x7fc68009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 --2- 172.21.15.125:0/902437138 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc680133c20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 -- 172.21.15.125:0/902437138 >> 172.21.15.125:0/902437138 conn(0x7fc6800a4430 msgr2=0x7fc6800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 -- 172.21.15.125:0/902437138 shutdown_connections 2023-10-03T10:18:24.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.691+0000 7fc687b47700 1 -- 172.21.15.125:0/902437138 wait complete. 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.692+0000 7fc687b47700 1 Processor -- start 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.692+0000 7fc687b47700 1 -- start start 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc68011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc680134160 0x7fc68011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801332f0 con 0x7fc68009e870 2023-10-03T10:18:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68006cfa0 con 0x7fc68009f180 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc680120b60 con 0x7fc680134160 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6858e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc68011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6858e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58196/0 (socket says 172.21.15.125:58196) 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6858e3700 1 -- 172.21.15.125:0/3796460415 learned_addr learned my addr 172.21.15.125:0/3796460415 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6860e4700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc680134160 0x7fc68011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 -- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc680134160 msgr2=0x7fc68011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc680134160 0x7fc68011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 -- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 msgr2=0x7fc68011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 -- 172.21.15.125:0/3796460415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700094a0 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6858e3700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6850e2700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc68011f010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc67c016000 tx=0x7fc67c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0036a0 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c01f070 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c003a60 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c0094a0 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.693+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc680121ee0 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.694+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc67c003bc0 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.694+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc67c021070 con 0x7fc68009f180 2023-10-03T10:18:24.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.694+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68004f2a0 con 0x7fc68009f180 2023-10-03T10:18:24.699 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:24.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.699+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc67c015020 con 0x7fc68009f180 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.821+0000 7f25fab62700 1 Processor -- start 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.821+0000 7f25fab62700 1 -- start start 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25fab62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25fab62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25fab62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f406b2d0 con 0x7f25f41300a0 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25fab62700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4133610 con 0x7f25f4133ad0 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25fab62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f409a500 con 0x7f25f4130bc0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f88fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55372/0 (socket says 172.21.15.125:55372) 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f88fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58200/0 (socket says 172.21.15.125:58200) 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 -- 172.21.15.125:0/1090577180 learned_addr learned my addr 172.21.15.125:0/1090577180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f3fff700 1 --1- 172.21.15.125:0/1090577180 >> v1:172.21.15.125:6789/0 conn(0x7f25f41300a0 0x7f25f41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39990/0 (socket says 172.21.15.125:39990) 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 -- 172.21.15.125:0/1090577180 >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 msgr2=0x7f25f4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 --2- 172.21.15.125:0/1090577180 >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 -- 172.21.15.125:0/1090577180 >> v1:172.21.15.125:6789/0 conn(0x7f25f41300a0 legacy=0x7f25f41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 -- 172.21.15.125:0/1090577180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f41338b0 con 0x7f25f4130bc0 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f88fe700 1 --2- 172.21.15.125:0/1090577180 >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f90ff700 1 --2- 172.21.15.125:0/1090577180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009e50 tx=0x7f25ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdafdfa1544918f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f37fe700 1 -- 172.21.15.125:0/1090577180 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00e070 con 0x7f25f4130bc0 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f37fe700 1 -- 172.21.15.125:0/1090577180 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00b910 con 0x7f25f4130bc0 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.822+0000 7f25f37fe700 1 -- 172.21.15.125:0/1090577180 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00bcc0 con 0x7f25f4130bc0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 -- 172.21.15.125:0/1090577180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 msgr2=0x7f25f413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 --2- 172.21.15.125:0/1090577180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009e50 tx=0x7f25ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 -- 172.21.15.125:0/1090577180 shutdown_connections 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 --2- 172.21.15.125:0/1090577180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 --2- 172.21.15.125:0/1090577180 >> v2:172.21.15.125:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 -- 172.21.15.125:0/1090577180 >> 172.21.15.125:0/1090577180 conn(0x7f25f4099c40 msgr2=0x7f25f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 -- 172.21.15.125:0/1090577180 shutdown_connections 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.823+0000 7f25fab62700 1 -- 172.21.15.125:0/1090577180 wait complete. 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 Processor -- start 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 -- start start 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f411f040 con 0x7f25f4133ad0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4120050 con 0x7f25f41300a0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.824+0000 7f25fab62700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f412f800 con 0x7f25f4130bc0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56470/0 (socket says 172.21.15.125:56470) 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 -- 172.21.15.125:0/1967948710 learned_addr learned my addr 172.21.15.125:0/1967948710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f90ff700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f88fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 -- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 msgr2=0x7f25f411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 -- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 msgr2=0x7f25f411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 -- 172.21.15.125:0/1967948710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80094a0 con 0x7f25f4130bc0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f90ff700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f88fe700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f3fff700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c550 tx=0x7f25e000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0005cb0 con 0x7f25f4130bc0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0005e10 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00072d0 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec009b30 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.825+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f411f840 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.826+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e0007430 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.826+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25e003e830 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.826+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f409cb20 con 0x7f25f4130bc0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.831+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e0017080 con 0x7f25f4130bc0 2023-10-03T10:18:24.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.890+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc68006c9d0 con 0x7fc68009f180 2023-10-03T10:18:24.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.891+0000 7fc6767fc700 1 -- 172.21.15.125:0/3796460415 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc67c015020 con 0x7fc68009f180 2023-10-03T10:18:24.891 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:24.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 msgr2=0x7fc68011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc68011f010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc67c016000 tx=0x7fc67c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 shutdown_connections 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc680134160 0x7fc68011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68009e870 0x7fc68011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 --2- 172.21.15.125:0/3796460415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc68009f180 0x7fc68011f010 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 >> 172.21.15.125:0/3796460415 conn(0x7fc6800a4430 msgr2=0x7fc68009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 shutdown_connections 2023-10-03T10:18:24.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:24.893+0000 7fc687b47700 1 -- 172.21.15.125:0/3796460415 wait complete. 2023-10-03T10:18:24.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:24.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:25.004 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.022+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25f411f7e0 con 0x7f25f4130bc0 2023-10-03T10:18:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.023+0000 7f25f17fa700 1 -- 172.21.15.125:0/1967948710 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e00076e0 con 0x7f25f4130bc0 2023-10-03T10:18:25.023 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 msgr2=0x7f25f411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c550 tx=0x7f25e000c860 comp rx=0 tx=0).stop 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 shutdown_connections 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 --2- 172.21.15.125:0/1967948710 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 >> 172.21.15.125:0/1967948710 conn(0x7f25f4099c40 msgr2=0x7f25f4132bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 shutdown_connections 2023-10-03T10:18:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.025+0000 7f25fab62700 1 -- 172.21.15.125:0/1967948710 wait complete. 2023-10-03T10:18:25.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:25.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.088+0000 7fdb0aaa3700 1 Processor -- start 2023-10-03T10:18:25.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.088+0000 7fdb0aaa3700 1 -- start start 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0aaa3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb040a1550 0x7fdb04138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0aaa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb0413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0aaa3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0409e9d0 con 0x7fdb040a0a70 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0aaa3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0409dc00 con 0x7fdb040a1550 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0aaa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0409dec0 con 0x7fdb04139200 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb040a1550 0x7fdb04138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0883f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdb040a0a70 0x7fdb040a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39998/0 (socket says 172.21.15.125:39998) 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb0883f700 1 -- 172.21.15.125:0/1924545365 learned_addr learned my addr 172.21.15.125:0/1924545365 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb09040700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb0413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb037fe700 1 -- 172.21.15.125:0/1924545365 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584365652 0 0) 0x7fdb0409e9d0 con 0x7fdb040a0a70 2023-10-03T10:18:25.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb037fe700 1 -- 172.21.15.125:0/1924545365 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf40035b0 con 0x7fdb040a0a70 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 -- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 msgr2=0x7fdb0413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 --2- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb0413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 -- 172.21.15.125:0/1924545365 >> v1:172.21.15.125:6789/0 conn(0x7fdb040a0a70 legacy=0x7fdb040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 -- 172.21.15.125:0/1924545365 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0409e6a0 con 0x7fdb040a1550 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb03fff700 1 --2- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a1550 0x7fdb04138cc0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009840 tx=0x7fdaf0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1f2ca240dbd3fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb037fe700 1 -- 172.21.15.125:0/1924545365 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0011830 con 0x7fdb040a1550 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb037fe700 1 -- 172.21.15.125:0/1924545365 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf0011990 con 0x7fdb040a1550 2023-10-03T10:18:25.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.089+0000 7fdb037fe700 1 -- 172.21.15.125:0/1924545365 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0011d20 con 0x7fdb040a1550 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a1550 msgr2=0x7fdb04138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a1550 0x7fdb04138cc0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009840 tx=0x7fdaf0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/1924545365 shutdown_connections 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb0413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/1924545365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a1550 0x7fdb04138cc0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/1924545365 >> 172.21.15.125:0/1924545365 conn(0x7fdb040a6610 msgr2=0x7fdb040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/1924545365 shutdown_connections 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.090+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/1924545365 wait complete. 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.091+0000 7fdb0aaa3700 1 Processor -- start 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.091+0000 7fdb0aaa3700 1 -- start start 2023-10-03T10:18:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb04121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04135fe0 con 0x7fdb040a0a70 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041365a0 con 0x7fdb04139200 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041241d0 con 0x7fdb040a1550 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0883f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:56484/0 (socket says 172.21.15.125:56484) 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0883f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58212/0 (socket says 172.21.15.125:58212) 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 -- 172.21.15.125:0/124065487 learned_addr learned my addr 172.21.15.125:0/124065487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb09040700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb04121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 -- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 msgr2=0x7fdb04121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb04121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 -- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 msgr2=0x7fdb04120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 -- 172.21.15.125:0/124065487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00094a0 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0883f700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb03fff700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00090b0 tx=0x7fdaf0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0004590 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf001f070 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb040a5100 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00038e0 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.092+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb04122ac0 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.093+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaf0003a40 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.093+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdaf0021070 con 0x7fdb040a1550 2023-10-03T10:18:25.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.093+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0404f2a0 con 0x7fdb040a1550 2023-10-03T10:18:25.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.098+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaf0015080 con 0x7fdb040a1550 2023-10-03T10:18:25.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 Processor -- start 2023-10-03T10:18:25.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 -- start start 2023-10-03T10:18:25.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c09b110 con 0x7fbf0c09ad40 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0a3b60 con 0x7fbf0c134570 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf12b2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0a1a80 con 0x7fbf0c134140 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf110c9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf110c9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:55392/0 (socket says 172.21.15.125:55392) 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf110c9700 1 -- 172.21.15.125:0/4348618 learned_addr learned my addr 172.21.15.125:0/4348618 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.144+0000 7fbf0bfff700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf0b7fe700 1 -- 172.21.15.125:0/4348618 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226904519 0 0) 0x7fbf0c09b110 con 0x7fbf0c09ad40 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf110c9700 1 -- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 msgr2=0x7fbf0c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf110c9700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf110c9700 1 -- 172.21.15.125:0/4348618 >> v1:172.21.15.125:6789/0 conn(0x7fbf0c09ad40 legacy=0x7fbf0c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf110c9700 1 -- 172.21.15.125:0/4348618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0a2fa0 con 0x7fbf0c134570 2023-10-03T10:18:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf110c9700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009eb0 tx=0x7fbf0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605b2f42038c1a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf0b7fe700 1 -- 172.21.15.125:0/4348618 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400e070 con 0x7fbf0c134570 2023-10-03T10:18:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf0b7fe700 1 -- 172.21.15.125:0/4348618 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400b8d0 con 0x7fbf0c134570 2023-10-03T10:18:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf0b7fe700 1 -- 172.21.15.125:0/4348618 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400bc80 con 0x7fbf0c134570 2023-10-03T10:18:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf12b2c700 1 -- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 msgr2=0x7fbf0c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.145+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009eb0 tx=0x7fbf0400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 -- 172.21.15.125:0/4348618 shutdown_connections 2023-10-03T10:18:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c134570 0x7fbf0c13b3d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/4348618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 -- 172.21.15.125:0/4348618 >> 172.21.15.125:0/4348618 conn(0x7fbf0c099c40 msgr2=0x7fbf0c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 -- 172.21.15.125:0/4348618 shutdown_connections 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 -- 172.21.15.125:0/4348618 wait complete. 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 Processor -- start 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.146+0000 7fbf12b2c700 1 -- start start 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c09ad40 0x7fbf0c139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c1399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c09c7e0 con 0x7fbf0c134570 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c09e490 con 0x7fbf0c09ad40 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf12b2c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c11d700 con 0x7fbf0c134140 2023-10-03T10:18:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58214/0 (socket says 172.21.15.125:58214) 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 -- 172.21.15.125:0/749342729 learned_addr learned my addr 172.21.15.125:0/749342729 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf108c8700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c09ad40 0x7fbf0c139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf0bfff700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c1399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 -- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 msgr2=0x7fbf0c1399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c1399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 -- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c09ad40 msgr2=0x7fbf0c139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c09ad40 0x7fbf0c139470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.147+0000 7fbf110c9700 1 -- 172.21.15.125:0/749342729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009b30 con 0x7fbf0c134570 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf110c9700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c09cca0 tx=0x7fbf04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04004450 con 0x7fbf0c134570 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf040045b0 con 0x7fbf0c134570 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c11e540 con 0x7fbf0c134570 2023-10-03T10:18:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04004940 con 0x7fbf0c134570 2023-10-03T10:18:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.148+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c11f2b0 con 0x7fbf0c134570 2023-10-03T10:18:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.149+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf0401c410 con 0x7fbf0c134570 2023-10-03T10:18:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.149+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c1361e0 con 0x7fbf0c134570 2023-10-03T10:18:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.149+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf04041480 con 0x7fbf0c134570 2023-10-03T10:18:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.153+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf0402d7a0 con 0x7fbf0c134570 2023-10-03T10:18:25.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.331+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb04072980 con 0x7fdb040a1550 2023-10-03T10:18:25.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.332+0000 7fdb017fa700 1 -- 172.21.15.125:0/124065487 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaf0010380 con 0x7fdb040a1550 2023-10-03T10:18:25.332 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:25.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 msgr2=0x7fdb04120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00090b0 tx=0x7fdaf0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:25.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 shutdown_connections 2023-10-03T10:18:25.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb04139200 0x7fdb04121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb040a0a70 0x7fdb04120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 --2- 172.21.15.125:0/124065487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdb040a1550 0x7fdb04120c40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 >> 172.21.15.125:0/124065487 conn(0x7fdb040a6610 msgr2=0x7fdb040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 shutdown_connections 2023-10-03T10:18:25.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.334+0000 7fdb0aaa3700 1 -- 172.21.15.125:0/124065487 wait complete. 2023-10-03T10:18:25.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:25.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.371+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf0c11e950 con 0x7fbf0c134570 2023-10-03T10:18:25.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.371+0000 7fbf097fa700 1 -- 172.21.15.125:0/749342729 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf0401a3c0 con 0x7fbf0c134570 2023-10-03T10:18:25.372 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 msgr2=0x7fbf0c139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c09cca0 tx=0x7fbf04004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 shutdown_connections 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf0c134570 0x7fbf0c139ef0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf0c09ad40 0x7fbf0c139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 --2- 172.21.15.125:0/749342729 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fbf0c134140 0x7fbf0c1399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 >> 172.21.15.125:0/749342729 conn(0x7fbf0c099c40 msgr2=0x7fbf0c13b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 shutdown_connections 2023-10-03T10:18:25.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:25.373+0000 7fbf12b2c700 1 -- 172.21.15.125:0/749342729 wait complete. 2023-10-03T10:18:25.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:25.906 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:26.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.030+0000 7f96215ce700 1 Processor -- start 2023-10-03T10:18:26.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.030+0000 7f96215ce700 1 -- start start 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f96215ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f96215ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 0x7f961c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f96215ce700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c06b5c0 con 0x7f961c131a00 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f96215ce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c06e900 con 0x7f961c09dec0 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f96215ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f961c09d180 con 0x7f961c06a770 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f961c131a00 0x7f961c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45092/0 (socket says 172.21.15.125:45092) 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961a7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 0x7f961c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961b7fe700 1 -- 172.21.15.125:0/473690267 learned_addr learned my addr 172.21.15.125:0/473690267 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f9619ffb700 1 -- 172.21.15.125:0/473690267 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131116216 0 0) 0x7f961c06b5c0 con 0x7f961c131a00 2023-10-03T10:18:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 -- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 msgr2=0x7f961c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 0x7f961c06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 -- 172.21.15.125:0/473690267 >> v1:172.21.15.125:6789/0 conn(0x7f961c131a00 legacy=0x7f961c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 -- 172.21.15.125:0/473690267 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c09e780 con 0x7f961c06a770 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961a7fc700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 0x7f961c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f961affd700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c06ab40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9614009870 tx=0x7f9614009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa600d8d86f2218 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.031+0000 7f9619ffb700 1 -- 172.21.15.125:0/473690267 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614011830 con 0x7f961c06a770 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f9619ffb700 1 -- 172.21.15.125:0/473690267 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614011990 con 0x7f961c06a770 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f9619ffb700 1 -- 172.21.15.125:0/473690267 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614011d20 con 0x7f961c06a770 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 -- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 msgr2=0x7f961c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c06ab40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9614009870 tx=0x7f9614009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 -- 172.21.15.125:0/473690267 shutdown_connections 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c06ab40 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 --2- 172.21.15.125:0/473690267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c09dec0 0x7f961c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 -- 172.21.15.125:0/473690267 >> 172.21.15.125:0/473690267 conn(0x7f961c099c40 msgr2=0x7f961c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 -- 172.21.15.125:0/473690267 shutdown_connections 2023-10-03T10:18:26.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.032+0000 7f96215ce700 1 -- 172.21.15.125:0/473690267 wait complete. 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.033+0000 7f96215ce700 1 Processor -- start 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 -- start start 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 0x7f961c11a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c131a00 0x7f961c11a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c11d920 con 0x7f961c09dec0 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c11c030 con 0x7f961c131a00 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f96215ce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f961c11ccf0 con 0x7f961c06a770 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f961a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 0x7f961c11a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f961affd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f961a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 0x7f961c11a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51556/0 (socket says 172.21.15.125:51556) 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f961a7fc700 1 -- 172.21.15.125:0/35945476 learned_addr learned my addr 172.21.15.125:0/35945476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.034+0000 7f961b7fe700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c131a00 0x7f961c11a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 -- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c131a00 msgr2=0x7f961c11a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c131a00 0x7f961c11a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 -- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 msgr2=0x7f961c11a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 0x7f961c11a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 -- 172.21.15.125:0/35945476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100094a0 con 0x7f961c06a770 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f961affd700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c119e50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9614016000 tx=0x7f9614004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614004510 con 0x7f961c06a770 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961401f070 con 0x7f961c06a770 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140094a0 con 0x7f961c06a770 2023-10-03T10:18:26.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140038e0 con 0x7f961c06a770 2023-10-03T10:18:26.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.035+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c071ce0 con 0x7f961c06a770 2023-10-03T10:18:26.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.036+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9614003a40 con 0x7f961c06a770 2023-10-03T10:18:26.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.036+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9614021070 con 0x7f961c06a770 2023-10-03T10:18:26.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.036+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c11d4a0 con 0x7f961c06a770 2023-10-03T10:18:26.039 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:26.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.041+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f961c11d4a0 con 0x7f961c06a770 2023-10-03T10:18:26.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.163+0000 7f2f20272700 1 Processor -- start 2023-10-03T10:18:26.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.163+0000 7f2f20272700 1 -- start start 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f20272700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f20272700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 0x7f2f180a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f20272700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1809b110 con 0x7f2f18133f70 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f20272700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180a3b60 con 0x7f2f181343a0 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f20272700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180a2fa0 con 0x7f2f1809ad40 2023-10-03T10:18:26.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57718/0 (socket says 172.21.15.125:57718) 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 -- 172.21.15.125:0/2682255241 learned_addr learned my addr 172.21.15.125:0/2682255241 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e80f700 1 --2- 172.21.15.125:0/2682255241 >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 0x7f2f180a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 -- 172.21.15.125:0/2682255241 >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 msgr2=0x7f2f180a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 --2- 172.21.15.125:0/2682255241 >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 0x7f2f180a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 -- 172.21.15.125:0/2682255241 >> v1:172.21.15.125:6789/0 conn(0x7f2f18133f70 legacy=0x7f2f180a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e00e700 1 -- 172.21.15.125:0/2682255241 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1809a280 con 0x7f2f1809ad40 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.164+0000 7f2f1e80f700 1 --2- 172.21.15.125:0/2682255241 >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 0x7f2f180a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f1e00e700 1 --2- 172.21.15.125:0/2682255241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009920 tx=0x7f2f14009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=398fe9d6484319d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f1d00c700 1 -- 172.21.15.125:0/2682255241 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011830 con 0x7f2f1809ad40 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f1d00c700 1 -- 172.21.15.125:0/2682255241 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14011990 con 0x7f2f1809ad40 2023-10-03T10:18:26.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f1d00c700 1 -- 172.21.15.125:0/2682255241 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011d20 con 0x7f2f1809ad40 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 -- 172.21.15.125:0/2682255241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 msgr2=0x7f2f18133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 --2- 172.21.15.125:0/2682255241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009920 tx=0x7f2f14009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 -- 172.21.15.125:0/2682255241 shutdown_connections 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 --2- 172.21.15.125:0/2682255241 >> v2:172.21.15.125:3300/0 conn(0x7f2f181343a0 0x7f2f180a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 --2- 172.21.15.125:0/2682255241 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f1809ad40 0x7f2f18133a30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 -- 172.21.15.125:0/2682255241 >> 172.21.15.125:0/2682255241 conn(0x7f2f18099c40 msgr2=0x7f2f1806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 -- 172.21.15.125:0/2682255241 shutdown_connections 2023-10-03T10:18:26.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.165+0000 7f2f20272700 1 -- 172.21.15.125:0/2682255241 wait complete. 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.166+0000 7f2f20272700 1 Processor -- start 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.166+0000 7f2f20272700 1 -- start start 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f18133f70 0x7f2f1811e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181219c0 con 0x7f2f181343a0 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1811fea0 con 0x7f2f1809ad40 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180a4530 con 0x7f2f18133f70 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e80f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38956/0 (socket says 172.21.15.125:38956) 2023-10-03T10:18:26.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e80f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51574/0 (socket says 172.21.15.125:51574) 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 -- 172.21.15.125:0/539107880 learned_addr learned my addr 172.21.15.125:0/539107880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1d80d700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f18133f70 0x7f2f1811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 -- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f18133f70 msgr2=0x7f2f1811e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f18133f70 0x7f2f1811e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 -- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 msgr2=0x7f2f1811ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 -- 172.21.15.125:0/539107880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10009a70 con 0x7f2f1809ad40 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e80f700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f1e00e700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009130 tx=0x7f2f14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140044d0 con 0x7f2f1809ad40 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1401e070 con 0x7f2f1809ad40 2023-10-03T10:18:26.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.167+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f14009550 con 0x7f2f1809ad40 2023-10-03T10:18:26.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.168+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140038e0 con 0x7f2f1809ad40 2023-10-03T10:18:26.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.168+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f18120fe0 con 0x7f2f1809ad40 2023-10-03T10:18:26.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.168+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1804f2a0 con 0x7f2f1809ad40 2023-10-03T10:18:26.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.169+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f14003a40 con 0x7f2f1809ad40 2023-10-03T10:18:26.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.169+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f14020070 con 0x7f2f1809ad40 2023-10-03T10:18:26.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.173+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f140243e0 con 0x7f2f1809ad40 2023-10-03T10:18:26.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.252+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f961c130ff0 con 0x7f961c06a770 2023-10-03T10:18:26.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.252+0000 7f96037fe700 1 -- 172.21.15.125:0/35945476 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9614015030 con 0x7f961c06a770 2023-10-03T10:18:26.253 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 msgr2=0x7f961c119e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c119e50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9614016000 tx=0x7f9614004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 shutdown_connections 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f961c131a00 0x7f961c11a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f961c06a770 0x7f961c119e50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 --2- 172.21.15.125:0/35945476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c09dec0 0x7f961c11a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 >> 172.21.15.125:0/35945476 conn(0x7f961c099c40 msgr2=0x7f961c12ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 shutdown_connections 2023-10-03T10:18:26.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.254+0000 7f96215ce700 1 -- 172.21.15.125:0/35945476 wait complete. 2023-10-03T10:18:26.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:26.348 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:26.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.381+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f180729d0 con 0x7f2f1809ad40 2023-10-03T10:18:26.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.381+0000 7f2f0effd700 1 -- 172.21.15.125:0/539107880 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f14010b70 con 0x7f2f1809ad40 2023-10-03T10:18:26.382 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 msgr2=0x7f2f1811e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009130 tx=0x7f2f14004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 shutdown_connections 2023-10-03T10:18:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f181343a0 0x7f2f1811ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f1809ad40 0x7f2f1811e180 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 --2- 172.21.15.125:0/539107880 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2f18133f70 0x7f2f1811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 >> 172.21.15.125:0/539107880 conn(0x7f2f18099c40 msgr2=0x7f2f18133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 shutdown_connections 2023-10-03T10:18:26.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.383+0000 7f2f20272700 1 -- 172.21.15.125:0/539107880 wait complete. 2023-10-03T10:18:26.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:26.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:26.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 Processor -- start 2023-10-03T10:18:26.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 -- start start 2023-10-03T10:18:26.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe50c09f180 0x7fe50c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0a0920 con 0x7fe50c09f180 2023-10-03T10:18:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c09c970 con 0x7fe50c131d70 2023-10-03T10:18:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.474+0000 7fe5147cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c09bab0 con 0x7fe50c09e870 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe51256b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe51256b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57722/0 (socket says 172.21.15.125:57722) 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe51256b700 1 -- 172.21.15.125:0/2113305611 learned_addr learned my addr 172.21.15.125:0/2113305611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 --2- 172.21.15.125:0/2113305611 >> v2:172.21.15.125:3300/0 conn(0x7fe50c09f180 0x7fe50c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe512d6c700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 -- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 msgr2=0x7fe50c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 -- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 msgr2=0x7fe50c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 -- 172.21.15.125:0/2113305611 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c09f9c0 con 0x7fe50c09f180 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe51256b700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe512d6c700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511d6a700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c131830 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009870 tx=0x7fe4fc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ea9124204cf58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511569700 1 -- 172.21.15.125:0/2113305611 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc010a90 con 0x7fe50c09f180 2023-10-03T10:18:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511569700 1 -- 172.21.15.125:0/2113305611 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc010bf0 con 0x7fe50c09f180 2023-10-03T10:18:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.475+0000 7fe511569700 1 -- 172.21.15.125:0/2113305611 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc018440 con 0x7fe50c09f180 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 -- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 msgr2=0x7fe50c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c131830 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009870 tx=0x7fe4fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 -- 172.21.15.125:0/2113305611 shutdown_connections 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 --2- 172.21.15.125:0/2113305611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c131830 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 -- 172.21.15.125:0/2113305611 >> 172.21.15.125:0/2113305611 conn(0x7fe50c0a4430 msgr2=0x7fe50c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 -- 172.21.15.125:0/2113305611 shutdown_connections 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.476+0000 7fe5147cf700 1 -- 172.21.15.125:0/2113305611 wait complete. 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 Processor -- start 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 -- start start 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c11bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c11c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c120370 con 0x7fe50c09f180 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c11daa0 con 0x7fe50c131d70 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.477+0000 7fe5147cf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c11e0c0 con 0x7fe50c09e870 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe511d6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c11c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe511d6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51590/0 (socket says 172.21.15.125:51590) 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe511d6a700 1 -- 172.21.15.125:0/1111864050 learned_addr learned my addr 172.21.15.125:0/1111864050 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe51256b700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c11bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 -- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 msgr2=0x7fe50c11bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c11bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 -- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 msgr2=0x7fe50c11c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 -- 172.21.15.125:0/1111864050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508009550 con 0x7fe50c131d70 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe511d6a700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe512d6c700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c11c9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe504009e50 tx=0x7fe50400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504009cc0 con 0x7fe50c131d70 2023-10-03T10:18:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400f040 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400cd60 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe504009a70 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.478+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc0094a0 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.479+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe504014480 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.479+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c0a2c40 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.479+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe50403fc20 con 0x7fe50c131d70 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.484+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe504012930 con 0x7fe50c131d70 2023-10-03T10:18:26.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.511+0000 7fc69768f700 1 Processor -- start 2023-10-03T10:18:26.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.511+0000 7fc69768f700 1 -- start start 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69768f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69768f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc690139200 0x7fc69013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69768f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6901336e0 con 0x7fc690133b10 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69768f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69009a080 con 0x7fc690139200 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69768f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69009a760 con 0x7fc6901368e0 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc690139200 0x7fc69013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc694c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc690139200 0x7fc69013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51598/0 (socket says 172.21.15.125:51598) 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc694c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57740/0 (socket says 172.21.15.125:57740) 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc69542b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc690133b10 0x7fc690133ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45124/0 (socket says 172.21.15.125:45124) 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 -- 172.21.15.125:0/3368644803 learned_addr learned my addr 172.21.15.125:0/3368644803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 -- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 msgr2=0x7fc690138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 -- 172.21.15.125:0/3368644803 >> v1:172.21.15.125:6789/0 conn(0x7fc690133b10 legacy=0x7fc690133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 -- 172.21.15.125:0/3368644803 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69009b5c0 con 0x7fc690139200 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc687fff700 1 -- 172.21.15.125:0/3368644803 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597963390 0 0) 0x7fc6901336e0 con 0x7fc690133b10 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc694c2a700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc695c2c700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69013b5e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59864d019a3db84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc687fff700 1 -- 172.21.15.125:0/3368644803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800e070 con 0x7fc690139200 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.512+0000 7fc687fff700 1 -- 172.21.15.125:0/3368644803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800b910 con 0x7fc690139200 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc687fff700 1 -- 172.21.15.125:0/3368644803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800bcc0 con 0x7fc690139200 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 -- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 msgr2=0x7fc69013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69013b5e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 -- 172.21.15.125:0/3368644803 shutdown_connections 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69013b5e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 --2- 172.21.15.125:0/3368644803 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6901368e0 0x7fc690138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 -- 172.21.15.125:0/3368644803 >> 172.21.15.125:0/3368644803 conn(0x7fc6900a2980 msgr2=0x7fc6900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 -- 172.21.15.125:0/3368644803 shutdown_connections 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.513+0000 7fc69768f700 1 -- 172.21.15.125:0/3368644803 wait complete. 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.514+0000 7fc69768f700 1 Processor -- start 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 -- start start 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 0x7fc69011afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 0x7fc69011b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69011cdd0 con 0x7fc690139200 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69011cbe0 con 0x7fc6901368e0 2023-10-03T10:18:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69768f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc690130f50 con 0x7fc690133b10 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69542b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 0x7fc69011afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc694c2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 0x7fc69011b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51604/0 (socket says 172.21.15.125:51604) 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 -- 172.21.15.125:0/3145254529 learned_addr learned my addr 172.21.15.125:0/3145254529 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc694c2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 0x7fc69011b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38982/0 (socket says 172.21.15.125:38982) 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc69542b700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 0x7fc69011afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57752/0 (socket says 172.21.15.125:57752) 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 -- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 msgr2=0x7fc69011afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 0x7fc69011afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 -- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 msgr2=0x7fc69011b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 0x7fc69011b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.515+0000 7fc695c2c700 1 -- 172.21.15.125:0/3145254529 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800094a0 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc695c2c700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc688012000 tx=0x7fc688004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68801c640 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68801c7a0 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc688009b30 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68801cb50 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.516+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69011e810 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.517+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc68801ccb0 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.517+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6880413a0 con 0x7fc690139200 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.517+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69006b700 con 0x7fc690139200 2023-10-03T10:18:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.522+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc688025750 con 0x7fc690139200 2023-10-03T10:18:26.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.675+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe50c09dba0 con 0x7fe50c131d70 2023-10-03T10:18:26.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.676+0000 7fe502ffd700 1 -- 172.21.15.125:0/1111864050 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe504012340 con 0x7fe50c131d70 2023-10-03T10:18:26.676 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:26.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 msgr2=0x7fe50c11c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c11c9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe504009e50 tx=0x7fe50400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 shutdown_connections 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe50c131d70 0x7fe50c11c9b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe50c09e870 0x7fe50c11bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 --2- 172.21.15.125:0/1111864050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe50c09f180 0x7fe50c11c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 >> 172.21.15.125:0/1111864050 conn(0x7fe50c0a4430 msgr2=0x7fe50c130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 shutdown_connections 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.678+0000 7fe5147cf700 1 -- 172.21.15.125:0/1111864050 wait complete. 2023-10-03T10:18:26.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.708+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc69004f2a0 con 0x7fc690139200 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.709+0000 7fc685ffb700 1 -- 172.21.15.125:0/3145254529 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc688036090 con 0x7fc690139200 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 msgr2=0x7fc69011ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc688012000 tx=0x7fc688004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 shutdown_connections 2023-10-03T10:18:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc690139200 0x7fc69011ba50 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc690133b10 0x7fc69011afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 --2- 172.21.15.125:0/3145254529 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6901368e0 0x7fc69011b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 >> 172.21.15.125:0/3145254529 conn(0x7fc6900a2980 msgr2=0x7fc6901346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 shutdown_connections 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:26.711+0000 7fc69768f700 1 -- 172.21.15.125:0/3145254529 wait complete. 2023-10-03T10:18:26.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:27.268 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:27.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.393+0000 7ff506070700 1 Processor -- start 2023-10-03T10:18:27.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 -- start start 2023-10-03T10:18:27.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff5001359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50009aaa0 con 0x7ff50009d860 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50009e730 con 0x7ff50009e340 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff506070700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50009f870 con 0x7ff500135f20 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4ff7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff50009d860 0x7ff50009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45134/0 (socket says 172.21.15.125:45134) 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4ff7fe700 1 -- 172.21.15.125:0/1511282498 learned_addr learned my addr 172.21.15.125:0/1511282498 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4feffd700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff5001359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4fe7fc700 1 -- 172.21.15.125:0/1511282498 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431847003 0 0) 0x7ff50009aaa0 con 0x7ff50009d860 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4feffd700 1 -- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 msgr2=0x7ff500138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4feffd700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4feffd700 1 -- 172.21.15.125:0/1511282498 >> v1:172.21.15.125:6789/0 conn(0x7ff50009d860 legacy=0x7ff50009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4feffd700 1 -- 172.21.15.125:0/1511282498 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50009b360 con 0x7ff50009e340 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.394+0000 7ff4fffff700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff4feffd700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff5001359e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009870 tx=0x7ff4f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f590c73d91d1de4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff4fe7fc700 1 -- 172.21.15.125:0/1511282498 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011830 con 0x7ff50009e340 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff4fe7fc700 1 -- 172.21.15.125:0/1511282498 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0011990 con 0x7ff50009e340 2023-10-03T10:18:27.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff4fe7fc700 1 -- 172.21.15.125:0/1511282498 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011d20 con 0x7ff50009e340 2023-10-03T10:18:27.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 -- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 msgr2=0x7ff5001359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff5001359e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009870 tx=0x7ff4f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:27.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 -- 172.21.15.125:0/1511282498 shutdown_connections 2023-10-03T10:18:27.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 --2- 172.21.15.125:0/1511282498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff5001359e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 -- 172.21.15.125:0/1511282498 >> 172.21.15.125:0/1511282498 conn(0x7ff500099c40 msgr2=0x7ff5000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 -- 172.21.15.125:0/1511282498 shutdown_connections 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.395+0000 7ff506070700 1 -- 172.21.15.125:0/1511282498 wait complete. 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.396+0000 7ff506070700 1 Processor -- start 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.396+0000 7ff506070700 1 -- start start 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff50009d860 0x7ff500120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff500122b70 con 0x7ff50009d860 2023-10-03T10:18:27.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50009c8b0 con 0x7ff50009e340 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff506070700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff500122550 con 0x7ff500135f20 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4feffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:38992/0 (socket says 172.21.15.125:38992) 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4ff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff50009d860 0x7ff500120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57770/0 (socket says 172.21.15.125:57770) 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4feffd700 1 -- 172.21.15.125:0/1207291026 learned_addr learned my addr 172.21.15.125:0/1207291026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 -- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 msgr2=0x7ff500120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 -- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff50009d860 msgr2=0x7ff500120990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff50009d860 0x7ff500120990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 -- 172.21.15.125:0/1207291026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f800bc80 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4feffd700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.397+0000 7ff4fffff700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009370 tx=0x7ff4f800e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8010040 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8003c20 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00094a0 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800b3a0 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500122d40 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.398+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4f800e940 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.399+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4f803fac0 con 0x7ff500135f20 2023-10-03T10:18:27.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.399+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50004f2a0 con 0x7ff500135f20 2023-10-03T10:18:27.402 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:27.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.403+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4f801d770 con 0x7ff500135f20 2023-10-03T10:18:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 Processor -- start 2023-10-03T10:18:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 -- start start 2023-10-03T10:18:27.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 0x7fc7a4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a409c970 con 0x7fc7a409f180 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40a0920 con 0x7fc7a409e870 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a94bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a409f9c0 con 0x7fc7a4131f40 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a37fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 0x7fc7a4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a27fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc7a409f180 0x7fc7a4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45138/0 (socket says 172.21.15.125:45138) 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a27fc700 1 -- 172.21.15.125:0/3430320373 learned_addr learned my addr 172.21.15.125:0/3430320373 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.528+0000 7fc7a2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51616/0 (socket says 172.21.15.125:51616) 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a1ffb700 1 -- 172.21.15.125:0/3430320373 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761758372 0 0) 0x7fc7a409c970 con 0x7fc7a409f180 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a37fe700 1 -- 172.21.15.125:0/3430320373 >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 msgr2=0x7fc7a409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a37fe700 1 --2- 172.21.15.125:0/3430320373 >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a37fe700 1 -- 172.21.15.125:0/3430320373 >> v1:172.21.15.125:6789/0 conn(0x7fc7a409f180 legacy=0x7fc7a4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a37fe700 1 -- 172.21.15.125:0/3430320373 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a409bab0 con 0x7fc7a4131f40 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a2ffd700 1 --2- 172.21.15.125:0/3430320373 >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a37fe700 1 --2- 172.21.15.125:0/3430320373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 0x7fc7a4139ca0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009d90 tx=0x7fc79c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90570f4e46050ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a1ffb700 1 -- 172.21.15.125:0/3430320373 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00e070 con 0x7fc7a4131f40 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a1ffb700 1 -- 172.21.15.125:0/3430320373 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c00bb20 con 0x7fc7a4131f40 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.529+0000 7fc7a1ffb700 1 -- 172.21.15.125:0/3430320373 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c012430 con 0x7fc7a4131f40 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 -- 172.21.15.125:0/3430320373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 msgr2=0x7fc7a4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/3430320373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 0x7fc7a4139ca0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009d90 tx=0x7fc79c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 -- 172.21.15.125:0/3430320373 shutdown_connections 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/3430320373 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a4131f40 0x7fc7a4139ca0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/3430320373 >> v2:172.21.15.125:3300/0 conn(0x7fc7a409e870 0x7fc7a409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 -- 172.21.15.125:0/3430320373 >> 172.21.15.125:0/3430320373 conn(0x7fc7a40a4430 msgr2=0x7fc7a40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 -- 172.21.15.125:0/3430320373 shutdown_connections 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.530+0000 7fc7a94bb700 1 -- 172.21.15.125:0/3430320373 wait complete. 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 Processor -- start 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 -- start start 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 0x7fc7a406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7a4131f40 0x7fc7a406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4124510 con 0x7fc7a409f180 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4131830 con 0x7fc7a4131f40 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a94bb700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4130620 con 0x7fc7a409e870 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57794/0 (socket says 172.21.15.125:57794) 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a2ffd700 1 -- 172.21.15.125:0/727506743 learned_addr learned my addr 172.21.15.125:0/727506743 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a27fc700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 0x7fc7a406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a37fe700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7a4131f40 0x7fc7a406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.531+0000 7fc7a2ffd700 1 -- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7a4131f40 msgr2=0x7fc7a406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a2ffd700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7a4131f40 0x7fc7a406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a2ffd700 1 -- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 msgr2=0x7fc7a406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a2ffd700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 0x7fc7a406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a2ffd700 1 -- 172.21.15.125:0/727506743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940094a0 con 0x7fc7a409e870 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a27fc700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 0x7fc7a406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a2ffd700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc79400ebe0 tx=0x7fc79400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794009760 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400c850 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c009a70 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400cbe0 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.532+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a4124750 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.533+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc79400cd40 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.533+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc79403f6f0 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.533+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a411be60 con 0x7fc7a409e870 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.537+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc794021080 con 0x7fc7a409e870 2023-10-03T10:18:27.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.600+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff50006c3b0 con 0x7ff500135f20 2023-10-03T10:18:27.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.600+0000 7ff4e7fff700 1 -- 172.21.15.125:0/1207291026 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4f8013380 con 0x7ff500135f20 2023-10-03T10:18:27.601 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.602+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 msgr2=0x7ff500121410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.602+0000 7ff506070700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009370 tx=0x7ff4f800e3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 shutdown_connections 2023-10-03T10:18:27.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff500135f20 0x7ff500121410 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff50009d860 0x7ff500120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 --2- 172.21.15.125:0/1207291026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff50009e340 0x7ff500120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 >> 172.21.15.125:0/1207291026 conn(0x7ff500099c40 msgr2=0x7ff5000a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 shutdown_connections 2023-10-03T10:18:27.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.603+0000 7ff506070700 1 -- 172.21.15.125:0/1207291026 wait complete. 2023-10-03T10:18:27.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:27.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:27.724 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:27.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.730+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc7a404f2a0 con 0x7fc7a409e870 2023-10-03T10:18:27.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.730+0000 7fc78b7fe700 1 -- 172.21.15.125:0/727506743 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7940232f0 con 0x7fc7a409e870 2023-10-03T10:18:27.731 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:27.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 msgr2=0x7fc7a406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc79400ebe0 tx=0x7fc79400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 shutdown_connections 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7a4131f40 0x7fc7a406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc7a409e870 0x7fc7a406b8b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 --2- 172.21.15.125:0/727506743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7a409f180 0x7fc7a406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 >> 172.21.15.125:0/727506743 conn(0x7fc7a40a4430 msgr2=0x7fc7a4131090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 shutdown_connections 2023-10-03T10:18:27.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.733+0000 7fc7a94bb700 1 -- 172.21.15.125:0/727506743 wait complete. 2023-10-03T10:18:27.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 Processor -- start 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 -- start start 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27c81343a0 0x7f27c80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c809b110 con 0x7f27c8133f70 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80a3b60 con 0x7f27c81343a0 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ce7b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80a2fa0 con 0x7f27c809ad40 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ccd4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27c81343a0 0x7f27c80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27c7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ccd4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27c81343a0 0x7f27c80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51636/0 (socket says 172.21.15.125:51636) 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27c7fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57796/0 (socket says 172.21.15.125:57796) 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27ccd4f700 1 -- 172.21.15.125:0/3500642072 learned_addr learned my addr 172.21.15.125:0/3500642072 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.818+0000 7f27c77fe700 1 --1- 172.21.15.125:0/3500642072 >> v1:172.21.15.125:6789/0 conn(0x7f27c8133f70 0x7f27c80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45146/0 (socket says 172.21.15.125:45146) 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27ccd4f700 1 -- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 msgr2=0x7f27c8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27ccd4f700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27ccd4f700 1 -- 172.21.15.125:0/3500642072 >> v1:172.21.15.125:6789/0 conn(0x7f27c8133f70 legacy=0x7f27c80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27ccd4f700 1 -- 172.21.15.125:0/3500642072 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c809a280 con 0x7f27c81343a0 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27c6ffd700 1 -- 172.21.15.125:0/3500642072 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896239434 0 0) 0x7f27c809b110 con 0x7f27c8133f70 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27c7fff700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27ccd4f700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c80a1180 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009e50 tx=0x7f27c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4bd50231ef0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27c6ffd700 1 -- 172.21.15.125:0/3500642072 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000e070 con 0x7f27c81343a0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27c6ffd700 1 -- 172.21.15.125:0/3500642072 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000b910 con 0x7f27c81343a0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.819+0000 7f27c6ffd700 1 -- 172.21.15.125:0/3500642072 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000bcc0 con 0x7f27c81343a0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 msgr2=0x7f27c80a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c80a1180 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009e50 tx=0x7f27c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3500642072 shutdown_connections 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c80a1180 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3500642072 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c809ad40 0x7f27c8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3500642072 >> 172.21.15.125:0/3500642072 conn(0x7f27c8099c40 msgr2=0x7f27c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3500642072 shutdown_connections 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.820+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3500642072 wait complete. 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 Processor -- start 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 -- start start 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 0x7f27c81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 0x7f27c81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c811efd0 con 0x7f27c81343a0 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8120730 con 0x7f27c809ad40 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ce7b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8122740 con 0x7f27c8133f70 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ccd4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 0x7f27c81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ccd4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51652/0 (socket says 172.21.15.125:51652) 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.821+0000 7f27ccd4f700 1 -- 172.21.15.125:0/3609119896 learned_addr learned my addr 172.21.15.125:0/3609119896 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c7fff700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 0x7f27c81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 -- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 msgr2=0x7f27c81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 0x7f27c81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 -- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 msgr2=0x7f27c81c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 -- 172.21.15.125:0/3609119896 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b80094a0 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27ccd4f700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c7fff700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 0x7f27c81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c77fe700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 0x7f27c81c8660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c470 tx=0x7f27bc00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004c80 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc004de0 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc007310 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c0009b30 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.822+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c8120f20 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.823+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27bc007470 con 0x7f27c8133f70 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.823+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27bc03f1a0 con 0x7f27c8133f70 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.823+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8122580 con 0x7f27c8133f70 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.828+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27c8122580 con 0x7f27c8133f70 2023-10-03T10:18:27.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.856+0000 7f0a78a27700 1 Processor -- start 2023-10-03T10:18:27.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.856+0000 7f0a78a27700 1 -- start start 2023-10-03T10:18:27.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 0x7f0a74133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 0x7f0a74134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740a0370 con 0x7f0a7409f180 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7409fa00 con 0x7f0a7409e870 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a78a27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7409ada0 con 0x7f0a74134160 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a71d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 0x7f0a74133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39016/0 (socket says 172.21.15.125:39016) 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 -- 172.21.15.125:0/644269109 learned_addr learned my addr 172.21.15.125:0/644269109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a72d9d700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 0x7f0a74134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 -- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 msgr2=0x7f0a74134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 0x7f0a74134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 -- 172.21.15.125:0/644269109 >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 msgr2=0x7f0a74133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 --2- 172.21.15.125:0/644269109 >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 0x7f0a74133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 -- 172.21.15.125:0/644269109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7406bec0 con 0x7f0a7409e870 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a71d9b700 1 --2- 172.21.15.125:0/644269109 >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 0x7f0a74133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a72d9d700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 0x7f0a74134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7259c700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098f0 tx=0x7f0a64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742373bfb67f471 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7159a700 1 -- 172.21.15.125:0/644269109 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64011830 con 0x7f0a7409e870 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7159a700 1 -- 172.21.15.125:0/644269109 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64011990 con 0x7f0a7409e870 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.857+0000 7f0a7159a700 1 -- 172.21.15.125:0/644269109 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64011d20 con 0x7f0a7409e870 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 -- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 msgr2=0x7f0a7409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098f0 tx=0x7f0a64009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 -- 172.21.15.125:0/644269109 shutdown_connections 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a7409e870 0x7f0a7409ec40 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 --2- 172.21.15.125:0/644269109 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a74134160 0x7f0a74134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 --2- 172.21.15.125:0/644269109 >> v2:172.21.15.125:3300/0 conn(0x7f0a7409f180 0x7f0a74133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 -- 172.21.15.125:0/644269109 >> 172.21.15.125:0/644269109 conn(0x7f0a740a4430 msgr2=0x7f0a740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 -- 172.21.15.125:0/644269109 shutdown_connections 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.858+0000 7f0a78a27700 1 -- 172.21.15.125:0/644269109 wait complete. 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.859+0000 7f0a78a27700 1 Processor -- start 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.859+0000 7f0a78a27700 1 -- start start 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 0x7f0a74122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 0x7f0a74122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741240c0 con 0x7f0a7409f180 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74123960 con 0x7f0a74134160 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74124f50 con 0x7f0a7409e870 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57816/0 (socket says 172.21.15.125:57816) 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 0x7f0a74122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a7259c700 1 -- 172.21.15.125:0/1998548492 learned_addr learned my addr 172.21.15.125:0/1998548492 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a71d9b700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 0x7f0a74122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 -- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 msgr2=0x7f0a74122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 -- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 msgr2=0x7f0a74122a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 0x7f0a74122a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 -- 172.21.15.125:0/1998548492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680094a0 con 0x7f0a74134160 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a7259c700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a71d9b700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 0x7f0a74122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a72d9d700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 0x7f0a74122f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009e50 tx=0x7f0a6c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ca90 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00f040 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c009a70 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ce50 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.860+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a64009550 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.861+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a740a3c70 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.862+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a6c014480 con 0x7f0a74134160 2023-10-03T10:18:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.862+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a6c03fbc0 con 0x7f0a74134160 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:27.866+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a6c012520 con 0x7f0a74134160 2023-10-03T10:18:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.021+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27c8122580 con 0x7f27c8133f70 2023-10-03T10:18:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.022+0000 7f27c4ff9700 1 -- 172.21.15.125:0/3609119896 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27c8122580 con 0x7f27c8133f70 2023-10-03T10:18:28.022 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 msgr2=0x7f27c81c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 0x7f27c81c8660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c470 tx=0x7f27bc00c780 comp rx=0 tx=0).stop 2023-10-03T10:18:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 shutdown_connections 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27c81343a0 0x7f27c81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27c809ad40 0x7f27c81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 --2- 172.21.15.125:0/3609119896 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f27c8133f70 0x7f27c81c8660 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 >> 172.21.15.125:0/3609119896 conn(0x7f27c8099c40 msgr2=0x7f27c81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 shutdown_connections 2023-10-03T10:18:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.024+0000 7f27ce7b2700 1 -- 172.21.15.125:0/3609119896 wait complete. 2023-10-03T10:18:28.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.060+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a7406cfa0 con 0x7f0a74134160 2023-10-03T10:18:28.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.061+0000 7f0a62ffd700 1 -- 172.21.15.125:0/1998548492 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a6c012340 con 0x7f0a74134160 2023-10-03T10:18:28.061 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 msgr2=0x7f0a74122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 0x7f0a74122f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009e50 tx=0x7f0a6c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 shutdown_connections 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a74134160 0x7f0a74122f80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0a7409e870 0x7f0a74122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 --2- 172.21.15.125:0/1998548492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7409f180 0x7f0a74122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 >> 172.21.15.125:0/1998548492 conn(0x7f0a740a4430 msgr2=0x7f0a740709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 shutdown_connections 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.063+0000 7f0a78a27700 1 -- 172.21.15.125:0/1998548492 wait complete. 2023-10-03T10:18:28.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:28.616 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:28.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.737+0000 7f71d1d39700 1 Processor -- start 2023-10-03T10:18:28.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.737+0000 7f71d1d39700 1 -- start start 2023-10-03T10:18:28.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71d1d39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 0x7f71cc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71d1d39700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71d1d39700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc09c970 con 0x7f71cc09e870 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71d1d39700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0a0920 con 0x7f71cc1371c0 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71d1d39700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc09f9c0 con 0x7f71cc09f350 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 0x7f71cc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51690/0 (socket says 172.21.15.125:51690) 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71cbfff700 1 -- 172.21.15.125:0/1092309590 learned_addr learned my addr 172.21.15.125:0/1092309590 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71cb7fe700 1 --1- 172.21.15.125:0/1092309590 >> v1:172.21.15.125:6789/0 conn(0x7f71cc09e870 0x7f71cc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45162/0 (socket says 172.21.15.125:45162) 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 -- 172.21.15.125:0/1092309590 >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 msgr2=0x7f71cc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 --2- 172.21.15.125:0/1092309590 >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 -- 172.21.15.125:0/1092309590 >> v1:172.21.15.125:6789/0 conn(0x7f71cc09e870 legacy=0x7f71cc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 -- 172.21.15.125:0/1092309590 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc09bab0 con 0x7f71cc09f350 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71ca7fc700 1 -- 172.21.15.125:0/1092309590 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663002456 0 0) 0x7f71cc09c970 con 0x7f71cc09e870 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71cbfff700 1 --2- 172.21.15.125:0/1092309590 >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71caffd700 1 --2- 172.21.15.125:0/1092309590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 0x7f71cc136c80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009840 tx=0x7f71bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd08d12567bac45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71ca7fc700 1 -- 172.21.15.125:0/1092309590 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011830 con 0x7f71cc09f350 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71ca7fc700 1 -- 172.21.15.125:0/1092309590 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc011990 con 0x7f71cc09f350 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.738+0000 7f71ca7fc700 1 -- 172.21.15.125:0/1092309590 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011d20 con 0x7f71cc09f350 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 -- 172.21.15.125:0/1092309590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 msgr2=0x7f71cc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 --2- 172.21.15.125:0/1092309590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 0x7f71cc136c80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009840 tx=0x7f71bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:28.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 -- 172.21.15.125:0/1092309590 shutdown_connections 2023-10-03T10:18:28.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 --2- 172.21.15.125:0/1092309590 >> v2:172.21.15.125:3300/0 conn(0x7f71cc1371c0 0x7f71cc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 --2- 172.21.15.125:0/1092309590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc09f350 0x7f71cc136c80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 -- 172.21.15.125:0/1092309590 >> 172.21.15.125:0/1092309590 conn(0x7f71cc0a4430 msgr2=0x7f71cc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 -- 172.21.15.125:0/1092309590 shutdown_connections 2023-10-03T10:18:28.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.739+0000 7f71d1d39700 1 -- 172.21.15.125:0/1092309590 wait complete. 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 Processor -- start 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 -- start start 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 0x7f71cc1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 0x7f71cc120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 0x7f71cc121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc123af0 con 0x7f71cc09f350 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc122c60 con 0x7f71cc1371c0 2023-10-03T10:18:28.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.740+0000 7f71d1d39700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc072250 con 0x7f71cc09e870 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71caffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 0x7f71cc120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 0x7f71cc1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71caffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 0x7f71cc120e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51706/0 (socket says 172.21.15.125:51706) 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 0x7f71cc121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71caffd700 1 -- 172.21.15.125:0/2528584695 learned_addr learned my addr 172.21.15.125:0/2528584695 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 -- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 msgr2=0x7f71cc1208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 0x7f71cc1208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 -- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 msgr2=0x7f71cc120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 0x7f71cc120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 -- 172.21.15.125:0/2528584695 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009b30 con 0x7f71cc1371c0 2023-10-03T10:18:28.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cb7fe700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 0x7f71cc1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71cbfff700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 0x7f71cc121360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f71c400ef90 tx=0x7f71c400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400ca80 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400f040 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400ce20 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc0094a0 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.741+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc123fc0 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.742+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71c4014480 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.742+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71c403faa0 con 0x7f71cc1371c0 2023-10-03T10:18:28.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.742+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc06ad00 con 0x7f71cc1371c0 2023-10-03T10:18:28.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:28.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.747+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71c4012930 con 0x7f71cc1371c0 2023-10-03T10:18:28.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 Processor -- start 2023-10-03T10:18:28.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 -- start start 2023-10-03T10:18:28.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 0x7fa50c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c09dc00 con 0x7fa50c133f50 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c09ea60 con 0x7fa50c0a1380 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa513a60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c09dec0 con 0x7fa50c0a0a70 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa5117fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa510ffb700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 0x7fa50c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa5117fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57828/0 (socket says 172.21.15.125:57828) 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa5117fc700 1 -- 172.21.15.125:0/776579140 learned_addr learned my addr 172.21.15.125:0/776579140 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.870+0000 7fa511ffd700 1 --1- 172.21.15.125:0/776579140 >> v1:172.21.15.125:6789/0 conn(0x7fa50c133f50 0x7fa50c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45178/0 (socket says 172.21.15.125:45178) 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa5117fc700 1 -- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 msgr2=0x7fa50c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa5117fc700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 0x7fa50c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa5117fc700 1 -- 172.21.15.125:0/776579140 >> v1:172.21.15.125:6789/0 conn(0x7fa50c133f50 legacy=0x7fa50c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa503fff700 1 -- 172.21.15.125:0/776579140 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970152929 0 0) 0x7fa50c09dc00 con 0x7fa50c133f50 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa5117fc700 1 -- 172.21.15.125:0/776579140 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c09e6a0 con 0x7fa50c0a0a70 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa510ffb700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 0x7fa50c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa5117fc700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa508009920 tx=0x7fa508009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34aabdc318765cb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa503fff700 1 -- 172.21.15.125:0/776579140 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508011830 con 0x7fa50c0a0a70 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa503fff700 1 -- 172.21.15.125:0/776579140 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa508011990 con 0x7fa50c0a0a70 2023-10-03T10:18:28.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.871+0000 7fa503fff700 1 -- 172.21.15.125:0/776579140 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508011d20 con 0x7fa50c0a0a70 2023-10-03T10:18:28.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 -- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 msgr2=0x7fa50c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa508009920 tx=0x7fa508009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 -- 172.21.15.125:0/776579140 shutdown_connections 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a0a70 0x7fa50c0a0e40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 --2- 172.21.15.125:0/776579140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c0a1380 0x7fa50c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 -- 172.21.15.125:0/776579140 >> 172.21.15.125:0/776579140 conn(0x7fa50c0a6610 msgr2=0x7fa50c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 -- 172.21.15.125:0/776579140 shutdown_connections 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.872+0000 7fa513a60700 1 -- 172.21.15.125:0/776579140 wait complete. 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.873+0000 7fa513a60700 1 Processor -- start 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.873+0000 7fa513a60700 1 -- start start 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 0x7fa50c1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c133f50 0x7fa50c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c126180 con 0x7fa50c0a0a70 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c126360 con 0x7fa50c133f50 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa513a60700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c125dc0 con 0x7fa50c0a1380 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa5117fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 0x7fa50c1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57836/0 (socket says 172.21.15.125:57836) 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 -- 172.21.15.125:0/1146834644 learned_addr learned my addr 172.21.15.125:0/1146834644 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa511ffd700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c133f50 0x7fa50c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 -- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c133f50 msgr2=0x7fa50c123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c133f50 0x7fa50c123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 -- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 msgr2=0x7fa50c1228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 0x7fa50c1228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 -- 172.21.15.125:0/1146834644 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0094a0 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa5117fc700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 0x7fa50c1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa510ffb700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00ebb0 tx=0x7fa4fc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.874+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00c850 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.875+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00c9b0 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.875+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa508009550 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.875+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00cd40 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.875+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c124560 con 0x7fa50c0a1380 2023-10-03T10:18:28.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.875+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4fc013470 con 0x7fa50c0a1380 2023-10-03T10:18:28.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.876+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c04f2a0 con 0x7fa50c0a1380 2023-10-03T10:18:28.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.876+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4fc03fc50 con 0x7fa50c0a1380 2023-10-03T10:18:28.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.880+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4fc01b3b0 con 0x7fa50c0a1380 2023-10-03T10:18:28.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.942+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f71cc04f2a0 con 0x7f71cc1371c0 2023-10-03T10:18:28.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.942+0000 7f71b3fff700 1 -- 172.21.15.125:0/2528584695 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71c4012340 con 0x7f71cc1371c0 2023-10-03T10:18:28.942 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:28.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 msgr2=0x7f71cc121360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 0x7f71cc121360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f71c400ef90 tx=0x7f71c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 shutdown_connections 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71cc1371c0 0x7f71cc121360 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f71cc09e870 0x7f71cc1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 --2- 172.21.15.125:0/2528584695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71cc09f350 0x7f71cc120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 >> 172.21.15.125:0/2528584695 conn(0x7f71cc0a4430 msgr2=0x7f71cc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 shutdown_connections 2023-10-03T10:18:28.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:28.944+0000 7f71d1d39700 1 -- 172.21.15.125:0/2528584695 wait complete. 2023-10-03T10:18:28.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:29.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:29.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.072+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa50c133360 con 0x7fa50c0a1380 2023-10-03T10:18:29.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.072+0000 7fa501ffb700 1 -- 172.21.15.125:0/1146834644 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4fc017020 con 0x7fa50c0a1380 2023-10-03T10:18:29.073 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 msgr2=0x7fa50c122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00ebb0 tx=0x7fa4fc00eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 shutdown_connections 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50c133f50 0x7fa50c123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa50c0a0a70 0x7fa50c1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 --2- 172.21.15.125:0/1146834644 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fa50c0a1380 0x7fa50c122e10 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.074+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 >> 172.21.15.125:0/1146834644 conn(0x7fa50c0a6610 msgr2=0x7fa50c0a4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.075+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 shutdown_connections 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.075+0000 7fa513a60700 1 -- 172.21.15.125:0/1146834644 wait complete. 2023-10-03T10:18:29.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:29.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:29.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 Processor -- start 2023-10-03T10:18:29.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 -- start start 2023-10-03T10:18:29.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 0x7fe5d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d809e9d0 con 0x7fe5d80a1380 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d809dc00 con 0x7fe5d80a0a70 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5e0211700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d809dec0 con 0x7fe5d8133f50 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5de7ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5dd7ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5dd7ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51738/0 (socket says 172.21.15.125:51738) 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5ddfad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 0x7fe5d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5dd7ac700 1 -- 172.21.15.125:0/871734965 learned_addr learned my addr 172.21.15.125:0/871734965 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:29.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.163+0000 7fe5de7ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57844/0 (socket says 172.21.15.125:57844) 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 -- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 msgr2=0x7fe5d8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 -- 172.21.15.125:0/871734965 >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 msgr2=0x7fe5d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 --2- 172.21.15.125:0/871734965 >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 -- 172.21.15.125:0/871734965 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d809e6a0 con 0x7fe5d80a0a70 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5dd7ac700 1 --2- 172.21.15.125:0/871734965 >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5de7ae700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5ddfad700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 0x7fe5d80a0e40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b0d517202b0776 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5dcfab700 1 -- 172.21.15.125:0/871734965 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011830 con 0x7fe5d80a0a70 2023-10-03T10:18:29.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5dcfab700 1 -- 172.21.15.125:0/871734965 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4011990 con 0x7fe5d80a0a70 2023-10-03T10:18:29.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.164+0000 7fe5dcfab700 1 -- 172.21.15.125:0/871734965 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011d20 con 0x7fe5d80a0a70 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 -- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 msgr2=0x7fe5d80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 0x7fe5d80a0e40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 -- 172.21.15.125:0/871734965 shutdown_connections 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a0a70 0x7fe5d80a0e40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 --2- 172.21.15.125:0/871734965 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 --2- 172.21.15.125:0/871734965 >> v2:172.21.15.125:3300/0 conn(0x7fe5d80a1380 0x7fe5d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 -- 172.21.15.125:0/871734965 >> 172.21.15.125:0/871734965 conn(0x7fe5d80a6610 msgr2=0x7fe5d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 -- 172.21.15.125:0/871734965 shutdown_connections 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.165+0000 7fe5e0211700 1 -- 172.21.15.125:0/871734965 wait complete. 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 Processor -- start 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 -- start start 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80a0a70 0x7fe5d8122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a1380 0x7fe5d8122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8125e70 con 0x7fe5d80a0a70 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8125960 con 0x7fe5d80a1380 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5e0211700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8124df0 con 0x7fe5d8133f50 2023-10-03T10:18:29.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5de7ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5de7ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57856/0 (socket says 172.21.15.125:57856) 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5de7ae700 1 -- 172.21.15.125:0/3358383282 learned_addr learned my addr 172.21.15.125:0/3358383282 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5ddfad700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80a0a70 0x7fe5d8122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.166+0000 7fe5dd7ac700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a1380 0x7fe5d8122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 -- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a1380 msgr2=0x7fe5d8122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a1380 0x7fe5d8122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 -- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80a0a70 msgr2=0x7fe5d8122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80a0a70 0x7fe5d8122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 -- 172.21.15.125:0/3358383282 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009550 con 0x7fe5d8133f50 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5de7ae700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000efc0 tx=0x7fe5d000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000ca90 con 0x7fe5d8133f50 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d000f040 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000ce10 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0009a70 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.167+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d40094a0 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.168+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5d0014480 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.168+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5d003fd30 con 0x7fe5d8133f50 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.168+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d811f760 con 0x7fe5d8133f50 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.173+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5d0012930 con 0x7fe5d8133f50 2023-10-03T10:18:29.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.201+0000 7fcadfa0a700 1 Processor -- start 2023-10-03T10:18:29.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.201+0000 7fcadfa0a700 1 -- start start 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadfa0a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadfa0a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcad8130eb0 0x7fcad8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadfa0a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad809aaa0 con 0x7fcad809e170 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadfa0a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad809f870 con 0x7fcad8130eb0 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadfa0a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcad809b360 con 0x7fcad809d860 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadd7a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcad8130eb0 0x7fcad8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadcfa5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcad809e170 0x7fcad81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45188/0 (socket says 172.21.15.125:45188) 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadcfa5700 1 -- 172.21.15.125:0/2345965222 learned_addr learned my addr 172.21.15.125:0/2345965222 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadd7a6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57868/0 (socket says 172.21.15.125:57868) 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 -- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 msgr2=0x7fcad809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 -- 172.21.15.125:0/2345965222 >> v1:172.21.15.125:6789/0 conn(0x7fcad809e170 legacy=0x7fcad81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 -- 172.21.15.125:0/2345965222 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad809b620 con 0x7fcad8130eb0 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcacffff700 1 -- 172.21.15.125:0/2345965222 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685803522 0 0) 0x7fcad809aaa0 con 0x7fcad809e170 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcadd7a6700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcaddfa7700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad8130eb0 0x7fcad8138a00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009d90 tx=0x7fcad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747a312c327dbc16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.202+0000 7fcacffff700 1 -- 172.21.15.125:0/2345965222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcad8130eb0 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcacffff700 1 -- 172.21.15.125:0/2345965222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000bb20 con 0x7fcad8130eb0 2023-10-03T10:18:29.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcacffff700 1 -- 172.21.15.125:0/2345965222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0012430 con 0x7fcad8130eb0 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 -- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad8130eb0 msgr2=0x7fcad8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad8130eb0 0x7fcad8138a00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009d90 tx=0x7fcad000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 -- 172.21.15.125:0/2345965222 shutdown_connections 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad8130eb0 0x7fcad8138a00 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/2345965222 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad809d860 0x7fcad809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 -- 172.21.15.125:0/2345965222 >> 172.21.15.125:0/2345965222 conn(0x7fcad8099c40 msgr2=0x7fcad80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 -- 172.21.15.125:0/2345965222 shutdown_connections 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.203+0000 7fcadfa0a700 1 -- 172.21.15.125:0/2345965222 wait complete. 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 Processor -- start 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 -- start start 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 0x7fcad811e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 0x7fcad811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 0x7fcad811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8120cf0 con 0x7fcad809d860 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80a07b0 con 0x7fcad809e170 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.204+0000 7fcadfa0a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcad809c8b0 con 0x7fcad8130eb0 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcaddfa7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 0x7fcad811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 0x7fcad811e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcaddfa7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 0x7fcad811eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57876/0 (socket says 172.21.15.125:57876) 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcaddfa7700 1 -- 172.21.15.125:0/1137149852 learned_addr learned my addr 172.21.15.125:0/1137149852 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadcfa5700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 0x7fcad811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 -- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 msgr2=0x7fcad811eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 0x7fcad811eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 -- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 msgr2=0x7fcad811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 0x7fcad811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 -- 172.21.15.125:0/1137149852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80094a0 con 0x7fcad809d860 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadcfa5700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 0x7fcad811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadd7a6700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 0x7fcad811e420 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e9b0 tx=0x7fcac800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800c850 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800c9b0 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0009a70 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800cd60 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.205+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad811f810 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.206+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad804f2a0 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.207+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcac8013470 con 0x7fcad809d860 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.207+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcac803ff80 con 0x7fcad809d860 2023-10-03T10:18:29.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.211+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcac8011760 con 0x7fcad809d860 2023-10-03T10:18:29.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.368+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5d80a51f0 con 0x7fe5d8133f50 2023-10-03T10:18:29.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.368+0000 7fe5ce7fc700 1 -- 172.21.15.125:0/3358383282 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5d001c3b0 con 0x7fe5d8133f50 2023-10-03T10:18:29.369 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 msgr2=0x7fe5d8122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000efc0 tx=0x7fe5d000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 shutdown_connections 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fe5d8133f50 0x7fe5d8122dd0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80a0a70 0x7fe5d8122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 --2- 172.21.15.125:0/3358383282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5d80a1380 0x7fe5d8122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 >> 172.21.15.125:0/3358383282 conn(0x7fe5d80a6610 msgr2=0x7fe5d811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.370+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 shutdown_connections 2023-10-03T10:18:29.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.371+0000 7fe5e0211700 1 -- 172.21.15.125:0/3358383282 wait complete. 2023-10-03T10:18:29.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:29.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.407+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcad806c3b0 con 0x7fcad809d860 2023-10-03T10:18:29.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.407+0000 7fcacdffb700 1 -- 172.21.15.125:0/1137149852 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcac8021020 con 0x7fcad809d860 2023-10-03T10:18:29.408 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 msgr2=0x7fcad811e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 0x7fcad811e420 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e9b0 tx=0x7fcac800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 shutdown_connections 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fcad8130eb0 0x7fcad811eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad809d860 0x7fcad811e420 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 --2- 172.21.15.125:0/1137149852 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcad809e170 0x7fcad811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 >> 172.21.15.125:0/1137149852 conn(0x7fcad8099c40 msgr2=0x7fcad80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 shutdown_connections 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:29.409+0000 7fcadfa0a700 1 -- 172.21.15.125:0/1137149852 wait complete. 2023-10-03T10:18:29.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:29.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:30.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 Processor -- start 2023-10-03T10:18:30.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 -- start start 2023-10-03T10:18:30.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc09aa00 con 0x7f5ccc133b80 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc09a080 con 0x7f5ccc099a60 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd387b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc133750 con 0x7f5ccc138e30 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd0e16700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd1e18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd1617700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5ccc133b80 0x7f5ccc133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45196/0 (socket says 172.21.15.125:45196) 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd1e18700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57882/0 (socket says 172.21.15.125:57882) 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd1617700 1 -- 172.21.15.125:0/2383604917 learned_addr learned my addr 172.21.15.125:0/2383604917 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.080+0000 7f5cd0e16700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51764/0 (socket says 172.21.15.125:51764) 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd1e18700 1 -- 172.21.15.125:0/2383604917 >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 msgr2=0x7f5ccc1388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd1e18700 1 --2- 172.21.15.125:0/2383604917 >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd1e18700 1 -- 172.21.15.125:0/2383604917 >> v1:172.21.15.125:6789/0 conn(0x7f5ccc133b80 legacy=0x7f5ccc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd1e18700 1 -- 172.21.15.125:0/2383604917 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc09a760 con 0x7f5ccc138e30 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cc3fff700 1 -- 172.21.15.125:0/2383604917 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814935260 0 0) 0x7f5ccc09aa00 con 0x7f5ccc133b80 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd0e16700 1 --2- 172.21.15.125:0/2383604917 >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd1e18700 1 --2- 172.21.15.125:0/2383604917 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f2c72e421dd62c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cc3fff700 1 -- 172.21.15.125:0/2383604917 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400e070 con 0x7f5ccc138e30 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cc3fff700 1 -- 172.21.15.125:0/2383604917 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc400bb20 con 0x7f5ccc138e30 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cc3fff700 1 -- 172.21.15.125:0/2383604917 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4012430 con 0x7f5ccc138e30 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd387b700 1 -- 172.21.15.125:0/2383604917 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 msgr2=0x7f5ccc13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.081+0000 7f5cd387b700 1 --2- 172.21.15.125:0/2383604917 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 -- 172.21.15.125:0/2383604917 shutdown_connections 2023-10-03T10:18:30.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 --2- 172.21.15.125:0/2383604917 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc138e30 0x7f5ccc13b210 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 --2- 172.21.15.125:0/2383604917 >> v2:172.21.15.125:3300/0 conn(0x7f5ccc099a60 0x7f5ccc1388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 -- 172.21.15.125:0/2383604917 >> 172.21.15.125:0/2383604917 conn(0x7f5ccc0a2980 msgr2=0x7f5ccc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 -- 172.21.15.125:0/2383604917 shutdown_connections 2023-10-03T10:18:30.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 -- 172.21.15.125:0/2383604917 wait complete. 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.082+0000 7f5cd387b700 1 Processor -- start 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 -- start start 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ccc133b80 0x7f5ccc119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 0x7f5ccc119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc11b760 con 0x7f5ccc138e30 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc119e70 con 0x7f5ccc133b80 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd387b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc11ab30 con 0x7f5ccc099a60 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1617700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 0x7f5ccc119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd0e16700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ccc133b80 0x7f5ccc119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1617700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57898/0 (socket says 172.21.15.125:57898) 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1617700 1 -- 172.21.15.125:0/13342711 learned_addr learned my addr 172.21.15.125:0/13342711 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 -- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 msgr2=0x7f5ccc118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 -- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ccc133b80 msgr2=0x7f5ccc119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ccc133b80 0x7f5ccc119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 -- 172.21.15.125:0/13342711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0094a0 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1617700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.083+0000 7f5cd1e18700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 0x7f5ccc119870 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4016000 tx=0x7f5cc4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4012430 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4020070 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc4009a70 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40098f0 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc072720 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.084+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cc4004040 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.085+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5cc4022070 con 0x7f5ccc138e30 2023-10-03T10:18:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.085+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc11b120 con 0x7f5ccc138e30 2023-10-03T10:18:30.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.089+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ccc11b120 con 0x7f5ccc138e30 2023-10-03T10:18:30.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 Processor -- start 2023-10-03T10:18:30.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 -- start start 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784809dc00 con 0x7f7848133f50 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784809ea60 con 0x7f78480a1380 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.215+0000 7f784cac4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f784809dec0 con 0x7f78480a0a70 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f7845d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f7846d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7848133f50 0x7f784813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45210/0 (socket says 172.21.15.125:45210) 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f7846d9d700 1 -- 172.21.15.125:0/2592263383 learned_addr learned my addr 172.21.15.125:0/2592263383 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:30.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784559a700 1 -- 172.21.15.125:0/2592263383 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675652025 0 0) 0x7f784809dc00 con 0x7f7848133f50 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 -- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 msgr2=0x7f7848133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 -- 172.21.15.125:0/2592263383 >> v1:172.21.15.125:6789/0 conn(0x7f7848133f50 legacy=0x7f784813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 -- 172.21.15.125:0/2592263383 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784809e6a0 con 0x7f78480a0a70 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f7845d9b700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784659c700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78480a0e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7838009870 tx=0x7f7838009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653e1aa48b979125 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784559a700 1 -- 172.21.15.125:0/2592263383 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011830 con 0x7f78480a0a70 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784559a700 1 -- 172.21.15.125:0/2592263383 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838011990 con 0x7f78480a0a70 2023-10-03T10:18:30.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.216+0000 7f784559a700 1 -- 172.21.15.125:0/2592263383 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011d20 con 0x7f78480a0a70 2023-10-03T10:18:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 -- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 msgr2=0x7f78480a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78480a0e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7838009870 tx=0x7f7838009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 -- 172.21.15.125:0/2592263383 shutdown_connections 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78480a0e40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 --2- 172.21.15.125:0/2592263383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 -- 172.21.15.125:0/2592263383 >> 172.21.15.125:0/2592263383 conn(0x7f78480a6610 msgr2=0x7f78480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 -- 172.21.15.125:0/2592263383 shutdown_connections 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.217+0000 7f784cac4700 1 -- 172.21.15.125:0/2592263383 wait complete. 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.218+0000 7f784cac4700 1 Processor -- start 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.218+0000 7f784cac4700 1 -- start start 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.218+0000 7f784cac4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.218+0000 7f784cac4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.218+0000 7f784cac4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7848133f50 0x7f7848123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784cac4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481262e0 con 0x7f7848133f50 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784cac4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848123c20 con 0x7f78480a1380 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784cac4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78480a03e0 con 0x7f78480a0a70 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57918/0 (socket says 172.21.15.125:57918) 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 -- 172.21.15.125:0/461475286 learned_addr learned my addr 172.21.15.125:0/461475286 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7846d9d700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7848133f50 0x7f7848123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 -- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 msgr2=0x7f7848122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7845d9b700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 -- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7848133f50 msgr2=0x7f7848123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7848133f50 0x7f7848123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 -- 172.21.15.125:0/461475286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0094a0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7845d9b700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784659c700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7838009bc0 tx=0x7f7838004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380045d0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783801f070 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380038c0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380094a0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.219+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481332e0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.220+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784804f2a0 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.220+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7838003a20 con 0x7f78480a0a70 2023-10-03T10:18:30.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.221+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7838021070 con 0x7f78480a0a70 2023-10-03T10:18:30.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.229+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f783802f3a0 con 0x7f78480a0a70 2023-10-03T10:18:30.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.293+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ccc11b120 con 0x7f5ccc138e30 2023-10-03T10:18:30.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.293+0000 7f5cc1ffb700 1 -- 172.21.15.125:0/13342711 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ccc11b120 con 0x7f5ccc138e30 2023-10-03T10:18:30.294 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 msgr2=0x7f5ccc119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 0x7f5ccc119870 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4016000 tx=0x7f5cc4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 shutdown_connections 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ccc138e30 0x7f5ccc119870 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5ccc099a60 0x7f5ccc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 --2- 172.21.15.125:0/13342711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ccc133b80 0x7f5ccc119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.295+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 >> 172.21.15.125:0/13342711 conn(0x7f5ccc0a2980 msgr2=0x7f5ccc09f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.296+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 shutdown_connections 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.296+0000 7f5cd387b700 1 -- 172.21.15.125:0/13342711 wait complete. 2023-10-03T10:18:30.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:30.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:30.422 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:30.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.422+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7848125ca0 con 0x7f78480a0a70 2023-10-03T10:18:30.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.422+0000 7f7836ffd700 1 -- 172.21.15.125:0/461475286 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7838015070 con 0x7f78480a0a70 2023-10-03T10:18:30.423 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:30.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.424+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 msgr2=0x7f78481227c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.424+0000 7f784cac4700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7838009bc0 tx=0x7f7838004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 shutdown_connections 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7848133f50 0x7f7848123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f78480a0a70 0x7f78481227c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 --2- 172.21.15.125:0/461475286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78480a1380 0x7f7848122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 >> 172.21.15.125:0/461475286 conn(0x7f78480a6610 msgr2=0x7f78480a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 shutdown_connections 2023-10-03T10:18:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.425+0000 7f784cac4700 1 -- 172.21.15.125:0/461475286 wait complete. 2023-10-03T10:18:30.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 Processor -- start 2023-10-03T10:18:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 -- start start 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 0x7f4188138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418809e9d0 con 0x7f41880a0a70 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418809dc00 con 0x7f41880a1550 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418f074700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f418809dec0 con 0x7f4188139200 2023-10-03T10:18:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f4187fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 0x7f4188138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418d611700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418ce10700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f41880a0a70 0x7f41880a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45224/0 (socket says 172.21.15.125:45224) 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f418ce10700 1 -- 172.21.15.125:0/2829256335 learned_addr learned my addr 172.21.15.125:0/2829256335 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.512+0000 7f41877fe700 1 -- 172.21.15.125:0/2829256335 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337665501 0 0) 0x7f418809e9d0 con 0x7f41880a0a70 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f41877fe700 1 -- 172.21.15.125:0/2829256335 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41780035b0 con 0x7f41880a0a70 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418d611700 1 -- 172.21.15.125:0/2829256335 >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 msgr2=0x7f4188138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418d611700 1 --2- 172.21.15.125:0/2829256335 >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 0x7f4188138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418d611700 1 -- 172.21.15.125:0/2829256335 >> v1:172.21.15.125:6789/0 conn(0x7f41880a0a70 legacy=0x7f41880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418d611700 1 -- 172.21.15.125:0/2829256335 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418809e6a0 con 0x7f4188139200 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f4187fff700 1 --2- 172.21.15.125:0/2829256335 >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 0x7f4188138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418d611700 1 --2- 172.21.15.125:0/2829256335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418813b5e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4180009d90 tx=0x7f418000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399734a385a5a022 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f41877fe700 1 -- 172.21.15.125:0/2829256335 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000e070 con 0x7f4188139200 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f41877fe700 1 -- 172.21.15.125:0/2829256335 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000bb20 con 0x7f4188139200 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f41877fe700 1 -- 172.21.15.125:0/2829256335 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000be90 con 0x7f4188139200 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 -- 172.21.15.125:0/2829256335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 msgr2=0x7f418813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 --2- 172.21.15.125:0/2829256335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418813b5e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4180009d90 tx=0x7f418000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 -- 172.21.15.125:0/2829256335 shutdown_connections 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 --2- 172.21.15.125:0/2829256335 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418813b5e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 --2- 172.21.15.125:0/2829256335 >> v2:172.21.15.125:3300/0 conn(0x7f41880a1550 0x7f4188138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.513+0000 7f418f074700 1 -- 172.21.15.125:0/2829256335 >> 172.21.15.125:0/2829256335 conn(0x7f41880a6610 msgr2=0x7f41880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.514+0000 7f418f074700 1 -- 172.21.15.125:0/2829256335 shutdown_connections 2023-10-03T10:18:30.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.514+0000 7f418f074700 1 -- 172.21.15.125:0/2829256335 wait complete. 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.514+0000 7f418f074700 1 Processor -- start 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.514+0000 7f418f074700 1 -- start start 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 0x7f418811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41881222c0 con 0x7f41880a0a70 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41881219b0 con 0x7f41880a1550 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418f074700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41880a03e0 con 0x7f4188139200 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418ce10700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418d611700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418ce10700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51814/0 (socket says 172.21.15.125:51814) 2023-10-03T10:18:30.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418d611700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57942/0 (socket says 172.21.15.125:57942) 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418ce10700 1 -- 172.21.15.125:0/572714305 learned_addr learned my addr 172.21.15.125:0/572714305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f4187fff700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 0x7f418811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418ce10700 1 -- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 msgr2=0x7f418811f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.515+0000 7f418ce10700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418ce10700 1 -- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 msgr2=0x7f418811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418ce10700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 0x7f418811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418ce10700 1 -- 172.21.15.125:0/572714305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740094a0 con 0x7f41880a0a70 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f4187fff700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 0x7f418811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418d611700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418ce10700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c730 tx=0x7f417c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c005d70 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c0070d0 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180009a70 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c007440 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.516+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4188120ac0 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.517+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f417c0075a0 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.517+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4188121ba0 con 0x7f41880a0a70 2023-10-03T10:18:30.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.517+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f417c03eb00 con 0x7f41880a0a70 2023-10-03T10:18:30.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.522+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f417c019b40 con 0x7f41880a0a70 2023-10-03T10:18:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.550+0000 7fd992dce700 1 Processor -- start 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 -- start start 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 0x7fd98c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c09dc00 con 0x7fd98c133f50 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c09ea60 con 0x7fd98c0a1380 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd992dce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c09dec0 con 0x7fd98c0a0a70 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd990b6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd99136b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd98c133f50 0x7fd98c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45230/0 (socket says 172.21.15.125:45230) 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd99136b700 1 -- 172.21.15.125:0/971961051 learned_addr learned my addr 172.21.15.125:0/971961051 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd98bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 0x7fd98c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd990b6a700 1 -- 172.21.15.125:0/971961051 >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 msgr2=0x7fd98c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd990b6a700 1 --2- 172.21.15.125:0/971961051 >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 0x7fd98c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd990b6a700 1 -- 172.21.15.125:0/971961051 >> v1:172.21.15.125:6789/0 conn(0x7fd98c133f50 legacy=0x7fd98c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd990b6a700 1 -- 172.21.15.125:0/971961051 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c09e6a0 con 0x7fd98c0a0a70 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd98b7fe700 1 -- 172.21.15.125:0/971961051 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398684993 0 0) 0x7fd98c09dc00 con 0x7fd98c133f50 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.551+0000 7fd98bfff700 1 --2- 172.21.15.125:0/971961051 >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 0x7fd98c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd990b6a700 1 --2- 172.21.15.125:0/971961051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c0a0e40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd980009840 tx=0x7fd980009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9380243735ca150 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd98b7fe700 1 -- 172.21.15.125:0/971961051 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980011830 con 0x7fd98c0a0a70 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd98b7fe700 1 -- 172.21.15.125:0/971961051 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980011990 con 0x7fd98c0a0a70 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd98b7fe700 1 -- 172.21.15.125:0/971961051 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980011d20 con 0x7fd98c0a0a70 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 -- 172.21.15.125:0/971961051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 msgr2=0x7fd98c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 --2- 172.21.15.125:0/971961051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c0a0e40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd980009840 tx=0x7fd980009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:30.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 -- 172.21.15.125:0/971961051 shutdown_connections 2023-10-03T10:18:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 --2- 172.21.15.125:0/971961051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c0a0e40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 --2- 172.21.15.125:0/971961051 >> v2:172.21.15.125:3300/0 conn(0x7fd98c0a1380 0x7fd98c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 -- 172.21.15.125:0/971961051 >> 172.21.15.125:0/971961051 conn(0x7fd98c0a6610 msgr2=0x7fd98c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 -- 172.21.15.125:0/971961051 shutdown_connections 2023-10-03T10:18:30.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.552+0000 7fd992dce700 1 -- 172.21.15.125:0/971961051 wait complete. 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.553+0000 7fd992dce700 1 Processor -- start 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.553+0000 7fd992dce700 1 -- start start 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 0x7fd98c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 0x7fd98c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c126140 con 0x7fd98c0a1380 2023-10-03T10:18:30.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1244d0 con 0x7fd98c0a0a70 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd992dce700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c126340 con 0x7fd98c133f50 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd990b6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd990b6a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39150/0 (socket says 172.21.15.125:39150) 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd990b6a700 1 -- 172.21.15.125:0/1268448763 learned_addr learned my addr 172.21.15.125:0/1268448763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 0x7fd98c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd99136b700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 0x7fd98c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 -- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 msgr2=0x7fd98c1232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 0x7fd98c1232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 -- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 msgr2=0x7fd98c122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 -- 172.21.15.125:0/1268448763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780094a0 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd99136b700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 0x7fd98c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.554+0000 7fd98bfff700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 0x7fd98c122d60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd97800e9b0 tx=0x7fd97800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800ee50 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97800c850 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9800094a0 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800cbe0 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c125da0 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.555+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd97800cd40 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.556+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd97803f720 con 0x7fd98c0a1380 2023-10-03T10:18:30.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.556+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c04f2a0 con 0x7fd98c0a1380 2023-10-03T10:18:30.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.560+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd978021080 con 0x7fd98c0a1380 2023-10-03T10:18:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.716+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4188121d80 con 0x7f41880a0a70 2023-10-03T10:18:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.716+0000 7f41857fa700 1 -- 172.21.15.125:0/572714305 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f417c017030 con 0x7f41880a0a70 2023-10-03T10:18:30.716 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 msgr2=0x7f418811e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c730 tx=0x7f417c00ca40 comp rx=0 tx=0).stop 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 shutdown_connections 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4188139200 0x7f418811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41880a0a70 0x7f418811e700 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 --2- 172.21.15.125:0/572714305 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41880a1550 0x7f418811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 >> 172.21.15.125:0/572714305 conn(0x7f41880a6610 msgr2=0x7f41880a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 shutdown_connections 2023-10-03T10:18:30.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.718+0000 7f418f074700 1 -- 172.21.15.125:0/572714305 wait complete. 2023-10-03T10:18:30.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:30.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.752+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd98c1339b0 con 0x7fd98c0a1380 2023-10-03T10:18:30.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.752+0000 7fd9897fa700 1 -- 172.21.15.125:0/1268448763 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9780232f0 con 0x7fd98c0a1380 2023-10-03T10:18:30.752 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 msgr2=0x7fd98c122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 0x7fd98c122d60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd97800e9b0 tx=0x7fd97800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 shutdown_connections 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd98c133f50 0x7fd98c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98c0a0a70 0x7fd98c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 --2- 172.21.15.125:0/1268448763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd98c0a1380 0x7fd98c122d60 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 >> 172.21.15.125:0/1268448763 conn(0x7fd98c0a6610 msgr2=0x7fd98c0a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 shutdown_connections 2023-10-03T10:18:30.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:30.754+0000 7fd992dce700 1 -- 172.21.15.125:0/1268448763 wait complete. 2023-10-03T10:18:30.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:31.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.435+0000 7ff2269b8700 1 Processor -- start 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.435+0000 7ff2269b8700 1 -- start start 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2201309f0 0x7ff22013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22006b2d0 con 0x7ff2201309f0 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff220133610 con 0x7ff220133ad0 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff2269b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22009a500 con 0x7ff2201300a0 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2201309f0 0x7ff22013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21f7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57950/0 (socket says 172.21.15.125:57950) 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39158/0 (socket says 172.21.15.125:39158) 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21f7fe700 1 -- 172.21.15.125:0/2309295182 learned_addr learned my addr 172.21.15.125:0/2309295182 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 -- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 msgr2=0x7ff2201304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 -- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 msgr2=0x7ff220133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff224f55700 1 -- 172.21.15.125:0/2309295182 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2201338b0 con 0x7ff2201309f0 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21f7fe700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.436+0000 7ff21ffff700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff224f55700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201309f0 0x7ff22013a980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff218009d90 tx=0x7ff21800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad5355e3bf2e11f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff21effd700 1 -- 172.21.15.125:0/2309295182 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800e070 con 0x7ff2201309f0 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff21effd700 1 -- 172.21.15.125:0/2309295182 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800bb20 con 0x7ff2201309f0 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff21effd700 1 -- 172.21.15.125:0/2309295182 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218012430 con 0x7ff2201309f0 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 -- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201309f0 msgr2=0x7ff22013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201309f0 0x7ff22013a980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff218009d90 tx=0x7ff21800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 -- 172.21.15.125:0/2309295182 shutdown_connections 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff220133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201309f0 0x7ff22013a980 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2309295182 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201300a0 0x7ff2201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 -- 172.21.15.125:0/2309295182 >> 172.21.15.125:0/2309295182 conn(0x7ff220099c40 msgr2=0x7ff2200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 -- 172.21.15.125:0/2309295182 shutdown_connections 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.437+0000 7ff2269b8700 1 -- 172.21.15.125:0/2309295182 wait complete. 2023-10-03T10:18:31.441 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.438+0000 7ff2269b8700 1 Processor -- start 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 -- start start 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201309f0 0x7ff22011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22011ec00 con 0x7ff2201300a0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22012dd00 con 0x7ff220133ad0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff2269b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22012d9d0 con 0x7ff2201309f0 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff21ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff224f55700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff21ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51852/0 (socket says 172.21.15.125:51852) 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff21ffff700 1 -- 172.21.15.125:0/2085816581 learned_addr learned my addr 172.21.15.125:0/2085816581 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff224f55700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39162/0 (socket says 172.21.15.125:39162) 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.439+0000 7ff21f7fe700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201309f0 0x7ff22011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 -- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201309f0 msgr2=0x7ff22011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201309f0 0x7ff22011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 -- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 msgr2=0x7ff22011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 -- 172.21.15.125:0/2085816581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009550 con 0x7ff2201300a0 2023-10-03T10:18:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff224f55700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21ffff700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ff21000ebe0 tx=0x7ff21000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210009800 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000c910 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2100094a0 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000cc80 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.440+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff218009a70 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.441+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff210013470 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.441+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff21003f7a0 con 0x7ff2201300a0 2023-10-03T10:18:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.441+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22009cb20 con 0x7ff2201300a0 2023-10-03T10:18:31.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.445+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff210017070 con 0x7ff2201300a0 2023-10-03T10:18:31.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 Processor -- start 2023-10-03T10:18:31.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 -- start start 2023-10-03T10:18:31.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 0x7f8bd009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 0x7f8bd013ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd009ad30 con 0x7f8bd01337d0 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd009a8e0 con 0x7f8bd009bd20 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bd528a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0134600 con 0x7f8bd0134160 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bce7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 0x7f8bd013ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bce7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51860/0 (socket says 172.21.15.125:51860) 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bceffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 0x7f8bd009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.568+0000 7f8bce7fc700 1 -- 172.21.15.125:0/2309633144 learned_addr learned my addr 172.21.15.125:0/2309633144 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 -- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 msgr2=0x7f8bd013ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 0x7f8bd013ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 -- 172.21.15.125:0/2309633144 >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 msgr2=0x7f8bd0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 --2- 172.21.15.125:0/2309633144 >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 -- 172.21.15.125:0/2309633144 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd009a620 con 0x7f8bd009bd20 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bcf7fe700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 0x7f8bd013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bce7fc700 1 --2- 172.21.15.125:0/2309633144 >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bceffd700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 0x7f8bd009c0f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009820 tx=0x7f8bc0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edbaad64beb45289 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bcdffb700 1 -- 172.21.15.125:0/2309633144 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0005e30 con 0x7f8bd009bd20 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bcdffb700 1 -- 172.21.15.125:0/2309633144 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0006030 con 0x7f8bd009bd20 2023-10-03T10:18:31.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.569+0000 7f8bcdffb700 1 -- 172.21.15.125:0/2309633144 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00063c0 con 0x7f8bd009bd20 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 -- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 msgr2=0x7f8bd009c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 0x7f8bd009c0f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009820 tx=0x7f8bc0009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 -- 172.21.15.125:0/2309633144 shutdown_connections 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd009bd20 0x7f8bd009c0f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2309633144 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd0134160 0x7f8bd013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2309633144 >> v2:172.21.15.125:3300/0 conn(0x7f8bd01337d0 0x7f8bd0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 -- 172.21.15.125:0/2309633144 >> 172.21.15.125:0/2309633144 conn(0x7f8bd009f9f0 msgr2=0x7f8bd009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 -- 172.21.15.125:0/2309633144 shutdown_connections 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.570+0000 7f8bd528a700 1 -- 172.21.15.125:0/2309633144 wait complete. 2023-10-03T10:18:31.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 Processor -- start 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 -- start start 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 0x7f8bd011df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 0x7f8bd011e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 0x7f8bd011e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd011f3b0 con 0x7f8bd0134160 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd011fb30 con 0x7f8bd01337d0 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bd528a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0120150 con 0x7f8bd009bd20 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 0x7f8bd011df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 0x7f8bd011e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bceffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 0x7f8bd011df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57976/0 (socket says 172.21.15.125:57976) 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bceffd700 1 -- 172.21.15.125:0/2890455158 learned_addr learned my addr 172.21.15.125:0/2890455158 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bcf7fe700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 0x7f8bd011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 -- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 msgr2=0x7f8bd011df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 0x7f8bd011df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 -- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 msgr2=0x7f8bd011e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 0x7f8bd011e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.571+0000 7f8bce7fc700 1 -- 172.21.15.125:0/2890455158 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4009550 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bcf7fe700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 0x7f8bd011e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bce7fc700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 0x7f8bd011e460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400e9d0 tx=0x7f8bc400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400ee60 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc4004240 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc8009a70 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40036a0 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.572+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0009430 con 0x7f8bd01337d0 2023-10-03T10:18:31.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.573+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bc4003800 con 0x7f8bd01337d0 2023-10-03T10:18:31.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.573+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bc403f7f0 con 0x7f8bd01337d0 2023-10-03T10:18:31.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.573+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00a1550 con 0x7f8bd01337d0 2023-10-03T10:18:31.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.578+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bc400c640 con 0x7f8bd01337d0 2023-10-03T10:18:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.642+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff22004f2a0 con 0x7ff2201300a0 2023-10-03T10:18:31.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.643+0000 7ff21cff9700 1 -- 172.21.15.125:0/2085816581 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff210017070 con 0x7ff2201300a0 2023-10-03T10:18:31.643 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:31.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 msgr2=0x7ff22011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ff21000ebe0 tx=0x7ff21000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 shutdown_connections 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff220133ad0 0x7ff22011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2201300a0 0x7ff22011da40 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 --2- 172.21.15.125:0/2085816581 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff2201309f0 0x7ff22011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 >> 172.21.15.125:0/2085816581 conn(0x7ff220099c40 msgr2=0x7ff2200a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 shutdown_connections 2023-10-03T10:18:31.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.645+0000 7ff2269b8700 1 -- 172.21.15.125:0/2085816581 wait complete. 2023-10-03T10:18:31.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:31.731 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:31.767 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:31.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.767+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bd011ad60 con 0x7f8bd01337d0 2023-10-03T10:18:31.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.767+0000 7f8bb77fe700 1 -- 172.21.15.125:0/2890455158 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bc401bb60 con 0x7f8bd01337d0 2023-10-03T10:18:31.768 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:31.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 msgr2=0x7f8bd011e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 0x7f8bd011e460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400e9d0 tx=0x7f8bc400ece0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 shutdown_connections 2023-10-03T10:18:31.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bd0134160 0x7f8bd011e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8bd009bd20 0x7f8bd011df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 --2- 172.21.15.125:0/2890455158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bd01337d0 0x7f8bd011e460 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 >> 172.21.15.125:0/2890455158 conn(0x7f8bd009f9f0 msgr2=0x7f8bd0132eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 shutdown_connections 2023-10-03T10:18:31.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.769+0000 7f8bd528a700 1 -- 172.21.15.125:0/2890455158 wait complete. 2023-10-03T10:18:31.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:31.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.858+0000 7fdd9eac9700 1 Processor -- start 2023-10-03T10:18:31.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.858+0000 7fdd9eac9700 1 -- start start 2023-10-03T10:18:31.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9eac9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 0x7fdd9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9eac9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 0x7fdd98131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9eac9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9809c970 con 0x7fdd98131d70 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9eac9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980a0920 con 0x7fdd9809f180 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9eac9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9809f9c0 con 0x7fdd9809e870 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9c865700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 0x7fdd9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9d066700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdd98131d70 0x7fdd98138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45246/0 (socket says 172.21.15.125:45246) 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd9d066700 1 -- 172.21.15.125:0/2388400387 learned_addr learned my addr 172.21.15.125:0/2388400387 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.859+0000 7fdd97fff700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 0x7fdd98131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd977fe700 1 -- 172.21.15.125:0/2388400387 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277498547 0 0) 0x7fdd9809c970 con 0x7fdd98131d70 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd97fff700 1 -- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 msgr2=0x7fdd9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd97fff700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 0x7fdd9809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd97fff700 1 -- 172.21.15.125:0/2388400387 >> v1:172.21.15.125:6789/0 conn(0x7fdd98131d70 legacy=0x7fdd98138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd97fff700 1 -- 172.21.15.125:0/2388400387 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9809bab0 con 0x7fdd9809f180 2023-10-03T10:18:31.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd9c865700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 0x7fdd9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd97fff700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 0x7fdd98131830 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009870 tx=0x7fdd84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9660a9f0ef1de72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd977fe700 1 -- 172.21.15.125:0/2388400387 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84011830 con 0x7fdd9809f180 2023-10-03T10:18:31.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd977fe700 1 -- 172.21.15.125:0/2388400387 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84011990 con 0x7fdd9809f180 2023-10-03T10:18:31.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.860+0000 7fdd977fe700 1 -- 172.21.15.125:0/2388400387 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84011d20 con 0x7fdd9809f180 2023-10-03T10:18:31.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 -- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 msgr2=0x7fdd98131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 0x7fdd98131830 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009870 tx=0x7fdd84009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:31.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 -- 172.21.15.125:0/2388400387 shutdown_connections 2023-10-03T10:18:31.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809e870 0x7fdd9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/2388400387 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9809f180 0x7fdd98131830 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 -- 172.21.15.125:0/2388400387 >> 172.21.15.125:0/2388400387 conn(0x7fdd980a4430 msgr2=0x7fdd980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 -- 172.21.15.125:0/2388400387 shutdown_connections 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.861+0000 7fdd9eac9700 1 -- 172.21.15.125:0/2388400387 wait complete. 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 Processor -- start 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 -- start start 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809f180 0x7fdd9811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98120cf0 con 0x7fdd9809e870 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98121b80 con 0x7fdd98131d70 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9eac9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98122660 con 0x7fdd9809f180 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9d066700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9c865700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9c865700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51880/0 (socket says 172.21.15.125:51880) 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9d066700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39176/0 (socket says 172.21.15.125:39176) 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd9c865700 1 -- 172.21.15.125:0/3518047461 learned_addr learned my addr 172.21.15.125:0/3518047461 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.862+0000 7fdd97fff700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809f180 0x7fdd9811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 -- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809f180 msgr2=0x7fdd9811f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809f180 0x7fdd9811f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 -- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 msgr2=0x7fdd9811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 -- 172.21.15.125:0/3518047461 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0094a0 con 0x7fdd98131d70 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9c865700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9d066700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000cc10 tx=0x7fdd9000cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000aa00 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000ab60 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900070d0 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840094a0 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.863+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9809dba0 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.864+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd90007230 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.864+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd9003f100 con 0x7fdd98131d70 2023-10-03T10:18:31.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.864+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9811be60 con 0x7fdd98131d70 2023-10-03T10:18:31.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.868+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd90018070 con 0x7fdd98131d70 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.894+0000 7f06f2a6d700 1 Processor -- start 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 -- start start 2023-10-03T10:18:31.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06ec09ad40 0x7f06ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec0a0a70 0x7f06ec0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0a3b60 con 0x7f06ec09ad40 2023-10-03T10:18:31.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1348e0 con 0x7f06ec0a0a70 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f2a6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec09b110 con 0x7f06ec133f70 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06ec09ad40 0x7f06ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57990/0 (socket says 172.21.15.125:57990) 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06ec09ad40 0x7f06ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51890/0 (socket says 172.21.15.125:51890) 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06ebfff700 1 -- 172.21.15.125:0/830433556 learned_addr learned my addr 172.21.15.125:0/830433556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f100a700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec0a0a70 0x7f06ec0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 -- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 msgr2=0x7f06ec1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 -- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec0a0a70 msgr2=0x7f06ec0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec0a0a70 0x7f06ec0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06f0809700 1 -- 172.21.15.125:0/830433556 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0a2fa0 con 0x7f06ec09ad40 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.895+0000 7f06ebfff700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f0809700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec09ad40 0x7f06ec133a30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009870 tx=0x7f06e0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd223c95f0e9b8ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06eb7fe700 1 -- 172.21.15.125:0/830433556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011830 con 0x7f06ec09ad40 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06eb7fe700 1 -- 172.21.15.125:0/830433556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0011990 con 0x7f06ec09ad40 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06eb7fe700 1 -- 172.21.15.125:0/830433556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011d20 con 0x7f06ec09ad40 2023-10-03T10:18:31.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 -- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec09ad40 msgr2=0x7f06ec133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec09ad40 0x7f06ec133a30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009870 tx=0x7f06e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 -- 172.21.15.125:0/830433556 shutdown_connections 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec0a0a70 0x7f06ec0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec09ad40 0x7f06ec133a30 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/830433556 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec133f70 0x7f06ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 -- 172.21.15.125:0/830433556 >> 172.21.15.125:0/830433556 conn(0x7f06ec099c40 msgr2=0x7f06ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.896+0000 7f06f2a6d700 1 -- 172.21.15.125:0/830433556 shutdown_connections 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.897+0000 7f06f2a6d700 1 -- 172.21.15.125:0/830433556 wait complete. 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.898+0000 7f06f2a6d700 1 Processor -- start 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.898+0000 7f06f2a6d700 1 -- start start 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.898+0000 7f06f2a6d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec09ad40 0x7f06ec1222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.898+0000 7f06f2a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec133f70 0x7f06ec122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec125120 con 0x7f06ec133f70 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec124050 con 0x7f06ec09ad40 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec124d60 con 0x7f06ec0a0a70 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:57992/0 (socket says 172.21.15.125:57992) 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 -- 172.21.15.125:0/3908587702 learned_addr learned my addr 172.21.15.125:0/3908587702 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f0809700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec09ad40 0x7f06ec1222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f100a700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec133f70 0x7f06ec122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 -- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec09ad40 msgr2=0x7f06ec1222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec09ad40 0x7f06ec1222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 -- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec133f70 msgr2=0x7f06ec122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec133f70 0x7f06ec122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 -- 172.21.15.125:0/3908587702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009550 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06ebfff700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ebe0 tx=0x7f06d800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800c850 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800c9b0 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e00094a0 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800cd40 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.899+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec125840 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.900+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06d8013470 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.900+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06d803f7a0 con 0x7f06ec0a0a70 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.900+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec04f2a0 con 0x7f06ec0a0a70 2023-10-03T10:18:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:31.905+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06d80232f0 con 0x7f06ec0a0a70 2023-10-03T10:18:32.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.062+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdd9804f2a0 con 0x7fdd98131d70 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.062+0000 7fdd957fa700 1 -- 172.21.15.125:0/3518047461 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd90011950 con 0x7fdd98131d70 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 msgr2=0x7fdd9811fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000cc10 tx=0x7fdd9000cf20 comp rx=0 tx=0).stop 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 shutdown_connections 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd98131d70 0x7fdd9811fb60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9809e870 0x7fdd9811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 --2- 172.21.15.125:0/3518047461 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdd9809f180 0x7fdd9811f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 >> 172.21.15.125:0/3518047461 conn(0x7fdd980a4430 msgr2=0x7fdd98131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.064+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 shutdown_connections 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.065+0000 7fdd9eac9700 1 -- 172.21.15.125:0/3518047461 wait complete. 2023-10-03T10:18:32.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.097+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06ec125b60 con 0x7f06ec0a0a70 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.097+0000 7f06e97fa700 1 -- 172.21.15.125:0/3908587702 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06d8021030 con 0x7f06ec0a0a70 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 msgr2=0x7f06ec122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ebe0 tx=0x7f06d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 shutdown_connections 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06ec133f70 0x7f06ec122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06ec09ad40 0x7f06ec1222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 --2- 172.21.15.125:0/3908587702 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f06ec0a0a70 0x7f06ec122800 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 >> 172.21.15.125:0/3908587702 conn(0x7f06ec099c40 msgr2=0x7f06ec09ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 shutdown_connections 2023-10-03T10:18:32.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.099+0000 7f06f2a6d700 1 -- 172.21.15.125:0/3908587702 wait complete. 2023-10-03T10:18:32.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:32.659 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.783+0000 7f9f29832700 1 Processor -- start 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.783+0000 7f9f29832700 1 -- start start 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f29832700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f29832700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 0x7f9f241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f29832700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2409aaa0 con 0x7f9f24130ce0 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f29832700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2409f870 con 0x7f9f2409d860 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f29832700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2409b360 con 0x7f9f2409e170 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 0x7f9f241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f237fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9f24130ce0 0x7f9f241379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45256/0 (socket says 172.21.15.125:45256) 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f237fe700 1 -- 172.21.15.125:0/4230503602 learned_addr learned my addr 172.21.15.125:0/4230503602 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 -- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 msgr2=0x7f9f2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 -- 172.21.15.125:0/4230503602 >> v1:172.21.15.125:6789/0 conn(0x7f9f24130ce0 legacy=0x7f9f241379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f21ffb700 1 -- 172.21.15.125:0/4230503602 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205502791 0 0) 0x7f9f2409aaa0 con 0x7f9f24130ce0 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 -- 172.21.15.125:0/4230503602 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2409b620 con 0x7f9f2409e170 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f227fc700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 0x7f9f241307a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400bb10 tx=0x7f9f1400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d84039255fdc23f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f21ffb700 1 -- 172.21.15.125:0/4230503602 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400dc70 con 0x7f9f2409e170 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f21ffb700 1 -- 172.21.15.125:0/4230503602 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1400ddd0 con 0x7f9f2409e170 2023-10-03T10:18:32.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.784+0000 7f9f21ffb700 1 -- 172.21.15.125:0/4230503602 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14010690 con 0x7f9f2409e170 2023-10-03T10:18:32.787 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:32.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 -- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 msgr2=0x7f9f241307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 0x7f9f241307a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400bb10 tx=0x7f9f1400be20 comp rx=0 tx=0).stop 2023-10-03T10:18:32.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 -- 172.21.15.125:0/4230503602 shutdown_connections 2023-10-03T10:18:32.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 --2- 172.21.15.125:0/4230503602 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f2409e170 0x7f9f241307a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 -- 172.21.15.125:0/4230503602 >> 172.21.15.125:0/4230503602 conn(0x7f9f24099c40 msgr2=0x7f9f240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 -- 172.21.15.125:0/4230503602 shutdown_connections 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.785+0000 7f9f29832700 1 -- 172.21.15.125:0/4230503602 wait complete. 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.786+0000 7f9f29832700 1 Processor -- start 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.786+0000 7f9f29832700 1 -- start start 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.786+0000 7f9f29832700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.786+0000 7f9f29832700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f2409e170 0x7f9f2411eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.786+0000 7f9f29832700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24130ce0 0x7f9f2411efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f29832700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24121730 con 0x7f9f2409e170 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f29832700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24120780 con 0x7f9f2409d860 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f29832700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24120120 con 0x7f9f24130ce0 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39218/0 (socket says 172.21.15.125:39218) 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f227fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f2409e170 0x7f9f2411eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 -- 172.21.15.125:0/315193618 learned_addr learned my addr 172.21.15.125:0/315193618 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f237fe700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24130ce0 0x7f9f2411efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 -- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24130ce0 msgr2=0x7f9f2411efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24130ce0 0x7f9f2411efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 -- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f2409e170 msgr2=0x7f9f2411eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f2409e170 0x7f9f2411eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 -- 172.21.15.125:0/315193618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180094a0 con 0x7f9f2409d860 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f22ffd700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800ebe0 tx=0x7f9f1800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800c850 con 0x7f9f2409d860 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800c9b0 con 0x7f9f2409d860 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800cd40 con 0x7f9f2409d860 2023-10-03T10:18:32.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1400b740 con 0x7f9f2409d860 2023-10-03T10:18:32.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.787+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24130470 con 0x7f9f2409d860 2023-10-03T10:18:32.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.788+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f18013470 con 0x7f9f2409d860 2023-10-03T10:18:32.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.788+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f1803f770 con 0x7f9f2409d860 2023-10-03T10:18:32.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.788+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2404f2a0 con 0x7f9f2409d860 2023-10-03T10:18:32.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.793+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f18013720 con 0x7f9f2409d860 2023-10-03T10:18:32.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.911+0000 7f2bcd8d0700 1 Processor -- start 2023-10-03T10:18:32.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.911+0000 7f2bcd8d0700 1 -- start start 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bcd8d0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc80a1570 0x7f2bc8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bcd8d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bcd8d0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc80a1fe0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bcd8d0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc80a3aa0 con 0x7f2bc80a1570 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bcd8d0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc809a540 con 0x7f2bc81393c0 2023-10-03T10:18:32.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc80a1570 0x7f2bc8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2bc80a0a90 0x7f2bc80a0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45260/0 (socket says 172.21.15.125:45260) 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1587465049 learned_addr learned my addr 172.21.15.125:0/1587465049 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2bc80a1570 0x7f2bc8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51920/0 (socket says 172.21.15.125:51920) 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1587465049 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666772111 0 0) 0x7f2bc80a1fe0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1587465049 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb00035b0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 msgr2=0x7f2bc813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc813b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1587465049 >> v1:172.21.15.125:6789/0 conn(0x7f2bc80a0a90 legacy=0x7f2bc80a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc67fc700 1 -- 172.21.15.125:0/1587465049 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc809a280 con 0x7f2bc80a1570 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.912+0000 7f2bc77fe700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a1570 0x7f2bc8138e80 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009840 tx=0x7f2bbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100ca1879a4f59c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1587465049 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc011830 con 0x7f2bc80a1570 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1587465049 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc011990 con 0x7f2bc80a1570 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bc5ffb700 1 -- 172.21.15.125:0/1587465049 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc011d20 con 0x7f2bc80a1570 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a1570 msgr2=0x7f2bc8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a1570 0x7f2bc8138e80 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009840 tx=0x7f2bbc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1587465049 shutdown_connections 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1587465049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a1570 0x7f2bc8138e80 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1587465049 >> 172.21.15.125:0/1587465049 conn(0x7f2bc8099c40 msgr2=0x7f2bc806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1587465049 shutdown_connections 2023-10-03T10:18:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.913+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1587465049 wait complete. 2023-10-03T10:18:32.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.914+0000 7f2bcd8d0700 1 Processor -- start 2023-10-03T10:18:32.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.914+0000 7f2bcd8d0700 1 -- start start 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 0x7f2bc8122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 0x7f2bc8122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc81263e0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc809c7e0 con 0x7f2bc80a1570 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bcd8d0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc809c190 con 0x7f2bc81393c0 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc67fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 0x7f2bc8122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58012/0 (socket says 172.21.15.125:58012) 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc77fe700 1 -- 172.21.15.125:0/1098095723 learned_addr learned my addr 172.21.15.125:0/1098095723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 0x7f2bc8122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 msgr2=0x7f2bc81233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 msgr2=0x7f2bc8122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 0x7f2bc8122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 -- 172.21.15.125:0/1098095723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009a70 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc67fc700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 0x7f2bc8122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc77fe700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.915+0000 7f2bc6ffd700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 0x7f2bc8122950 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800c490 tx=0x7f2bb800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8005d70 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80070d0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc0094a0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8007440 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc809b130 con 0x7f2bc80a0a90 2023-10-03T10:18:32.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.916+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bb80075a0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.917+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bb803ea00 con 0x7f2bc80a0a90 2023-10-03T10:18:32.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.917+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc8125cb0 con 0x7f2bc80a0a90 2023-10-03T10:18:32.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.925+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bb8017020 con 0x7f2bc80a0a90 2023-10-03T10:18:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.990+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f2406c3b0 con 0x7f9f2409d860 2023-10-03T10:18:32.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.991+0000 7f9f0bfff700 1 -- 172.21.15.125:0/315193618 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f18021030 con 0x7f9f2409d860 2023-10-03T10:18:32.991 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:32.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 msgr2=0x7f9f2411e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800ebe0 tx=0x7f9f1800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 shutdown_connections 2023-10-03T10:18:32.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9f24130ce0 0x7f9f2411efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f2409d860 0x7f9f2411e560 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 --2- 172.21.15.125:0/315193618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f2409e170 0x7f9f2411eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 >> 172.21.15.125:0/315193618 conn(0x7f9f24099c40 msgr2=0x7f9f240a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 shutdown_connections 2023-10-03T10:18:32.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:32.993+0000 7f9f29832700 1 -- 172.21.15.125:0/315193618 wait complete. 2023-10-03T10:18:33.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:33.078 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:33.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:33.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.121+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2bc804f2a0 con 0x7f2bc80a0a90 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.122+0000 7f2baffff700 1 -- 172.21.15.125:0/1098095723 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bb8019b40 con 0x7f2bc80a0a90 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 msgr2=0x7f2bc8122950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 0x7f2bc8122950 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800c490 tx=0x7f2bb800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 shutdown_connections 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2bc81393c0 0x7f2bc81233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2bc80a0a90 0x7f2bc8122950 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 --2- 172.21.15.125:0/1098095723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2bc80a1570 0x7f2bc8122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 >> 172.21.15.125:0/1098095723 conn(0x7f2bc8099c40 msgr2=0x7f2bc811c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 shutdown_connections 2023-10-03T10:18:33.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.124+0000 7f2bcd8d0700 1 -- 172.21.15.125:0/1098095723 wait complete. 2023-10-03T10:18:33.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 Processor -- start 2023-10-03T10:18:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 -- start start 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febc0134120 0x7febc013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc009dc00 con 0x7febc00a1380 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc009ea60 con 0x7febc0134120 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc74ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc009dec0 con 0x7febc00a0a70 2023-10-03T10:18:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc5a8a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febc0134120 0x7febc013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.206+0000 7febc5289700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febc0134120 0x7febc013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51940/0 (socket says 172.21.15.125:51940) 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5289700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58028/0 (socket says 172.21.15.125:58028) 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc4a88700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7febc00a1380 0x7febc0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45272/0 (socket says 172.21.15.125:45272) 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 -- 172.21.15.125:0/3842054146 learned_addr learned my addr 172.21.15.125:0/3842054146 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 -- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 msgr2=0x7febc00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 -- 172.21.15.125:0/3842054146 >> v1:172.21.15.125:6789/0 conn(0x7febc00a1380 legacy=0x7febc0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 -- 172.21.15.125:0/3842054146 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc009e6a0 con 0x7febc0134120 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febb7fff700 1 -- 172.21.15.125:0/3842054146 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490483072 0 0) 0x7febc009dc00 con 0x7febc00a1380 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5289700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febc5a8a700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc0134120 0x7febc013bce0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8364b78305076730 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febb7fff700 1 -- 172.21.15.125:0/3842054146 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800e070 con 0x7febc0134120 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febb7fff700 1 -- 172.21.15.125:0/3842054146 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800b910 con 0x7febc0134120 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.207+0000 7febb7fff700 1 -- 172.21.15.125:0/3842054146 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800bcc0 con 0x7febc0134120 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 -- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc0134120 msgr2=0x7febc013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc0134120 0x7febc013bce0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 -- 172.21.15.125:0/3842054146 shutdown_connections 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc0134120 0x7febc013bce0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 --2- 172.21.15.125:0/3842054146 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a0a70 0x7febc00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 -- 172.21.15.125:0/3842054146 >> 172.21.15.125:0/3842054146 conn(0x7febc00a6610 msgr2=0x7febc00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 -- 172.21.15.125:0/3842054146 shutdown_connections 2023-10-03T10:18:33.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.208+0000 7febc74ed700 1 -- 172.21.15.125:0/3842054146 wait complete. 2023-10-03T10:18:33.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 Processor -- start 2023-10-03T10:18:33.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 -- start start 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febc0134120 0x7febc01231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01332b0 con 0x7febc00a0a70 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01258b0 con 0x7febc0134120 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc74ed700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc01242c0 con 0x7febc00a1380 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc5289700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc4a88700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc5289700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51954/0 (socket says 172.21.15.125:51954) 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc4a88700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58036/0 (socket says 172.21.15.125:58036) 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc5289700 1 -- 172.21.15.125:0/1266706077 learned_addr learned my addr 172.21.15.125:0/1266706077 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.209+0000 7febc5a8a700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febc0134120 0x7febc01231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 -- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febc0134120 msgr2=0x7febc01231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febc0134120 0x7febc01231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 -- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 msgr2=0x7febc0122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 -- 172.21.15.125:0/1266706077 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0094a0 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc5289700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc4a88700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7febb000c470 tx=0x7febb000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0004c80 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0004de0 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0007310 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb8009b30 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.210+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc0125c30 con 0x7febc00a1380 2023-10-03T10:18:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.211+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febb0007470 con 0x7febc00a1380 2023-10-03T10:18:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.211+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7febb003f1a0 con 0x7febc00a1380 2023-10-03T10:18:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.211+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc004f2a0 con 0x7febc00a1380 2023-10-03T10:18:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.216+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febb000ce40 con 0x7febc00a1380 2023-10-03T10:18:33.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.246+0000 7f46f53b9700 1 Processor -- start 2023-10-03T10:18:33.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.246+0000 7f46f53b9700 1 -- start start 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46f53b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46f00a0a70 0x7f46f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46f53b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46f53b9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f009dc00 con 0x7f46f00a1380 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46f53b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f009ea90 con 0x7f46f00a0a70 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46f53b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f009dec0 con 0x7f46f0134120 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46eeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46f00a0a70 0x7f46f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ee7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f46f00a1380 0x7f46f0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45282/0 (socket says 172.21.15.125:45282) 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ee7fc700 1 -- 172.21.15.125:0/2835955636 learned_addr learned my addr 172.21.15.125:0/2835955636 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46edffb700 1 -- 172.21.15.125:0/2835955636 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017554467 0 0) 0x7f46f009dc00 con 0x7f46f00a1380 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46edffb700 1 -- 172.21.15.125:0/2835955636 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d80035b0 con 0x7f46f00a1380 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 -- 172.21.15.125:0/2835955636 >> v2:172.21.15.125:3300/0 conn(0x7f46f00a0a70 msgr2=0x7f46f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 --2- 172.21.15.125:0/2835955636 >> v2:172.21.15.125:3300/0 conn(0x7f46f00a0a70 0x7f46f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 -- 172.21.15.125:0/2835955636 >> v1:172.21.15.125:6789/0 conn(0x7f46f00a1380 legacy=0x7f46f0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 -- 172.21.15.125:0/2835955636 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f009e6a0 con 0x7f46f0134120 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46ef7fe700 1 --2- 172.21.15.125:0/2835955636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f013bce0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009d90 tx=0x7f46e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7461a4b59bc0c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.247+0000 7f46edffb700 1 -- 172.21.15.125:0/2835955636 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800e070 con 0x7f46f0134120 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46edffb700 1 -- 172.21.15.125:0/2835955636 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800bb20 con 0x7f46f0134120 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46edffb700 1 -- 172.21.15.125:0/2835955636 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8012430 con 0x7f46f0134120 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 -- 172.21.15.125:0/2835955636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 msgr2=0x7f46f013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 --2- 172.21.15.125:0/2835955636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f013bce0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009d90 tx=0x7f46e800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 -- 172.21.15.125:0/2835955636 shutdown_connections 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 --2- 172.21.15.125:0/2835955636 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f013bce0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 --2- 172.21.15.125:0/2835955636 >> v2:172.21.15.125:3300/0 conn(0x7f46f00a0a70 0x7f46f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 -- 172.21.15.125:0/2835955636 >> 172.21.15.125:0/2835955636 conn(0x7f46f00a6610 msgr2=0x7f46f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 -- 172.21.15.125:0/2835955636 shutdown_connections 2023-10-03T10:18:33.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.248+0000 7f46f53b9700 1 -- 172.21.15.125:0/2835955636 wait complete. 2023-10-03T10:18:33.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.249+0000 7f46f53b9700 1 Processor -- start 2023-10-03T10:18:33.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.249+0000 7f46f53b9700 1 -- start start 2023-10-03T10:18:33.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 0x7f46f0122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f01230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0124b30 con 0x7f46f00a1380 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0125e90 con 0x7f46f00a0a70 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0124370 con 0x7f46f0134120 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 0x7f46f0122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39242/0 (socket says 172.21.15.125:39242) 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 -- 172.21.15.125:0/3204315898 learned_addr learned my addr 172.21.15.125:0/3204315898 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46ef7fe700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f01230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 -- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 msgr2=0x7f46f01230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f01230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 -- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 msgr2=0x7f46f0122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 0x7f46f0122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 -- 172.21.15.125:0/3204315898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8009a70 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46ef7fe700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f01230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46ee7fc700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 0x7f46f0122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46eeffd700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f46e000ea10 tx=0x7f46e000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0009710 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e000eeb0 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f00a5610 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000ca50 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.250+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0126900 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.251+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f004f2a0 con 0x7f46f00a0a70 2023-10-03T10:18:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.251+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46e000cbb0 con 0x7f46f00a0a70 2023-10-03T10:18:33.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.251+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46e003f750 con 0x7f46f00a0a70 2023-10-03T10:18:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.260+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46e00232f0 con 0x7f46f00a0a70 2023-10-03T10:18:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.415+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7febc0072980 con 0x7febc00a1380 2023-10-03T10:18:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.416+0000 7febb5ffb700 1 -- 172.21.15.125:0/1266706077 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febb001b760 con 0x7febc00a1380 2023-10-03T10:18:33.416 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 msgr2=0x7febc0122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7febb000c470 tx=0x7febb000c780 comp rx=0 tx=0).stop 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 shutdown_connections 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febc0134120 0x7febc01231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febc00a0a70 0x7febc0122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 --2- 172.21.15.125:0/1266706077 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7febc00a1380 0x7febc0122c90 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 >> 172.21.15.125:0/1266706077 conn(0x7febc00a6610 msgr2=0x7febc011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 shutdown_connections 2023-10-03T10:18:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.418+0000 7febc74ed700 1 -- 172.21.15.125:0/1266706077 wait complete. 2023-10-03T10:18:33.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:33.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.456+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f46f0072980 con 0x7f46f00a0a70 2023-10-03T10:18:33.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.456+0000 7f46d77fe700 1 -- 172.21.15.125:0/3204315898 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46e001ae80 con 0x7f46f00a0a70 2023-10-03T10:18:33.457 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:33.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.458+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 msgr2=0x7f46f0122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f46e000ea10 tx=0x7f46e000ed20 comp rx=0 tx=0).stop 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 shutdown_connections 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f46f0134120 0x7f46f01230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f00a0a70 0x7f46f0122650 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 --2- 172.21.15.125:0/3204315898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f00a1380 0x7f46f0122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 >> 172.21.15.125:0/3204315898 conn(0x7f46f00a6610 msgr2=0x7f46f00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 shutdown_connections 2023-10-03T10:18:33.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:33.459+0000 7f46f53b9700 1 -- 172.21.15.125:0/3204315898 wait complete. 2023-10-03T10:18:33.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:34.006 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:34.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.130+0000 7ff67b2e8700 1 Processor -- start 2023-10-03T10:18:34.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 -- start start 2023-10-03T10:18:34.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6741300a0 0x7ff6741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67406b2d0 con 0x7ff6741309f0 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff674133610 con 0x7ff6741300a0 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff67b2e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67409a500 con 0x7ff674133ad0 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff679084700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff678883700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6741300a0 0x7ff6741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff679084700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39244/0 (socket says 172.21.15.125:39244) 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff678883700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6741300a0 0x7ff6741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51976/0 (socket says 172.21.15.125:51976) 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff679084700 1 -- 172.21.15.125:0/3771477798 learned_addr learned my addr 172.21.15.125:0/3771477798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff679885700 1 --1- 172.21.15.125:0/3771477798 >> v1:172.21.15.125:6789/0 conn(0x7ff6741309f0 0x7ff67413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45294/0 (socket says 172.21.15.125:45294) 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff678883700 1 -- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 msgr2=0x7ff674133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff678883700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.131+0000 7ff678883700 1 -- 172.21.15.125:0/3771477798 >> v1:172.21.15.125:6789/0 conn(0x7ff6741309f0 legacy=0x7ff67413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff678883700 1 -- 172.21.15.125:0/3771477798 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6741338b0 con 0x7ff6741300a0 2023-10-03T10:18:34.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff679084700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff678883700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff6741304b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff668009840 tx=0x7ff668009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450daf67f6b8397e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff673fff700 1 -- 172.21.15.125:0/3771477798 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668011830 con 0x7ff6741300a0 2023-10-03T10:18:34.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff673fff700 1 -- 172.21.15.125:0/3771477798 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668011990 con 0x7ff6741300a0 2023-10-03T10:18:34.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff673fff700 1 -- 172.21.15.125:0/3771477798 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668011d20 con 0x7ff6741300a0 2023-10-03T10:18:34.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 msgr2=0x7ff6741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff6741304b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff668009840 tx=0x7ff668009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3771477798 shutdown_connections 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3771477798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff6741304b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3771477798 >> 172.21.15.125:0/3771477798 conn(0x7ff674099c40 msgr2=0x7ff6740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3771477798 shutdown_connections 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.132+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3771477798 wait complete. 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.133+0000 7ff67b2e8700 1 Processor -- start 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.133+0000 7ff67b2e8700 1 -- start start 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6741309f0 0x7ff67411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff67411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67411f7c0 con 0x7ff6741300a0 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67412d910 con 0x7ff674133ad0 2023-10-03T10:18:34.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67411fa20 con 0x7ff6741309f0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51988/0 (socket says 172.21.15.125:51988) 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 -- 172.21.15.125:0/3097505679 learned_addr learned my addr 172.21.15.125:0/3097505679 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff678883700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6741309f0 0x7ff67411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679885700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff67411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 -- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6741309f0 msgr2=0x7ff67411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6741309f0 0x7ff67411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 -- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 msgr2=0x7ff67411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff67411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 -- 172.21.15.125:0/3097505679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c009550 con 0x7ff6741300a0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff679084700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00ebe0 tx=0x7ff66c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00c850 con 0x7ff6741300a0 2023-10-03T10:18:34.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c00c9b0 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00cd40 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.134+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6680094a0 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.135+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67411fce0 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.135+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff66c013470 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.135+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff66c03fbe0 con 0x7ff6741300a0 2023-10-03T10:18:34.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.135+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67404f2a0 con 0x7ff6741300a0 2023-10-03T10:18:34.139 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:34.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.140+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff66c01b3b0 con 0x7ff6741300a0 2023-10-03T10:18:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 Processor -- start 2023-10-03T10:18:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 -- start start 2023-10-03T10:18:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 0x7f56d4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 0x7f56d41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d409c970 con 0x7f56d409e870 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40a0920 con 0x7f56d41371c0 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56db04a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d409f9c0 con 0x7f56d409f350 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56d8de6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f56d409e870 0x7f56d409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45302/0 (socket says 172.21.15.125:45302) 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56d3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 0x7f56d4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56d8de6700 1 -- 172.21.15.125:0/3728090875 learned_addr learned my addr 172.21.15.125:0/3728090875 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.262+0000 7f56d95e7700 1 --2- 172.21.15.125:0/3728090875 >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 0x7f56d41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d37fe700 1 -- 172.21.15.125:0/3728090875 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210329146 0 0) 0x7f56d409c970 con 0x7f56d409e870 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d3fff700 1 -- 172.21.15.125:0/3728090875 >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 msgr2=0x7f56d41395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d3fff700 1 --2- 172.21.15.125:0/3728090875 >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 0x7f56d41395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d3fff700 1 -- 172.21.15.125:0/3728090875 >> v1:172.21.15.125:6789/0 conn(0x7f56d409e870 legacy=0x7f56d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d3fff700 1 -- 172.21.15.125:0/3728090875 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d409bab0 con 0x7f56d409f350 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d95e7700 1 --2- 172.21.15.125:0/3728090875 >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 0x7f56d41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d3fff700 1 --2- 172.21.15.125:0/3728090875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 0x7f56d4136c80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009840 tx=0x7f56c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9534682472732ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d37fe700 1 -- 172.21.15.125:0/3728090875 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0011830 con 0x7f56d409f350 2023-10-03T10:18:34.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d37fe700 1 -- 172.21.15.125:0/3728090875 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0011990 con 0x7f56d409f350 2023-10-03T10:18:34.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.263+0000 7f56d37fe700 1 -- 172.21.15.125:0/3728090875 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0011d20 con 0x7f56d409f350 2023-10-03T10:18:34.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 -- 172.21.15.125:0/3728090875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 msgr2=0x7f56d4136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 --2- 172.21.15.125:0/3728090875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 0x7f56d4136c80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009840 tx=0x7f56c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 -- 172.21.15.125:0/3728090875 shutdown_connections 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 --2- 172.21.15.125:0/3728090875 >> v2:172.21.15.125:3300/0 conn(0x7f56d41371c0 0x7f56d41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 --2- 172.21.15.125:0/3728090875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d409f350 0x7f56d4136c80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 -- 172.21.15.125:0/3728090875 >> 172.21.15.125:0/3728090875 conn(0x7f56d40a4430 msgr2=0x7f56d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 -- 172.21.15.125:0/3728090875 shutdown_connections 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 -- 172.21.15.125:0/3728090875 wait complete. 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.264+0000 7f56db04a700 1 Processor -- start 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 -- start start 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 0x7f56d41c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d41371c0 0x7f56d406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4136590 con 0x7f56d409e870 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d41bc2a0 con 0x7f56d409f350 2023-10-03T10:18:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56db04a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4072250 con 0x7f56d41371c0 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d8de6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 0x7f56d41c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d8de6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51996/0 (socket says 172.21.15.125:51996) 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d8de6700 1 -- 172.21.15.125:0/3719217854 learned_addr learned my addr 172.21.15.125:0/3719217854 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d95e7700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d41371c0 0x7f56d406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 -- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d41371c0 msgr2=0x7f56d406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d41371c0 0x7f56d406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 -- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 msgr2=0x7f56d41c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.265+0000 7f56d3fff700 1 -- 172.21.15.125:0/3719217854 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009a70 con 0x7f56d409f350 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56d8de6700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56d3fff700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 0x7f56d41c8c30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f56c0016000 tx=0x7f56c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00036a0 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c001f070 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c00094a0 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0003a20 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.266+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4126220 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.267+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56c0003b80 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.267+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56c0021070 con 0x7f56d409f350 2023-10-03T10:18:34.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.267+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d406ad00 con 0x7f56d409f350 2023-10-03T10:18:34.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.271+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56c0015070 con 0x7f56d409f350 2023-10-03T10:18:34.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.335+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff67406c3b0 con 0x7ff6741300a0 2023-10-03T10:18:34.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.336+0000 7ff671ffb700 1 -- 172.21.15.125:0/3097505679 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff66c011b00 con 0x7ff6741300a0 2023-10-03T10:18:34.336 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:34.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 msgr2=0x7ff67411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00ebe0 tx=0x7ff66c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 shutdown_connections 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff674133ad0 0x7ff67411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6741300a0 0x7ff67411da40 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 --2- 172.21.15.125:0/3097505679 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff6741309f0 0x7ff67411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 >> 172.21.15.125:0/3097505679 conn(0x7ff674099c40 msgr2=0x7ff674132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 shutdown_connections 2023-10-03T10:18:34.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.338+0000 7ff67b2e8700 1 -- 172.21.15.125:0/3097505679 wait complete. 2023-10-03T10:18:34.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:34.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:34.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.466+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56d41c9230 con 0x7f56d409f350 2023-10-03T10:18:34.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.467+0000 7f56d17fa700 1 -- 172.21.15.125:0/3719217854 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56c0019ba0 con 0x7f56d409f350 2023-10-03T10:18:34.467 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 msgr2=0x7f56d41c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 0x7f56d41c8c30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f56c0016000 tx=0x7f56c0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 shutdown_connections 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f56d41371c0 0x7f56d406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56d409e870 0x7f56d41c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 --2- 172.21.15.125:0/3719217854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56d409f350 0x7f56d41c8c30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 >> 172.21.15.125:0/3719217854 conn(0x7f56d40a4430 msgr2=0x7f56d409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 shutdown_connections 2023-10-03T10:18:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.469+0000 7f56db04a700 1 -- 172.21.15.125:0/3719217854 wait complete. 2023-10-03T10:18:34.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:34.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:34.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.558+0000 7f95eb810700 1 Processor -- start 2023-10-03T10:18:34.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 -- start start 2023-10-03T10:18:34.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 0x7f95e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 0x7f95e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e409e9d0 con 0x7f95e40a0a70 2023-10-03T10:18:34.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e409dc00 con 0x7f95e40a1550 2023-10-03T10:18:34.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95eb810700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e409dec0 con 0x7f95e4139200 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95e8dab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 0x7f95e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95e95ac700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f95e40a0a70 0x7f95e40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45312/0 (socket says 172.21.15.125:45312) 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95e95ac700 1 -- 172.21.15.125:0/2972808292 learned_addr learned my addr 172.21.15.125:0/2972808292 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.559+0000 7f95e9dad700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 0x7f95e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95dbfff700 1 -- 172.21.15.125:0/2972808292 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453228683 0 0) 0x7f95e409e9d0 con 0x7f95e40a0a70 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95dbfff700 1 -- 172.21.15.125:0/2972808292 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d00035b0 con 0x7f95e40a0a70 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e8dab700 1 -- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 msgr2=0x7f95e413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e8dab700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 0x7f95e413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e8dab700 1 -- 172.21.15.125:0/2972808292 >> v1:172.21.15.125:6789/0 conn(0x7f95e40a0a70 legacy=0x7f95e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e8dab700 1 -- 172.21.15.125:0/2972808292 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e409e6a0 con 0x7f95e40a1550 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e9dad700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 0x7f95e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95e8dab700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 0x7f95e4138cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009870 tx=0x7f95d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344fd04376a576f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95dbfff700 1 -- 172.21.15.125:0/2972808292 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4011830 con 0x7f95e40a1550 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95dbfff700 1 -- 172.21.15.125:0/2972808292 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4011990 con 0x7f95e40a1550 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.560+0000 7f95dbfff700 1 -- 172.21.15.125:0/2972808292 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4011d20 con 0x7f95e40a1550 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 -- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 msgr2=0x7f95e4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 0x7f95e4138cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009870 tx=0x7f95d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 -- 172.21.15.125:0/2972808292 shutdown_connections 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e4139200 0x7f95e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 --2- 172.21.15.125:0/2972808292 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a1550 0x7f95e4138cc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 -- 172.21.15.125:0/2972808292 >> 172.21.15.125:0/2972808292 conn(0x7f95e40a6610 msgr2=0x7f95e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 -- 172.21.15.125:0/2972808292 shutdown_connections 2023-10-03T10:18:34.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.561+0000 7f95eb810700 1 -- 172.21.15.125:0/2972808292 wait complete. 2023-10-03T10:18:34.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 Processor -- start 2023-10-03T10:18:34.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 -- start start 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a0a70 0x7f95e411e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4139200 0x7f95e411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40a5100 con 0x7f95e4139200 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4122120 con 0x7f95e40a0a70 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95eb810700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41347d0 con 0x7f95e40a1550 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95e8dab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95e95ac700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a0a70 0x7f95e411e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95e8dab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:58080/0 (socket says 172.21.15.125:58080) 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95e8dab700 1 -- 172.21.15.125:0/2745139377 learned_addr learned my addr 172.21.15.125:0/2745139377 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:34.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.562+0000 7f95e9dad700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4139200 0x7f95e411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 -- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a0a70 msgr2=0x7f95e411e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a0a70 0x7f95e411e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 -- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4139200 msgr2=0x7f95e411f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4139200 0x7f95e411f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 -- 172.21.15.125:0/2745139377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009a70 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95e8dab700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f95d40090b0 tx=0x7f95d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4004450 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d401f070 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40038e0 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d40094a0 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.563+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4120ce0 con 0x7f95e40a1550 2023-10-03T10:18:34.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.564+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4121d90 con 0x7f95e40a1550 2023-10-03T10:18:34.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.565+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d4003a40 con 0x7f95e40a1550 2023-10-03T10:18:34.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.565+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95d4021070 con 0x7f95e40a1550 2023-10-03T10:18:34.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.569+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95d40193b0 con 0x7f95e40a1550 2023-10-03T10:18:34.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.607+0000 7f3aae9a7700 1 Processor -- start 2023-10-03T10:18:34.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.607+0000 7f3aae9a7700 1 -- start start 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aae9a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aae9a7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3aa81371c0 0x7f3aa81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aae9a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa809c970 con 0x7f3aa809e870 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aae9a7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa80a0920 con 0x7f3aa81371c0 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aae9a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa809f9c0 con 0x7f3aa809f350 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aacf44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3aa81371c0 0x7f3aa81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aa77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aa7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3aa809e870 0x7f3aa809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45314/0 (socket says 172.21.15.125:45314) 2023-10-03T10:18:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.608+0000 7f3aa7fff700 1 -- 172.21.15.125:0/3353587220 learned_addr learned my addr 172.21.15.125:0/3353587220 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aacf44700 1 -- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 msgr2=0x7f3aa8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aacf44700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aacf44700 1 -- 172.21.15.125:0/3353587220 >> v1:172.21.15.125:6789/0 conn(0x7f3aa809e870 legacy=0x7f3aa809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aacf44700 1 -- 172.21.15.125:0/3353587220 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa809bab0 con 0x7f3aa81371c0 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aa6ffd700 1 -- 172.21.15.125:0/3353587220 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748717922 0 0) 0x7f3aa809c970 con 0x7f3aa809e870 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aa77fe700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aacf44700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa81395a0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009d90 tx=0x7f3aa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5227d746a2aea8bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aa6ffd700 1 -- 172.21.15.125:0/3353587220 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000e070 con 0x7f3aa81371c0 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aa6ffd700 1 -- 172.21.15.125:0/3353587220 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000bb20 con 0x7f3aa81371c0 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.609+0000 7f3aa6ffd700 1 -- 172.21.15.125:0/3353587220 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0012430 con 0x7f3aa81371c0 2023-10-03T10:18:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 -- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 msgr2=0x7f3aa81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa81395a0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009d90 tx=0x7f3aa000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 -- 172.21.15.125:0/3353587220 shutdown_connections 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa81395a0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/3353587220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 -- 172.21.15.125:0/3353587220 >> 172.21.15.125:0/3353587220 conn(0x7f3aa80a4430 msgr2=0x7f3aa80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 -- 172.21.15.125:0/3353587220 shutdown_connections 2023-10-03T10:18:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.610+0000 7f3aae9a7700 1 -- 172.21.15.125:0/3353587220 wait complete. 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.611+0000 7f3aae9a7700 1 Processor -- start 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.611+0000 7f3aae9a7700 1 -- start start 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa811f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8122fc0 con 0x7f3aa81371c0 2023-10-03T10:18:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa81216d0 con 0x7f3aa809e870 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa809dba0 con 0x7f3aa809f350 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa7fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39304/0 (socket says 172.21.15.125:39304) 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52026/0 (socket says 172.21.15.125:52026) 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa7fff700 1 -- 172.21.15.125:0/1912948178 learned_addr learned my addr 172.21.15.125:0/1912948178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa77fe700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa811f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 -- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 msgr2=0x7f3aa811f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa811f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 -- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 msgr2=0x7f3aa811f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 -- 172.21.15.125:0/1912948178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c0094a0 con 0x7f3aa81371c0 2023-10-03T10:18:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa77fe700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa811f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa7fff700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aacf44700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0016000 tx=0x7f3aa0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0012430 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0020070 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0004280 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.612+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0009a70 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.613+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8122a20 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.613+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aa00043e0 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.613+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa804f2a0 con 0x7f3aa81371c0 2023-10-03T10:18:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.614+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3aa0022070 con 0x7f3aa81371c0 2023-10-03T10:18:34.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.618+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aa0012e40 con 0x7f3aa81371c0 2023-10-03T10:18:34.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.785+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95e409f920 con 0x7f95e40a1550 2023-10-03T10:18:34.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.785+0000 7f95d9ffb700 1 -- 172.21.15.125:0/2745139377 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95d4034090 con 0x7f95e40a1550 2023-10-03T10:18:34.786 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 msgr2=0x7f95e411eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f95d40090b0 tx=0x7f95d4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 shutdown_connections 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4139200 0x7f95e411f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40a0a70 0x7f95e411e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 --2- 172.21.15.125:0/2745139377 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f95e40a1550 0x7f95e411eec0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 >> 172.21.15.125:0/2745139377 conn(0x7f95e40a6610 msgr2=0x7f95e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 shutdown_connections 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.788+0000 7f95eb810700 1 -- 172.21.15.125:0/2745139377 wait complete. 2023-10-03T10:18:34.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:34.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.817+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3aa81218a0 con 0x7f3aa81371c0 2023-10-03T10:18:34.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.817+0000 7f3aa4ff9700 1 -- 172.21.15.125:0/1912948178 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3aa00263e0 con 0x7f3aa81371c0 2023-10-03T10:18:34.817 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 msgr2=0x7f3aa811ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0016000 tx=0x7f3aa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 shutdown_connections 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa81371c0 0x7f3aa811ff20 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3aa809e870 0x7f3aa811f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 --2- 172.21.15.125:0/1912948178 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3aa809f350 0x7f3aa811f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 >> 172.21.15.125:0/1912948178 conn(0x7f3aa80a4430 msgr2=0x7f3aa80a2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 shutdown_connections 2023-10-03T10:18:34.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:34.819+0000 7f3aae9a7700 1 -- 172.21.15.125:0/1912948178 wait complete. 2023-10-03T10:18:34.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:35.352 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:35.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.475+0000 7f494e15d700 1 Processor -- start 2023-10-03T10:18:35.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.475+0000 7f494e15d700 1 -- start start 2023-10-03T10:18:35.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f494e15d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f494e15d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4948130eb0 0x7f4948138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f494e15d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494809aaa0 con 0x7f494809e170 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f494e15d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494809f870 con 0x7f4948130eb0 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f494e15d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494809b360 con 0x7f494809d860 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f4947fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4948130eb0 0x7f4948138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f49477fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f4947fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4948130eb0 0x7f4948138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54218/0 (socket says 172.21.15.125:54218) 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f49477fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39688/0 (socket says 172.21.15.125:39688) 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.476+0000 7f4947fff700 1 -- 172.21.15.125:0/1460542957 learned_addr learned my addr 172.21.15.125:0/1460542957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f4947fff700 1 -- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 msgr2=0x7f494809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f4947fff700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f4947fff700 1 -- 172.21.15.125:0/1460542957 >> v1:172.21.15.125:6789/0 conn(0x7f494809e170 legacy=0x7f49481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f4947fff700 1 -- 172.21.15.125:0/1460542957 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494809b620 con 0x7f4948130eb0 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f49467fc700 1 -- 172.21.15.125:0/1460542957 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180161391 0 0) 0x7f494809aaa0 con 0x7f494809e170 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f49477fe700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f4947fff700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f4948138a00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f4940009e50 tx=0x7f494000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49b16a971710620 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f49467fc700 1 -- 172.21.15.125:0/1460542957 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000e070 con 0x7f4948130eb0 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f49467fc700 1 -- 172.21.15.125:0/1460542957 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000b910 con 0x7f4948130eb0 2023-10-03T10:18:35.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f49467fc700 1 -- 172.21.15.125:0/1460542957 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000bcc0 con 0x7f4948130eb0 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 -- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 msgr2=0x7f4948138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f4948138a00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f4940009e50 tx=0x7f494000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 -- 172.21.15.125:0/1460542957 shutdown_connections 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f4948138a00 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 --2- 172.21.15.125:0/1460542957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809d860 0x7f494809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.477+0000 7f494e15d700 1 -- 172.21.15.125:0/1460542957 >> 172.21.15.125:0/1460542957 conn(0x7f4948099c40 msgr2=0x7f49480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.478+0000 7f494e15d700 1 -- 172.21.15.125:0/1460542957 shutdown_connections 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.478+0000 7f494e15d700 1 -- 172.21.15.125:0/1460542957 wait complete. 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.479+0000 7f494e15d700 1 Processor -- start 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.479+0000 7f494e15d700 1 -- start start 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.479+0000 7f494e15d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 0x7f494811e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 0x7f494811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f494811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4948120cf0 con 0x7f4948130eb0 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480a07b0 con 0x7f494809e170 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494809c8b0 con 0x7f494809d860 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f49477fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 0x7f494811e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f49477fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 0x7f494811e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33896/0 (socket says 172.21.15.125:33896) 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f49477fe700 1 -- 172.21.15.125:0/1821208384 learned_addr learned my addr 172.21.15.125:0/1821208384 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f494811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4946ffd700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 0x7f494811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 -- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 msgr2=0x7f494811e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 0x7f494811e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 -- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 msgr2=0x7f494811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 0x7f494811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 -- 172.21.15.125:0/1821208384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094a0 con 0x7f4948130eb0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4946ffd700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 0x7f494811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f4947fff700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f494811eea0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f4940015000 tx=0x7f4940004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940004880 con 0x7f4948130eb0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49400092e0 con 0x7f4948130eb0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940009b30 con 0x7f4948130eb0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494001c630 con 0x7f4948130eb0 2023-10-03T10:18:35.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.480+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494811f810 con 0x7f4948130eb0 2023-10-03T10:18:35.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.481+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f494001c790 con 0x7f4948130eb0 2023-10-03T10:18:35.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:35.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.481+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494804f2a0 con 0x7f4948130eb0 2023-10-03T10:18:35.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.481+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4940040e10 con 0x7f4948130eb0 2023-10-03T10:18:35.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.486+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f494006c750 con 0x7f4948130eb0 2023-10-03T10:18:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.608+0000 7fd13271f700 1 Processor -- start 2023-10-03T10:18:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.608+0000 7fd13271f700 1 -- start start 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd13271f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd13271f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a1380 0x7fd12c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd13271f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c09dc00 con 0x7fd12c133f50 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd13271f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c09ea60 con 0x7fd12c0a0a70 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd13271f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c09dec0 con 0x7fd12c0a1380 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39700/0 (socket says 172.21.15.125:39700) 2023-10-03T10:18:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 -- 172.21.15.125:0/938755612 learned_addr learned my addr 172.21.15.125:0/938755612 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12b7fe700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a1380 0x7fd12c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 -- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a1380 msgr2=0x7fd12c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a1380 0x7fd12c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 -- 172.21.15.125:0/938755612 >> v1:172.21.15.125:6789/0 conn(0x7fd12c133f50 legacy=0x7fd12c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 -- 172.21.15.125:0/938755612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c09e6a0 con 0x7fd12c0a0a70 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12bfff700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009920 tx=0x7fd11c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7495bf4e56b1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12affd700 1 -- 172.21.15.125:0/938755612 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011830 con 0x7fd12c0a0a70 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12affd700 1 -- 172.21.15.125:0/938755612 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c011990 con 0x7fd12c0a0a70 2023-10-03T10:18:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.609+0000 7fd12affd700 1 -- 172.21.15.125:0/938755612 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011d20 con 0x7fd12c0a0a70 2023-10-03T10:18:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 -- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 msgr2=0x7fd12c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009920 tx=0x7fd11c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 -- 172.21.15.125:0/938755612 shutdown_connections 2023-10-03T10:18:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a0a70 0x7fd12c0a0e40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 --2- 172.21.15.125:0/938755612 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a1380 0x7fd12c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 -- 172.21.15.125:0/938755612 >> 172.21.15.125:0/938755612 conn(0x7fd12c0a6610 msgr2=0x7fd12c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 -- 172.21.15.125:0/938755612 shutdown_connections 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.610+0000 7fd13271f700 1 -- 172.21.15.125:0/938755612 wait complete. 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.612+0000 7fd13271f700 1 Processor -- start 2023-10-03T10:18:35.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.612+0000 7fd13271f700 1 -- start start 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.612+0000 7fd13271f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 0x7fd12c1c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 0x7fd12c1c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c125300 con 0x7fd12c133f50 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c124780 con 0x7fd12c0a1380 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0a03e0 con 0x7fd12c0a0a70 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 0x7fd12c1c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 0x7fd12c1c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12b7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 0x7fd12c1c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39714/0 (socket says 172.21.15.125:39714) 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12b7fe700 1 -- 172.21.15.125:0/2911981512 learned_addr learned my addr 172.21.15.125:0/2911981512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33912/0 (socket says 172.21.15.125:33912) 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 -- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 msgr2=0x7fd12c1c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 -- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 msgr2=0x7fd12c1c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 0x7fd12c1c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 -- 172.21.15.125:0/2911981512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c009550 con 0x7fd12c133f50 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd12bfff700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd130cbc700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 0x7fd12c1c8ce0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fd12400cb90 tx=0x7fd12400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124003c00 con 0x7fd12c133f50 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124003d60 con 0x7fd12c133f50 2023-10-03T10:18:35.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c125f70 con 0x7fd12c133f50 2023-10-03T10:18:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400aa80 con 0x7fd12c133f50 2023-10-03T10:18:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.613+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c126ca0 con 0x7fd12c133f50 2023-10-03T10:18:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.614+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd12400abe0 con 0x7fd12c133f50 2023-10-03T10:18:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.614+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd12403f5a0 con 0x7fd12c133f50 2023-10-03T10:18:35.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.614+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c04f2a0 con 0x7fd12c133f50 2023-10-03T10:18:35.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.619+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1240198f0 con 0x7fd12c133f50 2023-10-03T10:18:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.682+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f494806c3b0 con 0x7f4948130eb0 2023-10-03T10:18:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.682+0000 7f492ffff700 1 -- 172.21.15.125:0/1821208384 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4940029020 con 0x7f4948130eb0 2023-10-03T10:18:35.683 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 msgr2=0x7f494811eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f494811eea0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f4940015000 tx=0x7f4940004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 shutdown_connections 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4948130eb0 0x7f494811eea0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f494809d860 0x7f494811e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 --2- 172.21.15.125:0/1821208384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494809e170 0x7f494811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 >> 172.21.15.125:0/1821208384 conn(0x7f4948099c40 msgr2=0x7f49480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 shutdown_connections 2023-10-03T10:18:35.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.685+0000 7f494e15d700 1 -- 172.21.15.125:0/1821208384 wait complete. 2023-10-03T10:18:35.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:35.801 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.807+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd12c072980 con 0x7fd12c133f50 2023-10-03T10:18:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.808+0000 7fd128ff9700 1 -- 172.21.15.125:0/2911981512 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd124019300 con 0x7fd12c133f50 2023-10-03T10:18:35.808 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 msgr2=0x7fd12c1c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 0x7fd12c1c8ce0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fd12400cb90 tx=0x7fd12400cea0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 shutdown_connections 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd12c133f50 0x7fd12c1c8ce0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd12c0a0a70 0x7fd12c1c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 --2- 172.21.15.125:0/2911981512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd12c0a1380 0x7fd12c1c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 >> 172.21.15.125:0/2911981512 conn(0x7fd12c0a6610 msgr2=0x7fd12c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 shutdown_connections 2023-10-03T10:18:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.810+0000 7fd13271f700 1 -- 172.21.15.125:0/2911981512 wait complete. 2023-10-03T10:18:35.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:35.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.925+0000 7f45f330d700 1 Processor -- start 2023-10-03T10:18:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.925+0000 7f45f330d700 1 -- start start 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f330d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f330d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f330d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec09b110 con 0x7f45ec0a0a70 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f330d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0a3b60 con 0x7f45ec133f70 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f330d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1348e0 con 0x7f45ec09ad40 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f08a8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33926/0 (socket says 172.21.15.125:33926) 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 -- 172.21.15.125:0/661246727 learned_addr learned my addr 172.21.15.125:0/661246727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 -- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 msgr2=0x7f45ec1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 -- 172.21.15.125:0/661246727 >> v1:172.21.15.125:6789/0 conn(0x7f45ec0a0a70 legacy=0x7f45ec0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45e3fff700 1 -- 172.21.15.125:0/661246727 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798531933 0 0) 0x7f45ec09b110 con 0x7f45ec0a0a70 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 -- 172.21.15.125:0/661246727 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0a2fa0 con 0x7f45ec09ad40 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f08a8700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45f10a9700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009920 tx=0x7f45e8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dfa5098e19b5048 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45e3fff700 1 -- 172.21.15.125:0/661246727 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011830 con 0x7f45ec09ad40 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45e3fff700 1 -- 172.21.15.125:0/661246727 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8011990 con 0x7f45ec09ad40 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.926+0000 7f45e3fff700 1 -- 172.21.15.125:0/661246727 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011d20 con 0x7f45ec09ad40 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 -- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 msgr2=0x7f45ec133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009920 tx=0x7f45e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 -- 172.21.15.125:0/661246727 shutdown_connections 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec133a30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 --2- 172.21.15.125:0/661246727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 -- 172.21.15.125:0/661246727 >> 172.21.15.125:0/661246727 conn(0x7f45ec099c40 msgr2=0x7f45ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 -- 172.21.15.125:0/661246727 shutdown_connections 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.927+0000 7f45f330d700 1 -- 172.21.15.125:0/661246727 wait complete. 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.928+0000 7f45f330d700 1 Processor -- start 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.928+0000 7f45f330d700 1 -- start start 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec120790 con 0x7f45ec0a0a70 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1205a0 con 0x7f45ec133f70 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f330d700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1224b0 con 0x7f45ec09ad40 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f10a9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f08a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39740/0 (socket says 172.21.15.125:39740) 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 -- 172.21.15.125:0/3589764255 learned_addr learned my addr 172.21.15.125:0/3589764255 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 -- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 msgr2=0x7f45ec1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 -- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 msgr2=0x7f45ec1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f18aa700 1 -- 172.21.15.125:0/3589764255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0094a0 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f10a9700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.929+0000 7f45f08a8700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45f18aa700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001560 tx=0x7f45e400cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4003e30 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4005070 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4005420 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8009550 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.930+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec1221d0 con 0x7f45ec133f70 2023-10-03T10:18:35.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.931+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45e4005580 con 0x7f45ec133f70 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.931+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f45e403ed00 con 0x7f45ec133f70 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.931+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec121e70 con 0x7f45ec133f70 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.936+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45ec121e70 con 0x7f45ec133f70 2023-10-03T10:18:35.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.988+0000 7f34547c1700 1 Processor -- start 2023-10-03T10:18:35.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.988+0000 7f34547c1700 1 -- start start 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c09e9d0 con 0x7f344c0a1380 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c09dc00 con 0x7f344c133f50 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f34547c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344c09dec0 con 0x7f344c0a0a70 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f345255d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54250/0 (socket says 172.21.15.125:54250) 2023-10-03T10:18:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f345255d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33930/0 (socket says 172.21.15.125:33930) 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 -- 172.21.15.125:0/1345000531 learned_addr learned my addr 172.21.15.125:0/1345000531 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3452d5e700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 -- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 msgr2=0x7f344c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 -- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 msgr2=0x7f344c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3451d5c700 1 -- 172.21.15.125:0/1345000531 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c09e6a0 con 0x7f344c0a1380 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f345255d700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.989+0000 7f3452d5e700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f3451d5c700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d2c8b877a88d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f345155b700 1 -- 172.21.15.125:0/1345000531 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011830 con 0x7f344c0a1380 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f345155b700 1 -- 172.21.15.125:0/1345000531 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c011990 con 0x7f344c0a1380 2023-10-03T10:18:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f345155b700 1 -- 172.21.15.125:0/1345000531 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011d20 con 0x7f344c0a1380 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 -- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 msgr2=0x7f344c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 -- 172.21.15.125:0/1345000531 shutdown_connections 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a0a70 0x7f344c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 --2- 172.21.15.125:0/1345000531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a1380 0x7f344c133a10 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 -- 172.21.15.125:0/1345000531 >> 172.21.15.125:0/1345000531 conn(0x7f344c0a6610 msgr2=0x7f344c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 -- 172.21.15.125:0/1345000531 shutdown_connections 2023-10-03T10:18:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.990+0000 7f34547c1700 1 -- 172.21.15.125:0/1345000531 wait complete. 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.991+0000 7f34547c1700 1 Processor -- start 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.991+0000 7f34547c1700 1 -- start start 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c133760 con 0x7f344c0a0a70 2023-10-03T10:18:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c1237f0 con 0x7f344c133f50 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f34547c1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344c124e30 con 0x7f344c0a1380 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f345255d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f345255d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54266/0 (socket says 172.21.15.125:54266) 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f345255d700 1 -- 172.21.15.125:0/525416113 learned_addr learned my addr 172.21.15.125:0/525416113 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3451d5c700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 -- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 msgr2=0x7f344c1228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c1228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 -- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 msgr2=0x7f344c122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 -- 172.21.15.125:0/525416113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480094a0 con 0x7f344c133f50 2023-10-03T10:18:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f345255d700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3452d5e700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c122e10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3444009e50 tx=0x7f344400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.992+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400ca90 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344400f040 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400ce50 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3444009a70 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c009550 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3444014480 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.993+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c0a51e0 con 0x7f344c133f50 2023-10-03T10:18:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.994+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f344403fc10 con 0x7f344c133f50 2023-10-03T10:18:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:35.998+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3444012930 con 0x7f344c133f50 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.130+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45ec121e70 con 0x7f45ec133f70 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.130+0000 7f45e1ffb700 1 -- 172.21.15.125:0/3589764255 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45ec121e70 con 0x7f45ec133f70 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:36.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 msgr2=0x7f45ec1c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001560 tx=0x7f45e400cb50 comp rx=0 tx=0).stop 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 shutdown_connections 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ec133f70 0x7f45ec1c8c80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f45ec09ad40 0x7f45ec1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 --2- 172.21.15.125:0/3589764255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 >> 172.21.15.125:0/3589764255 conn(0x7f45ec099c40 msgr2=0x7f45ec1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 shutdown_connections 2023-10-03T10:18:36.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.132+0000 7f45f330d700 1 -- 172.21.15.125:0/3589764255 wait complete. 2023-10-03T10:18:36.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:36.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.188+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f344c11f760 con 0x7f344c133f50 2023-10-03T10:18:36.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.188+0000 7f3442ffd700 1 -- 172.21.15.125:0/525416113 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3444012340 con 0x7f344c133f50 2023-10-03T10:18:36.188 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 msgr2=0x7f344c122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c122e10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3444009e50 tx=0x7f344400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 shutdown_connections 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f344c133f50 0x7f344c122e10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f344c0a0a70 0x7f344c122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 --2- 172.21.15.125:0/525416113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f344c0a1380 0x7f344c1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 >> 172.21.15.125:0/525416113 conn(0x7f344c0a6610 msgr2=0x7f344c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 shutdown_connections 2023-10-03T10:18:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.190+0000 7f34547c1700 1 -- 172.21.15.125:0/525416113 wait complete. 2023-10-03T10:18:36.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:36.699 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:36.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.821+0000 7f520af11700 1 Processor -- start 2023-10-03T10:18:36.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.821+0000 7f520af11700 1 -- start start 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f520af11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 0x7f5204133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f520af11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f520af11700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520406b2d0 con 0x7f52041300a0 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f520af11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5204133610 con 0x7f5204133ad0 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f520af11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520409a500 con 0x7f5204130bc0 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52094ae700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5203fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f52041300a0 0x7f52041304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46830/0 (socket says 172.21.15.125:46830) 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 0x7f5204133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5203fff700 1 -- 172.21.15.125:0/4206615624 learned_addr learned my addr 172.21.15.125:0/4206615624 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52037fe700 1 -- 172.21.15.125:0/4206615624 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389693146 0 0) 0x7f520406b2d0 con 0x7f52041300a0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 -- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 msgr2=0x7f520413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 -- 172.21.15.125:0/4206615624 >> v1:172.21.15.125:6789/0 conn(0x7f52041300a0 legacy=0x7f52041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 -- 172.21.15.125:0/4206615624 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52041338b0 con 0x7f5204133ad0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52094ae700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f5208cad700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 0x7f5204133ea0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405453ad3f32ff97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52037fe700 1 -- 172.21.15.125:0/4206615624 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011830 con 0x7f5204133ad0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52037fe700 1 -- 172.21.15.125:0/4206615624 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8011990 con 0x7f5204133ad0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.822+0000 7f52037fe700 1 -- 172.21.15.125:0/4206615624 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011d20 con 0x7f5204133ad0 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 -- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 msgr2=0x7f5204133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 0x7f5204133ea0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 -- 172.21.15.125:0/4206615624 shutdown_connections 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 --2- 172.21.15.125:0/4206615624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5204133ad0 0x7f5204133ea0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 -- 172.21.15.125:0/4206615624 >> 172.21.15.125:0/4206615624 conn(0x7f5204099c40 msgr2=0x7f52040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 -- 172.21.15.125:0/4206615624 shutdown_connections 2023-10-03T10:18:36.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.823+0000 7f520af11700 1 -- 172.21.15.125:0/4206615624 wait complete. 2023-10-03T10:18:36.826 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 Processor -- start 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 -- start start 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 0x7f520411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520411f060 con 0x7f5204133ad0 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520412fe60 con 0x7f52041300a0 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.824+0000 7f520af11700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520411f850 con 0x7f5204130bc0 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5203fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52094ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5203fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33958/0 (socket says 172.21.15.125:33958) 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52094ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54272/0 (socket says 172.21.15.125:54272) 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5203fff700 1 -- 172.21.15.125:0/1265084589 learned_addr learned my addr 172.21.15.125:0/1265084589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 0x7f520411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 -- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 msgr2=0x7f520411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 -- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 msgr2=0x7f520411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 -- 172.21.15.125:0/1265084589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009a70 con 0x7f52041300a0 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5203fff700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52094ae700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f5208cad700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 0x7f520411da40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f51f8016000 tx=0x7f51f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8004550 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80036a0 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8003a50 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f80094a0 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.825+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520412dd00 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.826+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51f8003bb0 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.826+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51f8040870 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.826+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520404f2a0 con 0x7f52041300a0 2023-10-03T10:18:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.831+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51f8003e60 con 0x7f52041300a0 2023-10-03T10:18:36.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.953+0000 7feec741a700 1 Processor -- start 2023-10-03T10:18:36.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 -- start start 2023-10-03T10:18:36.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec009b110 con 0x7feec00a0a70 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00a3b60 con 0x7feec0133f70 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec741a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec01348e0 con 0x7feec009ad40 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec49b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec51b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec59b7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feec00a0a70 0x7feec00a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46832/0 (socket says 172.21.15.125:46832) 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec49b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39790/0 (socket says 172.21.15.125:39790) 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec51b6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33960/0 (socket says 172.21.15.125:33960) 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.954+0000 7feec59b7700 1 -- 172.21.15.125:0/1265356928 learned_addr learned my addr 172.21.15.125:0/1265356928 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feeb7fff700 1 -- 172.21.15.125:0/1265356928 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539904717 0 0) 0x7feec009b110 con 0x7feec00a0a70 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feeb7fff700 1 -- 172.21.15.125:0/1265356928 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac0035b0 con 0x7feec00a0a70 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec51b6700 1 -- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 msgr2=0x7feec01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec51b6700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec51b6700 1 -- 172.21.15.125:0/1265356928 >> v1:172.21.15.125:6789/0 conn(0x7feec00a0a70 legacy=0x7feec00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec51b6700 1 -- 172.21.15.125:0/1265356928 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00a2fa0 con 0x7feec009ad40 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec49b5700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec51b6700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feebc009870 tx=0x7feebc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e681c04306fdea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feeb7fff700 1 -- 172.21.15.125:0/1265356928 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc011830 con 0x7feec009ad40 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feeb7fff700 1 -- 172.21.15.125:0/1265356928 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc011990 con 0x7feec009ad40 2023-10-03T10:18:36.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feeb7fff700 1 -- 172.21.15.125:0/1265356928 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc011d20 con 0x7feec009ad40 2023-10-03T10:18:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 -- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 msgr2=0x7feec0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feebc009870 tx=0x7feebc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 -- 172.21.15.125:0/1265356928 shutdown_connections 2023-10-03T10:18:36.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec009ad40 0x7feec0133a30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 --2- 172.21.15.125:0/1265356928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec0133f70 0x7feec01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.955+0000 7feec741a700 1 -- 172.21.15.125:0/1265356928 >> 172.21.15.125:0/1265356928 conn(0x7feec0099c40 msgr2=0x7feec006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.956+0000 7feec741a700 1 -- 172.21.15.125:0/1265356928 shutdown_connections 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.956+0000 7feec741a700 1 -- 172.21.15.125:0/1265356928 wait complete. 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.956+0000 7feec741a700 1 Processor -- start 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.956+0000 7feec741a700 1 -- start start 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 0x7feec011f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 0x7feec01c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec011ef00 con 0x7feec009ad40 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec01333d0 con 0x7feec00a0a70 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec741a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec0121fc0 con 0x7feec0133f70 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec51b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 0x7feec011f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec51b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54284/0 (socket says 172.21.15.125:54284) 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec51b6700 1 -- 172.21.15.125:0/2016653865 learned_addr learned my addr 172.21.15.125:0/2016653865 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec59b7700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 0x7feec01c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 -- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 msgr2=0x7feec01c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 0x7feec01c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 -- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 msgr2=0x7feec011f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 -- 172.21.15.125:0/2016653865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00094a0 con 0x7feec00a0a70 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec59b7700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 0x7feec01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec51b6700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.957+0000 7feec49b5700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 0x7feec011f910 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9b0 tx=0x7feeb000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.958+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000ee50 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.958+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000c850 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.958+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc0094a0 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.958+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000cbe0 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.958+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec011fea0 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.959+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feeb000cd40 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.959+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feeb003f6c0 con 0x7feec00a0a70 2023-10-03T10:18:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.959+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec004f2a0 con 0x7feec00a0a70 2023-10-03T10:18:36.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:36.963+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feeb001bdf0 con 0x7feec00a0a70 2023-10-03T10:18:37.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.024+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f520406c3b0 con 0x7f52041300a0 2023-10-03T10:18:37.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.025+0000 7f52017fa700 1 -- 172.21.15.125:0/1265084589 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51f8015030 con 0x7f52041300a0 2023-10-03T10:18:37.025 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 msgr2=0x7f520411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 0x7f520411da40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f51f8016000 tx=0x7f51f8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 shutdown_connections 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5204133ad0 0x7f520411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52041300a0 0x7f520411da40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 --2- 172.21.15.125:0/1265084589 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5204130bc0 0x7f520411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 >> 172.21.15.125:0/1265084589 conn(0x7f5204099c40 msgr2=0x7f52041320d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 shutdown_connections 2023-10-03T10:18:37.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.027+0000 7f520af11700 1 -- 172.21.15.125:0/1265084589 wait complete. 2023-10-03T10:18:37.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:37.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:37.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.152+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feec0120650 con 0x7feec00a0a70 2023-10-03T10:18:37.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.152+0000 7feeb5ffb700 1 -- 172.21.15.125:0/2016653865 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feeb0017020 con 0x7feec00a0a70 2023-10-03T10:18:37.152 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 msgr2=0x7feec011f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 0x7feec011f910 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9b0 tx=0x7feeb000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 shutdown_connections 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7feec0133f70 0x7feec01c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec009ad40 0x7feec011f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 --2- 172.21.15.125:0/2016653865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec00a0a70 0x7feec011f910 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 >> 172.21.15.125:0/2016653865 conn(0x7feec0099c40 msgr2=0x7feec01bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 shutdown_connections 2023-10-03T10:18:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.154+0000 7feec741a700 1 -- 172.21.15.125:0/2016653865 wait complete. 2023-10-03T10:18:37.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:37.203 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:37.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 Processor -- start 2023-10-03T10:18:37.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 -- start start 2023-10-03T10:18:37.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a80a3b60 con 0x7f22a80a0a70 2023-10-03T10:18:37.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81348e0 con 0x7f22a809ad40 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.271+0000 7f22aee5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22a809b110 con 0x7f22a8133f70 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22ad3f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22acbf8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22ad3f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54298/0 (socket says 172.21.15.125:54298) 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22ad3f9700 1 -- 172.21.15.125:0/1418852771 learned_addr learned my addr 172.21.15.125:0/1418852771 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 -- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 msgr2=0x7f22a8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 -- 172.21.15.125:0/1418852771 >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 msgr2=0x7f22a80a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1418852771 >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 -- 172.21.15.125:0/1418852771 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80a2fa0 con 0x7f22a8133f70 2023-10-03T10:18:37.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22ad3f9700 1 --2- 172.21.15.125:0/1418852771 >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22acbf8700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a81343a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2294009840 tx=0x7f2294009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6dae5f03f0ca49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a77fe700 1 -- 172.21.15.125:0/1418852771 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011830 con 0x7f22a8133f70 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a77fe700 1 -- 172.21.15.125:0/1418852771 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294011990 con 0x7f22a8133f70 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.272+0000 7f22a77fe700 1 -- 172.21.15.125:0/1418852771 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011d20 con 0x7f22a8133f70 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 -- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 msgr2=0x7f22a81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a81343a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2294009840 tx=0x7f2294009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 -- 172.21.15.125:0/1418852771 shutdown_connections 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1418852771 >> v2:172.21.15.125:3300/0 conn(0x7f22a80a0a70 0x7f22a80a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1418852771 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a81343a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 -- 172.21.15.125:0/1418852771 >> 172.21.15.125:0/1418852771 conn(0x7f22a8099c40 msgr2=0x7f22a806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 -- 172.21.15.125:0/1418852771 shutdown_connections 2023-10-03T10:18:37.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.273+0000 7f22aee5c700 1 -- 172.21.15.125:0/1418852771 wait complete. 2023-10-03T10:18:37.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 Processor -- start 2023-10-03T10:18:37.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 -- start start 2023-10-03T10:18:37.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a8121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8122e40 con 0x7f22a80a0a70 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8124b10 con 0x7f22a809ad40 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.274+0000 7f22aee5c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8123cd0 con 0x7f22a8133f70 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54312/0 (socket says 172.21.15.125:54312) 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 -- 172.21.15.125:0/1659143277 learned_addr learned my addr 172.21.15.125:0/1659143277 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22ad3f9700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a8121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22acbf8700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 -- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 msgr2=0x7f22a8121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a8121cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 -- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 msgr2=0x7f22a8121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 -- 172.21.15.125:0/1659143277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0094a0 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22ad3f9700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a8121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a7fff700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f22940090b0 tx=0x7f2294004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294004450 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940045b0 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940038c0 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0009b30 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.275+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940094a0 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.276+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a809bf00 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.276+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2294003a20 con 0x7f22a80a0a70 2023-10-03T10:18:37.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.276+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2294040890 con 0x7f22a80a0a70 2023-10-03T10:18:37.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.281+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f229401a420 con 0x7f22a80a0a70 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.334+0000 7f4176d44700 1 Processor -- start 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.334+0000 7f4176d44700 1 -- start start 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4176d44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 0x7f41700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4176d44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4176d44700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417009dc00 con 0x7f4170133f50 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4176d44700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417009ea60 con 0x7f41700a0a70 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4176d44700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417009dec0 con 0x7f41700a1380 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4174ae0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 0x7f41700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39824/0 (socket says 172.21.15.125:39824) 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 -- 172.21.15.125:0/414954191 learned_addr learned my addr 172.21.15.125:0/414954191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 -- 172.21.15.125:0/414954191 >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 msgr2=0x7f41700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 --2- 172.21.15.125:0/414954191 >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 0x7f41700a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 -- 172.21.15.125:0/414954191 >> v1:172.21.15.125:6789/0 conn(0x7f4170133f50 legacy=0x7f417013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 -- 172.21.15.125:0/414954191 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417009e6a0 con 0x7f41700a1380 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f4174ae0700 1 --2- 172.21.15.125:0/414954191 >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 0x7f41700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.335+0000 7f416ffff700 1 --2- 172.21.15.125:0/414954191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098f0 tx=0x7f415c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f668d3f8df1527 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f416f7fe700 1 -- 172.21.15.125:0/414954191 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c011830 con 0x7f41700a1380 2023-10-03T10:18:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f416f7fe700 1 -- 172.21.15.125:0/414954191 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c011990 con 0x7f41700a1380 2023-10-03T10:18:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f416f7fe700 1 -- 172.21.15.125:0/414954191 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c011d20 con 0x7f41700a1380 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 -- 172.21.15.125:0/414954191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 msgr2=0x7f4170133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 --2- 172.21.15.125:0/414954191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098f0 tx=0x7f415c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 -- 172.21.15.125:0/414954191 shutdown_connections 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 --2- 172.21.15.125:0/414954191 >> v2:172.21.15.125:3300/0 conn(0x7f41700a0a70 0x7f41700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 --2- 172.21.15.125:0/414954191 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a1380 0x7f4170133a10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 -- 172.21.15.125:0/414954191 >> 172.21.15.125:0/414954191 conn(0x7f41700a6610 msgr2=0x7f41700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 -- 172.21.15.125:0/414954191 shutdown_connections 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.336+0000 7f4176d44700 1 -- 172.21.15.125:0/414954191 wait complete. 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.338+0000 7f4176d44700 1 Processor -- start 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.338+0000 7f4176d44700 1 -- start start 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.338+0000 7f4176d44700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.338+0000 7f4176d44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 0x7f41701c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 0x7f41701c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170122e90 con 0x7f4170133f50 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4170133a10 con 0x7f41700a0a70 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41700a03e0 con 0x7f41700a1380 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f416ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 0x7f41701c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39826/0 (socket says 172.21.15.125:39826) 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 -- 172.21.15.125:0/1306228086 learned_addr learned my addr 172.21.15.125:0/1306228086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f41752e1700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 0x7f41701c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 -- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 msgr2=0x7f41701c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 0x7f41701c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 -- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 msgr2=0x7f41701c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 0x7f41701c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 -- 172.21.15.125:0/1306228086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640094a0 con 0x7f41700a0a70 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f416ffff700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 0x7f41701c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f41752e1700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 0x7f41701c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4174ae0700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f416400ebe0 tx=0x7f416400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400c850 con 0x7f41700a0a70 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416400c9b0 con 0x7f41700a0a70 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400cd40 con 0x7f41700a0a70 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c009550 con 0x7f41700a0a70 2023-10-03T10:18:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.339+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41701252e0 con 0x7f41700a0a70 2023-10-03T10:18:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.340+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4164013470 con 0x7f41700a0a70 2023-10-03T10:18:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.340+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f416403fbb0 con 0x7f41700a0a70 2023-10-03T10:18:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.340+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4170126330 con 0x7f41700a0a70 2023-10-03T10:18:37.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.345+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4164013720 con 0x7f41700a0a70 2023-10-03T10:18:37.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.479+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22a811e060 con 0x7f22a80a0a70 2023-10-03T10:18:37.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.479+0000 7f22a57fa700 1 -- 172.21.15.125:0/1659143277 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2294015020 con 0x7f22a80a0a70 2023-10-03T10:18:37.480 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 msgr2=0x7f22a8121770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f22940090b0 tx=0x7f2294004750 comp rx=0 tx=0).stop 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 shutdown_connections 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f22a8133f70 0x7f22a8121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22a809ad40 0x7f22a8121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.481+0000 7f22aee5c700 1 --2- 172.21.15.125:0/1659143277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a80a0a70 0x7f22a8121770 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.482+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 >> 172.21.15.125:0/1659143277 conn(0x7f22a8099c40 msgr2=0x7f22a81332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.482+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 shutdown_connections 2023-10-03T10:18:37.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.482+0000 7f22aee5c700 1 -- 172.21.15.125:0/1659143277 wait complete. 2023-10-03T10:18:37.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:37.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.537+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f417004f2a0 con 0x7f41700a0a70 2023-10-03T10:18:37.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.537+0000 7f416d7fa700 1 -- 172.21.15.125:0/1306228086 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4164017020 con 0x7f41700a0a70 2023-10-03T10:18:37.538 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:37.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 msgr2=0x7f41701c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f416400ebe0 tx=0x7f416400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 shutdown_connections 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4170133f50 0x7f41701c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41700a0a70 0x7f41701c8250 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 --2- 172.21.15.125:0/1306228086 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f41700a1380 0x7f41701c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 >> 172.21.15.125:0/1306228086 conn(0x7f41700a6610 msgr2=0x7f41700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 shutdown_connections 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:37.540+0000 7f4176d44700 1 -- 172.21.15.125:0/1306228086 wait complete. 2023-10-03T10:18:37.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:38.041 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 Processor -- start 2023-10-03T10:18:38.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 -- start start 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c06b2d0 con 0x7f661c1300a0 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c133610 con 0x7f661c133ad0 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f66232bc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c09a500 con 0x7f661c130bc0 2023-10-03T10:18:38.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6621058700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6621859700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6621058700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54332/0 (socket says 172.21.15.125:54332) 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6621859700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39834/0 (socket says 172.21.15.125:39834) 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6620857700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f661c1300a0 0x7f661c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46842/0 (socket says 172.21.15.125:46842) 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.165+0000 7f6621058700 1 -- 172.21.15.125:0/2213155147 learned_addr learned my addr 172.21.15.125:0/2213155147 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621859700 1 -- 172.21.15.125:0/2213155147 >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 msgr2=0x7f661c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621859700 1 --2- 172.21.15.125:0/2213155147 >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621859700 1 -- 172.21.15.125:0/2213155147 >> v1:172.21.15.125:6789/0 conn(0x7f661c1300a0 legacy=0x7f661c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6613fff700 1 -- 172.21.15.125:0/2213155147 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916337168 0 0) 0x7f661c06b2d0 con 0x7f661c1300a0 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621859700 1 -- 172.21.15.125:0/2213155147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c1338b0 con 0x7f661c130bc0 2023-10-03T10:18:38.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621058700 1 --2- 172.21.15.125:0/2213155147 >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6621859700 1 --2- 172.21.15.125:0/2213155147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6614009d90 tx=0x7f661400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=969aa6b4ac053559 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6613fff700 1 -- 172.21.15.125:0/2213155147 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661400e070 con 0x7f661c130bc0 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6613fff700 1 -- 172.21.15.125:0/2213155147 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400bb20 con 0x7f661c130bc0 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.166+0000 7f6613fff700 1 -- 172.21.15.125:0/2213155147 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614012430 con 0x7f661c130bc0 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 -- 172.21.15.125:0/2213155147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 msgr2=0x7f661c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 --2- 172.21.15.125:0/2213155147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6614009d90 tx=0x7f661400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 -- 172.21.15.125:0/2213155147 shutdown_connections 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 --2- 172.21.15.125:0/2213155147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c130bc0 0x7f661c13b990 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 --2- 172.21.15.125:0/2213155147 >> v2:172.21.15.125:3300/0 conn(0x7f661c133ad0 0x7f661c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 -- 172.21.15.125:0/2213155147 >> 172.21.15.125:0/2213155147 conn(0x7f661c099c40 msgr2=0x7f661c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 -- 172.21.15.125:0/2213155147 shutdown_connections 2023-10-03T10:18:38.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.167+0000 7f66232bc700 1 -- 172.21.15.125:0/2213155147 wait complete. 2023-10-03T10:18:38.170 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 Processor -- start 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 -- start start 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f661c130bc0 0x7f661c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f661c133ad0 0x7f661c071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c11e100 con 0x7f661c130bc0 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c12f6f0 con 0x7f661c1300a0 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f66232bc700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f661c12dd00 con 0x7f661c133ad0 2023-10-03T10:18:38.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39842/0 (socket says 172.21.15.125:39842) 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 -- 172.21.15.125:0/870419113 learned_addr learned my addr 172.21.15.125:0/870419113 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621859700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f661c133ad0 0x7f661c071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6620857700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f661c130bc0 0x7f661c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 -- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f661c133ad0 msgr2=0x7f661c071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f661c133ad0 0x7f661c071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 -- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f661c130bc0 msgr2=0x7f661c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f661c130bc0 0x7f661c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.168+0000 7f6621058700 1 -- 172.21.15.125:0/870419113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009550 con 0x7f661c1300a0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f6621058700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f661800ebe0 tx=0x7f661800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800c850 con 0x7f661c1300a0 2023-10-03T10:18:38.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661800c9b0 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6614009a70 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800cd40 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c11f960 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.169+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6618013470 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.170+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f661803f860 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.170+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c09cb20 con 0x7f661c1300a0 2023-10-03T10:18:38.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.174+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6618017080 con 0x7f661c1300a0 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.297+0000 7fae41120700 1 Processor -- start 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.297+0000 7fae41120700 1 -- start start 2023-10-03T10:18:38.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.297+0000 7fae41120700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 0x7fae3c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae41120700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae41120700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c09b110 con 0x7fae3c0a0a70 2023-10-03T10:18:38.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae41120700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0a3b60 con 0x7fae3c133f70 2023-10-03T10:18:38.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae41120700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1348e0 con 0x7fae3c09ad40 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3ad9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 0x7fae3c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39850/0 (socket says 172.21.15.125:39850) 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fae3c0a0a70 0x7fae3c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46848/0 (socket says 172.21.15.125:46848) 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 -- 172.21.15.125:0/4001841534 learned_addr learned my addr 172.21.15.125:0/4001841534 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 -- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 msgr2=0x7fae3c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 0x7fae3c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae39d9b700 1 -- 172.21.15.125:0/4001841534 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235402873 0 0) 0x7fae3c09b110 con 0x7fae3c0a0a70 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 -- 172.21.15.125:0/4001841534 >> v1:172.21.15.125:6789/0 conn(0x7fae3c0a0a70 legacy=0x7fae3c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 -- 172.21.15.125:0/4001841534 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0a2fa0 con 0x7fae3c133f70 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3ad9d700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 0x7fae3c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae3a59c700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fae30009920 tx=0x7fae30009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a3f9998c1fd24cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae39d9b700 1 -- 172.21.15.125:0/4001841534 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30011830 con 0x7fae3c133f70 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae39d9b700 1 -- 172.21.15.125:0/4001841534 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30011990 con 0x7fae3c133f70 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.298+0000 7fae39d9b700 1 -- 172.21.15.125:0/4001841534 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30011d20 con 0x7fae3c133f70 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 -- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 msgr2=0x7fae3c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fae30009920 tx=0x7fae30009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 -- 172.21.15.125:0/4001841534 shutdown_connections 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c09ad40 0x7fae3c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 --2- 172.21.15.125:0/4001841534 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c133f70 0x7fae3c1343a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 -- 172.21.15.125:0/4001841534 >> 172.21.15.125:0/4001841534 conn(0x7fae3c099c40 msgr2=0x7fae3c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 -- 172.21.15.125:0/4001841534 shutdown_connections 2023-10-03T10:18:38.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.299+0000 7fae41120700 1 -- 172.21.15.125:0/4001841534 wait complete. 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.300+0000 7fae41120700 1 Processor -- start 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.300+0000 7fae41120700 1 -- start start 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 0x7fae3c121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c133f70 0x7fae3c121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c122e80 con 0x7fae3c09ad40 2023-10-03T10:18:38.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c123d10 con 0x7fae3c0a0a70 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.301+0000 7fae41120700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1247f0 con 0x7fae3c133f70 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39866/0 (socket says 172.21.15.125:39866) 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 -- 172.21.15.125:0/1297664577 learned_addr learned my addr 172.21.15.125:0/1297664577 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3ad9d700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 0x7fae3c121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3b59e700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c133f70 0x7fae3c121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 -- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c133f70 msgr2=0x7fae3c121cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c133f70 0x7fae3c121cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 -- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 msgr2=0x7fae3c121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 0x7fae3c121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 -- 172.21.15.125:0/1297664577 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094a0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3ad9d700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 0x7fae3c121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.302+0000 7fae3a59c700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fae300098f0 tx=0x7fae30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30004510 con 0x7fae3c0a0a70 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae300036a0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30009550 con 0x7fae3c0a0a70 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30003a50 con 0x7fae3c0a0a70 2023-10-03T10:18:38.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c09c7e0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae30003bb0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.303+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae300407e0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.304+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c1240d0 con 0x7fae3c0a0a70 2023-10-03T10:18:38.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.308+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae30003e60 con 0x7fae3c0a0a70 2023-10-03T10:18:38.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.374+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f661c04f2a0 con 0x7f661c1300a0 2023-10-03T10:18:38.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.374+0000 7f6611ffb700 1 -- 172.21.15.125:0/870419113 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6618021020 con 0x7f661c1300a0 2023-10-03T10:18:38.375 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:38.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 msgr2=0x7f661c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f661800ebe0 tx=0x7f661800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 shutdown_connections 2023-10-03T10:18:38.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f661c133ad0 0x7f661c071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f661c1300a0 0x7f661c071370 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 --2- 172.21.15.125:0/870419113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f661c130bc0 0x7f661c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.376+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 >> 172.21.15.125:0/870419113 conn(0x7f661c099c40 msgr2=0x7f661c132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.377+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 shutdown_connections 2023-10-03T10:18:38.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.377+0000 7f66232bc700 1 -- 172.21.15.125:0/870419113 wait complete. 2023-10-03T10:18:38.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:38.494 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:38.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.500+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae3c11e060 con 0x7fae3c0a0a70 2023-10-03T10:18:38.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.501+0000 7fae237fe700 1 -- 172.21.15.125:0/1297664577 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae3002bb90 con 0x7fae3c0a0a70 2023-10-03T10:18:38.501 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:38.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 msgr2=0x7fae3c1217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fae300098f0 tx=0x7fae30004750 comp rx=0 tx=0).stop 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 shutdown_connections 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fae3c133f70 0x7fae3c121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae3c09ad40 0x7fae3c121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 --2- 172.21.15.125:0/1297664577 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae3c0a0a70 0x7fae3c1217b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 >> 172.21.15.125:0/1297664577 conn(0x7fae3c099c40 msgr2=0x7fae3c133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 shutdown_connections 2023-10-03T10:18:38.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.503+0000 7fae41120700 1 -- 172.21.15.125:0/1297664577 wait complete. 2023-10-03T10:18:38.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:38.552 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:38.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.618+0000 7f09e5aa4700 1 Processor -- start 2023-10-03T10:18:38.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.618+0000 7f09e5aa4700 1 -- start start 2023-10-03T10:18:38.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09e5aa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 0x7f09e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09e5aa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 0x7f09e013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09e5aa4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e009dc00 con 0x7f09e00a1380 2023-10-03T10:18:38.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09e5aa4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009ea90 con 0x7f09e00a0a70 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09e5aa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009dec0 con 0x7f09e0134120 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 0x7f09e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09deffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f09e00a1380 0x7f09e0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46852/0 (socket says 172.21.15.125:46852) 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09deffd700 1 -- 172.21.15.125:0/2404560208 learned_addr learned my addr 172.21.15.125:0/2404560208 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.619+0000 7f09dffff700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 0x7f09e013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09df7fe700 1 -- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 msgr2=0x7f09e013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09df7fe700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 0x7f09e013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09de7fc700 1 -- 172.21.15.125:0/2404560208 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231590548 0 0) 0x7f09e009dc00 con 0x7f09e00a1380 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09df7fe700 1 -- 172.21.15.125:0/2404560208 >> v1:172.21.15.125:6789/0 conn(0x7f09e00a1380 legacy=0x7f09e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09df7fe700 1 -- 172.21.15.125:0/2404560208 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e009e6a0 con 0x7f09e00a0a70 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09dffff700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 0x7f09e013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09df7fe700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 0x7f09e00a0e40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009870 tx=0x7f09d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21acac55981a370e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09de7fc700 1 -- 172.21.15.125:0/2404560208 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8011830 con 0x7f09e00a0a70 2023-10-03T10:18:38.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09de7fc700 1 -- 172.21.15.125:0/2404560208 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8011990 con 0x7f09e00a0a70 2023-10-03T10:18:38.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.620+0000 7f09de7fc700 1 -- 172.21.15.125:0/2404560208 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8011d20 con 0x7f09e00a0a70 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 -- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 msgr2=0x7f09e00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 0x7f09e00a0e40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009870 tx=0x7f09d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 -- 172.21.15.125:0/2404560208 shutdown_connections 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e0134120 0x7f09e013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/2404560208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a0a70 0x7f09e00a0e40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 -- 172.21.15.125:0/2404560208 >> 172.21.15.125:0/2404560208 conn(0x7f09e00a6610 msgr2=0x7f09e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 -- 172.21.15.125:0/2404560208 shutdown_connections 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.621+0000 7f09e5aa4700 1 -- 172.21.15.125:0/2404560208 wait complete. 2023-10-03T10:18:38.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 Processor -- start 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 -- start start 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e00a0a70 0x7f09e01c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 0x7f09e01c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e01264b0 con 0x7f09e0134120 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e01247a0 con 0x7f09e00a1380 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.622+0000 7f09e5aa4700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0124d50 con 0x7f09e00a0a70 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39884/0 (socket says 172.21.15.125:39884) 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 -- 172.21.15.125:0/840820528 learned_addr learned my addr 172.21.15.125:0/840820528 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09dffff700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 0x7f09e01c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09df7fe700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e00a0a70 0x7f09e01c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 -- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e00a0a70 msgr2=0x7f09e01c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e00a0a70 0x7f09e01c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 -- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 msgr2=0x7f09e01c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 0x7f09e01c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 -- 172.21.15.125:0/840820528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009a70 con 0x7f09e00a1380 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09dffff700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 0x7f09e01c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09deffd700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f09c8001eb0 tx=0x7f09c800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8004c80 con 0x7f09e00a1380 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8004de0 con 0x7f09e00a1380 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d80094a0 con 0x7f09e00a1380 2023-10-03T10:18:38.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8007310 con 0x7f09e00a1380 2023-10-03T10:18:38.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.623+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e009d390 con 0x7f09e00a1380 2023-10-03T10:18:38.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.624+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09c8007470 con 0x7f09e00a1380 2023-10-03T10:18:38.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.624+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e004f2a0 con 0x7f09e00a1380 2023-10-03T10:18:38.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.624+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09c803f3f0 con 0x7f09e00a1380 2023-10-03T10:18:38.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.629+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09c80106d0 con 0x7f09e00a1380 2023-10-03T10:18:38.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.682+0000 7f38db2d9700 1 Processor -- start 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.682+0000 7f38db2d9700 1 -- start start 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 0x7f38d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38d41341d0 0x7f38d4134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d406ce60 con 0x7f38d41341d0 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d406bec0 con 0x7f38d409f180 2023-10-03T10:18:38.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38db2d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d409fa00 con 0x7f38d409e870 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d8874700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38d41341d0 0x7f38d4134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9075700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 0x7f38d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38d41341d0 0x7f38d4134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54366/0 (socket says 172.21.15.125:54366) 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 -- 172.21.15.125:0/4236456001 learned_addr learned my addr 172.21.15.125:0/4236456001 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d8874700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39898/0 (socket says 172.21.15.125:39898) 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 -- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 msgr2=0x7f38d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 0x7f38d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 -- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 msgr2=0x7f38d4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9876700 1 -- 172.21.15.125:0/4236456001 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d409ad80 con 0x7f38d41341d0 2023-10-03T10:18:38.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d9075700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 0x7f38d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.683+0000 7f38d8874700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38d9876700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4134670 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009e80 tx=0x7f38cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bfe4f58fa436aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38cbfff700 1 -- 172.21.15.125:0/4236456001 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00e070 con 0x7f38d41341d0 2023-10-03T10:18:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38cbfff700 1 -- 172.21.15.125:0/4236456001 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc00b8d0 con 0x7f38d41341d0 2023-10-03T10:18:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38cbfff700 1 -- 172.21.15.125:0/4236456001 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00bc80 con 0x7f38d41341d0 2023-10-03T10:18:38.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 -- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 msgr2=0x7f38d4134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4134670 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009e80 tx=0x7f38cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 -- 172.21.15.125:0/4236456001 shutdown_connections 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4134670 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409e870 0x7f38d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 --2- 172.21.15.125:0/4236456001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409f180 0x7f38d4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.684+0000 7f38db2d9700 1 -- 172.21.15.125:0/4236456001 >> 172.21.15.125:0/4236456001 conn(0x7f38d40a4430 msgr2=0x7f38d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.685+0000 7f38db2d9700 1 -- 172.21.15.125:0/4236456001 shutdown_connections 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.685+0000 7f38db2d9700 1 -- 172.21.15.125:0/4236456001 wait complete. 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.685+0000 7f38db2d9700 1 Processor -- start 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.685+0000 7f38db2d9700 1 -- start start 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409e870 0x7f38d4122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4124ec0 con 0x7f38d41341d0 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41241b0 con 0x7f38d409e870 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38db2d9700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4123fc0 con 0x7f38d409f180 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34066/0 (socket says 172.21.15.125:34066) 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 -- 172.21.15.125:0/3389299833 learned_addr learned my addr 172.21.15.125:0/3389299833 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d9876700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d9075700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409e870 0x7f38d4122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 -- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409e870 msgr2=0x7f38d4122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409e870 0x7f38d4122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 -- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 msgr2=0x7f38d4122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.686+0000 7f38d8874700 1 -- 172.21.15.125:0/3389299833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00094a0 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38d8874700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f38c400ebb0 tx=0x7f38c400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400c850 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c400c9b0 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c40094a0 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400cd40 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.687+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc009b30 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.688+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38c4013470 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.688+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38c403f6c0 con 0x7f38d409f180 2023-10-03T10:18:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.688+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4125660 con 0x7f38d409f180 2023-10-03T10:18:38.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.693+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38c40232f0 con 0x7f38d409f180 2023-10-03T10:18:38.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.821+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09e006d660 con 0x7f09e00a1380 2023-10-03T10:18:38.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.822+0000 7f09d7fff700 1 -- 172.21.15.125:0/840820528 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09c80102c0 con 0x7f09e00a1380 2023-10-03T10:18:38.822 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:38.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 msgr2=0x7f09e01c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f09c8001eb0 tx=0x7f09c800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:38.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 shutdown_connections 2023-10-03T10:18:38.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e0134120 0x7f09e01c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f09e00a0a70 0x7f09e01c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 --2- 172.21.15.125:0/840820528 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09e00a1380 0x7f09e01c8a70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 >> 172.21.15.125:0/840820528 conn(0x7f09e00a6610 msgr2=0x7f09e009abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 shutdown_connections 2023-10-03T10:18:38.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.824+0000 7f09e5aa4700 1 -- 172.21.15.125:0/840820528 wait complete. 2023-10-03T10:18:38.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:38.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.884+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38d404f2a0 con 0x7f38d409f180 2023-10-03T10:18:38.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.884+0000 7f38c9ffb700 1 -- 172.21.15.125:0/3389299833 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38c4021020 con 0x7f38d409f180 2023-10-03T10:18:38.884 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 msgr2=0x7f38d4122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f38c400ebb0 tx=0x7f38c400eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 shutdown_connections 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38d41341d0 0x7f38d4122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38d409e870 0x7f38d4122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 --2- 172.21.15.125:0/3389299833 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f38d409f180 0x7f38d4122980 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 >> 172.21.15.125:0/3389299833 conn(0x7f38d40a4430 msgr2=0x7f38d40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 shutdown_connections 2023-10-03T10:18:38.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:38.886+0000 7f38db2d9700 1 -- 172.21.15.125:0/3389299833 wait complete. 2023-10-03T10:18:38.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:39.389 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 Processor -- start 2023-10-03T10:18:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 -- start start 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 0x7f23bc0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 0x7f23bc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0a3aa0 con 0x7f23bc0a0a90 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc09a540 con 0x7f23bc0a13a0 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23c1a1c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0a1fe0 con 0x7f23bc133f70 2023-10-03T10:18:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23bb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23ba7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 0x7f23bc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23bb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34076/0 (socket says 172.21.15.125:34076) 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23baffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 0x7f23bc0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.512+0000 7f23bb7fe700 1 -- 172.21.15.125:0/481962066 learned_addr learned my addr 172.21.15.125:0/481962066 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 -- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 msgr2=0x7f23bc1343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 -- 172.21.15.125:0/481962066 >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 msgr2=0x7f23bc0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 --2- 172.21.15.125:0/481962066 >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 0x7f23bc0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 -- 172.21.15.125:0/481962066 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc09a280 con 0x7f23bc0a13a0 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23bb7fe700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23baffd700 1 --2- 172.21.15.125:0/481962066 >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 0x7f23bc0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23ba7fc700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 0x7f23bc133a30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009840 tx=0x7f23b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc29afe43947f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23b9ffb700 1 -- 172.21.15.125:0/481962066 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0011830 con 0x7f23bc0a13a0 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23b9ffb700 1 -- 172.21.15.125:0/481962066 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0011990 con 0x7f23bc0a13a0 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.513+0000 7f23b9ffb700 1 -- 172.21.15.125:0/481962066 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0011d20 con 0x7f23bc0a13a0 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 -- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 msgr2=0x7f23bc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 0x7f23bc133a30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009840 tx=0x7f23b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 -- 172.21.15.125:0/481962066 shutdown_connections 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc133f70 0x7f23bc1343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/481962066 >> v2:172.21.15.125:3300/0 conn(0x7f23bc0a0a90 0x7f23bc0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/481962066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc0a13a0 0x7f23bc133a30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 -- 172.21.15.125:0/481962066 >> 172.21.15.125:0/481962066 conn(0x7f23bc099c40 msgr2=0x7f23bc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 -- 172.21.15.125:0/481962066 shutdown_connections 2023-10-03T10:18:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.514+0000 7f23c1a1c700 1 -- 172.21.15.125:0/481962066 wait complete. 2023-10-03T10:18:39.517 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 Processor -- start 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 -- start start 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23bc0a0a90 0x7f23bc11f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 0x7f23bc11f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc122900 con 0x7f23bc0a0a90 2023-10-03T10:18:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc133530 con 0x7f23bc133f70 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23c1a1c700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc11f0c0 con 0x7f23bc0a13a0 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23ba7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 0x7f23bc11f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23bb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23ba7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 0x7f23bc11f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34080/0 (socket says 172.21.15.125:34080) 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23ba7fc700 1 -- 172.21.15.125:0/1882219197 learned_addr learned my addr 172.21.15.125:0/1882219197 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23bb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39918/0 (socket says 172.21.15.125:39918) 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.515+0000 7f23baffd700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23bc0a0a90 0x7f23bc11f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 -- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 msgr2=0x7f23bc11f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 0x7f23bc11f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 -- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23bc0a0a90 msgr2=0x7f23bc11f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23bc0a0a90 0x7f23bc11f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 -- 172.21.15.125:0/1882219197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0094a0 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23bb7fe700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f23b400efc0 tx=0x7f23b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4018070 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b400f040 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4003c60 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b4009b30 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.516+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b00094a0 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.517+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23b400c880 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.517+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc1222a0 con 0x7f23bc133f70 2023-10-03T10:18:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.517+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23b403f710 con 0x7f23bc133f70 2023-10-03T10:18:39.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.521+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23b4003dc0 con 0x7f23bc133f70 2023-10-03T10:18:39.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 Processor -- start 2023-10-03T10:18:39.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 -- start start 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 0x7fd88c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 0x7fd88c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c06ce60 con 0x7fd88c1341d0 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c06bec0 con 0x7fd88c09e870 2023-10-03T10:18:39.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.643+0000 7fd893789700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c09fa00 con 0x7fd88c09f180 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891525700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 0x7fd88c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891d26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 0x7fd88c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891d26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54404/0 (socket says 172.21.15.125:54404) 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891525700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 0x7fd88c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39924/0 (socket says 172.21.15.125:39924) 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891d26700 1 -- 172.21.15.125:0/1559481923 learned_addr learned my addr 172.21.15.125:0/1559481923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 -- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 msgr2=0x7fd88c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 --2- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 0x7fd88c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 -- 172.21.15.125:0/1559481923 >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 msgr2=0x7fd88c134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 --2- 172.21.15.125:0/1559481923 >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 -- 172.21.15.125:0/1559481923 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c09ad80 con 0x7fd88c09f180 2023-10-03T10:18:39.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd891d26700 1 --2- 172.21.15.125:0/1559481923 >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd890d24700 1 --2- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 0x7fd88c133c90 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009870 tx=0x7fd87c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d56d0c4a7eef0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd883fff700 1 -- 172.21.15.125:0/1559481923 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011830 con 0x7fd88c09f180 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd883fff700 1 -- 172.21.15.125:0/1559481923 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c011990 con 0x7fd88c09f180 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.644+0000 7fd883fff700 1 -- 172.21.15.125:0/1559481923 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011d20 con 0x7fd88c09f180 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 -- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 msgr2=0x7fd88c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 --2- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 0x7fd88c133c90 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009870 tx=0x7fd87c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 -- 172.21.15.125:0/1559481923 shutdown_connections 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 --2- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09e870 0x7fd88c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 --2- 172.21.15.125:0/1559481923 >> v2:172.21.15.125:3300/0 conn(0x7fd88c1341d0 0x7fd88c134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 --2- 172.21.15.125:0/1559481923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c09f180 0x7fd88c133c90 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 -- 172.21.15.125:0/1559481923 >> 172.21.15.125:0/1559481923 conn(0x7fd88c0a4430 msgr2=0x7fd88c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 -- 172.21.15.125:0/1559481923 shutdown_connections 2023-10-03T10:18:39.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.645+0000 7fd893789700 1 -- 172.21.15.125:0/1559481923 wait complete. 2023-10-03T10:18:39.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 Processor -- start 2023-10-03T10:18:39.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 -- start start 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09f180 0x7fd88c122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 0x7fd88c123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c125ff0 con 0x7fd88c09e870 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c1248e0 con 0x7fd88c09f180 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd893789700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0a1790 con 0x7fd88c1341d0 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54418/0 (socket says 172.21.15.125:54418) 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 -- 172.21.15.125:0/1280990629 learned_addr learned my addr 172.21.15.125:0/1280990629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891d26700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 0x7fd88c123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd890d24700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09f180 0x7fd88c122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 -- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 msgr2=0x7fd88c123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 0x7fd88c123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 -- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09f180 msgr2=0x7fd88c122ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.646+0000 7fd891525700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09f180 0x7fd88c122ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd891525700 1 -- 172.21.15.125:0/1280990629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009b30 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd891d26700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 0x7fd88c123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd891525700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e9b0 tx=0x7fd88800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888009710 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800ee50 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0094a0 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800ca50 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.647+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c06cff0 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.648+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd88800cbb0 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.648+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd88803f830 con 0x7fd88c09e870 2023-10-03T10:18:39.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.648+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c124070 con 0x7fd88c09e870 2023-10-03T10:18:39.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.653+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd888017080 con 0x7fd88c09e870 2023-10-03T10:18:39.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.713+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23bc120810 con 0x7f23bc133f70 2023-10-03T10:18:39.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.713+0000 7f23a3fff700 1 -- 172.21.15.125:0/1882219197 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23b401de00 con 0x7f23bc133f70 2023-10-03T10:18:39.713 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 msgr2=0x7f23bc1c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f23b400efc0 tx=0x7f23b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 shutdown_connections 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23bc133f70 0x7f23bc1c8300 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23bc0a0a90 0x7f23bc11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 --2- 172.21.15.125:0/1882219197 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f23bc0a13a0 0x7f23bc11f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 >> 172.21.15.125:0/1882219197 conn(0x7f23bc099c40 msgr2=0x7f23bc1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 shutdown_connections 2023-10-03T10:18:39.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.715+0000 7f23c1a1c700 1 -- 172.21.15.125:0/1882219197 wait complete. 2023-10-03T10:18:39.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:39.837 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:39.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.837+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd88c04f2a0 con 0x7fd88c09e870 2023-10-03T10:18:39.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.837+0000 7fd881ffb700 1 -- 172.21.15.125:0/1280990629 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8880232f0 con 0x7fd88c09e870 2023-10-03T10:18:39.838 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 msgr2=0x7fd88c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e9b0 tx=0x7fd88800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 shutdown_connections 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd88c1341d0 0x7fd88c123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd88c09e870 0x7fd88c1225a0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 --2- 172.21.15.125:0/1280990629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd88c09f180 0x7fd88c122ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 >> 172.21.15.125:0/1280990629 conn(0x7fd88c0a4430 msgr2=0x7fd88c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.839+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 shutdown_connections 2023-10-03T10:18:39.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.840+0000 7fd893789700 1 -- 172.21.15.125:0/1280990629 wait complete. 2023-10-03T10:18:39.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:39.899 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:39.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.962+0000 7f0032ea8700 1 Processor -- start 2023-10-03T10:18:39.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.962+0000 7f0032ea8700 1 -- start start 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0032ea8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0032ea8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0032ea8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c09c970 con 0x7f002c09e870 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0032ea8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0a0920 con 0x7f002c1371c0 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0032ea8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f002c09f9c0 con 0x7f002c09f350 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0030c44700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f002c09e870 0x7f002c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46862/0 (socket says 172.21.15.125:46862) 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0030c44700 1 -- 172.21.15.125:0/2252022875 learned_addr learned my addr 172.21.15.125:0/2252022875 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39952/0 (socket says 172.21.15.125:39952) 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 -- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 msgr2=0x7f002c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 -- 172.21.15.125:0/2252022875 >> v1:172.21.15.125:6789/0 conn(0x7f002c09e870 legacy=0x7f002c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 -- 172.21.15.125:0/2252022875 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c09bab0 con 0x7f002c1371c0 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f002b7fe700 1 -- 172.21.15.125:0/2252022875 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16549103 0 0) 0x7f002c09c970 con 0x7f002c09e870 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f002bfff700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.963+0000 7f0031445700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0024009dc0 tx=0x7f002400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd1fd1e293ce741 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f002b7fe700 1 -- 172.21.15.125:0/2252022875 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400e070 con 0x7f002c1371c0 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f002b7fe700 1 -- 172.21.15.125:0/2252022875 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400bb20 con 0x7f002c1371c0 2023-10-03T10:18:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f002b7fe700 1 -- 172.21.15.125:0/2252022875 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024012430 con 0x7f002c1371c0 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 -- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 msgr2=0x7f002c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0024009dc0 tx=0x7f002400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 -- 172.21.15.125:0/2252022875 shutdown_connections 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c1395a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 --2- 172.21.15.125:0/2252022875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 -- 172.21.15.125:0/2252022875 >> 172.21.15.125:0/2252022875 conn(0x7f002c0a4430 msgr2=0x7f002c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 -- 172.21.15.125:0/2252022875 shutdown_connections 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.964+0000 7f0032ea8700 1 -- 172.21.15.125:0/2252022875 wait complete. 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.965+0000 7f0032ea8700 1 Processor -- start 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.965+0000 7f0032ea8700 1 -- start start 2023-10-03T10:18:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 0x7f002c120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c122290 con 0x7f002c09e870 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c1234e0 con 0x7f002c1371c0 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0032ea8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f002c122af0 con 0x7f002c09f350 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34120/0 (socket says 172.21.15.125:34120) 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39960/0 (socket says 172.21.15.125:39960) 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f002bfff700 1 -- 172.21.15.125:0/1119543588 learned_addr learned my addr 172.21.15.125:0/1119543588 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0030c44700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 0x7f002c120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 -- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 msgr2=0x7f002c120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 -- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 msgr2=0x7f002c120680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 0x7f002c120680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 -- 172.21.15.125:0/1119543588 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00180094a0 con 0x7f002c1371c0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f002bfff700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0030c44700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 0x7f002c120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.966+0000 7f0031445700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0024016000 tx=0x7f0024004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024022070 con 0x7f002c1371c0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002401dad0 con 0x7f002c1371c0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0024009a70 con 0x7f002c1371c0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024012430 con 0x7f002c1371c0 2023-10-03T10:18:39.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c123f10 con 0x7f002c1371c0 2023-10-03T10:18:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0024026070 con 0x7f002c1371c0 2023-10-03T10:18:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.967+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00240444d0 con 0x7f002c1371c0 2023-10-03T10:18:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.968+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c123f10 con 0x7f002c1371c0 2023-10-03T10:18:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:39.972+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f002c123f10 con 0x7f002c1371c0 2023-10-03T10:18:40.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 Processor -- start 2023-10-03T10:18:40.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 -- start start 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e1009f180 0x7f5e10131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1009c970 con 0x7f5e10131d70 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100a0920 con 0x7f5e1009f180 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e182b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1009f9c0 con 0x7f5e1009e870 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e16054700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e15853700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e1009f180 0x7f5e10131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.025+0000 7f5e16054700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39972/0 (socket says 172.21.15.125:39972) 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e16054700 1 -- 172.21.15.125:0/2202653850 learned_addr learned my addr 172.21.15.125:0/2202653850 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15853700 1 -- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 msgr2=0x7f5e1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15853700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15853700 1 -- 172.21.15.125:0/2202653850 >> v1:172.21.15.125:6789/0 conn(0x7f5e10131d70 legacy=0x7f5e10138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15052700 1 -- 172.21.15.125:0/2202653850 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111168775 0 0) 0x7f5e1009c970 con 0x7f5e10131d70 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15853700 1 -- 172.21.15.125:0/2202653850 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1009bab0 con 0x7f5e1009f180 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e16054700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15853700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009f180 0x7f5e10131830 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000dc60 tx=0x7f5e0000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151eed8b6e7f6424 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15052700 1 -- 172.21.15.125:0/2202653850 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00012070 con 0x7f5e1009f180 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15052700 1 -- 172.21.15.125:0/2202653850 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000d2e0 con 0x7f5e1009f180 2023-10-03T10:18:40.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.026+0000 7f5e15052700 1 -- 172.21.15.125:0/2202653850 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000f900 con 0x7f5e1009f180 2023-10-03T10:18:40.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 -- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009f180 msgr2=0x7f5e10131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009f180 0x7f5e10131830 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000dc60 tx=0x7f5e0000df70 comp rx=0 tx=0).stop 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 -- 172.21.15.125:0/2202653850 shutdown_connections 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009e870 0x7f5e1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 --2- 172.21.15.125:0/2202653850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009f180 0x7f5e10131830 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 -- 172.21.15.125:0/2202653850 >> 172.21.15.125:0/2202653850 conn(0x7f5e100a4430 msgr2=0x7f5e100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 -- 172.21.15.125:0/2202653850 shutdown_connections 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.027+0000 7f5e182b8700 1 -- 172.21.15.125:0/2202653850 wait complete. 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 Processor -- start 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 -- start start 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 0x7f5e1011b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 0x7f5e1011b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1011f2e0 con 0x7f5e1009e870 2023-10-03T10:18:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1011ca10 con 0x7f5e1009f180 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e182b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1011d030 con 0x7f5e10131d70 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e16054700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e16855700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 0x7f5e1011b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e16054700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54448/0 (socket says 172.21.15.125:54448) 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e16054700 1 -- 172.21.15.125:0/982102614 learned_addr learned my addr 172.21.15.125:0/982102614 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.028+0000 7f5e15853700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 0x7f5e1011b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 -- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 msgr2=0x7f5e1011b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 0x7f5e1011b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 -- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 msgr2=0x7f5e1011ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 -- 172.21.15.125:0/982102614 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c009550 con 0x7f5e10131d70 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e15853700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 0x7f5e1011b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16054700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e16855700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 0x7f5e1011b880 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800c820 tx=0x7f5e0800cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08003e30 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08005070 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08005420 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0000d940 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.029+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1011e0b0 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.030+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e08005580 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.030+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e0803ec60 con 0x7f5e10131d70 2023-10-03T10:18:40.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.030+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e100a29d0 con 0x7f5e10131d70 2023-10-03T10:18:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.035+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e08017030 con 0x7f5e10131d70 2023-10-03T10:18:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.166+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f002c123f10 con 0x7f002c1371c0 2023-10-03T10:18:40.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.167+0000 7f00297fa700 1 -- 172.21.15.125:0/1119543588 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f002c123f10 con 0x7f002c1371c0 2023-10-03T10:18:40.167 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:40.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 msgr2=0x7f002c121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0024016000 tx=0x7f0024004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 shutdown_connections 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f002c1371c0 0x7f002c121100 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c09e870 0x7f002c120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 --2- 172.21.15.125:0/1119543588 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f002c09f350 0x7f002c120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 >> 172.21.15.125:0/1119543588 conn(0x7f002c0a4430 msgr2=0x7f002c0a2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 shutdown_connections 2023-10-03T10:18:40.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.169+0000 7f0032ea8700 1 -- 172.21.15.125:0/1119543588 wait complete. 2023-10-03T10:18:40.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:40.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.228+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e1009dba0 con 0x7f5e10131d70 2023-10-03T10:18:40.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.229+0000 7f5e06ffd700 1 -- 172.21.15.125:0/982102614 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e08005830 con 0x7f5e10131d70 2023-10-03T10:18:40.229 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 msgr2=0x7f5e1011b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 0x7f5e1011b880 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800c820 tx=0x7f5e0800cb30 comp rx=0 tx=0).stop 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 shutdown_connections 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5e10131d70 0x7f5e1011b880 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e1009e870 0x7f5e1011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 --2- 172.21.15.125:0/982102614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e1009f180 0x7f5e1011b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 >> 172.21.15.125:0/982102614 conn(0x7f5e100a4430 msgr2=0x7f5e1012fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 shutdown_connections 2023-10-03T10:18:40.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.231+0000 7f5e182b8700 1 -- 172.21.15.125:0/982102614 wait complete. 2023-10-03T10:18:40.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:40.728 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:40.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.850+0000 7f5261eab700 1 Processor -- start 2023-10-03T10:18:40.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.850+0000 7f5261eab700 1 -- start start 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 0x7f525c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c06bcd0 con 0x7f525c09f180 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c06c6a0 con 0x7f525c134160 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f5261eab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f525c06bec0 con 0x7f525c09e870 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 0x7f525c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39984/0 (socket says 172.21.15.125:39984) 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 -- 172.21.15.125:0/1916516211 learned_addr learned my addr 172.21.15.125:0/1916516211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34132/0 (socket says 172.21.15.125:34132) 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 -- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 msgr2=0x7f525c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 -- 172.21.15.125:0/1916516211 >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 msgr2=0x7f525c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 --2- 172.21.15.125:0/1916516211 >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 0x7f525c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 -- 172.21.15.125:0/1916516211 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c06c8f0 con 0x7f525c134160 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525affd700 1 --2- 172.21.15.125:0/1916516211 >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 0x7f525c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525b7fe700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.851+0000 7f525bfff700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5254009e50 tx=0x7f525400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60490496b2760203 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f525a7fc700 1 -- 172.21.15.125:0/1916516211 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400e070 con 0x7f525c134160 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f525a7fc700 1 -- 172.21.15.125:0/1916516211 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400b910 con 0x7f525c134160 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f525a7fc700 1 -- 172.21.15.125:0/1916516211 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400bcc0 con 0x7f525c134160 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 -- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 msgr2=0x7f525c134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5254009e50 tx=0x7f525400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 -- 172.21.15.125:0/1916516211 shutdown_connections 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c134160 0x7f525c134600 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 --2- 172.21.15.125:0/1916516211 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c09e870 0x7f525c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 --2- 172.21.15.125:0/1916516211 >> v2:172.21.15.125:3300/0 conn(0x7f525c09f180 0x7f525c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 -- 172.21.15.125:0/1916516211 >> 172.21.15.125:0/1916516211 conn(0x7f525c0a4430 msgr2=0x7f525c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 -- 172.21.15.125:0/1916516211 shutdown_connections 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.852+0000 7f5261eab700 1 -- 172.21.15.125:0/1916516211 wait complete. 2023-10-03T10:18:40.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.853+0000 7f5261eab700 1 Processor -- start 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.853+0000 7f5261eab700 1 -- start start 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 0x7f525c122550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 0x7f525c122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c123a20 con 0x7f525c09e870 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c133920 con 0x7f525c09f180 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f525c124ff0 con 0x7f525c134160 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39990/0 (socket says 172.21.15.125:39990) 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 0x7f525c122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 -- 172.21.15.125:0/3898589129 learned_addr learned my addr 172.21.15.125:0/3898589129 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525b7fe700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 0x7f525c122550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 -- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 msgr2=0x7f525c122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 0x7f525c122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 -- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 msgr2=0x7f525c122550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 0x7f525c122550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 -- 172.21.15.125:0/3898589129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500094a0 con 0x7f525c09f180 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525bfff700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 0x7f525c122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525b7fe700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 0x7f525c122550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f525affd700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f524c00ec10 tx=0x7f524c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00c850 con 0x7f525c09f180 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c00c9b0 con 0x7f525c09f180 2023-10-03T10:18:40.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00cd20 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c0094a0 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.854+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5254009b30 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.855+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f524c013470 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.855+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f524c03f740 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.855+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c0a17a0 con 0x7f525c09f180 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.860+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f524c013720 con 0x7f525c09f180 2023-10-03T10:18:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.982+0000 7fc527459700 1 Processor -- start 2023-10-03T10:18:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 -- start start 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52009dc00 con 0x7fc520133f50 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52009ea60 con 0x7fc5200a0a70 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc527459700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52009dec0 con 0x7fc5200a1380 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5249f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5251f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5249f4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34148/0 (socket says 172.21.15.125:34148) 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5249f4700 1 -- 172.21.15.125:0/745536799 learned_addr learned my addr 172.21.15.125:0/745536799 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5251f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54476/0 (socket says 172.21.15.125:54476) 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5251f5700 1 -- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 msgr2=0x7fc520133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5251f5700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc5251f5700 1 -- 172.21.15.125:0/745536799 >> v1:172.21.15.125:6789/0 conn(0x7fc520133f50 legacy=0x7fc52013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc5251f5700 1 -- 172.21.15.125:0/745536799 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52009e6a0 con 0x7fc5200a0a70 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.983+0000 7fc517fff700 1 -- 172.21.15.125:0/745536799 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620475389 0 0) 0x7fc52009dc00 con 0x7fc520133f50 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc5249f4700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc5251f5700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009840 tx=0x7fc51c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5085d5f6432e55f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc517fff700 1 -- 172.21.15.125:0/745536799 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011830 con 0x7fc5200a0a70 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc517fff700 1 -- 172.21.15.125:0/745536799 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c011990 con 0x7fc5200a0a70 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc517fff700 1 -- 172.21.15.125:0/745536799 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011d20 con 0x7fc5200a0a70 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 -- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a0a70 msgr2=0x7fc5200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009840 tx=0x7fc51c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 -- 172.21.15.125:0/745536799 shutdown_connections 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5200a0a70 0x7fc5200a0e40 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 --2- 172.21.15.125:0/745536799 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a1380 0x7fc520133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.984+0000 7fc527459700 1 -- 172.21.15.125:0/745536799 >> 172.21.15.125:0/745536799 conn(0x7fc5200a6610 msgr2=0x7fc5200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.985+0000 7fc527459700 1 -- 172.21.15.125:0/745536799 shutdown_connections 2023-10-03T10:18:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.985+0000 7fc527459700 1 -- 172.21.15.125:0/745536799 wait complete. 2023-10-03T10:18:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 Processor -- start 2023-10-03T10:18:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 -- start start 2023-10-03T10:18:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 0x7fc520122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520133ad0 con 0x7fc520133f50 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520125de0 con 0x7fc5200a1380 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc527459700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc520124510 con 0x7fc5200a0a70 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc5259f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.986+0000 7fc5249f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5249f4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:39998/0 (socket says 172.21.15.125:39998) 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5249f4700 1 -- 172.21.15.125:0/3566101696 learned_addr learned my addr 172.21.15.125:0/3566101696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54478/0 (socket says 172.21.15.125:54478) 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5251f5700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 0x7fc520122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 -- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 msgr2=0x7fc520122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 0x7fc520122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 -- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 msgr2=0x7fc520122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 -- 172.21.15.125:0/3566101696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009550 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5251f5700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 0x7fc520122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5249f4700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc5259f6700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc51800c7c0 tx=0x7fc51800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518003e30 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518005070 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518005420 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c0094a0 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.987+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200a0430 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.988+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc518005580 con 0x7fc520133f50 2023-10-03T10:18:40.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.988+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc51803ed00 con 0x7fc520133f50 2023-10-03T10:18:40.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.989+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520133810 con 0x7fc520133f50 2023-10-03T10:18:40.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:40.993+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc520133810 con 0x7fc520133f50 2023-10-03T10:18:41.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.054+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f525c06cfa0 con 0x7f525c09f180 2023-10-03T10:18:41.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.055+0000 7f5243fff700 1 -- 172.21.15.125:0/3898589129 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f524c02a090 con 0x7f525c09f180 2023-10-03T10:18:41.055 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 msgr2=0x7f525c122a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f524c00ec10 tx=0x7f524c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 shutdown_connections 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f525c134160 0x7f525c122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f525c09e870 0x7f525c122550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 --2- 172.21.15.125:0/3898589129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f525c09f180 0x7f525c122a90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 >> 172.21.15.125:0/3898589129 conn(0x7f525c0a4430 msgr2=0x7f525c09d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 shutdown_connections 2023-10-03T10:18:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.057+0000 7f5261eab700 1 -- 172.21.15.125:0/3898589129 wait complete. 2023-10-03T10:18:41.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.180+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc520133810 con 0x7fc520133f50 2023-10-03T10:18:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.181+0000 7fc515ffb700 1 -- 172.21.15.125:0/3566101696 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc520133810 con 0x7fc520133f50 2023-10-03T10:18:41.181 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:41.182 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 msgr2=0x7fc5201232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc51800c7c0 tx=0x7fc51800cad0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 shutdown_connections 2023-10-03T10:18:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc520133f50 0x7fc5201232e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc5200a0a70 0x7fc520122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 --2- 172.21.15.125:0/3566101696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5200a1380 0x7fc520122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 >> 172.21.15.125:0/3566101696 conn(0x7fc5200a6610 msgr2=0x7fc52009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 shutdown_connections 2023-10-03T10:18:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.183+0000 7fc527459700 1 -- 172.21.15.125:0/3566101696 wait complete. 2023-10-03T10:18:41.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:41.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.310+0000 7f8307676700 1 Processor -- start 2023-10-03T10:18:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.310+0000 7f8307676700 1 -- start start 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.310+0000 7f8307676700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.310+0000 7f8307676700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8307676700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830006b2d0 con 0x7f83001300a0 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8307676700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8300133610 con 0x7f8300130bc0 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8307676700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830009a500 con 0x7f8300133ad0 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305c13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305c13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54484/0 (socket says 172.21.15.125:54484) 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34160/0 (socket says 172.21.15.125:34160) 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8304c11700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83001300a0 0x7f83001304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46892/0 (socket says 172.21.15.125:46892) 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305c13700 1 -- 172.21.15.125:0/3206295808 learned_addr learned my addr 172.21.15.125:0/3206295808 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 -- 172.21.15.125:0/3206295808 >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 msgr2=0x7f830013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 --2- 172.21.15.125:0/3206295808 >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 -- 172.21.15.125:0/3206295808 >> v1:172.21.15.125:6789/0 conn(0x7f83001300a0 legacy=0x7f83001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f82f7fff700 1 -- 172.21.15.125:0/3206295808 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320356771 0 0) 0x7f830006b2d0 con 0x7f83001300a0 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 -- 172.21.15.125:0/3206295808 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83001338b0 con 0x7f8300133ad0 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305c13700 1 --2- 172.21.15.125:0/3206295808 >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f8305412700 1 --2- 172.21.15.125:0/3206295808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009840 tx=0x7f82fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6233e43470c84001 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f82f7fff700 1 -- 172.21.15.125:0/3206295808 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc011830 con 0x7f8300133ad0 2023-10-03T10:18:41.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f82f7fff700 1 -- 172.21.15.125:0/3206295808 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc011990 con 0x7f8300133ad0 2023-10-03T10:18:41.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.311+0000 7f82f7fff700 1 -- 172.21.15.125:0/3206295808 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc011d20 con 0x7f8300133ad0 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 -- 172.21.15.125:0/3206295808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 msgr2=0x7f8300133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 --2- 172.21.15.125:0/3206295808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009840 tx=0x7f82fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 -- 172.21.15.125:0/3206295808 shutdown_connections 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 --2- 172.21.15.125:0/3206295808 >> v2:172.21.15.125:3300/0 conn(0x7f8300130bc0 0x7f830013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 --2- 172.21.15.125:0/3206295808 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f8300133ea0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 -- 172.21.15.125:0/3206295808 >> 172.21.15.125:0/3206295808 conn(0x7f8300099c40 msgr2=0x7f83000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 -- 172.21.15.125:0/3206295808 shutdown_connections 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.312+0000 7f8307676700 1 -- 172.21.15.125:0/3206295808 wait complete. 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 Processor -- start 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 -- start start 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83001300a0 0x7f830011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 0x7f830011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300120050 con 0x7f83001300a0 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83001209c0 con 0x7f8300130bc0 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8307676700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8300071fd0 con 0x7f8300133ad0 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8305c13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8304c11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 0x7f830011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8305c13700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34172/0 (socket says 172.21.15.125:34172) 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8304c11700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 0x7f830011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40008/0 (socket says 172.21.15.125:40008) 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.313+0000 7f8305c13700 1 -- 172.21.15.125:0/4223540359 learned_addr learned my addr 172.21.15.125:0/4223540359 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 -- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 msgr2=0x7f830011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 0x7f830011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 -- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83001300a0 msgr2=0x7f830011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83001300a0 0x7f830011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 -- 172.21.15.125:0/4223540359 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009b30 con 0x7f8300133ad0 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8305c13700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f82f800efc0 tx=0x7f82f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8018070 con 0x7f8300133ad0 2023-10-03T10:18:41.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f800f040 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc0094a0 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003c20 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.314+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83000a34a0 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.315+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82f800c930 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.315+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82f803f7e0 con 0x7f8300133ad0 2023-10-03T10:18:41.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.315+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830009cb20 con 0x7f8300133ad0 2023-10-03T10:18:41.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.320+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82f8012340 con 0x7f8300133ad0 2023-10-03T10:18:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.372+0000 7f9478a6f700 1 Processor -- start 2023-10-03T10:18:41.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.372+0000 7f9478a6f700 1 -- start start 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9478a6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 0x7f947409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9478a6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 0x7f9474134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9478a6f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947409af80 con 0x7f947409edb0 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9478a6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947409a520 con 0x7f947409f1a0 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9478a6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f947409fe00 con 0x7f947409a150 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9471d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f947409edb0 0x7f9474133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46894/0 (socket says 172.21.15.125:46894) 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 0x7f947409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9471d9b700 1 -- 172.21.15.125:0/1542911870 learned_addr learned my addr 172.21.15.125:0/1542911870 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9472d9d700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 0x7f9474134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947159a700 1 -- 172.21.15.125:0/1542911870 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974538606 0 0) 0x7f947409af80 con 0x7f947409edb0 2023-10-03T10:18:41.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 -- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 msgr2=0x7f9474134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 0x7f9474134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 -- 172.21.15.125:0/1542911870 >> v1:172.21.15.125:6789/0 conn(0x7f947409edb0 legacy=0x7f9474133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 -- 172.21.15.125:0/1542911870 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947406bc20 con 0x7f947409a150 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f9472d9d700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 0x7f9474134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947259c700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 0x7f947409e870 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f94640098a0 tx=0x7f9464009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3bfe821097de15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.373+0000 7f947159a700 1 -- 172.21.15.125:0/1542911870 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464011830 con 0x7f947409a150 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f947159a700 1 -- 172.21.15.125:0/1542911870 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464011990 con 0x7f947409a150 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f947159a700 1 -- 172.21.15.125:0/1542911870 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464011d20 con 0x7f947409a150 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 -- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 msgr2=0x7f947409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 0x7f947409e870 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f94640098a0 tx=0x7f9464009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 -- 172.21.15.125:0/1542911870 shutdown_connections 2023-10-03T10:18:41.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409f1a0 0x7f9474134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 --2- 172.21.15.125:0/1542911870 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409a150 0x7f947409e870 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 -- 172.21.15.125:0/1542911870 >> 172.21.15.125:0/1542911870 conn(0x7f94740a4430 msgr2=0x7f94740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 -- 172.21.15.125:0/1542911870 shutdown_connections 2023-10-03T10:18:41.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.374+0000 7f9478a6f700 1 -- 172.21.15.125:0/1542911870 wait complete. 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 Processor -- start 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 -- start start 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 0x7f94741c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 0x7f94741c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94741aad00 con 0x7f947409a150 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947409bc40 con 0x7f947409edb0 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9478a6f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94740a0440 con 0x7f947409f1a0 2023-10-03T10:18:41.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f947259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9472d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 0x7f94741c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f947259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54500/0 (socket says 172.21.15.125:54500) 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f9471d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 0x7f94741c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.376+0000 7f947259c700 1 -- 172.21.15.125:0/153366220 learned_addr learned my addr 172.21.15.125:0/153366220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 -- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 msgr2=0x7f94741c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 0x7f94741c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 -- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 msgr2=0x7f94741c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 -- 172.21.15.125:0/153366220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009a70 con 0x7f947409edb0 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f947259c700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9472d9d700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 0x7f94741c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9471d9b700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 0x7f94741c8f40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f94740a5080 tx=0x7f946800c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468004c80 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468004de0 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468007310 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640094a0 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.377+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94741aa0c0 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.378+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9468007470 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.378+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f946803f030 con 0x7f947409edb0 2023-10-03T10:18:41.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.378+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947409fa30 con 0x7f947409edb0 2023-10-03T10:18:41.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.383+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f946800ce40 con 0x7f947409edb0 2023-10-03T10:18:41.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.508+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f830011fbf0 con 0x7f8300133ad0 2023-10-03T10:18:41.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.508+0000 7f82f5ffb700 1 -- 172.21.15.125:0/4223540359 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f80133e0 con 0x7f8300133ad0 2023-10-03T10:18:41.509 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 msgr2=0x7f830011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f82f800efc0 tx=0x7f82f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 shutdown_connections 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f8300133ad0 0x7f830011e4c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83001300a0 0x7f830011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 --2- 172.21.15.125:0/4223540359 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8300130bc0 0x7f830011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 >> 172.21.15.125:0/4223540359 conn(0x7f8300099c40 msgr2=0x7f830012f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 shutdown_connections 2023-10-03T10:18:41.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.510+0000 7f8307676700 1 -- 172.21.15.125:0/4223540359 wait complete. 2023-10-03T10:18:41.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.569+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94741aa0c0 con 0x7f947409edb0 2023-10-03T10:18:41.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.569+0000 7f9462ffd700 1 -- 172.21.15.125:0/153366220 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94741aa0c0 con 0x7f947409edb0 2023-10-03T10:18:41.570 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:41.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.571+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 msgr2=0x7f94741c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.571+0000 7f9478a6f700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 0x7f94741c8f40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f94740a5080 tx=0x7f946800c750 comp rx=0 tx=0).stop 2023-10-03T10:18:41.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.571+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 shutdown_connections 2023-10-03T10:18:41.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.571+0000 7f9478a6f700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f947409f1a0 0x7f94741c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.572+0000 7f9478a6f700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f947409a150 0x7f94741c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.572+0000 7f9478a6f700 1 --2- 172.21.15.125:0/153366220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f947409edb0 0x7f94741c8f40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.572+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 >> 172.21.15.125:0/153366220 conn(0x7f94740a4430 msgr2=0x7f9474072560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.572+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 shutdown_connections 2023-10-03T10:18:41.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:41.572+0000 7f9478a6f700 1 -- 172.21.15.125:0/153366220 wait complete. 2023-10-03T10:18:41.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:42.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:42.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 Processor -- start 2023-10-03T10:18:42.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 -- start start 2023-10-03T10:18:42.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f70133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f70134210 0x7f5f700a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7009a760 con 0x7f5f70134210 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f701336e0 con 0x7f5f70133900 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.194+0000 7f5f777b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7009a080 con 0x7f5f700a0ee0 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f70134210 0x7f5f700a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75d55700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75d55700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34190/0 (socket says 172.21.15.125:34190) 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f70134210 0x7f5f700a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54510/0 (socket says 172.21.15.125:54510) 2023-10-03T10:18:42.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75554700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f70133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75d55700 1 -- 172.21.15.125:0/4186327141 learned_addr learned my addr 172.21.15.125:0/4186327141 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 -- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 msgr2=0x7f5f700a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 -- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 msgr2=0x7f5f70133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f70133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 -- 172.21.15.125:0/4186327141 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700a23e0 con 0x7f5f70134210 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75554700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f70133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f75d55700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f74d53700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f700a09a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009840 tx=0x7f5f60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44387b779f83239e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f67fff700 1 -- 172.21.15.125:0/4186327141 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60011830 con 0x7f5f70134210 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f67fff700 1 -- 172.21.15.125:0/4186327141 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60011990 con 0x7f5f70134210 2023-10-03T10:18:42.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.195+0000 7f5f67fff700 1 -- 172.21.15.125:0/4186327141 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60011d20 con 0x7f5f70134210 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 -- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 msgr2=0x7f5f700a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f700a09a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009840 tx=0x7f5f60009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 -- 172.21.15.125:0/4186327141 shutdown_connections 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f70133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f700a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 --2- 172.21.15.125:0/4186327141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f700a09a0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 -- 172.21.15.125:0/4186327141 >> 172.21.15.125:0/4186327141 conn(0x7f5f700a2980 msgr2=0x7f5f700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 -- 172.21.15.125:0/4186327141 shutdown_connections 2023-10-03T10:18:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.196+0000 7f5f777b8700 1 -- 172.21.15.125:0/4186327141 wait complete. 2023-10-03T10:18:42.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:42.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.197+0000 7f5f777b8700 1 Processor -- start 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.197+0000 7f5f777b8700 1 -- start start 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f7011cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f7011d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7011e900 con 0x7f5f70134210 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7011f5c0 con 0x7f5f70133900 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70132f60 con 0x7f5f700a0ee0 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34202/0 (socket says 172.21.15.125:34202) 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 -- 172.21.15.125:0/1884328324 learned_addr learned my addr 172.21.15.125:0/1884328324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75d55700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f7011d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f74d53700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f7011cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 -- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 msgr2=0x7f5f7011cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f7011cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 -- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 msgr2=0x7f5f7011d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f7011d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 -- 172.21.15.125:0/1884328324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009b30 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f75554700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ebe0 tx=0x7f5f6c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c005a20 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c005b80 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00c850 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.198+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c009430 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.199+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f600094a0 con 0x7f5f700a0ee0 2023-10-03T10:18:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.199+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f6c00c9b0 con 0x7f5f700a0ee0 2023-10-03T10:18:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.199+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f6c03f8f0 con 0x7f5f700a0ee0 2023-10-03T10:18:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.200+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7009a320 con 0x7f5f700a0ee0 2023-10-03T10:18:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.204+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f6c022300 con 0x7f5f700a0ee0 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.327+0000 7efbf45c7700 1 Processor -- start 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.327+0000 7efbf45c7700 1 -- start start 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efbec09da10 0x7efbec06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec06acb0 0x7efbec06b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbec12de50 con 0x7efbec09da10 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec09f6e0 con 0x7efbec12e490 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf45c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efbec09eb00 con 0x7efbec06acb0 2023-10-03T10:18:42.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efbec09da10 0x7efbec06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf2363700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf2363700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40048/0 (socket says 172.21.15.125:40048) 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efbec09da10 0x7efbec06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54522/0 (socket says 172.21.15.125:54522) 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf2363700 1 -- 172.21.15.125:0/731472249 learned_addr learned my addr 172.21.15.125:0/731472249 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf2b64700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec06acb0 0x7efbec06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 -- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec06acb0 msgr2=0x7efbec06b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec06acb0 0x7efbec06b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 -- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 msgr2=0x7efbec12e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 -- 172.21.15.125:0/731472249 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec09e780 con 0x7efbec09da10 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf2363700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1b62700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec09da10 0x7efbec06a770 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7efbe800dc90 tx=0x7efbe800f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c513348df28e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.328+0000 7efbf1361700 1 -- 172.21.15.125:0/731472249 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8012070 con 0x7efbec09da10 2023-10-03T10:18:42.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf1361700 1 -- 172.21.15.125:0/731472249 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe800d2e0 con 0x7efbec09da10 2023-10-03T10:18:42.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf1361700 1 -- 172.21.15.125:0/731472249 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800f850 con 0x7efbec09da10 2023-10-03T10:18:42.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 -- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec09da10 msgr2=0x7efbec06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec09da10 0x7efbec06a770 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7efbe800dc90 tx=0x7efbe800f050 comp rx=0 tx=0).stop 2023-10-03T10:18:42.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 -- 172.21.15.125:0/731472249 shutdown_connections 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec12e490 0x7efbec12e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec06acb0 0x7efbec06b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 --2- 172.21.15.125:0/731472249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec09da10 0x7efbec06a770 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 -- 172.21.15.125:0/731472249 >> 172.21.15.125:0/731472249 conn(0x7efbec099c40 msgr2=0x7efbec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 -- 172.21.15.125:0/731472249 shutdown_connections 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.329+0000 7efbf45c7700 1 -- 172.21.15.125:0/731472249 wait complete. 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.330+0000 7efbf45c7700 1 Processor -- start 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.330+0000 7efbf45c7700 1 -- start start 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.330+0000 7efbf45c7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 0x7efbec1c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 0x7efbec06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec12bab0 con 0x7efbec06acb0 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec1284c0 con 0x7efbec09da10 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efbec0706f0 con 0x7efbec12e490 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf1b62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 0x7efbec06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf1b62700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40062/0 (socket says 172.21.15.125:40062) 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf1b62700 1 -- 172.21.15.125:0/3445302429 learned_addr learned my addr 172.21.15.125:0/3445302429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2363700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 0x7efbec1c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 -- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 msgr2=0x7efbec1c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 -- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 msgr2=0x7efbec1c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 0x7efbec1c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 -- 172.21.15.125:0/3445302429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc009550 con 0x7efbec12e490 2023-10-03T10:18:42.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf1b62700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2363700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 0x7efbec1c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf2b64700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 0x7efbec06e900 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efbe400eab0 tx=0x7efbe400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4010040 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe400b970 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe800d940 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4009a80 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.331+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbec09a640 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.332+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efbe400bd20 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.332+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efbe403fc40 con 0x7efbec12e490 2023-10-03T10:18:42.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.332+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbec04f2a0 con 0x7efbec12e490 2023-10-03T10:18:42.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.337+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efbe4024300 con 0x7efbec12e490 2023-10-03T10:18:42.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.404+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f7011fd90 con 0x7f5f700a0ee0 2023-10-03T10:18:42.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.405+0000 7f5f65ffb700 1 -- 172.21.15.125:0/1884328324 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f6c02a090 con 0x7f5f700a0ee0 2023-10-03T10:18:42.405 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 msgr2=0x7f5f7011c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ebe0 tx=0x7f5f6c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 shutdown_connections 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f70134210 0x7f5f7011d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f5f700a0ee0 0x7f5f7011c6d0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 --2- 172.21.15.125:0/1884328324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f70133900 0x7f5f7011cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 >> 172.21.15.125:0/1884328324 conn(0x7f5f700a2980 msgr2=0x7f5f701bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 shutdown_connections 2023-10-03T10:18:42.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.407+0000 7f5f777b8700 1 -- 172.21.15.125:0/1884328324 wait complete. 2023-10-03T10:18:42.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:42.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:42.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.527+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efbec09bcc0 con 0x7efbec12e490 2023-10-03T10:18:42.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.527+0000 7efbe2ffd700 1 -- 172.21.15.125:0/3445302429 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efbe4007b20 con 0x7efbec12e490 2023-10-03T10:18:42.529 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:42.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 msgr2=0x7efbec06e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 0x7efbec06e900 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efbe400eab0 tx=0x7efbe400edc0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 shutdown_connections 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efbec12e490 0x7efbec06e900 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efbec06acb0 0x7efbec1c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 --2- 172.21.15.125:0/3445302429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efbec09da10 0x7efbec1c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 >> 172.21.15.125:0/3445302429 conn(0x7efbec099c40 msgr2=0x7efbec0a2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 shutdown_connections 2023-10-03T10:18:42.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.530+0000 7efbf45c7700 1 -- 172.21.15.125:0/3445302429 wait complete. 2023-10-03T10:18:42.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:42.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.647+0000 7f68eaeba700 1 Processor -- start 2023-10-03T10:18:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.647+0000 7f68eaeba700 1 -- start start 2023-10-03T10:18:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68eaeba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68e40a1550 0x7f68e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68eaeba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e4139200 0x7f68e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68eaeba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e409e9d0 con 0x7f68e40a0a70 2023-10-03T10:18:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68eaeba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e409dc00 con 0x7f68e40a1550 2023-10-03T10:18:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68eaeba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e409dec0 con 0x7f68e4139200 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68e40a1550 0x7f68e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e8c56700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f68e40a0a70 0x7f68e40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46910/0 (socket says 172.21.15.125:46910) 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e8c56700 1 -- 172.21.15.125:0/2975661168 learned_addr learned my addr 172.21.15.125:0/2975661168 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e9457700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e4139200 0x7f68e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e3fff700 1 -- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e4139200 msgr2=0x7f68e413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e3fff700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e4139200 0x7f68e413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e3fff700 1 -- 172.21.15.125:0/2975661168 >> v1:172.21.15.125:6789/0 conn(0x7f68e40a0a70 legacy=0x7f68e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e3fff700 1 -- 172.21.15.125:0/2975661168 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e409e6a0 con 0x7f68e40a1550 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.648+0000 7f68e37fe700 1 -- 172.21.15.125:0/2975661168 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937953517 0 0) 0x7f68e409e9d0 con 0x7f68e40a0a70 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68e3fff700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e40a1550 0x7f68e4138cc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009840 tx=0x7f68d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687dc7e811a9347d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68e37fe700 1 -- 172.21.15.125:0/2975661168 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011830 con 0x7f68e40a1550 2023-10-03T10:18:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68e37fe700 1 -- 172.21.15.125:0/2975661168 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0011990 con 0x7f68e40a1550 2023-10-03T10:18:42.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68e37fe700 1 -- 172.21.15.125:0/2975661168 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011d20 con 0x7f68e40a1550 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 -- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e40a1550 msgr2=0x7f68e4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e40a1550 0x7f68e4138cc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009840 tx=0x7f68d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 -- 172.21.15.125:0/2975661168 shutdown_connections 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e4139200 0x7f68e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2975661168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e40a1550 0x7f68e4138cc0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 -- 172.21.15.125:0/2975661168 >> 172.21.15.125:0/2975661168 conn(0x7f68e40a6610 msgr2=0x7f68e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 -- 172.21.15.125:0/2975661168 shutdown_connections 2023-10-03T10:18:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.649+0000 7f68eaeba700 1 -- 172.21.15.125:0/2975661168 wait complete. 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.650+0000 7f68eaeba700 1 Processor -- start 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.650+0000 7f68eaeba700 1 -- start start 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 0x7f68e41207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 0x7f68e4121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e41360a0 con 0x7f68e4139200 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4136660 con 0x7f68e40a1550 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68eaeba700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4124290 con 0x7f68e40a0a70 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40094/0 (socket says 172.21.15.125:40094) 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 -- 172.21.15.125:0/2220145215 learned_addr learned my addr 172.21.15.125:0/2220145215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e9457700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 0x7f68e4121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e8c56700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 0x7f68e41207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 -- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 msgr2=0x7f68e41207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 0x7f68e41207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 -- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 msgr2=0x7f68e4121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 0x7f68e4121240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 -- 172.21.15.125:0/2220145215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00094a0 con 0x7f68e40a1550 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e8c56700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 0x7f68e41207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e9457700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 0x7f68e4121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.651+0000 7f68e3fff700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009fd0 tx=0x7f68d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00036a0 con 0x7f68e40a1550 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d001f070 con 0x7f68e40a1550 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40a5100 con 0x7f68e40a1550 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0003a60 con 0x7f68e40a1550 2023-10-03T10:18:42.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e4122b80 con 0x7f68e40a1550 2023-10-03T10:18:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.652+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68d0003bc0 con 0x7f68e40a1550 2023-10-03T10:18:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.653+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68d0021070 con 0x7f68e40a1550 2023-10-03T10:18:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.653+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e404f2a0 con 0x7f68e40a1550 2023-10-03T10:18:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.657+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68d00253e0 con 0x7f68e40a1550 2023-10-03T10:18:42.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.710+0000 7f169759e700 1 Processor -- start 2023-10-03T10:18:42.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.710+0000 7f169759e700 1 -- start start 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 0x7f16901338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169009af90 con 0x7f1690133470 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169009f590 con 0x7f1690130520 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169759e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1690130ed0 con 0x7f169006a770 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40106/0 (socket says 172.21.15.125:40106) 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34248/0 (socket says 172.21.15.125:34248) 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1695d9b700 1 -- 172.21.15.125:0/2445610475 learned_addr learned my addr 172.21.15.125:0/2445610475 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1696d9d700 1 --2- 172.21.15.125:0/2445610475 >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 0x7f16901338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 -- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 msgr2=0x7f1690130990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 -- 172.21.15.125:0/2445610475 >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 msgr2=0x7f16901338e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 --2- 172.21.15.125:0/2445610475 >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 0x7f16901338e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 -- 172.21.15.125:0/2445610475 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169009a5d0 con 0x7f169006a770 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1695d9b700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f1696d9d700 1 --2- 172.21.15.125:0/2445610475 >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 0x7f16901338e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.711+0000 7f169659c700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f16840098a0 tx=0x7f1684009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82d134f6de95c47b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169559a700 1 -- 172.21.15.125:0/2445610475 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684011830 con 0x7f169006a770 2023-10-03T10:18:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169559a700 1 -- 172.21.15.125:0/2445610475 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684011990 con 0x7f169006a770 2023-10-03T10:18:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169559a700 1 -- 172.21.15.125:0/2445610475 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684011d20 con 0x7f169006a770 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 -- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 msgr2=0x7f169012ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f16840098a0 tx=0x7f1684009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 -- 172.21.15.125:0/2445610475 shutdown_connections 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 --2- 172.21.15.125:0/2445610475 >> v2:172.21.15.125:3300/0 conn(0x7f1690133470 0x7f16901338e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f169006a770 0x7f169012ff00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 --2- 172.21.15.125:0/2445610475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1690130520 0x7f1690130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 -- 172.21.15.125:0/2445610475 >> 172.21.15.125:0/2445610475 conn(0x7f16900a2d80 msgr2=0x7f16900a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 -- 172.21.15.125:0/2445610475 shutdown_connections 2023-10-03T10:18:42.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.712+0000 7f169759e700 1 -- 172.21.15.125:0/2445610475 wait complete. 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.713+0000 7f169759e700 1 Processor -- start 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.713+0000 7f169759e700 1 -- start start 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 0x7f169011d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1690133470 0x7f169011e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690120b90 con 0x7f1690133470 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169011feb0 con 0x7f169006a770 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169759e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f169012db50 con 0x7f1690130520 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34258/0 (socket says 172.21.15.125:34258) 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f1695d9b700 1 -- 172.21.15.125:0/2989922853 learned_addr learned my addr 172.21.15.125:0/2989922853 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f1696d9d700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1690133470 0x7f169011e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 0x7f169011d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 -- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 msgr2=0x7f169011dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 -- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1690133470 msgr2=0x7f169011e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1690133470 0x7f169011e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 -- 172.21.15.125:0/2989922853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009550 con 0x7f169006a770 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f1695d9b700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.714+0000 7f169659c700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 0x7f169011d7e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f16840098a0 tx=0x7f1684004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.715+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684004450 con 0x7f169006a770 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.715+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168401f070 con 0x7f169006a770 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.715+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c009a70 con 0x7f169006a770 2023-10-03T10:18:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.715+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840038c0 con 0x7f169006a770 2023-10-03T10:18:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.715+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16840094a0 con 0x7f169006a770 2023-10-03T10:18:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.716+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1684003a20 con 0x7f169006a770 2023-10-03T10:18:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.716+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169004f2a0 con 0x7f169006a770 2023-10-03T10:18:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.716+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1684021070 con 0x7f169006a770 2023-10-03T10:18:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.725+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16840045b0 con 0x7f169006a770 2023-10-03T10:18:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.857+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68e4124010 con 0x7f68e40a1550 2023-10-03T10:18:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.857+0000 7f68e17fa700 1 -- 172.21.15.125:0/2220145215 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68d0010b70 con 0x7f68e40a1550 2023-10-03T10:18:42.857 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:42.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 msgr2=0x7f68e4120d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009fd0 tx=0x7f68d0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 shutdown_connections 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68e4139200 0x7f68e4121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f68e40a0a70 0x7f68e41207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 --2- 172.21.15.125:0/2220145215 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68e40a1550 0x7f68e4120d00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 >> 172.21.15.125:0/2220145215 conn(0x7f68e40a6610 msgr2=0x7f68e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 shutdown_connections 2023-10-03T10:18:42.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.859+0000 7f68eaeba700 1 -- 172.21.15.125:0/2220145215 wait complete. 2023-10-03T10:18:42.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.916+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f169006c1e0 con 0x7f169006a770 2023-10-03T10:18:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.916+0000 7f1682ffd700 1 -- 172.21.15.125:0/2989922853 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1684015030 con 0x7f169006a770 2023-10-03T10:18:42.917 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 msgr2=0x7f169011d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 0x7f169011d7e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f16840098a0 tx=0x7f1684004750 comp rx=0 tx=0).stop 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 shutdown_connections 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1690133470 0x7f169011e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f169006a770 0x7f169011d7e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 --2- 172.21.15.125:0/2989922853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1690130520 0x7f169011dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 >> 172.21.15.125:0/2989922853 conn(0x7f16900a2d80 msgr2=0x7f16900a1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 shutdown_connections 2023-10-03T10:18:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:42.918+0000 7f169759e700 1 -- 172.21.15.125:0/2989922853 wait complete. 2023-10-03T10:18:42.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:43.421 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:43.543 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 Processor -- start 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 -- start start 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c0a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 0x7f9d7c133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c09db90 con 0x7f9d7c133f40 2023-10-03T10:18:43.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c09de10 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.543+0000 7f9d817ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0a2560 con 0x7f9d7c0a12f0 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c0a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9d7c133f40 0x7f9d7c13acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46912/0 (socket says 172.21.15.125:46912) 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7b7fe700 1 -- 172.21.15.125:0/975760186 learned_addr learned my addr 172.21.15.125:0/975760186 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7a7fc700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 0x7f9d7c133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 -- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 msgr2=0x7f9d7c133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 0x7f9d7c133a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 -- 172.21.15.125:0/975760186 >> v1:172.21.15.125:6789/0 conn(0x7f9d7c133f40 legacy=0x7f9d7c13acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d79ffb700 1 -- 172.21.15.125:0/975760186 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747910920 0 0) 0x7f9d7c09db90 con 0x7f9d7c133f40 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 -- 172.21.15.125:0/975760186 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0a1f60 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7a7fc700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 0x7f9d7c133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d7affd700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c0a0db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009870 tx=0x7f9d70009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c98d918bb469d40e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d79ffb700 1 -- 172.21.15.125:0/975760186 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011830 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d79ffb700 1 -- 172.21.15.125:0/975760186 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70011990 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.544+0000 7f9d79ffb700 1 -- 172.21.15.125:0/975760186 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011d20 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 -- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 msgr2=0x7f9d7c0a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c0a0db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009870 tx=0x7f9d70009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 -- 172.21.15.125:0/975760186 shutdown_connections 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c0a0db0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 --2- 172.21.15.125:0/975760186 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c0a12f0 0x7f9d7c133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 -- 172.21.15.125:0/975760186 >> 172.21.15.125:0/975760186 conn(0x7f9d7c0a3000 msgr2=0x7f9d7c0a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 -- 172.21.15.125:0/975760186 shutdown_connections 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.545+0000 7f9d817ad700 1 -- 172.21.15.125:0/975760186 wait complete. 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 Processor -- start 2023-10-03T10:18:43.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 -- start start 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 0x7f9d7c122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 0x7f9d7c123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c09cdc0 con 0x7f9d7c0a12f0 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c124570 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d817ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c133300 con 0x7f9d7c133f40 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d7affd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40140/0 (socket says 172.21.15.125:40140) 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d7a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 0x7f9d7c122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d7affd700 1 -- 172.21.15.125:0/4234859728 learned_addr learned my addr 172.21.15.125:0/4234859728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:43.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.546+0000 7f9d7b7fe700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 0x7f9d7c123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 -- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 msgr2=0x7f9d7c123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 0x7f9d7c123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 -- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 msgr2=0x7f9d7c122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 0x7f9d7c122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 -- 172.21.15.125:0/4234859728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0094a0 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7b7fe700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 0x7f9d7c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7a7fc700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 0x7f9d7c122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d7affd700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9d70014040 tx=0x7f9d70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70004510 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7001e070 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d700094a0 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700038e0 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.547+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c126020 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.548+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d70003a40 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.548+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d700403f0 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.548+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c04f2a0 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.553+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d70015080 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.667+0000 7fd2b6caf700 1 Processor -- start 2023-10-03T10:18:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.667+0000 7fd2b6caf700 1 -- start start 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b6caf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 0x7fd2b0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b6caf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 0x7fd2b013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b6caf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b009af80 con 0x7fd2b009a150 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b6caf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b009a520 con 0x7fd2b009ef80 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b6caf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b009fe00 con 0x7fd2b009f370 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b524c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 0x7fd2b013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2affff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 0x7fd2b0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b4a4b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd2b009a150 0x7fd2b009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46924/0 (socket says 172.21.15.125:46924) 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b4a4b700 1 -- 172.21.15.125:0/2107300366 learned_addr learned my addr 172.21.15.125:0/2107300366 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2af7fe700 1 -- 172.21.15.125:0/2107300366 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970944550 0 0) 0x7fd2b009af80 con 0x7fd2b009a150 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2af7fe700 1 -- 172.21.15.125:0/2107300366 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a00035b0 con 0x7fd2b009a150 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b524c700 1 -- 172.21.15.125:0/2107300366 >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 msgr2=0x7fd2b0138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b524c700 1 --2- 172.21.15.125:0/2107300366 >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 0x7fd2b0138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b524c700 1 -- 172.21.15.125:0/2107300366 >> v1:172.21.15.125:6789/0 conn(0x7fd2b009a150 legacy=0x7fd2b009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2b524c700 1 -- 172.21.15.125:0/2107300366 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b006bc20 con 0x7fd2b009f370 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.668+0000 7fd2affff700 1 --2- 172.21.15.125:0/2107300366 >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 0x7fd2b0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b524c700 1 --2- 172.21.15.125:0/2107300366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 0x7fd2b013b3b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009dc0 tx=0x7fd2a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d4aa4f2ca0a506 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2af7fe700 1 -- 172.21.15.125:0/2107300366 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800e070 con 0x7fd2b009f370 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2af7fe700 1 -- 172.21.15.125:0/2107300366 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a800bae0 con 0x7fd2b009f370 2023-10-03T10:18:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2af7fe700 1 -- 172.21.15.125:0/2107300366 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800be90 con 0x7fd2b009f370 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 -- 172.21.15.125:0/2107300366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 msgr2=0x7fd2b013b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/2107300366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 0x7fd2b013b3b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009dc0 tx=0x7fd2a800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 -- 172.21.15.125:0/2107300366 shutdown_connections 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/2107300366 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009f370 0x7fd2b013b3b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/2107300366 >> v2:172.21.15.125:3300/0 conn(0x7fd2b009ef80 0x7fd2b0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 -- 172.21.15.125:0/2107300366 >> 172.21.15.125:0/2107300366 conn(0x7fd2b00a4430 msgr2=0x7fd2b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 -- 172.21.15.125:0/2107300366 shutdown_connections 2023-10-03T10:18:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.669+0000 7fd2b6caf700 1 -- 172.21.15.125:0/2107300366 wait complete. 2023-10-03T10:18:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.670+0000 7fd2b6caf700 1 Processor -- start 2023-10-03T10:18:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.670+0000 7fd2b6caf700 1 -- start start 2023-10-03T10:18:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd2b009ef80 0x7fd2b0139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0120360 con 0x7fd2b009f370 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b009b8c0 con 0x7fd2b009a150 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b6caf700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00a0440 con 0x7fd2b009ef80 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b4a4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54598/0 (socket says 172.21.15.125:54598) 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b4a4b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40160/0 (socket says 172.21.15.125:40160) 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 -- 172.21.15.125:0/3080923779 learned_addr learned my addr 172.21.15.125:0/3080923779 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2affff700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd2b009ef80 0x7fd2b0139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 -- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd2b009ef80 msgr2=0x7fd2b0139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd2b009ef80 0x7fd2b0139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 -- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 msgr2=0x7fd2b01397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 -- 172.21.15.125:0/3080923779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0094a0 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b4a4b700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2b524c700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800b370 tx=0x7fd2a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.671+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8004800 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.672+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8020070 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.672+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8026670 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.672+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a8009a70 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.672+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b011faf0 con 0x7fd2b009f370 2023-10-03T10:18:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.672+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2a8012430 con 0x7fd2b009f370 2023-10-03T10:18:43.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.673+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd2a8022070 con 0x7fd2b009f370 2023-10-03T10:18:43.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.673+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b009fa30 con 0x7fd2b009f370 2023-10-03T10:18:43.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.681+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2a800c410 con 0x7fd2b009f370 2023-10-03T10:18:43.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.752+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d7c133730 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.753+0000 7f9d637fe700 1 -- 172.21.15.125:0/4234859728 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d7002d450 con 0x7f9d7c0a09e0 2023-10-03T10:18:43.753 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:43.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 msgr2=0x7f9d7c1227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9d70014040 tx=0x7f9d70004750 comp rx=0 tx=0).stop 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 shutdown_connections 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9d7c133f40 0x7f9d7c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d7c0a09e0 0x7f9d7c1227e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 --2- 172.21.15.125:0/4234859728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d7c0a12f0 0x7f9d7c122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 >> 172.21.15.125:0/4234859728 conn(0x7f9d7c0a3000 msgr2=0x7f9d7c09ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 shutdown_connections 2023-10-03T10:18:43.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.755+0000 7f9d817ad700 1 -- 172.21.15.125:0/4234859728 wait complete. 2023-10-03T10:18:43.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.870+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2b009ea80 con 0x7fd2b009f370 2023-10-03T10:18:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.870+0000 7fd2ad7fa700 1 -- 172.21.15.125:0/3080923779 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2a8011390 con 0x7fd2b009f370 2023-10-03T10:18:43.871 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:43.872 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:43.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.872+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 msgr2=0x7fd2b013a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.872+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800b370 tx=0x7fd2a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 shutdown_connections 2023-10-03T10:18:43.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b009f370 0x7fd2b013a250 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b009a150 0x7fd2b01397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 --2- 172.21.15.125:0/3080923779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fd2b009ef80 0x7fd2b0139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 >> 172.21.15.125:0/3080923779 conn(0x7fd2b00a4430 msgr2=0x7fd2b009c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 shutdown_connections 2023-10-03T10:18:43.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.873+0000 7fd2b6caf700 1 -- 172.21.15.125:0/3080923779 wait complete. 2023-10-03T10:18:43.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:43.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.998+0000 7f080e317700 1 Processor -- start 2023-10-03T10:18:43.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 -- start start 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 0x7f080809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080809fa00 con 0x7f0808134160 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080a0370 con 0x7f080809e870 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080e317700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f080806bec0 con 0x7f080809f180 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f0807fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 0x7f080809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080c8b4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0808134160 0x7f080813ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46928/0 (socket says 172.21.15.125:46928) 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f080c8b4700 1 -- 172.21.15.125:0/2294912237 learned_addr learned my addr 172.21.15.125:0/2294912237 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34290/0 (socket says 172.21.15.125:34290) 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 -- 172.21.15.125:0/2294912237 >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 msgr2=0x7f080809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 --2- 172.21.15.125:0/2294912237 >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 0x7f080809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 -- 172.21.15.125:0/2294912237 >> v1:172.21.15.125:6789/0 conn(0x7f0808134160 legacy=0x7f080813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:43.999+0000 7f07fffff700 1 -- 172.21.15.125:0/2294912237 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080809ada0 con 0x7f080809f180 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f0807fff700 1 --2- 172.21.15.125:0/2294912237 >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 0x7f080809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f07fffff700 1 --2- 172.21.15.125:0/2294912237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009840 tx=0x7f07f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9f9eafea5abc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f08077fe700 1 -- 172.21.15.125:0/2294912237 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011830 con 0x7f080809f180 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f08077fe700 1 -- 172.21.15.125:0/2294912237 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011990 con 0x7f080809f180 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f08077fe700 1 -- 172.21.15.125:0/2294912237 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011d20 con 0x7f080809f180 2023-10-03T10:18:44.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 -- 172.21.15.125:0/2294912237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 msgr2=0x7f0808133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 --2- 172.21.15.125:0/2294912237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009840 tx=0x7f07f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 -- 172.21.15.125:0/2294912237 shutdown_connections 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 --2- 172.21.15.125:0/2294912237 >> v2:172.21.15.125:3300/0 conn(0x7f080809e870 0x7f080809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 --2- 172.21.15.125:0/2294912237 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809f180 0x7f0808133c20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.000+0000 7f080e317700 1 -- 172.21.15.125:0/2294912237 >> 172.21.15.125:0/2294912237 conn(0x7f08080a4430 msgr2=0x7f08080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.001+0000 7f080e317700 1 -- 172.21.15.125:0/2294912237 shutdown_connections 2023-10-03T10:18:44.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.001+0000 7f080e317700 1 -- 172.21.15.125:0/2294912237 wait complete. 2023-10-03T10:18:44.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 Processor -- start 2023-10-03T10:18:44.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 -- start start 2023-10-03T10:18:44.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 0x7f080811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08081332f0 con 0x7f080809f180 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080806cfa0 con 0x7f0808134160 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080e317700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0808120b60 con 0x7f080809e870 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.002+0000 7f080c8b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f07fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40168/0 (socket says 172.21.15.125:40168) 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f07fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54616/0 (socket says 172.21.15.125:54616) 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 -- 172.21.15.125:0/4253936386 learned_addr learned my addr 172.21.15.125:0/4253936386 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f0807fff700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 0x7f080811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 -- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 msgr2=0x7f080811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 0x7f080811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 -- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 msgr2=0x7f080811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 -- 172.21.15.125:0/4253936386 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80094a0 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f07fffff700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f0807fff700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 0x7f080811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080c8b4700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f080000cbc0 tx=0x7f080000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000a9e0 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000ab40 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f00094a0 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800012400 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.003+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0808121ee0 con 0x7f0808134160 2023-10-03T10:18:44.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.004+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080804f2a0 con 0x7f0808134160 2023-10-03T10:18:44.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.005+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080001b3b0 con 0x7f0808134160 2023-10-03T10:18:44.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.005+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f080003f760 con 0x7f0808134160 2023-10-03T10:18:44.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.009+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08000192c0 con 0x7f0808134160 2023-10-03T10:18:44.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.057+0000 7f4e4b45b700 1 Processor -- start 2023-10-03T10:18:44.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.057+0000 7f4e4b45b700 1 -- start start 2023-10-03T10:18:44.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e4b45b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e4b45b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e4b45b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4409b110 con 0x7f4e440a0a70 2023-10-03T10:18:44.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e4b45b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440a3b60 con 0x7f4e44133f70 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e4b45b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441348e0 con 0x7f4e4409ad40 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e491f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40170/0 (socket says 172.21.15.125:40170) 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e499f8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4e440a0a70 0x7f4e440a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46942/0 (socket says 172.21.15.125:46942) 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e491f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34302/0 (socket says 172.21.15.125:34302) 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 -- 172.21.15.125:0/3459835793 learned_addr learned my addr 172.21.15.125:0/3459835793 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 -- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 msgr2=0x7f4e44133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e3bfff700 1 -- 172.21.15.125:0/3459835793 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050568009 0 0) 0x7f4e4409b110 con 0x7f4e440a0a70 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 -- 172.21.15.125:0/3459835793 >> v1:172.21.15.125:6789/0 conn(0x7f4e440a0a70 legacy=0x7f4e440a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 -- 172.21.15.125:0/3459835793 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440a2fa0 con 0x7f4e44133f70 2023-10-03T10:18:44.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e491f7700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.058+0000 7f4e489f6700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009920 tx=0x7f4e34009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf8402174966abf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e3bfff700 1 -- 172.21.15.125:0/3459835793 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34011830 con 0x7f4e44133f70 2023-10-03T10:18:44.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e3bfff700 1 -- 172.21.15.125:0/3459835793 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34011990 con 0x7f4e44133f70 2023-10-03T10:18:44.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e3bfff700 1 -- 172.21.15.125:0/3459835793 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34011d20 con 0x7f4e44133f70 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 -- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 msgr2=0x7f4e441343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009920 tx=0x7f4e34009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 -- 172.21.15.125:0/3459835793 shutdown_connections 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e4409ad40 0x7f4e44133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/3459835793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e441343a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 -- 172.21.15.125:0/3459835793 >> 172.21.15.125:0/3459835793 conn(0x7f4e44099c40 msgr2=0x7f4e4406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 -- 172.21.15.125:0/3459835793 shutdown_connections 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.059+0000 7f4e4b45b700 1 -- 172.21.15.125:0/3459835793 wait complete. 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.060+0000 7f4e4b45b700 1 Processor -- start 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.060+0000 7f4e4b45b700 1 -- start start 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e44121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44122740 con 0x7f4e4409ad40 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44124db0 con 0x7f4e44133f70 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e4b45b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441248a0 con 0x7f4e440a0a70 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e489f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e499f8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e44121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54630/0 (socket says 172.21.15.125:54630) 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 -- 172.21.15.125:0/4172871943 learned_addr learned my addr 172.21.15.125:0/4172871943 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e489f6700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34310/0 (socket says 172.21.15.125:34310) 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 -- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 msgr2=0x7f4e441217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 -- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 msgr2=0x7f4e44121d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e44121d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 -- 172.21.15.125:0/4172871943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400094a0 con 0x7f4e4409ad40 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e489f6700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e499f8700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e44121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e491f7700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000ec10 tx=0x7f4e4000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.061+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40009760 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.062+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000c850 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.062+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34009550 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.062+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000cbe0 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.062+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4409e910 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.063+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e4000cd40 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.063+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4411e060 con 0x7f4e4409ad40 2023-10-03T10:18:44.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.063+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e4003f6f0 con 0x7f4e4409ad40 2023-10-03T10:18:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.067+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e4001bba0 con 0x7f4e4409ad40 2023-10-03T10:18:44.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.202+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f080806c9d0 con 0x7f0808134160 2023-10-03T10:18:44.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.203+0000 7f08057fa700 1 -- 172.21.15.125:0/4253936386 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0800017020 con 0x7f0808134160 2023-10-03T10:18:44.203 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:44.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 msgr2=0x7f080811f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f080000cbc0 tx=0x7f080000ced0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 shutdown_connections 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0808134160 0x7f080811f550 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f080809e870 0x7f080811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 --2- 172.21.15.125:0/4253936386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f080809f180 0x7f080811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 >> 172.21.15.125:0/4253936386 conn(0x7f08080a4430 msgr2=0x7f080809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 shutdown_connections 2023-10-03T10:18:44.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.205+0000 7f080e317700 1 -- 172.21.15.125:0/4253936386 wait complete. 2023-10-03T10:18:44.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:44.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.259+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4e44122f00 con 0x7f4e4409ad40 2023-10-03T10:18:44.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.260+0000 7f4e39ffb700 1 -- 172.21.15.125:0/4172871943 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e40021070 con 0x7f4e4409ad40 2023-10-03T10:18:44.260 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 msgr2=0x7f4e44121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000ec10 tx=0x7f4e4000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 shutdown_connections 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e44133f70 0x7f4e44121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e4409ad40 0x7f4e44121290 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 --2- 172.21.15.125:0/4172871943 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f4e440a0a70 0x7f4e441217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 >> 172.21.15.125:0/4172871943 conn(0x7f4e44099c40 msgr2=0x7f4e441332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 shutdown_connections 2023-10-03T10:18:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.262+0000 7f4e4b45b700 1 -- 172.21.15.125:0/4172871943 wait complete. 2023-10-03T10:18:44.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:44.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:44.887 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.890+0000 7fb448303700 1 Processor -- start 2023-10-03T10:18:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.890+0000 7fb448303700 1 -- start start 2023-10-03T10:18:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb448303700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb440136960 0x7fb440138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb448303700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb448303700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44006b2d0 con 0x7fb440133ad0 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb448303700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4401345b0 con 0x7fb440136960 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb448303700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440133610 con 0x7fb440139280 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb440136960 0x7fb440138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb4468a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb4468a0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:40188/0 (socket says 172.21.15.125:40188) 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb440136960 0x7fb440138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54646/0 (socket says 172.21.15.125:54646) 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44609f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb440133ad0 0x7fb440133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46950/0 (socket says 172.21.15.125:46950) 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb4468a0700 1 -- 172.21.15.125:0/2943096650 learned_addr learned my addr 172.21.15.125:0/2943096650 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44509d700 1 -- 172.21.15.125:0/2943096650 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205713923 0 0) 0x7fb44006b2d0 con 0x7fb440133ad0 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 -- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 msgr2=0x7fb44013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 -- 172.21.15.125:0/2943096650 >> v1:172.21.15.125:6789/0 conn(0x7fb440133ad0 legacy=0x7fb440133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb44589e700 1 -- 172.21.15.125:0/2943096650 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44009a500 con 0x7fb440136960 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.891+0000 7fb4468a0700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb44589e700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440136960 0x7fb440138d40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb430009840 tx=0x7fb430009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4d61f4fd822142 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb44509d700 1 -- 172.21.15.125:0/2943096650 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011830 con 0x7fb440136960 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb44509d700 1 -- 172.21.15.125:0/2943096650 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430011990 con 0x7fb440136960 2023-10-03T10:18:44.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb44509d700 1 -- 172.21.15.125:0/2943096650 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011d20 con 0x7fb440136960 2023-10-03T10:18:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 -- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440136960 msgr2=0x7fb440138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440136960 0x7fb440138d40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb430009840 tx=0x7fb430009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 -- 172.21.15.125:0/2943096650 shutdown_connections 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440139280 0x7fb44013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 --2- 172.21.15.125:0/2943096650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440136960 0x7fb440138d40 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 -- 172.21.15.125:0/2943096650 >> 172.21.15.125:0/2943096650 conn(0x7fb440099c40 msgr2=0x7fb4400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 -- 172.21.15.125:0/2943096650 shutdown_connections 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.892+0000 7fb448303700 1 -- 172.21.15.125:0/2943096650 wait complete. 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.893+0000 7fb448303700 1 Processor -- start 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.893+0000 7fb448303700 1 -- start start 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 0x7fb440071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 0x7fb440071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 0x7fb440071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44006ec30 con 0x7fb440139280 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440072200 con 0x7fb440133ad0 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb448303700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4401317a0 con 0x7fb440136960 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb44589e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 0x7fb440071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 0x7fb440071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb44609f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 0x7fb440071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb44589e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 0x7fb440071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34316/0 (socket says 172.21.15.125:34316) 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb44589e700 1 -- 172.21.15.125:0/397575860 learned_addr learned my addr 172.21.15.125:0/397575860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 -- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 msgr2=0x7fb440071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 0x7fb440071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 -- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 msgr2=0x7fb440071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 0x7fb440071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 -- 172.21.15.125:0/397575860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438009b30 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb44609f700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 0x7fb440071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.894+0000 7fb4468a0700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 0x7fb440071bd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb44006c710 tx=0x7fb43800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800ca10 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43800f040 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4300094a0 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800cdb0 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44006ee50 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb438014480 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.895+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb43803fcb0 con 0x7fb440139280 2023-10-03T10:18:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.896+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44004f2a0 con 0x7fb440139280 2023-10-03T10:18:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:44.900+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb438012930 con 0x7fb440139280 2023-10-03T10:18:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 Processor -- start 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 -- start start 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 0x7f6254133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625409b110 con 0x7f62540a0a70 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540a3b60 con 0x7f625409ad40 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f625a482700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62541348e0 con 0x7f6254133f70 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f62537fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f6253fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 0x7f6254133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f62537fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34324/0 (socket says 172.21.15.125:34324) 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.011+0000 7f62537fe700 1 -- 172.21.15.125:0/2589985897 learned_addr learned my addr 172.21.15.125:0/2589985897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f62537fe700 1 -- 172.21.15.125:0/2589985897 >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 msgr2=0x7f6254133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f62537fe700 1 --2- 172.21.15.125:0/2589985897 >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 0x7f6254133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f62537fe700 1 -- 172.21.15.125:0/2589985897 >> v1:172.21.15.125:6789/0 conn(0x7f62540a0a70 legacy=0x7f62540a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f62537fe700 1 -- 172.21.15.125:0/2589985897 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540a2fa0 con 0x7f6254133f70 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f6253fff700 1 --2- 172.21.15.125:0/2589985897 >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 0x7f6254133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f6252ffd700 1 -- 172.21.15.125:0/2589985897 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496133685 0 0) 0x7f625409b110 con 0x7f62540a0a70 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f62537fe700 1 --2- 172.21.15.125:0/2589985897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f62480098f0 tx=0x7f6248009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78f1d2a234b1cec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f6252ffd700 1 -- 172.21.15.125:0/2589985897 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248011830 con 0x7f6254133f70 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f6252ffd700 1 -- 172.21.15.125:0/2589985897 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6248011990 con 0x7f6254133f70 2023-10-03T10:18:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.012+0000 7f6252ffd700 1 -- 172.21.15.125:0/2589985897 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248011d20 con 0x7f6254133f70 2023-10-03T10:18:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 -- 172.21.15.125:0/2589985897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 msgr2=0x7f62541343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 --2- 172.21.15.125:0/2589985897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f62480098f0 tx=0x7f6248009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 -- 172.21.15.125:0/2589985897 shutdown_connections 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 --2- 172.21.15.125:0/2589985897 >> v2:172.21.15.125:3300/0 conn(0x7f625409ad40 0x7f6254133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 --2- 172.21.15.125:0/2589985897 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6254133f70 0x7f62541343a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 -- 172.21.15.125:0/2589985897 >> 172.21.15.125:0/2589985897 conn(0x7f6254099c40 msgr2=0x7f625406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 -- 172.21.15.125:0/2589985897 shutdown_connections 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.013+0000 7f625a482700 1 -- 172.21.15.125:0/2589985897 wait complete. 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.014+0000 7f625a482700 1 Processor -- start 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.014+0000 7f625a482700 1 -- start start 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62540a0a70 0x7f6254121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254123db0 con 0x7f6254133f70 2023-10-03T10:18:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254122eb0 con 0x7f62540a0a70 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f625a482700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625409c7e0 con 0x7f625409ad40 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6258a1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:34340/0 (socket says 172.21.15.125:34340) 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6258a1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54670/0 (socket says 172.21.15.125:54670) 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 -- 172.21.15.125:0/1871786696 learned_addr learned my addr 172.21.15.125:0/1871786696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 -- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62540a0a70 msgr2=0x7f6254121820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62540a0a70 0x7f6254121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 -- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 msgr2=0x7f6254121d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 -- 172.21.15.125:0/1871786696 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440094a0 con 0x7f625409ad40 2023-10-03T10:18:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6258a1f700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.015+0000 7f6253fff700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624400ebe0 tx=0x7f624400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400c850 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400c9b0 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248009550 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400cd40 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254124b30 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.016+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6244013470 con 0x7f625409ad40 2023-10-03T10:18:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.017+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6254124940 con 0x7f625409ad40 2023-10-03T10:18:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.017+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f624403f730 con 0x7f625409ad40 2023-10-03T10:18:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.021+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6254124940 con 0x7f625409ad40 2023-10-03T10:18:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.095+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb44009f0f0 con 0x7fb440139280 2023-10-03T10:18:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.096+0000 7fb436ffd700 1 -- 172.21.15.125:0/397575860 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb43802c090 con 0x7fb440139280 2023-10-03T10:18:45.096 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:45.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 msgr2=0x7fb440071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 0x7fb440071bd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb44006c710 tx=0x7fb43800ef90 comp rx=0 tx=0).stop 2023-10-03T10:18:45.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 shutdown_connections 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440139280 0x7fb440071bd0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440133ad0 0x7fb440071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 --2- 172.21.15.125:0/397575860 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb440136960 0x7fb440071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 >> 172.21.15.125:0/397575860 conn(0x7fb440099c40 msgr2=0x7fb4400a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 shutdown_connections 2023-10-03T10:18:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.098+0000 7fb448303700 1 -- 172.21.15.125:0/397575860 wait complete. 2023-10-03T10:18:45.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:45.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.209+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6254124b30 con 0x7f625409ad40 2023-10-03T10:18:45.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.210+0000 7f6250ff9700 1 -- 172.21.15.125:0/1871786696 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6254124b30 con 0x7f625409ad40 2023-10-03T10:18:45.210 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.211+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 msgr2=0x7f62541212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624400ebe0 tx=0x7f624400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 shutdown_connections 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6254133f70 0x7f6254121d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f625409ad40 0x7f62541212e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 --2- 172.21.15.125:0/1871786696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62540a0a70 0x7f6254121820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 >> 172.21.15.125:0/1871786696 conn(0x7f6254099c40 msgr2=0x7f62541332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 shutdown_connections 2023-10-03T10:18:45.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.212+0000 7f625a482700 1 -- 172.21.15.125:0/1871786696 wait complete. 2023-10-03T10:18:45.218 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:45.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:45.276 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:45.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 Processor -- start 2023-10-03T10:18:45.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 -- start start 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16481391f0 0x7f164813b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164809db90 con 0x7f16480a09e0 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164809de10 con 0x7f16481391f0 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.343+0000 7f164cd43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16480a2560 con 0x7f16480a14c0 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1646d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16481391f0 0x7f164813b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f164659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f16480a09e0 0x7f16480a0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38830/0 (socket says 172.21.15.125:38830) 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f164659c700 1 -- 172.21.15.125:0/1658933875 learned_addr learned my addr 172.21.15.125:0/1658933875 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:45.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 -- 172.21.15.125:0/1658933875 >> v2:172.21.15.125:3300/0 conn(0x7f16481391f0 msgr2=0x7f164813b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 --2- 172.21.15.125:0/1658933875 >> v2:172.21.15.125:3300/0 conn(0x7f16481391f0 0x7f164813b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 -- 172.21.15.125:0/1658933875 >> v1:172.21.15.125:6789/0 conn(0x7f16480a09e0 legacy=0x7f16480a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 -- 172.21.15.125:0/1658933875 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480a1f60 con 0x7f16480a14c0 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f1645d9b700 1 --2- 172.21.15.125:0/1658933875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648138cb0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f163c009840 tx=0x7f163c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b45d365a55c4cbdc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f164559a700 1 -- 172.21.15.125:0/1658933875 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011830 con 0x7f16480a14c0 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f164559a700 1 -- 172.21.15.125:0/1658933875 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c011990 con 0x7f16480a14c0 2023-10-03T10:18:45.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.344+0000 7f164559a700 1 -- 172.21.15.125:0/1658933875 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011d20 con 0x7f16480a14c0 2023-10-03T10:18:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 -- 172.21.15.125:0/1658933875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 msgr2=0x7f1648138cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 --2- 172.21.15.125:0/1658933875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648138cb0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f163c009840 tx=0x7f163c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 -- 172.21.15.125:0/1658933875 shutdown_connections 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 --2- 172.21.15.125:0/1658933875 >> v2:172.21.15.125:3300/0 conn(0x7f16481391f0 0x7f164813b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 --2- 172.21.15.125:0/1658933875 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648138cb0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 -- 172.21.15.125:0/1658933875 >> 172.21.15.125:0/1658933875 conn(0x7f16480a3000 msgr2=0x7f16480a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 -- 172.21.15.125:0/1658933875 shutdown_connections 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.345+0000 7f164cd43700 1 -- 172.21.15.125:0/1658933875 wait complete. 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 Processor -- start 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 -- start start 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 0x7f1648123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648138b00 con 0x7f16480a09e0 2023-10-03T10:18:45.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1648124a80 con 0x7f16481391f0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.346+0000 7f164cd43700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16481244a0 con 0x7f16480a14c0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56092/0 (socket says 172.21.15.125:56092) 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 0x7f1648123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164659c700 1 -- 172.21.15.125:0/3834439747 learned_addr learned my addr 172.21.15.125:0/3834439747 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1645d9b700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 -- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 msgr2=0x7f1648122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 -- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 msgr2=0x7f16481229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 -- 172.21.15.125:0/3834439747 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0094a0 con 0x7f16481391f0 2023-10-03T10:18:45.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164659c700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1645d9b700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1646d9d700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 0x7f1648123440 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f164000ef90 tx=0x7f164000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000cc90 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000f040 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400146c0 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164809ea00 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.347+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1648125e10 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.348+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1640014820 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.348+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164804f2a0 con 0x7f16481391f0 2023-10-03T10:18:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.348+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16400402a0 con 0x7f16481391f0 2023-10-03T10:18:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.353+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f164001d400 con 0x7f16481391f0 2023-10-03T10:18:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 Processor -- start 2023-10-03T10:18:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 -- start start 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 0x7fed8c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 0x7fed8c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c09dc00 con 0x7fed8c133f50 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c09ea60 con 0x7fed8c0a1380 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed9117e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c09dec0 con 0x7fed8c0a0a70 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed8a59c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 0x7fed8c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed8b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fed8c133f50 0x7fed8c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38838/0 (socket says 172.21.15.125:38838) 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed8b59e700 1 -- 172.21.15.125:0/706880296 learned_addr learned my addr 172.21.15.125:0/706880296 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed8ad9d700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 0x7fed8c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed89d9b700 1 -- 172.21.15.125:0/706880296 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804428531 0 0) 0x7fed8c09dc00 con 0x7fed8c133f50 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.403+0000 7fed8ad9d700 1 -- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 msgr2=0x7fed8c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed8ad9d700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 0x7fed8c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed8ad9d700 1 -- 172.21.15.125:0/706880296 >> v1:172.21.15.125:6789/0 conn(0x7fed8c133f50 legacy=0x7fed8c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed8ad9d700 1 -- 172.21.15.125:0/706880296 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c09e6a0 con 0x7fed8c0a0a70 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed8a59c700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 0x7fed8c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed8ad9d700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 0x7fed8c0a0e40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95dfb2f8cb7abbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed89d9b700 1 -- 172.21.15.125:0/706880296 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011830 con 0x7fed8c0a0a70 2023-10-03T10:18:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed89d9b700 1 -- 172.21.15.125:0/706880296 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c011990 con 0x7fed8c0a0a70 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed89d9b700 1 -- 172.21.15.125:0/706880296 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011d20 con 0x7fed8c0a0a70 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 -- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 msgr2=0x7fed8c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 0x7fed8c0a0e40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 -- 172.21.15.125:0/706880296 shutdown_connections 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a0a70 0x7fed8c0a0e40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 --2- 172.21.15.125:0/706880296 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c0a1380 0x7fed8c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.404+0000 7fed9117e700 1 -- 172.21.15.125:0/706880296 >> 172.21.15.125:0/706880296 conn(0x7fed8c0a6610 msgr2=0x7fed8c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.405+0000 7fed9117e700 1 -- 172.21.15.125:0/706880296 shutdown_connections 2023-10-03T10:18:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.405+0000 7fed9117e700 1 -- 172.21.15.125:0/706880296 wait complete. 2023-10-03T10:18:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.406+0000 7fed9117e700 1 Processor -- start 2023-10-03T10:18:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.406+0000 7fed9117e700 1 -- start start 2023-10-03T10:18:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 0x7fed8c122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 0x7fed8c123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1262e0 con 0x7fed8c0a0a70 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c123c20 con 0x7fed8c133f50 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed9117e700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0a03e0 con 0x7fed8c0a1380 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56102/0 (socket says 172.21.15.125:56102) 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8ad9d700 1 -- 172.21.15.125:0/1171633779 learned_addr learned my addr 172.21.15.125:0/1171633779 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 0x7fed8c122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8b59e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 0x7fed8c123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 -- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 msgr2=0x7fed8c123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 0x7fed8c123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 -- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 msgr2=0x7fed8c1227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 -- 172.21.15.125:0/1171633779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800094a0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8ad9d700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8b59e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 0x7fed8c123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed8a59c700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 0x7fed8c122d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fed8000e980 tx=0x7fed8000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.407+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000c690 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8000c7f0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0094a0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000cb80 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c1332e0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed8000cce0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.408+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c04f2a0 con 0x7fed8c0a1380 2023-10-03T10:18:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.409+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed8003f860 con 0x7fed8c0a1380 2023-10-03T10:18:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.413+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed800232f0 con 0x7fed8c0a1380 2023-10-03T10:18:45.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.550+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1648124c90 con 0x7f16481391f0 2023-10-03T10:18:45.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.550+0000 7f1636ffd700 1 -- 172.21.15.125:0/3834439747 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f164002b070 con 0x7f16481391f0 2023-10-03T10:18:45.551 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 msgr2=0x7f1648123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 0x7f1648123440 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f164000ef90 tx=0x7f164000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 shutdown_connections 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16481391f0 0x7f1648123440 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480a09e0 0x7f16481229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 --2- 172.21.15.125:0/3834439747 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f16480a14c0 0x7f1648122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 >> 172.21.15.125:0/3834439747 conn(0x7f16480a3000 msgr2=0x7f1648099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 shutdown_connections 2023-10-03T10:18:45.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.552+0000 7f164cd43700 1 -- 172.21.15.125:0/3834439747 wait complete. 2023-10-03T10:18:45.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:45.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.606+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed8c126ad0 con 0x7fed8c0a1380 2023-10-03T10:18:45.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.606+0000 7fed737fe700 1 -- 172.21.15.125:0/1171633779 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed80021020 con 0x7fed8c0a1380 2023-10-03T10:18:45.607 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 msgr2=0x7fed8c122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 0x7fed8c122d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fed8000e980 tx=0x7fed8000ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 shutdown_connections 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed8c133f50 0x7fed8c123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8c0a0a70 0x7fed8c1227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 --2- 172.21.15.125:0/1171633779 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fed8c0a1380 0x7fed8c122d00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 >> 172.21.15.125:0/1171633779 conn(0x7fed8c0a6610 msgr2=0x7fed8c0a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 shutdown_connections 2023-10-03T10:18:45.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:45.608+0000 7fed9117e700 1 -- 172.21.15.125:0/1171633779 wait complete. 2023-10-03T10:18:45.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:46.111 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:46.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:46.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.235+0000 7f91d5bc1700 1 Processor -- start 2023-10-03T10:18:46.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.235+0000 7f91d5bc1700 1 -- start start 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91d5bc1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91d5bc1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91d5bc1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d00a1e70 con 0x7f91d00a1340 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91d5bc1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d009a720 con 0x7f91d0130670 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91d5bc1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91d009b300 con 0x7f91d00a0a30 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33102/0 (socket says 172.21.15.125:33102) 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 -- 172.21.15.125:0/610345221 learned_addr learned my addr 172.21.15.125:0/610345221 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cffff700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 -- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 msgr2=0x7f91d01381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 -- 172.21.15.125:0/610345221 >> v1:172.21.15.125:6789/0 conn(0x7f91d00a1340 legacy=0x7f91d012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 -- 172.21.15.125:0/610345221 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d009abc0 con 0x7f91d00a0a30 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91ce7fc700 1 -- 172.21.15.125:0/610345221 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870694595 0 0) 0x7f91d00a1e70 con 0x7f91d00a1340 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cffff700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.236+0000 7f91cf7fe700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f91c00098f0 tx=0x7f91c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b665ce84d21e89bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91ce7fc700 1 -- 172.21.15.125:0/610345221 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005e30 con 0x7f91d00a0a30 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91ce7fc700 1 -- 172.21.15.125:0/610345221 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0004030 con 0x7f91d00a0a30 2023-10-03T10:18:46.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91ce7fc700 1 -- 172.21.15.125:0/610345221 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00043e0 con 0x7f91d00a0a30 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 -- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 msgr2=0x7f91d00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f91c00098f0 tx=0x7f91c0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 -- 172.21.15.125:0/610345221 shutdown_connections 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/610345221 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d00a0e00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 -- 172.21.15.125:0/610345221 >> 172.21.15.125:0/610345221 conn(0x7f91d00a2980 msgr2=0x7f91d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 -- 172.21.15.125:0/610345221 shutdown_connections 2023-10-03T10:18:46.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.237+0000 7f91d5bc1700 1 -- 172.21.15.125:0/610345221 wait complete. 2023-10-03T10:18:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.238+0000 7f91d5bc1700 1 Processor -- start 2023-10-03T10:18:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.238+0000 7f91d5bc1700 1 -- start start 2023-10-03T10:18:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 0x7f91d011c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d011b6c0 con 0x7f91d00a1340 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d012fb70 con 0x7f91d0130670 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91d5bc1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91d011ea20 con 0x7f91d00a0a30 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91ceffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 0x7f91d011c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33108/0 (socket says 172.21.15.125:33108) 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 -- 172.21.15.125:0/3978628172 learned_addr learned my addr 172.21.15.125:0/3978628172 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cffff700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 -- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 msgr2=0x7f91d01c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 -- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 msgr2=0x7f91d011c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 0x7f91d011c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 -- 172.21.15.125:0/3978628172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009a70 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cffff700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91ceffd700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 0x7f91d011c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.239+0000 7f91cf7fe700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.240+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0003ae0 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.240+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0003c40 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.240+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0011420 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.240+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c0009500 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.240+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d011cdf0 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.241+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91c0018070 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.241+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91c003fd10 con 0x7f91d00a0a30 2023-10-03T10:18:46.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.241+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d004f2a0 con 0x7f91d00a0a30 2023-10-03T10:18:46.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.246+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91c0029080 con 0x7f91d00a0a30 2023-10-03T10:18:46.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.350+0000 7f40f25b2700 1 Processor -- start 2023-10-03T10:18:46.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.350+0000 7f40f25b2700 1 -- start start 2023-10-03T10:18:46.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f25b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 0x7f40ec136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f25b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 0x7f40ec1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f25b2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec09b6a0 con 0x7f40ec09e870 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f25b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec09f720 con 0x7f40ec09f350 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f25b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec09ad60 con 0x7f40ec137000 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 0x7f40ec1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40ebfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f40ec09e870 0x7f40ec09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38850/0 (socket says 172.21.15.125:38850) 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40ebfff700 1 -- 172.21.15.125:0/1331100190 learned_addr learned my addr 172.21.15.125:0/1331100190 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40eb7fe700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 0x7f40ec136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 -- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 msgr2=0x7f40ec136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 0x7f40ec136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 -- 172.21.15.125:0/1331100190 >> v1:172.21.15.125:6789/0 conn(0x7f40ec09e870 legacy=0x7f40ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40eaffd700 1 -- 172.21.15.125:0/1331100190 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199260901 0 0) 0x7f40ec09b6a0 con 0x7f40ec09e870 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 -- 172.21.15.125:0/1331100190 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0a0650 con 0x7f40ec137000 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40eb7fe700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 0x7f40ec136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.351+0000 7f40f0b4f700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 0x7f40ec1393e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009dc0 tx=0x7f40e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37a056fba0dc938e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40eaffd700 1 -- 172.21.15.125:0/1331100190 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400e070 con 0x7f40ec137000 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40eaffd700 1 -- 172.21.15.125:0/1331100190 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400bb20 con 0x7f40ec137000 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40eaffd700 1 -- 172.21.15.125:0/1331100190 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012430 con 0x7f40ec137000 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 -- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 msgr2=0x7f40ec1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 0x7f40ec1393e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009dc0 tx=0x7f40e400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 -- 172.21.15.125:0/1331100190 shutdown_connections 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec137000 0x7f40ec1393e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 --2- 172.21.15.125:0/1331100190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec09f350 0x7f40ec136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 -- 172.21.15.125:0/1331100190 >> 172.21.15.125:0/1331100190 conn(0x7f40ec0a4150 msgr2=0x7f40ec0a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 -- 172.21.15.125:0/1331100190 shutdown_connections 2023-10-03T10:18:46.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.352+0000 7f40f25b2700 1 -- 172.21.15.125:0/1331100190 wait complete. 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.353+0000 7f40f25b2700 1 Processor -- start 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.353+0000 7f40f25b2700 1 -- start start 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e870 0x7f40ec11f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 0x7f40ec11ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1233b0 con 0x7f40ec09f350 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1214a0 con 0x7f40ec137000 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f25b2700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0720a0 con 0x7f40ec09e870 2023-10-03T10:18:46.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42732/0 (socket says 172.21.15.125:42732) 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 -- 172.21.15.125:0/918283984 learned_addr learned my addr 172.21.15.125:0/918283984 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40eb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 0x7f40ec11ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40ebfff700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e870 0x7f40ec11f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 -- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e870 msgr2=0x7f40ec11f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e870 0x7f40ec11f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 -- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 msgr2=0x7f40ec11ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 0x7f40ec11ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 -- 172.21.15.125:0/918283984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094a0 con 0x7f40ec137000 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40eb7fe700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 0x7f40ec11ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.354+0000 7f40f0b4f700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b370 tx=0x7f40e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.355+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012430 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.355+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4020070 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.355+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4004280 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.355+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e4009a70 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.355+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec122e10 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.356+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40e40043e0 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.356+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04f2a0 con 0x7f40ec137000 2023-10-03T10:18:46.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.356+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40e4022070 con 0x7f40ec137000 2023-10-03T10:18:46.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.365+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40e401b400 con 0x7f40ec137000 2023-10-03T10:18:46.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.445+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91d011d5e0 con 0x7f91d00a0a30 2023-10-03T10:18:46.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.445+0000 7f91b7fff700 1 -- 172.21.15.125:0/3978628172 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91c0016020 con 0x7f91d00a0a30 2023-10-03T10:18:46.445 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 msgr2=0x7f91d011bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 shutdown_connections 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f91d0130670 0x7f91d01c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f91d00a0a30 0x7f91d011bb00 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 --2- 172.21.15.125:0/3978628172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91d00a1340 0x7f91d011c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 >> 172.21.15.125:0/3978628172 conn(0x7f91d00a2980 msgr2=0x7f91d0070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 shutdown_connections 2023-10-03T10:18:46.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.447+0000 7f91d5bc1700 1 -- 172.21.15.125:0/3978628172 wait complete. 2023-10-03T10:18:46.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:46.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.556+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f40ec072840 con 0x7f40ec137000 2023-10-03T10:18:46.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.556+0000 7f40e8ff9700 1 -- 172.21.15.125:0/918283984 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40e402c030 con 0x7f40ec137000 2023-10-03T10:18:46.557 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 msgr2=0x7f40ec120440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b370 tx=0x7f40e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 shutdown_connections 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f40ec137000 0x7f40ec120440 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f40ec09e870 0x7f40ec11f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 --2- 172.21.15.125:0/918283984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40ec09f350 0x7f40ec11ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 >> 172.21.15.125:0/918283984 conn(0x7f40ec0a4150 msgr2=0x7f40ec1bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 shutdown_connections 2023-10-03T10:18:46.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.558+0000 7f40f25b2700 1 -- 172.21.15.125:0/918283984 wait complete. 2023-10-03T10:18:46.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:46.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:46.622 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:46.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 Processor -- start 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 -- start start 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e409c970 con 0x7f97e4131d70 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40a0920 con 0x7f97e409e870 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e94a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e409f9c0 con 0x7f97e409f180 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42738/0 (socket says 172.21.15.125:42738) 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56128/0 (socket says 172.21.15.125:56128) 2023-10-03T10:18:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e27fc700 1 -- 172.21.15.125:0/2189849866 learned_addr learned my addr 172.21.15.125:0/2189849866 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.691+0000 7f97e37fe700 1 --1- 172.21.15.125:0/2189849866 >> v1:172.21.15.125:6789/0 conn(0x7f97e4131d70 0x7f97e4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38856/0 (socket says 172.21.15.125:38856) 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e27fc700 1 -- 172.21.15.125:0/2189849866 >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 msgr2=0x7f97e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e27fc700 1 --2- 172.21.15.125:0/2189849866 >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e27fc700 1 -- 172.21.15.125:0/2189849866 >> v1:172.21.15.125:6789/0 conn(0x7f97e4131d70 legacy=0x7f97e4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e27fc700 1 -- 172.21.15.125:0/2189849866 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e409bab0 con 0x7f97e409f180 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e1ffb700 1 -- 172.21.15.125:0/2189849866 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897713527 0 0) 0x7f97e409c970 con 0x7f97e4131d70 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e2ffd700 1 --2- 172.21.15.125:0/2189849866 >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e27fc700 1 --2- 172.21.15.125:0/2189849866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a9ca5c23a1b8335 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e1ffb700 1 -- 172.21.15.125:0/2189849866 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011830 con 0x7f97e409f180 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e1ffb700 1 -- 172.21.15.125:0/2189849866 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8011990 con 0x7f97e409f180 2023-10-03T10:18:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.692+0000 7f97e1ffb700 1 -- 172.21.15.125:0/2189849866 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011d20 con 0x7f97e409f180 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 -- 172.21.15.125:0/2189849866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 msgr2=0x7f97e4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 --2- 172.21.15.125:0/2189849866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 -- 172.21.15.125:0/2189849866 shutdown_connections 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 --2- 172.21.15.125:0/2189849866 >> v2:172.21.15.125:3300/0 conn(0x7f97e409e870 0x7f97e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 --2- 172.21.15.125:0/2189849866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e4131830 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 -- 172.21.15.125:0/2189849866 >> 172.21.15.125:0/2189849866 conn(0x7f97e40a4430 msgr2=0x7f97e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 -- 172.21.15.125:0/2189849866 shutdown_connections 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.693+0000 7f97e94a5700 1 -- 172.21.15.125:0/2189849866 wait complete. 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 Processor -- start 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 -- start start 2023-10-03T10:18:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 0x7f97e411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e411f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4131d70 0x7f97e411fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4121da0 con 0x7f97e4131d70 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4122db0 con 0x7f97e409f180 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e94a5700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41228a0 con 0x7f97e409e870 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e411f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e2ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 0x7f97e411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e27fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e411f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42740/0 (socket says 172.21.15.125:42740) 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e27fc700 1 -- 172.21.15.125:0/624626487 learned_addr learned my addr 172.21.15.125:0/624626487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.694+0000 7f97e37fe700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4131d70 0x7f97e411fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 -- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 msgr2=0x7f97e411f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e411f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 -- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4131d70 msgr2=0x7f97e411fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4131d70 0x7f97e411fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 -- 172.21.15.125:0/624626487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40094a0 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e2ffd700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 0x7f97e411f2e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e930 tx=0x7f97d400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4013680 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d40137e0 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4013b90 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.695+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e4130660 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.696+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d4013cf0 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.696+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97d403f640 con 0x7f97e409e870 2023-10-03T10:18:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.696+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e411be60 con 0x7f97e409e870 2023-10-03T10:18:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.701+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d4017020 con 0x7f97e409e870 2023-10-03T10:18:46.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.746+0000 7f58137a7700 1 Processor -- start 2023-10-03T10:18:46.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.746+0000 7f58137a7700 1 -- start start 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f58137a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f58137a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f58137a7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c099a60 con 0x7f580c099e20 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f58137a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c09bf50 con 0x7f580c133660 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f58137a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f580c09b230 con 0x7f580c135f80 2023-10-03T10:18:46.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5811d44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5811d44700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33138/0 (socket says 172.21.15.125:33138) 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5811d44700 1 -- 172.21.15.125:0/2163034923 learned_addr learned my addr 172.21.15.125:0/2163034923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42746/0 (socket says 172.21.15.125:42746) 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5811543700 1 --1- 172.21.15.125:0/2163034923 >> v1:172.21.15.125:6789/0 conn(0x7f580c099e20 0x7f580c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38870/0 (socket says 172.21.15.125:38870) 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 -- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 msgr2=0x7f580c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5803fff700 1 -- 172.21.15.125:0/2163034923 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875426727 0 0) 0x7f580c099a60 con 0x7f580c099e20 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 -- 172.21.15.125:0/2163034923 >> v1:172.21.15.125:6789/0 conn(0x7f580c099e20 legacy=0x7f580c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5810d42700 1 -- 172.21.15.125:0/2163034923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c09bb90 con 0x7f580c133660 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.747+0000 7f5811d44700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f5810d42700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00dc90 tx=0x7f57fc00f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fe4315add3fd8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f5803fff700 1 -- 172.21.15.125:0/2163034923 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc012070 con 0x7f580c133660 2023-10-03T10:18:46.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f5803fff700 1 -- 172.21.15.125:0/2163034923 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00d2e0 con 0x7f580c133660 2023-10-03T10:18:46.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f5803fff700 1 -- 172.21.15.125:0/2163034923 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00f8f0 con 0x7f580c133660 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 -- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 msgr2=0x7f580c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00dc90 tx=0x7f57fc00f050 comp rx=0 tx=0).stop 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 -- 172.21.15.125:0/2163034923 shutdown_connections 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 --2- 172.21.15.125:0/2163034923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c135a40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 -- 172.21.15.125:0/2163034923 >> 172.21.15.125:0/2163034923 conn(0x7f580c0a2980 msgr2=0x7f580c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 -- 172.21.15.125:0/2163034923 shutdown_connections 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.748+0000 7f58137a7700 1 -- 172.21.15.125:0/2163034923 wait complete. 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.749+0000 7f58137a7700 1 Processor -- start 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 -- start start 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580c099e20 0x7f580c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c133ac0 con 0x7f580c099e20 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c09b470 con 0x7f580c133660 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f58137a7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f580c119f70 con 0x7f580c135f80 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f5810d42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f5810d42700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42754/0 (socket says 172.21.15.125:42754) 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f5810d42700 1 -- 172.21.15.125:0/2912998575 learned_addr learned my addr 172.21.15.125:0/2912998575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f5811543700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580c099e20 0x7f580c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.750+0000 7f5811d44700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 -- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 msgr2=0x7f580c070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 -- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580c099e20 msgr2=0x7f580c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580c099e20 0x7f580c0700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 -- 172.21.15.125:0/2912998575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580400bb50 con 0x7f580c133660 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5810d42700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00dc60 tx=0x7f57fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc010d80 con 0x7f580c133660 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0036a0 con 0x7f580c133660 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc00d940 con 0x7f580c133660 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc010ee0 con 0x7f580c133660 2023-10-03T10:18:46.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.751+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c1190c0 con 0x7f580c133660 2023-10-03T10:18:46.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.752+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57fc003a50 con 0x7f580c133660 2023-10-03T10:18:46.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.752+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57fc0445f0 con 0x7f580c133660 2023-10-03T10:18:46.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.752+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c072480 con 0x7f580c133660 2023-10-03T10:18:46.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.757+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f580c072480 con 0x7f580c133660 2023-10-03T10:18:46.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.891+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97e404f2a0 con 0x7f97e409e870 2023-10-03T10:18:46.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.891+0000 7f97cb7fe700 1 -- 172.21.15.125:0/624626487 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97d401b820 con 0x7f97e409e870 2023-10-03T10:18:46.892 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:46.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 msgr2=0x7f97e411f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 0x7f97e411f2e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e930 tx=0x7f97d400ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:46.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 shutdown_connections 2023-10-03T10:18:46.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97e4131d70 0x7f97e411fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f97e409e870 0x7f97e411f2e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 --2- 172.21.15.125:0/624626487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97e409f180 0x7f97e411f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 >> 172.21.15.125:0/624626487 conn(0x7f97e40a4430 msgr2=0x7f97e4131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 shutdown_connections 2023-10-03T10:18:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.894+0000 7f97e94a5700 1 -- 172.21.15.125:0/624626487 wait complete. 2023-10-03T10:18:46.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:46.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.947+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f580c072480 con 0x7f580c133660 2023-10-03T10:18:46.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.947+0000 7f5801ffb700 1 -- 172.21.15.125:0/2912998575 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f580c072480 con 0x7f580c133660 2023-10-03T10:18:46.947 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 msgr2=0x7f580c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00dc60 tx=0x7f57fc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 shutdown_connections 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f580c135f80 0x7f580c070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580c099e20 0x7f580c0700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 --2- 172.21.15.125:0/2912998575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f580c133660 0x7f580c070600 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 >> 172.21.15.125:0/2912998575 conn(0x7f580c0a2980 msgr2=0x7f580c1324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 shutdown_connections 2023-10-03T10:18:46.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:46.949+0000 7f58137a7700 1 -- 172.21.15.125:0/2912998575 wait complete. 2023-10-03T10:18:46.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:47.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:47.572 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:47.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.586+0000 7f2705cb8700 1 Processor -- start 2023-10-03T10:18:47.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.586+0000 7f2705cb8700 1 -- start start 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f2705cb8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 0x7f2700133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f2705cb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f2705cb8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270006b2d0 con 0x7f27001300a0 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f2705cb8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700133610 con 0x7f2700133ad0 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f2705cb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270009a500 con 0x7f2700130bc0 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26ff7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 0x7f2700133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33168/0 (socket says 172.21.15.125:33168) 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 -- 172.21.15.125:0/548438118 learned_addr learned my addr 172.21.15.125:0/548438118 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 -- 172.21.15.125:0/548438118 >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 msgr2=0x7f2700133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 --2- 172.21.15.125:0/548438118 >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 0x7f2700133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 -- 172.21.15.125:0/548438118 >> v1:172.21.15.125:6789/0 conn(0x7f27001300a0 legacy=0x7f27001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 -- 172.21.15.125:0/548438118 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27001338b0 con 0x7f2700130bc0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fe7fc700 1 -- 172.21.15.125:0/548438118 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296981145 0 0) 0x7f270006b2d0 con 0x7f27001300a0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26ff7fe700 1 --2- 172.21.15.125:0/548438118 >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 0x7f2700133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.587+0000 7f26fffff700 1 --2- 172.21.15.125:0/548438118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63375aa28163087d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f26fe7fc700 1 -- 172.21.15.125:0/548438118 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800e070 con 0x7f2700130bc0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f26fe7fc700 1 -- 172.21.15.125:0/548438118 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f800b910 con 0x7f2700130bc0 2023-10-03T10:18:47.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f26fe7fc700 1 -- 172.21.15.125:0/548438118 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800bcc0 con 0x7f2700130bc0 2023-10-03T10:18:47.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 -- 172.21.15.125:0/548438118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 msgr2=0x7f270013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 --2- 172.21.15.125:0/548438118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 -- 172.21.15.125:0/548438118 shutdown_connections 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 --2- 172.21.15.125:0/548438118 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f270013b990 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 --2- 172.21.15.125:0/548438118 >> v2:172.21.15.125:3300/0 conn(0x7f2700133ad0 0x7f2700133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 -- 172.21.15.125:0/548438118 >> 172.21.15.125:0/548438118 conn(0x7f2700099c40 msgr2=0x7f27000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 -- 172.21.15.125:0/548438118 shutdown_connections 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.588+0000 7f2705cb8700 1 -- 172.21.15.125:0/548438118 wait complete. 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.589+0000 7f2705cb8700 1 Processor -- start 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 -- start start 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 0x7f2700071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f27000718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270011e100 con 0x7f2700133ad0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270012f6f0 con 0x7f27001300a0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f2705cb8700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270012dd00 con 0x7f2700130bc0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 0x7f2700071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56170/0 (socket says 172.21.15.125:56170) 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26feffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f27000718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 -- 172.21.15.125:0/691051053 learned_addr learned my addr 172.21.15.125:0/691051053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 -- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 msgr2=0x7f27000718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f27000718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 -- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 msgr2=0x7f2700071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 0x7f2700071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26fffff700 1 -- 172.21.15.125:0/691051053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00094a0 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.590+0000 7f26ff7fe700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 0x7f2700071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f26fffff700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f26f800b680 tx=0x7f26f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80048b0 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f80092e0 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f8009b30 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f801c660 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270011f960 con 0x7f2700133ad0 2023-10-03T10:18:47.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.591+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26f801c7c0 con 0x7f2700133ad0 2023-10-03T10:18:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.592+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26f8041250 con 0x7f2700133ad0 2023-10-03T10:18:47.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.592+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270009cb20 con 0x7f2700133ad0 2023-10-03T10:18:47.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.597+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26f802d940 con 0x7f2700133ad0 2023-10-03T10:18:47.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 Processor -- start 2023-10-03T10:18:47.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 -- start start 2023-10-03T10:18:47.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb22c131f40 0x7fb22c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c09c970 con 0x7fb22c09f180 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c0a0920 con 0x7fb22c131f40 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb233538700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c09f9c0 con 0x7fb22c09e870 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb231ad5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb22c131f40 0x7fb22c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb2312d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb231ad5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb22c131f40 0x7fb22c139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56176/0 (socket says 172.21.15.125:56176) 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb230ad3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb22c09f180 0x7fb22c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38886/0 (socket says 172.21.15.125:38886) 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb231ad5700 1 -- 172.21.15.125:0/3632075638 learned_addr learned my addr 172.21.15.125:0/3632075638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.697+0000 7fb2312d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33178/0 (socket says 172.21.15.125:33178) 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb231ad5700 1 -- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 msgr2=0x7fb22c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb231ad5700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb231ad5700 1 -- 172.21.15.125:0/3632075638 >> v1:172.21.15.125:6789/0 conn(0x7fb22c09f180 legacy=0x7fb22c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb231ad5700 1 -- 172.21.15.125:0/3632075638 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c09bab0 con 0x7fb22c131f40 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb2312d4700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb231ad5700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c131f40 0x7fb22c139ca0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fb224009e50 tx=0x7fb22400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bada2319a323f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb223fff700 1 -- 172.21.15.125:0/3632075638 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22400e070 con 0x7fb22c131f40 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb223fff700 1 -- 172.21.15.125:0/3632075638 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22400b910 con 0x7fb22c131f40 2023-10-03T10:18:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb223fff700 1 -- 172.21.15.125:0/3632075638 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22400bcc0 con 0x7fb22c131f40 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb233538700 1 -- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c131f40 msgr2=0x7fb22c139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.698+0000 7fb233538700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c131f40 0x7fb22c139ca0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fb224009e50 tx=0x7fb22400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 -- 172.21.15.125:0/3632075638 shutdown_connections 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c131f40 0x7fb22c139ca0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 --2- 172.21.15.125:0/3632075638 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 -- 172.21.15.125:0/3632075638 >> 172.21.15.125:0/3632075638 conn(0x7fb22c0a4430 msgr2=0x7fb22c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 -- 172.21.15.125:0/3632075638 shutdown_connections 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 -- 172.21.15.125:0/3632075638 wait complete. 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.699+0000 7fb233538700 1 Processor -- start 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 -- start start 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c1201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb22c131f40 0x7fb22c120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1216a0 con 0x7fb22c09f180 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1315a0 con 0x7fb22c131f40 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb233538700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c122c70 con 0x7fb22c09e870 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb230ad3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c1201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb231ad5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb22c131f40 0x7fb22c120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb230ad3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56190/0 (socket says 172.21.15.125:56190) 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb230ad3700 1 -- 172.21.15.125:0/234604778 learned_addr learned my addr 172.21.15.125:0/234604778 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 -- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb22c131f40 msgr2=0x7fb22c120c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb22c131f40 0x7fb22c120c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 -- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 msgr2=0x7fb22c120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 -- 172.21.15.125:0/234604778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094a0 con 0x7fb22c09e870 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb230ad3700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.700+0000 7fb2312d4700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c1201d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e930 tx=0x7fb22800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.701+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228013680 con 0x7fb22c09e870 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.701+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280137e0 con 0x7fb22c09e870 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.701+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224009b30 con 0x7fb22c09e870 2023-10-03T10:18:47.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.701+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228013b90 con 0x7fb22c09e870 2023-10-03T10:18:47.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.701+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c09dba0 con 0x7fb22c09e870 2023-10-03T10:18:47.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.702+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb228013cf0 con 0x7fb22c09e870 2023-10-03T10:18:47.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.702+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb22803f640 con 0x7fb22c09e870 2023-10-03T10:18:47.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.702+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c11d580 con 0x7fb22c09e870 2023-10-03T10:18:47.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.706+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb228017020 con 0x7fb22c09e870 2023-10-03T10:18:47.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.791+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f270004f2a0 con 0x7f2700133ad0 2023-10-03T10:18:47.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.791+0000 7f26e7fff700 1 -- 172.21.15.125:0/691051053 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26f802d350 con 0x7f2700133ad0 2023-10-03T10:18:47.792 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 msgr2=0x7f2700071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f26f800b680 tx=0x7f26f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 shutdown_connections 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700133ad0 0x7f2700071df0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27001300a0 0x7f2700071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 --2- 172.21.15.125:0/691051053 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f2700130bc0 0x7f27000718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 >> 172.21.15.125:0/691051053 conn(0x7f2700099c40 msgr2=0x7f2700132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 shutdown_connections 2023-10-03T10:18:47.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.793+0000 7f2705cb8700 1 -- 172.21.15.125:0/691051053 wait complete. 2023-10-03T10:18:47.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:47.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.897+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb22c04f2a0 con 0x7fb22c09e870 2023-10-03T10:18:47.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.897+0000 7fb221ffb700 1 -- 172.21.15.125:0/234604778 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb22801b820 con 0x7fb22c09e870 2023-10-03T10:18:47.897 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:47.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 msgr2=0x7fb22c1201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c1201d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e930 tx=0x7fb22800ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 shutdown_connections 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb22c131f40 0x7fb22c120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb22c09e870 0x7fb22c1201d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 --2- 172.21.15.125:0/234604778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb22c09f180 0x7fb22c120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 >> 172.21.15.125:0/234604778 conn(0x7fb22c0a4430 msgr2=0x7fb22c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 shutdown_connections 2023-10-03T10:18:47.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:47.899+0000 7fb233538700 1 -- 172.21.15.125:0/234604778 wait complete. 2023-10-03T10:18:47.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:47.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:47.962 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:48.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 Processor -- start 2023-10-03T10:18:48.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 -- start start 2023-10-03T10:18:48.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a1380 0x7f491c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c09dc00 con 0x7f491c133f50 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c09ea60 con 0x7f491c0a0a70 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.032+0000 7f4922c49700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f491c09dec0 con 0x7f491c0a1380 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f491bfff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a1380 0x7f491c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42778/0 (socket says 172.21.15.125:42778) 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49211e6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f491c133f50 0x7f491c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38890/0 (socket says 172.21.15.125:38890) 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 -- 172.21.15.125:0/3856934064 learned_addr learned my addr 172.21.15.125:0/3856934064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f491b7fe700 1 -- 172.21.15.125:0/3856934064 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117980310 0 0) 0x7f491c09dc00 con 0x7f491c133f50 2023-10-03T10:18:48.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 -- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a1380 msgr2=0x7f491c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 --2- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a1380 0x7f491c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 -- 172.21.15.125:0/3856934064 >> v1:172.21.15.125:6789/0 conn(0x7f491c133f50 legacy=0x7f491c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 -- 172.21.15.125:0/3856934064 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c09e6a0 con 0x7f491c0a0a70 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f49209e5700 1 --2- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4910009920 tx=0x7f4910009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c7b16b1b83b3fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f491b7fe700 1 -- 172.21.15.125:0/3856934064 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910011830 con 0x7f491c0a0a70 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f491b7fe700 1 -- 172.21.15.125:0/3856934064 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910011990 con 0x7f491c0a0a70 2023-10-03T10:18:48.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.033+0000 7f491b7fe700 1 -- 172.21.15.125:0/3856934064 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910011d20 con 0x7f491c0a0a70 2023-10-03T10:18:48.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 -- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 msgr2=0x7f491c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 --2- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4910009920 tx=0x7f4910009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 -- 172.21.15.125:0/3856934064 shutdown_connections 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 --2- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a0a70 0x7f491c0a0e40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 --2- 172.21.15.125:0/3856934064 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a1380 0x7f491c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 -- 172.21.15.125:0/3856934064 >> 172.21.15.125:0/3856934064 conn(0x7f491c0a6610 msgr2=0x7f491c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 -- 172.21.15.125:0/3856934064 shutdown_connections 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.034+0000 7f4922c49700 1 -- 172.21.15.125:0/3856934064 wait complete. 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.035+0000 7f4922c49700 1 Processor -- start 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.035+0000 7f4922c49700 1 -- start start 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f491c133f50 0x7f491c11f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c133b30 con 0x7f491c133f50 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1226c0 con 0x7f491c0a1380 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f491c120fd0 con 0x7f491c0a0a70 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f491bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33198/0 (socket says 172.21.15.125:33198) 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 -- 172.21.15.125:0/99761443 learned_addr learned my addr 172.21.15.125:0/99761443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f491bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42780/0 (socket says 172.21.15.125:42780) 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49211e6700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f491c133f50 0x7f491c11f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 -- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 msgr2=0x7f491c11f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 -- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f491c133f50 msgr2=0x7f491c11f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f491c133f50 0x7f491c11f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 -- 172.21.15.125:0/99761443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910009550 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f491bfff700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49209e5700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4910000c00 tx=0x7f4910004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910004450 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49100045b0 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100038c0 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.036+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c09c9c0 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.037+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c1223e0 con 0x7f491c0a0a70 2023-10-03T10:18:48.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.037+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4910003a20 con 0x7f491c0a0a70 2023-10-03T10:18:48.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.037+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4910021030 con 0x7f491c0a0a70 2023-10-03T10:18:48.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.038+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c04f2a0 con 0x7f491c0a0a70 2023-10-03T10:18:48.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.042+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4910015080 con 0x7f491c0a0a70 2023-10-03T10:18:48.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.088+0000 7f726b5f7700 1 Processor -- start 2023-10-03T10:18:48.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 -- start start 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 0x7f7264133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726406b2d0 con 0x7f72641309f0 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7264133610 con 0x7f7264133ad0 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f726b5f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726409a500 con 0x7f72641300a0 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42786/0 (socket says 172.21.15.125:42786) 2023-10-03T10:18:48.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 -- 172.21.15.125:0/2763109951 learned_addr learned my addr 172.21.15.125:0/2763109951 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7269393700 1 --2- 172.21.15.125:0/2763109951 >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 0x7f7264133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 -- 172.21.15.125:0/2763109951 >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 msgr2=0x7f7264133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 --2- 172.21.15.125:0/2763109951 >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 0x7f7264133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 -- 172.21.15.125:0/2763109951 >> v1:172.21.15.125:6789/0 conn(0x7f72641309f0 legacy=0x7f726413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f7268b92700 1 -- 172.21.15.125:0/2763109951 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72641338b0 con 0x7f72641300a0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.089+0000 7f725bfff700 1 -- 172.21.15.125:0/2763109951 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823553438 0 0) 0x7f726406b2d0 con 0x7f72641309f0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f7269393700 1 --2- 172.21.15.125:0/2763109951 >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 0x7f7264133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f7268b92700 1 --2- 172.21.15.125:0/2763109951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f72540098f0 tx=0x7f7254009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5acf586a5e0e12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f725bfff700 1 -- 172.21.15.125:0/2763109951 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011830 con 0x7f72641300a0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f725bfff700 1 -- 172.21.15.125:0/2763109951 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254011990 con 0x7f72641300a0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f725bfff700 1 -- 172.21.15.125:0/2763109951 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011d20 con 0x7f72641300a0 2023-10-03T10:18:48.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 -- 172.21.15.125:0/2763109951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 msgr2=0x7f72641304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 --2- 172.21.15.125:0/2763109951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f72540098f0 tx=0x7f7254009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 -- 172.21.15.125:0/2763109951 shutdown_connections 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 --2- 172.21.15.125:0/2763109951 >> v2:172.21.15.125:3300/0 conn(0x7f7264133ad0 0x7f7264133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 --2- 172.21.15.125:0/2763109951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641300a0 0x7f72641304b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.090+0000 7f726b5f7700 1 -- 172.21.15.125:0/2763109951 >> 172.21.15.125:0/2763109951 conn(0x7f7264099c40 msgr2=0x7f72640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.091+0000 7f726b5f7700 1 -- 172.21.15.125:0/2763109951 shutdown_connections 2023-10-03T10:18:48.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.091+0000 7f726b5f7700 1 -- 172.21.15.125:0/2763109951 wait complete. 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.091+0000 7f726b5f7700 1 Processor -- start 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.091+0000 7f726b5f7700 1 -- start start 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72641300a0 0x7f72641c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641309f0 0x7f72641c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72640721a0 con 0x7f7264133ad0 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726411fc80 con 0x7f72641309f0 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f726b5f7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72640a3400 con 0x7f72641300a0 2023-10-03T10:18:48.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56216/0 (socket says 172.21.15.125:56216) 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269393700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72641300a0 0x7f72641c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 -- 172.21.15.125:0/3261687301 learned_addr learned my addr 172.21.15.125:0/3261687301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7268b92700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641309f0 0x7f72641c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 -- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72641300a0 msgr2=0x7f72641c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72641300a0 0x7f72641c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 -- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641309f0 msgr2=0x7f72641c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641309f0 0x7f72641c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 -- 172.21.15.125:0/3261687301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600094a0 con 0x7f7264133ad0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.092+0000 7f7269b94700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f725c001560 tx=0x7f725c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c003e30 con 0x7f7264133ad0 2023-10-03T10:18:48.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c005070 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c005420 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254009550 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726411ff40 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.093+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f725c005580 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.094+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f725c040d10 con 0x7f7264133ad0 2023-10-03T10:18:48.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.094+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72640a2620 con 0x7f7264133ad0 2023-10-03T10:18:48.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.098+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f725c017070 con 0x7f7264133ad0 2023-10-03T10:18:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.236+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f491c09c440 con 0x7f491c0a0a70 2023-10-03T10:18:48.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.236+0000 7f49197fa700 1 -- 172.21.15.125:0/99761443 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f491001a430 con 0x7f491c0a0a70 2023-10-03T10:18:48.236 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 msgr2=0x7f491c11eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4910000c00 tx=0x7f4910004750 comp rx=0 tx=0).stop 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 shutdown_connections 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f491c133f50 0x7f491c11f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f491c0a0a70 0x7f491c11eba0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 --2- 172.21.15.125:0/99761443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f491c0a1380 0x7f491c11f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 >> 172.21.15.125:0/99761443 conn(0x7f491c0a6610 msgr2=0x7f491c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 shutdown_connections 2023-10-03T10:18:48.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.238+0000 7f4922c49700 1 -- 172.21.15.125:0/99761443 wait complete. 2023-10-03T10:18:48.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:48.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.292+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f726404f2a0 con 0x7f7264133ad0 2023-10-03T10:18:48.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.292+0000 7f7259ffb700 1 -- 172.21.15.125:0/3261687301 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f725c017020 con 0x7f7264133ad0 2023-10-03T10:18:48.293 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 msgr2=0x7f72641c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f725c001560 tx=0x7f725c00cb50 comp rx=0 tx=0).stop 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 shutdown_connections 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7264133ad0 0x7f72641c91d0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f72641300a0 0x7f72641c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 --2- 172.21.15.125:0/3261687301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72641309f0 0x7f72641c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 >> 172.21.15.125:0/3261687301 conn(0x7f7264099c40 msgr2=0x7f7264132a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 shutdown_connections 2023-10-03T10:18:48.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.294+0000 7f726b5f7700 1 -- 172.21.15.125:0/3261687301 wait complete. 2023-10-03T10:18:48.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:48.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:48.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.935+0000 7f9fbd82b700 1 Processor -- start 2023-10-03T10:18:48.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 -- start start 2023-10-03T10:18:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 0x7f9fb81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb81356e0 0x7f9fb8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80a1e70 con 0x7f9fb80a0a30 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809a720 con 0x7f9fb81356e0 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fbd82b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809b300 con 0x7f9fb80a1510 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fb67fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 0x7f9fb81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb81356e0 0x7f9fb8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fb6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9fb80a0a30 0x7f9fb80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38922/0 (socket says 172.21.15.125:38922) 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.936+0000 7f9fb6ffd700 1 -- 172.21.15.125:0/2601483954 learned_addr learned my addr 172.21.15.125:0/2601483954 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb5ffb700 1 -- 172.21.15.125:0/2601483954 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511182179 0 0) 0x7f9fb80a1e70 con 0x7f9fb80a0a30 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb81356e0 msgr2=0x7f9fb8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb67fc700 1 --2- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb81356e0 0x7f9fb8137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2601483954 >> v1:172.21.15.125:6789/0 conn(0x7f9fb80a0a30 legacy=0x7f9fb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2601483954 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb809abc0 con 0x7f9fb80a1510 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb67fc700 1 --2- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 0x7f9fb81351a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009870 tx=0x7f9fac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38477a5ad846ac55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb5ffb700 1 -- 172.21.15.125:0/2601483954 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011830 con 0x7f9fb80a1510 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb5ffb700 1 -- 172.21.15.125:0/2601483954 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac011990 con 0x7f9fb80a1510 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.937+0000 7f9fb5ffb700 1 -- 172.21.15.125:0/2601483954 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011d20 con 0x7f9fb80a1510 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 msgr2=0x7f9fb81351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 0x7f9fb81351a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009870 tx=0x7f9fac009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2601483954 shutdown_connections 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb81356e0 0x7f9fb8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2601483954 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb80a1510 0x7f9fb81351a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2601483954 >> 172.21.15.125:0/2601483954 conn(0x7f9fb80a2980 msgr2=0x7f9fb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2601483954 shutdown_connections 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.938+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2601483954 wait complete. 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 Processor -- start 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 -- start start 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 0x7f9fb81c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8135590 con 0x7f9fb80a1510 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8134be0 con 0x7f9fb80a0a30 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.939+0000 7f9fbd82b700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809ae00 con 0x7f9fb81356e0 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 0x7f9fb81c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42828/0 (socket says 172.21.15.125:42828) 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56228/0 (socket says 172.21.15.125:56228) 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb6ffd700 1 -- 172.21.15.125:0/2057593736 learned_addr learned my addr 172.21.15.125:0/2057593736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 msgr2=0x7f9fb81c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 0x7f9fb81c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 msgr2=0x7f9fb80711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 -- 172.21.15.125:0/2057593736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0094a0 con 0x7f9fb80a1510 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb77fe700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 0x7f9fb81c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb6ffd700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fb67fc700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9fac016000 tx=0x7f9fac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac004550 con 0x7f9fb80a1510 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac01f070 con 0x7f9fb80a1510 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0038e0 con 0x7f9fb80a1510 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb806f180 con 0x7f9fb80a1510 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.940+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8071c40 con 0x7f9fb80a1510 2023-10-03T10:18:48.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.941+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8071e30 con 0x7f9fb80a1510 2023-10-03T10:18:48.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.942+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fac003a40 con 0x7f9fb80a1510 2023-10-03T10:18:48.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.942+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9fac021070 con 0x7f9fb80a1510 2023-10-03T10:18:48.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:48.950+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fac01a430 con 0x7f9fb80a1510 2023-10-03T10:18:49.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.048+0000 7f24dbc26700 1 Processor -- start 2023-10-03T10:18:49.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.048+0000 7f24dbc26700 1 -- start start 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24dbc26700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 0x7f24d4138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24dbc26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24dbc26700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d406bec0 con 0x7f24d409e870 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24dbc26700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d406ce60 con 0x7f24d409f350 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24dbc26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24d409fa00 con 0x7f24d4139480 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24da1c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d99c2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f24d409e870 0x7f24d409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38926/0 (socket says 172.21.15.125:38926) 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d91c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 0x7f24d4138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d99c2700 1 -- 172.21.15.125:0/1894178700 learned_addr learned my addr 172.21.15.125:0/1894178700 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d89c0700 1 -- 172.21.15.125:0/1894178700 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445803775 0 0) 0x7f24d406bec0 con 0x7f24d409e870 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d89c0700 1 -- 172.21.15.125:0/1894178700 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c00035b0 con 0x7f24d409e870 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24da1c3700 1 -- 172.21.15.125:0/1894178700 >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 msgr2=0x7f24d4138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24da1c3700 1 --2- 172.21.15.125:0/1894178700 >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 0x7f24d4138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24da1c3700 1 -- 172.21.15.125:0/1894178700 >> v1:172.21.15.125:6789/0 conn(0x7f24d409e870 legacy=0x7f24d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24da1c3700 1 -- 172.21.15.125:0/1894178700 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d409ad80 con 0x7f24d4139480 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.049+0000 7f24d91c1700 1 --2- 172.21.15.125:0/1894178700 >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 0x7f24d4138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24da1c3700 1 --2- 172.21.15.125:0/1894178700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d413b860 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009d90 tx=0x7f24cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c61f28ab36f5713 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24d89c0700 1 -- 172.21.15.125:0/1894178700 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00e070 con 0x7f24d4139480 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24d89c0700 1 -- 172.21.15.125:0/1894178700 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc00bb20 con 0x7f24d4139480 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24d89c0700 1 -- 172.21.15.125:0/1894178700 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc012430 con 0x7f24d4139480 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 -- 172.21.15.125:0/1894178700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 msgr2=0x7f24d413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1894178700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d413b860 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009d90 tx=0x7f24cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 -- 172.21.15.125:0/1894178700 shutdown_connections 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1894178700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d413b860 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1894178700 >> v2:172.21.15.125:3300/0 conn(0x7f24d409f350 0x7f24d4138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 -- 172.21.15.125:0/1894178700 >> 172.21.15.125:0/1894178700 conn(0x7f24d40a4430 msgr2=0x7f24d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 -- 172.21.15.125:0/1894178700 shutdown_connections 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.050+0000 7f24dbc26700 1 -- 172.21.15.125:0/1894178700 wait complete. 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.051+0000 7f24dbc26700 1 Processor -- start 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.051+0000 7f24dbc26700 1 -- start start 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24d409e870 0x7f24d4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d41c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4122670 con 0x7f24d409f350 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4120960 con 0x7f24d409e870 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40a1640 con 0x7f24d4139480 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56244/0 (socket says 172.21.15.125:56244) 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 -- 172.21.15.125:0/1795944200 learned_addr learned my addr 172.21.15.125:0/1795944200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d99c2700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24d409e870 0x7f24d4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24da1c3700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d41c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 -- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 msgr2=0x7f24d41c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d41c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 -- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24d409e870 msgr2=0x7f24d4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24d409e870 0x7f24d4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 -- 172.21.15.125:0/1795944200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40094a0 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24d91c1700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f24c400ebe0 tx=0x7f24c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400c850 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c400c9b0 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc009a70 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400cd40 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.052+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d4123060 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.053+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24c4013470 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.053+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f24c403f710 con 0x7f24d409f350 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.053+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d41211b0 con 0x7f24d409f350 2023-10-03T10:18:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.058+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24c4021020 con 0x7f24d409f350 2023-10-03T10:18:49.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.152+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fb804f2a0 con 0x7f9fb80a1510 2023-10-03T10:18:49.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.152+0000 7f9f9ffff700 1 -- 172.21.15.125:0/2057593736 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fac034090 con 0x7f9fb80a1510 2023-10-03T10:18:49.153 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:49.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 msgr2=0x7f9fb8071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9fac016000 tx=0x7f9fac004750 comp rx=0 tx=0).stop 2023-10-03T10:18:49.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 shutdown_connections 2023-10-03T10:18:49.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9fb81356e0 0x7f9fb81c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fb80a0a30 0x7f9fb80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 --2- 172.21.15.125:0/2057593736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fb80a1510 0x7f9fb8071700 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 >> 172.21.15.125:0/2057593736 conn(0x7f9fb80a2980 msgr2=0x7f9fb8131210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 shutdown_connections 2023-10-03T10:18:49.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.155+0000 7f9fbd82b700 1 -- 172.21.15.125:0/2057593736 wait complete. 2023-10-03T10:18:49.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:49.252 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:49.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.254+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24d406d840 con 0x7f24d409f350 2023-10-03T10:18:49.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.254+0000 7f24ca7fc700 1 -- 172.21.15.125:0/1795944200 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24c4021020 con 0x7f24d409f350 2023-10-03T10:18:49.255 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:49.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 msgr2=0x7f24d4134210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f24c400ebe0 tx=0x7f24c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 shutdown_connections 2023-10-03T10:18:49.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f24d4139480 0x7f24d41c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f24d409e870 0x7f24d4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 --2- 172.21.15.125:0/1795944200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24d409f350 0x7f24d4134210 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.256+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 >> 172.21.15.125:0/1795944200 conn(0x7f24d40a4430 msgr2=0x7f24d4136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.257+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 shutdown_connections 2023-10-03T10:18:49.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.257+0000 7f24dbc26700 1 -- 172.21.15.125:0/1795944200 wait complete. 2023-10-03T10:18:49.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:49.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.377+0000 7fdfd8f5a700 1 Processor -- start 2023-10-03T10:18:49.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.377+0000 7fdfd8f5a700 1 -- start start 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd8f5a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdfd40a1550 0x7fdfd4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd8f5a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd8f5a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd409e9d0 con 0x7fdfd40a0a70 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd8f5a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd409dc00 con 0x7fdfd40a1550 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd8f5a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd409dec0 con 0x7fdfd4139200 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdfd40a1550 0x7fdfd4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdfd40a0a70 0x7fdfd40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38940/0 (socket says 172.21.15.125:38940) 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdfd40a1550 0x7fdfd4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56246/0 (socket says 172.21.15.125:56246) 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd259c700 1 -- 172.21.15.125:0/3090692536 learned_addr learned my addr 172.21.15.125:0/3090692536 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:49.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd2d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42836/0 (socket says 172.21.15.125:42836) 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 msgr2=0x7fdfd413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/3090692536 >> v1:172.21.15.125:6789/0 conn(0x7fdfd40a0a70 legacy=0x7fdfd40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/3090692536 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd409e6a0 con 0x7fdfd40a1550 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd159a700 1 -- 172.21.15.125:0/3090692536 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763819884 0 0) 0x7fdfd409e9d0 con 0x7fdfd40a0a70 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd2d9d700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd1d9b700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4138cc0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009840 tx=0x7fdfc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be3d370c50e6056 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd159a700 1 -- 172.21.15.125:0/3090692536 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011830 con 0x7fdfd40a1550 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd159a700 1 -- 172.21.15.125:0/3090692536 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8011990 con 0x7fdfd40a1550 2023-10-03T10:18:49.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.378+0000 7fdfd159a700 1 -- 172.21.15.125:0/3090692536 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011d20 con 0x7fdfd40a1550 2023-10-03T10:18:49.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 msgr2=0x7fdfd4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4138cc0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009840 tx=0x7fdfc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/3090692536 shutdown_connections 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/3090692536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4138cc0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/3090692536 >> 172.21.15.125:0/3090692536 conn(0x7fdfd40a6610 msgr2=0x7fdfd40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/3090692536 shutdown_connections 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.379+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/3090692536 wait complete. 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.380+0000 7fdfd8f5a700 1 Processor -- start 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.380+0000 7fdfd8f5a700 1 -- start start 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 0x7fdfd41207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd4121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4124420 con 0x7fdfd40a1550 2023-10-03T10:18:49.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40a5100 con 0x7fdfd4139200 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4123ac0 con 0x7fdfd40a0a70 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 0x7fdfd41207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56252/0 (socket says 172.21.15.125:56252) 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/1914674575 learned_addr learned my addr 172.21.15.125:0/1914674575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd2d9d700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd4121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 msgr2=0x7fdfd41207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 0x7fdfd41207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 msgr2=0x7fdfd4121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd4121270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 -- 172.21.15.125:0/1914674575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc009a70 con 0x7fdfd40a1550 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd259c700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 0x7fdfd41207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd1d9b700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80045d0 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc801f070 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc80094a0 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80038a0 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.381+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd4124030 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.382+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfc8003a00 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.382+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdfc8021070 con 0x7fdfd40a1550 2023-10-03T10:18:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.383+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd404f2a0 con 0x7fdfd40a1550 2023-10-03T10:18:49.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.387+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfc8010380 con 0x7fdfd40a1550 2023-10-03T10:18:49.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.453+0000 7f27279df700 1 Processor -- start 2023-10-03T10:18:49.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.453+0000 7f27279df700 1 -- start start 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 0x7f2720131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272009aaa0 con 0x7f272009e170 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272009f870 con 0x7f2720130ce0 2023-10-03T10:18:49.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f27279df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272009b360 con 0x7f272009d860 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2724f7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 0x7f2720131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f272577b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2724f7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56262/0 (socket says 172.21.15.125:56262) 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2724f7a700 1 -- 172.21.15.125:0/3046328700 learned_addr learned my addr 172.21.15.125:0/3046328700 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 -- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 msgr2=0x7f272009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 -- 172.21.15.125:0/3046328700 >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 msgr2=0x7f27201307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 --2- 172.21.15.125:0/3046328700 >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2725f7c700 1 -- 172.21.15.125:0/3046328700 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272009b620 con 0x7f2720130ce0 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f2724f7a700 1 --2- 172.21.15.125:0/3046328700 >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.454+0000 7f272577b700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f2725f7c700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 0x7f2720131180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2718009dc0 tx=0x7f271800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3388bd24de5153db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f2717fff700 1 -- 172.21.15.125:0/3046328700 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800e070 con 0x7f2720130ce0 2023-10-03T10:18:49.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f2717fff700 1 -- 172.21.15.125:0/3046328700 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271800bae0 con 0x7f2720130ce0 2023-10-03T10:18:49.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f2717fff700 1 -- 172.21.15.125:0/3046328700 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800be90 con 0x7f2720130ce0 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 -- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 msgr2=0x7f2720131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 0x7f2720131180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2718009dc0 tx=0x7f271800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 -- 172.21.15.125:0/3046328700 shutdown_connections 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2720130ce0 0x7f2720131180 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 --2- 172.21.15.125:0/3046328700 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 --2- 172.21.15.125:0/3046328700 >> v2:172.21.15.125:3300/0 conn(0x7f272009e170 0x7f27201307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 -- 172.21.15.125:0/3046328700 >> 172.21.15.125:0/3046328700 conn(0x7f2720099c40 msgr2=0x7f27200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 -- 172.21.15.125:0/3046328700 shutdown_connections 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.455+0000 7f27279df700 1 -- 172.21.15.125:0/3046328700 wait complete. 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.456+0000 7f27279df700 1 Processor -- start 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.456+0000 7f27279df700 1 -- start start 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272011cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 0x7f272011d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 0x7f272011d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272011e390 con 0x7f2720130ce0 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272011eaf0 con 0x7f272009e170 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272011fd40 con 0x7f272009d860 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2724f7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 0x7f272011d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272011cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2724f7a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 0x7f272011d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42868/0 (socket says 172.21.15.125:42868) 2023-10-03T10:18:49.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2724f7a700 1 -- 172.21.15.125:0/1831922594 learned_addr learned my addr 172.21.15.125:0/1831922594 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2725f7c700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 0x7f272011d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 -- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 msgr2=0x7f272011d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 0x7f272011d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 -- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 msgr2=0x7f272011d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 0x7f272011d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 -- 172.21.15.125:0/1831922594 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0094a0 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2725f7c700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 0x7f272011d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f272577b700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272011cee0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e8b0 tx=0x7f271c00ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004030 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c004190 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271000b7f0 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.457+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004520 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.458+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718009a70 con 0x7f272009d860 2023-10-03T10:18:49.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.458+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f271c0036a0 con 0x7f272009d860 2023-10-03T10:18:49.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.458+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f271c03f4a0 con 0x7f272009d860 2023-10-03T10:18:49.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.459+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27200a0660 con 0x7f272009d860 2023-10-03T10:18:49.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.463+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271c003950 con 0x7f272009d860 2023-10-03T10:18:49.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.603+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdfd4122bf0 con 0x7fdfd40a1550 2023-10-03T10:18:49.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.604+0000 7fdfc2ffd700 1 -- 172.21.15.125:0/1914674575 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfc802eb90 con 0x7fdfd40a1550 2023-10-03T10:18:49.604 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 msgr2=0x7fdfd4120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 shutdown_connections 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfd4139200 0x7fdfd4121270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fdfd40a0a70 0x7fdfd41207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 --2- 172.21.15.125:0/1914674575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfd40a1550 0x7fdfd4120d30 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 >> 172.21.15.125:0/1914674575 conn(0x7fdfd40a6610 msgr2=0x7fdfd40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 shutdown_connections 2023-10-03T10:18:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.606+0000 7fdfd8f5a700 1 -- 172.21.15.125:0/1914674575 wait complete. 2023-10-03T10:18:49.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:49.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.657+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f272009c8b0 con 0x7f272009d860 2023-10-03T10:18:49.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.657+0000 7f2715ffb700 1 -- 172.21.15.125:0/1831922594 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271c020020 con 0x7f272009d860 2023-10-03T10:18:49.658 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 msgr2=0x7f272011cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272011cee0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e8b0 tx=0x7f271c00ebc0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 shutdown_connections 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2720130ce0 0x7f272011d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f272009d860 0x7f272011cee0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 --2- 172.21.15.125:0/1831922594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f272009e170 0x7f272011d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 >> 172.21.15.125:0/1831922594 conn(0x7f2720099c40 msgr2=0x7f272012fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 shutdown_connections 2023-10-03T10:18:49.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:49.659+0000 7f27279df700 1 -- 172.21.15.125:0/1831922594 wait complete. 2023-10-03T10:18:49.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:50.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:50.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:50.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.298+0000 7f9dd1f35700 1 Processor -- start 2023-10-03T10:18:50.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.298+0000 7f9dd1f35700 1 -- start start 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dd1f35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dd1f35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 0x7f9dcc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dd1f35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc09c970 con 0x7f9dcc131d70 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dd1f35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0a0920 con 0x7f9dcc09f180 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dd1f35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc09f9c0 con 0x7f9dcc09e870 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33266/0 (socket says 172.21.15.125:33266) 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9dcc131d70 0x7f9dcc138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38942/0 (socket says 172.21.15.125:38942) 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 0x7f9dcc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcb7fe700 1 -- 172.21.15.125:0/799659217 learned_addr learned my addr 172.21.15.125:0/799659217 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dca7fc700 1 -- 172.21.15.125:0/799659217 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988951033 0 0) 0x7f9dcc09c970 con 0x7f9dcc131d70 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 -- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 msgr2=0x7f9dcc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 -- 172.21.15.125:0/799659217 >> v1:172.21.15.125:6789/0 conn(0x7f9dcc131d70 legacy=0x7f9dcc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 -- 172.21.15.125:0/799659217 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc09bab0 con 0x7f9dcc09f180 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcb7fe700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.299+0000 7f9dcaffd700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 0x7f9dcc131830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009870 tx=0x7f9dc0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6291e6a5273509c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dca7fc700 1 -- 172.21.15.125:0/799659217 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0011830 con 0x7f9dcc09f180 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dca7fc700 1 -- 172.21.15.125:0/799659217 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0011990 con 0x7f9dcc09f180 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dca7fc700 1 -- 172.21.15.125:0/799659217 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0011d20 con 0x7f9dcc09f180 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 -- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 msgr2=0x7f9dcc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 0x7f9dcc131830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009870 tx=0x7f9dc0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 -- 172.21.15.125:0/799659217 shutdown_connections 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09e870 0x7f9dcc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/799659217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09f180 0x7f9dcc131830 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 -- 172.21.15.125:0/799659217 >> 172.21.15.125:0/799659217 conn(0x7f9dcc0a4430 msgr2=0x7f9dcc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 -- 172.21.15.125:0/799659217 shutdown_connections 2023-10-03T10:18:50.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.300+0000 7f9dd1f35700 1 -- 172.21.15.125:0/799659217 wait complete. 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.301+0000 7f9dd1f35700 1 Processor -- start 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.301+0000 7f9dd1f35700 1 -- start start 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 0x7f9dcc11f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dcc131d70 0x7f9dcc11fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc120cf0 con 0x7f9dcc131d70 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc121b80 con 0x7f9dcc09e870 2023-10-03T10:18:50.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dd1f35700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc122660 con 0x7f9dcc09f180 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 0x7f9dcc11f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:42888/0 (socket says 172.21.15.125:42888) 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcb7fe700 1 -- 172.21.15.125:0/3402893942 learned_addr learned my addr 172.21.15.125:0/3402893942 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcbfff700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dcc131d70 0x7f9dcc11fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 -- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 msgr2=0x7f9dcc11f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 -- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dcc131d70 msgr2=0x7f9dcc11fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dcc131d70 0x7f9dcc11fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 -- 172.21.15.125:0/3402893942 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009550 con 0x7f9dcc09f180 2023-10-03T10:18:50.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcb7fe700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.302+0000 7f9dcaffd700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 0x7f9dcc11f620 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016000 tx=0x7f9dc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0004510 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc001f070 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc00094a0 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00038e0 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc09dba0 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.303+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dc0003a40 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.304+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc121f40 con 0x7f9dcc09f180 2023-10-03T10:18:50.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.304+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dc0021070 con 0x7f9dcc09f180 2023-10-03T10:18:50.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.312+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dc00253e0 con 0x7f9dcc09f180 2023-10-03T10:18:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.399+0000 7f21ba8ad700 1 Processor -- start 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 -- start start 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 0x7f21b406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b409da80 con 0x7f21b406b080 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b409dce0 con 0x7f21b406a770 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21ba8ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b409eb20 con 0x7f21b4131ec0 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 0x7f21b406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33296/0 (socket says 172.21.15.125:33296) 2023-10-03T10:18:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 -- 172.21.15.125:0/4285029525 learned_addr learned my addr 172.21.15.125:0/4285029525 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 -- 172.21.15.125:0/4285029525 >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 msgr2=0x7f21b406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 --2- 172.21.15.125:0/4285029525 >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 0x7f21b406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 -- 172.21.15.125:0/4285029525 >> v1:172.21.15.125:6789/0 conn(0x7f21b406b080 legacy=0x7f21b41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b8e4a700 1 -- 172.21.15.125:0/4285029525 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b409d860 con 0x7f21b4131ec0 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b2ffd700 1 -- 172.21.15.125:0/4285029525 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570031865 0 0) 0x7f21b409da80 con 0x7f21b406b080 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.400+0000 7f21b3fff700 1 --2- 172.21.15.125:0/4285029525 >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 0x7f21b406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21b8e4a700 1 --2- 172.21.15.125:0/4285029525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009e50 tx=0x7f21ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bb972a2894e77a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21b2ffd700 1 -- 172.21.15.125:0/4285029525 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00e070 con 0x7f21b4131ec0 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21b2ffd700 1 -- 172.21.15.125:0/4285029525 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00b910 con 0x7f21b4131ec0 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21b2ffd700 1 -- 172.21.15.125:0/4285029525 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00bcc0 con 0x7f21b4131ec0 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 -- 172.21.15.125:0/4285029525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 msgr2=0x7f21b4139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/4285029525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009e50 tx=0x7f21ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 -- 172.21.15.125:0/4285029525 shutdown_connections 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/4285029525 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b4131ec0 0x7f21b4139c20 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/4285029525 >> v2:172.21.15.125:3300/0 conn(0x7f21b406a770 0x7f21b406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 -- 172.21.15.125:0/4285029525 >> 172.21.15.125:0/4285029525 conn(0x7f21b4099c40 msgr2=0x7f21b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 -- 172.21.15.125:0/4285029525 shutdown_connections 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.401+0000 7f21ba8ad700 1 -- 172.21.15.125:0/4285029525 wait complete. 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.402+0000 7f21ba8ad700 1 Processor -- start 2023-10-03T10:18:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.402+0000 7f21ba8ad700 1 -- start start 2023-10-03T10:18:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b406a770 0x7f21b41c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b406b080 0x7f21b41c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b409c0a0 con 0x7f21b4131ec0 2023-10-03T10:18:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4130440 con 0x7f21b406b080 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21ba8ad700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4121390 con 0x7f21b406a770 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56292/0 (socket says 172.21.15.125:56292) 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 -- 172.21.15.125:0/3834528177 learned_addr learned my addr 172.21.15.125:0/3834528177 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b37fe700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b406b080 0x7f21b41c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b3fff700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b406a770 0x7f21b41c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 -- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b406a770 msgr2=0x7f21b41c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b406a770 0x7f21b41c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 -- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b406b080 msgr2=0x7f21b41c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b406b080 0x7f21b41c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.403+0000 7f21b8e4a700 1 -- 172.21.15.125:0/3834528177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40094a0 con 0x7f21b4131ec0 2023-10-03T10:18:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21b8e4a700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f21b409ec60 tx=0x7f21ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac003ea0 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac0048e0 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac009b30 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01c680 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b41210b0 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.404+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21ac01c7e0 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.405+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21ac0411b0 con 0x7f21b4131ec0 2023-10-03T10:18:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.405+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b4120d50 con 0x7f21b4131ec0 2023-10-03T10:18:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.409+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21b4120d50 con 0x7f21b4131ec0 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.504+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dcc11be60 con 0x7f9dcc09f180 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.504+0000 7f9db3fff700 1 -- 172.21.15.125:0/3402893942 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dc0015030 con 0x7f9dcc09f180 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:128849018883 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 msgr2=0x7f9dcc11f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 0x7f9dcc11f620 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016000 tx=0x7f9dc0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 shutdown_connections 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9dcc131d70 0x7f9dcc11fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9dcc09e870 0x7f9dcc11f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 --2- 172.21.15.125:0/3402893942 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f9dcc09f180 0x7f9dcc11f620 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 >> 172.21.15.125:0/3402893942 conn(0x7f9dcc0a4430 msgr2=0x7f9dcc131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 shutdown_connections 2023-10-03T10:18:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.506+0000 7f9dd1f35700 1 -- 172.21.15.125:0/3402893942 wait complete. 2023-10-03T10:18:50.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.0 2023-10-03T10:18:50.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.596+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21b4120d50 con 0x7f21b4131ec0 2023-10-03T10:18:50.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.596+0000 7f21b0ff9700 1 -- 172.21.15.125:0/3834528177 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b4120d50 con 0x7f21b4131ec0 2023-10-03T10:18:50.596 INFO:teuthology.orchestra.run.smithi125.stdout:133143986179 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 msgr2=0x7f21b41c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f21b409ec60 tx=0x7f21ac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 shutdown_connections 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21b4131ec0 0x7f21b41c8ab0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f21b406a770 0x7f21b41c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 --2- 172.21.15.125:0/3834528177 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21b406b080 0x7f21b41c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 >> 172.21.15.125:0/3834528177 conn(0x7f21b4099c40 msgr2=0x7f21b40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 shutdown_connections 2023-10-03T10:18:50.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.598+0000 7f21ba8ad700 1 -- 172.21.15.125:0/3834528177 wait complete. 2023-10-03T10:18:50.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:50.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:50.673 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 Processor -- start 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 -- start start 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 0x7f7e180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 0x7f7e1813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1809dc00 con 0x7f7e180a1380 2023-10-03T10:18:50.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1809ea90 con 0x7f7e180a0a70 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e1d899700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1809dec0 con 0x7f7e18134120 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e177fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 0x7f7e1813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e167fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7e180a1380 0x7f7e18133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38962/0 (socket says 172.21.15.125:38962) 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e167fc700 1 -- 172.21.15.125:0/2562445648 learned_addr learned my addr 172.21.15.125:0/2562445648 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e16ffd700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 0x7f7e180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e177fe700 1 -- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 msgr2=0x7f7e180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e177fe700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 0x7f7e180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e15ffb700 1 -- 172.21.15.125:0/2562445648 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240258344 0 0) 0x7f7e1809dc00 con 0x7f7e180a1380 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.743+0000 7f7e177fe700 1 -- 172.21.15.125:0/2562445648 >> v1:172.21.15.125:6789/0 conn(0x7f7e180a1380 legacy=0x7f7e18133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e177fe700 1 -- 172.21.15.125:0/2562445648 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1809e6a0 con 0x7f7e18134120 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e16ffd700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 0x7f7e180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e177fe700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 0x7f7e1813bce0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009dc0 tx=0x7f7e1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15906eeba482ea58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e15ffb700 1 -- 172.21.15.125:0/2562445648 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000e070 con 0x7f7e18134120 2023-10-03T10:18:50.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e15ffb700 1 -- 172.21.15.125:0/2562445648 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1000bb20 con 0x7f7e18134120 2023-10-03T10:18:50.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e15ffb700 1 -- 172.21.15.125:0/2562445648 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10012430 con 0x7f7e18134120 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 -- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 msgr2=0x7f7e1813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 0x7f7e1813bce0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009dc0 tx=0x7f7e1000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 -- 172.21.15.125:0/2562445648 shutdown_connections 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e18134120 0x7f7e1813bce0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 --2- 172.21.15.125:0/2562445648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e180a0a70 0x7f7e180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 -- 172.21.15.125:0/2562445648 >> 172.21.15.125:0/2562445648 conn(0x7f7e180a6610 msgr2=0x7f7e180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.744+0000 7f7e1d899700 1 -- 172.21.15.125:0/2562445648 shutdown_connections 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.745+0000 7f7e1d899700 1 -- 172.21.15.125:0/2562445648 wait complete. 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.745+0000 7f7e1d899700 1 Processor -- start 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 -- start start 2023-10-03T10:18:50.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e180a1380 0x7f7e18122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 0x7f7e18123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181258f0 con 0x7f7e180a1380 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18133640 con 0x7f7e18134120 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e1d899700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181262f0 con 0x7f7e180a0a70 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33324/0 (socket says 172.21.15.125:33324) 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 -- 172.21.15.125:0/4146079613 learned_addr learned my addr 172.21.15.125:0/4146079613 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e167fc700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e180a1380 0x7f7e18122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e177fe700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 0x7f7e18123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 -- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 msgr2=0x7f7e18123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 0x7f7e18123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 -- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e180a1380 msgr2=0x7f7e18122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e180a1380 0x7f7e18122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e16ffd700 1 -- 172.21.15.125:0/4146079613 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080094a0 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.746+0000 7f7e177fe700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 0x7f7e18123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7e16ffd700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800ebe0 tx=0x7f7e0800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800c850 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800c9b0 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e10009a70 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800cd40 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180a0430 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.747+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e08013470 con 0x7f7e180a0a70 2023-10-03T10:18:50.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.748+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e0803f770 con 0x7f7e180a0a70 2023-10-03T10:18:50.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.748+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e18126a60 con 0x7f7e180a0a70 2023-10-03T10:18:50.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.753+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e08013720 con 0x7f7e180a0a70 2023-10-03T10:18:50.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.797+0000 7ff59bc1f700 1 Processor -- start 2023-10-03T10:18:50.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.797+0000 7ff59bc1f700 1 -- start start 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59bc1f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff59409f350 0x7ff594136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59bc1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5941371c0 0x7ff5941395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59bc1f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59409c970 con 0x7ff59409e870 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59bc1f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940a0920 con 0x7ff59409f350 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59bc1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59409f9c0 con 0x7ff5941371c0 2023-10-03T10:18:50.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff59409f350 0x7ff594136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff59a1bc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5941371c0 0x7ff5941395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff59409f350 0x7ff594136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56314/0 (socket says 172.21.15.125:56314) 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 -- 172.21.15.125:0/3954986093 learned_addr learned my addr 172.21.15.125:0/3954986093 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 -- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5941371c0 msgr2=0x7ff5941395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 --2- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5941371c0 0x7ff5941395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 -- 172.21.15.125:0/3954986093 >> v1:172.21.15.125:6789/0 conn(0x7ff59409e870 legacy=0x7ff59409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5991ba700 1 -- 172.21.15.125:0/3954986093 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59409bab0 con 0x7ff59409f350 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.798+0000 7ff5989b9700 1 -- 172.21.15.125:0/3954986093 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707623230 0 0) 0x7ff59409c970 con 0x7ff59409e870 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff5991ba700 1 --2- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff59409f350 0x7ff594136c80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff5840098f0 tx=0x7ff584009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be7f8b0c551db09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff5989b9700 1 -- 172.21.15.125:0/3954986093 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584011830 con 0x7ff59409f350 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff5989b9700 1 -- 172.21.15.125:0/3954986093 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584011990 con 0x7ff59409f350 2023-10-03T10:18:50.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff5989b9700 1 -- 172.21.15.125:0/3954986093 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584011d20 con 0x7ff59409f350 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff59409f350 msgr2=0x7ff594136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff59409f350 0x7ff594136c80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff5840098f0 tx=0x7ff584009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3954986093 shutdown_connections 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5941371c0 0x7ff5941395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3954986093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff59409f350 0x7ff594136c80 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3954986093 >> 172.21.15.125:0/3954986093 conn(0x7ff5940a4430 msgr2=0x7ff5940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3954986093 shutdown_connections 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.799+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3954986093 wait complete. 2023-10-03T10:18:50.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.800+0000 7ff59bc1f700 1 Processor -- start 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.800+0000 7ff59bc1f700 1 -- start start 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff59409e870 0x7ff594120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff59409f350 0x7ff594120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594122310 con 0x7ff5941371c0 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59409dba0 con 0x7ff59409e870 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff594123fb0 con 0x7ff59409f350 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff5991ba700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff59409f350 0x7ff594120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56318/0 (socket says 172.21.15.125:56318) 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 -- 172.21.15.125:0/3745342082 learned_addr learned my addr 172.21.15.125:0/3745342082 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff5999bb700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff59409e870 0x7ff594120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 -- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff59409f350 msgr2=0x7ff594120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff59409f350 0x7ff594120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 -- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff59409e870 msgr2=0x7ff594120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff59409e870 0x7ff594120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 -- 172.21.15.125:0/3745342082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009550 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59a1bc700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00efc0 tx=0x7ff58c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c009ea0 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00f040 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.801+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff594124220 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.802+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00ced0 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.802+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff594122b00 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.802+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff58c014480 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.802+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff58c03fe30 con 0x7ff5941371c0 2023-10-03T10:18:50.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.802+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59404f2a0 con 0x7ff5941371c0 2023-10-03T10:18:50.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.807+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff58c018020 con 0x7ff5941371c0 2023-10-03T10:18:50.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.946+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e1804f2a0 con 0x7f7e180a0a70 2023-10-03T10:18:50.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.947+0000 7f7dfffff700 1 -- 172.21.15.125:0/4146079613 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e08021030 con 0x7f7e180a0a70 2023-10-03T10:18:50.947 INFO:teuthology.orchestra.run.smithi125.stdout:141733920770 2023-10-03T10:18:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 msgr2=0x7f7e18122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800ebe0 tx=0x7f7e0800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 shutdown_connections 2023-10-03T10:18:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e18134120 0x7f7e18123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7e180a0a70 0x7f7e18122890 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 --2- 172.21.15.125:0/4146079613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e180a1380 0x7f7e18122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.948+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 >> 172.21.15.125:0/4146079613 conn(0x7f7e180a6610 msgr2=0x7f7e1809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.949+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 shutdown_connections 2023-10-03T10:18:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.949+0000 7f7e1d899700 1 -- 172.21.15.125:0/4146079613 wait complete. 2023-10-03T10:18:50.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920770 for osd.3 2023-10-03T10:18:50.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.999+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5941238a0 con 0x7ff5941371c0 2023-10-03T10:18:50.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:50.999+0000 7ff58a7fc700 1 -- 172.21.15.125:0/3745342082 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff58c01a680 con 0x7ff5941371c0 2023-10-03T10:18:50.999 INFO:teuthology.orchestra.run.smithi125.stdout:137438953475 2023-10-03T10:18:51.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 msgr2=0x7ff594121180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00efc0 tx=0x7ff58c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 shutdown_connections 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5941371c0 0x7ff594121180 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff59409e870 0x7ff594120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 --2- 172.21.15.125:0/3745342082 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff59409f350 0x7ff594120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 >> 172.21.15.125:0/3745342082 conn(0x7ff5940a4430 msgr2=0x7ff5940a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 shutdown_connections 2023-10-03T10:18:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.001+0000 7ff59bc1f700 1 -- 172.21.15.125:0/3745342082 wait complete. 2023-10-03T10:18:51.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-10-03T10:18:51.520 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.0: 128849018883 < 128849018884 2023-10-03T10:18:51.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:18:51.520 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:18:51.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.644+0000 7f0d7fe51700 1 Processor -- start 2023-10-03T10:18:51.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.644+0000 7f0d7fe51700 1 -- start start 2023-10-03T10:18:51.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7fe51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d78138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7fe51700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d7813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7fe51700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7806b2d0 con 0x7f0d78133ad0 2023-10-03T10:18:51.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7fe51700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781345b0 con 0x7f0d78136960 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7fe51700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78133610 con 0x7f0d78139280 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d78138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7dbed700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0d78133ad0 0x7f0d78133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38986/0 (socket says 172.21.15.125:38986) 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7dbed700 1 -- 172.21.15.125:0/892091398 learned_addr learned my addr 172.21.15.125:0/892091398 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7e3ee700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d7813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 -- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 msgr2=0x7f0d7813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d7813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 -- 172.21.15.125:0/892091398 >> v1:172.21.15.125:6789/0 conn(0x7f0d78133ad0 legacy=0x7f0d78133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7cbeb700 1 -- 172.21.15.125:0/892091398 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064912373 0 0) 0x7f0d7806b2d0 con 0x7f0d78133ad0 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 -- 172.21.15.125:0/892091398 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7809a500 con 0x7f0d78136960 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7d3ec700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d78138d40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d74009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0927c15ffdae943 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7cbeb700 1 -- 172.21.15.125:0/892091398 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011830 con 0x7f0d78136960 2023-10-03T10:18:51.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7cbeb700 1 -- 172.21.15.125:0/892091398 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74011990 con 0x7f0d78136960 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.645+0000 7f0d7cbeb700 1 -- 172.21.15.125:0/892091398 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011d20 con 0x7f0d78136960 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 -- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 msgr2=0x7f0d78138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d78138d40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d74009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 -- 172.21.15.125:0/892091398 shutdown_connections 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d7813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 --2- 172.21.15.125:0/892091398 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d78138d40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 -- 172.21.15.125:0/892091398 >> 172.21.15.125:0/892091398 conn(0x7f0d78099c40 msgr2=0x7f0d780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 -- 172.21.15.125:0/892091398 shutdown_connections 2023-10-03T10:18:51.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.646+0000 7f0d7fe51700 1 -- 172.21.15.125:0/892091398 wait complete. 2023-10-03T10:18:51.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 Processor -- start 2023-10-03T10:18:51.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 -- start start 2023-10-03T10:18:51.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d78133ad0 0x7f0d78071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d780715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d78071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7812ee10 con 0x7f0d78133ad0 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781316a0 con 0x7f0d78136960 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7fe51700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780701b0 con 0x7f0d78139280 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7dbed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d78133ad0 0x7f0d78071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7e3ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d78071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7dbed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d78133ad0 0x7f0d78071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56334/0 (socket says 172.21.15.125:56334) 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7dbed700 1 -- 172.21.15.125:0/3081674512 learned_addr learned my addr 172.21.15.125:0/3081674512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7e3ee700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d78071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:33362/0 (socket says 172.21.15.125:33362) 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.647+0000 7f0d7d3ec700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d780715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 -- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 msgr2=0x7f0d78071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d78071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 -- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 msgr2=0x7f0d780715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d780715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 -- 172.21.15.125:0/3081674512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740094a0 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7d3ec700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d78136960 0x7f0d780715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7e3ee700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f0d78139280 0x7f0d78071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7dbed700 1 --2- 172.21.15.125:0/3081674512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d78133ad0 0x7f0d78071070 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c520 tx=0x7f0d6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68004c80 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68004de0 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7fe51700 1 -- 172.21.15.125:0/3081674512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7806ed70 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007310 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.648+0000 7f0d7fe51700 1 -- 172.21.15.125:0/3081674512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d78130980 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.649+0000 7f0d7fe51700 1 -- 172.21.15.125:0/3081674512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7806fe50 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.649+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d68007470 con 0x7f0d78133ad0 2023-10-03T10:18:51.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.650+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d6803f6b0 con 0x7f0d78133ad0 2023-10-03T10:18:51.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:18:51.654+0000 7f0d6e7fc700 1 -- 172.21.15.125:0/3081674512 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d680102c0 con 0x7f0d78133ad0 2023-10-03T10:20:51.556 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:20:51.557 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:20:52.936 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3ba1e34be62147e981b3101fe7613339 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:20:52.940 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:20:52.951 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-03T10:20:52.973 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:20:52.982 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:20:52.991 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-03T10:20:53.001 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T10:20:53.010 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T10:20:53.011 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:20:53.011 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:20:53.050 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:20:53.050 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:20:53.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:20:53.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 Processor -- start 2023-10-03T10:20:53.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 -- start start 2023-10-03T10:20:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe409a540 con 0x7f1fe4099920 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe409ad40 con 0x7f1fe41307c0 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1febb27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe409e640 con 0x7f1fe412feb0 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fe90c2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fe98c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fe90c2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43116/0 (socket says 172.21.15.125:43116) 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fe98c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46868/0 (socket says 172.21.15.125:46868) 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fea0c4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1fe4099920 0x7f1fe4136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35878/0 (socket says 172.21.15.125:35878) 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.250+0000 7f1fe90c2700 1 -- 172.21.15.125:0/2987082343 learned_addr learned my addr 172.21.15.125:0/2987082343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe98c3700 1 -- 172.21.15.125:0/2987082343 >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 msgr2=0x7f1fe40993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe98c3700 1 --2- 172.21.15.125:0/2987082343 >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe98c3700 1 -- 172.21.15.125:0/2987082343 >> v1:172.21.15.125:6789/0 conn(0x7f1fe4099920 legacy=0x7f1fe4136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe98c3700 1 -- 172.21.15.125:0/2987082343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe409e3c0 con 0x7f1fe412feb0 2023-10-03T10:20:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe88c1700 1 -- 172.21.15.125:0/2987082343 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348485797 0 0) 0x7f1fe409a540 con 0x7f1fe4099920 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe90c2700 1 --2- 172.21.15.125:0/2987082343 >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe98c3700 1 --2- 172.21.15.125:0/2987082343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009820 tx=0x7f1fe0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3feab68d954433e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe88c1700 1 -- 172.21.15.125:0/2987082343 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0005e30 con 0x7f1fe412feb0 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe88c1700 1 -- 172.21.15.125:0/2987082343 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0006030 con 0x7f1fe412feb0 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.251+0000 7f1fe88c1700 1 -- 172.21.15.125:0/2987082343 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00063c0 con 0x7f1fe412feb0 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 -- 172.21.15.125:0/2987082343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 msgr2=0x7f1fe4130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 --2- 172.21.15.125:0/2987082343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009820 tx=0x7f1fe0009b30 comp rx=0 tx=0).stop 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 -- 172.21.15.125:0/2987082343 shutdown_connections 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 --2- 172.21.15.125:0/2987082343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe412feb0 0x7f1fe4130280 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 --2- 172.21.15.125:0/2987082343 >> v2:172.21.15.125:3300/0 conn(0x7f1fe41307c0 0x7f1fe40993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 -- 172.21.15.125:0/2987082343 >> 172.21.15.125:0/2987082343 conn(0x7f1fe40a2b30 msgr2=0x7f1fe409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 -- 172.21.15.125:0/2987082343 shutdown_connections 2023-10-03T10:20:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.252+0000 7f1febb27700 1 -- 172.21.15.125:0/2987082343 wait complete. 2023-10-03T10:20:53.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 Processor -- start 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 -- start start 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fe412feb0 0x7f1fe413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 0x7f1fe413b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe413bca0 con 0x7f1fe41307c0 2023-10-03T10:20:53.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe406f770 con 0x7f1fe4099920 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1febb27700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe406f9e0 con 0x7f1fe412feb0 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46880/0 (socket says 172.21.15.125:46880) 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 -- 172.21.15.125:0/3167768858 learned_addr learned my addr 172.21.15.125:0/3167768858 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fea0c4700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 0x7f1fe413b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe90c2700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fe412feb0 0x7f1fe413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 -- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fe412feb0 msgr2=0x7f1fe413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fe412feb0 0x7f1fe413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 -- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 msgr2=0x7f1fe413b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.253+0000 7f1fe98c3700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 0x7f1fe413b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fe98c3700 1 -- 172.21.15.125:0/3167768858 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009550 con 0x7f1fe4099920 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fea0c4700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 0x7f1fe413b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fe98c3700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0000c00 tx=0x7f1fe0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0004240 con 0x7f1fe4099920 2023-10-03T10:20:53.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe00043a0 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0006910 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe0009430 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.254+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe413a010 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.255+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe0022070 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.255+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fe0040c90 con 0x7f1fe4099920 2023-10-03T10:20:53.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.255+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe406f5d0 con 0x7f1fe4099920 2023-10-03T10:20:53.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.259+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe406f5d0 con 0x7f1fe4099920 2023-10-03T10:20:53.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.445+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fe406f5d0 con 0x7f1fe4099920 2023-10-03T10:20:53.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.446+0000 7f1fda7fc700 1 -- 172.21.15.125:0/3167768858 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13435 (secure 0 0 0) 0x7f1fe406f5d0 con 0x7f1fe4099920 2023-10-03T10:20:53.446 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:20:53.447 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":41,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:12:30.049199+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6816/126957":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/3516620713":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/507713441":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/595985394":"2023-10-04T10:12:30.049171+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/1534821931":"2023-10-04T10:12:30.049171+0000","172.21.15.125:6817/582467044":"2023-10-04T10:11:56.371913+0000","172.21.15.125:0/3204617686":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/4213304626":"2023-10-04T10:12:30.049171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:20:53.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 msgr2=0x7f1fe413a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0000c00 tx=0x7f1fe0004750 comp rx=0 tx=0).stop 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 shutdown_connections 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe41307c0 0x7f1fe413b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe4099920 0x7f1fe413a6d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 --2- 172.21.15.125:0/3167768858 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f1fe412feb0 0x7f1fe413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 >> 172.21.15.125:0/3167768858 conn(0x7f1fe40a2b30 msgr2=0x7f1fe412f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 shutdown_connections 2023-10-03T10:20:53.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.448+0000 7f1febb27700 1 -- 172.21.15.125:0/3167768858 wait complete. 2023-10-03T10:20:53.460 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:20:53.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:20:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 Processor -- start 2023-10-03T10:20:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 -- start start 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab7809da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7809d1e0 con 0x7fab7809df90 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7809b6f0 con 0x7fab7809d680 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.585+0000 7fab7d1a1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab7809b960 con 0x7fab78130c50 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab7c9a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab7809da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab777fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fab7809df90 0x7fab78130540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35882/0 (socket says 172.21.15.125:35882) 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab7c9a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:44510/0 (socket says 172.21.15.125:44510) 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab777fe700 1 -- 172.21.15.125:0/1883584805 learned_addr learned my addr 172.21.15.125:0/1883584805 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 -- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 msgr2=0x7fab781387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 -- 172.21.15.125:0/1883584805 >> v1:172.21.15.125:6789/0 conn(0x7fab7809df90 legacy=0x7fab78130540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab76ffd700 1 -- 172.21.15.125:0/1883584805 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566241557 0 0) 0x7fab7809d1e0 con 0x7fab7809df90 2023-10-03T10:20:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 -- 172.21.15.125:0/1883584805 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7809a8d0 con 0x7fab7809d680 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab7c9a0700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab77fff700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab7809da50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009870 tx=0x7fab6c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5434b8fc51e80b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab76ffd700 1 -- 172.21.15.125:0/1883584805 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011830 con 0x7fab7809d680 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab76ffd700 1 -- 172.21.15.125:0/1883584805 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c011990 con 0x7fab7809d680 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.586+0000 7fab76ffd700 1 -- 172.21.15.125:0/1883584805 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011d20 con 0x7fab7809d680 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 -- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 msgr2=0x7fab7809da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab7809da50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009870 tx=0x7fab6c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 -- 172.21.15.125:0/1883584805 shutdown_connections 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/1883584805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab7809da50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 -- 172.21.15.125:0/1883584805 >> 172.21.15.125:0/1883584805 conn(0x7fab780a2d80 msgr2=0x7fab780a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 -- 172.21.15.125:0/1883584805 shutdown_connections 2023-10-03T10:20:53.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.587+0000 7fab7d1a1700 1 -- 172.21.15.125:0/1883584805 wait complete. 2023-10-03T10:20:53.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.588+0000 7fab7d1a1700 1 Processor -- start 2023-10-03T10:20:53.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.588+0000 7fab7d1a1700 1 -- start start 2023-10-03T10:20:53.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 0x7fab781c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab781261c0 con 0x7fab7809df90 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7811f1d0 con 0x7fab7809d680 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7d1a1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab78120680 con 0x7fab78130c50 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7c9a0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46906/0 (socket says 172.21.15.125:46906) 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 -- 172.21.15.125:0/4294711543 learned_addr learned my addr 172.21.15.125:0/4294711543 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 0x7fab781c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 -- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 msgr2=0x7fab781c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 -- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 msgr2=0x7fab781c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 0x7fab781c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 -- 172.21.15.125:0/4294711543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009a70 con 0x7fab7809d680 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab7c9a0700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab777fe700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 0x7fab781c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab77fff700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009840 tx=0x7fab6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.589+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0044d0 con 0x7fab7809d680 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c01f070 con 0x7fab7809d680 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c0094a0 con 0x7fab7809d680 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0038e0 con 0x7fab7809d680 2023-10-03T10:20:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab781203b0 con 0x7fab7809d680 2023-10-03T10:20:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab6c003a40 con 0x7fab7809d680 2023-10-03T10:20:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab6c021070 con 0x7fab7809d680 2023-10-03T10:20:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.590+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7809f540 con 0x7fab7809d680 2023-10-03T10:20:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.595+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab6c015030 con 0x7fab7809d680 2023-10-03T10:20:53.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.775+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab78125a00 con 0x7fab7809d680 2023-10-03T10:20:53.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.776+0000 7fab74ff9700 1 -- 172.21.15.125:0/4294711543 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab6c003cf0 con 0x7fab7809d680 2023-10-03T10:20:53.776 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 msgr2=0x7fab781c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009840 tx=0x7fab6c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 shutdown_connections 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fab78130c50 0x7fab781c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab7809d680 0x7fab781c8090 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 --2- 172.21.15.125:0/4294711543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab7809df90 0x7fab781c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 >> 172.21.15.125:0/4294711543 conn(0x7fab780a2d80 msgr2=0x7fab781193d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 shutdown_connections 2023-10-03T10:20:53.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.778+0000 7fab7d1a1700 1 -- 172.21.15.125:0/4294711543 wait complete. 2023-10-03T10:20:53.790 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:20:53.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.913+0000 7fde58c2a700 1 Processor -- start 2023-10-03T10:20:53.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.913+0000 7fde58c2a700 1 -- start start 2023-10-03T10:20:53.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde58c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde58c2a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5409e260 0x7fde5413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde58c2a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5409a590 con 0x7fde5409d780 2023-10-03T10:20:53.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde58c2a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5406b450 con 0x7fde5409e260 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde58c2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5406a9e0 con 0x7fde5409ad70 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5409e260 0x7fde5413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5409e260 0x7fde5413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43140/0 (socket says 172.21.15.125:43140) 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:44532/0 (socket says 172.21.15.125:44532) 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde5259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde5409d780 0x7fde5409db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35886/0 (socket says 172.21.15.125:35886) 2023-10-03T10:20:53.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 -- 172.21.15.125:0/1912970433 learned_addr learned my addr 172.21.15.125:0/1912970433 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 -- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 msgr2=0x7fde54138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 -- 172.21.15.125:0/1912970433 >> v1:172.21.15.125:6789/0 conn(0x7fde5409d780 legacy=0x7fde5409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 -- 172.21.15.125:0/1912970433 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5409a870 con 0x7fde5409e260 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde5159a700 1 -- 172.21.15.125:0/1912970433 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510781887 0 0) 0x7fde5409a590 con 0x7fde5409d780 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde51d9b700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.914+0000 7fde52d9d700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409e260 0x7fde5413b210 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009e50 tx=0x7fde4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c8467cd1fa2668 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde5159a700 1 -- 172.21.15.125:0/1912970433 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00e070 con 0x7fde5409e260 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde5159a700 1 -- 172.21.15.125:0/1912970433 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00b910 con 0x7fde5409e260 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde5159a700 1 -- 172.21.15.125:0/1912970433 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00bcc0 con 0x7fde5409e260 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 -- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409e260 msgr2=0x7fde5413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409e260 0x7fde5413b210 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009e50 tx=0x7fde4c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 -- 172.21.15.125:0/1912970433 shutdown_connections 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409e260 0x7fde5413b210 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 --2- 172.21.15.125:0/1912970433 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409ad70 0x7fde54138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 -- 172.21.15.125:0/1912970433 >> 172.21.15.125:0/1912970433 conn(0x7fde5409f980 msgr2=0x7fde5409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 -- 172.21.15.125:0/1912970433 shutdown_connections 2023-10-03T10:20:53.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.915+0000 7fde58c2a700 1 -- 172.21.15.125:0/1912970433 wait complete. 2023-10-03T10:20:53.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.916+0000 7fde58c2a700 1 Processor -- start 2023-10-03T10:20:53.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.916+0000 7fde58c2a700 1 -- start start 2023-10-03T10:20:53.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 0x7fde54119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409e260 0x7fde5411a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54137940 con 0x7fde5409ad70 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5409c710 con 0x7fde5409d780 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5411cd80 con 0x7fde5409e260 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde5259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde5259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43146/0 (socket says 172.21.15.125:43146) 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 0x7fde54119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde5259c700 1 -- 172.21.15.125:0/3957608988 learned_addr learned my addr 172.21.15.125:0/3957608988 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde52d9d700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409e260 0x7fde5411a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 -- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409e260 msgr2=0x7fde5411a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409e260 0x7fde5411a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 -- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 msgr2=0x7fde541197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 -- 172.21.15.125:0/3957608988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440094a0 con 0x7fde5409d780 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde5259c700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde51d9b700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 0x7fde54119cf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9b0 tx=0x7fde4400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400ee50 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400c850 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c009b30 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.917+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400cc00 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.918+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5411ba90 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.919+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5411ca20 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.919+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde44013470 con 0x7fde5409d780 2023-10-03T10:20:53.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.919+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde4403fee0 con 0x7fde5409d780 2023-10-03T10:20:53.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:53.923+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde44013720 con 0x7fde5409d780 2023-10-03T10:20:54.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.106+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde5411cec0 con 0x7fde5409d780 2023-10-03T10:20:54.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.106+0000 7fde42ffd700 1 -- 172.21.15.125:0/3957608988 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde5411cec0 con 0x7fde5409d780 2023-10-03T10:20:54.107 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:20:54.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 msgr2=0x7fde54119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 0x7fde54119cf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9b0 tx=0x7fde4400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 shutdown_connections 2023-10-03T10:20:54.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fde5409e260 0x7fde5411a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5409ad70 0x7fde541197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 --2- 172.21.15.125:0/3957608988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5409d780 0x7fde54119cf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 >> 172.21.15.125:0/3957608988 conn(0x7fde5409f980 msgr2=0x7fde54070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 shutdown_connections 2023-10-03T10:20:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.108+0000 7fde58c2a700 1 -- 172.21.15.125:0/3957608988 wait complete. 2023-10-03T10:20:54.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:20:54.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.244+0000 7fc6b8469700 1 Processor -- start 2023-10-03T10:20:54.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.244+0000 7fc6b8469700 1 -- start start 2023-10-03T10:20:54.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b8469700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b8469700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6b0136010 0x7fc6b01383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b8469700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b009e690 con 0x7fc6b009d780 2023-10-03T10:20:54.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b8469700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b009d430 con 0x7fc6b0136010 2023-10-03T10:20:54.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b8469700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b009e910 con 0x7fc6b009e260 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6b0136010 0x7fc6b01383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6b0136010 0x7fc6b01383f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43156/0 (socket says 172.21.15.125:43156) 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6205700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc6b009d780 0x7fc6b009db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35898/0 (socket says 172.21.15.125:35898) 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 -- 172.21.15.125:0/3674009793 learned_addr learned my addr 172.21.15.125:0/3674009793 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b5a04700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 -- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 msgr2=0x7fc6b0135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 -- 172.21.15.125:0/3674009793 >> v1:172.21.15.125:6789/0 conn(0x7fc6b009d780 legacy=0x7fc6b009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b6a06700 1 -- 172.21.15.125:0/3674009793 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b009b380 con 0x7fc6b0136010 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.245+0000 7fc6b5203700 1 -- 172.21.15.125:0/3674009793 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262602390 0 0) 0x7fc6b009e690 con 0x7fc6b009d780 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b6a06700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b0136010 0x7fc6b01383f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009e50 tx=0x7fc6a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be73eb395ee33bab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b5203700 1 -- 172.21.15.125:0/3674009793 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800e070 con 0x7fc6b0136010 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b5203700 1 -- 172.21.15.125:0/3674009793 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800b910 con 0x7fc6b0136010 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b5203700 1 -- 172.21.15.125:0/3674009793 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800bcc0 con 0x7fc6b0136010 2023-10-03T10:20:54.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 -- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b0136010 msgr2=0x7fc6b01383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b0136010 0x7fc6b01383f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009e50 tx=0x7fc6a800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 -- 172.21.15.125:0/3674009793 shutdown_connections 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b0136010 0x7fc6b01383f0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 --2- 172.21.15.125:0/3674009793 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 -- 172.21.15.125:0/3674009793 >> 172.21.15.125:0/3674009793 conn(0x7fc6b009f980 msgr2=0x7fc6b009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 -- 172.21.15.125:0/3674009793 shutdown_connections 2023-10-03T10:20:54.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.246+0000 7fc6b8469700 1 -- 172.21.15.125:0/3674009793 wait complete. 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.247+0000 7fc6b8469700 1 Processor -- start 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.247+0000 7fc6b8469700 1 -- start start 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6b0136010 0x7fc6b0123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0123b60 con 0x7fc6b009d780 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01261b0 con 0x7fc6b0136010 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01242a0 con 0x7fc6b009e260 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6a06700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6b0136010 0x7fc6b0123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43164/0 (socket says 172.21.15.125:43164) 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b5a04700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 -- 172.21.15.125:0/2883275449 learned_addr learned my addr 172.21.15.125:0/2883275449 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 -- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 msgr2=0x7fc6b0122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 -- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6b0136010 msgr2=0x7fc6b0123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6b0136010 0x7fc6b0123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 -- 172.21.15.125:0/2883275449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009b30 con 0x7fc6b009d780 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b5a04700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b6205700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c550 tx=0x7fc6a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0004c80 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0004e00 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b00a3ad0 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.248+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0007310 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.249+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b0126940 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.249+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6a0007470 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.249+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6a003f270 con 0x7fc6b009d780 2023-10-03T10:20:54.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.249+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b0135690 con 0x7fc6b009d780 2023-10-03T10:20:54.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.254+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6a00123b0 con 0x7fc6b009d780 2023-10-03T10:20:54.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.437+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6b004f2a0 con 0x7fc6b009d780 2023-10-03T10:20:54.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.437+0000 7fc6a6ffd700 1 -- 172.21.15.125:0/2883275449 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6a0011360 con 0x7fc6b009d780 2023-10-03T10:20:54.438 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:20:54.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 msgr2=0x7fc6b0122690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c550 tx=0x7fc6a000c860 comp rx=0 tx=0).stop 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 shutdown_connections 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6b0136010 0x7fc6b0123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6b009d780 0x7fc6b0122690 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 --2- 172.21.15.125:0/2883275449 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fc6b009e260 0x7fc6b0122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.439+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 >> 172.21.15.125:0/2883275449 conn(0x7fc6b009f980 msgr2=0x7fc6b00a1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.440+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 shutdown_connections 2023-10-03T10:20:54.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.440+0000 7fc6b8469700 1 -- 172.21.15.125:0/2883275449 wait complete. 2023-10-03T10:20:54.452 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:20:54.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.578+0000 7f6a78d14700 1 Processor -- start 2023-10-03T10:20:54.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.578+0000 7f6a78d14700 1 -- start start 2023-10-03T10:20:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a78d14700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a78d14700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a78d14700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7409a590 con 0x7f6a7409d780 2023-10-03T10:20:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a78d14700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7406b450 con 0x7f6a7409ad70 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a78d14700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7406a9e0 con 0x7f6a7409e260 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a71d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a72d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a71d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43176/0 (socket says 172.21.15.125:43176) 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a72d9d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:44566/0 (socket says 172.21.15.125:44566) 2023-10-03T10:20:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a71d9b700 1 -- 172.21.15.125:0/4255645204 learned_addr learned my addr 172.21.15.125:0/4255645204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a7259c700 1 --1- 172.21.15.125:0/4255645204 >> v1:172.21.15.125:6789/0 conn(0x7f6a7409d780 0x7f6a7409db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35900/0 (socket says 172.21.15.125:35900) 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a72d9d700 1 -- 172.21.15.125:0/4255645204 >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 msgr2=0x7f6a74138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a72d9d700 1 --2- 172.21.15.125:0/4255645204 >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a72d9d700 1 -- 172.21.15.125:0/4255645204 >> v1:172.21.15.125:6789/0 conn(0x7f6a7409d780 legacy=0x7f6a7409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a72d9d700 1 -- 172.21.15.125:0/4255645204 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7409a870 con 0x7f6a7409e260 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.579+0000 7f6a7159a700 1 -- 172.21.15.125:0/4255645204 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018825792 0 0) 0x7f6a7409a590 con 0x7f6a7409d780 2023-10-03T10:20:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a71d9b700 1 --2- 172.21.15.125:0/4255645204 >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a72d9d700 1 --2- 172.21.15.125:0/4255645204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009d90 tx=0x7f6a6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4733daf01ed17c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a7159a700 1 -- 172.21.15.125:0/4255645204 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00e070 con 0x7f6a7409e260 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a7159a700 1 -- 172.21.15.125:0/4255645204 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00bb20 con 0x7f6a7409e260 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a7159a700 1 -- 172.21.15.125:0/4255645204 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c012430 con 0x7f6a7409e260 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 -- 172.21.15.125:0/4255645204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 msgr2=0x7f6a7413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 --2- 172.21.15.125:0/4255645204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009d90 tx=0x7f6a6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 -- 172.21.15.125:0/4255645204 shutdown_connections 2023-10-03T10:20:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 --2- 172.21.15.125:0/4255645204 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409e260 0x7f6a7413b210 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 --2- 172.21.15.125:0/4255645204 >> v2:172.21.15.125:3300/0 conn(0x7f6a7409ad70 0x7f6a74138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 -- 172.21.15.125:0/4255645204 >> 172.21.15.125:0/4255645204 conn(0x7f6a7409f980 msgr2=0x7f6a7409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 -- 172.21.15.125:0/4255645204 shutdown_connections 2023-10-03T10:20:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.580+0000 7f6a78d14700 1 -- 172.21.15.125:0/4255645204 wait complete. 2023-10-03T10:20:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.581+0000 7f6a78d14700 1 Processor -- start 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 -- start start 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a7409d780 0x7f6a7411de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 0x7f6a7411e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7409a150 con 0x7f6a7409e260 2023-10-03T10:20:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7411fb20 con 0x7f6a7409d780 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a78d14700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74120020 con 0x7f6a7409ad70 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:44576/0 (socket says 172.21.15.125:44576) 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a71d9b700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a7409d780 0x7f6a7411de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 -- 172.21.15.125:0/2634813511 learned_addr learned my addr 172.21.15.125:0/2634813511 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a72d9d700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 0x7f6a7411e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 -- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a7409d780 msgr2=0x7f6a7411de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a7409d780 0x7f6a7411de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 -- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 msgr2=0x7f6a7411e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 0x7f6a7411e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 -- 172.21.15.125:0/2634813511 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64009550 con 0x7f6a7409ad70 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a72d9d700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 0x7f6a7411e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.582+0000 7f6a7259c700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c520 tx=0x7f6a6800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68004c80 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68004e00 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c009a70 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007310 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7411f860 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a68007470 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.583+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a6803f300 con 0x7f6a7409ad70 2023-10-03T10:20:54.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.584+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7404f2a0 con 0x7f6a7409ad70 2023-10-03T10:20:54.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.588+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a680123b0 con 0x7f6a7409ad70 2023-10-03T10:20:54.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.770+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a7413ae00 con 0x7f6a7409ad70 2023-10-03T10:20:54.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.770+0000 7f6a62ffd700 1 -- 172.21.15.125:0/2634813511 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a68011360 con 0x7f6a7409ad70 2023-10-03T10:20:54.771 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:20:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 msgr2=0x7f6a7411d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c520 tx=0x7f6a6800c830 comp rx=0 tx=0).stop 2023-10-03T10:20:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 shutdown_connections 2023-10-03T10:20:54.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a7409e260 0x7f6a7411e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f6a7409ad70 0x7f6a7411d920 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 --2- 172.21.15.125:0/2634813511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a7409d780 0x7f6a7411de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 >> 172.21.15.125:0/2634813511 conn(0x7f6a7409f980 msgr2=0x7f6a74136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 shutdown_connections 2023-10-03T10:20:54.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.772+0000 7f6a78d14700 1 -- 172.21.15.125:0/2634813511 wait complete. 2023-10-03T10:20:54.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:20:54.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.905+0000 7ff067e1a700 1 Processor -- start 2023-10-03T10:20:54.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.905+0000 7ff067e1a700 1 -- start start 2023-10-03T10:20:54.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff067e1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff067e1a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0601393a0 0x7ff06013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff067e1a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06009fa00 con 0x7ff06009e870 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff067e1a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600a0370 con 0x7ff0601393a0 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff067e1a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06006bec0 con 0x7ff06009f350 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0601393a0 0x7ff06013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0653b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff0601393a0 0x7ff06013b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:43184/0 (socket says 172.21.15.125:43184) 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0653b5700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46960/0 (socket says 172.21.15.125:46960) 2023-10-03T10:20:54.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 -- 172.21.15.125:0/199251560 learned_addr learned my addr 172.21.15.125:0/199251560 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff065bb6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff06009e870 0x7ff06009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35910/0 (socket says 172.21.15.125:35910) 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 -- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 msgr2=0x7ff060138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 -- 172.21.15.125:0/199251560 >> v1:172.21.15.125:6789/0 conn(0x7ff06009e870 legacy=0x7ff06009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 -- 172.21.15.125:0/199251560 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06009ada0 con 0x7ff0601393a0 2023-10-03T10:20:54.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff064bb4700 1 -- 172.21.15.125:0/199251560 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209367791 0 0) 0x7ff06009fa00 con 0x7ff06009e870 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0653b5700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff0663b7700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff06013b780 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff058009e50 tx=0x7ff05800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a42cd1ae64d3fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff064bb4700 1 -- 172.21.15.125:0/199251560 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800e070 con 0x7ff0601393a0 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff064bb4700 1 -- 172.21.15.125:0/199251560 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800b910 con 0x7ff0601393a0 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.906+0000 7ff064bb4700 1 -- 172.21.15.125:0/199251560 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800bcc0 con 0x7ff0601393a0 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 -- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 msgr2=0x7ff06013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff06013b780 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff058009e50 tx=0x7ff05800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 -- 172.21.15.125:0/199251560 shutdown_connections 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff06013b780 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 --2- 172.21.15.125:0/199251560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009f350 0x7ff060138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 -- 172.21.15.125:0/199251560 >> 172.21.15.125:0/199251560 conn(0x7ff0600a4430 msgr2=0x7ff0600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 -- 172.21.15.125:0/199251560 shutdown_connections 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.907+0000 7ff067e1a700 1 -- 172.21.15.125:0/199251560 wait complete. 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 Processor -- start 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 -- start start 2023-10-03T10:20:54.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff06009f350 0x7ff060122090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff0601225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060124de0 con 0x7ff0601393a0 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff060123760 con 0x7ff06009e870 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff067e1a700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a1730 con 0x7ff06009f350 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff065bb6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff0653b5700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff06009f350 0x7ff060122090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff065bb6700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:46976/0 (socket says 172.21.15.125:46976) 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff065bb6700 1 -- 172.21.15.125:0/1413110959 learned_addr learned my addr 172.21.15.125:0/1413110959 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.908+0000 7ff0663b7700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff0601225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 -- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff06009f350 msgr2=0x7ff060122090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff06009f350 0x7ff060122090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 -- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 msgr2=0x7ff060121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 -- 172.21.15.125:0/1413110959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0094a0 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff065bb6700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0663b7700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff0601225d0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff058015000 tx=0x7ff058004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058004880 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0580092e0 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058009b30 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05801c660 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.909+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060123f20 con 0x7ff0601393a0 2023-10-03T10:20:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.910+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff05801c7c0 con 0x7ff0601393a0 2023-10-03T10:20:54.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.910+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff058040ff0 con 0x7ff0601393a0 2023-10-03T10:20:54.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.910+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06009a9d0 con 0x7ff0601393a0 2023-10-03T10:20:54.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:54.915+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0580123f0 con 0x7ff0601393a0 2023-10-03T10:20:55.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.109+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff06004f2a0 con 0x7ff0601393a0 2023-10-03T10:20:55.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.109+0000 7ff0567fc700 1 -- 172.21.15.125:0/1413110959 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v41) v1 ==== 81+0+645 (secure 0 0 0) 0x7ff058034080 con 0x7ff0601393a0 2023-10-03T10:20:55.110 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6816/126957 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.110 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3516620713 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.110 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/507713441 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.110 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/677301661 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/595985394 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6816/118167 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/386436796 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/1534821931 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6817/582467044 2023-10-04T10:11:56.371913+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3204617686 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.111 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/4213304626 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:55.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 msgr2=0x7ff0601225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff0601225d0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff058015000 tx=0x7ff058004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 shutdown_connections 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0601393a0 0x7ff0601225d0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff06009e870 0x7ff060121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 --2- 172.21.15.125:0/1413110959 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff06009f350 0x7ff060122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 >> 172.21.15.125:0/1413110959 conn(0x7ff0600a4430 msgr2=0x7ff060070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 shutdown_connections 2023-10-03T10:20:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.111+0000 7ff067e1a700 1 -- 172.21.15.125:0/1413110959 wait complete. 2023-10-03T10:20:55.114 INFO:teuthology.orchestra.run.smithi125.stderr:listed 11 entries 2023-10-03T10:20:55.124 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-03T10:20:55.124 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:20:55.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:20:55.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 Processor -- start 2023-10-03T10:20:55.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 -- start start 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f077c130eb0 0x7f077c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c09aaa0 con 0x7f077c09e170 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c09f870 con 0x7f077c130eb0 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0782cd1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c09b360 con 0x7f077c09d860 2023-10-03T10:20:55.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f078126e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f077c130eb0 0x7f077c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0780a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f078126e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f077c130eb0 0x7f077c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51498/0 (socket says 172.21.15.125:51498) 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f0780a6d700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43532/0 (socket says 172.21.15.125:43532) 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f078126e700 1 -- 172.21.15.125:0/4193154332 learned_addr learned my addr 172.21.15.125:0/4193154332 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.266+0000 7f077bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f077c09e170 0x7f077c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47590/0 (socket says 172.21.15.125:47590) 2023-10-03T10:20:55.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f078126e700 1 -- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 msgr2=0x7f077c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f078126e700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f078126e700 1 -- 172.21.15.125:0/4193154332 >> v1:172.21.15.125:6789/0 conn(0x7f077c09e170 legacy=0x7f077c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f078126e700 1 -- 172.21.15.125:0/4193154332 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c09b620 con 0x7f077c130eb0 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f077b7fe700 1 -- 172.21.15.125:0/4193154332 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512482112 0 0) 0x7f077c09aaa0 con 0x7f077c09e170 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f0780a6d700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f078126e700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c130eb0 0x7f077c138a00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f0774009e50 tx=0x7f077400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc6d53f5a9a89a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f077b7fe700 1 -- 172.21.15.125:0/4193154332 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400e070 con 0x7f077c130eb0 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f077b7fe700 1 -- 172.21.15.125:0/4193154332 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400b910 con 0x7f077c130eb0 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.267+0000 7f077b7fe700 1 -- 172.21.15.125:0/4193154332 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400bcc0 con 0x7f077c130eb0 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 -- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c130eb0 msgr2=0x7f077c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c130eb0 0x7f077c138a00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f0774009e50 tx=0x7f077400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 -- 172.21.15.125:0/4193154332 shutdown_connections 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c130eb0 0x7f077c138a00 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 --2- 172.21.15.125:0/4193154332 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c09d860 0x7f077c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 -- 172.21.15.125:0/4193154332 >> 172.21.15.125:0/4193154332 conn(0x7f077c099c40 msgr2=0x7f077c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 -- 172.21.15.125:0/4193154332 shutdown_connections 2023-10-03T10:20:55.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 -- 172.21.15.125:0/4193154332 wait complete. 2023-10-03T10:20:55.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.268+0000 7f0782cd1700 1 Processor -- start 2023-10-03T10:20:55.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 -- start start 2023-10-03T10:20:55.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c09d860 0x7f077c121660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 0x7f077c121ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c123da0 con 0x7f077c09d860 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c09c8b0 con 0x7f077c09e170 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0782cd1700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c06b480 con 0x7f077c130eb0 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f078126e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f077bfff700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 0x7f077c121ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f078126e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43536/0 (socket says 172.21.15.125:43536) 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f078126e700 1 -- 172.21.15.125:0/2050147171 learned_addr learned my addr 172.21.15.125:0/2050147171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.269+0000 7f0780a6d700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c09d860 0x7f077c121660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 -- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 msgr2=0x7f077c121ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 0x7f077c121ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 -- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c09d860 msgr2=0x7f077c121660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c09d860 0x7f077c121660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 -- 172.21.15.125:0/2050147171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700094a0 con 0x7f077c130eb0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f077bfff700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 0x7f077c121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f078126e700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f077400b680 tx=0x7f0774004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740048b0 con 0x7f077c130eb0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740092e0 con 0x7f077c130eb0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0774009b30 con 0x7f077c130eb0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077401c630 con 0x7f077c130eb0 2023-10-03T10:20:55.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.270+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c124080 con 0x7f077c130eb0 2023-10-03T10:20:55.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.271+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f077401c790 con 0x7f077c130eb0 2023-10-03T10:20:55.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.271+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0774040d90 con 0x7f077c130eb0 2023-10-03T10:20:55.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.271+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c123ee0 con 0x7f077c130eb0 2023-10-03T10:20:55.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.275+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f077c123ee0 con 0x7f077c130eb0 2023-10-03T10:20:55.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.458+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f077c123ee0 con 0x7f077c130eb0 2023-10-03T10:20:55.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.459+0000 7f07797fa700 1 -- 172.21.15.125:0/2050147171 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13435 (secure 0 0 0) 0x7f077c123ee0 con 0x7f077c130eb0 2023-10-03T10:20:55.459 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-03T10:20:55.460 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":41,"fsid":"15b0d202-3c9c-40fb-bdbc-3890d84c122d","created":"2023-10-03T10:08:57.993987+0000","modified":"2023-10-03T10:12:30.049199+0000","last_up_change":"2023-10-03T10:11:49.442692+0000","last_in_change":"2023-10-03T10:09:00.288581+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:07.196311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:08.208327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:12.955356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:13.646123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e46d0293-43a8-48d0-8115-65e8d17976fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6800","nonce":130330}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6801","nonce":130330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6803","nonce":130330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6802","nonce":130330}]},"public_addr":"172.21.15.125:6800/130330","cluster_addr":"172.21.15.125:6801/130330","heartbeat_back_addr":"172.21.15.125:6803/130330","heartbeat_front_addr":"172.21.15.125:6802/130330","state":["exists","up"]},{"osd":1,"uuid":"900e5e55-9496-43ac-b8c8-a1c1305d5a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6804","nonce":130428}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6805","nonce":130428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6807","nonce":130428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6806","nonce":130428}]},"public_addr":"172.21.15.125:6804/130428","cluster_addr":"172.21.15.125:6805/130428","heartbeat_back_addr":"172.21.15.125:6807/130428","heartbeat_front_addr":"172.21.15.125:6806/130428","state":["exists","up"]},{"osd":2,"uuid":"7a1e1fe5-345d-4830-9c17-9662b63d17c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6808","nonce":130560}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6809","nonce":130560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6811","nonce":130560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6810","nonce":130560}]},"public_addr":"172.21.15.125:6808/130560","cluster_addr":"172.21.15.125:6809/130560","heartbeat_back_addr":"172.21.15.125:6811/130560","heartbeat_front_addr":"172.21.15.125:6810/130560","state":["exists","up"]},{"osd":3,"uuid":"337de985-5ba4-41db-9d64-832f9a8393ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":33,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6812","nonce":130878}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6813","nonce":130878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6815","nonce":130878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.125:6814","nonce":130878}]},"public_addr":"172.21.15.125:6812/130878","cluster_addr":"172.21.15.125:6813/130878","heartbeat_back_addr":"172.21.15.125:6815/130878","heartbeat_front_addr":"172.21.15.125:6814/130878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.541618+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.435543+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.427753+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-10-03T10:11:43.415680+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:05.492064+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6816/126957":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/3516620713":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/507713441":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/677301661":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/595985394":"2023-10-04T10:12:30.049171+0000","172.21.15.125:6816/118167":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/386436796":"2023-10-04T10:11:25.311631+0000","172.21.15.125:0/1534821931":"2023-10-04T10:12:30.049171+0000","172.21.15.125:6817/582467044":"2023-10-04T10:11:56.371913+0000","172.21.15.125:0/3204617686":"2023-10-04T10:12:30.049171+0000","172.21.15.125:0/4213304626":"2023-10-04T10:12:30.049171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:20:55.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 msgr2=0x7f077c1220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f077400b680 tx=0x7f0774004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 shutdown_connections 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f077c130eb0 0x7f077c1220e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c09d860 0x7f077c121660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 --2- 172.21.15.125:0/2050147171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c09e170 0x7f077c121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 >> 172.21.15.125:0/2050147171 conn(0x7f077c099c40 msgr2=0x7f077c119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 shutdown_connections 2023-10-03T10:20:55.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.461+0000 7f0782cd1700 1 -- 172.21.15.125:0/2050147171 wait complete. 2023-10-03T10:20:55.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:07.196311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:08.208327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:12.955356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:13.646123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:20:55.474 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:20:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 Processor -- start 2023-10-03T10:20:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 -- start start 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 0x7f3544131b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 0x7f3544071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3544131340 con 0x7f354409ed40 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354406e690 con 0x7f3544131730 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.598+0000 7f354adf7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f354409b3d0 con 0x7f3544132040 2023-10-03T10:20:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 0x7f3544071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3543fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f354409ed40 0x7f3544071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47596/0 (socket says 172.21.15.125:47596) 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3548b93700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 0x7f3544131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3543fff700 1 -- 172.21.15.125:0/153619391 learned_addr learned my addr 172.21.15.125:0/153619391 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 -- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 msgr2=0x7f3544131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f35437fe700 1 -- 172.21.15.125:0/153619391 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418777347 0 0) 0x7f3544131340 con 0x7f354409ed40 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 0x7f3544131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 -- 172.21.15.125:0/153619391 >> v1:172.21.15.125:6789/0 conn(0x7f354409ed40 legacy=0x7f3544071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 -- 172.21.15.125:0/153619391 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354409a530 con 0x7f3544132040 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3548b93700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 0x7f3544131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f3549394700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 0x7f3544071b20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f353c009dc0 tx=0x7f353c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a08c88ec52be52a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f35437fe700 1 -- 172.21.15.125:0/153619391 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00e070 con 0x7f3544132040 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f35437fe700 1 -- 172.21.15.125:0/153619391 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c00bb20 con 0x7f3544132040 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.599+0000 7f35437fe700 1 -- 172.21.15.125:0/153619391 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c012430 con 0x7f3544132040 2023-10-03T10:20:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 -- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 msgr2=0x7f3544071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 0x7f3544071b20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f353c009dc0 tx=0x7f353c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 -- 172.21.15.125:0/153619391 shutdown_connections 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f3544132040 0x7f3544071b20 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 --2- 172.21.15.125:0/153619391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544131730 0x7f3544131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 -- 172.21.15.125:0/153619391 >> 172.21.15.125:0/153619391 conn(0x7f354409f3f0 msgr2=0x7f354409f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 -- 172.21.15.125:0/153619391 shutdown_connections 2023-10-03T10:20:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.600+0000 7f354adf7700 1 -- 172.21.15.125:0/153619391 wait complete. 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 Processor -- start 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 -- start start 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 0x7f3544119bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 0x7f354411a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354411c8a0 con 0x7f3544131730 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354411da60 con 0x7f3544132040 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f354adf7700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3544099eb0 con 0x7f354409ed40 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f3548b93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f3543fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 0x7f3544119bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f3548b93700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43566/0 (socket says 172.21.15.125:43566) 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f3548b93700 1 -- 172.21.15.125:0/3599943815 learned_addr learned my addr 172.21.15.125:0/3599943815 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.601+0000 7f3549394700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 0x7f354411a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 -- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 msgr2=0x7f354411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 0x7f354411a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 -- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 msgr2=0x7f3544119bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 0x7f3544119bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 -- 172.21.15.125:0/3599943815 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380094a0 con 0x7f354409ed40 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3549394700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 0x7f354411a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3543fff700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 0x7f3544119bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f3548b93700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f353800ec10 tx=0x7f353800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800c850 con 0x7f354409ed40 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800c9b0 con 0x7f354409ed40 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c009a70 con 0x7f354409ed40 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800cd20 con 0x7f354409ed40 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.602+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354411cdc0 con 0x7f354409ed40 2023-10-03T10:20:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.603+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3538013470 con 0x7f354409ed40 2023-10-03T10:20:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.603+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f353803f7f0 con 0x7f354409ed40 2023-10-03T10:20:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.603+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354404f2a0 con 0x7f354409ed40 2023-10-03T10:20:55.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.608+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3538013720 con 0x7f354409ed40 2023-10-03T10:20:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.788+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f354406baa0 con 0x7f354409ed40 2023-10-03T10:20:55.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.788+0000 7f35417fa700 1 -- 172.21.15.125:0/3599943815 <== mon.2 v2:172.21.15.125:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f353801bd00 con 0x7f354409ed40 2023-10-03T10:20:55.789 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-03T10:20:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 msgr2=0x7f3544119690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f353800ec10 tx=0x7f353800ef20 comp rx=0 tx=0).stop 2023-10-03T10:20:55.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 shutdown_connections 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3544132040 0x7f354411a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f354409ed40 0x7f3544119690 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 --2- 172.21.15.125:0/3599943815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3544131730 0x7f3544119bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 >> 172.21.15.125:0/3599943815 conn(0x7f354409f3f0 msgr2=0x7f354412e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 shutdown_connections 2023-10-03T10:20:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.790+0000 7f354adf7700 1 -- 172.21.15.125:0/3599943815 wait complete. 2023-10-03T10:20:55.803 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:20:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 Processor -- start 2023-10-03T10:20:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 -- start start 2023-10-03T10:20:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9c00a1e90 0x7ff9c00a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 0x7ff9c0133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c006c210 con 0x7ff9c00a2bd0 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c006cbf0 con 0x7ff9c00a1e90 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9c5a2f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00a3dc0 con 0x7ff9c00a27a0 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9beffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9c00a1e90 0x7ff9c00a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9beffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9c00a1e90 0x7ff9c00a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51526/0 (socket says 172.21.15.125:51526) 2023-10-03T10:20:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9beffd700 1 -- 172.21.15.125:0/303080627 learned_addr learned my addr 172.21.15.125:0/303080627 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9be7fc700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 0x7ff9c0133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.926+0000 7ff9beffd700 1 -- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 msgr2=0x7ff9c0133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9beffd700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 0x7ff9c0133ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9beffd700 1 -- 172.21.15.125:0/303080627 >> v1:172.21.15.125:6789/0 conn(0x7ff9c00a2bd0 legacy=0x7ff9c01340e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9bdffb700 1 -- 172.21.15.125:0/303080627 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153138546 0 0) 0x7ff9c006c210 con 0x7ff9c00a2bd0 2023-10-03T10:20:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9beffd700 1 -- 172.21.15.125:0/303080627 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c006d880 con 0x7ff9c00a1e90 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9be7fc700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 0x7ff9c0133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9beffd700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c00a2260 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098f0 tx=0x7ff9b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298829642e8ad0ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9bdffb700 1 -- 172.21.15.125:0/303080627 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0011830 con 0x7ff9c00a1e90 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9bdffb700 1 -- 172.21.15.125:0/303080627 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0011990 con 0x7ff9c00a1e90 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9bdffb700 1 -- 172.21.15.125:0/303080627 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0011d20 con 0x7ff9c00a1e90 2023-10-03T10:20:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 msgr2=0x7ff9c00a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c00a2260 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098f0 tx=0x7ff9b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/303080627 shutdown_connections 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c00a2260 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/303080627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a27a0 0x7ff9c0133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/303080627 >> 172.21.15.125:0/303080627 conn(0x7ff9c00a43d0 msgr2=0x7ff9c00a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/303080627 shutdown_connections 2023-10-03T10:20:55.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.927+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/303080627 wait complete. 2023-10-03T10:20:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.928+0000 7ff9c5a2f700 1 Processor -- start 2023-10-03T10:20:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.928+0000 7ff9c5a2f700 1 -- start start 2023-10-03T10:20:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 0x7ff9c01c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a2bd0 0x7ff9c01c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0125b90 con 0x7ff9c00a1e90 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0125d70 con 0x7ff9c00a2bd0 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9c5a2f700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c01c5a40 con 0x7ff9c00a27a0 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9be7fc700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 0x7ff9c01c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51540/0 (socket says 172.21.15.125:51540) 2023-10-03T10:20:55.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 -- 172.21.15.125:0/1935305360 learned_addr learned my addr 172.21.15.125:0/1935305360 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9bf7fe700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a2bd0 0x7ff9c01c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 -- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 msgr2=0x7ff9c01c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 0x7ff9c01c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 -- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a2bd0 msgr2=0x7ff9c01c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a2bd0 0x7ff9c01c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 -- 172.21.15.125:0/1935305360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40094a0 con 0x7ff9c00a1e90 2023-10-03T10:20:55.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9be7fc700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 0x7ff9c01c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.929+0000 7ff9beffd700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009c40 tx=0x7ff9b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0004300 con 0x7ff9c00a1e90 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b001f070 con 0x7ff9c00a1e90 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b0009550 con 0x7ff9c00a1e90 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00036a0 con 0x7ff9c00a1e90 2023-10-03T10:20:55.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01257d0 con 0x7ff9c00a1e90 2023-10-03T10:20:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9b0021030 con 0x7ff9c00a1e90 2023-10-03T10:20:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.930+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff9b0040950 con 0x7ff9c00a1e90 2023-10-03T10:20:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.931+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c01259c0 con 0x7ff9c00a1e90 2023-10-03T10:20:55.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:55.935+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9b0015080 con 0x7ff9c00a1e90 2023-10-03T10:20:56.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.116+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9c004f2a0 con 0x7ff9c00a1e90 2023-10-03T10:20:56.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.117+0000 7ff9a7fff700 1 -- 172.21.15.125:0/1935305360 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff9b00199a0 con 0x7ff9c00a1e90 2023-10-03T10:20:56.118 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-03T10:20:56.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 msgr2=0x7ff9c01c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009c40 tx=0x7ff9b0004750 comp rx=0 tx=0).stop 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 shutdown_connections 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9c00a2bd0 0x7ff9c01c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c00a1e90 0x7ff9c01c4fc0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 --2- 172.21.15.125:0/1935305360 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7ff9c00a27a0 0x7ff9c01c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 >> 172.21.15.125:0/1935305360 conn(0x7ff9c00a43d0 msgr2=0x7ff9c0133ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 shutdown_connections 2023-10-03T10:20:56.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.119+0000 7ff9c5a2f700 1 -- 172.21.15.125:0/1935305360 wait complete. 2023-10-03T10:20:56.131 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:20:56.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 Processor -- start 2023-10-03T10:20:56.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 -- start start 2023-10-03T10:20:56.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb040136010 0x7fb0401383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04009e690 con 0x7fb04009d780 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04009d430 con 0x7fb040136010 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb046e71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04009e910 con 0x7fb04009e260 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb044c0d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb04009d780 0x7fb04009db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47614/0 (socket says 172.21.15.125:47614) 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb044c0d700 1 -- 172.21.15.125:0/3358568545 learned_addr learned my addr 172.21.15.125:0/3358568545 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb04540e700 1 --2- 172.21.15.125:0/3358568545 >> v2:172.21.15.125:3300/0 conn(0x7fb040136010 0x7fb0401383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.254+0000 7fb03ffff700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb04540e700 1 -- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 msgr2=0x7fb040135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb04540e700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb04540e700 1 -- 172.21.15.125:0/3358568545 >> v1:172.21.15.125:6789/0 conn(0x7fb04009d780 legacy=0x7fb04009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb04540e700 1 -- 172.21.15.125:0/3358568545 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04009b380 con 0x7fb040136010 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb03f7fe700 1 -- 172.21.15.125:0/3358568545 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828699553 0 0) 0x7fb04009e690 con 0x7fb04009d780 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb03ffff700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb04540e700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb040136010 0x7fb0401383f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb03800bfa0 tx=0x7fb03800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce7951c9c42c6f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb03f7fe700 1 -- 172.21.15.125:0/3358568545 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038010070 con 0x7fb040136010 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb03f7fe700 1 -- 172.21.15.125:0/3358568545 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800b2e0 con 0x7fb040136010 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb03f7fe700 1 -- 172.21.15.125:0/3358568545 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800dc40 con 0x7fb040136010 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb046e71700 1 -- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb040136010 msgr2=0x7fb0401383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb046e71700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb040136010 0x7fb0401383f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb03800bfa0 tx=0x7fb03800d330 comp rx=0 tx=0).stop 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.255+0000 7fb046e71700 1 -- 172.21.15.125:0/3358568545 shutdown_connections 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb040136010 0x7fb0401383f0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 --2- 172.21.15.125:0/3358568545 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 -- 172.21.15.125:0/3358568545 >> 172.21.15.125:0/3358568545 conn(0x7fb04009f980 msgr2=0x7fb04009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 -- 172.21.15.125:0/3358568545 shutdown_connections 2023-10-03T10:20:56.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 -- 172.21.15.125:0/3358568545 wait complete. 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 Processor -- start 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.256+0000 7fb046e71700 1 -- start start 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 0x7fb0401230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040123b40 con 0x7fb04009d780 2023-10-03T10:20:56.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040126190 con 0x7fb040136010 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb046e71700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb040124280 con 0x7fb04009e260 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb03ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb04540e700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 0x7fb0401230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51552/0 (socket says 172.21.15.125:51552) 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 -- 172.21.15.125:0/1103777347 learned_addr learned my addr 172.21.15.125:0/1103777347 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:56.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb03ffff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43588/0 (socket says 172.21.15.125:43588) 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 -- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 msgr2=0x7fb040122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 -- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 msgr2=0x7fb0401230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 0x7fb0401230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb044c0d700 1 -- 172.21.15.125:0/1103777347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0094a0 con 0x7fb04009d780 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb03ffff700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.257+0000 7fb04540e700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 0x7fb0401230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb044c0d700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c550 tx=0x7fb03400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034004c80 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034004e00 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034007310 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03800bc80 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb040125bf0 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.258+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb034007470 con 0x7fb04009d780 2023-10-03T10:20:56.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.259+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb040135670 con 0x7fb04009d780 2023-10-03T10:20:56.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.259+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb03403f270 con 0x7fb04009d780 2023-10-03T10:20:56.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.263+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0340133c0 con 0x7fb04009d780 2023-10-03T10:20:56.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.445+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb04004f2a0 con 0x7fb04009d780 2023-10-03T10:20:56.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.445+0000 7fb03d7fa700 1 -- 172.21.15.125:0/1103777347 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb034011360 con 0x7fb04009d780 2023-10-03T10:20:56.446 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-03T10:20:56.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.447+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 msgr2=0x7fb040122670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c550 tx=0x7fb03400c860 comp rx=0 tx=0).stop 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 shutdown_connections 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb040136010 0x7fb0401230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb04009d780 0x7fb040122670 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 --2- 172.21.15.125:0/1103777347 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb04009e260 0x7fb040122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 >> 172.21.15.125:0/1103777347 conn(0x7fb04009f980 msgr2=0x7fb0400a1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 shutdown_connections 2023-10-03T10:20:56.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.448+0000 7fb046e71700 1 -- 172.21.15.125:0/1103777347 wait complete. 2023-10-03T10:20:56.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:20:56.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.584+0000 7efcaafe0700 1 Processor -- start 2023-10-03T10:20:56.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 -- start start 2023-10-03T10:20:56.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efca41351d0 0x7efca41375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca40706f0 con 0x7efca412f910 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40709c0 con 0x7efca41351d0 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efcaafe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca4099a60 con 0x7efca41303f0 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca957d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efca41351d0 0x7efca41375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca3fff700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43600/0 (socket says 172.21.15.125:43600) 2023-10-03T10:20:56.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca3fff700 1 -- 172.21.15.125:0/3326963651 learned_addr learned my addr 172.21.15.125:0/3326963651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca957d700 1 -- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 msgr2=0x7efca4134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca957d700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca957d700 1 -- 172.21.15.125:0/3326963651 >> v1:172.21.15.125:6789/0 conn(0x7efca412f910 legacy=0x7efca412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca957d700 1 -- 172.21.15.125:0/3326963651 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4072190 con 0x7efca41351d0 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca37fe700 1 -- 172.21.15.125:0/3326963651 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243619533 0 0) 0x7efca40706f0 con 0x7efca412f910 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.585+0000 7efca3fff700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efca957d700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41351d0 0x7efca41375b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00f370 tx=0x7efc9c00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268678d1f2b30d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efca37fe700 1 -- 172.21.15.125:0/3326963651 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c012070 con 0x7efca41351d0 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efca37fe700 1 -- 172.21.15.125:0/3326963651 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00fe70 con 0x7efca41351d0 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efca37fe700 1 -- 172.21.15.125:0/3326963651 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00d2f0 con 0x7efca41351d0 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 -- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41351d0 msgr2=0x7efca41375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41351d0 0x7efca41375b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00f370 tx=0x7efc9c00f680 comp rx=0 tx=0).stop 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 -- 172.21.15.125:0/3326963651 shutdown_connections 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41351d0 0x7efca41375b0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 --2- 172.21.15.125:0/3326963651 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca41303f0 0x7efca4134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 -- 172.21.15.125:0/3326963651 >> 172.21.15.125:0/3326963651 conn(0x7efca409f3f0 msgr2=0x7efca409f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 -- 172.21.15.125:0/3326963651 shutdown_connections 2023-10-03T10:20:56.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.586+0000 7efcaafe0700 1 -- 172.21.15.125:0/3326963651 wait complete. 2023-10-03T10:20:56.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.587+0000 7efcaafe0700 1 Processor -- start 2023-10-03T10:20:56.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 -- start start 2023-10-03T10:20:56.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 0x7efca409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efca41351d0 0x7efca409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca409d0d0 con 0x7efca41303f0 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca412df00 con 0x7efca41351d0 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efcaafe0700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca409ec80 con 0x7efca412f910 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efca8d7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efca8d7c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43604/0 (socket says 172.21.15.125:43604) 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efca3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 0x7efca409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efca8d7c700 1 -- 172.21.15.125:0/2399535701 learned_addr learned my addr 172.21.15.125:0/2399535701 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.588+0000 7efca957d700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efca41351d0 0x7efca409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 -- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 msgr2=0x7efca4099d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 -- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efca41351d0 msgr2=0x7efca409a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efca41351d0 0x7efca409a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 -- 172.21.15.125:0/2399535701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9000b600 con 0x7efca41303f0 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca8d7c700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca3fff700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 0x7efca409a2b0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7efc9000de20 tx=0x7efc9000c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90004030 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90004190 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c00f050 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90004540 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.589+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca409df40 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.590+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc900036a0 con 0x7efca41303f0 2023-10-03T10:20:56.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.590+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc9003f680 con 0x7efca41303f0 2023-10-03T10:20:56.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.590+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca404f2a0 con 0x7efca41303f0 2023-10-03T10:20:56.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.595+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc900138f0 con 0x7efca41303f0 2023-10-03T10:20:56.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.777+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efca40717e0 con 0x7efca41303f0 2023-10-03T10:20:56.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.778+0000 7efca17fa700 1 -- 172.21.15.125:0/2399535701 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc9001a020 con 0x7efca41303f0 2023-10-03T10:20:56.779 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-03T10:20:56.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 msgr2=0x7efca409a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 0x7efca409a2b0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7efc9000de20 tx=0x7efc9000c6c0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 shutdown_connections 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efca41351d0 0x7efca409a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7efca412f910 0x7efca4099d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 --2- 172.21.15.125:0/2399535701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efca41303f0 0x7efca409a2b0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 >> 172.21.15.125:0/2399535701 conn(0x7efca409f3f0 msgr2=0x7efca40a1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 shutdown_connections 2023-10-03T10:20:56.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.780+0000 7efcaafe0700 1 -- 172.21.15.125:0/2399535701 wait complete. 2023-10-03T10:20:56.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:20:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.914+0000 7fb1e5853700 1 Processor -- start 2023-10-03T10:20:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.914+0000 7fb1e5853700 1 -- start start 2023-10-03T10:20:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1e5853700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1e5853700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1e5853700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e009a7c0 con 0x7fb1e009d8f0 2023-10-03T10:20:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1e5853700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0099490 con 0x7fb1e009e3d0 2023-10-03T10:20:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1e5853700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0098f20 con 0x7fb1e01395e0 2023-10-03T10:20:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1deffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1e009d8f0 0x7fb1e009dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47634/0 (socket says 172.21.15.125:47634) 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59124/0 (socket says 172.21.15.125:59124) 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3302/0 says I am v2:172.21.15.125:43614/0 (socket says 172.21.15.125:43614) 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1deffd700 1 -- 172.21.15.125:0/2050701853 learned_addr learned my addr 172.21.15.125:0/2050701853 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 -- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 msgr2=0x7fb1e013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 -- 172.21.15.125:0/2050701853 >> v1:172.21.15.125:6789/0 conn(0x7fb1e009d8f0 legacy=0x7fb1e009dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1de7fc700 1 -- 172.21.15.125:0/2050701853 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e009c200 con 0x7fb1e009e3d0 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.915+0000 7fb1df7fe700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00098a0 tx=0x7fb1d0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=298c2e95be5ca5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1ddffb700 1 -- 172.21.15.125:0/2050701853 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011830 con 0x7fb1e009e3d0 2023-10-03T10:20:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1ddffb700 1 -- 172.21.15.125:0/2050701853 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0011990 con 0x7fb1e009e3d0 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1ddffb700 1 -- 172.21.15.125:0/2050701853 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011d20 con 0x7fb1e009e3d0 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 -- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 msgr2=0x7fb1e01390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00098a0 tx=0x7fb1d0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 -- 172.21.15.125:0/2050701853 shutdown_connections 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e013b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 --2- 172.21.15.125:0/2050701853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e01390a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 -- 172.21.15.125:0/2050701853 >> 172.21.15.125:0/2050701853 conn(0x7fb1e00a2b30 msgr2=0x7fb1e009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 -- 172.21.15.125:0/2050701853 shutdown_connections 2023-10-03T10:20:56.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.916+0000 7fb1e5853700 1 -- 172.21.15.125:0/2050701853 wait complete. 2023-10-03T10:20:56.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.917+0000 7fb1e5853700 1 Processor -- start 2023-10-03T10:20:56.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.917+0000 7fb1e5853700 1 -- start start 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e0091310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0094f50 con 0x7fb1e009d8f0 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e006d7b0 con 0x7fb1e009e3d0 2023-10-03T10:20:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1e5853700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e009a170 con 0x7fb1e01395e0 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1deffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1deffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51584/0 (socket says 172.21.15.125:51584) 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1deffd700 1 -- 172.21.15.125:0/1730793323 learned_addr learned my addr 172.21.15.125:0/1730793323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59132/0 (socket says 172.21.15.125:59132) 2023-10-03T10:20:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1df7fe700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e0091310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 -- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 msgr2=0x7fb1e0091310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e0091310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 -- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 msgr2=0x7fb1e0090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 -- 172.21.15.125:0/1730793323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009a70 con 0x7fb1e009e3d0 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1deffd700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.918+0000 7fb1de7fc700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0016000 tx=0x7fb1d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0004340 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d001f070 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00094a0 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00036a0 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e0094240 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1d0021030 con 0x7fb1e009e3d0 2023-10-03T10:20:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1d0040750 con 0x7fb1e009e3d0 2023-10-03T10:20:56.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.919+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e0093ff0 con 0x7fb1e009e3d0 2023-10-03T10:20:56.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:56.924+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1d00239c0 con 0x7fb1e009e3d0 2023-10-03T10:20:57.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.120+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1e0093e10 con 0x7fb1e009e3d0 2023-10-03T10:20:57.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.121+0000 7fb1c7fff700 1 -- 172.21.15.125:0/1730793323 <== mon.1 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v41) v1 ==== 81+0+645 (secure 0 0 0) 0x7fb1d00233d0 con 0x7fb1e009e3d0 2023-10-03T10:20:57.121 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6816/126957 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.122 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3516620713 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.122 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/507713441 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.122 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/677301661 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:57.122 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/595985394 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.122 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6816/118167 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:57.123 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/386436796 2023-10-04T10:11:25.311631+0000 2023-10-03T10:20:57.123 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/1534821931 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.123 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:6817/582467044 2023-10-04T10:11:56.371913+0000 2023-10-03T10:20:57.123 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3204617686 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.123 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/4213304626 2023-10-04T10:12:30.049171+0000 2023-10-03T10:20:57.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.122+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 msgr2=0x7fb1e0090dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.122+0000 7fb1e5853700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0016000 tx=0x7fb1d0004750 comp rx=0 tx=0).stop 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 shutdown_connections 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7fb1e01395e0 0x7fb1e0091310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e009d8f0 0x7fb1e0090890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 --2- 172.21.15.125:0/1730793323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e009e3d0 0x7fb1e0090dd0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 >> 172.21.15.125:0/1730793323 conn(0x7fb1e00a2b30 msgr2=0x7fb1e0138570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 shutdown_connections 2023-10-03T10:20:57.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:20:57.123+0000 7fb1e5853700 1 -- 172.21.15.125:0/1730793323 wait complete. 2023-10-03T10:20:57.126 INFO:teuthology.orchestra.run.smithi125.stderr:listed 11 entries 2023-10-03T10:20:57.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-10-03T10:20:57.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:20:57.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T10:20:57.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi167.stderr:ceph-fuse[112268]: fuse finished with error 0 and tester_r 0 2023-10-03T10:20:57.181 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:21:03.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-10-03T10:21:03.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:03.284 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T10:21:03.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:03.318 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-10-03T10:21:03.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T10:21:03.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:03.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:21:03.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:03.461 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-10-03T10:21:03.561 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T10:21:03.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:21:03.575 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:21:03.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 Processor -- start 2023-10-03T10:21:03.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 -- start start 2023-10-03T10:21:03.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 0x7f726809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 0x7f72681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726809aaa0 con 0x7f7268130ce0 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726809f870 con 0x7f726809d860 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726d0fd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726809b360 con 0x7f726809e170 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f7266d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 0x7f726809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726659c700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 0x7f72681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.710+0000 7f726759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51598/0 (socket says 172.21.15.125:51598) 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726759e700 1 -- 172.21.15.125:0/4026667131 learned_addr learned my addr 172.21.15.125:0/4026667131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:21:03.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f7266d9d700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 0x7f726809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:59136/0 (socket says 172.21.15.125:59136) 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 -- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 msgr2=0x7f726809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 --2- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 0x7f726809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 -- 172.21.15.125:0/4026667131 >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 msgr2=0x7f7268131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 --2- 172.21.15.125:0/4026667131 >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 -- 172.21.15.125:0/4026667131 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726809b620 con 0x7f726809e170 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726759e700 1 --2- 172.21.15.125:0/4026667131 >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f726659c700 1 --2- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 0x7f72681307a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e6bff360ee81e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f7265d9b700 1 -- 172.21.15.125:0/4026667131 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011830 con 0x7f726809e170 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f7265d9b700 1 -- 172.21.15.125:0/4026667131 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258011990 con 0x7f726809e170 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.711+0000 7f7265d9b700 1 -- 172.21.15.125:0/4026667131 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011d20 con 0x7f726809e170 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 -- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 msgr2=0x7f72681307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 --2- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 0x7f72681307a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 -- 172.21.15.125:0/4026667131 shutdown_connections 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 --2- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809d860 0x7f726809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 --2- 172.21.15.125:0/4026667131 >> v2:172.21.15.125:3300/0 conn(0x7f7268130ce0 0x7f7268131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 --2- 172.21.15.125:0/4026667131 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f726809e170 0x7f72681307a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 -- 172.21.15.125:0/4026667131 >> 172.21.15.125:0/4026667131 conn(0x7f7268099c40 msgr2=0x7f72680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:03.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 -- 172.21.15.125:0/4026667131 shutdown_connections 2023-10-03T10:21:03.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.712+0000 7f726d0fd700 1 -- 172.21.15.125:0/4026667131 wait complete. 2023-10-03T10:21:03.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 Processor -- start 2023-10-03T10:21:03.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 -- start start 2023-10-03T10:21:03.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 0x7f7268120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809e170 0x7f7268120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7268130ce0 0x7f7268120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72681216e0 con 0x7f726809d860 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268130530 con 0x7f726809e170 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.713+0000 7f726d0fd700 1 -- --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72681236f0 con 0x7f7268130ce0 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f7266d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 0x7f7268120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 --2- >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7268130ce0 0x7f7268120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f7266d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 0x7f7268120210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51612/0 (socket says 172.21.15.125:51612) 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f7266d9d700 1 -- 172.21.15.125:0/3344330476 learned_addr learned my addr 172.21.15.125:0/3344330476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-03T10:21:03.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726659c700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809e170 0x7f7268120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 -- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809e170 msgr2=0x7f7268120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809e170 0x7f7268120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 -- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 msgr2=0x7f7268120210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 0x7f7268120210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 -- 172.21.15.125:0/3344330476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260009b30 con 0x7f7268130ce0 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726659c700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f726809e170 0x7f7268120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f7266d9d700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f726809d860 0x7f7268120210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:03.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726759e700 1 --2- 172.21.15.125:0/3344330476 >> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] conn(0x7f7268130ce0 0x7f7268120c90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7260009e50 tx=0x7f726000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260018070 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000f040 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726d0fd700 1 -- 172.21.15.125:0/3344330476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580094a0 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260003c40 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.714+0000 7f726d0fd700 1 -- 172.21.15.125:0/3344330476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7268123420 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.715+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f726000c880 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.715+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f726003f6f0 con 0x7f7268130ce0 2023-10-03T10:21:03.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.715+0000 7f726d0fd700 1 -- 172.21.15.125:0/3344330476 --> [v2:172.21.15.125:3302/0,v1:172.21.15.125:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268122fd0 con 0x7f7268130ce0 2023-10-03T10:21:03.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-03T10:21:03.720+0000 7f724f7fe700 1 -- 172.21.15.125:0/3344330476 <== mon.2 v2:172.21.15.125:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7260012340 con 0x7f7268130ce0 2023-10-03T10:23:03.615 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:23:03.616 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:03.624 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T10:23:03.625 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:23:03.625 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.638 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:23:03.638 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T10:23:03.638 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:23:03.639 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.704 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:23:03.704 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:23:03.704 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.784 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:23:03.785 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:23:03.785 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.853 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:23:03.853 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:23:03.853 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.922 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:23:03.922 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T10:23:03.922 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:23:03.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:03.923 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:23:03.932 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:23:03.932 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T10:23:03.932 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:23:03.932 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:03.974 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:23:03.974 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:23:03.974 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:04.026 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:23:04.026 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:23:04.026 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:04.077 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:23:04.078 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T10:23:04.078 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-03T10:23:04.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:23:04.159 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T10:23:04.356 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:23:04.356 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T10:23:04.483 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:23:04.483 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T10:23:04.582 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:23:04.582 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T10:23:04.650 INFO:tasks.ceph:Archiving mon data... 2023-10-03T10:23:04.651 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/data/mon.a.tgz 2023-10-03T10:23:04.652 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-03T10:23:04.669 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.IJO4V3sBJE 2023-10-03T10:23:04.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IJO4V3sBJE 2023-10-03T10:23:04.801 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.IJO4V3sBJE 2023-10-03T10:23:04.889 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.IJO4V3sBJE is 319KB 2023-10-03T10:23:04.982 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.IJO4V3sBJE 2023-10-03T10:23:04.998 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/data/mon.b.tgz 2023-10-03T10:23:04.999 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-03T10:23:05.055 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.701ngLEZsV 2023-10-03T10:23:05.055 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.701ngLEZsV 2023-10-03T10:23:05.179 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.701ngLEZsV 2023-10-03T10:23:05.267 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.701ngLEZsV is 320KB 2023-10-03T10:23:05.334 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.701ngLEZsV 2023-10-03T10:23:05.351 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/data/mon.c.tgz 2023-10-03T10:23:05.352 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-03T10:23:05.408 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.yB6LymxcM4 2023-10-03T10:23:05.409 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yB6LymxcM4 2023-10-03T10:23:05.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.yB6LymxcM4 2023-10-03T10:23:05.621 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.yB6LymxcM4 is 320KB 2023-10-03T10:23:05.715 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.yB6LymxcM4 2023-10-03T10:23:05.733 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T10:23:05.733 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:05.774 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:05.813 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T10:23:05.813 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:05.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:05.867 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:05.885 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:05.891 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T10:23:05.893 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi125/crash 2023-10-03T10:23:05.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:05.940 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi167/crash 2023-10-03T10:23:05.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:05.979 INFO:tasks.ceph:Compressing logs... 2023-10-03T10:23:05.979 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:05.985 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:06.011 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167593.log 2023-10-03T10:23:06.011 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177107.log 2023-10-03T10:23:06.055 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112268.log 2023-10-03T10:23:06.062 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.112268.log: 96.5% -- replaced with /var/log/ceph/ceph-client.0.112268.log.gz 2023-10-03T10:23:06.062 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-03T10:23:06.062 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m0.019s 2023-10-03T10:23:06.063 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m0.016s 2023-10-03T10:23:06.063 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.012s 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.167593.log: -- /var/log/ceph/ceph-client.admin.176617.log 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177107.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167593.log.gz 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177107.log.gz 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193513.log 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170631.log 2023-10-03T10:23:06.159 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176617.log.gz 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179655.log 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170631.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193513.log.gz 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154525.log 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170631.log.gzgzip 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176297.log 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154525.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179655.log.gz 2023-10-03T10:23:06.160 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159229.log 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154525.log.gz 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193590.log 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176297.log: /var/log/ceph/ceph-client.admin.159229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190648.log 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176297.log.gz 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128095.log 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159229.log.gz 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193590.log.gz 2023-10-03T10:23:06.161 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178453.log 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128095.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190648.log.gz 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142452.log 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128095.log.gz/var/log/ceph/ceph-client.admin.178453.log: 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177303.log 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178453.log.gz 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148464.log 2023-10-03T10:23:06.162 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177303.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142452.log.gz 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163869.log 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177303.log.gz 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151871.log 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148464.log.gz 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178871.log 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151871.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163869.log.gz 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139538.log 2023-10-03T10:23:06.163 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4%/var/log/ceph/ceph-client.admin.178871.log: -- replaced with /var/log/ceph/ceph-client.admin.151871.log.gz 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165339.log 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178871.log.gz 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160333.log 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165339.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139538.log.gz 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125976.log 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165339.log.gz 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180911.log 2023-10-03T10:23:06.164 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160333.log.gz 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156779.log 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180911.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125976.log.gz 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174265.log 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156779.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.180911.log.gz 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185027.log 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156779.log.gz 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189543.log 2023-10-03T10:23:06.165 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174265.log.gz 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173481.log 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189543.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.185027.log.gz-- 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151211.log 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189543.log.gz 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136515.log 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151211.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.173481.log.gz 2023-10-03T10:23:06.166 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175415.log 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151211.log.gz 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159157.log 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136515.log.gz 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137410.log 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159157.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175415.log.gz 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195328.log 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137410.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159157.log.gz 2023-10-03T10:23:06.167 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191749.log 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137410.log.gz 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138754.log 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191749.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195328.log.gz 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167861.log 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191749.log.gz 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175147.log 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138754.log.gz 2023-10-03T10:23:06.168 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174559.log 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175147.log: gzip -5 --verbose -- 89.8%/var/log/ceph/ceph-client.admin.160627.log 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.167861.log.gz 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174559.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175147.log.gz 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136837.log 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174559.log.gz 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141763.log 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160627.log.gz 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143902.log 2023-10-03T10:23:06.169 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136837.log.gz 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157589.log 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141763.log.gz 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147556.log 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169553.log 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143902.log.gz 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157589.log.gz 2023-10-03T10:23:06.170 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143314.log 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136760.log 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147556.log.gz 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143314.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169553.log.gz 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171585.log 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143314.log.gz/var/log/ceph/ceph-client.admin.136760.log: 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140178.log 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136760.log.gz 2023-10-03T10:23:06.171 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156975.log 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140178.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171585.log.gz 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155701.log 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140178.log.gz 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143824.log 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156975.log.gz 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140714.log 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143824.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155701.log.gz 2023-10-03T10:23:06.172 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196131.log 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140714.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143824.log.gz 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142648.log 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140714.log.gz 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.196131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167691.log 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142648.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.196131.log.gz--verbose 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:-- /var/log/ceph/ceph-client.admin.122367.log 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142648.log.gz 2023-10-03T10:23:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159549.log 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167691.log.gz 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186131.log 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122367.log: /var/log/ceph/ceph-client.admin.159549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174657.log 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122367.log.gz 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138192.log 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159549.log.gz 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174657.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186131.log.gz 2023-10-03T10:23:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180217.log 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174657.log.gz 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178747.log 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180217.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138192.log.gz 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174069.log 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180217.log.gz 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189739.log 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174069.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178747.log.gz 2023-10-03T10:23:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153857.log 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174069.log.gz 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182701.log 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189739.log.gz 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189639.log 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153857.log.gz 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192290.log 2023-10-03T10:23:06.176 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182701.log.gz 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129522.log 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.189639.log.gz 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168475.log 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129522.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192290.log.gz 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192610.log 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129522.log.gz/var/log/ceph/ceph-client.admin.168475.log: 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136417.log 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.168475.log.gz 2023-10-03T10:23:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193121.log 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136417.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192610.log.gz 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189443.log 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136417.log.gz 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166123.log 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193121.log.gz 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152681.log 2023-10-03T10:23:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166123.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189443.log.gz 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196033.log 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166123.log.gz 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138532.log 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152681.log.gz 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.196033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196180.log 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138532.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.196033.log.gz 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157367.log 2023-10-03T10:23:06.179 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138532.log.gz 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.196180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147288.log 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.196180.log.gz 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123971.log 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147288.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.157367.log.gz 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151603.log 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147288.log.gz 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153145.log 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123971.log.gz 2023-10-03T10:23:06.180 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153537.log 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153145.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151603.log.gz 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180243.log 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153145.log.gz 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165215.log 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.153537.log.gz 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193662.log 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165215.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.180243.log.gz--verbose 2023-10-03T10:23:06.181 INFO:teuthology.orchestra.run.smithi125.stderr:-- /var/log/ceph/ceph-client.admin.138140.log 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165215.log.gz 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167371.log 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193662.log.gz 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169749.log 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138140.log: /var/log/ceph/ceph-client.admin.167371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188679.log 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138140.log.gz 2023-10-03T10:23:06.182 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167371.log.gz 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174461.log 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185811.log 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188679.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169749.log.gz 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152067.log 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188679.log.gz 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174461.log.gz 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163575.log 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185811.log.gz 2023-10-03T10:23:06.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153733.log 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.152067.log.gz 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143287.log 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163575.log.gz 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170729.log 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153733.log.gz 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158961.log 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170729.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143287.log.gz 2023-10-03T10:23:06.184 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162979.log 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170729.log.gz 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144099.log 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4%/var/log/ceph/ceph-client.admin.162979.log: -- replaced with /var/log/ceph/ceph-client.admin.158961.log.gz 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188014.log 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144099.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.162979.log.gz 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169527.log 2023-10-03T10:23:06.185 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144099.log.gz 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136050.log 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188014.log.gz 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187575.log 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169527.log.gz 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177597.log 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136050.log.gz 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139785.log 2023-10-03T10:23:06.186 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187575.log.gz 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126025.log 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139785.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177597.log.gz 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178185.log 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139785.log.gz 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.126025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180813.log 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165927.log 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr: 91.1%/var/log/ceph/ceph-client.admin.180813.log: -- replaced with /var/log/ceph/ceph-client.admin.126025.log.gz 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.178185.log.gz 2023-10-03T10:23:06.187 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181401.log 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180813.log.gz 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167985.log 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181401.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165927.log.gz 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162365.log 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181401.log.gz 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143510.log 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167985.log.gz 2023-10-03T10:23:06.188 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137007.log 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143510.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.162365.log.gz 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189394.log 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143510.log.gz 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170801.log 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137007.log.gz 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148634.log 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170801.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189394.log.gz 2023-10-03T10:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143875.log 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170801.log.gz/var/log/ceph/ceph-client.admin.148634.log: 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195886.log 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0%/var/log/ceph/ceph-client.admin.143875.log: -- replaced with /var/log/ceph/ceph-client.admin.148634.log.gz 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189190.log 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143875.log.gz 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142936.log 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195886.log.gz 2023-10-03T10:23:06.190 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148758.log 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189190.log: /var/log/ceph/ceph-client.admin.142936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189667.log 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189190.log.gz 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178845.log 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142936.log.gz 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.148758.log.gz 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159817.log 2023-10-03T10:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189667.log.gz 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157393.log 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178845.log.gz 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191553.log 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159817.log.gz 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122904.log 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156511.log 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157393.log.gz 2023-10-03T10:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122904.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191553.log.gz 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168377.log 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122904.log.gz 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183485.log 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168377.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156511.log.gz 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156021.log 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168377.log.gz 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124415.log 2023-10-03T10:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183485.log.gz 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193905.log 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124415.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156021.log.gz 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127040.log 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124415.log.gz 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129424.log 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193905.log.gz 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193786.log 2023-10-03T10:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129424.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127040.log.gz 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181891.log 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129424.log.gz 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166783.log 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193786.log.gz 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166979.log 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166783.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.181891.log.gzgzip 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.184073.log 2023-10-03T10:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166979.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166783.log.gz 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158445.log 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166979.log.gz 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195935.log 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184073.log.gz 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155407.log 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.158445.log.gz 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163183.log 2023-10-03T10:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195935.log.gz 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125023.log 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.155407.log.gz/var/log/ceph/ceph-client.admin.163183.log: 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125219.log 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163183.log.gz 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145417.log 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125023.log.gz 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159425.log 2023-10-03T10:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145417.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125219.log.gz 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138975.log 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145417.log.gz 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162071.log 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159425.log.gz 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160895.log 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138975.log.gz 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164946.log 2023-10-03T10:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162071.log.gz 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174239.log 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160895.log.gz 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164946.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.168867.log 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164946.log.gz 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156903.log 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174239.log.gz 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152361.log 2023-10-03T10:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168867.log.gz 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172769.log 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156903.log.gz 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174729.log 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172769.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152361.log.gz 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166809.log 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.172769.log.gz 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179949.log 2023-10-03T10:23:06.200 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174729.log.gz 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166417.log 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179949.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166809.log.gz 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183681.log 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166417.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179949.log.gz 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148562.log 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166417.log.gz 2023-10-03T10:23:06.201 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195354.log 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183681.log: /var/log/ceph/ceph-client.admin.148562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158373.log 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183681.log.gz 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195354.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148562.log.gz 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151113.log 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.195354.log.gz 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192974.log 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151113.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158373.log.gz 2023-10-03T10:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146896.log 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151113.log.gz 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195457.log 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192974.log.gz 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183557.log 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195457.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146896.log.gz 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136641.log 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195457.log.gz 2023-10-03T10:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194101.log 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165535.log 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183557.log.gz 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0%/var/log/ceph/ceph-client.admin.194101.log: -- replaced with /var/log/ceph/ceph-client.admin.136641.log.gz 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157269.log 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.194101.log.gz 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156707.log 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165535.log.gz/var/log/ceph/ceph-client.admin.157269.log: 2023-10-03T10:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153465.log 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156707.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157269.log.gz 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185445.log 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156707.log.gz 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191014.log 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153465.log.gz 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169821.log 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191014.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185445.log.gz 2023-10-03T10:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159915.log 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191014.log.gz 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168573.log 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159915.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169821.log.gz 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177865.log 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159915.log.gz 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165534.log 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163967.log 2023-10-03T10:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168573.log.gz 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165534.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177865.log.gz 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137356.log 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165534.log.gz 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163967.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137356.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163967.log.gz 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144268.log 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137356.log.gz 2023-10-03T10:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122249.log 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164823.log 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192218.log 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122249.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144268.log.gz 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122249.log.gz 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164358.log 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164823.log.gz 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.192218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.142844.log 2023-10-03T10:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184269.log 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.192218.log.gz 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164358.log.gz 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154649.log 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142844.log.gz 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.184269.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.182675.log 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 /var/log/ceph/ceph-client.admin.154649.log: --verbose -- /var/log/ceph/ceph-client.admin.177009.log 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184269.log.gz 2023-10-03T10:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182675.log: gzip 88.4%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.154649.log.gz/var/log/ceph/ceph-client.admin.170533.log 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177009.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182675.log.gz 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164235.log 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177009.log.gz 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195081.log 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164235.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170533.log.gz 2023-10-03T10:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125121.log 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164235.log.gz 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150034.log 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125121.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195081.log.gz 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162169.log 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125121.log.gz 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156191.log 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187867.log 2023-10-03T10:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150034.log.gz 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162169.log.gz 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183387.log 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156191.log.gz 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118459.log 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187867.log.gz 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162293.log 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183387.log.gz 2023-10-03T10:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130061.log 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118459.log.gz 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178087.log 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162293.log.gz 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172279.log 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178087.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130061.log.gz 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123308.log 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.178087.log.gz 2023-10-03T10:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149150.log 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123308.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.172279.log.gz--verbose 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:-- /var/log/ceph/ceph-client.admin.176421.log 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123308.log.gz 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190227.log 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149150.log.gz 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179851.log 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176421.log.gz 2023-10-03T10:23:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151381.log 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179851.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190227.log.gz 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187697.log 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179851.log.gz 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124582.log 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151381.log.gz 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149026.log 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124582.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.187697.log.gz 2023-10-03T10:23:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160431.log 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124582.log.gz 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142530.log 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149026.log.gz 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193564.log 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160431.log.gz 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171291.log 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193564.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142530.log.gz 2023-10-03T10:23:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149936.log 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193564.log.gz 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194297.log 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149936.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171291.log.gz 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174043.log 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194297.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149936.log.gz 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180413.log 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194297.log.gz 2023-10-03T10:23:06.217 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167665.log 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174043.log.gz 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150008.log 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180413.log.gz 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186719.log 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167665.log.gz 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169723.log 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150008.log.gz 2023-10-03T10:23:06.218 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179335.log 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169723.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186719.log.gz 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173383.log 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169723.log.gz 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149910.log 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179335.log.gz 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181917.log 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173383.log.gz 2023-10-03T10:23:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187426.log 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181917.log: gzip -5 89.5%--verbose -- replaced with /var/log/ceph/ceph-client.admin.149910.log.gz-- 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122510.log 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141179.log 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181917.log.gz 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194544.log 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187426.log.gz 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122510.log.gz 2023-10-03T10:23:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163451.log 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194544.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141179.log.gz 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188483.log 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194544.log.gz 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147066.log 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163451.log.gz/var/log/ceph/ceph-client.admin.188483.log: 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144020.log 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188483.log.gz 2023-10-03T10:23:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185419.log 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147066.log.gz 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164431.log 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144020.log.gz 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143432.log 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164431.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185419.log.gz 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168841.log 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164431.log.gz 2023-10-03T10:23:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129865.log 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143432.log.gz 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182897.log 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129865.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168841.log.gz 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141767.log 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129865.log.gz 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155727.log 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182897.log.gz 2023-10-03T10:23:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123110.log 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155727.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141767.log.gz 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166587.log 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155727.log.gz 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175121.log 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123110.log.gz 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175219.log 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175121.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166587.log.gz 2023-10-03T10:23:06.224 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129620.log 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175121.log.gz 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193982.log 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129620.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175219.log.gz 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147680.log 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129620.log.gz 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128820.log 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193982.log.gz 2023-10-03T10:23:06.225 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145515.log 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128820.log: gzip -5 --verbose -- 89.5%/var/log/ceph/ceph-client.admin.150989.log 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147680.log.gz 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145515.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128820.log.gz 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150623.log 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145515.log.gz 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186301.log 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150989.log.gz 2023-10-03T10:23:06.226 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185641.log 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186301.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150623.log.gz 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129767.log 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186301.log.gz 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.185641.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.136956.log 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185641.log.gz 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139199.log 2023-10-03T10:23:06.227 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129767.log.gz 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155237.log 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136956.log.gz 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149642.log 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139199.log.gz 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190965.log 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149642.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155237.log.gz 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175245.log 2023-10-03T10:23:06.228 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149642.log.gz 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169455.log 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156877.log 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190965.log.gz 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169357.log 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169455.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175245.log.gz 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156877.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169455.log.gz 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182603.log 2023-10-03T10:23:06.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169357.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156877.log.gz 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164653.log 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169357.log.gz 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123826.log 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164653.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.182603.log.gz 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162783.log 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123826.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164653.log.gz 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168083.log 2023-10-03T10:23:06.230 INFO:teuthology.orchestra.run.smithi125.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123826.log.gz 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162881.log 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162783.log.gz 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194570.log 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168083.log.gz 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137607.log 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162881.log.gz 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129914.log 2023-10-03T10:23:06.231 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194570.log.gz 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173651.log 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137607.log.gz 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167789.log 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129914.log.gz 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175441.log 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173651.log.gz 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.167789.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.127217.log 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175441.log: gzip 89.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.167789.log.gz-- 2023-10-03T10:23:06.232 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183067.log 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175441.log.gz 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138828.log 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179041.log 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127217.log.gz 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183067.log: /var/log/ceph/ceph-client.admin.138828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137651.log 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183067.log.gz 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138828.log.gz 2023-10-03T10:23:06.233 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168449.log 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137651.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179041.log.gz 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128246.log 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137651.log.gz 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139395.log 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128246.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168449.log.gz 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142334.log 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128246.log.gz 2023-10-03T10:23:06.234 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180715.log 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139395.log.gz 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145025.log 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180715.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142334.log.gz 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160921.log 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.180715.log.gz 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165437.log 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145025.log.gz 2023-10-03T10:23:06.235 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174827.log 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165437.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160921.log.gz 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194178.log 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174827.log: gzip -5 88.4%--verbose -- /var/log/ceph/ceph-client.admin.177571.log -- replaced with /var/log/ceph/ceph-client.admin.165437.log.gz 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194178.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174827.log.gz 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148536.log 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194178.log.gz 2023-10-03T10:23:06.236 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186693.log 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177571.log.gz 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185909.log 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186693.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.148536.log.gz 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161189.log 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186693.log.gz 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154819.log 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161189.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.185909.log.gz 2023-10-03T10:23:06.237 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156289.log 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161189.log.gz 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192414.log 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154819.log.gz 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144859.log 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156289.log.gz 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168253.log 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192414.log.gz 2023-10-03T10:23:06.238 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170043.log 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168253.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144859.log.gz 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172697.log 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170043.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168253.log.gz 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173749.log 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170043.log.gz 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186033.log 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172697.log.gz 2023-10-03T10:23:06.239 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176591.log 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173749.log.gz 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129963.log 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176591.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186033.log.gz 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142528.log 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176591.log.gz 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178943.log 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129963.log.gz 2023-10-03T10:23:06.240 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138166.log 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142528.log.gz 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181623.log 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178943.log.gz 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160111.log 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138166.log.gz 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151407.log 2023-10-03T10:23:06.241 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.181623.log.gz 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157465.log 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151407.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160111.log.gz 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124729.log 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151407.log.gz 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161679.log 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124729.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.157465.log.gz 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128530.log 2023-10-03T10:23:06.242 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124729.log.gz 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153171.log 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128530.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161679.log.gz 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166613.log 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128530.log.gz 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192778.log 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1%/var/log/ceph/ceph-client.admin.166613.log: -- replaced with /var/log/ceph/ceph-client.admin.153171.log.gz 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144071.log 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192778.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166613.log.gz 2023-10-03T10:23:06.243 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158471.log 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192778.log.gz 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169233.log 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144071.log.gz 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188555.log 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169233.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158471.log.gz 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190722.log 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169233.log.gz 2023-10-03T10:23:06.244 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146184.log 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190722.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188555.log.gz 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146111.log 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190722.log.gz 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176715.log 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146184.log.gz 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191945.log 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146111.log.gz 2023-10-03T10:23:06.245 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174631.log 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191945.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176715.log.gz 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173971.log 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191945.log.gz 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159131.log 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173971.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174631.log.gz 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186621.log 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159131.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173971.log.gz 2023-10-03T10:23:06.246 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159353.log 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186621.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159131.log.gz 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172795.log 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186621.log.gz 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123504.log 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159353.log.gz 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187230.log 2023-10-03T10:23:06.247 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172795.log.gz 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193760.log 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123504.log: /var/log/ceph/ceph-client.admin.187230.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.154917.log -- replaced with /var/log/ceph/ceph-client.admin.123504.log.gz 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182283.log 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187230.log.gz 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193760.log.gz 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137552.log 2023-10-03T10:23:06.248 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154917.log.gz 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195524.log 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151479.log 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182283.log.gz 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137552.log.gz 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143091.log 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151479.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.195524.log.gz 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184563.log 2023-10-03T10:23:06.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143091.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151479.log.gz 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136271.log 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143091.log.gz 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174337.log 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136271.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184563.log.gz 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125072.log 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136271.log.gz 2023-10-03T10:23:06.250 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172573.log 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174337.log.gz 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151773.log 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172573.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125072.log.gz 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129226.log 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172573.log.gz 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188359.log 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151773.log.gz 2023-10-03T10:23:06.251 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149518.log 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188359.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129226.log.gz 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188359.log.gz 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125437.log 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149518.log.gz 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157883.log 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150917.log 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125437.log.gz 2023-10-03T10:23:06.252 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182995.log 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157883.log.gz 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192806.log 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.150917.log.gz--verbose 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:-- /var/log/ceph/ceph-client.admin.175833.log 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182995.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182995.log.gz 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151969.log 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186105.log 2023-10-03T10:23:06.253 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192806.log.gz 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175833.log: /var/log/ceph/ceph-client.admin.151969.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175833.log.gz 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148830.log 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151969.log.gz 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166685.log 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181035.log 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186105.log.gz 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176029.log 2023-10-03T10:23:06.254 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148830.log.gz 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166685.log.gz 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128064.log 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181035.log.gz 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194374.log 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176029.log: /var/log/ceph/ceph-client.admin.128064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189786.log 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176029.log.gz 2023-10-03T10:23:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124192.log 87.9% 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128064.log.gz 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.194374.log.gz 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125486.log 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170017.log 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189786.log.gz 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124192.log: /var/log/ceph/ceph-client.admin.125486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122657.log 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124192.log.gz 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170017.log: gzip -5 --verbose 88.2%-- /var/log/ceph/ceph-client.admin.189272.log 2023-10-03T10:23:06.256 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125486.log.gz 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122657.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170017.log.gz 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190031.log 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122657.log.gz 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192582.log 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145319.log 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190031.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189272.log.gz 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138558.log 2023-10-03T10:23:06.257 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190031.log.gz 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192582.log.gz 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149812.log 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177695.log 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138558.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145319.log.gz 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166318.log 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138558.log.gz 2023-10-03T10:23:06.258 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149812.log.gz 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184047.log 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176199.log 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166318.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177695.log.gz 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153341.log 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166318.log.gz 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184047.log.gz 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-03T10:23:06.259 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127428.log 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176199.log.gz 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140348.log 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167273.log 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127428.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.153341.log.gz 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140348.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127428.log.gz 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176493.log 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181499.log 2023-10-03T10:23:06.260 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140348.log.gz 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176493.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167273.log.gz 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154747.log 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176493.log.gz 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136297.log 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146380.log 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181499.log.gz 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176689.log 2023-10-03T10:23:06.261 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154747.log.gz 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136297.log.gz 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163966.log 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146380.log.gz 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146602.log 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176689.log.gz 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146308.log 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163966.log.gz 2023-10-03T10:23:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177081.log 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146602.log: /var/log/ceph/ceph-client.admin.146308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194250.log 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146602.log.gz 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146308.log.gz 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128198.log 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142700.log 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177081.log.gz 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194250.log: /var/log/ceph/ceph-client.admin.128198.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194250.log.gz 2023-10-03T10:23:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147974.log 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128198.log.gz 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189071.log 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148072.log 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142700.log.gz 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147974.log.gz 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123553.log 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189071.log.gz 2023-10-03T10:23:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170239.log 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148072.log.gz 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152459.log 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123553.log: /var/log/ceph/ceph-client.admin.170239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123825.log 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123553.log.gz 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152459.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170239.log.gz 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147164.log 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152459.log.gzgzip 2023-10-03T10:23:06.265 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.140152.log 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123825.log: /var/log/ceph/ceph-client.admin.147164.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123825.log.gz 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173259.log 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147164.log.gz 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157171.log 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140152.log: /var/log/ceph/ceph-client.admin.173259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175023.log 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140152.log.gz 2023-10-03T10:23:06.266 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173259.log.gz 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122804.log 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157171.log.gz 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154845.log 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175023.log.gz 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152289.log 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122804.log: /var/log/ceph/ceph-client.admin.154845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192486.log 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122804.log.gz 2023-10-03T10:23:06.267 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152289.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154845.log.gz 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159941.log 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178159.log 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152289.log.gz 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192486.log: /var/log/ceph/ceph-client.admin.159941.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192486.log.gz 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153563.log 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.159941.log.gz 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122608.log 2023-10-03T10:23:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195158.log 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178159.log.gz 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153563.log.gz 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145818.log 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122608.log.gz 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188994.log 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195158.log: /var/log/ceph/ceph-client.admin.145818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171389.log 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195158.log.gz 2023-10-03T10:23:06.269 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118508.log 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145818.log.gz 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171389.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188994.log.gz 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154943.log 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171389.log.gz 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122955.log 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118508.log.gz 2023-10-03T10:23:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159033.log 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122955.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.154943.log.gz-5 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:--verbose -- /var/log/ceph/ceph-client.admin.174755.log 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122955.log.gz 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181695.log 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159033.log.gz 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146674.log 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174755.log.gz 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129375.log 2023-10-03T10:23:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146674.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181695.log.gz 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130110.log 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146674.log.gz 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193198.log 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166907.log 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129375.log.gz 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193198.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130110.log.gz 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159745.log 2023-10-03T10:23:06.272 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193198.log.gz 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187279.log 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138728.log 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166907.log.gz 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159745.log.gz 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156583.log 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187279.log.gz 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196082.log 2023-10-03T10:23:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156583.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138728.log.gz 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125535.log 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.196082.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156583.log.gz 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186595.log 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.196082.log.gz 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192337.log 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125535.log.gz 2023-10-03T10:23:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171985.log 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192337.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186595.log.gz 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193858.log 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192337.log.gz 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130012.log 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193858.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171985.log.gz 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140151.log 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130012.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193858.log.gz 2023-10-03T10:23:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192925.log 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130012.log.gz 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136836.log 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140151.log.gz 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173775.log 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192925.log.gz 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189347.log 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136836.log.gz 2023-10-03T10:23:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147484.log 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189347.log: gzip -5 --verbose 88.5%-- /var/log/ceph/ceph-client.admin.194689.log -- replaced with /var/log/ceph/ceph-client.admin.173775.log.gz 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147484.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189347.log.gz 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147484.log.gz 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194689.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194689.log.gz 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171683.log 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186327.log 2023-10-03T10:23:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148046.log 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186327.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171683.log.gz 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163771.log 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148046.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186327.log.gz 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193394.log 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148046.log.gz 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145915.log 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193394.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163771.log.gz 2023-10-03T10:23:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163051.log 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193394.log.gz 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124533.log 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163051.log: gzip -5 89.3%--verbose -- /var/log/ceph/ceph-client.admin.147850.log 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145915.log.gz 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124533.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163051.log.gz 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187501.log 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124533.log.gz 2023-10-03T10:23:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154125.log 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187501.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147850.log.gz 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160039.log 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187501.log.gz 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125731.log 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154125.log.gz 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158837.log 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160039.log.gz 2023-10-03T10:23:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157981.log 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125731.log.gz 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181525.log 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157981.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158837.log.gz 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127547.log 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157981.log.gz 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128297.log 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181525.log.gz 2023-10-03T10:23:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165926.log 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128297.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127547.log.gz 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123012.log 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128297.log.gz 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149740.log 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165926.log.gz 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174435.log 2023-10-03T10:23:06.282 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149740.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123012.log.gz 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129163.log 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174435.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149740.log.gz 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155139.log 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174435.log.gz 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149838.log 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129163.log.gz 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165143.log 2023-10-03T10:23:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178649.log 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155139.log.gz 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165143.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149838.log.gz 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165143.log.gz 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155211.log 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149420.log 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178649.log.gz 2023-10-03T10:23:06.284 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151995.log 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155211.log.gz 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141571.log 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149420.log.gz 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147778.log 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151995.log: /var/log/ceph/ceph-client.admin.141571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184661.log 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151995.log.gz 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141571.log.gz 2023-10-03T10:23:06.285 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152557.log 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167887.log 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184661.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147778.log.gz 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152557.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.184661.log.gz 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171219.log 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152557.log.gz 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125829.log 2023-10-03T10:23:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167887.log: /var/log/ceph/ceph-client.admin.171219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177669.log 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167887.log.gz 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125829.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171219.log.gz 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161313.log 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177669.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125829.log.gz 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151505.log 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177669.log.gz 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162463.log 2023-10-03T10:23:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151505.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161313.log.gz 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179923.log 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151505.log.gz 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192190.log 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179923.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162463.log.gz 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127991.log 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179923.log.gz 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190846.log 2023-10-03T10:23:06.288 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127991.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192190.log.gz 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166195.log 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127991.log.gz 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192141.log 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171317.log 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166195.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190846.log.gz 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166195.log.gz 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169063.log 2023-10-03T10:23:06.289 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192141.log.gz 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137997.log 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171317.log: /var/log/ceph/ceph-client.admin.169063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161509.log 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171317.log.gz 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137997.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169063.log.gz 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153367.log 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161509.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137997.log.gz 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162855.log 2023-10-03T10:23:06.290 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161509.log.gz 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156681.log 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162855.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153367.log.gz 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183949.log 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162855.log.gz 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144072.log 2023-10-03T10:23:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183949.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.156681.log.gz 2023-10-03T10:23:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139612.log 2023-10-03T10:23:06.293 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183949.log.gz 2023-10-03T10:23:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122755.log 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144072.log.gz 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.139612.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.164065.log 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195132.log 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139612.log.gz 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164065.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122755.log.gz 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188875.log 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164065.log.gz 2023-10-03T10:23:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187895.log 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146014.log 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195132.log.gz 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187895.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188875.log.gz 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150891.log 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187895.log.gz 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158079.log 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161705.log 2023-10-03T10:23:06.295 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.146014.log.gz 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150891.log.gz 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147262.log 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158079.log.gz 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136838.log 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161705.log.gz 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183975.log 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147262.log: /var/log/ceph/ceph-client.admin.136838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152851.log 2023-10-03T10:23:06.296 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147262.log.gz 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183975.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136838.log.gz 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157295.log 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152851.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183975.log.gz 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195230.log 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152851.log.gz 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141960.log 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195230.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157295.log.gz 2023-10-03T10:23:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172475.log 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141960.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195230.log.gz 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141960.log.gz 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179433.log 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194740.log 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172475.log.gz 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151675.log 2023-10-03T10:23:06.298 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179433.log.gz 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165829.log 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140788.log 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194740.log.gz 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165829.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151675.log.gz 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140788.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165829.log.gz 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140788.log.gz 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139955.log 2023-10-03T10:23:06.299 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154053.log 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144490.log 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139955.log.gz 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154053.log: /var/log/ceph/ceph-client.admin.144490.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154053.log.gz 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144490.log.gz 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148242.log 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136247.log 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124827.log 2023-10-03T10:23:06.300 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148242.log.gz 2023-10-03T10:23:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136642.log 2023-10-03T10:23:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130208.log 2023-10-03T10:23:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124827.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136247.log.gz 2023-10-03T10:23:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136642.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124827.log.gz 2023-10-03T10:23:06.394 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136642.log.gz 2023-10-03T10:23:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181303.log 2023-10-03T10:23:06.394 INFO:teuthology.orchestra.run.smithi125.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.130208.log.gz 2023-10-03T10:23:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143509.log 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150427.log 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181303.log.gz 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192682.log 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168351.log 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143509.log.gz 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150427.log: /var/log/ceph/ceph-client.admin.192682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173063.log 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150427.log.gz 2023-10-03T10:23:06.395 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6%/var/log/ceph/ceph-client.admin.168351.log: -- replaced with /var/log/ceph/ceph-client.admin.192682.log.gz 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168351.log.gz 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173063.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173063.log.gz 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191702.log 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182969.log 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159647.log 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182969.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191702.log.gz 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182969.log.gz 2023-10-03T10:23:06.396 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159647.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.159647.log.gz 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123967.log 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154623.log 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161973.log 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123967.log.gz 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172377.log 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161973.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154623.log.gz 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155531.log 2023-10-03T10:23:06.397 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161973.log.gz 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172377.log: /var/log/ceph/ceph-client.admin.155531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172377.log.gz 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155531.log.gz 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173455.log 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157687.log 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192878.log 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173455.log.gz 2023-10-03T10:23:06.398 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178283.log 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192878.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.157687.log.gz-5 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:--verbose -- /var/log/ceph/ceph-client.admin.190131.log 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192878.log.gz 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148732.log 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190131.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178283.log.gz 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3%/var/log/ceph/ceph-client.admin.148732.log: -- replaced with /var/log/ceph/ceph-client.admin.190131.log.gz 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.148732.log.gz 2023-10-03T10:23:06.399 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176787.log 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188651.log 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184367.log 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176787.log.gz 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129018.log 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184367.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188651.log.gz 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184367.log.gz 2023-10-03T10:23:06.400 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188287.log 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129018.log.gz 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151087.log 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176519.log 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.188287.log.gz 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166122.log 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127780.log 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151087.log.gz 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176519.log.gz 2023-10-03T10:23:06.401 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118162.log 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166122.log.gz 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171415.log 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118162.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127780.log.gz 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171415.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.118162.log.gz 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171415.log.gz 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124022.log 2023-10-03T10:23:06.402 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159255.log 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183851.log 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124022.log.gz 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147582.log 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167469.log 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159255.log.gz 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154721.log 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183851.log.gz 2023-10-03T10:23:06.403 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147582.log.gz 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191042.log 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.167469.log.gz 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154721.log: /var/log/ceph/ceph-client.admin.191042.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154721.log.gz 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191042.log.gz 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160013.log 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191357.log 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193956.log 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160013.log.gz 2023-10-03T10:23:06.404 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181721.log 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191357.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191357.log.gz 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193956.log: /var/log/ceph/ceph-client.admin.181721.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193956.log.gz 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181721.log.gz 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146210.log 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163843.log 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152387.log 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4%/var/log/ceph/ceph-client.admin.163843.log: -- replaced with /var/log/ceph/ceph-client.admin.146210.log.gz 2023-10-03T10:23:06.405 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163843.log.gz 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152387.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152387.log.gz 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182505.log 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189863.log 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137799.log 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189863.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182505.log.gz 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189863.log.gz 2023-10-03T10:23:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137799.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137799.log.gz 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166025.log 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144634.log 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188947.log 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144634.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166025.log.gz 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144634.log.gz 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188947.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.188947.log.gz 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165338.log 2023-10-03T10:23:06.407 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188602.log 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189239.log 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165338.log.gz 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188602.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188602.log.gz 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189239.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189239.log.gz 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157955.log 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195276.log 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178551.log 2023-10-03T10:23:06.408 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7%/var/log/ceph/ceph-client.admin.195276.log: -- replaced with /var/log/ceph/ceph-client.admin.157955.log.gz 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.195276.log.gz 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178551.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178551.log.gz 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174925.log 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161607.log 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176885.log 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161607.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.174925.log.gz 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161607.log.gz 2023-10-03T10:23:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176885.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.176885.log.gz 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150132.log 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182381.log 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124389.log 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150132.log.gz 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182381.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182381.log.gz 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124389.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124389.log.gz 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124023.log 2023-10-03T10:23:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185321.log 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146576.log 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124023.log.gz 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185321.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185321.log.gz 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146576.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146576.log.gz 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150793.log 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158569.log 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156217.log 2023-10-03T10:23:06.411 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158569.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150793.log.gz 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158569.log.gz 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171193.log 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156217.log.gz 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141498.log 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150819.log 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171193.log.gz 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124141.log 2023-10-03T10:23:06.412 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191798.log 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141498.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150819.log: /var/log/ceph/ceph-client.admin.124141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183459.log 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150819.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191798.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124141.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173187.log 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191798.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183459.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183459.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173187.log.gz 2023-10-03T10:23:06.413 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122318.log 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125780.log 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151701.log 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125780.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122318.log.gz 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125780.log.gz 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161215.log 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151701.log.gz 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187771.log 2023-10-03T10:23:06.414 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190058.log 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161215.log.gz 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187771.log: /var/log/ceph/ceph-client.admin.190058.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187771.log.gz 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190058.log.gz 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195622.log 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187379.log 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164162.log 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.195622.log.gz 2023-10-03T10:23:06.415 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144608.log 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164162.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.167175.log 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187379.log.gz 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164162.log.gz 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144608.log.gz 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167175.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167175.log.gz 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128482.log 2023-10-03T10:23:06.416 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179825.log 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128482.log: /var/log/ceph/ceph-client.admin.179825.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128482.log.gz 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179825.log.gz 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167103.log 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130281.log 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124925.log 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167103.log.gz 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187085.log 2023-10-03T10:23:06.417 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140492.log 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124925.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130281.log.gz 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177793.log 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.124925.log.gz 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187085.log.gz 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162685.log 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140492.log.gz 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177793.log: /var/log/ceph/ceph-client.admin.162685.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177793.log.gz 2023-10-03T10:23:06.418 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162685.log.gz 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158543.log 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158641.log 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193466.log 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158543.log.gz 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158641.log: /var/log/ceph/ceph-client.admin.193466.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158641.log.gz 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193466.log.gz 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160797.log 2023-10-03T10:23:06.419 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145418.log 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140545.log 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160797.log.gz 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142333.log 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169037.log 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140545.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145418.log.gz 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191406.log 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140545.log.gz 2023-10-03T10:23:06.420 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142333.log.gz 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122441.log 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.169037.log.gz 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172991.log 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122441.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191406.log.gz 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122441.log.gz/var/log/ceph/ceph-client.admin.172991.log: 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172991.log.gz 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128299.log 2023-10-03T10:23:06.421 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130564.log 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127875.log 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128299.log.gz 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172305.log 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173579.log 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127875.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130564.log.gz 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127875.log.gz 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172305.log.gz 2023-10-03T10:23:06.422 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173579.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173579.log.gz 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118556.log 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137178.log 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161385.log 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118556.log.gz 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183165.log 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165803.log 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161385.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137178.log.gz 2023-10-03T10:23:06.423 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183165.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161385.log.gz 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183165.log.gz 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165803.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165803.log.gz 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190449.log 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148170.log 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161581.log 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190449.log.gz 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169945.log 2023-10-03T10:23:06.424 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143705.log 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161581.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148170.log.gz 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169945.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161581.log.gz 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6%/var/log/ceph/ceph-client.admin.143705.log: -- replaced with /var/log/ceph/ceph-client.admin.169945.log.gz 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143705.log.gz 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139786.log 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146504.log 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149347.log 2023-10-03T10:23:06.425 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139786.log.gz 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164554.log 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190918.log 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149347.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.146504.log.gz 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143118.log 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149347.log.gz 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164554.log.gz/var/log/ceph/ceph-client.admin.190918.log: 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180021.log 2023-10-03T10:23:06.426 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143118.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190918.log.gz 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180021.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143118.log.gz 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123824.log 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180021.log.gz 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169259.log 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158765.log 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123824.log: /var/log/ceph/ceph-client.admin.169259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194642.log 2023-10-03T10:23:06.427 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123824.log.gz 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.169259.log.gz 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158765.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158765.log.gz 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194642.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194642.log.gz 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155113.log 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169429.log 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176983.log 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155113.log.gz 2023-10-03T10:23:06.428 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169429.log: /var/log/ceph/ceph-client.admin.176983.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169429.log.gz 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176983.log.gz 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185053.log 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149544.log 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156413.log 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.185053.log.gz 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164555.log 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156413.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149544.log.gz 2023-10-03T10:23:06.429 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156413.log.gz 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161875.log 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164555.log.gz 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151283.log 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192094.log 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161875.log.gz 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151283.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151283.log.gz 2023-10-03T10:23:06.430 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192094.log.gz 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190374.log 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185151.log 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141276.log 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185151.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190374.log.gz 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147386.log 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185151.log.gz 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141276.log: /var/log/ceph/ceph-client.admin.147386.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141276.log.gz 2023-10-03T10:23:06.431 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147386.log.gz 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173161.log 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152655.log 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169847.log 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152655.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173161.log.gz 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.152655.log.gz 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169847.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.169847.log.gz 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188751.log 2023-10-03T10:23:06.432 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176127.log 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174853.log 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188751.log.gz 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150695.log 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174853.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.176127.log.gz 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138924.log 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174853.log.gz 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150695.log: /var/log/ceph/ceph-client.admin.138924.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150695.log.gz 2023-10-03T10:23:06.433 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138924.log.gz 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127219.log 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170435.log 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130693.log 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127219.log.gz 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124631.log 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140518.log 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170435.log.gz/var/log/ceph/ceph-client.admin.130693.log: 2023-10-03T10:23:06.434 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130693.log.gz 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124631.log.gz 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140518.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140518.log.gz 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144491.log 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172893.log 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168671.log 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144491.log.gz 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186523.log 2023-10-03T10:23:06.435 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167005.log 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168671.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172893.log.gz 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186523.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168671.log.gz 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186523.log.gz 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167005.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167005.log.gz 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142529.log 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150499.log 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171023.log 2023-10-03T10:23:06.436 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142529.log.gz 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157661.log 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154321.log 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150499.log.gz 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157661.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.171023.log.gz 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157661.log.gz 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154321.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154321.log.gz 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158863.log 2023-10-03T10:23:06.437 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179263.log 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138631.log 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158863.log.gz 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195690.log 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179361.log 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138631.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179263.log.gz 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161117.log 2023-10-03T10:23:06.438 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138631.log.gz 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179361.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195690.log.gz 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169651.log 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179361.log.gz 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161117.log: /var/log/ceph/ceph-client.admin.169651.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161117.log.gz 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169651.log.gz 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164359.log 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122559.log 2023-10-03T10:23:06.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152877.log 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122559.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164359.log.gz 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122559.log.gz 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152877.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152877.log.gz 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141695.log 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147092.log 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179237.log 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141695.log.gz 2023-10-03T10:23:06.440 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147092.log.gz 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179237.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179237.log.gz 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154249.log 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189590.log 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175513.log 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154249.log.gz 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189590.log: /var/log/ceph/ceph-client.admin.175513.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189590.log.gz 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175513.log.gz 2023-10-03T10:23:06.441 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178773.log 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169161.log 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170507.log 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178773.log.gz 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181231.log 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169161.log.gz 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170507.log: /var/log/ceph/ceph-client.admin.181231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170507.log.gz 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181231.log.gz 2023-10-03T10:23:06.442 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187818.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139316.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118612.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187818.log.gz 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142870.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166489.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118612.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139316.log.gz 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171709.log 2023-10-03T10:23:06.443 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118612.log.gz 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142870.log.gz 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125268.log 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171709.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166489.log.gz 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171709.log.gz 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170899.log 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125268.log.gz 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151309.log 2023-10-03T10:23:06.444 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168743.log 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170899.log.gz 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187671.log 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137152.log 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168743.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151309.log.gz 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127829.log 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168743.log.gz 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137152.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187671.log.gz 2023-10-03T10:23:06.445 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185615.log 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137152.log.gz 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127829.log: /var/log/ceph/ceph-client.admin.185615.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127829.log.gz 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.185615.log.gz 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191826.log 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178061.log 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185543.log 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178061.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191826.log.gz 2023-10-03T10:23:06.446 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.178061.log.gz 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185543.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185543.log.gz 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173677.log 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124876.log 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177891.log 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124876.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173677.log.gz 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124876.log.gz 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177891.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177891.log.gz 2023-10-03T10:23:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194348.log 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146798.log 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183655.log 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194348.log.gz 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146798.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146798.log.gz 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188455.log 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140591.log 2023-10-03T10:23:06.448 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183655.log.gz 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162757.log 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188455.log.gz 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136127.log 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.140591.log.gz--verbose 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr:-- /var/log/ceph/ceph-client.admin.158275.log 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162757.log: /var/log/ceph/ceph-client.admin.136127.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162757.log.gz 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158275.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136127.log.gz 2023-10-03T10:23:06.449 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158275.log.gz 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144216.log 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140957.log 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182113.log 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144216.log.gz 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140957.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-03T10:23:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140957.log.gz 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155505.log 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mgr.x.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182113.log.gz 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155603.log 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155505.log: /var/log/ceph/ceph-client.admin.155603.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.155505.log.gz 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155603.log.gz 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180047.log 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149248.log 2023-10-03T10:23:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180047.log: /var/log/ceph/ceph-client.admin.149248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180047.log.gz 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.149248.log.gz 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157759.log 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143876.log 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138584.log 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143876.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157759.log.gz 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138584.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143876.log.gz 2023-10-03T10:23:06.452 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138584.log.gz 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146282.log 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161411.log 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146282.log: /var/log/ceph/ceph-client.admin.161411.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146282.log.gz 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161411.log.gz 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137008.log 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148856.log 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182871.log 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148856.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137008.log.gz 2023-10-03T10:23:06.453 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182871.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148856.log.gz 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182871.log.gz 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189835.log 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146870.log 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164261.log 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146870.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189835.log.gz 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146870.log.gz 2023-10-03T10:23:06.454 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164261.log.gz 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183191.log 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163647.log 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194962.log 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163647.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183191.log.gz 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194962.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.163647.log.gz 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194962.log.gz 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122853.log 2023-10-03T10:23:06.455 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123210.log 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165411.log 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123210.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122853.log.gz 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165411.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123210.log.gz 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165411.log.gz 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160823.log 2023-10-03T10:23:06.456 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180145.log 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137847.log 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180145.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160823.log.gz 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137847.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180145.log.gz 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137847.log.gz 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178969.log 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174167.log 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178969.log: /var/log/ceph/ceph-client.admin.174167.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178969.log.gz 2023-10-03T10:23:06.457 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174167.log.gz 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153047.log 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153759.log 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157001.log 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153047.log.gz 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157001.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153759.log.gz 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149052.log 2023-10-03T10:23:06.458 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.157001.log.gz 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167763.log 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149052.log: /var/log/ceph/ceph-client.admin.167763.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149052.log.gz 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167763.log.gz 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164163.log 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190423.log 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195034.log 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190423.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164163.log.gz 2023-10-03T10:23:06.459 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195034.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190423.log.gz 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195034.log.gz 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129816.log 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172109.log 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157491.log 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172109.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129816.log.gz 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157491.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172109.log.gz 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157491.log.gz 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128788.log 2023-10-03T10:23:06.460 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147654.log 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182309.log 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128788.log.gz 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182309.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147654.log.gz 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.182309.log.gz 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155825.log 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139564.log 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125366.log 2023-10-03T10:23:06.461 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139564.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.155825.log.gz 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125366.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139564.log.gz 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.125366.log.gz 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153243.log 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141153.log 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135173.log 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141153.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153243.log.gz 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.135173.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141153.log.gz 2023-10-03T10:23:06.462 INFO:teuthology.orchestra.run.smithi125.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135173.log.gz 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164849.log 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170409.log 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171121.log 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170409.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164849.log.gz 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171121.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170409.log.gz 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.171121.log.gz 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184465.log 2023-10-03T10:23:06.463 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152949.log 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165607.log 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152949.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184465.log.gz 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165607.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152949.log.gz 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165607.log.gz 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190818.log 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150204.log 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129473.log 2023-10-03T10:23:06.464 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.190818.log.gz 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150204.log: /var/log/ceph/ceph-client.admin.129473.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.150204.log.gz 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129473.log.gz 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171913.log 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123406.log 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186229.log 2023-10-03T10:23:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123406.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171913.log.gz 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186229.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123406.log.gz 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.186229.log.gz 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176003.log 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146772.log 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149714.log 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146772.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176003.log.gz 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146772.log.gz 2023-10-03T10:23:06.466 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149714.log.gz 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145320.log 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123602.log 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164947.log 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123602.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145320.log.gz 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164947.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123602.log.gz 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164947.log.gz 2023-10-03T10:23:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182479.log 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151799.log 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143040.log 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182479.log.gz 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143040.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151799.log.gz 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143040.log.gz 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145221.log 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147360.log 2023-10-03T10:23:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179165.log 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147360.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145221.log.gz 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179165.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.147360.log.gz 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137970.log 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179165.log.gz 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165241.log 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137970.log: /var/log/ceph/ceph-client.admin.165241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137970.log.gz 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165241.log.gz 2023-10-03T10:23:06.469 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168279.log 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160307.log 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187305.log 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168279.log.gz 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195550.log 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160307.log.gz 2023-10-03T10:23:06.470 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124778.log 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195550.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.187305.log.gz-- 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150721.log 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195550.log.gz 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170703.log 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124778.log.gz 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192729.log 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191994.log 2023-10-03T10:23:06.471 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150721.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170703.log: /var/log/ceph/ceph-client.admin.192729.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170703.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192729.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161091.log 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139002.log 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161091.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191994.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161091.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139002.log.gz 2023-10-03T10:23:06.472 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193074.log 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172207.log 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139734.log 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4%/var/log/ceph/ceph-client.admin.172207.log: -- replaced with /var/log/ceph/ceph-client.admin.193074.log.gz 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137800.log 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139734.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172207.log.gz 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137800.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139734.log.gz 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181205.log 2023-10-03T10:23:06.473 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137800.log.gz 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141472.log 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177375.log 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181205.log.gz 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176395.log 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128454.log 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141472.log.gz 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176395.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177375.log.gz 2023-10-03T10:23:06.474 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128454.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176395.log.gz 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128454.log.gz 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162195.log 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171611.log 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152779.log 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162195.log.gz 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168155.log 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157857.log 2023-10-03T10:23:06.475 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171611.log.gz 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168155.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152779.log.gz 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168155.log.gz 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156805.log 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141956.log 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157857.log.gz 2023-10-03T10:23:06.476 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153929.log 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139708.log 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141956.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156805.log.gz 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141956.log.gz 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153929.log.gz 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184537.log 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184929.log 2023-10-03T10:23:06.477 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139708.log.gz 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185713.log 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140884.log 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184929.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184537.log.gz 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185713.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.184929.log.gz 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185713.log.gz 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163281.log 2023-10-03T10:23:06.478 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179139.log 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140884.log.gz 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142281.log 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181793.log 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163281.log.gz 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:gzip /var/log/ceph/ceph-client.admin.142281.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.171781.log 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179139.log.gz 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181793.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142281.log.gz 2023-10-03T10:23:06.479 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194885.log 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181793.log.gz 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171781.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171781.log.gz 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194885.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194885.log.gz 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128792.log 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143092.log 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128792.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128792.log.gz 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143092.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143092.log.gz 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177205.log 2023-10-03T10:23:06.480 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163673.log 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129718.log 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0%/var/log/ceph/ceph-client.admin.163673.log: -- replaced with /var/log/ceph/ceph-client.admin.177205.log.gz 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163673.log.gz 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129718.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129718.log.gz 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183289.log 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148660.log 2023-10-03T10:23:06.481 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143628.log 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0%/var/log/ceph/ceph-client.admin.148660.log: -- replaced with /var/log/ceph/ceph-client.admin.183289.log.gz 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148660.log.gz 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143628.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.143628.log.gz 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187183.log 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177401.log 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172671.log 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6%/var/log/ceph/ceph-client.admin.177401.log: -- replaced with /var/log/ceph/ceph-client.admin.187183.log.gz 2023-10-03T10:23:06.482 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177401.log.gz 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172671.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172671.log.gz 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125878.log 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196229.log 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141363.log 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125878.log.gz/var/log/ceph/ceph-client.admin.196229.log: 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143236.log 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.196229.log.gz 2023-10-03T10:23:06.483 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141363.log: /var/log/ceph/ceph-client.admin.143236.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141363.log.gz 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143236.log.gz 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191161.log 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151185.log 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148438.log 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191161.log.gz 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146994.log 2023-10-03T10:23:06.484 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176225.log 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151185.log.gz 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148438.log.gz 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146994.log.gz 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141554.log 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176225.log.gz 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118873.log 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127754.log 2023-10-03T10:23:06.485 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141554.log.gz 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.118873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196278.log 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1%/var/log/ceph/ceph-client.admin.127754.log: -- replaced with /var/log/ceph/ceph-client.admin.118873.log.gz 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178381.log 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8%/var/log/ceph/ceph-client.admin.196278.log: -- replaced with /var/log/ceph/ceph-client.admin.127754.log.gz 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169919.log 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.196278.log.gz 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178381.log: /var/log/ceph/ceph-client.admin.169919.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178381.log.gz 2023-10-03T10:23:06.486 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169919.log.gz 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184759.log 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159451.log 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186915.log 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184759.log.gz 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159451.log.gz 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186915.log.gz 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-03T10:23:06.487 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168645.log 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145516.log 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125584.log 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168645.log.gz 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145516.log.gz 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125584.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125584.log.gz 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175905.log 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135976.log 2023-10-03T10:23:06.488 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175905.log: /var/log/ceph/ceph-client.admin.135976.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175905.log.gz 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135976.log.gz 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188847.log 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161803.log 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175709.log 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161803.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.188847.log.gz 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175709.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161803.log.gz 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175709.log.gz 2023-10-03T10:23:06.489 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143288.log 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146478.log 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143288.log: /var/log/ceph/ceph-client.admin.146478.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143288.log.gz 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146478.log.gz 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194838.log 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145712.log 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158739.log 2023-10-03T10:23:06.490 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145712.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.194838.log.gz 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158739.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145712.log.gz 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158739.log.gz 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141302.log 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123827.log 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140296.log 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123827.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141302.log.gz 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140296.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123827.log.gz 2023-10-03T10:23:06.491 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140296.log.gz 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127216.log 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170141.log 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127216.log: /var/log/ceph/ceph-client.admin.170141.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.127216.log.gz 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.170141.log.gz 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155309.log 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139368.log 2023-10-03T10:23:06.492 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155309.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139368.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155309.log.gz 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139368.log.gz 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181107.log 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181107.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181107.log.gz 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139172.log 2023-10-03T10:23:06.493 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139172.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139172.log.gz 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172403.log 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172403.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172403.log.gz 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144412.log 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144412.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144412.log.gz 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148268.log 2023-10-03T10:23:06.494 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148268.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148268.log.gz 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165045.log 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165045.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.165045.log.gz 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159523.log 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159523.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159523.log.gz 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163077.log 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163077.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163077.log.gz 2023-10-03T10:23:06.495 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159843.log 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159843.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.159843.log.gz 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190573.log 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190573.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190573.log.gz 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175637.log 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175637.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175637.log.gz 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180741.log 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180741.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180741.log.gz 2023-10-03T10:23:06.496 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177767.log 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177767.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177767.log.gz 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136223.log 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136223.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.136223.log.gz 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177499.log 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177499.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177499.log.gz 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164457.log 2023-10-03T10:23:06.497 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164457.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.164457.log.gz 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122706.log 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.122706.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122706.log.gz 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170115.log 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170115.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170115.log.gz 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144830.log 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144830.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.144830.log.gz 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167959.log 2023-10-03T10:23:06.498 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167959.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.167959.log.gz 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187013.log 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187013.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187013.log.gz 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161777.log 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161777.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161777.log.gz 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179727.log 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179727.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179727.log.gz 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189982.log 2023-10-03T10:23:06.499 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189982.log.gz 2023-10-03T10:23:06.500 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124193.log 2023-10-03T10:23:06.500 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124193.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124193.log.gz 2023-10-03T10:23:06.501 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129252.log 2023-10-03T10:23:06.501 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129252.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129252.log.gz 2023-10-03T10:23:06.501 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136640.log 2023-10-03T10:23:06.501 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136640.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136640.log.gz 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137252.log 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137252.log.gz 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185249.log 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185249.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185249.log.gz 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180439.log 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180439.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.180439.log.gz 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162391.log 2023-10-03T10:23:06.502 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162391.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162391.log.gz 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190253.log 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190253.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190253.log.gz 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168939.log 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168939.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168939.log.gz 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160993.log 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160993.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160993.log.gz 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192533.log 2023-10-03T10:23:06.503 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192533.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192533.log.gz 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152753.log 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152753.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152753.log.gz 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129669.log 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129669.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129669.log.gz 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183263.log 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183263.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.183263.log.gz 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176813.log 2023-10-03T10:23:06.504 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176813.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176813.log.gz 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183093.log 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183093.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183093.log.gz 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142060.log 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142060.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142060.log.gz 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142111.log 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142111.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142111.log.gz 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183877.log 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183877.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183877.log.gz 2023-10-03T10:23:06.505 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147948.log 2023-10-03T10:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147948.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147948.log.gz 2023-10-03T10:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123161.log 2023-10-03T10:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123161.log.gz 2023-10-03T10:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161901.log 2023-10-03T10:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161901.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161901.log.gz 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172011.log 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191630.log 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172011.log: /var/log/ceph/ceph-client.admin.191630.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172011.log.gz 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.191630.log.gz 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127366.log 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127366.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127366.log.gz 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168057.log 2023-10-03T10:23:06.507 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168057.log.gz 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171095.log 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171095.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171095.log.gz 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195984.log 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161483.log 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195984.log.gz 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181819.log 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161483.log: /var/log/ceph/ceph-client.admin.181819.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.161483.log.gz 2023-10-03T10:23:06.508 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181819.log.gz 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152165.log 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179629.log 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152165.log: /var/log/ceph/ceph-client.admin.179629.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152165.log.gz 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179629.log.gz 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187111.log 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144707.log 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187111.log: /var/log/ceph/ceph-client.admin.144707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187111.log.gz 2023-10-03T10:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144707.log.gz 2023-10-03T10:23:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173089.log 2023-10-03T10:23:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170997.log 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173089.log: /var/log/ceph/ceph-client.admin.170997.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173089.log.gz 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170997.log.gz 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191506.log 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137578.log 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191506.log: /var/log/ceph/ceph-client.admin.137578.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191506.log.gz 2023-10-03T10:23:06.574 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137578.log.gz 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144438.log 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182407.log 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144438.log: /var/log/ceph/ceph-client.admin.182407.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144438.log.gz 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182407.log.gz 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128065.log 2023-10-03T10:23:06.575 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148144.log 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128065.log: /var/log/ceph/ceph-client.admin.148144.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128065.log.gz 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148144.log.gz 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195426.log 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163477.log 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195426.log: /var/log/ceph/ceph-client.admin.163477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195426.log.gz 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.163477.log.gz 2023-10-03T10:23:06.576 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180617.log 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153269.log 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180617.log: /var/log/ceph/ceph-client.admin.153269.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180617.log.gz 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153269.log.gz 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152485.log 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165142.log 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150525.log 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152485.log.gz 2023-10-03T10:23:06.577 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165142.log: /var/log/ceph/ceph-client.admin.150525.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165142.log.gz 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150525.log.gz 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145026.log 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145026.log: /var/log/ceph/ceph-mon.c.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145026.log.gz 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194446.log 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194446.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194446.log.gz 2023-10-03T10:23:06.578 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188210.log 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188210.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188210.log.gz 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188798.log 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188798.log.gz 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180119.log 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180119.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180119.log.gz 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180545.log 2023-10-03T10:23:06.579 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180545.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180545.log.gz 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142112.log 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142112.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142112.log.gz 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178257.log 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178257.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178257.log.gz 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150400.log 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150400.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150400.log.gz 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166711.log 2023-10-03T10:23:06.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166711.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166711.log.gz 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144315.log 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144315.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144315.log.gz 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185125.log 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185125.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185125.log.gz 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182087.log 2023-10-03T10:23:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182087.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.182087.log.gz 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136321.log 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136321.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136321.log.gz 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158935.log 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158935.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158935.log.gz 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145123.log 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145123.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145123.log.gz 2023-10-03T10:23:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175049.log 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175049.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175049.log.gz 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178675.log 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178675.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.178675.log.gz 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160405.log 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160405.log.gz 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145916.log 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145916.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145916.log.gz 2023-10-03T10:23:06.583 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163379.log 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163379.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163379.log.gz 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130370.log 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.130370.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130370.log.gz 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156093.log 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156093.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.156093.log.gz 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186203.log 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186203.log.gz 2023-10-03T10:23:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124219.log 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124219.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124219.log.gz 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175343.log 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175343.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175343.log.gz 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185739.log 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185739.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185739.log.gz 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195837.log 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195837.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195837.log.gz 2023-10-03T10:23:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164751.log 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164751.log.gz 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160601.log 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160601.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160601.log.gz 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152975.log 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152975.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152975.log.gz 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178355.log 2023-10-03T10:23:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178355.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178355.log.gz 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184955.log 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184955.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184955.log.gz 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172965.log 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172965.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172965.log.gz 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186007.log 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186007.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.186007.log.gz 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176911.log 2023-10-03T10:23:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176911.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176911.log.gz 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123061.log 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123061.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123061.log.gz 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165731.log 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165731.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165731.log.gz 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161999.log 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161999.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161999.log.gz 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-03T10:23:06.588 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157563.log 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140100.log 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157563.log: /var/log/ceph/ceph-client.admin.140100.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157563.log.gz 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140100.log.gz 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187475.log 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155041.log 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187475.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187475.log.gz 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155041.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155041.log.gz 2023-10-03T10:23:06.589 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161287.log 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171887.log 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.161287.log: /var/log/ceph/ceph-client.admin.171887.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161287.log.gz 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171887.log.gz 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153661.log 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166515.log 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153661.log: /var/log/ceph/ceph-client.admin.166515.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153661.log.gz 2023-10-03T10:23:06.590 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166515.log.gz 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139120.log 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177473.log 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139120.log: /var/log/ceph/ceph-client.admin.177473.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139120.log.gz 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177473.log.gz 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148340.log 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184341.log 2023-10-03T10:23:06.591 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.148340.log: /var/log/ceph/ceph-client.admin.184341.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.148340.log.gz 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184341.log.gz 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167495.log 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183779.log 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167495.log: /var/log/ceph/ceph-client.admin.183779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167495.log.gz 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183779.log.gz 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160699.log 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185223.log 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160699.log: /var/log/ceph/ceph-client.admin.185223.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160699.log.gz 2023-10-03T10:23:06.592 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185223.log.gz 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186497.log 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136174.log 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175539.log 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186497.log.gz 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136174.log: /var/log/ceph/ceph-client.admin.175539.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136174.log.gz 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175539.log.gz 2023-10-03T10:23:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170311.log 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137748.log 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170311.log: /var/log/ceph/ceph-client.admin.137748.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170311.log.gz 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137748.log.gz 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163378.log 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153831.log 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163378.log: /var/log/ceph/ceph-client.admin.153831.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163378.log.gz 2023-10-03T10:23:06.594 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153831.log.gz 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147752.log 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179531.log 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147752.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147752.log.gz 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179531.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179531.log.gz 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168181.log 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124680.log 2023-10-03T10:23:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168181.log: /var/log/ceph/ceph-client.admin.124680.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.168181.log.gz 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124680.log.gz 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139982.log 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139982.log: /var/log/ceph/ceph.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139982.log.gz 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141890.log 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138043.log 2023-10-03T10:23:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141890.log: /var/log/ceph/ceph-client.admin.138043.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141890.log.gz 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138043.log.gz 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150328.log 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150597.log 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150328.log: /var/log/ceph/ceph-client.admin.150597.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.150328.log.gz 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150597.log.gz 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175735.log 2023-10-03T10:23:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155923.log 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.175735.log: /var/log/ceph/ceph-client.admin.155923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175735.log.gz 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.155923.log.gz 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193002.log 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123259.log: /var/log/ceph/ceph-client.admin.193002.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193002.log.gz 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162953.log 2023-10-03T10:23:06.598 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179557.log 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162953.log: /var/log/ceph/ceph-client.admin.179557.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.162953.log.gz 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.179557.log.gz 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171513.log 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184439.log 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171513.log: /var/log/ceph/ceph-client.admin.184439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171513.log.gz 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.184439.log.gz 2023-10-03T10:23:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160235.log 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188091.log 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160235.log: /var/log/ceph/ceph-client.admin.188091.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160235.log.gz 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188091.log.gz 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195788.log 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157099.log 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195788.log: /var/log/ceph/ceph-client.admin.157099.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195788.log.gz 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157099.log.gz 2023-10-03T10:23:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171487.log 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184243.log 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.171487.log: /var/log/ceph/ceph-client.admin.184243.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171487.log.gz 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.184243.log.gz 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194936.log 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148954.log 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194936.log: /var/log/ceph/ceph-client.admin.148954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194936.log.gz 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148954.log.gz 2023-10-03T10:23:06.601 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140688.log 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141864.log 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140688.log: /var/log/ceph/ceph-client.admin.141864.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140688.log.gz 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141864.log.gz 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159327.log 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147458.log 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159327.log: /var/log/ceph/ceph-client.admin.147458.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159327.log.gz 2023-10-03T10:23:06.602 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147458.log.gz 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125170.log 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155335.log 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125170.log: /var/log/ceph/ceph-client.admin.155335.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125170.log.gz 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155335.log.gz 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146406.log 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185935.log 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.146406.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146406.log.gz 2023-10-03T10:23:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185935.log.gz 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138976.log 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124388.log 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138976.log: /var/log/ceph/ceph-client.admin.124388.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138976.log.gz 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124388.log.gz 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193709.log 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162587.log 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193709.log: /var/log/ceph/ceph-client.admin.162587.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193709.log.gz 2023-10-03T10:23:06.604 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162587.log.gz 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185517.log 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129571.log 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185517.log: /var/log/ceph/ceph-client.admin.129571.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185517.log.gz 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125633.log 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129571.log.gz 2023-10-03T10:23:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127221.log 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125633.log: /var/log/ceph/ceph-client.admin.127221.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125633.log.gz 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127221.log.gz 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157197.log 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158667.log 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157197.log: /var/log/ceph/ceph-client.admin.158667.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157197.log.gz 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158667.log.gz 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129280.log 2023-10-03T10:23:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173285.log 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.129280.log: /var/log/ceph/ceph-client.admin.173285.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129280.log.gz 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173285.log.gz 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126939.log 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139367.log 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.126939.log: /var/log/ceph/ceph-client.admin.139367.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.126939.log.gz 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139367.log.gz 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137456.log 2023-10-03T10:23:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190178.log 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137456.log: /var/log/ceph/ceph-client.admin.190178.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137456.log.gz 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190178.log.gz 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188163.log 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193317.log 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188163.log: /var/log/ceph/ceph-client.admin.193317.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188163.log.gz 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193317.log.gz 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128916.log 2023-10-03T10:23:06.608 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144242.log 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128916.log: /var/log/ceph/ceph-client.admin.144242.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128916.log.gz 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144242.log.gz 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181597.log 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181427.log 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181597.log: /var/log/ceph/ceph-client.admin.181427.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181597.log.gz 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181427.log.gz 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185347.log 2023-10-03T10:23:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130159.log 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.185347.log: /var/log/ceph/ceph-client.admin.130159.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185347.log.gz 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130159.log.gz 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191114.log 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159059.log 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191114.log: /var/log/ceph/ceph-client.admin.159059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191114.log.gz 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159059.log.gz 2023-10-03T10:23:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155897.log 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149124.log 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155897.log: /var/log/ceph/ceph-client.admin.149124.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.155897.log.gz 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149124.log.gz 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143654.log 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165730.log 2023-10-03T10:23:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143654.log: /var/log/ceph/ceph-client.admin.165730.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143654.log.gz 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165730.log.gz 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127091.log 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186817.log 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127091.log: /var/log/ceph/ceph-client.admin.186817.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127091.log.gz 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186817.log.gz 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178479.log 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191898.log 2023-10-03T10:23:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178479.log: /var/log/ceph/ceph-client.admin.191898.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.178479.log.gz 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191898.log.gz 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141375.log 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157073.log 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141375.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141375.log.gz 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157073.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157073.log.gz 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156387.log 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148928.log 2023-10-03T10:23:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156387.log: /var/log/ceph/ceph-client.admin.148928.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156387.log.gz 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148928.log.gz 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145613.log 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167201.log 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145613.log: /var/log/ceph/ceph-client.admin.167201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145613.log.gz 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.167201.log.gz 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188259.log 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111887.log 2023-10-03T10:23:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188259.log: /var/log/ceph/ceph.tmp-client.admin.111887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188259.log.gz 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111887.log.gz 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163770.log 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152263.log 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.163770.log: /var/log/ceph/ceph-client.admin.152263.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163770.log.gz 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152263.log.gz 2023-10-03T10:23:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137034.log 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165999.log 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137034.log: /var/log/ceph/ceph-client.admin.165999.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137034.log.gz 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195739.log 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165999.log.gz 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190769.log 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.195739.log: /var/log/ceph/ceph-client.admin.190769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195739.log.gz 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.190769.log.gz 2023-10-03T10:23:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186425.log 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153955.log 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186425.log: /var/log/ceph/ceph-client.admin.153955.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186425.log.gz 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.153955.log.gz 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162267.log 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162561.log 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162267.log: /var/log/ceph/ceph-client.admin.162561.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162267.log.gz 2023-10-03T10:23:06.617 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162561.log.gz 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140983.log 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186987.log 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140983.log: /var/log/ceph/ceph-client.admin.186987.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140983.log.gz 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186987.log.gz 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137382.log 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175317.log 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137382.log: /var/log/ceph/ceph-client.admin.175317.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137382.log.gz 2023-10-03T10:23:06.618 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175317.log.gz 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170925.log 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190526.log 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170925.log: /var/log/ceph/ceph-client.admin.190526.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170925.log.gz 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190526.log.gz 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160209.log 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145988.log 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160209.log: /var/log/ceph/ceph-client.admin.145988.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160209.log.gz 2023-10-03T10:23:06.619 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.145988.log.gz 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168769.log 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185837.log 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168769.log: /var/log/ceph/ceph-client.admin.185837.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168769.log.gz 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185837.log.gz 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145711.log 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155433.log 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145711.log: /var/log/ceph/ceph-client.admin.155433.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145711.log.gz 2023-10-03T10:23:06.620 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155433.log.gz 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127666.log 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127335.log 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127666.log: /var/log/ceph/ceph-client.admin.127335.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127666.log.gz 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127335.log.gz 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154027.log 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146112.log 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154027.log: /var/log/ceph/ceph-client.admin.146112.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154027.log.gz 2023-10-03T10:23:06.621 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146112.log.gz 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159621.log 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182773.log 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159621.log: /var/log/ceph/ceph-client.admin.182773.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159621.log.gz 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.182773.log.gz 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194152.log 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182211.log 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194152.log: /var/log/ceph/ceph-client.admin.182211.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194152.log.gz 2023-10-03T10:23:06.622 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182211.log.gz 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150106.log 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170337.log 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150106.log: /var/log/ceph/ceph-client.admin.170337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150106.log.gz 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170337.log.gz 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166319.log 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171807.log 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166319.log: /var/log/ceph/ceph-client.admin.171807.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166319.log.gz 2023-10-03T10:23:06.623 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171807.log.gz 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183361.log 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154551.log 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183361.log: /var/log/ceph/ceph-client.admin.154551.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183361.log.gz 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154551.log.gz 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167397.log 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175807.log 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167397.log: /var/log/ceph/ceph-client.admin.175807.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167397.log.gz 2023-10-03T10:23:06.624 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175807.log.gz 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160137.log 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155995.log 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160137.log: /var/log/ceph/ceph-client.admin.155995.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160137.log.gz 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155995.log.gz 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191432.log 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175931.log 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191432.log: /var/log/ceph/ceph-client.admin.175931.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.191432.log.gz 2023-10-03T10:23:06.625 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175931.log.gz 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147190.log 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140395.log 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147190.log: /var/log/ceph/ceph-client.admin.140395.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147190.log.gz 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140395.log.gz 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191602.log 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176323.log 2023-10-03T10:23:06.626 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191602.log: /var/log/ceph/ceph-client.admin.176323.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.191602.log.gz 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176323.log.gz 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182185.log 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138414.log 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182185.log: /var/log/ceph/ceph-client.admin.138414.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182185.log.gz 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138414.log.gz 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177277.log 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144663.log 2023-10-03T10:23:06.627 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177277.log: /var/log/ceph/ceph-client.admin.144663.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177277.log.gz 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144663.log.gz 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124337.log 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136639.log 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.124337.log: /var/log/ceph/ceph-client.admin.136639.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124337.log.gz 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136639.log.gz 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180643.log 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184171.log 2023-10-03T10:23:06.628 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180643.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180643.log.gz 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184171.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.184171.log.gz 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174141.log 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140761.log 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174141.log: /var/log/ceph/ceph-client.admin.140761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174141.log.gz 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140761.log.gz 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184635.log 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125682.log 2023-10-03T10:23:06.629 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184635.log: /var/log/ceph/ceph-client.admin.125682.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184635.log.gz 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125682.log.gz 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181133.log 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149222.log 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.181133.log: /var/log/ceph/ceph-client.admin.149222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181133.log.gz 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149222.log.gz 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184145.log 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166881.log 2023-10-03T10:23:06.630 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184145.log: /var/log/ceph/ceph-client.admin.166881.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184145.log.gz 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166881.log.gz 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178577.log 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118764.log 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.178577.log: /var/log/ceph/ceph-client.admin.118764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178577.log.gz 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118764.log.gz 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167077.log 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145222.log 2023-10-03T10:23:06.631 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167077.log: /var/log/ceph/ceph-client.admin.145222.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167077.log.gz 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145222.log.gz 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156609.log 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191210.log 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156609.log: /var/log/ceph/ceph-client.admin.191210.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156609.log.gz 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191210.log.gz 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123357.log 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187622.log 2023-10-03T10:23:06.632 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123357.log: /var/log/ceph/ceph-client.admin.187622.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123357.log.gz 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187622.log.gz 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174533.log 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141106.log 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174533.log: 88.3%/var/log/ceph/ceph-client.admin.141106.log: -- replaced with /var/log/ceph/ceph-client.admin.174533.log.gz 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141106.log.gz 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194493.log 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163157.log 2023-10-03T10:23:06.633 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194493.log: /var/log/ceph/ceph-client.admin.163157.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194493.log.gz 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163157.log.gz 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189043.log 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153439.log 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189043.log: /var/log/ceph/ceph-client.admin.153439.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.189043.log.gz 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153439.log.gz 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193368.log 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175611.log 2023-10-03T10:23:06.634 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193368.log: /var/log/ceph/ceph-client.admin.175611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.193368.log.gz 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.175611.log.gz 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177963.log 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191310.log 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.177963.log: /var/log/ceph/ceph-client.admin.191310.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177963.log.gz 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191310.log.gz 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158347.log 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170605.log 2023-10-03T10:23:06.635 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158347.log: /var/log/ceph/ceph-client.admin.170605.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158347.log.gz 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170605.log.gz 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192386.log 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163255.log 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192386.log: /var/log/ceph/ceph-client.admin.163255.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192386.log.gz 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163255.log.gz 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127573.log 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152093.log 2023-10-03T10:23:06.636 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127573.log: /var/log/ceph/ceph-client.admin.152093.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127573.log.gz 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152093.log.gz 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160529.log 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180839.log 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.160529.log: 88.4%/var/log/ceph/ceph-client.admin.180839.log: -- replaced with /var/log/ceph/ceph-client.admin.160529.log.gz 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180839.log.gz 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150302.log 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177989.log 2023-10-03T10:23:06.637 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.150302.log: /var/log/ceph/ceph-client.admin.177989.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.150302.log.gz 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177989.log.gz 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162489.log 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154427.log 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162489.log: /var/log/ceph/ceph-client.admin.154427.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162489.log.gz 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154427.log.gz 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154223.log 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142699.log 2023-10-03T10:23:06.638 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154223.log: /var/log/ceph/ceph-client.admin.142699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154223.log.gz 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142699.log.gz 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152583.log 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136368.log 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152583.log: /var/log/ceph/ceph-client.admin.136368.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.152583.log.gz 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136368.log.gz 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166221.log 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140910.log 2023-10-03T10:23:06.639 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.166221.log: /var/log/ceph/ceph-client.admin.140910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166221.log.gz 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140910.log.gz 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193170.log 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158053.log 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.193170.log: /var/log/ceph/ceph-client.admin.158053.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193170.log.gz 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158053.log.gz 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183753.log 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127420.log 2023-10-03T10:23:06.640 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.183753.log: /var/log/ceph/ceph-client.admin.127420.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183753.log.gz 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127420.log.gz 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182799.log 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160725.log 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182799.log: /var/log/ceph/ceph-client.admin.160725.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182799.log.gz 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160725.log.gz 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142726.log 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190622.log 2023-10-03T10:23:06.641 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142726.log: /var/log/ceph/ceph-client.admin.190622.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142726.log.gz 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190622.log.gz 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168965.log 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179067.log 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168965.log: /var/log/ceph/ceph-client.admin.179067.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168965.log.gz 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179067.log.gz 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179459.log 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174951.log 2023-10-03T10:23:06.642 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179459.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179459.log.gz 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.174951.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174951.log.gz 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188406.log 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125927.log 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.188406.log: /var/log/ceph/ceph-client.admin.125927.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188406.log.gz 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125927.log.gz 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170213.log 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139956.log 2023-10-03T10:23:06.643 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170213.log: /var/log/ceph/ceph-client.admin.139956.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170213.log.gz 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139956.log.gz 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144904.log 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137204.log 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144904.log: /var/log/ceph/ceph-client.admin.137204.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144904.log.gz 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137204.log.gz 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190327.log 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173945.log 2023-10-03T10:23:06.644 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.190327.log: /var/log/ceph/ceph-client.admin.173945.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190327.log.gz 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173945.log.gz 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184733.log 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173357.log 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184733.log: /var/log/ceph/ceph-client.admin.173357.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184733.log.gz 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173357.log.gz 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169135.log 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181009.log 2023-10-03T10:23:06.645 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169135.log: /var/log/ceph/ceph-client.admin.181009.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169135.log.gz 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181009.log.gz 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186889.log 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151015.log 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186889.log: /var/log/ceph/ceph-client.admin.151015.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186889.log.gz 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.151015.log.gz 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186791.log 2023-10-03T10:23:06.646 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183583.log 2023-10-03T10:23:06.647 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186791.log: /var/log/ceph/ceph-client.admin.183583.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186791.log.gz 2023-10-03T10:23:06.647 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183583.log.gz 2023-10-03T10:23:06.647 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151577.log 2023-10-03T10:23:06.647 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138239.log 2023-10-03T10:23:06.668 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151577.log: /var/log/ceph/ceph-client.admin.138239.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151577.log.gz 2023-10-03T10:23:06.668 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138239.log.gz 2023-10-03T10:23:06.668 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168547.log 2023-10-03T10:23:06.668 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164039.log 2023-10-03T10:23:06.668 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.168547.log: /var/log/ceph/ceph-client.admin.164039.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.168547.log.gz 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164039.log.gz 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154347.log 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177179.log 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154347.log: /var/log/ceph/ceph-client.admin.177179.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154347.log.gz 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177179.log.gz 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141668.log 2023-10-03T10:23:06.669 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166391.log 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.141668.log: /var/log/ceph/ceph-client.admin.166391.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141668.log.gz 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166391.log.gz 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125317.log 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163574.log 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.125317.log: /var/log/ceph/ceph-client.admin.163574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125317.log.gz 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.163574.log.gz 2023-10-03T10:23:06.670 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128963.log 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156119.log 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128963.log: /var/log/ceph/ceph-client.admin.156119.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128963.log.gz 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.156119.log.gz 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172501.log 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146700.log 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172501.log: /var/log/ceph/ceph-client.admin.146700.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172501.log.gz 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.146700.log.gz 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172181.log 2023-10-03T10:23:06.671 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130468.log 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172181.log: /var/log/ceph/ceph-client.admin.130468.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172181.log.gz 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130468.log.gz 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154453.log 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164750.log 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154453.log: 89.2%/var/log/ceph/ceph-client.admin.164750.log: -- replaced with /var/log/ceph/ceph-client.admin.154453.log.gz 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164750.log.gz 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169625.log 2023-10-03T10:23:06.672 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148366.log 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169625.log: /var/log/ceph/ceph-client.admin.148366.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169625.log.gz 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148366.log.gz 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127621.log 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.127621.log: /var/log/ceph/ceph-osd.1.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127621.log.gz 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142932.log 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142932.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142932.log.gz 2023-10-03T10:23:06.673 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151897.log 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.151897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151897.log.gz 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136466.log 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.136466.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136466.log.gz 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156315.log 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156315.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156315.log.gz 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164627.log 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.164627.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164627.log.gz 2023-10-03T10:23:06.674 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143458.log 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143458.log.gz 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123455.log 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123455.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123455.log.gz 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139512.log 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139512.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139512.log.gz 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159719.log 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.159719.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159719.log.gz 2023-10-03T10:23:06.675 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144804.log 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.144804.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144804.log.gz 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182577.log 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182577.log.gz 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165633.log 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165633.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165633.log.gz 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194054.log 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194054.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.194054.log.gz 2023-10-03T10:23:06.676 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153073.log 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153073.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153073.log.gz 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147876.log 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.147876.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147876.log.gz 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172867.log 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172867.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172867.log.gz 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180937.log 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180937.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180937.log.gz 2023-10-03T10:23:06.677 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139904.log 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.139904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139904.log.gz 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169331.log 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.169331.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169331.log.gz 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158249.log 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158249.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158249.log.gz 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152191.log 2023-10-03T10:23:06.678 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.152191.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152191.log.gz 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157785.log 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.157785.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157785.log.gz 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172599.log 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172599.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172599.log.gz 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191237.log 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.191237.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191237.log.gz 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180519.log 2023-10-03T10:23:06.679 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180519.log.gz 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137944.log 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.137944.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137944.log.gz 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172083.log 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.172083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172083.log.gz 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128989.log 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128989.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128989.log.gz 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156485.log 2023-10-03T10:23:06.680 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.156485.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156485.log.gz 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179753.log 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.179753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179753.log.gz 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143706.log 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.143706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143706.log.gz 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180315.log 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180315.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.180315.log.gz 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173553.log 2023-10-03T10:23:06.681 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173553.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173553.log.gz 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173847.log 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173847.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173847.log.gz 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192022.log 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.192022.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192022.log.gz 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173873.log 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.173873.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173873.log.gz 2023-10-03T10:23:06.682 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128407.log 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128407.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128407.log.gz 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180341.log 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.180341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180341.log.gz 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176101.log 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.176101.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176101.log.gz 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189143.log 2023-10-03T10:23:06.683 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174363.log 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189143.log: /var/log/ceph/ceph-client.admin.174363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189143.log.gz 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174363.log.gz 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189935.log 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182015.log 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.189935.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189935.log.gz 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.182015.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.182015.log.gz 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140322.log 2023-10-03T10:23:06.684 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153635.log 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.140322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140322.log.gz 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.153635.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153635.log.gz 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158177.log 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138781.log 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158177.log: /var/log/ceph/ceph-client.admin.138781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158177.log.gz 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138781.log.gz 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167567.log 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.167567.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167567.log.gz 2023-10-03T10:23:06.685 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154151.log 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138415.log 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.154151.log: /var/log/ceph/ceph-client.admin.138415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154151.log.gz 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138415.log.gz 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186399.log 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149446.log 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.186399.log: /var/log/ceph/ceph-client.admin.149446.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186399.log.gz 2023-10-03T10:23:06.686 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149446.log.gz 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138336.log 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184831.log 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138336.log: /var/log/ceph/ceph-client.admin.184831.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138336.log.gz 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145124.log 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184831.log.gz 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181989.log 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145124.log: /var/log/ceph/ceph-client.admin.181989.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145124.log.gz 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181989.log.gz 2023-10-03T10:23:06.687 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165019.log 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188063.log 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.165019.log: /var/log/ceph/ceph-client.admin.188063.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165019.log.gz 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188063.log.gz 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194766.log 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184857.log 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.194766.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194766.log.gz 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.184857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184857.log.gz 2023-10-03T10:23:06.688 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162097.log 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145817.log 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162097.log: /var/log/ceph/ceph-client.admin.145817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162097.log.gz 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145817.log.gz 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123700.log 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181329.log 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123700.log: /var/log/ceph/ceph-client.admin.181329.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123700.log.gz 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181329.log.gz 2023-10-03T10:23:06.689 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142139.log 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189471.log 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.142139.log: /var/log/ceph/ceph-client.admin.189471.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142139.log.gz 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189471.log.gz 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170827.log 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150230.log 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.170827.log: /var/log/ceph/ceph-client.admin.150230.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170827.log.gz 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150230.log.gz 2023-10-03T10:23:06.690 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138362.log 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141080.log 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.138362.log: /var/log/ceph/ceph-client.admin.141080.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138362.log.gz 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141080.log.gz 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187967.log 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124974.log 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.187967.log: /var/log/ceph/ceph-client.admin.124974.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187967.log.gz 2023-10-03T10:23:06.691 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158151.log 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124974.log.gz 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155629.log 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155799.log 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.158151.log: /var/log/ceph/ceph-client.admin.155629.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158151.log.gz 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155799.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155629.log.gz 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155799.log.gz 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123651.log 2023-10-03T10:23:06.692 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142282.log 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.123651.log: /var/log/ceph/ceph-client.admin.142282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123651.log.gz 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142282.log.gz 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149321.log 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167299.log 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149321.log: /var/log/ceph/ceph-client.admin.167299.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.149321.log.gz 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.167299.log.gz 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162659.log 2023-10-03T10:23:06.693 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161019.log 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.162659.log: /var/log/ceph/ceph-client.admin.161019.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.162659.log.gz 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161019.log.gz 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149616.log 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193270.log 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.149616.log: /var/log/ceph/ceph-client.admin.193270.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149616.log.gz 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193270.log.gz 2023-10-03T10:23:06.694 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155015.log 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146968.log 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.155015.log: /var/log/ceph/ceph-client.admin.146968.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.155015.log.gz 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146968.log.gz 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145614.log 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160503.log 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.145614.log: /var/log/ceph/ceph-client.admin.160503.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145614.log.gz 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160503.log.gz 2023-10-03T10:23:06.695 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128612.log 2023-10-03T10:23:06.696 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139171.log 2023-10-03T10:23:06.696 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.128612.log: /var/log/ceph/ceph-client.admin.139171.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128612.log.gz 2023-10-03T10:23:06.696 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139171.log.gz 2023-10-03T10:23:06.751 INFO:teuthology.orchestra.run.smithi125.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-03T10:23:06.764 INFO:teuthology.orchestra.run.smithi125.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-03T10:23:06.812 INFO:teuthology.orchestra.run.smithi125.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-03T10:23:06.959 INFO:teuthology.orchestra.run.smithi125.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-03T10:23:07.004 INFO:teuthology.orchestra.run.smithi125.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-03T10:23:07.005 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-03T10:23:07.006 INFO:teuthology.orchestra.run.smithi125.stderr:real 0m1.005s 2023-10-03T10:23:07.006 INFO:teuthology.orchestra.run.smithi125.stderr:user 0m3.936s 2023-10-03T10:23:07.006 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m0.770s 2023-10-03T10:23:07.006 INFO:tasks.ceph:Archiving logs... 2023-10-03T10:23:07.007 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi125/log 2023-10-03T10:23:07.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:08.717 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi167/log 2023-10-03T10:23:08.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:08.753 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:08.763 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T10:23:08.782 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:08.785 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T10:23:08.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:08.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:08.908 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T10:23:08.918 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T10:23:08.919 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:08.921 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:08.940 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-03T10:23:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-10-03T10:23:08.945 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:08.945 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-03T10:23:08.945 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +645us[ +645us] +/- 72ms 2023-10-03T10:23:08.945 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -174us[ -174us] +/- 59ms 2023-10-03T10:23:08.945 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -320us[ -320us] +/- 79ms 2023-10-03T10:23:08.946 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-10-03T10:23:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +603us[ +603us] +/- 72ms 2023-10-03T10:23:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -202us[ -203us] +/- 59ms 2023-10-03T10:23:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -350us[ -350us] +/- 79ms 2023-10-03T10:23:08.948 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:08.948 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T10:23:08.958 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T10:23:08.958 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T10:23:08.969 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:09.041 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:09.131 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:09.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:09.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:09.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:09.196 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T10:23:09.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T10:23:09.219 INFO:teuthology.task.internal:Duration was 1447.892530 seconds 2023-10-03T10:23:09.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T10:23:09.229 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T10:23:09.230 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:09.232 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:09.751 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T10:23:09.752 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-10-03T10:23:09.752 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:09.781 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2023-10-03T10:23:09.781 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:09.804 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T10:23:09.804 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:09.824 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:09.882 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T10:23:09.882 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:09.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:09.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T10:23:10.000 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T10:23:10.001 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:10.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:10.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T10:23:10.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:10.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:10.102 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-10-03T10:23:10.126 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2023-10-03T10:23:10.139 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:10.196 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi125.front.sepia.ceph.com, flagging run as failed 2023-10-03T10:23:10.196 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:10.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:10.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T10:23:10.225 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T10:23:10.226 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi125 2023-10-03T10:23:10.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T10:24:33.237 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-03T10:24:33.605 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568/remote/smithi125/coredump/1696327918.126957.core.gz: gzip compressed data, was "1696327918.126957.core", last modified: Tue Oct 3 10:23:10 2023, max compression, original size modulo 2^32 1364250624 2023-10-03T10:24:33.606 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-03T10:24:39.946 INFO:teuthology.task.internal: core looks like: /tmp/tmp7woxnbrg: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/proc/self/exe', platform: 'x86_64' 2023-10-03T10:24:40.157 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-03T10:24:40.158 DEBUG:teuthology.orchestra.run.smithi125:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:24:40.181 INFO:teuthology.orchestra.run.smithi125.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-03T10:24:40.182 INFO:teuthology.orchestra.run.smithi125.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-03T10:24:40.182 INFO:teuthology.orchestra.run.smithi125.stdout:/usr/bin/ceph-mgr 2023-10-03T10:24:40.182 INFO:teuthology.orchestra.run.smithi125.stdout:/usr/bin/ceph 2023-10-03T10:24:40.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:40.183 INFO:teuthology.orchestra.run.smithi125.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-03T10:24:40.184 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-03T10:24:40.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T10:24:40.223 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T10:24:40.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T10:24:40.236 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T10:24:40.236 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:24:40.255 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:24:40.267 INFO:teuthology.orchestra.run.smithi125.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:24:40.267 INFO:teuthology.orchestra.run.smithi125.stdout: 525358 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:24:40.267 INFO:teuthology.orchestra.run.smithi125.stdout: 525359 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:11 /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 525601 360060 -rw------- 1 root root 1364250624 Oct 3 10:11 /home/ubuntu/cephtest/archive/coredump/1696327918.126957.core 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 655822 28 -rw------- 1 ubuntu ubuntu 27449 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 525485 4 -rw-rw-rw- 1 ubuntu ubuntu 775 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 525362 112 -rw-rw-r-- 1 ubuntu ubuntu 113463 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:24:40.268 INFO:teuthology.orchestra.run.smithi125.stdout: 525361 132 -rw-rw-rw- 1 ubuntu ubuntu 134282 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:24:40.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:40.269 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:24:40.270 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-03T10:24:40.282 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T10:24:40.294 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T10:24:40.360 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi125 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:24:40.361 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 525358 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223726 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 525485 4 -rw-rw-rw- 1 ubuntu ubuntu 891 Oct 3 10:21 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:24:40.368 INFO:teuthology.orchestra.run.smithi167.stdout: 525362 92 -rw-rw-r-- 1 ubuntu ubuntu 92500 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:24:40.369 INFO:teuthology.orchestra.run.smithi167.stdout: 525361 88 -rw-rw-rw- 1 ubuntu ubuntu 86578 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:24:40.369 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:24:40.393 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-03T10:24:40.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:24:40.417 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-03T10:24:40.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:24:40.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:46.371067', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPW21wSPrWg+e2zCzUBGgpqi3ldHVtstWGWks9X/CTU1m7MnklW98O/LTGyRbwvd0a4tHBLD80qAy22EnwD7iZs='} 2023-10-03T10:24:40.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:46.368675', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLiWOod+mpVQsSNdmAbjWWxo9+aMyr5y9bm6rTT1lFDhBsbX+PmOdU/qPDp/aq8vzVZs/2BX564XeISsneBrdw='} 2023-10-03T10:24:40.467 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-03T10:24:40.468 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:24:40.487 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-03T10:24:40.487 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:24:40.496 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-03T10:24:40.496 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:40.518 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-03T10:24:40.518 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:40.527 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-03T10:24:40.542 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-03T10:24:44.528 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:44.543 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:44.639 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-03T10:24:44.651 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-03T10:24:48.644 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:48.652 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:24:48.754 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-03T10:24:48.760 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-03T10:24:48.856 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-03T10:24:48.861 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-03T10:24:48.966 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} duration: 1447.8925297260284 failure_reason: 'Command failed on smithi125 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3ba1e34be62147e981b3101fe7613339 status: fail success: false 2023-10-03T10:24:48.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T10:24:49.039 INFO:teuthology.run:FAIL